2024-09-11T22:10:00.408 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T22:10:00.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T22:10:00.522 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901420 branch: squid description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901420' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - overall HEALTH_ - \(MON_DOWN\) - SLOW_OPS - slow request sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLoEJrCrBBIs15bJlc7xNGFpBTrZM6m8k4P0HQ5ANyyB8o92Si5xu4bDryGwj5HRhDjFQKRoQuGUlZWvQO7YbO0= smithi167.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFCzhNT3edH+qRJs8zcNb4ydg2SJdfB69ho/IF585eB9pnZ/Qib94uHdKnUJ+Us8d+//JuiKo6CRIaQV8XkeCKY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - mon_thrash: check_mds_failover: true revive_delay: 20 thrash_delay: 10 - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T22:10:00.522 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-11T22:10:00.523 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-11T22:10:00.523 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T22:10:00.524 INFO:teuthology.task.internal:Checking packages... 2024-09-11T22:10:00.545 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-11T22:10:00.546 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T22:10:00.546 INFO:teuthology.packaging:ref: None 2024-09-11T22:10:00.546 INFO:teuthology.packaging:tag: None 2024-09-11T22:10:00.546 INFO:teuthology.packaging:branch: squid 2024-09-11T22:10:00.546 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:10:00.546 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-11T22:10:00.756 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-11T22:10:00.758 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T22:10:00.764 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T22:10:00.765 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T22:10:00.771 INFO:teuthology.task.internal:Saving configuration 2024-09-11T22:10:00.789 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T22:10:00.796 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T22:10:00.822 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901420', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 22:04:55.927327', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLoEJrCrBBIs15bJlc7xNGFpBTrZM6m8k4P0HQ5ANyyB8o92Si5xu4bDryGwj5HRhDjFQKRoQuGUlZWvQO7YbO0='} 2024-09-11T22:10:00.845 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901420', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 22:04:55.925660', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFCzhNT3edH+qRJs8zcNb4ydg2SJdfB69ho/IF585eB9pnZ/Qib94uHdKnUJ+Us8d+//JuiKo6CRIaQV8XkeCKY='} 2024-09-11T22:10:00.845 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T22:10:00.851 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-09-11T22:10:00.851 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-09-11T22:10:00.851 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T22:10:00.912 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5758fd7be0>, signals=[15]) 2024-09-11T22:10:00.912 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T22:10:00.918 INFO:teuthology.task.internal:Opening connections... 2024-09-11T22:10:00.918 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2024-09-11T22:10:00.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:10:00.995 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi167.front.sepia.ceph.com 2024-09-11T22:10:00.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:10:01.069 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T22:10:01.076 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-09-11T22:10:01.094 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-09-11T22:10:01.095 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-09-11T22:10:01.152 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-09-11T22:10:01.152 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9" 2024-09-11T22:10:01.152 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-09-11T22:10:01.153 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-09-11T22:10:01.153 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9" 2024-09-11T22:10:01.153 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9" 2024-09-11T22:10:01.153 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T22:10:01.153 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-09-11T22:10:01.153 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon" 2024-09-11T22:10:01.153 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T22:10:01.153 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-09-11T22:10:01.153 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T22:10:01.153 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T22:10:01.153 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T22:10:01.154 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-09-11T22:10:01.176 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2024-09-11T22:10:01.193 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2024-09-11T22:10:01.194 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-09-11T22:10:01.251 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2024-09-11T22:10:01.251 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2024-09-11T22:10:01.251 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2024-09-11T22:10:01.251 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2024-09-11T22:10:01.251 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2024-09-11T22:10:01.251 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2024-09-11T22:10:01.251 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T22:10:01.252 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2024-09-11T22:10:01.252 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2024-09-11T22:10:01.252 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T22:10:01.252 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2024-09-11T22:10:01.252 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T22:10:01.252 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T22:10:01.252 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T22:10:01.252 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-09-11T22:10:01.276 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T22:10:01.285 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T22:10:01.290 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T22:10:01.290 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2024-09-11T22:10:01.293 DEBUG:teuthology.orchestra.run.smithi167:> test '!' -e /home/ubuntu/cephtest 2024-09-11T22:10:01.308 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T22:10:01.314 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T22:10:01.314 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2024-09-11T22:10:01.349 DEBUG:teuthology.orchestra.run.smithi167:> test -z $(ls -A /var/lib/ceph) 2024-09-11T22:10:01.379 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T22:10:01.422 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T22:10:01.450 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-11T22:10:01.450 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-11T22:10:01.450 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T22:10:01.451 DEBUG:teuthology.orchestra.run.smithi167:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T22:10:01.466 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:10:01.466 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2024-09-11T22:10:01.467 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:10:01.467 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-09-11T22:10:01.523 INFO:teuthology.orchestra.run.smithi167.stdout:5.14.0-503.el9.x86_64 2024-09-11T22:10:01.523 INFO:teuthology.task.kernel:Running kernel on smithi167: 5.14.0-503.el9.x86_64 2024-09-11T22:10:01.523 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum install -y kernel 2024-09-11T22:10:01.524 INFO:teuthology.orchestra.run.smithi100.stdout:5.14.0-503.el9.x86_64 2024-09-11T22:10:01.525 INFO:teuthology.task.kernel:Running kernel on smithi100: 5.14.0-503.el9.x86_64 2024-09-11T22:10:01.525 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum install -y kernel 2024-09-11T22:10:03.975 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-11T22:10:04.908 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.2 MB 00:01 2024-09-11T22:10:05.826 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-11T22:10:09.826 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 5.4 MB/s | 20 MB 00:03 2024-09-11T22:10:10.127 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-11T22:10:11.628 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 19 kB 00:00 2024-09-11T22:10:12.515 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-11T22:10:14.376 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 8.4 MB/s | 6.5 MB 00:00 2024-09-11T22:10:15.843 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 19 kB 00:00 2024-09-11T22:10:17.006 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-11T22:10:17.904 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-11T22:10:19.936 INFO:teuthology.orchestra.run.smithi167.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T22:10:19.936 INFO:teuthology.orchestra.run.smithi167.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T22:10:20.026 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-11T22:10:20.034 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-11T22:10:20.034 INFO:teuthology.orchestra.run.smithi167.stdout: Package Architecture Version Repository Size 2024-09-11T22:10:20.035 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-11T22:10:20.035 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-11T22:10:20.035 INFO:teuthology.orchestra.run.smithi167.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T22:10:20.035 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-11T22:10:20.035 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T22:10:20.035 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T22:10:20.035 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T22:10:20.035 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:10:20.035 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-11T22:10:20.035 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-11T22:10:20.035 INFO:teuthology.orchestra.run.smithi167.stdout:Install 4 Packages 2024-09-11T22:10:20.035 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:10:20.036 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 79 M 2024-09-11T22:10:20.036 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 126 M 2024-09-11T22:10:20.036 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-11T22:10:20.381 INFO:teuthology.orchestra.run.smithi167.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 252 kB/s | 23 kB 00:00 2024-09-11T22:10:22.487 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-11T22:10:22.822 INFO:teuthology.orchestra.run.smithi167.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 6.2 MB/s | 16 MB 00:02 2024-09-11T22:10:24.530 INFO:teuthology.orchestra.run.smithi100.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T22:10:24.530 INFO:teuthology.orchestra.run.smithi100.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T22:10:24.630 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-11T22:10:24.637 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-11T22:10:24.637 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2024-09-11T22:10:24.637 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-11T22:10:24.637 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-11T22:10:24.637 INFO:teuthology.orchestra.run.smithi100.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T22:10:24.637 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-11T22:10:24.637 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T22:10:24.637 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T22:10:24.637 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T22:10:24.638 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:10:24.638 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-11T22:10:24.638 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-09-11T22:10:24.638 INFO:teuthology.orchestra.run.smithi100.stdout:Install 4 Packages 2024-09-11T22:10:24.638 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:10:24.638 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 79 M 2024-09-11T22:10:24.639 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 126 M 2024-09-11T22:10:24.639 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-11T22:10:25.055 INFO:teuthology.orchestra.run.smithi100.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 176 kB/s | 23 kB 00:00 2024-09-11T22:10:26.314 INFO:teuthology.orchestra.run.smithi167.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 5.7 MB/s | 35 MB 00:06 2024-09-11T22:10:26.547 INFO:teuthology.orchestra.run.smithi100.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 9.7 MB/s | 16 MB 00:01 2024-09-11T22:10:26.739 INFO:teuthology.orchestra.run.smithi167.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 4.5 MB/s | 29 MB 00:06 2024-09-11T22:10:26.739 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-11T22:10:26.739 INFO:teuthology.orchestra.run.smithi167.stdout:Total 12 MB/s | 79 MB 00:06 2024-09-11T22:10:27.247 INFO:teuthology.orchestra.run.smithi100.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 15 MB/s | 35 MB 00:02 2024-09-11T22:10:27.426 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-11T22:10:27.606 INFO:teuthology.orchestra.run.smithi100.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 11 MB/s | 29 MB 00:02 2024-09-11T22:10:27.606 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-11T22:10:27.606 INFO:teuthology.orchestra.run.smithi100.stdout:Total 27 MB/s | 79 MB 00:02 2024-09-11T22:10:27.768 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-11T22:10:27.768 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-11T22:10:28.287 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-11T22:10:28.656 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-11T22:10:28.657 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-11T22:10:28.703 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-11T22:10:28.704 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-11T22:10:29.606 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-11T22:10:29.607 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-11T22:10:31.139 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-11T22:10:31.782 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T22:10:31.940 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T22:10:32.053 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-11T22:10:32.708 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T22:10:32.790 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T22:10:34.727 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T22:10:34.859 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T22:10:35.580 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T22:10:35.710 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T22:10:39.661 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T22:10:39.701 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:10:40.552 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T22:10:40.644 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:10:44.591 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:10:45.469 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:11:23.126 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:11:23.166 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:11:23.550 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:11:23.550 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T22:11:23.550 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T22:11:23.550 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T22:11:23.884 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:11:23.924 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:11:24.252 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:11:24.252 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T22:11:24.252 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T22:11:24.253 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T22:11:24.443 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:11:24.443 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:11:24.443 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-11T22:11:24.443 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T22:11:24.443 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T22:11:24.443 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T22:11:24.443 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T22:11:24.443 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:11:24.443 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-11T22:11:24.794 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T22:11:24.885 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T22:11:24.885 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T22:11:24.885 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T22:11:24.885 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T22:11:24.885 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T22:11:24.886 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-11T22:11:24.886 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi167.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T22:11:24.886 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T22:11:24.945 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T22:11:24.945 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T22:11:24.945 DEBUG:teuthology.orchestra.run.smithi167:> sudo rpm -qi grub2-tools 2024-09-11T22:11:24.983 INFO:teuthology.orchestra.run.smithi167.stdout:Name : grub2-tools 2024-09-11T22:11:24.983 INFO:teuthology.orchestra.run.smithi167.stdout:Epoch : 1 2024-09-11T22:11:24.983 INFO:teuthology.orchestra.run.smithi167.stdout:Version : 2.06 2024-09-11T22:11:24.983 INFO:teuthology.orchestra.run.smithi167.stdout:Release : 82.el9 2024-09-11T22:11:24.983 INFO:teuthology.orchestra.run.smithi167.stdout:Architecture: x86_64 2024-09-11T22:11:24.983 INFO:teuthology.orchestra.run.smithi167.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T22:11:24.983 INFO:teuthology.orchestra.run.smithi167.stdout:Group : Unspecified 2024-09-11T22:11:24.983 INFO:teuthology.orchestra.run.smithi167.stdout:Size : 8274670 2024-09-11T22:11:24.983 INFO:teuthology.orchestra.run.smithi167.stdout:License : GPLv3+ 2024-09-11T22:11:24.984 INFO:teuthology.orchestra.run.smithi167.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T22:11:24.984 INFO:teuthology.orchestra.run.smithi167.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T22:11:24.984 INFO:teuthology.orchestra.run.smithi167.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T22:11:24.984 INFO:teuthology.orchestra.run.smithi167.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T22:11:24.984 INFO:teuthology.orchestra.run.smithi167.stdout:Packager : builder@centos.org 2024-09-11T22:11:24.984 INFO:teuthology.orchestra.run.smithi167.stdout:Vendor : CentOS 2024-09-11T22:11:24.984 INFO:teuthology.orchestra.run.smithi167.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T22:11:24.984 INFO:teuthology.orchestra.run.smithi167.stdout:Summary : Support tools for GRUB. 2024-09-11T22:11:24.984 INFO:teuthology.orchestra.run.smithi167.stdout:Description : 2024-09-11T22:11:24.984 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:11:24.984 INFO:teuthology.orchestra.run.smithi167.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T22:11:24.984 INFO:teuthology.orchestra.run.smithi167.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T22:11:24.984 INFO:teuthology.orchestra.run.smithi167.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T22:11:24.984 INFO:teuthology.orchestra.run.smithi167.stdout:hardware devices. 2024-09-11T22:11:24.985 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:11:24.985 INFO:teuthology.orchestra.run.smithi167.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T22:11:24.985 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T22:11:24.986 INFO:teuthology.task.kernel:Updating grub on smithi167 to boot 5.14.0-505.el9.x86_64 2024-09-11T22:11:24.986 DEBUG:teuthology.orchestra.run.smithi167:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T22:11:25.081 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T22:11:25.082 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:11:25.082 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-11T22:11:25.082 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T22:11:25.082 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T22:11:25.082 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T22:11:25.082 INFO:teuthology.orchestra.run.smithi100.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T22:11:25.082 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:11:25.082 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-11T22:11:25.414 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T22:11:25.508 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T22:11:25.508 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T22:11:25.509 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T22:11:25.509 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T22:11:25.509 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T22:11:25.509 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-11T22:11:25.509 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi100.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T22:11:25.509 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T22:11:25.567 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T22:11:25.567 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T22:11:25.568 DEBUG:teuthology.orchestra.run.smithi100:> sudo rpm -qi grub2-tools 2024-09-11T22:11:25.601 INFO:teuthology.orchestra.run.smithi100.stdout:Name : grub2-tools 2024-09-11T22:11:25.601 INFO:teuthology.orchestra.run.smithi100.stdout:Epoch : 1 2024-09-11T22:11:25.602 INFO:teuthology.orchestra.run.smithi100.stdout:Version : 2.06 2024-09-11T22:11:25.602 INFO:teuthology.orchestra.run.smithi100.stdout:Release : 82.el9 2024-09-11T22:11:25.602 INFO:teuthology.orchestra.run.smithi100.stdout:Architecture: x86_64 2024-09-11T22:11:25.602 INFO:teuthology.orchestra.run.smithi100.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T22:11:25.602 INFO:teuthology.orchestra.run.smithi100.stdout:Group : Unspecified 2024-09-11T22:11:25.602 INFO:teuthology.orchestra.run.smithi100.stdout:Size : 8274670 2024-09-11T22:11:25.602 INFO:teuthology.orchestra.run.smithi100.stdout:License : GPLv3+ 2024-09-11T22:11:25.602 INFO:teuthology.orchestra.run.smithi100.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T22:11:25.602 INFO:teuthology.orchestra.run.smithi100.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T22:11:25.602 INFO:teuthology.orchestra.run.smithi100.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T22:11:25.602 INFO:teuthology.orchestra.run.smithi100.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T22:11:25.602 INFO:teuthology.orchestra.run.smithi100.stdout:Packager : builder@centos.org 2024-09-11T22:11:25.602 INFO:teuthology.orchestra.run.smithi100.stdout:Vendor : CentOS 2024-09-11T22:11:25.603 INFO:teuthology.orchestra.run.smithi100.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T22:11:25.603 INFO:teuthology.orchestra.run.smithi100.stdout:Summary : Support tools for GRUB. 2024-09-11T22:11:25.603 INFO:teuthology.orchestra.run.smithi100.stdout:Description : 2024-09-11T22:11:25.603 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:11:25.603 INFO:teuthology.orchestra.run.smithi100.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T22:11:25.603 INFO:teuthology.orchestra.run.smithi100.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T22:11:25.603 INFO:teuthology.orchestra.run.smithi100.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T22:11:25.603 INFO:teuthology.orchestra.run.smithi100.stdout:hardware devices. 2024-09-11T22:11:25.603 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:11:25.603 INFO:teuthology.orchestra.run.smithi100.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T22:11:25.604 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T22:11:25.604 INFO:teuthology.task.kernel:Updating grub on smithi100 to boot 5.14.0-505.el9.x86_64 2024-09-11T22:11:25.604 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T22:11:25.643 INFO:teuthology.orchestra.run.smithi167.stderr:Generating grub configuration file ... 2024-09-11T22:11:26.279 INFO:teuthology.orchestra.run.smithi100.stderr:Generating grub configuration file ... 2024-09-11T22:11:27.014 INFO:teuthology.orchestra.run.smithi167.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T22:11:27.044 INFO:teuthology.orchestra.run.smithi167.stderr:done 2024-09-11T22:11:27.046 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2024-09-11T22:11:27.061 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.s1J8WDDJ89 2024-09-11T22:11:27.061 DEBUG:teuthology.orchestra.run.smithi167:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.s1J8WDDJ89 2024-09-11T22:11:27.128 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.s1J8WDDJ89 2024-09-11T22:11:27.277 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.s1J8WDDJ89 is 6KB 2024-09-11T22:11:27.326 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.s1J8WDDJ89 2024-09-11T22:11:27.341 DEBUG:teuthology.orchestra.run.smithi167:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T22:11:27.409 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T22:11:27.409 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T22:11:27.409 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T22:11:27.409 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T22:11:27.410 DEBUG:teuthology.orchestra.run.smithi167:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T22:11:27.577 DEBUG:teuthology.orchestra.run.smithi167:> sudo shutdown -r now 2024-09-11T22:11:27.614 INFO:teuthology.orchestra.run.smithi100.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T22:11:27.646 INFO:teuthology.orchestra.run.smithi100.stderr:done 2024-09-11T22:11:27.648 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-09-11T22:11:27.664 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.BHvKVOyIkx 2024-09-11T22:11:27.664 DEBUG:teuthology.orchestra.run.smithi100:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.BHvKVOyIkx 2024-09-11T22:11:27.731 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.BHvKVOyIkx 2024-09-11T22:11:27.873 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.BHvKVOyIkx is 6KB 2024-09-11T22:11:27.921 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.BHvKVOyIkx 2024-09-11T22:11:27.936 DEBUG:teuthology.orchestra.run.smithi100:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T22:11:27.998 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T22:11:27.999 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T22:11:27.999 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T22:11:27.999 INFO:teuthology.orchestra.run.smithi100.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T22:11:28.000 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T22:11:28.152 DEBUG:teuthology.orchestra.run.smithi100:> sudo shutdown -r now 2024-09-11T22:11:57.609 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-11T22:11:57.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-11T22:11:57.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:11:58.155 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T22:11:58.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-11T22:11:58.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:12:32.189 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-09-11T22:12:32.701 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-09-11T22:12:41.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-11T22:12:41.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:12:41.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-11T22:12:41.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:13:00.093 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-09-11T22:13:12.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-11T22:13:12.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:13:12.498 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-09-11T22:13:12.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-11T22:13:12.874 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-11T22:13:12.874 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-09-11T22:13:12.889 INFO:teuthology.orchestra.run.smithi100.stdout:5.14.0-505.el9.x86_64 2024-09-11T22:13:12.890 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T22:13:12.890 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T22:13:12.890 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T22:13:13.891 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T22:13:13.891 DEBUG:teuthology.orchestra.run.smithi100:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T22:13:13.969 INFO:teuthology.orchestra.run.smithi100.stdout:ttyS1 2024-09-11T22:13:13.997 DEBUG:teuthology.parallel:result is None 2024-09-11T22:13:41.204 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T22:13:53.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-11T22:13:53.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:13:53.584 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-09-11T22:13:53.957 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-11T22:13:53.957 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-11T22:13:53.957 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2024-09-11T22:13:53.974 INFO:teuthology.orchestra.run.smithi167.stdout:5.14.0-505.el9.x86_64 2024-09-11T22:13:53.974 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T22:13:53.974 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T22:13:53.974 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T22:13:54.976 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-11T22:13:54.976 DEBUG:teuthology.orchestra.run.smithi167:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T22:13:55.048 INFO:teuthology.orchestra.run.smithi167.stdout:ttyS1 2024-09-11T22:13:55.078 DEBUG:teuthology.parallel:result is None 2024-09-11T22:13:55.078 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T22:13:55.086 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T22:13:55.086 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T22:13:55.089 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T22:13:55.107 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T22:13:55.113 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T22:13:55.119 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T22:13:55.120 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T22:13:55.148 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T22:13:55.211 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T22:13:55.218 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T22:13:55.218 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T22:13:55.221 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T22:13:55.250 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T22:13:55.253 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T22:13:55.261 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T22:13:55.264 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T22:13:55.266 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T22:13:55.272 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T22:13:55.272 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T22:13:55.306 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T22:13:55.333 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T22:13:55.342 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T22:13:55.343 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T22:13:55.375 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T22:13:55.392 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T22:13:55.470 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T22:13:55.522 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T22:13:55.607 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T22:13:55.646 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:13:55.646 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T22:13:55.710 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T22:13:55.753 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T22:13:55.806 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T22:13:55.891 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T22:13:55.932 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T22:13:55.932 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T22:13:55.999 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2024-09-11T22:13:56.002 DEBUG:teuthology.orchestra.run.smithi167:> sudo service rsyslog restart 2024-09-11T22:13:56.058 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T22:13:56.077 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T22:13:56.503 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T22:13:56.511 INFO:teuthology.task.internal:Starting timer... 2024-09-11T22:13:56.511 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T22:13:56.522 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T22:13:56.534 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-11T22:13:56.535 DEBUG:teuthology.orchestra.run.smithi100:> sudo service auditd rotate 2024-09-11T22:13:56.586 INFO:teuthology.orchestra.run.smithi100.stdout:Rotating logs: 2024-09-11T22:13:56.588 DEBUG:teuthology.orchestra.run.smithi167:> sudo service auditd rotate 2024-09-11T22:13:56.630 INFO:teuthology.orchestra.run.smithi167.stdout:Rotating logs: 2024-09-11T22:13:56.632 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T22:13:56.632 DEBUG:teuthology.orchestra.run.smithi100:> /usr/sbin/getenforce 2024-09-11T22:13:56.656 INFO:teuthology.orchestra.run.smithi100.stdout:Permissive 2024-09-11T22:13:56.656 DEBUG:teuthology.orchestra.run.smithi167:> /usr/sbin/getenforce 2024-09-11T22:13:56.693 INFO:teuthology.orchestra.run.smithi167.stdout:Permissive 2024-09-11T22:13:56.693 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi100.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi167.front.sepia.ceph.com': 'permissive'} 2024-09-11T22:13:56.693 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T22:13:56.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:13:56.721 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T22:13:56.763 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:13:56.763 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T22:13:56.764 DEBUG:teuthology.orchestra.run.smithi100:> sudo /usr/sbin/setenforce permissive 2024-09-11T22:13:56.797 DEBUG:teuthology.orchestra.run.smithi167:> sudo /usr/sbin/setenforce permissive 2024-09-11T22:13:56.838 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T22:13:56.848 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-11T22:13:56.851 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-11T22:13:56.958 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T22:13:56.973 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T22:13:56.974 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi100.front.sepia.ceph.com,smithi167.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T22:17:41.004 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi100.front.sepia.ceph.com'), Remote(name='ubuntu@smithi167.front.sepia.ceph.com')] 2024-09-11T22:17:41.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-11T22:17:41.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:17:41.085 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-09-11T22:17:41.164 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-11T22:17:41.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-11T22:17:41.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T22:17:41.241 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-09-11T22:17:41.320 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-11T22:17:41.320 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T22:17:41.334 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T22:17:41.335 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T22:17:41.335 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T22:17:41.338 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T22:17:41.339 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T22:17:41.366 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T22:17:41.381 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T22:17:41.390 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T22:17:41.404 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T22:17:41.407 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: ntpd: command not found 2024-09-11T22:17:41.418 INFO:teuthology.orchestra.run.smithi100.stdout:506 Cannot talk to daemon 2024-09-11T22:17:41.429 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: ntpd: command not found 2024-09-11T22:17:41.432 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T22:17:41.440 INFO:teuthology.orchestra.run.smithi167.stdout:506 Cannot talk to daemon 2024-09-11T22:17:41.446 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T22:17:41.455 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T22:17:41.468 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T22:17:41.501 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-09-11T22:17:41.504 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T22:17:41.504 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-09-11T22:17:41.504 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:17:41.504 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:17:41.504 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:17:41.504 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:17:41.526 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2024-09-11T22:17:41.529 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T22:17:41.530 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2024-09-11T22:17:41.530 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:17:41.530 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:17:41.530 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:17:41.530 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:17:41.531 INFO:teuthology.run_tasks:Running task install... 2024-09-11T22:17:41.539 DEBUG:teuthology.task.install:project ceph 2024-09-11T22:17:41.539 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-11T22:17:41.539 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-11T22:17:41.539 INFO:teuthology.task.install:Using flavor: default 2024-09-11T22:17:41.545 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T22:17:41.545 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-11T22:17:41.545 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T22:17:41.546 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:17:41.548 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-11T22:17:41.548 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:17:41.695 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T22:17:41.696 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T22:17:41.699 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-11T22:17:41.699 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-11T22:17:41.807 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T22:17:41.808 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:17:41.808 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T22:17:41.816 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T22:17:41.817 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T22:17:41.817 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T22:17:41.833 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T22:17:41.834 DEBUG:teuthology.orchestra.run.smithi100:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T22:17:41.843 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T22:17:41.843 DEBUG:teuthology.orchestra.run.smithi167:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T22:17:41.899 DEBUG:teuthology.orchestra.run.smithi100:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T22:17:41.909 DEBUG:teuthology.orchestra.run.smithi167:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T22:17:41.974 DEBUG:teuthology.orchestra.run.smithi100:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T22:17:41.984 DEBUG:teuthology.orchestra.run.smithi167:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T22:17:42.038 INFO:teuthology.orchestra.run.smithi100.stdout:check_obsoletes = 1 2024-09-11T22:17:42.040 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum clean all 2024-09-11T22:17:42.049 INFO:teuthology.orchestra.run.smithi167.stdout:check_obsoletes = 1 2024-09-11T22:17:42.050 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum clean all 2024-09-11T22:17:42.285 INFO:teuthology.orchestra.run.smithi100.stdout:45 files removed 2024-09-11T22:17:42.288 INFO:teuthology.orchestra.run.smithi167.stdout:45 files removed 2024-09-11T22:17:42.312 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T22:17:42.314 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T22:17:42.882 INFO:teuthology.orchestra.run.smithi100.stdout:ceph packages for x86_64 298 kB/s | 84 kB 00:00 2024-09-11T22:17:42.883 INFO:teuthology.orchestra.run.smithi167.stdout:ceph packages for x86_64 295 kB/s | 84 kB 00:00 2024-09-11T22:17:43.183 INFO:teuthology.orchestra.run.smithi100.stdout:ceph noarch packages 46 kB/s | 12 kB 00:00 2024-09-11T22:17:43.183 INFO:teuthology.orchestra.run.smithi167.stdout:ceph noarch packages 46 kB/s | 12 kB 00:00 2024-09-11T22:17:43.468 INFO:teuthology.orchestra.run.smithi167.stdout:ceph source packages 7.6 kB/s | 1.9 kB 00:00 2024-09-11T22:17:43.474 INFO:teuthology.orchestra.run.smithi100.stdout:ceph source packages 7.4 kB/s | 1.9 kB 00:00 2024-09-11T22:17:44.193 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-11T22:17:44.235 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-11T22:17:47.561 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - AppStream 9.2 MB/s | 20 MB 00:02 2024-09-11T22:17:51.769 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 3.2 MB/s | 20 MB 00:06 2024-09-11T22:17:52.346 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - CRB 8.2 MB/s | 6.5 MB 00:00 2024-09-11T22:17:53.905 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - Extras packages 94 kB/s | 19 kB 00:00 2024-09-11T22:17:54.750 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-11T22:17:56.053 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-11T22:17:57.529 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 74 kB/s | 19 kB 00:00 2024-09-11T22:17:58.317 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-11T22:18:00.449 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-11T22:18:02.777 INFO:teuthology.orchestra.run.smithi167.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T22:18:02.778 INFO:teuthology.orchestra.run.smithi167.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T22:18:02.791 INFO:teuthology.orchestra.run.smithi167.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T22:18:02.792 INFO:teuthology.orchestra.run.smithi167.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T22:18:02.793 INFO:teuthology.orchestra.run.smithi167.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T22:18:02.794 INFO:teuthology.orchestra.run.smithi167.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T22:18:02.796 INFO:teuthology.orchestra.run.smithi167.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T22:18:02.798 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T22:18:02.799 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T22:18:02.863 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-11T22:18:02.879 INFO:teuthology.orchestra.run.smithi167.stdout:====================================================================================== 2024-09-11T22:18:02.879 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-09-11T22:18:02.880 INFO:teuthology.orchestra.run.smithi167.stdout:====================================================================================== 2024-09-11T22:18:02.880 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-11T22:18:02.880 INFO:teuthology.orchestra.run.smithi167.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T22:18:02.880 INFO:teuthology.orchestra.run.smithi167.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T22:18:02.880 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T22:18:02.880 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T22:18:02.880 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T22:18:02.880 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T22:18:02.880 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T22:18:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T22:18:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T22:18:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T22:18:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T22:18:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T22:18:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T22:18:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T22:18:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T22:18:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T22:18:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T22:18:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T22:18:02.881 INFO:teuthology.orchestra.run.smithi167.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T22:18:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T22:18:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T22:18:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T22:18:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T22:18:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T22:18:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T22:18:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T22:18:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T22:18:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T22:18:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T22:18:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T22:18:02.882 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T22:18:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T22:18:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T22:18:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T22:18:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T22:18:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T22:18:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T22:18:02.883 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrading: 2024-09-11T22:18:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T22:18:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T22:18:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T22:18:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T22:18:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T22:18:02.883 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T22:18:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T22:18:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T22:18:02.884 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-11T22:18:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T22:18:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T22:18:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T22:18:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T22:18:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T22:18:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T22:18:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T22:18:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T22:18:02.884 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T22:18:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T22:18:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T22:18:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T22:18:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T22:18:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T22:18:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T22:18:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T22:18:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T22:18:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T22:18:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T22:18:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T22:18:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T22:18:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T22:18:02.885 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T22:18:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T22:18:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T22:18:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T22:18:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T22:18:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T22:18:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T22:18:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T22:18:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T22:18:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T22:18:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T22:18:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T22:18:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T22:18:02.886 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T22:18:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T22:18:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T22:18:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T22:18:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T22:18:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T22:18:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T22:18:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T22:18:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T22:18:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T22:18:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T22:18:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T22:18:02.887 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T22:18:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T22:18:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T22:18:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T22:18:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T22:18:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T22:18:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T22:18:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T22:18:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T22:18:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T22:18:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T22:18:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T22:18:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T22:18:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T22:18:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T22:18:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T22:18:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T22:18:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T22:18:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T22:18:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T22:18:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T22:18:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T22:18:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T22:18:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T22:18:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T22:18:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T22:18:02.889 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T22:18:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T22:18:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T22:18:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T22:18:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T22:18:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T22:18:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T22:18:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T22:18:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T22:18:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T22:18:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T22:18:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T22:18:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T22:18:02.890 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T22:18:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T22:18:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T22:18:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T22:18:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T22:18:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T22:18:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T22:18:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T22:18:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T22:18:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T22:18:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T22:18:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T22:18:02.891 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T22:18:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T22:18:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T22:18:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T22:18:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T22:18:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T22:18:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T22:18:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T22:18:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T22:18:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T22:18:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T22:18:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T22:18:02.892 INFO:teuthology.orchestra.run.smithi167.stdout:Installing weak dependencies: 2024-09-11T22:18:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T22:18:02.892 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:18:02.893 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-11T22:18:02.893 INFO:teuthology.orchestra.run.smithi167.stdout:====================================================================================== 2024-09-11T22:18:02.893 INFO:teuthology.orchestra.run.smithi167.stdout:Install 148 Packages 2024-09-11T22:18:02.893 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrade 8 Packages 2024-09-11T22:18:02.893 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:18:02.893 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 226 M 2024-09-11T22:18:02.894 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-11T22:18:03.250 INFO:teuthology.orchestra.run.smithi167.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 47 kB/s | 6.5 kB 00:00 2024-09-11T22:18:03.458 INFO:teuthology.orchestra.run.smithi167.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 4.2 MB/s | 897 kB 00:00 2024-09-11T22:18:03.526 INFO:teuthology.orchestra.run.smithi167.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 2.1 MB/s | 145 kB 00:00 2024-09-11T22:18:03.617 INFO:teuthology.orchestra.run.smithi167.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-11T22:18:03.718 INFO:teuthology.orchestra.run.smithi167.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 12 MB/s | 2.4 MB 00:00 2024-09-11T22:18:03.768 INFO:teuthology.orchestra.run.smithi167.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 10 MB/s | 1.5 MB 00:00 2024-09-11T22:18:03.822 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-11T22:18:04.102 INFO:teuthology.orchestra.run.smithi167.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-11T22:18:04.394 INFO:teuthology.orchestra.run.smithi167.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 17 MB/s | 21 MB 00:01 2024-09-11T22:18:04.436 INFO:teuthology.orchestra.run.smithi167.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 607 kB/s | 25 kB 00:00 2024-09-11T22:18:04.770 INFO:teuthology.orchestra.run.smithi167.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 17 MB/s | 17 MB 00:01 2024-09-11T22:18:04.895 INFO:teuthology.orchestra.run.smithi167.stdout:(11/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 13 MB/s | 11 MB 00:00 2024-09-11T22:18:04.920 INFO:teuthology.orchestra.run.smithi167.stdout:(12/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 1.5 MB/s | 228 kB 00:00 2024-09-11T22:18:04.945 INFO:teuthology.orchestra.run.smithi167.stdout:(13/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 538 kB/s | 27 kB 00:00 2024-09-11T22:18:04.962 INFO:teuthology.orchestra.run.smithi167.stdout:(14/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 754 kB/s | 32 kB 00:00 2024-09-11T22:18:04.996 INFO:teuthology.orchestra.run.smithi167.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 15 MB/s | 752 kB 00:00 2024-09-11T22:18:05.021 INFO:teuthology.orchestra.run.smithi167.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 163 kB 00:00 2024-09-11T22:18:05.047 INFO:teuthology.orchestra.run.smithi167.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.5 MB/s | 127 kB 00:00 2024-09-11T22:18:05.080 INFO:teuthology.orchestra.run.smithi167.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 8.4 MB/s | 506 kB 00:00 2024-09-11T22:18:05.147 INFO:teuthology.orchestra.run.smithi167.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 678 kB/s | 45 kB 00:00 2024-09-11T22:18:05.239 INFO:teuthology.orchestra.run.smithi167.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.4 MB/s | 136 kB 00:00 2024-09-11T22:18:05.315 INFO:teuthology.orchestra.run.smithi167.stdout:(21/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 20 MB/s | 5.3 MB 00:00 2024-09-11T22:18:05.340 INFO:teuthology.orchestra.run.smithi167.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.6 MB/s | 162 kB 00:00 2024-09-11T22:18:05.374 INFO:teuthology.orchestra.run.smithi167.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 5.4 MB/s | 321 kB 00:00 2024-09-11T22:18:05.399 INFO:teuthology.orchestra.run.smithi167.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.0 MB/s | 301 kB 00:00 2024-09-11T22:18:05.424 INFO:teuthology.orchestra.run.smithi167.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-11T22:18:05.450 INFO:teuthology.orchestra.run.smithi167.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-11T22:18:05.517 INFO:teuthology.orchestra.run.smithi167.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.5 MB/s | 171 kB 00:00 2024-09-11T22:18:05.575 INFO:teuthology.orchestra.run.smithi167.stdout:(28/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 21 MB/s | 3.1 MB 00:00 2024-09-11T22:18:05.601 INFO:teuthology.orchestra.run.smithi167.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 381 kB/s | 32 kB 00:00 2024-09-11T22:18:05.626 INFO:teuthology.orchestra.run.smithi167.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.8 MB/s | 146 kB 00:00 2024-09-11T22:18:05.851 INFO:teuthology.orchestra.run.smithi167.stdout:(31/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 14 MB/s | 3.6 MB 00:00 2024-09-11T22:18:06.002 INFO:teuthology.orchestra.run.smithi167.stdout:(32/156): ceph-mgr-diskprediction-local-19.1.1- 20 MB/s | 7.4 MB 00:00 2024-09-11T22:18:06.036 INFO:teuthology.orchestra.run.smithi167.stdout:(33/156): ceph-mgr-modules-core-19.1.1-298.gb53 1.3 MB/s | 249 kB 00:00 2024-09-11T22:18:06.061 INFO:teuthology.orchestra.run.smithi167.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 839 kB/s | 49 kB 00:00 2024-09-11T22:18:06.086 INFO:teuthology.orchestra.run.smithi167.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 327 kB/s | 16 kB 00:00 2024-09-11T22:18:06.111 INFO:teuthology.orchestra.run.smithi167.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 5.5 MB/s | 285 kB 00:00 2024-09-11T22:18:06.202 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T22:18:06.203 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T22:18:06.216 INFO:teuthology.orchestra.run.smithi100.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T22:18:06.217 INFO:teuthology.orchestra.run.smithi100.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T22:18:06.218 INFO:teuthology.orchestra.run.smithi100.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T22:18:06.219 INFO:teuthology.orchestra.run.smithi100.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T22:18:06.220 INFO:teuthology.orchestra.run.smithi100.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T22:18:06.223 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T22:18:06.224 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T22:18:06.263 INFO:teuthology.orchestra.run.smithi167.stdout:(37/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 438 kB/s | 18 kB 00:00 2024-09-11T22:18:06.263 INFO:teuthology.orchestra.run.smithi167.stdout:(38/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 4.3 MB/s | 765 kB 00:00 2024-09-11T22:18:06.287 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-11T22:18:06.314 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-11T22:18:06.314 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-11T22:18:06.314 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-11T22:18:06.314 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-11T22:18:06.314 INFO:teuthology.orchestra.run.smithi100.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T22:18:06.315 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-11T22:18:06.315 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-11T22:18:06.315 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-11T22:18:06.315 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-11T22:18:06.315 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-11T22:18:06.315 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-11T22:18:06.315 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-11T22:18:06.315 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-11T22:18:06.315 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-11T22:18:06.315 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-11T22:18:06.315 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-11T22:18:06.315 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-11T22:18:06.316 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-11T22:18:06.316 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-11T22:18:06.316 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-11T22:18:06.316 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-11T22:18:06.316 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T22:18:06.316 INFO:teuthology.orchestra.run.smithi100.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T22:18:06.316 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T22:18:06.316 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-11T22:18:06.316 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-11T22:18:06.316 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-11T22:18:06.316 INFO:teuthology.orchestra.run.smithi100.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T22:18:06.316 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T22:18:06.316 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T22:18:06.317 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T22:18:06.317 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T22:18:06.317 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T22:18:06.317 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-11T22:18:06.317 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-11T22:18:06.317 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-11T22:18:06.317 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-11T22:18:06.317 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-11T22:18:06.317 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-11T22:18:06.317 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-11T22:18:06.317 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T22:18:06.317 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-09-11T22:18:06.318 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T22:18:06.318 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T22:18:06.318 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T22:18:06.318 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T22:18:06.318 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-11T22:18:06.318 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-11T22:18:06.318 INFO:teuthology.orchestra.run.smithi100.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T22:18:06.318 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T22:18:06.318 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-11T22:18:06.318 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T22:18:06.318 INFO:teuthology.orchestra.run.smithi100.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T22:18:06.318 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T22:18:06.318 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-11T22:18:06.319 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-11T22:18:06.319 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-11T22:18:06.319 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-11T22:18:06.319 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-11T22:18:06.319 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-11T22:18:06.319 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-11T22:18:06.319 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-11T22:18:06.319 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T22:18:06.319 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T22:18:06.319 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T22:18:06.319 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T22:18:06.319 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T22:18:06.320 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T22:18:06.320 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T22:18:06.320 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T22:18:06.320 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-11T22:18:06.320 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T22:18:06.320 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T22:18:06.320 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T22:18:06.320 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T22:18:06.320 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T22:18:06.320 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-11T22:18:06.320 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T22:18:06.320 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-11T22:18:06.321 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T22:18:06.321 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T22:18:06.321 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T22:18:06.321 INFO:teuthology.orchestra.run.smithi100.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T22:18:06.321 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T22:18:06.321 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T22:18:06.321 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T22:18:06.321 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T22:18:06.321 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T22:18:06.321 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T22:18:06.321 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T22:18:06.321 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T22:18:06.321 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T22:18:06.322 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T22:18:06.322 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T22:18:06.322 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T22:18:06.322 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T22:18:06.322 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-11T22:18:06.322 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-11T22:18:06.322 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T22:18:06.322 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T22:18:06.322 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T22:18:06.322 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T22:18:06.322 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T22:18:06.322 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T22:18:06.322 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T22:18:06.323 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T22:18:06.323 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T22:18:06.323 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T22:18:06.323 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T22:18:06.323 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T22:18:06.323 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T22:18:06.323 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T22:18:06.323 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T22:18:06.323 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T22:18:06.323 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T22:18:06.323 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T22:18:06.323 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T22:18:06.323 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T22:18:06.324 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T22:18:06.324 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T22:18:06.324 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T22:18:06.324 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T22:18:06.324 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T22:18:06.324 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T22:18:06.324 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T22:18:06.324 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T22:18:06.324 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T22:18:06.324 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T22:18:06.324 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T22:18:06.324 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T22:18:06.324 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T22:18:06.325 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T22:18:06.325 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T22:18:06.325 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T22:18:06.325 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T22:18:06.325 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T22:18:06.325 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T22:18:06.325 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T22:18:06.325 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T22:18:06.325 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T22:18:06.325 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T22:18:06.325 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T22:18:06.325 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T22:18:06.325 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T22:18:06.325 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T22:18:06.326 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T22:18:06.326 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T22:18:06.326 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T22:18:06.326 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T22:18:06.326 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T22:18:06.326 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T22:18:06.326 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T22:18:06.326 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T22:18:06.326 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T22:18:06.326 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T22:18:06.326 INFO:teuthology.orchestra.run.smithi100.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T22:18:06.326 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T22:18:06.326 INFO:teuthology.orchestra.run.smithi100.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T22:18:06.327 INFO:teuthology.orchestra.run.smithi100.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T22:18:06.327 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T22:18:06.327 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T22:18:06.327 INFO:teuthology.orchestra.run.smithi100.stdout:Installing weak dependencies: 2024-09-11T22:18:06.327 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T22:18:06.327 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:18:06.327 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-11T22:18:06.327 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-11T22:18:06.327 INFO:teuthology.orchestra.run.smithi100.stdout:Install 148 Packages 2024-09-11T22:18:06.327 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 8 Packages 2024-09-11T22:18:06.327 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:18:06.328 INFO:teuthology.orchestra.run.smithi167.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 479 kB/s | 80 kB 00:00 2024-09-11T22:18:06.328 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 226 M 2024-09-11T22:18:06.328 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-11T22:18:06.446 INFO:teuthology.orchestra.run.smithi167.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-11T22:18:06.791 INFO:teuthology.orchestra.run.smithi100.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 44 kB/s | 6.5 kB 00:00 2024-09-11T22:18:06.888 INFO:teuthology.orchestra.run.smithi167.stdout:(41/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 20 MB/s | 49 MB 00:02 2024-09-11T22:18:06.913 INFO:teuthology.orchestra.run.smithi167.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 542 kB/s | 253 kB 00:00 2024-09-11T22:18:06.947 INFO:teuthology.orchestra.run.smithi167.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-11T22:18:06.972 INFO:teuthology.orchestra.run.smithi167.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-11T22:18:07.006 INFO:teuthology.orchestra.run.smithi167.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.2 MB/s | 135 kB 00:00 2024-09-11T22:18:07.032 INFO:teuthology.orchestra.run.smithi167.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-11T22:18:07.065 INFO:teuthology.orchestra.run.smithi167.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-11T22:18:07.065 INFO:teuthology.orchestra.run.smithi100.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 3.2 MB/s | 897 kB 00:00 2024-09-11T22:18:07.133 INFO:teuthology.orchestra.run.smithi100.stdout:(3/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-11T22:18:07.158 INFO:teuthology.orchestra.run.smithi100.stdout:(4/156): ceph-immutable-object-cache-19.1.1-298 1.5 MB/s | 145 kB 00:00 2024-09-11T22:18:07.207 INFO:teuthology.orchestra.run.smithi167.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-09-11T22:18:07.249 INFO:teuthology.orchestra.run.smithi167.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 5.0 MB/s | 943 kB 00:00 2024-09-11T22:18:07.274 INFO:teuthology.orchestra.run.smithi167.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-11T22:18:07.300 INFO:teuthology.orchestra.run.smithi167.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-09-11T22:18:07.300 INFO:teuthology.orchestra.run.smithi100.stdout:(5/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 14 MB/s | 2.4 MB 00:00 2024-09-11T22:18:07.334 INFO:teuthology.orchestra.run.smithi167.stdout:(52/156): python3-cryptography-36.0.1-4.el9.x86 2.8 MB/s | 1.2 MB 00:00 2024-09-11T22:18:07.359 INFO:teuthology.orchestra.run.smithi167.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-09-11T22:18:07.392 INFO:teuthology.orchestra.run.smithi167.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-11T22:18:07.418 INFO:teuthology.orchestra.run.smithi167.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-11T22:18:07.442 INFO:teuthology.orchestra.run.smithi167.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-11T22:18:07.485 INFO:teuthology.orchestra.run.smithi167.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-11T22:18:07.508 INFO:teuthology.orchestra.run.smithi100.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 4.3 MB/s | 1.5 MB 00:00 2024-09-11T22:18:07.510 INFO:teuthology.orchestra.run.smithi167.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 674 kB/s | 45 kB 00:00 2024-09-11T22:18:07.561 INFO:teuthology.orchestra.run.smithi167.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 11 MB/s | 581 kB 00:00 2024-09-11T22:18:07.575 INFO:teuthology.orchestra.run.smithi100.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-11T22:18:07.586 INFO:teuthology.orchestra.run.smithi167.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 662 kB 00:00 2024-09-11T22:18:07.611 INFO:teuthology.orchestra.run.smithi167.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 487 kB/s | 24 kB 00:00 2024-09-11T22:18:07.636 INFO:teuthology.orchestra.run.smithi167.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-11T22:18:07.670 INFO:teuthology.orchestra.run.smithi167.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-11T22:18:07.695 INFO:teuthology.orchestra.run.smithi167.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-11T22:18:07.721 INFO:teuthology.orchestra.run.smithi167.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-09-11T22:18:07.771 INFO:teuthology.orchestra.run.smithi167.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.8 MB/s | 3.0 MB 00:00 2024-09-11T22:18:07.792 INFO:teuthology.orchestra.run.smithi100.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 18 MB/s | 21 MB 00:01 2024-09-11T22:18:07.834 INFO:teuthology.orchestra.run.smithi100.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 607 kB/s | 25 kB 00:00 2024-09-11T22:18:07.863 INFO:teuthology.orchestra.run.smithi167.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2024-09-11T22:18:07.905 INFO:teuthology.orchestra.run.smithi167.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-11T22:18:07.947 INFO:teuthology.orchestra.run.smithi167.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-11T22:18:07.972 INFO:teuthology.orchestra.run.smithi167.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-11T22:18:08.056 INFO:teuthology.orchestra.run.smithi167.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-11T22:18:08.131 INFO:teuthology.orchestra.run.smithi167.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 31 MB/s | 5.8 MB 00:00 2024-09-11T22:18:08.156 INFO:teuthology.orchestra.run.smithi167.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 874 kB/s | 87 kB 00:00 2024-09-11T22:18:08.168 INFO:teuthology.orchestra.run.smithi100.stdout:(10/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 18 MB/s | 11 MB 00:00 2024-09-11T22:18:08.215 INFO:teuthology.orchestra.run.smithi167.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-11T22:18:08.218 INFO:teuthology.orchestra.run.smithi100.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 4.5 MB/s | 228 kB 00:00 2024-09-11T22:18:08.293 INFO:teuthology.orchestra.run.smithi100.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 361 kB/s | 27 kB 00:00 2024-09-11T22:18:08.299 INFO:teuthology.orchestra.run.smithi167.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 36 MB/s | 6.0 MB 00:00 2024-09-11T22:18:08.333 INFO:teuthology.orchestra.run.smithi167.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-11T22:18:08.358 INFO:teuthology.orchestra.run.smithi167.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-11T22:18:08.369 INFO:teuthology.orchestra.run.smithi100.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 422 kB/s | 32 kB 00:00 2024-09-11T22:18:08.383 INFO:teuthology.orchestra.run.smithi167.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-11T22:18:08.417 INFO:teuthology.orchestra.run.smithi167.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-09-11T22:18:08.444 INFO:teuthology.orchestra.run.smithi167.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-11T22:18:08.467 INFO:teuthology.orchestra.run.smithi167.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 688 kB/s | 35 kB 00:00 2024-09-11T22:18:08.469 INFO:teuthology.orchestra.run.smithi100.stdout:(14/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 7.4 MB/s | 752 kB 00:00 2024-09-11T22:18:08.535 INFO:teuthology.orchestra.run.smithi167.stdout:(82/156): openblas-openmp-0.3.26-2.el9.x86_64.r 5.9 MB/s | 4.9 MB 00:00 2024-09-11T22:18:08.553 INFO:teuthology.orchestra.run.smithi100.stdout:(15/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 1.9 MB/s | 163 kB 00:00 2024-09-11T22:18:08.560 INFO:teuthology.orchestra.run.smithi167.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-09-11T22:18:08.585 INFO:teuthology.orchestra.run.smithi167.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-11T22:18:08.627 INFO:teuthology.orchestra.run.smithi167.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-09-11T22:18:08.636 INFO:teuthology.orchestra.run.smithi100.stdout:(16/156): librados-devel-19.1.1-298.gb53b6d3e.e 1.5 MB/s | 127 kB 00:00 2024-09-11T22:18:08.653 INFO:teuthology.orchestra.run.smithi167.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 628 kB/s | 42 kB 00:00 2024-09-11T22:18:08.686 INFO:teuthology.orchestra.run.smithi167.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-11T22:18:08.712 INFO:teuthology.orchestra.run.smithi167.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-11T22:18:08.737 INFO:teuthology.orchestra.run.smithi100.stdout:(17/156): libradosstriper1-19.1.1-298.gb53b6d3e 5.0 MB/s | 506 kB 00:00 2024-09-11T22:18:08.737 INFO:teuthology.orchestra.run.smithi167.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-11T22:18:08.762 INFO:teuthology.orchestra.run.smithi167.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-11T22:18:08.787 INFO:teuthology.orchestra.run.smithi167.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-11T22:18:08.855 INFO:teuthology.orchestra.run.smithi167.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-11T22:18:08.880 INFO:teuthology.orchestra.run.smithi167.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-09-11T22:18:08.905 INFO:teuthology.orchestra.run.smithi167.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 880 kB/s | 44 kB 00:00 2024-09-11T22:18:08.947 INFO:teuthology.orchestra.run.smithi167.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-11T22:18:08.972 INFO:teuthology.orchestra.run.smithi167.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 535 kB/s | 36 kB 00:00 2024-09-11T22:18:08.998 INFO:teuthology.orchestra.run.smithi167.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-11T22:18:09.031 INFO:teuthology.orchestra.run.smithi167.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-11T22:18:09.057 INFO:teuthology.orchestra.run.smithi167.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 985 kB/s | 58 kB 00:00 2024-09-11T22:18:09.082 INFO:teuthology.orchestra.run.smithi167.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-11T22:18:09.107 INFO:teuthology.orchestra.run.smithi167.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-11T22:18:09.128 INFO:teuthology.orchestra.run.smithi100.stdout:(18/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 14 MB/s | 5.3 MB 00:00 2024-09-11T22:18:09.133 INFO:teuthology.orchestra.run.smithi167.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 890 kB/s | 45 kB 00:00 2024-09-11T22:18:09.179 INFO:teuthology.orchestra.run.smithi100.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 904 kB/s | 45 kB 00:00 2024-09-11T22:18:09.225 INFO:teuthology.orchestra.run.smithi167.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 190 kB/s | 22 kB 00:00 2024-09-11T22:18:09.292 INFO:teuthology.orchestra.run.smithi167.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.0 MB/s | 548 kB 00:00 2024-09-11T22:18:09.325 INFO:teuthology.orchestra.run.smithi167.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-11T22:18:09.350 INFO:teuthology.orchestra.run.smithi167.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 775 kB/s | 19 kB 00:00 2024-09-11T22:18:09.362 INFO:teuthology.orchestra.run.smithi100.stdout:(20/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 9.1 MB/s | 17 MB 00:01 2024-09-11T22:18:09.384 INFO:teuthology.orchestra.run.smithi167.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.4 MB/s | 863 kB 00:00 2024-09-11T22:18:09.388 INFO:teuthology.orchestra.run.smithi100.stdout:(21/156): python3-ceph-common-19.1.1-298.gb53b6 651 kB/s | 136 kB 00:00 2024-09-11T22:18:09.413 INFO:teuthology.orchestra.run.smithi100.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 3.2 MB/s | 162 kB 00:00 2024-09-11T22:18:09.426 INFO:teuthology.orchestra.run.smithi167.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 625 kB/s | 26 kB 00:00 2024-09-11T22:18:09.438 INFO:teuthology.orchestra.run.smithi100.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 6.3 MB/s | 321 kB 00:00 2024-09-11T22:18:09.443 INFO:teuthology.orchestra.run.smithi167.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-11T22:18:09.468 INFO:teuthology.orchestra.run.smithi167.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-11T22:18:09.472 INFO:teuthology.orchestra.run.smithi100.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.0 MB/s | 301 kB 00:00 2024-09-11T22:18:09.497 INFO:teuthology.orchestra.run.smithi100.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.7 MB/s | 100 kB 00:00 2024-09-11T22:18:09.503 INFO:teuthology.orchestra.run.smithi167.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-11T22:18:09.523 INFO:teuthology.orchestra.run.smithi100.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.6 MB/s | 85 kB 00:00 2024-09-11T22:18:09.578 INFO:teuthology.orchestra.run.smithi167.stdout:(112/156): libarrow-9.0.0-11.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-09-11T22:18:09.611 INFO:teuthology.orchestra.run.smithi167.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-11T22:18:09.637 INFO:teuthology.orchestra.run.smithi167.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T22:18:09.662 INFO:teuthology.orchestra.run.smithi167.stdout:(115/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.1 MB/s | 839 kB 00:00 2024-09-11T22:18:09.687 INFO:teuthology.orchestra.run.smithi167.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-09-11T22:18:09.713 INFO:teuthology.orchestra.run.smithi167.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-11T22:18:09.738 INFO:teuthology.orchestra.run.smithi167.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-11T22:18:09.772 INFO:teuthology.orchestra.run.smithi167.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-11T22:18:09.806 INFO:teuthology.orchestra.run.smithi167.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-09-11T22:18:09.831 INFO:teuthology.orchestra.run.smithi167.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-11T22:18:09.864 INFO:teuthology.orchestra.run.smithi167.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-11T22:18:09.890 INFO:teuthology.orchestra.run.smithi167.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-11T22:18:09.915 INFO:teuthology.orchestra.run.smithi167.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-09-11T22:18:09.941 INFO:teuthology.orchestra.run.smithi167.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 920 kB/s | 23 kB 00:00 2024-09-11T22:18:09.957 INFO:teuthology.orchestra.run.smithi100.stdout:(27/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 23 MB/s | 49 MB 00:02 2024-09-11T22:18:09.974 INFO:teuthology.orchestra.run.smithi167.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 587 kB/s | 19 kB 00:00 2024-09-11T22:18:09.982 INFO:teuthology.orchestra.run.smithi100.stdout:(28/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 372 kB/s | 171 kB 00:00 2024-09-11T22:18:10.007 INFO:teuthology.orchestra.run.smithi100.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 639 kB/s | 32 kB 00:00 2024-09-11T22:18:10.008 INFO:teuthology.orchestra.run.smithi167.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 588 kB/s | 20 kB 00:00 2024-09-11T22:18:10.033 INFO:teuthology.orchestra.run.smithi100.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.8 MB/s | 146 kB 00:00 2024-09-11T22:18:10.058 INFO:teuthology.orchestra.run.smithi167.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.1 MB/s | 2.0 MB 00:00 2024-09-11T22:18:10.083 INFO:teuthology.orchestra.run.smithi167.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T22:18:10.099 INFO:teuthology.orchestra.run.smithi100.stdout:(31/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 5.2 MB/s | 3.1 MB 00:00 2024-09-11T22:18:10.109 INFO:teuthology.orchestra.run.smithi167.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T22:18:10.134 INFO:teuthology.orchestra.run.smithi167.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-09-11T22:18:10.158 INFO:teuthology.orchestra.run.smithi100.stdout:(32/156): ceph-mgr-modules-core-19.1.1-298.gb53 4.2 MB/s | 249 kB 00:00 2024-09-11T22:18:10.176 INFO:teuthology.orchestra.run.smithi167.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-11T22:18:10.203 INFO:teuthology.orchestra.run.smithi167.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 651 kB/s | 16 kB 00:00 2024-09-11T22:18:10.226 INFO:teuthology.orchestra.run.smithi167.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-11T22:18:10.250 INFO:teuthology.orchestra.run.smithi100.stdout:(33/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 15 MB/s | 3.6 MB 00:00 2024-09-11T22:18:10.252 INFO:teuthology.orchestra.run.smithi167.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-11T22:18:10.275 INFO:teuthology.orchestra.run.smithi100.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 422 kB/s | 49 kB 00:00 2024-09-11T22:18:10.286 INFO:teuthology.orchestra.run.smithi167.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 479 kB/s | 28 kB 00:00 2024-09-11T22:18:10.309 INFO:teuthology.orchestra.run.smithi100.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 282 kB/s | 16 kB 00:00 2024-09-11T22:18:10.311 INFO:teuthology.orchestra.run.smithi167.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 522 kB/s | 31 kB 00:00 2024-09-11T22:18:10.334 INFO:teuthology.orchestra.run.smithi100.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 4.8 MB/s | 285 kB 00:00 2024-09-11T22:18:10.336 INFO:teuthology.orchestra.run.smithi167.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-11T22:18:10.362 INFO:teuthology.orchestra.run.smithi167.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-11T22:18:10.367 INFO:teuthology.orchestra.run.smithi100.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 13 MB/s | 765 kB 00:00 2024-09-11T22:18:10.379 INFO:teuthology.orchestra.run.smithi167.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 851 kB/s | 36 kB 00:00 2024-09-11T22:18:10.393 INFO:teuthology.orchestra.run.smithi100.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 312 kB/s | 18 kB 00:00 2024-09-11T22:18:10.404 INFO:teuthology.orchestra.run.smithi167.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-11T22:18:10.543 INFO:teuthology.orchestra.run.smithi100.stdout:(39/156): ceph-mgr-diskprediction-local-19.1.1- 15 MB/s | 7.4 MB 00:00 2024-09-11T22:18:10.569 INFO:teuthology.orchestra.run.smithi100.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 398 kB/s | 80 kB 00:00 2024-09-11T22:18:10.579 INFO:teuthology.orchestra.run.smithi167.stdout:(142/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.9 MB/s | 16 MB 00:01 2024-09-11T22:18:10.610 INFO:teuthology.orchestra.run.smithi167.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 436 kB/s | 90 kB 00:00 2024-09-11T22:18:10.644 INFO:teuthology.orchestra.run.smithi167.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 871 kB/s | 230 kB 00:00 2024-09-11T22:18:10.645 INFO:teuthology.orchestra.run.smithi100.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.1 MB/s | 801 kB 00:00 2024-09-11T22:18:10.669 INFO:teuthology.orchestra.run.smithi167.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 388 kB/s | 20 kB 00:00 2024-09-11T22:18:10.677 INFO:teuthology.orchestra.run.smithi100.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-11T22:18:10.694 INFO:teuthology.orchestra.run.smithi167.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.9 MB/s | 191 kB 00:00 2024-09-11T22:18:10.703 INFO:teuthology.orchestra.run.smithi100.stdout:(43/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-11T22:18:10.720 INFO:teuthology.orchestra.run.smithi167.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.0 MB/s | 427 kB 00:00 2024-09-11T22:18:10.728 INFO:teuthology.orchestra.run.smithi100.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-11T22:18:10.762 INFO:teuthology.orchestra.run.smithi167.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-11T22:18:10.795 INFO:teuthology.orchestra.run.smithi100.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-11T22:18:10.820 INFO:teuthology.orchestra.run.smithi100.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-11T22:18:10.854 INFO:teuthology.orchestra.run.smithi100.stdout:(47/156): python3-cryptography-36.0.1-4.el9.x86 5.9 MB/s | 1.2 MB 00:00 2024-09-11T22:18:10.879 INFO:teuthology.orchestra.run.smithi100.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-11T22:18:10.945 INFO:teuthology.orchestra.run.smithi167.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 14 MB/s | 3.4 MB 00:00 2024-09-11T22:18:11.062 INFO:teuthology.orchestra.run.smithi167.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 7.9 MB/s | 2.3 MB 00:00 2024-09-11T22:18:11.063 INFO:teuthology.orchestra.run.smithi100.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 583 kB/s | 107 kB 00:00 2024-09-11T22:18:11.130 INFO:teuthology.orchestra.run.smithi100.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 326 kB/s | 22 kB 00:00 2024-09-11T22:18:11.138 INFO:teuthology.orchestra.run.smithi167.stdout:(151/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 7.6 MB/s | 3.2 MB 00:00 2024-09-11T22:18:11.155 INFO:teuthology.orchestra.run.smithi100.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 689 kB 00:00 2024-09-11T22:18:11.163 INFO:teuthology.orchestra.run.smithi167.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 405 kB/s | 41 kB 00:00 2024-09-11T22:18:11.197 INFO:teuthology.orchestra.run.smithi100.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 2.7 MB/s | 943 kB 00:00 2024-09-11T22:18:11.222 INFO:teuthology.orchestra.run.smithi100.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-11T22:18:11.247 INFO:teuthology.orchestra.run.smithi167.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-09-11T22:18:11.273 INFO:teuthology.orchestra.run.smithi100.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-11T22:18:11.280 INFO:teuthology.orchestra.run.smithi167.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 5.4 MB/s | 1.8 MB 00:00 2024-09-11T22:18:11.301 INFO:teuthology.orchestra.run.smithi100.stdout:(55/156): flex-2.6.4-9.el9.x86_64.rpm 1.8 MB/s | 313 kB 00:00 2024-09-11T22:18:11.347 INFO:teuthology.orchestra.run.smithi167.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-09-11T22:18:11.357 INFO:teuthology.orchestra.run.smithi100.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2024-09-11T22:18:11.382 INFO:teuthology.orchestra.run.smithi100.stdout:(57/156): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-09-11T22:18:11.397 INFO:teuthology.orchestra.run.smithi167.stdout:(156/156): NetworkManager-tui-1.49.90-1.el9.x86 960 kB/s | 249 kB 00:00 2024-09-11T22:18:11.403 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-11T22:18:11.403 INFO:teuthology.orchestra.run.smithi167.stdout:Total 27 MB/s | 226 MB 00:08 2024-09-11T22:18:11.407 INFO:teuthology.orchestra.run.smithi100.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-11T22:18:11.432 INFO:teuthology.orchestra.run.smithi100.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 600 kB/s | 45 kB 00:00 2024-09-11T22:18:11.466 INFO:teuthology.orchestra.run.smithi100.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-11T22:18:11.491 INFO:teuthology.orchestra.run.smithi100.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-11T22:18:11.525 INFO:teuthology.orchestra.run.smithi100.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 4.8 MB/s | 581 kB 00:00 2024-09-11T22:18:11.551 INFO:teuthology.orchestra.run.smithi100.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-09-11T22:18:11.576 INFO:teuthology.orchestra.run.smithi100.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-11T22:18:11.609 INFO:teuthology.orchestra.run.smithi100.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-11T22:18:11.634 INFO:teuthology.orchestra.run.smithi100.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 460 kB/s | 38 kB 00:00 2024-09-11T22:18:11.718 INFO:teuthology.orchestra.run.smithi100.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-11T22:18:11.835 INFO:teuthology.orchestra.run.smithi100.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 19 MB/s | 4.9 MB 00:00 2024-09-11T22:18:11.913 INFO:teuthology.orchestra.run.smithi100.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-11T22:18:11.961 INFO:teuthology.orchestra.run.smithi100.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-09-11T22:18:12.003 INFO:teuthology.orchestra.run.smithi100.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 3.1 MB/s | 910 kB 00:00 2024-09-11T22:18:12.036 INFO:teuthology.orchestra.run.smithi100.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-11T22:18:12.061 INFO:teuthology.orchestra.run.smithi100.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-11T22:18:12.145 INFO:teuthology.orchestra.run.smithi100.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 735 kB/s | 61 kB 00:00 2024-09-11T22:18:12.220 INFO:teuthology.orchestra.run.smithi100.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 19 MB/s | 5.8 MB 00:00 2024-09-11T22:18:12.254 INFO:teuthology.orchestra.run.smithi100.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-11T22:18:12.279 INFO:teuthology.orchestra.run.smithi100.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-11T22:18:12.354 INFO:teuthology.orchestra.run.smithi100.stdout:(78/156): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-09-11T22:18:12.371 INFO:teuthology.orchestra.run.smithi100.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 218 kB/s | 26 kB 00:00 2024-09-11T22:18:12.388 INFO:teuthology.orchestra.run.smithi100.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-09-11T22:18:12.414 INFO:teuthology.orchestra.run.smithi100.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-11T22:18:12.447 INFO:teuthology.orchestra.run.smithi100.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 593 kB/s | 35 kB 00:00 2024-09-11T22:18:12.498 INFO:teuthology.orchestra.run.smithi100.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-11T22:18:12.524 INFO:teuthology.orchestra.run.smithi100.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-09-11T22:18:12.598 INFO:teuthology.orchestra.run.smithi100.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 5.1 MB 00:00 2024-09-11T22:18:12.624 INFO:teuthology.orchestra.run.smithi100.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 420 kB/s | 42 kB 00:00 2024-09-11T22:18:12.634 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-11T22:18:12.657 INFO:teuthology.orchestra.run.smithi100.stdout:(87/156): python3-packaging-20.9-5.el9.noarch.r 485 kB/s | 77 kB 00:00 2024-09-11T22:18:12.682 INFO:teuthology.orchestra.run.smithi100.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-11T22:18:12.708 INFO:teuthology.orchestra.run.smithi100.stdout:(89/156): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-09-11T22:18:12.733 INFO:teuthology.orchestra.run.smithi100.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-11T22:18:12.759 INFO:teuthology.orchestra.run.smithi100.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 673 kB/s | 51 kB 00:00 2024-09-11T22:18:12.784 INFO:teuthology.orchestra.run.smithi100.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 710 kB/s | 54 kB 00:00 2024-09-11T22:18:12.790 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-11T22:18:12.790 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-11T22:18:12.817 INFO:teuthology.orchestra.run.smithi100.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 713 kB/s | 42 kB 00:00 2024-09-11T22:18:12.842 INFO:teuthology.orchestra.run.smithi100.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 755 kB/s | 44 kB 00:00 2024-09-11T22:18:12.876 INFO:teuthology.orchestra.run.smithi100.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-11T22:18:12.902 INFO:teuthology.orchestra.run.smithi100.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 610 kB/s | 36 kB 00:00 2024-09-11T22:18:12.927 INFO:teuthology.orchestra.run.smithi100.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-11T22:18:12.969 INFO:teuthology.orchestra.run.smithi100.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 4.4 MB/s | 304 kB 00:00 2024-09-11T22:18:12.994 INFO:teuthology.orchestra.run.smithi100.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 861 kB/s | 58 kB 00:00 2024-09-11T22:18:13.036 INFO:teuthology.orchestra.run.smithi100.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-11T22:18:13.061 INFO:teuthology.orchestra.run.smithi100.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 952 kB/s | 64 kB 00:00 2024-09-11T22:18:13.087 INFO:teuthology.orchestra.run.smithi100.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-11T22:18:13.245 INFO:teuthology.orchestra.run.smithi100.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-11T22:18:13.270 INFO:teuthology.orchestra.run.smithi100.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 107 kB/s | 22 kB 00:00 2024-09-11T22:18:13.321 INFO:teuthology.orchestra.run.smithi100.stdout:(105/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.6 MB/s | 863 kB 00:00 2024-09-11T22:18:13.371 INFO:teuthology.orchestra.run.smithi100.stdout:(106/156): abseil-cpp-20211102.0-3.el9.x86_64.r 4.3 MB/s | 548 kB 00:00 2024-09-11T22:18:13.396 INFO:teuthology.orchestra.run.smithi100.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 2.4 MB/s | 309 kB 00:00 2024-09-11T22:18:13.421 INFO:teuthology.orchestra.run.smithi100.stdout:(108/156): grpc-data-1.46.7-10.el9.noarch.rpm 197 kB/s | 19 kB 00:00 2024-09-11T22:18:13.447 INFO:teuthology.orchestra.run.smithi100.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 517 kB/s | 26 kB 00:00 2024-09-11T22:18:13.472 INFO:teuthology.orchestra.run.smithi100.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 965 kB/s | 49 kB 00:00 2024-09-11T22:18:13.498 INFO:teuthology.orchestra.run.smithi100.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-11T22:18:13.540 INFO:teuthology.orchestra.run.smithi100.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-11T22:18:13.582 INFO:teuthology.orchestra.run.smithi100.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-11T22:18:13.676 INFO:teuthology.orchestra.run.smithi100.stdout:(114/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.6 MB/s | 839 kB 00:00 2024-09-11T22:18:13.699 INFO:teuthology.orchestra.run.smithi100.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 371 kB/s | 43 kB 00:00 2024-09-11T22:18:13.724 INFO:teuthology.orchestra.run.smithi100.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 669 kB/s | 32 kB 00:00 2024-09-11T22:18:13.741 INFO:teuthology.orchestra.run.smithi100.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 336 kB/s | 14 kB 00:00 2024-09-11T22:18:13.766 INFO:teuthology.orchestra.run.smithi100.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-11T22:18:13.800 INFO:teuthology.orchestra.run.smithi100.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-11T22:18:13.825 INFO:teuthology.orchestra.run.smithi100.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-11T22:18:13.851 INFO:teuthology.orchestra.run.smithi100.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-11T22:18:13.893 INFO:teuthology.orchestra.run.smithi100.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-09-11T22:18:13.918 INFO:teuthology.orchestra.run.smithi100.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-11T22:18:13.943 INFO:teuthology.orchestra.run.smithi100.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 709 kB/s | 18 kB 00:00 2024-09-11T22:18:14.019 INFO:teuthology.orchestra.run.smithi100.stdout:(125/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.8 MB/s | 4.4 MB 00:00 2024-09-11T22:18:14.044 INFO:teuthology.orchestra.run.smithi100.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 230 kB/s | 23 kB 00:00 2024-09-11T22:18:14.069 INFO:teuthology.orchestra.run.smithi100.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-11T22:18:14.094 INFO:teuthology.orchestra.run.smithi100.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-11T22:18:14.120 INFO:teuthology.orchestra.run.smithi100.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T22:18:14.145 INFO:teuthology.orchestra.run.smithi100.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T22:18:14.196 INFO:teuthology.orchestra.run.smithi100.stdout:(131/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.5 MB/s | 2.0 MB 00:00 2024-09-11T22:18:14.221 INFO:teuthology.orchestra.run.smithi100.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 765 kB/s | 58 kB 00:00 2024-09-11T22:18:14.246 INFO:teuthology.orchestra.run.smithi100.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-11T22:18:14.280 INFO:teuthology.orchestra.run.smithi100.stdout:(134/156): python3-kubernetes-26.1.0-2.el9.noar 4.9 MB/s | 1.0 MB 00:00 2024-09-11T22:18:14.305 INFO:teuthology.orchestra.run.smithi100.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-11T22:18:14.330 INFO:teuthology.orchestra.run.smithi100.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-11T22:18:14.355 INFO:teuthology.orchestra.run.smithi100.stdout:(137/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 823 kB/s | 90 kB 00:00 2024-09-11T22:18:14.381 INFO:teuthology.orchestra.run.smithi100.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-09-11T22:18:14.406 INFO:teuthology.orchestra.run.smithi100.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-11T22:18:14.456 INFO:teuthology.orchestra.run.smithi100.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 474 kB/s | 36 kB 00:00 2024-09-11T22:18:14.482 INFO:teuthology.orchestra.run.smithi100.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-11T22:18:14.507 INFO:teuthology.orchestra.run.smithi100.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 738 kB/s | 74 kB 00:00 2024-09-11T22:18:14.533 INFO:teuthology.orchestra.run.smithi100.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-11T22:18:14.557 INFO:teuthology.orchestra.run.smithi100.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-11T22:18:14.583 INFO:teuthology.orchestra.run.smithi100.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-11T22:18:14.608 INFO:teuthology.orchestra.run.smithi100.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-11T22:18:14.633 INFO:teuthology.orchestra.run.smithi100.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-11T22:18:14.675 INFO:teuthology.orchestra.run.smithi100.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-11T22:18:14.876 INFO:teuthology.orchestra.run.smithi100.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-11T22:18:14.918 INFO:teuthology.orchestra.run.smithi100.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 9.6 MB/s | 2.3 MB 00:00 2024-09-11T22:18:14.976 INFO:teuthology.orchestra.run.smithi100.stdout:(151/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 9.2 MB/s | 3.2 MB 00:00 2024-09-11T22:18:15.001 INFO:teuthology.orchestra.run.smithi100.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 489 kB/s | 41 kB 00:00 2024-09-11T22:18:15.050 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-11T22:18:15.051 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-11T22:18:15.068 INFO:teuthology.orchestra.run.smithi100.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-11T22:18:15.110 INFO:teuthology.orchestra.run.smithi100.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 7.7 MB/s | 1.8 MB 00:00 2024-09-11T22:18:15.136 INFO:teuthology.orchestra.run.smithi100.stdout:(155/156): NetworkManager-tui-1.49.90-1.el9.x86 1.5 MB/s | 249 kB 00:00 2024-09-11T22:18:15.186 INFO:teuthology.orchestra.run.smithi100.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 20 MB/s | 2.4 MB 00:00 2024-09-11T22:18:15.190 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-11T22:18:15.191 INFO:teuthology.orchestra.run.smithi100.stdout:Total 26 MB/s | 226 MB 00:08 2024-09-11T22:18:16.369 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-11T22:18:16.520 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-11T22:18:16.521 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-11T22:18:18.738 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-11T22:18:18.738 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-11T22:18:21.416 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-11T22:18:21.535 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T22:18:21.623 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T22:18:21.840 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T22:18:21.886 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T22:18:21.911 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T22:18:21.975 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T22:18:22.308 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T22:18:22.429 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:18:22.535 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:18:22.564 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:18:22.656 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:18:22.685 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T22:18:22.901 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T22:18:23.115 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T22:18:23.144 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:18:23.249 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:18:23.278 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T22:18:23.341 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T22:18:23.371 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T22:18:23.396 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T22:18:23.598 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T22:18:23.756 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T22:18:23.886 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T22:18:24.022 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:18:24.105 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:18:24.338 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:18:24.449 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T22:18:24.540 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T22:18:24.589 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T22:18:24.628 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T22:18:24.702 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T22:18:24.754 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T22:18:24.787 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T22:18:24.830 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T22:18:24.863 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T22:18:24.891 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T22:18:24.960 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T22:18:25.014 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T22:18:25.052 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T22:18:25.095 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-11T22:18:25.095 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T22:18:25.171 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T22:18:25.207 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T22:18:25.225 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-11T22:18:25.250 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T22:18:25.279 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T22:18:25.349 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T22:18:25.383 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-11T22:18:25.394 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T22:18:25.443 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-11T22:18:25.476 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T22:18:25.484 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-11T22:18:25.510 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-11T22:18:25.566 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-11T22:18:25.627 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T22:18:25.680 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T22:18:25.906 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-11T22:18:26.019 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:18:26.141 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:18:26.170 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:18:26.211 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T22:18:26.262 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:18:26.292 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T22:18:26.301 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T22:18:26.330 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T22:18:26.364 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T22:18:26.403 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T22:18:26.444 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T22:18:26.487 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-11T22:18:26.546 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-11T22:18:26.574 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:18:26.597 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T22:18:26.656 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T22:18:26.671 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:18:26.700 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T22:18:26.711 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T22:18:26.770 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-11T22:18:26.783 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T22:18:26.793 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T22:18:26.816 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-11T22:18:26.824 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T22:18:26.935 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T22:18:26.986 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T22:18:27.015 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T22:18:27.051 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T22:18:27.095 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T22:18:27.137 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T22:18:27.179 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-11T22:18:27.272 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T22:18:27.314 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T22:18:27.330 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-11T22:18:27.355 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T22:18:27.448 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:18:27.465 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T22:18:27.516 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T22:18:27.518 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:18:27.558 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T22:18:27.592 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T22:18:27.625 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T22:18:27.726 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T22:18:27.759 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-11T22:18:27.859 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T22:18:27.879 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-11T22:18:27.899 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T22:18:27.944 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T22:18:27.979 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-11T22:18:27.983 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T22:18:28.015 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-11T22:18:28.026 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T22:18:28.050 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-11T22:18:28.060 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T22:18:28.087 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T22:18:28.115 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-11T22:18:28.122 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T22:18:28.155 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T22:18:28.167 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-11T22:18:28.197 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T22:18:28.208 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-11T22:18:28.231 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T22:18:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-11T22:18:28.285 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-11T22:18:28.312 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-11T22:18:28.326 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T22:18:28.379 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T22:18:28.381 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-11T22:18:28.410 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T22:18:28.434 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-11T22:18:28.465 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-11T22:18:28.509 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-11T22:18:28.513 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T22:18:28.563 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T22:18:28.584 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-11T22:18:28.628 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-11T22:18:28.673 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-11T22:18:28.700 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-11T22:18:28.769 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-11T22:18:28.815 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-11T22:18:28.899 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-11T22:18:29.033 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-11T22:18:29.084 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-11T22:18:29.632 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-11T22:18:29.633 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T22:18:29.633 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T22:18:29.633 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T22:18:29.633 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T22:18:29.633 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T22:18:29.633 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T22:18:29.663 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T22:18:29.702 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T22:18:29.713 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-11T22:18:29.742 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-11T22:18:29.784 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-11T22:18:29.831 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-11T22:18:29.873 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-11T22:18:29.889 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T22:18:29.917 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T22:18:29.996 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T22:18:30.044 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-11T22:18:30.102 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-11T22:18:30.156 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-11T22:18:30.228 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-11T22:18:30.260 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-11T22:18:30.296 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-11T22:18:30.343 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-11T22:18:30.404 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-11T22:18:30.447 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-11T22:18:30.489 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-11T22:18:30.650 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T22:18:30.745 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-11T22:18:30.766 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T22:18:30.799 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-11T22:18:30.841 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-11T22:18:30.943 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-11T22:18:30.975 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-11T22:18:31.023 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-11T22:18:31.065 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-11T22:18:31.089 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-11T22:18:31.190 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-11T22:18:31.319 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-11T22:18:31.375 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-11T22:18:31.412 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-11T22:18:31.459 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-11T22:18:31.502 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-11T22:18:31.534 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-11T22:18:31.564 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-11T22:18:31.598 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-11T22:18:31.631 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-11T22:18:31.673 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-11T22:18:31.708 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-11T22:18:31.794 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-11T22:18:31.846 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-11T22:18:31.885 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-11T22:18:31.989 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-11T22:18:32.019 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T22:18:32.045 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-11T22:18:32.249 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T22:18:32.276 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T22:18:32.310 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T22:18:32.631 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T22:18:32.672 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T22:18:32.762 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T22:18:32.770 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-11T22:18:32.794 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T22:18:32.817 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-11T22:18:32.830 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T22:18:32.859 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-11T22:18:32.967 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-11T22:18:33.031 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-11T22:18:33.076 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-11T22:18:33.163 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-11T22:18:33.197 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-11T22:18:33.319 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T22:18:33.359 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T22:18:33.380 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-11T22:18:33.403 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-11T22:18:33.430 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T22:18:33.460 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T22:18:33.486 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-11T22:18:34.139 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-11T22:18:34.252 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-11T22:18:35.514 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-11T22:18:35.608 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-11T22:18:35.820 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-11T22:18:35.869 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-11T22:18:36.182 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-11T22:18:36.224 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T22:18:36.234 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:18:36.266 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:18:36.314 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-11T22:18:36.345 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-11T22:18:36.387 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-11T22:18:36.835 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:18:36.869 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-11T22:18:36.870 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T22:18:36.910 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T22:18:36.961 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T22:18:36.961 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T22:18:36.961 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T22:18:36.961 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:18:36.981 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-11T22:18:37.003 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-11T22:18:37.004 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T22:18:39.623 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:18:39.658 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:18:40.220 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-11T22:18:40.255 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T22:18:40.347 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-11T22:18:40.347 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T22:18:40.347 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T22:18:40.347 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:18:40.390 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T22:18:48.986 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T22:18:48.987 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /sys 2024-09-11T22:18:48.987 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /proc 2024-09-11T22:18:48.987 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /mnt 2024-09-11T22:18:48.987 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /var/tmp 2024-09-11T22:18:48.987 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /home 2024-09-11T22:18:48.987 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /root 2024-09-11T22:18:48.987 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /tmp 2024-09-11T22:18:48.987 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:18:49.166 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T22:18:49.183 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T22:18:49.183 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:49.183 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T22:18:49.183 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:18:50.707 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T22:18:50.733 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T22:18:50.733 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:50.734 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T22:18:50.734 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T22:18:50.734 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T22:18:50.734 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:18:50.974 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T22:18:50.998 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T22:18:50.998 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:50.998 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T22:18:50.998 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T22:18:50.998 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T22:18:50.998 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:18:51.450 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T22:18:51.474 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T22:18:51.474 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:51.474 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T22:18:51.474 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T22:18:51.474 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T22:18:51.474 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:18:51.588 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T22:18:51.646 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T22:18:51.701 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T22:18:51.894 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T22:18:51.943 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T22:18:52.021 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T22:18:52.110 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T22:18:52.258 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T22:18:52.272 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-11T22:18:52.272 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /sys 2024-09-11T22:18:52.273 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /proc 2024-09-11T22:18:52.273 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /mnt 2024-09-11T22:18:52.273 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /var/tmp 2024-09-11T22:18:52.273 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /home 2024-09-11T22:18:52.273 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /root 2024-09-11T22:18:52.273 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /tmp 2024-09-11T22:18:52.273 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:18:52.310 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T22:18:52.350 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T22:18:52.386 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T22:18:52.452 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T22:18:52.469 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-11T22:18:52.469 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:52.469 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T22:18:52.469 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:18:52.795 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T22:18:52.827 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T22:18:52.859 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T22:18:52.922 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T22:18:52.950 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T22:18:53.964 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T22:18:53.991 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-11T22:18:53.991 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:53.991 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T22:18:53.991 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T22:18:53.991 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T22:18:53.991 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:18:53.997 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T22:18:54.036 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T22:18:54.214 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T22:18:54.237 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-11T22:18:54.237 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:54.237 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T22:18:54.237 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T22:18:54.238 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T22:18:54.238 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:18:54.673 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T22:18:54.696 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-11T22:18:54.697 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:54.697 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T22:18:54.697 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T22:18:54.697 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T22:18:54.697 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:18:54.795 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-11T22:18:54.852 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-11T22:18:54.915 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-11T22:18:55.005 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T22:18:55.036 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T22:18:55.104 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-11T22:18:55.141 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T22:18:55.157 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-11T22:18:55.227 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-11T22:18:55.306 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T22:18:55.325 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-11T22:18:55.330 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T22:18:55.354 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T22:18:55.354 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:55.354 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T22:18:55.354 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T22:18:55.354 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T22:18:55.354 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:18:55.406 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T22:18:55.418 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T22:18:55.465 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-11T22:18:55.515 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T22:18:55.516 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-11T22:18:55.548 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-11T22:18:55.569 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T22:18:55.575 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-11T22:18:56.026 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T22:18:56.058 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-11T22:18:56.089 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-11T22:18:56.152 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-11T22:18:56.181 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T22:18:56.499 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T22:18:56.534 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T22:18:56.558 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T22:18:56.558 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:56.558 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T22:18:56.558 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T22:18:56.558 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T22:18:56.558 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:18:56.601 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T22:18:56.624 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T22:18:56.625 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:56.625 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T22:18:56.625 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:18:56.677 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T22:18:56.701 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T22:18:56.701 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:56.701 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T22:18:56.701 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T22:18:56.701 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T22:18:56.701 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:18:57.020 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T22:18:57.043 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T22:18:57.043 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:57.043 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T22:18:57.043 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T22:18:57.043 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T22:18:57.043 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:18:57.228 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-11T22:18:57.260 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T22:18:58.221 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-11T22:18:58.250 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T22:18:58.352 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-11T22:18:58.512 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-11T22:18:58.535 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T22:18:58.560 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-11T22:18:58.560 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:58.560 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T22:18:58.560 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T22:18:58.560 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T22:18:58.560 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:18:58.611 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T22:18:58.622 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-11T22:18:58.723 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-11T22:18:58.779 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-11T22:18:59.703 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-11T22:18:59.730 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T22:18:59.754 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-11T22:18:59.755 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:59.755 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T22:18:59.755 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T22:18:59.755 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T22:18:59.755 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:18:59.797 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T22:18:59.820 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-11T22:18:59.820 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:59.820 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T22:18:59.821 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:18:59.865 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T22:18:59.888 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-11T22:18:59.888 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:18:59.888 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T22:18:59.888 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T22:18:59.888 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T22:18:59.888 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:00.190 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T22:19:00.214 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-11T22:19:00.214 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T22:19:00.214 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T22:19:00.214 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T22:19:00.214 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T22:19:00.214 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:01.640 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T22:19:01.682 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T22:19:01.722 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T22:19:01.755 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T22:19:01.782 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T22:19:01.985 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T22:19:02.029 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T22:19:02.060 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T22:19:02.090 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T22:19:02.136 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T22:19:02.700 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:19:02.743 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:19:02.763 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:19:03.605 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T22:19:03.682 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T22:19:03.738 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T22:19:03.839 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T22:19:03.877 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T22:19:03.903 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T22:19:03.928 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T22:19:03.928 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T22:19:04.021 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T22:19:04.021 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T22:19:04.105 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T22:19:04.130 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T22:19:04.136 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:19:04.136 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:19:04.324 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:19:04.324 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T22:19:04.417 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T22:19:04.481 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:19:04.794 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-11T22:19:04.835 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-11T22:19:04.877 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-11T22:19:04.908 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-11T22:19:04.936 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-11T22:19:05.139 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-11T22:19:05.183 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-11T22:19:05.213 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-11T22:19:05.244 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-11T22:19:05.290 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-11T22:19:05.842 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:19:05.887 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:19:05.907 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-11T22:19:06.738 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-11T22:19:06.825 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-11T22:19:06.871 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-11T22:19:06.965 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-11T22:19:06.994 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-11T22:19:07.020 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-11T22:19:07.046 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-11T22:19:07.046 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T22:19:07.130 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-11T22:19:07.130 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T22:19:07.214 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-11T22:19:07.239 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-11T22:19:07.244 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:19:07.244 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:19:07.424 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-11T22:19:07.424 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T22:19:07.508 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-11T22:19:07.582 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:19:10.630 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:19:10.630 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T22:19:10.630 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T22:19:10.630 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T22:19:10.630 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T22:19:10.630 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T22:19:10.631 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T22:19:10.631 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T22:19:10.631 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:19:10.633 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:19:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T22:19:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T22:19:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T22:19:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:19:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T22:19:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T22:19:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T22:19:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T22:19:10.634 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T22:19:10.652 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T22:19:10.652 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T22:19:10.652 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T22:19:10.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T22:19:10.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T22:19:10.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T22:19:10.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T22:19:10.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T22:19:10.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T22:19:10.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T22:19:10.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T22:19:10.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T22:19:10.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T22:19:10.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T22:19:10.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T22:19:10.653 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T22:19:10.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T22:19:10.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T22:19:10.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T22:19:10.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T22:19:10.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T22:19:10.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T22:19:10.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T22:19:10.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T22:19:10.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T22:19:10.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T22:19:10.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T22:19:10.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T22:19:10.654 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T22:19:10.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T22:19:10.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T22:19:10.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T22:19:10.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T22:19:10.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T22:19:10.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T22:19:10.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T22:19:10.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T22:19:10.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T22:19:10.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T22:19:10.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T22:19:10.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T22:19:10.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T22:19:10.655 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T22:19:10.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T22:19:10.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T22:19:10.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T22:19:10.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T22:19:10.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T22:19:10.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T22:19:10.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T22:19:10.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T22:19:10.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T22:19:10.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T22:19:10.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T22:19:10.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T22:19:10.656 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T22:19:10.657 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T22:19:10.657 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T22:19:10.657 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T22:19:10.657 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T22:19:10.657 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T22:19:10.657 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T22:19:10.657 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T22:19:10.657 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T22:19:10.657 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T22:19:10.657 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T22:19:10.657 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T22:19:10.662 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T22:19:10.662 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T22:19:10.662 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T22:19:10.662 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T22:19:10.662 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T22:19:10.662 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T22:19:10.662 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T22:19:10.662 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T22:19:10.662 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T22:19:10.662 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T22:19:10.663 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T22:19:10.663 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T22:19:10.663 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T22:19:10.663 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T22:19:10.664 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T22:19:10.664 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T22:19:10.664 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T22:19:10.664 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T22:19:10.664 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T22:19:10.664 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T22:19:10.664 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T22:19:10.665 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T22:19:10.665 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T22:19:10.665 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T22:19:10.665 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T22:19:10.665 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T22:19:10.665 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T22:19:10.666 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T22:19:10.666 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T22:19:10.666 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T22:19:10.666 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T22:19:10.666 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T22:19:10.666 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T22:19:10.666 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T22:19:10.666 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T22:19:10.666 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T22:19:10.667 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T22:19:10.667 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T22:19:10.667 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T22:19:10.667 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T22:19:10.667 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T22:19:10.667 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T22:19:10.667 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T22:19:10.667 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T22:19:10.667 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T22:19:10.667 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T22:19:10.667 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T22:19:10.667 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T22:19:10.667 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T22:19:10.668 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T22:19:10.668 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T22:19:10.668 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T22:19:10.668 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T22:19:10.668 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T22:19:10.668 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T22:19:10.668 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T22:19:10.668 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T22:19:10.668 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T22:19:10.668 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T22:19:10.668 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T22:19:10.668 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T22:19:10.668 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T22:19:10.668 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T22:19:10.669 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T22:19:10.669 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T22:19:10.669 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T22:19:10.669 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T22:19:10.669 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T22:19:10.669 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T22:19:10.669 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T22:19:10.669 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T22:19:10.669 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T22:19:10.669 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T22:19:10.669 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T22:19:10.669 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T22:19:10.669 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T22:19:10.669 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T22:19:10.670 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T22:19:13.232 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:19:13.233 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:13.233 INFO:teuthology.orchestra.run.smithi167.stdout:Upgraded: 2024-09-11T22:19:13.233 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T22:19:13.233 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T22:19:13.233 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T22:19:13.233 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T22:19:13.233 INFO:teuthology.orchestra.run.smithi167.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.233 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.233 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T22:19:13.233 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T22:19:13.233 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-11T22:19:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T22:19:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T22:19:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T22:19:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T22:19:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:19:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.234 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:19:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:19:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:19:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:19:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:19:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:19:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:19:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:19:13.235 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:19:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T22:19:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T22:19:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T22:19:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T22:19:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T22:19:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T22:19:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T22:19:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T22:19:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T22:19:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T22:19:13.236 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T22:19:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T22:19:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T22:19:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T22:19:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T22:19:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T22:19:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T22:19:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.237 INFO:teuthology.orchestra.run.smithi167.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T22:19:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T22:19:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T22:19:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T22:19:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T22:19:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T22:19:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T22:19:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T22:19:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T22:19:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T22:19:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T22:19:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T22:19:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T22:19:13.238 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T22:19:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T22:19:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T22:19:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T22:19:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T22:19:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T22:19:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T22:19:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T22:19:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T22:19:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T22:19:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.239 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T22:19:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T22:19:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T22:19:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T22:19:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T22:19:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T22:19:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T22:19:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T22:19:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T22:19:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T22:19:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T22:19:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T22:19:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T22:19:13.240 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T22:19:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T22:19:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T22:19:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T22:19:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T22:19:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T22:19:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T22:19:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T22:19:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T22:19:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T22:19:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T22:19:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T22:19:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T22:19:13.241 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T22:19:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T22:19:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T22:19:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T22:19:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T22:19:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T22:19:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T22:19:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T22:19:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T22:19:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T22:19:13.242 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T22:19:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T22:19:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T22:19:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T22:19:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T22:19:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T22:19:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T22:19:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T22:19:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T22:19:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T22:19:13.243 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T22:19:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T22:19:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T22:19:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T22:19:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T22:19:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T22:19:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T22:19:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T22:19:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T22:19:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T22:19:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T22:19:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T22:19:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.244 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T22:19:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T22:19:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T22:19:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T22:19:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T22:19:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T22:19:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T22:19:13.245 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:13.246 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-11T22:19:13.508 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:19:13.508 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-11T22:19:13.509 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-11T22:19:13.509 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-11T22:19:13.509 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-11T22:19:13.509 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-11T22:19:13.509 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-11T22:19:13.509 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-11T22:19:13.509 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-11T22:19:13.509 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-11T22:19:13.510 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-11T22:19:13.510 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-11T22:19:13.510 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-11T22:19:13.510 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-11T22:19:13.510 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-11T22:19:13.510 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-11T22:19:13.510 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-11T22:19:13.510 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-11T22:19:13.510 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-11T22:19:13.510 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-11T22:19:13.510 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-11T22:19:13.510 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-11T22:19:13.510 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-11T22:19:13.510 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-11T22:19:13.511 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-11T22:19:13.511 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-11T22:19:13.511 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-11T22:19:13.511 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-11T22:19:13.524 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-11T22:19:13.524 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-11T22:19:13.525 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-11T22:19:13.525 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-11T22:19:13.525 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-11T22:19:13.525 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-11T22:19:13.525 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-11T22:19:13.525 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-11T22:19:13.525 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-11T22:19:13.525 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-11T22:19:13.525 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-11T22:19:13.525 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-11T22:19:13.525 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-11T22:19:13.525 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-11T22:19:13.525 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-11T22:19:13.525 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-11T22:19:13.526 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-11T22:19:13.526 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-11T22:19:13.526 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-11T22:19:13.526 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-11T22:19:13.526 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-11T22:19:13.526 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-11T22:19:13.526 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-11T22:19:13.526 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-11T22:19:13.526 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-11T22:19:13.527 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-11T22:19:13.527 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-11T22:19:13.527 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-11T22:19:13.527 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-11T22:19:13.527 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-11T22:19:13.527 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-11T22:19:13.527 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-11T22:19:13.527 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-11T22:19:13.527 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-11T22:19:13.527 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-11T22:19:13.527 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-11T22:19:13.527 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-11T22:19:13.527 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-11T22:19:13.527 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-11T22:19:13.528 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-11T22:19:13.528 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-11T22:19:13.528 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-11T22:19:13.528 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-11T22:19:13.528 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-11T22:19:13.528 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-11T22:19:13.528 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-11T22:19:13.528 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-11T22:19:13.528 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-11T22:19:13.528 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-11T22:19:13.528 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-11T22:19:13.529 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-11T22:19:13.529 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-11T22:19:13.529 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-11T22:19:13.529 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-11T22:19:13.529 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-11T22:19:13.529 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-11T22:19:13.529 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-11T22:19:13.529 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-11T22:19:13.529 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-11T22:19:13.529 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-11T22:19:13.529 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-11T22:19:13.529 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-11T22:19:13.530 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-11T22:19:13.530 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-11T22:19:13.530 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-11T22:19:13.530 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-11T22:19:13.530 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-11T22:19:13.530 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-11T22:19:13.530 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-11T22:19:13.530 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-11T22:19:13.530 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-11T22:19:13.530 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-11T22:19:13.531 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-11T22:19:13.531 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-11T22:19:13.531 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-11T22:19:13.531 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-11T22:19:13.531 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-11T22:19:13.531 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-11T22:19:13.531 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-11T22:19:13.531 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-11T22:19:13.531 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-11T22:19:13.531 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-11T22:19:13.531 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-11T22:19:13.531 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-11T22:19:13.531 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-11T22:19:13.531 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-11T22:19:13.532 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-11T22:19:13.532 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-11T22:19:13.532 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-11T22:19:13.532 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-11T22:19:13.532 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-11T22:19:13.532 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-11T22:19:13.532 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-11T22:19:13.532 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-11T22:19:13.532 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-11T22:19:13.532 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-11T22:19:13.532 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-11T22:19:13.532 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-11T22:19:13.532 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-11T22:19:13.533 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-11T22:19:13.533 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-11T22:19:13.533 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-11T22:19:13.533 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-11T22:19:13.533 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-11T22:19:13.533 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-11T22:19:13.533 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-11T22:19:13.533 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-11T22:19:13.533 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-11T22:19:13.533 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-11T22:19:13.533 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-11T22:19:13.533 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-11T22:19:13.533 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-11T22:19:13.533 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-11T22:19:13.534 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-11T22:19:13.535 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-11T22:19:13.688 DEBUG:teuthology.parallel:result is None 2024-09-11T22:19:16.213 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-11T22:19:16.213 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:16.214 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-09-11T22:19:16.214 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T22:19:16.214 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T22:19:16.214 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T22:19:16.214 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T22:19:16.214 INFO:teuthology.orchestra.run.smithi100.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.214 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.214 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T22:19:16.214 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T22:19:16.214 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-11T22:19:16.214 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T22:19:16.214 INFO:teuthology.orchestra.run.smithi100.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T22:19:16.214 INFO:teuthology.orchestra.run.smithi100.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T22:19:16.215 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T22:19:16.215 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.215 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.215 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.215 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.215 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:19:16.215 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.215 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.215 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.215 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:19:16.215 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:19:16.215 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:19:16.215 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:19:16.215 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:19:16.216 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.216 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.216 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:19:16.216 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.216 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.216 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.216 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:19:16.216 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:19:16.216 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.216 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.216 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-11T22:19:16.216 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T22:19:16.216 INFO:teuthology.orchestra.run.smithi100.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T22:19:16.217 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T22:19:16.217 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T22:19:16.217 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T22:19:16.217 INFO:teuthology.orchestra.run.smithi100.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T22:19:16.217 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T22:19:16.217 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T22:19:16.217 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T22:19:16.217 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T22:19:16.217 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T22:19:16.217 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.217 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.217 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.217 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T22:19:16.218 INFO:teuthology.orchestra.run.smithi100.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T22:19:16.218 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T22:19:16.218 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T22:19:16.218 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T22:19:16.218 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.218 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.218 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T22:19:16.218 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.218 INFO:teuthology.orchestra.run.smithi100.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T22:19:16.218 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T22:19:16.218 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T22:19:16.218 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T22:19:16.218 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T22:19:16.218 INFO:teuthology.orchestra.run.smithi100.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T22:19:16.219 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T22:19:16.219 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T22:19:16.219 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T22:19:16.219 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T22:19:16.219 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T22:19:16.219 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T22:19:16.219 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T22:19:16.219 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T22:19:16.219 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T22:19:16.219 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T22:19:16.219 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T22:19:16.219 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T22:19:16.219 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T22:19:16.219 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T22:19:16.220 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T22:19:16.220 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T22:19:16.220 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T22:19:16.220 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.220 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.220 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.220 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T22:19:16.220 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T22:19:16.220 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T22:19:16.220 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T22:19:16.220 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T22:19:16.220 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T22:19:16.220 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T22:19:16.221 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T22:19:16.221 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T22:19:16.221 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T22:19:16.221 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T22:19:16.221 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T22:19:16.221 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T22:19:16.221 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T22:19:16.221 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T22:19:16.221 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T22:19:16.221 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T22:19:16.221 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T22:19:16.221 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T22:19:16.221 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T22:19:16.222 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T22:19:16.222 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T22:19:16.222 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T22:19:16.222 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T22:19:16.222 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T22:19:16.222 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T22:19:16.222 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T22:19:16.222 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T22:19:16.222 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T22:19:16.222 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T22:19:16.222 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T22:19:16.222 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T22:19:16.222 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T22:19:16.222 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T22:19:16.223 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T22:19:16.223 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T22:19:16.223 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T22:19:16.223 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T22:19:16.223 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T22:19:16.223 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T22:19:16.223 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.223 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.223 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T22:19:16.223 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T22:19:16.223 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T22:19:16.223 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.223 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T22:19:16.223 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T22:19:16.224 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T22:19:16.224 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T22:19:16.224 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T22:19:16.224 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T22:19:16.224 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T22:19:16.224 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T22:19:16.224 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T22:19:16.224 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T22:19:16.224 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T22:19:16.224 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T22:19:16.224 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T22:19:16.224 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T22:19:16.224 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T22:19:16.224 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.225 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.225 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-11T22:19:16.225 INFO:teuthology.orchestra.run.smithi100.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T22:19:16.225 INFO:teuthology.orchestra.run.smithi100.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T22:19:16.225 INFO:teuthology.orchestra.run.smithi100.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T22:19:16.225 INFO:teuthology.orchestra.run.smithi100.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T22:19:16.225 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T22:19:16.225 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T22:19:16.225 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T22:19:16.226 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:16.226 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-11T22:19:16.622 DEBUG:teuthology.parallel:result is None 2024-09-11T22:19:16.623 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:19:16.768 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T22:19:16.790 INFO:teuthology.orchestra.run.smithi100.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T22:19:16.790 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T22:19:16.791 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T22:19:16.792 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T22:19:16.943 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T22:19:16.970 INFO:teuthology.orchestra.run.smithi167.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-11T22:19:16.970 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-11T22:19:16.970 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-11T22:19:16.972 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T22:19:16.972 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:16.972 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T22:19:16.999 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T22:19:16.999 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T22:19:17.042 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T22:19:17.043 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:17.043 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T22:19:17.069 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T22:19:17.134 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T22:19:17.134 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T22:19:17.163 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T22:19:17.232 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T22:19:17.232 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:17.232 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T22:19:17.257 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T22:19:17.322 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T22:19:17.322 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T22:19:17.349 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T22:19:17.416 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T22:19:17.416 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:17.416 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T22:19:17.441 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T22:19:17.506 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T22:19:17.506 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T22:19:17.532 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T22:19:17.599 INFO:teuthology.run_tasks:Running task ceph... 2024-09-11T22:19:17.695 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-11T22:19:17.695 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /var/log/ceph 2024-09-11T22:19:17.698 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 777 /var/log/ceph 2024-09-11T22:19:17.723 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-11T22:19:17.723 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T22:19:17.762 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T22:19:17.788 INFO:tasks.ceph:Creating extra log directories... 2024-09-11T22:19:17.788 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T22:19:17.826 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T22:19:17.859 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-11T22:19:17.860 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-11T22:19:17.860 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-11T22:19:17.860 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:17.860 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-11T22:19:17.905 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-11T22:19:18.016 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-11T22:19:18.054 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T22:19:18.055 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-11T22:19:18.070 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-11T22:19:18.183 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-11T22:19:18.213 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-11T22:19:18.213 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-11T22:19:18.213 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901420', 'branch': 'squid', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7901420', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 481, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'sleep_before_teardown': 0, 'subset': '57/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi100.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLoEJrCrBBIs15bJlc7xNGFpBTrZM6m8k4P0HQ5ANyyB8o92Si5xu4bDryGwj5HRhDjFQKRoQuGUlZWvQO7YbO0=', 'smithi167.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFCzhNT3edH+qRJs8zcNb4ydg2SJdfB69ho/IF585eB9pnZ/Qib94uHdKnUJ+Us8d+//JuiKo6CRIaQV8XkeCKY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'overall HEALTH_', '\\(MON_DOWN\\)', 'SLOW_OPS', 'slow request'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'mon_thrash': {'check_mds_failover': True, 'revive_delay': 20, 'thrash_delay': 10}}, {'workunit': {'clients': {'all': ['suites/ffsb.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_21:24:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-11T22:19:18.214 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T22:19:18.216 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T22:19:18.263 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T22:19:18.272 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T22:19:18.328 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:18.328 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T22:19:18.349 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T22:19:18.349 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2024-09-11T22:19:18.405 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T22:19:18.405 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:19:18.405 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-11T22:19:18.405 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:19:18.405 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:19:18.405 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-11 22:19:07.977937123 +0000 2024-09-11T22:19:18.405 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-11 22:17:20.810442053 +0000 2024-09-11T22:19:18.406 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-11 22:17:20.810442053 +0000 2024-09-11T22:19:18.406 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-11 22:17:20.810442053 +0000 2024-09-11T22:19:18.406 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T22:19:18.468 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-11T22:19:18.468 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-11T22:19:18.468 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000295482 s, 1.7 MB/s 2024-09-11T22:19:18.469 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T22:19:18.525 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2024-09-11T22:19:18.581 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T22:19:18.581 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:19:18.581 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-11T22:19:18.581 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:19:18.581 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:19:18.581 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-11 22:19:07.978937096 +0000 2024-09-11T22:19:18.581 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-11 22:17:21.119433656 +0000 2024-09-11T22:19:18.581 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-11 22:17:21.119433656 +0000 2024-09-11T22:19:18.581 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-11 22:17:21.119433656 +0000 2024-09-11T22:19:18.582 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T22:19:18.647 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-11T22:19:18.648 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-11T22:19:18.648 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000226267 s, 2.3 MB/s 2024-09-11T22:19:18.649 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T22:19:18.705 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2024-09-11T22:19:18.761 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T22:19:18.761 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:19:18.761 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-11T22:19:18.761 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:19:18.762 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:19:18.762 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-11 22:19:07.978937096 +0000 2024-09-11T22:19:18.762 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-11 22:17:21.436425042 +0000 2024-09-11T22:19:18.762 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-11 22:17:21.436425042 +0000 2024-09-11T22:19:18.762 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-11 22:17:21.436425042 +0000 2024-09-11T22:19:18.763 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T22:19:18.824 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-11T22:19:18.824 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-11T22:19:18.825 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000193753 s, 2.6 MB/s 2024-09-11T22:19:18.826 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T22:19:18.882 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2024-09-11T22:19:18.937 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T22:19:18.938 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:19:18.938 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-11T22:19:18.938 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:19:18.938 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:19:18.938 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-11 22:19:07.979937070 +0000 2024-09-11T22:19:18.938 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-11 22:17:21.802415097 +0000 2024-09-11T22:19:18.938 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-11 22:17:21.802415097 +0000 2024-09-11T22:19:18.938 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-11 22:17:21.802415097 +0000 2024-09-11T22:19:18.938 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T22:19:19.001 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-11T22:19:19.002 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-11T22:19:19.002 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000187252 s, 2.7 MB/s 2024-09-11T22:19:19.003 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T22:19:19.059 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T22:19:19.060 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T22:19:19.060 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T22:19:19.077 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T22:19:19.077 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_1 2024-09-11T22:19:19.134 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T22:19:19.134 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:19:19.134 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-11T22:19:19.134 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:19:19.134 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:19:19.134 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-11 22:19:04.846771608 +0000 2024-09-11T22:19:19.134 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-11 22:17:20.280130607 +0000 2024-09-11T22:19:19.134 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-11 22:17:20.280130607 +0000 2024-09-11T22:19:19.134 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-11 22:17:20.280130607 +0000 2024-09-11T22:19:19.135 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T22:19:19.199 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-11T22:19:19.199 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-11T22:19:19.199 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000212003 s, 2.4 MB/s 2024-09-11T22:19:19.200 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T22:19:19.258 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_2 2024-09-11T22:19:19.315 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T22:19:19.315 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:19:19.316 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-11T22:19:19.316 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:19:19.316 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:19:19.316 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-11 22:19:04.847771590 +0000 2024-09-11T22:19:19.316 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-11 22:17:20.615124815 +0000 2024-09-11T22:19:19.316 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-11 22:17:20.615124815 +0000 2024-09-11T22:19:19.316 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-11 22:17:20.615124815 +0000 2024-09-11T22:19:19.316 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T22:19:19.380 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-11T22:19:19.380 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-11T22:19:19.380 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.00016927 s, 3.0 MB/s 2024-09-11T22:19:19.382 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T22:19:19.438 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_3 2024-09-11T22:19:19.494 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T22:19:19.494 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:19:19.494 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-11T22:19:19.494 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:19:19.494 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:19:19.494 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-11 22:19:04.847771590 +0000 2024-09-11T22:19:19.494 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-11 22:17:20.935119283 +0000 2024-09-11T22:19:19.494 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-11 22:17:20.935119283 +0000 2024-09-11T22:19:19.495 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-11 22:17:20.935119283 +0000 2024-09-11T22:19:19.495 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T22:19:19.558 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-11T22:19:19.558 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-11T22:19:19.558 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000194076 s, 2.6 MB/s 2024-09-11T22:19:19.559 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T22:19:19.616 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_4 2024-09-11T22:19:19.671 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T22:19:19.671 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T22:19:19.671 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-11T22:19:19.671 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:19:19.671 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T22:19:19.671 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-11 22:19:04.848771572 +0000 2024-09-11T22:19:19.671 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-11 22:17:21.296113048 +0000 2024-09-11T22:19:19.671 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-11 22:17:21.296113048 +0000 2024-09-11T22:19:19.671 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-11 22:17:21.296113048 +0000 2024-09-11T22:19:19.672 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T22:19:19.733 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-11T22:19:19.734 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-11T22:19:19.734 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.00016777 s, 3.1 MB/s 2024-09-11T22:19:19.736 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T22:19:19.792 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T22:19:19.792 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-11T22:19:19.792 INFO:tasks.ceph:Generating config... 2024-09-11T22:19:19.794 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-11T22:19:19.794 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-09-11T22:19:19.794 INFO:tasks.ceph:[client] debug client = 20 2024-09-11T22:19:19.794 INFO:tasks.ceph:[client] debug ms = 1 2024-09-11T22:19:19.794 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-11T22:19:19.794 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-11T22:19:19.795 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-11T22:19:19.795 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-11T22:19:19.795 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-11T22:19:19.795 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-09-11T22:19:19.795 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-09-11T22:19:19.795 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-09-11T22:19:19.795 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-09-11T22:19:19.795 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-11T22:19:19.795 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-11T22:19:19.795 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-09-11T22:19:19.795 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-11T22:19:19.795 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-11T22:19:19.795 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-09-11T22:19:19.795 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-09-11T22:19:19.796 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-11T22:19:19.796 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-11T22:19:19.796 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-11T22:19:19.796 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-11T22:19:19.796 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-11T22:19:19.796 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-11T22:19:19.796 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-11T22:19:19.796 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-11T22:19:19.796 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-11T22:19:19.796 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-11T22:19:19.796 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-11T22:19:19.796 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-11T22:19:19.796 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-11T22:19:19.796 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-11T22:19:19.797 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-11T22:19:19.797 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-11T22:19:19.797 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-11T22:19:19.797 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-11T22:19:19.797 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-11T22:19:19.797 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-11T22:19:19.797 INFO:tasks.ceph:[osd] filestore flush min = 0 2024-09-11T22:19:19.797 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-11T22:19:19.797 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-11T22:19:19.797 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-11T22:19:19.797 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-11T22:19:19.797 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-11T22:19:19.797 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-11T22:19:19.798 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-11T22:19:19.798 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-11T22:19:19.798 INFO:tasks.ceph:Setting up mon.a... 2024-09-11T22:19:19.798 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-11T22:19:19.849 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.keyring 2024-09-11T22:19:19.851 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-11T22:19:19.895 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T22:19:19.961 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.100'), ('mon.b', '172.21.15.167'), ('mon.c', '[v2:172.21.15.167:3301,v1:172.21.15.167:6790]')] 2024-09-11T22:19:19.962 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.100,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-11T22:19:19.963 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:19.963 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T22:19:20.017 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.100 --add b 172.21.15.167 --addv c '[v2:172.21.15.167:3301,v1:172.21.15.167:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:19:20.104 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:19:20.104 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: generated fsid e9259096-4424-4dcb-839f-82ac34412ee2 2024-09-11T22:19:20.104 INFO:teuthology.orchestra.run.smithi100.stdout:setting min_mon_release = quincy 2024-09-11T22:19:20.104 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 0 2024-09-11T22:19:20.104 INFO:teuthology.orchestra.run.smithi100.stdout:fsid e9259096-4424-4dcb-839f-82ac34412ee2 2024-09-11T22:19:20.104 INFO:teuthology.orchestra.run.smithi100.stdout:last_changed 2024-09-11T22:19:20.104546+0000 2024-09-11T22:19:20.104 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-09-11T22:19:20.104546+0000 2024-09-11T22:19:20.104 INFO:teuthology.orchestra.run.smithi100.stdout:min_mon_release 17 (quincy) 2024-09-11T22:19:20.104 INFO:teuthology.orchestra.run.smithi100.stdout:election_strategy: 1 2024-09-11T22:19:20.105 INFO:teuthology.orchestra.run.smithi100.stdout:0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-09-11T22:19:20.105 INFO:teuthology.orchestra.run.smithi100.stdout:1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.b 2024-09-11T22:19:20.105 INFO:teuthology.orchestra.run.smithi100.stdout:2: [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] mon.c 2024-09-11T22:19:20.105 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-11T22:19:20.106 DEBUG:teuthology.orchestra.run.smithi100:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T22:19:20.122 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e9259096-4424-4dcb-839f-82ac34412ee2... 2024-09-11T22:19:20.123 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T22:19:20.165 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T22:19:20.204 INFO:teuthology.orchestra.run.smithi100.stdout:[global] 2024-09-11T22:19:20.205 INFO:teuthology.orchestra.run.smithi100.stdout: chdir = "" 2024-09-11T22:19:20.205 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T22:19:20.205 INFO:teuthology.orchestra.run.smithi100.stdout: auth supported = cephx 2024-09-11T22:19:20.205 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.205 INFO:teuthology.orchestra.run.smithi100.stdout: filestore xattr use omap = true 2024-09-11T22:19:20.205 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.206 INFO:teuthology.orchestra.run.smithi100.stdout: mon clock drift allowed = 1.000 2024-09-11T22:19:20.206 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.206 INFO:teuthology.orchestra.run.smithi100.stdout: osd crush chooseleaf type = 0 2024-09-11T22:19:20.206 INFO:teuthology.orchestra.run.smithi100.stdout: auth debug = true 2024-09-11T22:19:20.206 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.206 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on old message = true 2024-09-11T22:19:20.206 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on bug = true 2024-09-11T22:19:20.206 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.206 INFO:teuthology.orchestra.run.smithi100.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T22:19:20.206 INFO:teuthology.orchestra.run.smithi100.stdout: mon pg warn max object skew = 0 2024-09-11T22:19:20.206 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.206 INFO:teuthology.orchestra.run.smithi100.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T22:19:20.206 INFO:teuthology.orchestra.run.smithi100.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T22:19:20.207 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.207 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default size = 2 2024-09-11T22:19:20.207 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.207 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow primary affinity = true 2024-09-11T22:19:20.207 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow pg remap = true 2024-09-11T22:19:20.207 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on legacy crush tunables = false 2024-09-11T22:19:20.207 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on crush straw calc version zero = false 2024-09-11T22:19:20.207 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on no sortbitwise = false 2024-09-11T22:19:20.207 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on osd down out interval zero = false 2024-09-11T22:19:20.207 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on too few osds = false 2024-09-11T22:19:20.207 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T22:19:20.207 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T22:19:20.208 INFO:teuthology.orchestra.run.smithi100.stdout: mon_allow_pool_size_one = true 2024-09-11T22:19:20.208 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.208 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T22:19:20.208 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.208 INFO:teuthology.orchestra.run.smithi100.stdout: osd default data pool replay window = 5 2024-09-11T22:19:20.208 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.208 INFO:teuthology.orchestra.run.smithi100.stdout: mon allow pool delete = true 2024-09-11T22:19:20.208 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.208 INFO:teuthology.orchestra.run.smithi100.stdout: mon cluster log file level = debug 2024-09-11T22:19:20.208 INFO:teuthology.orchestra.run.smithi100.stdout: debug asserts on shutdown = true 2024-09-11T22:19:20.208 INFO:teuthology.orchestra.run.smithi100.stdout: mon health detail to clog = false 2024-09-11T22:19:20.209 INFO:teuthology.orchestra.run.smithi100.stdout: mon host = "172.21.15.100,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-09-11T22:19:20.209 INFO:teuthology.orchestra.run.smithi100.stdout: fsid = e9259096-4424-4dcb-839f-82ac34412ee2 2024-09-11T22:19:20.209 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.209 INFO:teuthology.orchestra.run.smithi100.stdout:[osd] 2024-09-11T22:19:20.209 INFO:teuthology.orchestra.run.smithi100.stdout: osd journal size = 100 2024-09-11T22:19:20.209 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.209 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub load threshold = 5.0 2024-09-11T22:19:20.209 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub max interval = 600 2024-09-11T22:19:20.209 INFO:teuthology.orchestra.run.smithi100.stdout: osd mclock profile = high_recovery_ops 2024-09-11T22:19:20.209 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.209 INFO:teuthology.orchestra.run.smithi100.stdout: osd recover clone overlap = true 2024-09-11T22:19:20.209 INFO:teuthology.orchestra.run.smithi100.stdout: osd recovery max chunk = 1048576 2024-09-11T22:19:20.209 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.210 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug shutdown = true 2024-09-11T22:19:20.210 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug op order = true 2024-09-11T22:19:20.210 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug verify stray on activate = true 2024-09-11T22:19:20.210 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug trim objects = true 2024-09-11T22:19:20.210 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.210 INFO:teuthology.orchestra.run.smithi100.stdout: osd open classes on start = true 2024-09-11T22:19:20.210 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug pg log writeout = true 2024-09-11T22:19:20.210 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.210 INFO:teuthology.orchestra.run.smithi100.stdout: osd deep scrub update digest min age = 30 2024-09-11T22:19:20.210 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.210 INFO:teuthology.orchestra.run.smithi100.stdout: osd map max advance = 10 2024-09-11T22:19:20.210 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.211 INFO:teuthology.orchestra.run.smithi100.stdout: journal zero on create = true 2024-09-11T22:19:20.211 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.211 INFO:teuthology.orchestra.run.smithi100.stdout: filestore ondisk finisher threads = 3 2024-09-11T22:19:20.211 INFO:teuthology.orchestra.run.smithi100.stdout: filestore apply finisher threads = 3 2024-09-11T22:19:20.211 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.211 INFO:teuthology.orchestra.run.smithi100.stdout: bdev debug aio = true 2024-09-11T22:19:20.212 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug misdirected ops = true 2024-09-11T22:19:20.212 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore block size = 96636764160 2024-09-11T22:19:20.212 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore compression mode = aggressive 2024-09-11T22:19:20.212 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore fsck on mount = True 2024-09-11T22:19:20.212 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluefs = 20 2024-09-11T22:19:20.212 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluestore = 20 2024-09-11T22:19:20.213 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-09-11T22:19:20.213 INFO:teuthology.orchestra.run.smithi100.stdout: debug osd = 20 2024-09-11T22:19:20.213 INFO:teuthology.orchestra.run.smithi100.stdout: debug rocksdb = 10 2024-09-11T22:19:20.213 INFO:teuthology.orchestra.run.smithi100.stdout: filestore flush min = 0 2024-09-11T22:19:20.213 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T22:19:20.213 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd full ratio = 0.9 2024-09-11T22:19:20.213 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd nearfull ratio = 0.8 2024-09-11T22:19:20.213 INFO:teuthology.orchestra.run.smithi100.stdout: osd blocked scrub grace period = 3600 2024-09-11T22:19:20.213 INFO:teuthology.orchestra.run.smithi100.stdout: osd failsafe full ratio = 0.95 2024-09-11T22:19:20.213 INFO:teuthology.orchestra.run.smithi100.stdout: osd max markdown count = 1000 2024-09-11T22:19:20.213 INFO:teuthology.orchestra.run.smithi100.stdout: osd objectstore = bluestore 2024-09-11T22:19:20.213 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2024-09-11T22:19:20.213 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.214 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr] 2024-09-11T22:19:20.214 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-09-11T22:19:20.214 INFO:teuthology.orchestra.run.smithi100.stdout: debug mgr = 20 2024-09-11T22:19:20.214 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2024-09-11T22:19:20.214 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2024-09-11T22:19:20.214 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2024-09-11T22:19:20.214 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2024-09-11T22:19:20.214 INFO:teuthology.orchestra.run.smithi100.stdout: mgr/telemetry/nag = false 2024-09-11T22:19:20.215 INFO:teuthology.orchestra.run.smithi100.stdout: debug client = 20 2024-09-11T22:19:20.215 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.215 INFO:teuthology.orchestra.run.smithi100.stdout:[mon] 2024-09-11T22:19:20.215 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-09-11T22:19:20.215 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2024-09-11T22:19:20.216 INFO:teuthology.orchestra.run.smithi100.stdout: debug paxos = 20 2024-09-11T22:19:20.216 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2024-09-11T22:19:20.216 INFO:teuthology.orchestra.run.smithi100.stdout: mon data avail warn = 5 2024-09-11T22:19:20.216 INFO:teuthology.orchestra.run.smithi100.stdout: mon mgr mkfs grace = 240 2024-09-11T22:19:20.216 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2024-09-11T22:19:20.216 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd reporter subtree level = osd 2024-09-11T22:19:20.216 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd prime pg temp = true 2024-09-11T22:19:20.216 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2024-09-11T22:19:20.216 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.216 INFO:teuthology.orchestra.run.smithi100.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T22:19:20.217 INFO:teuthology.orchestra.run.smithi100.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T22:19:20.217 INFO:teuthology.orchestra.run.smithi100.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T22:19:20.217 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.217 INFO:teuthology.orchestra.run.smithi100.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T22:19:20.217 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T22:19:20.217 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T22:19:20.218 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.218 INFO:teuthology.orchestra.run.smithi100.stdout: # 1m isn't quite enough 2024-09-11T22:19:20.218 INFO:teuthology.orchestra.run.smithi100.stdout: mon_down_mkfs_grace = 2m 2024-09-11T22:19:20.218 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.218 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_filestore_osds = false 2024-09-11T22:19:20.218 INFO:teuthology.orchestra.run.smithi100.stdout: mon down mkfs grace = 300 2024-09-11T22:19:20.219 INFO:teuthology.orchestra.run.smithi100.stdout: mon op complaint time = 120 2024-09-11T22:19:20.219 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on pool no app = False 2024-09-11T22:19:20.219 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:20.219 INFO:teuthology.orchestra.run.smithi100.stdout:[client] 2024-09-11T22:19:20.219 INFO:teuthology.orchestra.run.smithi100.stdout: rgw cache enabled = true 2024-09-11T22:19:20.219 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable ops log = true 2024-09-11T22:19:20.220 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable usage log = true 2024-09-11T22:19:20.220 INFO:teuthology.orchestra.run.smithi100.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T22:19:20.220 INFO:teuthology.orchestra.run.smithi100.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T22:19:20.220 INFO:teuthology.orchestra.run.smithi100.stdout: client mount timeout = 600 2024-09-11T22:19:20.220 INFO:teuthology.orchestra.run.smithi100.stdout: client_shutdown_timeout = 120 2024-09-11T22:19:20.220 INFO:teuthology.orchestra.run.smithi100.stdout: debug client = 20 2024-09-11T22:19:20.220 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-09-11T22:19:20.220 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 900 2024-09-11T22:19:20.220 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 900 2024-09-11T22:19:20.220 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.a] 2024-09-11T22:19:20.220 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.b] 2024-09-11T22:19:20.220 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.c] 2024-09-11T22:19:20.220 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2024-09-11T22:19:20.221 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2024-09-11T22:19:20.221 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.e] 2024-09-11T22:19:20.221 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2024-09-11T22:19:20.221 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2024-09-11T22:19:20.221 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.f] 2024-09-11T22:19:20.222 INFO:teuthology.orchestra.run.smithi100.stdout:[mds] 2024-09-11T22:19:20.222 INFO:teuthology.orchestra.run.smithi100.stdout: debug mds = 20 2024-09-11T22:19:20.222 INFO:teuthology.orchestra.run.smithi100.stdout: debug mds balancer = 20 2024-09-11T22:19:20.222 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-09-11T22:19:20.222 INFO:teuthology.orchestra.run.smithi100.stdout: mds bal fragment size max = 10000 2024-09-11T22:19:20.222 INFO:teuthology.orchestra.run.smithi100.stdout: mds bal merge size = 5 2024-09-11T22:19:20.222 INFO:teuthology.orchestra.run.smithi100.stdout: mds bal split bits = 3 2024-09-11T22:19:20.222 INFO:teuthology.orchestra.run.smithi100.stdout: mds bal split size = 100 2024-09-11T22:19:20.222 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug frag = True 2024-09-11T22:19:20.222 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug scatterstat = True 2024-09-11T22:19:20.222 INFO:teuthology.orchestra.run.smithi100.stdout: mds oft prefetch dirfrags = True 2024-09-11T22:19:20.223 INFO:teuthology.orchestra.run.smithi100.stdout: mds op complaint time = 180 2024-09-11T22:19:20.223 INFO:teuthology.orchestra.run.smithi100.stdout: mds verify scatter = True 2024-09-11T22:19:20.223 INFO:teuthology.orchestra.run.smithi100.stdout: mds_dir_prefetch = True 2024-09-11T22:19:20.223 INFO:teuthology.orchestra.run.smithi100.stdout: mds_sleep_rank_change = 5000000.0 2024-09-11T22:19:20.223 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2024-09-11T22:19:20.223 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 900 2024-09-11T22:19:20.223 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 900 2024-09-11T22:19:20.226 INFO:teuthology.orchestra.run.smithi167.stdout:[global] 2024-09-11T22:19:20.226 INFO:teuthology.orchestra.run.smithi167.stdout: chdir = "" 2024-09-11T22:19:20.226 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T22:19:20.226 INFO:teuthology.orchestra.run.smithi167.stdout: auth supported = cephx 2024-09-11T22:19:20.226 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.227 INFO:teuthology.orchestra.run.smithi167.stdout: filestore xattr use omap = true 2024-09-11T22:19:20.227 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.227 INFO:teuthology.orchestra.run.smithi167.stdout: mon clock drift allowed = 1.000 2024-09-11T22:19:20.227 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.227 INFO:teuthology.orchestra.run.smithi167.stdout: osd crush chooseleaf type = 0 2024-09-11T22:19:20.228 INFO:teuthology.orchestra.run.smithi167.stdout: auth debug = true 2024-09-11T22:19:20.228 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.228 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on old message = true 2024-09-11T22:19:20.228 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on bug = true 2024-09-11T22:19:20.228 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.228 INFO:teuthology.orchestra.run.smithi167.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T22:19:20.229 INFO:teuthology.orchestra.run.smithi167.stdout: mon pg warn max object skew = 0 2024-09-11T22:19:20.229 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.229 INFO:teuthology.orchestra.run.smithi167.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T22:19:20.229 INFO:teuthology.orchestra.run.smithi167.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T22:19:20.229 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.230 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default size = 2 2024-09-11T22:19:20.230 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.230 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow primary affinity = true 2024-09-11T22:19:20.230 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow pg remap = true 2024-09-11T22:19:20.230 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on legacy crush tunables = false 2024-09-11T22:19:20.230 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on crush straw calc version zero = false 2024-09-11T22:19:20.230 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on no sortbitwise = false 2024-09-11T22:19:20.230 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on osd down out interval zero = false 2024-09-11T22:19:20.230 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on too few osds = false 2024-09-11T22:19:20.231 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T22:19:20.231 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T22:19:20.231 INFO:teuthology.orchestra.run.smithi167.stdout: mon_allow_pool_size_one = true 2024-09-11T22:19:20.231 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.231 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T22:19:20.231 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.231 INFO:teuthology.orchestra.run.smithi167.stdout: osd default data pool replay window = 5 2024-09-11T22:19:20.231 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.231 INFO:teuthology.orchestra.run.smithi167.stdout: mon allow pool delete = true 2024-09-11T22:19:20.231 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.231 INFO:teuthology.orchestra.run.smithi167.stdout: mon cluster log file level = debug 2024-09-11T22:19:20.231 INFO:teuthology.orchestra.run.smithi167.stdout: debug asserts on shutdown = true 2024-09-11T22:19:20.231 INFO:teuthology.orchestra.run.smithi167.stdout: mon health detail to clog = false 2024-09-11T22:19:20.231 INFO:teuthology.orchestra.run.smithi167.stdout: mon host = "172.21.15.100,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-09-11T22:19:20.232 INFO:teuthology.orchestra.run.smithi167.stdout: fsid = e9259096-4424-4dcb-839f-82ac34412ee2 2024-09-11T22:19:20.232 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.232 INFO:teuthology.orchestra.run.smithi167.stdout:[osd] 2024-09-11T22:19:20.232 INFO:teuthology.orchestra.run.smithi167.stdout: osd journal size = 100 2024-09-11T22:19:20.232 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.232 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub load threshold = 5.0 2024-09-11T22:19:20.232 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub max interval = 600 2024-09-11T22:19:20.232 INFO:teuthology.orchestra.run.smithi167.stdout: osd mclock profile = high_recovery_ops 2024-09-11T22:19:20.232 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.232 INFO:teuthology.orchestra.run.smithi167.stdout: osd recover clone overlap = true 2024-09-11T22:19:20.232 INFO:teuthology.orchestra.run.smithi167.stdout: osd recovery max chunk = 1048576 2024-09-11T22:19:20.232 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.232 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug shutdown = true 2024-09-11T22:19:20.233 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug op order = true 2024-09-11T22:19:20.233 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug verify stray on activate = true 2024-09-11T22:19:20.233 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug trim objects = true 2024-09-11T22:19:20.233 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.233 INFO:teuthology.orchestra.run.smithi167.stdout: osd open classes on start = true 2024-09-11T22:19:20.233 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug pg log writeout = true 2024-09-11T22:19:20.233 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.233 INFO:teuthology.orchestra.run.smithi167.stdout: osd deep scrub update digest min age = 30 2024-09-11T22:19:20.233 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.233 INFO:teuthology.orchestra.run.smithi167.stdout: osd map max advance = 10 2024-09-11T22:19:20.233 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.234 INFO:teuthology.orchestra.run.smithi167.stdout: journal zero on create = true 2024-09-11T22:19:20.234 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.234 INFO:teuthology.orchestra.run.smithi167.stdout: filestore ondisk finisher threads = 3 2024-09-11T22:19:20.234 INFO:teuthology.orchestra.run.smithi167.stdout: filestore apply finisher threads = 3 2024-09-11T22:19:20.234 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.234 INFO:teuthology.orchestra.run.smithi167.stdout: bdev debug aio = true 2024-09-11T22:19:20.234 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug misdirected ops = true 2024-09-11T22:19:20.234 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore block size = 96636764160 2024-09-11T22:19:20.234 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore compression mode = aggressive 2024-09-11T22:19:20.234 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore fsck on mount = True 2024-09-11T22:19:20.234 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluefs = 20 2024-09-11T22:19:20.234 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluestore = 20 2024-09-11T22:19:20.234 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-09-11T22:19:20.234 INFO:teuthology.orchestra.run.smithi167.stdout: debug osd = 20 2024-09-11T22:19:20.235 INFO:teuthology.orchestra.run.smithi167.stdout: debug rocksdb = 10 2024-09-11T22:19:20.235 INFO:teuthology.orchestra.run.smithi167.stdout: filestore flush min = 0 2024-09-11T22:19:20.235 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T22:19:20.235 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd full ratio = 0.9 2024-09-11T22:19:20.235 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd nearfull ratio = 0.8 2024-09-11T22:19:20.235 INFO:teuthology.orchestra.run.smithi167.stdout: osd blocked scrub grace period = 3600 2024-09-11T22:19:20.235 INFO:teuthology.orchestra.run.smithi167.stdout: osd failsafe full ratio = 0.95 2024-09-11T22:19:20.235 INFO:teuthology.orchestra.run.smithi167.stdout: osd max markdown count = 1000 2024-09-11T22:19:20.235 INFO:teuthology.orchestra.run.smithi167.stdout: osd objectstore = bluestore 2024-09-11T22:19:20.235 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-09-11T22:19:20.235 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.235 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr] 2024-09-11T22:19:20.235 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-09-11T22:19:20.235 INFO:teuthology.orchestra.run.smithi167.stdout: debug mgr = 20 2024-09-11T22:19:20.236 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-09-11T22:19:20.236 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-09-11T22:19:20.236 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-09-11T22:19:20.236 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-09-11T22:19:20.236 INFO:teuthology.orchestra.run.smithi167.stdout: mgr/telemetry/nag = false 2024-09-11T22:19:20.236 INFO:teuthology.orchestra.run.smithi167.stdout: debug client = 20 2024-09-11T22:19:20.236 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.236 INFO:teuthology.orchestra.run.smithi167.stdout:[mon] 2024-09-11T22:19:20.236 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-09-11T22:19:20.236 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-09-11T22:19:20.236 INFO:teuthology.orchestra.run.smithi167.stdout: debug paxos = 20 2024-09-11T22:19:20.236 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-09-11T22:19:20.236 INFO:teuthology.orchestra.run.smithi167.stdout: mon data avail warn = 5 2024-09-11T22:19:20.236 INFO:teuthology.orchestra.run.smithi167.stdout: mon mgr mkfs grace = 240 2024-09-11T22:19:20.237 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-09-11T22:19:20.237 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd reporter subtree level = osd 2024-09-11T22:19:20.237 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd prime pg temp = true 2024-09-11T22:19:20.237 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-09-11T22:19:20.237 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.237 INFO:teuthology.orchestra.run.smithi167.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T22:19:20.238 INFO:teuthology.orchestra.run.smithi167.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T22:19:20.238 INFO:teuthology.orchestra.run.smithi167.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T22:19:20.238 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.238 INFO:teuthology.orchestra.run.smithi167.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T22:19:20.238 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T22:19:20.239 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T22:19:20.239 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.239 INFO:teuthology.orchestra.run.smithi167.stdout: # 1m isn't quite enough 2024-09-11T22:19:20.239 INFO:teuthology.orchestra.run.smithi167.stdout: mon_down_mkfs_grace = 2m 2024-09-11T22:19:20.239 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.239 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_filestore_osds = false 2024-09-11T22:19:20.240 INFO:teuthology.orchestra.run.smithi167.stdout: mon down mkfs grace = 300 2024-09-11T22:19:20.240 INFO:teuthology.orchestra.run.smithi167.stdout: mon op complaint time = 120 2024-09-11T22:19:20.240 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on pool no app = False 2024-09-11T22:19:20.240 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-11T22:19:20.240 INFO:teuthology.orchestra.run.smithi167.stdout:[client] 2024-09-11T22:19:20.240 INFO:teuthology.orchestra.run.smithi167.stdout: rgw cache enabled = true 2024-09-11T22:19:20.240 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable ops log = true 2024-09-11T22:19:20.240 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable usage log = true 2024-09-11T22:19:20.240 INFO:teuthology.orchestra.run.smithi167.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T22:19:20.240 INFO:teuthology.orchestra.run.smithi167.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T22:19:20.240 INFO:teuthology.orchestra.run.smithi167.stdout: client mount timeout = 600 2024-09-11T22:19:20.240 INFO:teuthology.orchestra.run.smithi167.stdout: client_shutdown_timeout = 120 2024-09-11T22:19:20.241 INFO:teuthology.orchestra.run.smithi167.stdout: debug client = 20 2024-09-11T22:19:20.241 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-09-11T22:19:20.241 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-09-11T22:19:20.241 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-09-11T22:19:20.241 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.a] 2024-09-11T22:19:20.241 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.b] 2024-09-11T22:19:20.241 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.c] 2024-09-11T22:19:20.241 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2024-09-11T22:19:20.241 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2024-09-11T22:19:20.241 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.e] 2024-09-11T22:19:20.241 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2024-09-11T22:19:20.241 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2024-09-11T22:19:20.241 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.f] 2024-09-11T22:19:20.242 INFO:teuthology.orchestra.run.smithi167.stdout:[mds] 2024-09-11T22:19:20.242 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds = 20 2024-09-11T22:19:20.242 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds balancer = 20 2024-09-11T22:19:20.242 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-09-11T22:19:20.242 INFO:teuthology.orchestra.run.smithi167.stdout: mds bal fragment size max = 10000 2024-09-11T22:19:20.242 INFO:teuthology.orchestra.run.smithi167.stdout: mds bal merge size = 5 2024-09-11T22:19:20.242 INFO:teuthology.orchestra.run.smithi167.stdout: mds bal split bits = 3 2024-09-11T22:19:20.242 INFO:teuthology.orchestra.run.smithi167.stdout: mds bal split size = 100 2024-09-11T22:19:20.243 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug frag = True 2024-09-11T22:19:20.243 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug scatterstat = True 2024-09-11T22:19:20.243 INFO:teuthology.orchestra.run.smithi167.stdout: mds oft prefetch dirfrags = True 2024-09-11T22:19:20.243 INFO:teuthology.orchestra.run.smithi167.stdout: mds op complaint time = 180 2024-09-11T22:19:20.243 INFO:teuthology.orchestra.run.smithi167.stdout: mds verify scatter = True 2024-09-11T22:19:20.243 INFO:teuthology.orchestra.run.smithi167.stdout: mds_dir_prefetch = True 2024-09-11T22:19:20.243 INFO:teuthology.orchestra.run.smithi167.stdout: mds_sleep_rank_change = 5000000.0 2024-09-11T22:19:20.243 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-09-11T22:19:20.243 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-09-11T22:19:20.243 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-09-11T22:19:20.243 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-11T22:19:20.244 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-11T22:19:20.319 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-11T22:19:20.320 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:20.320 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-11T22:19:20.335 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:20.336 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-11T22:19:20.390 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi100.front.sepia.ceph.com 2024-09-11T22:19:20.391 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:20.391 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T22:19:20.391 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T22:19:20.464 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:20.464 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:19:20.519 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi167.front.sepia.ceph.com 2024-09-11T22:19:20.520 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T22:19:20.520 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T22:19:20.520 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T22:19:20.555 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T22:19:20.555 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:19:20.610 INFO:tasks.ceph:Setting up mon nodes... 2024-09-11T22:19:20.610 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-11T22:19:20.611 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-11T22:19:20.661 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-11T22:19:20.664 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T22:19:20.719 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T22:19:20.722 INFO:tasks.ceph:Setting up mds nodes... 2024-09-11T22:19:20.722 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-11T22:19:20.773 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-11T22:19:20.775 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-11T22:19:20.799 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-11T22:19:20.890 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-11T22:19:20.892 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-11T22:19:20.917 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-09-11T22:19:21.008 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-09-11T22:19:21.010 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-09-11T22:19:21.034 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-11T22:19:21.086 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-11T22:19:21.088 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-11T22:19:21.113 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-11T22:19:21.205 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-11T22:19:21.208 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-11T22:19:21.233 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-09-11T22:19:21.325 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-09-11T22:19:21.327 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-09-11T22:19:21.353 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-11T22:19:21.354 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T22:19:21.395 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-11T22:19:21.407 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-11T22:19:21.408 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-11T22:19:21.408 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-11T22:19:21.472 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T22:19:21.472 INFO:tasks.ceph:role: osd.0 2024-09-11T22:19:21.472 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-11T22:19:21.473 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T22:19:21.544 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T22:19:21.544 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T22:19:21.544 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T22:19:21.545 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T22:19:21.545 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T22:19:21.545 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-09-11T22:19:21.545 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T22:19:21.545 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T22:19:21.545 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T22:19:21.545 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T22:19:22.037 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-09-11T22:19:22.039 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-09-11T22:19:22.039 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-11T22:19:22.159 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-11T22:19:22.192 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-11T22:19:22.259 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T22:19:22.259 INFO:tasks.ceph:role: osd.1 2024-09-11T22:19:22.259 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-11T22:19:22.259 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T22:19:22.332 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T22:19:22.332 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T22:19:22.332 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T22:19:22.332 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T22:19:22.332 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T22:19:22.332 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-09-11T22:19:22.333 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T22:19:22.333 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T22:19:22.333 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T22:19:22.333 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T22:19:22.795 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-09-11T22:19:22.798 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-09-11T22:19:22.798 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-11T22:19:22.890 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-11T22:19:22.920 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-11T22:19:22.985 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T22:19:22.986 INFO:tasks.ceph:role: osd.2 2024-09-11T22:19:22.986 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-11T22:19:22.986 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T22:19:23.057 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T22:19:23.057 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T22:19:23.057 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T22:19:23.058 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T22:19:23.058 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T22:19:23.058 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-09-11T22:19:23.058 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T22:19:23.058 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T22:19:23.058 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T22:19:23.058 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T22:19:23.535 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-09-11T22:19:23.537 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-09-11T22:19:23.537 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-11T22:19:23.647 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-11T22:19:23.678 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-11T22:19:23.743 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T22:19:23.743 INFO:tasks.ceph:role: osd.3 2024-09-11T22:19:23.743 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-11T22:19:23.743 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-11T22:19:23.816 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T22:19:23.816 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T22:19:23.816 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T22:19:23.816 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T22:19:23.816 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T22:19:23.816 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-09-11T22:19:23.816 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T22:19:23.816 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T22:19:23.816 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T22:19:23.816 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T22:19:24.308 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-09-11T22:19:24.310 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-09-11T22:19:24.310 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-11T22:19:24.452 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-11T22:19:24.483 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:19:24.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:24.579+0000 7f1734c0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-11T22:19:24.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:24.579+0000 7f1734c0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-11T22:19:24.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:24.579+0000 7f1734c0d640 -1 bdev(0x564f56357800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-11T22:19:24.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:24.579+0000 7f1734c0d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-11T22:19:27.741 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-11T22:19:27.771 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:19:27.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:27.860+0000 7fd078f41640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-11T22:19:27.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:27.860+0000 7fd078f41640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-11T22:19:27.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:27.860+0000 7fd078f41640 -1 bdev(0x5602a8305800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-11T22:19:27.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:27.860+0000 7fd078f41640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-11T22:19:31.266 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-11T22:19:31.293 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:19:31.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:31.379+0000 7f5eb9c85640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-11T22:19:31.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:31.380+0000 7f5eb9c85640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-11T22:19:31.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:31.380+0000 7f5eb9c85640 -1 bdev(0x55eca7513800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-11T22:19:31.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:31.380+0000 7f5eb9c85640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-11T22:19:34.298 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-11T22:19:34.325 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:19:34.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:34.411+0000 7f9c8a1dd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-11T22:19:34.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:34.411+0000 7f9c8a1dd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-11T22:19:34.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:34.411+0000 7f9c8a1dd640 -1 bdev(0x55622ecaf800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-11T22:19:34.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:34.411+0000 7f9c8a1dd640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-11T22:19:37.330 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-11T22:19:37.356 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-11T22:19:37.386 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T22:19:37.386 INFO:tasks.ceph:role: osd.4 2024-09-11T22:19:37.386 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-11T22:19:37.386 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T22:19:37.463 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T22:19:37.463 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T22:19:37.463 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T22:19:37.463 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T22:19:37.463 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T22:19:37.464 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-09-11T22:19:37.464 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T22:19:37.464 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T22:19:37.464 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T22:19:37.464 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T22:19:37.964 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-09-11T22:19:37.966 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-09-11T22:19:37.966 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-11T22:19:38.081 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-11T22:19:38.114 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-11T22:19:38.179 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T22:19:38.179 INFO:tasks.ceph:role: osd.5 2024-09-11T22:19:38.180 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-11T22:19:38.180 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T22:19:38.252 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T22:19:38.252 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T22:19:38.252 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T22:19:38.252 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T22:19:38.253 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T22:19:38.253 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-09-11T22:19:38.253 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T22:19:38.253 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T22:19:38.253 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T22:19:38.253 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T22:19:38.721 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-09-11T22:19:38.723 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-09-11T22:19:38.723 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-11T22:19:38.810 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-11T22:19:38.838 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-11T22:19:38.903 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T22:19:38.904 INFO:tasks.ceph:role: osd.6 2024-09-11T22:19:38.904 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-11T22:19:38.904 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T22:19:38.976 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T22:19:38.976 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T22:19:38.976 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T22:19:38.976 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T22:19:38.976 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T22:19:38.977 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-09-11T22:19:38.977 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T22:19:38.977 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T22:19:38.977 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T22:19:38.977 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T22:19:39.462 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-09-11T22:19:39.464 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-09-11T22:19:39.464 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-11T22:19:39.588 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-11T22:19:39.618 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-11T22:19:39.683 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T22:19:39.684 INFO:tasks.ceph:role: osd.7 2024-09-11T22:19:39.684 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-11T22:19:39.684 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-11T22:19:39.757 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T22:19:39.757 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T22:19:39.757 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T22:19:39.757 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-11T22:19:39.757 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T22:19:39.757 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-09-11T22:19:39.757 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T22:19:39.757 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-11T22:19:39.757 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T22:19:39.757 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T22:19:40.260 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-09-11T22:19:40.262 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-09-11T22:19:40.262 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-11T22:19:40.393 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-11T22:19:40.424 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:19:40.518 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:40.518+0000 7fe03cc9c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-11T22:19:40.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:40.519+0000 7fe03cc9c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-11T22:19:40.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:40.519+0000 7fe03cc9c640 -1 bdev(0x556ae5e41800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-11T22:19:40.519 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:40.519+0000 7fe03cc9c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-11T22:19:43.918 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-11T22:19:43.948 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:19:44.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:44.041+0000 7f0740f45640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-11T22:19:44.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:44.041+0000 7f0740f45640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-11T22:19:44.041 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:44.041+0000 7f0740f45640 -1 bdev(0x55f58e3db800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-11T22:19:44.042 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:44.042+0000 7f0740f45640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-11T22:19:46.956 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-11T22:19:46.986 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:19:47.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:47.077+0000 7f38662f1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-11T22:19:47.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:47.077+0000 7f38662f1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-11T22:19:47.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:47.077+0000 7f38662f1640 -1 bdev(0x5628e524b800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-11T22:19:47.077 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:47.077+0000 7f38662f1640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-11T22:19:48.215 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:19:48.219 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:19:50.005 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-11T22:19:50.031 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:19:50.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:50.118+0000 7f50bc620640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-11T22:19:50.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:50.118+0000 7f50bc620640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-11T22:19:50.119 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:50.118+0000 7f50bc620640 -1 bdev(0x55d98f27b800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-11T22:19:50.120 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:50.118+0000 7f50bc620640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-11T22:19:53.281 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-11T22:19:53.311 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-11T22:19:53.311 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:53.311 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-11T22:19:53.342 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:53.342 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-11T22:19:53.411 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:53.411 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-11T22:19:53.479 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:53.479 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-09-11T22:19:53.546 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:53.546 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-11T22:19:53.613 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:53.613 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-11T22:19:53.679 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:53.680 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-11T22:19:53.745 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:53.745 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-11T22:19:53.810 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T22:19:53.810 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-11T22:19:53.840 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T22:19:53.841 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-11T22:19:53.910 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T22:19:53.910 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-11T22:19:53.978 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T22:19:53.978 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-09-11T22:19:54.049 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T22:19:54.049 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-11T22:19:54.117 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T22:19:54.117 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-11T22:19:54.184 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T22:19:54.184 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-11T22:19:54.252 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T22:19:54.253 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-11T22:19:54.318 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:54.318 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-11T22:19:54.334 INFO:tasks.ceph:Adding keys to all mons... 2024-09-11T22:19:54.334 DEBUG:teuthology.orchestra.run.smithi100:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T22:19:54.377 DEBUG:teuthology.orchestra.run.smithi167:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T22:19:54.398 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.y] 2024-09-11T22:19:54.398 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBoF+Jmtpt8JxAAc54oz+E9YQhgEy3ecq8tWw== 2024-09-11T22:19:54.399 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2024-09-11T22:19:54.399 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBoF+JmjdMeLhAAeNh6CDE/jXPljyhVF7Hi9w== 2024-09-11T22:19:54.399 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2024-09-11T22:19:54.399 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBoF+Jmd2gYNRAAI5lnyA+6hNGFMoO9tpfQqA== 2024-09-11T22:19:54.399 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.e] 2024-09-11T22:19:54.399 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBpF+Jmzw2FABAA4ccRqd5QtqLizEzHwUFBlQ== 2024-09-11T22:19:54.399 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.0] 2024-09-11T22:19:54.399 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBsF+JmGw+XIhAA8lQslT2ZAf2giC15QjXhDA== 2024-09-11T22:19:54.399 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.1] 2024-09-11T22:19:54.399 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBvF+JmsnpaMxAAoDDEsyHMd49wOgSyITIV4A== 2024-09-11T22:19:54.399 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.2] 2024-09-11T22:19:54.399 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBzF+JmzRSzFhAAw3egXTaG3rRN9236xQdxEA== 2024-09-11T22:19:54.399 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.3] 2024-09-11T22:19:54.399 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQB2F+Jmaq2UGBAAlkUu46VyU95MpS0hJ+nssw== 2024-09-11T22:19:54.400 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.x] 2024-09-11T22:19:54.400 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBoF+JmYfzvKhAAxpxsabKlzUazbXPjQxxPxg== 2024-09-11T22:19:54.400 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2024-09-11T22:19:54.400 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBpF+JmxakqBRAAYfBhNianGcFgn0Jz1JU9DQ== 2024-09-11T22:19:54.400 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2024-09-11T22:19:54.400 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBpF+JmNiZLDBAAHZIHt8k8bjY+kZVevnq2sA== 2024-09-11T22:19:54.400 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.f] 2024-09-11T22:19:54.400 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBpF+Jm/JdpExAAzjHkMpNtGoUX5EdQO52k1A== 2024-09-11T22:19:54.400 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.4] 2024-09-11T22:19:54.400 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQB8F+Jms13xHhAAQeYcX+igkb7hssa3/721fw== 2024-09-11T22:19:54.400 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.5] 2024-09-11T22:19:54.400 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCAF+JmyGZ/AhAAYMyDMgEknDjsrFrBM1PFIw== 2024-09-11T22:19:54.400 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.6] 2024-09-11T22:19:54.401 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCDF+JmCyuhBBAAUIGE9irae7rj9FwgGiar0Q== 2024-09-11T22:19:54.401 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.7] 2024-09-11T22:19:54.401 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCGF+JmTmIhBxAABUnz/10Hh2FGryTh006CCw== 2024-09-11T22:19:54.401 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2024-09-11T22:19:54.401 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQBpF+JmwVyWFxAAO0UEn7ul4cunF0jUzqSWLw== 2024-09-11T22:19:54.401 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr.y] 2024-09-11T22:19:54.401 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBoF+Jmtpt8JxAAc54oz+E9YQhgEy3ecq8tWw== 2024-09-11T22:19:54.401 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2024-09-11T22:19:54.402 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBoF+JmjdMeLhAAeNh6CDE/jXPljyhVF7Hi9w== 2024-09-11T22:19:54.402 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2024-09-11T22:19:54.402 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBoF+Jmd2gYNRAAI5lnyA+6hNGFMoO9tpfQqA== 2024-09-11T22:19:54.402 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.e] 2024-09-11T22:19:54.402 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBpF+Jmzw2FABAA4ccRqd5QtqLizEzHwUFBlQ== 2024-09-11T22:19:54.402 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.0] 2024-09-11T22:19:54.402 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBsF+JmGw+XIhAA8lQslT2ZAf2giC15QjXhDA== 2024-09-11T22:19:54.402 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.1] 2024-09-11T22:19:54.402 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBvF+JmsnpaMxAAoDDEsyHMd49wOgSyITIV4A== 2024-09-11T22:19:54.402 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.2] 2024-09-11T22:19:54.402 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBzF+JmzRSzFhAAw3egXTaG3rRN9236xQdxEA== 2024-09-11T22:19:54.402 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.3] 2024-09-11T22:19:54.402 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQB2F+Jmaq2UGBAAlkUu46VyU95MpS0hJ+nssw== 2024-09-11T22:19:54.402 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr.x] 2024-09-11T22:19:54.403 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBoF+JmYfzvKhAAxpxsabKlzUazbXPjQxxPxg== 2024-09-11T22:19:54.403 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2024-09-11T22:19:54.403 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBpF+JmxakqBRAAYfBhNianGcFgn0Jz1JU9DQ== 2024-09-11T22:19:54.403 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2024-09-11T22:19:54.403 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBpF+JmNiZLDBAAHZIHt8k8bjY+kZVevnq2sA== 2024-09-11T22:19:54.403 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.f] 2024-09-11T22:19:54.403 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBpF+Jm/JdpExAAzjHkMpNtGoUX5EdQO52k1A== 2024-09-11T22:19:54.403 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.4] 2024-09-11T22:19:54.403 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQB8F+Jms13xHhAAQeYcX+igkb7hssa3/721fw== 2024-09-11T22:19:54.403 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.5] 2024-09-11T22:19:54.403 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCAF+JmyGZ/AhAAYMyDMgEknDjsrFrBM1PFIw== 2024-09-11T22:19:54.403 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.6] 2024-09-11T22:19:54.403 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCDF+JmCyuhBBAAUIGE9irae7rj9FwgGiar0Q== 2024-09-11T22:19:54.403 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.7] 2024-09-11T22:19:54.404 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQCGF+JmTmIhBxAABUnz/10Hh2FGryTh006CCw== 2024-09-11T22:19:54.404 INFO:teuthology.orchestra.run.smithi167.stdout:[client.0] 2024-09-11T22:19:54.404 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBpF+JmwVyWFxAAO0UEn7ul4cunF0jUzqSWLw== 2024-09-11T22:19:54.405 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T22:19:54.447 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T22:19:54.498 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T22:19:54.501 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T22:19:54.554 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T22:19:54.557 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T22:19:54.610 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T22:19:54.613 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T22:19:54.666 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:19:54.669 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:19:54.720 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:19:54.723 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:19:54.775 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:19:54.777 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:19:54.827 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:19:54.830 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:19:54.880 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T22:19:54.882 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T22:19:54.933 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T22:19:54.936 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T22:19:54.989 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T22:19:54.992 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T22:19:55.045 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T22:19:55.047 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-11T22:19:55.101 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:19:55.103 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:19:55.154 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:19:55.157 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:19:55.208 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:19:55.210 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:19:55.260 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:19:55.263 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T22:19:55.313 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T22:19:55.316 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T22:19:55.369 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-11T22:19:55.369 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-11T22:19:55.394 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T22:19:55.489 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-11T22:19:55.513 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-11T22:19:55.538 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T22:19:55.634 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-11T22:19:55.659 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-11T22:19:55.724 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T22:19:55.820 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-11T22:19:55.845 DEBUG:teuthology.orchestra.run.smithi100:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:19:55.848 DEBUG:teuthology.orchestra.run.smithi167:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T22:19:55.900 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-11T22:19:55.901 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T22:19:55.901 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T22:19:55.903 INFO:tasks.ceph.mon.a:Started 2024-09-11T22:19:55.903 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-11T22:19:55.903 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-11T22:19:55.943 INFO:tasks.ceph.mon.b:Started 2024-09-11T22:19:55.943 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-11T22:19:55.943 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-11T22:19:55.945 INFO:tasks.ceph.mon.c:Started 2024-09-11T22:19:55.945 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-11T22:19:55.945 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-11T22:19:55.945 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-11T22:19:55.947 INFO:tasks.ceph.mgr.y:Started 2024-09-11T22:19:55.947 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-11T22:19:55.947 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-11T22:19:55.950 INFO:tasks.ceph.mgr.x:Started 2024-09-11T22:19:55.950 INFO:tasks.ceph:Setting crush tunables to default 2024-09-11T22:19:55.950 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd crush tunables default 2024-09-11T22:19:56.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.048+0000 7f40dc752640 1 Processor -- start 2024-09-11T22:19:56.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.048+0000 7f40dc752640 1 -- start start 2024-09-11T22:19:56.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.049+0000 7f40dc752640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f40d4073280 0x7f40d40c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.049+0000 7f40dc752640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f40d40c3bb0 0x7f40d40c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.049+0000 7f40dc752640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40d4072020 con 0x7f40d41518e0 2024-09-11T22:19:56.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.049+0000 7f40dc752640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f40d4151cc0 con 0x7f40d4073280 2024-09-11T22:19:56.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.049+0000 7f40dc752640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f40d4072300 con 0x7f40d40c3bb0 2024-09-11T22:19:56.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.049+0000 7f40d9ced640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f40d4073280 0x7f40d40c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.049+0000 7f40d9ced640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f40d4073280 0x7f40d40c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59042/0 (socket says 172.21.15.100:59042) 2024-09-11T22:19:56.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.049+0000 7f40d9ced640 1 -- 172.21.15.100:0/1493849434 learned_addr learned my addr 172.21.15.100:0/1493849434 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:19:56.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.049+0000 7f40d9ced640 1 -- 172.21.15.100:0/1493849434 >> v2:172.21.15.100:3300/0 conn(0x7f40d4073280 msgr2=0x7f40d40c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:19:56.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.049+0000 7f40d9ced640 1 -- 172.21.15.100:0/1493849434 >> v2:172.21.15.100:3300/0 conn(0x7f40d4073280 msgr2=0x7f40d40c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:19:56.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.049+0000 7f40d9ced640 1 --2- 172.21.15.100:0/1493849434 >> v2:172.21.15.100:3300/0 conn(0x7f40d4073280 0x7f40d40c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:19:56.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.049+0000 7f40d9ced640 1 --2- 172.21.15.100:0/1493849434 >> v2:172.21.15.100:3300/0 conn(0x7f40d4073280 0x7f40d40c82d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:19:56.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.049+0000 7f40dacef640 1 --2- 172.21.15.100:0/1493849434 >> v2:172.21.15.167:3300/0 conn(0x7f40d40c3bb0 0x7f40d40c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.050+0000 7f40dacef640 1 -- 172.21.15.100:0/1493849434 >> v2:172.21.15.167:3300/0 conn(0x7f40d40c3bb0 msgr2=0x7f40d40c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:19:56.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.050+0000 7f40dacef640 1 -- 172.21.15.100:0/1493849434 >> v2:172.21.15.167:3300/0 conn(0x7f40d40c3bb0 msgr2=0x7f40d40c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:19:56.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.050+0000 7f40dacef640 1 --2- 172.21.15.100:0/1493849434 >> v2:172.21.15.167:3300/0 conn(0x7f40d40c3bb0 0x7f40d40c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:19:56.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.050+0000 7f40dacef640 1 --2- 172.21.15.100:0/1493849434 >> v2:172.21.15.167:3300/0 conn(0x7f40d40c3bb0 0x7f40d40c9010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:19:56.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.208+0000 7f40d94ec640 1 -- 172.21.15.100:0/1493849434 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3028394242 0 0) 0x7f40d4072020 con 0x7f40d41518e0 2024-09-11T22:19:56.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.208+0000 7f40d94ec640 1 -- 172.21.15.100:0/1493849434 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40c0003520 con 0x7f40d41518e0 2024-09-11T22:19:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.209+0000 7f40d94ec640 1 -- 172.21.15.100:0/1493849434 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3975445201 0 0) 0x7f40c0003520 con 0x7f40d41518e0 2024-09-11T22:19:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.209+0000 7f40d94ec640 1 -- 172.21.15.100:0/1493849434 >> v2:172.21.15.167:3300/0 conn(0x7f40d40c3bb0 msgr2=0x7f40d40c9010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:19:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.209+0000 7f40d94ec640 1 --2- 172.21.15.100:0/1493849434 >> v2:172.21.15.167:3300/0 conn(0x7f40d40c3bb0 0x7f40d40c9010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.209+0000 7f40d94ec640 1 -- 172.21.15.100:0/1493849434 >> v2:172.21.15.100:3300/0 conn(0x7f40d4073280 msgr2=0x7f40d40c82d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:19:56.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.209+0000 7f40d94ec640 1 --2- 172.21.15.100:0/1493849434 >> v2:172.21.15.100:3300/0 conn(0x7f40d4073280 0x7f40d40c82d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.209+0000 7f40d94ec640 1 -- 172.21.15.100:0/1493849434 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d4072a80 con 0x7f40d41518e0 2024-09-11T22:19:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.209+0000 7f40d94ec640 1 -- 172.21.15.100:0/1493849434 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f40d0001670 con 0x7f40d41518e0 2024-09-11T22:19:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.209+0000 7f40d94ec640 1 -- 172.21.15.100:0/1493849434 >> v1:172.21.15.167:6789/0 conn(0x7f40d41518e0 legacy=0x7f40d4157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.209+0000 7f40d94ec640 1 --2- 172.21.15.100:0/1493849434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c00039b0 0x7f40c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.209+0000 7f40d94ec640 1 --2- 172.21.15.100:0/1493849434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40c0004800 0x7f40c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.210+0000 7f40d94ec640 1 --2- 172.21.15.100:0/1493849434 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40c00051c0 0x7f40c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.210+0000 7f40d94ec640 1 -- 172.21.15.100:0/1493849434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f40d4151cc0 con 0x7f40c00039b0 2024-09-11T22:19:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.210+0000 7f40d94ec640 1 -- 172.21.15.100:0/1493849434 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f40d4072300 con 0x7f40c0004800 2024-09-11T22:19:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.210+0000 7f40d94ec640 1 -- 172.21.15.100:0/1493849434 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f40c000c0c0 con 0x7f40c00051c0 2024-09-11T22:19:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.210+0000 7f40da4ee640 1 --2- 172.21.15.100:0/1493849434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c00039b0 0x7f40c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.210+0000 7f40d9ced640 1 --2- 172.21.15.100:0/1493849434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40c0004800 0x7f40c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.210+0000 7f40dacef640 1 --2- 172.21.15.100:0/1493849434 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40c00051c0 0x7f40c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.210+0000 7f40da4ee640 1 -- 172.21.15.100:0/1493849434 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40c00051c0 msgr2=0x7f40c000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.210+0000 7f40da4ee640 1 --2- 172.21.15.100:0/1493849434 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40c00051c0 0x7f40c000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.210+0000 7f40da4ee640 1 -- 172.21.15.100:0/1493849434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40c0004800 msgr2=0x7f40c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.210+0000 7f40da4ee640 1 --2- 172.21.15.100:0/1493849434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40c0004800 0x7f40c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.210+0000 7f40dacef640 1 -- 172.21.15.100:0/1493849434 reap_dead start 2024-09-11T22:19:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.210+0000 7f40da4ee640 1 -- 172.21.15.100:0/1493849434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c0003520 con 0x7f40c00039b0 2024-09-11T22:19:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.211+0000 7f40da4ee640 1 --2- 172.21.15.100:0/1493849434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c00039b0 0x7f40c0003dd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f40d0007c20 tx=0x7f40c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91599791dc77e6d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.211+0000 7f40d94ec640 1 -- 172.21.15.100:0/1493849434 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d0007c60 con 0x7f40c00039b0 2024-09-11T22:19:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.211+0000 7f40d94ec640 1 -- 172.21.15.100:0/1493849434 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d0037070 con 0x7f40c00039b0 2024-09-11T22:19:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.211+0000 7f40d94ec640 1 -- 172.21.15.100:0/1493849434 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d0032850 con 0x7f40c00039b0 2024-09-11T22:19:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.211+0000 7f40dc752640 1 -- 172.21.15.100:0/1493849434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c00039b0 msgr2=0x7f40c0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.211+0000 7f40dc752640 1 --2- 172.21.15.100:0/1493849434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c00039b0 0x7f40c0003dd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f40d0007c20 tx=0x7f40c0005830 comp rx=0 tx=0).stop 2024-09-11T22:19:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.212+0000 7f40dc752640 1 -- 172.21.15.100:0/1493849434 shutdown_connections 2024-09-11T22:19:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.212+0000 7f40dc752640 1 --2- 172.21.15.100:0/1493849434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c00039b0 0x7f40c0003dd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.212+0000 7f40dc752640 1 -- 172.21.15.100:0/1493849434 >> 172.21.15.100:0/1493849434 conn(0x7f40d406fa70 msgr2=0x7f40d406fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:56.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.212+0000 7f40dc752640 1 -- 172.21.15.100:0/1493849434 shutdown_connections 2024-09-11T22:19:56.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.212+0000 7f40dc752640 1 -- 172.21.15.100:0/1493849434 wait complete. 2024-09-11T22:19:56.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.213+0000 7f40dc752640 1 Processor -- start 2024-09-11T22:19:56.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.213+0000 7f40dc752640 1 -- start start 2024-09-11T22:19:56.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.214+0000 7f40dc752640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c00039b0 0x7f40d4144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.214+0000 7f40dc752640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d41587a0 0x7f40d41f01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.214+0000 7f40dc752640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40d41f06f0 0x7f40d4142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.214+0000 7f40dc752640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f40d4072730 con 0x7f40c00039b0 2024-09-11T22:19:56.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.214+0000 7f40dc752640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f40d40c8b70 con 0x7f40d41587a0 2024-09-11T22:19:56.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.214+0000 7f40dc752640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f40d4074110 con 0x7f40d41f06f0 2024-09-11T22:19:56.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.214+0000 7f40da4ee640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c00039b0 0x7f40d4144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.214+0000 7f40da4ee640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c00039b0 0x7f40d4144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59070/0 (socket says 172.21.15.100:59070) 2024-09-11T22:19:56.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.214+0000 7f40da4ee640 1 -- 172.21.15.100:0/1238624510 learned_addr learned my addr 172.21.15.100:0/1238624510 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:19:56.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.214+0000 7f40d9ced640 1 --2- 172.21.15.100:0/1238624510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d41587a0 0x7f40d41f01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.214+0000 7f40dacef640 1 --2- 172.21.15.100:0/1238624510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40d41f06f0 0x7f40d4142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.214+0000 7f40d9ced640 1 -- 172.21.15.100:0/1238624510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40d41f06f0 msgr2=0x7f40d4142f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.214+0000 7f40d9ced640 1 --2- 172.21.15.100:0/1238624510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40d41f06f0 0x7f40d4142f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.214+0000 7f40d9ced640 1 -- 172.21.15.100:0/1238624510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c00039b0 msgr2=0x7f40d4144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.214+0000 7f40d9ced640 1 --2- 172.21.15.100:0/1238624510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c00039b0 0x7f40d4144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.214+0000 7f40d9ced640 1 -- 172.21.15.100:0/1238624510 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d41f0b70 con 0x7f40d41587a0 2024-09-11T22:19:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.214+0000 7f40da4ee640 1 --2- 172.21.15.100:0/1238624510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c00039b0 0x7f40d4144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.214+0000 7f40dacef640 1 --2- 172.21.15.100:0/1238624510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40d41f06f0 0x7f40d4142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.214+0000 7f40d9ced640 1 --2- 172.21.15.100:0/1238624510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d41587a0 0x7f40d41f01b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f40c4011540 tx=0x7f40c4011a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.215+0000 7f40caffd640 1 -- 172.21.15.100:0/1238624510 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4019070 con 0x7f40d41587a0 2024-09-11T22:19:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.215+0000 7f40caffd640 1 -- 172.21.15.100:0/1238624510 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c4015930 con 0x7f40d41587a0 2024-09-11T22:19:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.215+0000 7f40dc752640 1 -- 172.21.15.100:0/1238624510 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40d4149470 con 0x7f40d41587a0 2024-09-11T22:19:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.215+0000 7f40caffd640 1 -- 172.21.15.100:0/1238624510 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c400f040 con 0x7f40d41587a0 2024-09-11T22:19:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.215+0000 7f40dc752640 1 -- 172.21.15.100:0/1238624510 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40d4150430 con 0x7f40d41587a0 2024-09-11T22:19:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.215+0000 7f40caffd640 1 -- 172.21.15.100:0/1238624510 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f40c401c070 con 0x7f40d41587a0 2024-09-11T22:19:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.215+0000 7f40caffd640 1 -- 172.21.15.100:0/1238624510 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f40c4013740 con 0x7f40d41587a0 2024-09-11T22:19:56.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.216+0000 7f40dc752640 1 -- 172.21.15.100:0/1238624510 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40d40c82d0 con 0x7f40d41587a0 2024-09-11T22:19:56.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.218+0000 7f40caffd640 1 -- 172.21.15.100:0/1238624510 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f40d41f0b70 con 0x7f40d41587a0 2024-09-11T22:19:56.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.281+0000 7f40dc752640 1 -- 172.21.15.100:0/1238624510 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f40d40c9aa0 con 0x7f40d41587a0 2024-09-11T22:19:56.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.289+0000 7f40caffd640 1 -- 172.21.15.100:0/1238624510 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f40c4015d00 con 0x7f40d41587a0 2024-09-11T22:19:56.290 INFO:teuthology.orchestra.run.smithi100.stderr:adjusted tunables profile to default 2024-09-11T22:19:56.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.290+0000 7f40dc752640 1 -- 172.21.15.100:0/1238624510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d41587a0 msgr2=0x7f40d41f01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.290+0000 7f40dc752640 1 --2- 172.21.15.100:0/1238624510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d41587a0 0x7f40d41f01b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f40c4011540 tx=0x7f40c4011a00 comp rx=0 tx=0).stop 2024-09-11T22:19:56.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.290+0000 7f40dc752640 1 -- 172.21.15.100:0/1238624510 shutdown_connections 2024-09-11T22:19:56.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.290+0000 7f40dc752640 1 --2- 172.21.15.100:0/1238624510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40d41f06f0 0x7f40d4142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.290+0000 7f40dc752640 1 --2- 172.21.15.100:0/1238624510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d41587a0 0x7f40d41f01b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.290+0000 7f40dc752640 1 --2- 172.21.15.100:0/1238624510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40c00039b0 0x7f40d4144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.290+0000 7f40dc752640 1 -- 172.21.15.100:0/1238624510 >> 172.21.15.100:0/1238624510 conn(0x7f40d406fa70 msgr2=0x7f40d414d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:56.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.290+0000 7f40dc752640 1 -- 172.21.15.100:0/1238624510 shutdown_connections 2024-09-11T22:19:56.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:56.290+0000 7f40dc752640 1 -- 172.21.15.100:0/1238624510 wait complete. 2024-09-11T22:19:56.301 INFO:tasks.ceph:check_enable_crimson: False 2024-09-11T22:19:56.301 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-11T22:19:56.301 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:56.301 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-11T22:19:56.326 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:56.326 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-11T22:19:56.328 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:56.328+0000 7f9ec89dd040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T22:19:56.333 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:56.333+0000 7f56f5f86040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T22:19:56.352 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:56.352 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-11T22:19:56.371 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:56.371+0000 7f9ec89dd040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T22:19:56.374 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:56.373+0000 7f56f5f86040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T22:19:56.396 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:19:56.396 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-11T22:19:56.461 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T22:19:56.461 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-11T22:19:56.486 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T22:19:56.486 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-11T22:19:56.515 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:56.514+0000 7f9ec89dd040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T22:19:56.517 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:56.516+0000 7f56f5f86040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T22:19:56.541 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T22:19:56.541 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-11T22:19:56.565 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:56.564+0000 7f9ec89dd040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T22:19:56.570 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:56.570+0000 7f56f5f86040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T22:19:56.595 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-11T22:19:56.595 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-11T22:19:56.659 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 5de0ba54-34c5-4343-b19a-1f675efc49c8 0 2024-09-11T22:19:56.727 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:56.727+0000 7f9ec89dd040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:19:56.746 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:56.746+0000 7f56f5f86040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:19:56.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.798+0000 7f24d9742640 1 Processor -- start 2024-09-11T22:19:56.799 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.798+0000 7f24d9742640 1 -- start start 2024-09-11T22:19:56.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.799+0000 7f24d9742640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d4152a80 0x7f24d406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.800+0000 7f24d9742640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f24d40b0c00 0x7f24d40cb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.800+0000 7f24d9742640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d40c98f0 con 0x7f24d40c8b10 2024-09-11T22:19:56.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.800+0000 7f24d9742640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f24d4152e60 con 0x7f24d40b0c00 2024-09-11T22:19:56.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.800+0000 7f24d9742640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f24d40c9050 con 0x7f24d4152a80 2024-09-11T22:19:56.801 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.800+0000 7f24d2ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d4152a80 0x7f24d406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.800+0000 7f24d2ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d4152a80 0x7f24d406ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:44282/0 (socket says 172.21.15.167:44282) 2024-09-11T22:19:56.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.800+0000 7f24d2ffd640 1 -- 172.21.15.167:0/1643556524 learned_addr learned my addr 172.21.15.167:0/1643556524 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-11T22:19:56.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.800+0000 7f24d37fe640 1 --2- 172.21.15.167:0/1643556524 >> v2:172.21.15.100:3300/0 conn(0x7f24d40b0c00 0x7f24d40cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.800+0000 7f24d2ffd640 1 -- 172.21.15.167:0/1643556524 >> v2:172.21.15.100:3300/0 conn(0x7f24d40b0c00 msgr2=0x7f24d40cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:56.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.800+0000 7f24d2ffd640 1 --2- 172.21.15.167:0/1643556524 >> v2:172.21.15.100:3300/0 conn(0x7f24d40b0c00 0x7f24d40cb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.800+0000 7f24d2ffd640 1 -- 172.21.15.167:0/1643556524 >> v1:172.21.15.100:6789/0 conn(0x7f24d40c8b10 legacy=0x7f24d4159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.800+0000 7f24d2ffd640 1 -- 172.21.15.167:0/1643556524 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d40c9330 con 0x7f24d4152a80 2024-09-11T22:19:56.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.801+0000 7f24d2ffd640 1 --2- 172.21.15.167:0/1643556524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d4152a80 0x7f24d406ff90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f24c4009870 tx=0x7f24c402a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b51f8e55810c71c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:56.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.801+0000 7f24d1ffb640 1 -- 172.21.15.167:0/1643556524 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c4037070 con 0x7f24d4152a80 2024-09-11T22:19:56.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.801+0000 7f24d1ffb640 1 -- 172.21.15.167:0/1643556524 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c402ae50 con 0x7f24d4152a80 2024-09-11T22:19:56.804 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.801+0000 7f24d1ffb640 1 -- 172.21.15.167:0/1643556524 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c4032860 con 0x7f24d4152a80 2024-09-11T22:19:56.804 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.802+0000 7f24d9742640 1 -- 172.21.15.167:0/1643556524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d4152a80 msgr2=0x7f24d406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.804 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.802+0000 7f24d9742640 1 --2- 172.21.15.167:0/1643556524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d4152a80 0x7f24d406ff90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f24c4009870 tx=0x7f24c402a300 comp rx=0 tx=0).stop 2024-09-11T22:19:56.804 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.802+0000 7f24d9742640 1 -- 172.21.15.167:0/1643556524 shutdown_connections 2024-09-11T22:19:56.804 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.802+0000 7f24d9742640 1 --2- 172.21.15.167:0/1643556524 >> v2:172.21.15.100:3300/0 conn(0x7f24d40b0c00 0x7f24d40cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.804 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.802+0000 7f24d9742640 1 --2- 172.21.15.167:0/1643556524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d4152a80 0x7f24d406ff90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.804 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.802+0000 7f24d9742640 1 -- 172.21.15.167:0/1643556524 >> 172.21.15.167:0/1643556524 conn(0x7f24d406e000 msgr2=0x7f24d406e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:56.804 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.802+0000 7f24d9742640 1 -- 172.21.15.167:0/1643556524 shutdown_connections 2024-09-11T22:19:56.804 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.802+0000 7f24d9742640 1 -- 172.21.15.167:0/1643556524 wait complete. 2024-09-11T22:19:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.803+0000 7f24d9742640 1 Processor -- start 2024-09-11T22:19:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.803+0000 7f24d9742640 1 -- start start 2024-09-11T22:19:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.804+0000 7f24d9742640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d40b0c00 0x7f24d4153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.804+0000 7f24d9742640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d40c8b10 0x7f24d41543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.804+0000 7f24d9742640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24d4152a80 0x7f24d4151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.804+0000 7f24d9742640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f24d4158b10 con 0x7f24d4152a80 2024-09-11T22:19:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.804+0000 7f24d9742640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f24d4158830 con 0x7f24d40b0c00 2024-09-11T22:19:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.804+0000 7f24d9742640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f24d415bc60 con 0x7f24d40c8b10 2024-09-11T22:19:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.804+0000 7f24d2ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d40b0c00 0x7f24d4153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.804+0000 7f24d27fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d40c8b10 0x7f24d41543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.804+0000 7f24d2ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d40b0c00 0x7f24d4153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48816/0 (socket says 172.21.15.167:48816) 2024-09-11T22:19:56.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.804+0000 7f24d27fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d40c8b10 0x7f24d41543b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:44286/0 (socket says 172.21.15.167:44286) 2024-09-11T22:19:56.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.804+0000 7f24d2ffd640 1 -- 172.21.15.167:0/658666821 learned_addr learned my addr 172.21.15.167:0/658666821 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-11T22:19:56.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.804+0000 7f24d37fe640 1 --2- 172.21.15.167:0/658666821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24d4152a80 0x7f24d4151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.804+0000 7f24d27fc640 1 -- 172.21.15.167:0/658666821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d40b0c00 msgr2=0x7f24d4153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.804+0000 7f24d27fc640 1 --2- 172.21.15.167:0/658666821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d40b0c00 0x7f24d4153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.804+0000 7f24d27fc640 1 -- 172.21.15.167:0/658666821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24d4152a80 msgr2=0x7f24d4151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.804+0000 7f24d27fc640 1 --2- 172.21.15.167:0/658666821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24d4152a80 0x7f24d4151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.804+0000 7f24d27fc640 1 -- 172.21.15.167:0/658666821 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d41e2bb0 con 0x7f24d40c8b10 2024-09-11T22:19:56.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.804+0000 7f24d2ffd640 1 --2- 172.21.15.167:0/658666821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d40b0c00 0x7f24d4153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:56.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.804+0000 7f24d27fc640 1 --2- 172.21.15.167:0/658666821 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d40c8b10 0x7f24d41543b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00c340 tx=0x7f24bc00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:56.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.805+0000 7f24cb7fe640 1 -- 172.21.15.167:0/658666821 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc0052d0 con 0x7f24d40c8b10 2024-09-11T22:19:56.808 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.805+0000 7f24cb7fe640 1 -- 172.21.15.167:0/658666821 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24bc005490 con 0x7f24d40c8b10 2024-09-11T22:19:56.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.805+0000 7f24d9742640 1 -- 172.21.15.167:0/658666821 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d41ef430 con 0x7f24d40c8b10 2024-09-11T22:19:56.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.805+0000 7f24cb7fe640 1 -- 172.21.15.167:0/658666821 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc007260 con 0x7f24d40c8b10 2024-09-11T22:19:56.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.805+0000 7f24d9742640 1 -- 172.21.15.167:0/658666821 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d41e3130 con 0x7f24d40c8b10 2024-09-11T22:19:56.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.805+0000 7f24cb7fe640 1 -- 172.21.15.167:0/658666821 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f24bc007400 con 0x7f24d40c8b10 2024-09-11T22:19:56.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.805+0000 7f24cb7fe640 1 -- 172.21.15.167:0/658666821 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f24bc003b30 con 0x7f24d40c8b10 2024-09-11T22:19:56.809 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.806+0000 7f24d9742640 1 -- 172.21.15.167:0/658666821 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d40c8800 con 0x7f24d40c8b10 2024-09-11T22:19:56.810 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.810+0000 7f24cb7fe640 1 -- 172.21.15.167:0/658666821 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f24d40c8800 con 0x7f24d40c8b10 2024-09-11T22:19:56.838 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:56.837+0000 7f9ec89dd040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T22:19:56.865 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:56.865+0000 7f56f5f86040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T22:19:56.879 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.879+0000 7f24d9742640 1 -- 172.21.15.167:0/658666821 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5de0ba54-34c5-4343-b19a-1f675efc49c8", "id": 0} v 0) -- 0x7f24d406ff90 con 0x7f24d40c8b10 2024-09-11T22:19:56.883 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.882+0000 7f24cb7fe640 1 -- 172.21.15.167:0/658666821 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5de0ba54-34c5-4343-b19a-1f675efc49c8", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f24bc020070 con 0x7f24d40c8b10 2024-09-11T22:19:56.883 INFO:teuthology.orchestra.run.smithi167.stdout:0 2024-09-11T22:19:56.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.883+0000 7f24d9742640 1 -- 172.21.15.167:0/658666821 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d40c8b10 msgr2=0x7f24d41543b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.883+0000 7f24d9742640 1 --2- 172.21.15.167:0/658666821 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d40c8b10 0x7f24d41543b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00c340 tx=0x7f24bc00c800 comp rx=0 tx=0).stop 2024-09-11T22:19:56.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.883+0000 7f24d9742640 1 -- 172.21.15.167:0/658666821 shutdown_connections 2024-09-11T22:19:56.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.883+0000 7f24d9742640 1 --2- 172.21.15.167:0/658666821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24d4152a80 0x7f24d4151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.883+0000 7f24d9742640 1 --2- 172.21.15.167:0/658666821 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d40c8b10 0x7f24d41543b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.883+0000 7f24d9742640 1 --2- 172.21.15.167:0/658666821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d40b0c00 0x7f24d4153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.883+0000 7f24d9742640 1 -- 172.21.15.167:0/658666821 >> 172.21.15.167:0/658666821 conn(0x7f24d406e000 msgr2=0x7f24d415bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:56.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.883+0000 7f24d9742640 1 -- 172.21.15.167:0/658666821 shutdown_connections 2024-09-11T22:19:56.885 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.883+0000 7f24d9742640 1 -- 172.21.15.167:0/658666821 wait complete. 2024-09-11T22:19:56.895 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 5a1f6456-6604-4b41-b9b9-52ae8d6616ce 1 2024-09-11T22:19:56.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.993+0000 7f6915c4c640 1 Processor -- start 2024-09-11T22:19:56.994 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.993+0000 7f6915c4c640 1 -- start start 2024-09-11T22:19:56.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.994+0000 7f6915c4c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6910152c40 0x7f69100cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:56.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.994+0000 7f6915c4c640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69100c6bb0 con 0x7f69100c7710 2024-09-11T22:19:56.995 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.994+0000 7f6915c4c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69100c7fa0 con 0x7f6910152860 2024-09-11T22:19:56.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.994+0000 7f6915c4c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f6910075d50 con 0x7f6910152c40 2024-09-11T22:19:56.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.994+0000 7f6907fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6910152c40 0x7f69100cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:56.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.994+0000 7f690f7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f6910152860 0x7f691015bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:39480/0 (socket says 172.21.15.167:39480) 2024-09-11T22:19:56.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.994+0000 7f690f7fe640 1 -- 172.21.15.167:0/3402649317 learned_addr learned my addr 172.21.15.167:0/3402649317 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-11T22:19:56.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.995+0000 7f6907fff640 1 -- 172.21.15.167:0/3402649317 >> v1:172.21.15.167:6789/0 conn(0x7f6910152860 legacy=0x7f691015bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.995+0000 7f6907fff640 1 -- 172.21.15.167:0/3402649317 >> v1:172.21.15.100:6789/0 conn(0x7f69100c7710 legacy=0x7f6910163020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.995+0000 7f690effd640 1 -- 172.21.15.167:0/3402649317 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 974337699 0 0) 0x7f69100c7fa0 con 0x7f6910152860 2024-09-11T22:19:56.996 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.995+0000 7f6907fff640 1 -- 172.21.15.167:0/3402649317 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69100c8280 con 0x7f6910152c40 2024-09-11T22:19:56.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.995+0000 7f6907fff640 1 --2- 172.21.15.167:0/3402649317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6910152c40 0x7f69100cc6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6910075ed0 tx=0x7f68f802a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1ea1bca39e87251 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:56.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.995+0000 7f690effd640 1 -- 172.21.15.167:0/3402649317 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f8037070 con 0x7f6910152c40 2024-09-11T22:19:56.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.995+0000 7f690effd640 1 -- 172.21.15.167:0/3402649317 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f8032440 con 0x7f6910152c40 2024-09-11T22:19:56.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.995+0000 7f690effd640 1 -- 172.21.15.167:0/3402649317 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f8032810 con 0x7f6910152c40 2024-09-11T22:19:56.997 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.996+0000 7f6915c4c640 1 -- 172.21.15.167:0/3402649317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6910152c40 msgr2=0x7f69100cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:56.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.996+0000 7f6915c4c640 1 --2- 172.21.15.167:0/3402649317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6910152c40 0x7f69100cc6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6910075ed0 tx=0x7f68f802a210 comp rx=0 tx=0).stop 2024-09-11T22:19:56.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.996+0000 7f6915c4c640 1 -- 172.21.15.167:0/3402649317 shutdown_connections 2024-09-11T22:19:56.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.996+0000 7f6915c4c640 1 --2- 172.21.15.167:0/3402649317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6910152c40 0x7f69100cc6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:56.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.996+0000 7f6915c4c640 1 -- 172.21.15.167:0/3402649317 >> 172.21.15.167:0/3402649317 conn(0x7f691006fa70 msgr2=0x7f691006fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:56.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.996+0000 7f6915c4c640 1 -- 172.21.15.167:0/3402649317 shutdown_connections 2024-09-11T22:19:56.998 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.996+0000 7f6915c4c640 1 -- 172.21.15.167:0/3402649317 wait complete. 2024-09-11T22:19:57.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.997+0000 7f6915c4c640 1 Processor -- start 2024-09-11T22:19:57.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.997+0000 7f6915c4c640 1 -- start start 2024-09-11T22:19:57.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.998+0000 7f6915c4c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69100c7710 0x7f69100cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.998+0000 7f6915c4c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6910152860 0x7f6910154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.000 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.998+0000 7f6915c4c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f691014dea0 0x7f6910154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.998+0000 7f6915c4c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f69100c49f0 con 0x7f691014dea0 2024-09-11T22:19:57.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.998+0000 7f6915c4c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f69100c4710 con 0x7f6910152860 2024-09-11T22:19:57.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.998+0000 7f6915c4c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f69100c3bb0 con 0x7f69100c7710 2024-09-11T22:19:57.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.998+0000 7f690f7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69100c7710 0x7f69100cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.998+0000 7f6907fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6910152860 0x7f6910154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.998+0000 7f690f7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69100c7710 0x7f69100cbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:44302/0 (socket says 172.21.15.167:44302) 2024-09-11T22:19:57.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.998+0000 7f690f7fe640 1 -- 172.21.15.167:0/427902223 learned_addr learned my addr 172.21.15.167:0/427902223 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-11T22:19:57.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.998+0000 7f690ffff640 1 --2- 172.21.15.167:0/427902223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f691014dea0 0x7f6910154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.998+0000 7f6907fff640 1 -- 172.21.15.167:0/427902223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69100c7710 msgr2=0x7f69100cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.998+0000 7f6907fff640 1 --2- 172.21.15.167:0/427902223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69100c7710 0x7f69100cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.998+0000 7f6907fff640 1 -- 172.21.15.167:0/427902223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f691014dea0 msgr2=0x7f6910154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.998+0000 7f6907fff640 1 --2- 172.21.15.167:0/427902223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f691014dea0 0x7f6910154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.001 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.998+0000 7f6907fff640 1 -- 172.21.15.167:0/427902223 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6910155d80 con 0x7f6910152860 2024-09-11T22:19:57.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.999+0000 7f6907fff640 1 --2- 172.21.15.167:0/427902223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6910152860 0x7f6910154230 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f68f8031000 tx=0x7f68f80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:57.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.999+0000 7f690cff9640 1 -- 172.21.15.167:0/427902223 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f8032e60 con 0x7f6910152860 2024-09-11T22:19:57.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.999+0000 7f690cff9640 1 -- 172.21.15.167:0/427902223 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f8042070 con 0x7f6910152860 2024-09-11T22:19:57.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.999+0000 7f6915c4c640 1 -- 172.21.15.167:0/427902223 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69101eed90 con 0x7f6910152860 2024-09-11T22:19:57.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.999+0000 7f690cff9640 1 -- 172.21.15.167:0/427902223 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f8037040 con 0x7f6910152860 2024-09-11T22:19:57.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.999+0000 7f6915c4c640 1 -- 172.21.15.167:0/427902223 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6910156020 con 0x7f6910152860 2024-09-11T22:19:57.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.999+0000 7f690cff9640 1 -- 172.21.15.167:0/427902223 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f68f8030bb0 con 0x7f6910152860 2024-09-11T22:19:57.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:56.999+0000 7f690cff9640 1 -- 172.21.15.167:0/427902223 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f68f803d7f0 con 0x7f6910152860 2024-09-11T22:19:57.002 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.000+0000 7f6915c4c640 1 -- 172.21.15.167:0/427902223 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69100c7300 con 0x7f6910152860 2024-09-11T22:19:57.003 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.002+0000 7f690cff9640 1 -- 172.21.15.167:0/427902223 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f68f803da40 con 0x7f6910152860 2024-09-11T22:19:57.114 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.113+0000 7f6915c4c640 1 -- 172.21.15.167:0/427902223 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5a1f6456-6604-4b41-b9b9-52ae8d6616ce", "id": 1} v 0) -- 0x7f69100c5430 con 0x7f6910152860 2024-09-11T22:19:57.122 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.121+0000 7f690cff9640 1 -- 172.21.15.167:0/427902223 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5a1f6456-6604-4b41-b9b9-52ae8d6616ce", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f68f8047460 con 0x7f6910152860 2024-09-11T22:19:57.122 INFO:teuthology.orchestra.run.smithi167.stdout:1 2024-09-11T22:19:57.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.122+0000 7f6915c4c640 1 -- 172.21.15.167:0/427902223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6910152860 msgr2=0x7f6910154230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.122+0000 7f6915c4c640 1 --2- 172.21.15.167:0/427902223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6910152860 0x7f6910154230 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f68f8031000 tx=0x7f68f80046c0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.122+0000 7f6915c4c640 1 -- 172.21.15.167:0/427902223 shutdown_connections 2024-09-11T22:19:57.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.122+0000 7f6915c4c640 1 --2- 172.21.15.167:0/427902223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f691014dea0 0x7f6910154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.122+0000 7f6915c4c640 1 --2- 172.21.15.167:0/427902223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6910152860 0x7f6910154230 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.122+0000 7f6915c4c640 1 --2- 172.21.15.167:0/427902223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69100c7710 0x7f69100cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.122+0000 7f6915c4c640 1 -- 172.21.15.167:0/427902223 >> 172.21.15.167:0/427902223 conn(0x7f691006fa70 msgr2=0x7f6910150080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:57.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.122+0000 7f6915c4c640 1 -- 172.21.15.167:0/427902223 shutdown_connections 2024-09-11T22:19:57.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.122+0000 7f6915c4c640 1 -- 172.21.15.167:0/427902223 wait complete. 2024-09-11T22:19:57.133 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new a604cb26-7b0f-402d-b6ac-3652884b4b45 2 2024-09-11T22:19:57.174 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:57.173+0000 7f9ec89dd040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T22:19:57.229 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:57.228+0000 7f9ec89dd040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T22:19:57.232 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.232+0000 7f8d98f0a640 1 Processor -- start 2024-09-11T22:19:57.233 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.232+0000 7f8d98f0a640 1 -- start start 2024-09-11T22:19:57.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.233+0000 7f8d98f0a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d9406c3a0 0x7f8d94073880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.233+0000 7f8d98f0a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8d9406cee0 0x7f8d94073dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.233+0000 7f8d98f0a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d940687e0 con 0x7f8d940b20e0 2024-09-11T22:19:57.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.233+0000 7f8d98f0a640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f8d940c41a0 con 0x7f8d9406cee0 2024-09-11T22:19:57.234 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.233+0000 7f8d98f0a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8d94072860 con 0x7f8d9406c3a0 2024-09-11T22:19:57.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.233+0000 7f8d91d9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d9406c3a0 0x7f8d94073880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.233+0000 7f8d9259c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f8d940b20e0 0x7f8d94072cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:39488/0 (socket says 172.21.15.167:39488) 2024-09-11T22:19:57.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.233+0000 7f8d9259c640 1 -- 172.21.15.167:0/2805079476 learned_addr learned my addr 172.21.15.167:0/2805079476 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-11T22:19:57.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.233+0000 7f8d92d9d640 1 --2- 172.21.15.167:0/2805079476 >> v2:172.21.15.100:3300/0 conn(0x7f8d9406cee0 0x7f8d94073dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.233+0000 7f8d9159a640 1 -- 172.21.15.167:0/2805079476 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3639814246 0 0) 0x7f8d940687e0 con 0x7f8d940b20e0 2024-09-11T22:19:57.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.233+0000 7f8d91d9b640 1 -- 172.21.15.167:0/2805079476 >> v2:172.21.15.100:3300/0 conn(0x7f8d9406cee0 msgr2=0x7f8d94073dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:57.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.233+0000 7f8d91d9b640 1 --2- 172.21.15.167:0/2805079476 >> v2:172.21.15.100:3300/0 conn(0x7f8d9406cee0 0x7f8d94073dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.233+0000 7f8d91d9b640 1 -- 172.21.15.167:0/2805079476 >> v1:172.21.15.167:6789/0 conn(0x7f8d940b20e0 legacy=0x7f8d94072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.235 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.233+0000 7f8d91d9b640 1 -- 172.21.15.167:0/2805079476 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d9406c890 con 0x7f8d9406c3a0 2024-09-11T22:19:57.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.234+0000 7f8d91d9b640 1 --2- 172.21.15.167:0/2805079476 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d9406c3a0 0x7f8d94073880 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8d880097a0 tx=0x7f8d8802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e737384097c30373 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:57.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.234+0000 7f8d9159a640 1 -- 172.21.15.167:0/2805079476 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d88037070 con 0x7f8d9406c3a0 2024-09-11T22:19:57.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.234+0000 7f8d9159a640 1 -- 172.21.15.167:0/2805079476 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d88032440 con 0x7f8d9406c3a0 2024-09-11T22:19:57.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.234+0000 7f8d9159a640 1 -- 172.21.15.167:0/2805079476 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d88032810 con 0x7f8d9406c3a0 2024-09-11T22:19:57.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.235+0000 7f8d98f0a640 1 -- 172.21.15.167:0/2805079476 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d9406c3a0 msgr2=0x7f8d94073880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.235+0000 7f8d98f0a640 1 --2- 172.21.15.167:0/2805079476 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d9406c3a0 0x7f8d94073880 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8d880097a0 tx=0x7f8d8802a210 comp rx=0 tx=0).stop 2024-09-11T22:19:57.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.235+0000 7f8d98f0a640 1 -- 172.21.15.167:0/2805079476 shutdown_connections 2024-09-11T22:19:57.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.235+0000 7f8d98f0a640 1 --2- 172.21.15.167:0/2805079476 >> v2:172.21.15.100:3300/0 conn(0x7f8d9406cee0 0x7f8d94073dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.235+0000 7f8d98f0a640 1 --2- 172.21.15.167:0/2805079476 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d9406c3a0 0x7f8d94073880 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.237 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.235+0000 7f8d98f0a640 1 -- 172.21.15.167:0/2805079476 >> 172.21.15.167:0/2805079476 conn(0x7f8d9406ee80 msgr2=0x7f8d94070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:57.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.235+0000 7f8d98f0a640 1 -- 172.21.15.167:0/2805079476 shutdown_connections 2024-09-11T22:19:57.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.235+0000 7f8d98f0a640 1 -- 172.21.15.167:0/2805079476 wait complete. 2024-09-11T22:19:57.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.236+0000 7f8d98f0a640 1 Processor -- start 2024-09-11T22:19:57.238 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.236+0000 7f8d98f0a640 1 -- start start 2024-09-11T22:19:57.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.237+0000 7f8d98f0a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d9406c3a0 0x7f8d940cd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.237+0000 7f8d98f0a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d9406cee0 0x7f8d94157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.237+0000 7f8d98f0a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d940b20e0 0x7f8d941f0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.237+0000 7f8d98f0a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8d940b24c0 con 0x7f8d9406cee0 2024-09-11T22:19:57.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.237+0000 7f8d98f0a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8d940c7e60 con 0x7f8d9406c3a0 2024-09-11T22:19:57.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.237+0000 7f8d98f0a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8d940c8140 con 0x7f8d940b20e0 2024-09-11T22:19:57.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.237+0000 7f8d9259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d9406c3a0 0x7f8d940cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.237+0000 7f8d92d9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d940b20e0 0x7f8d941f0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.240 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.237+0000 7f8d92d9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d940b20e0 0x7f8d941f0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:44318/0 (socket says 172.21.15.167:44318) 2024-09-11T22:19:57.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.237+0000 7f8d92d9d640 1 -- 172.21.15.167:0/334942650 learned_addr learned my addr 172.21.15.167:0/334942650 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-11T22:19:57.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.237+0000 7f8d91d9b640 1 --2- 172.21.15.167:0/334942650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d9406cee0 0x7f8d94157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.237+0000 7f8d9259c640 1 -- 172.21.15.167:0/334942650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d940b20e0 msgr2=0x7f8d941f0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.237+0000 7f8d9259c640 1 --2- 172.21.15.167:0/334942650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d940b20e0 0x7f8d941f0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.237+0000 7f8d9259c640 1 -- 172.21.15.167:0/334942650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d9406cee0 msgr2=0x7f8d94157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.237+0000 7f8d9259c640 1 --2- 172.21.15.167:0/334942650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d9406cee0 0x7f8d94157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.237+0000 7f8d9259c640 1 -- 172.21.15.167:0/334942650 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d940ccab0 con 0x7f8d9406c3a0 2024-09-11T22:19:57.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.237+0000 7f8d92d9d640 1 --2- 172.21.15.167:0/334942650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d940b20e0 0x7f8d941f0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:57.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.237+0000 7f8d9259c640 1 --2- 172.21.15.167:0/334942650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d9406c3a0 0x7f8d940cd000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8d940689b0 tx=0x7f8d8400c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:57.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.237+0000 7f8d82ffd640 1 -- 172.21.15.167:0/334942650 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d84017070 con 0x7f8d9406c3a0 2024-09-11T22:19:57.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.237+0000 7f8d82ffd640 1 -- 172.21.15.167:0/334942650 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d84005ce0 con 0x7f8d9406c3a0 2024-09-11T22:19:57.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.237+0000 7f8d98f0a640 1 -- 172.21.15.167:0/334942650 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d940ccd50 con 0x7f8d9406c3a0 2024-09-11T22:19:57.241 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.237+0000 7f8d82ffd640 1 -- 172.21.15.167:0/334942650 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d840072f0 con 0x7f8d9406c3a0 2024-09-11T22:19:57.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.238+0000 7f8d98f0a640 1 -- 172.21.15.167:0/334942650 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d941f4750 con 0x7f8d9406c3a0 2024-09-11T22:19:57.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.238+0000 7f8d82ffd640 1 -- 172.21.15.167:0/334942650 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8d8401a070 con 0x7f8d9406c3a0 2024-09-11T22:19:57.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.238+0000 7f8d82ffd640 1 -- 172.21.15.167:0/334942650 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f8d84012820 con 0x7f8d9406c3a0 2024-09-11T22:19:57.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.239+0000 7f8d98f0a640 1 -- 172.21.15.167:0/334942650 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d940c9710 con 0x7f8d9406c3a0 2024-09-11T22:19:57.242 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.241+0000 7f8d82ffd640 1 -- 172.21.15.167:0/334942650 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8d84021070 con 0x7f8d9406c3a0 2024-09-11T22:19:57.242 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:57.242+0000 7f56f5f86040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T22:19:57.297 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:57.296+0000 7f56f5f86040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T22:19:57.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.310+0000 7f8d98f0a640 1 -- 172.21.15.167:0/334942650 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a604cb26-7b0f-402d-b6ac-3652884b4b45", "id": 2} v 0) -- 0x7f8d9406ccc0 con 0x7f8d9406c3a0 2024-09-11T22:19:57.316 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.316+0000 7f8d82ffd640 1 -- 172.21.15.167:0/334942650 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a604cb26-7b0f-402d-b6ac-3652884b4b45", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f8d84012530 con 0x7f8d9406c3a0 2024-09-11T22:19:57.317 INFO:teuthology.orchestra.run.smithi167.stdout:2 2024-09-11T22:19:57.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.317+0000 7f8d98f0a640 1 -- 172.21.15.167:0/334942650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d9406c3a0 msgr2=0x7f8d940cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.317+0000 7f8d98f0a640 1 --2- 172.21.15.167:0/334942650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d9406c3a0 0x7f8d940cd000 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8d940689b0 tx=0x7f8d8400c8e0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.317+0000 7f8d98f0a640 1 -- 172.21.15.167:0/334942650 shutdown_connections 2024-09-11T22:19:57.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.317+0000 7f8d98f0a640 1 --2- 172.21.15.167:0/334942650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d940b20e0 0x7f8d941f0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.317+0000 7f8d98f0a640 1 --2- 172.21.15.167:0/334942650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d9406cee0 0x7f8d94157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.317+0000 7f8d98f0a640 1 --2- 172.21.15.167:0/334942650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d9406c3a0 0x7f8d940cd000 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.317+0000 7f8d98f0a640 1 -- 172.21.15.167:0/334942650 >> 172.21.15.167:0/334942650 conn(0x7f8d9406ee80 msgr2=0x7f8d9415e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:57.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.317+0000 7f8d98f0a640 1 -- 172.21.15.167:0/334942650 shutdown_connections 2024-09-11T22:19:57.318 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.317+0000 7f8d98f0a640 1 -- 172.21.15.167:0/334942650 wait complete. 2024-09-11T22:19:57.331 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 73dc2cbb-70ff-4d12-ba2f-8778a49892f2 3 2024-09-11T22:19:57.378 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:57.377+0000 7f9ec89dd040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T22:19:57.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.429+0000 7f3c9cd23640 1 Processor -- start 2024-09-11T22:19:57.431 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.429+0000 7f3c9cd23640 1 -- start start 2024-09-11T22:19:57.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.430+0000 7f3c9cd23640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c98154cd0 0x7f3c9815bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.430+0000 7f3c9cd23640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3c980c71e0 0x7f3c98165140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.430+0000 7f3c9cd23640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c980738d0 con 0x7f3c9815e7c0 2024-09-11T22:19:57.432 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.430+0000 7f3c9cd23640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f3c9815ecb0 con 0x7f3c980c71e0 2024-09-11T22:19:57.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.430+0000 7f3c9cd23640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3c98072830 con 0x7f3c98154cd0 2024-09-11T22:19:57.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.430+0000 7f3c96d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3c980c71e0 0x7f3c98165140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.430+0000 7f3c9659c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c98154cd0 0x7f3c9815bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.430+0000 7f3c95d9b640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f3c9815e7c0 0x7f3c980cc740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:39496/0 (socket says 172.21.15.167:39496) 2024-09-11T22:19:57.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.430+0000 7f3c95d9b640 1 -- 172.21.15.167:0/3425083845 learned_addr learned my addr 172.21.15.167:0/3425083845 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-11T22:19:57.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.430+0000 7f3c96d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3c980c71e0 0x7f3c98165140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48854/0 (socket says 172.21.15.167:48854) 2024-09-11T22:19:57.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.431+0000 7f3c9659c640 1 -- 172.21.15.167:0/3425083845 >> v2:172.21.15.167:3300/0 conn(0x7f3c980c71e0 msgr2=0x7f3c98165140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:57.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.431+0000 7f3c9659c640 1 --2- 172.21.15.167:0/3425083845 >> v2:172.21.15.167:3300/0 conn(0x7f3c980c71e0 0x7f3c98165140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.431+0000 7f3c9659c640 1 -- 172.21.15.167:0/3425083845 >> v1:172.21.15.167:6789/0 conn(0x7f3c9815e7c0 legacy=0x7f3c980cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.431+0000 7f3c9559a640 1 -- 172.21.15.167:0/3425083845 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1241034605 0 0) 0x7f3c980738d0 con 0x7f3c9815e7c0 2024-09-11T22:19:57.433 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.431+0000 7f3c9659c640 1 -- 172.21.15.167:0/3425083845 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c98072b10 con 0x7f3c98154cd0 2024-09-11T22:19:57.434 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.431+0000 7f3c9659c640 1 --2- 172.21.15.167:0/3425083845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c98154cd0 0x7f3c9815bcb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3c800097a0 tx=0x7f3c8002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ba3db33768a6e0b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:57.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.432+0000 7f3c9559a640 1 -- 172.21.15.167:0/3425083845 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c80037070 con 0x7f3c98154cd0 2024-09-11T22:19:57.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.432+0000 7f3c9559a640 1 -- 172.21.15.167:0/3425083845 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c80032440 con 0x7f3c98154cd0 2024-09-11T22:19:57.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.432+0000 7f3c9559a640 1 -- 172.21.15.167:0/3425083845 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c80032810 con 0x7f3c98154cd0 2024-09-11T22:19:57.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.432+0000 7f3c9cd23640 1 -- 172.21.15.167:0/3425083845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c98154cd0 msgr2=0x7f3c9815bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.432+0000 7f3c9cd23640 1 --2- 172.21.15.167:0/3425083845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c98154cd0 0x7f3c9815bcb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3c800097a0 tx=0x7f3c8002a180 comp rx=0 tx=0).stop 2024-09-11T22:19:57.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.432+0000 7f3c9cd23640 1 -- 172.21.15.167:0/3425083845 shutdown_connections 2024-09-11T22:19:57.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.432+0000 7f3c9cd23640 1 --2- 172.21.15.167:0/3425083845 >> v2:172.21.15.167:3300/0 conn(0x7f3c980c71e0 0x7f3c98165140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.432+0000 7f3c9cd23640 1 --2- 172.21.15.167:0/3425083845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c98154cd0 0x7f3c9815bcb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.432+0000 7f3c9cd23640 1 -- 172.21.15.167:0/3425083845 >> 172.21.15.167:0/3425083845 conn(0x7f3c9806fa70 msgr2=0x7f3c9806fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:57.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.432+0000 7f3c9cd23640 1 -- 172.21.15.167:0/3425083845 shutdown_connections 2024-09-11T22:19:57.435 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.432+0000 7f3c9cd23640 1 -- 172.21.15.167:0/3425083845 wait complete. 2024-09-11T22:19:57.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.434+0000 7f3c9cd23640 1 Processor -- start 2024-09-11T22:19:57.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.434+0000 7f3c9cd23640 1 -- start start 2024-09-11T22:19:57.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.434+0000 7f3c9cd23640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c980c71e0 0x7f3c981f1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.436 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.434+0000 7f3c9cd23640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c98154cd0 0x7f3c980c4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.434+0000 7f3c9cd23640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c9815e7c0 0x7f3c981e5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.435+0000 7f3c9cd23640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3c98075770 con 0x7f3c980c71e0 2024-09-11T22:19:57.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.435+0000 7f3c9cd23640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3c980730d0 con 0x7f3c98154cd0 2024-09-11T22:19:57.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.435+0000 7f3c9cd23640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3c980cce50 con 0x7f3c9815e7c0 2024-09-11T22:19:57.437 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.435+0000 7f3c95d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c98154cd0 0x7f3c980c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.435+0000 7f3c95d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c98154cd0 0x7f3c980c4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48868/0 (socket says 172.21.15.167:48868) 2024-09-11T22:19:57.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.435+0000 7f3c95d9b640 1 -- 172.21.15.167:0/1958823807 learned_addr learned my addr 172.21.15.167:0/1958823807 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-11T22:19:57.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.435+0000 7f3c96d9d640 1 --2- 172.21.15.167:0/1958823807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c9815e7c0 0x7f3c981e5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.435+0000 7f3c9659c640 1 --2- 172.21.15.167:0/1958823807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c980c71e0 0x7f3c981f1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.435+0000 7f3c95d9b640 1 -- 172.21.15.167:0/1958823807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c9815e7c0 msgr2=0x7f3c981e5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.435+0000 7f3c95d9b640 1 --2- 172.21.15.167:0/1958823807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c9815e7c0 0x7f3c981e5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.439 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.435+0000 7f3c95d9b640 1 -- 172.21.15.167:0/1958823807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c980c71e0 msgr2=0x7f3c981f1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.435+0000 7f3c95d9b640 1 --2- 172.21.15.167:0/1958823807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c980c71e0 0x7f3c981f1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.435+0000 7f3c95d9b640 1 -- 172.21.15.167:0/1958823807 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c98157980 con 0x7f3c98154cd0 2024-09-11T22:19:57.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.435+0000 7f3c9659c640 1 --2- 172.21.15.167:0/1958823807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c980c71e0 0x7f3c981f1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:57.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.435+0000 7f3c95d9b640 1 --2- 172.21.15.167:0/1958823807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c98154cd0 0x7f3c980c4450 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3c8800c4b0 tx=0x7f3c8800c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:57.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.435+0000 7f3c8effd640 1 -- 172.21.15.167:0/1958823807 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c88018070 con 0x7f3c98154cd0 2024-09-11T22:19:57.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.435+0000 7f3c8effd640 1 -- 172.21.15.167:0/1958823807 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c88007500 con 0x7f3c98154cd0 2024-09-11T22:19:57.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.435+0000 7f3c8effd640 1 -- 172.21.15.167:0/1958823807 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c88004a20 con 0x7f3c98154cd0 2024-09-11T22:19:57.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.435+0000 7f3c9cd23640 1 -- 172.21.15.167:0/1958823807 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c981f05f0 con 0x7f3c98154cd0 2024-09-11T22:19:57.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.435+0000 7f3c9cd23640 1 -- 172.21.15.167:0/1958823807 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c981f0890 con 0x7f3c98154cd0 2024-09-11T22:19:57.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.435+0000 7f3c8effd640 1 -- 172.21.15.167:0/1958823807 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3c8801b070 con 0x7f3c98154cd0 2024-09-11T22:19:57.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.435+0000 7f3c8effd640 1 -- 172.21.15.167:0/1958823807 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f3c88012890 con 0x7f3c98154cd0 2024-09-11T22:19:57.440 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.437+0000 7f3c9cd23640 1 -- 172.21.15.167:0/1958823807 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c980c7800 con 0x7f3c98154cd0 2024-09-11T22:19:57.441 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.439+0000 7f3c8effd640 1 -- 172.21.15.167:0/1958823807 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3c88012bb0 con 0x7f3c98154cd0 2024-09-11T22:19:57.462 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:57.461+0000 7f56f5f86040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T22:19:57.510 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.509+0000 7f3c9cd23640 1 -- 172.21.15.167:0/1958823807 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "73dc2cbb-70ff-4d12-ba2f-8778a49892f2", "id": 3} v 0) -- 0x7f3c980722d0 con 0x7f3c98154cd0 2024-09-11T22:19:57.516 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.515+0000 7f3c8effd640 1 -- 172.21.15.167:0/1958823807 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "73dc2cbb-70ff-4d12-ba2f-8778a49892f2", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f3c88012400 con 0x7f3c98154cd0 2024-09-11T22:19:57.516 INFO:teuthology.orchestra.run.smithi167.stdout:3 2024-09-11T22:19:57.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.516+0000 7f3c9cd23640 1 -- 172.21.15.167:0/1958823807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c98154cd0 msgr2=0x7f3c980c4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.516+0000 7f3c9cd23640 1 --2- 172.21.15.167:0/1958823807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c98154cd0 0x7f3c980c4450 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3c8800c4b0 tx=0x7f3c8800c970 comp rx=0 tx=0).stop 2024-09-11T22:19:57.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.516+0000 7f3c9cd23640 1 -- 172.21.15.167:0/1958823807 shutdown_connections 2024-09-11T22:19:57.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.516+0000 7f3c9cd23640 1 --2- 172.21.15.167:0/1958823807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c9815e7c0 0x7f3c981e5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.516+0000 7f3c9cd23640 1 --2- 172.21.15.167:0/1958823807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c98154cd0 0x7f3c980c4450 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.516+0000 7f3c9cd23640 1 --2- 172.21.15.167:0/1958823807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c980c71e0 0x7f3c981f1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.516+0000 7f3c9cd23640 1 -- 172.21.15.167:0/1958823807 >> 172.21.15.167:0/1958823807 conn(0x7f3c9806fa70 msgr2=0x7f3c9815d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:57.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.516+0000 7f3c9cd23640 1 -- 172.21.15.167:0/1958823807 shutdown_connections 2024-09-11T22:19:57.517 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.516+0000 7f3c9cd23640 1 -- 172.21.15.167:0/1958823807 wait complete. 2024-09-11T22:19:57.527 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 07960648-04df-4aec-a72c-c29e28b74bcb 4 2024-09-11T22:19:57.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.626+0000 7fe0e0b52640 1 Processor -- start 2024-09-11T22:19:57.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.626+0000 7fe0e0b52640 1 -- start start 2024-09-11T22:19:57.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.627+0000 7fe0e0b52640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe0dc0726c0 0x7fe0dc0c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.627+0000 7fe0e0b52640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0dc072af0 con 0x7fe0dc072f30 2024-09-11T22:19:57.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.627+0000 7fe0e0b52640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0dc073bf0 con 0x7fe0dc151970 2024-09-11T22:19:57.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.627+0000 7fe0e0b52640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fe0dc0ca3f0 con 0x7fe0dc0726c0 2024-09-11T22:19:57.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.627+0000 7fe0da59c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fe0dc151970 0x7fe0dc1576c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:39498/0 (socket says 172.21.15.167:39498) 2024-09-11T22:19:57.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.627+0000 7fe0da59c640 1 -- 172.21.15.167:0/529192680 learned_addr learned my addr 172.21.15.167:0/529192680 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-11T22:19:57.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.627+0000 7fe0d9d9b640 1 --2- 172.21.15.167:0/529192680 >> v2:172.21.15.100:3300/0 conn(0x7fe0dc0726c0 0x7fe0dc0c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.627+0000 7fe0d959a640 1 -- 172.21.15.167:0/529192680 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 134507193 0 0) 0x7fe0dc073bf0 con 0x7fe0dc151970 2024-09-11T22:19:57.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.627+0000 7fe0d959a640 1 -- 172.21.15.167:0/529192680 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0c8003520 con 0x7fe0dc151970 2024-09-11T22:19:57.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.627+0000 7fe0d9d9b640 1 -- 172.21.15.167:0/529192680 >> v1:172.21.15.167:6789/0 conn(0x7fe0dc151970 legacy=0x7fe0dc1576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.627+0000 7fe0d9d9b640 1 -- 172.21.15.167:0/529192680 >> v1:172.21.15.100:6789/0 conn(0x7fe0dc072f30 legacy=0x7fe0dc161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.627+0000 7fe0d959a640 1 -- 172.21.15.167:0/529192680 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2343213661 0 0) 0x7fe0dc072af0 con 0x7fe0dc072f30 2024-09-11T22:19:57.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.627+0000 7fe0d9d9b640 1 -- 172.21.15.167:0/529192680 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc073ed0 con 0x7fe0dc0726c0 2024-09-11T22:19:57.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.628+0000 7fe0d9d9b640 1 --2- 172.21.15.167:0/529192680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0dc0726c0 0x7fe0dc0c3c60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40097a0 tx=0x7fe0c402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa65fbfef17110b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:57.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.628+0000 7fe0d959a640 1 -- 172.21.15.167:0/529192680 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4037070 con 0x7fe0dc0726c0 2024-09-11T22:19:57.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.628+0000 7fe0d959a640 1 -- 172.21.15.167:0/529192680 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0c4032640 con 0x7fe0dc0726c0 2024-09-11T22:19:57.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.628+0000 7fe0d959a640 1 -- 172.21.15.167:0/529192680 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c40329f0 con 0x7fe0dc0726c0 2024-09-11T22:19:57.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.629+0000 7fe0e0b52640 1 -- 172.21.15.167:0/529192680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0dc0726c0 msgr2=0x7fe0dc0c3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.629+0000 7fe0e0b52640 1 --2- 172.21.15.167:0/529192680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0dc0726c0 0x7fe0dc0c3c60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40097a0 tx=0x7fe0c402a2c0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.629+0000 7fe0e0b52640 1 -- 172.21.15.167:0/529192680 shutdown_connections 2024-09-11T22:19:57.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.629+0000 7fe0e0b52640 1 --2- 172.21.15.167:0/529192680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0dc0726c0 0x7fe0dc0c3c60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.629+0000 7fe0e0b52640 1 -- 172.21.15.167:0/529192680 >> 172.21.15.167:0/529192680 conn(0x7fe0dc06ee80 msgr2=0x7fe0dc070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:57.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.629+0000 7fe0e0b52640 1 -- 172.21.15.167:0/529192680 shutdown_connections 2024-09-11T22:19:57.631 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.629+0000 7fe0e0b52640 1 -- 172.21.15.167:0/529192680 wait complete. 2024-09-11T22:19:57.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.631+0000 7fe0e0b52640 1 Processor -- start 2024-09-11T22:19:57.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.631+0000 7fe0e0b52640 1 -- start start 2024-09-11T22:19:57.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.631+0000 7fe0e0b52640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0dc0726c0 0x7fe0dc1f0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.631+0000 7fe0e0b52640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0dc072f30 0x7fe0dc1f3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.631+0000 7fe0e0b52640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0dc151970 0x7fe0dc0cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.631+0000 7fe0e0b52640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc0c9f60 con 0x7fe0dc072f30 2024-09-11T22:19:57.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.631+0000 7fe0e0b52640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc0c41a0 con 0x7fe0dc0726c0 2024-09-11T22:19:57.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.631+0000 7fe0e0b52640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe0dc0741b0 con 0x7fe0dc151970 2024-09-11T22:19:57.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.631+0000 7fe0da59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0dc0726c0 0x7fe0dc1f0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.631+0000 7fe0dad9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0dc151970 0x7fe0dc0cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.631+0000 7fe0da59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0dc0726c0 0x7fe0dc1f0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48876/0 (socket says 172.21.15.167:48876) 2024-09-11T22:19:57.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.631+0000 7fe0da59c640 1 -- 172.21.15.167:0/2020827608 learned_addr learned my addr 172.21.15.167:0/2020827608 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-11T22:19:57.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.631+0000 7fe0d9d9b640 1 --2- 172.21.15.167:0/2020827608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0dc072f30 0x7fe0dc1f3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.632+0000 7fe0da59c640 1 -- 172.21.15.167:0/2020827608 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0dc151970 msgr2=0x7fe0dc0cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.632+0000 7fe0da59c640 1 --2- 172.21.15.167:0/2020827608 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0dc151970 0x7fe0dc0cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.632+0000 7fe0da59c640 1 -- 172.21.15.167:0/2020827608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0dc072f30 msgr2=0x7fe0dc1f3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.632+0000 7fe0da59c640 1 --2- 172.21.15.167:0/2020827608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0dc072f30 0x7fe0dc1f3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.632+0000 7fe0da59c640 1 -- 172.21.15.167:0/2020827608 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc0c7540 con 0x7fe0dc0726c0 2024-09-11T22:19:57.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.632+0000 7fe0d9d9b640 1 --2- 172.21.15.167:0/2020827608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0dc072f30 0x7fe0dc1f3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:57.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.632+0000 7fe0da59c640 1 --2- 172.21.15.167:0/2020827608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0dc0726c0 0x7fe0dc1f0970 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00c3c0 tx=0x7fe0cc00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:57.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.632+0000 7fe0d2ffd640 1 -- 172.21.15.167:0/2020827608 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc017070 con 0x7fe0dc0726c0 2024-09-11T22:19:57.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.632+0000 7fe0d2ffd640 1 -- 172.21.15.167:0/2020827608 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0cc005ce0 con 0x7fe0dc0726c0 2024-09-11T22:19:57.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.632+0000 7fe0d2ffd640 1 -- 172.21.15.167:0/2020827608 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0072f0 con 0x7fe0dc0726c0 2024-09-11T22:19:57.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.632+0000 7fe0e0b52640 1 -- 172.21.15.167:0/2020827608 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0dc153240 con 0x7fe0dc0726c0 2024-09-11T22:19:57.635 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.632+0000 7fe0e0b52640 1 -- 172.21.15.167:0/2020827608 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0dc1f3580 con 0x7fe0dc0726c0 2024-09-11T22:19:57.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.632+0000 7fe0d2ffd640 1 -- 172.21.15.167:0/2020827608 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe0cc01a070 con 0x7fe0dc0726c0 2024-09-11T22:19:57.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.632+0000 7fe0d2ffd640 1 -- 172.21.15.167:0/2020827608 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fe0cc012910 con 0x7fe0dc0726c0 2024-09-11T22:19:57.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.633+0000 7fe0e0b52640 1 -- 172.21.15.167:0/2020827608 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0dc0c9bf0 con 0x7fe0dc0726c0 2024-09-11T22:19:57.636 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.635+0000 7fe0d2ffd640 1 -- 172.21.15.167:0/2020827608 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe0cc021070 con 0x7fe0dc0726c0 2024-09-11T22:19:57.706 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.706+0000 7fe0e0b52640 1 -- 172.21.15.167:0/2020827608 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "07960648-04df-4aec-a72c-c29e28b74bcb", "id": 4} v 0) -- 0x7fe0dc072d10 con 0x7fe0dc0726c0 2024-09-11T22:19:57.712 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.711+0000 7fe0d2ffd640 1 -- 172.21.15.167:0/2020827608 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "07960648-04df-4aec-a72c-c29e28b74bcb", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fe0cc007670 con 0x7fe0dc0726c0 2024-09-11T22:19:57.712 INFO:teuthology.orchestra.run.smithi167.stdout:4 2024-09-11T22:19:57.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.712+0000 7fe0e0b52640 1 -- 172.21.15.167:0/2020827608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0dc0726c0 msgr2=0x7fe0dc1f0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.712+0000 7fe0e0b52640 1 --2- 172.21.15.167:0/2020827608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0dc0726c0 0x7fe0dc1f0970 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00c3c0 tx=0x7fe0cc00c880 comp rx=0 tx=0).stop 2024-09-11T22:19:57.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.712+0000 7fe0e0b52640 1 -- 172.21.15.167:0/2020827608 shutdown_connections 2024-09-11T22:19:57.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.712+0000 7fe0e0b52640 1 --2- 172.21.15.167:0/2020827608 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0dc151970 0x7fe0dc0cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.712+0000 7fe0e0b52640 1 --2- 172.21.15.167:0/2020827608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0dc072f30 0x7fe0dc1f3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.712+0000 7fe0e0b52640 1 --2- 172.21.15.167:0/2020827608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0dc0726c0 0x7fe0dc1f0970 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.713 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.712+0000 7fe0e0b52640 1 -- 172.21.15.167:0/2020827608 >> 172.21.15.167:0/2020827608 conn(0x7fe0dc06ee80 msgr2=0x7fe0dc14e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:57.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.712+0000 7fe0e0b52640 1 -- 172.21.15.167:0/2020827608 shutdown_connections 2024-09-11T22:19:57.714 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.712+0000 7fe0e0b52640 1 -- 172.21.15.167:0/2020827608 wait complete. 2024-09-11T22:19:57.723 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 2b4767e6-cab7-4b45-9150-55432f5576aa 5 2024-09-11T22:19:57.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.822+0000 7f7b49386640 1 Processor -- start 2024-09-11T22:19:57.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.822+0000 7f7b49386640 1 -- start start 2024-09-11T22:19:57.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.822+0000 7f7b49386640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7b44152a80 0x7f7b4406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.822+0000 7f7b49386640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b440b0c00 0x7f7b440cb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.822+0000 7f7b49386640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b440c98f0 con 0x7f7b440c8b10 2024-09-11T22:19:57.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.822+0000 7f7b49386640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f7b44152e60 con 0x7f7b44152a80 2024-09-11T22:19:57.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.822+0000 7f7b49386640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7b440c9050 con 0x7f7b440b0c00 2024-09-11T22:19:57.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.823+0000 7f7b437fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b440b0c00 0x7f7b440cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.823+0000 7f7b42ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7b44152a80 0x7f7b4406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.823+0000 7f7b437fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b440b0c00 0x7f7b440cb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:44334/0 (socket says 172.21.15.167:44334) 2024-09-11T22:19:57.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.823+0000 7f7b42ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7b44152a80 0x7f7b4406ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48886/0 (socket says 172.21.15.167:48886) 2024-09-11T22:19:57.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.823+0000 7f7b437fe640 1 -- 172.21.15.167:0/588968904 learned_addr learned my addr 172.21.15.167:0/588968904 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-11T22:19:57.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.823+0000 7f7b437fe640 1 -- 172.21.15.167:0/588968904 >> v2:172.21.15.167:3300/0 conn(0x7f7b44152a80 msgr2=0x7f7b4406ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:57.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.823+0000 7f7b437fe640 1 --2- 172.21.15.167:0/588968904 >> v2:172.21.15.167:3300/0 conn(0x7f7b44152a80 0x7f7b4406ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.823+0000 7f7b437fe640 1 -- 172.21.15.167:0/588968904 >> v1:172.21.15.100:6789/0 conn(0x7f7b440c8b10 legacy=0x7f7b44159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.823+0000 7f7b437fe640 1 -- 172.21.15.167:0/588968904 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b440c9330 con 0x7f7b440b0c00 2024-09-11T22:19:57.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.823+0000 7f7b42ffd640 1 --2- 172.21.15.167:0/588968904 >> v2:172.21.15.167:3300/0 conn(0x7f7b44152a80 0x7f7b4406ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:57.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.824+0000 7f7b437fe640 1 --2- 172.21.15.167:0/588968904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b440b0c00 0x7f7b440cb020 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009e50 tx=0x7f7b3c02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1904e2bfbb7226d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:57.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.824+0000 7f7b41ffb640 1 -- 172.21.15.167:0/588968904 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c036070 con 0x7f7b440b0c00 2024-09-11T22:19:57.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.824+0000 7f7b41ffb640 1 -- 172.21.15.167:0/588968904 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b3c031600 con 0x7f7b440b0c00 2024-09-11T22:19:57.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.824+0000 7f7b41ffb640 1 -- 172.21.15.167:0/588968904 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c0319d0 con 0x7f7b440b0c00 2024-09-11T22:19:57.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.824+0000 7f7b49386640 1 -- 172.21.15.167:0/588968904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b440b0c00 msgr2=0x7f7b440cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.824+0000 7f7b49386640 1 --2- 172.21.15.167:0/588968904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b440b0c00 0x7f7b440cb020 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009e50 tx=0x7f7b3c02a710 comp rx=0 tx=0).stop 2024-09-11T22:19:57.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.825+0000 7f7b49386640 1 -- 172.21.15.167:0/588968904 shutdown_connections 2024-09-11T22:19:57.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.825+0000 7f7b49386640 1 --2- 172.21.15.167:0/588968904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b440b0c00 0x7f7b440cb020 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.825+0000 7f7b49386640 1 --2- 172.21.15.167:0/588968904 >> v2:172.21.15.167:3300/0 conn(0x7f7b44152a80 0x7f7b4406ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.825+0000 7f7b49386640 1 -- 172.21.15.167:0/588968904 >> 172.21.15.167:0/588968904 conn(0x7f7b4406e000 msgr2=0x7f7b4406e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:57.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.825+0000 7f7b49386640 1 -- 172.21.15.167:0/588968904 shutdown_connections 2024-09-11T22:19:57.829 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.825+0000 7f7b49386640 1 -- 172.21.15.167:0/588968904 wait complete. 2024-09-11T22:19:57.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.826+0000 7f7b49386640 1 Processor -- start 2024-09-11T22:19:57.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.826+0000 7f7b49386640 1 -- start start 2024-09-11T22:19:57.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.827+0000 7f7b49386640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b440b0c00 0x7f7b441eca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.827+0000 7f7b49386640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b440c8b10 0x7f7b4406ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.827+0000 7f7b49386640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b44152a80 0x7f7b4414ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:57.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.827+0000 7f7b49386640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7b44158b10 con 0x7f7b440c8b10 2024-09-11T22:19:57.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.827+0000 7f7b49386640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7b44158830 con 0x7f7b44152a80 2024-09-11T22:19:57.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.827+0000 7f7b49386640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7b4415bc60 con 0x7f7b440b0c00 2024-09-11T22:19:57.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.827+0000 7f7b42ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b440b0c00 0x7f7b441eca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.827+0000 7f7b437fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b44152a80 0x7f7b4414ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.827+0000 7f7b42ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b440b0c00 0x7f7b441eca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:44336/0 (socket says 172.21.15.167:44336) 2024-09-11T22:19:57.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.827+0000 7f7b42ffd640 1 -- 172.21.15.167:0/1533668983 learned_addr learned my addr 172.21.15.167:0/1533668983 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-11T22:19:57.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.827+0000 7f7b427fc640 1 --2- 172.21.15.167:0/1533668983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b440c8b10 0x7f7b4406ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:57.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.827+0000 7f7b42ffd640 1 -- 172.21.15.167:0/1533668983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b44152a80 msgr2=0x7f7b4414ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.830 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.827+0000 7f7b42ffd640 1 --2- 172.21.15.167:0/1533668983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b44152a80 0x7f7b4414ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.827+0000 7f7b42ffd640 1 -- 172.21.15.167:0/1533668983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b440c8b10 msgr2=0x7f7b4406ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.827+0000 7f7b42ffd640 1 --2- 172.21.15.167:0/1533668983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b440c8b10 0x7f7b4406ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.827+0000 7f7b42ffd640 1 -- 172.21.15.167:0/1533668983 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b44151a20 con 0x7f7b440b0c00 2024-09-11T22:19:57.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.827+0000 7f7b437fe640 1 --2- 172.21.15.167:0/1533668983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b44152a80 0x7f7b4414ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:57.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.827+0000 7f7b42ffd640 1 --2- 172.21.15.167:0/1533668983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b440b0c00 0x7f7b441eca20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7b34012fc0 tx=0x7f7b34010490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:57.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.827+0000 7f7b2b7fe640 1 -- 172.21.15.167:0/1533668983 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b34010da0 con 0x7f7b440b0c00 2024-09-11T22:19:57.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.827+0000 7f7b2b7fe640 1 -- 172.21.15.167:0/1533668983 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b3401d070 con 0x7f7b440b0c00 2024-09-11T22:19:57.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.827+0000 7f7b49386640 1 -- 172.21.15.167:0/1533668983 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b440b3790 con 0x7f7b440b0c00 2024-09-11T22:19:57.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.827+0000 7f7b2b7fe640 1 -- 172.21.15.167:0/1533668983 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b340186a0 con 0x7f7b440b0c00 2024-09-11T22:19:57.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.827+0000 7f7b49386640 1 -- 172.21.15.167:0/1533668983 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b440b31d0 con 0x7f7b440b0c00 2024-09-11T22:19:57.831 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.828+0000 7f7b2b7fe640 1 -- 172.21.15.167:0/1533668983 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7b34016050 con 0x7f7b440b0c00 2024-09-11T22:19:57.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.828+0000 7f7b2b7fe640 1 -- 172.21.15.167:0/1533668983 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f7b340065a0 con 0x7f7b440b0c00 2024-09-11T22:19:57.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.828+0000 7f7b49386640 1 -- 172.21.15.167:0/1533668983 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b440cd050 con 0x7f7b440b0c00 2024-09-11T22:19:57.832 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.831+0000 7f7b2b7fe640 1 -- 172.21.15.167:0/1533668983 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7b440cd050 con 0x7f7b440b0c00 2024-09-11T22:19:57.902 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.901+0000 7f7b49386640 1 -- 172.21.15.167:0/1533668983 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2b4767e6-cab7-4b45-9150-55432f5576aa", "id": 5} v 0) -- 0x7f7b440cd4f0 con 0x7f7b440b0c00 2024-09-11T22:19:57.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.906+0000 7f7b2b7fe640 1 -- 172.21.15.167:0/1533668983 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2b4767e6-cab7-4b45-9150-55432f5576aa", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f7b34027020 con 0x7f7b440b0c00 2024-09-11T22:19:57.907 INFO:teuthology.orchestra.run.smithi167.stdout:5 2024-09-11T22:19:57.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.907+0000 7f7b49386640 1 -- 172.21.15.167:0/1533668983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b440b0c00 msgr2=0x7f7b441eca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:57.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.907+0000 7f7b49386640 1 --2- 172.21.15.167:0/1533668983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b440b0c00 0x7f7b441eca20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7b34012fc0 tx=0x7f7b34010490 comp rx=0 tx=0).stop 2024-09-11T22:19:57.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.907+0000 7f7b49386640 1 -- 172.21.15.167:0/1533668983 shutdown_connections 2024-09-11T22:19:57.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.907+0000 7f7b49386640 1 --2- 172.21.15.167:0/1533668983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b44152a80 0x7f7b4414ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.907+0000 7f7b49386640 1 --2- 172.21.15.167:0/1533668983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7b440c8b10 0x7f7b4406ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.907+0000 7f7b49386640 1 --2- 172.21.15.167:0/1533668983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b440b0c00 0x7f7b441eca20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:57.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.907+0000 7f7b49386640 1 -- 172.21.15.167:0/1533668983 >> 172.21.15.167:0/1533668983 conn(0x7f7b4406e000 msgr2=0x7f7b4406e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:57.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.907+0000 7f7b49386640 1 -- 172.21.15.167:0/1533668983 shutdown_connections 2024-09-11T22:19:57.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:57.907+0000 7f7b49386640 1 -- 172.21.15.167:0/1533668983 wait complete. 2024-09-11T22:19:57.919 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 4ef2c4b5-52f4-4f69-8fca-2334077ed8b3 6 2024-09-11T22:19:58.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.017+0000 7fb04483c640 1 Processor -- start 2024-09-11T22:19:58.018 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.017+0000 7fb04483c640 1 -- start start 2024-09-11T22:19:58.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.018+0000 7fb04483c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb0400c3c60 0x7fb040162fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.019 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.018+0000 7fb04483c640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb040072af0 con 0x7fb040151970 2024-09-11T22:19:58.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.018+0000 7fb04483c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb040073bf0 con 0x7fb0400726c0 2024-09-11T22:19:58.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.018+0000 7fb04483c640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb0400ca3f0 con 0x7fb0400c3c60 2024-09-11T22:19:58.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.018+0000 7fb037fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb0400726c0 0x7fb040072f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:39500/0 (socket says 172.21.15.167:39500) 2024-09-11T22:19:58.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.018+0000 7fb037fff640 1 -- 172.21.15.167:0/1298694443 learned_addr learned my addr 172.21.15.167:0/1298694443 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-09-11T22:19:58.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.018+0000 7fb03ed9d640 1 --2- 172.21.15.167:0/1298694443 >> v2:172.21.15.100:3300/0 conn(0x7fb0400c3c60 0x7fb040162fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.018+0000 7fb03dd9b640 1 -- 172.21.15.167:0/1298694443 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3813952288 0 0) 0x7fb040073bf0 con 0x7fb0400726c0 2024-09-11T22:19:58.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.018+0000 7fb03dd9b640 1 -- 172.21.15.167:0/1298694443 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb02c003520 con 0x7fb0400726c0 2024-09-11T22:19:58.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.018+0000 7fb03ed9d640 1 -- 172.21.15.167:0/1298694443 >> v1:172.21.15.167:6789/0 conn(0x7fb0400726c0 legacy=0x7fb040072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.018+0000 7fb03ed9d640 1 -- 172.21.15.167:0/1298694443 >> v1:172.21.15.100:6789/0 conn(0x7fb040151970 legacy=0x7fb0401576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.018+0000 7fb03dd9b640 1 -- 172.21.15.167:0/1298694443 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3930981409 0 0) 0x7fb040072af0 con 0x7fb040151970 2024-09-11T22:19:58.020 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.018+0000 7fb03ed9d640 1 -- 172.21.15.167:0/1298694443 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb040073ed0 con 0x7fb0400c3c60 2024-09-11T22:19:58.021 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.019+0000 7fb03ed9d640 1 --2- 172.21.15.167:0/1298694443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0400c3c60 0x7fb040162fb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb038009d90 tx=0x7fb03802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd993072324248c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.019+0000 7fb03dd9b640 1 -- 172.21.15.167:0/1298694443 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb038037070 con 0x7fb0400c3c60 2024-09-11T22:19:58.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.019+0000 7fb03dd9b640 1 -- 172.21.15.167:0/1298694443 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb038007740 con 0x7fb0400c3c60 2024-09-11T22:19:58.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.019+0000 7fb03dd9b640 1 -- 172.21.15.167:0/1298694443 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb038007b10 con 0x7fb0400c3c60 2024-09-11T22:19:58.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.020+0000 7fb04483c640 1 -- 172.21.15.167:0/1298694443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0400c3c60 msgr2=0x7fb040162fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.020+0000 7fb04483c640 1 --2- 172.21.15.167:0/1298694443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0400c3c60 0x7fb040162fb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb038009d90 tx=0x7fb03802a780 comp rx=0 tx=0).stop 2024-09-11T22:19:58.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.020+0000 7fb04483c640 1 -- 172.21.15.167:0/1298694443 shutdown_connections 2024-09-11T22:19:58.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.020+0000 7fb04483c640 1 --2- 172.21.15.167:0/1298694443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0400c3c60 0x7fb040162fb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.020+0000 7fb04483c640 1 -- 172.21.15.167:0/1298694443 >> 172.21.15.167:0/1298694443 conn(0x7fb04006ee80 msgr2=0x7fb040070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:58.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.020+0000 7fb04483c640 1 -- 172.21.15.167:0/1298694443 shutdown_connections 2024-09-11T22:19:58.022 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.020+0000 7fb04483c640 1 -- 172.21.15.167:0/1298694443 wait complete. 2024-09-11T22:19:58.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.021+0000 7fb04483c640 1 Processor -- start 2024-09-11T22:19:58.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.021+0000 7fb04483c640 1 -- start start 2024-09-11T22:19:58.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.022+0000 7fb04483c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0400726c0 0x7fb0400cd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.022+0000 7fb04483c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0400c3c60 0x7fb0401ee250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.022+0000 7fb04483c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb040151970 0x7fb0401ee790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.022+0000 7fb04483c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb0400741b0 con 0x7fb040151970 2024-09-11T22:19:58.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.022+0000 7fb04483c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb0400c9f60 con 0x7fb0400726c0 2024-09-11T22:19:58.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.022+0000 7fb04483c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb0400c9bf0 con 0x7fb0400c3c60 2024-09-11T22:19:58.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.022+0000 7fb03e59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0400726c0 0x7fb0400cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.022+0000 7fb037fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0400c3c60 0x7fb0401ee250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.025 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.022+0000 7fb03e59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0400726c0 0x7fb0400cd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48900/0 (socket says 172.21.15.167:48900) 2024-09-11T22:19:58.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.022+0000 7fb037fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0400c3c60 0x7fb0401ee250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:44346/0 (socket says 172.21.15.167:44346) 2024-09-11T22:19:58.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.022+0000 7fb03e59c640 1 -- 172.21.15.167:0/3702810865 learned_addr learned my addr 172.21.15.167:0/3702810865 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-11T22:19:58.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.022+0000 7fb03ed9d640 1 --2- 172.21.15.167:0/3702810865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb040151970 0x7fb0401ee790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.022+0000 7fb037fff640 1 -- 172.21.15.167:0/3702810865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0400726c0 msgr2=0x7fb0400cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.022+0000 7fb037fff640 1 --2- 172.21.15.167:0/3702810865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0400726c0 0x7fb0400cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.022+0000 7fb037fff640 1 -- 172.21.15.167:0/3702810865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb040151970 msgr2=0x7fb0401ee790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.022+0000 7fb037fff640 1 --2- 172.21.15.167:0/3702810865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb040151970 0x7fb0401ee790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.022+0000 7fb037fff640 1 -- 172.21.15.167:0/3702810865 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0401f0dc0 con 0x7fb0400c3c60 2024-09-11T22:19:58.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.022+0000 7fb03e59c640 1 --2- 172.21.15.167:0/3702810865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0400726c0 0x7fb0400cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:58.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.022+0000 7fb03ed9d640 1 --2- 172.21.15.167:0/3702810865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb040151970 0x7fb0401ee790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:19:58.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.023+0000 7fb037fff640 1 --2- 172.21.15.167:0/3702810865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0400c3c60 0x7fb0401ee250 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb02800c390 tx=0x7fb028001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.023+0000 7fb036ffd640 1 -- 172.21.15.167:0/3702810865 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028017070 con 0x7fb0400c3c60 2024-09-11T22:19:58.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.023+0000 7fb036ffd640 1 -- 172.21.15.167:0/3702810865 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb028005ce0 con 0x7fb0400c3c60 2024-09-11T22:19:58.026 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.023+0000 7fb036ffd640 1 -- 172.21.15.167:0/3702810865 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0280072f0 con 0x7fb0400c3c60 2024-09-11T22:19:58.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.023+0000 7fb04483c640 1 -- 172.21.15.167:0/3702810865 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb040155570 con 0x7fb0400c3c60 2024-09-11T22:19:58.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.023+0000 7fb04483c640 1 -- 172.21.15.167:0/3702810865 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb040155b30 con 0x7fb0400c3c60 2024-09-11T22:19:58.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.023+0000 7fb036ffd640 1 -- 172.21.15.167:0/3702810865 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb02801a070 con 0x7fb0400c3c60 2024-09-11T22:19:58.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.023+0000 7fb036ffd640 1 -- 172.21.15.167:0/3702810865 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fb0280129f0 con 0x7fb0400c3c60 2024-09-11T22:19:58.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.024+0000 7fb04483c640 1 -- 172.21.15.167:0/3702810865 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb04006d530 con 0x7fb0400c3c60 2024-09-11T22:19:58.027 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.026+0000 7fb036ffd640 1 -- 172.21.15.167:0/3702810865 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb028021020 con 0x7fb0400c3c60 2024-09-11T22:19:58.095 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.094+0000 7fb04483c640 1 -- 172.21.15.167:0/3702810865 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4ef2c4b5-52f4-4f69-8fca-2334077ed8b3", "id": 6} v 0) -- 0x7fb040072d10 con 0x7fb0400c3c60 2024-09-11T22:19:58.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.099+0000 7fb036ffd640 1 -- 172.21.15.167:0/3702810865 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4ef2c4b5-52f4-4f69-8fca-2334077ed8b3", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fb028007610 con 0x7fb0400c3c60 2024-09-11T22:19:58.100 INFO:teuthology.orchestra.run.smithi167.stdout:6 2024-09-11T22:19:58.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.100+0000 7fb04483c640 1 -- 172.21.15.167:0/3702810865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0400c3c60 msgr2=0x7fb0401ee250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.100+0000 7fb04483c640 1 --2- 172.21.15.167:0/3702810865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0400c3c60 0x7fb0401ee250 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb02800c390 tx=0x7fb028001e70 comp rx=0 tx=0).stop 2024-09-11T22:19:58.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.100+0000 7fb04483c640 1 -- 172.21.15.167:0/3702810865 shutdown_connections 2024-09-11T22:19:58.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.100+0000 7fb04483c640 1 --2- 172.21.15.167:0/3702810865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb040151970 0x7fb0401ee790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.100+0000 7fb04483c640 1 --2- 172.21.15.167:0/3702810865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0400c3c60 0x7fb0401ee250 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.100+0000 7fb04483c640 1 --2- 172.21.15.167:0/3702810865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0400726c0 0x7fb0400cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.100+0000 7fb04483c640 1 -- 172.21.15.167:0/3702810865 >> 172.21.15.167:0/3702810865 conn(0x7fb04006ee80 msgr2=0x7fb0400cb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:58.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.100+0000 7fb04483c640 1 -- 172.21.15.167:0/3702810865 shutdown_connections 2024-09-11T22:19:58.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.100+0000 7fb04483c640 1 -- 172.21.15.167:0/3702810865 wait complete. 2024-09-11T22:19:58.111 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 761673d8-d6fc-4ded-a9f3-d49ab8f7c969 7 2024-09-11T22:19:58.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.210+0000 7f2ca3ad7640 1 Processor -- start 2024-09-11T22:19:58.211 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.210+0000 7f2ca3ad7640 1 -- start start 2024-09-11T22:19:58.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.211+0000 7f2ca3ad7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c9c06c3a0 0x7f2c9c073880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.211+0000 7f2ca3ad7640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2c9c06cee0 0x7f2c9c073dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.211+0000 7f2ca3ad7640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c9c0687e0 con 0x7f2c9c0b20e0 2024-09-11T22:19:58.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.211+0000 7f2ca3ad7640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f2c9c0c41a0 con 0x7f2c9c06cee0 2024-09-11T22:19:58.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.211+0000 7f2ca3ad7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2c9c072860 con 0x7f2c9c06c3a0 2024-09-11T22:19:58.212 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.211+0000 7f2ca2074640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2c9c06cee0 0x7f2c9c073dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.211+0000 7f2ca2074640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2c9c06cee0 0x7f2c9c073dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.167:34546/0 (socket says 172.21.15.167:34546) 2024-09-11T22:19:58.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.211+0000 7f2ca2074640 1 -- 172.21.15.167:0/1516135912 learned_addr learned my addr 172.21.15.167:0/1516135912 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-11T22:19:58.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.211+0000 7f2ca1072640 1 --2- 172.21.15.167:0/1516135912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c9c06c3a0 0x7f2c9c073880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.211+0000 7f2ca2074640 1 -- 172.21.15.167:0/1516135912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c9c06c3a0 msgr2=0x7f2c9c073880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:58.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.211+0000 7f2ca2074640 1 --2- 172.21.15.167:0/1516135912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c9c06c3a0 0x7f2c9c073880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.211+0000 7f2ca2074640 1 -- 172.21.15.167:0/1516135912 >> v1:172.21.15.100:6789/0 conn(0x7f2c9c0b20e0 legacy=0x7f2c9c072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.211+0000 7f2ca2074640 1 -- 172.21.15.167:0/1516135912 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c9c06c890 con 0x7f2c9c06cee0 2024-09-11T22:19:58.213 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.212+0000 7f2ca2074640 1 --2- 172.21.15.167:0/1516135912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c9c06cee0 0x7f2c9c073dc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009e50 tx=0x7f2c9402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ccf2138121c474 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.215+0000 7f2ca0871640 1 -- 172.21.15.167:0/1516135912 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94036070 con 0x7f2c9c06cee0 2024-09-11T22:19:58.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.215+0000 7f2ca0871640 1 -- 172.21.15.167:0/1516135912 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c94031600 con 0x7f2c9c06cee0 2024-09-11T22:19:58.216 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.215+0000 7f2ca0871640 1 -- 172.21.15.167:0/1516135912 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c940319d0 con 0x7f2c9c06cee0 2024-09-11T22:19:58.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.216+0000 7f2ca3ad7640 1 -- 172.21.15.167:0/1516135912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c9c06cee0 msgr2=0x7f2c9c073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.216+0000 7f2ca3ad7640 1 --2- 172.21.15.167:0/1516135912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c9c06cee0 0x7f2c9c073dc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009e50 tx=0x7f2c9402a7a0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.216+0000 7f2ca3ad7640 1 -- 172.21.15.167:0/1516135912 shutdown_connections 2024-09-11T22:19:58.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.216+0000 7f2ca3ad7640 1 --2- 172.21.15.167:0/1516135912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c9c06cee0 0x7f2c9c073dc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.216+0000 7f2ca3ad7640 1 --2- 172.21.15.167:0/1516135912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c9c06c3a0 0x7f2c9c073880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.217 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.216+0000 7f2ca3ad7640 1 -- 172.21.15.167:0/1516135912 >> 172.21.15.167:0/1516135912 conn(0x7f2c9c06ee80 msgr2=0x7f2c9c070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:58.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.216+0000 7f2ca3ad7640 1 -- 172.21.15.167:0/1516135912 shutdown_connections 2024-09-11T22:19:58.218 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.216+0000 7f2ca3ad7640 1 -- 172.21.15.167:0/1516135912 wait complete. 2024-09-11T22:19:58.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.217+0000 7f2ca3ad7640 1 Processor -- start 2024-09-11T22:19:58.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.217+0000 7f2ca3ad7640 1 -- start start 2024-09-11T22:19:58.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.218+0000 7f2ca3ad7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c9c06c3a0 0x7f2c9c0739f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.218+0000 7f2ca3ad7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c9c06cee0 0x7f2c9c14be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.218+0000 7f2ca3ad7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c9c0b20e0 0x7f2c9c147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.218+0000 7f2ca3ad7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9c0b24c0 con 0x7f2c9c06c3a0 2024-09-11T22:19:58.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.218+0000 7f2ca3ad7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9c0c7e60 con 0x7f2c9c0b20e0 2024-09-11T22:19:58.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.218+0000 7f2ca3ad7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2c9c0c8140 con 0x7f2c9c06cee0 2024-09-11T22:19:58.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.218+0000 7f2ca2074640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c9c0b20e0 0x7f2c9c147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.218+0000 7f2ca1072640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c9c06cee0 0x7f2c9c14be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.218+0000 7f2ca1072640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c9c06cee0 0x7f2c9c14be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:44374/0 (socket says 172.21.15.167:44374) 2024-09-11T22:19:58.221 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.218+0000 7f2ca2074640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c9c0b20e0 0x7f2c9c147830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48914/0 (socket says 172.21.15.167:48914) 2024-09-11T22:19:58.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.218+0000 7f2ca1072640 1 -- 172.21.15.167:0/1074158305 learned_addr learned my addr 172.21.15.167:0/1074158305 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-11T22:19:58.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.218+0000 7f2ca1873640 1 --2- 172.21.15.167:0/1074158305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c9c06c3a0 0x7f2c9c0739f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.218+0000 7f2ca2074640 1 -- 172.21.15.167:0/1074158305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c9c06cee0 msgr2=0x7f2c9c14be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.218+0000 7f2ca2074640 1 --2- 172.21.15.167:0/1074158305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c9c06cee0 0x7f2c9c14be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.218+0000 7f2ca2074640 1 -- 172.21.15.167:0/1074158305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c9c06c3a0 msgr2=0x7f2c9c0739f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.218+0000 7f2ca2074640 1 --2- 172.21.15.167:0/1074158305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c9c06c3a0 0x7f2c9c0739f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.218+0000 7f2ca2074640 1 -- 172.21.15.167:0/1074158305 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c9c1f12d0 con 0x7f2c9c0b20e0 2024-09-11T22:19:58.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.218+0000 7f2ca1072640 1 --2- 172.21.15.167:0/1074158305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c9c06cee0 0x7f2c9c14be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:58.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.218+0000 7f2ca2074640 1 --2- 172.21.15.167:0/1074158305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c9c0b20e0 0x7f2c9c147830 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2c94030000 tx=0x7f2c94004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.218+0000 7f2c927fc640 1 -- 172.21.15.167:0/1074158305 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94036050 con 0x7f2c9c0b20e0 2024-09-11T22:19:58.222 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.218+0000 7f2c927fc640 1 -- 172.21.15.167:0/1074158305 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c94042070 con 0x7f2c9c0b20e0 2024-09-11T22:19:58.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.218+0000 7f2c927fc640 1 -- 172.21.15.167:0/1074158305 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94009510 con 0x7f2c9c0b20e0 2024-09-11T22:19:58.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.218+0000 7f2ca3ad7640 1 -- 172.21.15.167:0/1074158305 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c9c150210 con 0x7f2c9c0b20e0 2024-09-11T22:19:58.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.219+0000 7f2ca3ad7640 1 -- 172.21.15.167:0/1074158305 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c9c1f1570 con 0x7f2c9c0b20e0 2024-09-11T22:19:58.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.219+0000 7f2c927fc640 1 -- 172.21.15.167:0/1074158305 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2c94007bd0 con 0x7f2c9c0b20e0 2024-09-11T22:19:58.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.219+0000 7f2c927fc640 1 -- 172.21.15.167:0/1074158305 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f2c9403dab0 con 0x7f2c9c0b20e0 2024-09-11T22:19:58.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.220+0000 7f2ca3ad7640 1 -- 172.21.15.167:0/1074158305 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c9c0c9710 con 0x7f2c9c0b20e0 2024-09-11T22:19:58.223 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.222+0000 7f2c927fc640 1 -- 172.21.15.167:0/1074158305 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2c9403dd50 con 0x7f2c9c0b20e0 2024-09-11T22:19:58.292 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.292+0000 7f2ca3ad7640 1 -- 172.21.15.167:0/1074158305 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "761673d8-d6fc-4ded-a9f3-d49ab8f7c969", "id": 7} v 0) -- 0x7f2c9c06ccc0 con 0x7f2c9c0b20e0 2024-09-11T22:19:58.301 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.300+0000 7f2c927fc640 1 -- 172.21.15.167:0/1074158305 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "761673d8-d6fc-4ded-a9f3-d49ab8f7c969", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f2c94047460 con 0x7f2c9c0b20e0 2024-09-11T22:19:58.301 INFO:teuthology.orchestra.run.smithi167.stdout:7 2024-09-11T22:19:58.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.301+0000 7f2ca3ad7640 1 -- 172.21.15.167:0/1074158305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c9c0b20e0 msgr2=0x7f2c9c147830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.301+0000 7f2ca3ad7640 1 --2- 172.21.15.167:0/1074158305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c9c0b20e0 0x7f2c9c147830 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2c94030000 tx=0x7f2c94004a40 comp rx=0 tx=0).stop 2024-09-11T22:19:58.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.301+0000 7f2ca3ad7640 1 -- 172.21.15.167:0/1074158305 shutdown_connections 2024-09-11T22:19:58.302 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.301+0000 7f2ca3ad7640 1 --2- 172.21.15.167:0/1074158305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c9c0b20e0 0x7f2c9c147830 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.301+0000 7f2ca3ad7640 1 --2- 172.21.15.167:0/1074158305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c9c06cee0 0x7f2c9c14be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.301+0000 7f2ca3ad7640 1 --2- 172.21.15.167:0/1074158305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c9c06c3a0 0x7f2c9c0739f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.301+0000 7f2ca3ad7640 1 -- 172.21.15.167:0/1074158305 >> 172.21.15.167:0/1074158305 conn(0x7f2c9c06ee80 msgr2=0x7f2c9c157a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:58.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.301+0000 7f2ca3ad7640 1 -- 172.21.15.167:0/1074158305 shutdown_connections 2024-09-11T22:19:58.303 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-11T22:19:58.301+0000 7f2ca3ad7640 1 -- 172.21.15.167:0/1074158305 wait complete. 2024-09-11T22:19:58.312 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-11T22:19:58.312 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-11T22:19:58.315 INFO:tasks.ceph.osd.0:Started 2024-09-11T22:19:58.315 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-11T22:19:58.315 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-11T22:19:58.317 INFO:tasks.ceph.osd.1:Started 2024-09-11T22:19:58.318 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-11T22:19:58.318 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-11T22:19:58.320 INFO:tasks.ceph.osd.2:Started 2024-09-11T22:19:58.320 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-11T22:19:58.320 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-11T22:19:58.322 INFO:tasks.ceph.osd.3:Started 2024-09-11T22:19:58.322 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-11T22:19:58.322 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-11T22:19:58.324 INFO:tasks.ceph.osd.4:Started 2024-09-11T22:19:58.325 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-11T22:19:58.325 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-11T22:19:58.327 INFO:tasks.ceph.osd.5:Started 2024-09-11T22:19:58.327 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-11T22:19:58.327 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-11T22:19:58.329 INFO:tasks.ceph.osd.6:Started 2024-09-11T22:19:58.329 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-11T22:19:58.329 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-11T22:19:58.331 INFO:tasks.ceph.osd.7:Started 2024-09-11T22:19:58.332 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:19:58.348 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:58.344+0000 7f9ec89dd040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T22:19:58.425 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:58.424+0000 7f9ec89dd040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T22:19:58.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.448+0000 7f377e996640 1 Processor -- start 2024-09-11T22:19:58.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.448+0000 7f377e996640 1 -- start start 2024-09-11T22:19:58.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.449+0000 7f377e996640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3778154b00 0x7f377806d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.449+0000 7f377e996640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f37780c89a0 0x7f3778067950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.449+0000 7f377e996640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37780c9190 con 0x7f3778072840 2024-09-11T22:19:58.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.449+0000 7f377e996640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f37780739d0 con 0x7f37780c89a0 2024-09-11T22:19:58.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.449+0000 7f377e996640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f37780c9470 con 0x7f3778154b00 2024-09-11T22:19:58.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.449+0000 7f377cf33640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f37780c89a0 0x7f3778067950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.449+0000 7f37777fe640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3778072840 0x7f377815e840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:32886/0 (socket says 172.21.15.100:32886) 2024-09-11T22:19:58.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.449+0000 7f37777fe640 1 -- 172.21.15.100:0/2520701113 learned_addr learned my addr 172.21.15.100:0/2520701113 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:19:58.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.449+0000 7f3777fff640 1 --2- 172.21.15.100:0/2520701113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3778154b00 0x7f377806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.449+0000 7f377cf33640 1 -- 172.21.15.100:0/2520701113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3778154b00 msgr2=0x7f377806d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:58.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.449+0000 7f377cf33640 1 --2- 172.21.15.100:0/2520701113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3778154b00 0x7f377806d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.449+0000 7f377cf33640 1 -- 172.21.15.100:0/2520701113 >> v1:172.21.15.100:6789/0 conn(0x7f3778072840 legacy=0x7f377815e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.450+0000 7f377cf33640 1 -- 172.21.15.100:0/2520701113 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377806c670 con 0x7f37780c89a0 2024-09-11T22:19:58.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.450+0000 7f3776ffd640 1 -- 172.21.15.100:0/2520701113 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2959287156 0 0) 0x7f37780c9190 con 0x7f3778072840 2024-09-11T22:19:58.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.450+0000 7f377cf33640 1 --2- 172.21.15.100:0/2520701113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37780c89a0 0x7f3778067950 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3770009d90 tx=0x7f377002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f569d68c1964b17 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.450+0000 7f3776ffd640 1 -- 172.21.15.100:0/2520701113 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3770007740 con 0x7f37780c89a0 2024-09-11T22:19:58.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.450+0000 7f3776ffd640 1 -- 172.21.15.100:0/2520701113 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37700078e0 con 0x7f37780c89a0 2024-09-11T22:19:58.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.450+0000 7f3776ffd640 1 -- 172.21.15.100:0/2520701113 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3770007cb0 con 0x7f37780c89a0 2024-09-11T22:19:58.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.451+0000 7f377e996640 1 -- 172.21.15.100:0/2520701113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37780c89a0 msgr2=0x7f3778067950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.451+0000 7f377e996640 1 --2- 172.21.15.100:0/2520701113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37780c89a0 0x7f3778067950 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3770009d90 tx=0x7f377002a6f0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.451+0000 7f377e996640 1 -- 172.21.15.100:0/2520701113 shutdown_connections 2024-09-11T22:19:58.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.451+0000 7f377e996640 1 --2- 172.21.15.100:0/2520701113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37780c89a0 0x7f3778067950 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.451+0000 7f377e996640 1 --2- 172.21.15.100:0/2520701113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3778154b00 0x7f377806d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.451+0000 7f377e996640 1 -- 172.21.15.100:0/2520701113 >> 172.21.15.100:0/2520701113 conn(0x7f37780cd200 msgr2=0x7f37780cd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:58.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.451+0000 7f377e996640 1 -- 172.21.15.100:0/2520701113 shutdown_connections 2024-09-11T22:19:58.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.451+0000 7f377e996640 1 -- 172.21.15.100:0/2520701113 wait complete. 2024-09-11T22:19:58.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.452+0000 7f377e996640 1 Processor -- start 2024-09-11T22:19:58.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.452+0000 7f377e996640 1 -- start start 2024-09-11T22:19:58.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.453+0000 7f377e996640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3778072840 0x7f377815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.453+0000 7f377e996640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37780c89a0 0x7f377815b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.453+0000 7f377e996640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3778154b00 0x7f37781509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:58.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.453+0000 7f377e996640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3778072c60 con 0x7f37780c89a0 2024-09-11T22:19:58.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.453+0000 7f377e996640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f377806cc30 con 0x7f3778154b00 2024-09-11T22:19:58.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.453+0000 7f377e996640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f37780c8510 con 0x7f3778072840 2024-09-11T22:19:58.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.453+0000 7f37777fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37780c89a0 0x7f377815b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.453+0000 7f37777fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37780c89a0 0x7f377815b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59104/0 (socket says 172.21.15.100:59104) 2024-09-11T22:19:58.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.453+0000 7f37777fe640 1 -- 172.21.15.100:0/2816777053 learned_addr learned my addr 172.21.15.100:0/2816777053 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:19:58.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.453+0000 7f3777fff640 1 --2- 172.21.15.100:0/2816777053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3778072840 0x7f377815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.453+0000 7f377cf33640 1 --2- 172.21.15.100:0/2816777053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3778154b00 0x7f37781509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:58.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.454+0000 7f3777fff640 1 -- 172.21.15.100:0/2816777053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3778154b00 msgr2=0x7f37781509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.454+0000 7f3777fff640 1 --2- 172.21.15.100:0/2816777053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3778154b00 0x7f37781509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.454+0000 7f3777fff640 1 -- 172.21.15.100:0/2816777053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37780c89a0 msgr2=0x7f377815b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.454+0000 7f3777fff640 1 --2- 172.21.15.100:0/2816777053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37780c89a0 0x7f377815b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.454+0000 7f3777fff640 1 -- 172.21.15.100:0/2816777053 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37780c7640 con 0x7f3778072840 2024-09-11T22:19:58.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.454+0000 7f37777fe640 1 --2- 172.21.15.100:0/2816777053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37780c89a0 0x7f377815b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:58.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.454+0000 7f377cf33640 1 --2- 172.21.15.100:0/2816777053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3778154b00 0x7f37781509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:58.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.454+0000 7f3777fff640 1 --2- 172.21.15.100:0/2816777053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3778072840 0x7f377815ae70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f376c00e8a0 tx=0x7f376c00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:58.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.454+0000 7f3774ff9640 1 -- 172.21.15.100:0/2816777053 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c017070 con 0x7f3778072840 2024-09-11T22:19:58.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.454+0000 7f3774ff9640 1 -- 172.21.15.100:0/2816777053 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f376c00c940 con 0x7f3778072840 2024-09-11T22:19:58.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.454+0000 7f3774ff9640 1 -- 172.21.15.100:0/2816777053 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c009e60 con 0x7f3778072840 2024-09-11T22:19:58.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.454+0000 7f377e996640 1 -- 172.21.15.100:0/2816777053 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37781f3290 con 0x7f3778072840 2024-09-11T22:19:58.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.454+0000 7f377e996640 1 -- 172.21.15.100:0/2816777053 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f377815a390 con 0x7f3778072840 2024-09-11T22:19:58.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.455+0000 7f3774ff9640 1 -- 172.21.15.100:0/2816777053 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f376c01a070 con 0x7f3778072840 2024-09-11T22:19:58.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.455+0000 7f3774ff9640 1 -- 172.21.15.100:0/2816777053 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f376c01cb20 con 0x7f3778072840 2024-09-11T22:19:58.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.455+0000 7f377e996640 1 -- 172.21.15.100:0/2816777053 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37780c8e50 con 0x7f3778072840 2024-09-11T22:19:58.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.457+0000 7f3774ff9640 1 -- 172.21.15.100:0/2816777053 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f376c00cd60 con 0x7f3778072840 2024-09-11T22:19:58.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.515+0000 7f377e996640 1 -- 172.21.15.100:0/2816777053 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37781540e0 con 0x7f3778072840 2024-09-11T22:19:58.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.516+0000 7f3774ff9640 1 -- 172.21.15.100:0/2816777053 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f376c01c450 con 0x7f3778072840 2024-09-11T22:19:58.517 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:19:58.518 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":10,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","created":"2024-09-11T22:19:56.198855+0000","modified":"2024-09-11T22:19:58.294227+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T22:19:58.294227+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5de0ba54-34c5-4343-b19a-1f675efc49c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5a1f6456-6604-4b41-b9b9-52ae8d6616ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a604cb26-7b0f-402d-b6ac-3652884b4b45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"73dc2cbb-70ff-4d12-ba2f-8778a49892f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"07960648-04df-4aec-a72c-c29e28b74bcb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2b4767e6-cab7-4b45-9150-55432f5576aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4ef2c4b5-52f4-4f69-8fca-2334077ed8b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"761673d8-d6fc-4ded-a9f3-d49ab8f7c969","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:19:58.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.517+0000 7f377e996640 1 -- 172.21.15.100:0/2816777053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3778072840 msgr2=0x7f377815ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:58.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.517+0000 7f377e996640 1 --2- 172.21.15.100:0/2816777053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3778072840 0x7f377815ae70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f376c00e8a0 tx=0x7f376c00ed60 comp rx=0 tx=0).stop 2024-09-11T22:19:58.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.517+0000 7f377e996640 1 -- 172.21.15.100:0/2816777053 shutdown_connections 2024-09-11T22:19:58.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.517+0000 7f377e996640 1 --2- 172.21.15.100:0/2816777053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3778154b00 0x7f37781509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.517+0000 7f377e996640 1 --2- 172.21.15.100:0/2816777053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37780c89a0 0x7f377815b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.517+0000 7f377e996640 1 --2- 172.21.15.100:0/2816777053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3778072840 0x7f377815ae70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:58.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.517+0000 7f377e996640 1 -- 172.21.15.100:0/2816777053 >> 172.21.15.100:0/2816777053 conn(0x7f37780cd200 msgr2=0x7f377815c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:58.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.517+0000 7f377e996640 1 -- 172.21.15.100:0/2816777053 shutdown_connections 2024-09-11T22:19:58.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:19:58.517+0000 7f377e996640 1 -- 172.21.15.100:0/2816777053 wait complete. 2024-09-11T22:19:58.520 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:58.518+0000 7f56f5f86040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T22:19:58.528 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-11T22:19:58.528 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-11T22:19:58.572 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:58.571+0000 7f56f5f86040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T22:19:58.798 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:58.798+0000 7f9ec89dd040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T22:19:58.883 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:58.882+0000 7f9ec89dd040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T22:19:58.944 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:58.942+0000 7f56f5f86040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-11T22:19:58.991 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:58.991+0000 7f9ec89dd040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:19:59.032 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:59.031+0000 7f56f5f86040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T22:19:59.038 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:59.038+0000 7f9ec89dd040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T22:19:59.140 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:59.139+0000 7f56f5f86040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T22:19:59.153 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:59.152+0000 7f9ec89dd040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T22:19:59.186 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:59.185+0000 7f56f5f86040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T22:19:59.205 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:59.205+0000 7f9ec89dd040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T22:19:59.253 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:59.252+0000 7f9ec89dd040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T22:19:59.303 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:59.303+0000 7f56f5f86040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-11T22:19:59.333 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T22:19:59.356 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:59.356+0000 7f56f5f86040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T22:19:59.367 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:59.366+0000 7f9ec89dd040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T22:19:59.401 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:59.401+0000 7f56f5f86040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T22:19:59.419 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:59.419+0000 7f9ec89dd040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T22:19:59.423 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.423+0000 7fd80fdc6640 1 Processor -- start 2024-09-11T22:19:59.423 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.423+0000 7fd80fdc6640 1 -- start start 2024-09-11T22:19:59.425 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.424+0000 7fd80fdc6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd808151690 0x7fd8080c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.425 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.424+0000 7fd80fdc6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd808151a70 0x7fd8080c4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.425 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.424+0000 7fd80fdc6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8080c8c30 con 0x7fd8080c72d0 2024-09-11T22:19:59.425 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.424+0000 7fd80fdc6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fd8080c4b50 con 0x7fd808151a70 2024-09-11T22:19:59.425 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.424+0000 7fd80fdc6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd8080c6060 con 0x7fd808151690 2024-09-11T22:19:59.425 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.424+0000 7fd80db62640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd808151690 0x7fd8080c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.426 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.424+0000 7fd80d361640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd808151a70 0x7fd8080c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.426 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.424+0000 7fd80e363640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fd8080c72d0 0x7fd8080c93f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:56350/0 (socket says 172.21.15.100:56350) 2024-09-11T22:19:59.426 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.424+0000 7fd80db62640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd808151690 0x7fd8080c7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:56676/0 (socket says 172.21.15.100:56676) 2024-09-11T22:19:59.426 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.424+0000 7fd80e363640 1 -- 172.21.15.100:0/1607500088 learned_addr learned my addr 172.21.15.100:0/1607500088 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:19:59.426 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.424+0000 7fd80d361640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd808151a70 0x7fd8080c4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:35890/0 (socket says 172.21.15.100:35890) 2024-09-11T22:19:59.426 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.424+0000 7fd80db62640 1 -- 172.21.15.100:0/1607500088 >> v2:172.21.15.167:3300/0 conn(0x7fd808151a70 msgr2=0x7fd8080c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:19:59.426 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.424+0000 7fd80db62640 1 --2- 172.21.15.100:0/1607500088 >> v2:172.21.15.167:3300/0 conn(0x7fd808151a70 0x7fd8080c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.426 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.424+0000 7fd80db62640 1 -- 172.21.15.100:0/1607500088 >> v1:172.21.15.167:6789/0 conn(0x7fd8080c72d0 legacy=0x7fd8080c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.426 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.424+0000 7fd80db62640 1 -- 172.21.15.100:0/1607500088 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8080c6340 con 0x7fd808151690 2024-09-11T22:19:59.426 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.425+0000 7fd80d361640 1 --2- 172.21.15.100:0/1607500088 >> v2:172.21.15.167:3300/0 conn(0x7fd808151a70 0x7fd8080c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:59.428 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.425+0000 7fd80db62640 1 --2- 172.21.15.100:0/1607500088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd808151690 0x7fd8080c7b10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd8080c8e00 tx=0x7fd7f802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b41540cf6e51b064 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:59.428 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.425+0000 7fd80cb60640 1 -- 172.21.15.100:0/1607500088 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8037070 con 0x7fd808151690 2024-09-11T22:19:59.428 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.425+0000 7fd80cb60640 1 -- 172.21.15.100:0/1607500088 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7f8032440 con 0x7fd808151690 2024-09-11T22:19:59.428 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.425+0000 7fd80cb60640 1 -- 172.21.15.100:0/1607500088 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8032810 con 0x7fd808151690 2024-09-11T22:19:59.428 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.426+0000 7fd80fdc6640 1 -- 172.21.15.100:0/1607500088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd808151690 msgr2=0x7fd8080c7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.428 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.426+0000 7fd80fdc6640 1 --2- 172.21.15.100:0/1607500088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd808151690 0x7fd8080c7b10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd8080c8e00 tx=0x7fd7f802a210 comp rx=0 tx=0).stop 2024-09-11T22:19:59.428 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.426+0000 7fd80fdc6640 1 -- 172.21.15.100:0/1607500088 shutdown_connections 2024-09-11T22:19:59.428 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.426+0000 7fd80fdc6640 1 --2- 172.21.15.100:0/1607500088 >> v2:172.21.15.167:3300/0 conn(0x7fd808151a70 0x7fd8080c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.428 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.426+0000 7fd80fdc6640 1 --2- 172.21.15.100:0/1607500088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd808151690 0x7fd8080c7b10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.428 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.426+0000 7fd80fdc6640 1 -- 172.21.15.100:0/1607500088 >> 172.21.15.100:0/1607500088 conn(0x7fd8080cd500 msgr2=0x7fd8080cd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:59.428 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.426+0000 7fd80fdc6640 1 -- 172.21.15.100:0/1607500088 shutdown_connections 2024-09-11T22:19:59.428 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.426+0000 7fd80fdc6640 1 -- 172.21.15.100:0/1607500088 wait complete. 2024-09-11T22:19:59.429 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.427+0000 7fd80fdc6640 1 Processor -- start 2024-09-11T22:19:59.429 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.427+0000 7fd80fdc6640 1 -- start start 2024-09-11T22:19:59.431 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.428+0000 7fd80fdc6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8080c72d0 0x7fd8081e5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.431 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.428+0000 7fd80fdc6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd808151690 0x7fd8080cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.431 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.428+0000 7fd80fdc6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd808151a70 0x7fd808159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:19:59.431 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.428+0000 7fd80fdc6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd8080c8ed0 con 0x7fd808151690 2024-09-11T22:19:59.431 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.428+0000 7fd80fdc6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd8080c6900 con 0x7fd808151a70 2024-09-11T22:19:59.431 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.428+0000 7fd80fdc6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd80806c260 con 0x7fd8080c72d0 2024-09-11T22:19:59.431 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.428+0000 7fd80d361640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd808151690 0x7fd8080cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.431 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.428+0000 7fd80db62640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8080c72d0 0x7fd8081e5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.431 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.428+0000 7fd80d361640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd808151690 0x7fd8080cc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59110/0 (socket says 172.21.15.100:59110) 2024-09-11T22:19:59.431 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.428+0000 7fd80d361640 1 -- 172.21.15.100:0/881700151 learned_addr learned my addr 172.21.15.100:0/881700151 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:19:59.432 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.428+0000 7fd80e363640 1 --2- 172.21.15.100:0/881700151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd808151a70 0x7fd808159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:19:59.432 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.428+0000 7fd80db62640 1 -- 172.21.15.100:0/881700151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd808151a70 msgr2=0x7fd808159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.432 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.428+0000 7fd80db62640 1 --2- 172.21.15.100:0/881700151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd808151a70 0x7fd808159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.432 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.428+0000 7fd80db62640 1 -- 172.21.15.100:0/881700151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd808151690 msgr2=0x7fd8080cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.432 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.428+0000 7fd80db62640 1 --2- 172.21.15.100:0/881700151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd808151690 0x7fd8080cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.432 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.428+0000 7fd80db62640 1 -- 172.21.15.100:0/881700151 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8081e5b90 con 0x7fd8080c72d0 2024-09-11T22:19:59.432 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.428+0000 7fd80d361640 1 --2- 172.21.15.100:0/881700151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd808151690 0x7fd8080cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:59.432 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.428+0000 7fd80e363640 1 --2- 172.21.15.100:0/881700151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd808151a70 0x7fd808159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:19:59.432 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.429+0000 7fd80db62640 1 --2- 172.21.15.100:0/881700151 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8080c72d0 0x7fd8081e5650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd8080cacd0 tx=0x7fd7f80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:19:59.432 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.429+0000 7fd7fe7fc640 1 -- 172.21.15.100:0/881700151 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8041030 con 0x7fd8080c72d0 2024-09-11T22:19:59.432 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.429+0000 7fd7fe7fc640 1 -- 172.21.15.100:0/881700151 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7f8030500 con 0x7fd8080c72d0 2024-09-11T22:19:59.432 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.429+0000 7fd80fdc6640 1 -- 172.21.15.100:0/881700151 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd80815a110 con 0x7fd8080c72d0 2024-09-11T22:19:59.432 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.429+0000 7fd7fe7fc640 1 -- 172.21.15.100:0/881700151 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8037040 con 0x7fd8080c72d0 2024-09-11T22:19:59.432 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.429+0000 7fd80fdc6640 1 -- 172.21.15.100:0/881700151 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd80815a3b0 con 0x7fd8080c72d0 2024-09-11T22:19:59.433 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.429+0000 7fd7fe7fc640 1 -- 172.21.15.100:0/881700151 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd7f8044070 con 0x7fd8080c72d0 2024-09-11T22:19:59.433 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.429+0000 7fd7fe7fc640 1 -- 172.21.15.100:0/881700151 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fd7f803d6a0 con 0x7fd8080c72d0 2024-09-11T22:19:59.433 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.430+0000 7fd80fdc6640 1 -- 172.21.15.100:0/881700151 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8080c7b10 con 0x7fd8080c72d0 2024-09-11T22:19:59.433 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.432+0000 7fd7fe7fc640 1 -- 172.21.15.100:0/881700151 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd7f803d970 con 0x7fd8080c72d0 2024-09-11T22:19:59.474 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:59.473+0000 7f9ec89dd040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T22:19:59.491 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.491+0000 7fd80fdc6640 1 -- 172.21.15.100:0/881700151 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd80814b110 con 0x7fd8080c72d0 2024-09-11T22:19:59.492 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.491+0000 7fd7fe7fc640 1 -- 172.21.15.100:0/881700151 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fd7f803db50 con 0x7fd8080c72d0 2024-09-11T22:19:59.492 INFO:teuthology.misc.health.smithi100.stdout: 2024-09-11T22:19:59.492 INFO:teuthology.misc.health.smithi100.stdout:{"epoch":10,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","created":"2024-09-11T22:19:56.198855+0000","modified":"2024-09-11T22:19:58.294227+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T22:19:58.294227+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5de0ba54-34c5-4343-b19a-1f675efc49c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5a1f6456-6604-4b41-b9b9-52ae8d6616ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a604cb26-7b0f-402d-b6ac-3652884b4b45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"73dc2cbb-70ff-4d12-ba2f-8778a49892f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"07960648-04df-4aec-a72c-c29e28b74bcb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2b4767e6-cab7-4b45-9150-55432f5576aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4ef2c4b5-52f4-4f69-8fca-2334077ed8b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"761673d8-d6fc-4ded-a9f3-d49ab8f7c969","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:19:59.493 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.492+0000 7fd80fdc6640 1 -- 172.21.15.100:0/881700151 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8080c72d0 msgr2=0x7fd8081e5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:19:59.493 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.492+0000 7fd80fdc6640 1 --2- 172.21.15.100:0/881700151 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8080c72d0 0x7fd8081e5650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd8080cacd0 tx=0x7fd7f80046c0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.493 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.492+0000 7fd80fdc6640 1 -- 172.21.15.100:0/881700151 shutdown_connections 2024-09-11T22:19:59.493 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.492+0000 7fd80fdc6640 1 --2- 172.21.15.100:0/881700151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd808151a70 0x7fd808159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.493 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.492+0000 7fd80fdc6640 1 --2- 172.21.15.100:0/881700151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd808151690 0x7fd8080cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.493 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.492+0000 7fd80fdc6640 1 --2- 172.21.15.100:0/881700151 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8080c72d0 0x7fd8081e5650 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:19:59.494 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.492+0000 7fd80fdc6640 1 -- 172.21.15.100:0/881700151 >> 172.21.15.100:0/881700151 conn(0x7fd8080cd500 msgr2=0x7fd8080c9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:19:59.494 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.492+0000 7fd80fdc6640 1 -- 172.21.15.100:0/881700151 shutdown_connections 2024-09-11T22:19:59.494 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:19:59.492+0000 7fd80fdc6640 1 -- 172.21.15.100:0/881700151 wait complete. 2024-09-11T22:19:59.502 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-11T22:19:59.514 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-11T22:19:59.513+0000 7f8403a0b640 -1 Falling back to public interface 2024-09-11T22:19:59.515 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:59.515+0000 7f56f5f86040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T22:19:59.534 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-11T22:19:59.533+0000 7f95666ef640 -1 Falling back to public interface 2024-09-11T22:19:59.544 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:59.544+0000 7f9ec89dd040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T22:19:59.563 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-09-11T22:19:59.562+0000 7f4dff8ef640 -1 Falling back to public interface 2024-09-11T22:19:59.567 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:59.567+0000 7f56f5f86040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T22:19:59.590 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:59.590+0000 7f9ec89dd040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T22:19:59.619 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:59.618+0000 7f56f5f86040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T22:19:59.633 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:19:59.633+0000 7f9ec89dd040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T22:19:59.687 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:59.686+0000 7f56f5f86040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T22:19:59.731 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:59.730+0000 7f56f5f86040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T22:19:59.776 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:19:59.775+0000 7f56f5f86040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T22:19:59.786 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-11T22:19:59.785+0000 7fb9dae33640 -1 Falling back to public interface 2024-09-11T22:19:59.795 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-09-11T22:19:59.794+0000 7f9ec7f20640 -1 Falling back to public interface 2024-09-11T22:19:59.800 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-11T22:19:59.799+0000 7f9c8441e640 -1 Falling back to public interface 2024-09-11T22:20:00.008 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-11T22:20:00.007+0000 7f6ad59db640 -1 Falling back to public interface 2024-09-11T22:20:00.277 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-09-11T22:20:00.276+0000 7fe1c2e0c640 -1 Falling back to public interface 2024-09-11T22:20:00.294 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:20:00.294+0000 7f9ec89dd040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T22:20:00.447 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-09-11T22:20:00.446+0000 7f56f5f86040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T22:20:01.306 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:20:01.305+0000 7f9e692ab640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-11T22:20:01.307 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-09-11T22:20:01.307+0000 7f9e692ab640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-11T22:20:03.091 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-09-11T22:20:03.090+0000 7f4dff8ef640 -1 osd.1 0 log_to_monitors true 2024-09-11T22:20:03.339 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-11T22:20:03.338+0000 7f95666ef640 -1 osd.6 0 log_to_monitors true 2024-09-11T22:20:03.362 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-11T22:20:03.361+0000 7f8403a0b640 -1 osd.7 0 log_to_monitors true 2024-09-11T22:20:03.633 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-11T22:20:03.632+0000 7fb9dae33640 -1 osd.4 0 log_to_monitors true 2024-09-11T22:20:03.816 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-09-11T22:20:03.816+0000 7f9ec7f20640 -1 osd.0 0 log_to_monitors true 2024-09-11T22:20:03.869 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-11T22:20:03.868+0000 7f9c8441e640 -1 osd.5 0 log_to_monitors true 2024-09-11T22:20:04.061 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-11T22:20:04.061+0000 7f6ad59db640 -1 osd.2 0 log_to_monitors true 2024-09-11T22:20:04.564 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-09-11T22:20:04.563+0000 7fe1c2e0c640 -1 osd.3 0 log_to_monitors true 2024-09-11T22:20:04.890 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-09-11T22:20:04.889+0000 7f4dfb87e640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T22:20:04.901 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-09-11T22:20:04.901+0000 7f4df369e640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:20:06.025 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-09-11T22:20:06.025+0000 7f9ec46c3640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T22:20:06.038 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-09-11T22:20:06.038+0000 7f9ebbccf640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:20:06.060 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-11T22:20:06.060+0000 7f6ad217e640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T22:20:06.071 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-11T22:20:06.071+0000 7f6ac978a640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:20:06.308 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T22:20:06.312 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-11T22:20:06.311+0000 7f83ff3f9640 -1 osd.7 0 waiting for initial osdmap 2024-09-11T22:20:06.317 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-11T22:20:06.316+0000 7fb9d6dc2640 -1 osd.4 0 waiting for initial osdmap 2024-09-11T22:20:06.319 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-11T22:20:06.317+0000 7f956267e640 -1 osd.6 0 waiting for initial osdmap 2024-09-11T22:20:06.325 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-09-11T22:20:06.325+0000 7fb9cebe2640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:20:06.328 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-11T22:20:06.327+0000 7f9c803ad640 -1 osd.5 0 waiting for initial osdmap 2024-09-11T22:20:06.333 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-09-11T22:20:06.332+0000 7f955a49e640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:20:06.333 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-09-11T22:20:06.332+0000 7f83f7219640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:20:06.339 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-09-11T22:20:06.339+0000 7f9c781cd640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:20:06.411 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.410+0000 7f4068ffd640 1 Processor -- start 2024-09-11T22:20:06.411 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.410+0000 7f4068ffd640 1 -- start start 2024-09-11T22:20:06.412 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.411+0000 7f4068ffd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4064154d30 0x7f406406f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:06.412 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.411+0000 7f4068ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f406415b5f0 0x7f406406f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:06.412 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.411+0000 7f4068ffd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40640b0190 con 0x7f40640704d0 2024-09-11T22:20:06.412 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.411+0000 7f4068ffd640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f40640b0470 con 0x7f4064154d30 2024-09-11T22:20:06.413 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.411+0000 7f4068ffd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f40640b0750 con 0x7f406415b5f0 2024-09-11T22:20:06.413 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.411+0000 7f406259c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4064154d30 0x7f406406f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:06.413 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.411+0000 7f406259c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4064154d30 0x7f406406f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46658/0 (socket says 172.21.15.100:46658) 2024-09-11T22:20:06.413 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.411+0000 7f406259c640 1 -- 172.21.15.100:0/303155116 learned_addr learned my addr 172.21.15.100:0/303155116 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:06.413 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.411+0000 7f4062d9d640 1 --2- 172.21.15.100:0/303155116 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f406415b5f0 0x7f406406f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:06.413 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.412+0000 7f406259c640 1 -- 172.21.15.100:0/303155116 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f406415b5f0 msgr2=0x7f406406f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:06.413 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.412+0000 7f406259c640 1 --2- 172.21.15.100:0/303155116 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f406415b5f0 0x7f406406f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:06.413 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.412+0000 7f406259c640 1 -- 172.21.15.100:0/303155116 >> v1:172.21.15.167:6789/0 conn(0x7f40640704d0 legacy=0x7f406415aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:06.413 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.412+0000 7f406259c640 1 -- 172.21.15.100:0/303155116 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40640b0a30 con 0x7f4064154d30 2024-09-11T22:20:06.414 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.412+0000 7f406259c640 1 --2- 172.21.15.100:0/303155116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4064154d30 0x7f406406f140 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4054009870 tx=0x7f405402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5e17078efde994 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:06.414 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.412+0000 7f4061d9b640 1 -- 172.21.15.100:0/303155116 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4054037070 con 0x7f4064154d30 2024-09-11T22:20:06.414 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.412+0000 7f4061d9b640 1 -- 172.21.15.100:0/303155116 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f405402ae50 con 0x7f4064154d30 2024-09-11T22:20:06.414 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.412+0000 7f4061d9b640 1 -- 172.21.15.100:0/303155116 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4054032860 con 0x7f4064154d30 2024-09-11T22:20:06.414 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.413+0000 7f4068ffd640 1 -- 172.21.15.100:0/303155116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4064154d30 msgr2=0x7f406406f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:06.415 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.413+0000 7f4068ffd640 1 --2- 172.21.15.100:0/303155116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4064154d30 0x7f406406f140 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4054009870 tx=0x7f405402a300 comp rx=0 tx=0).stop 2024-09-11T22:20:06.415 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.413+0000 7f4068ffd640 1 -- 172.21.15.100:0/303155116 shutdown_connections 2024-09-11T22:20:06.415 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.413+0000 7f4068ffd640 1 --2- 172.21.15.100:0/303155116 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f406415b5f0 0x7f406406f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:06.415 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.413+0000 7f4068ffd640 1 --2- 172.21.15.100:0/303155116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4064154d30 0x7f406406f140 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:06.415 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.413+0000 7f4068ffd640 1 -- 172.21.15.100:0/303155116 >> 172.21.15.100:0/303155116 conn(0x7f40640ce3d0 msgr2=0x7f40640ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:06.415 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.413+0000 7f4068ffd640 1 -- 172.21.15.100:0/303155116 shutdown_connections 2024-09-11T22:20:06.415 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.413+0000 7f4068ffd640 1 -- 172.21.15.100:0/303155116 wait complete. 2024-09-11T22:20:06.415 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.415+0000 7f4068ffd640 1 Processor -- start 2024-09-11T22:20:06.416 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.415+0000 7f4068ffd640 1 -- start start 2024-09-11T22:20:06.418 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.416+0000 7f4068ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40640704d0 0x7f40641e43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:06.418 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.416+0000 7f4068ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4064154d30 0x7f40640b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:06.418 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.416+0000 7f4068ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f406415b5f0 0x7f40640b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:06.418 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.416+0000 7f4068ffd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f40640ca330 con 0x7f40640704d0 2024-09-11T22:20:06.418 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.416+0000 7f4068ffd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f40640ca1b0 con 0x7f4064154d30 2024-09-11T22:20:06.418 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.416+0000 7f4068ffd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f40640b0ec0 con 0x7f406415b5f0 2024-09-11T22:20:06.418 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.416+0000 7f406259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40640704d0 0x7f40641e43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:06.418 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.416+0000 7f406259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40640704d0 0x7f40641e43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46660/0 (socket says 172.21.15.100:46660) 2024-09-11T22:20:06.419 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.416+0000 7f406259c640 1 -- 172.21.15.100:0/710845718 learned_addr learned my addr 172.21.15.100:0/710845718 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:06.419 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.416+0000 7f4062d9d640 1 --2- 172.21.15.100:0/710845718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f406415b5f0 0x7f40640b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:06.419 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.416+0000 7f4059d9b640 1 --2- 172.21.15.100:0/710845718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4064154d30 0x7f40640b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:06.419 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.417+0000 7f4062d9d640 1 -- 172.21.15.100:0/710845718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4064154d30 msgr2=0x7f40640b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:06.419 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.417+0000 7f4062d9d640 1 --2- 172.21.15.100:0/710845718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4064154d30 0x7f40640b2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:06.419 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.417+0000 7f4062d9d640 1 -- 172.21.15.100:0/710845718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40640704d0 msgr2=0x7f40641e43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:06.419 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.417+0000 7f4062d9d640 1 --2- 172.21.15.100:0/710845718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40640704d0 0x7f40641e43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:06.419 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.417+0000 7f4062d9d640 1 -- 172.21.15.100:0/710845718 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40641581c0 con 0x7f406415b5f0 2024-09-11T22:20:06.419 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.417+0000 7f406259c640 1 --2- 172.21.15.100:0/710845718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40640704d0 0x7f40641e43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:06.419 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.417+0000 7f4059d9b640 1 --2- 172.21.15.100:0/710845718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4064154d30 0x7f40640b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:06.419 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.417+0000 7f4062d9d640 1 --2- 172.21.15.100:0/710845718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f406415b5f0 0x7f40640b3160 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f40640cc280 tx=0x7f405c00c0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:06.419 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.417+0000 7f405b7fe640 1 -- 172.21.15.100:0/710845718 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c018020 con 0x7f406415b5f0 2024-09-11T22:20:06.419 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.417+0000 7f405b7fe640 1 -- 172.21.15.100:0/710845718 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f405c00cc80 con 0x7f406415b5f0 2024-09-11T22:20:06.419 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.417+0000 7f4068ffd640 1 -- 172.21.15.100:0/710845718 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40641f3900 con 0x7f406415b5f0 2024-09-11T22:20:06.420 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.417+0000 7f405b7fe640 1 -- 172.21.15.100:0/710845718 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c014480 con 0x7f406415b5f0 2024-09-11T22:20:06.420 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.417+0000 7f4068ffd640 1 -- 172.21.15.100:0/710845718 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f40641f3ea0 con 0x7f406415b5f0 2024-09-11T22:20:06.420 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.418+0000 7f4068ffd640 1 -- 172.21.15.100:0/710845718 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40640ca550 con 0x7f406415b5f0 2024-09-11T22:20:06.421 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.418+0000 7f405b7fe640 1 -- 172.21.15.100:0/710845718 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7f405c005d10 con 0x7f406415b5f0 2024-09-11T22:20:06.421 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.419+0000 7f405b7fe640 1 --2- 172.21.15.100:0/710845718 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f404406bda0 0x7f404406e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:06.421 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.419+0000 7f406259c640 1 --2- 172.21.15.100:0/710845718 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f404406bda0 0x7f404406e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:06.421 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.419+0000 7f405b7fe640 1 -- 172.21.15.100:0/710845718 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(14..14 src has 1..14) ==== 3071+0+0 (secure 0 0 0) 0x7f405c08ae40 con 0x7f406415b5f0 2024-09-11T22:20:06.421 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.419+0000 7f406259c640 1 --2- 172.21.15.100:0/710845718 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f404406bda0 0x7f404406e260 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f40540090b0 tx=0x7f405402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:06.424 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.424+0000 7f405b7fe640 1 -- 172.21.15.100:0/710845718 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f405c022030 con 0x7f406415b5f0 2024-09-11T22:20:06.611 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.611+0000 7f4068ffd640 1 -- 172.21.15.100:0/710845718 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f406415aec0 con 0x7f406415b5f0 2024-09-11T22:20:06.612 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.612+0000 7f405b7fe640 1 -- 172.21.15.100:0/710845718 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8550 (secure 0 0 0) 0x7f405c010040 con 0x7f406415b5f0 2024-09-11T22:20:06.612 INFO:teuthology.misc.health.smithi100.stdout: 2024-09-11T22:20:06.612 INFO:teuthology.misc.health.smithi100.stdout:{"epoch":14,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","created":"2024-09-11T22:19:56.198855+0000","modified":"2024-09-11T22:20:06.311066+0000","last_up_change":"2024-09-11T22:20:06.311066+0000","last_in_change":"2024-09-11T22:19:58.294227+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5de0ba54-34c5-4343-b19a-1f675efc49c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6809","nonce":2008454847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6811","nonce":2008454847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6815","nonce":2008454847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6813","nonce":2008454847}]},"public_addr":"172.21.15.100:6809/2008454847","cluster_addr":"172.21.15.100:6811/2008454847","heartbeat_back_addr":"172.21.15.100:6815/2008454847","heartbeat_front_addr":"172.21.15.100:6813/2008454847","state":["exists","up"]},{"osd":1,"uuid":"5a1f6456-6604-4b41-b9b9-52ae8d6616ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6801","nonce":1802107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6803","nonce":1802107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6807","nonce":1802107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6805","nonce":1802107101}]},"public_addr":"172.21.15.100:6801/1802107101","cluster_addr":"172.21.15.100:6803/1802107101","heartbeat_back_addr":"172.21.15.100:6807/1802107101","heartbeat_front_addr":"172.21.15.100:6805/1802107101","state":["exists","up"]},{"osd":2,"uuid":"a604cb26-7b0f-402d-b6ac-3652884b4b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6817","nonce":644491349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6819","nonce":644491349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6823","nonce":644491349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6821","nonce":644491349}]},"public_addr":"172.21.15.100:6817/644491349","cluster_addr":"172.21.15.100:6819/644491349","heartbeat_back_addr":"172.21.15.100:6823/644491349","heartbeat_front_addr":"172.21.15.100:6821/644491349","state":["exists","up"]},{"osd":3,"uuid":"73dc2cbb-70ff-4d12-ba2f-8778a49892f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"07960648-04df-4aec-a72c-c29e28b74bcb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2b4767e6-cab7-4b45-9150-55432f5576aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4ef2c4b5-52f4-4f69-8fca-2334077ed8b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"761673d8-d6fc-4ded-a9f3-d49ab8f7c969","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.080311+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:20:06.614 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.614+0000 7f4068ffd640 1 -- 172.21.15.100:0/710845718 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f404406bda0 msgr2=0x7f404406e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:06.615 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.614+0000 7f4068ffd640 1 --2- 172.21.15.100:0/710845718 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f404406bda0 0x7f404406e260 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f40540090b0 tx=0x7f405402e000 comp rx=0 tx=0).stop 2024-09-11T22:20:06.615 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.614+0000 7f4068ffd640 1 -- 172.21.15.100:0/710845718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f406415b5f0 msgr2=0x7f40640b3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:06.615 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.614+0000 7f4068ffd640 1 --2- 172.21.15.100:0/710845718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f406415b5f0 0x7f40640b3160 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f40640cc280 tx=0x7f405c00c0c0 comp rx=0 tx=0).stop 2024-09-11T22:20:06.615 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.614+0000 7f4068ffd640 1 -- 172.21.15.100:0/710845718 shutdown_connections 2024-09-11T22:20:06.615 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.614+0000 7f4068ffd640 1 --2- 172.21.15.100:0/710845718 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f404406bda0 0x7f404406e260 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:06.615 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.614+0000 7f4068ffd640 1 --2- 172.21.15.100:0/710845718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f406415b5f0 0x7f40640b3160 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:06.615 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.614+0000 7f4068ffd640 1 --2- 172.21.15.100:0/710845718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4064154d30 0x7f40640b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:06.615 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.614+0000 7f4068ffd640 1 --2- 172.21.15.100:0/710845718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40640704d0 0x7f40641e43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:06.615 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.614+0000 7f4068ffd640 1 -- 172.21.15.100:0/710845718 >> 172.21.15.100:0/710845718 conn(0x7f40640ce3d0 msgr2=0x7f4064153410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:06.615 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.614+0000 7f4068ffd640 1 -- 172.21.15.100:0/710845718 shutdown_connections 2024-09-11T22:20:06.615 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:06.614+0000 7f4068ffd640 1 -- 172.21.15.100:0/710845718 wait complete. 2024-09-11T22:20:06.625 DEBUG:teuthology.misc:3 of 8 OSDs are up 2024-09-11T22:20:06.889 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-09-11T22:20:06.889+0000 7fe1be686640 -1 osd.3 0 waiting for initial osdmap 2024-09-11T22:20:06.903 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-09-11T22:20:06.903+0000 7fe1b64a6640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T22:20:13.431 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T22:20:13.533 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.533+0000 7ff88f7cf640 1 Processor -- start 2024-09-11T22:20:13.533 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.533+0000 7ff88f7cf640 1 -- start start 2024-09-11T22:20:13.535 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.534+0000 7ff88f7cf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff88815e830 0x7ff88815faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:13.535 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.534+0000 7ff88f7cf640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff8880cc570 0x7ff8880cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:13.535 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.534+0000 7ff88f7cf640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff88815ffe0 con 0x7ff88815ec10 2024-09-11T22:20:13.535 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.534+0000 7ff88f7cf640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7ff8880af140 con 0x7ff8880cc570 2024-09-11T22:20:13.535 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.534+0000 7ff88f7cf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff8880c6c00 con 0x7ff88815e830 2024-09-11T22:20:13.535 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.534+0000 7ff88dd6c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff8880cc570 0x7ff8880cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:13.535 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.534+0000 7ff88dd6c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff8880cc570 0x7ff8880cc9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41806/0 (socket says 172.21.15.100:41806) 2024-09-11T22:20:13.535 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.534+0000 7ff88dd6c640 1 -- 172.21.15.100:0/3832333875 learned_addr learned my addr 172.21.15.100:0/3832333875 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:13.535 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.534+0000 7ff88d56b640 1 --2- 172.21.15.100:0/3832333875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff88815e830 0x7ff88815faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:13.536 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.534+0000 7ff88dd6c640 1 -- 172.21.15.100:0/3832333875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff88815e830 msgr2=0x7ff88815faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:13.536 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.534+0000 7ff88dd6c640 1 --2- 172.21.15.100:0/3832333875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff88815e830 0x7ff88815faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:13.536 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.534+0000 7ff88dd6c640 1 -- 172.21.15.100:0/3832333875 >> v1:172.21.15.167:6789/0 conn(0x7ff88815ec10 legacy=0x7ff88806e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:13.536 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.534+0000 7ff88dd6c640 1 -- 172.21.15.100:0/3832333875 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8880c6f30 con 0x7ff8880cc570 2024-09-11T22:20:13.537 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.535+0000 7ff88dd6c640 1 --2- 172.21.15.100:0/3832333875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8880cc570 0x7ff8880cc9e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff880009e50 tx=0x7ff88002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5023feaa15b9f3f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:13.537 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.535+0000 7ff87ffff640 1 -- 172.21.15.100:0/3832333875 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff880036070 con 0x7ff8880cc570 2024-09-11T22:20:13.537 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.535+0000 7ff87ffff640 1 -- 172.21.15.100:0/3832333875 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff880031600 con 0x7ff8880cc570 2024-09-11T22:20:13.537 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.535+0000 7ff87ffff640 1 -- 172.21.15.100:0/3832333875 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8800319d0 con 0x7ff8880cc570 2024-09-11T22:20:13.537 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.536+0000 7ff88f7cf640 1 -- 172.21.15.100:0/3832333875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8880cc570 msgr2=0x7ff8880cc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:13.537 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.536+0000 7ff88f7cf640 1 --2- 172.21.15.100:0/3832333875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8880cc570 0x7ff8880cc9e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff880009e50 tx=0x7ff88002a710 comp rx=0 tx=0).stop 2024-09-11T22:20:13.537 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.536+0000 7ff88f7cf640 1 -- 172.21.15.100:0/3832333875 shutdown_connections 2024-09-11T22:20:13.538 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.536+0000 7ff88f7cf640 1 --2- 172.21.15.100:0/3832333875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8880cc570 0x7ff8880cc9e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:13.538 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.536+0000 7ff88f7cf640 1 --2- 172.21.15.100:0/3832333875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff88815e830 0x7ff88815faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:13.538 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.536+0000 7ff88f7cf640 1 -- 172.21.15.100:0/3832333875 >> 172.21.15.100:0/3832333875 conn(0x7ff88806f830 msgr2=0x7ff88806fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:13.538 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.536+0000 7ff88f7cf640 1 -- 172.21.15.100:0/3832333875 shutdown_connections 2024-09-11T22:20:13.538 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.536+0000 7ff88f7cf640 1 -- 172.21.15.100:0/3832333875 wait complete. 2024-09-11T22:20:13.540 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.537+0000 7ff88f7cf640 1 Processor -- start 2024-09-11T22:20:13.540 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.537+0000 7ff88f7cf640 1 -- start start 2024-09-11T22:20:13.540 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.538+0000 7ff88f7cf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8880cc570 0x7ff8881f8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:13.540 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.538+0000 7ff88f7cf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff88815e830 0x7ff8880c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:13.540 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.538+0000 7ff88f7cf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff88815ec10 0x7ff8880c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:13.540 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.538+0000 7ff88f7cf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff8880aeaf0 con 0x7ff8880cc570 2024-09-11T22:20:13.540 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.538+0000 7ff88f7cf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff8880c74f0 con 0x7ff88815ec10 2024-09-11T22:20:13.541 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.538+0000 7ff88f7cf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff8880aedd0 con 0x7ff88815e830 2024-09-11T22:20:13.541 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.538+0000 7ff88d56b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8880cc570 0x7ff8881f8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:13.541 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.538+0000 7ff88d56b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8880cc570 0x7ff8881f8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41816/0 (socket says 172.21.15.100:41816) 2024-09-11T22:20:13.541 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.538+0000 7ff88d56b640 1 -- 172.21.15.100:0/143144070 learned_addr learned my addr 172.21.15.100:0/143144070 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:13.541 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.538+0000 7ff88cd6a640 1 --2- 172.21.15.100:0/143144070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff88815e830 0x7ff8880c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:13.541 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.538+0000 7ff88d56b640 1 -- 172.21.15.100:0/143144070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff88815e830 msgr2=0x7ff8880c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:13.541 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.538+0000 7ff88d56b640 1 --2- 172.21.15.100:0/143144070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff88815e830 0x7ff8880c5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:13.541 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.538+0000 7ff88dd6c640 1 --2- 172.21.15.100:0/143144070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff88815ec10 0x7ff8880c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:13.541 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.538+0000 7ff88d56b640 1 -- 172.21.15.100:0/143144070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff88815ec10 msgr2=0x7ff8880c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:13.541 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.538+0000 7ff88d56b640 1 --2- 172.21.15.100:0/143144070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff88815ec10 0x7ff8880c8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:13.541 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.538+0000 7ff88d56b640 1 -- 172.21.15.100:0/143144070 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8881f8d60 con 0x7ff8880cc570 2024-09-11T22:20:13.541 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.538+0000 7ff88d56b640 1 --2- 172.21.15.100:0/143144070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8880cc570 0x7ff8881f8820 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff88400e9e0 tx=0x7ff88400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:13.541 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.538+0000 7ff87dffb640 1 -- 172.21.15.100:0/143144070 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff884017070 con 0x7ff8880cc570 2024-09-11T22:20:13.542 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.538+0000 7ff87dffb640 1 -- 172.21.15.100:0/143144070 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff88400c9d0 con 0x7ff8880cc570 2024-09-11T22:20:13.542 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.538+0000 7ff88f7cf640 1 -- 172.21.15.100:0/143144070 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8881f5d60 con 0x7ff8880cc570 2024-09-11T22:20:13.542 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.538+0000 7ff87dffb640 1 -- 172.21.15.100:0/143144070 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff88400cdc0 con 0x7ff8880cc570 2024-09-11T22:20:13.542 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.539+0000 7ff88f7cf640 1 -- 172.21.15.100:0/143144070 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff888072c20 con 0x7ff8880cc570 2024-09-11T22:20:13.542 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.540+0000 7ff88f7cf640 1 -- 172.21.15.100:0/143144070 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff88815faa0 con 0x7ff8880cc570 2024-09-11T22:20:13.543 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.540+0000 7ff87dffb640 1 -- 172.21.15.100:0/143144070 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff88401a070 con 0x7ff8880cc570 2024-09-11T22:20:13.543 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.541+0000 7ff87dffb640 1 --2- 172.21.15.100:0/143144070 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff86c06be30 0x7ff86c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:13.543 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.541+0000 7ff87dffb640 1 -- 172.21.15.100:0/143144070 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7ff88408abb0 con 0x7ff8880cc570 2024-09-11T22:20:13.543 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.541+0000 7ff88cd6a640 1 --2- 172.21.15.100:0/143144070 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff86c06be30 0x7ff86c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:13.543 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.541+0000 7ff88cd6a640 1 --2- 172.21.15.100:0/143144070 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff86c06be30 0x7ff86c06e2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff8881ea930 tx=0x7ff878009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:13.546 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.545+0000 7ff87dffb640 1 -- 172.21.15.100:0/143144070 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff8840598b0 con 0x7ff8880cc570 2024-09-11T22:20:13.711 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.711+0000 7ff88f7cf640 1 -- 172.21.15.100:0/143144070 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8881ea680 con 0x7ff8880cc570 2024-09-11T22:20:13.712 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.712+0000 7ff87dffb640 1 -- 172.21.15.100:0/143144070 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12944 (secure 0 0 0) 0x7ff8840591b0 con 0x7ff8880cc570 2024-09-11T22:20:13.712 INFO:teuthology.misc.health.smithi100.stdout: 2024-09-11T22:20:13.712 INFO:teuthology.misc.health.smithi100.stdout:{"epoch":18,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","created":"2024-09-11T22:19:56.198855+0000","modified":"2024-09-11T22:20:10.344412+0000","last_up_change":"2024-09-11T22:20:07.328863+0000","last_in_change":"2024-09-11T22:19:58.294227+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:20:08.333538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5de0ba54-34c5-4343-b19a-1f675efc49c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6809","nonce":2008454847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6811","nonce":2008454847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6815","nonce":2008454847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6813","nonce":2008454847}]},"public_addr":"172.21.15.100:6809/2008454847","cluster_addr":"172.21.15.100:6811/2008454847","heartbeat_back_addr":"172.21.15.100:6815/2008454847","heartbeat_front_addr":"172.21.15.100:6813/2008454847","state":["exists","up"]},{"osd":1,"uuid":"5a1f6456-6604-4b41-b9b9-52ae8d6616ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6801","nonce":1802107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6803","nonce":1802107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6807","nonce":1802107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6805","nonce":1802107101}]},"public_addr":"172.21.15.100:6801/1802107101","cluster_addr":"172.21.15.100:6803/1802107101","heartbeat_back_addr":"172.21.15.100:6807/1802107101","heartbeat_front_addr":"172.21.15.100:6805/1802107101","state":["exists","up"]},{"osd":2,"uuid":"a604cb26-7b0f-402d-b6ac-3652884b4b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6817","nonce":644491349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6819","nonce":644491349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6823","nonce":644491349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6821","nonce":644491349}]},"public_addr":"172.21.15.100:6817/644491349","cluster_addr":"172.21.15.100:6819/644491349","heartbeat_back_addr":"172.21.15.100:6823/644491349","heartbeat_front_addr":"172.21.15.100:6821/644491349","state":["exists","up"]},{"osd":3,"uuid":"73dc2cbb-70ff-4d12-ba2f-8778a49892f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6825","nonce":2519160882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6827","nonce":2519160882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6831","nonce":2519160882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6829","nonce":2519160882}]},"public_addr":"172.21.15.100:6825/2519160882","cluster_addr":"172.21.15.100:6827/2519160882","heartbeat_back_addr":"172.21.15.100:6831/2519160882","heartbeat_front_addr":"172.21.15.100:6829/2519160882","state":["exists","up"]},{"osd":4,"uuid":"07960648-04df-4aec-a72c-c29e28b74bcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6817","nonce":736010951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6819","nonce":736010951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6823","nonce":736010951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6821","nonce":736010951}]},"public_addr":"172.21.15.167:6817/736010951","cluster_addr":"172.21.15.167:6819/736010951","heartbeat_back_addr":"172.21.15.167:6823/736010951","heartbeat_front_addr":"172.21.15.167:6821/736010951","state":["exists","up"]},{"osd":5,"uuid":"2b4767e6-cab7-4b45-9150-55432f5576aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6825","nonce":2479173909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6827","nonce":2479173909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6831","nonce":2479173909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6829","nonce":2479173909}]},"public_addr":"172.21.15.167:6825/2479173909","cluster_addr":"172.21.15.167:6827/2479173909","heartbeat_back_addr":"172.21.15.167:6831/2479173909","heartbeat_front_addr":"172.21.15.167:6829/2479173909","state":["exists","up"]},{"osd":6,"uuid":"4ef2c4b5-52f4-4f69-8fca-2334077ed8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6809","nonce":2825112504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6811","nonce":2825112504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6815","nonce":2825112504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6813","nonce":2825112504}]},"public_addr":"172.21.15.167:6809/2825112504","cluster_addr":"172.21.15.167:6811/2825112504","heartbeat_back_addr":"172.21.15.167:6815/2825112504","heartbeat_front_addr":"172.21.15.167:6813/2825112504","state":["exists","up"]},{"osd":7,"uuid":"761673d8-d6fc-4ded-a9f3-d49ab8f7c969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337015843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337015843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337015843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337015843}]},"public_addr":"172.21.15.167:6801/1337015843","cluster_addr":"172.21.15.167:6803/1337015843","heartbeat_back_addr":"172.21.15.167:6807/1337015843","heartbeat_front_addr":"172.21.15.167:6805/1337015843","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.833280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.080311+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.100648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.544261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.670353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.880921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.365441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.366659+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:20:13.714 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.714+0000 7ff88f7cf640 1 -- 172.21.15.100:0/143144070 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff86c06be30 msgr2=0x7ff86c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:13.715 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.714+0000 7ff88f7cf640 1 --2- 172.21.15.100:0/143144070 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff86c06be30 0x7ff86c06e2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff8881ea930 tx=0x7ff878009040 comp rx=0 tx=0).stop 2024-09-11T22:20:13.715 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.714+0000 7ff88f7cf640 1 -- 172.21.15.100:0/143144070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8880cc570 msgr2=0x7ff8881f8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:13.715 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.714+0000 7ff88f7cf640 1 --2- 172.21.15.100:0/143144070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8880cc570 0x7ff8881f8820 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff88400e9e0 tx=0x7ff88400eea0 comp rx=0 tx=0).stop 2024-09-11T22:20:13.715 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.714+0000 7ff88f7cf640 1 -- 172.21.15.100:0/143144070 shutdown_connections 2024-09-11T22:20:13.715 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.714+0000 7ff88f7cf640 1 --2- 172.21.15.100:0/143144070 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff86c06be30 0x7ff86c06e2f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:13.715 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.714+0000 7ff88f7cf640 1 --2- 172.21.15.100:0/143144070 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff88815ec10 0x7ff8880c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:13.715 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.714+0000 7ff88f7cf640 1 --2- 172.21.15.100:0/143144070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff88815e830 0x7ff8880c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:13.715 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.714+0000 7ff88f7cf640 1 --2- 172.21.15.100:0/143144070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff8880cc570 0x7ff8881f8820 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:13.715 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.714+0000 7ff88f7cf640 1 -- 172.21.15.100:0/143144070 >> 172.21.15.100:0/143144070 conn(0x7ff88806f830 msgr2=0x7ff888159be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:13.715 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.714+0000 7ff88f7cf640 1 -- 172.21.15.100:0/143144070 shutdown_connections 2024-09-11T22:20:13.715 INFO:teuthology.misc.health.smithi100.stderr:2024-09-11T22:20:13.714+0000 7ff88f7cf640 1 -- 172.21.15.100:0/143144070 wait complete. 2024-09-11T22:20:13.724 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-11T22:20:13.724 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-11T22:20:13.724 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-11T22:20:13.724 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-11T22:20:13.726 INFO:tasks.ceph.mds.a:Started 2024-09-11T22:20:13.727 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-11T22:20:13.727 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-11T22:20:13.728 INFO:tasks.ceph.mds.c:Started 2024-09-11T22:20:13.729 INFO:tasks.ceph.mds.e:Restarting daemon 2024-09-11T22:20:13.729 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-09-11T22:20:13.731 INFO:tasks.ceph.mds.e:Started 2024-09-11T22:20:13.731 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-11T22:20:13.731 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-11T22:20:13.734 INFO:tasks.ceph.mds.b:Started 2024-09-11T22:20:13.734 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-11T22:20:13.734 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-11T22:20:13.736 INFO:tasks.ceph.mds.d:Started 2024-09-11T22:20:13.736 INFO:tasks.ceph.mds.f:Restarting daemon 2024-09-11T22:20:13.736 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-09-11T22:20:13.739 INFO:tasks.ceph.mds.f:Started 2024-09-11T22:20:13.739 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-11T22:20:13.739 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:13.803 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2024-09-11T22:20:13.803 INFO:tasks.ceph.mds.c.smithi100.stdout:starting mds.c at 2024-09-11T22:20:13.804 INFO:tasks.ceph.mds.c.smithi100.stderr:2024-09-11T22:20:13.803+0000 7f6183c2f640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-11T22:20:13.804 INFO:tasks.ceph.mds.e.smithi100.stdout:starting mds.e at 2024-09-11T22:20:13.823 INFO:tasks.ceph.mds.f.smithi167.stdout:starting mds.f at 2024-09-11T22:20:13.824 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-09-11T22:20:13.824 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-09-11T22:20:13.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.846+0000 7fc311b1a640 1 Processor -- start 2024-09-11T22:20:13.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.846+0000 7fc311b1a640 1 -- start start 2024-09-11T22:20:13.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.847+0000 7fc311b1a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc30c157fd0 0x7fc30c0c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:13.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.847+0000 7fc311b1a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc30c06bc10 0x7fc30c0ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:13.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.847+0000 7fc311b1a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc30c15a950 con 0x7fc30c0cd480 2024-09-11T22:20:13.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.847+0000 7fc30b7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc30c157fd0 0x7fc30c0c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:13.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.847+0000 7fc311b1a640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fc30c1583b0 con 0x7fc30c157fd0 2024-09-11T22:20:13.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.847+0000 7fc311b1a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fc30c15abd0 con 0x7fc30c06bc10 2024-09-11T22:20:13.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.847+0000 7fc30b7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc30c157fd0 0x7fc30c0c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41876/0 (socket says 172.21.15.100:41876) 2024-09-11T22:20:13.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.847+0000 7fc30b7fe640 1 -- 172.21.15.100:0/1442563733 learned_addr learned my addr 172.21.15.100:0/1442563733 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:13.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.847+0000 7fc30affd640 1 --2- 172.21.15.100:0/1442563733 >> v2:172.21.15.167:3300/0 conn(0x7fc30c06bc10 0x7fc30c0ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:13.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.847+0000 7fc30b7fe640 1 -- 172.21.15.100:0/1442563733 >> v2:172.21.15.167:3300/0 conn(0x7fc30c06bc10 msgr2=0x7fc30c0ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:13.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.847+0000 7fc30b7fe640 1 --2- 172.21.15.100:0/1442563733 >> v2:172.21.15.167:3300/0 conn(0x7fc30c06bc10 0x7fc30c0ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:13.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.847+0000 7fc30b7fe640 1 -- 172.21.15.100:0/1442563733 >> v1:172.21.15.167:6789/0 conn(0x7fc30c0cd480 legacy=0x7fc30c15e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:13.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.847+0000 7fc30b7fe640 1 -- 172.21.15.100:0/1442563733 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc30c15aeb0 con 0x7fc30c157fd0 2024-09-11T22:20:13.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.848+0000 7fc30b7fe640 1 --2- 172.21.15.100:0/1442563733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc30c157fd0 0x7fc30c0c8ca0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0caee0 tx=0x7fc2fc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d2c1499bd7d934 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:13.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.848+0000 7fc30a7fc640 1 -- 172.21.15.100:0/1442563733 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc037070 con 0x7fc30c157fd0 2024-09-11T22:20:13.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.848+0000 7fc30a7fc640 1 -- 172.21.15.100:0/1442563733 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2fc02ae50 con 0x7fc30c157fd0 2024-09-11T22:20:13.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.848+0000 7fc30a7fc640 1 -- 172.21.15.100:0/1442563733 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc032860 con 0x7fc30c157fd0 2024-09-11T22:20:13.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.848+0000 7fc311b1a640 1 -- 172.21.15.100:0/1442563733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc30c157fd0 msgr2=0x7fc30c0c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:13.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.848+0000 7fc311b1a640 1 --2- 172.21.15.100:0/1442563733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc30c157fd0 0x7fc30c0c8ca0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0caee0 tx=0x7fc2fc02a300 comp rx=0 tx=0).stop 2024-09-11T22:20:13.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.849+0000 7fc311b1a640 1 -- 172.21.15.100:0/1442563733 shutdown_connections 2024-09-11T22:20:13.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.849+0000 7fc311b1a640 1 --2- 172.21.15.100:0/1442563733 >> v2:172.21.15.167:3300/0 conn(0x7fc30c06bc10 0x7fc30c0ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:13.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.849+0000 7fc311b1a640 1 --2- 172.21.15.100:0/1442563733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc30c157fd0 0x7fc30c0c8ca0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:13.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.849+0000 7fc311b1a640 1 -- 172.21.15.100:0/1442563733 >> 172.21.15.100:0/1442563733 conn(0x7fc30c072960 msgr2=0x7fc30c072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:13.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.849+0000 7fc311b1a640 1 -- 172.21.15.100:0/1442563733 shutdown_connections 2024-09-11T22:20:13.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.849+0000 7fc311b1a640 1 -- 172.21.15.100:0/1442563733 wait complete. 2024-09-11T22:20:13.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.850+0000 7fc311b1a640 1 Processor -- start 2024-09-11T22:20:13.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.850+0000 7fc311b1a640 1 -- start start 2024-09-11T22:20:13.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.851+0000 7fc311b1a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc30c06bc10 0x7fc30c1f07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:13.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.851+0000 7fc311b1a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc30c0cd480 0x7fc30c0cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:13.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.851+0000 7fc311b1a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc30c157fd0 0x7fc30c1e4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:13.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.851+0000 7fc311b1a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc30c067ae0 con 0x7fc30c0cd480 2024-09-11T22:20:13.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.851+0000 7fc311b1a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc30c15b470 con 0x7fc30c157fd0 2024-09-11T22:20:13.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.851+0000 7fc311b1a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc30c1e50b0 con 0x7fc30c06bc10 2024-09-11T22:20:13.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.851+0000 7fc30affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc30c0cd480 0x7fc30c0cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:13.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.851+0000 7fc30affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc30c0cd480 0x7fc30c0cc1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41886/0 (socket says 172.21.15.100:41886) 2024-09-11T22:20:13.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.851+0000 7fc30affd640 1 -- 172.21.15.100:0/1512433372 learned_addr learned my addr 172.21.15.100:0/1512433372 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:13.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.851+0000 7fc30b7fe640 1 --2- 172.21.15.100:0/1512433372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc30c06bc10 0x7fc30c1f07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:13.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.851+0000 7fc30bfff640 1 --2- 172.21.15.100:0/1512433372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc30c157fd0 0x7fc30c1e4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:13.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.851+0000 7fc30affd640 1 -- 172.21.15.100:0/1512433372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc30c06bc10 msgr2=0x7fc30c1f07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:13.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.851+0000 7fc30affd640 1 --2- 172.21.15.100:0/1512433372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc30c06bc10 0x7fc30c1f07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:13.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.851+0000 7fc30affd640 1 -- 172.21.15.100:0/1512433372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc30c157fd0 msgr2=0x7fc30c1e4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:13.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.851+0000 7fc30affd640 1 --2- 172.21.15.100:0/1512433372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc30c157fd0 0x7fc30c1e4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:13.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.851+0000 7fc30affd640 1 -- 172.21.15.100:0/1512433372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc30c1e52e0 con 0x7fc30c0cd480 2024-09-11T22:20:13.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.851+0000 7fc30affd640 1 --2- 172.21.15.100:0/1512433372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc30c0cd480 0x7fc30c0cc1f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc30000e9e0 tx=0x7fc30000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:13.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.851+0000 7fc2f3fff640 1 -- 172.21.15.100:0/1512433372 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc300017070 con 0x7fc30c0cd480 2024-09-11T22:20:13.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.851+0000 7fc2f3fff640 1 -- 172.21.15.100:0/1512433372 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc30000c9d0 con 0x7fc30c0cd480 2024-09-11T22:20:13.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.851+0000 7fc311b1a640 1 -- 172.21.15.100:0/1512433372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc30c1e55c0 con 0x7fc30c0cd480 2024-09-11T22:20:13.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.851+0000 7fc2f3fff640 1 -- 172.21.15.100:0/1512433372 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30000cdc0 con 0x7fc30c0cd480 2024-09-11T22:20:13.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.851+0000 7fc311b1a640 1 -- 172.21.15.100:0/1512433372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc30c1e5b80 con 0x7fc30c0cd480 2024-09-11T22:20:13.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.852+0000 7fc311b1a640 1 -- 172.21.15.100:0/1512433372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc30c068060 con 0x7fc30c0cd480 2024-09-11T22:20:13.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.853+0000 7fc2f3fff640 1 -- 172.21.15.100:0/1512433372 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc30001a070 con 0x7fc30c0cd480 2024-09-11T22:20:13.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.853+0000 7fc2f3fff640 1 --2- 172.21.15.100:0/1512433372 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc2f806be30 0x7fc2f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:13.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.853+0000 7fc2f3fff640 1 -- 172.21.15.100:0/1512433372 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fc30008aea0 con 0x7fc30c0cd480 2024-09-11T22:20:13.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.853+0000 7fc30b7fe640 1 --2- 172.21.15.100:0/1512433372 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc2f806be30 0x7fc2f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:13.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.854+0000 7fc30b7fe640 1 --2- 172.21.15.100:0/1512433372 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc2f806be30 0x7fc2f806e2f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc034000 tx=0x7fc2fc02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:13.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:13.857+0000 7fc2f3fff640 1 -- 172.21.15.100:0/1512433372 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc3000594c0 con 0x7fc30c0cd480 2024-09-11T22:20:14.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:14.056+0000 7fc311b1a640 1 -- 172.21.15.100:0/1512433372 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc30c068690 con 0x7fc30c0cd480 2024-09-11T22:20:14.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:14.056+0000 7fc2f3fff640 1 -- 172.21.15.100:0/1512433372 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7fc30005d7c0 con 0x7fc30c0cd480 2024-09-11T22:20:14.057 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:14.057 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":2,"btime":"2024-09-11T22:20:13:807716+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1912241808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1912241808},{"type":"v1","addr":"172.21.15.100:6836","nonce":1912241808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-11T22:20:14.057 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 2 2024-09-11T22:20:14.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:14.058+0000 7fc311b1a640 1 -- 172.21.15.100:0/1512433372 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc2f806be30 msgr2=0x7fc2f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:14.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:14.058+0000 7fc311b1a640 1 --2- 172.21.15.100:0/1512433372 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc2f806be30 0x7fc2f806e2f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc034000 tx=0x7fc2fc02e000 comp rx=0 tx=0).stop 2024-09-11T22:20:14.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:14.058+0000 7fc311b1a640 1 -- 172.21.15.100:0/1512433372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc30c0cd480 msgr2=0x7fc30c0cc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:14.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:14.058+0000 7fc311b1a640 1 --2- 172.21.15.100:0/1512433372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc30c0cd480 0x7fc30c0cc1f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc30000e9e0 tx=0x7fc30000eea0 comp rx=0 tx=0).stop 2024-09-11T22:20:14.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:14.058+0000 7fc311b1a640 1 -- 172.21.15.100:0/1512433372 shutdown_connections 2024-09-11T22:20:14.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:14.058+0000 7fc311b1a640 1 --2- 172.21.15.100:0/1512433372 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc2f806be30 0x7fc2f806e2f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:14.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:14.058+0000 7fc311b1a640 1 --2- 172.21.15.100:0/1512433372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc30c157fd0 0x7fc30c1e4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:14.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:14.058+0000 7fc311b1a640 1 --2- 172.21.15.100:0/1512433372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc30c0cd480 0x7fc30c0cc1f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:14.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:14.058+0000 7fc311b1a640 1 --2- 172.21.15.100:0/1512433372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc30c06bc10 0x7fc30c1f07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:14.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:14.058+0000 7fc311b1a640 1 -- 172.21.15.100:0/1512433372 >> 172.21.15.100:0/1512433372 conn(0x7fc30c072960 msgr2=0x7fc30c072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:14.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:14.058+0000 7fc311b1a640 1 -- 172.21.15.100:0/1512433372 shutdown_connections 2024-09-11T22:20:14.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:14.058+0000 7fc311b1a640 1 -- 172.21.15.100:0/1512433372 wait complete. 2024-09-11T22:20:16.070 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:16.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.181+0000 7f9112c23640 1 Processor -- start 2024-09-11T22:20:16.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.181+0000 7f9112c23640 1 -- start start 2024-09-11T22:20:16.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.182+0000 7f9112c23640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f910c0d0b20 0x7f910c0ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.182+0000 7f9112c23640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f910c0cad20 0x7f910c154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.182+0000 7f9112c23640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f910c0c55d0 con 0x7f910c0d0f00 2024-09-11T22:20:16.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.182+0000 7f9112c23640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f910c0c58b0 con 0x7f910c0d0b20 2024-09-11T22:20:16.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.182+0000 7f9112c23640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f910c15ad20 con 0x7f910c0cad20 2024-09-11T22:20:16.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.182+0000 7f91109bf640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f910c0d0b20 0x7f910c0ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.182+0000 7f91109bf640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f910c0d0b20 0x7f910c0ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41900/0 (socket says 172.21.15.100:41900) 2024-09-11T22:20:16.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.182+0000 7f91109bf640 1 -- 172.21.15.100:0/3282382800 learned_addr learned my addr 172.21.15.100:0/3282382800 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:16.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.182+0000 7f910bfff640 1 --2- 172.21.15.100:0/3282382800 >> v2:172.21.15.167:3300/0 conn(0x7f910c0cad20 0x7f910c154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.182+0000 7f91109bf640 1 -- 172.21.15.100:0/3282382800 >> v2:172.21.15.167:3300/0 conn(0x7f910c0cad20 msgr2=0x7f910c154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:16.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.182+0000 7f91109bf640 1 --2- 172.21.15.100:0/3282382800 >> v2:172.21.15.167:3300/0 conn(0x7f910c0cad20 0x7f910c154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.182+0000 7f91109bf640 1 -- 172.21.15.100:0/3282382800 >> v1:172.21.15.167:6789/0 conn(0x7f910c0d0f00 legacy=0x7f910c15dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.182+0000 7f91109bf640 1 -- 172.21.15.100:0/3282382800 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910c15b000 con 0x7f910c0d0b20 2024-09-11T22:20:16.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.183+0000 7f91109bf640 1 --2- 172.21.15.100:0/3282382800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f910c0d0b20 0x7f910c0ccdb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f910c0726e0 tx=0x7f910002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ae1ff626b2da59 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:16.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.183+0000 7f910b7fe640 1 -- 172.21.15.100:0/3282382800 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9100037070 con 0x7f910c0d0b20 2024-09-11T22:20:16.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.183+0000 7f910b7fe640 1 -- 172.21.15.100:0/3282382800 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9100032440 con 0x7f910c0d0b20 2024-09-11T22:20:16.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.183+0000 7f910b7fe640 1 -- 172.21.15.100:0/3282382800 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9100032810 con 0x7f910c0d0b20 2024-09-11T22:20:16.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.184+0000 7f9112c23640 1 -- 172.21.15.100:0/3282382800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f910c0d0b20 msgr2=0x7f910c0ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.184+0000 7f9112c23640 1 --2- 172.21.15.100:0/3282382800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f910c0d0b20 0x7f910c0ccdb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f910c0726e0 tx=0x7f910002a1e0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.184+0000 7f9112c23640 1 -- 172.21.15.100:0/3282382800 shutdown_connections 2024-09-11T22:20:16.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.184+0000 7f9112c23640 1 --2- 172.21.15.100:0/3282382800 >> v2:172.21.15.167:3300/0 conn(0x7f910c0cad20 0x7f910c154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.184+0000 7f9112c23640 1 --2- 172.21.15.100:0/3282382800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f910c0d0b20 0x7f910c0ccdb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.184+0000 7f9112c23640 1 -- 172.21.15.100:0/3282382800 >> 172.21.15.100:0/3282382800 conn(0x7f910c06d160 msgr2=0x7f910c06d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:16.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.184+0000 7f9112c23640 1 -- 172.21.15.100:0/3282382800 shutdown_connections 2024-09-11T22:20:16.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.184+0000 7f9112c23640 1 -- 172.21.15.100:0/3282382800 wait complete. 2024-09-11T22:20:16.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.185+0000 7f9112c23640 1 Processor -- start 2024-09-11T22:20:16.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.185+0000 7f9112c23640 1 -- start start 2024-09-11T22:20:16.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.186+0000 7f9112c23640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f910c0cad20 0x7f910c15e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.186+0000 7f9112c23640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f910c0d0b20 0x7f910c1f44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.186+0000 7f9112c23640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f910c0d0f00 0x7f910c0c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.186+0000 7f9112c23640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f910c15b800 con 0x7f910c0d0f00 2024-09-11T22:20:16.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.186+0000 7f9112c23640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f910c15a9f0 con 0x7f910c0d0b20 2024-09-11T22:20:16.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.186+0000 7f9112c23640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f910c0b3290 con 0x7f910c0cad20 2024-09-11T22:20:16.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.186+0000 7f91111c0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f910c0d0f00 0x7f910c0c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.186+0000 7f91111c0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f910c0d0f00 0x7f910c0c9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41904/0 (socket says 172.21.15.100:41904) 2024-09-11T22:20:16.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.186+0000 7f91111c0640 1 -- 172.21.15.100:0/1904644163 learned_addr learned my addr 172.21.15.100:0/1904644163 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:16.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.186+0000 7f910bfff640 1 --2- 172.21.15.100:0/1904644163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f910c0d0b20 0x7f910c1f44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.186+0000 7f91109bf640 1 --2- 172.21.15.100:0/1904644163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f910c0cad20 0x7f910c15e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.186+0000 7f91111c0640 1 -- 172.21.15.100:0/1904644163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f910c0cad20 msgr2=0x7f910c15e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.186+0000 7f91111c0640 1 --2- 172.21.15.100:0/1904644163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f910c0cad20 0x7f910c15e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.186+0000 7f91111c0640 1 -- 172.21.15.100:0/1904644163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f910c0d0b20 msgr2=0x7f910c1f44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.186+0000 7f91111c0640 1 --2- 172.21.15.100:0/1904644163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f910c0d0b20 0x7f910c1f44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.186+0000 7f91111c0640 1 -- 172.21.15.100:0/1904644163 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910c15bd50 con 0x7f910c0d0f00 2024-09-11T22:20:16.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.187+0000 7f91111c0640 1 --2- 172.21.15.100:0/1904644163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f910c0d0f00 0x7f910c0c9c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f910400c760 tx=0x7f910400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:16.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.187+0000 7f91097fa640 1 -- 172.21.15.100:0/1904644163 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9104016020 con 0x7f910c0d0f00 2024-09-11T22:20:16.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.187+0000 7f91097fa640 1 -- 172.21.15.100:0/1904644163 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9104006d50 con 0x7f910c0d0f00 2024-09-11T22:20:16.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.187+0000 7f9112c23640 1 -- 172.21.15.100:0/1904644163 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f910c15c030 con 0x7f910c0d0f00 2024-09-11T22:20:16.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.187+0000 7f91097fa640 1 -- 172.21.15.100:0/1904644163 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9104003bb0 con 0x7f910c0d0f00 2024-09-11T22:20:16.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.187+0000 7f9112c23640 1 -- 172.21.15.100:0/1904644163 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f910c1f3f90 con 0x7f910c0d0f00 2024-09-11T22:20:16.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.188+0000 7f9112c23640 1 -- 172.21.15.100:0/1904644163 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f910c069290 con 0x7f910c0d0f00 2024-09-11T22:20:16.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.188+0000 7f91097fa640 1 -- 172.21.15.100:0/1904644163 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f91040050d0 con 0x7f910c0d0f00 2024-09-11T22:20:16.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.189+0000 7f91097fa640 1 --2- 172.21.15.100:0/1904644163 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f90f006be30 0x7f90f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.189+0000 7f91097fa640 1 -- 172.21.15.100:0/1904644163 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f910408a650 con 0x7f910c0d0f00 2024-09-11T22:20:16.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.189+0000 7f91109bf640 1 --2- 172.21.15.100:0/1904644163 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f90f006be30 0x7f90f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.189+0000 7f91109bf640 1 --2- 172.21.15.100:0/1904644163 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f90f006be30 0x7f90f006e2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9100034000 tx=0x7f910002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:16.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.193+0000 7f91097fa640 1 -- 172.21.15.100:0/1904644163 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9104020020 con 0x7f910c0d0f00 2024-09-11T22:20:16.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.392+0000 7f9112c23640 1 -- 172.21.15.100:0/1904644163 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f910c0c6c60 con 0x7f910c0d0f00 2024-09-11T22:20:16.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.393+0000 7f91097fa640 1 -- 172.21.15.100:0/1904644163 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5569 (secure 0 0 0) 0x7f910c0c6c60 con 0x7f910c0d0f00 2024-09-11T22:20:16.394 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:16.394 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":3,"btime":"2024-09-11T22:20:14:809200+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2075802330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":2075802330},{"type":"v1","addr":"172.21.15.100:6837","nonce":2075802330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/1727733473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1727733473},{"type":"v1","addr":"172.21.15.167:6836","nonce":1727733473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/880809662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":880809662},{"type":"v1","addr":"172.21.15.167:6837","nonce":880809662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1912241808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1912241808},{"type":"v1","addr":"172.21.15.100:6836","nonce":1912241808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3236256661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3236256661},{"type":"v1","addr":"172.21.15.100:6839","nonce":3236256661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6834/1651678197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1651678197},{"type":"v1","addr":"172.21.15.167:6834","nonce":1651678197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-11T22:20:16.394 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 3 2024-09-11T22:20:16.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.395+0000 7f9112c23640 1 -- 172.21.15.100:0/1904644163 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f90f006be30 msgr2=0x7f90f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.395+0000 7f9112c23640 1 --2- 172.21.15.100:0/1904644163 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f90f006be30 0x7f90f006e2f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9100034000 tx=0x7f910002e000 comp rx=0 tx=0).stop 2024-09-11T22:20:16.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.395+0000 7f9112c23640 1 -- 172.21.15.100:0/1904644163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f910c0d0f00 msgr2=0x7f910c0c9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.395+0000 7f9112c23640 1 --2- 172.21.15.100:0/1904644163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f910c0d0f00 0x7f910c0c9c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f910400c760 tx=0x7f910400cc20 comp rx=0 tx=0).stop 2024-09-11T22:20:16.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.395+0000 7f9112c23640 1 -- 172.21.15.100:0/1904644163 shutdown_connections 2024-09-11T22:20:16.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.395+0000 7f9112c23640 1 --2- 172.21.15.100:0/1904644163 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f90f006be30 0x7f90f006e2f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.395+0000 7f9112c23640 1 --2- 172.21.15.100:0/1904644163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f910c0d0f00 0x7f910c0c9c50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.395+0000 7f9112c23640 1 --2- 172.21.15.100:0/1904644163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f910c0d0b20 0x7f910c1f44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.395+0000 7f9112c23640 1 --2- 172.21.15.100:0/1904644163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f910c0cad20 0x7f910c15e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.395+0000 7f9112c23640 1 -- 172.21.15.100:0/1904644163 >> 172.21.15.100:0/1904644163 conn(0x7f910c06d160 msgr2=0x7f910c0ce3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:16.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.395+0000 7f9112c23640 1 -- 172.21.15.100:0/1904644163 shutdown_connections 2024-09-11T22:20:16.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.395+0000 7f9112c23640 1 -- 172.21.15.100:0/1904644163 wait complete. 2024-09-11T22:20:16.406 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-11T22:20:16.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.504+0000 7fdc12cb7640 1 Processor -- start 2024-09-11T22:20:16.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.504+0000 7fdc12cb7640 1 -- start start 2024-09-11T22:20:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.504+0000 7fdc12cb7640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdc0c0c5fc0 0x7fdc0c158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.504+0000 7fdc12cb7640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc0c159510 con 0x7fdc0c0c63a0 2024-09-11T22:20:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.504+0000 7fdc12cb7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc0c06f730 con 0x7fdc0c152860 2024-09-11T22:20:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.504+0000 7fdc12cb7640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fdc0c06fa10 con 0x7fdc0c0c5fc0 2024-09-11T22:20:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.505+0000 7fdc10a53640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdc0c0c5fc0 0x7fdc0c158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.505+0000 7fdc10a53640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdc0c0c5fc0 0x7fdc0c158fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41908/0 (socket says 172.21.15.100:41908) 2024-09-11T22:20:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.505+0000 7fdc0bfff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fdc0c0c63a0 0x7fdc0c152150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57066/0 (socket says 172.21.15.100:57066) 2024-09-11T22:20:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.505+0000 7fdc10a53640 1 -- 172.21.15.100:0/1320305483 learned_addr learned my addr 172.21.15.100:0/1320305483 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.505+0000 7fdc10a53640 1 -- 172.21.15.100:0/1320305483 >> v1:172.21.15.167:6789/0 conn(0x7fdc0c152860 legacy=0x7fdc0c0cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.505+0000 7fdc10a53640 1 -- 172.21.15.100:0/1320305483 >> v1:172.21.15.100:6789/0 conn(0x7fdc0c0c63a0 legacy=0x7fdc0c152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.505+0000 7fdc0b7fe640 1 -- 172.21.15.100:0/1320305483 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2924231559 0 0) 0x7fdc0c159510 con 0x7fdc0c0c63a0 2024-09-11T22:20:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.505+0000 7fdc10a53640 1 -- 172.21.15.100:0/1320305483 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0c06fcf0 con 0x7fdc0c0c5fc0 2024-09-11T22:20:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.506+0000 7fdc10a53640 1 --2- 172.21.15.100:0/1320305483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc0c0c5fc0 0x7fdc0c158fd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009870 tx=0x7fdc0002a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563b720c588cbc2a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.506+0000 7fdc0b7fe640 1 -- 172.21.15.100:0/1320305483 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00037070 con 0x7fdc0c0c5fc0 2024-09-11T22:20:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.506+0000 7fdc0b7fe640 1 -- 172.21.15.100:0/1320305483 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc00032640 con 0x7fdc0c0c5fc0 2024-09-11T22:20:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.506+0000 7fdc0b7fe640 1 -- 172.21.15.100:0/1320305483 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00032a10 con 0x7fdc0c0c5fc0 2024-09-11T22:20:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.506+0000 7fdc12cb7640 1 -- 172.21.15.100:0/1320305483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc0c0c5fc0 msgr2=0x7fdc0c158fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.506+0000 7fdc12cb7640 1 --2- 172.21.15.100:0/1320305483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc0c0c5fc0 0x7fdc0c158fd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009870 tx=0x7fdc0002a330 comp rx=0 tx=0).stop 2024-09-11T22:20:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.506+0000 7fdc12cb7640 1 -- 172.21.15.100:0/1320305483 shutdown_connections 2024-09-11T22:20:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.506+0000 7fdc12cb7640 1 --2- 172.21.15.100:0/1320305483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc0c0c5fc0 0x7fdc0c158fd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.506+0000 7fdc12cb7640 1 -- 172.21.15.100:0/1320305483 >> 172.21.15.100:0/1320305483 conn(0x7fdc0c06bc10 msgr2=0x7fdc0c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.506+0000 7fdc12cb7640 1 -- 172.21.15.100:0/1320305483 shutdown_connections 2024-09-11T22:20:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.506+0000 7fdc12cb7640 1 -- 172.21.15.100:0/1320305483 wait complete. 2024-09-11T22:20:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.507+0000 7fdc12cb7640 1 Processor -- start 2024-09-11T22:20:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.507+0000 7fdc12cb7640 1 -- start start 2024-09-11T22:20:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.508+0000 7fdc12cb7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc0c0c5fc0 0x7fdc0c1e3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.508+0000 7fdc12cb7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc0c0c63a0 0x7fdc0c14b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.508+0000 7fdc12cb7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc0c152860 0x7fdc0c1e4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.508+0000 7fdc12cb7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c0ca570 con 0x7fdc0c152860 2024-09-11T22:20:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.508+0000 7fdc12cb7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0c0702b0 con 0x7fdc0c0c63a0 2024-09-11T22:20:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.508+0000 7fdc12cb7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fdc0c0ca6f0 con 0x7fdc0c0c5fc0 2024-09-11T22:20:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.508+0000 7fdc11254640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc0c152860 0x7fdc0c1e4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.508+0000 7fdc11254640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc0c152860 0x7fdc0c1e4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41918/0 (socket says 172.21.15.100:41918) 2024-09-11T22:20:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.508+0000 7fdc11254640 1 -- 172.21.15.100:0/1312688036 learned_addr learned my addr 172.21.15.100:0/1312688036 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.509+0000 7fdc0bfff640 1 --2- 172.21.15.100:0/1312688036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc0c0c63a0 0x7fdc0c14b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.509+0000 7fdc10a53640 1 --2- 172.21.15.100:0/1312688036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc0c0c5fc0 0x7fdc0c1e3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.509+0000 7fdc11254640 1 -- 172.21.15.100:0/1312688036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc0c0c5fc0 msgr2=0x7fdc0c1e3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.509+0000 7fdc11254640 1 --2- 172.21.15.100:0/1312688036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc0c0c5fc0 0x7fdc0c1e3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.509+0000 7fdc11254640 1 -- 172.21.15.100:0/1312688036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc0c0c63a0 msgr2=0x7fdc0c14b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.509+0000 7fdc11254640 1 --2- 172.21.15.100:0/1312688036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc0c0c63a0 0x7fdc0c14b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.509+0000 7fdc11254640 1 -- 172.21.15.100:0/1312688036 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0c1f43a0 con 0x7fdc0c152860 2024-09-11T22:20:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.509+0000 7fdc10a53640 1 --2- 172.21.15.100:0/1312688036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc0c0c5fc0 0x7fdc0c1e3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.509+0000 7fdc11254640 1 --2- 172.21.15.100:0/1312688036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc0c152860 0x7fdc0c1e4780 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400b970 tx=0x7fdc0400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.509+0000 7fdc097fa640 1 -- 172.21.15.100:0/1312688036 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc04019070 con 0x7fdc0c152860 2024-09-11T22:20:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.509+0000 7fdc097fa640 1 -- 172.21.15.100:0/1312688036 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc0400cb40 con 0x7fdc0c152860 2024-09-11T22:20:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.509+0000 7fdc12cb7640 1 -- 172.21.15.100:0/1312688036 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc0c1e3fc0 con 0x7fdc0c152860 2024-09-11T22:20:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.509+0000 7fdc097fa640 1 -- 172.21.15.100:0/1312688036 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc04014440 con 0x7fdc0c152860 2024-09-11T22:20:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.509+0000 7fdc12cb7640 1 -- 172.21.15.100:0/1312688036 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc0c0c59f0 con 0x7fdc0c152860 2024-09-11T22:20:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.510+0000 7fdc12cb7640 1 -- 172.21.15.100:0/1312688036 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc0c0c7040 con 0x7fdc0c152860 2024-09-11T22:20:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.510+0000 7fdc097fa640 1 -- 172.21.15.100:0/1312688036 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc0401c070 con 0x7fdc0c152860 2024-09-11T22:20:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.511+0000 7fdc097fa640 1 --2- 172.21.15.100:0/1312688036 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fdbf006be30 0x7fdbf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.511+0000 7fdc097fa640 1 -- 172.21.15.100:0/1312688036 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fdc0408a820 con 0x7fdc0c152860 2024-09-11T22:20:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.511+0000 7fdc10a53640 1 --2- 172.21.15.100:0/1312688036 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fdbf006be30 0x7fdbf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.511+0000 7fdc10a53640 1 --2- 172.21.15.100:0/1312688036 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fdbf006be30 0x7fdbf006e2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdc00034000 tx=0x7fdc0002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:16.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.515+0000 7fdc097fa640 1 -- 172.21.15.100:0/1312688036 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc04059520 con 0x7fdc0c152860 2024-09-11T22:20:16.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.683+0000 7fdc12cb7640 1 -- 172.21.15.100:0/1312688036 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fdc0c1f4180 con 0x7fdc0c152860 2024-09-11T22:20:16.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.683+0000 7fdc097fa640 1 -- 172.21.15.100:0/1312688036 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7fdc04058e20 con 0x7fdc0c152860 2024-09-11T22:20:16.685 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:16.685 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-09-11T22:20:16.685 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:20:16.685 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2024-09-11T22:20:16.685 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": ".mgr" 2024-09-11T22:20:16.685 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:20:16.686 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-09-11T22:20:16.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.685+0000 7fdc12cb7640 1 -- 172.21.15.100:0/1312688036 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fdbf006be30 msgr2=0x7fdbf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.685+0000 7fdc12cb7640 1 --2- 172.21.15.100:0/1312688036 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fdbf006be30 0x7fdbf006e2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdc00034000 tx=0x7fdc0002e000 comp rx=0 tx=0).stop 2024-09-11T22:20:16.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.685+0000 7fdc12cb7640 1 -- 172.21.15.100:0/1312688036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc0c152860 msgr2=0x7fdc0c1e4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.685+0000 7fdc12cb7640 1 --2- 172.21.15.100:0/1312688036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc0c152860 0x7fdc0c1e4780 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400b970 tx=0x7fdc0400be30 comp rx=0 tx=0).stop 2024-09-11T22:20:16.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.685+0000 7fdc12cb7640 1 -- 172.21.15.100:0/1312688036 shutdown_connections 2024-09-11T22:20:16.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.685+0000 7fdc12cb7640 1 --2- 172.21.15.100:0/1312688036 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fdbf006be30 0x7fdbf006e2f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.685+0000 7fdc12cb7640 1 --2- 172.21.15.100:0/1312688036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc0c152860 0x7fdc0c1e4780 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.685+0000 7fdc12cb7640 1 --2- 172.21.15.100:0/1312688036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc0c0c63a0 0x7fdc0c14b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.685+0000 7fdc12cb7640 1 --2- 172.21.15.100:0/1312688036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc0c0c5fc0 0x7fdc0c1e3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.685+0000 7fdc12cb7640 1 -- 172.21.15.100:0/1312688036 >> 172.21.15.100:0/1312688036 conn(0x7fdc0c06bc10 msgr2=0x7fdc0c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:16.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.685+0000 7fdc12cb7640 1 -- 172.21.15.100:0/1312688036 shutdown_connections 2024-09-11T22:20:16.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.685+0000 7fdc12cb7640 1 -- 172.21.15.100:0/1312688036 wait complete. 2024-09-11T22:20:16.696 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T22:20:16.696 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T22:20:16.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.799+0000 7f22fd2dd640 1 Processor -- start 2024-09-11T22:20:16.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.799+0000 7f22fd2dd640 1 -- start start 2024-09-11T22:20:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.800+0000 7f22fd2dd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22f80cc770 0x7f22f80cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.800+0000 7f22fd2dd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f22f80cb920 0x7f22f815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.800+0000 7f22fd2dd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22f80c5d80 con 0x7f22f8154d20 2024-09-11T22:20:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.800+0000 7f22fd2dd640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f22f815ebe0 con 0x7f22f80cb920 2024-09-11T22:20:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.800+0000 7f22fd2dd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f22f8155100 con 0x7f22f80cc770 2024-09-11T22:20:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.800+0000 7f22f77fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f22f80cb920 0x7f22f815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.800+0000 7f22f77fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f22f80cb920 0x7f22f815aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41934/0 (socket says 172.21.15.100:41934) 2024-09-11T22:20:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.800+0000 7f22f77fe640 1 -- 172.21.15.100:0/2209652360 learned_addr learned my addr 172.21.15.100:0/2209652360 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.800+0000 7f22f77fe640 1 -- 172.21.15.100:0/2209652360 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22f80cc770 msgr2=0x7f22f80cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.800+0000 7f22f67fc640 1 --2- 172.21.15.100:0/2209652360 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22f80cc770 0x7f22f80cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.800+0000 7f22f77fe640 1 --2- 172.21.15.100:0/2209652360 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22f80cc770 0x7f22f80cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.800+0000 7f22f77fe640 1 -- 172.21.15.100:0/2209652360 >> v1:172.21.15.167:6789/0 conn(0x7f22f8154d20 legacy=0x7f22f8072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:16.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.800+0000 7f22f77fe640 1 -- 172.21.15.100:0/2209652360 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f815dfd0 con 0x7f22f80cb920 2024-09-11T22:20:16.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.800+0000 7f22f67fc640 1 --2- 172.21.15.100:0/2209652360 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22f80cc770 0x7f22f80cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:16.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.801+0000 7f22f77fe640 1 --2- 172.21.15.100:0/2209652360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f80cb920 0x7f22f815aaa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f22f0009870 tx=0x7f22f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64e6953b293eb02 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:16.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.801+0000 7f22f5ffb640 1 -- 172.21.15.100:0/2209652360 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f0037070 con 0x7f22f80cb920 2024-09-11T22:20:16.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.801+0000 7f22f5ffb640 1 -- 172.21.15.100:0/2209652360 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22f0032440 con 0x7f22f80cb920 2024-09-11T22:20:16.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.801+0000 7f22f5ffb640 1 -- 172.21.15.100:0/2209652360 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f0032810 con 0x7f22f80cb920 2024-09-11T22:20:16.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.802+0000 7f22fd2dd640 1 -- 172.21.15.100:0/2209652360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f80cb920 msgr2=0x7f22f815aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.802+0000 7f22fd2dd640 1 --2- 172.21.15.100:0/2209652360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f80cb920 0x7f22f815aaa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f22f0009870 tx=0x7f22f002a270 comp rx=0 tx=0).stop 2024-09-11T22:20:16.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.802+0000 7f22fd2dd640 1 -- 172.21.15.100:0/2209652360 shutdown_connections 2024-09-11T22:20:16.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.802+0000 7f22fd2dd640 1 --2- 172.21.15.100:0/2209652360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f80cb920 0x7f22f815aaa0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.802+0000 7f22fd2dd640 1 --2- 172.21.15.100:0/2209652360 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22f80cc770 0x7f22f80cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.802+0000 7f22fd2dd640 1 -- 172.21.15.100:0/2209652360 >> 172.21.15.100:0/2209652360 conn(0x7f22f80d0380 msgr2=0x7f22f80d0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:16.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.802+0000 7f22fd2dd640 1 -- 172.21.15.100:0/2209652360 shutdown_connections 2024-09-11T22:20:16.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.802+0000 7f22fd2dd640 1 -- 172.21.15.100:0/2209652360 wait complete. 2024-09-11T22:20:16.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.803+0000 7f22fd2dd640 1 Processor -- start 2024-09-11T22:20:16.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.803+0000 7f22fd2dd640 1 -- start start 2024-09-11T22:20:16.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.804+0000 7f22fd2dd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f80cb920 0x7f22f81e58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.804+0000 7f22fd2dd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22f80cc770 0x7f22f80cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.804+0000 7f22fd2dd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22f8154d20 0x7f22f81e3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.804+0000 7f22fd2dd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f22f815e870 con 0x7f22f80cb920 2024-09-11T22:20:16.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.804+0000 7f22fd2dd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f22f815e590 con 0x7f22f80cc770 2024-09-11T22:20:16.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.804+0000 7f22fd2dd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f22f8072940 con 0x7f22f8154d20 2024-09-11T22:20:16.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.804+0000 7f22f6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f80cb920 0x7f22f81e58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.804+0000 7f22f6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f80cb920 0x7f22f81e58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41936/0 (socket says 172.21.15.100:41936) 2024-09-11T22:20:16.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.804+0000 7f22f6ffd640 1 -- 172.21.15.100:0/1848473036 learned_addr learned my addr 172.21.15.100:0/1848473036 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:16.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.804+0000 7f22f67fc640 1 --2- 172.21.15.100:0/1848473036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22f80cc770 0x7f22f80cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.804+0000 7f22f77fe640 1 --2- 172.21.15.100:0/1848473036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22f8154d20 0x7f22f81e3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.804+0000 7f22f6ffd640 1 -- 172.21.15.100:0/1848473036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22f8154d20 msgr2=0x7f22f81e3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.804+0000 7f22f6ffd640 1 --2- 172.21.15.100:0/1848473036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22f8154d20 0x7f22f81e3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.804+0000 7f22f6ffd640 1 -- 172.21.15.100:0/1848473036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22f80cc770 msgr2=0x7f22f80cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:16.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.804+0000 7f22f6ffd640 1 --2- 172.21.15.100:0/1848473036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22f80cc770 0x7f22f80cf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:16.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.804+0000 7f22f6ffd640 1 -- 172.21.15.100:0/1848473036 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f814fcf0 con 0x7f22f80cb920 2024-09-11T22:20:16.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.804+0000 7f22f6ffd640 1 --2- 172.21.15.100:0/1848473036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f80cb920 0x7f22f81e58f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f22e800c730 tx=0x7f22e800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:16.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.804+0000 7f22df7fe640 1 -- 172.21.15.100:0/1848473036 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e8016020 con 0x7f22f80cb920 2024-09-11T22:20:16.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.805+0000 7f22df7fe640 1 -- 172.21.15.100:0/1848473036 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22e8006d50 con 0x7f22f80cb920 2024-09-11T22:20:16.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.805+0000 7f22df7fe640 1 -- 172.21.15.100:0/1848473036 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e8003bb0 con 0x7f22f80cb920 2024-09-11T22:20:16.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.805+0000 7f22fd2dd640 1 -- 172.21.15.100:0/1848473036 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f81e5e30 con 0x7f22f80cb920 2024-09-11T22:20:16.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.805+0000 7f22fd2dd640 1 -- 172.21.15.100:0/1848473036 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f815c390 con 0x7f22f80cb920 2024-09-11T22:20:16.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.806+0000 7f22fd2dd640 1 -- 172.21.15.100:0/1848473036 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22f80ca9d0 con 0x7f22f80cb920 2024-09-11T22:20:16.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.806+0000 7f22df7fe640 1 -- 172.21.15.100:0/1848473036 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f22e800a850 con 0x7f22f80cb920 2024-09-11T22:20:16.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.807+0000 7f22df7fe640 1 --2- 172.21.15.100:0/1848473036 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f22e406be60 0x7f22e406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:16.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.807+0000 7f22f67fc640 1 --2- 172.21.15.100:0/1848473036 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f22e406be60 0x7f22e406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:16.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.807+0000 7f22df7fe640 1 -- 172.21.15.100:0/1848473036 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f22e808a570 con 0x7f22f80cb920 2024-09-11T22:20:16.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.807+0000 7f22f67fc640 1 --2- 172.21.15.100:0/1848473036 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f22e406be60 0x7f22e406e320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f22f81e5880 tx=0x7f22ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:16.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.811+0000 7f22df7fe640 1 -- 172.21.15.100:0/1848473036 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f22f80ca9d0 con 0x7f22f80cb920 2024-09-11T22:20:16.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:16.977+0000 7f22fd2dd640 1 -- 172.21.15.100:0/1848473036 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f22f80b3b40 con 0x7f22f80cb920 2024-09-11T22:20:17.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.827+0000 7f22df7fe640 1 -- 172.21.15.100:0/1848473036 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7f22f80b3b40 con 0x7f22f80cb920 2024-09-11T22:20:17.828 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' created 2024-09-11T22:20:17.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.829+0000 7f22fd2dd640 1 -- 172.21.15.100:0/1848473036 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f22e406be60 msgr2=0x7f22e406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.829+0000 7f22fd2dd640 1 --2- 172.21.15.100:0/1848473036 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f22e406be60 0x7f22e406e320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f22f81e5880 tx=0x7f22ec008040 comp rx=0 tx=0).stop 2024-09-11T22:20:17.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.829+0000 7f22fd2dd640 1 -- 172.21.15.100:0/1848473036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f80cb920 msgr2=0x7f22f81e58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.829+0000 7f22fd2dd640 1 --2- 172.21.15.100:0/1848473036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f80cb920 0x7f22f81e58f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f22e800c730 tx=0x7f22e800cbf0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.829+0000 7f22fd2dd640 1 -- 172.21.15.100:0/1848473036 shutdown_connections 2024-09-11T22:20:17.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.829+0000 7f22fd2dd640 1 --2- 172.21.15.100:0/1848473036 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f22e406be60 0x7f22e406e320 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.829+0000 7f22fd2dd640 1 --2- 172.21.15.100:0/1848473036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22f8154d20 0x7f22f81e3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.829+0000 7f22fd2dd640 1 --2- 172.21.15.100:0/1848473036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22f80cc770 0x7f22f80cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.829+0000 7f22fd2dd640 1 --2- 172.21.15.100:0/1848473036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f80cb920 0x7f22f81e58f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.829+0000 7f22fd2dd640 1 -- 172.21.15.100:0/1848473036 >> 172.21.15.100:0/1848473036 conn(0x7f22f80d0380 msgr2=0x7f22f814b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.830+0000 7f22fd2dd640 1 -- 172.21.15.100:0/1848473036 shutdown_connections 2024-09-11T22:20:17.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.830+0000 7f22fd2dd640 1 -- 172.21.15.100:0/1848473036 wait complete. 2024-09-11T22:20:17.845 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-11T22:20:17.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.950+0000 7fabf2f31640 1 Processor -- start 2024-09-11T22:20:17.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.950+0000 7fabf2f31640 1 -- start start 2024-09-11T22:20:17.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.951+0000 7fabf2f31640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fabec151970 0x7fabec0726c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.951+0000 7fabf2f31640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabec072f30 0x7fabec073380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.951+0000 7fabf2f31640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabec073bf0 con 0x7fabec0c3c60 2024-09-11T22:20:17.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.951+0000 7fabf2f31640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fabec0ca3f0 con 0x7fabec151970 2024-09-11T22:20:17.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.951+0000 7fabf2f31640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fabec0c9f60 con 0x7fabec072f30 2024-09-11T22:20:17.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.951+0000 7fabe3fff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fabec0c3c60 0x7fabec1576c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57080/0 (socket says 172.21.15.100:57080) 2024-09-11T22:20:17.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.951+0000 7fabe3fff640 1 -- 172.21.15.100:0/2433408035 learned_addr learned my addr 172.21.15.100:0/2433408035 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:17.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabf0ccd640 1 --2- 172.21.15.100:0/2433408035 >> v2:172.21.15.167:3300/0 conn(0x7fabec151970 0x7fabec0726c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabf14ce640 1 --2- 172.21.15.100:0/2433408035 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabec072f30 0x7fabec073380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabe37fe640 1 -- 172.21.15.100:0/2433408035 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3581480758 0 0) 0x7fabec073bf0 con 0x7fabec0c3c60 2024-09-11T22:20:17.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabe37fe640 1 -- 172.21.15.100:0/2433408035 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabd4003520 con 0x7fabec0c3c60 2024-09-11T22:20:17.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabe37fe640 1 -- 172.21.15.100:0/2433408035 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1474492453 0 0) 0x7fabd4003520 con 0x7fabec0c3c60 2024-09-11T22:20:17.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabe37fe640 1 -- 172.21.15.100:0/2433408035 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabec072f30 msgr2=0x7fabec073380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabe37fe640 1 --2- 172.21.15.100:0/2433408035 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabec072f30 0x7fabec073380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabe37fe640 1 -- 172.21.15.100:0/2433408035 >> v2:172.21.15.167:3300/0 conn(0x7fabec151970 msgr2=0x7fabec0726c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabe37fe640 1 --2- 172.21.15.100:0/2433408035 >> v2:172.21.15.167:3300/0 conn(0x7fabec151970 0x7fabec0726c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabe37fe640 1 -- 172.21.15.100:0/2433408035 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabec073ed0 con 0x7fabec0c3c60 2024-09-11T22:20:17.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabe37fe640 1 -- 172.21.15.100:0/2433408035 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fabdc001670 con 0x7fabec0c3c60 2024-09-11T22:20:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabe37fe640 1 -- 172.21.15.100:0/2433408035 >> v1:172.21.15.100:6789/0 conn(0x7fabec0c3c60 legacy=0x7fabec1576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabe37fe640 1 --2- 172.21.15.100:0/2433408035 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabec072f30 0x7fabd40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabe37fe640 1 --2- 172.21.15.100:0/2433408035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabd4003f30 0x7fabd4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabe37fe640 1 --2- 172.21.15.100:0/2433408035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabd4004d40 0x7fabd40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabe37fe640 1 -- 172.21.15.100:0/2433408035 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fabec0ca3f0 con 0x7fabd4004d40 2024-09-11T22:20:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabe37fe640 1 -- 172.21.15.100:0/2433408035 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fabec0c9f60 con 0x7fabd4003f30 2024-09-11T22:20:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabe37fe640 1 -- 172.21.15.100:0/2433408035 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fabd400b9f0 con 0x7fabec072f30 2024-09-11T22:20:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabf14ce640 1 --2- 172.21.15.100:0/2433408035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabd4004d40 0x7fabd40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabf0ccd640 1 --2- 172.21.15.100:0/2433408035 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabec072f30 0x7fabd40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabe3fff640 1 --2- 172.21.15.100:0/2433408035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabd4003f30 0x7fabd4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabf14ce640 1 -- 172.21.15.100:0/2433408035 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabec072f30 msgr2=0x7fabd40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabf14ce640 1 --2- 172.21.15.100:0/2433408035 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabec072f30 0x7fabd40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabf14ce640 1 -- 172.21.15.100:0/2433408035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabd4003f30 msgr2=0x7fabd4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:17.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabf14ce640 1 --2- 172.21.15.100:0/2433408035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabd4003f30 0x7fabd4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.952+0000 7fabf14ce640 1 -- 172.21.15.100:0/2433408035 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd4003520 con 0x7fabd4004d40 2024-09-11T22:20:17.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.953+0000 7fabf14ce640 1 --2- 172.21.15.100:0/2433408035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabd4004d40 0x7fabd40051c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fabe4009fc0 tx=0x7fabd4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a427fc8fe9e1ddf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.953+0000 7fabe37fe640 1 -- 172.21.15.100:0/2433408035 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe4009c10 con 0x7fabd4004d40 2024-09-11T22:20:17.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.953+0000 7fabe37fe640 1 -- 172.21.15.100:0/2433408035 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabe402e610 con 0x7fabd4004d40 2024-09-11T22:20:17.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.953+0000 7fabe37fe640 1 -- 172.21.15.100:0/2433408035 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe402ea00 con 0x7fabd4004d40 2024-09-11T22:20:17.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.954+0000 7fabf2f31640 1 -- 172.21.15.100:0/2433408035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabd4004d40 msgr2=0x7fabd40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.954+0000 7fabf2f31640 1 --2- 172.21.15.100:0/2433408035 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabd4004d40 0x7fabd40051c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fabe4009fc0 tx=0x7fabd4005830 comp rx=0 tx=0).stop 2024-09-11T22:20:17.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.954+0000 7fabf14ce640 1 -- 172.21.15.100:0/2433408035 reap_dead start 2024-09-11T22:20:17.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.954+0000 7fabf2f31640 1 -- 172.21.15.100:0/2433408035 shutdown_connections 2024-09-11T22:20:17.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.954+0000 7fabf2f31640 1 -- 172.21.15.100:0/2433408035 >> 172.21.15.100:0/2433408035 conn(0x7fabec06ee80 msgr2=0x7fabec070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:17.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.954+0000 7fabf2f31640 1 -- 172.21.15.100:0/2433408035 shutdown_connections 2024-09-11T22:20:17.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.954+0000 7fabf2f31640 1 -- 172.21.15.100:0/2433408035 wait complete. 2024-09-11T22:20:17.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.955+0000 7fabf2f31640 1 Processor -- start 2024-09-11T22:20:17.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.955+0000 7fabf2f31640 1 -- start start 2024-09-11T22:20:17.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.956+0000 7fabf2f31640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabd4004d40 0x7fabec1441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.956+0000 7fabf2f31640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabec1dff40 0x7fabec1f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.956+0000 7fabf2f31640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabec1f0c00 0x7fabec1df240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.956+0000 7fabf2f31640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fabec0c9bf0 con 0x7fabec1dff40 2024-09-11T22:20:17.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.956+0000 7fabf2f31640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fabec0741b0 con 0x7fabec1f0c00 2024-09-11T22:20:17.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.956+0000 7fabf2f31640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fabec06d530 con 0x7fabd4004d40 2024-09-11T22:20:17.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.956+0000 7fabe3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabec1dff40 0x7fabec1f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.956+0000 7fabe3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabec1dff40 0x7fabec1f06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41960/0 (socket says 172.21.15.100:41960) 2024-09-11T22:20:17.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.956+0000 7fabe3fff640 1 -- 172.21.15.100:0/2113291121 learned_addr learned my addr 172.21.15.100:0/2113291121 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:17.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.956+0000 7fabf0ccd640 1 --2- 172.21.15.100:0/2113291121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabd4004d40 0x7fabec1441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.956+0000 7fabf14ce640 1 --2- 172.21.15.100:0/2113291121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabec1f0c00 0x7fabec1df240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.956+0000 7fabe3fff640 1 -- 172.21.15.100:0/2113291121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabd4004d40 msgr2=0x7fabec1441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.956+0000 7fabe3fff640 1 --2- 172.21.15.100:0/2113291121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabd4004d40 0x7fabec1441c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.956+0000 7fabe3fff640 1 -- 172.21.15.100:0/2113291121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabec1f0c00 msgr2=0x7fabec1df240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:17.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.956+0000 7fabe3fff640 1 --2- 172.21.15.100:0/2113291121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabec1f0c00 0x7fabec1df240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:17.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.956+0000 7fabe3fff640 1 -- 172.21.15.100:0/2113291121 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabec1f1080 con 0x7fabec1dff40 2024-09-11T22:20:17.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.956+0000 7fabf14ce640 1 --2- 172.21.15.100:0/2113291121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabec1f0c00 0x7fabec1df240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:17.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.956+0000 7fabe3fff640 1 --2- 172.21.15.100:0/2113291121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabec1dff40 0x7fabec1f06c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fabdc007370 tx=0x7fabdc007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.956+0000 7fabe17fa640 1 -- 172.21.15.100:0/2113291121 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabdc01a070 con 0x7fabec1dff40 2024-09-11T22:20:17.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.957+0000 7fabe17fa640 1 -- 172.21.15.100:0/2113291121 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabdc00f9a0 con 0x7fabec1dff40 2024-09-11T22:20:17.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.957+0000 7fabf2f31640 1 -- 172.21.15.100:0/2113291121 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabec1e0480 con 0x7fabec1dff40 2024-09-11T22:20:17.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.957+0000 7fabe17fa640 1 -- 172.21.15.100:0/2113291121 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabdc00fd90 con 0x7fabec1dff40 2024-09-11T22:20:17.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.957+0000 7fabf2f31640 1 -- 172.21.15.100:0/2113291121 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabec0cb100 con 0x7fabec1dff40 2024-09-11T22:20:17.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.957+0000 7fabf2f31640 1 -- 172.21.15.100:0/2113291121 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabec073bf0 con 0x7fabec1dff40 2024-09-11T22:20:17.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.958+0000 7fabe17fa640 1 -- 172.21.15.100:0/2113291121 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fabdc01d070 con 0x7fabec1dff40 2024-09-11T22:20:17.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.959+0000 7fabe17fa640 1 --2- 172.21.15.100:0/2113291121 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fabd806be60 0x7fabd806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:17.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.959+0000 7fabe17fa640 1 -- 172.21.15.100:0/2113291121 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7fabdc08a5d0 con 0x7fabec1dff40 2024-09-11T22:20:17.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.959+0000 7fabf0ccd640 1 --2- 172.21.15.100:0/2113291121 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fabd806be60 0x7fabd806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:17.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.959+0000 7fabf0ccd640 1 --2- 172.21.15.100:0/2113291121 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fabd806be60 0x7fabd806e320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fabe8009a60 tx=0x7fabe8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:17.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:17.963+0000 7fabe17fa640 1 -- 172.21.15.100:0/2113291121 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fabec073bf0 con 0x7fabec1dff40 2024-09-11T22:20:18.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.129+0000 7fabf2f31640 1 -- 172.21.15.100:0/2113291121 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fabec0c4090 con 0x7fabec1dff40 2024-09-11T22:20:18.329 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:20:18.332 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:20:18.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.834+0000 7fabe17fa640 1 -- 172.21.15.100:0/2113291121 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) ==== 171+0+0 (secure 0 0 0) 0x7fabec1f1080 con 0x7fabec1dff40 2024-09-11T22:20:18.834 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' created 2024-09-11T22:20:18.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.836+0000 7fabf2f31640 1 -- 172.21.15.100:0/2113291121 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fabd806be60 msgr2=0x7fabd806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:18.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.836+0000 7fabf2f31640 1 --2- 172.21.15.100:0/2113291121 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fabd806be60 0x7fabd806e320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fabe8009a60 tx=0x7fabe8008040 comp rx=0 tx=0).stop 2024-09-11T22:20:18.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.836+0000 7fabf2f31640 1 -- 172.21.15.100:0/2113291121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabec1dff40 msgr2=0x7fabec1f06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:18.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.836+0000 7fabf2f31640 1 --2- 172.21.15.100:0/2113291121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabec1dff40 0x7fabec1f06c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fabdc007370 tx=0x7fabdc007830 comp rx=0 tx=0).stop 2024-09-11T22:20:18.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.836+0000 7fabf2f31640 1 -- 172.21.15.100:0/2113291121 shutdown_connections 2024-09-11T22:20:18.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.836+0000 7fabf2f31640 1 --2- 172.21.15.100:0/2113291121 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fabd806be60 0x7fabd806e320 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.836+0000 7fabf2f31640 1 --2- 172.21.15.100:0/2113291121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabec1f0c00 0x7fabec1df240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.836+0000 7fabf2f31640 1 --2- 172.21.15.100:0/2113291121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabec1dff40 0x7fabec1f06c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.836+0000 7fabf2f31640 1 --2- 172.21.15.100:0/2113291121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabd4004d40 0x7fabec1441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.836+0000 7fabf2f31640 1 -- 172.21.15.100:0/2113291121 >> 172.21.15.100:0/2113291121 conn(0x7fabec06ee80 msgr2=0x7fabec150ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:18.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.836+0000 7fabf2f31640 1 -- 172.21.15.100:0/2113291121 shutdown_connections 2024-09-11T22:20:18.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.836+0000 7fabf2f31640 1 -- 172.21.15.100:0/2113291121 wait complete. 2024-09-11T22:20:18.857 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T22:20:18.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.958+0000 7fd7554ba640 1 Processor -- start 2024-09-11T22:20:18.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.958+0000 7fd7554ba640 1 -- start start 2024-09-11T22:20:18.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.959+0000 7fd7554ba640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd750155040 0x7fd75015e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:18.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.959+0000 7fd7554ba640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd75015e920 0x7fd7500cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:18.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.959+0000 7fd7554ba640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd75015ac20 con 0x7fd750154c60 2024-09-11T22:20:18.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.959+0000 7fd7554ba640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fd75015bad0 con 0x7fd75015e920 2024-09-11T22:20:18.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.959+0000 7fd7554ba640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd75015ed70 con 0x7fd750155040 2024-09-11T22:20:18.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.959+0000 7fd74effd640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd750154c60 0x7fd7500d0370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57088/0 (socket says 172.21.15.100:57088) 2024-09-11T22:20:18.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.959+0000 7fd74effd640 1 -- 172.21.15.100:0/1651539033 learned_addr learned my addr 172.21.15.100:0/1651539033 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:18.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.959+0000 7fd74e7fc640 1 -- 172.21.15.100:0/1651539033 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3361098458 0 0) 0x7fd75015ac20 con 0x7fd750154c60 2024-09-11T22:20:18.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.959+0000 7fd74e7fc640 1 -- 172.21.15.100:0/1651539033 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd73c003520 con 0x7fd750154c60 2024-09-11T22:20:18.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.959+0000 7fd7467fc640 1 --2- 172.21.15.100:0/1651539033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd750155040 0x7fd75015e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:18.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.959+0000 7fd74f7fe640 1 --2- 172.21.15.100:0/1651539033 >> v2:172.21.15.167:3300/0 conn(0x7fd75015e920 0x7fd7500cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:18.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.959+0000 7fd74e7fc640 1 -- 172.21.15.100:0/1651539033 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1169593315 0 0) 0x7fd73c003520 con 0x7fd750154c60 2024-09-11T22:20:18.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.959+0000 7fd74e7fc640 1 -- 172.21.15.100:0/1651539033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd750155040 msgr2=0x7fd75015e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:18.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.959+0000 7fd74e7fc640 1 --2- 172.21.15.100:0/1651539033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd750155040 0x7fd75015e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.959+0000 7fd74e7fc640 1 -- 172.21.15.100:0/1651539033 >> v2:172.21.15.167:3300/0 conn(0x7fd75015e920 msgr2=0x7fd7500cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:18.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.959+0000 7fd74e7fc640 1 --2- 172.21.15.100:0/1651539033 >> v2:172.21.15.167:3300/0 conn(0x7fd75015e920 0x7fd7500cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.960+0000 7fd74e7fc640 1 -- 172.21.15.100:0/1651539033 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd75015aec0 con 0x7fd750154c60 2024-09-11T22:20:18.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.960+0000 7fd74e7fc640 1 -- 172.21.15.100:0/1651539033 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fd740001670 con 0x7fd750154c60 2024-09-11T22:20:18.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.960+0000 7fd74e7fc640 1 -- 172.21.15.100:0/1651539033 >> v1:172.21.15.100:6789/0 conn(0x7fd750154c60 legacy=0x7fd7500d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:18.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.960+0000 7fd74e7fc640 1 --2- 172.21.15.100:0/1651539033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd73c0039b0 0x7fd73c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:18.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.960+0000 7fd74e7fc640 1 --2- 172.21.15.100:0/1651539033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd750155040 0x7fd73c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:18.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.960+0000 7fd74e7fc640 1 --2- 172.21.15.100:0/1651539033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd73c004d40 0x7fd73c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:18.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.960+0000 7fd74e7fc640 1 -- 172.21.15.100:0/1651539033 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd75015bad0 con 0x7fd73c0039b0 2024-09-11T22:20:18.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.960+0000 7fd74e7fc640 1 -- 172.21.15.100:0/1651539033 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd75015ed70 con 0x7fd73c004d40 2024-09-11T22:20:18.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.960+0000 7fd74e7fc640 1 -- 172.21.15.100:0/1651539033 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd73c00b9c0 con 0x7fd750155040 2024-09-11T22:20:18.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.960+0000 7fd74effd640 1 --2- 172.21.15.100:0/1651539033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd73c0039b0 0x7fd73c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:18.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.960+0000 7fd7467fc640 1 --2- 172.21.15.100:0/1651539033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd750155040 0x7fd73c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:18.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.960+0000 7fd74f7fe640 1 --2- 172.21.15.100:0/1651539033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd73c004d40 0x7fd73c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:18.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.960+0000 7fd74effd640 1 -- 172.21.15.100:0/1651539033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd750155040 msgr2=0x7fd73c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:18.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.960+0000 7fd74effd640 1 --2- 172.21.15.100:0/1651539033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd750155040 0x7fd73c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.960+0000 7fd74effd640 1 -- 172.21.15.100:0/1651539033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd73c004d40 msgr2=0x7fd73c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:18.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.960+0000 7fd74effd640 1 --2- 172.21.15.100:0/1651539033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd73c004d40 0x7fd73c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.960+0000 7fd74effd640 1 -- 172.21.15.100:0/1651539033 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73c003520 con 0x7fd73c0039b0 2024-09-11T22:20:18.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.961+0000 7fd74effd640 1 --2- 172.21.15.100:0/1651539033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd73c0039b0 0x7fd73c003dd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd740001050 tx=0x7fd73c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3078d2c756c9b930 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:18.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.961+0000 7fd74e7fc640 1 -- 172.21.15.100:0/1651539033 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74002e070 con 0x7fd73c0039b0 2024-09-11T22:20:18.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.961+0000 7fd74e7fc640 1 -- 172.21.15.100:0/1651539033 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd740005af0 con 0x7fd73c0039b0 2024-09-11T22:20:18.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.961+0000 7fd74e7fc640 1 -- 172.21.15.100:0/1651539033 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd740007d70 con 0x7fd73c0039b0 2024-09-11T22:20:18.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.961+0000 7fd7554ba640 1 -- 172.21.15.100:0/1651539033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd73c0039b0 msgr2=0x7fd73c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:18.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.961+0000 7fd7554ba640 1 --2- 172.21.15.100:0/1651539033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd73c0039b0 0x7fd73c003dd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd740001050 tx=0x7fd73c005830 comp rx=0 tx=0).stop 2024-09-11T22:20:18.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.961+0000 7fd74f7fe640 1 -- 172.21.15.100:0/1651539033 reap_dead start 2024-09-11T22:20:18.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.961+0000 7fd7554ba640 1 -- 172.21.15.100:0/1651539033 shutdown_connections 2024-09-11T22:20:18.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.961+0000 7fd7554ba640 1 -- 172.21.15.100:0/1651539033 >> 172.21.15.100:0/1651539033 conn(0x7fd75006d060 msgr2=0x7fd75006d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:18.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.961+0000 7fd7554ba640 1 -- 172.21.15.100:0/1651539033 shutdown_connections 2024-09-11T22:20:18.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.961+0000 7fd7554ba640 1 -- 172.21.15.100:0/1651539033 wait complete. 2024-09-11T22:20:18.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.962+0000 7fd7554ba640 1 Processor -- start 2024-09-11T22:20:18.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.963+0000 7fd7554ba640 1 -- start start 2024-09-11T22:20:18.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.963+0000 7fd7554ba640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd73c0039b0 0x7fd750159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:18.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.963+0000 7fd7554ba640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7500ceaf0 0x7fd750156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:18.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.963+0000 7fd7554ba640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd750157280 0x7fd750149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:18.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.963+0000 7fd7554ba640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd75015b760 con 0x7fd750157280 2024-09-11T22:20:18.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.963+0000 7fd7554ba640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd75015b480 con 0x7fd73c0039b0 2024-09-11T22:20:18.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.963+0000 7fd7554ba640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd7500c5e10 con 0x7fd7500ceaf0 2024-09-11T22:20:18.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.963+0000 7fd74f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd750157280 0x7fd750149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:18.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.963+0000 7fd74f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd750157280 0x7fd750149ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41980/0 (socket says 172.21.15.100:41980) 2024-09-11T22:20:18.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.963+0000 7fd74f7fe640 1 -- 172.21.15.100:0/1222270608 learned_addr learned my addr 172.21.15.100:0/1222270608 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:18.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.963+0000 7fd74effd640 1 --2- 172.21.15.100:0/1222270608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd73c0039b0 0x7fd750159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:18.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.964+0000 7fd7467fc640 1 --2- 172.21.15.100:0/1222270608 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7500ceaf0 0x7fd750156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:18.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.964+0000 7fd74f7fe640 1 -- 172.21.15.100:0/1222270608 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7500ceaf0 msgr2=0x7fd750156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:18.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.964+0000 7fd74f7fe640 1 --2- 172.21.15.100:0/1222270608 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7500ceaf0 0x7fd750156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.964+0000 7fd74f7fe640 1 -- 172.21.15.100:0/1222270608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd73c0039b0 msgr2=0x7fd750159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:18.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.964+0000 7fd74f7fe640 1 --2- 172.21.15.100:0/1222270608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd73c0039b0 0x7fd750159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:18.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.964+0000 7fd74f7fe640 1 -- 172.21.15.100:0/1222270608 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd750157700 con 0x7fd750157280 2024-09-11T22:20:18.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.964+0000 7fd74f7fe640 1 --2- 172.21.15.100:0/1222270608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd750157280 0x7fd750149ed0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd7500b38d0 tx=0x7fd74800f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:18.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.964+0000 7fd747fff640 1 -- 172.21.15.100:0/1222270608 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74800fcb0 con 0x7fd750157280 2024-09-11T22:20:18.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.964+0000 7fd747fff640 1 -- 172.21.15.100:0/1222270608 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd74801d070 con 0x7fd750157280 2024-09-11T22:20:18.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.964+0000 7fd7554ba640 1 -- 172.21.15.100:0/1222270608 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd75015a2c0 con 0x7fd750157280 2024-09-11T22:20:18.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.964+0000 7fd747fff640 1 -- 172.21.15.100:0/1222270608 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd748015670 con 0x7fd750157280 2024-09-11T22:20:18.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.964+0000 7fd7554ba640 1 -- 172.21.15.100:0/1222270608 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd75015a880 con 0x7fd750157280 2024-09-11T22:20:18.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.965+0000 7fd7554ba640 1 -- 172.21.15.100:0/1222270608 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd75015e3e0 con 0x7fd750157280 2024-09-11T22:20:18.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.965+0000 7fd747fff640 1 -- 172.21.15.100:0/1222270608 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd748015810 con 0x7fd750157280 2024-09-11T22:20:18.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.966+0000 7fd747fff640 1 --2- 172.21.15.100:0/1222270608 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd73006be60 0x7fd73006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:18.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.966+0000 7fd747fff640 1 -- 172.21.15.100:0/1222270608 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7fd74808b520 con 0x7fd750157280 2024-09-11T22:20:18.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.966+0000 7fd74effd640 1 --2- 172.21.15.100:0/1222270608 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd73006be60 0x7fd73006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:18.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.966+0000 7fd74effd640 1 --2- 172.21.15.100:0/1222270608 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd73006be60 0x7fd73006e320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd740033000 tx=0x7fd740009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:18.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:18.970+0000 7fd747fff640 1 -- 172.21.15.100:0/1222270608 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd750157700 con 0x7fd750157280 2024-09-11T22:20:19.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.169+0000 7fd7554ba640 1 -- 172.21.15.100:0/1222270608 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd750152800 con 0x7fd750157280 2024-09-11T22:20:19.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.835+0000 7fd747fff640 1 -- 172.21.15.100:0/1222270608 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fd748010040 con 0x7fd750157280 2024-09-11T22:20:19.836 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 2 and data pool 3 2024-09-11T22:20:19.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.838+0000 7fd7554ba640 1 -- 172.21.15.100:0/1222270608 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd73006be60 msgr2=0x7fd73006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:19.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.838+0000 7fd7554ba640 1 --2- 172.21.15.100:0/1222270608 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd73006be60 0x7fd73006e320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd740033000 tx=0x7fd740009030 comp rx=0 tx=0).stop 2024-09-11T22:20:19.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.838+0000 7fd7554ba640 1 -- 172.21.15.100:0/1222270608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd750157280 msgr2=0x7fd750149ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:19.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.838+0000 7fd7554ba640 1 --2- 172.21.15.100:0/1222270608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd750157280 0x7fd750149ed0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd7500b38d0 tx=0x7fd74800f1b0 comp rx=0 tx=0).stop 2024-09-11T22:20:19.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.839+0000 7fd7554ba640 1 -- 172.21.15.100:0/1222270608 shutdown_connections 2024-09-11T22:20:19.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.839+0000 7fd7554ba640 1 --2- 172.21.15.100:0/1222270608 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd73006be60 0x7fd73006e320 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:19.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.839+0000 7fd7554ba640 1 --2- 172.21.15.100:0/1222270608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd750157280 0x7fd750149ed0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:19.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.839+0000 7fd7554ba640 1 --2- 172.21.15.100:0/1222270608 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7500ceaf0 0x7fd750156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:19.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.839+0000 7fd7554ba640 1 --2- 172.21.15.100:0/1222270608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd73c0039b0 0x7fd750159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:19.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.839+0000 7fd7554ba640 1 -- 172.21.15.100:0/1222270608 >> 172.21.15.100:0/1222270608 conn(0x7fd75006d060 msgr2=0x7fd750152ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:19.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.840+0000 7fd7554ba640 1 -- 172.21.15.100:0/1222270608 shutdown_connections 2024-09-11T22:20:19.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.840+0000 7fd7554ba640 1 -- 172.21.15.100:0/1222270608 wait complete. 2024-09-11T22:20:19.863 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-11T22:20:19.864 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-11T22:20:19.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.969+0000 7fc11b9bd640 1 Processor -- start 2024-09-11T22:20:19.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.969+0000 7fc11b9bd640 1 -- start start 2024-09-11T22:20:19.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.970+0000 7fc11b9bd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc114154d20 0x7fc1140cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:19.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.970+0000 7fc11b9bd640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1140c5d80 con 0x7fc1140cb920 2024-09-11T22:20:19.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.970+0000 7fc11b9bd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc11415dfd0 con 0x7fc1140cc770 2024-09-11T22:20:19.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.970+0000 7fc11b9bd640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fc11415ebe0 con 0x7fc114154d20 2024-09-11T22:20:19.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.970+0000 7fc119759640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc114154d20 0x7fc1140cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:19.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.970+0000 7fc119f5a640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc1140cb920 0x7fc11415aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57100/0 (socket says 172.21.15.100:57100) 2024-09-11T22:20:19.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.970+0000 7fc119f5a640 1 -- 172.21.15.100:0/467780607 learned_addr learned my addr 172.21.15.100:0/467780607 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:19.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.970+0000 7fc119759640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc114154d20 0x7fc1140cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41996/0 (socket says 172.21.15.100:41996) 2024-09-11T22:20:19.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.970+0000 7fc119759640 1 -- 172.21.15.100:0/467780607 >> v1:172.21.15.167:6789/0 conn(0x7fc1140cc770 legacy=0x7fc114072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:19.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.970+0000 7fc119759640 1 -- 172.21.15.100:0/467780607 >> v1:172.21.15.100:6789/0 conn(0x7fc1140cb920 legacy=0x7fc11415aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:19.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.970+0000 7fc119759640 1 -- 172.21.15.100:0/467780607 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc11415e2b0 con 0x7fc114154d20 2024-09-11T22:20:19.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.970+0000 7fc10bfff640 1 -- 172.21.15.100:0/467780607 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2612807629 0 0) 0x7fc1140c5d80 con 0x7fc1140cb920 2024-09-11T22:20:19.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.971+0000 7fc119759640 1 --2- 172.21.15.100:0/467780607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc114154d20 0x7fc1140cb300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc11415ed60 tx=0x7fc11002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a5b1320d942002 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:19.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.971+0000 7fc10bfff640 1 -- 172.21.15.100:0/467780607 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc110037070 con 0x7fc114154d20 2024-09-11T22:20:19.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.971+0000 7fc10bfff640 1 -- 172.21.15.100:0/467780607 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc11002ae40 con 0x7fc114154d20 2024-09-11T22:20:19.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.971+0000 7fc10bfff640 1 -- 172.21.15.100:0/467780607 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc110032660 con 0x7fc114154d20 2024-09-11T22:20:19.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.971+0000 7fc11b9bd640 1 -- 172.21.15.100:0/467780607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc114154d20 msgr2=0x7fc1140cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:19.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.971+0000 7fc11b9bd640 1 --2- 172.21.15.100:0/467780607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc114154d20 0x7fc1140cb300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc11415ed60 tx=0x7fc11002a130 comp rx=0 tx=0).stop 2024-09-11T22:20:19.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.971+0000 7fc11b9bd640 1 -- 172.21.15.100:0/467780607 shutdown_connections 2024-09-11T22:20:19.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.971+0000 7fc11b9bd640 1 --2- 172.21.15.100:0/467780607 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc114154d20 0x7fc1140cb300 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:19.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.971+0000 7fc11b9bd640 1 -- 172.21.15.100:0/467780607 >> 172.21.15.100:0/467780607 conn(0x7fc1140d0380 msgr2=0x7fc1140d0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:19.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.972+0000 7fc11b9bd640 1 -- 172.21.15.100:0/467780607 shutdown_connections 2024-09-11T22:20:19.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.972+0000 7fc11b9bd640 1 -- 172.21.15.100:0/467780607 wait complete. 2024-09-11T22:20:19.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.973+0000 7fc11b9bd640 1 Processor -- start 2024-09-11T22:20:19.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.973+0000 7fc11b9bd640 1 -- start start 2024-09-11T22:20:19.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.973+0000 7fc11b9bd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc1140cb920 0x7fc114153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:19.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.973+0000 7fc11b9bd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1140cc770 0x7fc114145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:19.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.973+0000 7fc11b9bd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc114154d20 0x7fc114146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:19.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.973+0000 7fc11b9bd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc11415e870 con 0x7fc114154d20 2024-09-11T22:20:19.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.973+0000 7fc11b9bd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc114155100 con 0x7fc1140cc770 2024-09-11T22:20:19.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.973+0000 7fc11b9bd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc114072940 con 0x7fc1140cb920 2024-09-11T22:20:19.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.973+0000 7fc119f5a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc114154d20 0x7fc114146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:19.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.973+0000 7fc119f5a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc114154d20 0x7fc114146480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42006/0 (socket says 172.21.15.100:42006) 2024-09-11T22:20:19.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.973+0000 7fc119f5a640 1 -- 172.21.15.100:0/3774444264 learned_addr learned my addr 172.21.15.100:0/3774444264 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:19.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.974+0000 7fc119759640 1 --2- 172.21.15.100:0/3774444264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc1140cb920 0x7fc114153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:19.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.974+0000 7fc118f58640 1 --2- 172.21.15.100:0/3774444264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1140cc770 0x7fc114145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:19.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.974+0000 7fc119f5a640 1 -- 172.21.15.100:0/3774444264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc1140cb920 msgr2=0x7fc114153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:19.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.974+0000 7fc119f5a640 1 --2- 172.21.15.100:0/3774444264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc1140cb920 0x7fc114153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:19.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.974+0000 7fc119f5a640 1 -- 172.21.15.100:0/3774444264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1140cc770 msgr2=0x7fc114145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:19.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.974+0000 7fc119f5a640 1 --2- 172.21.15.100:0/3774444264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1140cc770 0x7fc114145f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:19.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.974+0000 7fc119f5a640 1 -- 172.21.15.100:0/3774444264 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1140ca6f0 con 0x7fc114154d20 2024-09-11T22:20:19.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.974+0000 7fc119f5a640 1 --2- 172.21.15.100:0/3774444264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc114154d20 0x7fc114146480 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc10c00c730 tx=0x7fc10c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:19.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.974+0000 7fc109ffb640 1 -- 172.21.15.100:0/3774444264 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10c018070 con 0x7fc114154d20 2024-09-11T22:20:19.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.974+0000 7fc109ffb640 1 -- 172.21.15.100:0/3774444264 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc10c00ce40 con 0x7fc114154d20 2024-09-11T22:20:19.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.974+0000 7fc109ffb640 1 -- 172.21.15.100:0/3774444264 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10c00a860 con 0x7fc114154d20 2024-09-11T22:20:19.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.974+0000 7fc11b9bd640 1 -- 172.21.15.100:0/3774444264 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc11414a120 con 0x7fc114154d20 2024-09-11T22:20:19.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.974+0000 7fc11b9bd640 1 -- 172.21.15.100:0/3774444264 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1141f0920 con 0x7fc114154d20 2024-09-11T22:20:19.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.975+0000 7fc11b9bd640 1 -- 172.21.15.100:0/3774444264 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1140cb300 con 0x7fc114154d20 2024-09-11T22:20:19.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.976+0000 7fc109ffb640 1 -- 172.21.15.100:0/3774444264 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc10c01b070 con 0x7fc114154d20 2024-09-11T22:20:19.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.976+0000 7fc109ffb640 1 --2- 172.21.15.100:0/3774444264 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc0f806be30 0x7fc0f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:19.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.976+0000 7fc109ffb640 1 -- 172.21.15.100:0/3774444264 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc10c08a480 con 0x7fc114154d20 2024-09-11T22:20:19.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.976+0000 7fc119759640 1 --2- 172.21.15.100:0/3774444264 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc0f806be30 0x7fc0f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:19.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.976+0000 7fc119759640 1 --2- 172.21.15.100:0/3774444264 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc0f806be30 0x7fc0f806e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc110034000 tx=0x7fc11002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:19.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:19.980+0000 7fc109ffb640 1 -- 172.21.15.100:0/3774444264 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc10c058e30 con 0x7fc114154d20 2024-09-11T22:20:20.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.156+0000 7fc11b9bd640 1 -- 172.21.15.100:0/3774444264 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fc1141f06f0 con 0x7fc114154d20 2024-09-11T22:20:20.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.836+0000 7fc109ffb640 1 -- 172.21.15.100:0/3774444264 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) ==== 157+0+0 (secure 0 0 0) 0x7fc10c058730 con 0x7fc114154d20 2024-09-11T22:20:20.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.839+0000 7fc11b9bd640 1 -- 172.21.15.100:0/3774444264 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc0f806be30 msgr2=0x7fc0f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:20.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.839+0000 7fc11b9bd640 1 --2- 172.21.15.100:0/3774444264 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc0f806be30 0x7fc0f806e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc110034000 tx=0x7fc11002e000 comp rx=0 tx=0).stop 2024-09-11T22:20:20.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.839+0000 7fc11b9bd640 1 -- 172.21.15.100:0/3774444264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc114154d20 msgr2=0x7fc114146480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:20.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.839+0000 7fc11b9bd640 1 --2- 172.21.15.100:0/3774444264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc114154d20 0x7fc114146480 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc10c00c730 tx=0x7fc10c00cbf0 comp rx=0 tx=0).stop 2024-09-11T22:20:20.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.839+0000 7fc11b9bd640 1 -- 172.21.15.100:0/3774444264 shutdown_connections 2024-09-11T22:20:20.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.839+0000 7fc11b9bd640 1 --2- 172.21.15.100:0/3774444264 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc0f806be30 0x7fc0f806e2f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:20.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.839+0000 7fc11b9bd640 1 --2- 172.21.15.100:0/3774444264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc114154d20 0x7fc114146480 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:20.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.839+0000 7fc11b9bd640 1 --2- 172.21.15.100:0/3774444264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1140cc770 0x7fc114145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:20.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.839+0000 7fc11b9bd640 1 --2- 172.21.15.100:0/3774444264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc1140cb920 0x7fc114153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:20.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.839+0000 7fc11b9bd640 1 -- 172.21.15.100:0/3774444264 >> 172.21.15.100:0/3774444264 conn(0x7fc1140d0380 msgr2=0x7fc11406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:20.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.839+0000 7fc11b9bd640 1 -- 172.21.15.100:0/3774444264 shutdown_connections 2024-09-11T22:20:20.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.839+0000 7fc11b9bd640 1 -- 172.21.15.100:0/3774444264 wait complete. 2024-09-11T22:20:20.854 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T22:20:20.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.964+0000 7f399c3f8640 1 Processor -- start 2024-09-11T22:20:20.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.964+0000 7f399c3f8640 1 -- start start 2024-09-11T22:20:20.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.964+0000 7f399c3f8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f39940707a0 0x7f399415e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:20.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.964+0000 7f399c3f8640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39941585f0 con 0x7f39940b0ca0 2024-09-11T22:20:20.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.964+0000 7f399c3f8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39940c9430 con 0x7f3994158210 2024-09-11T22:20:20.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.964+0000 7f399c3f8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f3994070310 con 0x7f39940707a0 2024-09-11T22:20:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.965+0000 7f3999993640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f39940b0ca0 0x7f39940ce160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57116/0 (socket says 172.21.15.100:57116) 2024-09-11T22:20:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.965+0000 7f3999993640 1 -- 172.21.15.100:0/3545861912 learned_addr learned my addr 172.21.15.100:0/3545861912 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.965+0000 7f399a995640 1 --2- 172.21.15.100:0/3545861912 >> v2:172.21.15.167:3300/0 conn(0x7f39940707a0 0x7f399415e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.965+0000 7f3999192640 1 -- 172.21.15.100:0/3545861912 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2470608385 0 0) 0x7f39941585f0 con 0x7f39940b0ca0 2024-09-11T22:20:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.965+0000 7f3999192640 1 -- 172.21.15.100:0/3545861912 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3980003520 con 0x7f39940b0ca0 2024-09-11T22:20:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.965+0000 7f3999192640 1 -- 172.21.15.100:0/3545861912 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4157408723 0 0) 0x7f3980003520 con 0x7f39940b0ca0 2024-09-11T22:20:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.965+0000 7f3999192640 1 -- 172.21.15.100:0/3545861912 >> v2:172.21.15.167:3300/0 conn(0x7f39940707a0 msgr2=0x7f399415e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.965+0000 7f3999192640 1 --2- 172.21.15.100:0/3545861912 >> v2:172.21.15.167:3300/0 conn(0x7f39940707a0 0x7f399415e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.965+0000 7f3999192640 1 -- 172.21.15.100:0/3545861912 >> v1:172.21.15.167:6789/0 conn(0x7f3994158210 legacy=0x7f399406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.965+0000 7f3999192640 1 -- 172.21.15.100:0/3545861912 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39940c96d0 con 0x7f39940b0ca0 2024-09-11T22:20:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.965+0000 7f3999192640 1 -- 172.21.15.100:0/3545861912 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f3984001670 con 0x7f39940b0ca0 2024-09-11T22:20:20.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.965+0000 7f3999192640 1 -- 172.21.15.100:0/3545861912 >> v1:172.21.15.100:6789/0 conn(0x7f39940b0ca0 legacy=0x7f39940ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:20.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.965+0000 7f3999192640 1 --2- 172.21.15.100:0/3545861912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39800039b0 0x7f3980003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:20.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.965+0000 7f3999192640 1 --2- 172.21.15.100:0/3545861912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3980004800 0x7f3980004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:20.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.965+0000 7f3999192640 1 --2- 172.21.15.100:0/3545861912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39800051c0 0x7f398000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:20.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.965+0000 7f3999192640 1 -- 172.21.15.100:0/3545861912 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3994070310 con 0x7f39800051c0 2024-09-11T22:20:20.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.965+0000 7f3999192640 1 -- 172.21.15.100:0/3545861912 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f398000c070 con 0x7f3980004800 2024-09-11T22:20:20.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.965+0000 7f3999192640 1 -- 172.21.15.100:0/3545861912 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f398000c270 con 0x7f39800039b0 2024-09-11T22:20:20.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.965+0000 7f399a995640 1 --2- 172.21.15.100:0/3545861912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39800051c0 0x7f398000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:20.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.965+0000 7f3999993640 1 --2- 172.21.15.100:0/3545861912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3980004800 0x7f3980004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:20.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.965+0000 7f399a194640 1 --2- 172.21.15.100:0/3545861912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39800039b0 0x7f3980003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:20.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.966+0000 7f399a995640 1 -- 172.21.15.100:0/3545861912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39800039b0 msgr2=0x7f3980003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:20.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.966+0000 7f399a995640 1 --2- 172.21.15.100:0/3545861912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39800039b0 0x7f3980003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:20.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.966+0000 7f399a995640 1 -- 172.21.15.100:0/3545861912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3980004800 msgr2=0x7f3980004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:20.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.966+0000 7f399a995640 1 --2- 172.21.15.100:0/3545861912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3980004800 0x7f3980004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.966+0000 7f399a995640 1 -- 172.21.15.100:0/3545861912 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3980003520 con 0x7f39800051c0 2024-09-11T22:20:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.966+0000 7f3999993640 1 --2- 172.21.15.100:0/3545861912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3980004800 0x7f3980004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.966+0000 7f399a995640 1 -- 172.21.15.100:0/3545861912 reap_dead start 2024-09-11T22:20:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.966+0000 7f399a995640 1 --2- 172.21.15.100:0/3545861912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39800051c0 0x7f398000b9c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f398c009fc0 tx=0x7f3980005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8d2d31d2f17082 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.966+0000 7f3999192640 1 -- 172.21.15.100:0/3545861912 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c035020 con 0x7f39800051c0 2024-09-11T22:20:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.966+0000 7f3999192640 1 -- 172.21.15.100:0/3545861912 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398c003bd0 con 0x7f39800051c0 2024-09-11T22:20:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.966+0000 7f3999192640 1 -- 172.21.15.100:0/3545861912 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c009c10 con 0x7f39800051c0 2024-09-11T22:20:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.967+0000 7f399c3f8640 1 -- 172.21.15.100:0/3545861912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39800051c0 msgr2=0x7f398000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.967+0000 7f399c3f8640 1 --2- 172.21.15.100:0/3545861912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39800051c0 0x7f398000b9c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f398c009fc0 tx=0x7f3980005830 comp rx=0 tx=0).stop 2024-09-11T22:20:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.967+0000 7f399c3f8640 1 -- 172.21.15.100:0/3545861912 shutdown_connections 2024-09-11T22:20:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.967+0000 7f399c3f8640 1 --2- 172.21.15.100:0/3545861912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39800051c0 0x7f398000b9c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.967+0000 7f399c3f8640 1 -- 172.21.15.100:0/3545861912 >> 172.21.15.100:0/3545861912 conn(0x7f399406de20 msgr2=0x7f399406e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:20.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.967+0000 7f399c3f8640 1 -- 172.21.15.100:0/3545861912 shutdown_connections 2024-09-11T22:20:20.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.967+0000 7f399c3f8640 1 -- 172.21.15.100:0/3545861912 wait complete. 2024-09-11T22:20:20.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.968+0000 7f399c3f8640 1 Processor -- start 2024-09-11T22:20:20.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.968+0000 7f399c3f8640 1 -- start start 2024-09-11T22:20:20.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.969+0000 7f399c3f8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39800051c0 0x7f39940b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:20.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.969+0000 7f399c3f8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3994159960 0x7f399415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:20.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.969+0000 7f399c3f8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f399415b460 0x7f399415a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:20.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.969+0000 7f399c3f8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f399406ffa0 con 0x7f39800051c0 2024-09-11T22:20:20.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.969+0000 7f399c3f8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f39940c9c90 con 0x7f3994159960 2024-09-11T22:20:20.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.969+0000 7f399c3f8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f399406db40 con 0x7f399415b460 2024-09-11T22:20:20.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.969+0000 7f399a194640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39800051c0 0x7f39940b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:20.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.969+0000 7f399a194640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39800051c0 0x7f39940b31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42026/0 (socket says 172.21.15.100:42026) 2024-09-11T22:20:20.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.969+0000 7f399a194640 1 -- 172.21.15.100:0/2548245550 learned_addr learned my addr 172.21.15.100:0/2548245550 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:20.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.969+0000 7f3999993640 1 --2- 172.21.15.100:0/2548245550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3994159960 0x7f399415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:20.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.969+0000 7f399a995640 1 --2- 172.21.15.100:0/2548245550 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f399415b460 0x7f399415a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:20.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.969+0000 7f399a194640 1 -- 172.21.15.100:0/2548245550 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f399415b460 msgr2=0x7f399415a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:20.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.969+0000 7f399a194640 1 --2- 172.21.15.100:0/2548245550 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f399415b460 0x7f399415a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:20.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.969+0000 7f399a194640 1 -- 172.21.15.100:0/2548245550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3994159960 msgr2=0x7f399415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:20.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.969+0000 7f399a194640 1 --2- 172.21.15.100:0/2548245550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3994159960 0x7f399415bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:20.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.969+0000 7f399a194640 1 -- 172.21.15.100:0/2548245550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39941f1310 con 0x7f39800051c0 2024-09-11T22:20:20.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.969+0000 7f399a194640 1 --2- 172.21.15.100:0/2548245550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39800051c0 0x7f39940b31f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f399000e480 tx=0x7f399000e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:20.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.970+0000 7f398affd640 1 -- 172.21.15.100:0/2548245550 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39900052e0 con 0x7f39800051c0 2024-09-11T22:20:20.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.970+0000 7f398affd640 1 -- 172.21.15.100:0/2548245550 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3990018070 con 0x7f39800051c0 2024-09-11T22:20:20.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.970+0000 7f398affd640 1 -- 172.21.15.100:0/2548245550 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3990003830 con 0x7f39800051c0 2024-09-11T22:20:20.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.970+0000 7f399c3f8640 1 -- 172.21.15.100:0/2548245550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3994158ba0 con 0x7f39800051c0 2024-09-11T22:20:20.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.970+0000 7f399c3f8640 1 -- 172.21.15.100:0/2548245550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3994159160 con 0x7f39800051c0 2024-09-11T22:20:20.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.971+0000 7f399c3f8640 1 -- 172.21.15.100:0/2548245550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f399415e100 con 0x7f39800051c0 2024-09-11T22:20:20.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.971+0000 7f398affd640 1 -- 172.21.15.100:0/2548245550 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39900039d0 con 0x7f39800051c0 2024-09-11T22:20:20.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.972+0000 7f398affd640 1 --2- 172.21.15.100:0/2548245550 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f397806be60 0x7f397806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:20.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.972+0000 7f3999993640 1 --2- 172.21.15.100:0/2548245550 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f397806be60 0x7f397806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:20.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.972+0000 7f398affd640 1 -- 172.21.15.100:0/2548245550 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6007+0+0 (secure 0 0 0) 0x7f399008aa30 con 0x7f39800051c0 2024-09-11T22:20:20.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.972+0000 7f3999993640 1 --2- 172.21.15.100:0/2548245550 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f397806be60 0x7f397806e320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f39940b06b0 tx=0x7f3984007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:20.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:20.977+0000 7f398affd640 1 -- 172.21.15.100:0/2548245550 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3990058cf0 con 0x7f39800051c0 2024-09-11T22:20:21.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:21.141+0000 7f399c3f8640 1 -- 172.21.15.100:0/2548245550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3994070da0 con 0x7f39800051c0 2024-09-11T22:20:22.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.855+0000 7f398affd640 1 -- 172.21.15.100:0/2548245550 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) ==== 228+0+0 (secure 0 0 0) 0x7f399005cff0 con 0x7f39800051c0 2024-09-11T22:20:22.856 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data_ec' created 2024-09-11T22:20:22.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.858+0000 7f399c3f8640 1 -- 172.21.15.100:0/2548245550 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f397806be60 msgr2=0x7f397806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:22.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.858+0000 7f399c3f8640 1 --2- 172.21.15.100:0/2548245550 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f397806be60 0x7f397806e320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f39940b06b0 tx=0x7f3984007040 comp rx=0 tx=0).stop 2024-09-11T22:20:22.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.858+0000 7f399c3f8640 1 -- 172.21.15.100:0/2548245550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39800051c0 msgr2=0x7f39940b31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:22.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.858+0000 7f399c3f8640 1 --2- 172.21.15.100:0/2548245550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39800051c0 0x7f39940b31f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f399000e480 tx=0x7f399000e940 comp rx=0 tx=0).stop 2024-09-11T22:20:22.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.858+0000 7f399c3f8640 1 -- 172.21.15.100:0/2548245550 shutdown_connections 2024-09-11T22:20:22.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.858+0000 7f399c3f8640 1 --2- 172.21.15.100:0/2548245550 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f397806be60 0x7f397806e320 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f39940b06b0 tx=0x7f3984007040 comp rx=0 tx=0).stop 2024-09-11T22:20:22.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.859+0000 7f399c3f8640 1 --2- 172.21.15.100:0/2548245550 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f399415b460 0x7f399415a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:22.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.859+0000 7f399c3f8640 1 --2- 172.21.15.100:0/2548245550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3994159960 0x7f399415bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:22.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.859+0000 7f399c3f8640 1 --2- 172.21.15.100:0/2548245550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39800051c0 0x7f39940b31f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:22.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.859+0000 7f399c3f8640 1 -- 172.21.15.100:0/2548245550 >> 172.21.15.100:0/2548245550 conn(0x7f399406de20 msgr2=0x7f39940c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:22.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.859+0000 7f399c3f8640 1 -- 172.21.15.100:0/2548245550 shutdown_connections 2024-09-11T22:20:22.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.859+0000 7f399c3f8640 1 -- 172.21.15.100:0/2548245550 wait complete. 2024-09-11T22:20:22.880 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-11T22:20:22.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.986+0000 7f8ba823c640 1 Processor -- start 2024-09-11T22:20:22.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.986+0000 7f8ba823c640 1 -- start start 2024-09-11T22:20:22.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.987+0000 7f8ba823c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ba0154aa0 0x7f8ba006c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:22.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.987+0000 7f8ba823c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8ba0154e80 0x7f8ba00cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:22.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.987+0000 7f8ba823c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8ba006c780 0x7f8ba00cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:22.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.987+0000 7f8ba823c640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f8ba006bdb0 con 0x7f8ba0154e80 2024-09-11T22:20:22.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.987+0000 7f8ba823c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f8ba00c4de0 con 0x7f8ba006c780 2024-09-11T22:20:22.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.987+0000 7f8ba823c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8ba00c85c0 con 0x7f8ba0154aa0 2024-09-11T22:20:22.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.987+0000 7f8ba57d7640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8ba0154e80 0x7f8ba00cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:22.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.987+0000 7f8ba57d7640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8ba0154e80 0x7f8ba00cd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35774/0 (socket says 172.21.15.100:35774) 2024-09-11T22:20:22.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.987+0000 7f8ba57d7640 1 -- 172.21.15.100:0/1865673958 learned_addr learned my addr 172.21.15.100:0/1865673958 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:22.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.988+0000 7f8ba57d7640 1 -- 172.21.15.100:0/1865673958 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ba0154aa0 msgr2=0x7f8ba006c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:22.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.988+0000 7f8ba5fd8640 1 --2- 172.21.15.100:0/1865673958 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ba0154aa0 0x7f8ba006c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:22.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.988+0000 7f8ba67d9640 1 --2- 172.21.15.100:0/1865673958 >> v2:172.21.15.167:3300/0 conn(0x7f8ba006c780 0x7f8ba00cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:22.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.988+0000 7f8ba57d7640 1 --2- 172.21.15.100:0/1865673958 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ba0154aa0 0x7f8ba006c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:22.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.988+0000 7f8ba57d7640 1 -- 172.21.15.100:0/1865673958 >> v2:172.21.15.167:3300/0 conn(0x7f8ba006c780 msgr2=0x7f8ba00cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:22.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.988+0000 7f8ba57d7640 1 --2- 172.21.15.100:0/1865673958 >> v2:172.21.15.167:3300/0 conn(0x7f8ba006c780 0x7f8ba00cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:22.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.988+0000 7f8ba57d7640 1 -- 172.21.15.100:0/1865673958 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba00c88a0 con 0x7f8ba0154e80 2024-09-11T22:20:22.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.988+0000 7f8ba5fd8640 1 --2- 172.21.15.100:0/1865673958 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ba0154aa0 0x7f8ba006c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:22.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.988+0000 7f8ba67d9640 1 --2- 172.21.15.100:0/1865673958 >> v2:172.21.15.167:3300/0 conn(0x7f8ba006c780 0x7f8ba00cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:22.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.988+0000 7f8ba57d7640 1 --2- 172.21.15.100:0/1865673958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba0154e80 0x7f8ba00cd130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8ba00c9b80 tx=0x7f8b9002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31dcbe2a5f52f9a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:22.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.988+0000 7f8ba4fd6640 1 -- 172.21.15.100:0/1865673958 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b90037070 con 0x7f8ba0154e80 2024-09-11T22:20:22.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.989+0000 7f8ba4fd6640 1 -- 172.21.15.100:0/1865673958 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b90032440 con 0x7f8ba0154e80 2024-09-11T22:20:22.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.989+0000 7f8ba4fd6640 1 -- 172.21.15.100:0/1865673958 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b90032810 con 0x7f8ba0154e80 2024-09-11T22:20:22.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.989+0000 7f8ba823c640 1 -- 172.21.15.100:0/1865673958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba0154e80 msgr2=0x7f8ba00cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:22.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.989+0000 7f8ba823c640 1 --2- 172.21.15.100:0/1865673958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba0154e80 0x7f8ba00cd130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8ba00c9b80 tx=0x7f8b9002a270 comp rx=0 tx=0).stop 2024-09-11T22:20:22.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.989+0000 7f8ba823c640 1 -- 172.21.15.100:0/1865673958 shutdown_connections 2024-09-11T22:20:22.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.989+0000 7f8ba823c640 1 --2- 172.21.15.100:0/1865673958 >> v2:172.21.15.167:3300/0 conn(0x7f8ba006c780 0x7f8ba00cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:22.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.989+0000 7f8ba823c640 1 --2- 172.21.15.100:0/1865673958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba0154e80 0x7f8ba00cd130 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:22.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.989+0000 7f8ba823c640 1 --2- 172.21.15.100:0/1865673958 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ba0154aa0 0x7f8ba006c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:22.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.989+0000 7f8ba823c640 1 -- 172.21.15.100:0/1865673958 >> 172.21.15.100:0/1865673958 conn(0x7f8ba0072880 msgr2=0x7f8ba0072c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:22.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.989+0000 7f8ba823c640 1 -- 172.21.15.100:0/1865673958 shutdown_connections 2024-09-11T22:20:22.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.989+0000 7f8ba823c640 1 -- 172.21.15.100:0/1865673958 wait complete. 2024-09-11T22:20:22.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.990+0000 7f8ba823c640 1 Processor -- start 2024-09-11T22:20:22.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.990+0000 7f8ba823c640 1 -- start start 2024-09-11T22:20:22.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.991+0000 7f8ba823c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ba006c780 0x7f8ba01edc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:22.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.991+0000 7f8ba823c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba0154aa0 0x7f8ba01577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:22.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.991+0000 7f8ba823c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba0154e80 0x7f8ba0157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:22.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.991+0000 7f8ba823c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba015a920 con 0x7f8ba0154aa0 2024-09-11T22:20:22.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.991+0000 7f8ba823c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba00c8e60 con 0x7f8ba0154e80 2024-09-11T22:20:22.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.991+0000 7f8ba823c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8ba00c9140 con 0x7f8ba006c780 2024-09-11T22:20:22.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.991+0000 7f8ba57d7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba0154aa0 0x7f8ba01577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:22.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.991+0000 7f8ba57d7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba0154aa0 0x7f8ba01577a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35788/0 (socket says 172.21.15.100:35788) 2024-09-11T22:20:22.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.991+0000 7f8ba57d7640 1 -- 172.21.15.100:0/3413252754 learned_addr learned my addr 172.21.15.100:0/3413252754 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:22.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.991+0000 7f8ba5fd8640 1 --2- 172.21.15.100:0/3413252754 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ba006c780 0x7f8ba01edc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:22.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.991+0000 7f8ba67d9640 1 --2- 172.21.15.100:0/3413252754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba0154e80 0x7f8ba0157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:22.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.991+0000 7f8ba57d7640 1 -- 172.21.15.100:0/3413252754 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ba006c780 msgr2=0x7f8ba01edc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:22.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.991+0000 7f8ba57d7640 1 --2- 172.21.15.100:0/3413252754 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ba006c780 0x7f8ba01edc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:22.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.991+0000 7f8ba57d7640 1 -- 172.21.15.100:0/3413252754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba0154e80 msgr2=0x7f8ba0157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:22.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.991+0000 7f8ba57d7640 1 --2- 172.21.15.100:0/3413252754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba0154e80 0x7f8ba0157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:22.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.991+0000 7f8ba57d7640 1 -- 172.21.15.100:0/3413252754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba0158220 con 0x7f8ba0154aa0 2024-09-11T22:20:22.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.992+0000 7f8ba57d7640 1 --2- 172.21.15.100:0/3413252754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba0154aa0 0x7f8ba01577a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8b90000c00 tx=0x7f8b900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:22.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.992+0000 7f8b967fc640 1 -- 172.21.15.100:0/3413252754 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b90037040 con 0x7f8ba0154aa0 2024-09-11T22:20:22.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.992+0000 7f8b967fc640 1 -- 172.21.15.100:0/3413252754 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b90042070 con 0x7f8ba0154aa0 2024-09-11T22:20:22.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.992+0000 7f8ba823c640 1 -- 172.21.15.100:0/3413252754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba01592c0 con 0x7f8ba0154aa0 2024-09-11T22:20:22.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.992+0000 7f8b967fc640 1 -- 172.21.15.100:0/3413252754 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b90030bb0 con 0x7f8ba0154aa0 2024-09-11T22:20:22.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.992+0000 7f8ba823c640 1 -- 172.21.15.100:0/3413252754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba01e6a40 con 0x7f8ba0154aa0 2024-09-11T22:20:22.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.993+0000 7f8ba823c640 1 -- 172.21.15.100:0/3413252754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba0068510 con 0x7f8ba0154aa0 2024-09-11T22:20:22.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.993+0000 7f8b967fc640 1 -- 172.21.15.100:0/3413252754 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b90047460 con 0x7f8ba0154aa0 2024-09-11T22:20:22.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.994+0000 7f8b967fc640 1 --2- 172.21.15.100:0/3413252754 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8b8406be60 0x7f8b8406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:22.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.994+0000 7f8b967fc640 1 -- 172.21.15.100:0/3413252754 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f8b900abd00 con 0x7f8ba0154aa0 2024-09-11T22:20:22.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.994+0000 7f8ba5fd8640 1 --2- 172.21.15.100:0/3413252754 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8b8406be60 0x7f8b8406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:22.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.994+0000 7f8ba5fd8640 1 --2- 172.21.15.100:0/3413252754 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8b8406be60 0x7f8b8406e320 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00ab60 tx=0x7f8b9c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:22.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:22.998+0000 7f8b967fc640 1 -- 172.21.15.100:0/3413252754 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b90079c30 con 0x7f8ba0154aa0 2024-09-11T22:20:23.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.162+0000 7f8ba823c640 1 -- 172.21.15.100:0/3413252754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f8ba01f1c40 con 0x7f8ba0154aa0 2024-09-11T22:20:23.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.856+0000 7f8b967fc640 1 -- 172.21.15.100:0/3413252754 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) ==== 169+0+0 (secure 0 0 0) 0x7f8b9007df30 con 0x7f8ba0154aa0 2024-09-11T22:20:23.857 INFO:teuthology.orchestra.run.smithi100.stderr:set pool 4 allow_ec_overwrites to true 2024-09-11T22:20:23.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.859+0000 7f8ba823c640 1 -- 172.21.15.100:0/3413252754 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8b8406be60 msgr2=0x7f8b8406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.859+0000 7f8ba823c640 1 --2- 172.21.15.100:0/3413252754 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8b8406be60 0x7f8b8406e320 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c00ab60 tx=0x7f8b9c008040 comp rx=0 tx=0).stop 2024-09-11T22:20:23.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.860+0000 7f8ba823c640 1 -- 172.21.15.100:0/3413252754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba0154aa0 msgr2=0x7f8ba01577a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:23.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.860+0000 7f8ba823c640 1 --2- 172.21.15.100:0/3413252754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba0154aa0 0x7f8ba01577a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8b90000c00 tx=0x7f8b900046c0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.861+0000 7f8ba823c640 1 -- 172.21.15.100:0/3413252754 shutdown_connections 2024-09-11T22:20:23.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.861+0000 7f8ba823c640 1 --2- 172.21.15.100:0/3413252754 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8b8406be60 0x7f8b8406e320 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.861+0000 7f8ba823c640 1 --2- 172.21.15.100:0/3413252754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba0154e80 0x7f8ba0157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.861+0000 7f8ba823c640 1 --2- 172.21.15.100:0/3413252754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba0154aa0 0x7f8ba01577a0 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8b90000c00 tx=0x7f8b900046c0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.861+0000 7f8ba823c640 1 --2- 172.21.15.100:0/3413252754 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ba006c780 0x7f8ba01edc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.861+0000 7f8ba823c640 1 -- 172.21.15.100:0/3413252754 >> 172.21.15.100:0/3413252754 conn(0x7f8ba0072880 msgr2=0x7f8ba006cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:23.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.862+0000 7f8ba823c640 1 -- 172.21.15.100:0/3413252754 shutdown_connections 2024-09-11T22:20:23.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.862+0000 7f8ba823c640 1 -- 172.21.15.100:0/3413252754 wait complete. 2024-09-11T22:20:23.891 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-11T22:20:23.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.991+0000 7f348cadd640 1 Processor -- start 2024-09-11T22:20:23.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.991+0000 7f348cadd640 1 -- start start 2024-09-11T22:20:23.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.992+0000 7f348cadd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3488154d70 0x7f34880714c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.992+0000 7f348cadd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3488071a00 0x7f348815ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:23.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.992+0000 7f348cadd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34880ca5c0 con 0x7f34880c3230 2024-09-11T22:20:23.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.992+0000 7f348cadd640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f34880c43b0 con 0x7f3488154d70 2024-09-11T22:20:23.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.992+0000 7f348cadd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f34880ae930 con 0x7f3488071a00 2024-09-11T22:20:23.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.993+0000 7f348659c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3488154d70 0x7f34880714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.993+0000 7f348659c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3488154d70 0x7f34880714c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35794/0 (socket says 172.21.15.100:35794) 2024-09-11T22:20:23.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.993+0000 7f348659c640 1 -- 172.21.15.100:0/627605417 learned_addr learned my addr 172.21.15.100:0/627605417 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:23.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.993+0000 7f3486d9d640 1 --2- 172.21.15.100:0/627605417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3488071a00 0x7f348815ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:23.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.993+0000 7f348659c640 1 -- 172.21.15.100:0/627605417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3488071a00 msgr2=0x7f348815ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:23.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.993+0000 7f348659c640 1 --2- 172.21.15.100:0/627605417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3488071a00 0x7f348815ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:23.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.993+0000 7f348659c640 1 -- 172.21.15.100:0/627605417 >> v1:172.21.15.167:6789/0 conn(0x7f34880c3230 legacy=0x7f34880c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:23.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.993+0000 7f348659c640 1 -- 172.21.15.100:0/627605417 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34880c3830 con 0x7f3488154d70 2024-09-11T22:20:23.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.994+0000 7f348659c640 1 --2- 172.21.15.100:0/627605417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3488154d70 0x7f34880714c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3478009870 tx=0x7f347802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3fdddae8fd5b978 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:23.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.994+0000 7f348559a640 1 -- 172.21.15.100:0/627605417 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3478037070 con 0x7f3488154d70 2024-09-11T22:20:23.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.994+0000 7f348559a640 1 -- 172.21.15.100:0/627605417 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3478032440 con 0x7f3488154d70 2024-09-11T22:20:23.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.994+0000 7f348559a640 1 -- 172.21.15.100:0/627605417 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3478032810 con 0x7f3488154d70 2024-09-11T22:20:24.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.994+0000 7f348cadd640 1 -- 172.21.15.100:0/627605417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3488154d70 msgr2=0x7f34880714c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.994+0000 7f348cadd640 1 --2- 172.21.15.100:0/627605417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3488154d70 0x7f34880714c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3478009870 tx=0x7f347802a2a0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.994+0000 7f348cadd640 1 -- 172.21.15.100:0/627605417 shutdown_connections 2024-09-11T22:20:24.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.994+0000 7f348cadd640 1 --2- 172.21.15.100:0/627605417 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3488071a00 0x7f348815ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.994+0000 7f348cadd640 1 --2- 172.21.15.100:0/627605417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3488154d70 0x7f34880714c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.994+0000 7f348cadd640 1 -- 172.21.15.100:0/627605417 >> 172.21.15.100:0/627605417 conn(0x7f348806f4c0 msgr2=0x7f348806f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:24.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.994+0000 7f348cadd640 1 -- 172.21.15.100:0/627605417 shutdown_connections 2024-09-11T22:20:24.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.994+0000 7f348cadd640 1 -- 172.21.15.100:0/627605417 wait complete. 2024-09-11T22:20:24.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.996+0000 7f348cadd640 1 Processor -- start 2024-09-11T22:20:24.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.996+0000 7f348cadd640 1 -- start start 2024-09-11T22:20:24.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.996+0000 7f348cadd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3488071a00 0x7f34881f1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.996+0000 7f348cadd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34880c3230 0x7f3488151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.996+0000 7f348cadd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3488154d70 0x7f3488151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.996+0000 7f348cadd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f34880c40d0 con 0x7f3488071a00 2024-09-11T22:20:24.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.996+0000 7f348cadd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f34880c3df0 con 0x7f3488154d70 2024-09-11T22:20:24.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.996+0000 7f348cadd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f34880c9f70 con 0x7f34880c3230 2024-09-11T22:20:24.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.996+0000 7f348659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3488071a00 0x7f34881f1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.996+0000 7f348659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3488071a00 0x7f34881f1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35798/0 (socket says 172.21.15.100:35798) 2024-09-11T22:20:24.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.996+0000 7f348659c640 1 -- 172.21.15.100:0/3017423541 learned_addr learned my addr 172.21.15.100:0/3017423541 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:24.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.997+0000 7f3485d9b640 1 --2- 172.21.15.100:0/3017423541 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34880c3230 0x7f3488151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.997+0000 7f3486d9d640 1 --2- 172.21.15.100:0/3017423541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3488154d70 0x7f3488151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.997+0000 7f348659c640 1 -- 172.21.15.100:0/3017423541 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34880c3230 msgr2=0x7f3488151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.997+0000 7f348659c640 1 --2- 172.21.15.100:0/3017423541 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34880c3230 0x7f3488151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.997+0000 7f348659c640 1 -- 172.21.15.100:0/3017423541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3488154d70 msgr2=0x7f3488151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.997+0000 7f348659c640 1 --2- 172.21.15.100:0/3017423541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3488154d70 0x7f3488151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.997+0000 7f348659c640 1 -- 172.21.15.100:0/3017423541 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348806cde0 con 0x7f3488071a00 2024-09-11T22:20:24.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.997+0000 7f3486d9d640 1 --2- 172.21.15.100:0/3017423541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3488154d70 0x7f3488151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:24.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.997+0000 7f348659c640 1 --2- 172.21.15.100:0/3017423541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3488071a00 0x7f34881f1540 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3478009870 tx=0x7f34780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:24.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.997+0000 7f3476ffd640 1 -- 172.21.15.100:0/3017423541 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3478041070 con 0x7f3488071a00 2024-09-11T22:20:24.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.997+0000 7f3476ffd640 1 -- 172.21.15.100:0/3017423541 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f347803c870 con 0x7f3488071a00 2024-09-11T22:20:24.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.997+0000 7f348cadd640 1 -- 172.21.15.100:0/3017423541 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f348806d0c0 con 0x7f3488071a00 2024-09-11T22:20:24.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.997+0000 7f3476ffd640 1 -- 172.21.15.100:0/3017423541 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3478037040 con 0x7f3488071a00 2024-09-11T22:20:24.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.997+0000 7f348cadd640 1 -- 172.21.15.100:0/3017423541 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f348806d680 con 0x7f3488071a00 2024-09-11T22:20:24.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.998+0000 7f348cadd640 1 -- 172.21.15.100:0/3017423541 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f348815bab0 con 0x7f3488071a00 2024-09-11T22:20:24.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.999+0000 7f3476ffd640 1 -- 172.21.15.100:0/3017423541 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3478044070 con 0x7f3488071a00 2024-09-11T22:20:24.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.999+0000 7f3476ffd640 1 --2- 172.21.15.100:0/3017423541 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f346806be30 0x7f346806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:24.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.999+0000 7f3476ffd640 1 -- 172.21.15.100:0/3017423541 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7f34780abf10 con 0x7f3488071a00 2024-09-11T22:20:24.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:23.999+0000 7f3485d9b640 1 --2- 172.21.15.100:0/3017423541 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f346806be30 0x7f346806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:24.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:24.000+0000 7f3485d9b640 1 --2- 172.21.15.100:0/3017423541 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f346806be30 0x7f346806e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f348815a880 tx=0x7f347c007e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:24.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:24.004+0000 7f3476ffd640 1 -- 172.21.15.100:0/3017423541 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f348815bab0 con 0x7f3488071a00 2024-09-11T22:20:24.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:24.211+0000 7f348cadd640 1 -- 172.21.15.100:0/3017423541 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f348814edf0 con 0x7f3488071a00 2024-09-11T22:20:24.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:24.890+0000 7f3476ffd640 1 -- 172.21.15.100:0/3017423541 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7f348814edf0 con 0x7f3488071a00 2024-09-11T22:20:24.890 INFO:teuthology.orchestra.run.smithi100.stderr:added data pool 4 to fsmap 2024-09-11T22:20:24.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:24.892+0000 7f348cadd640 1 -- 172.21.15.100:0/3017423541 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f346806be30 msgr2=0x7f346806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:24.892+0000 7f348cadd640 1 --2- 172.21.15.100:0/3017423541 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f346806be30 0x7f346806e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f348815a880 tx=0x7f347c007e30 comp rx=0 tx=0).stop 2024-09-11T22:20:24.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:24.892+0000 7f348cadd640 1 -- 172.21.15.100:0/3017423541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3488071a00 msgr2=0x7f34881f1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:24.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:24.892+0000 7f348cadd640 1 --2- 172.21.15.100:0/3017423541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3488071a00 0x7f34881f1540 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3478009870 tx=0x7f34780046c0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:24.892+0000 7f348cadd640 1 -- 172.21.15.100:0/3017423541 shutdown_connections 2024-09-11T22:20:24.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:24.892+0000 7f348cadd640 1 --2- 172.21.15.100:0/3017423541 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f346806be30 0x7f346806e2f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:24.892+0000 7f348cadd640 1 --2- 172.21.15.100:0/3017423541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3488154d70 0x7f3488151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:24.892+0000 7f348cadd640 1 --2- 172.21.15.100:0/3017423541 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34880c3230 0x7f3488151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:24.892+0000 7f348cadd640 1 --2- 172.21.15.100:0/3017423541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3488071a00 0x7f34881f1540 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:24.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:24.892+0000 7f348cadd640 1 -- 172.21.15.100:0/3017423541 >> 172.21.15.100:0/3017423541 conn(0x7f348806f4c0 msgr2=0x7f34881504e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:24.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:24.892+0000 7f348cadd640 1 -- 172.21.15.100:0/3017423541 shutdown_connections 2024-09-11T22:20:24.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:24.892+0000 7f348cadd640 1 -- 172.21.15.100:0/3017423541 wait complete. 2024-09-11T22:20:24.905 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:25.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.006+0000 7fdd8dc1e640 1 Processor -- start 2024-09-11T22:20:25.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.006+0000 7fdd8dc1e640 1 -- start start 2024-09-11T22:20:25.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.007+0000 7fdd8dc1e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd880b1e80 0x7fdd88071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.007+0000 7fdd8dc1e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdd880c0f90 0x7fdd8806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.007+0000 7fdd8dc1e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd880c80f0 con 0x7fdd88151090 2024-09-11T22:20:25.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.007+0000 7fdd8dc1e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fdd880b16c0 con 0x7fdd880c0f90 2024-09-11T22:20:25.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.007+0000 7fdd8dc1e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fdd88073070 con 0x7fdd880b1e80 2024-09-11T22:20:25.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.007+0000 7fdd87fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdd880c0f90 0x7fdd8806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.007+0000 7fdd87fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdd880c0f90 0x7fdd8806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35808/0 (socket says 172.21.15.100:35808) 2024-09-11T22:20:25.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.007+0000 7fdd87fff640 1 -- 172.21.15.100:0/2365991540 learned_addr learned my addr 172.21.15.100:0/2365991540 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:25.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.007+0000 7fdd86ffd640 1 --2- 172.21.15.100:0/2365991540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd880b1e80 0x7fdd88071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.007+0000 7fdd87fff640 1 -- 172.21.15.100:0/2365991540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd880b1e80 msgr2=0x7fdd88071780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.007+0000 7fdd87fff640 1 --2- 172.21.15.100:0/2365991540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd880b1e80 0x7fdd88071780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.007+0000 7fdd87fff640 1 -- 172.21.15.100:0/2365991540 >> v1:172.21.15.167:6789/0 conn(0x7fdd88151090 legacy=0x7fdd88156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.007+0000 7fdd87fff640 1 -- 172.21.15.100:0/2365991540 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd88073350 con 0x7fdd880c0f90 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.008+0000 7fdd87fff640 1 --2- 172.21.15.100:0/2365991540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd880c0f90 0x7fdd8806bc10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009e50 tx=0x7fdd8002a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77319700d49cebcc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.008+0000 7fdd867fc640 1 -- 172.21.15.100:0/2365991540 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd80036070 con 0x7fdd880c0f90 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.008+0000 7fdd867fc640 1 -- 172.21.15.100:0/2365991540 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd80031600 con 0x7fdd880c0f90 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.008+0000 7fdd867fc640 1 -- 172.21.15.100:0/2365991540 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd800319d0 con 0x7fdd880c0f90 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.008+0000 7fdd8dc1e640 1 -- 172.21.15.100:0/2365991540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd880c0f90 msgr2=0x7fdd8806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.008+0000 7fdd8dc1e640 1 --2- 172.21.15.100:0/2365991540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd880c0f90 0x7fdd8806bc10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009e50 tx=0x7fdd8002a750 comp rx=0 tx=0).stop 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.008+0000 7fdd8dc1e640 1 -- 172.21.15.100:0/2365991540 shutdown_connections 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.008+0000 7fdd8dc1e640 1 --2- 172.21.15.100:0/2365991540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd880c0f90 0x7fdd8806bc10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.008+0000 7fdd8dc1e640 1 --2- 172.21.15.100:0/2365991540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd880b1e80 0x7fdd88071780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.008+0000 7fdd8dc1e640 1 -- 172.21.15.100:0/2365991540 >> 172.21.15.100:0/2365991540 conn(0x7fdd880cbf70 msgr2=0x7fdd880cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:25.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.008+0000 7fdd8dc1e640 1 -- 172.21.15.100:0/2365991540 shutdown_connections 2024-09-11T22:20:25.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.008+0000 7fdd8dc1e640 1 -- 172.21.15.100:0/2365991540 wait complete. 2024-09-11T22:20:25.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.009+0000 7fdd8dc1e640 1 Processor -- start 2024-09-11T22:20:25.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.010+0000 7fdd8dc1e640 1 -- start start 2024-09-11T22:20:25.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.010+0000 7fdd8dc1e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd880b1e80 0x7fdd881f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.010+0000 7fdd8dc1e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd880c0f90 0x7fdd88150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.010+0000 7fdd8dc1e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd88151090 0x7fdd88143090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.010+0000 7fdd8dc1e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdd880b1960 con 0x7fdd880b1e80 2024-09-11T22:20:25.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.010+0000 7fdd8dc1e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdd88073910 con 0x7fdd880c0f90 2024-09-11T22:20:25.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.010+0000 7fdd8dc1e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fdd88151470 con 0x7fdd88151090 2024-09-11T22:20:25.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.010+0000 7fdd877fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd880b1e80 0x7fdd881f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.010+0000 7fdd877fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd880b1e80 0x7fdd881f2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35822/0 (socket says 172.21.15.100:35822) 2024-09-11T22:20:25.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.010+0000 7fdd877fe640 1 -- 172.21.15.100:0/818646978 learned_addr learned my addr 172.21.15.100:0/818646978 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:25.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.010+0000 7fdd87fff640 1 --2- 172.21.15.100:0/818646978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd88151090 0x7fdd88143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.011+0000 7fdd86ffd640 1 --2- 172.21.15.100:0/818646978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd880c0f90 0x7fdd88150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.011+0000 7fdd877fe640 1 -- 172.21.15.100:0/818646978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd88151090 msgr2=0x7fdd88143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.011+0000 7fdd877fe640 1 --2- 172.21.15.100:0/818646978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd88151090 0x7fdd88143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.011+0000 7fdd877fe640 1 -- 172.21.15.100:0/818646978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd880c0f90 msgr2=0x7fdd88150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.011+0000 7fdd877fe640 1 --2- 172.21.15.100:0/818646978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd880c0f90 0x7fdd88150080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.011+0000 7fdd877fe640 1 -- 172.21.15.100:0/818646978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd88156180 con 0x7fdd880b1e80 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.011+0000 7fdd86ffd640 1 --2- 172.21.15.100:0/818646978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd880c0f90 0x7fdd88150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.011+0000 7fdd877fe640 1 --2- 172.21.15.100:0/818646978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd880b1e80 0x7fdd881f2370 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c00b420 tx=0x7fdd7c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.011+0000 7fdd6ffff640 1 -- 172.21.15.100:0/818646978 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c011830 con 0x7fdd880b1e80 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.011+0000 7fdd6ffff640 1 -- 172.21.15.100:0/818646978 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd7c016070 con 0x7fdd880b1e80 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.011+0000 7fdd6ffff640 1 -- 172.21.15.100:0/818646978 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c011c10 con 0x7fdd880b1e80 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.011+0000 7fdd8dc1e640 1 -- 172.21.15.100:0/818646978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd881f28b0 con 0x7fdd880b1e80 2024-09-11T22:20:25.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.011+0000 7fdd8dc1e640 1 -- 172.21.15.100:0/818646978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd881566e0 con 0x7fdd880b1e80 2024-09-11T22:20:25.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.012+0000 7fdd8dc1e640 1 -- 172.21.15.100:0/818646978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd880722d0 con 0x7fdd880b1e80 2024-09-11T22:20:25.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.012+0000 7fdd6ffff640 1 -- 172.21.15.100:0/818646978 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd7c01b460 con 0x7fdd880b1e80 2024-09-11T22:20:25.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.013+0000 7fdd6ffff640 1 --2- 172.21.15.100:0/818646978 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fdd7406be30 0x7fdd7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.013+0000 7fdd6ffff640 1 -- 172.21.15.100:0/818646978 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fdd7c08abb0 con 0x7fdd880b1e80 2024-09-11T22:20:25.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.013+0000 7fdd86ffd640 1 --2- 172.21.15.100:0/818646978 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fdd7406be30 0x7fdd7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.013+0000 7fdd86ffd640 1 --2- 172.21.15.100:0/818646978 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fdd7406be30 0x7fdd7406e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdd88074170 tx=0x7fdd78008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.017+0000 7fdd6ffff640 1 -- 172.21.15.100:0/818646978 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd880722d0 con 0x7fdd880b1e80 2024-09-11T22:20:25.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.218+0000 7fdd8dc1e640 1 -- 172.21.15.100:0/818646978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd880c7480 con 0x7fdd880b1e80 2024-09-11T22:20:25.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.218+0000 7fdd6ffff640 1 -- 172.21.15.100:0/818646978 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6882 (secure 0 0 0) 0x7fdd7c020020 con 0x7fdd880b1e80 2024-09-11T22:20:25.219 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:25.219 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":6,"btime":"2024-09-11T22:20:24:893311+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2075802330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":2075802330},{"type":"v1","addr":"172.21.15.100:6837","nonce":2075802330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/1727733473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1727733473},{"type":"v1","addr":"172.21.15.167:6836","nonce":1727733473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/880809662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":880809662},{"type":"v1","addr":"172.21.15.167:6837","nonce":880809662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1912241808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1912241808},{"type":"v1","addr":"172.21.15.100:6836","nonce":1912241808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3236256661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3236256661},{"type":"v1","addr":"172.21.15.100:6839","nonce":3236256661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:19.171222+0000","modified":"2024-09-11T22:20:24.883934+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6834/1651678197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1651678197},{"type":"v1","addr":"172.21.15.167:6834","nonce":1651678197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-09-11T22:20:25.220 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 6 2024-09-11T22:20:25.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.220+0000 7fdd8dc1e640 1 -- 172.21.15.100:0/818646978 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fdd7406be30 msgr2=0x7fdd7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.220+0000 7fdd8dc1e640 1 --2- 172.21.15.100:0/818646978 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fdd7406be30 0x7fdd7406e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdd88074170 tx=0x7fdd78008040 comp rx=0 tx=0).stop 2024-09-11T22:20:25.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.220+0000 7fdd8dc1e640 1 -- 172.21.15.100:0/818646978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd880b1e80 msgr2=0x7fdd881f2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.220+0000 7fdd8dc1e640 1 --2- 172.21.15.100:0/818646978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd880b1e80 0x7fdd881f2370 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c00b420 tx=0x7fdd7c00b8e0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.220+0000 7fdd8dc1e640 1 -- 172.21.15.100:0/818646978 shutdown_connections 2024-09-11T22:20:25.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.220+0000 7fdd8dc1e640 1 --2- 172.21.15.100:0/818646978 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fdd7406be30 0x7fdd7406e2f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.220+0000 7fdd8dc1e640 1 --2- 172.21.15.100:0/818646978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd88151090 0x7fdd88143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.220+0000 7fdd8dc1e640 1 --2- 172.21.15.100:0/818646978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd880c0f90 0x7fdd88150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.220+0000 7fdd8dc1e640 1 --2- 172.21.15.100:0/818646978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd880b1e80 0x7fdd881f2370 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.220+0000 7fdd8dc1e640 1 -- 172.21.15.100:0/818646978 >> 172.21.15.100:0/818646978 conn(0x7fdd880cbf70 msgr2=0x7fdd880c9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:25.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.221+0000 7fdd8dc1e640 1 -- 172.21.15.100:0/818646978 shutdown_connections 2024-09-11T22:20:25.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.221+0000 7fdd8dc1e640 1 -- 172.21.15.100:0/818646978 wait complete. 2024-09-11T22:20:25.232 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:20:25.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.329+0000 7fb408d6d640 1 Processor -- start 2024-09-11T22:20:25.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.329+0000 7fb408d6d640 1 -- start start 2024-09-11T22:20:25.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.330+0000 7fb408d6d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4040cc770 0x7fb4040cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.330+0000 7fb408d6d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb4040cb920 0x7fb40415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.330+0000 7fb408d6d640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4040c5d80 con 0x7fb404154d20 2024-09-11T22:20:25.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.330+0000 7fb408d6d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fb40415ebe0 con 0x7fb4040cb920 2024-09-11T22:20:25.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.330+0000 7fb408d6d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb404155100 con 0x7fb4040cc770 2024-09-11T22:20:25.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.330+0000 7fb40259c640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb404154d20 0x7fb404072230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38694/0 (socket says 172.21.15.100:38694) 2024-09-11T22:20:25.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.330+0000 7fb40259c640 1 -- 172.21.15.100:0/3105744745 learned_addr learned my addr 172.21.15.100:0/3105744745 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:25.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.330+0000 7fb401d9b640 1 -- 172.21.15.100:0/3105744745 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3269140215 0 0) 0x7fb4040c5d80 con 0x7fb404154d20 2024-09-11T22:20:25.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.330+0000 7fb401d9b640 1 -- 172.21.15.100:0/3105744745 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3f0003520 con 0x7fb404154d20 2024-09-11T22:20:25.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.330+0000 7fb402d9d640 1 --2- 172.21.15.100:0/3105744745 >> v2:172.21.15.167:3300/0 conn(0x7fb4040cb920 0x7fb40415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.330+0000 7fb3fbfff640 1 --2- 172.21.15.100:0/3105744745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4040cc770 0x7fb4040cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.331+0000 7fb401d9b640 1 -- 172.21.15.100:0/3105744745 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1521591 0 0) 0x7fb3f0003520 con 0x7fb404154d20 2024-09-11T22:20:25.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.331+0000 7fb401d9b640 1 -- 172.21.15.100:0/3105744745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4040cc770 msgr2=0x7fb4040cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:25.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.331+0000 7fb401d9b640 1 --2- 172.21.15.100:0/3105744745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4040cc770 0x7fb4040cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.331+0000 7fb401d9b640 1 -- 172.21.15.100:0/3105744745 >> v2:172.21.15.167:3300/0 conn(0x7fb4040cb920 msgr2=0x7fb40415aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:25.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.331+0000 7fb401d9b640 1 --2- 172.21.15.100:0/3105744745 >> v2:172.21.15.167:3300/0 conn(0x7fb4040cb920 0x7fb40415aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.331+0000 7fb401d9b640 1 -- 172.21.15.100:0/3105744745 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40415dfd0 con 0x7fb404154d20 2024-09-11T22:20:25.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.331+0000 7fb401d9b640 1 -- 172.21.15.100:0/3105744745 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fb3f4001670 con 0x7fb404154d20 2024-09-11T22:20:25.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.331+0000 7fb401d9b640 1 -- 172.21.15.100:0/3105744745 >> v1:172.21.15.100:6789/0 conn(0x7fb404154d20 legacy=0x7fb404072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.331+0000 7fb401d9b640 1 --2- 172.21.15.100:0/3105744745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3f00039b0 0x7fb3f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.331+0000 7fb401d9b640 1 --2- 172.21.15.100:0/3105744745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4040cc770 0x7fb3f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.331+0000 7fb401d9b640 1 --2- 172.21.15.100:0/3105744745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3f0004d40 0x7fb3f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.331+0000 7fb401d9b640 1 -- 172.21.15.100:0/3105744745 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb40415ebe0 con 0x7fb3f0004d40 2024-09-11T22:20:25.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.331+0000 7fb401d9b640 1 -- 172.21.15.100:0/3105744745 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb404155100 con 0x7fb3f00039b0 2024-09-11T22:20:25.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.331+0000 7fb401d9b640 1 -- 172.21.15.100:0/3105744745 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb3f000b9c0 con 0x7fb4040cc770 2024-09-11T22:20:25.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.331+0000 7fb402d9d640 1 --2- 172.21.15.100:0/3105744745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3f0004d40 0x7fb3f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.331+0000 7fb40259c640 1 --2- 172.21.15.100:0/3105744745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3f00039b0 0x7fb3f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.331+0000 7fb3fbfff640 1 --2- 172.21.15.100:0/3105744745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4040cc770 0x7fb3f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.331+0000 7fb402d9d640 1 -- 172.21.15.100:0/3105744745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4040cc770 msgr2=0x7fb3f0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:25.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.331+0000 7fb402d9d640 1 --2- 172.21.15.100:0/3105744745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4040cc770 0x7fb3f0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.331+0000 7fb402d9d640 1 -- 172.21.15.100:0/3105744745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3f00039b0 msgr2=0x7fb3f0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:25.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.331+0000 7fb402d9d640 1 --2- 172.21.15.100:0/3105744745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3f00039b0 0x7fb3f0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.331+0000 7fb402d9d640 1 -- 172.21.15.100:0/3105744745 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f0003520 con 0x7fb3f0004d40 2024-09-11T22:20:25.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.332+0000 7fb402d9d640 1 --2- 172.21.15.100:0/3105744745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3f0004d40 0x7fb3f00051c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009fc0 tx=0x7fb3f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8d1d1dcab28eba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.332+0000 7fb401d9b640 1 -- 172.21.15.100:0/3105744745 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc009c10 con 0x7fb3f0004d40 2024-09-11T22:20:25.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.332+0000 7fb401d9b640 1 -- 172.21.15.100:0/3105744745 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3fc036070 con 0x7fb3f0004d40 2024-09-11T22:20:25.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.332+0000 7fb401d9b640 1 -- 172.21.15.100:0/3105744745 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc02d070 con 0x7fb3f0004d40 2024-09-11T22:20:25.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.332+0000 7fb408d6d640 1 -- 172.21.15.100:0/3105744745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3f0004d40 msgr2=0x7fb3f00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.332+0000 7fb408d6d640 1 --2- 172.21.15.100:0/3105744745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3f0004d40 0x7fb3f00051c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009fc0 tx=0x7fb3f0005830 comp rx=0 tx=0).stop 2024-09-11T22:20:25.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.332+0000 7fb402d9d640 1 -- 172.21.15.100:0/3105744745 reap_dead start 2024-09-11T22:20:25.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.332+0000 7fb408d6d640 1 -- 172.21.15.100:0/3105744745 shutdown_connections 2024-09-11T22:20:25.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.332+0000 7fb408d6d640 1 -- 172.21.15.100:0/3105744745 >> 172.21.15.100:0/3105744745 conn(0x7fb4040d0380 msgr2=0x7fb4040d0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:25.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.332+0000 7fb408d6d640 1 -- 172.21.15.100:0/3105744745 shutdown_connections 2024-09-11T22:20:25.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.332+0000 7fb408d6d640 1 -- 172.21.15.100:0/3105744745 wait complete. 2024-09-11T22:20:25.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.334+0000 7fb408d6d640 1 Processor -- start 2024-09-11T22:20:25.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.334+0000 7fb408d6d640 1 -- start start 2024-09-11T22:20:25.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.334+0000 7fb408d6d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3f0004d40 0x7fb404146ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.334+0000 7fb408d6d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb404144d00 0x7fb4040cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.334+0000 7fb408d6d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb404145b50 0x7fb4040cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.335+0000 7fb408d6d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb40415e870 con 0x7fb3f0004d40 2024-09-11T22:20:25.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.335+0000 7fb408d6d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb40415e590 con 0x7fb404144d00 2024-09-11T22:20:25.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.335+0000 7fb408d6d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb404072940 con 0x7fb404145b50 2024-09-11T22:20:25.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.335+0000 7fb40259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3f0004d40 0x7fb404146ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.335+0000 7fb40259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3f0004d40 0x7fb404146ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35840/0 (socket says 172.21.15.100:35840) 2024-09-11T22:20:25.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.335+0000 7fb40259c640 1 -- 172.21.15.100:0/1512705817 learned_addr learned my addr 172.21.15.100:0/1512705817 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:25.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.335+0000 7fb402d9d640 1 --2- 172.21.15.100:0/1512705817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb404145b50 0x7fb4040cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.335+0000 7fb3fbfff640 1 --2- 172.21.15.100:0/1512705817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb404144d00 0x7fb4040cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.335+0000 7fb40259c640 1 -- 172.21.15.100:0/1512705817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb404145b50 msgr2=0x7fb4040cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.335+0000 7fb40259c640 1 --2- 172.21.15.100:0/1512705817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb404145b50 0x7fb4040cfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.335+0000 7fb40259c640 1 -- 172.21.15.100:0/1512705817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb404144d00 msgr2=0x7fb4040cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.335+0000 7fb40259c640 1 --2- 172.21.15.100:0/1512705817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb404144d00 0x7fb4040cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.335+0000 7fb40259c640 1 -- 172.21.15.100:0/1512705817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4040ceed0 con 0x7fb3f0004d40 2024-09-11T22:20:25.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.335+0000 7fb40259c640 1 --2- 172.21.15.100:0/1512705817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3f0004d40 0x7fb404146ad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40073a0 tx=0x7fb3f4007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.335+0000 7fb3faffd640 1 -- 172.21.15.100:0/1512705817 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f401a070 con 0x7fb3f0004d40 2024-09-11T22:20:25.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.335+0000 7fb3faffd640 1 -- 172.21.15.100:0/1512705817 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f400f930 con 0x7fb3f0004d40 2024-09-11T22:20:25.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.335+0000 7fb408d6d640 1 -- 172.21.15.100:0/1512705817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4040d0120 con 0x7fb3f0004d40 2024-09-11T22:20:25.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.335+0000 7fb3faffd640 1 -- 172.21.15.100:0/1512705817 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f400fce0 con 0x7fb3f0004d40 2024-09-11T22:20:25.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.335+0000 7fb408d6d640 1 -- 172.21.15.100:0/1512705817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4040cf170 con 0x7fb3f0004d40 2024-09-11T22:20:25.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.336+0000 7fb408d6d640 1 -- 172.21.15.100:0/1512705817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4040cb300 con 0x7fb3f0004d40 2024-09-11T22:20:25.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.337+0000 7fb3faffd640 1 -- 172.21.15.100:0/1512705817 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3f401d070 con 0x7fb3f0004d40 2024-09-11T22:20:25.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.337+0000 7fb3faffd640 1 --2- 172.21.15.100:0/1512705817 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb3e406be30 0x7fb3e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.337+0000 7fb3faffd640 1 -- 172.21.15.100:0/1512705817 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb3f408aca0 con 0x7fb3f0004d40 2024-09-11T22:20:25.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.337+0000 7fb3fbfff640 1 --2- 172.21.15.100:0/1512705817 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb3e406be30 0x7fb3e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.337+0000 7fb3fbfff640 1 --2- 172.21.15.100:0/1512705817 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb3e406be30 0x7fb3e406e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb404154730 tx=0x7fb3ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.341+0000 7fb3faffd640 1 -- 172.21.15.100:0/1512705817 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb3f4059310 con 0x7fb3f0004d40 2024-09-11T22:20:25.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.509+0000 7fb408d6d640 1 -- 172.21.15.100:0/1512705817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4040b3fb0 con 0x7fb3f0004d40 2024-09-11T22:20:25.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.511+0000 7fb3faffd640 1 -- 172.21.15.100:0/1512705817 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18646 (secure 0 0 0) 0x7fb3f4058c10 con 0x7fb3f0004d40 2024-09-11T22:20:25.512 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:25.512 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":26,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","created":"2024-09-11T22:19:56.198855+0000","modified":"2024-09-11T22:20:24.213024+0000","last_up_change":"2024-09-11T22:20:07.328863+0000","last_in_change":"2024-09-11T22:19:58.294227+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:20:08.333538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:20:16.995279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:20:18.147950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:20:21.873694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5de0ba54-34c5-4343-b19a-1f675efc49c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6809","nonce":2008454847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6811","nonce":2008454847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6815","nonce":2008454847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6813","nonce":2008454847}]},"public_addr":"172.21.15.100:6809/2008454847","cluster_addr":"172.21.15.100:6811/2008454847","heartbeat_back_addr":"172.21.15.100:6815/2008454847","heartbeat_front_addr":"172.21.15.100:6813/2008454847","state":["exists","up"]},{"osd":1,"uuid":"5a1f6456-6604-4b41-b9b9-52ae8d6616ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6801","nonce":1802107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6803","nonce":1802107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6807","nonce":1802107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6805","nonce":1802107101}]},"public_addr":"172.21.15.100:6801/1802107101","cluster_addr":"172.21.15.100:6803/1802107101","heartbeat_back_addr":"172.21.15.100:6807/1802107101","heartbeat_front_addr":"172.21.15.100:6805/1802107101","state":["exists","up"]},{"osd":2,"uuid":"a604cb26-7b0f-402d-b6ac-3652884b4b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6817","nonce":644491349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6819","nonce":644491349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6823","nonce":644491349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6821","nonce":644491349}]},"public_addr":"172.21.15.100:6817/644491349","cluster_addr":"172.21.15.100:6819/644491349","heartbeat_back_addr":"172.21.15.100:6823/644491349","heartbeat_front_addr":"172.21.15.100:6821/644491349","state":["exists","up"]},{"osd":3,"uuid":"73dc2cbb-70ff-4d12-ba2f-8778a49892f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6825","nonce":2519160882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6827","nonce":2519160882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6831","nonce":2519160882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6829","nonce":2519160882}]},"public_addr":"172.21.15.100:6825/2519160882","cluster_addr":"172.21.15.100:6827/2519160882","heartbeat_back_addr":"172.21.15.100:6831/2519160882","heartbeat_front_addr":"172.21.15.100:6829/2519160882","state":["exists","up"]},{"osd":4,"uuid":"07960648-04df-4aec-a72c-c29e28b74bcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6817","nonce":736010951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6819","nonce":736010951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6823","nonce":736010951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6821","nonce":736010951}]},"public_addr":"172.21.15.167:6817/736010951","cluster_addr":"172.21.15.167:6819/736010951","heartbeat_back_addr":"172.21.15.167:6823/736010951","heartbeat_front_addr":"172.21.15.167:6821/736010951","state":["exists","up"]},{"osd":5,"uuid":"2b4767e6-cab7-4b45-9150-55432f5576aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6825","nonce":2479173909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6827","nonce":2479173909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6831","nonce":2479173909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6829","nonce":2479173909}]},"public_addr":"172.21.15.167:6825/2479173909","cluster_addr":"172.21.15.167:6827/2479173909","heartbeat_back_addr":"172.21.15.167:6831/2479173909","heartbeat_front_addr":"172.21.15.167:6829/2479173909","state":["exists","up"]},{"osd":6,"uuid":"4ef2c4b5-52f4-4f69-8fca-2334077ed8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6809","nonce":2825112504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6811","nonce":2825112504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6815","nonce":2825112504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6813","nonce":2825112504}]},"public_addr":"172.21.15.167:6809/2825112504","cluster_addr":"172.21.15.167:6811/2825112504","heartbeat_back_addr":"172.21.15.167:6815/2825112504","heartbeat_front_addr":"172.21.15.167:6813/2825112504","state":["exists","up"]},{"osd":7,"uuid":"761673d8-d6fc-4ded-a9f3-d49ab8f7c969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337015843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337015843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337015843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337015843}]},"public_addr":"172.21.15.167:6801/1337015843","cluster_addr":"172.21.15.167:6803/1337015843","heartbeat_back_addr":"172.21.15.167:6807/1337015843","heartbeat_front_addr":"172.21.15.167:6805/1337015843","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.833280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.080311+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.100648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.544261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.670353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.880921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.365441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.366659+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:20:25.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.513+0000 7fb408d6d640 1 -- 172.21.15.100:0/1512705817 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb3e406be30 msgr2=0x7fb3e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.513+0000 7fb408d6d640 1 --2- 172.21.15.100:0/1512705817 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb3e406be30 0x7fb3e406e2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb404154730 tx=0x7fb3ec008040 comp rx=0 tx=0).stop 2024-09-11T22:20:25.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.513+0000 7fb408d6d640 1 -- 172.21.15.100:0/1512705817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3f0004d40 msgr2=0x7fb404146ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.513+0000 7fb408d6d640 1 --2- 172.21.15.100:0/1512705817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3f0004d40 0x7fb404146ad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40073a0 tx=0x7fb3f4007860 comp rx=0 tx=0).stop 2024-09-11T22:20:25.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.513+0000 7fb408d6d640 1 -- 172.21.15.100:0/1512705817 shutdown_connections 2024-09-11T22:20:25.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.513+0000 7fb408d6d640 1 --2- 172.21.15.100:0/1512705817 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb3e406be30 0x7fb3e406e2f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.513+0000 7fb408d6d640 1 --2- 172.21.15.100:0/1512705817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb404145b50 0x7fb4040cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.513+0000 7fb408d6d640 1 --2- 172.21.15.100:0/1512705817 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb404144d00 0x7fb4040cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.513+0000 7fb408d6d640 1 --2- 172.21.15.100:0/1512705817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3f0004d40 0x7fb404146ad0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.513+0000 7fb408d6d640 1 -- 172.21.15.100:0/1512705817 >> 172.21.15.100:0/1512705817 conn(0x7fb4040d0380 msgr2=0x7fb4041585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:25.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.513+0000 7fb408d6d640 1 -- 172.21.15.100:0/1512705817 shutdown_connections 2024-09-11T22:20:25.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.513+0000 7fb408d6d640 1 -- 172.21.15.100:0/1512705817 wait complete. 2024-09-11T22:20:25.525 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:20:25.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.623+0000 7fbb04f78640 1 Processor -- start 2024-09-11T22:20:25.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.623+0000 7fbb04f78640 1 -- start start 2024-09-11T22:20:25.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.624+0000 7fbb04f78640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbb00154b00 0x7fbb0006d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.624+0000 7fbb04f78640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb00072840 0x7fbb0015e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.624+0000 7fbb04f78640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb0015ed80 con 0x7fbb000c89a0 2024-09-11T22:20:25.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.624+0000 7fbb04f78640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fbb000739d0 con 0x7fbb00154b00 2024-09-11T22:20:25.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.624+0000 7fbb04f78640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbb000c9190 con 0x7fbb00072840 2024-09-11T22:20:25.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.625+0000 7fbafe59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbb00154b00 0x7fbb0006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.625+0000 7fbaf7fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb00072840 0x7fbb0015e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.625+0000 7fbafe59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbb00154b00 0x7fbb0006d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:49834/0 (socket says 172.21.15.100:49834) 2024-09-11T22:20:25.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.625+0000 7fbafed9d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fbb000c89a0 0x7fbb00067950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:36556/0 (socket says 172.21.15.100:36556) 2024-09-11T22:20:25.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.625+0000 7fbafe59c640 1 -- 172.21.15.100:0/1207578026 learned_addr learned my addr 172.21.15.100:0/1207578026 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:25.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.625+0000 7fbafe59c640 1 -- 172.21.15.100:0/1207578026 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb00072840 msgr2=0x7fbb0015e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:25.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.625+0000 7fbafe59c640 1 --2- 172.21.15.100:0/1207578026 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb00072840 0x7fbb0015e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.625+0000 7fbafe59c640 1 -- 172.21.15.100:0/1207578026 >> v1:172.21.15.167:6789/0 conn(0x7fbb000c89a0 legacy=0x7fbb00067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.625+0000 7fbafe59c640 1 -- 172.21.15.100:0/1207578026 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb000c9470 con 0x7fbb00154b00 2024-09-11T22:20:25.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.625+0000 7fbafdd9b640 1 -- 172.21.15.100:0/1207578026 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 423725585 0 0) 0x7fbb0015ed80 con 0x7fbb000c89a0 2024-09-11T22:20:25.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.626+0000 7fbafe59c640 1 --2- 172.21.15.100:0/1207578026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb00154b00 0x7fbb0006d150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0009870 tx=0x7fbaf002a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12f6182b6981942d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.626+0000 7fbafdd9b640 1 -- 172.21.15.100:0/1207578026 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0037070 con 0x7fbb00154b00 2024-09-11T22:20:25.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.626+0000 7fbafdd9b640 1 -- 172.21.15.100:0/1207578026 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf002ae50 con 0x7fbb00154b00 2024-09-11T22:20:25.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.626+0000 7fbafdd9b640 1 -- 172.21.15.100:0/1207578026 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0032860 con 0x7fbb00154b00 2024-09-11T22:20:25.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.626+0000 7fbb04f78640 1 -- 172.21.15.100:0/1207578026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb00154b00 msgr2=0x7fbb0006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.626+0000 7fbb04f78640 1 --2- 172.21.15.100:0/1207578026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb00154b00 0x7fbb0006d150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0009870 tx=0x7fbaf002a300 comp rx=0 tx=0).stop 2024-09-11T22:20:25.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.627+0000 7fbb04f78640 1 -- 172.21.15.100:0/1207578026 shutdown_connections 2024-09-11T22:20:25.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.627+0000 7fbb04f78640 1 --2- 172.21.15.100:0/1207578026 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb00072840 0x7fbb0015e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.627+0000 7fbb04f78640 1 --2- 172.21.15.100:0/1207578026 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb00154b00 0x7fbb0006d150 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.627+0000 7fbb04f78640 1 -- 172.21.15.100:0/1207578026 >> 172.21.15.100:0/1207578026 conn(0x7fbb000cd200 msgr2=0x7fbb000cd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:25.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.627+0000 7fbb04f78640 1 -- 172.21.15.100:0/1207578026 shutdown_connections 2024-09-11T22:20:25.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.627+0000 7fbb04f78640 1 -- 172.21.15.100:0/1207578026 wait complete. 2024-09-11T22:20:25.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.628+0000 7fbb04f78640 1 Processor -- start 2024-09-11T22:20:25.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.628+0000 7fbb04f78640 1 -- start start 2024-09-11T22:20:25.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.629+0000 7fbb04f78640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb00072840 0x7fbb00158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.629+0000 7fbb04f78640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb000c89a0 0x7fbb00150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.629+0000 7fbb04f78640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb00154b00 0x7fbb00155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.629+0000 7fbb04f78640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0006cc30 con 0x7fbb00154b00 2024-09-11T22:20:25.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.629+0000 7fbb04f78640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0006c950 con 0x7fbb00072840 2024-09-11T22:20:25.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.629+0000 7fbb04f78640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbb00072c60 con 0x7fbb000c89a0 2024-09-11T22:20:25.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.629+0000 7fbafed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb00154b00 0x7fbb00155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.629+0000 7fbafed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb00154b00 0x7fbb00155b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35842/0 (socket says 172.21.15.100:35842) 2024-09-11T22:20:25.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.629+0000 7fbafed9d640 1 -- 172.21.15.100:0/3936117843 learned_addr learned my addr 172.21.15.100:0/3936117843 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:25.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.629+0000 7fbaf7fff640 1 --2- 172.21.15.100:0/3936117843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb000c89a0 0x7fbb00150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.629+0000 7fbafe59c640 1 --2- 172.21.15.100:0/3936117843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb00072840 0x7fbb00158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.629+0000 7fbafed9d640 1 -- 172.21.15.100:0/3936117843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb000c89a0 msgr2=0x7fbb00150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.629+0000 7fbafed9d640 1 --2- 172.21.15.100:0/3936117843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb000c89a0 0x7fbb00150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.629+0000 7fbafed9d640 1 -- 172.21.15.100:0/3936117843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb00072840 msgr2=0x7fbb00158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.629+0000 7fbafed9d640 1 --2- 172.21.15.100:0/3936117843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb00072840 0x7fbb00158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.629+0000 7fbafed9d640 1 -- 172.21.15.100:0/3936117843 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb001568c0 con 0x7fbb00154b00 2024-09-11T22:20:25.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.629+0000 7fbafed9d640 1 --2- 172.21.15.100:0/3936117843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb00154b00 0x7fbb00155b90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800c7a0 tx=0x7fbaf800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.629+0000 7fbaf6ffd640 1 -- 172.21.15.100:0/3936117843 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8018070 con 0x7fbb00154b00 2024-09-11T22:20:25.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.629+0000 7fbaf6ffd640 1 -- 172.21.15.100:0/3936117843 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf800a5e0 con 0x7fbb00154b00 2024-09-11T22:20:25.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.629+0000 7fbb04f78640 1 -- 172.21.15.100:0/3936117843 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb00155240 con 0x7fbb00154b00 2024-09-11T22:20:25.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.629+0000 7fbaf6ffd640 1 -- 172.21.15.100:0/3936117843 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf800aa50 con 0x7fbb00154b00 2024-09-11T22:20:25.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.629+0000 7fbb04f78640 1 -- 172.21.15.100:0/3936117843 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb001f0c10 con 0x7fbb00154b00 2024-09-11T22:20:25.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.630+0000 7fbb04f78640 1 -- 172.21.15.100:0/3936117843 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb000c8510 con 0x7fbb00154b00 2024-09-11T22:20:25.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.631+0000 7fbaf6ffd640 1 -- 172.21.15.100:0/3936117843 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbaf801b070 con 0x7fbb00154b00 2024-09-11T22:20:25.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.631+0000 7fbaf6ffd640 1 --2- 172.21.15.100:0/3936117843 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbae006be30 0x7fbae006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.631+0000 7fbafe59c640 1 --2- 172.21.15.100:0/3936117843 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbae006be30 0x7fbae006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.631+0000 7fbaf6ffd640 1 -- 172.21.15.100:0/3936117843 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbaf808a670 con 0x7fbb00154b00 2024-09-11T22:20:25.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.632+0000 7fbafe59c640 1 --2- 172.21.15.100:0/3936117843 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbae006be30 0x7fbae006e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0034000 tx=0x7fbaf002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.636+0000 7fbaf6ffd640 1 -- 172.21.15.100:0/3936117843 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbaf8058720 con 0x7fbb00154b00 2024-09-11T22:20:25.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.801+0000 7fbb04f78640 1 -- 172.21.15.100:0/3936117843 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb000b3590 con 0x7fbb00154b00 2024-09-11T22:20:25.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.802+0000 7fbaf6ffd640 1 -- 172.21.15.100:0/3936117843 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18646 (secure 0 0 0) 0x7fbaf805ca20 con 0x7fbb00154b00 2024-09-11T22:20:25.803 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:25.803 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":26,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","created":"2024-09-11T22:19:56.198855+0000","modified":"2024-09-11T22:20:24.213024+0000","last_up_change":"2024-09-11T22:20:07.328863+0000","last_in_change":"2024-09-11T22:19:58.294227+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:20:08.333538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:20:16.995279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:20:18.147950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:20:21.873694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5de0ba54-34c5-4343-b19a-1f675efc49c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6809","nonce":2008454847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6811","nonce":2008454847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6815","nonce":2008454847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6813","nonce":2008454847}]},"public_addr":"172.21.15.100:6809/2008454847","cluster_addr":"172.21.15.100:6811/2008454847","heartbeat_back_addr":"172.21.15.100:6815/2008454847","heartbeat_front_addr":"172.21.15.100:6813/2008454847","state":["exists","up"]},{"osd":1,"uuid":"5a1f6456-6604-4b41-b9b9-52ae8d6616ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6801","nonce":1802107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6803","nonce":1802107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6807","nonce":1802107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6805","nonce":1802107101}]},"public_addr":"172.21.15.100:6801/1802107101","cluster_addr":"172.21.15.100:6803/1802107101","heartbeat_back_addr":"172.21.15.100:6807/1802107101","heartbeat_front_addr":"172.21.15.100:6805/1802107101","state":["exists","up"]},{"osd":2,"uuid":"a604cb26-7b0f-402d-b6ac-3652884b4b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6817","nonce":644491349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6819","nonce":644491349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6823","nonce":644491349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6821","nonce":644491349}]},"public_addr":"172.21.15.100:6817/644491349","cluster_addr":"172.21.15.100:6819/644491349","heartbeat_back_addr":"172.21.15.100:6823/644491349","heartbeat_front_addr":"172.21.15.100:6821/644491349","state":["exists","up"]},{"osd":3,"uuid":"73dc2cbb-70ff-4d12-ba2f-8778a49892f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6825","nonce":2519160882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6827","nonce":2519160882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6831","nonce":2519160882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6829","nonce":2519160882}]},"public_addr":"172.21.15.100:6825/2519160882","cluster_addr":"172.21.15.100:6827/2519160882","heartbeat_back_addr":"172.21.15.100:6831/2519160882","heartbeat_front_addr":"172.21.15.100:6829/2519160882","state":["exists","up"]},{"osd":4,"uuid":"07960648-04df-4aec-a72c-c29e28b74bcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6817","nonce":736010951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6819","nonce":736010951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6823","nonce":736010951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6821","nonce":736010951}]},"public_addr":"172.21.15.167:6817/736010951","cluster_addr":"172.21.15.167:6819/736010951","heartbeat_back_addr":"172.21.15.167:6823/736010951","heartbeat_front_addr":"172.21.15.167:6821/736010951","state":["exists","up"]},{"osd":5,"uuid":"2b4767e6-cab7-4b45-9150-55432f5576aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6825","nonce":2479173909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6827","nonce":2479173909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6831","nonce":2479173909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6829","nonce":2479173909}]},"public_addr":"172.21.15.167:6825/2479173909","cluster_addr":"172.21.15.167:6827/2479173909","heartbeat_back_addr":"172.21.15.167:6831/2479173909","heartbeat_front_addr":"172.21.15.167:6829/2479173909","state":["exists","up"]},{"osd":6,"uuid":"4ef2c4b5-52f4-4f69-8fca-2334077ed8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6809","nonce":2825112504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6811","nonce":2825112504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6815","nonce":2825112504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6813","nonce":2825112504}]},"public_addr":"172.21.15.167:6809/2825112504","cluster_addr":"172.21.15.167:6811/2825112504","heartbeat_back_addr":"172.21.15.167:6815/2825112504","heartbeat_front_addr":"172.21.15.167:6813/2825112504","state":["exists","up"]},{"osd":7,"uuid":"761673d8-d6fc-4ded-a9f3-d49ab8f7c969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337015843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337015843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337015843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337015843}]},"public_addr":"172.21.15.167:6801/1337015843","cluster_addr":"172.21.15.167:6803/1337015843","heartbeat_back_addr":"172.21.15.167:6807/1337015843","heartbeat_front_addr":"172.21.15.167:6805/1337015843","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.833280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.080311+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.100648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.544261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.670353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.880921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.365441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.366659+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:20:25.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.804+0000 7fbb04f78640 1 -- 172.21.15.100:0/3936117843 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbae006be30 msgr2=0x7fbae006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.804+0000 7fbb04f78640 1 --2- 172.21.15.100:0/3936117843 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbae006be30 0x7fbae006e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0034000 tx=0x7fbaf002e000 comp rx=0 tx=0).stop 2024-09-11T22:20:25.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.804+0000 7fbb04f78640 1 -- 172.21.15.100:0/3936117843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb00154b00 msgr2=0x7fbb00155b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.804+0000 7fbb04f78640 1 --2- 172.21.15.100:0/3936117843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb00154b00 0x7fbb00155b90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800c7a0 tx=0x7fbaf800cc60 comp rx=0 tx=0).stop 2024-09-11T22:20:25.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.804+0000 7fbb04f78640 1 -- 172.21.15.100:0/3936117843 shutdown_connections 2024-09-11T22:20:25.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.804+0000 7fbb04f78640 1 --2- 172.21.15.100:0/3936117843 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbae006be30 0x7fbae006e2f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.804+0000 7fbb04f78640 1 --2- 172.21.15.100:0/3936117843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb00154b00 0x7fbb00155b90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.804+0000 7fbb04f78640 1 --2- 172.21.15.100:0/3936117843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb000c89a0 0x7fbb00150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.804+0000 7fbb04f78640 1 --2- 172.21.15.100:0/3936117843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb00072840 0x7fbb00158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.804+0000 7fbb04f78640 1 -- 172.21.15.100:0/3936117843 >> 172.21.15.100:0/3936117843 conn(0x7fbb000cd200 msgr2=0x7fbb000c3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:25.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.804+0000 7fbb04f78640 1 -- 172.21.15.100:0/3936117843 shutdown_connections 2024-09-11T22:20:25.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.804+0000 7fbb04f78640 1 -- 172.21.15.100:0/3936117843 wait complete. 2024-09-11T22:20:25.833 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:25.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.932+0000 7fbeb203c640 1 Processor -- start 2024-09-11T22:20:25.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.932+0000 7fbeb203c640 1 -- start start 2024-09-11T22:20:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.932+0000 7fbeb203c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac0b1240 0x7fbeac15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.932+0000 7fbeb203c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbeac15e190 0x7fbeac0c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.932+0000 7fbeb203c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeac0b1640 con 0x7fbeac0cb450 2024-09-11T22:20:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.932+0000 7fbeb203c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fbeac1553e0 con 0x7fbeac15e190 2024-09-11T22:20:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.932+0000 7fbeb203c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbeac15ac20 con 0x7fbeac0b1240 2024-09-11T22:20:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.933+0000 7fbeabfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbeac15e190 0x7fbeac0c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.933+0000 7fbeaaffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac0b1240 0x7fbeac15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.933+0000 7fbeaaffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac0b1240 0x7fbeac15b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45314/0 (socket says 172.21.15.100:45314) 2024-09-11T22:20:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.933+0000 7fbeaaffd640 1 -- 172.21.15.100:0/464132880 learned_addr learned my addr 172.21.15.100:0/464132880 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.933+0000 7fbeabfff640 1 -- 172.21.15.100:0/464132880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac0b1240 msgr2=0x7fbeac15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.933+0000 7fbeabfff640 1 --2- 172.21.15.100:0/464132880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac0b1240 0x7fbeac15b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.933+0000 7fbeabfff640 1 -- 172.21.15.100:0/464132880 >> v1:172.21.15.167:6789/0 conn(0x7fbeac0cb450 legacy=0x7fbeac0c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.933+0000 7fbeabfff640 1 -- 172.21.15.100:0/464132880 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeac15e8f0 con 0x7fbeac15e190 2024-09-11T22:20:25.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.933+0000 7fbeaaffd640 1 --2- 172.21.15.100:0/464132880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac0b1240 0x7fbeac15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.934+0000 7fbeabfff640 1 --2- 172.21.15.100:0/464132880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbeac15e190 0x7fbeac0c9c20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009d90 tx=0x7fbea402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e083aa6246431ec2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.934+0000 7fbeaa7fc640 1 -- 172.21.15.100:0/464132880 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea4007740 con 0x7fbeac15e190 2024-09-11T22:20:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.934+0000 7fbeaa7fc640 1 -- 172.21.15.100:0/464132880 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbea40078e0 con 0x7fbeac15e190 2024-09-11T22:20:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.934+0000 7fbeaa7fc640 1 -- 172.21.15.100:0/464132880 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea4007cb0 con 0x7fbeac15e190 2024-09-11T22:20:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.935+0000 7fbeb203c640 1 -- 172.21.15.100:0/464132880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbeac15e190 msgr2=0x7fbeac0c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.935+0000 7fbeb203c640 1 --2- 172.21.15.100:0/464132880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbeac15e190 0x7fbeac0c9c20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009d90 tx=0x7fbea402a660 comp rx=0 tx=0).stop 2024-09-11T22:20:25.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.935+0000 7fbeb203c640 1 -- 172.21.15.100:0/464132880 shutdown_connections 2024-09-11T22:20:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.935+0000 7fbeb203c640 1 --2- 172.21.15.100:0/464132880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbeac15e190 0x7fbeac0c9c20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.935+0000 7fbeb203c640 1 --2- 172.21.15.100:0/464132880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac0b1240 0x7fbeac15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.935+0000 7fbeb203c640 1 -- 172.21.15.100:0/464132880 >> 172.21.15.100:0/464132880 conn(0x7fbeac071560 msgr2=0x7fbeac071940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.935+0000 7fbeb203c640 1 -- 172.21.15.100:0/464132880 shutdown_connections 2024-09-11T22:20:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.935+0000 7fbeb203c640 1 -- 172.21.15.100:0/464132880 wait complete. 2024-09-11T22:20:25.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.936+0000 7fbeb203c640 1 Processor -- start 2024-09-11T22:20:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.936+0000 7fbeb203c640 1 -- start start 2024-09-11T22:20:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.937+0000 7fbeb203c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac0b1240 0x7fbeac155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.937+0000 7fbeb203c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbeac0cb450 0x7fbeac1e57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.937+0000 7fbeb203c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbeac15e190 0x7fbeac15d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.937+0000 7fbeb203c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbeac15aee0 con 0x7fbeac0cb450 2024-09-11T22:20:25.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.937+0000 7fbeb203c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbeac15eeb0 con 0x7fbeac15e190 2024-09-11T22:20:25.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.937+0000 7fbeb203c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbeac15b1c0 con 0x7fbeac0b1240 2024-09-11T22:20:25.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.937+0000 7fbeaaffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbeac0cb450 0x7fbeac1e57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.937+0000 7fbeaaffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbeac0cb450 0x7fbeac1e57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35844/0 (socket says 172.21.15.100:35844) 2024-09-11T22:20:25.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.937+0000 7fbeaaffd640 1 -- 172.21.15.100:0/4294170294 learned_addr learned my addr 172.21.15.100:0/4294170294 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:25.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.937+0000 7fbeab7fe640 1 --2- 172.21.15.100:0/4294170294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac0b1240 0x7fbeac155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.937+0000 7fbeabfff640 1 --2- 172.21.15.100:0/4294170294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbeac15e190 0x7fbeac15d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.937+0000 7fbeaaffd640 1 -- 172.21.15.100:0/4294170294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac0b1240 msgr2=0x7fbeac155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.937+0000 7fbeaaffd640 1 --2- 172.21.15.100:0/4294170294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac0b1240 0x7fbeac155fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.937+0000 7fbeaaffd640 1 -- 172.21.15.100:0/4294170294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbeac15e190 msgr2=0x7fbeac15d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:25.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.937+0000 7fbeaaffd640 1 --2- 172.21.15.100:0/4294170294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbeac15e190 0x7fbeac15d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:25.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.937+0000 7fbeaaffd640 1 -- 172.21.15.100:0/4294170294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeac15c220 con 0x7fbeac0cb450 2024-09-11T22:20:25.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.937+0000 7fbeabfff640 1 --2- 172.21.15.100:0/4294170294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbeac15e190 0x7fbeac15d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:25.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.937+0000 7fbeaaffd640 1 --2- 172.21.15.100:0/4294170294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbeac0cb450 0x7fbeac1e57b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400e9d0 tx=0x7fbe9400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.937+0000 7fbea3fff640 1 -- 172.21.15.100:0/4294170294 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe94017070 con 0x7fbeac0cb450 2024-09-11T22:20:25.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.937+0000 7fbea3fff640 1 -- 172.21.15.100:0/4294170294 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe9400ca60 con 0x7fbeac0cb450 2024-09-11T22:20:25.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.937+0000 7fbea3fff640 1 -- 172.21.15.100:0/4294170294 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9400ce10 con 0x7fbeac0cb450 2024-09-11T22:20:25.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.937+0000 7fbeb203c640 1 -- 172.21.15.100:0/4294170294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeac0cd240 con 0x7fbeac0cb450 2024-09-11T22:20:25.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.937+0000 7fbeb203c640 1 -- 172.21.15.100:0/4294170294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeac0cd800 con 0x7fbeac0cb450 2024-09-11T22:20:25.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.938+0000 7fbeb203c640 1 -- 172.21.15.100:0/4294170294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeac0c18d0 con 0x7fbeac0cb450 2024-09-11T22:20:25.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.939+0000 7fbea3fff640 1 -- 172.21.15.100:0/4294170294 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe9401a070 con 0x7fbeac0cb450 2024-09-11T22:20:25.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.939+0000 7fbea3fff640 1 --2- 172.21.15.100:0/4294170294 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbe8c06be30 0x7fbe8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:25.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.939+0000 7fbea3fff640 1 -- 172.21.15.100:0/4294170294 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbe9408b3d0 con 0x7fbeac0cb450 2024-09-11T22:20:25.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.939+0000 7fbeab7fe640 1 --2- 172.21.15.100:0/4294170294 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbe8c06be30 0x7fbe8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:25.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.940+0000 7fbeab7fe640 1 --2- 172.21.15.100:0/4294170294 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbe8c06be30 0x7fbe8c06e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c001780 tx=0x7fbe9c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:25.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:25.943+0000 7fbea3fff640 1 -- 172.21.15.100:0/4294170294 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbeac0c18d0 con 0x7fbeac0cb450 2024-09-11T22:20:26.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.145+0000 7fbeb203c640 1 -- 172.21.15.100:0/4294170294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbeac15e600 con 0x7fbeac0cb450 2024-09-11T22:20:26.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.145+0000 7fbea3fff640 1 -- 172.21.15.100:0/4294170294 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6882 (secure 0 0 0) 0x7fbe94059480 con 0x7fbeac0cb450 2024-09-11T22:20:26.146 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:26.146 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":6,"btime":"2024-09-11T22:20:24:893311+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2075802330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":2075802330},{"type":"v1","addr":"172.21.15.100:6837","nonce":2075802330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/1727733473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1727733473},{"type":"v1","addr":"172.21.15.167:6836","nonce":1727733473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/880809662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":880809662},{"type":"v1","addr":"172.21.15.167:6837","nonce":880809662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1912241808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1912241808},{"type":"v1","addr":"172.21.15.100:6836","nonce":1912241808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3236256661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3236256661},{"type":"v1","addr":"172.21.15.100:6839","nonce":3236256661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:19.171222+0000","modified":"2024-09-11T22:20:24.883934+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6834/1651678197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1651678197},{"type":"v1","addr":"172.21.15.167:6834","nonce":1651678197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-09-11T22:20:26.146 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 6 2024-09-11T22:20:26.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.147+0000 7fbeb203c640 1 -- 172.21.15.100:0/4294170294 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbe8c06be30 msgr2=0x7fbe8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:26.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.147+0000 7fbeb203c640 1 --2- 172.21.15.100:0/4294170294 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbe8c06be30 0x7fbe8c06e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c001780 tx=0x7fbe9c009040 comp rx=0 tx=0).stop 2024-09-11T22:20:26.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.147+0000 7fbeb203c640 1 -- 172.21.15.100:0/4294170294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbeac0cb450 msgr2=0x7fbeac1e57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:26.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.147+0000 7fbeb203c640 1 --2- 172.21.15.100:0/4294170294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbeac0cb450 0x7fbeac1e57b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400e9d0 tx=0x7fbe9400ee90 comp rx=0 tx=0).stop 2024-09-11T22:20:26.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.147+0000 7fbeb203c640 1 -- 172.21.15.100:0/4294170294 shutdown_connections 2024-09-11T22:20:26.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.147+0000 7fbeb203c640 1 --2- 172.21.15.100:0/4294170294 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbe8c06be30 0x7fbe8c06e2f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:26.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.147+0000 7fbeb203c640 1 --2- 172.21.15.100:0/4294170294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbeac15e190 0x7fbeac15d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:26.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.147+0000 7fbeb203c640 1 --2- 172.21.15.100:0/4294170294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbeac0cb450 0x7fbeac1e57b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:26.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.147+0000 7fbeb203c640 1 --2- 172.21.15.100:0/4294170294 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbeac0b1240 0x7fbeac155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:26.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.147+0000 7fbeb203c640 1 -- 172.21.15.100:0/4294170294 >> 172.21.15.100:0/4294170294 conn(0x7fbeac071560 msgr2=0x7fbeac0b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:26.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.147+0000 7fbeb203c640 1 -- 172.21.15.100:0/4294170294 shutdown_connections 2024-09-11T22:20:26.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.147+0000 7fbeb203c640 1 -- 172.21.15.100:0/4294170294 wait complete. 2024-09-11T22:20:26.159 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:20:26.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.256+0000 7f0c050a6640 1 Processor -- start 2024-09-11T22:20:26.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.256+0000 7f0c050a6640 1 -- start start 2024-09-11T22:20:26.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.257+0000 7f0c050a6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c000cc770 0x7f0c000cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.257+0000 7f0c050a6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0c000cb920 0x7f0c0015aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.257+0000 7f0c050a6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c000c5d80 con 0x7f0c00154d20 2024-09-11T22:20:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.257+0000 7f0c050a6640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f0c0015ebe0 con 0x7f0c000cb920 2024-09-11T22:20:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.257+0000 7f0c050a6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0c00155100 con 0x7f0c000cc770 2024-09-11T22:20:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.257+0000 7f0bff59e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0c000cb920 0x7f0c0015aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.257+0000 7f0bff59e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0c000cb920 0x7f0c0015aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35856/0 (socket says 172.21.15.100:35856) 2024-09-11T22:20:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.257+0000 7f0bff59e640 1 -- 172.21.15.100:0/1059199266 learned_addr learned my addr 172.21.15.100:0/1059199266 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.257+0000 7f0bf7fff640 1 --2- 172.21.15.100:0/1059199266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c000cc770 0x7f0c000cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.257+0000 7f0bff59e640 1 -- 172.21.15.100:0/1059199266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c000cc770 msgr2=0x7f0c000cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.257+0000 7f0bff59e640 1 --2- 172.21.15.100:0/1059199266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c000cc770 0x7f0c000cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.257+0000 7f0bff59e640 1 -- 172.21.15.100:0/1059199266 >> v1:172.21.15.167:6789/0 conn(0x7f0c00154d20 legacy=0x7f0c00072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:26.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.257+0000 7f0bff59e640 1 -- 172.21.15.100:0/1059199266 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c0015dfd0 con 0x7f0c000cb920 2024-09-11T22:20:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.258+0000 7f0bff59e640 1 --2- 172.21.15.100:0/1059199266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c000cb920 0x7f0c0015aaa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009e50 tx=0x7f0bf802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603ccec46f63bb9d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.258+0000 7f0bfe59c640 1 -- 172.21.15.100:0/1059199266 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8036070 con 0x7f0c000cb920 2024-09-11T22:20:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.258+0000 7f0bfe59c640 1 -- 172.21.15.100:0/1059199266 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf8031600 con 0x7f0c000cb920 2024-09-11T22:20:26.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.258+0000 7f0bfe59c640 1 -- 172.21.15.100:0/1059199266 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf80319d0 con 0x7f0c000cb920 2024-09-11T22:20:26.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.258+0000 7f0c050a6640 1 -- 172.21.15.100:0/1059199266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c000cb920 msgr2=0x7f0c0015aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:26.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.258+0000 7f0c050a6640 1 --2- 172.21.15.100:0/1059199266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c000cb920 0x7f0c0015aaa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009e50 tx=0x7f0bf802a6c0 comp rx=0 tx=0).stop 2024-09-11T22:20:26.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.259+0000 7f0c050a6640 1 -- 172.21.15.100:0/1059199266 shutdown_connections 2024-09-11T22:20:26.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.259+0000 7f0c050a6640 1 --2- 172.21.15.100:0/1059199266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c000cb920 0x7f0c0015aaa0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:26.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.259+0000 7f0c050a6640 1 --2- 172.21.15.100:0/1059199266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c000cc770 0x7f0c000cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:26.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.259+0000 7f0c050a6640 1 -- 172.21.15.100:0/1059199266 >> 172.21.15.100:0/1059199266 conn(0x7f0c000d0380 msgr2=0x7f0c000d0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:26.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.259+0000 7f0c050a6640 1 -- 172.21.15.100:0/1059199266 shutdown_connections 2024-09-11T22:20:26.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.259+0000 7f0c050a6640 1 -- 172.21.15.100:0/1059199266 wait complete. 2024-09-11T22:20:26.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.260+0000 7f0c050a6640 1 Processor -- start 2024-09-11T22:20:26.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.260+0000 7f0c050a6640 1 -- start start 2024-09-11T22:20:26.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.261+0000 7f0c050a6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c000cb920 0x7f0c00155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:26.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.261+0000 7f0c050a6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c000cc770 0x7f0c001e5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:26.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.261+0000 7f0c050a6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c00154d20 0x7f0c0015d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:26.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.261+0000 7f0c050a6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0015e870 con 0x7f0c00154d20 2024-09-11T22:20:26.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.261+0000 7f0c050a6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0015e590 con 0x7f0c000cc770 2024-09-11T22:20:26.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.261+0000 7f0c050a6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0c00072940 con 0x7f0c000cb920 2024-09-11T22:20:26.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.261+0000 7f0bff59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c00154d20 0x7f0c0015d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:26.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.261+0000 7f0bff59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c00154d20 0x7f0c0015d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35866/0 (socket says 172.21.15.100:35866) 2024-09-11T22:20:26.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.261+0000 7f0bff59e640 1 -- 172.21.15.100:0/4078216157 learned_addr learned my addr 172.21.15.100:0/4078216157 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:26.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.261+0000 7f0bfed9d640 1 --2- 172.21.15.100:0/4078216157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c000cb920 0x7f0c00155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:26.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.261+0000 7f0bf7fff640 1 --2- 172.21.15.100:0/4078216157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c000cc770 0x7f0c001e5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:26.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.261+0000 7f0bff59e640 1 -- 172.21.15.100:0/4078216157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c000cb920 msgr2=0x7f0c00155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:26.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.261+0000 7f0bff59e640 1 --2- 172.21.15.100:0/4078216157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c000cb920 0x7f0c00155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:26.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.261+0000 7f0bff59e640 1 -- 172.21.15.100:0/4078216157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c000cc770 msgr2=0x7f0c001e5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:26.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.261+0000 7f0bff59e640 1 --2- 172.21.15.100:0/4078216157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c000cc770 0x7f0c001e5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:26.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.261+0000 7f0bff59e640 1 -- 172.21.15.100:0/4078216157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c00150f50 con 0x7f0c00154d20 2024-09-11T22:20:26.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.261+0000 7f0bff59e640 1 --2- 172.21.15.100:0/4078216157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c00154d20 0x7f0c0015d550 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8034040 tx=0x7f0bf8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:26.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.261+0000 7f0bf77fe640 1 -- 172.21.15.100:0/4078216157 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8036050 con 0x7f0c00154d20 2024-09-11T22:20:26.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.261+0000 7f0bf77fe640 1 -- 172.21.15.100:0/4078216157 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf8042070 con 0x7f0c00154d20 2024-09-11T22:20:26.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.261+0000 7f0c050a6640 1 -- 172.21.15.100:0/4078216157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c001514a0 con 0x7f0c00154d20 2024-09-11T22:20:26.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.261+0000 7f0bf77fe640 1 -- 172.21.15.100:0/4078216157 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8009510 con 0x7f0c00154d20 2024-09-11T22:20:26.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.261+0000 7f0c050a6640 1 -- 172.21.15.100:0/4078216157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c001568a0 con 0x7f0c00154d20 2024-09-11T22:20:26.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.262+0000 7f0c050a6640 1 -- 172.21.15.100:0/4078216157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c000cb300 con 0x7f0c00154d20 2024-09-11T22:20:26.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.263+0000 7f0bf77fe640 1 -- 172.21.15.100:0/4078216157 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0bf8007b90 con 0x7f0c00154d20 2024-09-11T22:20:26.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.263+0000 7f0bf77fe640 1 --2- 172.21.15.100:0/4078216157 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0be006be60 0x7f0be006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:26.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.263+0000 7f0bf77fe640 1 -- 172.21.15.100:0/4078216157 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0bf80abea0 con 0x7f0c00154d20 2024-09-11T22:20:26.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.263+0000 7f0bfed9d640 1 --2- 172.21.15.100:0/4078216157 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0be006be60 0x7f0be006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:26.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.264+0000 7f0bfed9d640 1 --2- 172.21.15.100:0/4078216157 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0be006be60 0x7f0be006e320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0006fd0 tx=0x7f0bf0009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:26.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.267+0000 7f0bf77fe640 1 -- 172.21.15.100:0/4078216157 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0bf8079ec0 con 0x7f0c00154d20 2024-09-11T22:20:26.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.436+0000 7f0c050a6640 1 -- 172.21.15.100:0/4078216157 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c000cbed0 con 0x7f0c00154d20 2024-09-11T22:20:26.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.437+0000 7f0bf77fe640 1 -- 172.21.15.100:0/4078216157 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18646 (secure 0 0 0) 0x7f0bf807e1c0 con 0x7f0c00154d20 2024-09-11T22:20:26.438 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:26.438 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":26,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","created":"2024-09-11T22:19:56.198855+0000","modified":"2024-09-11T22:20:24.213024+0000","last_up_change":"2024-09-11T22:20:07.328863+0000","last_in_change":"2024-09-11T22:19:58.294227+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:20:08.333538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:20:16.995279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:20:18.147950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:20:21.873694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5de0ba54-34c5-4343-b19a-1f675efc49c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6809","nonce":2008454847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6811","nonce":2008454847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6815","nonce":2008454847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6813","nonce":2008454847}]},"public_addr":"172.21.15.100:6809/2008454847","cluster_addr":"172.21.15.100:6811/2008454847","heartbeat_back_addr":"172.21.15.100:6815/2008454847","heartbeat_front_addr":"172.21.15.100:6813/2008454847","state":["exists","up"]},{"osd":1,"uuid":"5a1f6456-6604-4b41-b9b9-52ae8d6616ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6801","nonce":1802107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6803","nonce":1802107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6807","nonce":1802107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6805","nonce":1802107101}]},"public_addr":"172.21.15.100:6801/1802107101","cluster_addr":"172.21.15.100:6803/1802107101","heartbeat_back_addr":"172.21.15.100:6807/1802107101","heartbeat_front_addr":"172.21.15.100:6805/1802107101","state":["exists","up"]},{"osd":2,"uuid":"a604cb26-7b0f-402d-b6ac-3652884b4b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6817","nonce":644491349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6819","nonce":644491349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6823","nonce":644491349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6821","nonce":644491349}]},"public_addr":"172.21.15.100:6817/644491349","cluster_addr":"172.21.15.100:6819/644491349","heartbeat_back_addr":"172.21.15.100:6823/644491349","heartbeat_front_addr":"172.21.15.100:6821/644491349","state":["exists","up"]},{"osd":3,"uuid":"73dc2cbb-70ff-4d12-ba2f-8778a49892f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6825","nonce":2519160882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6827","nonce":2519160882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6831","nonce":2519160882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6829","nonce":2519160882}]},"public_addr":"172.21.15.100:6825/2519160882","cluster_addr":"172.21.15.100:6827/2519160882","heartbeat_back_addr":"172.21.15.100:6831/2519160882","heartbeat_front_addr":"172.21.15.100:6829/2519160882","state":["exists","up"]},{"osd":4,"uuid":"07960648-04df-4aec-a72c-c29e28b74bcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6817","nonce":736010951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6819","nonce":736010951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6823","nonce":736010951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6821","nonce":736010951}]},"public_addr":"172.21.15.167:6817/736010951","cluster_addr":"172.21.15.167:6819/736010951","heartbeat_back_addr":"172.21.15.167:6823/736010951","heartbeat_front_addr":"172.21.15.167:6821/736010951","state":["exists","up"]},{"osd":5,"uuid":"2b4767e6-cab7-4b45-9150-55432f5576aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6825","nonce":2479173909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6827","nonce":2479173909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6831","nonce":2479173909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6829","nonce":2479173909}]},"public_addr":"172.21.15.167:6825/2479173909","cluster_addr":"172.21.15.167:6827/2479173909","heartbeat_back_addr":"172.21.15.167:6831/2479173909","heartbeat_front_addr":"172.21.15.167:6829/2479173909","state":["exists","up"]},{"osd":6,"uuid":"4ef2c4b5-52f4-4f69-8fca-2334077ed8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6809","nonce":2825112504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6811","nonce":2825112504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6815","nonce":2825112504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6813","nonce":2825112504}]},"public_addr":"172.21.15.167:6809/2825112504","cluster_addr":"172.21.15.167:6811/2825112504","heartbeat_back_addr":"172.21.15.167:6815/2825112504","heartbeat_front_addr":"172.21.15.167:6813/2825112504","state":["exists","up"]},{"osd":7,"uuid":"761673d8-d6fc-4ded-a9f3-d49ab8f7c969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337015843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337015843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337015843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337015843}]},"public_addr":"172.21.15.167:6801/1337015843","cluster_addr":"172.21.15.167:6803/1337015843","heartbeat_back_addr":"172.21.15.167:6807/1337015843","heartbeat_front_addr":"172.21.15.167:6805/1337015843","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.833280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.080311+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.100648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.544261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.670353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.880921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.365441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.366659+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:20:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.439+0000 7f0c050a6640 1 -- 172.21.15.100:0/4078216157 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0be006be60 msgr2=0x7f0be006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.439+0000 7f0c050a6640 1 --2- 172.21.15.100:0/4078216157 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0be006be60 0x7f0be006e320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0006fd0 tx=0x7f0bf0009060 comp rx=0 tx=0).stop 2024-09-11T22:20:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.439+0000 7f0c050a6640 1 -- 172.21.15.100:0/4078216157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c00154d20 msgr2=0x7f0c0015d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.439+0000 7f0c050a6640 1 --2- 172.21.15.100:0/4078216157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c00154d20 0x7f0c0015d550 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8034040 tx=0x7f0bf8004a40 comp rx=0 tx=0).stop 2024-09-11T22:20:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.439+0000 7f0c050a6640 1 -- 172.21.15.100:0/4078216157 shutdown_connections 2024-09-11T22:20:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.439+0000 7f0c050a6640 1 --2- 172.21.15.100:0/4078216157 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0be006be60 0x7f0be006e320 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:26.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.439+0000 7f0c050a6640 1 --2- 172.21.15.100:0/4078216157 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c00154d20 0x7f0c0015d550 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.439+0000 7f0c050a6640 1 --2- 172.21.15.100:0/4078216157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c000cc770 0x7f0c001e5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.439+0000 7f0c050a6640 1 --2- 172.21.15.100:0/4078216157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c000cb920 0x7f0c00155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.439+0000 7f0c050a6640 1 -- 172.21.15.100:0/4078216157 >> 172.21.15.100:0/4078216157 conn(0x7f0c000d0380 msgr2=0x7f0c0015a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.439+0000 7f0c050a6640 1 -- 172.21.15.100:0/4078216157 shutdown_connections 2024-09-11T22:20:26.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:26.439+0000 7f0c050a6640 1 -- 172.21.15.100:0/4078216157 wait complete. 2024-09-11T22:20:27.054 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:20:19.171222+0000', 'modified': '2024-09-11T22:20:24.883934+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4296}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4296': {'gid': 4296, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.167:6834/1651678197', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6832', 'nonce': 1651678197}, {'type': 'v1', 'addr': '172.21.15.167:6834', 'nonce': 1651678197}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4296, 'qdb_cluster': [4296]} 2024-09-11T22:20:27.055 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T22:20:27.055 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-09-11T22:20:27.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.159+0000 7f5af3823640 1 Processor -- start 2024-09-11T22:20:27.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.159+0000 7f5af3823640 1 -- start start 2024-09-11T22:20:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.160+0000 7f5af3823640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5aec152ac0 0x7f5aec0c9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:27.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.160+0000 7f5af3823640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5aec15bcf0 0x7f5aec15c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.160+0000 7f5af3823640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aec15c680 con 0x7f5aec1591c0 2024-09-11T22:20:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.160+0000 7f5af3823640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f5aec06d0c0 con 0x7f5aec152ac0 2024-09-11T22:20:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.160+0000 7f5af3823640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f5aec152ea0 con 0x7f5aec15bcf0 2024-09-11T22:20:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.160+0000 7f5af15bf640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5aec152ac0 0x7f5aec0c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.160+0000 7f5af15bf640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5aec152ac0 0x7f5aec0c9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35880/0 (socket says 172.21.15.100:35880) 2024-09-11T22:20:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.160+0000 7f5af0dbe640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5aec1591c0 0x7f5aec067950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38700/0 (socket says 172.21.15.100:38700) 2024-09-11T22:20:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.160+0000 7f5af15bf640 1 -- 172.21.15.100:0/2862860578 learned_addr learned my addr 172.21.15.100:0/2862860578 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.160+0000 7f5af15bf640 1 -- 172.21.15.100:0/2862860578 >> v2:172.21.15.167:3300/0 conn(0x7f5aec15bcf0 msgr2=0x7f5aec15c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.160+0000 7f5af1dc0640 1 --2- 172.21.15.100:0/2862860578 >> v2:172.21.15.167:3300/0 conn(0x7f5aec15bcf0 0x7f5aec15c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.160+0000 7f5ae3fff640 1 -- 172.21.15.100:0/2862860578 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2626097008 0 0) 0x7f5aec15c680 con 0x7f5aec1591c0 2024-09-11T22:20:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.161+0000 7f5af15bf640 1 --2- 172.21.15.100:0/2862860578 >> v2:172.21.15.167:3300/0 conn(0x7f5aec15bcf0 0x7f5aec15c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.161+0000 7f5af15bf640 1 -- 172.21.15.100:0/2862860578 >> v1:172.21.15.100:6789/0 conn(0x7f5aec1591c0 legacy=0x7f5aec067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:27.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.161+0000 7f5af15bf640 1 -- 172.21.15.100:0/2862860578 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aec06c4f0 con 0x7f5aec152ac0 2024-09-11T22:20:27.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.161+0000 7f5af1dc0640 1 --2- 172.21.15.100:0/2862860578 >> v2:172.21.15.167:3300/0 conn(0x7f5aec15bcf0 0x7f5aec15c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:27.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.161+0000 7f5af15bf640 1 --2- 172.21.15.100:0/2862860578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5aec152ac0 0x7f5aec0c9520 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5aec070190 tx=0x7f5ae802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f503539d06c34fd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.161+0000 7f5ae3fff640 1 -- 172.21.15.100:0/2862860578 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8037070 con 0x7f5aec152ac0 2024-09-11T22:20:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.161+0000 7f5ae3fff640 1 -- 172.21.15.100:0/2862860578 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae802ae50 con 0x7f5aec152ac0 2024-09-11T22:20:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.161+0000 7f5ae3fff640 1 -- 172.21.15.100:0/2862860578 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8032860 con 0x7f5aec152ac0 2024-09-11T22:20:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.162+0000 7f5af3823640 1 -- 172.21.15.100:0/2862860578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5aec152ac0 msgr2=0x7f5aec0c9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.162+0000 7f5af3823640 1 --2- 172.21.15.100:0/2862860578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5aec152ac0 0x7f5aec0c9520 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5aec070190 tx=0x7f5ae802a300 comp rx=0 tx=0).stop 2024-09-11T22:20:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.162+0000 7f5af3823640 1 -- 172.21.15.100:0/2862860578 shutdown_connections 2024-09-11T22:20:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.162+0000 7f5af3823640 1 --2- 172.21.15.100:0/2862860578 >> v2:172.21.15.167:3300/0 conn(0x7f5aec15bcf0 0x7f5aec15c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.162+0000 7f5af3823640 1 --2- 172.21.15.100:0/2862860578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5aec152ac0 0x7f5aec0c9520 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.162+0000 7f5af3823640 1 -- 172.21.15.100:0/2862860578 >> 172.21.15.100:0/2862860578 conn(0x7f5aec06ee80 msgr2=0x7f5aec070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:27.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.162+0000 7f5af3823640 1 -- 172.21.15.100:0/2862860578 shutdown_connections 2024-09-11T22:20:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.162+0000 7f5af3823640 1 -- 172.21.15.100:0/2862860578 wait complete. 2024-09-11T22:20:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.163+0000 7f5af3823640 1 Processor -- start 2024-09-11T22:20:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.163+0000 7f5af3823640 1 -- start start 2024-09-11T22:20:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.164+0000 7f5af3823640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5aec152ac0 0x7f5aec151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.164+0000 7f5af3823640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5aec1591c0 0x7f5aec1f36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.164+0000 7f5af3823640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5aec15bcf0 0x7f5aec1f3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.164+0000 7f5af3823640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec06c210 con 0x7f5aec15bcf0 2024-09-11T22:20:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.164+0000 7f5af3823640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec06bf30 con 0x7f5aec1591c0 2024-09-11T22:20:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.164+0000 7f5af3823640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5aec06cd50 con 0x7f5aec152ac0 2024-09-11T22:20:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.164+0000 7f5af1dc0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5aec15bcf0 0x7f5aec1f3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.164+0000 7f5af1dc0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5aec15bcf0 0x7f5aec1f3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35888/0 (socket says 172.21.15.100:35888) 2024-09-11T22:20:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.164+0000 7f5af1dc0640 1 -- 172.21.15.100:0/3995768164 learned_addr learned my addr 172.21.15.100:0/3995768164 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.164+0000 7f5af0dbe640 1 --2- 172.21.15.100:0/3995768164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5aec1591c0 0x7f5aec1f36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:27.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.164+0000 7f5af15bf640 1 --2- 172.21.15.100:0/3995768164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5aec152ac0 0x7f5aec151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.164+0000 7f5af1dc0640 1 -- 172.21.15.100:0/3995768164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5aec152ac0 msgr2=0x7f5aec151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.164+0000 7f5af1dc0640 1 --2- 172.21.15.100:0/3995768164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5aec152ac0 0x7f5aec151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.164+0000 7f5af1dc0640 1 -- 172.21.15.100:0/3995768164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5aec1591c0 msgr2=0x7f5aec1f36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.164+0000 7f5af1dc0640 1 --2- 172.21.15.100:0/3995768164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5aec1591c0 0x7f5aec1f36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.164+0000 7f5af1dc0640 1 -- 172.21.15.100:0/3995768164 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aec0c3b30 con 0x7f5aec15bcf0 2024-09-11T22:20:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.164+0000 7f5af0dbe640 1 --2- 172.21.15.100:0/3995768164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5aec1591c0 0x7f5aec1f36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.164+0000 7f5af1dc0640 1 --2- 172.21.15.100:0/3995768164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5aec15bcf0 0x7f5aec1f3c10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400cf20 tx=0x7f5ae400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.164+0000 7f5ae1ffb640 1 -- 172.21.15.100:0/3995768164 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae401a070 con 0x7f5aec15bcf0 2024-09-11T22:20:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.165+0000 7f5ae1ffb640 1 -- 172.21.15.100:0/3995768164 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae400d840 con 0x7f5aec15bcf0 2024-09-11T22:20:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.165+0000 7f5af3823640 1 -- 172.21.15.100:0/3995768164 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aec0c23f0 con 0x7f5aec15bcf0 2024-09-11T22:20:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.165+0000 7f5ae1ffb640 1 -- 172.21.15.100:0/3995768164 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae400dc30 con 0x7f5aec15bcf0 2024-09-11T22:20:27.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.165+0000 7f5af3823640 1 -- 172.21.15.100:0/3995768164 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aec0c29b0 con 0x7f5aec15bcf0 2024-09-11T22:20:27.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.167+0000 7f5ae1ffb640 1 -- 172.21.15.100:0/3995768164 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ae401d070 con 0x7f5aec15bcf0 2024-09-11T22:20:27.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.167+0000 7f5ae1ffb640 1 --2- 172.21.15.100:0/3995768164 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5ad006be30 0x7f5ad006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:27.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.167+0000 7f5ae1ffb640 1 -- 172.21.15.100:0/3995768164 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5ae408b9a0 con 0x7f5aec15bcf0 2024-09-11T22:20:27.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.167+0000 7f5af15bf640 1 --2- 172.21.15.100:0/3995768164 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5ad006be30 0x7f5ad006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:27.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.168+0000 7f5af15bf640 1 --2- 172.21.15.100:0/3995768164 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5ad006be30 0x7f5ad006e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8034000 tx=0x7f5ae802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:27.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.168+0000 7f5af65bc740 1 Processor -- start 2024-09-11T22:20:27.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.168+0000 7f5af65bc740 1 -- start start 2024-09-11T22:20:27.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.169+0000 7f5af65bc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576d905d750 0x5576d90959e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:27.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.169+0000 7f5af65bc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905af80 0x5576d9095f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:27.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.169+0000 7f5af65bc740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5576d905db30 0x5576d9059a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:27.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.169+0000 7f5af65bc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5576d8fbe520 con 0x5576d905af80 2024-09-11T22:20:27.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.169+0000 7f5af65bc740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5576d8f663e0 con 0x5576d905d750 2024-09-11T22:20:27.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.169+0000 7f5af65bc740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5576d8fba4e0 con 0x5576d905db30 2024-09-11T22:20:27.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.169+0000 7f5af0dbe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905af80 0x5576d9095f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:27.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.169+0000 7f5af0dbe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905af80 0x5576d9095f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35900/0 (socket says 172.21.15.100:35900) 2024-09-11T22:20:27.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.169+0000 7f5af0dbe640 1 -- 172.21.15.100:0/2789594272 learned_addr learned my addr 172.21.15.100:0/2789594272 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:27.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.169+0000 7f5af15bf640 1 --2- 172.21.15.100:0/2789594272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576d905d750 0x5576d90959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:27.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.169+0000 7f5af1dc0640 1 --2- 172.21.15.100:0/2789594272 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5576d905db30 0x5576d9059a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:27.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.169+0000 7f5af0dbe640 1 -- 172.21.15.100:0/2789594272 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5576d905db30 msgr2=0x5576d9059a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:27.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.169+0000 7f5af0dbe640 1 --2- 172.21.15.100:0/2789594272 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5576d905db30 0x5576d9059a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.169+0000 7f5af0dbe640 1 -- 172.21.15.100:0/2789594272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576d905d750 msgr2=0x5576d90959e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:27.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.169+0000 7f5af0dbe640 1 --2- 172.21.15.100:0/2789594272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576d905d750 0x5576d90959e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.169+0000 7f5af0dbe640 1 -- 172.21.15.100:0/2789594272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576d8f812f0 con 0x5576d905af80 2024-09-11T22:20:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.169+0000 7f5af0dbe640 1 --2- 172.21.15.100:0/2789594272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905af80 0x5576d9095f20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5adc007530 tx=0x7f5adc005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370ffbb5986d5ebe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.169+0000 7f5ad6ffd640 1 -- 172.21.15.100:0/2789594272 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc019070 con 0x5576d905af80 2024-09-11T22:20:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.169+0000 7f5ad6ffd640 1 -- 172.21.15.100:0/2789594272 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5adc001890 con 0x5576d905af80 2024-09-11T22:20:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.169+0000 7f5ad6ffd640 1 -- 172.21.15.100:0/2789594272 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc001c40 con 0x5576d905af80 2024-09-11T22:20:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.170+0000 7f5af65bc740 1 -- 172.21.15.100:0/2789594272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905af80 msgr2=0x5576d9095f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.170+0000 7f5af65bc740 1 --2- 172.21.15.100:0/2789594272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905af80 0x5576d9095f20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5adc007530 tx=0x7f5adc005bc0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.170+0000 7f5af65bc740 1 -- 172.21.15.100:0/2789594272 shutdown_connections 2024-09-11T22:20:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.170+0000 7f5af65bc740 1 --2- 172.21.15.100:0/2789594272 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5576d905db30 0x5576d9059a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.170+0000 7f5af65bc740 1 --2- 172.21.15.100:0/2789594272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905af80 0x5576d9095f20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.170+0000 7f5af65bc740 1 --2- 172.21.15.100:0/2789594272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576d905d750 0x5576d90959e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.170+0000 7f5af65bc740 1 -- 172.21.15.100:0/2789594272 >> 172.21.15.100:0/2789594272 conn(0x5576d905be70 msgr2=0x5576d905c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.170+0000 7f5af65bc740 1 -- 172.21.15.100:0/2789594272 shutdown_connections 2024-09-11T22:20:27.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.170+0000 7f5af65bc740 1 -- 172.21.15.100:0/2789594272 wait complete. 2024-09-11T22:20:27.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.171+0000 7f5af65bc740 1 -- start start 2024-09-11T22:20:27.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.171+0000 7f5af65bc740 1 Processor -- start 2024-09-11T22:20:27.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.171+0000 7f5af65bc740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5576d905af80 0x5576d90ad890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:27.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5af65bc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576d905d750 0x5576d9085710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:27.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5af65bc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905db30 0x5576d907dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:27.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5af65bc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5576d905cfe0 con 0x5576d905db30 2024-09-11T22:20:27.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5af65bc740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5576d8f47450 con 0x5576d905d750 2024-09-11T22:20:27.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5af65bc740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5576d9095550 con 0x5576d905af80 2024-09-11T22:20:27.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5af65bc740 10 client.0 _ll_register_callbacks cb 0x5576d8cd0ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:27.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5af1dc0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905db30 0x5576d907dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:27.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5af1dc0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905db30 0x5576d907dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35906/0 (socket says 172.21.15.100:35906) 2024-09-11T22:20:27.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5af1dc0640 1 -- 172.21.15.100:0/3432310248 learned_addr learned my addr 172.21.15.100:0/3432310248 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:27.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5af0dbe640 1 --2- 172.21.15.100:0/3432310248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576d905d750 0x5576d9085710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:27.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5af15bf640 1 --2- 172.21.15.100:0/3432310248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5576d905af80 0x5576d90ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:27.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5af1dc0640 1 -- 172.21.15.100:0/3432310248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5576d905af80 msgr2=0x5576d90ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:27.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5af1dc0640 1 --2- 172.21.15.100:0/3432310248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5576d905af80 0x5576d90ad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5af1dc0640 1 -- 172.21.15.100:0/3432310248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576d905d750 msgr2=0x5576d9085710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:27.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5af1dc0640 1 --2- 172.21.15.100:0/3432310248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576d905d750 0x5576d9085710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:27.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5af1dc0640 1 -- 172.21.15.100:0/3432310248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576d8cd12d0 con 0x5576d905db30 2024-09-11T22:20:27.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5af1dc0640 1 --2- 172.21.15.100:0/3432310248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905db30 0x5576d907dfd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4062110 tx=0x7f5ae4059b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32a83884b9c480d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:27.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5acbfff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-11T22:20:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5acbfff640 1 -- 172.21.15.100:0/3432310248 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4088060 con 0x5576d905db30 2024-09-11T22:20:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5acbfff640 1 -- 172.21.15.100:0/3432310248 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5ae40621b0 con 0x5576d905db30 2024-09-11T22:20:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5af65bc740 1 -- 172.21.15.100:0/3432310248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5adc001890 con 0x5576d905db30 2024-09-11T22:20:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5acbfff640 1 -- 172.21.15.100:0/3432310248 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f5ae40623d0 con 0x5576d905db30 2024-09-11T22:20:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5af65bc740 10 client.4407 fetch_fsmap learned FSMap version 6 2024-09-11T22:20:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5af65bc740 1 -- 172.21.15.100:0/3432310248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5576d8d9b6b0 con 0x5576d905db30 2024-09-11T22:20:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.172+0000 7f5acbfff640 1 -- 172.21.15.100:0/3432310248 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5adc001890 con 0x5576d905db30 2024-09-11T22:20:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.173+0000 7f5acbfff640 1 -- 172.21.15.100:0/3432310248 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 6) ==== 4720+0+0 (secure 0 0 0) 0x7f5ae40600c0 con 0x5576d905db30 2024-09-11T22:20:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.173+0000 7f5af65bc740 10 client.4407 fetch_fsmap finished waiting for FSMap version 6 2024-09-11T22:20:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.173+0000 7f5af65bc740 10 client.4407 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-11T22:20:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.173+0000 7f5af65bc740 20 client.4407 populate_metadata read hostname 'smithi100' 2024-09-11T22:20:27.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.173+0000 7f5af65bc740 1 --2- 172.21.15.100:0/3432310248 >> [v2:172.21.15.167:6832/1651678197,v1:172.21.15.167:6834/1651678197] conn(0x5576d9084bd0 0x5576d90bb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.173+0000 7f5af65bc740 4 client.4407 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.173+0000 7f5af65bc740 1 -- 172.21.15.100:0/3432310248 --> [v2:172.21.15.167:6832/1651678197,v1:172.21.15.167:6834/1651678197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576d8fcbc50 con 0x5576d9084bd0 2024-09-11T22:20:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.173+0000 7f5af15bf640 1 --2- 172.21.15.100:0/3432310248 >> [v2:172.21.15.167:6832/1651678197,v1:172.21.15.167:6834/1651678197] conn(0x5576d9084bd0 0x5576d90bb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.173+0000 7f5acbfff640 10 client.4407 ms_handle_connect on v2:172.21.15.167:6832/1651678197 2024-09-11T22:20:27.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:27.173+0000 7f5af15bf640 1 --2- 172.21.15.100:0/3432310248 >> [v2:172.21.15.167:6832/1651678197,v1:172.21.15.167:6834/1651678197] conn(0x5576d9084bd0 0x5576d90bb9c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44eed8ff26168404 server_cookie=25b94102b3d1bc37 in_seq=0 out_seq=0 2024-09-11T22:20:29.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.892+0000 7f5acbfff640 1 -- 172.21.15.100:0/3432310248 <== mds.0 v2:172.21.15.167:6832/1651678197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5576d8fcbc50 con 0x5576d9084bd0 2024-09-11T22:20:29.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.892+0000 7f5acbfff640 10 client.4407 handle_command_reply: tid=0 2024-09-11T22:20:29.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.892+0000 7f5af65bc740 1 client.4407 shutdown 2024-09-11T22:20:29.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.892+0000 7f5af65bc740 1 -- 172.21.15.100:0/3432310248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905db30 msgr2=0x5576d907dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:29.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.892+0000 7f5af65bc740 1 --2- 172.21.15.100:0/3432310248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905db30 0x5576d907dfd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4062110 tx=0x7f5ae4059b90 comp rx=0 tx=0).stop 2024-09-11T22:20:29.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.893+0000 7f5af65bc740 1 -- 172.21.15.100:0/3432310248 shutdown_connections 2024-09-11T22:20:29.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.893+0000 7f5af65bc740 1 --2- 172.21.15.100:0/3432310248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905db30 0x5576d907dfd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.893+0000 7f5af65bc740 1 --2- 172.21.15.100:0/3432310248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576d905d750 0x5576d9085710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.893+0000 7f5af65bc740 1 --2- 172.21.15.100:0/3432310248 >> [v2:172.21.15.167:6832/1651678197,v1:172.21.15.167:6834/1651678197] conn(0x5576d9084bd0 0x5576d90bb9c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.893+0000 7f5af65bc740 1 --2- 172.21.15.100:0/3432310248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5576d905af80 0x5576d90ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.893+0000 7f5af65bc740 1 -- 172.21.15.100:0/3432310248 >> 172.21.15.100:0/3432310248 conn(0x5576d905be70 msgr2=0x5576d9095950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.893+0000 7f5acbfff640 0 client.4407 ms_handle_reset on v2:172.21.15.167:6832/1651678197 2024-09-11T22:20:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.893+0000 7f5af65bc740 1 -- 172.21.15.100:0/3432310248 shutdown_connections 2024-09-11T22:20:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.893+0000 7f5af65bc740 1 -- 172.21.15.100:0/3432310248 wait complete. 2024-09-11T22:20:29.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.893+0000 7f5af65bc740 20 client.4407 trim_cache size 0 max 16384 2024-09-11T22:20:29.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.912+0000 7f5af65bc740 1 Processor -- start 2024-09-11T22:20:29.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.912+0000 7f5af65bc740 1 -- start start 2024-09-11T22:20:29.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.913+0000 7f5af65bc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576d905af80 0x5576d90580b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:29.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.913+0000 7f5af65bc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905d750 0x5576d907d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:29.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.913+0000 7f5af65bc740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5576d905db30 0x5576d907de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:29.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.913+0000 7f5af65bc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5aec1fce80 con 0x5576d905d750 2024-09-11T22:20:29.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.913+0000 7f5af65bc740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5576d908eb60 con 0x5576d905af80 2024-09-11T22:20:29.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.913+0000 7f5af65bc740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5576d90823d0 con 0x5576d905db30 2024-09-11T22:20:29.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.913+0000 7f5af0dbe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905d750 0x5576d907d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:29.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.913+0000 7f5af0dbe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905d750 0x5576d907d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35908/0 (socket says 172.21.15.100:35908) 2024-09-11T22:20:29.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.913+0000 7f5af0dbe640 1 -- 172.21.15.100:0/1029234306 learned_addr learned my addr 172.21.15.100:0/1029234306 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:29.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.913+0000 7f5af1dc0640 1 --2- 172.21.15.100:0/1029234306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5576d905db30 0x5576d907de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:29.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.913+0000 7f5af15bf640 1 --2- 172.21.15.100:0/1029234306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576d905af80 0x5576d90580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:29.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.913+0000 7f5af0dbe640 1 -- 172.21.15.100:0/1029234306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5576d905db30 msgr2=0x5576d907de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:29.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.913+0000 7f5af0dbe640 1 --2- 172.21.15.100:0/1029234306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5576d905db30 0x5576d907de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.913+0000 7f5af0dbe640 1 -- 172.21.15.100:0/1029234306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576d905af80 msgr2=0x5576d90580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:29.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.913+0000 7f5af0dbe640 1 --2- 172.21.15.100:0/1029234306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576d905af80 0x5576d90580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.913+0000 7f5af0dbe640 1 -- 172.21.15.100:0/1029234306 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576d905d140 con 0x5576d905d750 2024-09-11T22:20:29.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.913+0000 7f5af1dc0640 1 --2- 172.21.15.100:0/1029234306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5576d905db30 0x5576d907de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:29.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.913+0000 7f5af15bf640 1 --2- 172.21.15.100:0/1029234306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576d905af80 0x5576d90580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:29.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.913+0000 7f5af0dbe640 1 --2- 172.21.15.100:0/1029234306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905d750 0x5576d907d8f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0074d0 tx=0x7f5adc00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b083c0b471d0445 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:29.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.914+0000 7f5ad67fc640 1 -- 172.21.15.100:0/1029234306 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc024070 con 0x5576d905d750 2024-09-11T22:20:29.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.914+0000 7f5ad67fc640 1 -- 172.21.15.100:0/1029234306 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5adc01a040 con 0x5576d905d750 2024-09-11T22:20:29.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.914+0000 7f5ad67fc640 1 -- 172.21.15.100:0/1029234306 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5adc019070 con 0x5576d905d750 2024-09-11T22:20:29.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.914+0000 7f5af65bc740 1 -- 172.21.15.100:0/1029234306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905d750 msgr2=0x5576d907d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:29.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.914+0000 7f5af65bc740 1 --2- 172.21.15.100:0/1029234306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905d750 0x5576d907d8f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0074d0 tx=0x7f5adc00c000 comp rx=0 tx=0).stop 2024-09-11T22:20:29.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.914+0000 7f5af65bc740 1 -- 172.21.15.100:0/1029234306 shutdown_connections 2024-09-11T22:20:29.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.914+0000 7f5af65bc740 1 --2- 172.21.15.100:0/1029234306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5576d905db30 0x5576d907de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.914+0000 7f5af65bc740 1 --2- 172.21.15.100:0/1029234306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905d750 0x5576d907d8f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.914+0000 7f5af65bc740 1 --2- 172.21.15.100:0/1029234306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576d905af80 0x5576d90580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.914+0000 7f5af65bc740 1 -- 172.21.15.100:0/1029234306 >> 172.21.15.100:0/1029234306 conn(0x5576d905be70 msgr2=0x5576d9085470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:29.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.915+0000 7f5af65bc740 1 -- 172.21.15.100:0/1029234306 shutdown_connections 2024-09-11T22:20:29.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.915+0000 7f5af65bc740 1 -- 172.21.15.100:0/1029234306 wait complete. 2024-09-11T22:20:29.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.915+0000 7f5af65bc740 1 -- start start 2024-09-11T22:20:29.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.915+0000 7f5af65bc740 1 Processor -- start 2024-09-11T22:20:29.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.916+0000 7f5af65bc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905af80 0x5576d911edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:29.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.916+0000 7f5af65bc740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5576d905d750 0x5576d907d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:29.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.916+0000 7f5af65bc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576d905db30 0x5576d907dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:29.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.916+0000 7f5af65bc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5576d9084a50 con 0x5576d905af80 2024-09-11T22:20:29.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.916+0000 7f5af65bc740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5576d907e560 con 0x5576d905db30 2024-09-11T22:20:29.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.916+0000 7f5af65bc740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5576d90b0380 con 0x5576d905d750 2024-09-11T22:20:29.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.916+0000 7f5af65bc740 10 client.0 _ll_register_callbacks cb 0x7f5ae4055dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:29.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.916+0000 7f5af15bf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905af80 0x5576d911edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:29.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.916+0000 7f5af15bf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905af80 0x5576d911edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35922/0 (socket says 172.21.15.100:35922) 2024-09-11T22:20:29.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.916+0000 7f5af15bf640 1 -- 172.21.15.100:0/1810883205 learned_addr learned my addr 172.21.15.100:0/1810883205 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:29.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.916+0000 7f5af0dbe640 1 --2- 172.21.15.100:0/1810883205 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5576d905d750 0x5576d907d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:29.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.916+0000 7f5af1dc0640 1 --2- 172.21.15.100:0/1810883205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576d905db30 0x5576d907dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:29.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.917+0000 7f5af15bf640 1 -- 172.21.15.100:0/1810883205 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5576d905d750 msgr2=0x5576d907d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:29.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.917+0000 7f5af15bf640 1 --2- 172.21.15.100:0/1810883205 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5576d905d750 0x5576d907d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.917+0000 7f5af15bf640 1 -- 172.21.15.100:0/1810883205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576d905db30 msgr2=0x5576d907dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:29.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.917+0000 7f5af15bf640 1 --2- 172.21.15.100:0/1810883205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576d905db30 0x5576d907dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.917+0000 7f5af15bf640 1 -- 172.21.15.100:0/1810883205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576d909f790 con 0x5576d905af80 2024-09-11T22:20:29.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.917+0000 7f5af15bf640 1 --2- 172.21.15.100:0/1810883205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905af80 0x5576d911edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009960 tx=0x7f5ae802c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c082533ed6486185 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:29.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.917+0000 7f5acbfff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-11T22:20:29.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.917+0000 7f5acbfff640 1 -- 172.21.15.100:0/1810883205 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8037040 con 0x5576d905af80 2024-09-11T22:20:29.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.917+0000 7f5acbfff640 1 -- 172.21.15.100:0/1810883205 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5ae8056de0 con 0x5576d905af80 2024-09-11T22:20:29.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.917+0000 7f5af65bc740 1 -- 172.21.15.100:0/1810883205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5adc01a040 con 0x5576d905af80 2024-09-11T22:20:29.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.917+0000 7f5acbfff640 1 -- 172.21.15.100:0/1810883205 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f5ae8032850 con 0x5576d905af80 2024-09-11T22:20:29.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.917+0000 7f5af65bc740 10 client.4413 fetch_fsmap learned FSMap version 6 2024-09-11T22:20:29.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.917+0000 7f5af65bc740 1 -- 172.21.15.100:0/1810883205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5576d90a05f0 con 0x5576d905af80 2024-09-11T22:20:29.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.918+0000 7f5acbfff640 1 -- 172.21.15.100:0/1810883205 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5adc01a040 con 0x5576d905af80 2024-09-11T22:20:29.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.918+0000 7f5acbfff640 1 -- 172.21.15.100:0/1810883205 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 6) ==== 4720+0+0 (secure 0 0 0) 0x7f5ae80329f0 con 0x5576d905af80 2024-09-11T22:20:29.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.918+0000 7f5af65bc740 10 client.4413 fetch_fsmap finished waiting for FSMap version 6 2024-09-11T22:20:29.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.918+0000 7f5af65bc740 10 client.4413 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-11T22:20:29.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.918+0000 7f5af65bc740 20 client.4413 populate_metadata read hostname 'smithi100' 2024-09-11T22:20:29.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.918+0000 7f5af65bc740 1 --2- 172.21.15.100:0/1810883205 >> [v2:172.21.15.167:6832/1651678197,v1:172.21.15.167:6834/1651678197] conn(0x5576d911bff0 0x5576d9127f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:29.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.918+0000 7f5af65bc740 4 client.4413 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:20:29.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.918+0000 7f5af65bc740 1 -- 172.21.15.100:0/1810883205 --> [v2:172.21.15.167:6832/1651678197,v1:172.21.15.167:6834/1651678197] -- command(tid 0: {"prefix": "status"}) -- 0x5576d8fc5fa0 con 0x5576d911bff0 2024-09-11T22:20:29.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.918+0000 7f5af0dbe640 1 --2- 172.21.15.100:0/1810883205 >> [v2:172.21.15.167:6832/1651678197,v1:172.21.15.167:6834/1651678197] conn(0x5576d911bff0 0x5576d9127f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:29.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.918+0000 7f5acbfff640 10 client.4413 ms_handle_connect on v2:172.21.15.167:6832/1651678197 2024-09-11T22:20:29.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.918+0000 7f5af0dbe640 1 --2- 172.21.15.100:0/1810883205 >> [v2:172.21.15.167:6832/1651678197,v1:172.21.15.167:6834/1651678197] conn(0x5576d911bff0 0x5576d9127f50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cd73abd19476985 server_cookie=57b80883878f2116 in_seq=0 out_seq=0 2024-09-11T22:20:29.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.919+0000 7f5acbfff640 1 -- 172.21.15.100:0/1810883205 <== mds.0 v2:172.21.15.167:6832/1651678197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5576d8fc5fa0 con 0x5576d911bff0 2024-09-11T22:20:29.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.919+0000 7f5acbfff640 10 client.4413 handle_command_reply: tid=0 2024-09-11T22:20:29.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.919+0000 7f5af65bc740 1 client.4413 shutdown 2024-09-11T22:20:29.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.919+0000 7f5af65bc740 1 -- 172.21.15.100:0/1810883205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905af80 msgr2=0x5576d911edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:29.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.919+0000 7f5af65bc740 1 --2- 172.21.15.100:0/1810883205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905af80 0x5576d911edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009960 tx=0x7f5ae802c070 comp rx=0 tx=0).stop 2024-09-11T22:20:29.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.919+0000 7f5af65bc740 1 -- 172.21.15.100:0/1810883205 shutdown_connections 2024-09-11T22:20:29.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.919+0000 7f5af65bc740 1 --2- 172.21.15.100:0/1810883205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5576d905db30 0x5576d907dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.919+0000 7f5af65bc740 1 --2- 172.21.15.100:0/1810883205 >> [v2:172.21.15.167:6832/1651678197,v1:172.21.15.167:6834/1651678197] conn(0x5576d911bff0 0x5576d9127f50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.919+0000 7f5af65bc740 1 --2- 172.21.15.100:0/1810883205 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5576d905d750 0x5576d907d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.919+0000 7f5af65bc740 1 --2- 172.21.15.100:0/1810883205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576d905af80 0x5576d911edb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.919+0000 7f5acbfff640 0 client.4413 ms_handle_reset on v2:172.21.15.167:6832/1651678197 2024-09-11T22:20:29.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.919+0000 7f5af65bc740 1 -- 172.21.15.100:0/1810883205 >> 172.21.15.100:0/1810883205 conn(0x5576d905be70 msgr2=0x5576d905b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:29.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.919+0000 7f5af65bc740 1 -- 172.21.15.100:0/1810883205 shutdown_connections 2024-09-11T22:20:29.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.919+0000 7f5af65bc740 1 -- 172.21.15.100:0/1810883205 wait complete. 2024-09-11T22:20:29.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.919+0000 7f5af65bc740 20 client.4413 trim_cache size 0 max 16384 2024-09-11T22:20:29.926 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:20:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:20:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-09-11T22:20:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4296, 2024-09-11T22:20:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-11T22:20:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-11T22:20:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-11T22:20:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 10.082831755000001, 2024-09-11T22:20:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 5, 2024-09-11T22:20:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 26, 2024-09-11T22:20:29.926 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 26, 2024-09-11T22:20:29.927 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 16.093952572999999 2024-09-11T22:20:29.927 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:20:29.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.920+0000 7f5af3823640 1 -- 172.21.15.100:0/3995768164 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5ad006be30 msgr2=0x7f5ad006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:29.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.920+0000 7f5af3823640 1 --2- 172.21.15.100:0/3995768164 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5ad006be30 0x7f5ad006e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8034000 tx=0x7f5ae802e000 comp rx=0 tx=0).stop 2024-09-11T22:20:29.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.920+0000 7f5af3823640 1 -- 172.21.15.100:0/3995768164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5aec15bcf0 msgr2=0x7f5aec1f3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:29.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.920+0000 7f5af3823640 1 --2- 172.21.15.100:0/3995768164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5aec15bcf0 0x7f5aec1f3c10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400cf20 tx=0x7f5ae400a7d0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.920+0000 7f5af3823640 1 -- 172.21.15.100:0/3995768164 shutdown_connections 2024-09-11T22:20:29.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.920+0000 7f5af3823640 1 --2- 172.21.15.100:0/3995768164 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5ad006be30 0x7f5ad006e2f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.920+0000 7f5af3823640 1 --2- 172.21.15.100:0/3995768164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5aec15bcf0 0x7f5aec1f3c10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.920+0000 7f5af3823640 1 --2- 172.21.15.100:0/3995768164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5aec1591c0 0x7f5aec1f36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.920+0000 7f5af3823640 1 --2- 172.21.15.100:0/3995768164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5aec152ac0 0x7f5aec151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:29.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.920+0000 7f5af3823640 1 -- 172.21.15.100:0/3995768164 >> 172.21.15.100:0/3995768164 conn(0x7f5aec06ee80 msgr2=0x7f5aec156bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:29.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.920+0000 7f5af3823640 1 -- 172.21.15.100:0/3995768164 shutdown_connections 2024-09-11T22:20:29.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:29.920+0000 7f5af3823640 1 -- 172.21.15.100:0/3995768164 wait complete. 2024-09-11T22:20:29.934 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T22:20:29.934 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-11T22:20:29.934 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T22:20:30.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.038+0000 7f9536eaf640 1 Processor -- start 2024-09-11T22:20:30.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.038+0000 7f9536eaf640 1 -- start start 2024-09-11T22:20:30.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.039+0000 7f9536eaf640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f95300c4fa0 0x7f95301592d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.039+0000 7f9536eaf640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9530159bc0 0x7f9530163010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.039+0000 7f9536eaf640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9530158860 con 0x7f9530152a40 2024-09-11T22:20:30.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.039+0000 7f9536eaf640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f9530158e40 con 0x7f9530159bc0 2024-09-11T22:20:30.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.039+0000 7f9536eaf640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f9530159fc0 con 0x7f95300c4fa0 2024-09-11T22:20:30.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.039+0000 7f953544c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9530159bc0 0x7f9530163010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.039+0000 7f953544c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9530159bc0 0x7f9530163010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35924/0 (socket says 172.21.15.100:35924) 2024-09-11T22:20:30.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.039+0000 7f953544c640 1 -- 172.21.15.100:0/943154939 learned_addr learned my addr 172.21.15.100:0/943154939 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:30.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.040+0000 7f952ffff640 1 --2- 172.21.15.100:0/943154939 >> v2:172.21.15.167:3300/0 conn(0x7f95300c4fa0 0x7f95301592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.040+0000 7f953544c640 1 -- 172.21.15.100:0/943154939 >> v2:172.21.15.167:3300/0 conn(0x7f95300c4fa0 msgr2=0x7f95301592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:30.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.040+0000 7f953544c640 1 --2- 172.21.15.100:0/943154939 >> v2:172.21.15.167:3300/0 conn(0x7f95300c4fa0 0x7f95301592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.040+0000 7f953544c640 1 -- 172.21.15.100:0/943154939 >> v1:172.21.15.167:6789/0 conn(0x7f9530152a40 legacy=0x7f95300c3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.040+0000 7f953544c640 1 -- 172.21.15.100:0/943154939 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95300c8c80 con 0x7f9530159bc0 2024-09-11T22:20:30.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.040+0000 7f952ffff640 1 --2- 172.21.15.100:0/943154939 >> v2:172.21.15.167:3300/0 conn(0x7f95300c4fa0 0x7f95301592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:30.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.040+0000 7f953544c640 1 --2- 172.21.15.100:0/943154939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9530159bc0 0x7f9530163010 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f95300c7ce0 tx=0x7f952802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a30f46f0f3ba4777 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:30.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.041+0000 7f952f7fe640 1 -- 172.21.15.100:0/943154939 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9528037070 con 0x7f9530159bc0 2024-09-11T22:20:30.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.041+0000 7f952f7fe640 1 -- 172.21.15.100:0/943154939 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f952802ae50 con 0x7f9530159bc0 2024-09-11T22:20:30.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.041+0000 7f952f7fe640 1 -- 172.21.15.100:0/943154939 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9528032860 con 0x7f9530159bc0 2024-09-11T22:20:30.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.041+0000 7f9536eaf640 1 -- 172.21.15.100:0/943154939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9530159bc0 msgr2=0x7f9530163010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.041+0000 7f9536eaf640 1 --2- 172.21.15.100:0/943154939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9530159bc0 0x7f9530163010 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f95300c7ce0 tx=0x7f952802a300 comp rx=0 tx=0).stop 2024-09-11T22:20:30.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.041+0000 7f9536eaf640 1 -- 172.21.15.100:0/943154939 shutdown_connections 2024-09-11T22:20:30.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.041+0000 7f9536eaf640 1 --2- 172.21.15.100:0/943154939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9530159bc0 0x7f9530163010 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.041+0000 7f9536eaf640 1 --2- 172.21.15.100:0/943154939 >> v2:172.21.15.167:3300/0 conn(0x7f95300c4fa0 0x7f95301592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.041+0000 7f9536eaf640 1 -- 172.21.15.100:0/943154939 >> 172.21.15.100:0/943154939 conn(0x7f9530073920 msgr2=0x7f9530073d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:30.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.041+0000 7f9536eaf640 1 -- 172.21.15.100:0/943154939 shutdown_connections 2024-09-11T22:20:30.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.041+0000 7f9536eaf640 1 -- 172.21.15.100:0/943154939 wait complete. 2024-09-11T22:20:30.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.042+0000 7f9536eaf640 1 Processor -- start 2024-09-11T22:20:30.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.042+0000 7f9536eaf640 1 -- start start 2024-09-11T22:20:30.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.043+0000 7f9536eaf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95300c4fa0 0x7f9530154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.043+0000 7f9536eaf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9530152a40 0x7f95301eeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.043+0000 7f9536eaf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9530159bc0 0x7f95301ef0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.043+0000 7f9536eaf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f95300c8f60 con 0x7f95300c4fa0 2024-09-11T22:20:30.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.043+0000 7f9536eaf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9530152e20 con 0x7f9530152a40 2024-09-11T22:20:30.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.043+0000 7f9536eaf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f95300c8470 con 0x7f9530159bc0 2024-09-11T22:20:30.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.043+0000 7f9534c4b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95300c4fa0 0x7f9530154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.043+0000 7f9534c4b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95300c4fa0 0x7f9530154740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35928/0 (socket says 172.21.15.100:35928) 2024-09-11T22:20:30.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.043+0000 7f9534c4b640 1 -- 172.21.15.100:0/3833054952 learned_addr learned my addr 172.21.15.100:0/3833054952 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:30.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.043+0000 7f952ffff640 1 --2- 172.21.15.100:0/3833054952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9530152a40 0x7f95301eeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.043+0000 7f953544c640 1 --2- 172.21.15.100:0/3833054952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9530159bc0 0x7f95301ef0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.044+0000 7f9534c4b640 1 -- 172.21.15.100:0/3833054952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9530159bc0 msgr2=0x7f95301ef0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.044+0000 7f9534c4b640 1 --2- 172.21.15.100:0/3833054952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9530159bc0 0x7f95301ef0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.044+0000 7f9534c4b640 1 -- 172.21.15.100:0/3833054952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9530152a40 msgr2=0x7f95301eeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.044+0000 7f9534c4b640 1 --2- 172.21.15.100:0/3833054952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9530152a40 0x7f95301eeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.044+0000 7f9534c4b640 1 -- 172.21.15.100:0/3833054952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9530155f70 con 0x7f95300c4fa0 2024-09-11T22:20:30.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.044+0000 7f9534c4b640 1 --2- 172.21.15.100:0/3833054952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95300c4fa0 0x7f9530154740 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f952000c430 tx=0x7f952000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:30.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.044+0000 7f952d7fa640 1 -- 172.21.15.100:0/3833054952 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95200052d0 con 0x7f95300c4fa0 2024-09-11T22:20:30.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.044+0000 7f952d7fa640 1 -- 172.21.15.100:0/3833054952 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9520005490 con 0x7f95300c4fa0 2024-09-11T22:20:30.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.044+0000 7f952d7fa640 1 -- 172.21.15.100:0/3833054952 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520007260 con 0x7f95300c4fa0 2024-09-11T22:20:30.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.044+0000 7f9536eaf640 1 -- 172.21.15.100:0/3833054952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95301565c0 con 0x7f95300c4fa0 2024-09-11T22:20:30.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.044+0000 7f9536eaf640 1 -- 172.21.15.100:0/3833054952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95300caf10 con 0x7f95300c4fa0 2024-09-11T22:20:30.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.045+0000 7f9536eaf640 1 -- 172.21.15.100:0/3833054952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95301563b0 con 0x7f95300c4fa0 2024-09-11T22:20:30.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.045+0000 7f952d7fa640 1 -- 172.21.15.100:0/3833054952 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9520007400 con 0x7f95300c4fa0 2024-09-11T22:20:30.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.046+0000 7f952d7fa640 1 --2- 172.21.15.100:0/3833054952 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f951c06be30 0x7f951c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:30.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.046+0000 7f952ffff640 1 --2- 172.21.15.100:0/3833054952 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f951c06be30 0x7f951c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:30.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.046+0000 7f952d7fa640 1 -- 172.21.15.100:0/3833054952 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f952008a580 con 0x7f95300c4fa0 2024-09-11T22:20:30.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.046+0000 7f952ffff640 1 --2- 172.21.15.100:0/3833054952 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f951c06be30 0x7f951c06e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f953015acc0 tx=0x7f9524009890 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:30.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.050+0000 7f952d7fa640 1 -- 172.21.15.100:0/3833054952 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9520058630 con 0x7f95300c4fa0 2024-09-11T22:20:30.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.250+0000 7f9536eaf640 1 -- 172.21.15.100:0/3833054952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f953006e7c0 con 0x7f95300c4fa0 2024-09-11T22:20:30.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.250+0000 7f952d7fa640 1 -- 172.21.15.100:0/3833054952 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f952005c930 con 0x7f95300c4fa0 2024-09-11T22:20:30.251 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T22:20:30.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.252+0000 7f9536eaf640 1 -- 172.21.15.100:0/3833054952 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f951c06be30 msgr2=0x7f951c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.252+0000 7f9536eaf640 1 --2- 172.21.15.100:0/3833054952 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f951c06be30 0x7f951c06e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f953015acc0 tx=0x7f9524009890 comp rx=0 tx=0).stop 2024-09-11T22:20:30.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.252+0000 7f9536eaf640 1 -- 172.21.15.100:0/3833054952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95300c4fa0 msgr2=0x7f9530154740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:30.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.252+0000 7f9536eaf640 1 --2- 172.21.15.100:0/3833054952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95300c4fa0 0x7f9530154740 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f952000c430 tx=0x7f952000c8f0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.252+0000 7f9536eaf640 1 -- 172.21.15.100:0/3833054952 shutdown_connections 2024-09-11T22:20:30.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.252+0000 7f9536eaf640 1 --2- 172.21.15.100:0/3833054952 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f951c06be30 0x7f951c06e2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.252+0000 7f9536eaf640 1 --2- 172.21.15.100:0/3833054952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9530159bc0 0x7f95301ef0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.252+0000 7f9536eaf640 1 --2- 172.21.15.100:0/3833054952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9530152a40 0x7f95301eeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.252+0000 7f9536eaf640 1 --2- 172.21.15.100:0/3833054952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95300c4fa0 0x7f9530154740 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:30.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.252+0000 7f9536eaf640 1 -- 172.21.15.100:0/3833054952 >> 172.21.15.100:0/3833054952 conn(0x7f9530073920 msgr2=0x7f953015b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:30.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.252+0000 7f9536eaf640 1 -- 172.21.15.100:0/3833054952 shutdown_connections 2024-09-11T22:20:30.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30.252+0000 7f9536eaf640 1 -- 172.21.15.100:0/3833054952 wait complete. 2024-09-11T22:20:30.263 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T22:20:30.263 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:20:30.264 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-09-11T22:20:30.264 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-11T22:20:30.264 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-11T22:20:30.264 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T22:20:30.264 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T22:20:30.264 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:20:30.264 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-11T22:20:30.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:30.264 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-09-11T22:20:30.280 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:20:30.280 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:20:30.280 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:20:30.280 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:20:30.280 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-09-11T22:20:30.280 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:20:30.280 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:20:30.280 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:20:30.280 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-09-11T22:20:30.280 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:20:30.280 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:20:30.280 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-09-11T22:20:30.281 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:20:30.281 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:20:30.281 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:20:30.281 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:20:30.281 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T22:20:30.281 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42758sec preferred_lft 42758sec 2024-09-11T22:20:30.281 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link noprefixroute 2024-09-11T22:20:30.281 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:20:30.282 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T22:20:30.282 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:20:30.282 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-11T22:20:30.282 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add name ceph-brx type bridge 2024-09-11T22:20:30.282 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr flush dev ceph-brx 2024-09-11T22:20:30.282 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set ceph-brx up 2024-09-11T22:20:30.282 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T22:20:30.282 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-11T22:20:30.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:20:30.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:30.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:30.486 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:20:30.510 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-09-11T22:20:30.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:30.512 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-09-11T22:20:30.591 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-09-11T22:20:30.591 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:20:30.591 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T22:20:30.592 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T22:20:30.592 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:20:30.592 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:20:30.592 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-11T22:20:30.592 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T22:20:30.592 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T22:20:30.592 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T22:20:30.593 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-11T22:20:30.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:20:30.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:30.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:30.894 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-11T22:20:30.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:30.910 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2024-09-11T22:20:30.966 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:20:30.966 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-11T22:20:30.966 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T22:20:30.966 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-11T22:20:30.966 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-11T22:20:31.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:20:31.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:31.087 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-11T22:20:31.087 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:20:31.087 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-11T22:20:31.087 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-11T22:20:31.087 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T22:20:31.087 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-11T22:20:31.087 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-11T22:20:31.087 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-11T22:20:31.088 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-11T22:20:31.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:20:31.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:31.226 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:20:31.226 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-11T22:20:31.226 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-09-11T22:20:31.226 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T22:20:31.226 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-11T22:20:31.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:20:31.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:31.303 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-11T22:20:31.303 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:20:31.303 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-11T22:20:31.318 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-11T22:20:31.319 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:20:31.319 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-11T22:20:31.373 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-09-11T22:20:31.439 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T22:20:31.495 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2024-09-11T22:20:31.495 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2024-09-11T22:20:31.495 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2024-09-11T22:20:31.495 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2024-09-11T22:20:31.495 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2024-09-11T22:20:31.496 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2024-09-11T22:20:31.496 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2024-09-11T22:20:31.496 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2024-09-11T22:20:31.496 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2024-09-11T22:20:31.496 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2024-09-11T22:20:31.496 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2024-09-11T22:20:31.496 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/selinux 2024-09-11T22:20:31.496 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T22:20:31.496 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2024-09-11T22:20:31.496 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2024-09-11T22:20:31.497 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2024-09-11T22:20:31.497 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2024-09-11T22:20:31.497 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T22:20:31.497 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2024-09-11T22:20:31.497 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2024-09-11T22:20:31.497 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T22:20:31.497 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T22:20:31.498 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T22:20:31.498 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2024-09-11T22:20:31.498 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2024-09-11T22:20:31.498 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T22:20:31.498 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T22:20:31.498 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T22:20:31.498 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T22:20:31.498 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2024-09-11T22:20:31.498 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T22:20:31.498 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T22:20:31.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:31.499 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-09-11T22:20:31.550 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T22:20:31.550 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-11T22:20:31.593 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-09-11T22:20:31.617 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T22:20:31.674 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2024-09-11T22:20:31.674 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2024-09-11T22:20:31.674 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2024-09-11T22:20:31.674 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2024-09-11T22:20:31.674 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2024-09-11T22:20:31.674 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2024-09-11T22:20:31.674 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2024-09-11T22:20:31.674 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2024-09-11T22:20:31.674 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2024-09-11T22:20:31.675 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2024-09-11T22:20:31.675 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2024-09-11T22:20:31.675 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/selinux 2024-09-11T22:20:31.675 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T22:20:31.675 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2024-09-11T22:20:31.675 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2024-09-11T22:20:31.675 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2024-09-11T22:20:31.675 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2024-09-11T22:20:31.675 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T22:20:31.675 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2024-09-11T22:20:31.675 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2024-09-11T22:20:31.675 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T22:20:31.675 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T22:20:31.675 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T22:20:31.676 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2024-09-11T22:20:31.676 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2024-09-11T22:20:31.676 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T22:20:31.676 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T22:20:31.676 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T22:20:31.676 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T22:20:31.676 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2024-09-11T22:20:31.676 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T22:20:31.676 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T22:20:31.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:31.676 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-09-11T22:20:31.689 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi100.stderr:2024-09-11T22:20:31.689+0000 7efe73158480 -1 init, newargv = 0x55f22ca34fe0 newargc=15 2024-09-11T22:20:31.689 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi100.stderr:ceph-fuse[41627]: starting ceph client 2024-09-11T22:20:31.697 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi100.stderr:ceph-fuse[41627]: starting fuse 2024-09-11T22:20:31.705 INFO:teuthology.orchestra.run.smithi100.stdout:42 2024-09-11T22:20:31.706 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-09-11T22:20:31.706 DEBUG:teuthology.orchestra.run.smithi100:> sudo stdin-killer -- python3 -c ' 2024-09-11T22:20:31.706 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2024-09-11T22:20:31.706 DEBUG:teuthology.orchestra.run.smithi100:> import re 2024-09-11T22:20:31.706 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-09-11T22:20:31.706 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2024-09-11T22:20:31.706 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-11T22:20:31.706 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2024-09-11T22:20:31.706 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-11T22:20:31.706 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2024-09-11T22:20:31.707 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-11T22:20:31.707 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-11T22:20:31.707 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2024-09-11T22:20:31.707 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2024-09-11T22:20:31.707 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2024-09-11T22:20:31.707 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2024-09-11T22:20:31.707 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-11T22:20:31.707 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2024-09-11T22:20:31.707 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T22:20:31.707 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T22:20:31.707 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T22:20:31.707 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2024-09-11T22:20:31.707 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2024-09-11T22:20:31.707 DEBUG:teuthology.orchestra.run.smithi100:> return f 2024-09-11T22:20:31.707 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T22:20:31.708 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-11T22:20:31.708 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.admin")) 2024-09-11T22:20:31.708 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-09-11T22:20:31.823 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.admin.41627.asok 2024-09-11T22:20:31.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:31.833 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.41627.asok 2024-09-11T22:20:31.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:31.833 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.41627.asok status 2024-09-11T22:20:31.969 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:20:31.969 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2024-09-11T22:20:31.969 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T22:20:31.969 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T22:20:31.970 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "admin", 2024-09-11T22:20:31.970 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2024-09-11T22:20:31.970 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-11T22:20:31.970 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "41627", 2024-09-11T22:20:31.970 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2024-09-11T22:20:31.970 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:20:31.970 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2024-09-11T22:20:31.970 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2024-09-11T22:20:31.970 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4425, 2024-09-11T22:20:31.970 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2024-09-11T22:20:31.970 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2024-09-11T22:20:31.970 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2024-09-11T22:20:31.970 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4425 2024-09-11T22:20:31.971 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:20:31.971 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-09-11T22:20:31.971 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:20:31.971 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-09-11T22:20:31.971 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 4129285348 2024-09-11T22:20:31.971 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:20:31.971 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:20:31.971 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-09-11T22:20:31.971 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:20:31.971 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-09-11T22:20:31.971 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 4129285348 2024-09-11T22:20:31.971 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:20:31.971 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.4425 192.168.0.1:0/4129285348", 2024-09-11T22:20:31.972 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.1:0/4129285348", 2024-09-11T22:20:31.972 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2024-09-11T22:20:31.972 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 5, 2024-09-11T22:20:31.972 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 26, 2024-09-11T22:20:31.972 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2024-09-11T22:20:31.972 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2024-09-11T22:20:31.972 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2024-09-11T22:20:31.972 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:20:31.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:31.978 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2024-09-11T22:20:31.979 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-11T22:20:31.994 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2024-09-11T22:20:31.994 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-11T22:20:31.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:31.994 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-11T22:20:32.060 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-11T22:20:32.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T22:20:32.168 INFO:teuthology.orchestra.run.smithi100.stdout:# file: . 2024-09-11T22:20:32.168 INFO:teuthology.orchestra.run.smithi100.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-11T22:20:32.168 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:32.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:32.174 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:20:32.174 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:20:32.190 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T22:20:32.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.330+0000 7f6dfceb7640 1 Processor -- start 2024-09-11T22:20:32.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.330+0000 7f6dfceb7640 1 -- start start 2024-09-11T22:20:32.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.331+0000 7f6dfceb7640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6df80c3230 0x7f6df80c9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.331+0000 7f6dfceb7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6df80c9da0 0x7f6df815ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.331+0000 7f6dfceb7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6df80ca5c0 con 0x7f6df8154d70 2024-09-11T22:20:32.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.331+0000 7f6dfceb7640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f6df80c43b0 con 0x7f6df80c3230 2024-09-11T22:20:32.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.331+0000 7f6dfceb7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f6df80ae930 con 0x7f6df80c9da0 2024-09-11T22:20:32.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.331+0000 7f6dedd9b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6df80c3230 0x7f6df80c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.331+0000 7f6dedd9b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6df80c3230 0x7f6df80c9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58302/0 (socket says 172.21.15.100:58302) 2024-09-11T22:20:32.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.331+0000 7f6dedd9b640 1 -- 172.21.15.100:0/4000153108 learned_addr learned my addr 172.21.15.100:0/4000153108 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:32.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.331+0000 7f6df6d9d640 1 --2- 172.21.15.100:0/4000153108 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6df80c9da0 0x7f6df815ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.331+0000 7f6dedd9b640 1 -- 172.21.15.100:0/4000153108 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6df80c9da0 msgr2=0x7f6df815ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:32.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.331+0000 7f6dedd9b640 1 --2- 172.21.15.100:0/4000153108 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6df80c9da0 0x7f6df815ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.331+0000 7f6dedd9b640 1 -- 172.21.15.100:0/4000153108 >> v1:172.21.15.167:6789/0 conn(0x7f6df8154d70 legacy=0x7f6df80714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:32.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.331+0000 7f6dedd9b640 1 -- 172.21.15.100:0/4000153108 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df80c3830 con 0x7f6df80c3230 2024-09-11T22:20:32.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.332+0000 7f6dedd9b640 1 --2- 172.21.15.100:0/4000153108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6df80c3230 0x7f6df80c9860 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6de0009870 tx=0x7f6de002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd36d02bbe628697 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:32.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.332+0000 7f6df5d9b640 1 -- 172.21.15.100:0/4000153108 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de0037070 con 0x7f6df80c3230 2024-09-11T22:20:32.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.332+0000 7f6df5d9b640 1 -- 172.21.15.100:0/4000153108 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de002ae50 con 0x7f6df80c3230 2024-09-11T22:20:32.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.332+0000 7f6df5d9b640 1 -- 172.21.15.100:0/4000153108 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de0032860 con 0x7f6df80c3230 2024-09-11T22:20:32.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.332+0000 7f6dfceb7640 1 -- 172.21.15.100:0/4000153108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6df80c3230 msgr2=0x7f6df80c9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.332+0000 7f6dfceb7640 1 --2- 172.21.15.100:0/4000153108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6df80c3230 0x7f6df80c9860 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6de0009870 tx=0x7f6de002a300 comp rx=0 tx=0).stop 2024-09-11T22:20:32.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.332+0000 7f6dfceb7640 1 -- 172.21.15.100:0/4000153108 shutdown_connections 2024-09-11T22:20:32.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.332+0000 7f6dfceb7640 1 --2- 172.21.15.100:0/4000153108 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6df80c9da0 0x7f6df815ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.332+0000 7f6dfceb7640 1 --2- 172.21.15.100:0/4000153108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6df80c3230 0x7f6df80c9860 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.332+0000 7f6dfceb7640 1 -- 172.21.15.100:0/4000153108 >> 172.21.15.100:0/4000153108 conn(0x7f6df806f4c0 msgr2=0x7f6df806f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.333+0000 7f6dfceb7640 1 -- 172.21.15.100:0/4000153108 shutdown_connections 2024-09-11T22:20:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.333+0000 7f6dfceb7640 1 -- 172.21.15.100:0/4000153108 wait complete. 2024-09-11T22:20:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.334+0000 7f6dfceb7640 1 Processor -- start 2024-09-11T22:20:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.334+0000 7f6dfceb7640 1 -- start start 2024-09-11T22:20:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.335+0000 7f6dfceb7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6df80c3230 0x7f6df81f4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.335+0000 7f6dfceb7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6df80c9da0 0x7f6df8150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.335+0000 7f6dfceb7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6df8154d70 0x7f6df81f1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.335+0000 7f6dfceb7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6df80c40d0 con 0x7f6df80c3230 2024-09-11T22:20:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.335+0000 7f6dfceb7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6df80c3df0 con 0x7f6df8154d70 2024-09-11T22:20:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.335+0000 7f6dfceb7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f6df8071bd0 con 0x7f6df80c9da0 2024-09-11T22:20:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.335+0000 7f6df659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6df80c3230 0x7f6df81f4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.335+0000 7f6df659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6df80c3230 0x7f6df81f4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58306/0 (socket says 172.21.15.100:58306) 2024-09-11T22:20:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.335+0000 7f6df659c640 1 -- 172.21.15.100:0/2679099872 learned_addr learned my addr 172.21.15.100:0/2679099872 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.335+0000 7f6df6d9d640 1 --2- 172.21.15.100:0/2679099872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6df8154d70 0x7f6df81f1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.335+0000 7f6dedd9b640 1 --2- 172.21.15.100:0/2679099872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6df80c9da0 0x7f6df8150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.335+0000 7f6df659c640 1 -- 172.21.15.100:0/2679099872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6df80c9da0 msgr2=0x7f6df8150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.335+0000 7f6df659c640 1 --2- 172.21.15.100:0/2679099872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6df80c9da0 0x7f6df8150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.335+0000 7f6df659c640 1 -- 172.21.15.100:0/2679099872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6df8154d70 msgr2=0x7f6df81f1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.335+0000 7f6df659c640 1 --2- 172.21.15.100:0/2679099872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6df8154d70 0x7f6df81f1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.335+0000 7f6df659c640 1 -- 172.21.15.100:0/2679099872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df80ce790 con 0x7f6df80c3230 2024-09-11T22:20:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.335+0000 7f6df659c640 1 --2- 172.21.15.100:0/2679099872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6df80c3230 0x7f6df81f4920 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6de800c3c0 tx=0x7f6de800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.335+0000 7f6def7fe640 1 -- 172.21.15.100:0/2679099872 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de80052d0 con 0x7f6df80c3230 2024-09-11T22:20:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.335+0000 7f6def7fe640 1 -- 172.21.15.100:0/2679099872 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de8005490 con 0x7f6df80c3230 2024-09-11T22:20:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.335+0000 7f6dfceb7640 1 -- 172.21.15.100:0/2679099872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6df80cea70 con 0x7f6df80c3230 2024-09-11T22:20:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.335+0000 7f6def7fe640 1 -- 172.21.15.100:0/2679099872 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de8007260 con 0x7f6df80c3230 2024-09-11T22:20:32.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.335+0000 7f6dfceb7640 1 -- 172.21.15.100:0/2679099872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6df81f4120 con 0x7f6df80c3230 2024-09-11T22:20:32.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.336+0000 7f6dfceb7640 1 -- 172.21.15.100:0/2679099872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6df80c9860 con 0x7f6df80c3230 2024-09-11T22:20:32.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.337+0000 7f6def7fe640 1 -- 172.21.15.100:0/2679099872 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6de8007400 con 0x7f6df80c3230 2024-09-11T22:20:32.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.337+0000 7f6def7fe640 1 --2- 172.21.15.100:0/2679099872 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6dd806be30 0x7f6dd806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.337+0000 7f6dedd9b640 1 --2- 172.21.15.100:0/2679099872 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6dd806be30 0x7f6dd806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.337+0000 7f6def7fe640 1 -- 172.21.15.100:0/2679099872 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6de808a510 con 0x7f6df80c3230 2024-09-11T22:20:32.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.338+0000 7f6dedd9b640 1 --2- 172.21.15.100:0/2679099872 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6dd806be30 0x7f6dd806e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6de0034000 tx=0x7f6de002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:32.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.342+0000 7f6def7fe640 1 -- 172.21.15.100:0/2679099872 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6de80585c0 con 0x7f6df80c3230 2024-09-11T22:20:32.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.516+0000 7f6dfceb7640 1 -- 172.21.15.100:0/2679099872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6df81f4e60 con 0x7f6df80c3230 2024-09-11T22:20:32.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.516+0000 7f6def7fe640 1 -- 172.21.15.100:0/2679099872 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f6de805c8c0 con 0x7f6df80c3230 2024-09-11T22:20:32.517 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-09-11T22:20:32.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.519+0000 7f6dfceb7640 1 -- 172.21.15.100:0/2679099872 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6dd806be30 msgr2=0x7f6dd806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.519+0000 7f6dfceb7640 1 --2- 172.21.15.100:0/2679099872 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6dd806be30 0x7f6dd806e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6de0034000 tx=0x7f6de002e000 comp rx=0 tx=0).stop 2024-09-11T22:20:32.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.519+0000 7f6dfceb7640 1 -- 172.21.15.100:0/2679099872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6df80c3230 msgr2=0x7f6df81f4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.519+0000 7f6dfceb7640 1 --2- 172.21.15.100:0/2679099872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6df80c3230 0x7f6df81f4920 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6de800c3c0 tx=0x7f6de800c880 comp rx=0 tx=0).stop 2024-09-11T22:20:32.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.519+0000 7f6dfceb7640 1 -- 172.21.15.100:0/2679099872 shutdown_connections 2024-09-11T22:20:32.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.519+0000 7f6dfceb7640 1 --2- 172.21.15.100:0/2679099872 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6dd806be30 0x7f6dd806e2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.519+0000 7f6dfceb7640 1 --2- 172.21.15.100:0/2679099872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6df8154d70 0x7f6df81f1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.519+0000 7f6dfceb7640 1 --2- 172.21.15.100:0/2679099872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6df80c9da0 0x7f6df8150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.519+0000 7f6dfceb7640 1 --2- 172.21.15.100:0/2679099872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6df80c3230 0x7f6df81f4920 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.519+0000 7f6dfceb7640 1 -- 172.21.15.100:0/2679099872 >> 172.21.15.100:0/2679099872 conn(0x7f6df806f4c0 msgr2=0x7f6df8153990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:32.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.519+0000 7f6dfceb7640 1 -- 172.21.15.100:0/2679099872 shutdown_connections 2024-09-11T22:20:32.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.519+0000 7f6dfceb7640 1 -- 172.21.15.100:0/2679099872 wait complete. 2024-09-11T22:20:32.530 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:20:32.530 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:20:32.546 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T22:20:32.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.686+0000 7f5451bb7640 1 Processor -- start 2024-09-11T22:20:32.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.686+0000 7f5451bb7640 1 -- start start 2024-09-11T22:20:32.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.686+0000 7f5451bb7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f544c0c7150 0x7f544c0c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.686+0000 7f5451bb7640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f544c0c7530 0x7f544c0c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.686+0000 7f5451bb7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f544c0c90b0 0x7f544c0ae970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.686+0000 7f5451bb7640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f544c15bf60 con 0x7f544c0c7530 2024-09-11T22:20:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.686+0000 7f5451bb7640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f544c0c95b0 con 0x7f544c0c7150 2024-09-11T22:20:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.686+0000 7f5451bb7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f544c15c1b0 con 0x7f544c0c90b0 2024-09-11T22:20:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.687+0000 7f544affd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f544c0c7530 0x7f544c0c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.687+0000 7f544affd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f544c0c7530 0x7f544c0c8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58312/0 (socket says 172.21.15.100:58312) 2024-09-11T22:20:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.687+0000 7f544affd640 1 -- 172.21.15.100:0/1534145368 learned_addr learned my addr 172.21.15.100:0/1534145368 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.687+0000 7f544b7fe640 1 --2- 172.21.15.100:0/1534145368 >> v2:172.21.15.167:3300/0 conn(0x7f544c0c7150 0x7f544c0c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.687+0000 7f544bfff640 1 --2- 172.21.15.100:0/1534145368 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f544c0c90b0 0x7f544c0ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.687+0000 7f544affd640 1 -- 172.21.15.100:0/1534145368 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f544c0c90b0 msgr2=0x7f544c0ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.687+0000 7f544affd640 1 --2- 172.21.15.100:0/1534145368 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f544c0c90b0 0x7f544c0ae970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.687+0000 7f544affd640 1 -- 172.21.15.100:0/1534145368 >> v2:172.21.15.167:3300/0 conn(0x7f544c0c7150 msgr2=0x7f544c0c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:32.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.687+0000 7f544affd640 1 --2- 172.21.15.100:0/1534145368 >> v2:172.21.15.167:3300/0 conn(0x7f544c0c7150 0x7f544c0c7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.687+0000 7f544affd640 1 -- 172.21.15.100:0/1534145368 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544c15c490 con 0x7f544c0c7530 2024-09-11T22:20:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.687+0000 7f544b7fe640 1 --2- 172.21.15.100:0/1534145368 >> v2:172.21.15.167:3300/0 conn(0x7f544c0c7150 0x7f544c0c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.688+0000 7f544affd640 1 --2- 172.21.15.100:0/1534145368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f544c0c7530 0x7f544c0c8b70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f544c0c6c00 tx=0x7f544002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81bf5a4d6c87d1e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.688+0000 7f544a7fc640 1 -- 172.21.15.100:0/1534145368 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5440037070 con 0x7f544c0c7530 2024-09-11T22:20:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.688+0000 7f544a7fc640 1 -- 172.21.15.100:0/1534145368 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5440032440 con 0x7f544c0c7530 2024-09-11T22:20:32.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.688+0000 7f544a7fc640 1 -- 172.21.15.100:0/1534145368 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5440032810 con 0x7f544c0c7530 2024-09-11T22:20:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.688+0000 7f5451bb7640 1 -- 172.21.15.100:0/1534145368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f544c0c7530 msgr2=0x7f544c0c8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.688+0000 7f5451bb7640 1 --2- 172.21.15.100:0/1534145368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f544c0c7530 0x7f544c0c8b70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f544c0c6c00 tx=0x7f544002a270 comp rx=0 tx=0).stop 2024-09-11T22:20:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.688+0000 7f5451bb7640 1 -- 172.21.15.100:0/1534145368 shutdown_connections 2024-09-11T22:20:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.688+0000 7f5451bb7640 1 --2- 172.21.15.100:0/1534145368 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f544c0c90b0 0x7f544c0ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.688+0000 7f5451bb7640 1 --2- 172.21.15.100:0/1534145368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f544c0c7530 0x7f544c0c8b70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.688+0000 7f5451bb7640 1 --2- 172.21.15.100:0/1534145368 >> v2:172.21.15.167:3300/0 conn(0x7f544c0c7150 0x7f544c0c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.688+0000 7f5451bb7640 1 -- 172.21.15.100:0/1534145368 >> 172.21.15.100:0/1534145368 conn(0x7f544c06f360 msgr2=0x7f544c06f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.688+0000 7f5451bb7640 1 -- 172.21.15.100:0/1534145368 shutdown_connections 2024-09-11T22:20:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.688+0000 7f5451bb7640 1 -- 172.21.15.100:0/1534145368 wait complete. 2024-09-11T22:20:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.689+0000 7f5451bb7640 1 Processor -- start 2024-09-11T22:20:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.690+0000 7f5451bb7640 1 -- start start 2024-09-11T22:20:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.690+0000 7f5451bb7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f544c0c7150 0x7f544c14b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.690+0000 7f5451bb7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f544c0c7530 0x7f544c14a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.690+0000 7f5451bb7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f544c0c90b0 0x7f544c159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.690+0000 7f5451bb7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f544c0aeeb0 con 0x7f544c0c7150 2024-09-11T22:20:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.690+0000 7f5451bb7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f544c15ca50 con 0x7f544c0c7530 2024-09-11T22:20:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.690+0000 7f5451bb7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f544c0af030 con 0x7f544c0c90b0 2024-09-11T22:20:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.691+0000 7f544b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f544c0c7150 0x7f544c14b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.691+0000 7f544b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f544c0c7150 0x7f544c14b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58320/0 (socket says 172.21.15.100:58320) 2024-09-11T22:20:32.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.691+0000 7f544b7fe640 1 -- 172.21.15.100:0/3228061578 learned_addr learned my addr 172.21.15.100:0/3228061578 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.691+0000 7f544affd640 1 --2- 172.21.15.100:0/3228061578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f544c0c7530 0x7f544c14a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.691+0000 7f544bfff640 1 --2- 172.21.15.100:0/3228061578 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f544c0c90b0 0x7f544c159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.691+0000 7f544b7fe640 1 -- 172.21.15.100:0/3228061578 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f544c0c90b0 msgr2=0x7f544c159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.691+0000 7f544b7fe640 1 --2- 172.21.15.100:0/3228061578 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f544c0c90b0 0x7f544c159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.691+0000 7f544b7fe640 1 -- 172.21.15.100:0/3228061578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f544c0c7530 msgr2=0x7f544c14a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.691+0000 7f544b7fe640 1 --2- 172.21.15.100:0/3228061578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f544c0c7530 0x7f544c14a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.691+0000 7f544b7fe640 1 -- 172.21.15.100:0/3228061578 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544c149db0 con 0x7f544c0c7150 2024-09-11T22:20:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.691+0000 7f544b7fe640 1 --2- 172.21.15.100:0/3228061578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f544c0c7150 0x7f544c14b910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f543c00e810 tx=0x7f543c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.691+0000 7f5433fff640 1 -- 172.21.15.100:0/3228061578 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f543c00f040 con 0x7f544c0c7150 2024-09-11T22:20:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.691+0000 7f5433fff640 1 -- 172.21.15.100:0/3228061578 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f543c004030 con 0x7f544c0c7150 2024-09-11T22:20:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.691+0000 7f5451bb7640 1 -- 172.21.15.100:0/3228061578 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f544c0c2e80 con 0x7f544c0c7150 2024-09-11T22:20:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.691+0000 7f5433fff640 1 -- 172.21.15.100:0/3228061578 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f543c004400 con 0x7f544c0c7150 2024-09-11T22:20:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.691+0000 7f5451bb7640 1 -- 172.21.15.100:0/3228061578 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f544c15b260 con 0x7f544c0c7150 2024-09-11T22:20:32.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.692+0000 7f5451bb7640 1 -- 172.21.15.100:0/3228061578 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f544c15b690 con 0x7f544c0c7150 2024-09-11T22:20:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.693+0000 7f5433fff640 1 -- 172.21.15.100:0/3228061578 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f543c00c6d0 con 0x7f544c0c7150 2024-09-11T22:20:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.693+0000 7f5433fff640 1 --2- 172.21.15.100:0/3228061578 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f543806be30 0x7f543806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:32.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.693+0000 7f5433fff640 1 -- 172.21.15.100:0/3228061578 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f543c08ace0 con 0x7f544c0c7150 2024-09-11T22:20:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.693+0000 7f544affd640 1 --2- 172.21.15.100:0/3228061578 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f543806be30 0x7f543806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:32.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.694+0000 7f544affd640 1 --2- 172.21.15.100:0/3228061578 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f543806be30 0x7f543806e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5440034000 tx=0x7f544002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:32.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.697+0000 7f5433fff640 1 -- 172.21.15.100:0/3228061578 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f543c017020 con 0x7f544c0c7150 2024-09-11T22:20:32.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.872+0000 7f5451bb7640 1 -- 172.21.15.100:0/3228061578 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f544c0c7ab0 con 0x7f544c0c7150 2024-09-11T22:20:32.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.872+0000 7f5433fff640 1 -- 172.21.15.100:0/3228061578 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f543c058d90 con 0x7f544c0c7150 2024-09-11T22:20:32.873 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-09-11T22:20:32.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.874+0000 7f5451bb7640 1 -- 172.21.15.100:0/3228061578 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f543806be30 msgr2=0x7f543806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.874+0000 7f5451bb7640 1 --2- 172.21.15.100:0/3228061578 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f543806be30 0x7f543806e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5440034000 tx=0x7f544002e000 comp rx=0 tx=0).stop 2024-09-11T22:20:32.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.874+0000 7f5451bb7640 1 -- 172.21.15.100:0/3228061578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f544c0c7150 msgr2=0x7f544c14b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:32.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.874+0000 7f5451bb7640 1 --2- 172.21.15.100:0/3228061578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f544c0c7150 0x7f544c14b910 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f543c00e810 tx=0x7f543c00ecd0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.874+0000 7f5451bb7640 1 -- 172.21.15.100:0/3228061578 shutdown_connections 2024-09-11T22:20:32.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.874+0000 7f5451bb7640 1 --2- 172.21.15.100:0/3228061578 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f543806be30 0x7f543806e2f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.874+0000 7f5451bb7640 1 --2- 172.21.15.100:0/3228061578 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f544c0c90b0 0x7f544c159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.874+0000 7f5451bb7640 1 --2- 172.21.15.100:0/3228061578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f544c0c7530 0x7f544c14a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.874+0000 7f5451bb7640 1 --2- 172.21.15.100:0/3228061578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f544c0c7150 0x7f544c14b910 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:32.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.874+0000 7f5451bb7640 1 -- 172.21.15.100:0/3228061578 >> 172.21.15.100:0/3228061578 conn(0x7f544c06f360 msgr2=0x7f544c0c9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:32.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.874+0000 7f5451bb7640 1 -- 172.21.15.100:0/3228061578 shutdown_connections 2024-09-11T22:20:32.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:32.874+0000 7f5451bb7640 1 -- 172.21.15.100:0/3228061578 wait complete. 2024-09-11T22:20:32.885 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2024-09-11T22:20:32.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:32.886 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-11T22:20:32.909 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi100.stderr:ceph-fuse[41627]: fuse finished with error 0 and tester_r 0 2024-09-11T22:20:32.911 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:20:34.818 INFO:tasks.ceph.mds.f.smithi167.stderr:2024-09-11T22:20:34.818+0000 7fcf973ca640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T22:20:39.013 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-09-11T22:20:39.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:39.013 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-11T22:20:39.340 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:20:39.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.450+0000 7f55960c9640 1 Processor -- start 2024-09-11T22:20:39.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.450+0000 7f55960c9640 1 -- start start 2024-09-11T22:20:39.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.451+0000 7f55960c9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f559006e140 0x7f5590067950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.451+0000 7f55960c9640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5590067e90 0x7f559015ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.451+0000 7f55960c9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f559006d100 con 0x7f5590154710 2024-09-11T22:20:39.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.451+0000 7f55960c9640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f559006ced0 con 0x7f5590067e90 2024-09-11T22:20:39.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.451+0000 7f55960c9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f559006d3c0 con 0x7f559006e140 2024-09-11T22:20:39.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.451+0000 7f558ffff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5590067e90 0x7f559015ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.451+0000 7f558ffff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5590067e90 0x7f559015ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58326/0 (socket says 172.21.15.100:58326) 2024-09-11T22:20:39.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.451+0000 7f558ffff640 1 -- 172.21.15.100:0/155876716 learned_addr learned my addr 172.21.15.100:0/155876716 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:39.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.451+0000 7f5587fff640 1 --2- 172.21.15.100:0/155876716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f559006e140 0x7f5590067950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.451+0000 7f558ffff640 1 -- 172.21.15.100:0/155876716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f559006e140 msgr2=0x7f5590067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:39.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.451+0000 7f558ffff640 1 --2- 172.21.15.100:0/155876716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f559006e140 0x7f5590067950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.451+0000 7f558ffff640 1 -- 172.21.15.100:0/155876716 >> v1:172.21.15.167:6789/0 conn(0x7f5590154710 legacy=0x7f55900c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:39.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.451+0000 7f558ffff640 1 -- 172.21.15.100:0/155876716 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559015ab50 con 0x7f5590067e90 2024-09-11T22:20:39.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.452+0000 7f558ffff640 1 --2- 172.21.15.100:0/155876716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5590067e90 0x7f559015ddf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5588009e50 tx=0x7f558802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dec7d0d2a5b7558 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:39.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.452+0000 7f558effd640 1 -- 172.21.15.100:0/155876716 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5588036070 con 0x7f5590067e90 2024-09-11T22:20:39.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.452+0000 7f558effd640 1 -- 172.21.15.100:0/155876716 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5588031600 con 0x7f5590067e90 2024-09-11T22:20:39.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.452+0000 7f558effd640 1 -- 172.21.15.100:0/155876716 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55880319d0 con 0x7f5590067e90 2024-09-11T22:20:39.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.453+0000 7f55960c9640 1 -- 172.21.15.100:0/155876716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5590067e90 msgr2=0x7f559015ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:39.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.453+0000 7f55960c9640 1 --2- 172.21.15.100:0/155876716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5590067e90 0x7f559015ddf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5588009e50 tx=0x7f558802a7a0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.453+0000 7f55960c9640 1 -- 172.21.15.100:0/155876716 shutdown_connections 2024-09-11T22:20:39.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.453+0000 7f55960c9640 1 --2- 172.21.15.100:0/155876716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5590067e90 0x7f559015ddf0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.453+0000 7f55960c9640 1 --2- 172.21.15.100:0/155876716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f559006e140 0x7f5590067950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.453+0000 7f55960c9640 1 -- 172.21.15.100:0/155876716 >> 172.21.15.100:0/155876716 conn(0x7f5590070b80 msgr2=0x7f55900ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:39.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.453+0000 7f55960c9640 1 -- 172.21.15.100:0/155876716 shutdown_connections 2024-09-11T22:20:39.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.453+0000 7f55960c9640 1 -- 172.21.15.100:0/155876716 wait complete. 2024-09-11T22:20:39.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.454+0000 7f55960c9640 1 Processor -- start 2024-09-11T22:20:39.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.454+0000 7f55960c9640 1 -- start start 2024-09-11T22:20:39.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.455+0000 7f55960c9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5590067e90 0x7f559014fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.455+0000 7f55960c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f559006e140 0x7f559015e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.455+0000 7f55960c9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5590154710 0x7f55901f01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.455+0000 7f55960c9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f559015b3f0 con 0x7f5590154710 2024-09-11T22:20:39.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.455+0000 7f55960c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f559015b110 con 0x7f559006e140 2024-09-11T22:20:39.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.455+0000 7f55960c9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f559015a800 con 0x7f5590067e90 2024-09-11T22:20:39.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.455+0000 7f558ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5590154710 0x7f55901f01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.455+0000 7f558ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5590154710 0x7f55901f01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58342/0 (socket says 172.21.15.100:58342) 2024-09-11T22:20:39.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.455+0000 7f558ffff640 1 -- 172.21.15.100:0/1465124499 learned_addr learned my addr 172.21.15.100:0/1465124499 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:39.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.455+0000 7f558f7fe640 1 --2- 172.21.15.100:0/1465124499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5590067e90 0x7f559014fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.455+0000 7f5587fff640 1 --2- 172.21.15.100:0/1465124499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f559006e140 0x7f559015e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.455+0000 7f558ffff640 1 -- 172.21.15.100:0/1465124499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5590067e90 msgr2=0x7f559014fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:39.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.455+0000 7f558ffff640 1 --2- 172.21.15.100:0/1465124499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5590067e90 0x7f559014fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.455+0000 7f558ffff640 1 -- 172.21.15.100:0/1465124499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f559006e140 msgr2=0x7f559015e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:39.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.455+0000 7f558ffff640 1 --2- 172.21.15.100:0/1465124499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f559006e140 0x7f559015e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.455+0000 7f558ffff640 1 -- 172.21.15.100:0/1465124499 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55900cd160 con 0x7f5590154710 2024-09-11T22:20:39.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.455+0000 7f558ffff640 1 --2- 172.21.15.100:0/1465124499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5590154710 0x7f55901f01e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5588009e50 tx=0x7f5588004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:39.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.455+0000 7f558cff9640 1 -- 172.21.15.100:0/1465124499 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5588036050 con 0x7f5590154710 2024-09-11T22:20:39.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.455+0000 7f558cff9640 1 -- 172.21.15.100:0/1465124499 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5588042070 con 0x7f5590154710 2024-09-11T22:20:39.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.455+0000 7f55960c9640 1 -- 172.21.15.100:0/1465124499 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55900cce80 con 0x7f5590154710 2024-09-11T22:20:39.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.455+0000 7f558cff9640 1 -- 172.21.15.100:0/1465124499 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5588009510 con 0x7f5590154710 2024-09-11T22:20:39.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.455+0000 7f55960c9640 1 -- 172.21.15.100:0/1465124499 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f559014f740 con 0x7f5590154710 2024-09-11T22:20:39.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.456+0000 7f55960c9640 1 -- 172.21.15.100:0/1465124499 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f559014f980 con 0x7f5590154710 2024-09-11T22:20:39.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.457+0000 7f558cff9640 1 -- 172.21.15.100:0/1465124499 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5588007b30 con 0x7f5590154710 2024-09-11T22:20:39.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.457+0000 7f558cff9640 1 --2- 172.21.15.100:0/1465124499 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f557006be30 0x7f557006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.457+0000 7f558cff9640 1 -- 172.21.15.100:0/1465124499 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f55880abf20 con 0x7f5590154710 2024-09-11T22:20:39.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.457+0000 7f558f7fe640 1 --2- 172.21.15.100:0/1465124499 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f557006be30 0x7f557006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.458+0000 7f558f7fe640 1 --2- 172.21.15.100:0/1465124499 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f557006be30 0x7f557006e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5580001780 tx=0x7f5580009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:39.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.462+0000 7f558cff9640 1 -- 172.21.15.100:0/1465124499 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5588007e20 con 0x7f5590154710 2024-09-11T22:20:39.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.625+0000 7f55960c9640 1 -- 172.21.15.100:0/1465124499 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5590154af0 con 0x7f5590154710 2024-09-11T22:20:39.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.627+0000 7f558cff9640 1 -- 172.21.15.100:0/1465124499 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18646 (secure 0 0 0) 0x7f5588079eb0 con 0x7f5590154710 2024-09-11T22:20:39.627 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:39.628 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":26,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","created":"2024-09-11T22:19:56.198855+0000","modified":"2024-09-11T22:20:24.213024+0000","last_up_change":"2024-09-11T22:20:07.328863+0000","last_in_change":"2024-09-11T22:19:58.294227+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:20:08.333538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:20:16.995279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:20:18.147950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:20:21.873694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5de0ba54-34c5-4343-b19a-1f675efc49c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6809","nonce":2008454847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6811","nonce":2008454847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6815","nonce":2008454847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6813","nonce":2008454847}]},"public_addr":"172.21.15.100:6809/2008454847","cluster_addr":"172.21.15.100:6811/2008454847","heartbeat_back_addr":"172.21.15.100:6815/2008454847","heartbeat_front_addr":"172.21.15.100:6813/2008454847","state":["exists","up"]},{"osd":1,"uuid":"5a1f6456-6604-4b41-b9b9-52ae8d6616ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6801","nonce":1802107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6803","nonce":1802107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6807","nonce":1802107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6805","nonce":1802107101}]},"public_addr":"172.21.15.100:6801/1802107101","cluster_addr":"172.21.15.100:6803/1802107101","heartbeat_back_addr":"172.21.15.100:6807/1802107101","heartbeat_front_addr":"172.21.15.100:6805/1802107101","state":["exists","up"]},{"osd":2,"uuid":"a604cb26-7b0f-402d-b6ac-3652884b4b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6817","nonce":644491349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6819","nonce":644491349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6823","nonce":644491349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6821","nonce":644491349}]},"public_addr":"172.21.15.100:6817/644491349","cluster_addr":"172.21.15.100:6819/644491349","heartbeat_back_addr":"172.21.15.100:6823/644491349","heartbeat_front_addr":"172.21.15.100:6821/644491349","state":["exists","up"]},{"osd":3,"uuid":"73dc2cbb-70ff-4d12-ba2f-8778a49892f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6825","nonce":2519160882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6827","nonce":2519160882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6831","nonce":2519160882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6829","nonce":2519160882}]},"public_addr":"172.21.15.100:6825/2519160882","cluster_addr":"172.21.15.100:6827/2519160882","heartbeat_back_addr":"172.21.15.100:6831/2519160882","heartbeat_front_addr":"172.21.15.100:6829/2519160882","state":["exists","up"]},{"osd":4,"uuid":"07960648-04df-4aec-a72c-c29e28b74bcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6817","nonce":736010951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6819","nonce":736010951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6823","nonce":736010951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6821","nonce":736010951}]},"public_addr":"172.21.15.167:6817/736010951","cluster_addr":"172.21.15.167:6819/736010951","heartbeat_back_addr":"172.21.15.167:6823/736010951","heartbeat_front_addr":"172.21.15.167:6821/736010951","state":["exists","up"]},{"osd":5,"uuid":"2b4767e6-cab7-4b45-9150-55432f5576aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6825","nonce":2479173909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6827","nonce":2479173909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6831","nonce":2479173909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6829","nonce":2479173909}]},"public_addr":"172.21.15.167:6825/2479173909","cluster_addr":"172.21.15.167:6827/2479173909","heartbeat_back_addr":"172.21.15.167:6831/2479173909","heartbeat_front_addr":"172.21.15.167:6829/2479173909","state":["exists","up"]},{"osd":6,"uuid":"4ef2c4b5-52f4-4f69-8fca-2334077ed8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6809","nonce":2825112504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6811","nonce":2825112504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6815","nonce":2825112504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6813","nonce":2825112504}]},"public_addr":"172.21.15.167:6809/2825112504","cluster_addr":"172.21.15.167:6811/2825112504","heartbeat_back_addr":"172.21.15.167:6815/2825112504","heartbeat_front_addr":"172.21.15.167:6813/2825112504","state":["exists","up"]},{"osd":7,"uuid":"761673d8-d6fc-4ded-a9f3-d49ab8f7c969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337015843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337015843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337015843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337015843}]},"public_addr":"172.21.15.167:6801/1337015843","cluster_addr":"172.21.15.167:6803/1337015843","heartbeat_back_addr":"172.21.15.167:6807/1337015843","heartbeat_front_addr":"172.21.15.167:6805/1337015843","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.833280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.080311+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.100648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.544261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.670353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.880921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.365441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.366659+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:20:39.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.629+0000 7f55960c9640 1 -- 172.21.15.100:0/1465124499 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f557006be30 msgr2=0x7f557006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:39.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.629+0000 7f55960c9640 1 --2- 172.21.15.100:0/1465124499 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f557006be30 0x7f557006e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5580001780 tx=0x7f5580009040 comp rx=0 tx=0).stop 2024-09-11T22:20:39.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.629+0000 7f55960c9640 1 -- 172.21.15.100:0/1465124499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5590154710 msgr2=0x7f55901f01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:39.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.629+0000 7f55960c9640 1 --2- 172.21.15.100:0/1465124499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5590154710 0x7f55901f01e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5588009e50 tx=0x7f5588004a40 comp rx=0 tx=0).stop 2024-09-11T22:20:39.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.629+0000 7f55960c9640 1 -- 172.21.15.100:0/1465124499 shutdown_connections 2024-09-11T22:20:39.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.629+0000 7f55960c9640 1 --2- 172.21.15.100:0/1465124499 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f557006be30 0x7f557006e2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.629+0000 7f55960c9640 1 --2- 172.21.15.100:0/1465124499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5590154710 0x7f55901f01e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.629+0000 7f55960c9640 1 --2- 172.21.15.100:0/1465124499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f559006e140 0x7f559015e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.629+0000 7f55960c9640 1 --2- 172.21.15.100:0/1465124499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5590067e90 0x7f559014fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.629+0000 7f55960c9640 1 -- 172.21.15.100:0/1465124499 >> 172.21.15.100:0/1465124499 conn(0x7f5590070b80 msgr2=0x7f55901589a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:39.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.629+0000 7f55960c9640 1 -- 172.21.15.100:0/1465124499 shutdown_connections 2024-09-11T22:20:39.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.629+0000 7f55960c9640 1 -- 172.21.15.100:0/1465124499 wait complete. 2024-09-11T22:20:39.641 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:20:39.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.738+0000 7f1e9b9fd640 1 Processor -- start 2024-09-11T22:20:39.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.738+0000 7f1e9b9fd640 1 -- start start 2024-09-11T22:20:39.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.739+0000 7f1e9b9fd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1e940c8570 0x7f1e940c0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.739+0000 7f1e9b9fd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1e940c2de0 0x7f1e940c14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.739+0000 7f1e9b9fd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e940c1ec0 con 0x7f1e94151ae0 2024-09-11T22:20:39.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.739+0000 7f1e9b9fd640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f1e94071f50 con 0x7f1e940c2de0 2024-09-11T22:20:39.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.739+0000 7f1e9b9fd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f1e94072230 con 0x7f1e940c8570 2024-09-11T22:20:39.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.739+0000 7f1e99f9a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1e940c2de0 0x7f1e940c14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.739+0000 7f1e99f9a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1e940c2de0 0x7f1e940c14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58350/0 (socket says 172.21.15.100:58350) 2024-09-11T22:20:39.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.739+0000 7f1e99f9a640 1 -- 172.21.15.100:0/3406456135 learned_addr learned my addr 172.21.15.100:0/3406456135 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:39.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.739+0000 7f1e98f98640 1 --2- 172.21.15.100:0/3406456135 >> v2:172.21.15.167:3300/0 conn(0x7f1e940c8570 0x7f1e940c0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.739+0000 7f1e99f9a640 1 -- 172.21.15.100:0/3406456135 >> v2:172.21.15.167:3300/0 conn(0x7f1e940c8570 msgr2=0x7f1e940c0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:39.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.739+0000 7f1e99f9a640 1 --2- 172.21.15.100:0/3406456135 >> v2:172.21.15.167:3300/0 conn(0x7f1e940c8570 0x7f1e940c0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.739+0000 7f1e99f9a640 1 -- 172.21.15.100:0/3406456135 >> v1:172.21.15.167:6789/0 conn(0x7f1e94151ae0 legacy=0x7f1e94071780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:39.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.739+0000 7f1e99f9a640 1 -- 172.21.15.100:0/3406456135 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e940c2160 con 0x7f1e940c2de0 2024-09-11T22:20:39.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.740+0000 7f1e99f9a640 1 --2- 172.21.15.100:0/3406456135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e940c2de0 0x7f1e940c14d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1e940c1e70 tx=0x7f1e8c02c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699f0af2ea96802 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:39.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.740+0000 7f1e8bfff640 1 -- 172.21.15.100:0/3406456135 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c00b2e0 con 0x7f1e940c2de0 2024-09-11T22:20:39.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.740+0000 7f1e8bfff640 1 -- 172.21.15.100:0/3406456135 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e8c037070 con 0x7f1e940c2de0 2024-09-11T22:20:39.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.740+0000 7f1e8bfff640 1 -- 172.21.15.100:0/3406456135 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c00b480 con 0x7f1e940c2de0 2024-09-11T22:20:39.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.741+0000 7f1e9b9fd640 1 -- 172.21.15.100:0/3406456135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e940c2de0 msgr2=0x7f1e940c14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:39.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.741+0000 7f1e9b9fd640 1 --2- 172.21.15.100:0/3406456135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e940c2de0 0x7f1e940c14d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1e940c1e70 tx=0x7f1e8c02c940 comp rx=0 tx=0).stop 2024-09-11T22:20:39.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.741+0000 7f1e9b9fd640 1 -- 172.21.15.100:0/3406456135 shutdown_connections 2024-09-11T22:20:39.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.741+0000 7f1e9b9fd640 1 --2- 172.21.15.100:0/3406456135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e940c2de0 0x7f1e940c14d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.741+0000 7f1e9b9fd640 1 --2- 172.21.15.100:0/3406456135 >> v2:172.21.15.167:3300/0 conn(0x7f1e940c8570 0x7f1e940c0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.741+0000 7f1e9b9fd640 1 -- 172.21.15.100:0/3406456135 >> 172.21.15.100:0/3406456135 conn(0x7f1e940cbf70 msgr2=0x7f1e940cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:39.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.741+0000 7f1e9b9fd640 1 -- 172.21.15.100:0/3406456135 shutdown_connections 2024-09-11T22:20:39.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.741+0000 7f1e9b9fd640 1 -- 172.21.15.100:0/3406456135 wait complete. 2024-09-11T22:20:39.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.742+0000 7f1e9b9fd640 1 Processor -- start 2024-09-11T22:20:39.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.742+0000 7f1e9b9fd640 1 -- start start 2024-09-11T22:20:39.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.743+0000 7f1e9b9fd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e940c2de0 0x7f1e9414c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.743+0000 7f1e9b9fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e940c8570 0x7f1e94153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.743+0000 7f1e9b9fd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e94151ae0 0x7f1e941544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.743+0000 7f1e9b9fd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9406bc10 con 0x7f1e94151ae0 2024-09-11T22:20:39.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.743+0000 7f1e9b9fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1e940c2720 con 0x7f1e940c8570 2024-09-11T22:20:39.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.743+0000 7f1e9b9fd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1e9406bd90 con 0x7f1e940c2de0 2024-09-11T22:20:39.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.743+0000 7f1e99f9a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e94151ae0 0x7f1e941544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.743+0000 7f1e99f9a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e94151ae0 0x7f1e941544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58358/0 (socket says 172.21.15.100:58358) 2024-09-11T22:20:39.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.743+0000 7f1e99f9a640 1 -- 172.21.15.100:0/2497752496 learned_addr learned my addr 172.21.15.100:0/2497752496 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:39.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.743+0000 7f1e99799640 1 --2- 172.21.15.100:0/2497752496 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e940c2de0 0x7f1e9414c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.743+0000 7f1e98f98640 1 --2- 172.21.15.100:0/2497752496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e940c8570 0x7f1e94153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.743+0000 7f1e99f9a640 1 -- 172.21.15.100:0/2497752496 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e940c2de0 msgr2=0x7f1e9414c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:39.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.743+0000 7f1e99f9a640 1 --2- 172.21.15.100:0/2497752496 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e940c2de0 0x7f1e9414c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.743+0000 7f1e99f9a640 1 -- 172.21.15.100:0/2497752496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e940c8570 msgr2=0x7f1e94153fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:39.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.743+0000 7f1e99f9a640 1 --2- 172.21.15.100:0/2497752496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e940c8570 0x7f1e94153fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.743+0000 7f1e99f9a640 1 -- 172.21.15.100:0/2497752496 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e940caff0 con 0x7f1e94151ae0 2024-09-11T22:20:39.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.743+0000 7f1e99f9a640 1 --2- 172.21.15.100:0/2497752496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e94151ae0 0x7f1e941544f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c00d240 tx=0x7f1e8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:39.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.743+0000 7f1e89ffb640 1 -- 172.21.15.100:0/2497752496 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c047680 con 0x7f1e94151ae0 2024-09-11T22:20:39.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.743+0000 7f1e89ffb640 1 -- 172.21.15.100:0/2497752496 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e8c047820 con 0x7f1e94151ae0 2024-09-11T22:20:39.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.743+0000 7f1e9b9fd640 1 -- 172.21.15.100:0/2497752496 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e940cb290 con 0x7f1e94151ae0 2024-09-11T22:20:39.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.743+0000 7f1e89ffb640 1 -- 172.21.15.100:0/2497752496 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c047c10 con 0x7f1e94151ae0 2024-09-11T22:20:39.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.744+0000 7f1e9b9fd640 1 -- 172.21.15.100:0/2497752496 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e9414ed90 con 0x7f1e94151ae0 2024-09-11T22:20:39.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.744+0000 7f1e9b9fd640 1 -- 172.21.15.100:0/2497752496 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e9406c120 con 0x7f1e94151ae0 2024-09-11T22:20:39.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.745+0000 7f1e89ffb640 1 -- 172.21.15.100:0/2497752496 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1e8c032430 con 0x7f1e94151ae0 2024-09-11T22:20:39.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.745+0000 7f1e89ffb640 1 --2- 172.21.15.100:0/2497752496 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1e7806be30 0x7f1e7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:39.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.745+0000 7f1e89ffb640 1 -- 172.21.15.100:0/2497752496 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1e8c0ae560 con 0x7f1e94151ae0 2024-09-11T22:20:39.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.745+0000 7f1e99799640 1 --2- 172.21.15.100:0/2497752496 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1e7806be30 0x7f1e7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:39.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.746+0000 7f1e99799640 1 --2- 172.21.15.100:0/2497752496 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1e7806be30 0x7f1e7806e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1e900016e0 tx=0x7f1e90009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:39.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.750+0000 7f1e89ffb640 1 -- 172.21.15.100:0/2497752496 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1e8c07c580 con 0x7f1e94151ae0 2024-09-11T22:20:39.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.918+0000 7f1e9b9fd640 1 -- 172.21.15.100:0/2497752496 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e940b20f0 con 0x7f1e94151ae0 2024-09-11T22:20:39.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.919+0000 7f1e89ffb640 1 -- 172.21.15.100:0/2497752496 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18646 (secure 0 0 0) 0x7f1e8c080880 con 0x7f1e94151ae0 2024-09-11T22:20:39.920 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:39.920 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":26,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","created":"2024-09-11T22:19:56.198855+0000","modified":"2024-09-11T22:20:24.213024+0000","last_up_change":"2024-09-11T22:20:07.328863+0000","last_in_change":"2024-09-11T22:19:58.294227+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:20:08.333538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:20:16.995279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:20:18.147950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:20:21.873694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5de0ba54-34c5-4343-b19a-1f675efc49c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6809","nonce":2008454847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6811","nonce":2008454847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6815","nonce":2008454847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6813","nonce":2008454847}]},"public_addr":"172.21.15.100:6809/2008454847","cluster_addr":"172.21.15.100:6811/2008454847","heartbeat_back_addr":"172.21.15.100:6815/2008454847","heartbeat_front_addr":"172.21.15.100:6813/2008454847","state":["exists","up"]},{"osd":1,"uuid":"5a1f6456-6604-4b41-b9b9-52ae8d6616ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6801","nonce":1802107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6803","nonce":1802107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6807","nonce":1802107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6805","nonce":1802107101}]},"public_addr":"172.21.15.100:6801/1802107101","cluster_addr":"172.21.15.100:6803/1802107101","heartbeat_back_addr":"172.21.15.100:6807/1802107101","heartbeat_front_addr":"172.21.15.100:6805/1802107101","state":["exists","up"]},{"osd":2,"uuid":"a604cb26-7b0f-402d-b6ac-3652884b4b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6817","nonce":644491349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6819","nonce":644491349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6823","nonce":644491349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6821","nonce":644491349}]},"public_addr":"172.21.15.100:6817/644491349","cluster_addr":"172.21.15.100:6819/644491349","heartbeat_back_addr":"172.21.15.100:6823/644491349","heartbeat_front_addr":"172.21.15.100:6821/644491349","state":["exists","up"]},{"osd":3,"uuid":"73dc2cbb-70ff-4d12-ba2f-8778a49892f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6825","nonce":2519160882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6827","nonce":2519160882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6831","nonce":2519160882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6829","nonce":2519160882}]},"public_addr":"172.21.15.100:6825/2519160882","cluster_addr":"172.21.15.100:6827/2519160882","heartbeat_back_addr":"172.21.15.100:6831/2519160882","heartbeat_front_addr":"172.21.15.100:6829/2519160882","state":["exists","up"]},{"osd":4,"uuid":"07960648-04df-4aec-a72c-c29e28b74bcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6817","nonce":736010951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6819","nonce":736010951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6823","nonce":736010951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6821","nonce":736010951}]},"public_addr":"172.21.15.167:6817/736010951","cluster_addr":"172.21.15.167:6819/736010951","heartbeat_back_addr":"172.21.15.167:6823/736010951","heartbeat_front_addr":"172.21.15.167:6821/736010951","state":["exists","up"]},{"osd":5,"uuid":"2b4767e6-cab7-4b45-9150-55432f5576aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6825","nonce":2479173909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6827","nonce":2479173909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6831","nonce":2479173909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6829","nonce":2479173909}]},"public_addr":"172.21.15.167:6825/2479173909","cluster_addr":"172.21.15.167:6827/2479173909","heartbeat_back_addr":"172.21.15.167:6831/2479173909","heartbeat_front_addr":"172.21.15.167:6829/2479173909","state":["exists","up"]},{"osd":6,"uuid":"4ef2c4b5-52f4-4f69-8fca-2334077ed8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6809","nonce":2825112504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6811","nonce":2825112504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6815","nonce":2825112504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6813","nonce":2825112504}]},"public_addr":"172.21.15.167:6809/2825112504","cluster_addr":"172.21.15.167:6811/2825112504","heartbeat_back_addr":"172.21.15.167:6815/2825112504","heartbeat_front_addr":"172.21.15.167:6813/2825112504","state":["exists","up"]},{"osd":7,"uuid":"761673d8-d6fc-4ded-a9f3-d49ab8f7c969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337015843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337015843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337015843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337015843}]},"public_addr":"172.21.15.167:6801/1337015843","cluster_addr":"172.21.15.167:6803/1337015843","heartbeat_back_addr":"172.21.15.167:6807/1337015843","heartbeat_front_addr":"172.21.15.167:6805/1337015843","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.833280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.080311+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.100648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.544261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.670353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.880921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.365441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.366659+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:20:39.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.921+0000 7f1e9b9fd640 1 -- 172.21.15.100:0/2497752496 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1e7806be30 msgr2=0x7f1e7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:39.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.921+0000 7f1e9b9fd640 1 --2- 172.21.15.100:0/2497752496 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1e7806be30 0x7f1e7806e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1e900016e0 tx=0x7f1e90009040 comp rx=0 tx=0).stop 2024-09-11T22:20:39.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.921+0000 7f1e9b9fd640 1 -- 172.21.15.100:0/2497752496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e94151ae0 msgr2=0x7f1e941544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:39.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.921+0000 7f1e9b9fd640 1 --2- 172.21.15.100:0/2497752496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e94151ae0 0x7f1e941544f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c00d240 tx=0x7f1e8c004a40 comp rx=0 tx=0).stop 2024-09-11T22:20:39.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.921+0000 7f1e9b9fd640 1 -- 172.21.15.100:0/2497752496 shutdown_connections 2024-09-11T22:20:39.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.921+0000 7f1e9b9fd640 1 --2- 172.21.15.100:0/2497752496 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1e7806be30 0x7f1e7806e2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.921+0000 7f1e9b9fd640 1 --2- 172.21.15.100:0/2497752496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e94151ae0 0x7f1e941544f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.921+0000 7f1e9b9fd640 1 --2- 172.21.15.100:0/2497752496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e940c8570 0x7f1e94153fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.921+0000 7f1e9b9fd640 1 --2- 172.21.15.100:0/2497752496 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e940c2de0 0x7f1e9414c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:39.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.921+0000 7f1e9b9fd640 1 -- 172.21.15.100:0/2497752496 >> 172.21.15.100:0/2497752496 conn(0x7f1e940cbf70 msgr2=0x7f1e9414fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:39.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.921+0000 7f1e9b9fd640 1 -- 172.21.15.100:0/2497752496 shutdown_connections 2024-09-11T22:20:39.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:39.921+0000 7f1e9b9fd640 1 -- 172.21.15.100:0/2497752496 wait complete. 2024-09-11T22:20:39.933 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-11T22:20:40.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.034+0000 7f7c2e786640 1 Processor -- start 2024-09-11T22:20:40.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.034+0000 7f7c2e786640 1 -- start start 2024-09-11T22:20:40.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.035+0000 7f7c2e786640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7c2806ce60 0x7f7c2815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:40.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.035+0000 7f7c2e786640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c2815c290 0x7f7c281546b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:40.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.035+0000 7f7c2e786640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c280c6510 con 0x7f7c2806d240 2024-09-11T22:20:40.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.035+0000 7f7c2e786640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f7c2815b820 con 0x7f7c2806ce60 2024-09-11T22:20:40.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.035+0000 7f7c2e786640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7c280c5470 con 0x7f7c2815c290 2024-09-11T22:20:40.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.035+0000 7f7c27fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7c2806ce60 0x7f7c2815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:40.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.035+0000 7f7c2cd23640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7c2806d240 0x7f7c2815de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40562/0 (socket says 172.21.15.100:40562) 2024-09-11T22:20:40.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.035+0000 7f7c2cd23640 1 -- 172.21.15.100:0/2979069836 learned_addr learned my addr 172.21.15.100:0/2979069836 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:40.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.035+0000 7f7c277fe640 1 --2- 172.21.15.100:0/2979069836 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c2815c290 0x7f7c281546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:40.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.035+0000 7f7c27fff640 1 -- 172.21.15.100:0/2979069836 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c2815c290 msgr2=0x7f7c281546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:40.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.035+0000 7f7c27fff640 1 --2- 172.21.15.100:0/2979069836 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c2815c290 0x7f7c281546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:40.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.035+0000 7f7c27fff640 1 -- 172.21.15.100:0/2979069836 >> v1:172.21.15.100:6789/0 conn(0x7f7c2806d240 legacy=0x7f7c2815de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:40.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.035+0000 7f7c27fff640 1 -- 172.21.15.100:0/2979069836 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c280c5750 con 0x7f7c2806ce60 2024-09-11T22:20:40.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.036+0000 7f7c27fff640 1 --2- 172.21.15.100:0/2979069836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c2806ce60 0x7f7c2815bd50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7c180097a0 tx=0x7f7c1802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6760609a35fe81 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:40.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.036+0000 7f7c26ffd640 1 -- 172.21.15.100:0/2979069836 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c18037070 con 0x7f7c2806ce60 2024-09-11T22:20:40.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.036+0000 7f7c26ffd640 1 -- 172.21.15.100:0/2979069836 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c18032440 con 0x7f7c2806ce60 2024-09-11T22:20:40.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.036+0000 7f7c26ffd640 1 -- 172.21.15.100:0/2979069836 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c18032810 con 0x7f7c2806ce60 2024-09-11T22:20:40.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.036+0000 7f7c2e786640 1 -- 172.21.15.100:0/2979069836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c2806ce60 msgr2=0x7f7c2815bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:40.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.036+0000 7f7c2e786640 1 --2- 172.21.15.100:0/2979069836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c2806ce60 0x7f7c2815bd50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7c180097a0 tx=0x7f7c1802a180 comp rx=0 tx=0).stop 2024-09-11T22:20:40.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.036+0000 7f7c2e786640 1 -- 172.21.15.100:0/2979069836 shutdown_connections 2024-09-11T22:20:40.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.036+0000 7f7c2e786640 1 --2- 172.21.15.100:0/2979069836 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c2815c290 0x7f7c281546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:40.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.036+0000 7f7c2e786640 1 --2- 172.21.15.100:0/2979069836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c2806ce60 0x7f7c2815bd50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:40.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.037+0000 7f7c2e786640 1 -- 172.21.15.100:0/2979069836 >> 172.21.15.100:0/2979069836 conn(0x7f7c2806bc10 msgr2=0x7f7c2806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:40.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.037+0000 7f7c2e786640 1 -- 172.21.15.100:0/2979069836 shutdown_connections 2024-09-11T22:20:40.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.037+0000 7f7c2e786640 1 -- 172.21.15.100:0/2979069836 wait complete. 2024-09-11T22:20:40.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.038+0000 7f7c2e786640 1 Processor -- start 2024-09-11T22:20:40.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.038+0000 7f7c2e786640 1 -- start start 2024-09-11T22:20:40.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.038+0000 7f7c2e786640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c2806ce60 0x7f7c280c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:40.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.038+0000 7f7c2e786640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c2806d240 0x7f7c281509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:40.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.038+0000 7f7c2e786640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c2815c290 0x7f7c281f0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:40.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.039+0000 7f7c2e786640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7c280cb1b0 con 0x7f7c2815c290 2024-09-11T22:20:40.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.039+0000 7f7c2e786640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7c280c5d10 con 0x7f7c2806ce60 2024-09-11T22:20:40.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.039+0000 7f7c2e786640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7c280cad20 con 0x7f7c2806d240 2024-09-11T22:20:40.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.039+0000 7f7c2cd23640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c2815c290 0x7f7c281f0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:40.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.039+0000 7f7c2cd23640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c2815c290 0x7f7c281f0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58386/0 (socket says 172.21.15.100:58386) 2024-09-11T22:20:40.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.039+0000 7f7c2cd23640 1 -- 172.21.15.100:0/127492303 learned_addr learned my addr 172.21.15.100:0/127492303 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:40.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.039+0000 7f7c277fe640 1 --2- 172.21.15.100:0/127492303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c2806d240 0x7f7c281509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:40.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.039+0000 7f7c2cd23640 1 -- 172.21.15.100:0/127492303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c2806d240 msgr2=0x7f7c281509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:40.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.039+0000 7f7c2cd23640 1 --2- 172.21.15.100:0/127492303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c2806d240 0x7f7c281509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:40.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.039+0000 7f7c2cd23640 1 -- 172.21.15.100:0/127492303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c2806ce60 msgr2=0x7f7c280c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:40.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.039+0000 7f7c27fff640 1 --2- 172.21.15.100:0/127492303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c2806ce60 0x7f7c280c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:40.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.039+0000 7f7c2cd23640 1 --2- 172.21.15.100:0/127492303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c2806ce60 0x7f7c280c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:40.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.039+0000 7f7c2cd23640 1 -- 172.21.15.100:0/127492303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c28150ef0 con 0x7f7c2815c290 2024-09-11T22:20:40.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.039+0000 7f7c2cd23640 1 --2- 172.21.15.100:0/127492303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c2815c290 0x7f7c281f0250 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000cb10 tx=0x7f7c2000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:40.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.039+0000 7f7c24ff9640 1 -- 172.21.15.100:0/127492303 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c20017070 con 0x7f7c2815c290 2024-09-11T22:20:40.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.039+0000 7f7c24ff9640 1 -- 172.21.15.100:0/127492303 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c2000ac10 con 0x7f7c2815c290 2024-09-11T22:20:40.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.039+0000 7f7c2e786640 1 -- 172.21.15.100:0/127492303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c280ca470 con 0x7f7c2815c290 2024-09-11T22:20:40.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.039+0000 7f7c24ff9640 1 -- 172.21.15.100:0/127492303 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c20012400 con 0x7f7c2815c290 2024-09-11T22:20:40.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.039+0000 7f7c2e786640 1 -- 172.21.15.100:0/127492303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c28151960 con 0x7f7c2815c290 2024-09-11T22:20:40.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.040+0000 7f7c2e786640 1 -- 172.21.15.100:0/127492303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c2815b2e0 con 0x7f7c2815c290 2024-09-11T22:20:40.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.041+0000 7f7c24ff9640 1 -- 172.21.15.100:0/127492303 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7c2001a070 con 0x7f7c2815c290 2024-09-11T22:20:40.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.041+0000 7f7c24ff9640 1 --2- 172.21.15.100:0/127492303 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7c1406be30 0x7f7c1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:40.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.041+0000 7f7c24ff9640 1 -- 172.21.15.100:0/127492303 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7c2008acd0 con 0x7f7c2815c290 2024-09-11T22:20:40.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.041+0000 7f7c27fff640 1 --2- 172.21.15.100:0/127492303 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7c1406be30 0x7f7c1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:40.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.042+0000 7f7c27fff640 1 --2- 172.21.15.100:0/127492303 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7c1406be30 0x7f7c1406e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7c18034000 tx=0x7f7c1802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:40.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.046+0000 7f7c24ff9640 1 -- 172.21.15.100:0/127492303 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7c20058d80 con 0x7f7c2815c290 2024-09-11T22:20:40.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.252+0000 7f7c2e786640 1 -- 172.21.15.100:0/127492303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7c28159590 con 0x7f7c2815c290 2024-09-11T22:20:40.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.918+0000 7f7c24ff9640 1 -- 172.21.15.100:0/127492303 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f7c2005d080 con 0x7f7c2815c290 2024-09-11T22:20:40.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.921+0000 7f7c2e786640 1 -- 172.21.15.100:0/127492303 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7c1406be30 msgr2=0x7f7c1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:40.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.921+0000 7f7c2e786640 1 --2- 172.21.15.100:0/127492303 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7c1406be30 0x7f7c1406e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7c18034000 tx=0x7f7c1802e000 comp rx=0 tx=0).stop 2024-09-11T22:20:40.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.921+0000 7f7c2e786640 1 -- 172.21.15.100:0/127492303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c2815c290 msgr2=0x7f7c281f0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:40.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.921+0000 7f7c2e786640 1 --2- 172.21.15.100:0/127492303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c2815c290 0x7f7c281f0250 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000cb10 tx=0x7f7c2000a060 comp rx=0 tx=0).stop 2024-09-11T22:20:40.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.921+0000 7f7c2e786640 1 -- 172.21.15.100:0/127492303 shutdown_connections 2024-09-11T22:20:40.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.921+0000 7f7c2e786640 1 --2- 172.21.15.100:0/127492303 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7c1406be30 0x7f7c1406e2f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:40.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.921+0000 7f7c2e786640 1 --2- 172.21.15.100:0/127492303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c2815c290 0x7f7c281f0250 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:40.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.921+0000 7f7c2e786640 1 --2- 172.21.15.100:0/127492303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c2806d240 0x7f7c281509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:40.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.921+0000 7f7c2e786640 1 --2- 172.21.15.100:0/127492303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c2806ce60 0x7f7c280c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:40.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.921+0000 7f7c2e786640 1 -- 172.21.15.100:0/127492303 >> 172.21.15.100:0/127492303 conn(0x7f7c2806bc10 msgr2=0x7f7c2806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:40.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.921+0000 7f7c2e786640 1 -- 172.21.15.100:0/127492303 shutdown_connections 2024-09-11T22:20:40.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:40.921+0000 7f7c2e786640 1 -- 172.21.15.100:0/127492303 wait complete. 2024-09-11T22:20:40.934 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300} 2024-09-11T22:20:40.934 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-11T22:20:41.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.038+0000 7fa8bf531640 1 Processor -- start 2024-09-11T22:20:41.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.038+0000 7fa8bf531640 1 -- start start 2024-09-11T22:20:41.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.039+0000 7fa8bf531640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8b80c3230 0x7fa8b80c9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:41.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.039+0000 7fa8bf531640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa8b80c9da0 0x7fa8b815ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:41.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.039+0000 7fa8bf531640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8b80ca5c0 con 0x7fa8b8154d70 2024-09-11T22:20:41.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.039+0000 7fa8bf531640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fa8b80c43b0 con 0x7fa8b80c9da0 2024-09-11T22:20:41.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.039+0000 7fa8bf531640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa8b80ae930 con 0x7fa8b80c3230 2024-09-11T22:20:41.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.039+0000 7fa8bdace640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa8b80c9da0 0x7fa8b815ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:41.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.039+0000 7fa8bdace640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa8b80c9da0 0x7fa8b815ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58396/0 (socket says 172.21.15.100:58396) 2024-09-11T22:20:41.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.039+0000 7fa8bdace640 1 -- 172.21.15.100:0/2420350965 learned_addr learned my addr 172.21.15.100:0/2420350965 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:41.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.039+0000 7fa8bd2cd640 1 --1- 172.21.15.100:0/2420350965 >> v1:172.21.15.100:6789/0 conn(0x7fa8b8154d70 0x7fa8b80714c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40578/0 (socket says 172.21.15.100:40578) 2024-09-11T22:20:41.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.040+0000 7fa8bcacc640 1 --2- 172.21.15.100:0/2420350965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8b80c3230 0x7fa8b80c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:41.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.040+0000 7fa8bdace640 1 -- 172.21.15.100:0/2420350965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8b80c3230 msgr2=0x7fa8b80c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:41.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.040+0000 7fa8bdace640 1 --2- 172.21.15.100:0/2420350965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8b80c3230 0x7fa8b80c9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:41.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.040+0000 7fa8bdace640 1 -- 172.21.15.100:0/2420350965 >> v1:172.21.15.100:6789/0 conn(0x7fa8b8154d70 legacy=0x7fa8b80714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:41.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.040+0000 7fa8b7fff640 1 -- 172.21.15.100:0/2420350965 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3792353745 0 0) 0x7fa8b80ca5c0 con 0x7fa8b8154d70 2024-09-11T22:20:41.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.040+0000 7fa8bdace640 1 -- 172.21.15.100:0/2420350965 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b80c3830 con 0x7fa8b80c9da0 2024-09-11T22:20:41.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.040+0000 7fa8bdace640 1 --2- 172.21.15.100:0/2420350965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8b80c9da0 0x7fa8b815ad20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009e50 tx=0x7fa8b002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ac2a40b366f4d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:41.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.040+0000 7fa8b7fff640 1 -- 172.21.15.100:0/2420350965 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0036070 con 0x7fa8b80c9da0 2024-09-11T22:20:41.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.041+0000 7fa8b7fff640 1 -- 172.21.15.100:0/2420350965 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b0031600 con 0x7fa8b80c9da0 2024-09-11T22:20:41.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.041+0000 7fa8b7fff640 1 -- 172.21.15.100:0/2420350965 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b00319d0 con 0x7fa8b80c9da0 2024-09-11T22:20:41.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.041+0000 7fa8bf531640 1 -- 172.21.15.100:0/2420350965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8b80c9da0 msgr2=0x7fa8b815ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:41.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.041+0000 7fa8bf531640 1 --2- 172.21.15.100:0/2420350965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8b80c9da0 0x7fa8b815ad20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009e50 tx=0x7fa8b002a7a0 comp rx=0 tx=0).stop 2024-09-11T22:20:41.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.041+0000 7fa8bf531640 1 -- 172.21.15.100:0/2420350965 shutdown_connections 2024-09-11T22:20:41.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.041+0000 7fa8bf531640 1 --2- 172.21.15.100:0/2420350965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8b80c9da0 0x7fa8b815ad20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:41.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.041+0000 7fa8bf531640 1 --2- 172.21.15.100:0/2420350965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8b80c3230 0x7fa8b80c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:41.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.041+0000 7fa8bf531640 1 -- 172.21.15.100:0/2420350965 >> 172.21.15.100:0/2420350965 conn(0x7fa8b806f4c0 msgr2=0x7fa8b806f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:41.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.041+0000 7fa8bf531640 1 -- 172.21.15.100:0/2420350965 shutdown_connections 2024-09-11T22:20:41.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.041+0000 7fa8bf531640 1 -- 172.21.15.100:0/2420350965 wait complete. 2024-09-11T22:20:41.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.042+0000 7fa8bf531640 1 Processor -- start 2024-09-11T22:20:41.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.042+0000 7fa8bf531640 1 -- start start 2024-09-11T22:20:41.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.043+0000 7fa8bf531640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8b80c3230 0x7fa8b80ce770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:41.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.043+0000 7fa8bf531640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8b80c9da0 0x7fa8b8144ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:41.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.043+0000 7fa8bf531640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8b8154d70 0x7fa8b8144ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:41.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.043+0000 7fa8bf531640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b80c40d0 con 0x7fa8b80c3230 2024-09-11T22:20:41.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.043+0000 7fa8bf531640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b80c3df0 con 0x7fa8b80c9da0 2024-09-11T22:20:41.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.043+0000 7fa8bf531640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa8b8071bd0 con 0x7fa8b8154d70 2024-09-11T22:20:41.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.043+0000 7fa8bd2cd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8b80c3230 0x7fa8b80ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:41.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.043+0000 7fa8bd2cd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8b80c3230 0x7fa8b80ce770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58404/0 (socket says 172.21.15.100:58404) 2024-09-11T22:20:41.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.043+0000 7fa8bd2cd640 1 -- 172.21.15.100:0/2529373616 learned_addr learned my addr 172.21.15.100:0/2529373616 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:41.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.043+0000 7fa8bcacc640 1 --2- 172.21.15.100:0/2529373616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8b80c9da0 0x7fa8b8144ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:41.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.043+0000 7fa8bdace640 1 --2- 172.21.15.100:0/2529373616 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8b8154d70 0x7fa8b8144ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:41.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.043+0000 7fa8bd2cd640 1 -- 172.21.15.100:0/2529373616 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8b8154d70 msgr2=0x7fa8b8144ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:41.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.043+0000 7fa8bd2cd640 1 --2- 172.21.15.100:0/2529373616 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8b8154d70 0x7fa8b8144ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:41.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.043+0000 7fa8bd2cd640 1 -- 172.21.15.100:0/2529373616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8b80c9da0 msgr2=0x7fa8b8144ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:41.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.043+0000 7fa8bd2cd640 1 --2- 172.21.15.100:0/2529373616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8b80c9da0 0x7fa8b8144ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:41.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.043+0000 7fa8bd2cd640 1 -- 172.21.15.100:0/2529373616 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b80c78a0 con 0x7fa8b80c3230 2024-09-11T22:20:41.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.043+0000 7fa8bcacc640 1 --2- 172.21.15.100:0/2529373616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8b80c9da0 0x7fa8b8144ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:41.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.044+0000 7fa8bd2cd640 1 --2- 172.21.15.100:0/2529373616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8b80c3230 0x7fa8b80ce770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800c430 tx=0x7fa8a800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:41.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.044+0000 7fa8b5ffb640 1 -- 172.21.15.100:0/2529373616 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a80074e0 con 0x7fa8b80c3230 2024-09-11T22:20:41.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.044+0000 7fa8b5ffb640 1 -- 172.21.15.100:0/2529373616 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8a80047e0 con 0x7fa8b80c3230 2024-09-11T22:20:41.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.044+0000 7fa8b5ffb640 1 -- 172.21.15.100:0/2529373616 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8004bd0 con 0x7fa8b80c3230 2024-09-11T22:20:41.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.044+0000 7fa8bf531640 1 -- 172.21.15.100:0/2529373616 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8b8149580 con 0x7fa8b80c3230 2024-09-11T22:20:41.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.044+0000 7fa8bf531640 1 -- 172.21.15.100:0/2529373616 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8b8148680 con 0x7fa8b80c3230 2024-09-11T22:20:41.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.045+0000 7fa8bf531640 1 -- 172.21.15.100:0/2529373616 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8b80c9860 con 0x7fa8b80c3230 2024-09-11T22:20:41.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.045+0000 7fa8b5ffb640 1 -- 172.21.15.100:0/2529373616 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa8a8011070 con 0x7fa8b80c3230 2024-09-11T22:20:41.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.046+0000 7fa8b5ffb640 1 --2- 172.21.15.100:0/2529373616 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa8a406be30 0x7fa8a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:41.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.046+0000 7fa8b5ffb640 1 -- 172.21.15.100:0/2529373616 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa8a808ad20 con 0x7fa8b80c3230 2024-09-11T22:20:41.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.046+0000 7fa8bcacc640 1 --2- 172.21.15.100:0/2529373616 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa8a406be30 0x7fa8a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:41.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.046+0000 7fa8bcacc640 1 --2- 172.21.15.100:0/2529373616 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa8a406be30 0x7fa8a406e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80cb600 tx=0x7fa8ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:41.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.050+0000 7fa8b5ffb640 1 -- 172.21.15.100:0/2529373616 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa8a8059390 con 0x7fa8b80c3230 2024-09-11T22:20:41.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.251+0000 7fa8bf531640 1 -- 172.21.15.100:0/2529373616 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fa8b80ca3a0 con 0x7fa8b80c3230 2024-09-11T22:20:41.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.919+0000 7fa8b5ffb640 1 -- 172.21.15.100:0/2529373616 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v8) ==== 105+0+0 (secure 0 0 0) 0x7fa8a8058c90 con 0x7fa8b80c3230 2024-09-11T22:20:41.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.923+0000 7fa8bf531640 1 -- 172.21.15.100:0/2529373616 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa8a406be30 msgr2=0x7fa8a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:41.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.923+0000 7fa8bf531640 1 --2- 172.21.15.100:0/2529373616 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa8a406be30 0x7fa8a406e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80cb600 tx=0x7fa8ac008040 comp rx=0 tx=0).stop 2024-09-11T22:20:41.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.923+0000 7fa8bf531640 1 -- 172.21.15.100:0/2529373616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8b80c3230 msgr2=0x7fa8b80ce770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:41.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.923+0000 7fa8bf531640 1 --2- 172.21.15.100:0/2529373616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8b80c3230 0x7fa8b80ce770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800c430 tx=0x7fa8a800c8f0 comp rx=0 tx=0).stop 2024-09-11T22:20:41.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.923+0000 7fa8bf531640 1 -- 172.21.15.100:0/2529373616 shutdown_connections 2024-09-11T22:20:41.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.923+0000 7fa8bf531640 1 --2- 172.21.15.100:0/2529373616 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa8a406be30 0x7fa8a406e2f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:41.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.923+0000 7fa8bf531640 1 --2- 172.21.15.100:0/2529373616 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8b8154d70 0x7fa8b8144ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:41.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.923+0000 7fa8bf531640 1 --2- 172.21.15.100:0/2529373616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8b80c9da0 0x7fa8b8144ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:41.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.923+0000 7fa8bf531640 1 --2- 172.21.15.100:0/2529373616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8b80c3230 0x7fa8b80ce770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:41.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.923+0000 7fa8bf531640 1 -- 172.21.15.100:0/2529373616 >> 172.21.15.100:0/2529373616 conn(0x7fa8b806f4c0 msgr2=0x7fa8b8152590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:41.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.923+0000 7fa8bf531640 1 -- 172.21.15.100:0/2529373616 shutdown_connections 2024-09-11T22:20:41.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:41.923+0000 7fa8bf531640 1 -- 172.21.15.100:0/2529373616 wait complete. 2024-09-11T22:20:41.937 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-11T22:20:42.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.045+0000 7fa9b492a640 1 Processor -- start 2024-09-11T22:20:42.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.045+0000 7fa9b492a640 1 -- start start 2024-09-11T22:20:42.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.046+0000 7fa9b492a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa9b006d240 0x7fa9b01546b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:42.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.046+0000 7fa9b492a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9b015b2e0 0x7fa9b0154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:42.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.046+0000 7fa9b492a640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9b00c6510 con 0x7fa9b006ce60 2024-09-11T22:20:42.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.046+0000 7fa9b492a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fa9b015b820 con 0x7fa9b006d240 2024-09-11T22:20:42.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.046+0000 7fa9b492a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa9b00c5470 con 0x7fa9b015b2e0 2024-09-11T22:20:42.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.046+0000 7fa9ae59c640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa9b006ce60 0x7fa9b015bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40584/0 (socket says 172.21.15.100:40584) 2024-09-11T22:20:42.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.046+0000 7fa9ae59c640 1 -- 172.21.15.100:0/3185216520 learned_addr learned my addr 172.21.15.100:0/3185216520 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:42.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.046+0000 7fa9aed9d640 1 --2- 172.21.15.100:0/3185216520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9b015b2e0 0x7fa9b0154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:42.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.046+0000 7fa9add9b640 1 --2- 172.21.15.100:0/3185216520 >> v2:172.21.15.167:3300/0 conn(0x7fa9b006d240 0x7fa9b01546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:42.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.046+0000 7fa9ad59a640 1 -- 172.21.15.100:0/3185216520 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3534929886 0 0) 0x7fa9b00c6510 con 0x7fa9b006ce60 2024-09-11T22:20:42.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.046+0000 7fa9ad59a640 1 -- 172.21.15.100:0/3185216520 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa998003520 con 0x7fa9b006ce60 2024-09-11T22:20:42.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.047+0000 7fa9ad59a640 1 -- 172.21.15.100:0/3185216520 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2587039845 0 0) 0x7fa998003520 con 0x7fa9b006ce60 2024-09-11T22:20:42.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.047+0000 7fa9ad59a640 1 -- 172.21.15.100:0/3185216520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9b015b2e0 msgr2=0x7fa9b0154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:42.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.047+0000 7fa9ad59a640 1 --2- 172.21.15.100:0/3185216520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9b015b2e0 0x7fa9b0154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.047+0000 7fa9ad59a640 1 -- 172.21.15.100:0/3185216520 >> v2:172.21.15.167:3300/0 conn(0x7fa9b006d240 msgr2=0x7fa9b01546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:42.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.047+0000 7fa9ad59a640 1 --2- 172.21.15.100:0/3185216520 >> v2:172.21.15.167:3300/0 conn(0x7fa9b006d240 0x7fa9b01546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.047+0000 7fa9ad59a640 1 -- 172.21.15.100:0/3185216520 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b00c5750 con 0x7fa9b006ce60 2024-09-11T22:20:42.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.047+0000 7fa9ad59a640 1 -- 172.21.15.100:0/3185216520 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fa9a00019f0 con 0x7fa9b006ce60 2024-09-11T22:20:42.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.047+0000 7fa9ad59a640 1 -- 172.21.15.100:0/3185216520 >> v1:172.21.15.100:6789/0 conn(0x7fa9b006ce60 legacy=0x7fa9b015bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:42.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.047+0000 7fa9ad59a640 1 --2- 172.21.15.100:0/3185216520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9980039b0 0x7fa998003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:42.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.047+0000 7fa9ad59a640 1 --2- 172.21.15.100:0/3185216520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9b015b2e0 0x7fa998004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:42.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.047+0000 7fa9ad59a640 1 --2- 172.21.15.100:0/3185216520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa998004d40 0x7fa9980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:42.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.047+0000 7fa9ad59a640 1 -- 172.21.15.100:0/3185216520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b015b820 con 0x7fa9980039b0 2024-09-11T22:20:42.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.047+0000 7fa9ad59a640 1 -- 172.21.15.100:0/3185216520 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b00c5470 con 0x7fa998004d40 2024-09-11T22:20:42.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.047+0000 7fa9ad59a640 1 -- 172.21.15.100:0/3185216520 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa99800b9c0 con 0x7fa9b015b2e0 2024-09-11T22:20:42.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.047+0000 7fa9ae59c640 1 --2- 172.21.15.100:0/3185216520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9980039b0 0x7fa998003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:42.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.047+0000 7fa9add9b640 1 --2- 172.21.15.100:0/3185216520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9b015b2e0 0x7fa998004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:42.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.047+0000 7fa9aed9d640 1 --2- 172.21.15.100:0/3185216520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa998004d40 0x7fa9980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:42.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.047+0000 7fa9ae59c640 1 -- 172.21.15.100:0/3185216520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9b015b2e0 msgr2=0x7fa998004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:42.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.047+0000 7fa9ae59c640 1 --2- 172.21.15.100:0/3185216520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9b015b2e0 0x7fa998004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.047+0000 7fa9ae59c640 1 -- 172.21.15.100:0/3185216520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa998004d40 msgr2=0x7fa9980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:42.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.047+0000 7fa9ae59c640 1 --2- 172.21.15.100:0/3185216520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa998004d40 0x7fa9980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.047+0000 7fa9ae59c640 1 -- 172.21.15.100:0/3185216520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa998003520 con 0x7fa9980039b0 2024-09-11T22:20:42.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.047+0000 7fa9aed9d640 1 --2- 172.21.15.100:0/3185216520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa998004d40 0x7fa9980051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:42.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.048+0000 7fa9ae59c640 1 --2- 172.21.15.100:0/3185216520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9980039b0 0x7fa998003dd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000a950 tx=0x7fa998005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=438e1626bc696685 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:42.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.048+0000 7fa9ad59a640 1 -- 172.21.15.100:0/3185216520 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a000a4c0 con 0x7fa9980039b0 2024-09-11T22:20:42.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.048+0000 7fa9ad59a640 1 -- 172.21.15.100:0/3185216520 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9a002f070 con 0x7fa9980039b0 2024-09-11T22:20:42.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.048+0000 7fa9ad59a640 1 -- 172.21.15.100:0/3185216520 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a002bd00 con 0x7fa9980039b0 2024-09-11T22:20:42.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.048+0000 7fa9b492a640 1 -- 172.21.15.100:0/3185216520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9980039b0 msgr2=0x7fa998003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:42.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.048+0000 7fa9b492a640 1 --2- 172.21.15.100:0/3185216520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9980039b0 0x7fa998003dd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000a950 tx=0x7fa998005830 comp rx=0 tx=0).stop 2024-09-11T22:20:42.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.048+0000 7fa9aed9d640 1 -- 172.21.15.100:0/3185216520 reap_dead start 2024-09-11T22:20:42.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.049+0000 7fa9b492a640 1 -- 172.21.15.100:0/3185216520 shutdown_connections 2024-09-11T22:20:42.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.049+0000 7fa9b492a640 1 -- 172.21.15.100:0/3185216520 >> 172.21.15.100:0/3185216520 conn(0x7fa9b006bc10 msgr2=0x7fa9b006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:42.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.049+0000 7fa9b492a640 1 -- 172.21.15.100:0/3185216520 shutdown_connections 2024-09-11T22:20:42.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.049+0000 7fa9b492a640 1 -- 172.21.15.100:0/3185216520 wait complete. 2024-09-11T22:20:42.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.050+0000 7fa9b492a640 1 Processor -- start 2024-09-11T22:20:42.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.050+0000 7fa9b492a640 1 -- start start 2024-09-11T22:20:42.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.051+0000 7fa9b492a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9980039b0 0x7fa9b014fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:42.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.051+0000 7fa9b492a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9b00c95e0 0x7fa9b00b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:42.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.051+0000 7fa9b492a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9b01f4040 0x7fa9b01f44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:42.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.051+0000 7fa9b492a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b015c460 con 0x7fa9b01f4040 2024-09-11T22:20:42.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.051+0000 7fa9b492a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b00c5d10 con 0x7fa9b00c95e0 2024-09-11T22:20:42.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.051+0000 7fa9b492a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa9b00cb1b0 con 0x7fa9980039b0 2024-09-11T22:20:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.051+0000 7fa9aed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9b01f4040 0x7fa9b01f44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.051+0000 7fa9aed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9b01f4040 0x7fa9b01f44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58420/0 (socket says 172.21.15.100:58420) 2024-09-11T22:20:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.051+0000 7fa9aed9d640 1 -- 172.21.15.100:0/1119832555 learned_addr learned my addr 172.21.15.100:0/1119832555 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.051+0000 7fa9ae59c640 1 --2- 172.21.15.100:0/1119832555 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9980039b0 0x7fa9b014fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.051+0000 7fa9add9b640 1 --2- 172.21.15.100:0/1119832555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9b00c95e0 0x7fa9b00b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.051+0000 7fa9aed9d640 1 -- 172.21.15.100:0/1119832555 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9980039b0 msgr2=0x7fa9b014fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.051+0000 7fa9aed9d640 1 --2- 172.21.15.100:0/1119832555 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9980039b0 0x7fa9b014fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.051+0000 7fa9aed9d640 1 -- 172.21.15.100:0/1119832555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9b00c95e0 msgr2=0x7fa9b00b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.051+0000 7fa9aed9d640 1 --2- 172.21.15.100:0/1119832555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9b00c95e0 0x7fa9b00b4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.051+0000 7fa9aed9d640 1 -- 172.21.15.100:0/1119832555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b01f4a00 con 0x7fa9b01f4040 2024-09-11T22:20:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.051+0000 7fa9aed9d640 1 --2- 172.21.15.100:0/1119832555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9b01f4040 0x7fa9b01f44c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa9b015b750 tx=0x7fa9a8011860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.051+0000 7fa99effd640 1 -- 172.21.15.100:0/1119832555 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8004440 con 0x7fa9b01f4040 2024-09-11T22:20:42.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.051+0000 7fa99effd640 1 -- 172.21.15.100:0/1119832555 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9a801b070 con 0x7fa9b01f4040 2024-09-11T22:20:42.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.051+0000 7fa9b492a640 1 -- 172.21.15.100:0/1119832555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9b014efe0 con 0x7fa9b01f4040 2024-09-11T22:20:42.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.051+0000 7fa99effd640 1 -- 172.21.15.100:0/1119832555 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8003850 con 0x7fa9b01f4040 2024-09-11T22:20:42.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.052+0000 7fa9b492a640 1 -- 172.21.15.100:0/1119832555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9b00c9f90 con 0x7fa9b01f4040 2024-09-11T22:20:42.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.052+0000 7fa9b492a640 1 -- 172.21.15.100:0/1119832555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9b00b3be0 con 0x7fa9b01f4040 2024-09-11T22:20:42.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.053+0000 7fa99effd640 1 -- 172.21.15.100:0/1119832555 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa9a80039f0 con 0x7fa9b01f4040 2024-09-11T22:20:42.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.053+0000 7fa99effd640 1 --2- 172.21.15.100:0/1119832555 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa99006be30 0x7fa99006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:42.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.054+0000 7fa9ae59c640 1 --2- 172.21.15.100:0/1119832555 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa99006be30 0x7fa99006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:42.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.054+0000 7fa99effd640 1 -- 172.21.15.100:0/1119832555 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa9a808b360 con 0x7fa9b01f4040 2024-09-11T22:20:42.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.054+0000 7fa9ae59c640 1 --2- 172.21.15.100:0/1119832555 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa99006be30 0x7fa99006e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0033000 tx=0x7fa9a0007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:42.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.058+0000 7fa99effd640 1 -- 172.21.15.100:0/1119832555 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa9b00b3be0 con 0x7fa9b01f4040 2024-09-11T22:20:42.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.258+0000 7fa9b492a640 1 -- 172.21.15.100:0/1119832555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa9b015b100 con 0x7fa9b01f4040 2024-09-11T22:20:42.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.929+0000 7fa99effd640 1 -- 172.21.15.100:0/1119832555 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fa9b015b100 con 0x7fa9b01f4040 2024-09-11T22:20:42.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.931+0000 7fa9b492a640 1 -- 172.21.15.100:0/1119832555 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa99006be30 msgr2=0x7fa99006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:42.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.931+0000 7fa9b492a640 1 --2- 172.21.15.100:0/1119832555 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa99006be30 0x7fa99006e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0033000 tx=0x7fa9a0007000 comp rx=0 tx=0).stop 2024-09-11T22:20:42.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.931+0000 7fa9b492a640 1 -- 172.21.15.100:0/1119832555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9b01f4040 msgr2=0x7fa9b01f44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:42.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.931+0000 7fa9b492a640 1 --2- 172.21.15.100:0/1119832555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9b01f4040 0x7fa9b01f44c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa9b015b750 tx=0x7fa9a8011860 comp rx=0 tx=0).stop 2024-09-11T22:20:42.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.931+0000 7fa9b492a640 1 -- 172.21.15.100:0/1119832555 shutdown_connections 2024-09-11T22:20:42.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.931+0000 7fa9b492a640 1 --2- 172.21.15.100:0/1119832555 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa99006be30 0x7fa99006e2f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.931+0000 7fa9b492a640 1 --2- 172.21.15.100:0/1119832555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9b01f4040 0x7fa9b01f44c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.931+0000 7fa9b492a640 1 --2- 172.21.15.100:0/1119832555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9b00c95e0 0x7fa9b00b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.931+0000 7fa9b492a640 1 --2- 172.21.15.100:0/1119832555 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9980039b0 0x7fa9b014fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:42.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.931+0000 7fa9b492a640 1 -- 172.21.15.100:0/1119832555 >> 172.21.15.100:0/1119832555 conn(0x7fa9b006bc10 msgr2=0x7fa9b015dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:42.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.931+0000 7fa9b492a640 1 -- 172.21.15.100:0/1119832555 shutdown_connections 2024-09-11T22:20:42.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:42.931+0000 7fa9b492a640 1 -- 172.21.15.100:0/1119832555 wait complete. 2024-09-11T22:20:42.944 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-09-11T22:20:43.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.046+0000 7f69b28ba640 1 Processor -- start 2024-09-11T22:20:43.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.046+0000 7f69b28ba640 1 -- start start 2024-09-11T22:20:43.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.047+0000 7f69b28ba640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69ac154d50 0x7f69ac0cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.047+0000 7f69b28ba640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f69ac0cc9a0 0x7f69ac0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.047+0000 7f69b28ba640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69ac15ab60 con 0x7f69ac0d03d0 2024-09-11T22:20:43.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.047+0000 7f69b28ba640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f69ac0c5f10 con 0x7f69ac0cc9a0 2024-09-11T22:20:43.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.047+0000 7f69b28ba640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f69ac15ade0 con 0x7f69ac154d50 2024-09-11T22:20:43.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.047+0000 7f69b0e57640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f69ac0d03d0 0x7f69ac15e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33184/0 (socket says 172.21.15.100:33184) 2024-09-11T22:20:43.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.047+0000 7f69b0e57640 1 -- 172.21.15.100:0/1871924206 learned_addr learned my addr 172.21.15.100:0/1871924206 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:43.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.047+0000 7f69ab7fe640 1 --2- 172.21.15.100:0/1871924206 >> v2:172.21.15.167:3300/0 conn(0x7f69ac0cc9a0 0x7f69ac0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.047+0000 7f69abfff640 1 --2- 172.21.15.100:0/1871924206 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69ac154d50 0x7f69ac0cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.047+0000 7f69aaffd640 1 -- 172.21.15.100:0/1871924206 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 681597108 0 0) 0x7f69a4001490 con 0x7f69ac0d03d0 2024-09-11T22:20:43.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.047+0000 7f69aaffd640 1 -- 172.21.15.100:0/1871924206 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6994003520 con 0x7f69ac0d03d0 2024-09-11T22:20:43.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.047+0000 7f69aaffd640 1 -- 172.21.15.100:0/1871924206 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 85688980 0 0) 0x7f6994003520 con 0x7f69ac0d03d0 2024-09-11T22:20:43.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.047+0000 7f69aaffd640 1 -- 172.21.15.100:0/1871924206 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69ac154d50 msgr2=0x7f69ac0cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:43.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.047+0000 7f69aaffd640 1 --2- 172.21.15.100:0/1871924206 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69ac154d50 0x7f69ac0cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.047+0000 7f69aaffd640 1 -- 172.21.15.100:0/1871924206 >> v2:172.21.15.167:3300/0 conn(0x7f69ac0cc9a0 msgr2=0x7f69ac0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:43.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.047+0000 7f69aaffd640 1 --2- 172.21.15.100:0/1871924206 >> v2:172.21.15.167:3300/0 conn(0x7f69ac0cc9a0 0x7f69ac0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.047+0000 7f69aaffd640 1 -- 172.21.15.100:0/1871924206 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ac15b0c0 con 0x7f69ac0d03d0 2024-09-11T22:20:43.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.047+0000 7f69aaffd640 1 -- 172.21.15.100:0/1871924206 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f69a4001bc0 con 0x7f69ac0d03d0 2024-09-11T22:20:43.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.047+0000 7f69aaffd640 1 -- 172.21.15.100:0/1871924206 >> v1:172.21.15.100:6789/0 conn(0x7f69ac0d03d0 legacy=0x7f69ac15e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:43.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.048+0000 7f69aaffd640 1 --2- 172.21.15.100:0/1871924206 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69940039b0 0x7f6994003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.048+0000 7f69aaffd640 1 --2- 172.21.15.100:0/1871924206 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69ac154d50 0x7f6994004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.048+0000 7f69aaffd640 1 --2- 172.21.15.100:0/1871924206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6994004d40 0x7f69940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.048+0000 7f69aaffd640 1 -- 172.21.15.100:0/1871924206 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac15ade0 con 0x7f6994004d40 2024-09-11T22:20:43.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.048+0000 7f69aaffd640 1 -- 172.21.15.100:0/1871924206 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f699400b9c0 con 0x7f69940039b0 2024-09-11T22:20:43.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.048+0000 7f69aaffd640 1 -- 172.21.15.100:0/1871924206 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f699400bb40 con 0x7f69ac154d50 2024-09-11T22:20:43.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.048+0000 7f69b0e57640 1 --2- 172.21.15.100:0/1871924206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6994004d40 0x7f69940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.048+0000 7f69abfff640 1 --2- 172.21.15.100:0/1871924206 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69940039b0 0x7f6994003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.048+0000 7f69ab7fe640 1 --2- 172.21.15.100:0/1871924206 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69ac154d50 0x7f6994004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.048+0000 7f69b0e57640 1 -- 172.21.15.100:0/1871924206 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69ac154d50 msgr2=0x7f6994004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:43.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.048+0000 7f69b0e57640 1 --2- 172.21.15.100:0/1871924206 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69ac154d50 0x7f6994004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.048+0000 7f69b0e57640 1 -- 172.21.15.100:0/1871924206 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69940039b0 msgr2=0x7f6994003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:43.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.048+0000 7f69b0e57640 1 --2- 172.21.15.100:0/1871924206 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69940039b0 0x7f6994003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.048+0000 7f69b0e57640 1 -- 172.21.15.100:0/1871924206 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6994003520 con 0x7f6994004d40 2024-09-11T22:20:43.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.049+0000 7f69b0e57640 1 --2- 172.21.15.100:0/1871924206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6994004d40 0x7f69940051c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f69a400aa60 tx=0x7f6994005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d741a1c2cece413 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:43.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.049+0000 7f69aaffd640 1 -- 172.21.15.100:0/1871924206 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a400a6b0 con 0x7f6994004d40 2024-09-11T22:20:43.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.049+0000 7f69aaffd640 1 -- 172.21.15.100:0/1871924206 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69a402f070 con 0x7f6994004d40 2024-09-11T22:20:43.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.049+0000 7f69aaffd640 1 -- 172.21.15.100:0/1871924206 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a4034470 con 0x7f6994004d40 2024-09-11T22:20:43.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.049+0000 7f69b28ba640 1 -- 172.21.15.100:0/1871924206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6994004d40 msgr2=0x7f69940051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:43.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.049+0000 7f69b28ba640 1 --2- 172.21.15.100:0/1871924206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6994004d40 0x7f69940051c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f69a400aa60 tx=0x7f6994005830 comp rx=0 tx=0).stop 2024-09-11T22:20:43.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.049+0000 7f69b0e57640 1 -- 172.21.15.100:0/1871924206 reap_dead start 2024-09-11T22:20:43.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.049+0000 7f69b28ba640 1 -- 172.21.15.100:0/1871924206 shutdown_connections 2024-09-11T22:20:43.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.049+0000 7f69b28ba640 1 -- 172.21.15.100:0/1871924206 >> 172.21.15.100:0/1871924206 conn(0x7f69ac06d040 msgr2=0x7f69ac06d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:43.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.049+0000 7f69b28ba640 1 -- 172.21.15.100:0/1871924206 shutdown_connections 2024-09-11T22:20:43.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.049+0000 7f69b28ba640 1 -- 172.21.15.100:0/1871924206 wait complete. 2024-09-11T22:20:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.050+0000 7f69b28ba640 1 Processor -- start 2024-09-11T22:20:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.051+0000 7f69b28ba640 1 -- start start 2024-09-11T22:20:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.051+0000 7f69b28ba640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6994004d40 0x7f69ac14f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.051+0000 7f69b28ba640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69ac151300 0x7f69ac153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.051+0000 7f69b28ba640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69ac1f4150 0x7f69ac1f45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.051+0000 7f69b28ba640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac15ea10 con 0x7f6994004d40 2024-09-11T22:20:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.051+0000 7f69b28ba640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac15b680 con 0x7f69ac151300 2024-09-11T22:20:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.051+0000 7f69b28ba640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f69ac15eb90 con 0x7f69ac1f4150 2024-09-11T22:20:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.051+0000 7f69abfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6994004d40 0x7f69ac14f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.051+0000 7f69abfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6994004d40 0x7f69ac14f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47150/0 (socket says 172.21.15.100:47150) 2024-09-11T22:20:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.051+0000 7f69abfff640 1 -- 172.21.15.100:0/3042655863 learned_addr learned my addr 172.21.15.100:0/3042655863 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.052+0000 7f69ab7fe640 1 --2- 172.21.15.100:0/3042655863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69ac151300 0x7f69ac153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.052+0000 7f69b0e57640 1 --2- 172.21.15.100:0/3042655863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69ac1f4150 0x7f69ac1f45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.052+0000 7f69abfff640 1 -- 172.21.15.100:0/3042655863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69ac1f4150 msgr2=0x7f69ac1f45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.052+0000 7f69abfff640 1 --2- 172.21.15.100:0/3042655863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69ac1f4150 0x7f69ac1f45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.052+0000 7f69abfff640 1 -- 172.21.15.100:0/3042655863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69ac151300 msgr2=0x7f69ac153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.052+0000 7f69abfff640 1 --2- 172.21.15.100:0/3042655863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69ac151300 0x7f69ac153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.052+0000 7f69abfff640 1 -- 172.21.15.100:0/3042655863 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ac151ba0 con 0x7f6994004d40 2024-09-11T22:20:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.052+0000 7f69ab7fe640 1 --2- 172.21.15.100:0/3042655863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69ac151300 0x7f69ac153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.052+0000 7f69abfff640 1 --2- 172.21.15.100:0/3042655863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6994004d40 0x7f69ac14f1d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f699c0118e0 tx=0x7f699c011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.052+0000 7f69a8ff9640 1 -- 172.21.15.100:0/3042655863 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c00f9d0 con 0x7f6994004d40 2024-09-11T22:20:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.052+0000 7f69a8ff9640 1 -- 172.21.15.100:0/3042655863 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f699c00fb70 con 0x7f6994004d40 2024-09-11T22:20:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.052+0000 7f69b28ba640 1 -- 172.21.15.100:0/3042655863 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69ac151e80 con 0x7f6994004d40 2024-09-11T22:20:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.052+0000 7f69a8ff9640 1 -- 172.21.15.100:0/3042655863 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c014440 con 0x7f6994004d40 2024-09-11T22:20:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.052+0000 7f69b28ba640 1 -- 172.21.15.100:0/3042655863 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69ac14dc40 con 0x7f6994004d40 2024-09-11T22:20:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.053+0000 7f69b28ba640 1 -- 172.21.15.100:0/3042655863 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69ac0b3470 con 0x7f6994004d40 2024-09-11T22:20:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.054+0000 7f69a8ff9640 1 -- 172.21.15.100:0/3042655863 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f699c012040 con 0x7f6994004d40 2024-09-11T22:20:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.054+0000 7f69a8ff9640 1 --2- 172.21.15.100:0/3042655863 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f699806be60 0x7f699806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.054+0000 7f69a8ff9640 1 -- 172.21.15.100:0/3042655863 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f699c08b740 con 0x7f6994004d40 2024-09-11T22:20:43.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.054+0000 7f69ab7fe640 1 --2- 172.21.15.100:0/3042655863 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f699806be60 0x7f699806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:43.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.054+0000 7f69ab7fe640 1 --2- 172.21.15.100:0/3042655863 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f699806be60 0x7f699806e320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f69ac06da30 tx=0x7f69a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:43.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.058+0000 7f69a8ff9640 1 -- 172.21.15.100:0/3042655863 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f69ac0b3470 con 0x7f6994004d40 2024-09-11T22:20:43.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.258+0000 7f69b28ba640 1 -- 172.21.15.100:0/3042655863 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f69ac0d0840 con 0x7f6994004d40 2024-09-11T22:20:43.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.934+0000 7f69a8ff9640 1 -- 172.21.15.100:0/3042655863 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v11) ==== 115+0+0 (secure 0 0 0) 0x7f699c019030 con 0x7f6994004d40 2024-09-11T22:20:43.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.936+0000 7f69b28ba640 1 -- 172.21.15.100:0/3042655863 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f699806be60 msgr2=0x7f699806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:43.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.936+0000 7f69b28ba640 1 --2- 172.21.15.100:0/3042655863 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f699806be60 0x7f699806e320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f69ac06da30 tx=0x7f69a0008040 comp rx=0 tx=0).stop 2024-09-11T22:20:43.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.936+0000 7f69b28ba640 1 -- 172.21.15.100:0/3042655863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6994004d40 msgr2=0x7f69ac14f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:43.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.936+0000 7f69b28ba640 1 --2- 172.21.15.100:0/3042655863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6994004d40 0x7f69ac14f1d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f699c0118e0 tx=0x7f699c011da0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.936+0000 7f69b28ba640 1 -- 172.21.15.100:0/3042655863 shutdown_connections 2024-09-11T22:20:43.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.936+0000 7f69b28ba640 1 --2- 172.21.15.100:0/3042655863 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f699806be60 0x7f699806e320 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.936+0000 7f69b28ba640 1 --2- 172.21.15.100:0/3042655863 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69ac1f4150 0x7f69ac1f45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.936+0000 7f69b28ba640 1 --2- 172.21.15.100:0/3042655863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69ac151300 0x7f69ac153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.936+0000 7f69b28ba640 1 --2- 172.21.15.100:0/3042655863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6994004d40 0x7f69ac14f1d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:43.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.936+0000 7f69b28ba640 1 -- 172.21.15.100:0/3042655863 >> 172.21.15.100:0/3042655863 conn(0x7f69ac06d040 msgr2=0x7f69ac0cb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:43.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.936+0000 7f69b28ba640 1 -- 172.21.15.100:0/3042655863 shutdown_connections 2024-09-11T22:20:43.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:43.936+0000 7f69b28ba640 1 -- 172.21.15.100:0/3042655863 wait complete. 2024-09-11T22:20:43.949 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-11T22:20:43.949 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:44.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.047+0000 7f4c9b131640 1 Processor -- start 2024-09-11T22:20:44.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.047+0000 7f4c9b131640 1 -- start start 2024-09-11T22:20:44.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.048+0000 7f4c9b131640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c94154c50 0x7f4c9415b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.048+0000 7f4c9b131640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c9415e3a0 con 0x7f4c9415def0 2024-09-11T22:20:44.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.048+0000 7f4c9b131640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c9415e680 con 0x7f4c940cb9b0 2024-09-11T22:20:44.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.048+0000 7f4c9b131640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4c9415b940 con 0x7f4c94154c50 2024-09-11T22:20:44.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.048+0000 7f4c93fff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f4c9415def0 0x7f4c94071450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33196/0 (socket says 172.21.15.100:33196) 2024-09-11T22:20:44.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.048+0000 7f4c93fff640 1 -- 172.21.15.100:0/2153883743 learned_addr learned my addr 172.21.15.100:0/2153883743 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:44.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.048+0000 7f4c98ecd640 1 --2- 172.21.15.100:0/2153883743 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c94154c50 0x7f4c9415b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.048+0000 7f4c937fe640 1 -- 172.21.15.100:0/2153883743 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 187141833 0 0) 0x7f4c9415e3a0 con 0x7f4c9415def0 2024-09-11T22:20:44.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.048+0000 7f4c937fe640 1 -- 172.21.15.100:0/2153883743 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c7c003520 con 0x7f4c9415def0 2024-09-11T22:20:44.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c937fe640 1 -- 172.21.15.100:0/2153883743 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3311935737 0 0) 0x7f4c9415e680 con 0x7f4c940cb9b0 2024-09-11T22:20:44.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c937fe640 1 -- 172.21.15.100:0/2153883743 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c9415e3a0 con 0x7f4c940cb9b0 2024-09-11T22:20:44.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c937fe640 1 -- 172.21.15.100:0/2153883743 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3239909072 0 0) 0x7f4c7c003520 con 0x7f4c9415def0 2024-09-11T22:20:44.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c937fe640 1 -- 172.21.15.100:0/2153883743 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c94154c50 msgr2=0x7f4c9415b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:44.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c937fe640 1 --2- 172.21.15.100:0/2153883743 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c94154c50 0x7f4c9415b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c937fe640 1 -- 172.21.15.100:0/2153883743 >> v1:172.21.15.167:6789/0 conn(0x7f4c940cb9b0 legacy=0x7f4c940ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c937fe640 1 -- 172.21.15.100:0/2153883743 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c9415e960 con 0x7f4c9415def0 2024-09-11T22:20:44.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c937fe640 1 -- 172.21.15.100:0/2153883743 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f4c880019f0 con 0x7f4c9415def0 2024-09-11T22:20:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c937fe640 1 -- 172.21.15.100:0/2153883743 >> v1:172.21.15.100:6789/0 conn(0x7f4c9415def0 legacy=0x7f4c94071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c937fe640 1 --2- 172.21.15.100:0/2153883743 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c94154c50 0x7f4c7c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c937fe640 1 --2- 172.21.15.100:0/2153883743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c7c004120 0x7f4c7c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c937fe640 1 --2- 172.21.15.100:0/2153883743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c7c004d40 0x7f4c7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c937fe640 1 -- 172.21.15.100:0/2153883743 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9415b940 con 0x7f4c7c004d40 2024-09-11T22:20:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c937fe640 1 -- 172.21.15.100:0/2153883743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c00bb00 con 0x7f4c7c004120 2024-09-11T22:20:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c937fe640 1 -- 172.21.15.100:0/2153883743 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4c7c00bd00 con 0x7f4c94154c50 2024-09-11T22:20:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c996ce640 1 --2- 172.21.15.100:0/2153883743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c7c004d40 0x7f4c7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c98ecd640 1 --2- 172.21.15.100:0/2153883743 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c94154c50 0x7f4c7c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c93fff640 1 --2- 172.21.15.100:0/2153883743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c7c004120 0x7f4c7c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c996ce640 1 -- 172.21.15.100:0/2153883743 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c94154c50 msgr2=0x7f4c7c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c996ce640 1 --2- 172.21.15.100:0/2153883743 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c94154c50 0x7f4c7c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c996ce640 1 -- 172.21.15.100:0/2153883743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c7c004120 msgr2=0x7f4c7c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:44.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c996ce640 1 --2- 172.21.15.100:0/2153883743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c7c004120 0x7f4c7c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c996ce640 1 -- 172.21.15.100:0/2153883743 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7c003520 con 0x7f4c7c004d40 2024-09-11T22:20:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.049+0000 7f4c93fff640 1 --2- 172.21.15.100:0/2153883743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c7c004120 0x7f4c7c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.050+0000 7f4c996ce640 1 --2- 172.21.15.100:0/2153883743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c7c004d40 0x7f4c7c0051c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c0018d0 tx=0x7f4c7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1164e30c275918f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.050+0000 7f4c937fe640 1 -- 172.21.15.100:0/2153883743 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c0014f0 con 0x7f4c7c004d40 2024-09-11T22:20:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.050+0000 7f4c937fe640 1 -- 172.21.15.100:0/2153883743 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c8c0052d0 con 0x7f4c7c004d40 2024-09-11T22:20:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.050+0000 7f4c937fe640 1 -- 172.21.15.100:0/2153883743 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c02aca0 con 0x7f4c7c004d40 2024-09-11T22:20:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.050+0000 7f4c9b131640 1 -- 172.21.15.100:0/2153883743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c7c004d40 msgr2=0x7f4c7c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.050+0000 7f4c9b131640 1 --2- 172.21.15.100:0/2153883743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c7c004d40 0x7f4c7c0051c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c0018d0 tx=0x7f4c7c005830 comp rx=0 tx=0).stop 2024-09-11T22:20:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.050+0000 7f4c996ce640 1 -- 172.21.15.100:0/2153883743 reap_dead start 2024-09-11T22:20:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.050+0000 7f4c9b131640 1 -- 172.21.15.100:0/2153883743 shutdown_connections 2024-09-11T22:20:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.050+0000 7f4c9b131640 1 -- 172.21.15.100:0/2153883743 >> 172.21.15.100:0/2153883743 conn(0x7f4c9406fb50 msgr2=0x7f4c9406ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.050+0000 7f4c9b131640 1 -- 172.21.15.100:0/2153883743 shutdown_connections 2024-09-11T22:20:44.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.050+0000 7f4c9b131640 1 -- 172.21.15.100:0/2153883743 wait complete. 2024-09-11T22:20:44.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.052+0000 7f4c9b131640 1 Processor -- start 2024-09-11T22:20:44.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.052+0000 7f4c9b131640 1 -- start start 2024-09-11T22:20:44.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.052+0000 7f4c9b131640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c941f3e30 0x7f4c941f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.052+0000 7f4c9b131640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c9415bae0 0x7f4c941f4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.052+0000 7f4c9b131640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c941f4750 0x7f4c941493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.052+0000 7f4c9b131640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4c94155030 con 0x7f4c9415bae0 2024-09-11T22:20:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.052+0000 7f4c9b131640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4c940c9c90 con 0x7f4c941f4750 2024-09-11T22:20:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.052+0000 7f4c9b131640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4c94071b60 con 0x7f4c941f3e30 2024-09-11T22:20:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.053+0000 7f4c93fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c9415bae0 0x7f4c941f4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.053+0000 7f4c93fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c9415bae0 0x7f4c941f4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47156/0 (socket says 172.21.15.100:47156) 2024-09-11T22:20:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.053+0000 7f4c93fff640 1 -- 172.21.15.100:0/142866106 learned_addr learned my addr 172.21.15.100:0/142866106 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.053+0000 7f4c98ecd640 1 --2- 172.21.15.100:0/142866106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c941f3e30 0x7f4c941f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.053+0000 7f4c996ce640 1 --2- 172.21.15.100:0/142866106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c941f4750 0x7f4c941493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.053+0000 7f4c93fff640 1 -- 172.21.15.100:0/142866106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c941f3e30 msgr2=0x7f4c941f1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.053+0000 7f4c93fff640 1 --2- 172.21.15.100:0/142866106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c941f3e30 0x7f4c941f1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.053+0000 7f4c93fff640 1 -- 172.21.15.100:0/142866106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c941f4750 msgr2=0x7f4c941493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.053+0000 7f4c93fff640 1 --2- 172.21.15.100:0/142866106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c941f4750 0x7f4c941493e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.053+0000 7f4c93fff640 1 -- 172.21.15.100:0/142866106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c940cd360 con 0x7f4c9415bae0 2024-09-11T22:20:44.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.053+0000 7f4c93fff640 1 --2- 172.21.15.100:0/142866106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c9415bae0 0x7f4c941f4210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4c88004bc0 tx=0x7f4c8800e2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:44.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.053+0000 7f4c917fa640 1 -- 172.21.15.100:0/142866106 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c8800ece0 con 0x7f4c9415bae0 2024-09-11T22:20:44.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.053+0000 7f4c917fa640 1 -- 172.21.15.100:0/142866106 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c88018070 con 0x7f4c9415bae0 2024-09-11T22:20:44.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.053+0000 7f4c917fa640 1 -- 172.21.15.100:0/142866106 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c88013620 con 0x7f4c9415bae0 2024-09-11T22:20:44.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.053+0000 7f4c9b131640 1 -- 172.21.15.100:0/142866106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c940cd640 con 0x7f4c9415bae0 2024-09-11T22:20:44.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.053+0000 7f4c9b131640 1 -- 172.21.15.100:0/142866106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c941f2000 con 0x7f4c9415bae0 2024-09-11T22:20:44.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.054+0000 7f4c9b131640 1 -- 172.21.15.100:0/142866106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c9415b400 con 0x7f4c9415bae0 2024-09-11T22:20:44.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.055+0000 7f4c917fa640 1 -- 172.21.15.100:0/142866106 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4c880137c0 con 0x7f4c9415bae0 2024-09-11T22:20:44.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.055+0000 7f4c917fa640 1 --2- 172.21.15.100:0/142866106 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4c8006be30 0x7f4c8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.055+0000 7f4c98ecd640 1 --2- 172.21.15.100:0/142866106 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4c8006be30 0x7f4c8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.055+0000 7f4c917fa640 1 -- 172.21.15.100:0/142866106 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4c8808b710 con 0x7f4c9415bae0 2024-09-11T22:20:44.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.056+0000 7f4c98ecd640 1 --2- 172.21.15.100:0/142866106 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4c8006be30 0x7f4c8006e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009b00 tx=0x7f4c84008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:44.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.059+0000 7f4c917fa640 1 -- 172.21.15.100:0/142866106 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4c88059e10 con 0x7f4c9415bae0 2024-09-11T22:20:44.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.258+0000 7f4c9b131640 1 -- 172.21.15.100:0/142866106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c940cafb0 con 0x7f4c9415bae0 2024-09-11T22:20:44.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.258+0000 7f4c917fa640 1 -- 172.21.15.100:0/142866106 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6901 (secure 0 0 0) 0x7f4c88059710 con 0x7f4c9415bae0 2024-09-11T22:20:44.259 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:44.259 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":11,"btime":"2024-09-11T22:20:43:930365+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2075802330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":2075802330},{"type":"v1","addr":"172.21.15.100:6837","nonce":2075802330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/1727733473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1727733473},{"type":"v1","addr":"172.21.15.167:6836","nonce":1727733473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/880809662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":880809662},{"type":"v1","addr":"172.21.15.167:6837","nonce":880809662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1912241808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1912241808},{"type":"v1","addr":"172.21.15.100:6836","nonce":1912241808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:19.171222+0000","modified":"2024-09-11T22:20:43.259662+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":4296,"mds_1":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"e","rank":1,"incarnation":9,"state":"up:creating","state_seq":1,"addr":"172.21.15.100:6839/3236256661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3236256661},{"type":"v1","addr":"172.21.15.100:6839","nonce":3236256661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4296":{"gid":4296,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6834/1651678197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1651678197},{"type":"v1","addr":"172.21.15.167:6834","nonce":1651678197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-09-11T22:20:44.259 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 11 2024-09-11T22:20:44.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.260+0000 7f4c9b131640 1 -- 172.21.15.100:0/142866106 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4c8006be30 msgr2=0x7f4c8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.260+0000 7f4c9b131640 1 --2- 172.21.15.100:0/142866106 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4c8006be30 0x7f4c8006e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009b00 tx=0x7f4c84008040 comp rx=0 tx=0).stop 2024-09-11T22:20:44.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.260+0000 7f4c9b131640 1 -- 172.21.15.100:0/142866106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c9415bae0 msgr2=0x7f4c941f4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.260+0000 7f4c9b131640 1 --2- 172.21.15.100:0/142866106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c9415bae0 0x7f4c941f4210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4c88004bc0 tx=0x7f4c8800e2a0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.260+0000 7f4c9b131640 1 -- 172.21.15.100:0/142866106 shutdown_connections 2024-09-11T22:20:44.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.260+0000 7f4c9b131640 1 --2- 172.21.15.100:0/142866106 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4c8006be30 0x7f4c8006e2f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.260+0000 7f4c9b131640 1 --2- 172.21.15.100:0/142866106 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c941f4750 0x7f4c941493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.260+0000 7f4c9b131640 1 --2- 172.21.15.100:0/142866106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c9415bae0 0x7f4c941f4210 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.260+0000 7f4c9b131640 1 --2- 172.21.15.100:0/142866106 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c941f3e30 0x7f4c941f1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.260+0000 7f4c9b131640 1 -- 172.21.15.100:0/142866106 >> 172.21.15.100:0/142866106 conn(0x7f4c9406fb50 msgr2=0x7f4c9406cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:44.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.260+0000 7f4c9b131640 1 -- 172.21.15.100:0/142866106 shutdown_connections 2024-09-11T22:20:44.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.260+0000 7f4c9b131640 1 -- 172.21.15.100:0/142866106 wait complete. 2024-09-11T22:20:44.272 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:20:44.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.370+0000 7f74cfbfd640 1 Processor -- start 2024-09-11T22:20:44.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.370+0000 7f74cfbfd640 1 -- start start 2024-09-11T22:20:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.371+0000 7f74cfbfd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f74c80cad20 0x7f74c8154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.371+0000 7f74cfbfd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f74c80d0f00 0x7f74c8154d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.371+0000 7f74cfbfd640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74c80cd4c0 con 0x7f74c80d0b20 2024-09-11T22:20:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.371+0000 7f74cfbfd640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f74c80c55d0 con 0x7f74c80d0f00 2024-09-11T22:20:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.371+0000 7f74cfbfd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f74c80c58b0 con 0x7f74c80cad20 2024-09-11T22:20:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.371+0000 7f74ce19a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f74c80d0f00 0x7f74c8154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.371+0000 7f74cd999640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f74c80d0b20 0x7f74c80ccdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33210/0 (socket says 172.21.15.100:33210) 2024-09-11T22:20:44.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.371+0000 7f74ce19a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f74c80d0f00 0x7f74c8154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47160/0 (socket says 172.21.15.100:47160) 2024-09-11T22:20:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.371+0000 7f74cd999640 1 -- 172.21.15.100:0/3045095103 learned_addr learned my addr 172.21.15.100:0/3045095103 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.371+0000 7f74cd198640 1 --2- 172.21.15.100:0/3045095103 >> v2:172.21.15.167:3300/0 conn(0x7f74c80cad20 0x7f74c8154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.371+0000 7f74ce19a640 1 -- 172.21.15.100:0/3045095103 >> v2:172.21.15.167:3300/0 conn(0x7f74c80cad20 msgr2=0x7f74c8154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.371+0000 7f74ce19a640 1 --2- 172.21.15.100:0/3045095103 >> v2:172.21.15.167:3300/0 conn(0x7f74c80cad20 0x7f74c8154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.371+0000 7f74ce19a640 1 -- 172.21.15.100:0/3045095103 >> v1:172.21.15.100:6789/0 conn(0x7f74c80d0b20 legacy=0x7f74c80ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.371+0000 7f74ce19a640 1 -- 172.21.15.100:0/3045095103 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c815ad20 con 0x7f74c80d0f00 2024-09-11T22:20:44.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.371+0000 7f74cc997640 1 -- 172.21.15.100:0/3045095103 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2387537449 0 0) 0x7f74c80cd4c0 con 0x7f74c80d0b20 2024-09-11T22:20:44.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.372+0000 7f74ce19a640 1 --2- 172.21.15.100:0/3045095103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74c80d0f00 0x7f74c8154d70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f74c80726e0 tx=0x7f74c002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c5543ac7269a17 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:44.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.372+0000 7f74cc997640 1 -- 172.21.15.100:0/3045095103 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c0007740 con 0x7f74c80d0f00 2024-09-11T22:20:44.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.372+0000 7f74cc997640 1 -- 172.21.15.100:0/3045095103 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74c00078e0 con 0x7f74c80d0f00 2024-09-11T22:20:44.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.372+0000 7f74cc997640 1 -- 172.21.15.100:0/3045095103 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c0007cb0 con 0x7f74c80d0f00 2024-09-11T22:20:44.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.372+0000 7f74cfbfd640 1 -- 172.21.15.100:0/3045095103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74c80d0f00 msgr2=0x7f74c8154d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.373+0000 7f74cfbfd640 1 --2- 172.21.15.100:0/3045095103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74c80d0f00 0x7f74c8154d70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f74c80726e0 tx=0x7f74c002a5f0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.373+0000 7f74cfbfd640 1 -- 172.21.15.100:0/3045095103 shutdown_connections 2024-09-11T22:20:44.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.373+0000 7f74cfbfd640 1 --2- 172.21.15.100:0/3045095103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74c80d0f00 0x7f74c8154d70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.373+0000 7f74cfbfd640 1 --2- 172.21.15.100:0/3045095103 >> v2:172.21.15.167:3300/0 conn(0x7f74c80cad20 0x7f74c8154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.373+0000 7f74cfbfd640 1 -- 172.21.15.100:0/3045095103 >> 172.21.15.100:0/3045095103 conn(0x7f74c806d160 msgr2=0x7f74c806d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:44.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.373+0000 7f74cfbfd640 1 -- 172.21.15.100:0/3045095103 shutdown_connections 2024-09-11T22:20:44.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.373+0000 7f74cfbfd640 1 -- 172.21.15.100:0/3045095103 wait complete. 2024-09-11T22:20:44.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.374+0000 7f74cfbfd640 1 Processor -- start 2024-09-11T22:20:44.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.374+0000 7f74cfbfd640 1 -- start start 2024-09-11T22:20:44.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.374+0000 7f74cfbfd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74c80cad20 0x7f74c8152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.374+0000 7f74cfbfd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74c80d0b20 0x7f74c80c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.375+0000 7f74cfbfd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74c80d0f00 0x7f74c80c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.375+0000 7f74cfbfd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f74c815a9f0 con 0x7f74c80d0b20 2024-09-11T22:20:44.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.375+0000 7f74cfbfd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f74c815b2e0 con 0x7f74c80d0f00 2024-09-11T22:20:44.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.375+0000 7f74cfbfd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f74c815b800 con 0x7f74c80cad20 2024-09-11T22:20:44.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.375+0000 7f74cd198640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74c80d0b20 0x7f74c80c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.375+0000 7f74cd198640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74c80d0b20 0x7f74c80c8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47172/0 (socket says 172.21.15.100:47172) 2024-09-11T22:20:44.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.375+0000 7f74cd198640 1 -- 172.21.15.100:0/3995993918 learned_addr learned my addr 172.21.15.100:0/3995993918 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:44.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.375+0000 7f74ce19a640 1 --2- 172.21.15.100:0/3995993918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74c80d0f00 0x7f74c80c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.375+0000 7f74cd999640 1 --2- 172.21.15.100:0/3995993918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74c80cad20 0x7f74c8152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.375+0000 7f74cd198640 1 -- 172.21.15.100:0/3995993918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74c80cad20 msgr2=0x7f74c8152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.375+0000 7f74cd198640 1 --2- 172.21.15.100:0/3995993918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74c80cad20 0x7f74c8152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.375+0000 7f74cd198640 1 -- 172.21.15.100:0/3995993918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74c80d0f00 msgr2=0x7f74c80c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.375+0000 7f74cd198640 1 --2- 172.21.15.100:0/3995993918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74c80d0f00 0x7f74c80c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.375+0000 7f74cd198640 1 -- 172.21.15.100:0/3995993918 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c81e4730 con 0x7f74c80d0b20 2024-09-11T22:20:44.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.375+0000 7f74ce19a640 1 --2- 172.21.15.100:0/3995993918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74c80d0f00 0x7f74c80c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:44.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.375+0000 7f74cd198640 1 --2- 172.21.15.100:0/3995993918 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74c80d0b20 0x7f74c80c8540 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f74b800e9e0 tx=0x7f74b800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:44.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.375+0000 7f74be7fc640 1 -- 172.21.15.100:0/3995993918 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b8017070 con 0x7f74c80d0b20 2024-09-11T22:20:44.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.375+0000 7f74be7fc640 1 -- 172.21.15.100:0/3995993918 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74b800c9d0 con 0x7f74c80d0b20 2024-09-11T22:20:44.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.375+0000 7f74cfbfd640 1 -- 172.21.15.100:0/3995993918 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c80ca290 con 0x7f74c80d0b20 2024-09-11T22:20:44.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.375+0000 7f74be7fc640 1 -- 172.21.15.100:0/3995993918 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b800cdc0 con 0x7f74c80d0b20 2024-09-11T22:20:44.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.375+0000 7f74cfbfd640 1 -- 172.21.15.100:0/3995993918 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c80ca550 con 0x7f74c80d0b20 2024-09-11T22:20:44.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.376+0000 7f74cfbfd640 1 -- 172.21.15.100:0/3995993918 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74c8069290 con 0x7f74c80d0b20 2024-09-11T22:20:44.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.377+0000 7f74be7fc640 1 -- 172.21.15.100:0/3995993918 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f74b801a070 con 0x7f74c80d0b20 2024-09-11T22:20:44.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.377+0000 7f74be7fc640 1 --2- 172.21.15.100:0/3995993918 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f74ac06be30 0x7f74ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.377+0000 7f74be7fc640 1 -- 172.21.15.100:0/3995993918 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f74b808b260 con 0x7f74c80d0b20 2024-09-11T22:20:44.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.377+0000 7f74cd999640 1 --2- 172.21.15.100:0/3995993918 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f74ac06be30 0x7f74ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.378+0000 7f74cd999640 1 --2- 172.21.15.100:0/3995993918 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f74ac06be30 0x7f74ac06e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f74c4000f60 tx=0x7f74c4007b50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:44.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.381+0000 7f74be7fc640 1 -- 172.21.15.100:0/3995993918 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f74b8059840 con 0x7f74c80d0b20 2024-09-11T22:20:44.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.546+0000 7f74cfbfd640 1 -- 172.21.15.100:0/3995993918 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74c80cbf90 con 0x7f74c80d0b20 2024-09-11T22:20:44.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.547+0000 7f74be7fc640 1 -- 172.21.15.100:0/3995993918 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18646 (secure 0 0 0) 0x7f74b8059140 con 0x7f74c80d0b20 2024-09-11T22:20:44.548 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:44.549 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":26,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","created":"2024-09-11T22:19:56.198855+0000","modified":"2024-09-11T22:20:24.213024+0000","last_up_change":"2024-09-11T22:20:07.328863+0000","last_in_change":"2024-09-11T22:19:58.294227+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:20:08.333538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:20:16.995279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:20:18.147950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:20:21.873694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5de0ba54-34c5-4343-b19a-1f675efc49c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6809","nonce":2008454847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6811","nonce":2008454847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6815","nonce":2008454847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6813","nonce":2008454847}]},"public_addr":"172.21.15.100:6809/2008454847","cluster_addr":"172.21.15.100:6811/2008454847","heartbeat_back_addr":"172.21.15.100:6815/2008454847","heartbeat_front_addr":"172.21.15.100:6813/2008454847","state":["exists","up"]},{"osd":1,"uuid":"5a1f6456-6604-4b41-b9b9-52ae8d6616ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6801","nonce":1802107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6803","nonce":1802107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6807","nonce":1802107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6805","nonce":1802107101}]},"public_addr":"172.21.15.100:6801/1802107101","cluster_addr":"172.21.15.100:6803/1802107101","heartbeat_back_addr":"172.21.15.100:6807/1802107101","heartbeat_front_addr":"172.21.15.100:6805/1802107101","state":["exists","up"]},{"osd":2,"uuid":"a604cb26-7b0f-402d-b6ac-3652884b4b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6817","nonce":644491349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6819","nonce":644491349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6823","nonce":644491349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6821","nonce":644491349}]},"public_addr":"172.21.15.100:6817/644491349","cluster_addr":"172.21.15.100:6819/644491349","heartbeat_back_addr":"172.21.15.100:6823/644491349","heartbeat_front_addr":"172.21.15.100:6821/644491349","state":["exists","up"]},{"osd":3,"uuid":"73dc2cbb-70ff-4d12-ba2f-8778a49892f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6825","nonce":2519160882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6827","nonce":2519160882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6831","nonce":2519160882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6829","nonce":2519160882}]},"public_addr":"172.21.15.100:6825/2519160882","cluster_addr":"172.21.15.100:6827/2519160882","heartbeat_back_addr":"172.21.15.100:6831/2519160882","heartbeat_front_addr":"172.21.15.100:6829/2519160882","state":["exists","up"]},{"osd":4,"uuid":"07960648-04df-4aec-a72c-c29e28b74bcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6817","nonce":736010951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6819","nonce":736010951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6823","nonce":736010951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6821","nonce":736010951}]},"public_addr":"172.21.15.167:6817/736010951","cluster_addr":"172.21.15.167:6819/736010951","heartbeat_back_addr":"172.21.15.167:6823/736010951","heartbeat_front_addr":"172.21.15.167:6821/736010951","state":["exists","up"]},{"osd":5,"uuid":"2b4767e6-cab7-4b45-9150-55432f5576aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6825","nonce":2479173909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6827","nonce":2479173909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6831","nonce":2479173909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6829","nonce":2479173909}]},"public_addr":"172.21.15.167:6825/2479173909","cluster_addr":"172.21.15.167:6827/2479173909","heartbeat_back_addr":"172.21.15.167:6831/2479173909","heartbeat_front_addr":"172.21.15.167:6829/2479173909","state":["exists","up"]},{"osd":6,"uuid":"4ef2c4b5-52f4-4f69-8fca-2334077ed8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6809","nonce":2825112504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6811","nonce":2825112504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6815","nonce":2825112504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6813","nonce":2825112504}]},"public_addr":"172.21.15.167:6809/2825112504","cluster_addr":"172.21.15.167:6811/2825112504","heartbeat_back_addr":"172.21.15.167:6815/2825112504","heartbeat_front_addr":"172.21.15.167:6813/2825112504","state":["exists","up"]},{"osd":7,"uuid":"761673d8-d6fc-4ded-a9f3-d49ab8f7c969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337015843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337015843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337015843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337015843}]},"public_addr":"172.21.15.167:6801/1337015843","cluster_addr":"172.21.15.167:6803/1337015843","heartbeat_back_addr":"172.21.15.167:6807/1337015843","heartbeat_front_addr":"172.21.15.167:6805/1337015843","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.833280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.080311+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.100648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.544261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.670353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.880921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.365441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.366659+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:20:44.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.549+0000 7f74cfbfd640 1 -- 172.21.15.100:0/3995993918 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f74ac06be30 msgr2=0x7f74ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.549+0000 7f74cfbfd640 1 --2- 172.21.15.100:0/3995993918 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f74ac06be30 0x7f74ac06e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f74c4000f60 tx=0x7f74c4007b50 comp rx=0 tx=0).stop 2024-09-11T22:20:44.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.549+0000 7f74cfbfd640 1 -- 172.21.15.100:0/3995993918 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74c80d0b20 msgr2=0x7f74c80c8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.549+0000 7f74cfbfd640 1 --2- 172.21.15.100:0/3995993918 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74c80d0b20 0x7f74c80c8540 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f74b800e9e0 tx=0x7f74b800eea0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.549+0000 7f74cfbfd640 1 -- 172.21.15.100:0/3995993918 shutdown_connections 2024-09-11T22:20:44.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.549+0000 7f74cfbfd640 1 --2- 172.21.15.100:0/3995993918 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f74ac06be30 0x7f74ac06e2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.549+0000 7f74cfbfd640 1 --2- 172.21.15.100:0/3995993918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74c80d0f00 0x7f74c80c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.549+0000 7f74cfbfd640 1 --2- 172.21.15.100:0/3995993918 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74c80d0b20 0x7f74c80c8540 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.549+0000 7f74cfbfd640 1 --2- 172.21.15.100:0/3995993918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74c80cad20 0x7f74c8152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.549+0000 7f74cfbfd640 1 -- 172.21.15.100:0/3995993918 >> 172.21.15.100:0/3995993918 conn(0x7f74c806d160 msgr2=0x7f74c806d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:44.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.550+0000 7f74cfbfd640 1 -- 172.21.15.100:0/3995993918 shutdown_connections 2024-09-11T22:20:44.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.550+0000 7f74cfbfd640 1 -- 172.21.15.100:0/3995993918 wait complete. 2024-09-11T22:20:44.561 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T22:20:44.562 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:20:44.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.660+0000 7f2e9705e640 1 Processor -- start 2024-09-11T22:20:44.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.660+0000 7f2e9705e640 1 -- start start 2024-09-11T22:20:44.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.661+0000 7f2e9705e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2e9006be80 0x7f2e90070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.661+0000 7f2e9705e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2e9015b630 0x7f2e9006c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.661+0000 7f2e9705e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e900cb120 0x7f2e90157c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.661+0000 7f2e9705e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f2e9006c7a0 con 0x7f2e9006be80 2024-09-11T22:20:44.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.661+0000 7f2e9705e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f2e900cac90 con 0x7f2e9015b630 2024-09-11T22:20:44.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.661+0000 7f2e9705e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2e900b39c0 con 0x7f2e900cb120 2024-09-11T22:20:44.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.661+0000 7f2e94dfa640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2e9006be80 0x7f2e90070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.661+0000 7f2e94dfa640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2e9006be80 0x7f2e90070530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47180/0 (socket says 172.21.15.100:47180) 2024-09-11T22:20:44.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.661+0000 7f2e94dfa640 1 -- 172.21.15.100:0/2441331099 learned_addr learned my addr 172.21.15.100:0/2441331099 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:44.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.661+0000 7f2e955fb640 1 --2- 172.21.15.100:0/2441331099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e900cb120 0x7f2e90157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.661+0000 7f2e8ffff640 1 --2- 172.21.15.100:0/2441331099 >> v2:172.21.15.167:3300/0 conn(0x7f2e9015b630 0x7f2e9006c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.661+0000 7f2e94dfa640 1 -- 172.21.15.100:0/2441331099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e900cb120 msgr2=0x7f2e90157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:44.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.661+0000 7f2e94dfa640 1 --2- 172.21.15.100:0/2441331099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e900cb120 0x7f2e90157c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.661+0000 7f2e94dfa640 1 -- 172.21.15.100:0/2441331099 >> v2:172.21.15.167:3300/0 conn(0x7f2e9015b630 msgr2=0x7f2e9006c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:44.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.661+0000 7f2e94dfa640 1 --2- 172.21.15.100:0/2441331099 >> v2:172.21.15.167:3300/0 conn(0x7f2e9015b630 0x7f2e9006c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.661+0000 7f2e94dfa640 1 -- 172.21.15.100:0/2441331099 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e900b3ca0 con 0x7f2e9006be80 2024-09-11T22:20:44.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.662+0000 7f2e94dfa640 1 --2- 172.21.15.100:0/2441331099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e9006be80 0x7f2e90070530 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2e9006ef00 tx=0x7f2e8402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ee40db4c12e160 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:44.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.662+0000 7f2e8f7fe640 1 -- 172.21.15.100:0/2441331099 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e84037070 con 0x7f2e9006be80 2024-09-11T22:20:44.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.662+0000 7f2e8f7fe640 1 -- 172.21.15.100:0/2441331099 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e84032440 con 0x7f2e9006be80 2024-09-11T22:20:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.662+0000 7f2e8f7fe640 1 -- 172.21.15.100:0/2441331099 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e84032810 con 0x7f2e9006be80 2024-09-11T22:20:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.663+0000 7f2e9705e640 1 -- 172.21.15.100:0/2441331099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e9006be80 msgr2=0x7f2e90070530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.663+0000 7f2e9705e640 1 --2- 172.21.15.100:0/2441331099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e9006be80 0x7f2e90070530 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2e9006ef00 tx=0x7f2e8402a1e0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.663+0000 7f2e9705e640 1 -- 172.21.15.100:0/2441331099 shutdown_connections 2024-09-11T22:20:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.663+0000 7f2e9705e640 1 --2- 172.21.15.100:0/2441331099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e900cb120 0x7f2e90157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.663+0000 7f2e9705e640 1 --2- 172.21.15.100:0/2441331099 >> v2:172.21.15.167:3300/0 conn(0x7f2e9015b630 0x7f2e9006c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.663+0000 7f2e9705e640 1 --2- 172.21.15.100:0/2441331099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e9006be80 0x7f2e90070530 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.663+0000 7f2e9705e640 1 -- 172.21.15.100:0/2441331099 >> 172.21.15.100:0/2441331099 conn(0x7f2e9006de20 msgr2=0x7f2e9006e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.663+0000 7f2e9705e640 1 -- 172.21.15.100:0/2441331099 shutdown_connections 2024-09-11T22:20:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.663+0000 7f2e9705e640 1 -- 172.21.15.100:0/2441331099 wait complete. 2024-09-11T22:20:44.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.664+0000 7f2e9705e640 1 Processor -- start 2024-09-11T22:20:44.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.664+0000 7f2e9705e640 1 -- start start 2024-09-11T22:20:44.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.665+0000 7f2e9705e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e9006be80 0x7f2e900c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.665+0000 7f2e9705e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e900cb120 0x7f2e901f3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.665+0000 7f2e9705e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e9015b630 0x7f2e901f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.665+0000 7f2e9705e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2e900cb5b0 con 0x7f2e9015b630 2024-09-11T22:20:44.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.665+0000 7f2e9705e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9015ba60 con 0x7f2e9006be80 2024-09-11T22:20:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.665+0000 7f2e9705e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2e900cb730 con 0x7f2e900cb120 2024-09-11T22:20:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.665+0000 7f2e955fb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e9015b630 0x7f2e901f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.665+0000 7f2e955fb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e9015b630 0x7f2e901f3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47182/0 (socket says 172.21.15.100:47182) 2024-09-11T22:20:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.665+0000 7f2e955fb640 1 -- 172.21.15.100:0/3928688514 learned_addr learned my addr 172.21.15.100:0/3928688514 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.665+0000 7f2e8ffff640 1 --2- 172.21.15.100:0/3928688514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e900cb120 0x7f2e901f3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.665+0000 7f2e94dfa640 1 --2- 172.21.15.100:0/3928688514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e9006be80 0x7f2e900c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.665+0000 7f2e955fb640 1 -- 172.21.15.100:0/3928688514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e900cb120 msgr2=0x7f2e901f3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.665+0000 7f2e955fb640 1 --2- 172.21.15.100:0/3928688514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e900cb120 0x7f2e901f3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.665+0000 7f2e955fb640 1 -- 172.21.15.100:0/3928688514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e9006be80 msgr2=0x7f2e900c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.665+0000 7f2e955fb640 1 --2- 172.21.15.100:0/3928688514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e9006be80 0x7f2e900c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.665+0000 7f2e955fb640 1 -- 172.21.15.100:0/3928688514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e900ceb20 con 0x7f2e9015b630 2024-09-11T22:20:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.665+0000 7f2e955fb640 1 --2- 172.21.15.100:0/3928688514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e9015b630 0x7f2e901f3990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800cd20 tx=0x7f2e8800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.665+0000 7f2e8d7fa640 1 -- 172.21.15.100:0/3928688514 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88003b90 con 0x7f2e9015b630 2024-09-11T22:20:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.665+0000 7f2e8d7fa640 1 -- 172.21.15.100:0/3928688514 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e88003d30 con 0x7f2e9015b630 2024-09-11T22:20:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.665+0000 7f2e9705e640 1 -- 172.21.15.100:0/3928688514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e901f0910 con 0x7f2e9015b630 2024-09-11T22:20:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.665+0000 7f2e8d7fa640 1 -- 172.21.15.100:0/3928688514 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e88004240 con 0x7f2e9015b630 2024-09-11T22:20:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.665+0000 7f2e9705e640 1 -- 172.21.15.100:0/3928688514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e900cf0a0 con 0x7f2e9015b630 2024-09-11T22:20:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.666+0000 7f2e9705e640 1 -- 172.21.15.100:0/3928688514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e900c8df0 con 0x7f2e9015b630 2024-09-11T22:20:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.667+0000 7f2e8d7fa640 1 -- 172.21.15.100:0/3928688514 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e880043e0 con 0x7f2e9015b630 2024-09-11T22:20:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.667+0000 7f2e8d7fa640 1 --2- 172.21.15.100:0/3928688514 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2e7406be30 0x7f2e7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.667+0000 7f2e8d7fa640 1 -- 172.21.15.100:0/3928688514 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2e8808bb90 con 0x7f2e9015b630 2024-09-11T22:20:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.667+0000 7f2e94dfa640 1 --2- 172.21.15.100:0/3928688514 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2e7406be30 0x7f2e7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.668+0000 7f2e94dfa640 1 --2- 172.21.15.100:0/3928688514 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2e7406be30 0x7f2e7406e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2e84034000 tx=0x7f2e8402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.672+0000 7f2e8d7fa640 1 -- 172.21.15.100:0/3928688514 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e88059b20 con 0x7f2e9015b630 2024-09-11T22:20:44.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.834+0000 7f2e9705e640 1 -- 172.21.15.100:0/3928688514 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2e900ce2f0 con 0x7f2e7406be30 2024-09-11T22:20:44.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.842+0000 7f2e8d7fa640 1 -- 172.21.15.100:0/3928688514 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332611 (secure 0 0 0) 0x7f2e900ce2f0 con 0x7f2e7406be30 2024-09-11T22:20:44.847 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:44.849 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-11T22:20:44.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.846+0000 7f2e9705e640 1 -- 172.21.15.100:0/3928688514 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2e7406be30 msgr2=0x7f2e7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.846+0000 7f2e9705e640 1 --2- 172.21.15.100:0/3928688514 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2e7406be30 0x7f2e7406e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2e84034000 tx=0x7f2e8402e000 comp rx=0 tx=0).stop 2024-09-11T22:20:44.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.846+0000 7f2e9705e640 1 -- 172.21.15.100:0/3928688514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e9015b630 msgr2=0x7f2e901f3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:44.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.846+0000 7f2e9705e640 1 --2- 172.21.15.100:0/3928688514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e9015b630 0x7f2e901f3990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800cd20 tx=0x7f2e8800a660 comp rx=0 tx=0).stop 2024-09-11T22:20:44.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.846+0000 7f2e9705e640 1 -- 172.21.15.100:0/3928688514 shutdown_connections 2024-09-11T22:20:44.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.846+0000 7f2e9705e640 1 --2- 172.21.15.100:0/3928688514 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2e7406be30 0x7f2e7406e2f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.846+0000 7f2e9705e640 1 --2- 172.21.15.100:0/3928688514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e9015b630 0x7f2e901f3990 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.846+0000 7f2e9705e640 1 --2- 172.21.15.100:0/3928688514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e900cb120 0x7f2e901f3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.846+0000 7f2e9705e640 1 --2- 172.21.15.100:0/3928688514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e9006be80 0x7f2e900c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:44.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.846+0000 7f2e9705e640 1 -- 172.21.15.100:0/3928688514 >> 172.21.15.100:0/3928688514 conn(0x7f2e9006de20 msgr2=0x7f2e900af7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:44.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.846+0000 7f2e9705e640 1 -- 172.21.15.100:0/3928688514 shutdown_connections 2024-09-11T22:20:44.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.846+0000 7f2e9705e640 1 -- 172.21.15.100:0/3928688514 wait complete. 2024-09-11T22:20:44.858 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-09-11T22:20:44.309602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218524,"kb_used_data":2304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756196,"statfs":{"total":773094113280,"available":772870344704,"internally_reserved":0,"allocated":2359296,"data_stored":2048564,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002888"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048242+0000","last_change":"2024-09-11T22:20:18.853007+0000","last_active":"2024-09-11T22:20:27.048242+0000","last_peered":"2024-09-11T22:20:27.048242+0000","last_clean":"2024-09-11T22:20:27.048242+0000","last_became_active":"2024-09-11T22:20:18.852740+0000","last_became_peered":"2024-09-11T22:20:18.852740+0000","last_unstale":"2024-09-11T22:20:27.048242+0000","last_undegraded":"2024-09-11T22:20:27.048242+0000","last_fullsized":"2024-09-11T22:20:27.048242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:46.710328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887920+0000","last_change":"2024-09-11T22:20:19.849765+0000","last_active":"2024-09-11T22:20:24.887920+0000","last_peered":"2024-09-11T22:20:24.887920+0000","last_clean":"2024-09-11T22:20:24.887920+0000","last_became_active":"2024-09-11T22:20:19.848619+0000","last_became_peered":"2024-09-11T22:20:19.848619+0000","last_unstale":"2024-09-11T22:20:24.887920+0000","last_undegraded":"2024-09-11T22:20:24.887920+0000","last_fullsized":"2024-09-11T22:20:24.887920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:57.621624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887250+0000","last_change":"2024-09-11T22:20:24.078618+0000","last_active":"2024-09-11T22:20:24.887250+0000","last_peered":"2024-09-11T22:20:24.887250+0000","last_clean":"2024-09-11T22:20:24.887250+0000","last_became_active":"2024-09-11T22:20:24.078283+0000","last_became_peered":"2024-09-11T22:20:24.078283+0000","last_unstale":"2024-09-11T22:20:24.887250+0000","last_undegraded":"2024-09-11T22:20:24.887250+0000","last_fullsized":"2024-09-11T22:20:24.887250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:01.901307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888010+0000","last_change":"2024-09-11T22:20:18.855945+0000","last_active":"2024-09-11T22:20:24.888010+0000","last_peered":"2024-09-11T22:20:24.888010+0000","last_clean":"2024-09-11T22:20:24.888010+0000","last_became_active":"2024-09-11T22:20:18.854811+0000","last_became_peered":"2024-09-11T22:20:18.854811+0000","last_unstale":"2024-09-11T22:20:24.888010+0000","last_undegraded":"2024-09-11T22:20:24.888010+0000","last_fullsized":"2024-09-11T22:20:24.888010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:47.508920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048102+0000","last_change":"2024-09-11T22:20:19.862436+0000","last_active":"2024-09-11T22:20:27.048102+0000","last_peered":"2024-09-11T22:20:27.048102+0000","last_clean":"2024-09-11T22:20:27.048102+0000","last_became_active":"2024-09-11T22:20:19.862061+0000","last_became_peered":"2024-09-11T22:20:19.862061+0000","last_unstale":"2024-09-11T22:20:27.048102+0000","last_undegraded":"2024-09-11T22:20:27.048102+0000","last_fullsized":"2024-09-11T22:20:27.048102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047627+0000","last_change":"2024-09-11T22:20:23.879729+0000","last_active":"2024-09-11T22:20:27.047627+0000","last_peered":"2024-09-11T22:20:27.047627+0000","last_clean":"2024-09-11T22:20:27.047627+0000","last_became_active":"2024-09-11T22:20:23.879245+0000","last_became_peered":"2024-09-11T22:20:23.879245+0000","last_unstale":"2024-09-11T22:20:27.047627+0000","last_undegraded":"2024-09-11T22:20:27.047627+0000","last_fullsized":"2024-09-11T22:20:27.047627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:36.836842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048249+0000","last_change":"2024-09-11T22:20:18.853076+0000","last_active":"2024-09-11T22:20:27.048249+0000","last_peered":"2024-09-11T22:20:27.048249+0000","last_clean":"2024-09-11T22:20:27.048249+0000","last_became_active":"2024-09-11T22:20:18.852728+0000","last_became_peered":"2024-09-11T22:20:18.852728+0000","last_unstale":"2024-09-11T22:20:27.048249+0000","last_undegraded":"2024-09-11T22:20:27.048249+0000","last_fullsized":"2024-09-11T22:20:27.048249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890308+0000","last_change":"2024-09-11T22:20:19.864544+0000","last_active":"2024-09-11T22:20:24.890308+0000","last_peered":"2024-09-11T22:20:24.890308+0000","last_clean":"2024-09-11T22:20:24.890308+0000","last_became_active":"2024-09-11T22:20:19.864234+0000","last_became_peered":"2024-09-11T22:20:19.864234+0000","last_unstale":"2024-09-11T22:20:24.890308+0000","last_undegraded":"2024-09-11T22:20:24.890308+0000","last_fullsized":"2024-09-11T22:20:24.890308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048400+0000","last_change":"2024-09-11T22:20:23.873783+0000","last_active":"2024-09-11T22:20:27.048400+0000","last_peered":"2024-09-11T22:20:27.048400+0000","last_clean":"2024-09-11T22:20:27.048400+0000","last_became_active":"2024-09-11T22:20:23.873385+0000","last_became_peered":"2024-09-11T22:20:23.873385+0000","last_unstale":"2024-09-11T22:20:27.048400+0000","last_undegraded":"2024-09-11T22:20:27.048400+0000","last_fullsized":"2024-09-11T22:20:27.048400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048092+0000","last_change":"2024-09-11T22:20:18.861530+0000","last_active":"2024-09-11T22:20:27.048092+0000","last_peered":"2024-09-11T22:20:27.048092+0000","last_clean":"2024-09-11T22:20:27.048092+0000","last_became_active":"2024-09-11T22:20:18.861230+0000","last_became_peered":"2024-09-11T22:20:18.861230+0000","last_unstale":"2024-09-11T22:20:27.048092+0000","last_undegraded":"2024-09-11T22:20:27.048092+0000","last_fullsized":"2024-09-11T22:20:27.048092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890615+0000","last_change":"2024-09-11T22:20:19.863401+0000","last_active":"2024-09-11T22:20:24.890615+0000","last_peered":"2024-09-11T22:20:24.890615+0000","last_clean":"2024-09-11T22:20:24.890615+0000","last_became_active":"2024-09-11T22:20:19.863127+0000","last_became_peered":"2024-09-11T22:20:19.863127+0000","last_unstale":"2024-09-11T22:20:24.890615+0000","last_undegraded":"2024-09-11T22:20:24.890615+0000","last_fullsized":"2024-09-11T22:20:24.890615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:36.888544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048021+0000","last_change":"2024-09-11T22:20:23.874650+0000","last_active":"2024-09-11T22:20:27.048021+0000","last_peered":"2024-09-11T22:20:27.048021+0000","last_clean":"2024-09-11T22:20:27.048021+0000","last_became_active":"2024-09-11T22:20:23.874040+0000","last_became_peered":"2024-09-11T22:20:23.874040+0000","last_unstale":"2024-09-11T22:20:27.048021+0000","last_undegraded":"2024-09-11T22:20:27.048021+0000","last_fullsized":"2024-09-11T22:20:27.048021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888158+0000","last_change":"2024-09-11T22:20:19.859446+0000","last_active":"2024-09-11T22:20:24.888158+0000","last_peered":"2024-09-11T22:20:24.888158+0000","last_clean":"2024-09-11T22:20:24.888158+0000","last_became_active":"2024-09-11T22:20:19.859106+0000","last_became_peered":"2024-09-11T22:20:19.859106+0000","last_unstale":"2024-09-11T22:20:24.888158+0000","last_undegraded":"2024-09-11T22:20:24.888158+0000","last_fullsized":"2024-09-11T22:20:24.888158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048811+0000","last_change":"2024-09-11T22:20:18.856475+0000","last_active":"2024-09-11T22:20:27.048811+0000","last_peered":"2024-09-11T22:20:27.048811+0000","last_clean":"2024-09-11T22:20:27.048811+0000","last_became_active":"2024-09-11T22:20:18.856165+0000","last_became_peered":"2024-09-11T22:20:18.856165+0000","last_unstale":"2024-09-11T22:20:27.048811+0000","last_undegraded":"2024-09-11T22:20:27.048811+0000","last_fullsized":"2024-09-11T22:20:27.048811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048102+0000","last_change":"2024-09-11T22:20:23.878121+0000","last_active":"2024-09-11T22:20:27.048102+0000","last_peered":"2024-09-11T22:20:27.048102+0000","last_clean":"2024-09-11T22:20:27.048102+0000","last_became_active":"2024-09-11T22:20:23.877713+0000","last_became_peered":"2024-09-11T22:20:23.877713+0000","last_unstale":"2024-09-11T22:20:27.048102+0000","last_undegraded":"2024-09-11T22:20:27.048102+0000","last_fullsized":"2024-09-11T22:20:27.048102+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887604+0000","last_change":"2024-09-11T22:20:19.858358+0000","last_active":"2024-09-11T22:20:24.887604+0000","last_peered":"2024-09-11T22:20:24.887604+0000","last_clean":"2024-09-11T22:20:24.887604+0000","last_became_active":"2024-09-11T22:20:19.858057+0000","last_became_peered":"2024-09-11T22:20:19.858057+0000","last_unstale":"2024-09-11T22:20:24.887604+0000","last_undegraded":"2024-09-11T22:20:24.887604+0000","last_fullsized":"2024-09-11T22:20:24.887604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:07.839926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998178+0000","last_change":"2024-09-11T22:20:18.853818+0000","last_active":"2024-09-11T22:20:24.998178+0000","last_peered":"2024-09-11T22:20:24.998178+0000","last_clean":"2024-09-11T22:20:24.998178+0000","last_became_active":"2024-09-11T22:20:18.853508+0000","last_became_peered":"2024-09-11T22:20:18.853508+0000","last_unstale":"2024-09-11T22:20:24.998178+0000","last_undegraded":"2024-09-11T22:20:24.998178+0000","last_fullsized":"2024-09-11T22:20:24.998178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:58.141587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047962+0000","last_change":"2024-09-11T22:20:23.879226+0000","last_active":"2024-09-11T22:20:27.047962+0000","last_peered":"2024-09-11T22:20:27.047962+0000","last_clean":"2024-09-11T22:20:27.047962+0000","last_became_active":"2024-09-11T22:20:23.878199+0000","last_became_peered":"2024-09-11T22:20:23.878199+0000","last_unstale":"2024-09-11T22:20:27.047962+0000","last_undegraded":"2024-09-11T22:20:27.047962+0000","last_fullsized":"2024-09-11T22:20:27.047962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:13.245927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887402+0000","last_change":"2024-09-11T22:20:19.844748+0000","last_active":"2024-09-11T22:20:24.887402+0000","last_peered":"2024-09-11T22:20:24.887402+0000","last_clean":"2024-09-11T22:20:24.887402+0000","last_became_active":"2024-09-11T22:20:19.844446+0000","last_became_peered":"2024-09-11T22:20:19.844446+0000","last_unstale":"2024-09-11T22:20:24.887402+0000","last_undegraded":"2024-09-11T22:20:24.887402+0000","last_fullsized":"2024-09-11T22:20:24.887402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:13.319918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997785+0000","last_change":"2024-09-11T22:20:18.847388+0000","last_active":"2024-09-11T22:20:24.997785+0000","last_peered":"2024-09-11T22:20:24.997785+0000","last_clean":"2024-09-11T22:20:24.997785+0000","last_became_active":"2024-09-11T22:20:18.847118+0000","last_became_peered":"2024-09-11T22:20:18.847118+0000","last_unstale":"2024-09-11T22:20:24.997785+0000","last_undegraded":"2024-09-11T22:20:24.997785+0000","last_fullsized":"2024-09-11T22:20:24.997785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:47.360920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998393+0000","last_change":"2024-09-11T22:20:24.077604+0000","last_active":"2024-09-11T22:20:24.998393+0000","last_peered":"2024-09-11T22:20:24.998393+0000","last_clean":"2024-09-11T22:20:24.998393+0000","last_became_active":"2024-09-11T22:20:24.077231+0000","last_became_peered":"2024-09-11T22:20:24.077231+0000","last_unstale":"2024-09-11T22:20:24.998393+0000","last_undegraded":"2024-09-11T22:20:24.998393+0000","last_fullsized":"2024-09-11T22:20:24.998393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:38.846688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048647+0000","last_change":"2024-09-11T22:20:19.854453+0000","last_active":"2024-09-11T22:20:27.048647+0000","last_peered":"2024-09-11T22:20:27.048647+0000","last_clean":"2024-09-11T22:20:27.048647+0000","last_became_active":"2024-09-11T22:20:19.854100+0000","last_became_peered":"2024-09-11T22:20:19.854100+0000","last_unstale":"2024-09-11T22:20:27.048647+0000","last_undegraded":"2024-09-11T22:20:27.048647+0000","last_fullsized":"2024-09-11T22:20:27.048647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:06.166813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047502+0000","last_change":"2024-09-11T22:20:18.854889+0000","last_active":"2024-09-11T22:20:27.047502+0000","last_peered":"2024-09-11T22:20:27.047502+0000","last_clean":"2024-09-11T22:20:27.047502+0000","last_became_active":"2024-09-11T22:20:18.854552+0000","last_became_peered":"2024-09-11T22:20:18.854552+0000","last_unstale":"2024-09-11T22:20:27.047502+0000","last_undegraded":"2024-09-11T22:20:27.047502+0000","last_fullsized":"2024-09-11T22:20:27.047502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:33.612126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048443+0000","last_change":"2024-09-11T22:20:23.878932+0000","last_active":"2024-09-11T22:20:27.048443+0000","last_peered":"2024-09-11T22:20:27.048443+0000","last_clean":"2024-09-11T22:20:27.048443+0000","last_became_active":"2024-09-11T22:20:23.878305+0000","last_became_peered":"2024-09-11T22:20:23.878305+0000","last_unstale":"2024-09-11T22:20:27.048443+0000","last_undegraded":"2024-09-11T22:20:27.048443+0000","last_fullsized":"2024-09-11T22:20:27.048443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048250+0000","last_change":"2024-09-11T22:20:19.856318+0000","last_active":"2024-09-11T22:20:27.048250+0000","last_peered":"2024-09-11T22:20:27.048250+0000","last_clean":"2024-09-11T22:20:27.048250+0000","last_became_active":"2024-09-11T22:20:19.855992+0000","last_became_peered":"2024-09-11T22:20:19.855992+0000","last_unstale":"2024-09-11T22:20:27.048250+0000","last_undegraded":"2024-09-11T22:20:27.048250+0000","last_fullsized":"2024-09-11T22:20:27.048250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:57.709140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889662+0000","last_change":"2024-09-11T22:20:18.850750+0000","last_active":"2024-09-11T22:20:24.889662+0000","last_peered":"2024-09-11T22:20:24.889662+0000","last_clean":"2024-09-11T22:20:24.889662+0000","last_became_active":"2024-09-11T22:20:18.849621+0000","last_became_peered":"2024-09-11T22:20:18.849621+0000","last_unstale":"2024-09-11T22:20:24.889662+0000","last_undegraded":"2024-09-11T22:20:24.889662+0000","last_fullsized":"2024-09-11T22:20:24.889662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047710+0000","last_change":"2024-09-11T22:20:24.077741+0000","last_active":"2024-09-11T22:20:27.047710+0000","last_peered":"2024-09-11T22:20:27.047710+0000","last_clean":"2024-09-11T22:20:27.047710+0000","last_became_active":"2024-09-11T22:20:24.077325+0000","last_became_peered":"2024-09-11T22:20:24.077325+0000","last_unstale":"2024-09-11T22:20:27.047710+0000","last_undegraded":"2024-09-11T22:20:27.047710+0000","last_fullsized":"2024-09-11T22:20:27.047710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:18.656529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888138+0000","last_change":"2024-09-11T22:20:19.850738+0000","last_active":"2024-09-11T22:20:24.888138+0000","last_peered":"2024-09-11T22:20:24.888138+0000","last_clean":"2024-09-11T22:20:24.888138+0000","last_became_active":"2024-09-11T22:20:19.850441+0000","last_became_peered":"2024-09-11T22:20:19.850441+0000","last_unstale":"2024-09-11T22:20:24.888138+0000","last_undegraded":"2024-09-11T22:20:24.888138+0000","last_fullsized":"2024-09-11T22:20:24.888138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:47.552343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998291+0000","last_change":"2024-09-11T22:20:18.845173+0000","last_active":"2024-09-11T22:20:24.998291+0000","last_peered":"2024-09-11T22:20:24.998291+0000","last_clean":"2024-09-11T22:20:24.998291+0000","last_became_active":"2024-09-11T22:20:18.844731+0000","last_became_peered":"2024-09-11T22:20:18.844731+0000","last_unstale":"2024-09-11T22:20:24.998291+0000","last_undegraded":"2024-09-11T22:20:24.998291+0000","last_fullsized":"2024-09-11T22:20:24.998291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:32.963285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887172+0000","last_change":"2024-09-11T22:20:24.078020+0000","last_active":"2024-09-11T22:20:24.887172+0000","last_peered":"2024-09-11T22:20:24.887172+0000","last_clean":"2024-09-11T22:20:24.887172+0000","last_became_active":"2024-09-11T22:20:24.077541+0000","last_became_peered":"2024-09-11T22:20:24.077541+0000","last_unstale":"2024-09-11T22:20:24.887172+0000","last_undegraded":"2024-09-11T22:20:24.887172+0000","last_fullsized":"2024-09-11T22:20:24.887172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:36.122714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998068+0000","last_change":"2024-09-11T22:20:19.845497+0000","last_active":"2024-09-11T22:20:24.998068+0000","last_peered":"2024-09-11T22:20:24.998068+0000","last_clean":"2024-09-11T22:20:24.998068+0000","last_became_active":"2024-09-11T22:20:19.845203+0000","last_became_peered":"2024-09-11T22:20:19.845203+0000","last_unstale":"2024-09-11T22:20:24.998068+0000","last_undegraded":"2024-09-11T22:20:24.998068+0000","last_fullsized":"2024-09-11T22:20:24.998068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:12.086231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048854+0000","last_change":"2024-09-11T22:20:18.856263+0000","last_active":"2024-09-11T22:20:27.048854+0000","last_peered":"2024-09-11T22:20:27.048854+0000","last_clean":"2024-09-11T22:20:27.048854+0000","last_became_active":"2024-09-11T22:20:18.855968+0000","last_became_peered":"2024-09-11T22:20:18.855968+0000","last_unstale":"2024-09-11T22:20:27.048854+0000","last_undegraded":"2024-09-11T22:20:27.048854+0000","last_fullsized":"2024-09-11T22:20:27.048854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047968+0000","last_change":"2024-09-11T22:20:24.075030+0000","last_active":"2024-09-11T22:20:27.047968+0000","last_peered":"2024-09-11T22:20:27.047968+0000","last_clean":"2024-09-11T22:20:27.047968+0000","last_became_active":"2024-09-11T22:20:24.074588+0000","last_became_peered":"2024-09-11T22:20:24.074588+0000","last_unstale":"2024-09-11T22:20:27.047968+0000","last_undegraded":"2024-09-11T22:20:27.047968+0000","last_fullsized":"2024-09-11T22:20:27.047968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890676+0000","last_change":"2024-09-11T22:20:19.859010+0000","last_active":"2024-09-11T22:20:24.890676+0000","last_peered":"2024-09-11T22:20:24.890676+0000","last_clean":"2024-09-11T22:20:24.890676+0000","last_became_active":"2024-09-11T22:20:19.858585+0000","last_became_peered":"2024-09-11T22:20:19.858585+0000","last_unstale":"2024-09-11T22:20:24.890676+0000","last_undegraded":"2024-09-11T22:20:24.890676+0000","last_fullsized":"2024-09-11T22:20:24.890676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998168+0000","last_change":"2024-09-11T22:20:18.847904+0000","last_active":"2024-09-11T22:20:24.998168+0000","last_peered":"2024-09-11T22:20:24.998168+0000","last_clean":"2024-09-11T22:20:24.998168+0000","last_became_active":"2024-09-11T22:20:18.847669+0000","last_became_peered":"2024-09-11T22:20:18.847669+0000","last_unstale":"2024-09-11T22:20:24.998168+0000","last_undegraded":"2024-09-11T22:20:24.998168+0000","last_fullsized":"2024-09-11T22:20:24.998168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:08.717999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997794+0000","last_change":"2024-09-11T22:20:23.881067+0000","last_active":"2024-09-11T22:20:24.997794+0000","last_peered":"2024-09-11T22:20:24.997794+0000","last_clean":"2024-09-11T22:20:24.997794+0000","last_became_active":"2024-09-11T22:20:23.880468+0000","last_became_peered":"2024-09-11T22:20:23.880468+0000","last_unstale":"2024-09-11T22:20:24.997794+0000","last_undegraded":"2024-09-11T22:20:24.997794+0000","last_fullsized":"2024-09-11T22:20:24.997794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:23.480547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048637+0000","last_change":"2024-09-11T22:20:19.860423+0000","last_active":"2024-09-11T22:20:27.048637+0000","last_peered":"2024-09-11T22:20:27.048637+0000","last_clean":"2024-09-11T22:20:27.048637+0000","last_became_active":"2024-09-11T22:20:19.858932+0000","last_became_peered":"2024-09-11T22:20:19.858932+0000","last_unstale":"2024-09-11T22:20:27.048637+0000","last_undegraded":"2024-09-11T22:20:27.048637+0000","last_fullsized":"2024-09-11T22:20:27.048637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:53.255932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889986+0000","last_change":"2024-09-11T22:20:18.854973+0000","last_active":"2024-09-11T22:20:24.889986+0000","last_peered":"2024-09-11T22:20:24.889986+0000","last_clean":"2024-09-11T22:20:24.889986+0000","last_became_active":"2024-09-11T22:20:18.854725+0000","last_became_peered":"2024-09-11T22:20:18.854725+0000","last_unstale":"2024-09-11T22:20:24.889986+0000","last_undegraded":"2024-09-11T22:20:24.889986+0000","last_fullsized":"2024-09-11T22:20:24.889986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998393+0000","last_change":"2024-09-11T22:20:23.880693+0000","last_active":"2024-09-11T22:20:24.998393+0000","last_peered":"2024-09-11T22:20:24.998393+0000","last_clean":"2024-09-11T22:20:24.998393+0000","last_became_active":"2024-09-11T22:20:23.880243+0000","last_became_peered":"2024-09-11T22:20:23.880243+0000","last_unstale":"2024-09-11T22:20:24.998393+0000","last_undegraded":"2024-09-11T22:20:24.998393+0000","last_fullsized":"2024-09-11T22:20:24.998393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.659287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997954+0000","last_change":"2024-09-11T22:20:19.844808+0000","last_active":"2024-09-11T22:20:24.997954+0000","last_peered":"2024-09-11T22:20:24.997954+0000","last_clean":"2024-09-11T22:20:24.997954+0000","last_became_active":"2024-09-11T22:20:19.844536+0000","last_became_peered":"2024-09-11T22:20:19.844536+0000","last_unstale":"2024-09-11T22:20:24.997954+0000","last_undegraded":"2024-09-11T22:20:24.997954+0000","last_fullsized":"2024-09-11T22:20:24.997954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:57.142383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951217+0000","last_change":"2024-09-11T22:20:18.855640+0000","last_active":"2024-09-11T22:20:26.951217+0000","last_peered":"2024-09-11T22:20:26.951217+0000","last_clean":"2024-09-11T22:20:26.951217+0000","last_became_active":"2024-09-11T22:20:18.855394+0000","last_became_peered":"2024-09-11T22:20:18.855394+0000","last_unstale":"2024-09-11T22:20:26.951217+0000","last_undegraded":"2024-09-11T22:20:26.951217+0000","last_fullsized":"2024-09-11T22:20:26.951217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998458+0000","last_change":"2024-09-11T22:20:23.882554+0000","last_active":"2024-09-11T22:20:24.998458+0000","last_peered":"2024-09-11T22:20:24.998458+0000","last_clean":"2024-09-11T22:20:24.998458+0000","last_became_active":"2024-09-11T22:20:23.881642+0000","last_became_peered":"2024-09-11T22:20:23.881642+0000","last_unstale":"2024-09-11T22:20:24.998458+0000","last_undegraded":"2024-09-11T22:20:24.998458+0000","last_fullsized":"2024-09-11T22:20:24.998458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:16.696043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047535+0000","last_change":"2024-09-11T22:20:19.859429+0000","last_active":"2024-09-11T22:20:27.047535+0000","last_peered":"2024-09-11T22:20:27.047535+0000","last_clean":"2024-09-11T22:20:27.047535+0000","last_became_active":"2024-09-11T22:20:19.859159+0000","last_became_peered":"2024-09-11T22:20:19.859159+0000","last_unstale":"2024-09-11T22:20:27.047535+0000","last_undegraded":"2024-09-11T22:20:27.047535+0000","last_fullsized":"2024-09-11T22:20:27.047535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:02.696450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047156+0000","last_change":"2024-09-11T22:20:18.856144+0000","last_active":"2024-09-11T22:20:27.047156+0000","last_peered":"2024-09-11T22:20:27.047156+0000","last_clean":"2024-09-11T22:20:27.047156+0000","last_became_active":"2024-09-11T22:20:18.855866+0000","last_became_peered":"2024-09-11T22:20:18.855866+0000","last_unstale":"2024-09-11T22:20:27.047156+0000","last_undegraded":"2024-09-11T22:20:27.047156+0000","last_fullsized":"2024-09-11T22:20:27.047156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:37.259393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048214+0000","last_change":"2024-09-11T22:20:24.075154+0000","last_active":"2024-09-11T22:20:27.048214+0000","last_peered":"2024-09-11T22:20:27.048214+0000","last_clean":"2024-09-11T22:20:27.048214+0000","last_became_active":"2024-09-11T22:20:24.074568+0000","last_became_peered":"2024-09-11T22:20:24.074568+0000","last_unstale":"2024-09-11T22:20:27.048214+0000","last_undegraded":"2024-09-11T22:20:27.048214+0000","last_fullsized":"2024-09-11T22:20:27.048214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:09.804991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887321+0000","last_change":"2024-09-11T22:20:19.861236+0000","last_active":"2024-09-11T22:20:24.887321+0000","last_peered":"2024-09-11T22:20:24.887321+0000","last_clean":"2024-09-11T22:20:24.887321+0000","last_became_active":"2024-09-11T22:20:19.860938+0000","last_became_peered":"2024-09-11T22:20:19.860938+0000","last_unstale":"2024-09-11T22:20:24.887321+0000","last_undegraded":"2024-09-11T22:20:24.887321+0000","last_fullsized":"2024-09-11T22:20:24.887321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:42.015334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890426+0000","last_change":"2024-09-11T22:20:18.853467+0000","last_active":"2024-09-11T22:20:24.890426+0000","last_peered":"2024-09-11T22:20:24.890426+0000","last_clean":"2024-09-11T22:20:24.890426+0000","last_became_active":"2024-09-11T22:20:18.853182+0000","last_became_peered":"2024-09-11T22:20:18.853182+0000","last_unstale":"2024-09-11T22:20:24.890426+0000","last_undegraded":"2024-09-11T22:20:24.890426+0000","last_fullsized":"2024-09-11T22:20:24.890426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047625+0000","last_change":"2024-09-11T22:20:09.425648+0000","last_active":"2024-09-11T22:20:27.047625+0000","last_peered":"2024-09-11T22:20:27.047625+0000","last_clean":"2024-09-11T22:20:27.047625+0000","last_became_active":"2024-09-11T22:20:09.424591+0000","last_became_peered":"2024-09-11T22:20:09.424591+0000","last_unstale":"2024-09-11T22:20:27.047625+0000","last_undegraded":"2024-09-11T22:20:27.047625+0000","last_fullsized":"2024-09-11T22:20:27.047625+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_clean_scrub_stamp":"2024-09-11T22:20:08.334092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:53.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888536+0000","last_change":"2024-09-11T22:20:24.077007+0000","last_active":"2024-09-11T22:20:24.888536+0000","last_peered":"2024-09-11T22:20:24.888536+0000","last_clean":"2024-09-11T22:20:24.888536+0000","last_became_active":"2024-09-11T22:20:24.076601+0000","last_became_peered":"2024-09-11T22:20:24.076601+0000","last_unstale":"2024-09-11T22:20:24.888536+0000","last_undegraded":"2024-09-11T22:20:24.888536+0000","last_fullsized":"2024-09-11T22:20:24.888536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048600+0000","last_change":"2024-09-11T22:20:19.863279+0000","last_active":"2024-09-11T22:20:27.048600+0000","last_peered":"2024-09-11T22:20:27.048600+0000","last_clean":"2024-09-11T22:20:27.048600+0000","last_became_active":"2024-09-11T22:20:19.861322+0000","last_became_peered":"2024-09-11T22:20:19.861322+0000","last_unstale":"2024-09-11T22:20:27.048600+0000","last_undegraded":"2024-09-11T22:20:27.048600+0000","last_fullsized":"2024-09-11T22:20:27.048600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951240+0000","last_change":"2024-09-11T22:20:18.853343+0000","last_active":"2024-09-11T22:20:26.951240+0000","last_peered":"2024-09-11T22:20:26.951240+0000","last_clean":"2024-09-11T22:20:26.951240+0000","last_became_active":"2024-09-11T22:20:18.853069+0000","last_became_peered":"2024-09-11T22:20:18.853069+0000","last_unstale":"2024-09-11T22:20:26.951240+0000","last_undegraded":"2024-09-11T22:20:26.951240+0000","last_fullsized":"2024-09-11T22:20:26.951240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888655+0000","last_change":"2024-09-11T22:20:24.075350+0000","last_active":"2024-09-11T22:20:24.888655+0000","last_peered":"2024-09-11T22:20:24.888655+0000","last_clean":"2024-09-11T22:20:24.888655+0000","last_became_active":"2024-09-11T22:20:24.074789+0000","last_became_peered":"2024-09-11T22:20:24.074789+0000","last_unstale":"2024-09-11T22:20:24.888655+0000","last_undegraded":"2024-09-11T22:20:24.888655+0000","last_fullsized":"2024-09-11T22:20:24.888655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890400+0000","last_change":"2024-09-11T22:20:19.866331+0000","last_active":"2024-09-11T22:20:24.890400+0000","last_peered":"2024-09-11T22:20:24.890400+0000","last_clean":"2024-09-11T22:20:24.890400+0000","last_became_active":"2024-09-11T22:20:19.865535+0000","last_became_peered":"2024-09-11T22:20:19.865535+0000","last_unstale":"2024-09-11T22:20:24.890400+0000","last_undegraded":"2024-09-11T22:20:24.890400+0000","last_fullsized":"2024-09-11T22:20:24.890400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998164+0000","last_change":"2024-09-11T22:20:18.849434+0000","last_active":"2024-09-11T22:20:24.998164+0000","last_peered":"2024-09-11T22:20:24.998164+0000","last_clean":"2024-09-11T22:20:24.998164+0000","last_became_active":"2024-09-11T22:20:18.848787+0000","last_became_peered":"2024-09-11T22:20:18.848787+0000","last_unstale":"2024-09-11T22:20:24.998164+0000","last_undegraded":"2024-09-11T22:20:24.998164+0000","last_fullsized":"2024-09-11T22:20:24.998164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:25.689495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048087+0000","last_change":"2024-09-11T22:20:23.879962+0000","last_active":"2024-09-11T22:20:27.048087+0000","last_peered":"2024-09-11T22:20:27.048087+0000","last_clean":"2024-09-11T22:20:27.048087+0000","last_became_active":"2024-09-11T22:20:23.879586+0000","last_became_peered":"2024-09-11T22:20:23.879586+0000","last_unstale":"2024-09-11T22:20:27.048087+0000","last_undegraded":"2024-09-11T22:20:27.048087+0000","last_fullsized":"2024-09-11T22:20:27.048087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:27.323116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.049164+0000","last_change":"2024-09-11T22:20:19.860411+0000","last_active":"2024-09-11T22:20:27.049164+0000","last_peered":"2024-09-11T22:20:27.049164+0000","last_clean":"2024-09-11T22:20:27.049164+0000","last_became_active":"2024-09-11T22:20:19.860076+0000","last_became_peered":"2024-09-11T22:20:19.860076+0000","last_unstale":"2024-09-11T22:20:27.049164+0000","last_undegraded":"2024-09-11T22:20:27.049164+0000","last_fullsized":"2024-09-11T22:20:27.049164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951255+0000","last_change":"2024-09-11T22:20:18.856020+0000","last_active":"2024-09-11T22:20:26.951255+0000","last_peered":"2024-09-11T22:20:26.951255+0000","last_clean":"2024-09-11T22:20:26.951255+0000","last_became_active":"2024-09-11T22:20:18.855753+0000","last_became_peered":"2024-09-11T22:20:18.855753+0000","last_unstale":"2024-09-11T22:20:26.951255+0000","last_undegraded":"2024-09-11T22:20:26.951255+0000","last_fullsized":"2024-09-11T22:20:26.951255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888726+0000","last_change":"2024-09-11T22:20:24.077975+0000","last_active":"2024-09-11T22:20:24.888726+0000","last_peered":"2024-09-11T22:20:24.888726+0000","last_clean":"2024-09-11T22:20:24.888726+0000","last_became_active":"2024-09-11T22:20:24.077502+0000","last_became_peered":"2024-09-11T22:20:24.077502+0000","last_unstale":"2024-09-11T22:20:24.888726+0000","last_undegraded":"2024-09-11T22:20:24.888726+0000","last_fullsized":"2024-09-11T22:20:24.888726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:16.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047781+0000","last_change":"2024-09-11T22:20:19.856986+0000","last_active":"2024-09-11T22:20:27.047781+0000","last_peered":"2024-09-11T22:20:27.047781+0000","last_clean":"2024-09-11T22:20:27.047781+0000","last_became_active":"2024-09-11T22:20:19.856739+0000","last_became_peered":"2024-09-11T22:20:19.856739+0000","last_unstale":"2024-09-11T22:20:27.047781+0000","last_undegraded":"2024-09-11T22:20:27.047781+0000","last_fullsized":"2024-09-11T22:20:27.047781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048306+0000","last_change":"2024-09-11T22:20:18.855044+0000","last_active":"2024-09-11T22:20:27.048306+0000","last_peered":"2024-09-11T22:20:27.048306+0000","last_clean":"2024-09-11T22:20:27.048306+0000","last_became_active":"2024-09-11T22:20:18.854764+0000","last_became_peered":"2024-09-11T22:20:18.854764+0000","last_unstale":"2024-09-11T22:20:27.048306+0000","last_undegraded":"2024-09-11T22:20:27.048306+0000","last_fullsized":"2024-09-11T22:20:27.048306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:22.207278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047516+0000","last_change":"2024-09-11T22:20:23.878383+0000","last_active":"2024-09-11T22:20:27.047516+0000","last_peered":"2024-09-11T22:20:27.047516+0000","last_clean":"2024-09-11T22:20:27.047516+0000","last_became_active":"2024-09-11T22:20:23.877890+0000","last_became_peered":"2024-09-11T22:20:23.877890+0000","last_unstale":"2024-09-11T22:20:27.047516+0000","last_undegraded":"2024-09-11T22:20:27.047516+0000","last_fullsized":"2024-09-11T22:20:27.047516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:18.876485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048434+0000","last_change":"2024-09-11T22:20:19.861242+0000","last_active":"2024-09-11T22:20:27.048434+0000","last_peered":"2024-09-11T22:20:27.048434+0000","last_clean":"2024-09-11T22:20:27.048434+0000","last_became_active":"2024-09-11T22:20:19.860988+0000","last_became_peered":"2024-09-11T22:20:19.860988+0000","last_unstale":"2024-09-11T22:20:27.048434+0000","last_undegraded":"2024-09-11T22:20:27.048434+0000","last_fullsized":"2024-09-11T22:20:27.048434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951217+0000","last_change":"2024-09-11T22:20:18.852459+0000","last_active":"2024-09-11T22:20:26.951217+0000","last_peered":"2024-09-11T22:20:26.951217+0000","last_clean":"2024-09-11T22:20:26.951217+0000","last_became_active":"2024-09-11T22:20:18.852153+0000","last_became_peered":"2024-09-11T22:20:18.852153+0000","last_unstale":"2024-09-11T22:20:26.951217+0000","last_undegraded":"2024-09-11T22:20:26.951217+0000","last_fullsized":"2024-09-11T22:20:26.951217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048026+0000","last_change":"2024-09-11T22:20:23.874062+0000","last_active":"2024-09-11T22:20:27.048026+0000","last_peered":"2024-09-11T22:20:27.048026+0000","last_clean":"2024-09-11T22:20:27.048026+0000","last_became_active":"2024-09-11T22:20:23.873635+0000","last_became_peered":"2024-09-11T22:20:23.873635+0000","last_unstale":"2024-09-11T22:20:27.048026+0000","last_undegraded":"2024-09-11T22:20:27.048026+0000","last_fullsized":"2024-09-11T22:20:27.048026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:40.914142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888125+0000","last_change":"2024-09-11T22:20:19.851577+0000","last_active":"2024-09-11T22:20:24.888125+0000","last_peered":"2024-09-11T22:20:24.888125+0000","last_clean":"2024-09-11T22:20:24.888125+0000","last_became_active":"2024-09-11T22:20:19.851286+0000","last_became_peered":"2024-09-11T22:20:19.851286+0000","last_unstale":"2024-09-11T22:20:24.888125+0000","last_undegraded":"2024-09-11T22:20:24.888125+0000","last_fullsized":"2024-09-11T22:20:24.888125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:32.025931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888304+0000","last_change":"2024-09-11T22:20:18.853301+0000","last_active":"2024-09-11T22:20:24.888304+0000","last_peered":"2024-09-11T22:20:24.888304+0000","last_clean":"2024-09-11T22:20:24.888304+0000","last_became_active":"2024-09-11T22:20:18.852978+0000","last_became_peered":"2024-09-11T22:20:18.852978+0000","last_unstale":"2024-09-11T22:20:24.888304+0000","last_undegraded":"2024-09-11T22:20:24.888304+0000","last_fullsized":"2024-09-11T22:20:24.888304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888069+0000","last_change":"2024-09-11T22:20:24.077636+0000","last_active":"2024-09-11T22:20:24.888069+0000","last_peered":"2024-09-11T22:20:24.888069+0000","last_clean":"2024-09-11T22:20:24.888069+0000","last_became_active":"2024-09-11T22:20:24.077313+0000","last_became_peered":"2024-09-11T22:20:24.077313+0000","last_unstale":"2024-09-11T22:20:24.888069+0000","last_undegraded":"2024-09-11T22:20:24.888069+0000","last_fullsized":"2024-09-11T22:20:24.888069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:23.154027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048723+0000","last_change":"2024-09-11T22:20:19.862562+0000","last_active":"2024-09-11T22:20:27.048723+0000","last_peered":"2024-09-11T22:20:27.048723+0000","last_clean":"2024-09-11T22:20:27.048723+0000","last_became_active":"2024-09-11T22:20:19.862267+0000","last_became_peered":"2024-09-11T22:20:19.862267+0000","last_unstale":"2024-09-11T22:20:27.048723+0000","last_undegraded":"2024-09-11T22:20:27.048723+0000","last_fullsized":"2024-09-11T22:20:27.048723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889888+0000","last_change":"2024-09-11T22:20:18.858002+0000","last_active":"2024-09-11T22:20:24.889888+0000","last_peered":"2024-09-11T22:20:24.889888+0000","last_clean":"2024-09-11T22:20:24.889888+0000","last_became_active":"2024-09-11T22:20:18.857419+0000","last_became_peered":"2024-09-11T22:20:18.857419+0000","last_unstale":"2024-09-11T22:20:24.889888+0000","last_undegraded":"2024-09-11T22:20:24.889888+0000","last_fullsized":"2024-09-11T22:20:24.889888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887723+0000","last_change":"2024-09-11T22:20:24.074971+0000","last_active":"2024-09-11T22:20:24.887723+0000","last_peered":"2024-09-11T22:20:24.887723+0000","last_clean":"2024-09-11T22:20:24.887723+0000","last_became_active":"2024-09-11T22:20:24.074609+0000","last_became_peered":"2024-09-11T22:20:24.074609+0000","last_unstale":"2024-09-11T22:20:24.887723+0000","last_undegraded":"2024-09-11T22:20:24.887723+0000","last_fullsized":"2024-09-11T22:20:24.887723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:55.318904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047865+0000","last_change":"2024-09-11T22:20:19.857276+0000","last_active":"2024-09-11T22:20:27.047865+0000","last_peered":"2024-09-11T22:20:27.047865+0000","last_clean":"2024-09-11T22:20:27.047865+0000","last_became_active":"2024-09-11T22:20:19.857027+0000","last_became_peered":"2024-09-11T22:20:19.857027+0000","last_unstale":"2024-09-11T22:20:27.047865+0000","last_undegraded":"2024-09-11T22:20:27.047865+0000","last_fullsized":"2024-09-11T22:20:27.047865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048222+0000","last_change":"2024-09-11T22:20:18.848671+0000","last_active":"2024-09-11T22:20:27.048222+0000","last_peered":"2024-09-11T22:20:27.048222+0000","last_clean":"2024-09-11T22:20:27.048222+0000","last_became_active":"2024-09-11T22:20:18.848405+0000","last_became_peered":"2024-09-11T22:20:18.848405+0000","last_unstale":"2024-09-11T22:20:27.048222+0000","last_undegraded":"2024-09-11T22:20:27.048222+0000","last_fullsized":"2024-09-11T22:20:27.048222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890660+0000","last_change":"2024-09-11T22:20:24.076835+0000","last_active":"2024-09-11T22:20:24.890660+0000","last_peered":"2024-09-11T22:20:24.890660+0000","last_clean":"2024-09-11T22:20:24.890660+0000","last_became_active":"2024-09-11T22:20:24.076200+0000","last_became_peered":"2024-09-11T22:20:24.076200+0000","last_unstale":"2024-09-11T22:20:24.890660+0000","last_undegraded":"2024-09-11T22:20:24.890660+0000","last_fullsized":"2024-09-11T22:20:24.890660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:48.150778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048503+0000","last_change":"2024-09-11T22:20:19.855334+0000","last_active":"2024-09-11T22:20:27.048503+0000","last_peered":"2024-09-11T22:20:27.048503+0000","last_clean":"2024-09-11T22:20:27.048503+0000","last_became_active":"2024-09-11T22:20:19.855018+0000","last_became_peered":"2024-09-11T22:20:19.855018+0000","last_unstale":"2024-09-11T22:20:27.048503+0000","last_undegraded":"2024-09-11T22:20:27.048503+0000","last_fullsized":"2024-09-11T22:20:27.048503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:32.166521+0000","last_change":"2024-09-11T22:20:18.855665+0000","last_active":"2024-09-11T22:20:32.166521+0000","last_peered":"2024-09-11T22:20:32.166521+0000","last_clean":"2024-09-11T22:20:32.166521+0000","last_became_active":"2024-09-11T22:20:18.855386+0000","last_became_peered":"2024-09-11T22:20:18.855386+0000","last_unstale":"2024-09-11T22:20:32.166521+0000","last_undegraded":"2024-09-11T22:20:32.166521+0000","last_fullsized":"2024-09-11T22:20:32.166521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998100+0000","last_change":"2024-09-11T22:20:23.880793+0000","last_active":"2024-09-11T22:20:24.998100+0000","last_peered":"2024-09-11T22:20:24.998100+0000","last_clean":"2024-09-11T22:20:24.998100+0000","last_became_active":"2024-09-11T22:20:23.879993+0000","last_became_peered":"2024-09-11T22:20:23.879993+0000","last_unstale":"2024-09-11T22:20:24.998100+0000","last_undegraded":"2024-09-11T22:20:24.998100+0000","last_fullsized":"2024-09-11T22:20:24.998100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:50.449090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048075+0000","last_change":"2024-09-11T22:20:19.858588+0000","last_active":"2024-09-11T22:20:27.048075+0000","last_peered":"2024-09-11T22:20:27.048075+0000","last_clean":"2024-09-11T22:20:27.048075+0000","last_became_active":"2024-09-11T22:20:19.858322+0000","last_became_peered":"2024-09-11T22:20:19.858322+0000","last_unstale":"2024-09-11T22:20:27.048075+0000","last_undegraded":"2024-09-11T22:20:27.048075+0000","last_fullsized":"2024-09-11T22:20:27.048075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998071+0000","last_change":"2024-09-11T22:20:18.855056+0000","last_active":"2024-09-11T22:20:24.998071+0000","last_peered":"2024-09-11T22:20:24.998071+0000","last_clean":"2024-09-11T22:20:24.998071+0000","last_became_active":"2024-09-11T22:20:18.854784+0000","last_became_peered":"2024-09-11T22:20:18.854784+0000","last_unstale":"2024-09-11T22:20:24.998071+0000","last_undegraded":"2024-09-11T22:20:24.998071+0000","last_fullsized":"2024-09-11T22:20:24.998071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:38.916121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048044+0000","last_change":"2024-09-11T22:20:23.879768+0000","last_active":"2024-09-11T22:20:27.048044+0000","last_peered":"2024-09-11T22:20:27.048044+0000","last_clean":"2024-09-11T22:20:27.048044+0000","last_became_active":"2024-09-11T22:20:23.878794+0000","last_became_peered":"2024-09-11T22:20:23.878794+0000","last_unstale":"2024-09-11T22:20:27.048044+0000","last_undegraded":"2024-09-11T22:20:27.048044+0000","last_fullsized":"2024-09-11T22:20:27.048044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:07.301587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048230+0000","last_change":"2024-09-11T22:20:19.862315+0000","last_active":"2024-09-11T22:20:27.048230+0000","last_peered":"2024-09-11T22:20:27.048230+0000","last_clean":"2024-09-11T22:20:27.048230+0000","last_became_active":"2024-09-11T22:20:19.861607+0000","last_became_peered":"2024-09-11T22:20:19.861607+0000","last_unstale":"2024-09-11T22:20:27.048230+0000","last_undegraded":"2024-09-11T22:20:27.048230+0000","last_fullsized":"2024-09-11T22:20:27.048230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889443+0000","last_change":"2024-09-11T22:20:18.853382+0000","last_active":"2024-09-11T22:20:24.889443+0000","last_peered":"2024-09-11T22:20:24.889443+0000","last_clean":"2024-09-11T22:20:24.889443+0000","last_became_active":"2024-09-11T22:20:18.853103+0000","last_became_peered":"2024-09-11T22:20:18.853103+0000","last_unstale":"2024-09-11T22:20:24.889443+0000","last_undegraded":"2024-09-11T22:20:24.889443+0000","last_fullsized":"2024-09-11T22:20:24.889443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887490+0000","last_change":"2024-09-11T22:20:23.876997+0000","last_active":"2024-09-11T22:20:24.887490+0000","last_peered":"2024-09-11T22:20:24.887490+0000","last_clean":"2024-09-11T22:20:24.887490+0000","last_became_active":"2024-09-11T22:20:23.876587+0000","last_became_peered":"2024-09-11T22:20:23.876587+0000","last_unstale":"2024-09-11T22:20:24.887490+0000","last_undegraded":"2024-09-11T22:20:24.887490+0000","last_fullsized":"2024-09-11T22:20:24.887490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:19.670665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889342+0000","last_change":"2024-09-11T22:20:19.866624+0000","last_active":"2024-09-11T22:20:24.889342+0000","last_peered":"2024-09-11T22:20:24.889342+0000","last_clean":"2024-09-11T22:20:24.889342+0000","last_became_active":"2024-09-11T22:20:19.866303+0000","last_became_peered":"2024-09-11T22:20:19.866303+0000","last_unstale":"2024-09-11T22:20:24.889342+0000","last_undegraded":"2024-09-11T22:20:24.889342+0000","last_fullsized":"2024-09-11T22:20:24.889342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889446+0000","last_change":"2024-09-11T22:20:18.854361+0000","last_active":"2024-09-11T22:20:24.889446+0000","last_peered":"2024-09-11T22:20:24.889446+0000","last_clean":"2024-09-11T22:20:24.889446+0000","last_became_active":"2024-09-11T22:20:18.854019+0000","last_became_peered":"2024-09-11T22:20:18.854019+0000","last_unstale":"2024-09-11T22:20:24.889446+0000","last_undegraded":"2024-09-11T22:20:24.889446+0000","last_fullsized":"2024-09-11T22:20:24.889446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887284+0000","last_change":"2024-09-11T22:20:24.077476+0000","last_active":"2024-09-11T22:20:24.887284+0000","last_peered":"2024-09-11T22:20:24.887284+0000","last_clean":"2024-09-11T22:20:24.887284+0000","last_became_active":"2024-09-11T22:20:24.077134+0000","last_became_peered":"2024-09-11T22:20:24.077134+0000","last_unstale":"2024-09-11T22:20:24.887284+0000","last_undegraded":"2024-09-11T22:20:24.887284+0000","last_fullsized":"2024-09-11T22:20:24.887284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:03.186460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048035+0000","last_change":"2024-09-11T22:20:24.077143+0000","last_active":"2024-09-11T22:20:27.048035+0000","last_peered":"2024-09-11T22:20:27.048035+0000","last_clean":"2024-09-11T22:20:27.048035+0000","last_became_active":"2024-09-11T22:20:24.076592+0000","last_became_peered":"2024-09-11T22:20:24.076592+0000","last_unstale":"2024-09-11T22:20:27.048035+0000","last_undegraded":"2024-09-11T22:20:27.048035+0000","last_fullsized":"2024-09-11T22:20:27.048035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:02.661077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997676+0000","last_change":"2024-09-11T22:20:19.845776+0000","last_active":"2024-09-11T22:20:24.997676+0000","last_peered":"2024-09-11T22:20:24.997676+0000","last_clean":"2024-09-11T22:20:24.997676+0000","last_became_active":"2024-09-11T22:20:19.845425+0000","last_became_peered":"2024-09-11T22:20:19.845425+0000","last_unstale":"2024-09-11T22:20:24.997676+0000","last_undegraded":"2024-09-11T22:20:24.997676+0000","last_fullsized":"2024-09-11T22:20:24.997676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:07.187533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889050+0000","last_change":"2024-09-11T22:20:18.852446+0000","last_active":"2024-09-11T22:20:24.889050+0000","last_peered":"2024-09-11T22:20:24.889050+0000","last_clean":"2024-09-11T22:20:24.889050+0000","last_became_active":"2024-09-11T22:20:18.852155+0000","last_became_peered":"2024-09-11T22:20:18.852155+0000","last_unstale":"2024-09-11T22:20:24.889050+0000","last_undegraded":"2024-09-11T22:20:24.889050+0000","last_fullsized":"2024-09-11T22:20:24.889050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889233+0000","last_change":"2024-09-11T22:20:23.876503+0000","last_active":"2024-09-11T22:20:24.889233+0000","last_peered":"2024-09-11T22:20:24.889233+0000","last_clean":"2024-09-11T22:20:24.889233+0000","last_became_active":"2024-09-11T22:20:23.876100+0000","last_became_peered":"2024-09-11T22:20:23.876100+0000","last_unstale":"2024-09-11T22:20:24.889233+0000","last_undegraded":"2024-09-11T22:20:24.889233+0000","last_fullsized":"2024-09-11T22:20:24.889233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887311+0000","last_change":"2024-09-11T22:20:19.852606+0000","last_active":"2024-09-11T22:20:24.887311+0000","last_peered":"2024-09-11T22:20:24.887311+0000","last_clean":"2024-09-11T22:20:24.887311+0000","last_became_active":"2024-09-11T22:20:19.852333+0000","last_became_peered":"2024-09-11T22:20:19.852333+0000","last_unstale":"2024-09-11T22:20:24.887311+0000","last_undegraded":"2024-09-11T22:20:24.887311+0000","last_fullsized":"2024-09-11T22:20:24.887311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:56.940278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887444+0000","last_change":"2024-09-11T22:20:18.853767+0000","last_active":"2024-09-11T22:20:24.887444+0000","last_peered":"2024-09-11T22:20:24.887444+0000","last_clean":"2024-09-11T22:20:24.887444+0000","last_became_active":"2024-09-11T22:20:18.853533+0000","last_became_peered":"2024-09-11T22:20:18.853533+0000","last_unstale":"2024-09-11T22:20:24.887444+0000","last_undegraded":"2024-09-11T22:20:24.887444+0000","last_fullsized":"2024-09-11T22:20:24.887444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:36.662271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888381+0000","last_change":"2024-09-11T22:20:18.847133+0000","last_active":"2024-09-11T22:20:24.888381+0000","last_peered":"2024-09-11T22:20:24.888381+0000","last_clean":"2024-09-11T22:20:24.888381+0000","last_became_active":"2024-09-11T22:20:18.846321+0000","last_became_peered":"2024-09-11T22:20:18.846321+0000","last_unstale":"2024-09-11T22:20:24.888381+0000","last_undegraded":"2024-09-11T22:20:24.888381+0000","last_fullsized":"2024-09-11T22:20:24.888381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048164+0000","last_change":"2024-09-11T22:20:19.861445+0000","last_active":"2024-09-11T22:20:27.048164+0000","last_peered":"2024-09-11T22:20:27.048164+0000","last_clean":"2024-09-11T22:20:27.048164+0000","last_became_active":"2024-09-11T22:20:19.861154+0000","last_became_peered":"2024-09-11T22:20:19.861154+0000","last_unstale":"2024-09-11T22:20:27.048164+0000","last_undegraded":"2024-09-11T22:20:27.048164+0000","last_fullsized":"2024-09-11T22:20:27.048164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951525+0000","last_change":"2024-09-11T22:20:23.877973+0000","last_active":"2024-09-11T22:20:26.951525+0000","last_peered":"2024-09-11T22:20:26.951525+0000","last_clean":"2024-09-11T22:20:26.951525+0000","last_became_active":"2024-09-11T22:20:23.877578+0000","last_became_peered":"2024-09-11T22:20:23.877578+0000","last_unstale":"2024-09-11T22:20:26.951525+0000","last_undegraded":"2024-09-11T22:20:26.951525+0000","last_fullsized":"2024-09-11T22:20:26.951525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:27.826669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887675+0000","last_change":"2024-09-11T22:20:18.854142+0000","last_active":"2024-09-11T22:20:24.887675+0000","last_peered":"2024-09-11T22:20:24.887675+0000","last_clean":"2024-09-11T22:20:24.887675+0000","last_became_active":"2024-09-11T22:20:18.853872+0000","last_became_peered":"2024-09-11T22:20:18.853872+0000","last_unstale":"2024-09-11T22:20:24.887675+0000","last_undegraded":"2024-09-11T22:20:24.887675+0000","last_fullsized":"2024-09-11T22:20:24.887675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:22.513242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047903+0000","last_change":"2024-09-11T22:20:19.852580+0000","last_active":"2024-09-11T22:20:27.047903+0000","last_peered":"2024-09-11T22:20:27.047903+0000","last_clean":"2024-09-11T22:20:27.047903+0000","last_became_active":"2024-09-11T22:20:19.850175+0000","last_became_peered":"2024-09-11T22:20:19.850175+0000","last_unstale":"2024-09-11T22:20:27.047903+0000","last_undegraded":"2024-09-11T22:20:27.047903+0000","last_fullsized":"2024-09-11T22:20:27.047903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:11.937256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887822+0000","last_change":"2024-09-11T22:20:23.878004+0000","last_active":"2024-09-11T22:20:24.887822+0000","last_peered":"2024-09-11T22:20:24.887822+0000","last_clean":"2024-09-11T22:20:24.887822+0000","last_became_active":"2024-09-11T22:20:23.876776+0000","last_became_peered":"2024-09-11T22:20:23.876776+0000","last_unstale":"2024-09-11T22:20:24.887822+0000","last_undegraded":"2024-09-11T22:20:24.887822+0000","last_fullsized":"2024-09-11T22:20:24.887822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:11.254248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887933+0000","last_change":"2024-09-11T22:20:19.853439+0000","last_active":"2024-09-11T22:20:24.887933+0000","last_peered":"2024-09-11T22:20:24.887933+0000","last_clean":"2024-09-11T22:20:24.887933+0000","last_became_active":"2024-09-11T22:20:19.852937+0000","last_became_peered":"2024-09-11T22:20:19.852937+0000","last_unstale":"2024-09-11T22:20:24.887933+0000","last_undegraded":"2024-09-11T22:20:24.887933+0000","last_fullsized":"2024-09-11T22:20:24.887933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951404+0000","last_change":"2024-09-11T22:20:19.861003+0000","last_active":"2024-09-11T22:20:26.951404+0000","last_peered":"2024-09-11T22:20:26.951404+0000","last_clean":"2024-09-11T22:20:26.951404+0000","last_became_active":"2024-09-11T22:20:19.860690+0000","last_became_peered":"2024-09-11T22:20:19.860690+0000","last_unstale":"2024-09-11T22:20:26.951404+0000","last_undegraded":"2024-09-11T22:20:26.951404+0000","last_fullsized":"2024-09-11T22:20:26.951404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889798+0000","last_change":"2024-09-11T22:20:19.856756+0000","last_active":"2024-09-11T22:20:24.889798+0000","last_peered":"2024-09-11T22:20:24.889798+0000","last_clean":"2024-09-11T22:20:24.889798+0000","last_became_active":"2024-09-11T22:20:19.856460+0000","last_became_peered":"2024-09-11T22:20:19.856460+0000","last_unstale":"2024-09-11T22:20:24.889798+0000","last_undegraded":"2024-09-11T22:20:24.889798+0000","last_fullsized":"2024-09-11T22:20:24.889798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048092+0000","last_change":"2024-09-11T22:20:19.855629+0000","last_active":"2024-09-11T22:20:27.048092+0000","last_peered":"2024-09-11T22:20:27.048092+0000","last_clean":"2024-09-11T22:20:27.048092+0000","last_became_active":"2024-09-11T22:20:19.855363+0000","last_became_peered":"2024-09-11T22:20:19.855363+0000","last_unstale":"2024-09-11T22:20:27.048092+0000","last_undegraded":"2024-09-11T22:20:27.048092+0000","last_fullsized":"2024-09-11T22:20:27.048092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887872+0000","last_change":"2024-09-11T22:20:19.863122+0000","last_active":"2024-09-11T22:20:24.887872+0000","last_peered":"2024-09-11T22:20:24.887872+0000","last_clean":"2024-09-11T22:20:24.887872+0000","last_became_active":"2024-09-11T22:20:19.862828+0000","last_became_peered":"2024-09-11T22:20:19.862828+0000","last_unstale":"2024-09-11T22:20:24.887872+0000","last_undegraded":"2024-09-11T22:20:24.887872+0000","last_fullsized":"2024-09-11T22:20:24.887872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:10.868762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997865+0000","last_change":"2024-09-11T22:20:19.846453+0000","last_active":"2024-09-11T22:20:24.997865+0000","last_peered":"2024-09-11T22:20:24.997865+0000","last_clean":"2024-09-11T22:20:24.997865+0000","last_became_active":"2024-09-11T22:20:19.846186+0000","last_became_peered":"2024-09-11T22:20:19.846186+0000","last_unstale":"2024-09-11T22:20:24.997865+0000","last_undegraded":"2024-09-11T22:20:24.997865+0000","last_fullsized":"2024-09-11T22:20:24.997865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:24.032365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888935+0000","last_change":"2024-09-11T22:20:19.860632+0000","last_active":"2024-09-11T22:20:24.888935+0000","last_peered":"2024-09-11T22:20:24.888935+0000","last_clean":"2024-09-11T22:20:24.888935+0000","last_became_active":"2024-09-11T22:20:19.860005+0000","last_became_peered":"2024-09-11T22:20:19.860005+0000","last_unstale":"2024-09-11T22:20:24.888935+0000","last_undegraded":"2024-09-11T22:20:24.888935+0000","last_fullsized":"2024-09-11T22:20:24.888935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888034+0000","last_change":"2024-09-11T22:20:19.859195+0000","last_active":"2024-09-11T22:20:24.888034+0000","last_peered":"2024-09-11T22:20:24.888034+0000","last_clean":"2024-09-11T22:20:24.888034+0000","last_became_active":"2024-09-11T22:20:19.858832+0000","last_became_peered":"2024-09-11T22:20:19.858832+0000","last_unstale":"2024-09-11T22:20:24.888034+0000","last_undegraded":"2024-09-11T22:20:24.888034+0000","last_fullsized":"2024-09-11T22:20:24.888034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:56.259074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888950+0000","last_change":"2024-09-11T22:20:19.858969+0000","last_active":"2024-09-11T22:20:24.888950+0000","last_peered":"2024-09-11T22:20:24.888950+0000","last_clean":"2024-09-11T22:20:24.888950+0000","last_became_active":"2024-09-11T22:20:19.857847+0000","last_became_peered":"2024-09-11T22:20:19.857847+0000","last_unstale":"2024-09-11T22:20:24.888950+0000","last_undegraded":"2024-09-11T22:20:24.888950+0000","last_fullsized":"2024-09-11T22:20:24.888950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887453+0000","last_change":"2024-09-11T22:20:19.863294+0000","last_active":"2024-09-11T22:20:24.887453+0000","last_peered":"2024-09-11T22:20:24.887453+0000","last_clean":"2024-09-11T22:20:24.887453+0000","last_became_active":"2024-09-11T22:20:19.863007+0000","last_became_peered":"2024-09-11T22:20:19.863007+0000","last_unstale":"2024-09-11T22:20:24.887453+0000","last_undegraded":"2024-09-11T22:20:24.887453+0000","last_fullsized":"2024-09-11T22:20:24.887453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:06.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889706+0000","last_change":"2024-09-11T22:20:19.858414+0000","last_active":"2024-09-11T22:20:24.889706+0000","last_peered":"2024-09-11T22:20:24.889706+0000","last_clean":"2024-09-11T22:20:24.889706+0000","last_became_active":"2024-09-11T22:20:19.857790+0000","last_became_peered":"2024-09-11T22:20:19.857790+0000","last_unstale":"2024-09-11T22:20:24.889706+0000","last_undegraded":"2024-09-11T22:20:24.889706+0000","last_fullsized":"2024-09-11T22:20:24.889706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047879+0000","last_change":"2024-09-11T22:20:19.855053+0000","last_active":"2024-09-11T22:20:27.047879+0000","last_peered":"2024-09-11T22:20:27.047879+0000","last_clean":"2024-09-11T22:20:27.047879+0000","last_became_active":"2024-09-11T22:20:19.854774+0000","last_became_peered":"2024-09-11T22:20:19.854774+0000","last_unstale":"2024-09-11T22:20:27.047879+0000","last_undegraded":"2024-09-11T22:20:27.047879+0000","last_fullsized":"2024-09-11T22:20:27.047879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:32.025931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888845+0000","last_change":"2024-09-11T22:20:19.864700+0000","last_active":"2024-09-11T22:20:24.888845+0000","last_peered":"2024-09-11T22:20:24.888845+0000","last_clean":"2024-09-11T22:20:24.888845+0000","last_became_active":"2024-09-11T22:20:19.862296+0000","last_became_peered":"2024-09-11T22:20:19.862296+0000","last_unstale":"2024-09-11T22:20:24.888845+0000","last_undegraded":"2024-09-11T22:20:24.888845+0000","last_fullsized":"2024-09-11T22:20:24.888845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048773+0000","last_change":"2024-09-11T22:20:19.855253+0000","last_active":"2024-09-11T22:20:27.048773+0000","last_peered":"2024-09-11T22:20:27.048773+0000","last_clean":"2024-09-11T22:20:27.048773+0000","last_became_active":"2024-09-11T22:20:19.854970+0000","last_became_peered":"2024-09-11T22:20:19.854970+0000","last_unstale":"2024-09-11T22:20:27.048773+0000","last_undegraded":"2024-09-11T22:20:27.048773+0000","last_fullsized":"2024-09-11T22:20:27.048773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951690+0000","last_change":"2024-09-11T22:20:19.850202+0000","last_active":"2024-09-11T22:20:26.951690+0000","last_peered":"2024-09-11T22:20:26.951690+0000","last_clean":"2024-09-11T22:20:26.951690+0000","last_became_active":"2024-09-11T22:20:19.849815+0000","last_became_peered":"2024-09-11T22:20:19.849815+0000","last_unstale":"2024-09-11T22:20:26.951690+0000","last_undegraded":"2024-09-11T22:20:26.951690+0000","last_fullsized":"2024-09-11T22:20:26.951690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:56.480679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889814+0000","last_change":"2024-09-11T22:20:19.866864+0000","last_active":"2024-09-11T22:20:24.889814+0000","last_peered":"2024-09-11T22:20:24.889814+0000","last_clean":"2024-09-11T22:20:24.889814+0000","last_became_active":"2024-09-11T22:20:19.866484+0000","last_became_peered":"2024-09-11T22:20:19.866484+0000","last_unstale":"2024-09-11T22:20:24.889814+0000","last_undegraded":"2024-09-11T22:20:24.889814+0000","last_fullsized":"2024-09-11T22:20:24.889814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888850+0000","last_change":"2024-09-11T22:20:19.859573+0000","last_active":"2024-09-11T22:20:24.888850+0000","last_peered":"2024-09-11T22:20:24.888850+0000","last_clean":"2024-09-11T22:20:24.888850+0000","last_became_active":"2024-09-11T22:20:19.859266+0000","last_became_peered":"2024-09-11T22:20:19.859266+0000","last_unstale":"2024-09-11T22:20:24.888850+0000","last_undegraded":"2024-09-11T22:20:24.888850+0000","last_fullsized":"2024-09-11T22:20:24.888850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997750+0000","last_change":"2024-09-11T22:20:19.860050+0000","last_active":"2024-09-11T22:20:24.997750+0000","last_peered":"2024-09-11T22:20:24.997750+0000","last_clean":"2024-09-11T22:20:24.997750+0000","last_became_active":"2024-09-11T22:20:19.859755+0000","last_became_peered":"2024-09-11T22:20:19.859755+0000","last_unstale":"2024-09-11T22:20:24.997750+0000","last_undegraded":"2024-09-11T22:20:24.997750+0000","last_fullsized":"2024-09-11T22:20:24.997750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:42.487669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047797+0000","last_change":"2024-09-11T22:20:19.853902+0000","last_active":"2024-09-11T22:20:27.047797+0000","last_peered":"2024-09-11T22:20:27.047797+0000","last_clean":"2024-09-11T22:20:27.047797+0000","last_became_active":"2024-09-11T22:20:19.853563+0000","last_became_peered":"2024-09-11T22:20:19.853563+0000","last_unstale":"2024-09-11T22:20:27.047797+0000","last_undegraded":"2024-09-11T22:20:27.047797+0000","last_fullsized":"2024-09-11T22:20:27.047797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887571+0000","last_change":"2024-09-11T22:20:19.849490+0000","last_active":"2024-09-11T22:20:24.887571+0000","last_peered":"2024-09-11T22:20:24.887571+0000","last_clean":"2024-09-11T22:20:24.887571+0000","last_became_active":"2024-09-11T22:20:19.848965+0000","last_became_peered":"2024-09-11T22:20:19.848965+0000","last_unstale":"2024-09-11T22:20:24.887571+0000","last_undegraded":"2024-09-11T22:20:24.887571+0000","last_fullsized":"2024-09-11T22:20:24.887571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:10.387663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048041+0000","last_change":"2024-09-11T22:20:19.860457+0000","last_active":"2024-09-11T22:20:27.048041+0000","last_peered":"2024-09-11T22:20:27.048041+0000","last_clean":"2024-09-11T22:20:27.048041+0000","last_became_active":"2024-09-11T22:20:19.858887+0000","last_became_peered":"2024-09-11T22:20:19.858887+0000","last_unstale":"2024-09-11T22:20:27.048041+0000","last_undegraded":"2024-09-11T22:20:27.048041+0000","last_fullsized":"2024-09-11T22:20:27.048041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:34.620956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888481+0000","last_change":"2024-09-11T22:20:19.862347+0000","last_active":"2024-09-11T22:20:24.888481+0000","last_peered":"2024-09-11T22:20:24.888481+0000","last_clean":"2024-09-11T22:20:24.888481+0000","last_became_active":"2024-09-11T22:20:19.861965+0000","last_became_peered":"2024-09-11T22:20:19.861965+0000","last_unstale":"2024-09-11T22:20:24.888481+0000","last_undegraded":"2024-09-11T22:20:24.888481+0000","last_fullsized":"2024-09-11T22:20:24.888481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888938+0000","last_change":"2024-09-11T22:20:19.862065+0000","last_active":"2024-09-11T22:20:24.888938+0000","last_peered":"2024-09-11T22:20:24.888938+0000","last_clean":"2024-09-11T22:20:24.888938+0000","last_became_active":"2024-09-11T22:20:19.861765+0000","last_became_peered":"2024-09-11T22:20:19.861765+0000","last_unstale":"2024-09-11T22:20:24.888938+0000","last_undegraded":"2024-09-11T22:20:24.888938+0000","last_fullsized":"2024-09-11T22:20:24.888938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.049117+0000","last_change":"2024-09-11T22:20:19.865064+0000","last_active":"2024-09-11T22:20:27.049117+0000","last_peered":"2024-09-11T22:20:27.049117+0000","last_clean":"2024-09-11T22:20:27.049117+0000","last_became_active":"2024-09-11T22:20:19.864697+0000","last_became_peered":"2024-09-11T22:20:19.864697+0000","last_unstale":"2024-09-11T22:20:27.049117+0000","last_undegraded":"2024-09-11T22:20:27.049117+0000","last_fullsized":"2024-09-11T22:20:27.049117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887201+0000","last_change":"2024-09-11T22:20:19.861293+0000","last_active":"2024-09-11T22:20:24.887201+0000","last_peered":"2024-09-11T22:20:24.887201+0000","last_clean":"2024-09-11T22:20:24.887201+0000","last_became_active":"2024-09-11T22:20:19.861013+0000","last_became_peered":"2024-09-11T22:20:19.861013+0000","last_unstale":"2024-09-11T22:20:24.887201+0000","last_undegraded":"2024-09-11T22:20:24.887201+0000","last_fullsized":"2024-09-11T22:20:24.887201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:13.178404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048303+0000","last_change":"2024-09-11T22:20:19.858131+0000","last_active":"2024-09-11T22:20:27.048303+0000","last_peered":"2024-09-11T22:20:27.048303+0000","last_clean":"2024-09-11T22:20:27.048303+0000","last_became_active":"2024-09-11T22:20:19.857842+0000","last_became_peered":"2024-09-11T22:20:19.857842+0000","last_unstale":"2024-09-11T22:20:27.048303+0000","last_undegraded":"2024-09-11T22:20:27.048303+0000","last_fullsized":"2024-09-11T22:20:27.048303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889602+0000","last_change":"2024-09-11T22:20:19.859667+0000","last_active":"2024-09-11T22:20:24.889602+0000","last_peered":"2024-09-11T22:20:24.889602+0000","last_clean":"2024-09-11T22:20:24.889602+0000","last_became_active":"2024-09-11T22:20:19.859306+0000","last_became_peered":"2024-09-11T22:20:19.859306+0000","last_unstale":"2024-09-11T22:20:24.889602+0000","last_undegraded":"2024-09-11T22:20:24.889602+0000","last_fullsized":"2024-09-11T22:20:24.889602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048551+0000","last_change":"2024-09-11T22:20:19.848821+0000","last_active":"2024-09-11T22:20:27.048551+0000","last_peered":"2024-09-11T22:20:27.048551+0000","last_clean":"2024-09-11T22:20:27.048551+0000","last_became_active":"2024-09-11T22:20:19.848531+0000","last_became_peered":"2024-09-11T22:20:19.848531+0000","last_unstale":"2024-09-11T22:20:27.048551+0000","last_undegraded":"2024-09-11T22:20:27.048551+0000","last_fullsized":"2024-09-11T22:20:27.048551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890212+0000","last_change":"2024-09-11T22:20:19.866300+0000","last_active":"2024-09-11T22:20:24.890212+0000","last_peered":"2024-09-11T22:20:24.890212+0000","last_clean":"2024-09-11T22:20:24.890212+0000","last_became_active":"2024-09-11T22:20:19.865939+0000","last_became_peered":"2024-09-11T22:20:19.865939+0000","last_unstale":"2024-09-11T22:20:24.890212+0000","last_undegraded":"2024-09-11T22:20:24.890212+0000","last_fullsized":"2024-09-11T22:20:24.890212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047932+0000","last_change":"2024-09-11T22:20:19.858144+0000","last_active":"2024-09-11T22:20:27.047932+0000","last_peered":"2024-09-11T22:20:27.047932+0000","last_clean":"2024-09-11T22:20:27.047932+0000","last_became_active":"2024-09-11T22:20:19.857840+0000","last_became_peered":"2024-09-11T22:20:19.857840+0000","last_unstale":"2024-09-11T22:20:27.047932+0000","last_undegraded":"2024-09-11T22:20:27.047932+0000","last_fullsized":"2024-09-11T22:20:27.047932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:23.801072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998195+0000","last_change":"2024-09-11T22:20:19.857378+0000","last_active":"2024-09-11T22:20:24.998195+0000","last_peered":"2024-09-11T22:20:24.998195+0000","last_clean":"2024-09-11T22:20:24.998195+0000","last_became_active":"2024-09-11T22:20:19.857089+0000","last_became_peered":"2024-09-11T22:20:19.857089+0000","last_unstale":"2024-09-11T22:20:24.998195+0000","last_undegraded":"2024-09-11T22:20:24.998195+0000","last_fullsized":"2024-09-11T22:20:24.998195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:29.835695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.049018+0000","last_change":"2024-09-11T22:20:19.852827+0000","last_active":"2024-09-11T22:20:27.049018+0000","last_peered":"2024-09-11T22:20:27.049018+0000","last_clean":"2024-09-11T22:20:27.049018+0000","last_became_active":"2024-09-11T22:20:19.852251+0000","last_became_peered":"2024-09-11T22:20:19.852251+0000","last_unstale":"2024-09-11T22:20:27.049018+0000","last_undegraded":"2024-09-11T22:20:27.049018+0000","last_fullsized":"2024-09-11T22:20:27.049018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:36.888544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":698268,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":107318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":348160,"data_stored":698324,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":107478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:20:44.865 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:20:44.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.996+0000 7effccd8d640 1 Processor -- start 2024-09-11T22:20:44.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.996+0000 7effccd8d640 1 -- start start 2024-09-11T22:20:45.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effccd8d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc80cc770 0x7effc80cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effccd8d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7effc80cb920 0x7effc815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effccd8d640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effc80c5d80 con 0x7effc8154d20 2024-09-11T22:20:45.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effccd8d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7effc815ebe0 con 0x7effc80cb920 2024-09-11T22:20:45.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effccd8d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7effc8155100 con 0x7effc80cc770 2024-09-11T22:20:45.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effc659c640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7effc8154d20 0x7effc8072230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33214/0 (socket says 172.21.15.100:33214) 2024-09-11T22:20:45.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effc659c640 1 -- 172.21.15.100:0/3593526457 learned_addr learned my addr 172.21.15.100:0/3593526457 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:45.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effc559a640 1 -- 172.21.15.100:0/3593526457 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1301341505 0 0) 0x7effc80c5d80 con 0x7effc8154d20 2024-09-11T22:20:45.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effc559a640 1 -- 172.21.15.100:0/3593526457 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effb0003520 con 0x7effc8154d20 2024-09-11T22:20:45.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effc5d9b640 1 --2- 172.21.15.100:0/3593526457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc80cc770 0x7effc80cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effc6d9d640 1 --2- 172.21.15.100:0/3593526457 >> v2:172.21.15.167:3300/0 conn(0x7effc80cb920 0x7effc815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effc559a640 1 -- 172.21.15.100:0/3593526457 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 131224759 0 0) 0x7effb0003520 con 0x7effc8154d20 2024-09-11T22:20:45.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effc559a640 1 -- 172.21.15.100:0/3593526457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc80cc770 msgr2=0x7effc80cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effc559a640 1 --2- 172.21.15.100:0/3593526457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc80cc770 0x7effc80cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effc559a640 1 -- 172.21.15.100:0/3593526457 >> v2:172.21.15.167:3300/0 conn(0x7effc80cb920 msgr2=0x7effc815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effc559a640 1 --2- 172.21.15.100:0/3593526457 >> v2:172.21.15.167:3300/0 conn(0x7effc80cb920 0x7effc815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effc559a640 1 -- 172.21.15.100:0/3593526457 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc815dfd0 con 0x7effc8154d20 2024-09-11T22:20:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effc559a640 1 -- 172.21.15.100:0/3593526457 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7effb8001670 con 0x7effc8154d20 2024-09-11T22:20:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effc559a640 1 -- 172.21.15.100:0/3593526457 >> v1:172.21.15.100:6789/0 conn(0x7effc8154d20 legacy=0x7effc8072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effc559a640 1 --2- 172.21.15.100:0/3593526457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc80cc770 0x7effb00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effc559a640 1 --2- 172.21.15.100:0/3593526457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effb0003fe0 0x7effb0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effc559a640 1 --2- 172.21.15.100:0/3593526457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effb0004d40 0x7effb00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effc559a640 1 -- 172.21.15.100:0/3593526457 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7effc815ebe0 con 0x7effb0004d40 2024-09-11T22:20:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effc559a640 1 -- 172.21.15.100:0/3593526457 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7effc8155100 con 0x7effb0003fe0 2024-09-11T22:20:45.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.997+0000 7effc559a640 1 -- 172.21.15.100:0/3593526457 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7effb000bac0 con 0x7effc80cc770 2024-09-11T22:20:45.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.998+0000 7effc6d9d640 1 --2- 172.21.15.100:0/3593526457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effb0004d40 0x7effb00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.998+0000 7effc659c640 1 --2- 172.21.15.100:0/3593526457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc80cc770 0x7effb00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.998+0000 7effc5d9b640 1 --2- 172.21.15.100:0/3593526457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effb0003fe0 0x7effb0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.998+0000 7effc6d9d640 1 -- 172.21.15.100:0/3593526457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc80cc770 msgr2=0x7effb00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:45.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.998+0000 7effc6d9d640 1 --2- 172.21.15.100:0/3593526457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effc80cc770 0x7effb00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.998+0000 7effc6d9d640 1 -- 172.21.15.100:0/3593526457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effb0003fe0 msgr2=0x7effb0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:45.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.998+0000 7effc6d9d640 1 --2- 172.21.15.100:0/3593526457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effb0003fe0 0x7effb0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.998+0000 7effc6d9d640 1 -- 172.21.15.100:0/3593526457 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb0003520 con 0x7effb0004d40 2024-09-11T22:20:45.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.999+0000 7effc6d9d640 1 --2- 172.21.15.100:0/3593526457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effb0004d40 0x7effb00051c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7effc0007360 tx=0x7effb0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4171bb431db4b418 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:45.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.999+0000 7effc559a640 1 -- 172.21.15.100:0/3593526457 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc0009be0 con 0x7effb0004d40 2024-09-11T22:20:45.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.999+0000 7effc559a640 1 -- 172.21.15.100:0/3593526457 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc002e620 con 0x7effb0004d40 2024-09-11T22:20:45.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.999+0000 7effc559a640 1 -- 172.21.15.100:0/3593526457 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc002e9f0 con 0x7effb0004d40 2024-09-11T22:20:45.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.999+0000 7effccd8d640 1 -- 172.21.15.100:0/3593526457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effb0004d40 msgr2=0x7effb00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.999+0000 7effccd8d640 1 --2- 172.21.15.100:0/3593526457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effb0004d40 0x7effb00051c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7effc0007360 tx=0x7effb0005830 comp rx=0 tx=0).stop 2024-09-11T22:20:45.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.999+0000 7effc6d9d640 1 -- 172.21.15.100:0/3593526457 reap_dead start 2024-09-11T22:20:45.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.999+0000 7effccd8d640 1 -- 172.21.15.100:0/3593526457 shutdown_connections 2024-09-11T22:20:45.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.999+0000 7effccd8d640 1 -- 172.21.15.100:0/3593526457 >> 172.21.15.100:0/3593526457 conn(0x7effc80d0380 msgr2=0x7effc80d0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:45.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.999+0000 7effccd8d640 1 -- 172.21.15.100:0/3593526457 shutdown_connections 2024-09-11T22:20:45.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:44.999+0000 7effccd8d640 1 -- 172.21.15.100:0/3593526457 wait complete. 2024-09-11T22:20:45.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.001+0000 7effccd8d640 1 Processor -- start 2024-09-11T22:20:45.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.001+0000 7effccd8d640 1 -- start start 2024-09-11T22:20:45.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.001+0000 7effccd8d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effb0004d40 0x7effc81f0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.001+0000 7effccd8d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effc81f1270 0x7effc813ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.001+0000 7effccd8d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effc80ca310 0x7effc813f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.001+0000 7effccd8d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7effc815e870 con 0x7effc81f1270 2024-09-11T22:20:45.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.001+0000 7effccd8d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7effc815e590 con 0x7effc80ca310 2024-09-11T22:20:45.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.001+0000 7effccd8d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7effc8072940 con 0x7effb0004d40 2024-09-11T22:20:45.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.001+0000 7effc5d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effc81f1270 0x7effc813ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.001+0000 7effc5d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effc81f1270 0x7effc813ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47190/0 (socket says 172.21.15.100:47190) 2024-09-11T22:20:45.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.001+0000 7effc5d9b640 1 -- 172.21.15.100:0/2343001841 learned_addr learned my addr 172.21.15.100:0/2343001841 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:45.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.002+0000 7effc659c640 1 --2- 172.21.15.100:0/2343001841 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effb0004d40 0x7effc81f0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.002+0000 7effc6d9d640 1 --2- 172.21.15.100:0/2343001841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effc80ca310 0x7effc813f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.002+0000 7effc5d9b640 1 -- 172.21.15.100:0/2343001841 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effb0004d40 msgr2=0x7effc81f0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.002+0000 7effc5d9b640 1 --2- 172.21.15.100:0/2343001841 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effb0004d40 0x7effc81f0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.002+0000 7effc5d9b640 1 -- 172.21.15.100:0/2343001841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effc80ca310 msgr2=0x7effc813f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.002+0000 7effc5d9b640 1 --2- 172.21.15.100:0/2343001841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effc80ca310 0x7effc813f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.002+0000 7effc5d9b640 1 -- 172.21.15.100:0/2343001841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc8149c10 con 0x7effc81f1270 2024-09-11T22:20:45.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.002+0000 7effc6d9d640 1 --2- 172.21.15.100:0/2343001841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effc80ca310 0x7effc813f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:45.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.002+0000 7effc5d9b640 1 --2- 172.21.15.100:0/2343001841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effc81f1270 0x7effc813ec00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7effbc0108f0 tx=0x7effbc010cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:45.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.002+0000 7effb6ffd640 1 -- 172.21.15.100:0/2343001841 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effbc01a020 con 0x7effc81f1270 2024-09-11T22:20:45.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.002+0000 7effb6ffd640 1 -- 172.21.15.100:0/2343001841 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effbc00e9c0 con 0x7effc81f1270 2024-09-11T22:20:45.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.002+0000 7effccd8d640 1 -- 172.21.15.100:0/2343001841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effc8152540 con 0x7effc81f1270 2024-09-11T22:20:45.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.002+0000 7effb6ffd640 1 -- 172.21.15.100:0/2343001841 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effbc00ed90 con 0x7effc81f1270 2024-09-11T22:20:45.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.002+0000 7effccd8d640 1 -- 172.21.15.100:0/2343001841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effc81423b0 con 0x7effc81f1270 2024-09-11T22:20:45.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.003+0000 7effccd8d640 1 -- 172.21.15.100:0/2343001841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effc80cb300 con 0x7effc81f1270 2024-09-11T22:20:45.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.004+0000 7effb6ffd640 1 -- 172.21.15.100:0/2343001841 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7effbc01d020 con 0x7effc81f1270 2024-09-11T22:20:45.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.004+0000 7effb6ffd640 1 --2- 172.21.15.100:0/2343001841 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7effa806be60 0x7effa806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.004+0000 7effb6ffd640 1 -- 172.21.15.100:0/2343001841 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7effbc08bad0 con 0x7effc81f1270 2024-09-11T22:20:45.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.004+0000 7effc659c640 1 --2- 172.21.15.100:0/2343001841 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7effa806be60 0x7effa806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.004+0000 7effc659c640 1 --2- 172.21.15.100:0/2343001841 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7effa806be60 0x7effa806e320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7effb8007e30 tx=0x7effb80078f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:45.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.008+0000 7effb6ffd640 1 -- 172.21.15.100:0/2343001841 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7effbc024020 con 0x7effc81f1270 2024-09-11T22:20:45.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.172+0000 7effccd8d640 1 -- 172.21.15.100:0/2343001841 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7effc81520f0 con 0x7effa806be60 2024-09-11T22:20:45.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.179+0000 7effb6ffd640 1 -- 172.21.15.100:0/2343001841 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332611 (secure 0 0 0) 0x7effc81520f0 con 0x7effa806be60 2024-09-11T22:20:45.185 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:45.187 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-11T22:20:45.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.183+0000 7effccd8d640 1 -- 172.21.15.100:0/2343001841 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7effa806be60 msgr2=0x7effa806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.183+0000 7effccd8d640 1 --2- 172.21.15.100:0/2343001841 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7effa806be60 0x7effa806e320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7effb8007e30 tx=0x7effb80078f0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.183+0000 7effccd8d640 1 -- 172.21.15.100:0/2343001841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effc81f1270 msgr2=0x7effc813ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.183+0000 7effccd8d640 1 --2- 172.21.15.100:0/2343001841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effc81f1270 0x7effc813ec00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7effbc0108f0 tx=0x7effbc010cf0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.183+0000 7effccd8d640 1 -- 172.21.15.100:0/2343001841 shutdown_connections 2024-09-11T22:20:45.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.183+0000 7effccd8d640 1 --2- 172.21.15.100:0/2343001841 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7effa806be60 0x7effa806e320 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.183+0000 7effccd8d640 1 --2- 172.21.15.100:0/2343001841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effc80ca310 0x7effc813f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.183+0000 7effccd8d640 1 --2- 172.21.15.100:0/2343001841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effc81f1270 0x7effc813ec00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.183+0000 7effccd8d640 1 --2- 172.21.15.100:0/2343001841 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effb0004d40 0x7effc81f0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.183+0000 7effccd8d640 1 -- 172.21.15.100:0/2343001841 >> 172.21.15.100:0/2343001841 conn(0x7effc80d0380 msgr2=0x7effc8143f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:45.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.183+0000 7effccd8d640 1 -- 172.21.15.100:0/2343001841 shutdown_connections 2024-09-11T22:20:45.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.183+0000 7effccd8d640 1 -- 172.21.15.100:0/2343001841 wait complete. 2024-09-11T22:20:45.194 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-09-11T22:20:44.309602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218524,"kb_used_data":2304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756196,"statfs":{"total":773094113280,"available":772870344704,"internally_reserved":0,"allocated":2359296,"data_stored":2048564,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002888"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048242+0000","last_change":"2024-09-11T22:20:18.853007+0000","last_active":"2024-09-11T22:20:27.048242+0000","last_peered":"2024-09-11T22:20:27.048242+0000","last_clean":"2024-09-11T22:20:27.048242+0000","last_became_active":"2024-09-11T22:20:18.852740+0000","last_became_peered":"2024-09-11T22:20:18.852740+0000","last_unstale":"2024-09-11T22:20:27.048242+0000","last_undegraded":"2024-09-11T22:20:27.048242+0000","last_fullsized":"2024-09-11T22:20:27.048242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:46.710328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887920+0000","last_change":"2024-09-11T22:20:19.849765+0000","last_active":"2024-09-11T22:20:24.887920+0000","last_peered":"2024-09-11T22:20:24.887920+0000","last_clean":"2024-09-11T22:20:24.887920+0000","last_became_active":"2024-09-11T22:20:19.848619+0000","last_became_peered":"2024-09-11T22:20:19.848619+0000","last_unstale":"2024-09-11T22:20:24.887920+0000","last_undegraded":"2024-09-11T22:20:24.887920+0000","last_fullsized":"2024-09-11T22:20:24.887920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:57.621624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887250+0000","last_change":"2024-09-11T22:20:24.078618+0000","last_active":"2024-09-11T22:20:24.887250+0000","last_peered":"2024-09-11T22:20:24.887250+0000","last_clean":"2024-09-11T22:20:24.887250+0000","last_became_active":"2024-09-11T22:20:24.078283+0000","last_became_peered":"2024-09-11T22:20:24.078283+0000","last_unstale":"2024-09-11T22:20:24.887250+0000","last_undegraded":"2024-09-11T22:20:24.887250+0000","last_fullsized":"2024-09-11T22:20:24.887250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:01.901307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888010+0000","last_change":"2024-09-11T22:20:18.855945+0000","last_active":"2024-09-11T22:20:24.888010+0000","last_peered":"2024-09-11T22:20:24.888010+0000","last_clean":"2024-09-11T22:20:24.888010+0000","last_became_active":"2024-09-11T22:20:18.854811+0000","last_became_peered":"2024-09-11T22:20:18.854811+0000","last_unstale":"2024-09-11T22:20:24.888010+0000","last_undegraded":"2024-09-11T22:20:24.888010+0000","last_fullsized":"2024-09-11T22:20:24.888010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:47.508920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048102+0000","last_change":"2024-09-11T22:20:19.862436+0000","last_active":"2024-09-11T22:20:27.048102+0000","last_peered":"2024-09-11T22:20:27.048102+0000","last_clean":"2024-09-11T22:20:27.048102+0000","last_became_active":"2024-09-11T22:20:19.862061+0000","last_became_peered":"2024-09-11T22:20:19.862061+0000","last_unstale":"2024-09-11T22:20:27.048102+0000","last_undegraded":"2024-09-11T22:20:27.048102+0000","last_fullsized":"2024-09-11T22:20:27.048102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047627+0000","last_change":"2024-09-11T22:20:23.879729+0000","last_active":"2024-09-11T22:20:27.047627+0000","last_peered":"2024-09-11T22:20:27.047627+0000","last_clean":"2024-09-11T22:20:27.047627+0000","last_became_active":"2024-09-11T22:20:23.879245+0000","last_became_peered":"2024-09-11T22:20:23.879245+0000","last_unstale":"2024-09-11T22:20:27.047627+0000","last_undegraded":"2024-09-11T22:20:27.047627+0000","last_fullsized":"2024-09-11T22:20:27.047627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:36.836842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048249+0000","last_change":"2024-09-11T22:20:18.853076+0000","last_active":"2024-09-11T22:20:27.048249+0000","last_peered":"2024-09-11T22:20:27.048249+0000","last_clean":"2024-09-11T22:20:27.048249+0000","last_became_active":"2024-09-11T22:20:18.852728+0000","last_became_peered":"2024-09-11T22:20:18.852728+0000","last_unstale":"2024-09-11T22:20:27.048249+0000","last_undegraded":"2024-09-11T22:20:27.048249+0000","last_fullsized":"2024-09-11T22:20:27.048249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890308+0000","last_change":"2024-09-11T22:20:19.864544+0000","last_active":"2024-09-11T22:20:24.890308+0000","last_peered":"2024-09-11T22:20:24.890308+0000","last_clean":"2024-09-11T22:20:24.890308+0000","last_became_active":"2024-09-11T22:20:19.864234+0000","last_became_peered":"2024-09-11T22:20:19.864234+0000","last_unstale":"2024-09-11T22:20:24.890308+0000","last_undegraded":"2024-09-11T22:20:24.890308+0000","last_fullsized":"2024-09-11T22:20:24.890308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048400+0000","last_change":"2024-09-11T22:20:23.873783+0000","last_active":"2024-09-11T22:20:27.048400+0000","last_peered":"2024-09-11T22:20:27.048400+0000","last_clean":"2024-09-11T22:20:27.048400+0000","last_became_active":"2024-09-11T22:20:23.873385+0000","last_became_peered":"2024-09-11T22:20:23.873385+0000","last_unstale":"2024-09-11T22:20:27.048400+0000","last_undegraded":"2024-09-11T22:20:27.048400+0000","last_fullsized":"2024-09-11T22:20:27.048400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048092+0000","last_change":"2024-09-11T22:20:18.861530+0000","last_active":"2024-09-11T22:20:27.048092+0000","last_peered":"2024-09-11T22:20:27.048092+0000","last_clean":"2024-09-11T22:20:27.048092+0000","last_became_active":"2024-09-11T22:20:18.861230+0000","last_became_peered":"2024-09-11T22:20:18.861230+0000","last_unstale":"2024-09-11T22:20:27.048092+0000","last_undegraded":"2024-09-11T22:20:27.048092+0000","last_fullsized":"2024-09-11T22:20:27.048092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890615+0000","last_change":"2024-09-11T22:20:19.863401+0000","last_active":"2024-09-11T22:20:24.890615+0000","last_peered":"2024-09-11T22:20:24.890615+0000","last_clean":"2024-09-11T22:20:24.890615+0000","last_became_active":"2024-09-11T22:20:19.863127+0000","last_became_peered":"2024-09-11T22:20:19.863127+0000","last_unstale":"2024-09-11T22:20:24.890615+0000","last_undegraded":"2024-09-11T22:20:24.890615+0000","last_fullsized":"2024-09-11T22:20:24.890615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:36.888544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048021+0000","last_change":"2024-09-11T22:20:23.874650+0000","last_active":"2024-09-11T22:20:27.048021+0000","last_peered":"2024-09-11T22:20:27.048021+0000","last_clean":"2024-09-11T22:20:27.048021+0000","last_became_active":"2024-09-11T22:20:23.874040+0000","last_became_peered":"2024-09-11T22:20:23.874040+0000","last_unstale":"2024-09-11T22:20:27.048021+0000","last_undegraded":"2024-09-11T22:20:27.048021+0000","last_fullsized":"2024-09-11T22:20:27.048021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888158+0000","last_change":"2024-09-11T22:20:19.859446+0000","last_active":"2024-09-11T22:20:24.888158+0000","last_peered":"2024-09-11T22:20:24.888158+0000","last_clean":"2024-09-11T22:20:24.888158+0000","last_became_active":"2024-09-11T22:20:19.859106+0000","last_became_peered":"2024-09-11T22:20:19.859106+0000","last_unstale":"2024-09-11T22:20:24.888158+0000","last_undegraded":"2024-09-11T22:20:24.888158+0000","last_fullsized":"2024-09-11T22:20:24.888158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048811+0000","last_change":"2024-09-11T22:20:18.856475+0000","last_active":"2024-09-11T22:20:27.048811+0000","last_peered":"2024-09-11T22:20:27.048811+0000","last_clean":"2024-09-11T22:20:27.048811+0000","last_became_active":"2024-09-11T22:20:18.856165+0000","last_became_peered":"2024-09-11T22:20:18.856165+0000","last_unstale":"2024-09-11T22:20:27.048811+0000","last_undegraded":"2024-09-11T22:20:27.048811+0000","last_fullsized":"2024-09-11T22:20:27.048811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048102+0000","last_change":"2024-09-11T22:20:23.878121+0000","last_active":"2024-09-11T22:20:27.048102+0000","last_peered":"2024-09-11T22:20:27.048102+0000","last_clean":"2024-09-11T22:20:27.048102+0000","last_became_active":"2024-09-11T22:20:23.877713+0000","last_became_peered":"2024-09-11T22:20:23.877713+0000","last_unstale":"2024-09-11T22:20:27.048102+0000","last_undegraded":"2024-09-11T22:20:27.048102+0000","last_fullsized":"2024-09-11T22:20:27.048102+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887604+0000","last_change":"2024-09-11T22:20:19.858358+0000","last_active":"2024-09-11T22:20:24.887604+0000","last_peered":"2024-09-11T22:20:24.887604+0000","last_clean":"2024-09-11T22:20:24.887604+0000","last_became_active":"2024-09-11T22:20:19.858057+0000","last_became_peered":"2024-09-11T22:20:19.858057+0000","last_unstale":"2024-09-11T22:20:24.887604+0000","last_undegraded":"2024-09-11T22:20:24.887604+0000","last_fullsized":"2024-09-11T22:20:24.887604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:07.839926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998178+0000","last_change":"2024-09-11T22:20:18.853818+0000","last_active":"2024-09-11T22:20:24.998178+0000","last_peered":"2024-09-11T22:20:24.998178+0000","last_clean":"2024-09-11T22:20:24.998178+0000","last_became_active":"2024-09-11T22:20:18.853508+0000","last_became_peered":"2024-09-11T22:20:18.853508+0000","last_unstale":"2024-09-11T22:20:24.998178+0000","last_undegraded":"2024-09-11T22:20:24.998178+0000","last_fullsized":"2024-09-11T22:20:24.998178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:58.141587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047962+0000","last_change":"2024-09-11T22:20:23.879226+0000","last_active":"2024-09-11T22:20:27.047962+0000","last_peered":"2024-09-11T22:20:27.047962+0000","last_clean":"2024-09-11T22:20:27.047962+0000","last_became_active":"2024-09-11T22:20:23.878199+0000","last_became_peered":"2024-09-11T22:20:23.878199+0000","last_unstale":"2024-09-11T22:20:27.047962+0000","last_undegraded":"2024-09-11T22:20:27.047962+0000","last_fullsized":"2024-09-11T22:20:27.047962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:13.245927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887402+0000","last_change":"2024-09-11T22:20:19.844748+0000","last_active":"2024-09-11T22:20:24.887402+0000","last_peered":"2024-09-11T22:20:24.887402+0000","last_clean":"2024-09-11T22:20:24.887402+0000","last_became_active":"2024-09-11T22:20:19.844446+0000","last_became_peered":"2024-09-11T22:20:19.844446+0000","last_unstale":"2024-09-11T22:20:24.887402+0000","last_undegraded":"2024-09-11T22:20:24.887402+0000","last_fullsized":"2024-09-11T22:20:24.887402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:13.319918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997785+0000","last_change":"2024-09-11T22:20:18.847388+0000","last_active":"2024-09-11T22:20:24.997785+0000","last_peered":"2024-09-11T22:20:24.997785+0000","last_clean":"2024-09-11T22:20:24.997785+0000","last_became_active":"2024-09-11T22:20:18.847118+0000","last_became_peered":"2024-09-11T22:20:18.847118+0000","last_unstale":"2024-09-11T22:20:24.997785+0000","last_undegraded":"2024-09-11T22:20:24.997785+0000","last_fullsized":"2024-09-11T22:20:24.997785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:47.360920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998393+0000","last_change":"2024-09-11T22:20:24.077604+0000","last_active":"2024-09-11T22:20:24.998393+0000","last_peered":"2024-09-11T22:20:24.998393+0000","last_clean":"2024-09-11T22:20:24.998393+0000","last_became_active":"2024-09-11T22:20:24.077231+0000","last_became_peered":"2024-09-11T22:20:24.077231+0000","last_unstale":"2024-09-11T22:20:24.998393+0000","last_undegraded":"2024-09-11T22:20:24.998393+0000","last_fullsized":"2024-09-11T22:20:24.998393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:38.846688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048647+0000","last_change":"2024-09-11T22:20:19.854453+0000","last_active":"2024-09-11T22:20:27.048647+0000","last_peered":"2024-09-11T22:20:27.048647+0000","last_clean":"2024-09-11T22:20:27.048647+0000","last_became_active":"2024-09-11T22:20:19.854100+0000","last_became_peered":"2024-09-11T22:20:19.854100+0000","last_unstale":"2024-09-11T22:20:27.048647+0000","last_undegraded":"2024-09-11T22:20:27.048647+0000","last_fullsized":"2024-09-11T22:20:27.048647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:06.166813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047502+0000","last_change":"2024-09-11T22:20:18.854889+0000","last_active":"2024-09-11T22:20:27.047502+0000","last_peered":"2024-09-11T22:20:27.047502+0000","last_clean":"2024-09-11T22:20:27.047502+0000","last_became_active":"2024-09-11T22:20:18.854552+0000","last_became_peered":"2024-09-11T22:20:18.854552+0000","last_unstale":"2024-09-11T22:20:27.047502+0000","last_undegraded":"2024-09-11T22:20:27.047502+0000","last_fullsized":"2024-09-11T22:20:27.047502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:33.612126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048443+0000","last_change":"2024-09-11T22:20:23.878932+0000","last_active":"2024-09-11T22:20:27.048443+0000","last_peered":"2024-09-11T22:20:27.048443+0000","last_clean":"2024-09-11T22:20:27.048443+0000","last_became_active":"2024-09-11T22:20:23.878305+0000","last_became_peered":"2024-09-11T22:20:23.878305+0000","last_unstale":"2024-09-11T22:20:27.048443+0000","last_undegraded":"2024-09-11T22:20:27.048443+0000","last_fullsized":"2024-09-11T22:20:27.048443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048250+0000","last_change":"2024-09-11T22:20:19.856318+0000","last_active":"2024-09-11T22:20:27.048250+0000","last_peered":"2024-09-11T22:20:27.048250+0000","last_clean":"2024-09-11T22:20:27.048250+0000","last_became_active":"2024-09-11T22:20:19.855992+0000","last_became_peered":"2024-09-11T22:20:19.855992+0000","last_unstale":"2024-09-11T22:20:27.048250+0000","last_undegraded":"2024-09-11T22:20:27.048250+0000","last_fullsized":"2024-09-11T22:20:27.048250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:57.709140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889662+0000","last_change":"2024-09-11T22:20:18.850750+0000","last_active":"2024-09-11T22:20:24.889662+0000","last_peered":"2024-09-11T22:20:24.889662+0000","last_clean":"2024-09-11T22:20:24.889662+0000","last_became_active":"2024-09-11T22:20:18.849621+0000","last_became_peered":"2024-09-11T22:20:18.849621+0000","last_unstale":"2024-09-11T22:20:24.889662+0000","last_undegraded":"2024-09-11T22:20:24.889662+0000","last_fullsized":"2024-09-11T22:20:24.889662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047710+0000","last_change":"2024-09-11T22:20:24.077741+0000","last_active":"2024-09-11T22:20:27.047710+0000","last_peered":"2024-09-11T22:20:27.047710+0000","last_clean":"2024-09-11T22:20:27.047710+0000","last_became_active":"2024-09-11T22:20:24.077325+0000","last_became_peered":"2024-09-11T22:20:24.077325+0000","last_unstale":"2024-09-11T22:20:27.047710+0000","last_undegraded":"2024-09-11T22:20:27.047710+0000","last_fullsized":"2024-09-11T22:20:27.047710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:18.656529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888138+0000","last_change":"2024-09-11T22:20:19.850738+0000","last_active":"2024-09-11T22:20:24.888138+0000","last_peered":"2024-09-11T22:20:24.888138+0000","last_clean":"2024-09-11T22:20:24.888138+0000","last_became_active":"2024-09-11T22:20:19.850441+0000","last_became_peered":"2024-09-11T22:20:19.850441+0000","last_unstale":"2024-09-11T22:20:24.888138+0000","last_undegraded":"2024-09-11T22:20:24.888138+0000","last_fullsized":"2024-09-11T22:20:24.888138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:47.552343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998291+0000","last_change":"2024-09-11T22:20:18.845173+0000","last_active":"2024-09-11T22:20:24.998291+0000","last_peered":"2024-09-11T22:20:24.998291+0000","last_clean":"2024-09-11T22:20:24.998291+0000","last_became_active":"2024-09-11T22:20:18.844731+0000","last_became_peered":"2024-09-11T22:20:18.844731+0000","last_unstale":"2024-09-11T22:20:24.998291+0000","last_undegraded":"2024-09-11T22:20:24.998291+0000","last_fullsized":"2024-09-11T22:20:24.998291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:32.963285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887172+0000","last_change":"2024-09-11T22:20:24.078020+0000","last_active":"2024-09-11T22:20:24.887172+0000","last_peered":"2024-09-11T22:20:24.887172+0000","last_clean":"2024-09-11T22:20:24.887172+0000","last_became_active":"2024-09-11T22:20:24.077541+0000","last_became_peered":"2024-09-11T22:20:24.077541+0000","last_unstale":"2024-09-11T22:20:24.887172+0000","last_undegraded":"2024-09-11T22:20:24.887172+0000","last_fullsized":"2024-09-11T22:20:24.887172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:36.122714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998068+0000","last_change":"2024-09-11T22:20:19.845497+0000","last_active":"2024-09-11T22:20:24.998068+0000","last_peered":"2024-09-11T22:20:24.998068+0000","last_clean":"2024-09-11T22:20:24.998068+0000","last_became_active":"2024-09-11T22:20:19.845203+0000","last_became_peered":"2024-09-11T22:20:19.845203+0000","last_unstale":"2024-09-11T22:20:24.998068+0000","last_undegraded":"2024-09-11T22:20:24.998068+0000","last_fullsized":"2024-09-11T22:20:24.998068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:12.086231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048854+0000","last_change":"2024-09-11T22:20:18.856263+0000","last_active":"2024-09-11T22:20:27.048854+0000","last_peered":"2024-09-11T22:20:27.048854+0000","last_clean":"2024-09-11T22:20:27.048854+0000","last_became_active":"2024-09-11T22:20:18.855968+0000","last_became_peered":"2024-09-11T22:20:18.855968+0000","last_unstale":"2024-09-11T22:20:27.048854+0000","last_undegraded":"2024-09-11T22:20:27.048854+0000","last_fullsized":"2024-09-11T22:20:27.048854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047968+0000","last_change":"2024-09-11T22:20:24.075030+0000","last_active":"2024-09-11T22:20:27.047968+0000","last_peered":"2024-09-11T22:20:27.047968+0000","last_clean":"2024-09-11T22:20:27.047968+0000","last_became_active":"2024-09-11T22:20:24.074588+0000","last_became_peered":"2024-09-11T22:20:24.074588+0000","last_unstale":"2024-09-11T22:20:27.047968+0000","last_undegraded":"2024-09-11T22:20:27.047968+0000","last_fullsized":"2024-09-11T22:20:27.047968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890676+0000","last_change":"2024-09-11T22:20:19.859010+0000","last_active":"2024-09-11T22:20:24.890676+0000","last_peered":"2024-09-11T22:20:24.890676+0000","last_clean":"2024-09-11T22:20:24.890676+0000","last_became_active":"2024-09-11T22:20:19.858585+0000","last_became_peered":"2024-09-11T22:20:19.858585+0000","last_unstale":"2024-09-11T22:20:24.890676+0000","last_undegraded":"2024-09-11T22:20:24.890676+0000","last_fullsized":"2024-09-11T22:20:24.890676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998168+0000","last_change":"2024-09-11T22:20:18.847904+0000","last_active":"2024-09-11T22:20:24.998168+0000","last_peered":"2024-09-11T22:20:24.998168+0000","last_clean":"2024-09-11T22:20:24.998168+0000","last_became_active":"2024-09-11T22:20:18.847669+0000","last_became_peered":"2024-09-11T22:20:18.847669+0000","last_unstale":"2024-09-11T22:20:24.998168+0000","last_undegraded":"2024-09-11T22:20:24.998168+0000","last_fullsized":"2024-09-11T22:20:24.998168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:08.717999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997794+0000","last_change":"2024-09-11T22:20:23.881067+0000","last_active":"2024-09-11T22:20:24.997794+0000","last_peered":"2024-09-11T22:20:24.997794+0000","last_clean":"2024-09-11T22:20:24.997794+0000","last_became_active":"2024-09-11T22:20:23.880468+0000","last_became_peered":"2024-09-11T22:20:23.880468+0000","last_unstale":"2024-09-11T22:20:24.997794+0000","last_undegraded":"2024-09-11T22:20:24.997794+0000","last_fullsized":"2024-09-11T22:20:24.997794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:23.480547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048637+0000","last_change":"2024-09-11T22:20:19.860423+0000","last_active":"2024-09-11T22:20:27.048637+0000","last_peered":"2024-09-11T22:20:27.048637+0000","last_clean":"2024-09-11T22:20:27.048637+0000","last_became_active":"2024-09-11T22:20:19.858932+0000","last_became_peered":"2024-09-11T22:20:19.858932+0000","last_unstale":"2024-09-11T22:20:27.048637+0000","last_undegraded":"2024-09-11T22:20:27.048637+0000","last_fullsized":"2024-09-11T22:20:27.048637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:53.255932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889986+0000","last_change":"2024-09-11T22:20:18.854973+0000","last_active":"2024-09-11T22:20:24.889986+0000","last_peered":"2024-09-11T22:20:24.889986+0000","last_clean":"2024-09-11T22:20:24.889986+0000","last_became_active":"2024-09-11T22:20:18.854725+0000","last_became_peered":"2024-09-11T22:20:18.854725+0000","last_unstale":"2024-09-11T22:20:24.889986+0000","last_undegraded":"2024-09-11T22:20:24.889986+0000","last_fullsized":"2024-09-11T22:20:24.889986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998393+0000","last_change":"2024-09-11T22:20:23.880693+0000","last_active":"2024-09-11T22:20:24.998393+0000","last_peered":"2024-09-11T22:20:24.998393+0000","last_clean":"2024-09-11T22:20:24.998393+0000","last_became_active":"2024-09-11T22:20:23.880243+0000","last_became_peered":"2024-09-11T22:20:23.880243+0000","last_unstale":"2024-09-11T22:20:24.998393+0000","last_undegraded":"2024-09-11T22:20:24.998393+0000","last_fullsized":"2024-09-11T22:20:24.998393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.659287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997954+0000","last_change":"2024-09-11T22:20:19.844808+0000","last_active":"2024-09-11T22:20:24.997954+0000","last_peered":"2024-09-11T22:20:24.997954+0000","last_clean":"2024-09-11T22:20:24.997954+0000","last_became_active":"2024-09-11T22:20:19.844536+0000","last_became_peered":"2024-09-11T22:20:19.844536+0000","last_unstale":"2024-09-11T22:20:24.997954+0000","last_undegraded":"2024-09-11T22:20:24.997954+0000","last_fullsized":"2024-09-11T22:20:24.997954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:57.142383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951217+0000","last_change":"2024-09-11T22:20:18.855640+0000","last_active":"2024-09-11T22:20:26.951217+0000","last_peered":"2024-09-11T22:20:26.951217+0000","last_clean":"2024-09-11T22:20:26.951217+0000","last_became_active":"2024-09-11T22:20:18.855394+0000","last_became_peered":"2024-09-11T22:20:18.855394+0000","last_unstale":"2024-09-11T22:20:26.951217+0000","last_undegraded":"2024-09-11T22:20:26.951217+0000","last_fullsized":"2024-09-11T22:20:26.951217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998458+0000","last_change":"2024-09-11T22:20:23.882554+0000","last_active":"2024-09-11T22:20:24.998458+0000","last_peered":"2024-09-11T22:20:24.998458+0000","last_clean":"2024-09-11T22:20:24.998458+0000","last_became_active":"2024-09-11T22:20:23.881642+0000","last_became_peered":"2024-09-11T22:20:23.881642+0000","last_unstale":"2024-09-11T22:20:24.998458+0000","last_undegraded":"2024-09-11T22:20:24.998458+0000","last_fullsized":"2024-09-11T22:20:24.998458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:16.696043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047535+0000","last_change":"2024-09-11T22:20:19.859429+0000","last_active":"2024-09-11T22:20:27.047535+0000","last_peered":"2024-09-11T22:20:27.047535+0000","last_clean":"2024-09-11T22:20:27.047535+0000","last_became_active":"2024-09-11T22:20:19.859159+0000","last_became_peered":"2024-09-11T22:20:19.859159+0000","last_unstale":"2024-09-11T22:20:27.047535+0000","last_undegraded":"2024-09-11T22:20:27.047535+0000","last_fullsized":"2024-09-11T22:20:27.047535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:02.696450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047156+0000","last_change":"2024-09-11T22:20:18.856144+0000","last_active":"2024-09-11T22:20:27.047156+0000","last_peered":"2024-09-11T22:20:27.047156+0000","last_clean":"2024-09-11T22:20:27.047156+0000","last_became_active":"2024-09-11T22:20:18.855866+0000","last_became_peered":"2024-09-11T22:20:18.855866+0000","last_unstale":"2024-09-11T22:20:27.047156+0000","last_undegraded":"2024-09-11T22:20:27.047156+0000","last_fullsized":"2024-09-11T22:20:27.047156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:37.259393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048214+0000","last_change":"2024-09-11T22:20:24.075154+0000","last_active":"2024-09-11T22:20:27.048214+0000","last_peered":"2024-09-11T22:20:27.048214+0000","last_clean":"2024-09-11T22:20:27.048214+0000","last_became_active":"2024-09-11T22:20:24.074568+0000","last_became_peered":"2024-09-11T22:20:24.074568+0000","last_unstale":"2024-09-11T22:20:27.048214+0000","last_undegraded":"2024-09-11T22:20:27.048214+0000","last_fullsized":"2024-09-11T22:20:27.048214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:09.804991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887321+0000","last_change":"2024-09-11T22:20:19.861236+0000","last_active":"2024-09-11T22:20:24.887321+0000","last_peered":"2024-09-11T22:20:24.887321+0000","last_clean":"2024-09-11T22:20:24.887321+0000","last_became_active":"2024-09-11T22:20:19.860938+0000","last_became_peered":"2024-09-11T22:20:19.860938+0000","last_unstale":"2024-09-11T22:20:24.887321+0000","last_undegraded":"2024-09-11T22:20:24.887321+0000","last_fullsized":"2024-09-11T22:20:24.887321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:42.015334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890426+0000","last_change":"2024-09-11T22:20:18.853467+0000","last_active":"2024-09-11T22:20:24.890426+0000","last_peered":"2024-09-11T22:20:24.890426+0000","last_clean":"2024-09-11T22:20:24.890426+0000","last_became_active":"2024-09-11T22:20:18.853182+0000","last_became_peered":"2024-09-11T22:20:18.853182+0000","last_unstale":"2024-09-11T22:20:24.890426+0000","last_undegraded":"2024-09-11T22:20:24.890426+0000","last_fullsized":"2024-09-11T22:20:24.890426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047625+0000","last_change":"2024-09-11T22:20:09.425648+0000","last_active":"2024-09-11T22:20:27.047625+0000","last_peered":"2024-09-11T22:20:27.047625+0000","last_clean":"2024-09-11T22:20:27.047625+0000","last_became_active":"2024-09-11T22:20:09.424591+0000","last_became_peered":"2024-09-11T22:20:09.424591+0000","last_unstale":"2024-09-11T22:20:27.047625+0000","last_undegraded":"2024-09-11T22:20:27.047625+0000","last_fullsized":"2024-09-11T22:20:27.047625+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_clean_scrub_stamp":"2024-09-11T22:20:08.334092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:53.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888536+0000","last_change":"2024-09-11T22:20:24.077007+0000","last_active":"2024-09-11T22:20:24.888536+0000","last_peered":"2024-09-11T22:20:24.888536+0000","last_clean":"2024-09-11T22:20:24.888536+0000","last_became_active":"2024-09-11T22:20:24.076601+0000","last_became_peered":"2024-09-11T22:20:24.076601+0000","last_unstale":"2024-09-11T22:20:24.888536+0000","last_undegraded":"2024-09-11T22:20:24.888536+0000","last_fullsized":"2024-09-11T22:20:24.888536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048600+0000","last_change":"2024-09-11T22:20:19.863279+0000","last_active":"2024-09-11T22:20:27.048600+0000","last_peered":"2024-09-11T22:20:27.048600+0000","last_clean":"2024-09-11T22:20:27.048600+0000","last_became_active":"2024-09-11T22:20:19.861322+0000","last_became_peered":"2024-09-11T22:20:19.861322+0000","last_unstale":"2024-09-11T22:20:27.048600+0000","last_undegraded":"2024-09-11T22:20:27.048600+0000","last_fullsized":"2024-09-11T22:20:27.048600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951240+0000","last_change":"2024-09-11T22:20:18.853343+0000","last_active":"2024-09-11T22:20:26.951240+0000","last_peered":"2024-09-11T22:20:26.951240+0000","last_clean":"2024-09-11T22:20:26.951240+0000","last_became_active":"2024-09-11T22:20:18.853069+0000","last_became_peered":"2024-09-11T22:20:18.853069+0000","last_unstale":"2024-09-11T22:20:26.951240+0000","last_undegraded":"2024-09-11T22:20:26.951240+0000","last_fullsized":"2024-09-11T22:20:26.951240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888655+0000","last_change":"2024-09-11T22:20:24.075350+0000","last_active":"2024-09-11T22:20:24.888655+0000","last_peered":"2024-09-11T22:20:24.888655+0000","last_clean":"2024-09-11T22:20:24.888655+0000","last_became_active":"2024-09-11T22:20:24.074789+0000","last_became_peered":"2024-09-11T22:20:24.074789+0000","last_unstale":"2024-09-11T22:20:24.888655+0000","last_undegraded":"2024-09-11T22:20:24.888655+0000","last_fullsized":"2024-09-11T22:20:24.888655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890400+0000","last_change":"2024-09-11T22:20:19.866331+0000","last_active":"2024-09-11T22:20:24.890400+0000","last_peered":"2024-09-11T22:20:24.890400+0000","last_clean":"2024-09-11T22:20:24.890400+0000","last_became_active":"2024-09-11T22:20:19.865535+0000","last_became_peered":"2024-09-11T22:20:19.865535+0000","last_unstale":"2024-09-11T22:20:24.890400+0000","last_undegraded":"2024-09-11T22:20:24.890400+0000","last_fullsized":"2024-09-11T22:20:24.890400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998164+0000","last_change":"2024-09-11T22:20:18.849434+0000","last_active":"2024-09-11T22:20:24.998164+0000","last_peered":"2024-09-11T22:20:24.998164+0000","last_clean":"2024-09-11T22:20:24.998164+0000","last_became_active":"2024-09-11T22:20:18.848787+0000","last_became_peered":"2024-09-11T22:20:18.848787+0000","last_unstale":"2024-09-11T22:20:24.998164+0000","last_undegraded":"2024-09-11T22:20:24.998164+0000","last_fullsized":"2024-09-11T22:20:24.998164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:25.689495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048087+0000","last_change":"2024-09-11T22:20:23.879962+0000","last_active":"2024-09-11T22:20:27.048087+0000","last_peered":"2024-09-11T22:20:27.048087+0000","last_clean":"2024-09-11T22:20:27.048087+0000","last_became_active":"2024-09-11T22:20:23.879586+0000","last_became_peered":"2024-09-11T22:20:23.879586+0000","last_unstale":"2024-09-11T22:20:27.048087+0000","last_undegraded":"2024-09-11T22:20:27.048087+0000","last_fullsized":"2024-09-11T22:20:27.048087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:27.323116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.049164+0000","last_change":"2024-09-11T22:20:19.860411+0000","last_active":"2024-09-11T22:20:27.049164+0000","last_peered":"2024-09-11T22:20:27.049164+0000","last_clean":"2024-09-11T22:20:27.049164+0000","last_became_active":"2024-09-11T22:20:19.860076+0000","last_became_peered":"2024-09-11T22:20:19.860076+0000","last_unstale":"2024-09-11T22:20:27.049164+0000","last_undegraded":"2024-09-11T22:20:27.049164+0000","last_fullsized":"2024-09-11T22:20:27.049164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951255+0000","last_change":"2024-09-11T22:20:18.856020+0000","last_active":"2024-09-11T22:20:26.951255+0000","last_peered":"2024-09-11T22:20:26.951255+0000","last_clean":"2024-09-11T22:20:26.951255+0000","last_became_active":"2024-09-11T22:20:18.855753+0000","last_became_peered":"2024-09-11T22:20:18.855753+0000","last_unstale":"2024-09-11T22:20:26.951255+0000","last_undegraded":"2024-09-11T22:20:26.951255+0000","last_fullsized":"2024-09-11T22:20:26.951255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888726+0000","last_change":"2024-09-11T22:20:24.077975+0000","last_active":"2024-09-11T22:20:24.888726+0000","last_peered":"2024-09-11T22:20:24.888726+0000","last_clean":"2024-09-11T22:20:24.888726+0000","last_became_active":"2024-09-11T22:20:24.077502+0000","last_became_peered":"2024-09-11T22:20:24.077502+0000","last_unstale":"2024-09-11T22:20:24.888726+0000","last_undegraded":"2024-09-11T22:20:24.888726+0000","last_fullsized":"2024-09-11T22:20:24.888726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:16.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047781+0000","last_change":"2024-09-11T22:20:19.856986+0000","last_active":"2024-09-11T22:20:27.047781+0000","last_peered":"2024-09-11T22:20:27.047781+0000","last_clean":"2024-09-11T22:20:27.047781+0000","last_became_active":"2024-09-11T22:20:19.856739+0000","last_became_peered":"2024-09-11T22:20:19.856739+0000","last_unstale":"2024-09-11T22:20:27.047781+0000","last_undegraded":"2024-09-11T22:20:27.047781+0000","last_fullsized":"2024-09-11T22:20:27.047781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048306+0000","last_change":"2024-09-11T22:20:18.855044+0000","last_active":"2024-09-11T22:20:27.048306+0000","last_peered":"2024-09-11T22:20:27.048306+0000","last_clean":"2024-09-11T22:20:27.048306+0000","last_became_active":"2024-09-11T22:20:18.854764+0000","last_became_peered":"2024-09-11T22:20:18.854764+0000","last_unstale":"2024-09-11T22:20:27.048306+0000","last_undegraded":"2024-09-11T22:20:27.048306+0000","last_fullsized":"2024-09-11T22:20:27.048306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:22.207278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047516+0000","last_change":"2024-09-11T22:20:23.878383+0000","last_active":"2024-09-11T22:20:27.047516+0000","last_peered":"2024-09-11T22:20:27.047516+0000","last_clean":"2024-09-11T22:20:27.047516+0000","last_became_active":"2024-09-11T22:20:23.877890+0000","last_became_peered":"2024-09-11T22:20:23.877890+0000","last_unstale":"2024-09-11T22:20:27.047516+0000","last_undegraded":"2024-09-11T22:20:27.047516+0000","last_fullsized":"2024-09-11T22:20:27.047516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:18.876485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048434+0000","last_change":"2024-09-11T22:20:19.861242+0000","last_active":"2024-09-11T22:20:27.048434+0000","last_peered":"2024-09-11T22:20:27.048434+0000","last_clean":"2024-09-11T22:20:27.048434+0000","last_became_active":"2024-09-11T22:20:19.860988+0000","last_became_peered":"2024-09-11T22:20:19.860988+0000","last_unstale":"2024-09-11T22:20:27.048434+0000","last_undegraded":"2024-09-11T22:20:27.048434+0000","last_fullsized":"2024-09-11T22:20:27.048434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951217+0000","last_change":"2024-09-11T22:20:18.852459+0000","last_active":"2024-09-11T22:20:26.951217+0000","last_peered":"2024-09-11T22:20:26.951217+0000","last_clean":"2024-09-11T22:20:26.951217+0000","last_became_active":"2024-09-11T22:20:18.852153+0000","last_became_peered":"2024-09-11T22:20:18.852153+0000","last_unstale":"2024-09-11T22:20:26.951217+0000","last_undegraded":"2024-09-11T22:20:26.951217+0000","last_fullsized":"2024-09-11T22:20:26.951217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048026+0000","last_change":"2024-09-11T22:20:23.874062+0000","last_active":"2024-09-11T22:20:27.048026+0000","last_peered":"2024-09-11T22:20:27.048026+0000","last_clean":"2024-09-11T22:20:27.048026+0000","last_became_active":"2024-09-11T22:20:23.873635+0000","last_became_peered":"2024-09-11T22:20:23.873635+0000","last_unstale":"2024-09-11T22:20:27.048026+0000","last_undegraded":"2024-09-11T22:20:27.048026+0000","last_fullsized":"2024-09-11T22:20:27.048026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:40.914142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888125+0000","last_change":"2024-09-11T22:20:19.851577+0000","last_active":"2024-09-11T22:20:24.888125+0000","last_peered":"2024-09-11T22:20:24.888125+0000","last_clean":"2024-09-11T22:20:24.888125+0000","last_became_active":"2024-09-11T22:20:19.851286+0000","last_became_peered":"2024-09-11T22:20:19.851286+0000","last_unstale":"2024-09-11T22:20:24.888125+0000","last_undegraded":"2024-09-11T22:20:24.888125+0000","last_fullsized":"2024-09-11T22:20:24.888125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:32.025931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888304+0000","last_change":"2024-09-11T22:20:18.853301+0000","last_active":"2024-09-11T22:20:24.888304+0000","last_peered":"2024-09-11T22:20:24.888304+0000","last_clean":"2024-09-11T22:20:24.888304+0000","last_became_active":"2024-09-11T22:20:18.852978+0000","last_became_peered":"2024-09-11T22:20:18.852978+0000","last_unstale":"2024-09-11T22:20:24.888304+0000","last_undegraded":"2024-09-11T22:20:24.888304+0000","last_fullsized":"2024-09-11T22:20:24.888304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888069+0000","last_change":"2024-09-11T22:20:24.077636+0000","last_active":"2024-09-11T22:20:24.888069+0000","last_peered":"2024-09-11T22:20:24.888069+0000","last_clean":"2024-09-11T22:20:24.888069+0000","last_became_active":"2024-09-11T22:20:24.077313+0000","last_became_peered":"2024-09-11T22:20:24.077313+0000","last_unstale":"2024-09-11T22:20:24.888069+0000","last_undegraded":"2024-09-11T22:20:24.888069+0000","last_fullsized":"2024-09-11T22:20:24.888069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:23.154027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048723+0000","last_change":"2024-09-11T22:20:19.862562+0000","last_active":"2024-09-11T22:20:27.048723+0000","last_peered":"2024-09-11T22:20:27.048723+0000","last_clean":"2024-09-11T22:20:27.048723+0000","last_became_active":"2024-09-11T22:20:19.862267+0000","last_became_peered":"2024-09-11T22:20:19.862267+0000","last_unstale":"2024-09-11T22:20:27.048723+0000","last_undegraded":"2024-09-11T22:20:27.048723+0000","last_fullsized":"2024-09-11T22:20:27.048723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889888+0000","last_change":"2024-09-11T22:20:18.858002+0000","last_active":"2024-09-11T22:20:24.889888+0000","last_peered":"2024-09-11T22:20:24.889888+0000","last_clean":"2024-09-11T22:20:24.889888+0000","last_became_active":"2024-09-11T22:20:18.857419+0000","last_became_peered":"2024-09-11T22:20:18.857419+0000","last_unstale":"2024-09-11T22:20:24.889888+0000","last_undegraded":"2024-09-11T22:20:24.889888+0000","last_fullsized":"2024-09-11T22:20:24.889888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887723+0000","last_change":"2024-09-11T22:20:24.074971+0000","last_active":"2024-09-11T22:20:24.887723+0000","last_peered":"2024-09-11T22:20:24.887723+0000","last_clean":"2024-09-11T22:20:24.887723+0000","last_became_active":"2024-09-11T22:20:24.074609+0000","last_became_peered":"2024-09-11T22:20:24.074609+0000","last_unstale":"2024-09-11T22:20:24.887723+0000","last_undegraded":"2024-09-11T22:20:24.887723+0000","last_fullsized":"2024-09-11T22:20:24.887723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:55.318904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047865+0000","last_change":"2024-09-11T22:20:19.857276+0000","last_active":"2024-09-11T22:20:27.047865+0000","last_peered":"2024-09-11T22:20:27.047865+0000","last_clean":"2024-09-11T22:20:27.047865+0000","last_became_active":"2024-09-11T22:20:19.857027+0000","last_became_peered":"2024-09-11T22:20:19.857027+0000","last_unstale":"2024-09-11T22:20:27.047865+0000","last_undegraded":"2024-09-11T22:20:27.047865+0000","last_fullsized":"2024-09-11T22:20:27.047865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048222+0000","last_change":"2024-09-11T22:20:18.848671+0000","last_active":"2024-09-11T22:20:27.048222+0000","last_peered":"2024-09-11T22:20:27.048222+0000","last_clean":"2024-09-11T22:20:27.048222+0000","last_became_active":"2024-09-11T22:20:18.848405+0000","last_became_peered":"2024-09-11T22:20:18.848405+0000","last_unstale":"2024-09-11T22:20:27.048222+0000","last_undegraded":"2024-09-11T22:20:27.048222+0000","last_fullsized":"2024-09-11T22:20:27.048222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890660+0000","last_change":"2024-09-11T22:20:24.076835+0000","last_active":"2024-09-11T22:20:24.890660+0000","last_peered":"2024-09-11T22:20:24.890660+0000","last_clean":"2024-09-11T22:20:24.890660+0000","last_became_active":"2024-09-11T22:20:24.076200+0000","last_became_peered":"2024-09-11T22:20:24.076200+0000","last_unstale":"2024-09-11T22:20:24.890660+0000","last_undegraded":"2024-09-11T22:20:24.890660+0000","last_fullsized":"2024-09-11T22:20:24.890660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:48.150778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048503+0000","last_change":"2024-09-11T22:20:19.855334+0000","last_active":"2024-09-11T22:20:27.048503+0000","last_peered":"2024-09-11T22:20:27.048503+0000","last_clean":"2024-09-11T22:20:27.048503+0000","last_became_active":"2024-09-11T22:20:19.855018+0000","last_became_peered":"2024-09-11T22:20:19.855018+0000","last_unstale":"2024-09-11T22:20:27.048503+0000","last_undegraded":"2024-09-11T22:20:27.048503+0000","last_fullsized":"2024-09-11T22:20:27.048503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:32.166521+0000","last_change":"2024-09-11T22:20:18.855665+0000","last_active":"2024-09-11T22:20:32.166521+0000","last_peered":"2024-09-11T22:20:32.166521+0000","last_clean":"2024-09-11T22:20:32.166521+0000","last_became_active":"2024-09-11T22:20:18.855386+0000","last_became_peered":"2024-09-11T22:20:18.855386+0000","last_unstale":"2024-09-11T22:20:32.166521+0000","last_undegraded":"2024-09-11T22:20:32.166521+0000","last_fullsized":"2024-09-11T22:20:32.166521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998100+0000","last_change":"2024-09-11T22:20:23.880793+0000","last_active":"2024-09-11T22:20:24.998100+0000","last_peered":"2024-09-11T22:20:24.998100+0000","last_clean":"2024-09-11T22:20:24.998100+0000","last_became_active":"2024-09-11T22:20:23.879993+0000","last_became_peered":"2024-09-11T22:20:23.879993+0000","last_unstale":"2024-09-11T22:20:24.998100+0000","last_undegraded":"2024-09-11T22:20:24.998100+0000","last_fullsized":"2024-09-11T22:20:24.998100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:50.449090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048075+0000","last_change":"2024-09-11T22:20:19.858588+0000","last_active":"2024-09-11T22:20:27.048075+0000","last_peered":"2024-09-11T22:20:27.048075+0000","last_clean":"2024-09-11T22:20:27.048075+0000","last_became_active":"2024-09-11T22:20:19.858322+0000","last_became_peered":"2024-09-11T22:20:19.858322+0000","last_unstale":"2024-09-11T22:20:27.048075+0000","last_undegraded":"2024-09-11T22:20:27.048075+0000","last_fullsized":"2024-09-11T22:20:27.048075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998071+0000","last_change":"2024-09-11T22:20:18.855056+0000","last_active":"2024-09-11T22:20:24.998071+0000","last_peered":"2024-09-11T22:20:24.998071+0000","last_clean":"2024-09-11T22:20:24.998071+0000","last_became_active":"2024-09-11T22:20:18.854784+0000","last_became_peered":"2024-09-11T22:20:18.854784+0000","last_unstale":"2024-09-11T22:20:24.998071+0000","last_undegraded":"2024-09-11T22:20:24.998071+0000","last_fullsized":"2024-09-11T22:20:24.998071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:38.916121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048044+0000","last_change":"2024-09-11T22:20:23.879768+0000","last_active":"2024-09-11T22:20:27.048044+0000","last_peered":"2024-09-11T22:20:27.048044+0000","last_clean":"2024-09-11T22:20:27.048044+0000","last_became_active":"2024-09-11T22:20:23.878794+0000","last_became_peered":"2024-09-11T22:20:23.878794+0000","last_unstale":"2024-09-11T22:20:27.048044+0000","last_undegraded":"2024-09-11T22:20:27.048044+0000","last_fullsized":"2024-09-11T22:20:27.048044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:07.301587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048230+0000","last_change":"2024-09-11T22:20:19.862315+0000","last_active":"2024-09-11T22:20:27.048230+0000","last_peered":"2024-09-11T22:20:27.048230+0000","last_clean":"2024-09-11T22:20:27.048230+0000","last_became_active":"2024-09-11T22:20:19.861607+0000","last_became_peered":"2024-09-11T22:20:19.861607+0000","last_unstale":"2024-09-11T22:20:27.048230+0000","last_undegraded":"2024-09-11T22:20:27.048230+0000","last_fullsized":"2024-09-11T22:20:27.048230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889443+0000","last_change":"2024-09-11T22:20:18.853382+0000","last_active":"2024-09-11T22:20:24.889443+0000","last_peered":"2024-09-11T22:20:24.889443+0000","last_clean":"2024-09-11T22:20:24.889443+0000","last_became_active":"2024-09-11T22:20:18.853103+0000","last_became_peered":"2024-09-11T22:20:18.853103+0000","last_unstale":"2024-09-11T22:20:24.889443+0000","last_undegraded":"2024-09-11T22:20:24.889443+0000","last_fullsized":"2024-09-11T22:20:24.889443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887490+0000","last_change":"2024-09-11T22:20:23.876997+0000","last_active":"2024-09-11T22:20:24.887490+0000","last_peered":"2024-09-11T22:20:24.887490+0000","last_clean":"2024-09-11T22:20:24.887490+0000","last_became_active":"2024-09-11T22:20:23.876587+0000","last_became_peered":"2024-09-11T22:20:23.876587+0000","last_unstale":"2024-09-11T22:20:24.887490+0000","last_undegraded":"2024-09-11T22:20:24.887490+0000","last_fullsized":"2024-09-11T22:20:24.887490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:19.670665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889342+0000","last_change":"2024-09-11T22:20:19.866624+0000","last_active":"2024-09-11T22:20:24.889342+0000","last_peered":"2024-09-11T22:20:24.889342+0000","last_clean":"2024-09-11T22:20:24.889342+0000","last_became_active":"2024-09-11T22:20:19.866303+0000","last_became_peered":"2024-09-11T22:20:19.866303+0000","last_unstale":"2024-09-11T22:20:24.889342+0000","last_undegraded":"2024-09-11T22:20:24.889342+0000","last_fullsized":"2024-09-11T22:20:24.889342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889446+0000","last_change":"2024-09-11T22:20:18.854361+0000","last_active":"2024-09-11T22:20:24.889446+0000","last_peered":"2024-09-11T22:20:24.889446+0000","last_clean":"2024-09-11T22:20:24.889446+0000","last_became_active":"2024-09-11T22:20:18.854019+0000","last_became_peered":"2024-09-11T22:20:18.854019+0000","last_unstale":"2024-09-11T22:20:24.889446+0000","last_undegraded":"2024-09-11T22:20:24.889446+0000","last_fullsized":"2024-09-11T22:20:24.889446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887284+0000","last_change":"2024-09-11T22:20:24.077476+0000","last_active":"2024-09-11T22:20:24.887284+0000","last_peered":"2024-09-11T22:20:24.887284+0000","last_clean":"2024-09-11T22:20:24.887284+0000","last_became_active":"2024-09-11T22:20:24.077134+0000","last_became_peered":"2024-09-11T22:20:24.077134+0000","last_unstale":"2024-09-11T22:20:24.887284+0000","last_undegraded":"2024-09-11T22:20:24.887284+0000","last_fullsized":"2024-09-11T22:20:24.887284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:03.186460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048035+0000","last_change":"2024-09-11T22:20:24.077143+0000","last_active":"2024-09-11T22:20:27.048035+0000","last_peered":"2024-09-11T22:20:27.048035+0000","last_clean":"2024-09-11T22:20:27.048035+0000","last_became_active":"2024-09-11T22:20:24.076592+0000","last_became_peered":"2024-09-11T22:20:24.076592+0000","last_unstale":"2024-09-11T22:20:27.048035+0000","last_undegraded":"2024-09-11T22:20:27.048035+0000","last_fullsized":"2024-09-11T22:20:27.048035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:02.661077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997676+0000","last_change":"2024-09-11T22:20:19.845776+0000","last_active":"2024-09-11T22:20:24.997676+0000","last_peered":"2024-09-11T22:20:24.997676+0000","last_clean":"2024-09-11T22:20:24.997676+0000","last_became_active":"2024-09-11T22:20:19.845425+0000","last_became_peered":"2024-09-11T22:20:19.845425+0000","last_unstale":"2024-09-11T22:20:24.997676+0000","last_undegraded":"2024-09-11T22:20:24.997676+0000","last_fullsized":"2024-09-11T22:20:24.997676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:07.187533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889050+0000","last_change":"2024-09-11T22:20:18.852446+0000","last_active":"2024-09-11T22:20:24.889050+0000","last_peered":"2024-09-11T22:20:24.889050+0000","last_clean":"2024-09-11T22:20:24.889050+0000","last_became_active":"2024-09-11T22:20:18.852155+0000","last_became_peered":"2024-09-11T22:20:18.852155+0000","last_unstale":"2024-09-11T22:20:24.889050+0000","last_undegraded":"2024-09-11T22:20:24.889050+0000","last_fullsized":"2024-09-11T22:20:24.889050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889233+0000","last_change":"2024-09-11T22:20:23.876503+0000","last_active":"2024-09-11T22:20:24.889233+0000","last_peered":"2024-09-11T22:20:24.889233+0000","last_clean":"2024-09-11T22:20:24.889233+0000","last_became_active":"2024-09-11T22:20:23.876100+0000","last_became_peered":"2024-09-11T22:20:23.876100+0000","last_unstale":"2024-09-11T22:20:24.889233+0000","last_undegraded":"2024-09-11T22:20:24.889233+0000","last_fullsized":"2024-09-11T22:20:24.889233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887311+0000","last_change":"2024-09-11T22:20:19.852606+0000","last_active":"2024-09-11T22:20:24.887311+0000","last_peered":"2024-09-11T22:20:24.887311+0000","last_clean":"2024-09-11T22:20:24.887311+0000","last_became_active":"2024-09-11T22:20:19.852333+0000","last_became_peered":"2024-09-11T22:20:19.852333+0000","last_unstale":"2024-09-11T22:20:24.887311+0000","last_undegraded":"2024-09-11T22:20:24.887311+0000","last_fullsized":"2024-09-11T22:20:24.887311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:56.940278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887444+0000","last_change":"2024-09-11T22:20:18.853767+0000","last_active":"2024-09-11T22:20:24.887444+0000","last_peered":"2024-09-11T22:20:24.887444+0000","last_clean":"2024-09-11T22:20:24.887444+0000","last_became_active":"2024-09-11T22:20:18.853533+0000","last_became_peered":"2024-09-11T22:20:18.853533+0000","last_unstale":"2024-09-11T22:20:24.887444+0000","last_undegraded":"2024-09-11T22:20:24.887444+0000","last_fullsized":"2024-09-11T22:20:24.887444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:36.662271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888381+0000","last_change":"2024-09-11T22:20:18.847133+0000","last_active":"2024-09-11T22:20:24.888381+0000","last_peered":"2024-09-11T22:20:24.888381+0000","last_clean":"2024-09-11T22:20:24.888381+0000","last_became_active":"2024-09-11T22:20:18.846321+0000","last_became_peered":"2024-09-11T22:20:18.846321+0000","last_unstale":"2024-09-11T22:20:24.888381+0000","last_undegraded":"2024-09-11T22:20:24.888381+0000","last_fullsized":"2024-09-11T22:20:24.888381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048164+0000","last_change":"2024-09-11T22:20:19.861445+0000","last_active":"2024-09-11T22:20:27.048164+0000","last_peered":"2024-09-11T22:20:27.048164+0000","last_clean":"2024-09-11T22:20:27.048164+0000","last_became_active":"2024-09-11T22:20:19.861154+0000","last_became_peered":"2024-09-11T22:20:19.861154+0000","last_unstale":"2024-09-11T22:20:27.048164+0000","last_undegraded":"2024-09-11T22:20:27.048164+0000","last_fullsized":"2024-09-11T22:20:27.048164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951525+0000","last_change":"2024-09-11T22:20:23.877973+0000","last_active":"2024-09-11T22:20:26.951525+0000","last_peered":"2024-09-11T22:20:26.951525+0000","last_clean":"2024-09-11T22:20:26.951525+0000","last_became_active":"2024-09-11T22:20:23.877578+0000","last_became_peered":"2024-09-11T22:20:23.877578+0000","last_unstale":"2024-09-11T22:20:26.951525+0000","last_undegraded":"2024-09-11T22:20:26.951525+0000","last_fullsized":"2024-09-11T22:20:26.951525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:27.826669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887675+0000","last_change":"2024-09-11T22:20:18.854142+0000","last_active":"2024-09-11T22:20:24.887675+0000","last_peered":"2024-09-11T22:20:24.887675+0000","last_clean":"2024-09-11T22:20:24.887675+0000","last_became_active":"2024-09-11T22:20:18.853872+0000","last_became_peered":"2024-09-11T22:20:18.853872+0000","last_unstale":"2024-09-11T22:20:24.887675+0000","last_undegraded":"2024-09-11T22:20:24.887675+0000","last_fullsized":"2024-09-11T22:20:24.887675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:22.513242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047903+0000","last_change":"2024-09-11T22:20:19.852580+0000","last_active":"2024-09-11T22:20:27.047903+0000","last_peered":"2024-09-11T22:20:27.047903+0000","last_clean":"2024-09-11T22:20:27.047903+0000","last_became_active":"2024-09-11T22:20:19.850175+0000","last_became_peered":"2024-09-11T22:20:19.850175+0000","last_unstale":"2024-09-11T22:20:27.047903+0000","last_undegraded":"2024-09-11T22:20:27.047903+0000","last_fullsized":"2024-09-11T22:20:27.047903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:11.937256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887822+0000","last_change":"2024-09-11T22:20:23.878004+0000","last_active":"2024-09-11T22:20:24.887822+0000","last_peered":"2024-09-11T22:20:24.887822+0000","last_clean":"2024-09-11T22:20:24.887822+0000","last_became_active":"2024-09-11T22:20:23.876776+0000","last_became_peered":"2024-09-11T22:20:23.876776+0000","last_unstale":"2024-09-11T22:20:24.887822+0000","last_undegraded":"2024-09-11T22:20:24.887822+0000","last_fullsized":"2024-09-11T22:20:24.887822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:11.254248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887933+0000","last_change":"2024-09-11T22:20:19.853439+0000","last_active":"2024-09-11T22:20:24.887933+0000","last_peered":"2024-09-11T22:20:24.887933+0000","last_clean":"2024-09-11T22:20:24.887933+0000","last_became_active":"2024-09-11T22:20:19.852937+0000","last_became_peered":"2024-09-11T22:20:19.852937+0000","last_unstale":"2024-09-11T22:20:24.887933+0000","last_undegraded":"2024-09-11T22:20:24.887933+0000","last_fullsized":"2024-09-11T22:20:24.887933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951404+0000","last_change":"2024-09-11T22:20:19.861003+0000","last_active":"2024-09-11T22:20:26.951404+0000","last_peered":"2024-09-11T22:20:26.951404+0000","last_clean":"2024-09-11T22:20:26.951404+0000","last_became_active":"2024-09-11T22:20:19.860690+0000","last_became_peered":"2024-09-11T22:20:19.860690+0000","last_unstale":"2024-09-11T22:20:26.951404+0000","last_undegraded":"2024-09-11T22:20:26.951404+0000","last_fullsized":"2024-09-11T22:20:26.951404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889798+0000","last_change":"2024-09-11T22:20:19.856756+0000","last_active":"2024-09-11T22:20:24.889798+0000","last_peered":"2024-09-11T22:20:24.889798+0000","last_clean":"2024-09-11T22:20:24.889798+0000","last_became_active":"2024-09-11T22:20:19.856460+0000","last_became_peered":"2024-09-11T22:20:19.856460+0000","last_unstale":"2024-09-11T22:20:24.889798+0000","last_undegraded":"2024-09-11T22:20:24.889798+0000","last_fullsized":"2024-09-11T22:20:24.889798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048092+0000","last_change":"2024-09-11T22:20:19.855629+0000","last_active":"2024-09-11T22:20:27.048092+0000","last_peered":"2024-09-11T22:20:27.048092+0000","last_clean":"2024-09-11T22:20:27.048092+0000","last_became_active":"2024-09-11T22:20:19.855363+0000","last_became_peered":"2024-09-11T22:20:19.855363+0000","last_unstale":"2024-09-11T22:20:27.048092+0000","last_undegraded":"2024-09-11T22:20:27.048092+0000","last_fullsized":"2024-09-11T22:20:27.048092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887872+0000","last_change":"2024-09-11T22:20:19.863122+0000","last_active":"2024-09-11T22:20:24.887872+0000","last_peered":"2024-09-11T22:20:24.887872+0000","last_clean":"2024-09-11T22:20:24.887872+0000","last_became_active":"2024-09-11T22:20:19.862828+0000","last_became_peered":"2024-09-11T22:20:19.862828+0000","last_unstale":"2024-09-11T22:20:24.887872+0000","last_undegraded":"2024-09-11T22:20:24.887872+0000","last_fullsized":"2024-09-11T22:20:24.887872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:10.868762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997865+0000","last_change":"2024-09-11T22:20:19.846453+0000","last_active":"2024-09-11T22:20:24.997865+0000","last_peered":"2024-09-11T22:20:24.997865+0000","last_clean":"2024-09-11T22:20:24.997865+0000","last_became_active":"2024-09-11T22:20:19.846186+0000","last_became_peered":"2024-09-11T22:20:19.846186+0000","last_unstale":"2024-09-11T22:20:24.997865+0000","last_undegraded":"2024-09-11T22:20:24.997865+0000","last_fullsized":"2024-09-11T22:20:24.997865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:24.032365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888935+0000","last_change":"2024-09-11T22:20:19.860632+0000","last_active":"2024-09-11T22:20:24.888935+0000","last_peered":"2024-09-11T22:20:24.888935+0000","last_clean":"2024-09-11T22:20:24.888935+0000","last_became_active":"2024-09-11T22:20:19.860005+0000","last_became_peered":"2024-09-11T22:20:19.860005+0000","last_unstale":"2024-09-11T22:20:24.888935+0000","last_undegraded":"2024-09-11T22:20:24.888935+0000","last_fullsized":"2024-09-11T22:20:24.888935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888034+0000","last_change":"2024-09-11T22:20:19.859195+0000","last_active":"2024-09-11T22:20:24.888034+0000","last_peered":"2024-09-11T22:20:24.888034+0000","last_clean":"2024-09-11T22:20:24.888034+0000","last_became_active":"2024-09-11T22:20:19.858832+0000","last_became_peered":"2024-09-11T22:20:19.858832+0000","last_unstale":"2024-09-11T22:20:24.888034+0000","last_undegraded":"2024-09-11T22:20:24.888034+0000","last_fullsized":"2024-09-11T22:20:24.888034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:56.259074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888950+0000","last_change":"2024-09-11T22:20:19.858969+0000","last_active":"2024-09-11T22:20:24.888950+0000","last_peered":"2024-09-11T22:20:24.888950+0000","last_clean":"2024-09-11T22:20:24.888950+0000","last_became_active":"2024-09-11T22:20:19.857847+0000","last_became_peered":"2024-09-11T22:20:19.857847+0000","last_unstale":"2024-09-11T22:20:24.888950+0000","last_undegraded":"2024-09-11T22:20:24.888950+0000","last_fullsized":"2024-09-11T22:20:24.888950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887453+0000","last_change":"2024-09-11T22:20:19.863294+0000","last_active":"2024-09-11T22:20:24.887453+0000","last_peered":"2024-09-11T22:20:24.887453+0000","last_clean":"2024-09-11T22:20:24.887453+0000","last_became_active":"2024-09-11T22:20:19.863007+0000","last_became_peered":"2024-09-11T22:20:19.863007+0000","last_unstale":"2024-09-11T22:20:24.887453+0000","last_undegraded":"2024-09-11T22:20:24.887453+0000","last_fullsized":"2024-09-11T22:20:24.887453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:06.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889706+0000","last_change":"2024-09-11T22:20:19.858414+0000","last_active":"2024-09-11T22:20:24.889706+0000","last_peered":"2024-09-11T22:20:24.889706+0000","last_clean":"2024-09-11T22:20:24.889706+0000","last_became_active":"2024-09-11T22:20:19.857790+0000","last_became_peered":"2024-09-11T22:20:19.857790+0000","last_unstale":"2024-09-11T22:20:24.889706+0000","last_undegraded":"2024-09-11T22:20:24.889706+0000","last_fullsized":"2024-09-11T22:20:24.889706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047879+0000","last_change":"2024-09-11T22:20:19.855053+0000","last_active":"2024-09-11T22:20:27.047879+0000","last_peered":"2024-09-11T22:20:27.047879+0000","last_clean":"2024-09-11T22:20:27.047879+0000","last_became_active":"2024-09-11T22:20:19.854774+0000","last_became_peered":"2024-09-11T22:20:19.854774+0000","last_unstale":"2024-09-11T22:20:27.047879+0000","last_undegraded":"2024-09-11T22:20:27.047879+0000","last_fullsized":"2024-09-11T22:20:27.047879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:32.025931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888845+0000","last_change":"2024-09-11T22:20:19.864700+0000","last_active":"2024-09-11T22:20:24.888845+0000","last_peered":"2024-09-11T22:20:24.888845+0000","last_clean":"2024-09-11T22:20:24.888845+0000","last_became_active":"2024-09-11T22:20:19.862296+0000","last_became_peered":"2024-09-11T22:20:19.862296+0000","last_unstale":"2024-09-11T22:20:24.888845+0000","last_undegraded":"2024-09-11T22:20:24.888845+0000","last_fullsized":"2024-09-11T22:20:24.888845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048773+0000","last_change":"2024-09-11T22:20:19.855253+0000","last_active":"2024-09-11T22:20:27.048773+0000","last_peered":"2024-09-11T22:20:27.048773+0000","last_clean":"2024-09-11T22:20:27.048773+0000","last_became_active":"2024-09-11T22:20:19.854970+0000","last_became_peered":"2024-09-11T22:20:19.854970+0000","last_unstale":"2024-09-11T22:20:27.048773+0000","last_undegraded":"2024-09-11T22:20:27.048773+0000","last_fullsized":"2024-09-11T22:20:27.048773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951690+0000","last_change":"2024-09-11T22:20:19.850202+0000","last_active":"2024-09-11T22:20:26.951690+0000","last_peered":"2024-09-11T22:20:26.951690+0000","last_clean":"2024-09-11T22:20:26.951690+0000","last_became_active":"2024-09-11T22:20:19.849815+0000","last_became_peered":"2024-09-11T22:20:19.849815+0000","last_unstale":"2024-09-11T22:20:26.951690+0000","last_undegraded":"2024-09-11T22:20:26.951690+0000","last_fullsized":"2024-09-11T22:20:26.951690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:56.480679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889814+0000","last_change":"2024-09-11T22:20:19.866864+0000","last_active":"2024-09-11T22:20:24.889814+0000","last_peered":"2024-09-11T22:20:24.889814+0000","last_clean":"2024-09-11T22:20:24.889814+0000","last_became_active":"2024-09-11T22:20:19.866484+0000","last_became_peered":"2024-09-11T22:20:19.866484+0000","last_unstale":"2024-09-11T22:20:24.889814+0000","last_undegraded":"2024-09-11T22:20:24.889814+0000","last_fullsized":"2024-09-11T22:20:24.889814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888850+0000","last_change":"2024-09-11T22:20:19.859573+0000","last_active":"2024-09-11T22:20:24.888850+0000","last_peered":"2024-09-11T22:20:24.888850+0000","last_clean":"2024-09-11T22:20:24.888850+0000","last_became_active":"2024-09-11T22:20:19.859266+0000","last_became_peered":"2024-09-11T22:20:19.859266+0000","last_unstale":"2024-09-11T22:20:24.888850+0000","last_undegraded":"2024-09-11T22:20:24.888850+0000","last_fullsized":"2024-09-11T22:20:24.888850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997750+0000","last_change":"2024-09-11T22:20:19.860050+0000","last_active":"2024-09-11T22:20:24.997750+0000","last_peered":"2024-09-11T22:20:24.997750+0000","last_clean":"2024-09-11T22:20:24.997750+0000","last_became_active":"2024-09-11T22:20:19.859755+0000","last_became_peered":"2024-09-11T22:20:19.859755+0000","last_unstale":"2024-09-11T22:20:24.997750+0000","last_undegraded":"2024-09-11T22:20:24.997750+0000","last_fullsized":"2024-09-11T22:20:24.997750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:42.487669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047797+0000","last_change":"2024-09-11T22:20:19.853902+0000","last_active":"2024-09-11T22:20:27.047797+0000","last_peered":"2024-09-11T22:20:27.047797+0000","last_clean":"2024-09-11T22:20:27.047797+0000","last_became_active":"2024-09-11T22:20:19.853563+0000","last_became_peered":"2024-09-11T22:20:19.853563+0000","last_unstale":"2024-09-11T22:20:27.047797+0000","last_undegraded":"2024-09-11T22:20:27.047797+0000","last_fullsized":"2024-09-11T22:20:27.047797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887571+0000","last_change":"2024-09-11T22:20:19.849490+0000","last_active":"2024-09-11T22:20:24.887571+0000","last_peered":"2024-09-11T22:20:24.887571+0000","last_clean":"2024-09-11T22:20:24.887571+0000","last_became_active":"2024-09-11T22:20:19.848965+0000","last_became_peered":"2024-09-11T22:20:19.848965+0000","last_unstale":"2024-09-11T22:20:24.887571+0000","last_undegraded":"2024-09-11T22:20:24.887571+0000","last_fullsized":"2024-09-11T22:20:24.887571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:10.387663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048041+0000","last_change":"2024-09-11T22:20:19.860457+0000","last_active":"2024-09-11T22:20:27.048041+0000","last_peered":"2024-09-11T22:20:27.048041+0000","last_clean":"2024-09-11T22:20:27.048041+0000","last_became_active":"2024-09-11T22:20:19.858887+0000","last_became_peered":"2024-09-11T22:20:19.858887+0000","last_unstale":"2024-09-11T22:20:27.048041+0000","last_undegraded":"2024-09-11T22:20:27.048041+0000","last_fullsized":"2024-09-11T22:20:27.048041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:34.620956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888481+0000","last_change":"2024-09-11T22:20:19.862347+0000","last_active":"2024-09-11T22:20:24.888481+0000","last_peered":"2024-09-11T22:20:24.888481+0000","last_clean":"2024-09-11T22:20:24.888481+0000","last_became_active":"2024-09-11T22:20:19.861965+0000","last_became_peered":"2024-09-11T22:20:19.861965+0000","last_unstale":"2024-09-11T22:20:24.888481+0000","last_undegraded":"2024-09-11T22:20:24.888481+0000","last_fullsized":"2024-09-11T22:20:24.888481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888938+0000","last_change":"2024-09-11T22:20:19.862065+0000","last_active":"2024-09-11T22:20:24.888938+0000","last_peered":"2024-09-11T22:20:24.888938+0000","last_clean":"2024-09-11T22:20:24.888938+0000","last_became_active":"2024-09-11T22:20:19.861765+0000","last_became_peered":"2024-09-11T22:20:19.861765+0000","last_unstale":"2024-09-11T22:20:24.888938+0000","last_undegraded":"2024-09-11T22:20:24.888938+0000","last_fullsized":"2024-09-11T22:20:24.888938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.049117+0000","last_change":"2024-09-11T22:20:19.865064+0000","last_active":"2024-09-11T22:20:27.049117+0000","last_peered":"2024-09-11T22:20:27.049117+0000","last_clean":"2024-09-11T22:20:27.049117+0000","last_became_active":"2024-09-11T22:20:19.864697+0000","last_became_peered":"2024-09-11T22:20:19.864697+0000","last_unstale":"2024-09-11T22:20:27.049117+0000","last_undegraded":"2024-09-11T22:20:27.049117+0000","last_fullsized":"2024-09-11T22:20:27.049117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887201+0000","last_change":"2024-09-11T22:20:19.861293+0000","last_active":"2024-09-11T22:20:24.887201+0000","last_peered":"2024-09-11T22:20:24.887201+0000","last_clean":"2024-09-11T22:20:24.887201+0000","last_became_active":"2024-09-11T22:20:19.861013+0000","last_became_peered":"2024-09-11T22:20:19.861013+0000","last_unstale":"2024-09-11T22:20:24.887201+0000","last_undegraded":"2024-09-11T22:20:24.887201+0000","last_fullsized":"2024-09-11T22:20:24.887201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:13.178404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048303+0000","last_change":"2024-09-11T22:20:19.858131+0000","last_active":"2024-09-11T22:20:27.048303+0000","last_peered":"2024-09-11T22:20:27.048303+0000","last_clean":"2024-09-11T22:20:27.048303+0000","last_became_active":"2024-09-11T22:20:19.857842+0000","last_became_peered":"2024-09-11T22:20:19.857842+0000","last_unstale":"2024-09-11T22:20:27.048303+0000","last_undegraded":"2024-09-11T22:20:27.048303+0000","last_fullsized":"2024-09-11T22:20:27.048303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889602+0000","last_change":"2024-09-11T22:20:19.859667+0000","last_active":"2024-09-11T22:20:24.889602+0000","last_peered":"2024-09-11T22:20:24.889602+0000","last_clean":"2024-09-11T22:20:24.889602+0000","last_became_active":"2024-09-11T22:20:19.859306+0000","last_became_peered":"2024-09-11T22:20:19.859306+0000","last_unstale":"2024-09-11T22:20:24.889602+0000","last_undegraded":"2024-09-11T22:20:24.889602+0000","last_fullsized":"2024-09-11T22:20:24.889602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048551+0000","last_change":"2024-09-11T22:20:19.848821+0000","last_active":"2024-09-11T22:20:27.048551+0000","last_peered":"2024-09-11T22:20:27.048551+0000","last_clean":"2024-09-11T22:20:27.048551+0000","last_became_active":"2024-09-11T22:20:19.848531+0000","last_became_peered":"2024-09-11T22:20:19.848531+0000","last_unstale":"2024-09-11T22:20:27.048551+0000","last_undegraded":"2024-09-11T22:20:27.048551+0000","last_fullsized":"2024-09-11T22:20:27.048551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890212+0000","last_change":"2024-09-11T22:20:19.866300+0000","last_active":"2024-09-11T22:20:24.890212+0000","last_peered":"2024-09-11T22:20:24.890212+0000","last_clean":"2024-09-11T22:20:24.890212+0000","last_became_active":"2024-09-11T22:20:19.865939+0000","last_became_peered":"2024-09-11T22:20:19.865939+0000","last_unstale":"2024-09-11T22:20:24.890212+0000","last_undegraded":"2024-09-11T22:20:24.890212+0000","last_fullsized":"2024-09-11T22:20:24.890212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047932+0000","last_change":"2024-09-11T22:20:19.858144+0000","last_active":"2024-09-11T22:20:27.047932+0000","last_peered":"2024-09-11T22:20:27.047932+0000","last_clean":"2024-09-11T22:20:27.047932+0000","last_became_active":"2024-09-11T22:20:19.857840+0000","last_became_peered":"2024-09-11T22:20:19.857840+0000","last_unstale":"2024-09-11T22:20:27.047932+0000","last_undegraded":"2024-09-11T22:20:27.047932+0000","last_fullsized":"2024-09-11T22:20:27.047932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:23.801072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998195+0000","last_change":"2024-09-11T22:20:19.857378+0000","last_active":"2024-09-11T22:20:24.998195+0000","last_peered":"2024-09-11T22:20:24.998195+0000","last_clean":"2024-09-11T22:20:24.998195+0000","last_became_active":"2024-09-11T22:20:19.857089+0000","last_became_peered":"2024-09-11T22:20:19.857089+0000","last_unstale":"2024-09-11T22:20:24.998195+0000","last_undegraded":"2024-09-11T22:20:24.998195+0000","last_fullsized":"2024-09-11T22:20:24.998195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:29.835695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.049018+0000","last_change":"2024-09-11T22:20:19.852827+0000","last_active":"2024-09-11T22:20:27.049018+0000","last_peered":"2024-09-11T22:20:27.049018+0000","last_clean":"2024-09-11T22:20:27.049018+0000","last_became_active":"2024-09-11T22:20:19.852251+0000","last_became_peered":"2024-09-11T22:20:19.852251+0000","last_unstale":"2024-09-11T22:20:27.049018+0000","last_undegraded":"2024-09-11T22:20:27.049018+0000","last_fullsized":"2024-09-11T22:20:27.049018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:36.888544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":698268,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":107444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":111162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":107318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":348160,"data_stored":698324,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":107478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:20:45.199 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T22:20:45.199 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T22:20:45.199 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-11T22:20:45.199 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-11T22:20:45.200 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-11T22:20:45.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.333+0000 7f5f62d66640 1 Processor -- start 2024-09-11T22:20:45.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.333+0000 7f5f62d66640 1 -- start start 2024-09-11T22:20:45.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.334+0000 7f5f62d66640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5f5c15def0 0x7f5f5c15b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.334+0000 7f5f62d66640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f5c0cb9b0 0x7f5f5c0ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.334+0000 7f5f62d66640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f5c15e3a0 con 0x7f5f5c154c50 2024-09-11T22:20:45.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.334+0000 7f5f62d66640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f5f5c15b940 con 0x7f5f5c15def0 2024-09-11T22:20:45.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.334+0000 7f5f62d66640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5f5c15e680 con 0x7f5f5c0cb9b0 2024-09-11T22:20:45.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.334+0000 7f5f5bfff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5f5c15def0 0x7f5f5c15b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.334+0000 7f5f5bfff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5f5c15def0 0x7f5f5c15b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47194/0 (socket says 172.21.15.100:47194) 2024-09-11T22:20:45.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.334+0000 7f5f5bfff640 1 -- 172.21.15.100:0/1454970895 learned_addr learned my addr 172.21.15.100:0/1454970895 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:45.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.334+0000 7f5f60b02640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5f5c154c50 0x7f5f5c071450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33226/0 (socket says 172.21.15.100:33226) 2024-09-11T22:20:45.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.334+0000 7f5f61303640 1 --2- 172.21.15.100:0/1454970895 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f5c0cb9b0 0x7f5f5c0ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.335+0000 7f5f5bfff640 1 -- 172.21.15.100:0/1454970895 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f5c0cb9b0 msgr2=0x7f5f5c0ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:45.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.335+0000 7f5f5bfff640 1 --2- 172.21.15.100:0/1454970895 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f5c0cb9b0 0x7f5f5c0ca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.335+0000 7f5f5bfff640 1 -- 172.21.15.100:0/1454970895 >> v1:172.21.15.100:6789/0 conn(0x7f5f5c154c50 legacy=0x7f5f5c071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.335+0000 7f5f5bfff640 1 -- 172.21.15.100:0/1454970895 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f5c15e960 con 0x7f5f5c15def0 2024-09-11T22:20:45.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.335+0000 7f5f5bfff640 1 --2- 172.21.15.100:0/1454970895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f5c15def0 0x7f5f5c15b400 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5f50009e50 tx=0x7f5f5002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f23e1e9bd045d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:45.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.335+0000 7f5f5b7fe640 1 -- 172.21.15.100:0/1454970895 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f50036070 con 0x7f5f5c15def0 2024-09-11T22:20:45.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.335+0000 7f5f5b7fe640 1 -- 172.21.15.100:0/1454970895 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f50031600 con 0x7f5f5c15def0 2024-09-11T22:20:45.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.335+0000 7f5f5b7fe640 1 -- 172.21.15.100:0/1454970895 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f500319d0 con 0x7f5f5c15def0 2024-09-11T22:20:45.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.336+0000 7f5f62d66640 1 -- 172.21.15.100:0/1454970895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f5c15def0 msgr2=0x7f5f5c15b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.336+0000 7f5f62d66640 1 --2- 172.21.15.100:0/1454970895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f5c15def0 0x7f5f5c15b400 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5f50009e50 tx=0x7f5f5002a7a0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.336+0000 7f5f62d66640 1 -- 172.21.15.100:0/1454970895 shutdown_connections 2024-09-11T22:20:45.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.336+0000 7f5f62d66640 1 --2- 172.21.15.100:0/1454970895 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f5c0cb9b0 0x7f5f5c0ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.336+0000 7f5f62d66640 1 --2- 172.21.15.100:0/1454970895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f5c15def0 0x7f5f5c15b400 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.336+0000 7f5f62d66640 1 -- 172.21.15.100:0/1454970895 >> 172.21.15.100:0/1454970895 conn(0x7f5f5c06fb50 msgr2=0x7f5f5c06ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:45.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.336+0000 7f5f62d66640 1 -- 172.21.15.100:0/1454970895 shutdown_connections 2024-09-11T22:20:45.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.336+0000 7f5f62d66640 1 -- 172.21.15.100:0/1454970895 wait complete. 2024-09-11T22:20:45.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.337+0000 7f5f62d66640 1 Processor -- start 2024-09-11T22:20:45.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.337+0000 7f5f62d66640 1 -- start start 2024-09-11T22:20:45.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.338+0000 7f5f62d66640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f5c0cb9b0 0x7f5f5c0ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.338+0000 7f5f62d66640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f5c154c50 0x7f5f5c1f3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.338+0000 7f5f62d66640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f5c15def0 0x7f5f5c1f41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.338+0000 7f5f62d66640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c155030 con 0x7f5f5c15def0 2024-09-11T22:20:45.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.338+0000 7f5f62d66640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c0c9c90 con 0x7f5f5c154c50 2024-09-11T22:20:45.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.338+0000 7f5f62d66640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5f5c071b60 con 0x7f5f5c0cb9b0 2024-09-11T22:20:45.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.338+0000 7f5f61303640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f5c15def0 0x7f5f5c1f41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.338+0000 7f5f61303640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f5c15def0 0x7f5f5c1f41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47204/0 (socket says 172.21.15.100:47204) 2024-09-11T22:20:45.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.338+0000 7f5f61303640 1 -- 172.21.15.100:0/2984272601 learned_addr learned my addr 172.21.15.100:0/2984272601 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:45.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.338+0000 7f5f60b02640 1 --2- 172.21.15.100:0/2984272601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f5c0cb9b0 0x7f5f5c0ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.338+0000 7f5f5bfff640 1 --2- 172.21.15.100:0/2984272601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f5c154c50 0x7f5f5c1f3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.338+0000 7f5f61303640 1 -- 172.21.15.100:0/2984272601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f5c0cb9b0 msgr2=0x7f5f5c0ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.338+0000 7f5f61303640 1 --2- 172.21.15.100:0/2984272601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f5c0cb9b0 0x7f5f5c0ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.338+0000 7f5f61303640 1 -- 172.21.15.100:0/2984272601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f5c154c50 msgr2=0x7f5f5c1f3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.338+0000 7f5f61303640 1 --2- 172.21.15.100:0/2984272601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f5c154c50 0x7f5f5c1f3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.338+0000 7f5f61303640 1 -- 172.21.15.100:0/2984272601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f5c0cc6c0 con 0x7f5f5c15def0 2024-09-11T22:20:45.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.339+0000 7f5f61303640 1 --2- 172.21.15.100:0/2984272601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f5c15def0 0x7f5f5c1f41f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400d5d0 tx=0x7f5f5400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:45.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.339+0000 7f5f597fa640 1 -- 172.21.15.100:0/2984272601 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f540125f0 con 0x7f5f5c15def0 2024-09-11T22:20:45.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.339+0000 7f5f597fa640 1 -- 172.21.15.100:0/2984272601 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f54019070 con 0x7f5f5c15def0 2024-09-11T22:20:45.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.339+0000 7f5f62d66640 1 -- 172.21.15.100:0/2984272601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f5c1f1940 con 0x7f5f5c15def0 2024-09-11T22:20:45.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.339+0000 7f5f597fa640 1 -- 172.21.15.100:0/2984272601 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f540129f0 con 0x7f5f5c15def0 2024-09-11T22:20:45.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.339+0000 7f5f62d66640 1 -- 172.21.15.100:0/2984272601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f5c0cc930 con 0x7f5f5c15def0 2024-09-11T22:20:45.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.340+0000 7f5f62d66640 1 -- 172.21.15.100:0/2984272601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f5c0ccb70 con 0x7f5f5c15def0 2024-09-11T22:20:45.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.340+0000 7f5f597fa640 1 -- 172.21.15.100:0/2984272601 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5f54012b90 con 0x7f5f5c15def0 2024-09-11T22:20:45.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.340+0000 7f5f597fa640 1 --2- 172.21.15.100:0/2984272601 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5f4806be30 0x7f5f4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.341+0000 7f5f597fa640 1 -- 172.21.15.100:0/2984272601 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5f5408b4f0 con 0x7f5f5c15def0 2024-09-11T22:20:45.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.341+0000 7f5f60b02640 1 --2- 172.21.15.100:0/2984272601 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5f4806be30 0x7f5f4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.341+0000 7f5f60b02640 1 --2- 172.21.15.100:0/2984272601 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5f4806be30 0x7f5f4806e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c007fd0 tx=0x7f5f4c007e80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:45.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.345+0000 7f5f597fa640 1 -- 172.21.15.100:0/2984272601 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5f5c0ccb70 con 0x7f5f5c15def0 2024-09-11T22:20:45.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.556+0000 7f5f62d66640 1 -- 172.21.15.100:0/2984272601 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f5f5c15b400 con 0x7f5f5c15def0 2024-09-11T22:20:45.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.559+0000 7f5f597fa640 1 -- 172.21.15.100:0/2984272601 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172946 (secure 0 0 0) 0x7f5f54059490 con 0x7f5f5c15def0 2024-09-11T22:20:45.561 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:45.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.561+0000 7f5f62d66640 1 -- 172.21.15.100:0/2984272601 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5f4806be30 msgr2=0x7f5f4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.561+0000 7f5f62d66640 1 --2- 172.21.15.100:0/2984272601 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5f4806be30 0x7f5f4806e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c007fd0 tx=0x7f5f4c007e80 comp rx=0 tx=0).stop 2024-09-11T22:20:45.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.561+0000 7f5f62d66640 1 -- 172.21.15.100:0/2984272601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f5c15def0 msgr2=0x7f5f5c1f41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.561+0000 7f5f62d66640 1 --2- 172.21.15.100:0/2984272601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f5c15def0 0x7f5f5c1f41f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400d5d0 tx=0x7f5f5400da90 comp rx=0 tx=0).stop 2024-09-11T22:20:45.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.562+0000 7f5f62d66640 1 -- 172.21.15.100:0/2984272601 shutdown_connections 2024-09-11T22:20:45.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.562+0000 7f5f62d66640 1 --2- 172.21.15.100:0/2984272601 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5f4806be30 0x7f5f4806e2f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.562+0000 7f5f62d66640 1 --2- 172.21.15.100:0/2984272601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f5c15def0 0x7f5f5c1f41f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.562+0000 7f5f62d66640 1 --2- 172.21.15.100:0/2984272601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f5c154c50 0x7f5f5c1f3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.562+0000 7f5f62d66640 1 --2- 172.21.15.100:0/2984272601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f5c0cb9b0 0x7f5f5c0ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.562+0000 7f5f62d66640 1 -- 172.21.15.100:0/2984272601 >> 172.21.15.100:0/2984272601 conn(0x7f5f5c06fb50 msgr2=0x7f5f5c0ca870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:45.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.562+0000 7f5f62d66640 1 -- 172.21.15.100:0/2984272601 shutdown_connections 2024-09-11T22:20:45.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.562+0000 7f5f62d66640 1 -- 172.21.15.100:0/2984272601 wait complete. 2024-09-11T22:20:45.573 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1748304473},{"type":"v1","addr":"172.21.15.100:6833","nonce":1748304473}]},"active_addr":"172.21.15.100:6833/1748304473","active_change":"2024-09-11T22:20:00.296111+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4114,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":1039051300}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":1710282175}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":4168323316}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":1178929085}]}]} 2024-09-11T22:20:45.577 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-11T22:20:45.577 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T22:20:45.577 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:20:45.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.674+0000 7f7d853d6640 1 Processor -- start 2024-09-11T22:20:45.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.674+0000 7f7d853d6640 1 -- start start 2024-09-11T22:20:45.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.675+0000 7f7d853d6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7d800cc770 0x7f7d800cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.675+0000 7f7d853d6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d800cb920 0x7f7d8015aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.675+0000 7f7d853d6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d800c5d80 con 0x7f7d80154d20 2024-09-11T22:20:45.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.675+0000 7f7d853d6640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f7d8015ebe0 con 0x7f7d800cc770 2024-09-11T22:20:45.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.675+0000 7f7d853d6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7d80155100 con 0x7f7d800cb920 2024-09-11T22:20:45.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.675+0000 7f7d7e7fc640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7d800cc770 0x7f7d800cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.675+0000 7f7d7e7fc640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7d800cc770 0x7f7d800cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47218/0 (socket says 172.21.15.100:47218) 2024-09-11T22:20:45.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.675+0000 7f7d7e7fc640 1 -- 172.21.15.100:0/1044898088 learned_addr learned my addr 172.21.15.100:0/1044898088 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:45.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.675+0000 7f7d7f7fe640 1 --2- 172.21.15.100:0/1044898088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d800cb920 0x7f7d8015aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.675+0000 7f7d7e7fc640 1 -- 172.21.15.100:0/1044898088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d800cb920 msgr2=0x7f7d8015aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:45.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.675+0000 7f7d7e7fc640 1 --2- 172.21.15.100:0/1044898088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d800cb920 0x7f7d8015aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.675+0000 7f7d7e7fc640 1 -- 172.21.15.100:0/1044898088 >> v1:172.21.15.167:6789/0 conn(0x7f7d80154d20 legacy=0x7f7d80072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.675+0000 7f7d7e7fc640 1 -- 172.21.15.100:0/1044898088 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8015dfd0 con 0x7f7d800cc770 2024-09-11T22:20:45.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.675+0000 7f7d7dffb640 1 -- 172.21.15.100:0/1044898088 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1272636742 0 0) 0x7f7d800c5d80 con 0x7f7d80154d20 2024-09-11T22:20:45.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.676+0000 7f7d7e7fc640 1 --2- 172.21.15.100:0/1044898088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d800cc770 0x7f7d800cb300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009870 tx=0x7f7d6802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d04f6c26dbf3b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:45.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.676+0000 7f7d7dffb640 1 -- 172.21.15.100:0/1044898088 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d68037070 con 0x7f7d800cc770 2024-09-11T22:20:45.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.676+0000 7f7d7dffb640 1 -- 172.21.15.100:0/1044898088 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d68032440 con 0x7f7d800cc770 2024-09-11T22:20:45.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.676+0000 7f7d7dffb640 1 -- 172.21.15.100:0/1044898088 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d68032810 con 0x7f7d800cc770 2024-09-11T22:20:45.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.677+0000 7f7d853d6640 1 -- 172.21.15.100:0/1044898088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d800cc770 msgr2=0x7f7d800cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.677+0000 7f7d853d6640 1 --2- 172.21.15.100:0/1044898088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d800cc770 0x7f7d800cb300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009870 tx=0x7f7d6802a1c0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.677+0000 7f7d853d6640 1 -- 172.21.15.100:0/1044898088 shutdown_connections 2024-09-11T22:20:45.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.677+0000 7f7d853d6640 1 --2- 172.21.15.100:0/1044898088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d800cb920 0x7f7d8015aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.677+0000 7f7d853d6640 1 --2- 172.21.15.100:0/1044898088 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d800cc770 0x7f7d800cb300 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.677+0000 7f7d853d6640 1 -- 172.21.15.100:0/1044898088 >> 172.21.15.100:0/1044898088 conn(0x7f7d800d0380 msgr2=0x7f7d800d0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:45.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.677+0000 7f7d853d6640 1 -- 172.21.15.100:0/1044898088 shutdown_connections 2024-09-11T22:20:45.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.677+0000 7f7d853d6640 1 -- 172.21.15.100:0/1044898088 wait complete. 2024-09-11T22:20:45.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.678+0000 7f7d853d6640 1 Processor -- start 2024-09-11T22:20:45.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.678+0000 7f7d853d6640 1 -- start start 2024-09-11T22:20:45.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.679+0000 7f7d853d6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d800cb920 0x7f7d80144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.679+0000 7f7d853d6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d800cc770 0x7f7d801513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.679+0000 7f7d853d6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d80154d20 0x7f7d80151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.679+0000 7f7d853d6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8015e870 con 0x7f7d80154d20 2024-09-11T22:20:45.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.679+0000 7f7d853d6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8015e590 con 0x7f7d800cc770 2024-09-11T22:20:45.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.679+0000 7f7d853d6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7d80072940 con 0x7f7d800cb920 2024-09-11T22:20:45.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.679+0000 7f7d7f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d80154d20 0x7f7d80151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.679+0000 7f7d7f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d80154d20 0x7f7d80151930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47232/0 (socket says 172.21.15.100:47232) 2024-09-11T22:20:45.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.679+0000 7f7d7f7fe640 1 -- 172.21.15.100:0/3626259928 learned_addr learned my addr 172.21.15.100:0/3626259928 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:45.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.679+0000 7f7d7effd640 1 --2- 172.21.15.100:0/3626259928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d800cb920 0x7f7d80144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.679+0000 7f7d7e7fc640 1 --2- 172.21.15.100:0/3626259928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d800cc770 0x7f7d801513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.679+0000 7f7d7f7fe640 1 -- 172.21.15.100:0/3626259928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d800cb920 msgr2=0x7f7d80144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.679+0000 7f7d7f7fe640 1 --2- 172.21.15.100:0/3626259928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d800cb920 0x7f7d80144080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.679+0000 7f7d7f7fe640 1 -- 172.21.15.100:0/3626259928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d800cc770 msgr2=0x7f7d801513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.679+0000 7f7d7f7fe640 1 --2- 172.21.15.100:0/3626259928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d800cc770 0x7f7d801513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.679+0000 7f7d7f7fe640 1 -- 172.21.15.100:0/3626259928 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d801f02e0 con 0x7f7d80154d20 2024-09-11T22:20:45.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.679+0000 7f7d7f7fe640 1 --2- 172.21.15.100:0/3626259928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d80154d20 0x7f7d80151930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7d7800e960 tx=0x7f7d7800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:45.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.680+0000 7f7d777fe640 1 -- 172.21.15.100:0/3626259928 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d78017070 con 0x7f7d80154d20 2024-09-11T22:20:45.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.680+0000 7f7d777fe640 1 -- 172.21.15.100:0/3626259928 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d7800c980 con 0x7f7d80154d20 2024-09-11T22:20:45.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.680+0000 7f7d853d6640 1 -- 172.21.15.100:0/3626259928 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d801f05c0 con 0x7f7d80154d20 2024-09-11T22:20:45.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.680+0000 7f7d777fe640 1 -- 172.21.15.100:0/3626259928 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7800cd70 con 0x7f7d80154d20 2024-09-11T22:20:45.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.680+0000 7f7d853d6640 1 -- 172.21.15.100:0/3626259928 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d801f0b80 con 0x7f7d80154d20 2024-09-11T22:20:45.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.681+0000 7f7d853d6640 1 -- 172.21.15.100:0/3626259928 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d800cb300 con 0x7f7d80154d20 2024-09-11T22:20:45.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.681+0000 7f7d777fe640 1 -- 172.21.15.100:0/3626259928 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d7801a070 con 0x7f7d80154d20 2024-09-11T22:20:45.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.682+0000 7f7d777fe640 1 --2- 172.21.15.100:0/3626259928 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7d6006be60 0x7f7d6006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.682+0000 7f7d777fe640 1 -- 172.21.15.100:0/3626259928 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7d7808b070 con 0x7f7d80154d20 2024-09-11T22:20:45.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.682+0000 7f7d7effd640 1 --2- 172.21.15.100:0/3626259928 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7d6006be60 0x7f7d6006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.682+0000 7f7d7effd640 1 --2- 172.21.15.100:0/3626259928 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7d6006be60 0x7f7d6006e320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7d700012e0 tx=0x7f7d70009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:45.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.686+0000 7f7d777fe640 1 -- 172.21.15.100:0/3626259928 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7d78059090 con 0x7f7d80154d20 2024-09-11T22:20:45.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.852+0000 7f7d853d6640 1 -- 172.21.15.100:0/3626259928 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d8014eda0 con 0x7f7d80154d20 2024-09-11T22:20:45.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.853+0000 7f7d777fe640 1 -- 172.21.15.100:0/3626259928 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18646 (secure 0 0 0) 0x7f7d7805d390 con 0x7f7d80154d20 2024-09-11T22:20:45.853 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:45.854 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":26,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","created":"2024-09-11T22:19:56.198855+0000","modified":"2024-09-11T22:20:24.213024+0000","last_up_change":"2024-09-11T22:20:07.328863+0000","last_in_change":"2024-09-11T22:19:58.294227+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:20:08.333538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:20:16.995279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:20:18.147950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:20:21.873694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5de0ba54-34c5-4343-b19a-1f675efc49c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6809","nonce":2008454847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6811","nonce":2008454847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6815","nonce":2008454847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6813","nonce":2008454847}]},"public_addr":"172.21.15.100:6809/2008454847","cluster_addr":"172.21.15.100:6811/2008454847","heartbeat_back_addr":"172.21.15.100:6815/2008454847","heartbeat_front_addr":"172.21.15.100:6813/2008454847","state":["exists","up"]},{"osd":1,"uuid":"5a1f6456-6604-4b41-b9b9-52ae8d6616ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6801","nonce":1802107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6803","nonce":1802107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6807","nonce":1802107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6805","nonce":1802107101}]},"public_addr":"172.21.15.100:6801/1802107101","cluster_addr":"172.21.15.100:6803/1802107101","heartbeat_back_addr":"172.21.15.100:6807/1802107101","heartbeat_front_addr":"172.21.15.100:6805/1802107101","state":["exists","up"]},{"osd":2,"uuid":"a604cb26-7b0f-402d-b6ac-3652884b4b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6817","nonce":644491349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6819","nonce":644491349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6823","nonce":644491349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6821","nonce":644491349}]},"public_addr":"172.21.15.100:6817/644491349","cluster_addr":"172.21.15.100:6819/644491349","heartbeat_back_addr":"172.21.15.100:6823/644491349","heartbeat_front_addr":"172.21.15.100:6821/644491349","state":["exists","up"]},{"osd":3,"uuid":"73dc2cbb-70ff-4d12-ba2f-8778a49892f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6825","nonce":2519160882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6827","nonce":2519160882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6831","nonce":2519160882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6829","nonce":2519160882}]},"public_addr":"172.21.15.100:6825/2519160882","cluster_addr":"172.21.15.100:6827/2519160882","heartbeat_back_addr":"172.21.15.100:6831/2519160882","heartbeat_front_addr":"172.21.15.100:6829/2519160882","state":["exists","up"]},{"osd":4,"uuid":"07960648-04df-4aec-a72c-c29e28b74bcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6817","nonce":736010951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6819","nonce":736010951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6823","nonce":736010951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6821","nonce":736010951}]},"public_addr":"172.21.15.167:6817/736010951","cluster_addr":"172.21.15.167:6819/736010951","heartbeat_back_addr":"172.21.15.167:6823/736010951","heartbeat_front_addr":"172.21.15.167:6821/736010951","state":["exists","up"]},{"osd":5,"uuid":"2b4767e6-cab7-4b45-9150-55432f5576aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6825","nonce":2479173909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6827","nonce":2479173909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6831","nonce":2479173909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6829","nonce":2479173909}]},"public_addr":"172.21.15.167:6825/2479173909","cluster_addr":"172.21.15.167:6827/2479173909","heartbeat_back_addr":"172.21.15.167:6831/2479173909","heartbeat_front_addr":"172.21.15.167:6829/2479173909","state":["exists","up"]},{"osd":6,"uuid":"4ef2c4b5-52f4-4f69-8fca-2334077ed8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6809","nonce":2825112504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6811","nonce":2825112504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6815","nonce":2825112504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6813","nonce":2825112504}]},"public_addr":"172.21.15.167:6809/2825112504","cluster_addr":"172.21.15.167:6811/2825112504","heartbeat_back_addr":"172.21.15.167:6815/2825112504","heartbeat_front_addr":"172.21.15.167:6813/2825112504","state":["exists","up"]},{"osd":7,"uuid":"761673d8-d6fc-4ded-a9f3-d49ab8f7c969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337015843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337015843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337015843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337015843}]},"public_addr":"172.21.15.167:6801/1337015843","cluster_addr":"172.21.15.167:6803/1337015843","heartbeat_back_addr":"172.21.15.167:6807/1337015843","heartbeat_front_addr":"172.21.15.167:6805/1337015843","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.833280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.080311+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.100648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.544261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.670353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.880921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.365441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.366659+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:20:45.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.855+0000 7f7d853d6640 1 -- 172.21.15.100:0/3626259928 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7d6006be60 msgr2=0x7f7d6006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.855+0000 7f7d853d6640 1 --2- 172.21.15.100:0/3626259928 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7d6006be60 0x7f7d6006e320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7d700012e0 tx=0x7f7d70009040 comp rx=0 tx=0).stop 2024-09-11T22:20:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.855+0000 7f7d853d6640 1 -- 172.21.15.100:0/3626259928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d80154d20 msgr2=0x7f7d80151930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.855+0000 7f7d853d6640 1 --2- 172.21.15.100:0/3626259928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d80154d20 0x7f7d80151930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7d7800e960 tx=0x7f7d7800ee20 comp rx=0 tx=0).stop 2024-09-11T22:20:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.855+0000 7f7d853d6640 1 -- 172.21.15.100:0/3626259928 shutdown_connections 2024-09-11T22:20:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.855+0000 7f7d853d6640 1 --2- 172.21.15.100:0/3626259928 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7d6006be60 0x7f7d6006e320 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.855+0000 7f7d853d6640 1 --2- 172.21.15.100:0/3626259928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d80154d20 0x7f7d80151930 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.855+0000 7f7d853d6640 1 --2- 172.21.15.100:0/3626259928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d800cc770 0x7f7d801513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.855+0000 7f7d853d6640 1 --2- 172.21.15.100:0/3626259928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d800cb920 0x7f7d80144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.855+0000 7f7d853d6640 1 -- 172.21.15.100:0/3626259928 >> 172.21.15.100:0/3626259928 conn(0x7f7d800d0380 msgr2=0x7f7d80153fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.855+0000 7f7d853d6640 1 -- 172.21.15.100:0/3626259928 shutdown_connections 2024-09-11T22:20:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.855+0000 7f7d853d6640 1 -- 172.21.15.100:0/3626259928 wait complete. 2024-09-11T22:20:45.867 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T22:20:45.867 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:20:45.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.965+0000 7fb0fcb0a640 1 Processor -- start 2024-09-11T22:20:45.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.965+0000 7fb0fcb0a640 1 -- start start 2024-09-11T22:20:45.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.966+0000 7fb0fcb0a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0f81529f0 0x7fb0f81593b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.966+0000 7fb0fcb0a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb0f806ec60 0x7fb0f815bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.966+0000 7fb0fcb0a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb0f80c9710 0x7fb0f80c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.966+0000 7fb0fcb0a640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb0f815cd20 con 0x7fb0f80c9710 2024-09-11T22:20:45.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.966+0000 7fb0fcb0a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fb0f8158910 con 0x7fb0f806ec60 2024-09-11T22:20:45.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.966+0000 7fb0fcb0a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb0f80c7b10 con 0x7fb0f81529f0 2024-09-11T22:20:45.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.966+0000 7fb0f6d9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb0f80c9710 0x7fb0f80c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.966+0000 7fb0f6d9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb0f80c9710 0x7fb0f80c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47234/0 (socket says 172.21.15.100:47234) 2024-09-11T22:20:45.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.966+0000 7fb0f6d9d640 1 -- 172.21.15.100:0/3707151254 learned_addr learned my addr 172.21.15.100:0/3707151254 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:45.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.966+0000 7fb0f6d9d640 1 -- 172.21.15.100:0/3707151254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0f81529f0 msgr2=0x7fb0f81593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:45.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.966+0000 7fb0f6d9d640 1 --2- 172.21.15.100:0/3707151254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0f81529f0 0x7fb0f81593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.966+0000 7fb0f6d9d640 1 -- 172.21.15.100:0/3707151254 >> v2:172.21.15.167:3300/0 conn(0x7fb0f806ec60 msgr2=0x7fb0f815bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:45.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.966+0000 7fb0f6d9d640 1 --2- 172.21.15.100:0/3707151254 >> v2:172.21.15.167:3300/0 conn(0x7fb0f806ec60 0x7fb0f815bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.966+0000 7fb0f6d9d640 1 -- 172.21.15.100:0/3707151254 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f80c7df0 con 0x7fb0f80c9710 2024-09-11T22:20:45.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.967+0000 7fb0f6d9d640 1 --2- 172.21.15.100:0/3707151254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0f80c9710 0x7fb0f80c6820 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8072340 tx=0x7fb0f002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1b865093b3bbc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:45.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.967+0000 7fb0f5d9b640 1 -- 172.21.15.100:0/3707151254 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f0036070 con 0x7fb0f80c9710 2024-09-11T22:20:45.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.967+0000 7fb0f5d9b640 1 -- 172.21.15.100:0/3707151254 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f0031600 con 0x7fb0f80c9710 2024-09-11T22:20:45.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.967+0000 7fb0f5d9b640 1 -- 172.21.15.100:0/3707151254 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f00319d0 con 0x7fb0f80c9710 2024-09-11T22:20:45.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.967+0000 7fb0fcb0a640 1 -- 172.21.15.100:0/3707151254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0f80c9710 msgr2=0x7fb0f80c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.968+0000 7fb0fcb0a640 1 --2- 172.21.15.100:0/3707151254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0f80c9710 0x7fb0f80c6820 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8072340 tx=0x7fb0f002a730 comp rx=0 tx=0).stop 2024-09-11T22:20:45.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.968+0000 7fb0fcb0a640 1 -- 172.21.15.100:0/3707151254 shutdown_connections 2024-09-11T22:20:45.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.968+0000 7fb0fcb0a640 1 --2- 172.21.15.100:0/3707151254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0f80c9710 0x7fb0f80c6820 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.968+0000 7fb0fcb0a640 1 --2- 172.21.15.100:0/3707151254 >> v2:172.21.15.167:3300/0 conn(0x7fb0f806ec60 0x7fb0f815bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.968+0000 7fb0fcb0a640 1 --2- 172.21.15.100:0/3707151254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0f81529f0 0x7fb0f81593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.968+0000 7fb0fcb0a640 1 -- 172.21.15.100:0/3707151254 >> 172.21.15.100:0/3707151254 conn(0x7fb0f80cd110 msgr2=0x7fb0f80cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:45.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.968+0000 7fb0fcb0a640 1 -- 172.21.15.100:0/3707151254 shutdown_connections 2024-09-11T22:20:45.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.968+0000 7fb0fcb0a640 1 -- 172.21.15.100:0/3707151254 wait complete. 2024-09-11T22:20:45.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.969+0000 7fb0fcb0a640 1 Processor -- start 2024-09-11T22:20:45.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.969+0000 7fb0fcb0a640 1 -- start start 2024-09-11T22:20:45.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.970+0000 7fb0fcb0a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0f806ec60 0x7fb0f8067bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.970+0000 7fb0fcb0a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0f80c9710 0x7fb0f80ba0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.970+0000 7fb0fcb0a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0f81529f0 0x7fb0f80ba600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.970+0000 7fb0fcb0a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f80c80d0 con 0x7fb0f80c9710 2024-09-11T22:20:45.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.970+0000 7fb0fcb0a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f8158e90 con 0x7fb0f806ec60 2024-09-11T22:20:45.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.970+0000 7fb0fcb0a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb0f80c8250 con 0x7fb0f81529f0 2024-09-11T22:20:45.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.970+0000 7fb0edd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0f80c9710 0x7fb0f80ba0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.970+0000 7fb0edd9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0f80c9710 0x7fb0f80ba0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47240/0 (socket says 172.21.15.100:47240) 2024-09-11T22:20:45.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.970+0000 7fb0edd9b640 1 -- 172.21.15.100:0/3467555401 learned_addr learned my addr 172.21.15.100:0/3467555401 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:45.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.970+0000 7fb0f6d9d640 1 --2- 172.21.15.100:0/3467555401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0f81529f0 0x7fb0f80ba600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.970+0000 7fb0f659c640 1 --2- 172.21.15.100:0/3467555401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0f806ec60 0x7fb0f8067bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.970+0000 7fb0edd9b640 1 -- 172.21.15.100:0/3467555401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0f81529f0 msgr2=0x7fb0f80ba600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.970+0000 7fb0edd9b640 1 --2- 172.21.15.100:0/3467555401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0f81529f0 0x7fb0f80ba600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.970+0000 7fb0edd9b640 1 -- 172.21.15.100:0/3467555401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0f806ec60 msgr2=0x7fb0f8067bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:45.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.970+0000 7fb0edd9b640 1 --2- 172.21.15.100:0/3467555401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0f806ec60 0x7fb0f8067bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:45.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.970+0000 7fb0edd9b640 1 -- 172.21.15.100:0/3467555401 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f8155da0 con 0x7fb0f80c9710 2024-09-11T22:20:45.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.970+0000 7fb0edd9b640 1 --2- 172.21.15.100:0/3467555401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0f80c9710 0x7fb0f80ba0c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb0e000b4d0 tx=0x7fb0e000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:45.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.970+0000 7fb0ef7fe640 1 -- 172.21.15.100:0/3467555401 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0014070 con 0x7fb0f80c9710 2024-09-11T22:20:45.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.971+0000 7fb0ef7fe640 1 -- 172.21.15.100:0/3467555401 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0e0010870 con 0x7fb0f80c9710 2024-09-11T22:20:45.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.971+0000 7fb0ef7fe640 1 -- 172.21.15.100:0/3467555401 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0010c60 con 0x7fb0f80c9710 2024-09-11T22:20:45.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.971+0000 7fb0fcb0a640 1 -- 172.21.15.100:0/3467555401 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0f8157910 con 0x7fb0f80c9710 2024-09-11T22:20:45.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.971+0000 7fb0fcb0a640 1 -- 172.21.15.100:0/3467555401 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0f81557e0 con 0x7fb0f80c9710 2024-09-11T22:20:45.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.971+0000 7fb0fcb0a640 1 -- 172.21.15.100:0/3467555401 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0f806e6e0 con 0x7fb0f80c9710 2024-09-11T22:20:45.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.972+0000 7fb0ef7fe640 1 -- 172.21.15.100:0/3467555401 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb0e0017070 con 0x7fb0f80c9710 2024-09-11T22:20:45.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.972+0000 7fb0ef7fe640 1 --2- 172.21.15.100:0/3467555401 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb0d806be30 0x7fb0d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:45.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.973+0000 7fb0ef7fe640 1 -- 172.21.15.100:0/3467555401 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb0e008aee0 con 0x7fb0f80c9710 2024-09-11T22:20:45.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.973+0000 7fb0f659c640 1 --2- 172.21.15.100:0/3467555401 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb0d806be30 0x7fb0d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:45.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.973+0000 7fb0f659c640 1 --2- 172.21.15.100:0/3467555401 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb0d806be30 0x7fb0d806e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb0e80098e0 tx=0x7fb0e8009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:45.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:45.977+0000 7fb0ef7fe640 1 -- 172.21.15.100:0/3467555401 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb0f8155da0 con 0x7fb0f80c9710 2024-09-11T22:20:46.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.144+0000 7fb0fcb0a640 1 -- 172.21.15.100:0/3467555401 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0f806c930 con 0x7fb0f80c9710 2024-09-11T22:20:46.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.145+0000 7fb0ef7fe640 1 -- 172.21.15.100:0/3467555401 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18646 (secure 0 0 0) 0x7fb0e0058f00 con 0x7fb0f80c9710 2024-09-11T22:20:46.146 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:46.146 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":26,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","created":"2024-09-11T22:19:56.198855+0000","modified":"2024-09-11T22:20:24.213024+0000","last_up_change":"2024-09-11T22:20:07.328863+0000","last_in_change":"2024-09-11T22:19:58.294227+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:20:08.333538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:20:16.995279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:20:18.147950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:20:21.873694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5de0ba54-34c5-4343-b19a-1f675efc49c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6809","nonce":2008454847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6811","nonce":2008454847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6815","nonce":2008454847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6813","nonce":2008454847}]},"public_addr":"172.21.15.100:6809/2008454847","cluster_addr":"172.21.15.100:6811/2008454847","heartbeat_back_addr":"172.21.15.100:6815/2008454847","heartbeat_front_addr":"172.21.15.100:6813/2008454847","state":["exists","up"]},{"osd":1,"uuid":"5a1f6456-6604-4b41-b9b9-52ae8d6616ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6801","nonce":1802107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6803","nonce":1802107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6807","nonce":1802107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6805","nonce":1802107101}]},"public_addr":"172.21.15.100:6801/1802107101","cluster_addr":"172.21.15.100:6803/1802107101","heartbeat_back_addr":"172.21.15.100:6807/1802107101","heartbeat_front_addr":"172.21.15.100:6805/1802107101","state":["exists","up"]},{"osd":2,"uuid":"a604cb26-7b0f-402d-b6ac-3652884b4b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6817","nonce":644491349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6819","nonce":644491349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6823","nonce":644491349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6821","nonce":644491349}]},"public_addr":"172.21.15.100:6817/644491349","cluster_addr":"172.21.15.100:6819/644491349","heartbeat_back_addr":"172.21.15.100:6823/644491349","heartbeat_front_addr":"172.21.15.100:6821/644491349","state":["exists","up"]},{"osd":3,"uuid":"73dc2cbb-70ff-4d12-ba2f-8778a49892f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6825","nonce":2519160882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6827","nonce":2519160882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6831","nonce":2519160882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6829","nonce":2519160882}]},"public_addr":"172.21.15.100:6825/2519160882","cluster_addr":"172.21.15.100:6827/2519160882","heartbeat_back_addr":"172.21.15.100:6831/2519160882","heartbeat_front_addr":"172.21.15.100:6829/2519160882","state":["exists","up"]},{"osd":4,"uuid":"07960648-04df-4aec-a72c-c29e28b74bcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6817","nonce":736010951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6819","nonce":736010951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6823","nonce":736010951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6821","nonce":736010951}]},"public_addr":"172.21.15.167:6817/736010951","cluster_addr":"172.21.15.167:6819/736010951","heartbeat_back_addr":"172.21.15.167:6823/736010951","heartbeat_front_addr":"172.21.15.167:6821/736010951","state":["exists","up"]},{"osd":5,"uuid":"2b4767e6-cab7-4b45-9150-55432f5576aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6825","nonce":2479173909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6827","nonce":2479173909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6831","nonce":2479173909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6829","nonce":2479173909}]},"public_addr":"172.21.15.167:6825/2479173909","cluster_addr":"172.21.15.167:6827/2479173909","heartbeat_back_addr":"172.21.15.167:6831/2479173909","heartbeat_front_addr":"172.21.15.167:6829/2479173909","state":["exists","up"]},{"osd":6,"uuid":"4ef2c4b5-52f4-4f69-8fca-2334077ed8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6809","nonce":2825112504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6811","nonce":2825112504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6815","nonce":2825112504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6813","nonce":2825112504}]},"public_addr":"172.21.15.167:6809/2825112504","cluster_addr":"172.21.15.167:6811/2825112504","heartbeat_back_addr":"172.21.15.167:6815/2825112504","heartbeat_front_addr":"172.21.15.167:6813/2825112504","state":["exists","up"]},{"osd":7,"uuid":"761673d8-d6fc-4ded-a9f3-d49ab8f7c969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337015843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337015843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337015843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337015843}]},"public_addr":"172.21.15.167:6801/1337015843","cluster_addr":"172.21.15.167:6803/1337015843","heartbeat_back_addr":"172.21.15.167:6807/1337015843","heartbeat_front_addr":"172.21.15.167:6805/1337015843","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.833280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.080311+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.100648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.544261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.670353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.880921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.365441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.366659+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:20:46.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.147+0000 7fb0fcb0a640 1 -- 172.21.15.100:0/3467555401 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb0d806be30 msgr2=0x7fb0d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.147+0000 7fb0fcb0a640 1 --2- 172.21.15.100:0/3467555401 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb0d806be30 0x7fb0d806e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb0e80098e0 tx=0x7fb0e8009060 comp rx=0 tx=0).stop 2024-09-11T22:20:46.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.147+0000 7fb0fcb0a640 1 -- 172.21.15.100:0/3467555401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0f80c9710 msgr2=0x7fb0f80ba0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.147+0000 7fb0fcb0a640 1 --2- 172.21.15.100:0/3467555401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0f80c9710 0x7fb0f80ba0c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb0e000b4d0 tx=0x7fb0e000b990 comp rx=0 tx=0).stop 2024-09-11T22:20:46.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.147+0000 7fb0fcb0a640 1 -- 172.21.15.100:0/3467555401 shutdown_connections 2024-09-11T22:20:46.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.147+0000 7fb0fcb0a640 1 --2- 172.21.15.100:0/3467555401 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb0d806be30 0x7fb0d806e2f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.147+0000 7fb0fcb0a640 1 --2- 172.21.15.100:0/3467555401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0f81529f0 0x7fb0f80ba600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.147+0000 7fb0fcb0a640 1 --2- 172.21.15.100:0/3467555401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0f80c9710 0x7fb0f80ba0c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.147+0000 7fb0fcb0a640 1 --2- 172.21.15.100:0/3467555401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0f806ec60 0x7fb0f8067bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.147+0000 7fb0fcb0a640 1 -- 172.21.15.100:0/3467555401 >> 172.21.15.100:0/3467555401 conn(0x7fb0f80cd110 msgr2=0x7fb0f80cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.147+0000 7fb0fcb0a640 1 -- 172.21.15.100:0/3467555401 shutdown_connections 2024-09-11T22:20:46.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.147+0000 7fb0fcb0a640 1 -- 172.21.15.100:0/3467555401 wait complete. 2024-09-11T22:20:46.159 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T22:20:46.159 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T22:20:46.160 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T22:20:46.160 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-11T22:20:46.161 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-11T22:20:46.161 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-11T22:20:46.162 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-11T22:20:46.162 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-11T22:20:46.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.328+0000 7f361a623640 1 Processor -- start 2024-09-11T22:20:46.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.328+0000 7f361a623640 1 -- start start 2024-09-11T22:20:46.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.329+0000 7f227c955640 1 Processor -- start 2024-09-11T22:20:46.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.330+0000 7f361a623640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3614150ee0 0x7f36140c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.330+0000 7f361a623640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36140c8b70 0x7f36140c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.330+0000 7f361a623640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3614151330 con 0x7f36140717a0 2024-09-11T22:20:46.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.330+0000 7f361a623640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f36140c8630 con 0x7f3614150ee0 2024-09-11T22:20:46.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.330+0000 7f361a623640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f36140c7ab0 con 0x7f36140c8b70 2024-09-11T22:20:46.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.329+0000 7f227c955640 1 -- start start 2024-09-11T22:20:46.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.330+0000 7f3613fff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f36140717a0 0x7f36140c70e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33236/0 (socket says 172.21.15.100:33236) 2024-09-11T22:20:46.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.330+0000 7f3613fff640 1 -- 172.21.15.100:0/682078092 learned_addr learned my addr 172.21.15.100:0/682078092 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:46.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.330+0000 7f803a853640 1 Processor -- start 2024-09-11T22:20:46.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.330+0000 7f803a853640 1 -- start start 2024-09-11T22:20:46.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.330+0000 7f36137fe640 1 --2- 172.21.15.100:0/682078092 >> v2:172.21.15.100:3300/0 conn(0x7f3614150ee0 0x7f36140c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.331+0000 7f3618bc0640 1 --2- 172.21.15.100:0/682078092 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36140c8b70 0x7f36140c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.331+0000 7f36137fe640 1 -- 172.21.15.100:0/682078092 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36140c8b70 msgr2=0x7f36140c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.331+0000 7fbc263a6640 1 Processor -- start 2024-09-11T22:20:46.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.331+0000 7f3612ffd640 1 -- 172.21.15.100:0/682078092 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1642359771 0 0) 0x7f3614151330 con 0x7f36140717a0 2024-09-11T22:20:46.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.331+0000 7f0b75f0a640 1 Processor -- start 2024-09-11T22:20:46.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.331+0000 7fbc263a6640 1 -- start start 2024-09-11T22:20:46.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.331+0000 7f36137fe640 1 --2- 172.21.15.100:0/682078092 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36140c8b70 0x7f36140c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.331+0000 7f0b75f0a640 1 -- start start 2024-09-11T22:20:46.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.331+0000 7f36137fe640 1 -- 172.21.15.100:0/682078092 >> v1:172.21.15.100:6789/0 conn(0x7f36140717a0 legacy=0x7f36140c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.331+0000 7f227c955640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2270008ad0 0x7f227004dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.331+0000 7f227c955640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22700e2b10 0x7f22700e2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.331+0000 7f36137fe640 1 -- 172.21.15.100:0/682078092 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36140c77f0 con 0x7f3614150ee0 2024-09-11T22:20:46.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.331+0000 7f227c955640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2270048a30 con 0x7f22700dcd30 2024-09-11T22:20:46.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.331+0000 7f227c955640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f2270048fd0 con 0x7f2270008ad0 2024-09-11T22:20:46.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.331+0000 7f227c955640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f227004e220 con 0x7f22700e2b10 2024-09-11T22:20:46.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.331+0000 7f9113fff640 1 Processor -- start 2024-09-11T22:20:46.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7f9113fff640 1 -- start start 2024-09-11T22:20:46.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.331+0000 7f3618bc0640 1 --2- 172.21.15.100:0/682078092 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36140c8b70 0x7f36140c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:46.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.331+0000 7f803a853640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f802c0d67d0 0x7f802c00d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.331+0000 7f803a853640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f802c04ef30 0x7f802c04d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.331+0000 7f803a853640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f802c0d6bb0 con 0x7f802c0dcf00 2024-09-11T22:20:46.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.331+0000 7f803a853640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f802c04cb60 con 0x7f802c0d67d0 2024-09-11T22:20:46.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.331+0000 7f803a853640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f802c00bf00 con 0x7f802c04ef30 2024-09-11T22:20:46.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7f8033fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f802c0d67d0 0x7f802c00d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7f8033fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f802c0d67d0 0x7f802c00d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44006/0 (socket says 172.21.15.100:44006) 2024-09-11T22:20:46.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7f8033fff640 1 -- 172.21.15.100:0/482695176 learned_addr learned my addr 172.21.15.100:0/482695176 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7fbc263a6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc200c5a90 0x7fbc200cc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7fbc1ffff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fbc20154c00 0x7fbc200d0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33270/0 (socket says 172.21.15.100:33270) 2024-09-11T22:20:46.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7fbc1ffff640 1 -- 172.21.15.100:0/874991306 learned_addr learned my addr 172.21.15.100:0/874991306 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:46.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7fbc1f7fe640 1 --2- 172.21.15.100:0/874991306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc200c5a90 0x7fbc200cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7fbc263a6640 1 -- 172.21.15.100:0/874991306 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc2015dfa0 con 0x7fbc20154c00 2024-09-11T22:20:46.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7fbc263a6640 1 -- 172.21.15.100:0/874991306 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc2015e220 con 0x7fbc2015afb0 2024-09-11T22:20:46.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7fbc263a6640 1 -- 172.21.15.100:0/874991306 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbc2015ab20 con 0x7fbc200c5a90 2024-09-11T22:20:46.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7f8ccacaf640 1 Processor -- start 2024-09-11T22:20:46.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f8ccacaf640 1 -- start start 2024-09-11T22:20:46.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7f9b29b0c640 1 Processor -- start 2024-09-11T22:20:46.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7f9b29b0c640 1 -- start start 2024-09-11T22:20:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7f0b75f0a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0b70154c00 0x7f0b700cc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7f0b75f0a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b700c5a90 0x7f0b700d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7f0b75f0a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b7015dfa0 con 0x7f0b700d0850 2024-09-11T22:20:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7f0b75f0a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f0b7015ab20 con 0x7f0b70154c00 2024-09-11T22:20:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7f0b75f0a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0b7015e220 con 0x7f0b700c5a90 2024-09-11T22:20:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7f0b6ffff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f0b700d0850 0x7f0b7015afb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:44204/0 (socket says 172.21.15.100:44204) 2024-09-11T22:20:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7f0b6ffff640 1 -- 172.21.15.100:0/394732223 learned_addr learned my addr 172.21.15.100:0/394732223 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7f0b6f7fe640 1 --2- 172.21.15.100:0/394732223 >> v2:172.21.15.167:3300/0 conn(0x7f0b70154c00 0x7f0b700cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f0b6effd640 1 --2- 172.21.15.100:0/394732223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b700c5a90 0x7f0b700d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f0b6e7fc640 1 -- 172.21.15.100:0/394732223 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 914060578 0 0) 0x7f0b58001110 con 0x7f0b700d0850 2024-09-11T22:20:46.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7f8038df0640 1 --2- 172.21.15.100:0/482695176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f802c04ef30 0x7f802c04d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f9113fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f910c0d93c0 0x7f910c045fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f0b6e7fc640 1 -- 172.21.15.100:0/394732223 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b5c003520 con 0x7f0b700d0850 2024-09-11T22:20:46.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f0b6f7fe640 1 -- 172.21.15.100:0/394732223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b700c5a90 msgr2=0x7f0b700d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f0b6f7fe640 1 --2- 172.21.15.100:0/394732223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b700c5a90 0x7f0b700d0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f0b6f7fe640 1 -- 172.21.15.100:0/394732223 >> v1:172.21.15.167:6789/0 conn(0x7f0b700d0850 legacy=0x7f0b7015afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f0b6f7fe640 1 -- 172.21.15.100:0/394732223 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7015e500 con 0x7f0b70154c00 2024-09-11T22:20:46.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f36137fe640 1 --2- 172.21.15.100:0/682078092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3614150ee0 0x7f36140c80f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f36040097a0 tx=0x7f360402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925bcbbbc7cc7a04 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f8032ffd640 1 -- 172.21.15.100:0/482695176 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1915754242 0 0) 0x7f8028001110 con 0x7f802c0dcf00 2024-09-11T22:20:46.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f8032ffd640 1 -- 172.21.15.100:0/482695176 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8024003520 con 0x7f802c0dcf00 2024-09-11T22:20:46.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7fbc1f7fe640 1 -- 172.21.15.100:0/874991306 >> v1:172.21.15.167:6789/0 conn(0x7fbc2015afb0 legacy=0x7fbc20165380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7fbc1f7fe640 1 -- 172.21.15.100:0/874991306 >> v1:172.21.15.100:6789/0 conn(0x7fbc20154c00 legacy=0x7fbc200d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7fbc1f7fe640 1 -- 172.21.15.100:0/874991306 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2015e500 con 0x7fbc200c5a90 2024-09-11T22:20:46.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f9113fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f910c005e30 0x7f910c0355e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f91137fe640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f910c006250 0x7f910c04b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33280/0 (socket says 172.21.15.100:33280) 2024-09-11T22:20:46.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f9112ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f910c0d93c0 0x7f910c045fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f9112ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f910c0d93c0 0x7f910c045fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45084/0 (socket says 172.21.15.100:45084) 2024-09-11T22:20:46.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f91137fe640 1 -- 172.21.15.100:0/4277463827 learned_addr learned my addr 172.21.15.100:0/4277463827 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:46.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f9113fff640 1 -- 172.21.15.100:0/4277463827 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f910c0e2da0 con 0x7f910c006250 2024-09-11T22:20:46.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f9113fff640 1 -- 172.21.15.100:0/4277463827 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f910c0e3920 con 0x7f910c005e30 2024-09-11T22:20:46.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f9113fff640 1 -- 172.21.15.100:0/4277463827 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f910c0e3080 con 0x7f910c0d93c0 2024-09-11T22:20:46.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f91127fc640 1 --2- 172.21.15.100:0/4277463827 >> v2:172.21.15.100:3300/0 conn(0x7f910c005e30 0x7f910c0355e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f9112ffd640 1 -- 172.21.15.100:0/4277463827 >> v2:172.21.15.100:3300/0 conn(0x7f910c005e30 msgr2=0x7f910c0355e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f9112ffd640 1 --2- 172.21.15.100:0/4277463827 >> v2:172.21.15.100:3300/0 conn(0x7f910c005e30 0x7f910c0355e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f9112ffd640 1 -- 172.21.15.100:0/4277463827 >> v1:172.21.15.100:6789/0 conn(0x7f910c006250 legacy=0x7f910c04b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f9112ffd640 1 -- 172.21.15.100:0/4277463827 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910c0e3360 con 0x7f910c0d93c0 2024-09-11T22:20:46.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f9b29b0c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9b240cd110 0x7f9b240cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f9b29b0c640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b24154e90 con 0x7f9b24154ab0 2024-09-11T22:20:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f9b29b0c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b2415b650 con 0x7f9b240cc150 2024-09-11T22:20:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f9b29b0c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f9b2415aad0 con 0x7f9b240cd110 2024-09-11T22:20:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f9b23fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f9b240cc150 0x7f9b2415e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:44208/0 (socket says 172.21.15.100:44208) 2024-09-11T22:20:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f9b23fff640 1 -- 172.21.15.100:0/2830649295 learned_addr learned my addr 172.21.15.100:0/2830649295 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7f2277fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22700e2b10 0x7f22700e2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7f2277fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22700e2b10 0x7f22700e2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45046/0 (socket says 172.21.15.100:45046) 2024-09-11T22:20:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.332+0000 7f2277fff640 1 -- 172.21.15.100:0/131501308 learned_addr learned my addr 172.21.15.100:0/131501308 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f2276ffd640 1 --2- 172.21.15.100:0/131501308 >> v2:172.21.15.100:3300/0 conn(0x7f2270008ad0 0x7f227004dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f2277fff640 1 -- 172.21.15.100:0/131501308 >> v2:172.21.15.100:3300/0 conn(0x7f2270008ad0 msgr2=0x7f227004dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f2277fff640 1 --2- 172.21.15.100:0/131501308 >> v2:172.21.15.100:3300/0 conn(0x7f2270008ad0 0x7f227004dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f2277fff640 1 -- 172.21.15.100:0/131501308 >> v1:172.21.15.100:6789/0 conn(0x7f22700dcd30 legacy=0x7f22700083c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f2277fff640 1 -- 172.21.15.100:0/131501308 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2270007ea0 con 0x7f22700e2b10 2024-09-11T22:20:46.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f0b6f7fe640 1 --2- 172.21.15.100:0/394732223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b70154c00 0x7f0b700cc700 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009de0 tx=0x7f0b6802a750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c3541e5081debd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f8033fff640 1 -- 172.21.15.100:0/482695176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f802c04ef30 msgr2=0x7f802c04d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f8033fff640 1 --2- 172.21.15.100:0/482695176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f802c04ef30 0x7f802c04d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f8033fff640 1 -- 172.21.15.100:0/482695176 >> v1:172.21.15.100:6789/0 conn(0x7f802c0dcf00 legacy=0x7f802c04e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.333+0000 7f8033fff640 1 -- 172.21.15.100:0/482695176 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f802c00c1c0 con 0x7f802c0d67d0 2024-09-11T22:20:46.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f9b227fc640 1 -- 172.21.15.100:0/2830649295 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 612879941 0 0) 0x7f9b2415b650 con 0x7f9b240cc150 2024-09-11T22:20:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f9b227fc640 1 -- 172.21.15.100:0/2830649295 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b14003520 con 0x7f9b240cc150 2024-09-11T22:20:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f9b227fc640 1 -- 172.21.15.100:0/2830649295 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1897655616 0 0) 0x7f9b18001040 con 0x7f9b24154ab0 2024-09-11T22:20:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f9b227fc640 1 -- 172.21.15.100:0/2830649295 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b2415b650 con 0x7f9b24154ab0 2024-09-11T22:20:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f8ccacaf640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8cc4154650 0x7f8cc415b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f8ccacaf640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8cc40cbc90 0x7f8cc40cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f8ccacaf640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cc40c5220 con 0x7f8cc4154a30 2024-09-11T22:20:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f8ccacaf640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f8cc40cac30 con 0x7f8cc4154650 2024-09-11T22:20:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f8ccacaf640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f8cc4074120 con 0x7f8cc40cbc90 2024-09-11T22:20:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f8cc94ac640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f8cc4154a30 0x7f8cc4073970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:44210/0 (socket says 172.21.15.100:44210) 2024-09-11T22:20:46.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f8cc94ac640 1 -- 172.21.15.100:0/133565545 learned_addr learned my addr 172.21.15.100:0/133565545 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f9b22ffd640 1 --2- 172.21.15.100:0/2830649295 >> v2:172.21.15.167:3300/0 conn(0x7f9b240cd110 0x7f9b240cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f0b6e7fc640 1 -- 172.21.15.100:0/394732223 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68007740 con 0x7f0b70154c00 2024-09-11T22:20:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f8cc9cad640 1 --2- 172.21.15.100:0/133565545 >> v2:172.21.15.100:3300/0 conn(0x7f8cc4154650 0x7f8cc415b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f8cca4ae640 1 --2- 172.21.15.100:0/133565545 >> v2:172.21.15.167:3300/0 conn(0x7f8cc40cbc90 0x7f8cc40cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f2277fff640 1 --2- 172.21.15.100:0/131501308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22700e2b10 0x7f22700e2fa0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f227806a4c0 tx=0x7f22780a6a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a59a96fbfa00987 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.334+0000 7f3612ffd640 1 -- 172.21.15.100:0/682078092 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3604037070 con 0x7f3614150ee0 2024-09-11T22:20:46.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f8033fff640 1 --2- 172.21.15.100:0/482695176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f802c0d67d0 0x7f802c00d290 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f803406b1f0 tx=0x7f80340a6b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfffcb9485213c45 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f3612ffd640 1 -- 172.21.15.100:0/682078092 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3604032440 con 0x7f3614150ee0 2024-09-11T22:20:46.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f8cc9cad640 1 -- 172.21.15.100:0/133565545 >> v2:172.21.15.167:3300/0 conn(0x7f8cc40cbc90 msgr2=0x7f8cc40cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f3612ffd640 1 -- 172.21.15.100:0/682078092 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3604032810 con 0x7f3614150ee0 2024-09-11T22:20:46.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f0b6e7fc640 1 -- 172.21.15.100:0/394732223 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b680078e0 con 0x7f0b70154c00 2024-09-11T22:20:46.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f0b6e7fc640 1 -- 172.21.15.100:0/394732223 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68007c90 con 0x7f0b70154c00 2024-09-11T22:20:46.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f22767fc640 1 -- 172.21.15.100:0/131501308 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22780af070 con 0x7f22700e2b10 2024-09-11T22:20:46.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f22767fc640 1 -- 172.21.15.100:0/131501308 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22780ab8c0 con 0x7f22700e2b10 2024-09-11T22:20:46.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f22767fc640 1 -- 172.21.15.100:0/131501308 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22780abcf0 con 0x7f22700e2b10 2024-09-11T22:20:46.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7fbc1f7fe640 1 --2- 172.21.15.100:0/874991306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc200c5a90 0x7fbc200cc700 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbc140097d0 tx=0x7fbc1402a2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=847cf658be30d286 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7fbc1effd640 1 -- 172.21.15.100:0/874991306 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc14037070 con 0x7fbc200c5a90 2024-09-11T22:20:46.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7fbc1effd640 1 -- 172.21.15.100:0/874991306 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc14032440 con 0x7fbc200c5a90 2024-09-11T22:20:46.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7fbc1effd640 1 -- 172.21.15.100:0/874991306 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc14037070 con 0x7fbc200c5a90 2024-09-11T22:20:46.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f361a623640 1 -- 172.21.15.100:0/682078092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3614150ee0 msgr2=0x7f36140c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f361a623640 1 --2- 172.21.15.100:0/682078092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3614150ee0 0x7f36140c80f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f36040097a0 tx=0x7f360402a230 comp rx=0 tx=0).stop 2024-09-11T22:20:46.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f361a623640 1 -- 172.21.15.100:0/682078092 shutdown_connections 2024-09-11T22:20:46.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f361a623640 1 --2- 172.21.15.100:0/682078092 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36140c8b70 0x7f36140c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f361a623640 1 --2- 172.21.15.100:0/682078092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3614150ee0 0x7f36140c80f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f361a623640 1 -- 172.21.15.100:0/682078092 >> 172.21.15.100:0/682078092 conn(0x7f361406f360 msgr2=0x7f361406f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f8cc9cad640 1 --2- 172.21.15.100:0/133565545 >> v2:172.21.15.167:3300/0 conn(0x7f8cc40cbc90 0x7f8cc40cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f8cc9cad640 1 -- 172.21.15.100:0/133565545 >> v1:172.21.15.167:6789/0 conn(0x7f8cc4154a30 legacy=0x7f8cc4073970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f8cc8cab640 1 -- 172.21.15.100:0/133565545 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2333554367 0 0) 0x7f8cc40c5220 con 0x7f8cc4154a30 2024-09-11T22:20:46.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f8cc9cad640 1 -- 172.21.15.100:0/133565545 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc40caed0 con 0x7f8cc4154650 2024-09-11T22:20:46.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f8cca4ae640 1 --2- 172.21.15.100:0/133565545 >> v2:172.21.15.167:3300/0 conn(0x7f8cc40cbc90 0x7f8cc40cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:46.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f9b227fc640 1 -- 172.21.15.100:0/2830649295 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2787831233 0 0) 0x7f9b2415b650 con 0x7f9b24154ab0 2024-09-11T22:20:46.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f9b227fc640 1 -- 172.21.15.100:0/2830649295 >> v2:172.21.15.167:3300/0 conn(0x7f9b240cd110 msgr2=0x7f9b240cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f9b227fc640 1 --2- 172.21.15.100:0/2830649295 >> v2:172.21.15.167:3300/0 conn(0x7f9b240cd110 0x7f9b240cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f9b227fc640 1 -- 172.21.15.100:0/2830649295 >> v1:172.21.15.167:6789/0 conn(0x7f9b240cc150 legacy=0x7f9b2415e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f9b227fc640 1 -- 172.21.15.100:0/2830649295 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2415adb0 con 0x7f9b24154ab0 2024-09-11T22:20:46.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f9b227fc640 1 -- 172.21.15.100:0/2830649295 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f9b18001770 con 0x7f9b24154ab0 2024-09-11T22:20:46.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f9b227fc640 1 -- 172.21.15.100:0/2830649295 >> v1:172.21.15.100:6789/0 conn(0x7f9b24154ab0 legacy=0x7f9b240caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f9b227fc640 1 --2- 172.21.15.100:0/2830649295 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b14004bf0 0x7f9b14005030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f9b227fc640 1 --2- 172.21.15.100:0/2830649295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b140037a0 0x7f9b14003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f9b227fc640 1 --2- 172.21.15.100:0/2830649295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b140042b0 0x7f9b140141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f9b227fc640 1 -- 172.21.15.100:0/2830649295 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2415aad0 con 0x7f9b140042b0 2024-09-11T22:20:46.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f9b227fc640 1 -- 172.21.15.100:0/2830649295 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9b14014a60 con 0x7f9b140037a0 2024-09-11T22:20:46.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f9b227fc640 1 -- 172.21.15.100:0/2830649295 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9b14014c60 con 0x7f9b14004bf0 2024-09-11T22:20:46.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f9b22ffd640 1 --2- 172.21.15.100:0/2830649295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b140037a0 0x7f9b14003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f9b237fe640 1 --2- 172.21.15.100:0/2830649295 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b14004bf0 0x7f9b14005030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f9b23fff640 1 --2- 172.21.15.100:0/2830649295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b140042b0 0x7f9b140141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f0b75f0a640 1 -- 172.21.15.100:0/394732223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b70154c00 msgr2=0x7f0b700cc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f0b75f0a640 1 --2- 172.21.15.100:0/394732223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b70154c00 0x7f0b700cc700 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009de0 tx=0x7f0b6802a750 comp rx=0 tx=0).stop 2024-09-11T22:20:46.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f0b75f0a640 1 -- 172.21.15.100:0/394732223 shutdown_connections 2024-09-11T22:20:46.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f0b75f0a640 1 --2- 172.21.15.100:0/394732223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b700c5a90 0x7f0b700d0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f0b75f0a640 1 --2- 172.21.15.100:0/394732223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b70154c00 0x7f0b700cc700 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f0b75f0a640 1 -- 172.21.15.100:0/394732223 >> 172.21.15.100:0/394732223 conn(0x7f0b7006cf50 msgr2=0x7f0b7006d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f8032ffd640 1 -- 172.21.15.100:0/482695176 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80340a8910 con 0x7f802c0d67d0 2024-09-11T22:20:46.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.335+0000 7f8032ffd640 1 -- 172.21.15.100:0/482695176 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80340a8ab0 con 0x7f802c0d67d0 2024-09-11T22:20:46.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f9b23fff640 1 -- 172.21.15.100:0/2830649295 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b14004bf0 msgr2=0x7f9b14005030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f9b23fff640 1 --2- 172.21.15.100:0/2830649295 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b14004bf0 0x7f9b14005030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f9b23fff640 1 -- 172.21.15.100:0/2830649295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b140037a0 msgr2=0x7f9b14003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f9b23fff640 1 --2- 172.21.15.100:0/2830649295 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b140037a0 0x7f9b14003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f9b23fff640 1 -- 172.21.15.100:0/2830649295 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b18001040 con 0x7f9b140042b0 2024-09-11T22:20:46.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f803a853640 1 -- 172.21.15.100:0/482695176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f802c0d67d0 msgr2=0x7f802c00d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f803a853640 1 --2- 172.21.15.100:0/482695176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f802c0d67d0 0x7f802c00d290 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f803406b1f0 tx=0x7f80340a6b30 comp rx=0 tx=0).stop 2024-09-11T22:20:46.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f361a623640 1 -- 172.21.15.100:0/682078092 shutdown_connections 2024-09-11T22:20:46.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f227c955640 1 -- 172.21.15.100:0/131501308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22700e2b10 msgr2=0x7f22700e2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f0b75f0a640 1 -- 172.21.15.100:0/394732223 shutdown_connections 2024-09-11T22:20:46.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f9112ffd640 1 --2- 172.21.15.100:0/4277463827 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f910c0d93c0 0x7f910c045fd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9114050d60 tx=0x7f91140a6950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53e6e865e9acbc25 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f227c955640 1 --2- 172.21.15.100:0/131501308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22700e2b10 0x7f22700e2fa0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f227806a4c0 tx=0x7f22780a6a60 comp rx=0 tx=0).stop 2024-09-11T22:20:46.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f361a623640 1 -- 172.21.15.100:0/682078092 wait complete. 2024-09-11T22:20:46.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f8cc9cad640 1 --2- 172.21.15.100:0/133565545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cc4154650 0x7f8cc415b2a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8cc40732f0 tx=0x7f8cc002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e2630b2e229a92 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7fbc263a6640 1 -- 172.21.15.100:0/874991306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc200c5a90 msgr2=0x7fbc200cc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7fbc263a6640 1 --2- 172.21.15.100:0/874991306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc200c5a90 0x7fbc200cc700 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbc140097d0 tx=0x7fbc1402a2a0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f803a853640 1 -- 172.21.15.100:0/482695176 shutdown_connections 2024-09-11T22:20:46.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f803a853640 1 --2- 172.21.15.100:0/482695176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f802c04ef30 0x7f802c04d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f803a853640 1 --2- 172.21.15.100:0/482695176 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f802c0d67d0 0x7f802c00d290 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f803a853640 1 -- 172.21.15.100:0/482695176 >> 172.21.15.100:0/482695176 conn(0x7f802c00a150 msgr2=0x7f802c00db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f9111ffb640 1 -- 172.21.15.100:0/4277463827 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91140b0020 con 0x7f910c0d93c0 2024-09-11T22:20:46.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f9111ffb640 1 -- 172.21.15.100:0/4277463827 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91140ac8d0 con 0x7f910c0d93c0 2024-09-11T22:20:46.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f9111ffb640 1 -- 172.21.15.100:0/4277463827 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91140acd40 con 0x7f910c0d93c0 2024-09-11T22:20:46.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f803a853640 1 -- 172.21.15.100:0/482695176 shutdown_connections 2024-09-11T22:20:46.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7fbc263a6640 1 -- 172.21.15.100:0/874991306 shutdown_connections 2024-09-11T22:20:46.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f8cc8cab640 1 -- 172.21.15.100:0/133565545 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0037070 con 0x7f8cc4154650 2024-09-11T22:20:46.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f8cc8cab640 1 -- 172.21.15.100:0/133565545 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cc0032440 con 0x7f8cc4154650 2024-09-11T22:20:46.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.336+0000 7f8cc8cab640 1 -- 172.21.15.100:0/133565545 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc002ae60 con 0x7f8cc4154650 2024-09-11T22:20:46.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.337+0000 7fbc263a6640 1 --2- 172.21.15.100:0/874991306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc200c5a90 0x7fbc200cc700 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.337+0000 7fbc263a6640 1 -- 172.21.15.100:0/874991306 >> 172.21.15.100:0/874991306 conn(0x7fbc2006cf50 msgr2=0x7fbc2006d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.337+0000 7f0b75f0a640 1 -- 172.21.15.100:0/394732223 wait complete. 2024-09-11T22:20:46.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.337+0000 7f9b23fff640 1 -- 172.21.15.100:0/2830649295 reap_dead start 2024-09-11T22:20:46.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.337+0000 7f9b23fff640 1 --2- 172.21.15.100:0/2830649295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b140042b0 0x7f9b140141d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c00c320 tx=0x7f9b14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2050bc34a88dfd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.337+0000 7f9b227fc640 1 -- 172.21.15.100:0/2830649295 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c0020a0 con 0x7f9b140042b0 2024-09-11T22:20:46.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.337+0000 7f9b227fc640 1 -- 172.21.15.100:0/2830649295 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b1c02d070 con 0x7f9b140042b0 2024-09-11T22:20:46.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.337+0000 7f9b227fc640 1 -- 172.21.15.100:0/2830649295 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c007510 con 0x7f9b140042b0 2024-09-11T22:20:46.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.337+0000 7f803a853640 1 -- 172.21.15.100:0/482695176 wait complete. 2024-09-11T22:20:46.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.337+0000 7f227c955640 1 -- 172.21.15.100:0/131501308 shutdown_connections 2024-09-11T22:20:46.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.337+0000 7f227c955640 1 --2- 172.21.15.100:0/131501308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22700e2b10 0x7f22700e2fa0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.337+0000 7f227c955640 1 --2- 172.21.15.100:0/131501308 >> v2:172.21.15.100:3300/0 conn(0x7f2270008ad0 0x7f227004dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.337+0000 7f227c955640 1 -- 172.21.15.100:0/131501308 >> 172.21.15.100:0/131501308 conn(0x7f227004e8e0 msgr2=0x7f227004ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.337+0000 7f9113fff640 1 -- 172.21.15.100:0/4277463827 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f910c0d93c0 msgr2=0x7f910c045fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.337+0000 7f9113fff640 1 --2- 172.21.15.100:0/4277463827 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f910c0d93c0 0x7f910c045fd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9114050d60 tx=0x7f91140a6950 comp rx=0 tx=0).stop 2024-09-11T22:20:46.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.337+0000 7fbc263a6640 1 -- 172.21.15.100:0/874991306 shutdown_connections 2024-09-11T22:20:46.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.337+0000 7fbc263a6640 1 -- 172.21.15.100:0/874991306 wait complete. 2024-09-11T22:20:46.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.337+0000 7f9113fff640 1 -- 172.21.15.100:0/4277463827 shutdown_connections 2024-09-11T22:20:46.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.337+0000 7f9113fff640 1 --2- 172.21.15.100:0/4277463827 >> v2:172.21.15.100:3300/0 conn(0x7f910c005e30 0x7f910c0355e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.337+0000 7f9113fff640 1 --2- 172.21.15.100:0/4277463827 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f910c0d93c0 0x7f910c045fd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.337+0000 7f9113fff640 1 -- 172.21.15.100:0/4277463827 >> 172.21.15.100:0/4277463827 conn(0x7f910c00c230 msgr2=0x7f910c00c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.337+0000 7f8ccacaf640 1 -- 172.21.15.100:0/133565545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cc4154650 msgr2=0x7f8cc415b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.337+0000 7f8ccacaf640 1 --2- 172.21.15.100:0/133565545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cc4154650 0x7f8cc415b2a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8cc40732f0 tx=0x7f8cc002a110 comp rx=0 tx=0).stop 2024-09-11T22:20:46.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.338+0000 7f8ccacaf640 1 -- 172.21.15.100:0/133565545 shutdown_connections 2024-09-11T22:20:46.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.338+0000 7f8ccacaf640 1 --2- 172.21.15.100:0/133565545 >> v2:172.21.15.167:3300/0 conn(0x7f8cc40cbc90 0x7f8cc40cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.338+0000 7f8ccacaf640 1 --2- 172.21.15.100:0/133565545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cc4154650 0x7f8cc415b2a0 secure :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8cc40732f0 tx=0x7f8cc002a110 comp rx=0 tx=0).stop 2024-09-11T22:20:46.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.338+0000 7f8ccacaf640 1 -- 172.21.15.100:0/133565545 >> 172.21.15.100:0/133565545 conn(0x7f8cc40d0190 msgr2=0x7f8cc40d05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.338+0000 7f8ccacaf640 1 -- 172.21.15.100:0/133565545 shutdown_connections 2024-09-11T22:20:46.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.338+0000 7f227c955640 1 -- 172.21.15.100:0/131501308 shutdown_connections 2024-09-11T22:20:46.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.338+0000 7f227c955640 1 -- 172.21.15.100:0/131501308 wait complete. 2024-09-11T22:20:46.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.338+0000 7f361a623640 1 Processor -- start 2024-09-11T22:20:46.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.338+0000 7f8ccacaf640 1 -- 172.21.15.100:0/133565545 wait complete. 2024-09-11T22:20:46.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.338+0000 7f9b29b0c640 1 -- 172.21.15.100:0/2830649295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b140042b0 msgr2=0x7f9b140141d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.338+0000 7f9b29b0c640 1 --2- 172.21.15.100:0/2830649295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b140042b0 0x7f9b140141d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c00c320 tx=0x7f9b14005830 comp rx=0 tx=0).stop 2024-09-11T22:20:46.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.338+0000 7f0b75f0a640 1 Processor -- start 2024-09-11T22:20:46.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.338+0000 7f9b29b0c640 1 -- 172.21.15.100:0/2830649295 shutdown_connections 2024-09-11T22:20:46.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.338+0000 7f9b29b0c640 1 --2- 172.21.15.100:0/2830649295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b140042b0 0x7f9b140141d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.338+0000 7f9b29b0c640 1 -- 172.21.15.100:0/2830649295 >> 172.21.15.100:0/2830649295 conn(0x7f9b2406ce30 msgr2=0x7f9b2406d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.339+0000 7f0b75f0a640 1 -- start start 2024-09-11T22:20:46.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.338+0000 7f803a853640 1 Processor -- start 2024-09-11T22:20:46.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.339+0000 7f803a853640 1 -- start start 2024-09-11T22:20:46.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.338+0000 7f361a623640 1 -- start start 2024-09-11T22:20:46.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.339+0000 7f9113fff640 1 -- 172.21.15.100:0/4277463827 shutdown_connections 2024-09-11T22:20:46.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.339+0000 7fbc263a6640 1 Processor -- start 2024-09-11T22:20:46.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.339+0000 7f361a623640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36140717a0 0x7f36141563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.339+0000 7fbc263a6640 1 -- start start 2024-09-11T22:20:46.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.339+0000 7f227c955640 1 Processor -- start 2024-09-11T22:20:46.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.339+0000 7f9113fff640 1 -- 172.21.15.100:0/4277463827 wait complete. 2024-09-11T22:20:46.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.339+0000 7f361a623640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36140c8b70 0x7f3614152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f3613fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36140717a0 0x7f36141563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f803a853640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f802c0d67d0 0x7f802c049200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f3613fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36140717a0 0x7f36141563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45104/0 (socket says 172.21.15.100:45104) 2024-09-11T22:20:46.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f227c955640 1 -- start start 2024-09-11T22:20:46.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f3613fff640 1 -- 172.21.15.100:0/4105516925 learned_addr learned my addr 172.21.15.100:0/4105516925 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f36137fe640 1 --2- 172.21.15.100:0/4105516925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36140c8b70 0x7f3614152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f0b75f0a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b700c5a90 0x7f0b700c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f0b75f0a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b700d0850 0x7f0b7015a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f0b75f0a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b7015d960 0x7f0b700c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f361a623640 1 --2- 172.21.15.100:0/4105516925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36141533e0 0x7f3614147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f8033fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f802c0d67d0 0x7f802c049200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f0b75f0a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7015eda0 con 0x7f0b700d0850 2024-09-11T22:20:46.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f8033fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f802c0d67d0 0x7f802c049200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47308/0 (socket says 172.21.15.100:47308) 2024-09-11T22:20:46.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f8033fff640 1 -- 172.21.15.100:0/3113499831 learned_addr learned my addr 172.21.15.100:0/3113499831 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f803a853640 1 --2- 172.21.15.100:0/3113499831 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f802c0dcf00 0x7f802c0d2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f803a853640 1 --2- 172.21.15.100:0/3113499831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f802c0d08a0 0x7f802c0d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f80337fe640 1 --2- 172.21.15.100:0/3113499831 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f802c0dcf00 0x7f802c0d2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f803a853640 1 -- 172.21.15.100:0/3113499831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f802c00ca60 con 0x7f802c0d67d0 2024-09-11T22:20:46.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f803a853640 1 -- 172.21.15.100:0/3113499831 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f802c00c780 con 0x7f802c0d08a0 2024-09-11T22:20:46.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f803a853640 1 -- 172.21.15.100:0/3113499831 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f802c00cdd0 con 0x7f802c0dcf00 2024-09-11T22:20:46.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f0b6effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b700d0850 0x7f0b7015a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f0b6f7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b700c5a90 0x7f0b700c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f0b6ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b7015d960 0x7f0b700c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f0b6effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b700d0850 0x7f0b7015a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47318/0 (socket says 172.21.15.100:47318) 2024-09-11T22:20:46.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f0b6effd640 1 -- 172.21.15.100:0/3737112913 learned_addr learned my addr 172.21.15.100:0/3737112913 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f0b75f0a640 1 -- 172.21.15.100:0/3737112913 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7015eac0 con 0x7f0b700c5a90 2024-09-11T22:20:46.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f0b75f0a640 1 -- 172.21.15.100:0/3737112913 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0b70154fe0 con 0x7f0b7015d960 2024-09-11T22:20:46.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f3618bc0640 1 --2- 172.21.15.100:0/4105516925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36141533e0 0x7f3614147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7fbc263a6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc200c5a90 0x7fbc2015d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7fbc263a6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc20154c00 0x7fbc200cf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7fbc263a6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc2015afb0 0x7fbc2014b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f361a623640 1 -- 172.21.15.100:0/4105516925 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3614073400 con 0x7f36141533e0 2024-09-11T22:20:46.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f361a623640 1 -- 172.21.15.100:0/4105516925 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3614073120 con 0x7f36140c8b70 2024-09-11T22:20:46.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f361a623640 1 -- 172.21.15.100:0/4105516925 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f36140736e0 con 0x7f36140717a0 2024-09-11T22:20:46.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7fbc263a6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2015eda0 con 0x7fbc200c5a90 2024-09-11T22:20:46.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7fbc263a6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2015eac0 con 0x7fbc2015afb0 2024-09-11T22:20:46.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7fbc263a6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbc20154fe0 con 0x7fbc20154c00 2024-09-11T22:20:46.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7fbc1f7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc20154c00 0x7fbc200cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f9113fff640 1 Processor -- start 2024-09-11T22:20:46.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f8ccacaf640 1 Processor -- start 2024-09-11T22:20:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7fbc1ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc200c5a90 0x7fbc2015d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7fbc1f7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc20154c00 0x7fbc200cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45132/0 (socket says 172.21.15.100:45132) 2024-09-11T22:20:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7fbc1f7fe640 1 -- 172.21.15.100:0/283316851 learned_addr learned my addr 172.21.15.100:0/283316851 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7fbc24943640 1 --2- 172.21.15.100:0/283316851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc2015afb0 0x7fbc2014b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f8033fff640 1 -- 172.21.15.100:0/3113499831 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f802c0dcf00 msgr2=0x7f802c0d2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f8033fff640 1 --2- 172.21.15.100:0/3113499831 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f802c0dcf00 0x7f802c0d2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f8033fff640 1 -- 172.21.15.100:0/3113499831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f802c0d08a0 msgr2=0x7f802c0d26c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:20:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f8033fff640 1 --2- 172.21.15.100:0/3113499831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f802c0d08a0 0x7f802c0d26c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f8033fff640 1 -- 172.21.15.100:0/3113499831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f802c04c160 con 0x7f802c0d67d0 2024-09-11T22:20:46.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f9b29b0c640 1 -- 172.21.15.100:0/2830649295 shutdown_connections 2024-09-11T22:20:46.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f9b29b0c640 1 -- 172.21.15.100:0/2830649295 wait complete. 2024-09-11T22:20:46.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f0b6ffff640 1 -- 172.21.15.100:0/3737112913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b700c5a90 msgr2=0x7f0b700c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f0b6ffff640 1 --2- 172.21.15.100:0/3737112913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b700c5a90 0x7f0b700c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f0b6ffff640 1 -- 172.21.15.100:0/3737112913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b700d0850 msgr2=0x7f0b7015a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f0b6ffff640 1 --2- 172.21.15.100:0/3737112913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0b700d0850 0x7f0b7015a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f0b6ffff640 1 -- 172.21.15.100:0/3737112913 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b701f1630 con 0x7f0b7015d960 2024-09-11T22:20:46.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f9113fff640 1 -- start start 2024-09-11T22:20:46.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f227c955640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2270008ad0 0x7f22700dff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.340+0000 7f8ccacaf640 1 -- start start 2024-09-11T22:20:46.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f8ccacaf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cc40cbc90 0x7f8cc4200c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f8ccacaf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cc4154a30 0x7f8cc41597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f8ccacaf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cc416de10 0x7f8cc40cf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f8ccacaf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc40cb770 con 0x7f8cc4154a30 2024-09-11T22:20:46.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f8ccacaf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc40cb490 con 0x7f8cc416de10 2024-09-11T22:20:46.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f8ccacaf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8cc4154e80 con 0x7f8cc40cbc90 2024-09-11T22:20:46.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f8cc9cad640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cc40cbc90 0x7f8cc4200c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f8cc9cad640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cc40cbc90 0x7f8cc4200c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45142/0 (socket says 172.21.15.100:45142) 2024-09-11T22:20:46.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f8cc9cad640 1 -- 172.21.15.100:0/3406617426 learned_addr learned my addr 172.21.15.100:0/3406617426 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f8cc94ac640 1 --2- 172.21.15.100:0/3406617426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cc4154a30 0x7f8cc41597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.341+0000 7f8cca4ae640 1 --2- 172.21.15.100:0/3406617426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cc416de10 0x7f8cc40cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f0b6ffff640 1 --2- 172.21.15.100:0/3737112913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b7015d960 0x7f0b700c8b00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800c390 tx=0x7f0b5800c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f227c955640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22700dcd30 0x7f22700e1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7fbc1f7fe640 1 -- 172.21.15.100:0/283316851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc2015afb0 msgr2=0x7fbc2014b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7fbc1f7fe640 1 --2- 172.21.15.100:0/283316851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc2015afb0 0x7fbc2014b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7fbc1f7fe640 1 -- 172.21.15.100:0/283316851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc200c5a90 msgr2=0x7fbc2015d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7fbc1f7fe640 1 --2- 172.21.15.100:0/283316851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc200c5a90 0x7fbc2015d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7fbc1f7fe640 1 -- 172.21.15.100:0/283316851 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2014fde0 con 0x7fbc20154c00 2024-09-11T22:20:46.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f227c955640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22700e2b10 0x7f22700cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f227c955640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2270007bc0 con 0x7f22700e2b10 2024-09-11T22:20:46.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f0b67fff640 1 -- 172.21.15.100:0/3737112913 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b58017070 con 0x7f0b7015d960 2024-09-11T22:20:46.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f0b67fff640 1 -- 172.21.15.100:0/3737112913 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b58005ce0 con 0x7f0b7015d960 2024-09-11T22:20:46.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f0b67fff640 1 -- 172.21.15.100:0/3737112913 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b580072f0 con 0x7f0b7015d960 2024-09-11T22:20:46.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f2276ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22700dcd30 0x7f22700e1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f0b75f0a640 1 -- 172.21.15.100:0/3737112913 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b7015b960 con 0x7f0b7015d960 2024-09-11T22:20:46.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f0b75f0a640 1 -- 172.21.15.100:0/3737112913 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b7015bf20 con 0x7f0b7015d960 2024-09-11T22:20:46.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f227c955640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f22700078e0 con 0x7f2270008ad0 2024-09-11T22:20:46.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f227c955640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f22700dd110 con 0x7f22700dcd30 2024-09-11T22:20:46.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f3618bc0640 1 -- 172.21.15.100:0/4105516925 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36140717a0 msgr2=0x7f36141563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f3618bc0640 1 --2- 172.21.15.100:0/4105516925 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36140717a0 0x7f36141563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f3618bc0640 1 -- 172.21.15.100:0/4105516925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36140c8b70 msgr2=0x7f3614152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f3618bc0640 1 --2- 172.21.15.100:0/4105516925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36140c8b70 0x7f3614152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f3618bc0640 1 -- 172.21.15.100:0/4105516925 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36141f6010 con 0x7f36141533e0 2024-09-11T22:20:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7fbc1f7fe640 1 --2- 172.21.15.100:0/283316851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc20154c00 0x7fbc200cf280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbc140098f0 tx=0x7fbc140046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f8cc9cad640 1 -- 172.21.15.100:0/3406617426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cc416de10 msgr2=0x7f8cc40cf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f8cc9cad640 1 --2- 172.21.15.100:0/3406617426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cc416de10 0x7f8cc40cf380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f8cc9cad640 1 -- 172.21.15.100:0/3406617426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cc4154a30 msgr2=0x7f8cc41597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f8cc9cad640 1 --2- 172.21.15.100:0/3406617426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8cc4154a30 0x7f8cc41597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f8cc9cad640 1 -- 172.21.15.100:0/3406617426 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc42011a0 con 0x7f8cc40cbc90 2024-09-11T22:20:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f22777fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2270008ad0 0x7f22700dff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f9113fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f910c005e30 0x7f910c0d89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7f9113fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f910c006250 0x7f910c04e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7f9113fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f910c0d93c0 0x7f910c0df420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7f8cc9cad640 1 --2- 172.21.15.100:0/3406617426 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cc40cbc90 0x7f8cc4200c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0009860 tx=0x7f8cc00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7f3618bc0640 1 --2- 172.21.15.100:0/4105516925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36141533e0 0x7f3614147fe0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f360c007e60 tx=0x7f360c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7fbc1cff9640 1 -- 172.21.15.100:0/283316851 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc14040030 con 0x7fbc20154c00 2024-09-11T22:20:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7f9112ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f910c005e30 0x7f910c0d89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7f9113fff640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f910c0e2960 con 0x7f910c0d93c0 2024-09-11T22:20:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7f9113fff640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f910c0d97a0 con 0x7f910c005e30 2024-09-11T22:20:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7f9113fff640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f910c0e2ae0 con 0x7f910c006250 2024-09-11T22:20:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7fbc1cff9640 1 -- 172.21.15.100:0/283316851 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc14038040 con 0x7fbc20154c00 2024-09-11T22:20:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7fbc1cff9640 1 -- 172.21.15.100:0/283316851 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc14037070 con 0x7fbc20154c00 2024-09-11T22:20:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7fbc263a6640 1 -- 172.21.15.100:0/283316851 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc2014b5a0 con 0x7fbc20154c00 2024-09-11T22:20:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7fbc263a6640 1 -- 172.21.15.100:0/283316851 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc2015d200 con 0x7fbc20154c00 2024-09-11T22:20:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f8033fff640 1 --2- 172.21.15.100:0/3113499831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f802c0d67d0 0x7f802c049200 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8034051500 tx=0x7f803406bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f8030ff9640 1 -- 172.21.15.100:0/3113499831 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80340c2070 con 0x7f802c0d67d0 2024-09-11T22:20:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f2276ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22700dcd30 0x7f22700e1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45146/0 (socket says 172.21.15.100:45146) 2024-09-11T22:20:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.342+0000 7f2276ffd640 1 -- 172.21.15.100:0/3102690777 learned_addr learned my addr 172.21.15.100:0/3102690777 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7f2277fff640 1 --2- 172.21.15.100:0/3102690777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22700e2b10 0x7f22700cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7f803a853640 1 -- 172.21.15.100:0/3113499831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f802c0dbc50 con 0x7f802c0d67d0 2024-09-11T22:20:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7f9112ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f910c005e30 0x7f910c0d89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44114/0 (socket says 172.21.15.100:44114) 2024-09-11T22:20:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7f9112ffd640 1 -- 172.21.15.100:0/3528258122 learned_addr learned my addr 172.21.15.100:0/3528258122 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7f91127fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f910c006250 0x7f910c04e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7f9112ffd640 1 -- 172.21.15.100:0/3528258122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f910c006250 msgr2=0x7f910c04e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7f9112ffd640 1 --2- 172.21.15.100:0/3528258122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f910c006250 0x7f910c04e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7f9112ffd640 1 -- 172.21.15.100:0/3528258122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f910c0d93c0 msgr2=0x7f910c0df420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7f9112ffd640 1 --2- 172.21.15.100:0/3528258122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f910c0d93c0 0x7f910c0df420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7f9112ffd640 1 -- 172.21.15.100:0/3528258122 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910c178250 con 0x7f910c005e30 2024-09-11T22:20:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.344+0000 7f3610ff9640 1 -- 172.21.15.100:0/4105516925 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c01a070 con 0x7f36141533e0 2024-09-11T22:20:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.344+0000 7f361a623640 1 -- 172.21.15.100:0/4105516925 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36140c3280 con 0x7f36141533e0 2024-09-11T22:20:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.344+0000 7f361a623640 1 -- 172.21.15.100:0/4105516925 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36141f5870 con 0x7f36141533e0 2024-09-11T22:20:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.344+0000 7f8cba7fc640 1 -- 172.21.15.100:0/3406617426 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0040020 con 0x7f8cc40cbc90 2024-09-11T22:20:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.344+0000 7f8cba7fc640 1 -- 172.21.15.100:0/3406617426 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cc0038040 con 0x7f8cc40cbc90 2024-09-11T22:20:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.344+0000 7f8cba7fc640 1 -- 172.21.15.100:0/3406617426 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0037070 con 0x7f8cc40cbc90 2024-09-11T22:20:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7f9b29b0c640 1 Processor -- start 2024-09-11T22:20:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7f9b29b0c640 1 -- start start 2024-09-11T22:20:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.344+0000 7f9b29b0c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b140042b0 0x7f9b2415c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.344+0000 7f9b29b0c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b24149850 0x7f9b24148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.344+0000 7f9b29b0c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b24153930 0x7f9b240cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.344+0000 7f9b237fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b140042b0 0x7f9b2415c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7f9b237fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b140042b0 0x7f9b2415c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44126/0 (socket says 172.21.15.100:44126) 2024-09-11T22:20:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7f9b237fe640 1 -- 172.21.15.100:0/553965137 learned_addr learned my addr 172.21.15.100:0/553965137 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.344+0000 7f9b22ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b24149850 0x7f9b24148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7f9b29b0c640 1 -- 172.21.15.100:0/553965137 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2415dd30 con 0x7f9b24153930 2024-09-11T22:20:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7f9b29b0c640 1 -- 172.21.15.100:0/553965137 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2415b370 con 0x7f9b140042b0 2024-09-11T22:20:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7f9b29b0c640 1 -- 172.21.15.100:0/553965137 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9b2415a700 con 0x7f9b24149850 2024-09-11T22:20:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7f803a853640 1 -- 172.21.15.100:0/3113499831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f802c0dc210 con 0x7f802c0d67d0 2024-09-11T22:20:46.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7f8030ff9640 1 -- 172.21.15.100:0/3113499831 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80340bd450 con 0x7f802c0d67d0 2024-09-11T22:20:46.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.343+0000 7f8030ff9640 1 -- 172.21.15.100:0/3113499831 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80340bd800 con 0x7f802c0d67d0 2024-09-11T22:20:46.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.344+0000 7f801e7fc640 1 -- 172.21.15.100:0/3113499831 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f802c0dd320 con 0x7f802c0d67d0 2024-09-11T22:20:46.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.344+0000 7f2277fff640 1 -- 172.21.15.100:0/3102690777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22700dcd30 msgr2=0x7f22700e1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.344+0000 7f2277fff640 1 --2- 172.21.15.100:0/3102690777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22700dcd30 0x7f22700e1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.344+0000 7f2277fff640 1 -- 172.21.15.100:0/3102690777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2270008ad0 msgr2=0x7f22700dff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.344+0000 7f2277fff640 1 --2- 172.21.15.100:0/3102690777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2270008ad0 0x7f22700dff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.344+0000 7f2277fff640 1 -- 172.21.15.100:0/3102690777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22700d83e0 con 0x7f22700e2b10 2024-09-11T22:20:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.344+0000 7f2276ffd640 1 --2- 172.21.15.100:0/3102690777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22700dcd30 0x7f22700e1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7f2277fff640 1 --2- 172.21.15.100:0/3102690777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22700e2b10 0x7f22700cd460 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2278065240 tx=0x7f227806bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7f2263fff640 1 -- 172.21.15.100:0/3102690777 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22780c4070 con 0x7f22700e2b10 2024-09-11T22:20:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7f2263fff640 1 -- 172.21.15.100:0/3102690777 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22780b5c10 con 0x7f22700e2b10 2024-09-11T22:20:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7f2263fff640 1 -- 172.21.15.100:0/3102690777 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22780af040 con 0x7f22700e2b10 2024-09-11T22:20:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7f8ccacaf640 1 -- 172.21.15.100:0/3406617426 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cc41594b0 con 0x7f8cc40cbc90 2024-09-11T22:20:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7f227c955640 1 -- 172.21.15.100:0/3102690777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22700defb0 con 0x7f22700e2b10 2024-09-11T22:20:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7f227c955640 1 -- 172.21.15.100:0/3102690777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22700d8650 con 0x7f22700e2b10 2024-09-11T22:20:46.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7f9b237fe640 1 -- 172.21.15.100:0/553965137 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b24149850 msgr2=0x7f9b24148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7f9b237fe640 1 --2- 172.21.15.100:0/553965137 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b24149850 0x7f9b24148130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7f9b237fe640 1 -- 172.21.15.100:0/553965137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b24153930 msgr2=0x7f9b240cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7f9b237fe640 1 --2- 172.21.15.100:0/553965137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b24153930 0x7f9b240cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7f9b237fe640 1 -- 172.21.15.100:0/553965137 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2415d4c0 con 0x7f9b140042b0 2024-09-11T22:20:46.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7f9112ffd640 1 --2- 172.21.15.100:0/3528258122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f910c005e30 0x7f910c0d89a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9114065710 tx=0x7f9114069df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.344+0000 7f0b67fff640 1 -- 172.21.15.100:0/3737112913 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b5801a070 con 0x7f0b7015d960 2024-09-11T22:20:46.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.344+0000 7f0b65ffb640 1 -- 172.21.15.100:0/3737112913 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0b700c5690 con 0x7f0b7015d960 2024-09-11T22:20:46.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7f0b67fff640 1 --2- 172.21.15.100:0/3737112913 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0b5006bf00 0x7f0b5006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7f0b67fff640 1 -- 172.21.15.100:0/3737112913 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0b5808a2f0 con 0x7f0b7015d960 2024-09-11T22:20:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7f0b67fff640 1 --2- 172.21.15.100:0/3737112913 >> [v2:172.21.15.167:6808/2825112504,v1:172.21.15.167:6809/2825112504] conn(0x7f0b500755f0 0x7f0b50077a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7f0b67fff640 1 -- 172.21.15.100:0/3737112913 --> [v2:172.21.15.167:6808/2825112504,v1:172.21.15.167:6809/2825112504] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b50078100 con 0x7f0b500755f0 2024-09-11T22:20:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.346+0000 7f0b6effd640 1 --2- 172.21.15.100:0/3737112913 >> [v2:172.21.15.167:6808/2825112504,v1:172.21.15.167:6809/2825112504] conn(0x7f0b500755f0 0x7f0b50077a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.346+0000 7f90fbfff640 1 -- 172.21.15.100:0/3528258122 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91140bc070 con 0x7f910c005e30 2024-09-11T22:20:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.346+0000 7f90fbfff640 1 -- 172.21.15.100:0/3528258122 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91140b6430 con 0x7f910c005e30 2024-09-11T22:20:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.346+0000 7f90fbfff640 1 -- 172.21.15.100:0/3528258122 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91140b0040 con 0x7f910c005e30 2024-09-11T22:20:46.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.346+0000 7f227c955640 1 -- 172.21.15.100:0/3102690777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2258001030 con 0x7f22700e2b10 2024-09-11T22:20:46.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.346+0000 7f0b67fff640 1 -- 172.21.15.100:0/3737112913 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0b58054620 con 0x7f0b7015d960 2024-09-11T22:20:46.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.346+0000 7f9b237fe640 1 --2- 172.21.15.100:0/553965137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b140042b0 0x7f9b2415c080 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800fb10 tx=0x7f9b18001880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7f8ccacaf640 1 -- 172.21.15.100:0/3406617426 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cc40c9ff0 con 0x7f8cc40cbc90 2024-09-11T22:20:46.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.346+0000 7f0b6effd640 1 --2- 172.21.15.100:0/3737112913 >> [v2:172.21.15.167:6808/2825112504,v1:172.21.15.167:6809/2825112504] conn(0x7f0b500755f0 0x7f0b50077a30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.347+0000 7f8ccacaf640 1 -- 172.21.15.100:0/3406617426 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8cc4157af0 con 0x7f8cc40cbc90 2024-09-11T22:20:46.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.347+0000 7f0b6f7fe640 1 --2- 172.21.15.100:0/3737112913 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0b5006bf00 0x7f0b5006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.347+0000 7f9b0ffff640 1 -- 172.21.15.100:0/553965137 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b18018020 con 0x7f9b140042b0 2024-09-11T22:20:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.347+0000 7f9113fff640 1 -- 172.21.15.100:0/3528258122 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f910c178510 con 0x7f910c005e30 2024-09-11T22:20:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.347+0000 7f9113fff640 1 -- 172.21.15.100:0/3528258122 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f910c0e4b00 con 0x7f910c005e30 2024-09-11T22:20:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.346+0000 7f8030ff9640 1 -- 172.21.15.100:0/3113499831 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f80340c5070 con 0x7f802c0d67d0 2024-09-11T22:20:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.347+0000 7f8030ff9640 1 --2- 172.21.15.100:0/3113499831 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f801806bf30 0x7f801806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7fbc263a6640 1 -- 172.21.15.100:0/283316851 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbc200c5690 con 0x7fbc20154c00 2024-09-11T22:20:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.345+0000 7fbc1cff9640 1 -- 172.21.15.100:0/283316851 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc14043070 con 0x7fbc20154c00 2024-09-11T22:20:46.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.346+0000 7fbc1cff9640 1 --2- 172.21.15.100:0/283316851 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbc0c06bf00 0x7fbc0c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.346+0000 7fbc1cff9640 1 -- 172.21.15.100:0/283316851 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbc140ab240 con 0x7fbc20154c00 2024-09-11T22:20:46.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.346+0000 7fbc1cff9640 1 --2- 172.21.15.100:0/283316851 >> [v2:172.21.15.100:6800/1802107101,v1:172.21.15.100:6801/1802107101] conn(0x7fbc0c075600 0x7fbc0c077a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.346+0000 7fbc1cff9640 1 -- 172.21.15.100:0/283316851 --> [v2:172.21.15.100:6800/1802107101,v1:172.21.15.100:6801/1802107101] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbc0c078110 con 0x7fbc0c075600 2024-09-11T22:20:46.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.347+0000 7fbc24943640 1 --2- 172.21.15.100:0/283316851 >> [v2:172.21.15.100:6800/1802107101,v1:172.21.15.100:6801/1802107101] conn(0x7fbc0c075600 0x7fbc0c077a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.347+0000 7f8030ff9640 1 -- 172.21.15.100:0/3113499831 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8034127de0 con 0x7f802c0d67d0 2024-09-11T22:20:46.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.347+0000 7f9b29b0c640 1 -- 172.21.15.100:0/553965137 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b2415da60 con 0x7f9b140042b0 2024-09-11T22:20:46.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.347+0000 7f8030ff9640 1 --2- 172.21.15.100:0/3113499831 >> [v2:172.21.15.167:6800/1337015843,v1:172.21.15.167:6801/1337015843] conn(0x7f8018075620 0x7f8018077a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.347+0000 7f8030ff9640 1 -- 172.21.15.100:0/3113499831 --> [v2:172.21.15.167:6800/1337015843,v1:172.21.15.167:6801/1337015843] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f803406de60 con 0x7f8018075620 2024-09-11T22:20:46.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.347+0000 7f9b29b0c640 1 -- 172.21.15.100:0/553965137 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b24148d70 con 0x7f9b140042b0 2024-09-11T22:20:46.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.347+0000 7f9b0ffff640 1 -- 172.21.15.100:0/553965137 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b1800daf0 con 0x7f9b140042b0 2024-09-11T22:20:46.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.347+0000 7fbc1cff9640 1 -- 172.21.15.100:0/283316851 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbc140b2050 con 0x7fbc20154c00 2024-09-11T22:20:46.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.347+0000 7f9b0ffff640 1 -- 172.21.15.100:0/553965137 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b18014470 con 0x7f9b140042b0 2024-09-11T22:20:46.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.347+0000 7f0b67fff640 1 -- 172.21.15.100:0/3737112913 <== osd.6 v2:172.21.15.167:6808/2825112504 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0b50078100 con 0x7f0b500755f0 2024-09-11T22:20:46.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.346+0000 7f35fa7fc640 1 -- 172.21.15.100:0/4105516925 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f35f4001030 con 0x7f36141533e0 2024-09-11T22:20:46.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.347+0000 7f3610ff9640 1 -- 172.21.15.100:0/4105516925 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f360c003b90 con 0x7f36141533e0 2024-09-11T22:20:46.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.347+0000 7f3610ff9640 1 -- 172.21.15.100:0/4105516925 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c00de20 con 0x7f36141533e0 2024-09-11T22:20:46.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.348+0000 7f8030ff9640 1 -- 172.21.15.100:0/3113499831 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f80340f2110 con 0x7f802c0d67d0 2024-09-11T22:20:46.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.348+0000 7f0b6f7fe640 1 --2- 172.21.15.100:0/3737112913 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0b5006bf00 0x7f0b5006e3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0b68034000 tx=0x7f0b6802f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.348+0000 7f8cba7fc640 1 -- 172.21.15.100:0/3406617426 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8cc0043020 con 0x7f8cc40cbc90 2024-09-11T22:20:46.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.347+0000 7fbc1ffff640 1 --2- 172.21.15.100:0/283316851 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbc0c06bf00 0x7fbc0c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.348+0000 7f8cba7fc640 1 --2- 172.21.15.100:0/3406617426 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8ca806beb0 0x7f8ca806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.349+0000 7f9113fff640 1 -- 172.21.15.100:0/3528258122 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f910c051640 con 0x7f910c005e30 2024-09-11T22:20:46.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.349+0000 7f2263fff640 1 -- 172.21.15.100:0/3102690777 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f22780b2070 con 0x7f22700e2b10 2024-09-11T22:20:46.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.349+0000 7f90fbfff640 1 -- 172.21.15.100:0/3528258122 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f91140c7060 con 0x7f910c005e30 2024-09-11T22:20:46.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.349+0000 7f3610ff9640 1 -- 172.21.15.100:0/4105516925 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f360c01d070 con 0x7f36141533e0 2024-09-11T22:20:46.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.350+0000 7f3610ff9640 1 --2- 172.21.15.100:0/4105516925 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f360006bf00 0x7f360006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.349+0000 7f8cba7fc640 1 -- 172.21.15.100:0/3406617426 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8cc00775b0 con 0x7f8cc40cbc90 2024-09-11T22:20:46.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.349+0000 7f8cba7fc640 1 --2- 172.21.15.100:0/3406617426 >> [v2:172.21.15.167:6816/736010951,v1:172.21.15.167:6817/736010951] conn(0x7f8ca8076270 0x7f8ca8078710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.349+0000 7f8cba7fc640 1 -- 172.21.15.100:0/3406617426 --> [v2:172.21.15.167:6816/736010951,v1:172.21.15.167:6817/736010951] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ca8078de0 con 0x7f8ca8076270 2024-09-11T22:20:46.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.349+0000 7f8cc94ac640 1 --2- 172.21.15.100:0/3406617426 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8ca806beb0 0x7f8ca806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.348+0000 7fbc24943640 1 --2- 172.21.15.100:0/283316851 >> [v2:172.21.15.100:6800/1802107101,v1:172.21.15.100:6801/1802107101] conn(0x7fbc0c075600 0x7fbc0c077a40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.350+0000 7fbc1cff9640 1 -- 172.21.15.100:0/283316851 <== osd.1 v2:172.21.15.100:6800/1802107101 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbc0c078110 con 0x7fbc0c075600 2024-09-11T22:20:46.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.349+0000 7f9b0ffff640 1 -- 172.21.15.100:0/553965137 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9b1801b020 con 0x7f9b140042b0 2024-09-11T22:20:46.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.349+0000 7f9b29b0c640 1 -- 172.21.15.100:0/553965137 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9b04001030 con 0x7f9b140042b0 2024-09-11T22:20:46.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.350+0000 7f8cca4ae640 1 --2- 172.21.15.100:0/3406617426 >> [v2:172.21.15.167:6816/736010951,v1:172.21.15.167:6817/736010951] conn(0x7f8ca8076270 0x7f8ca8078710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.350+0000 7f90fbfff640 1 --2- 172.21.15.100:0/3528258122 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f910006bf00 0x7f910006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.349+0000 7f80337fe640 1 --2- 172.21.15.100:0/3113499831 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f801806bf30 0x7f801806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.350+0000 7fbc1ffff640 1 --2- 172.21.15.100:0/283316851 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbc0c06bf00 0x7fbc0c06e3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbc100070b0 tx=0x7fbc10009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.350+0000 7f80337fe640 1 --2- 172.21.15.100:0/3113499831 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f801806bf30 0x7f801806e3f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f802c0cb860 tx=0x7f8028009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.350+0000 7f90fbfff640 1 -- 172.21.15.100:0/3528258122 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9114127d30 con 0x7f910c005e30 2024-09-11T22:20:46.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.350+0000 7f8cba7fc640 1 -- 172.21.15.100:0/3406617426 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8cc0075f40 con 0x7f8cc40cbc90 2024-09-11T22:20:46.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.350+0000 7f8038df0640 1 --2- 172.21.15.100:0/3113499831 >> [v2:172.21.15.167:6800/1337015843,v1:172.21.15.167:6801/1337015843] conn(0x7f8018075620 0x7f8018077a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.350+0000 7f91127fc640 1 --2- 172.21.15.100:0/3528258122 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f910006bf00 0x7f910006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.350+0000 7f90fbfff640 1 --2- 172.21.15.100:0/3528258122 >> [v2:172.21.15.100:6816/644491349,v1:172.21.15.100:6817/644491349] conn(0x7f9100075670 0x7f9100077ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.350+0000 7f9b0ffff640 1 --2- 172.21.15.100:0/553965137 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9b0806bf30 0x7f9b0806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.350+0000 7f8cc94ac640 1 --2- 172.21.15.100:0/3406617426 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8ca806beb0 0x7f8ca806e370 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc001740 tx=0x7f8cbc001690 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.350+0000 7f90fbfff640 1 -- 172.21.15.100:0/3528258122 --> [v2:172.21.15.100:6816/644491349,v1:172.21.15.100:6817/644491349] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f91140b3ec0 con 0x7f9100075670 2024-09-11T22:20:46.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.350+0000 7f90fbfff640 1 -- 172.21.15.100:0/3528258122 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f911412a390 con 0x7f910c005e30 2024-09-11T22:20:46.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.350+0000 7f91137fe640 1 --2- 172.21.15.100:0/3528258122 >> [v2:172.21.15.100:6816/644491349,v1:172.21.15.100:6817/644491349] conn(0x7f9100075670 0x7f9100077ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.350+0000 7f8cca4ae640 1 --2- 172.21.15.100:0/3406617426 >> [v2:172.21.15.167:6816/736010951,v1:172.21.15.167:6817/736010951] conn(0x7f8ca8076270 0x7f8ca8078710 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.351+0000 7f91137fe640 1 --2- 172.21.15.100:0/3528258122 >> [v2:172.21.15.100:6816/644491349,v1:172.21.15.100:6817/644491349] conn(0x7f9100075670 0x7f9100077ab0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.350+0000 7f9b22ffd640 1 --2- 172.21.15.100:0/553965137 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9b0806bf30 0x7f9b0806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.351+0000 7f8038df0640 1 --2- 172.21.15.100:0/3113499831 >> [v2:172.21.15.167:6800/1337015843,v1:172.21.15.167:6801/1337015843] conn(0x7f8018075620 0x7f8018077a60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.351+0000 7f2263fff640 1 --2- 172.21.15.100:0/3102690777 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f225c06be30 0x7f225c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.351+0000 7f91127fc640 1 --2- 172.21.15.100:0/3528258122 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f910006bf00 0x7f910006e3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f910c16c300 tx=0x7f9104009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.351+0000 7f22777fe640 1 --2- 172.21.15.100:0/3102690777 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f225c06be30 0x7f225c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.351+0000 7f2263fff640 1 -- 172.21.15.100:0/3102690777 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2278127a90 con 0x7f22700e2b10 2024-09-11T22:20:46.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.351+0000 7f8cba7fc640 1 -- 172.21.15.100:0/3406617426 <== osd.4 v2:172.21.15.167:6816/736010951 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8ca8078de0 con 0x7f8ca8076270 2024-09-11T22:20:46.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.351+0000 7f2263fff640 1 --2- 172.21.15.100:0/3102690777 >> [v2:172.21.15.100:6808/2008454847,v1:172.21.15.100:6809/2008454847] conn(0x7f225c075530 0x7f225c077970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.351+0000 7f2263fff640 1 -- 172.21.15.100:0/3102690777 --> [v2:172.21.15.100:6808/2008454847,v1:172.21.15.100:6809/2008454847] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f22780b6e50 con 0x7f225c075530 2024-09-11T22:20:46.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.351+0000 7f2263fff640 1 -- 172.21.15.100:0/3102690777 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2278127e40 con 0x7f22700e2b10 2024-09-11T22:20:46.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.351+0000 7f9b0ffff640 1 -- 172.21.15.100:0/553965137 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9b1808b8f0 con 0x7f9b140042b0 2024-09-11T22:20:46.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.351+0000 7f9b22ffd640 1 --2- 172.21.15.100:0/553965137 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9b0806bf30 0x7f9b0806e3f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9b2406d660 tx=0x7f9b10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.351+0000 7f9b0ffff640 1 --2- 172.21.15.100:0/553965137 >> [v2:172.21.15.167:6824/2479173909,v1:172.21.15.167:6825/2479173909] conn(0x7f9b080756b0 0x7f9b08077af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.351+0000 7f9b0ffff640 1 -- 172.21.15.100:0/553965137 --> [v2:172.21.15.167:6824/2479173909,v1:172.21.15.167:6825/2479173909] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b1801ee50 con 0x7f9b080756b0 2024-09-11T22:20:46.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.351+0000 7f9b0ffff640 1 -- 172.21.15.100:0/553965137 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9b18092050 con 0x7f9b140042b0 2024-09-11T22:20:46.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.352+0000 7f8030ff9640 1 -- 172.21.15.100:0/3113499831 <== osd.7 v2:172.21.15.167:6800/1337015843 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f803406de60 con 0x7f8018075620 2024-09-11T22:20:46.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.352+0000 7f2276ffd640 1 --2- 172.21.15.100:0/3102690777 >> [v2:172.21.15.100:6808/2008454847,v1:172.21.15.100:6809/2008454847] conn(0x7f225c075530 0x7f225c077970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.351+0000 7f3610ff9640 1 -- 172.21.15.100:0/4105516925 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f360c08b400 con 0x7f36141533e0 2024-09-11T22:20:46.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.352+0000 7f3610ff9640 1 --2- 172.21.15.100:0/4105516925 >> [v2:172.21.15.100:6824/2519160882,v1:172.21.15.100:6825/2519160882] conn(0x7f3600075670 0x7f3600077ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.352+0000 7f22777fe640 1 --2- 172.21.15.100:0/3102690777 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f225c06be30 0x7f225c06e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f22700d7b20 tx=0x7f226c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.352+0000 7f3610ff9640 1 -- 172.21.15.100:0/4105516925 --> [v2:172.21.15.100:6824/2519160882,v1:172.21.15.100:6825/2519160882] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3600078180 con 0x7f3600075670 2024-09-11T22:20:46.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.352+0000 7f3610ff9640 1 -- 172.21.15.100:0/4105516925 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f360c092050 con 0x7f36141533e0 2024-09-11T22:20:46.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.352+0000 7f36137fe640 1 --2- 172.21.15.100:0/4105516925 >> [v2:172.21.15.100:6824/2519160882,v1:172.21.15.100:6825/2519160882] conn(0x7f3600075670 0x7f3600077ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.352+0000 7f3613fff640 1 --2- 172.21.15.100:0/4105516925 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f360006bf00 0x7f360006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.352+0000 7f2276ffd640 1 --2- 172.21.15.100:0/3102690777 >> [v2:172.21.15.100:6808/2008454847,v1:172.21.15.100:6809/2008454847] conn(0x7f225c075530 0x7f225c077970 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.353+0000 7f36137fe640 1 --2- 172.21.15.100:0/4105516925 >> [v2:172.21.15.100:6824/2519160882,v1:172.21.15.100:6825/2519160882] conn(0x7f3600075670 0x7f3600077ab0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.352+0000 7f90fbfff640 1 -- 172.21.15.100:0/3528258122 <== osd.2 v2:172.21.15.100:6816/644491349 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f91140b3ec0 con 0x7f9100075670 2024-09-11T22:20:46.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.353+0000 7f3613fff640 1 --2- 172.21.15.100:0/4105516925 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f360006bf00 0x7f360006e3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3608000f60 tx=0x7f3608007e10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.353+0000 7f2263fff640 1 -- 172.21.15.100:0/3102690777 <== osd.0 v2:172.21.15.100:6808/2008454847 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f22780b6e50 con 0x7f225c075530 2024-09-11T22:20:46.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.354+0000 7f9b23fff640 1 --2- 172.21.15.100:0/553965137 >> [v2:172.21.15.167:6824/2479173909,v1:172.21.15.167:6825/2479173909] conn(0x7f9b080756b0 0x7f9b08077af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.354+0000 7f3610ff9640 1 -- 172.21.15.100:0/4105516925 <== osd.3 v2:172.21.15.100:6824/2519160882 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3600078180 con 0x7f3600075670 2024-09-11T22:20:46.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.355+0000 7f9b23fff640 1 --2- 172.21.15.100:0/553965137 >> [v2:172.21.15.167:6824/2479173909,v1:172.21.15.167:6825/2479173909] conn(0x7f9b080756b0 0x7f9b08077af0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.356+0000 7f9b0ffff640 1 -- 172.21.15.100:0/553965137 <== osd.5 v2:172.21.15.167:6824/2479173909 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9b1801ee50 con 0x7f9b080756b0 2024-09-11T22:20:46.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.379+0000 7f0b65ffb640 1 -- 172.21.15.100:0/3737112913 --> [v2:172.21.15.167:6808/2825112504,v1:172.21.15.167:6809/2825112504] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0b700b2f50 con 0x7f0b500755f0 2024-09-11T22:20:46.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.379+0000 7f8ccacaf640 1 -- 172.21.15.100:0/3406617426 --> [v2:172.21.15.167:6816/736010951,v1:172.21.15.167:6817/736010951] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8cc40cc0c0 con 0x7f8ca8076270 2024-09-11T22:20:46.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.380+0000 7fbc263a6640 1 -- 172.21.15.100:0/283316851 --> [v2:172.21.15.100:6800/1802107101,v1:172.21.15.100:6801/1802107101] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbc200cbe60 con 0x7fbc0c075600 2024-09-11T22:20:46.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.380+0000 7fbc1cff9640 1 -- 172.21.15.100:0/283316851 <== osd.1 v2:172.21.15.100:6800/1802107101 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbc200cbe60 con 0x7fbc0c075600 2024-09-11T22:20:46.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.380+0000 7f8cba7fc640 1 -- 172.21.15.100:0/3406617426 <== osd.4 v2:172.21.15.167:6816/736010951 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8cc40cc0c0 con 0x7f8ca8076270 2024-09-11T22:20:46.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7f8ccacaf640 1 -- 172.21.15.100:0/3406617426 >> [v2:172.21.15.167:6816/736010951,v1:172.21.15.167:6817/736010951] conn(0x7f8ca8076270 msgr2=0x7f8ca8078710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7f8ccacaf640 1 --2- 172.21.15.100:0/3406617426 >> [v2:172.21.15.167:6816/736010951,v1:172.21.15.167:6817/736010951] conn(0x7f8ca8076270 0x7f8ca8078710 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.380+0000 7f0b67fff640 1 -- 172.21.15.100:0/3737112913 <== osd.6 v2:172.21.15.167:6808/2825112504 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0b700b2f50 con 0x7f0b500755f0 2024-09-11T22:20:46.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.380+0000 7f0b75f0a640 1 -- 172.21.15.100:0/3737112913 >> [v2:172.21.15.167:6808/2825112504,v1:172.21.15.167:6809/2825112504] conn(0x7f0b500755f0 msgr2=0x7f0b50077a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.380+0000 7f0b75f0a640 1 --2- 172.21.15.100:0/3737112913 >> [v2:172.21.15.167:6808/2825112504,v1:172.21.15.167:6809/2825112504] conn(0x7f0b500755f0 0x7f0b50077a30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7f8ccacaf640 1 -- 172.21.15.100:0/3406617426 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8ca806beb0 msgr2=0x7f8ca806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7f8ccacaf640 1 --2- 172.21.15.100:0/3406617426 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8ca806beb0 0x7f8ca806e370 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc001740 tx=0x7f8cbc001690 comp rx=0 tx=0).stop 2024-09-11T22:20:46.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7f8ccacaf640 1 -- 172.21.15.100:0/3406617426 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cc40cbc90 msgr2=0x7f8cc4200c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7f8ccacaf640 1 --2- 172.21.15.100:0/3406617426 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cc40cbc90 0x7f8cc4200c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0009860 tx=0x7f8cc00046c0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7f8cca4ae640 1 -- 172.21.15.100:0/3406617426 reap_dead start 2024-09-11T22:20:46.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7f8ccacaf640 1 -- 172.21.15.100:0/3406617426 shutdown_connections 2024-09-11T22:20:46.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7f0b75f0a640 1 -- 172.21.15.100:0/3737112913 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0b5006bf00 msgr2=0x7f0b5006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7f0b75f0a640 1 --2- 172.21.15.100:0/3737112913 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0b5006bf00 0x7f0b5006e3c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0b68034000 tx=0x7f0b6802f000 comp rx=0 tx=0).stop 2024-09-11T22:20:46.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7f0b75f0a640 1 -- 172.21.15.100:0/3737112913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b7015d960 msgr2=0x7f0b700c8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7f0b75f0a640 1 --2- 172.21.15.100:0/3737112913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b7015d960 0x7f0b700c8b00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800c390 tx=0x7f0b5800c850 comp rx=0 tx=0).stop 2024-09-11T22:20:46.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7f8ccacaf640 1 -- 172.21.15.100:0/3406617426 >> 172.21.15.100:0/3406617426 conn(0x7f8cc40d0190 msgr2=0x7f8cc4073760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7f0b6ffff640 1 -- 172.21.15.100:0/3737112913 reap_dead start 2024-09-11T22:20:46.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7fbc263a6640 1 -- 172.21.15.100:0/283316851 >> [v2:172.21.15.100:6800/1802107101,v1:172.21.15.100:6801/1802107101] conn(0x7fbc0c075600 msgr2=0x7fbc0c077a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7fbc263a6640 1 --2- 172.21.15.100:0/283316851 >> [v2:172.21.15.100:6800/1802107101,v1:172.21.15.100:6801/1802107101] conn(0x7fbc0c075600 0x7fbc0c077a40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7f0b75f0a640 1 -- 172.21.15.100:0/3737112913 shutdown_connections 2024-09-11T22:20:46.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7f0b75f0a640 1 -- 172.21.15.100:0/3737112913 >> 172.21.15.100:0/3737112913 conn(0x7f0b7006cf50 msgr2=0x7f0b700ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7f0b75f0a640 1 -- 172.21.15.100:0/3737112913 shutdown_connections 2024-09-11T22:20:46.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7f0b75f0a640 1 -- 172.21.15.100:0/3737112913 wait complete. 2024-09-11T22:20:46.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7fbc263a6640 1 -- 172.21.15.100:0/283316851 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbc0c06bf00 msgr2=0x7fbc0c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7fbc263a6640 1 --2- 172.21.15.100:0/283316851 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbc0c06bf00 0x7fbc0c06e3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbc100070b0 tx=0x7fbc10009040 comp rx=0 tx=0).stop 2024-09-11T22:20:46.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7fbc263a6640 1 -- 172.21.15.100:0/283316851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc20154c00 msgr2=0x7fbc200cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.381+0000 7fbc263a6640 1 --2- 172.21.15.100:0/283316851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc20154c00 0x7fbc200cf280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbc140098f0 tx=0x7fbc140046c0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.382+0000 7fbc24943640 1 -- 172.21.15.100:0/283316851 reap_dead start 2024-09-11T22:20:46.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.382+0000 7fbc263a6640 1 -- 172.21.15.100:0/283316851 shutdown_connections 2024-09-11T22:20:46.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.382+0000 7fbc263a6640 1 -- 172.21.15.100:0/283316851 >> 172.21.15.100:0/283316851 conn(0x7fbc2006cf50 msgr2=0x7fbc2014eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.382+0000 7f9113fff640 1 -- 172.21.15.100:0/3528258122 --> [v2:172.21.15.100:6816/644491349,v1:172.21.15.100:6817/644491349] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f910c16c050 con 0x7f9100075670 2024-09-11T22:20:46.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.382+0000 7fbc263a6640 1 -- 172.21.15.100:0/283316851 shutdown_connections 2024-09-11T22:20:46.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.382+0000 7fbc263a6640 1 -- 172.21.15.100:0/283316851 wait complete. 2024-09-11T22:20:46.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.382+0000 7f801e7fc640 1 -- 172.21.15.100:0/3113499831 --> [v2:172.21.15.167:6800/1337015843,v1:172.21.15.167:6801/1337015843] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f802c04ce70 con 0x7f8018075620 2024-09-11T22:20:46.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.382+0000 7f90fbfff640 1 -- 172.21.15.100:0/3528258122 <== osd.2 v2:172.21.15.100:6816/644491349 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f910c16c050 con 0x7f9100075670 2024-09-11T22:20:46.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.382+0000 7f8ccacaf640 1 -- 172.21.15.100:0/3406617426 shutdown_connections 2024-09-11T22:20:46.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.382+0000 7f8ccacaf640 1 -- 172.21.15.100:0/3406617426 wait complete. 2024-09-11T22:20:46.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.383+0000 7f9113fff640 1 -- 172.21.15.100:0/3528258122 >> [v2:172.21.15.100:6816/644491349,v1:172.21.15.100:6817/644491349] conn(0x7f9100075670 msgr2=0x7f9100077ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.383+0000 7f9113fff640 1 --2- 172.21.15.100:0/3528258122 >> [v2:172.21.15.100:6816/644491349,v1:172.21.15.100:6817/644491349] conn(0x7f9100075670 0x7f9100077ab0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.383+0000 7f8030ff9640 1 -- 172.21.15.100:0/3113499831 <== osd.7 v2:172.21.15.167:6800/1337015843 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f802c04ce70 con 0x7f8018075620 2024-09-11T22:20:46.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.383+0000 7f9113fff640 1 -- 172.21.15.100:0/3528258122 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f910006bf00 msgr2=0x7f910006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.383+0000 7f9113fff640 1 --2- 172.21.15.100:0/3528258122 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f910006bf00 0x7f910006e3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f910c16c300 tx=0x7f9104009190 comp rx=0 tx=0).stop 2024-09-11T22:20:46.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.383+0000 7f9113fff640 1 -- 172.21.15.100:0/3528258122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f910c005e30 msgr2=0x7f910c0d89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.383+0000 7f9113fff640 1 --2- 172.21.15.100:0/3528258122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f910c005e30 0x7f910c0d89a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9114065710 tx=0x7f9114069df0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.383+0000 7f91137fe640 1 -- 172.21.15.100:0/3528258122 reap_dead start 2024-09-11T22:20:46.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.383+0000 7f9113fff640 1 -- 172.21.15.100:0/3528258122 shutdown_connections 2024-09-11T22:20:46.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.383+0000 7f9113fff640 1 -- 172.21.15.100:0/3528258122 >> 172.21.15.100:0/3528258122 conn(0x7f910c00c230 msgr2=0x7f910c0e05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.383+0000 7f35fa7fc640 1 -- 172.21.15.100:0/4105516925 --> [v2:172.21.15.100:6824/2519160882,v1:172.21.15.100:6825/2519160882] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f35f4002dd0 con 0x7f3600075670 2024-09-11T22:20:46.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.384+0000 7f9113fff640 1 -- 172.21.15.100:0/3528258122 shutdown_connections 2024-09-11T22:20:46.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.384+0000 7f9113fff640 1 -- 172.21.15.100:0/3528258122 wait complete. 2024-09-11T22:20:46.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.384+0000 7f227c955640 1 -- 172.21.15.100:0/3102690777 --> [v2:172.21.15.100:6808/2008454847,v1:172.21.15.100:6809/2008454847] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2258002d50 con 0x7f225c075530 2024-09-11T22:20:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.384+0000 7f801e7fc640 1 -- 172.21.15.100:0/3113499831 >> [v2:172.21.15.167:6800/1337015843,v1:172.21.15.167:6801/1337015843] conn(0x7f8018075620 msgr2=0x7f8018077a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.384+0000 7f801e7fc640 1 --2- 172.21.15.100:0/3113499831 >> [v2:172.21.15.167:6800/1337015843,v1:172.21.15.167:6801/1337015843] conn(0x7f8018075620 0x7f8018077a60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.384+0000 7f3610ff9640 1 -- 172.21.15.100:0/4105516925 <== osd.3 v2:172.21.15.100:6824/2519160882 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f35f4002dd0 con 0x7f3600075670 2024-09-11T22:20:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.385+0000 7f2263fff640 1 -- 172.21.15.100:0/3102690777 <== osd.0 v2:172.21.15.100:6808/2008454847 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2258002d50 con 0x7f225c075530 2024-09-11T22:20:46.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.385+0000 7f35fa7fc640 1 -- 172.21.15.100:0/4105516925 >> [v2:172.21.15.100:6824/2519160882,v1:172.21.15.100:6825/2519160882] conn(0x7f3600075670 msgr2=0x7f3600077ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.385+0000 7f35fa7fc640 1 --2- 172.21.15.100:0/4105516925 >> [v2:172.21.15.100:6824/2519160882,v1:172.21.15.100:6825/2519160882] conn(0x7f3600075670 0x7f3600077ab0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.384+0000 7f801e7fc640 1 -- 172.21.15.100:0/3113499831 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f801806bf30 msgr2=0x7f801806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.384+0000 7f801e7fc640 1 --2- 172.21.15.100:0/3113499831 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f801806bf30 0x7f801806e3f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f802c0cb860 tx=0x7f8028009040 comp rx=0 tx=0).stop 2024-09-11T22:20:46.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.384+0000 7f801e7fc640 1 -- 172.21.15.100:0/3113499831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f802c0d67d0 msgr2=0x7f802c049200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.384+0000 7f801e7fc640 1 --2- 172.21.15.100:0/3113499831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f802c0d67d0 0x7f802c049200 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8034051500 tx=0x7f803406bb40 comp rx=0 tx=0).stop 2024-09-11T22:20:46.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.384+0000 7f8038df0640 1 -- 172.21.15.100:0/3113499831 reap_dead start 2024-09-11T22:20:46.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.385+0000 7f801e7fc640 1 -- 172.21.15.100:0/3113499831 shutdown_connections 2024-09-11T22:20:46.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.385+0000 7f801e7fc640 1 -- 172.21.15.100:0/3113499831 >> 172.21.15.100:0/3113499831 conn(0x7f802c00a150 msgr2=0x7f802c036be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.385+0000 7f35fa7fc640 1 -- 172.21.15.100:0/4105516925 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f360006bf00 msgr2=0x7f360006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.385+0000 7f35fa7fc640 1 --2- 172.21.15.100:0/4105516925 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f360006bf00 0x7f360006e3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3608000f60 tx=0x7f3608007e10 comp rx=0 tx=0).stop 2024-09-11T22:20:46.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.385+0000 7f35fa7fc640 1 -- 172.21.15.100:0/4105516925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36141533e0 msgr2=0x7f3614147fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.385+0000 7f35fa7fc640 1 --2- 172.21.15.100:0/4105516925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36141533e0 0x7f3614147fe0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f360c007e60 tx=0x7f360c00d4a0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.385+0000 7f801e7fc640 1 -- 172.21.15.100:0/3113499831 shutdown_connections 2024-09-11T22:20:46.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.385+0000 7f3618bc0640 1 -- 172.21.15.100:0/4105516925 reap_dead start 2024-09-11T22:20:46.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.385+0000 7f35fa7fc640 1 -- 172.21.15.100:0/4105516925 shutdown_connections 2024-09-11T22:20:46.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.385+0000 7f35fa7fc640 1 -- 172.21.15.100:0/4105516925 >> 172.21.15.100:0/4105516925 conn(0x7f361406f360 msgr2=0x7f361414f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.385+0000 7f801e7fc640 1 -- 172.21.15.100:0/3113499831 wait complete. 2024-09-11T22:20:46.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.385+0000 7f35fa7fc640 1 -- 172.21.15.100:0/4105516925 shutdown_connections 2024-09-11T22:20:46.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.385+0000 7f35fa7fc640 1 -- 172.21.15.100:0/4105516925 wait complete. 2024-09-11T22:20:46.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.386+0000 7f227c955640 1 -- 172.21.15.100:0/3102690777 >> [v2:172.21.15.100:6808/2008454847,v1:172.21.15.100:6809/2008454847] conn(0x7f225c075530 msgr2=0x7f225c077970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.386+0000 7f227c955640 1 --2- 172.21.15.100:0/3102690777 >> [v2:172.21.15.100:6808/2008454847,v1:172.21.15.100:6809/2008454847] conn(0x7f225c075530 0x7f225c077970 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.386+0000 7f227c955640 1 -- 172.21.15.100:0/3102690777 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f225c06be30 msgr2=0x7f225c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.386+0000 7f227c955640 1 --2- 172.21.15.100:0/3102690777 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f225c06be30 0x7f225c06e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f22700d7b20 tx=0x7f226c009040 comp rx=0 tx=0).stop 2024-09-11T22:20:46.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.386+0000 7f9b29b0c640 1 -- 172.21.15.100:0/553965137 --> [v2:172.21.15.167:6824/2479173909,v1:172.21.15.167:6825/2479173909] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9b04002dd0 con 0x7f9b080756b0 2024-09-11T22:20:46.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.386+0000 7f227c955640 1 -- 172.21.15.100:0/3102690777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22700e2b10 msgr2=0x7f22700cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.386+0000 7f227c955640 1 --2- 172.21.15.100:0/3102690777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22700e2b10 0x7f22700cd460 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2278065240 tx=0x7f227806bb40 comp rx=0 tx=0).stop 2024-09-11T22:20:46.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.386+0000 7f2277fff640 1 -- 172.21.15.100:0/3102690777 reap_dead start 2024-09-11T22:20:46.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.387+0000 7f227c955640 1 -- 172.21.15.100:0/3102690777 shutdown_connections 2024-09-11T22:20:46.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.387+0000 7f227c955640 1 -- 172.21.15.100:0/3102690777 >> 172.21.15.100:0/3102690777 conn(0x7f227004e8e0 msgr2=0x7f227004ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.387+0000 7f227c955640 1 -- 172.21.15.100:0/3102690777 shutdown_connections 2024-09-11T22:20:46.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.387+0000 7f9b0ffff640 1 -- 172.21.15.100:0/553965137 <== osd.5 v2:172.21.15.167:6824/2479173909 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9b04002dd0 con 0x7f9b080756b0 2024-09-11T22:20:46.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.387+0000 7f227c955640 1 -- 172.21.15.100:0/3102690777 wait complete. 2024-09-11T22:20:46.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.388+0000 7f9b29b0c640 1 -- 172.21.15.100:0/553965137 >> [v2:172.21.15.167:6824/2479173909,v1:172.21.15.167:6825/2479173909] conn(0x7f9b080756b0 msgr2=0x7f9b08077af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.388+0000 7f9b29b0c640 1 --2- 172.21.15.100:0/553965137 >> [v2:172.21.15.167:6824/2479173909,v1:172.21.15.167:6825/2479173909] conn(0x7f9b080756b0 0x7f9b08077af0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.388+0000 7f9b29b0c640 1 -- 172.21.15.100:0/553965137 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9b0806bf30 msgr2=0x7f9b0806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.388+0000 7f9b29b0c640 1 --2- 172.21.15.100:0/553965137 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9b0806bf30 0x7f9b0806e3f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9b2406d660 tx=0x7f9b10008040 comp rx=0 tx=0).stop 2024-09-11T22:20:46.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.389+0000 7f9b29b0c640 1 -- 172.21.15.100:0/553965137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b140042b0 msgr2=0x7f9b2415c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.389+0000 7f9b29b0c640 1 --2- 172.21.15.100:0/553965137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b140042b0 0x7f9b2415c080 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800fb10 tx=0x7f9b18001880 comp rx=0 tx=0).stop 2024-09-11T22:20:46.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.389+0000 7f9b23fff640 1 -- 172.21.15.100:0/553965137 reap_dead start 2024-09-11T22:20:46.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.389+0000 7f9b29b0c640 1 -- 172.21.15.100:0/553965137 shutdown_connections 2024-09-11T22:20:46.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.389+0000 7f9b29b0c640 1 -- 172.21.15.100:0/553965137 >> 172.21.15.100:0/553965137 conn(0x7f9b2406ce30 msgr2=0x7f9b2414ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.390+0000 7f9b29b0c640 1 -- 172.21.15.100:0/553965137 shutdown_connections 2024-09-11T22:20:46.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.390+0000 7f9b29b0c640 1 -- 172.21.15.100:0/553965137 wait complete. 2024-09-11T22:20:46.439 INFO:teuthology.orchestra.run.smithi100.stdout:64424509450 2024-09-11T22:20:46.440 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T22:20:46.441 INFO:teuthology.orchestra.run.smithi100.stdout:64424509450 2024-09-11T22:20:46.441 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T22:20:46.441 INFO:teuthology.orchestra.run.smithi100.stdout:55834574859 2024-09-11T22:20:46.442 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T22:20:46.442 INFO:teuthology.orchestra.run.smithi100.stdout:60129542154 2024-09-11T22:20:46.443 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T22:20:46.443 INFO:teuthology.orchestra.run.smithi100.stdout:64424509450 2024-09-11T22:20:46.444 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T22:20:46.444 INFO:teuthology.orchestra.run.smithi100.stdout:64424509449 2024-09-11T22:20:46.445 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T22:20:46.445 INFO:teuthology.orchestra.run.smithi100.stdout:60129542154 2024-09-11T22:20:46.446 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T22:20:46.446 INFO:teuthology.orchestra.run.smithi100.stdout:64424509451 2024-09-11T22:20:46.447 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T22:20:46.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.645+0000 7fce843d8640 1 Processor -- start 2024-09-11T22:20:46.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.646+0000 7fba16fbc640 1 Processor -- start 2024-09-11T22:20:46.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.645+0000 7fce843d8640 1 -- start start 2024-09-11T22:20:46.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.646+0000 7fba16fbc640 1 -- start start 2024-09-11T22:20:46.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.647+0000 7fce843d8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce7c06fe50 0x7fce7c15ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.647+0000 7f4ccca2b640 1 Processor -- start 2024-09-11T22:20:46.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.647+0000 7f4ccca2b640 1 -- start start 2024-09-11T22:20:46.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.647+0000 7fce843d8640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fce7c072c80 0x7fce7c0c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.647+0000 7fce843d8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fce7c0c7510 0x7fce7c0c7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.647+0000 7fce843d8640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fce7c15b070 con 0x7fce7c072c80 2024-09-11T22:20:46.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.647+0000 7fce843d8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fce7c156bb0 con 0x7fce7c0c7510 2024-09-11T22:20:46.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.647+0000 7fce843d8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fce7c073470 con 0x7fce7c06fe50 2024-09-11T22:20:46.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.647+0000 7fce81973640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fce7c072c80 0x7fce7c0c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.647+0000 7fce81973640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fce7c072c80 0x7fce7c0c9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47364/0 (socket says 172.21.15.100:47364) 2024-09-11T22:20:46.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.647+0000 7fce81973640 1 -- 172.21.15.100:0/3135913965 learned_addr learned my addr 172.21.15.100:0/3135913965 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.648+0000 7fce82975640 1 --2- 172.21.15.100:0/3135913965 >> v2:172.21.15.167:3300/0 conn(0x7fce7c0c7510 0x7fce7c0c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.648+0000 7fce82174640 1 --2- 172.21.15.100:0/3135913965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce7c06fe50 0x7fce7c15ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.648+0000 7fce81973640 1 -- 172.21.15.100:0/3135913965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce7c06fe50 msgr2=0x7fce7c15ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.648+0000 7fce81973640 1 --2- 172.21.15.100:0/3135913965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce7c06fe50 0x7fce7c15ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.648+0000 7fce81973640 1 -- 172.21.15.100:0/3135913965 >> v2:172.21.15.167:3300/0 conn(0x7fce7c0c7510 msgr2=0x7fce7c0c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.648+0000 7fce81973640 1 --2- 172.21.15.100:0/3135913965 >> v2:172.21.15.167:3300/0 conn(0x7fce7c0c7510 0x7fce7c0c7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.648+0000 7fce81973640 1 -- 172.21.15.100:0/3135913965 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce7c156e70 con 0x7fce7c072c80 2024-09-11T22:20:46.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.648+0000 7fce82174640 1 --2- 172.21.15.100:0/3135913965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce7c06fe50 0x7fce7c15ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:46.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.648+0000 7f4ccca2b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4cc8073770 0x7f4cc8071d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.648+0000 7f4ccca2b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4cc80c7b50 0x7f4cc80c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.648+0000 7f4ccca2b640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cc815f530 con 0x7f4cc815c3d0 2024-09-11T22:20:46.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.648+0000 7f4ccca2b640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f4cc8162cc0 con 0x7f4cc80c7b50 2024-09-11T22:20:46.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.648+0000 7f4ccca2b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f4cc806e050 con 0x7f4cc8073770 2024-09-11T22:20:46.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.649+0000 7f4cc6ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4cc8073770 0x7f4cc8071d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.647+0000 7fb1a2637640 1 Processor -- start 2024-09-11T22:20:46.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.647+0000 7fb1a2637640 1 -- start start 2024-09-11T22:20:46.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.649+0000 7fc9471c4640 1 Processor -- start 2024-09-11T22:20:46.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.649+0000 7f4cc6ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4cc8073770 0x7f4cc8071d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44142/0 (socket says 172.21.15.100:44142) 2024-09-11T22:20:46.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.649+0000 7f4cc6ffd640 1 -- 172.21.15.100:0/1159543128 learned_addr learned my addr 172.21.15.100:0/1159543128 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.649+0000 7fc9471c4640 1 -- start start 2024-09-11T22:20:46.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.649+0000 7fb1a2637640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb19c0c6ba0 0x7fb19c0c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.649+0000 7fb1a2637640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb19c162570 0x7fb19c1629a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.649+0000 7fb1a2637640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb19c162ee0 con 0x7fb19c0b4090 2024-09-11T22:20:46.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.649+0000 7fb1a2637640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb19c159360 con 0x7fb19c0c6ba0 2024-09-11T22:20:46.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.649+0000 7fb1a2637640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fb19c15edd0 con 0x7fb19c162570 2024-09-11T22:20:46.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.648+0000 7fba16fbc640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fba080d5850 0x7fba08007730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.649+0000 7fba16fbc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba08047a80 0x7fba08006620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.649+0000 7fba16fbc640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba080dc3a0 con 0x7fba0804d310 2024-09-11T22:20:46.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.649+0000 7fba16fbc640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fba080dbe90 con 0x7fba080d5850 2024-09-11T22:20:46.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.649+0000 7fba16fbc640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fba080dc0c0 con 0x7fba08047a80 2024-09-11T22:20:46.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.649+0000 7fba167bb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba08047a80 0x7fba08006620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.649+0000 7fba167bb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba08047a80 0x7fba08006620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45192/0 (socket says 172.21.15.100:45192) 2024-09-11T22:20:46.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.649+0000 7fba167bb640 1 -- 172.21.15.100:0/4179897195 learned_addr learned my addr 172.21.15.100:0/4179897195 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.649+0000 7fb19b7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb19c0c6ba0 0x7fb19c0c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.649+0000 7fb19b7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb19c0c6ba0 0x7fb19c0c6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47386/0 (socket says 172.21.15.100:47386) 2024-09-11T22:20:46.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.649+0000 7fb19b7fe640 1 -- 172.21.15.100:0/2050351089 learned_addr learned my addr 172.21.15.100:0/2050351089 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7fce81973640 1 --2- 172.21.15.100:0/3135913965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce7c072c80 0x7fce7c0c9260 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fce7c071560 tx=0x7fce7402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7702b77bcaaf402a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7f4cc6ffd640 1 -- 172.21.15.100:0/1159543128 >> v2:172.21.15.100:3300/0 conn(0x7f4cc80c7b50 msgr2=0x7f4cc80c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7f4cc6ffd640 1 --2- 172.21.15.100:0/1159543128 >> v2:172.21.15.100:3300/0 conn(0x7f4cc80c7b50 0x7f4cc80c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7f4cc6ffd640 1 -- 172.21.15.100:0/1159543128 >> v1:172.21.15.100:6789/0 conn(0x7f4cc815c3d0 legacy=0x7f4cc815ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7f4cc6ffd640 1 -- 172.21.15.100:0/1159543128 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc806e2f0 con 0x7f4cc8073770 2024-09-11T22:20:46.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7fb1a0bd4640 1 --2- 172.21.15.100:0/2050351089 >> v2:172.21.15.167:3300/0 conn(0x7fb19c162570 0x7fb19c1629a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7fb19b7fe640 1 -- 172.21.15.100:0/2050351089 >> v2:172.21.15.167:3300/0 conn(0x7fb19c162570 msgr2=0x7fb19c1629a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7fb19b7fe640 1 --2- 172.21.15.100:0/2050351089 >> v2:172.21.15.167:3300/0 conn(0x7fb19c162570 0x7fb19c1629a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7fb19b7fe640 1 -- 172.21.15.100:0/2050351089 >> v1:172.21.15.100:6789/0 conn(0x7fb19c0b4090 legacy=0x7fb19c0b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7fb19b7fe640 1 -- 172.21.15.100:0/2050351089 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb19c15f0b0 con 0x7fb19c0c6ba0 2024-09-11T22:20:46.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7f3dcac22640 1 Processor -- start 2024-09-11T22:20:46.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7fce81172640 1 -- 172.21.15.100:0/3135913965 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74036070 con 0x7fce7c072c80 2024-09-11T22:20:46.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7fc9471c4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc940154b80 0x7fc9400d0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7fc9471c4640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc9400c58d0 0x7fc9400c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7fc9471c4640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc940154f60 con 0x7fc9400731c0 2024-09-11T22:20:46.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7fc9471c4640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fc9400c5440 con 0x7fc9400c58d0 2024-09-11T22:20:46.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7fc9471c4640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fc94015df30 con 0x7fc940154b80 2024-09-11T22:20:46.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7f3dcac22640 1 -- start start 2024-09-11T22:20:46.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7fce81172640 1 -- 172.21.15.100:0/3135913965 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce74031600 con 0x7fce7c072c80 2024-09-11T22:20:46.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7fce81172640 1 -- 172.21.15.100:0/3135913965 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74036070 con 0x7fce7c072c80 2024-09-11T22:20:46.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.651+0000 7f90c4d18640 1 Processor -- start 2024-09-11T22:20:46.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.651+0000 7fc93ffff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc9400731c0 0x7fc94006d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33324/0 (socket says 172.21.15.100:33324) 2024-09-11T22:20:46.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7fba15fba640 1 --2- 172.21.15.100:0/4179897195 >> v2:172.21.15.100:3300/0 conn(0x7fba080d5850 0x7fba08007730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7fba167bb640 1 -- 172.21.15.100:0/4179897195 >> v2:172.21.15.100:3300/0 conn(0x7fba080d5850 msgr2=0x7fba08007730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7fba167bb640 1 --2- 172.21.15.100:0/4179897195 >> v2:172.21.15.100:3300/0 conn(0x7fba080d5850 0x7fba08007730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7fba167bb640 1 -- 172.21.15.100:0/4179897195 >> v1:172.21.15.100:6789/0 conn(0x7fba0804d310 legacy=0x7fba08045d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.650+0000 7fba167bb640 1 -- 172.21.15.100:0/4179897195 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba08046cc0 con 0x7fba08047a80 2024-09-11T22:20:46.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.651+0000 7fc93ffff640 1 -- 172.21.15.100:0/1183502820 learned_addr learned my addr 172.21.15.100:0/1183502820 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:46.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.651+0000 7f90c4d18640 1 -- start start 2024-09-11T22:20:46.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.651+0000 7fb19b7fe640 1 --2- 172.21.15.100:0/2050351089 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb19c0c6ba0 0x7fb19c0c6fd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb194009e50 tx=0x7fb19402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5524858b4ce65ac2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.651+0000 7f4cc6ffd640 1 --2- 172.21.15.100:0/1159543128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cc8073770 0x7f4cc8071d10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4cc806fe70 tx=0x7f4cbc02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fd6f0809135a5bb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.651+0000 7fba167bb640 1 --2- 172.21.15.100:0/4179897195 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba08047a80 0x7fba08006620 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fba1006a4c0 tx=0x7fba100aeeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c28b761199be6d9a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.651+0000 7fc944f60640 1 --2- 172.21.15.100:0/1183502820 >> v2:172.21.15.167:3300/0 conn(0x7fc940154b80 0x7fc9400d0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.651+0000 7fc945761640 1 --2- 172.21.15.100:0/1183502820 >> v2:172.21.15.100:3300/0 conn(0x7fc9400c58d0 0x7fc9400c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.651+0000 7fc944f60640 1 -- 172.21.15.100:0/1183502820 >> v2:172.21.15.100:3300/0 conn(0x7fc9400c58d0 msgr2=0x7fc9400c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.651+0000 7fc944f60640 1 --2- 172.21.15.100:0/1183502820 >> v2:172.21.15.100:3300/0 conn(0x7fc9400c58d0 0x7fc9400c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.651+0000 7fc944f60640 1 -- 172.21.15.100:0/1183502820 >> v1:172.21.15.100:6789/0 conn(0x7fc9400731c0 legacy=0x7fc94006d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.651+0000 7fc944f60640 1 -- 172.21.15.100:0/1183502820 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94015e210 con 0x7fc940154b80 2024-09-11T22:20:46.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.651+0000 7f9e1e445640 1 Processor -- start 2024-09-11T22:20:46.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.651+0000 7f9e1e445640 1 -- start start 2024-09-11T22:20:46.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7f3dcac22640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3dbc0dcd90 0x7f3dbc045d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7fce843d8640 1 -- 172.21.15.100:0/3135913965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce7c072c80 msgr2=0x7fce7c0c9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7fce843d8640 1 --2- 172.21.15.100:0/3135913965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce7c072c80 0x7fce7c0c9260 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fce7c071560 tx=0x7fce7402a730 comp rx=0 tx=0).stop 2024-09-11T22:20:46.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7f3dcac22640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3dbc04a680 0x7f3dbc04aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7fce843d8640 1 -- 172.21.15.100:0/3135913965 shutdown_connections 2024-09-11T22:20:46.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7fce843d8640 1 --2- 172.21.15.100:0/3135913965 >> v2:172.21.15.167:3300/0 conn(0x7fce7c0c7510 0x7fce7c0c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7fce843d8640 1 --2- 172.21.15.100:0/3135913965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce7c072c80 0x7fce7c0c9260 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7fce843d8640 1 --2- 172.21.15.100:0/3135913965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce7c06fe50 0x7fce7c15ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7fce843d8640 1 -- 172.21.15.100:0/3135913965 >> 172.21.15.100:0/3135913965 conn(0x7fce7c06f360 msgr2=0x7fce7c06f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7f3dcac22640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dbc0e6a70 con 0x7f3dbc0e5f30 2024-09-11T22:20:46.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7f3dcac22640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f3dbc044d40 con 0x7f3dbc0dcd90 2024-09-11T22:20:46.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7f3dcac22640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f3dbc0dd170 con 0x7f3dbc04a680 2024-09-11T22:20:46.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7f3dc9c20640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3dbc0dcd90 0x7f3dbc045d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7fb19affd640 1 -- 172.21.15.100:0/2050351089 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194036070 con 0x7fb19c0c6ba0 2024-09-11T22:20:46.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7fb19affd640 1 -- 172.21.15.100:0/2050351089 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb194031600 con 0x7fb19c0c6ba0 2024-09-11T22:20:46.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7fb19affd640 1 -- 172.21.15.100:0/2050351089 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1940319d0 con 0x7fb19c0c6ba0 2024-09-11T22:20:46.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7fce843d8640 1 -- 172.21.15.100:0/3135913965 shutdown_connections 2024-09-11T22:20:46.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7f90c4d18640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f90c0150b60 0x7f90c00c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7f4cc67fc640 1 -- 172.21.15.100:0/1159543128 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc037070 con 0x7f4cc8073770 2024-09-11T22:20:46.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7fba14fb8640 1 -- 172.21.15.100:0/4179897195 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba100bc070 con 0x7fba08047a80 2024-09-11T22:20:46.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7fba14fb8640 1 -- 172.21.15.100:0/4179897195 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba100afc80 con 0x7fba08047a80 2024-09-11T22:20:46.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7fba14fb8640 1 -- 172.21.15.100:0/4179897195 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba100b7640 con 0x7fba08047a80 2024-09-11T22:20:46.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7f90c4d18640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f90c00c6970 0x7f90c00c7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7f4cc67fc640 1 -- 172.21.15.100:0/1159543128 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cbc032440 con 0x7f4cc8073770 2024-09-11T22:20:46.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7f4cc67fc640 1 -- 172.21.15.100:0/1159543128 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc032810 con 0x7f4cc8073770 2024-09-11T22:20:46.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7fc944f60640 1 --2- 172.21.15.100:0/1183502820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc940154b80 0x7fc9400d0c30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc9400722f0 tx=0x7fc93402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e11c57c0931c9830 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7f3dc9c20640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3dbc0dcd90 0x7f3dbc045d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47398/0 (socket says 172.21.15.100:47398) 2024-09-11T22:20:46.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7f3dc9c20640 1 -- 172.21.15.100:0/2327177485 learned_addr learned my addr 172.21.15.100:0/2327177485 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.652+0000 7f3dc941f640 1 --2- 172.21.15.100:0/2327177485 >> v2:172.21.15.167:3300/0 conn(0x7f3dbc04a680 0x7f3dbc04aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f90be59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f90c0150b60 0x7f90c00c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f90be59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f90c0150b60 0x7f90c00c80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44184/0 (socket says 172.21.15.100:44184) 2024-09-11T22:20:46.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f90be59c640 1 -- 172.21.15.100:0/3045181885 learned_addr learned my addr 172.21.15.100:0/3045181885 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7fb1a2637640 1 -- 172.21.15.100:0/2050351089 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb19c0c6ba0 msgr2=0x7fb19c0c6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f3dc941f640 1 -- 172.21.15.100:0/2327177485 >> v2:172.21.15.100:3300/0 conn(0x7f3dbc0dcd90 msgr2=0x7f3dbc045d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f3dc941f640 1 --2- 172.21.15.100:0/2327177485 >> v2:172.21.15.100:3300/0 conn(0x7f3dbc0dcd90 0x7f3dbc045d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f3dc941f640 1 -- 172.21.15.100:0/2327177485 >> v1:172.21.15.167:6789/0 conn(0x7f3dbc0e5f30 legacy=0x7f3dbc0e6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f3dc941f640 1 -- 172.21.15.100:0/2327177485 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dbc0e6d30 con 0x7f3dbc04a680 2024-09-11T22:20:46.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f3dc9c20640 1 --2- 172.21.15.100:0/2327177485 >> v2:172.21.15.100:3300/0 conn(0x7f3dbc0dcd90 0x7f3dbc045d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:46.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f90c4d18640 1 -- 172.21.15.100:0/3045181885 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90c00c8600 con 0x7f90c00c7ac0 2024-09-11T22:20:46.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7fce843d8640 1 -- 172.21.15.100:0/3135913965 wait complete. 2024-09-11T22:20:46.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7fb1a2637640 1 --2- 172.21.15.100:0/2050351089 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb19c0c6ba0 0x7fb19c0c6fd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb194009e50 tx=0x7fb19402a7a0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7fc93f7fe640 1 -- 172.21.15.100:0/1183502820 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc934037070 con 0x7fc940154b80 2024-09-11T22:20:46.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7fc93f7fe640 1 -- 172.21.15.100:0/1183502820 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc934032440 con 0x7fc940154b80 2024-09-11T22:20:46.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7fc93f7fe640 1 -- 172.21.15.100:0/1183502820 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93402ae60 con 0x7fc940154b80 2024-09-11T22:20:46.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f9e1e445640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9e180c8c70 0x7f9e1806e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f9e1e445640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e180c9050 0x7f9e18158990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f9e1e445640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e1815eb70 con 0x7f9e180c8230 2024-09-11T22:20:46.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f9e1e445640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f9e1815ee30 con 0x7f9e180c8c70 2024-09-11T22:20:46.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f9e1e445640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9e1815f110 con 0x7f9e180c9050 2024-09-11T22:20:46.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7fba16fbc640 1 -- 172.21.15.100:0/4179897195 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba08047a80 msgr2=0x7fba08006620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7fba16fbc640 1 --2- 172.21.15.100:0/4179897195 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba08047a80 0x7fba08006620 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fba1006a4c0 tx=0x7fba100aeeb0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7fba16fbc640 1 -- 172.21.15.100:0/4179897195 shutdown_connections 2024-09-11T22:20:46.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7fba16fbc640 1 --2- 172.21.15.100:0/4179897195 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba08047a80 0x7fba08006620 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7fba16fbc640 1 --2- 172.21.15.100:0/4179897195 >> v2:172.21.15.100:3300/0 conn(0x7fba080d5850 0x7fba08007730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7fba16fbc640 1 -- 172.21.15.100:0/4179897195 >> 172.21.15.100:0/4179897195 conn(0x7fba0804d830 msgr2=0x7fba0804dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f90c4d18640 1 -- 172.21.15.100:0/3045181885 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f90c0156730 con 0x7f90c00c6970 2024-09-11T22:20:46.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f9e17fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9e180c8c70 0x7f9e1806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f9e17fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9e180c8c70 0x7f9e1806e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44200/0 (socket says 172.21.15.100:44200) 2024-09-11T22:20:46.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f9e17fff640 1 -- 172.21.15.100:0/3306612905 learned_addr learned my addr 172.21.15.100:0/3306612905 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f90bdd9b640 1 --2- 172.21.15.100:0/3045181885 >> v2:172.21.15.100:3300/0 conn(0x7f90c00c6970 0x7f90c00c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f90c4d18640 1 -- 172.21.15.100:0/3045181885 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f90c01569f0 con 0x7f90c0150b60 2024-09-11T22:20:46.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f4ccca2b640 1 -- 172.21.15.100:0/1159543128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cc8073770 msgr2=0x7f4cc8071d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f90bd59a640 1 -- 172.21.15.100:0/3045181885 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1744861367 0 0) 0x7f90c00c8600 con 0x7f90c00c7ac0 2024-09-11T22:20:46.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f4ccca2b640 1 --2- 172.21.15.100:0/1159543128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cc8073770 0x7f4cc8071d10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4cc806fe70 tx=0x7f4cbc02a230 comp rx=0 tx=0).stop 2024-09-11T22:20:46.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.653+0000 7f9e177fe640 1 --2- 172.21.15.100:0/3306612905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e180c9050 0x7f9e18158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7f4ccca2b640 1 -- 172.21.15.100:0/1159543128 shutdown_connections 2024-09-11T22:20:46.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7f4ccca2b640 1 --2- 172.21.15.100:0/1159543128 >> v2:172.21.15.100:3300/0 conn(0x7f4cc80c7b50 0x7f4cc80c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7f4ccca2b640 1 --2- 172.21.15.100:0/1159543128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cc8073770 0x7f4cc8071d10 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4cc806fe70 tx=0x7f4cbc02a230 comp rx=0 tx=0).stop 2024-09-11T22:20:46.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7f4ccca2b640 1 -- 172.21.15.100:0/1159543128 >> 172.21.15.100:0/1159543128 conn(0x7f4cc806ed10 msgr2=0x7f4cc806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7fb1a2637640 1 -- 172.21.15.100:0/2050351089 shutdown_connections 2024-09-11T22:20:46.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7fb1a2637640 1 --2- 172.21.15.100:0/2050351089 >> v2:172.21.15.167:3300/0 conn(0x7fb19c162570 0x7fb19c1629a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7fb1a2637640 1 --2- 172.21.15.100:0/2050351089 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb19c0c6ba0 0x7fb19c0c6fd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7fb1a2637640 1 -- 172.21.15.100:0/2050351089 >> 172.21.15.100:0/2050351089 conn(0x7fb19c06c000 msgr2=0x7fb19c06c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7f90bd59a640 1 -- 172.21.15.100:0/3045181885 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90a8003520 con 0x7f90c00c7ac0 2024-09-11T22:20:46.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7fba16fbc640 1 -- 172.21.15.100:0/4179897195 shutdown_connections 2024-09-11T22:20:46.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7fba16fbc640 1 -- 172.21.15.100:0/4179897195 wait complete. 2024-09-11T22:20:46.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7fc9471c4640 1 -- 172.21.15.100:0/1183502820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc940154b80 msgr2=0x7fc9400d0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7fc9471c4640 1 --2- 172.21.15.100:0/1183502820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc940154b80 0x7fc9400d0c30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc9400722f0 tx=0x7fc93402a110 comp rx=0 tx=0).stop 2024-09-11T22:20:46.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7f4ccca2b640 1 -- 172.21.15.100:0/1159543128 shutdown_connections 2024-09-11T22:20:46.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7f4ccca2b640 1 -- 172.21.15.100:0/1159543128 wait complete. 2024-09-11T22:20:46.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7f90be59c640 1 -- 172.21.15.100:0/3045181885 >> v2:172.21.15.100:3300/0 conn(0x7f90c00c6970 msgr2=0x7f90c00c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7f90be59c640 1 --2- 172.21.15.100:0/3045181885 >> v2:172.21.15.100:3300/0 conn(0x7f90c00c6970 0x7f90c00c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7f90be59c640 1 -- 172.21.15.100:0/3045181885 >> v1:172.21.15.100:6789/0 conn(0x7f90c00c7ac0 legacy=0x7f90c0159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7f90be59c640 1 -- 172.21.15.100:0/3045181885 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90c0156cd0 con 0x7f90c0150b60 2024-09-11T22:20:46.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7fc9471c4640 1 -- 172.21.15.100:0/1183502820 shutdown_connections 2024-09-11T22:20:46.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7fc9471c4640 1 --2- 172.21.15.100:0/1183502820 >> v2:172.21.15.100:3300/0 conn(0x7fc9400c58d0 0x7fc9400c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7fc9471c4640 1 --2- 172.21.15.100:0/1183502820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc940154b80 0x7fc9400d0c30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7fc9471c4640 1 -- 172.21.15.100:0/1183502820 >> 172.21.15.100:0/1183502820 conn(0x7fc94006c000 msgr2=0x7fc94006c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7fce843d8640 1 Processor -- start 2024-09-11T22:20:46.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7f9e177fe640 1 -- 172.21.15.100:0/3306612905 >> v2:172.21.15.167:3300/0 conn(0x7f9e180c8c70 msgr2=0x7f9e1806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:46.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7f9e177fe640 1 --2- 172.21.15.100:0/3306612905 >> v2:172.21.15.167:3300/0 conn(0x7f9e180c8c70 0x7f9e1806e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7f9e177fe640 1 -- 172.21.15.100:0/3306612905 >> v1:172.21.15.100:6789/0 conn(0x7f9e180c8230 legacy=0x7f9e180c1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7f9e177fe640 1 -- 172.21.15.100:0/3306612905 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e1815f3f0 con 0x7f9e180c9050 2024-09-11T22:20:46.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7fb1a2637640 1 -- 172.21.15.100:0/2050351089 shutdown_connections 2024-09-11T22:20:46.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.654+0000 7fce843d8640 1 -- start start 2024-09-11T22:20:46.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.655+0000 7fc9471c4640 1 -- 172.21.15.100:0/1183502820 shutdown_connections 2024-09-11T22:20:46.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.655+0000 7f3dc941f640 1 --2- 172.21.15.100:0/2327177485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dbc04a680 0x7f3dbc04aab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc044ec0 tx=0x7f3dc002a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bd254482bedd4a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.655+0000 7f3dc8c1e640 1 -- 172.21.15.100:0/2327177485 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0037070 con 0x7f3dbc04a680 2024-09-11T22:20:46.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.655+0000 7fb1a2637640 1 -- 172.21.15.100:0/2050351089 wait complete. 2024-09-11T22:20:46.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.655+0000 7fc9471c4640 1 -- 172.21.15.100:0/1183502820 wait complete. 2024-09-11T22:20:46.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.655+0000 7f9e177fe640 1 --2- 172.21.15.100:0/3306612905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e180c9050 0x7f9e18158990 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0097a0 tx=0x7f9e0c02a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18a8edde128db71e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.655+0000 7f3dc8c1e640 1 -- 172.21.15.100:0/2327177485 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc0032440 con 0x7f3dbc04a680 2024-09-11T22:20:46.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.655+0000 7f3dc8c1e640 1 -- 172.21.15.100:0/2327177485 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0037070 con 0x7f3dbc04a680 2024-09-11T22:20:46.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.655+0000 7fce843d8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce7c06fe50 0x7fce7c13b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.655+0000 7fce843d8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce7c072c80 0x7fce7c0cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.655+0000 7fce843d8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce7c0c7510 0x7fce7c0cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.655+0000 7fce843d8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fce7c157710 con 0x7fce7c0c7510 2024-09-11T22:20:46.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.655+0000 7fce843d8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fce7c157430 con 0x7fce7c072c80 2024-09-11T22:20:46.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.655+0000 7fce843d8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fce7c0c13a0 con 0x7fce7c06fe50 2024-09-11T22:20:46.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7fce82975640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce7c0c7510 0x7fce7c0cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7fce82975640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce7c0c7510 0x7fce7c0cc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47416/0 (socket says 172.21.15.100:47416) 2024-09-11T22:20:46.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7f9e16ffd640 1 -- 172.21.15.100:0/3306612905 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c037070 con 0x7f9e180c9050 2024-09-11T22:20:46.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7f9e16ffd640 1 -- 172.21.15.100:0/3306612905 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e0c032440 con 0x7f9e180c9050 2024-09-11T22:20:46.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7f9e16ffd640 1 -- 172.21.15.100:0/3306612905 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c032810 con 0x7f9e180c9050 2024-09-11T22:20:46.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7fce82975640 1 -- 172.21.15.100:0/1787705600 learned_addr learned my addr 172.21.15.100:0/1787705600 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7fce82174640 1 --2- 172.21.15.100:0/1787705600 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce7c06fe50 0x7fce7c13b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7fce81973640 1 --2- 172.21.15.100:0/1787705600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce7c072c80 0x7fce7c0cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7f4ccca2b640 1 Processor -- start 2024-09-11T22:20:46.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7fba16fbc640 1 Processor -- start 2024-09-11T22:20:46.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7fba16fbc640 1 -- start start 2024-09-11T22:20:46.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7fce82975640 1 -- 172.21.15.100:0/1787705600 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce7c06fe50 msgr2=0x7fce7c13b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7fce82975640 1 --2- 172.21.15.100:0/1787705600 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce7c06fe50 0x7fce7c13b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7f3dcac22640 1 -- 172.21.15.100:0/2327177485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dbc04a680 msgr2=0x7f3dbc04aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7f3dcac22640 1 --2- 172.21.15.100:0/2327177485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dbc04a680 0x7f3dbc04aab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc044ec0 tx=0x7f3dc002a1e0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7fce82975640 1 -- 172.21.15.100:0/1787705600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce7c072c80 msgr2=0x7fce7c0cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7fce82975640 1 --2- 172.21.15.100:0/1787705600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce7c072c80 0x7fce7c0cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7fce82975640 1 -- 172.21.15.100:0/1787705600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce7c13a120 con 0x7fce7c0c7510 2024-09-11T22:20:46.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7f3dcac22640 1 -- 172.21.15.100:0/2327177485 shutdown_connections 2024-09-11T22:20:46.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7f3dcac22640 1 --2- 172.21.15.100:0/2327177485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dbc04a680 0x7f3dbc04aab0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7f3dcac22640 1 --2- 172.21.15.100:0/2327177485 >> v2:172.21.15.100:3300/0 conn(0x7f3dbc0dcd90 0x7f3dbc045d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7f3dcac22640 1 -- 172.21.15.100:0/2327177485 >> 172.21.15.100:0/2327177485 conn(0x7f3dbc04fc50 msgr2=0x7f3dbc050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7fce82975640 1 --2- 172.21.15.100:0/1787705600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce7c0c7510 0x7fce7c0cc6d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fce7800d600 tx=0x7fce7800dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7f3dcac22640 1 -- 172.21.15.100:0/2327177485 shutdown_connections 2024-09-11T22:20:46.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7fb1a2637640 1 Processor -- start 2024-09-11T22:20:46.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.657+0000 7fb1a2637640 1 -- start start 2024-09-11T22:20:46.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.657+0000 7fce72ffd640 1 -- 172.21.15.100:0/1787705600 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce780125f0 con 0x7fce7c0c7510 2024-09-11T22:20:46.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.657+0000 7f3dcac22640 1 -- 172.21.15.100:0/2327177485 wait complete. 2024-09-11T22:20:46.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.657+0000 7fce72ffd640 1 -- 172.21.15.100:0/1787705600 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce78019070 con 0x7fce7c0c7510 2024-09-11T22:20:46.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.657+0000 7fce843d8640 1 -- 172.21.15.100:0/1787705600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce7c13a400 con 0x7fce7c0c7510 2024-09-11T22:20:46.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.657+0000 7fce843d8640 1 -- 172.21.15.100:0/1787705600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce7c0ca080 con 0x7fce7c0c7510 2024-09-11T22:20:46.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.657+0000 7fce72ffd640 1 -- 172.21.15.100:0/1787705600 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce780129f0 con 0x7fce7c0c7510 2024-09-11T22:20:46.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.657+0000 7fba16fbc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba08047a80 0x7fba080dac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7f4ccca2b640 1 -- start start 2024-09-11T22:20:46.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.657+0000 7f4ccca2b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4cc80c7b50 0x7f4cc8160520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.657+0000 7f4ccca2b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cc815c3d0 0x7f4cc81e9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.657+0000 7fba16fbc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba0804d310 0x7fba08174200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.657+0000 7f4ccca2b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cc80cb2e0 0x7f4cc81ea130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7f4cc77fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4cc80c7b50 0x7f4cc8160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7fc9471c4640 1 Processor -- start 2024-09-11T22:20:46.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.656+0000 7fc9471c4640 1 -- start start 2024-09-11T22:20:46.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fc9471c4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9400731c0 0x7fc94006e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fc9471c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9400c58d0 0x7fc94014dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fc9471c4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc940154b80 0x7fc94014e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fc9471c4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc94015eab0 con 0x7fc9400c58d0 2024-09-11T22:20:46.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fc9471c4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc94015e7d0 con 0x7fc9400731c0 2024-09-11T22:20:46.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fc9471c4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc9400c6210 con 0x7fc940154b80 2024-09-11T22:20:46.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fc944f60640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9400731c0 0x7fc94006e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fc944f60640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9400731c0 0x7fc94006e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44216/0 (socket says 172.21.15.100:44216) 2024-09-11T22:20:46.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fc945761640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc940154b80 0x7fc94014e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fc944f60640 1 -- 172.21.15.100:0/3869682276 learned_addr learned my addr 172.21.15.100:0/3869682276 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fc93ffff640 1 --2- 172.21.15.100:0/3869682276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9400c58d0 0x7fc94014dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fb1a2637640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb19c0b4090 0x7fb19c15ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fb1a2637640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb19c0c6ba0 0x7fb19c0ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fb1a2637640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb19c162570 0x7fb19c1f7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fb1a2637640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c15f950 con 0x7fb19c162570 2024-09-11T22:20:46.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fb1a2637640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c15f670 con 0x7fb19c0b4090 2024-09-11T22:20:46.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fb1a2637640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb19c0d0830 con 0x7fb19c0c6ba0 2024-09-11T22:20:46.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fb19bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb19c0b4090 0x7fb19c15ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fb19bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb19c0b4090 0x7fb19c15ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44214/0 (socket says 172.21.15.100:44214) 2024-09-11T22:20:46.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fb19bfff640 1 -- 172.21.15.100:0/1418904792 learned_addr learned my addr 172.21.15.100:0/1418904792 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fb19b7fe640 1 --2- 172.21.15.100:0/1418904792 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb19c0c6ba0 0x7fb19c0ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7f3dcac22640 1 Processor -- start 2024-09-11T22:20:46.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7f3dcac22640 1 -- start start 2024-09-11T22:20:46.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7fc945761640 1 -- 172.21.15.100:0/3869682276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9400731c0 msgr2=0x7fc94006e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7fc945761640 1 --2- 172.21.15.100:0/3869682276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9400731c0 0x7fc94006e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7fc945761640 1 -- 172.21.15.100:0/3869682276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9400c58d0 msgr2=0x7fc94014dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7fc945761640 1 --2- 172.21.15.100:0/3869682276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9400c58d0 0x7fc94014dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7fc945761640 1 -- 172.21.15.100:0/3869682276 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94014ea80 con 0x7fc940154b80 2024-09-11T22:20:46.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fba15fba640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba08047a80 0x7fba080dac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fba15fba640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba08047a80 0x7fba080dac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45226/0 (socket says 172.21.15.100:45226) 2024-09-11T22:20:46.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fba15fba640 1 -- 172.21.15.100:0/249014123 learned_addr learned my addr 172.21.15.100:0/249014123 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fba16fbc640 1 --2- 172.21.15.100:0/249014123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba080d5850 0x7fba0804f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fba16fbc640 1 -- 172.21.15.100:0/249014123 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fba08047560 con 0x7fba0804d310 2024-09-11T22:20:46.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fba16fbc640 1 -- 172.21.15.100:0/249014123 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fba08047280 con 0x7fba080d5850 2024-09-11T22:20:46.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fba16fbc640 1 -- 172.21.15.100:0/249014123 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fba080468c0 con 0x7fba08047a80 2024-09-11T22:20:46.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7fba157b9640 1 --2- 172.21.15.100:0/249014123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba0804d310 0x7fba08174200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7f4cc77fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4cc80c7b50 0x7f4cc8160520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45228/0 (socket says 172.21.15.100:45228) 2024-09-11T22:20:46.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7fb19bfff640 1 -- 172.21.15.100:0/1418904792 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb19c0c6ba0 msgr2=0x7fb19c0ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7fb19bfff640 1 --2- 172.21.15.100:0/1418904792 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb19c0c6ba0 0x7fb19c0ceda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7fb19bfff640 1 -- 172.21.15.100:0/1418904792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb19c162570 msgr2=0x7fb19c1f7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7fb19bfff640 1 --2- 172.21.15.100:0/1418904792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb19c162570 0x7fb19c1f7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7fb19bfff640 1 -- 172.21.15.100:0/1418904792 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb19c15a1d0 con 0x7fb19c0b4090 2024-09-11T22:20:46.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7f4cc77fe640 1 -- 172.21.15.100:0/114783099 learned_addr learned my addr 172.21.15.100:0/114783099 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7f4cc6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cc815c3d0 0x7f4cc81e9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7fba157b9640 1 -- 172.21.15.100:0/249014123 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba08047a80 msgr2=0x7fba080dac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7fba157b9640 1 --2- 172.21.15.100:0/249014123 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba08047a80 0x7fba080dac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7fba157b9640 1 -- 172.21.15.100:0/249014123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba080d5850 msgr2=0x7fba0804f550 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:20:46.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7fba157b9640 1 --2- 172.21.15.100:0/249014123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba080d5850 0x7fba0804f550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7fba157b9640 1 -- 172.21.15.100:0/249014123 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba08049f10 con 0x7fba0804d310 2024-09-11T22:20:46.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7f4ccca2b640 1 -- 172.21.15.100:0/114783099 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8162950 con 0x7f4cc815c3d0 2024-09-11T22:20:46.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7f4ccca2b640 1 -- 172.21.15.100:0/114783099 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8162670 con 0x7f4cc80cb2e0 2024-09-11T22:20:46.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7fb19bfff640 1 --2- 172.21.15.100:0/1418904792 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb19c0b4090 0x7fb19c15ae00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00c440 tx=0x7fb18c00c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7fce843d8640 1 -- 172.21.15.100:0/1787705600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce64005290 con 0x7fce7c0c7510 2024-09-11T22:20:46.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7f9e1e445640 1 -- 172.21.15.100:0/3306612905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e180c9050 msgr2=0x7f9e18158990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.658+0000 7f4ccca2b640 1 -- 172.21.15.100:0/114783099 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc8162340 con 0x7f4cc80c7b50 2024-09-11T22:20:46.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7fc945761640 1 --2- 172.21.15.100:0/3869682276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc940154b80 0x7fc94014e420 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc938007d90 tx=0x7fc93800e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7f9e1e445640 1 --2- 172.21.15.100:0/3306612905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e180c9050 0x7f9e18158990 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c0097a0 tx=0x7f9e0c02a230 comp rx=0 tx=0).stop 2024-09-11T22:20:46.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7fce72ffd640 1 -- 172.21.15.100:0/1787705600 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce78012b90 con 0x7fce7c0c7510 2024-09-11T22:20:46.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7f4cc7fff640 1 --2- 172.21.15.100:0/114783099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cc80cb2e0 0x7f4cc81ea130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7f9e1e445640 1 -- 172.21.15.100:0/3306612905 shutdown_connections 2024-09-11T22:20:46.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7f9e1e445640 1 --2- 172.21.15.100:0/3306612905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e180c9050 0x7f9e18158990 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7f9e1e445640 1 --2- 172.21.15.100:0/3306612905 >> v2:172.21.15.167:3300/0 conn(0x7f9e180c8c70 0x7f9e1806e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7f9e1e445640 1 -- 172.21.15.100:0/3306612905 >> 172.21.15.100:0/3306612905 conn(0x7f9e1806f190 msgr2=0x7f9e1806f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7f90be59c640 1 --2- 172.21.15.100:0/3045181885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90c0150b60 0x7f90c00c80c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f90c00c87d0 tx=0x7f90b002e7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c36a93ea0698e66 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7fb198ff9640 1 -- 172.21.15.100:0/1418904792 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18c017070 con 0x7fb19c0b4090 2024-09-11T22:20:46.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.659+0000 7fb198ff9640 1 -- 172.21.15.100:0/1418904792 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb18c0035f0 con 0x7fb19c0b4090 2024-09-11T22:20:46.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7fb198ff9640 1 -- 172.21.15.100:0/1418904792 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18c0039c0 con 0x7fb19c0b4090 2024-09-11T22:20:46.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7fc93d7fa640 1 -- 172.21.15.100:0/3869682276 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93800edd0 con 0x7fc940154b80 2024-09-11T22:20:46.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7fc9471c4640 1 -- 172.21.15.100:0/3869682276 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc94006e710 con 0x7fc940154b80 2024-09-11T22:20:46.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7f90bd59a640 1 -- 172.21.15.100:0/3045181885 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b003a070 con 0x7f90c0150b60 2024-09-11T22:20:46.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7fc9471c4640 1 -- 172.21.15.100:0/3869682276 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc940157e20 con 0x7fc940154b80 2024-09-11T22:20:46.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7f90bd59a640 1 -- 172.21.15.100:0/3045181885 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b0033710 con 0x7f90c0150b60 2024-09-11T22:20:46.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7f3dcac22640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dbc04a680 0x7f3dbc0dd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7f90bd59a640 1 -- 172.21.15.100:0/3045181885 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b0033ae0 con 0x7f90c0150b60 2024-09-11T22:20:46.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7fc93d7fa640 1 -- 172.21.15.100:0/3869682276 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc938003990 con 0x7fc940154b80 2024-09-11T22:20:46.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7fc93d7fa640 1 -- 172.21.15.100:0/3869682276 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc938003d60 con 0x7fc940154b80 2024-09-11T22:20:46.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7f3dcac22640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dbc0dcd90 0x7f3dbc178be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7f3dcac22640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3dbc0e5f30 0x7f3dbc17b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7f4cc7fff640 1 -- 172.21.15.100:0/114783099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4cc80c7b50 msgr2=0x7f4cc8160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7f3dcac22640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc045550 con 0x7f3dbc04a680 2024-09-11T22:20:46.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7f3dcac22640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc045270 con 0x7f3dbc0dcd90 2024-09-11T22:20:46.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7f3dcac22640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3dbc045830 con 0x7f3dbc0e5f30 2024-09-11T22:20:46.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7f4cc7fff640 1 --2- 172.21.15.100:0/114783099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4cc80c7b50 0x7f4cc8160520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7fce72ffd640 1 --2- 172.21.15.100:0/1787705600 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fce6006be30 0x7fce6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7fce72ffd640 1 -- 172.21.15.100:0/1787705600 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fce7808b590 con 0x7fce7c0c7510 2024-09-11T22:20:46.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7f4cc7fff640 1 -- 172.21.15.100:0/114783099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cc815c3d0 msgr2=0x7f4cc81e9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7f4cc7fff640 1 --2- 172.21.15.100:0/114783099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cc815c3d0 0x7f4cc81e9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7f4cc7fff640 1 -- 172.21.15.100:0/114783099 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc8160e50 con 0x7f4cc80cb2e0 2024-09-11T22:20:46.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.660+0000 7f4cc6ffd640 1 --2- 172.21.15.100:0/114783099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cc815c3d0 0x7f4cc81e9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:46.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.661+0000 7f3dca421640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3dbc0e5f30 0x7f3dbc17b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.661+0000 7f3dca421640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3dbc0e5f30 0x7f3dbc17b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45252/0 (socket says 172.21.15.100:45252) 2024-09-11T22:20:46.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.661+0000 7fb1a2637640 1 -- 172.21.15.100:0/1418904792 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb19c159590 con 0x7fb19c0b4090 2024-09-11T22:20:46.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.661+0000 7fba157b9640 1 --2- 172.21.15.100:0/249014123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba0804d310 0x7fba08174200 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00b3e0 tx=0x7fba0c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.661+0000 7fce82174640 1 --2- 172.21.15.100:0/1787705600 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fce6006be30 0x7fce6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.661+0000 7fb1a2637640 1 -- 172.21.15.100:0/1418904792 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb19c160030 con 0x7fb19c0b4090 2024-09-11T22:20:46.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.661+0000 7f3dca421640 1 -- 172.21.15.100:0/2199822713 learned_addr learned my addr 172.21.15.100:0/2199822713 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.661+0000 7f4cc7fff640 1 --2- 172.21.15.100:0/114783099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cc80cb2e0 0x7f4cc81ea130 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000be20 tx=0x7f4cc000bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.661+0000 7f3dc941f640 1 --2- 172.21.15.100:0/2199822713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dbc0dcd90 0x7f3dbc178be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.661+0000 7f9e1e445640 1 -- 172.21.15.100:0/3306612905 shutdown_connections 2024-09-11T22:20:46.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.661+0000 7f3dc9c20640 1 --2- 172.21.15.100:0/2199822713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dbc04a680 0x7f3dbc0dd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.661+0000 7f9e1e445640 1 -- 172.21.15.100:0/3306612905 wait complete. 2024-09-11T22:20:46.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.661+0000 7fce82174640 1 --2- 172.21.15.100:0/1787705600 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fce6006be30 0x7fce6006e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0099a0 tx=0x7fce6c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.661+0000 7f3dca421640 1 -- 172.21.15.100:0/2199822713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dbc0dcd90 msgr2=0x7f3dbc178be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.662+0000 7f3dca421640 1 --2- 172.21.15.100:0/2199822713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dbc0dcd90 0x7f3dbc178be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.662+0000 7fc9471c4640 1 -- 172.21.15.100:0/3869682276 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc920005290 con 0x7fc940154b80 2024-09-11T22:20:46.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.662+0000 7f3dca421640 1 -- 172.21.15.100:0/2199822713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dbc04a680 msgr2=0x7f3dbc0dd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.662+0000 7f3dca421640 1 --2- 172.21.15.100:0/2199822713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dbc04a680 0x7f3dbc0dd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.662+0000 7f3dca421640 1 -- 172.21.15.100:0/2199822713 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dbc0e2400 con 0x7f3dbc0e5f30 2024-09-11T22:20:46.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.662+0000 7f3dc941f640 1 --2- 172.21.15.100:0/2199822713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dbc0dcd90 0x7f3dbc178be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:46.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.662+0000 7f3dc9c20640 1 --2- 172.21.15.100:0/2199822713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dbc04a680 0x7f3dbc0dd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:46.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.662+0000 7f90c4d18640 1 -- 172.21.15.100:0/3045181885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90c0150b60 msgr2=0x7f90c00c80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.662+0000 7f90c4d18640 1 --2- 172.21.15.100:0/3045181885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90c0150b60 0x7f90c00c80c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f90c00c87d0 tx=0x7f90b002e7b0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.662+0000 7f4caffff640 1 -- 172.21.15.100:0/114783099 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0019070 con 0x7f4cc80cb2e0 2024-09-11T22:20:46.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.662+0000 7f4ccca2b640 1 -- 172.21.15.100:0/114783099 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc81e94c0 con 0x7f4cc80cb2e0 2024-09-11T22:20:46.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.662+0000 7f4ccca2b640 1 -- 172.21.15.100:0/114783099 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc8201a00 con 0x7f4cc80cb2e0 2024-09-11T22:20:46.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.662+0000 7f4caffff640 1 -- 172.21.15.100:0/114783099 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc0014440 con 0x7f4cc80cb2e0 2024-09-11T22:20:46.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.662+0000 7f4caffff640 1 -- 172.21.15.100:0/114783099 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0014830 con 0x7f4cc80cb2e0 2024-09-11T22:20:46.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.662+0000 7fb1a2637640 1 -- 172.21.15.100:0/1418904792 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb19c1629a0 con 0x7fb19c0b4090 2024-09-11T22:20:46.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.662+0000 7f90c4d18640 1 -- 172.21.15.100:0/3045181885 shutdown_connections 2024-09-11T22:20:46.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.662+0000 7f90c4d18640 1 --2- 172.21.15.100:0/3045181885 >> v2:172.21.15.100:3300/0 conn(0x7f90c00c6970 0x7f90c00c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.662+0000 7f90c4d18640 1 --2- 172.21.15.100:0/3045181885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90c0150b60 0x7f90c00c80c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.662+0000 7f90c4d18640 1 -- 172.21.15.100:0/3045181885 >> 172.21.15.100:0/3045181885 conn(0x7f90c006f190 msgr2=0x7f90c006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:46.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.662+0000 7f3dca421640 1 --2- 172.21.15.100:0/2199822713 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3dbc0e5f30 0x7f3dbc17b970 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4051500 tx=0x7f3dc4069890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.662+0000 7fc93d7fa640 1 -- 172.21.15.100:0/3869682276 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc93801b020 con 0x7fc940154b80 2024-09-11T22:20:46.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.663+0000 7fc93d7fa640 1 --2- 172.21.15.100:0/3869682276 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc92406beb0 0x7fc92406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.663+0000 7f90c4d18640 1 -- 172.21.15.100:0/3045181885 shutdown_connections 2024-09-11T22:20:46.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.663+0000 7fb198ff9640 1 -- 172.21.15.100:0/1418904792 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb18c01a070 con 0x7fb19c0b4090 2024-09-11T22:20:46.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.663+0000 7f9e1e445640 1 Processor -- start 2024-09-11T22:20:46.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.663+0000 7f4ccca2b640 1 -- 172.21.15.100:0/114783099 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ca8005290 con 0x7f4cc80cb2e0 2024-09-11T22:20:46.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.663+0000 7f90c4d18640 1 -- 172.21.15.100:0/3045181885 wait complete. 2024-09-11T22:20:46.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.663+0000 7fc93d7fa640 1 -- 172.21.15.100:0/3869682276 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc93808b230 con 0x7fc940154b80 2024-09-11T22:20:46.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.664+0000 7fc944f60640 1 --2- 172.21.15.100:0/3869682276 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc92406beb0 0x7fc92406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.664+0000 7f9e1e445640 1 -- start start 2024-09-11T22:20:46.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.664+0000 7f4caffff640 1 -- 172.21.15.100:0/114783099 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4cc001c070 con 0x7f4cc80cb2e0 2024-09-11T22:20:46.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.664+0000 7fb198ff9640 1 --2- 172.21.15.100:0/1418904792 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb18806beb0 0x7fb18806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.664+0000 7fb198ff9640 1 -- 172.21.15.100:0/1418904792 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb18c08a310 con 0x7fb19c0b4090 2024-09-11T22:20:46.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.664+0000 7fc944f60640 1 --2- 172.21.15.100:0/3869682276 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc92406beb0 0x7fc92406e370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc934009560 tx=0x7fc93402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.664+0000 7fb19b7fe640 1 --2- 172.21.15.100:0/1418904792 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb18806beb0 0x7fb18806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.665+0000 7fb19b7fe640 1 --2- 172.21.15.100:0/1418904792 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb18806beb0 0x7fb18806e370 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb194033000 tx=0x7fb194009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.665+0000 7f4caffff640 1 --2- 172.21.15.100:0/114783099 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4cb406bf00 0x7f4cb406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.665+0000 7f4caffff640 1 -- 172.21.15.100:0/114783099 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4cc008b010 con 0x7f4cc80cb2e0 2024-09-11T22:20:46.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.665+0000 7f4cc77fe640 1 --2- 172.21.15.100:0/114783099 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4cb406bf00 0x7f4cb406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.665+0000 7f9e1e445640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e180c8230 0x7f9e18158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.665+0000 7f9e1e445640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e180c8c70 0x7f9e18158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.665+0000 7f9e1e445640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e180c9050 0x7f9e180c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.665+0000 7f9e1e445640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9e180c7500 con 0x7f9e180c9050 2024-09-11T22:20:46.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.665+0000 7f9e1e445640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9e180c7380 con 0x7f9e180c8230 2024-09-11T22:20:46.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.665+0000 7f9e1e445640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9e180c1850 con 0x7f9e180c8c70 2024-09-11T22:20:46.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.665+0000 7f4cc77fe640 1 --2- 172.21.15.100:0/114783099 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4cb406bf00 0x7f4cb406e3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4cb80099a0 tx=0x7f4cb80090e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.665+0000 7f9e1c9e2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e180c9050 0x7f9e180c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.665+0000 7f9e177fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e180c8c70 0x7f9e18158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.665+0000 7f90c4d18640 1 Processor -- start 2024-09-11T22:20:46.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.665+0000 7f9e1c9e2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e180c9050 0x7f9e180c4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47450/0 (socket says 172.21.15.100:47450) 2024-09-11T22:20:46.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.665+0000 7f9e1c9e2640 1 -- 172.21.15.100:0/1934295595 learned_addr learned my addr 172.21.15.100:0/1934295595 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.665+0000 7f9e17fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e180c8230 0x7f9e18158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.665+0000 7f90c4d18640 1 -- start start 2024-09-11T22:20:46.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.666+0000 7f9e1c9e2640 1 -- 172.21.15.100:0/1934295595 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e180c8c70 msgr2=0x7f9e18158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.666+0000 7f9e1c9e2640 1 --2- 172.21.15.100:0/1934295595 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e180c8c70 0x7f9e18158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.666+0000 7f9e1c9e2640 1 -- 172.21.15.100:0/1934295595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e180c8230 msgr2=0x7f9e18158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.666+0000 7f9e1c9e2640 1 --2- 172.21.15.100:0/1934295595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e180c8230 0x7f9e18158760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.666+0000 7f9e1c9e2640 1 -- 172.21.15.100:0/1934295595 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e181f52e0 con 0x7f9e180c9050 2024-09-11T22:20:46.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.666+0000 7f9e17fff640 1 --2- 172.21.15.100:0/1934295595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e180c8230 0x7f9e18158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:46.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.666+0000 7f9e1c9e2640 1 --2- 172.21.15.100:0/1934295595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e180c9050 0x7f9e180c4500 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000c730 tx=0x7f9e1000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.666+0000 7f90c4d18640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90c00c6970 0x7f90c014f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.666+0000 7f90c4d18640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90c00c7ac0 0x7f90c01585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.666+0000 7f90c4d18640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c0150b60 0x7f90c0158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.666+0000 7f90be59c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90c00c6970 0x7f90c014f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.666+0000 7f90be59c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90c00c6970 0x7f90c014f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45262/0 (socket says 172.21.15.100:45262) 2024-09-11T22:20:46.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.666+0000 7f90bdd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90c00c7ac0 0x7f90c01585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.666+0000 7f90be59c640 1 -- 172.21.15.100:0/195609248 learned_addr learned my addr 172.21.15.100:0/195609248 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:46.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.666+0000 7f90c4d18640 1 -- 172.21.15.100:0/195609248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f90c0071b20 con 0x7f90c0150b60 2024-09-11T22:20:46.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.666+0000 7f90bed9d640 1 --2- 172.21.15.100:0/195609248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c0150b60 0x7f90c0158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.666+0000 7f90c4d18640 1 -- 172.21.15.100:0/195609248 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f90c0157290 con 0x7f90c00c7ac0 2024-09-11T22:20:46.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.667+0000 7f90c4d18640 1 -- 172.21.15.100:0/195609248 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f90c00c6d70 con 0x7f90c00c6970 2024-09-11T22:20:46.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.667+0000 7f90be59c640 1 -- 172.21.15.100:0/195609248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90c00c7ac0 msgr2=0x7f90c01585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.667+0000 7f90be59c640 1 --2- 172.21.15.100:0/195609248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90c00c7ac0 0x7f90c01585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.667+0000 7f90be59c640 1 -- 172.21.15.100:0/195609248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c0150b60 msgr2=0x7f90c0158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:46.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.667+0000 7f90be59c640 1 --2- 172.21.15.100:0/195609248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c0150b60 0x7f90c0158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:46.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.667+0000 7f90be59c640 1 -- 172.21.15.100:0/195609248 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90c01ec310 con 0x7f90c00c6970 2024-09-11T22:20:46.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.667+0000 7f90be59c640 1 --2- 172.21.15.100:0/195609248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90c00c6970 0x7f90c014f890 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f90b0009990 tx=0x7f90b00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.667+0000 7fba067fc640 1 -- 172.21.15.100:0/249014123 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c015020 con 0x7fba0804d310 2024-09-11T22:20:46.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.667+0000 7fba067fc640 1 -- 172.21.15.100:0/249014123 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba0c011830 con 0x7fba0804d310 2024-09-11T22:20:46.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.667+0000 7fba067fc640 1 -- 172.21.15.100:0/249014123 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c011c20 con 0x7fba0804d310 2024-09-11T22:20:46.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.667+0000 7fce72ffd640 1 -- 172.21.15.100:0/1787705600 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce78059b20 con 0x7fce7c0c7510 2024-09-11T22:20:46.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.667+0000 7f9e14ff9640 1 -- 172.21.15.100:0/1934295595 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e10016020 con 0x7f9e180c9050 2024-09-11T22:20:46.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.667+0000 7f9e1e445640 1 -- 172.21.15.100:0/1934295595 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e180741a0 con 0x7f9e180c9050 2024-09-11T22:20:46.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.667+0000 7fba16fbc640 1 -- 172.21.15.100:0/249014123 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba080db2e0 con 0x7fba0804d310 2024-09-11T22:20:46.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.668+0000 7fba16fbc640 1 -- 172.21.15.100:0/249014123 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba0804af40 con 0x7fba0804d310 2024-09-11T22:20:46.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.667+0000 7f9e14ff9640 1 -- 172.21.15.100:0/1934295595 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e1000ce40 con 0x7f9e180c9050 2024-09-11T22:20:46.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.668+0000 7f9e14ff9640 1 -- 172.21.15.100:0/1934295595 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e10003970 con 0x7f9e180c9050 2024-09-11T22:20:46.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.668+0000 7f9e1e445640 1 -- 172.21.15.100:0/1934295595 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e181f4760 con 0x7f9e180c9050 2024-09-11T22:20:46.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.668+0000 7fc93d7fa640 1 -- 172.21.15.100:0/3869682276 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc9380598c0 con 0x7fc940154b80 2024-09-11T22:20:46.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.668+0000 7f90aeffd640 1 -- 172.21.15.100:0/195609248 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b003a040 con 0x7f90c00c6970 2024-09-11T22:20:46.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.668+0000 7f3dba7fc640 1 -- 172.21.15.100:0/2199822713 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4091070 con 0x7f3dbc0e5f30 2024-09-11T22:20:46.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.669+0000 7f3dba7fc640 1 -- 172.21.15.100:0/2199822713 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dc40718a0 con 0x7f3dbc0e5f30 2024-09-11T22:20:46.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.668+0000 7f90aeffd640 1 -- 172.21.15.100:0/195609248 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b0045070 con 0x7f90c00c6970 2024-09-11T22:20:46.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.668+0000 7f90aeffd640 1 -- 172.21.15.100:0/195609248 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b0035c60 con 0x7f90c00c6970 2024-09-11T22:20:46.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.668+0000 7f90c4d18640 1 -- 172.21.15.100:0/195609248 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90c0157b00 con 0x7f90c00c6970 2024-09-11T22:20:46.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.668+0000 7f90c4d18640 1 -- 172.21.15.100:0/195609248 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f90c01580c0 con 0x7f90c00c6970 2024-09-11T22:20:46.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.669+0000 7fba16fbc640 1 -- 172.21.15.100:0/249014123 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba0804c5f0 con 0x7fba0804d310 2024-09-11T22:20:46.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.669+0000 7f3dba7fc640 1 -- 172.21.15.100:0/2199822713 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4071cd0 con 0x7f3dbc0e5f30 2024-09-11T22:20:46.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.669+0000 7f3dcac22640 1 -- 172.21.15.100:0/2199822713 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dbc0470d0 con 0x7f3dbc0e5f30 2024-09-11T22:20:46.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.669+0000 7f3dcac22640 1 -- 172.21.15.100:0/2199822713 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dbc048a90 con 0x7f3dbc0e5f30 2024-09-11T22:20:46.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.670+0000 7f9e1e445640 1 -- 172.21.15.100:0/1934295595 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e180690a0 con 0x7f9e180c9050 2024-09-11T22:20:46.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.670+0000 7f9e14ff9640 1 -- 172.21.15.100:0/1934295595 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e10003b10 con 0x7f9e180c9050 2024-09-11T22:20:46.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.671+0000 7fb198ff9640 1 -- 172.21.15.100:0/1418904792 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb19c15a1d0 con 0x7fb19c0b4090 2024-09-11T22:20:46.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.671+0000 7fba067fc640 1 -- 172.21.15.100:0/249014123 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba0c018020 con 0x7fba0804d310 2024-09-11T22:20:46.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.671+0000 7f9e14ff9640 1 --2- 172.21.15.100:0/1934295595 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9e0406be30 0x7f9e0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.671+0000 7f9e14ff9640 1 -- 172.21.15.100:0/1934295595 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9e1008ad00 con 0x7f9e180c9050 2024-09-11T22:20:46.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.671+0000 7f9e17fff640 1 --2- 172.21.15.100:0/1934295595 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9e0406be30 0x7f9e0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.671+0000 7fba067fc640 1 --2- 172.21.15.100:0/249014123 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb9f406be30 0x7fb9f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.671+0000 7fba067fc640 1 -- 172.21.15.100:0/249014123 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fba0c08b000 con 0x7fba0804d310 2024-09-11T22:20:46.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.671+0000 7f90c4d18640 1 -- 172.21.15.100:0/195609248 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90c00c1f30 con 0x7f90c00c6970 2024-09-11T22:20:46.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.672+0000 7f3dba7fc640 1 -- 172.21.15.100:0/2199822713 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3dc4094070 con 0x7f3dbc0e5f30 2024-09-11T22:20:46.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.672+0000 7fba15fba640 1 --2- 172.21.15.100:0/249014123 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb9f406be30 0x7fb9f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.672+0000 7f90aeffd640 1 -- 172.21.15.100:0/195609248 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f90b003d070 con 0x7f90c00c6970 2024-09-11T22:20:46.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.672+0000 7f9e17fff640 1 --2- 172.21.15.100:0/1934295595 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9e0406be30 0x7f9e0406e2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9e08009fc0 tx=0x7f9e08009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.672+0000 7f90aeffd640 1 --2- 172.21.15.100:0/195609248 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f90a006bf30 0x7f90a006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.672+0000 7f90aeffd640 1 -- 172.21.15.100:0/195609248 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f90b00aaaa0 con 0x7f90c00c6970 2024-09-11T22:20:46.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.672+0000 7f90bdd9b640 1 --2- 172.21.15.100:0/195609248 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f90a006bf30 0x7f90a006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.672+0000 7fba15fba640 1 --2- 172.21.15.100:0/249014123 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb9f406be30 0x7fb9f406e2f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba00006fd0 tx=0x7fba00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.672+0000 7f3dcac22640 1 -- 172.21.15.100:0/2199822713 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dbc0e2be0 con 0x7f3dbc0e5f30 2024-09-11T22:20:46.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.673+0000 7f90bdd9b640 1 --2- 172.21.15.100:0/195609248 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f90a006bf30 0x7f90a006e3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f90c0074290 tx=0x7f90b4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.673+0000 7f3dba7fc640 1 --2- 172.21.15.100:0/2199822713 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3da806bf00 0x7f3da806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:46.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.673+0000 7f3dba7fc640 1 -- 172.21.15.100:0/2199822713 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3dc4107300 con 0x7f3dbc0e5f30 2024-09-11T22:20:46.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.673+0000 7f3dc9c20640 1 --2- 172.21.15.100:0/2199822713 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3da806bf00 0x7f3da806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:46.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.673+0000 7f3dc9c20640 1 --2- 172.21.15.100:0/2199822713 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3da806bf00 0x7f3da806e3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3db40099f0 tx=0x7f3db4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:46.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.674+0000 7f4caffff640 1 -- 172.21.15.100:0/114783099 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4cc00590a0 con 0x7f4cc80cb2e0 2024-09-11T22:20:46.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.677+0000 7f90aeffd640 1 -- 172.21.15.100:0/195609248 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f90c00c1f30 con 0x7f90c00c6970 2024-09-11T22:20:46.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.678+0000 7f9e14ff9640 1 -- 172.21.15.100:0/1934295595 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9e10020020 con 0x7f9e180c9050 2024-09-11T22:20:46.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.681+0000 7f3dba7fc640 1 -- 172.21.15.100:0/2199822713 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3dc40d59e0 con 0x7f3dbc0e5f30 2024-09-11T22:20:46.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:46.682+0000 7fba067fc640 1 -- 172.21.15.100:0/249014123 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fba0c01f020 con 0x7fba0804d310 2024-09-11T22:20:47.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.067+0000 7fce843d8640 1 -- 172.21.15.100:0/1787705600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fce64005580 con 0x7fce7c0c7510 2024-09-11T22:20:47.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.067+0000 7fce72ffd640 1 -- 172.21.15.100:0/1787705600 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fce78059420 con 0x7fce7c0c7510 2024-09-11T22:20:47.068 INFO:teuthology.orchestra.run.smithi100.stdout:64424509449 2024-09-11T22:20:47.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.071+0000 7fce70ff9640 1 -- 172.21.15.100:0/1787705600 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fce6006be30 msgr2=0x7fce6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.071+0000 7fce70ff9640 1 --2- 172.21.15.100:0/1787705600 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fce6006be30 0x7fce6006e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0099a0 tx=0x7fce6c008040 comp rx=0 tx=0).stop 2024-09-11T22:20:47.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.071+0000 7fce70ff9640 1 -- 172.21.15.100:0/1787705600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce7c0c7510 msgr2=0x7fce7c0cc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.071+0000 7fce70ff9640 1 --2- 172.21.15.100:0/1787705600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce7c0c7510 0x7fce7c0cc6d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fce7800d600 tx=0x7fce7800dac0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.071+0000 7fce70ff9640 1 -- 172.21.15.100:0/1787705600 shutdown_connections 2024-09-11T22:20:47.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.072+0000 7fce70ff9640 1 --2- 172.21.15.100:0/1787705600 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fce6006be30 0x7fce6006e2f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.072+0000 7fce70ff9640 1 --2- 172.21.15.100:0/1787705600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce7c0c7510 0x7fce7c0cc6d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.072+0000 7fce70ff9640 1 --2- 172.21.15.100:0/1787705600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fce7c072c80 0x7fce7c0cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.072+0000 7fce70ff9640 1 --2- 172.21.15.100:0/1787705600 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce7c06fe50 0x7fce7c13b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.072+0000 7fce70ff9640 1 -- 172.21.15.100:0/1787705600 >> 172.21.15.100:0/1787705600 conn(0x7fce7c06f360 msgr2=0x7fce7c14ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:47.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.072+0000 7fce70ff9640 1 -- 172.21.15.100:0/1787705600 shutdown_connections 2024-09-11T22:20:47.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.072+0000 7fce70ff9640 1 -- 172.21.15.100:0/1787705600 wait complete. 2024-09-11T22:20:47.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.081+0000 7f4ccca2b640 1 -- 172.21.15.100:0/114783099 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4ca8005580 con 0x7f4cc80cb2e0 2024-09-11T22:20:47.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.081+0000 7fb1a2637640 1 -- 172.21.15.100:0/1418904792 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fb19c0d1040 con 0x7fb19c0b4090 2024-09-11T22:20:47.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.081+0000 7f90c4d18640 1 -- 172.21.15.100:0/195609248 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f90c00cd060 con 0x7f90c00c6970 2024-09-11T22:20:47.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.081+0000 7f4caffff640 1 -- 172.21.15.100:0/114783099 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4cc005d3a0 con 0x7f4cc80cb2e0 2024-09-11T22:20:47.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.081+0000 7fb198ff9640 1 -- 172.21.15.100:0/1418904792 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb18c0583a0 con 0x7fb19c0b4090 2024-09-11T22:20:47.083 INFO:teuthology.orchestra.run.smithi100.stdout:64424509448 2024-09-11T22:20:47.083 INFO:teuthology.orchestra.run.smithi100.stdout:64424509449 2024-09-11T22:20:47.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.082+0000 7f90aeffd640 1 -- 172.21.15.100:0/195609248 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f90b0078b30 con 0x7f90c00c6970 2024-09-11T22:20:47.085 INFO:teuthology.orchestra.run.smithi100.stdout:64424509450 2024-09-11T22:20:47.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.084+0000 7fc9471c4640 1 -- 172.21.15.100:0/3869682276 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc920005580 con 0x7fc940154b80 2024-09-11T22:20:47.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7f4ccca2b640 1 -- 172.21.15.100:0/114783099 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4cb406bf00 msgr2=0x7f4cb406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7f4ccca2b640 1 --2- 172.21.15.100:0/114783099 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4cb406bf00 0x7f4cb406e3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4cb80099a0 tx=0x7f4cb80090e0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7fb1a2637640 1 -- 172.21.15.100:0/1418904792 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb18806beb0 msgr2=0x7fb18806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7f9e1e445640 1 -- 172.21.15.100:0/1934295595 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9e180c3400 con 0x7f9e180c9050 2024-09-11T22:20:47.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7f4ccca2b640 1 -- 172.21.15.100:0/114783099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cc80cb2e0 msgr2=0x7f4cc81ea130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7fb1a2637640 1 --2- 172.21.15.100:0/1418904792 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb18806beb0 0x7fb18806e370 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb194033000 tx=0x7fb194009000 comp rx=0 tx=0).stop 2024-09-11T22:20:47.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7fb1a2637640 1 -- 172.21.15.100:0/1418904792 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb19c0b4090 msgr2=0x7fb19c15ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7fb1a2637640 1 --2- 172.21.15.100:0/1418904792 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb19c0b4090 0x7fb19c15ae00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00c440 tx=0x7fb18c00c900 comp rx=0 tx=0).stop 2024-09-11T22:20:47.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7f4ccca2b640 1 --2- 172.21.15.100:0/114783099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cc80cb2e0 0x7f4cc81ea130 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000be20 tx=0x7f4cc000bf10 comp rx=0 tx=0).stop 2024-09-11T22:20:47.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7f4ccca2b640 1 -- 172.21.15.100:0/114783099 shutdown_connections 2024-09-11T22:20:47.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7f4ccca2b640 1 --2- 172.21.15.100:0/114783099 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4cb406bf00 0x7f4cb406e3c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7f4ccca2b640 1 --2- 172.21.15.100:0/114783099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cc80cb2e0 0x7f4cc81ea130 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7f90c4d18640 1 -- 172.21.15.100:0/195609248 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f90a006bf30 msgr2=0x7f90a006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7f90c4d18640 1 --2- 172.21.15.100:0/195609248 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f90a006bf30 0x7f90a006e3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f90c0074290 tx=0x7f90b4009190 comp rx=0 tx=0).stop 2024-09-11T22:20:47.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7f4ccca2b640 1 --2- 172.21.15.100:0/114783099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cc815c3d0 0x7f4cc81e9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7f4ccca2b640 1 --2- 172.21.15.100:0/114783099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4cc80c7b50 0x7f4cc8160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7f90c4d18640 1 -- 172.21.15.100:0/195609248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90c00c6970 msgr2=0x7f90c014f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7f90c4d18640 1 --2- 172.21.15.100:0/195609248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90c00c6970 0x7f90c014f890 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f90b0009990 tx=0x7f90b00046c0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7f4ccca2b640 1 -- 172.21.15.100:0/114783099 >> 172.21.15.100:0/114783099 conn(0x7f4cc806ed10 msgr2=0x7f4cc806cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:47.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7fc93d7fa640 1 -- 172.21.15.100:0/3869682276 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc9380591c0 con 0x7fc940154b80 2024-09-11T22:20:47.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7f90c4d18640 1 -- 172.21.15.100:0/195609248 shutdown_connections 2024-09-11T22:20:47.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7f90c4d18640 1 --2- 172.21.15.100:0/195609248 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f90a006bf30 0x7f90a006e3f0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f90c0074290 tx=0x7f90b4009190 comp rx=0 tx=0).stop 2024-09-11T22:20:47.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7f90c4d18640 1 --2- 172.21.15.100:0/195609248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90c0150b60 0x7f90c0158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7f90c4d18640 1 --2- 172.21.15.100:0/195609248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90c00c7ac0 0x7f90c01585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.085+0000 7f90c4d18640 1 --2- 172.21.15.100:0/195609248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f90c00c6970 0x7f90c014f890 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f90b0009990 tx=0x7f90b00046c0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.086+0000 7f90c4d18640 1 -- 172.21.15.100:0/195609248 >> 172.21.15.100:0/195609248 conn(0x7f90c006f190 msgr2=0x7f90c00c8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:47.092 INFO:teuthology.orchestra.run.smithi100.stdout:55834574858 2024-09-11T22:20:47.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.086+0000 7f4ccca2b640 1 -- 172.21.15.100:0/114783099 shutdown_connections 2024-09-11T22:20:47.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.086+0000 7f4ccca2b640 1 -- 172.21.15.100:0/114783099 wait complete. 2024-09-11T22:20:47.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.086+0000 7fb1a2637640 1 -- 172.21.15.100:0/1418904792 shutdown_connections 2024-09-11T22:20:47.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.086+0000 7fb1a2637640 1 --2- 172.21.15.100:0/1418904792 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb18806beb0 0x7fb18806e370 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.086+0000 7fb1a2637640 1 --2- 172.21.15.100:0/1418904792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb19c162570 0x7fb19c1f7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.086+0000 7fb1a2637640 1 --2- 172.21.15.100:0/1418904792 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb19c0c6ba0 0x7fb19c0ceda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.086+0000 7fb1a2637640 1 --2- 172.21.15.100:0/1418904792 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb19c0b4090 0x7fb19c15ae00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.086+0000 7fb1a2637640 1 -- 172.21.15.100:0/1418904792 >> 172.21.15.100:0/1418904792 conn(0x7fb19c06c000 msgr2=0x7fb19c0cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:47.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.086+0000 7f9e14ff9640 1 -- 172.21.15.100:0/1934295595 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9e10058c90 con 0x7f9e180c9050 2024-09-11T22:20:47.094 INFO:teuthology.orchestra.run.smithi100.stdout:60129542152 2024-09-11T22:20:47.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.086+0000 7fb1a2637640 1 -- 172.21.15.100:0/1418904792 shutdown_connections 2024-09-11T22:20:47.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.086+0000 7fb1a2637640 1 -- 172.21.15.100:0/1418904792 wait complete. 2024-09-11T22:20:47.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.086+0000 7f90c4d18640 1 -- 172.21.15.100:0/195609248 shutdown_connections 2024-09-11T22:20:47.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.087+0000 7f90c4d18640 1 -- 172.21.15.100:0/195609248 wait complete. 2024-09-11T22:20:47.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.087+0000 7fba16fbc640 1 -- 172.21.15.100:0/249014123 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fba0804c970 con 0x7fba0804d310 2024-09-11T22:20:47.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.087+0000 7f3dcac22640 1 -- 172.21.15.100:0/2199822713 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3dbc04b1c0 con 0x7f3dbc0e5f30 2024-09-11T22:20:47.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.087+0000 7fba067fc640 1 -- 172.21.15.100:0/249014123 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fba0c059550 con 0x7fba0804d310 2024-09-11T22:20:47.096 INFO:teuthology.orchestra.run.smithi100.stdout:64424509449 2024-09-11T22:20:47.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.6 2024-09-11T22:20:47.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.088+0000 7f3dba7fc640 1 -- 172.21.15.100:0/2199822713 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3dc40d52e0 con 0x7f3dbc0e5f30 2024-09-11T22:20:47.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.088+0000 7fc9471c4640 1 -- 172.21.15.100:0/3869682276 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc92406beb0 msgr2=0x7fc92406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.088+0000 7fc9471c4640 1 --2- 172.21.15.100:0/3869682276 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc92406beb0 0x7fc92406e370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc934009560 tx=0x7fc93402e000 comp rx=0 tx=0).stop 2024-09-11T22:20:47.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.088+0000 7fc9471c4640 1 -- 172.21.15.100:0/3869682276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc940154b80 msgr2=0x7fc94014e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.088+0000 7fc9471c4640 1 --2- 172.21.15.100:0/3869682276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc940154b80 0x7fc94014e420 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc938007d90 tx=0x7fc93800e4b0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.089+0000 7fc9471c4640 1 -- 172.21.15.100:0/3869682276 shutdown_connections 2024-09-11T22:20:47.098 INFO:teuthology.orchestra.run.smithi100.stdout:60129542152 2024-09-11T22:20:47.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.089+0000 7fc9471c4640 1 --2- 172.21.15.100:0/3869682276 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc92406beb0 0x7fc92406e370 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.089+0000 7fc9471c4640 1 --2- 172.21.15.100:0/3869682276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc940154b80 0x7fc94014e420 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.089+0000 7fc9471c4640 1 --2- 172.21.15.100:0/3869682276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9400c58d0 0x7fc94014dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.089+0000 7fc9471c4640 1 --2- 172.21.15.100:0/3869682276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9400731c0 0x7fc94006e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.089+0000 7fc9471c4640 1 -- 172.21.15.100:0/3869682276 >> 172.21.15.100:0/3869682276 conn(0x7fc94006c000 msgr2=0x7fc9400cc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:47.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.089+0000 7fc9471c4640 1 -- 172.21.15.100:0/3869682276 shutdown_connections 2024-09-11T22:20:47.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.089+0000 7fc9471c4640 1 -- 172.21.15.100:0/3869682276 wait complete. 2024-09-11T22:20:47.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.090+0000 7f9e1e445640 1 -- 172.21.15.100:0/1934295595 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9e0406be30 msgr2=0x7f9e0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.090+0000 7f9e1e445640 1 --2- 172.21.15.100:0/1934295595 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9e0406be30 0x7f9e0406e2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9e08009fc0 tx=0x7f9e08009240 comp rx=0 tx=0).stop 2024-09-11T22:20:47.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.090+0000 7f9e1e445640 1 -- 172.21.15.100:0/1934295595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e180c9050 msgr2=0x7f9e180c4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.090+0000 7f9e1e445640 1 --2- 172.21.15.100:0/1934295595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e180c9050 0x7f9e180c4500 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000c730 tx=0x7f9e1000cbf0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.091+0000 7fba16fbc640 1 -- 172.21.15.100:0/249014123 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb9f406be30 msgr2=0x7fb9f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.091+0000 7fba16fbc640 1 --2- 172.21.15.100:0/249014123 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb9f406be30 0x7fb9f406e2f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba00006fd0 tx=0x7fba00008040 comp rx=0 tx=0).stop 2024-09-11T22:20:47.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.091+0000 7f9e1e445640 1 -- 172.21.15.100:0/1934295595 shutdown_connections 2024-09-11T22:20:47.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.091+0000 7f9e1e445640 1 --2- 172.21.15.100:0/1934295595 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9e0406be30 0x7f9e0406e2f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.091+0000 7f9e1e445640 1 --2- 172.21.15.100:0/1934295595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e180c9050 0x7f9e180c4500 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.091+0000 7f9e1e445640 1 --2- 172.21.15.100:0/1934295595 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e180c8c70 0x7f9e18158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.091+0000 7f9e1e445640 1 --2- 172.21.15.100:0/1934295595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e180c8230 0x7f9e18158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.091+0000 7f9e1e445640 1 -- 172.21.15.100:0/1934295595 >> 172.21.15.100:0/1934295595 conn(0x7f9e1806f190 msgr2=0x7f9e180c1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:47.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.091+0000 7fba16fbc640 1 -- 172.21.15.100:0/249014123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba0804d310 msgr2=0x7fba08174200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.091+0000 7fba16fbc640 1 --2- 172.21.15.100:0/249014123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba0804d310 0x7fba08174200 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00b3e0 tx=0x7fba0c00b8a0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.091+0000 7fba16fbc640 1 -- 172.21.15.100:0/249014123 shutdown_connections 2024-09-11T22:20:47.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.091+0000 7fba16fbc640 1 --2- 172.21.15.100:0/249014123 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb9f406be30 0x7fb9f406e2f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.091+0000 7fba16fbc640 1 --2- 172.21.15.100:0/249014123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba080d5850 0x7fba0804f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.091+0000 7fba16fbc640 1 --2- 172.21.15.100:0/249014123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba0804d310 0x7fba08174200 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.091+0000 7fba16fbc640 1 --2- 172.21.15.100:0/249014123 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba08047a80 0x7fba080dac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.091+0000 7fba16fbc640 1 -- 172.21.15.100:0/249014123 >> 172.21.15.100:0/249014123 conn(0x7fba0804d830 msgr2=0x7fba08004f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:47.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.091+0000 7f9e1e445640 1 -- 172.21.15.100:0/1934295595 shutdown_connections 2024-09-11T22:20:47.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.091+0000 7fba16fbc640 1 -- 172.21.15.100:0/249014123 shutdown_connections 2024-09-11T22:20:47.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.091+0000 7fba16fbc640 1 -- 172.21.15.100:0/249014123 wait complete. 2024-09-11T22:20:47.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.092+0000 7f9e1e445640 1 -- 172.21.15.100:0/1934295595 wait complete. 2024-09-11T22:20:47.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.093+0000 7f3dcac22640 1 -- 172.21.15.100:0/2199822713 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3da806bf00 msgr2=0x7f3da806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.093+0000 7f3dcac22640 1 --2- 172.21.15.100:0/2199822713 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3da806bf00 0x7f3da806e3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3db40099f0 tx=0x7f3db4008040 comp rx=0 tx=0).stop 2024-09-11T22:20:47.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.093+0000 7f3dcac22640 1 -- 172.21.15.100:0/2199822713 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3dbc0e5f30 msgr2=0x7f3dbc17b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:47.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.093+0000 7f3dcac22640 1 --2- 172.21.15.100:0/2199822713 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3dbc0e5f30 0x7f3dbc17b970 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4051500 tx=0x7f3dc4069890 comp rx=0 tx=0).stop 2024-09-11T22:20:47.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.093+0000 7f3dcac22640 1 -- 172.21.15.100:0/2199822713 shutdown_connections 2024-09-11T22:20:47.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.093+0000 7f3dcac22640 1 --2- 172.21.15.100:0/2199822713 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3da806bf00 0x7f3da806e3c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.093+0000 7f3dcac22640 1 --2- 172.21.15.100:0/2199822713 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3dbc0e5f30 0x7f3dbc17b970 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.093+0000 7f3dcac22640 1 --2- 172.21.15.100:0/2199822713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3dbc0dcd90 0x7f3dbc178be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.093+0000 7f3dcac22640 1 --2- 172.21.15.100:0/2199822713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dbc04a680 0x7f3dbc0dd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:47.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.093+0000 7f3dcac22640 1 -- 172.21.15.100:0/2199822713 >> 172.21.15.100:0/2199822713 conn(0x7f3dbc04fc50 msgr2=0x7f3dbc0337b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:47.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.093+0000 7f3dcac22640 1 -- 172.21.15.100:0/2199822713 shutdown_connections 2024-09-11T22:20:47.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:47.093+0000 7f3dcac22640 1 -- 172.21.15.100:0/2199822713 wait complete. 2024-09-11T22:20:47.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.3 2024-09-11T22:20:47.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.5 2024-09-11T22:20:47.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.7 2024-09-11T22:20:47.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2024-09-11T22:20:47.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542152 for osd.2 2024-09-11T22:20:47.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.4 2024-09-11T22:20:47.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542152 for osd.0 2024-09-11T22:20:48.097 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T22:20:48.108 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T22:20:48.112 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T22:20:48.112 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T22:20:48.113 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T22:20:48.114 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T22:20:48.115 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T22:20:48.116 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T22:20:48.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.255+0000 7f314a6e6640 1 Processor -- start 2024-09-11T22:20:48.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.255+0000 7f314a6e6640 1 -- start start 2024-09-11T22:20:48.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.258+0000 7f314a6e6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f314415f8d0 0x7f31440c6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.258+0000 7f314a6e6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f31440c63b0 0x7f3144071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.258+0000 7f314a6e6640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3144162300 con 0x7f3144162ac0 2024-09-11T22:20:48.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.258+0000 7f314a6e6640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f314415fcb0 con 0x7f314415f8d0 2024-09-11T22:20:48.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.258+0000 7f314a6e6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f3144162630 con 0x7f31440c63b0 2024-09-11T22:20:48.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.258+0000 7f3148c83640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3144162ac0 0x7f31440cc740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33362/0 (socket says 172.21.15.100:33362) 2024-09-11T22:20:48.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.258+0000 7f3148c83640 1 -- 172.21.15.100:0/3715789530 learned_addr learned my addr 172.21.15.100:0/3715789530 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:48.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.258+0000 7f3143fff640 1 --2- 172.21.15.100:0/3715789530 >> v2:172.21.15.100:3300/0 conn(0x7f314415f8d0 0x7f31440c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.259+0000 7f3142ffd640 1 -- 172.21.15.100:0/3715789530 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1506159818 0 0) 0x7f3144162300 con 0x7f3144162ac0 2024-09-11T22:20:48.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.259+0000 7f3142ffd640 1 -- 172.21.15.100:0/3715789530 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f312c003520 con 0x7f3144162ac0 2024-09-11T22:20:48.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.261+0000 7f31437fe640 1 --2- 172.21.15.100:0/3715789530 >> v2:172.21.15.167:3300/0 conn(0x7f31440c63b0 0x7f3144071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.261+0000 7f3143fff640 1 -- 172.21.15.100:0/3715789530 >> v2:172.21.15.167:3300/0 conn(0x7f31440c63b0 msgr2=0x7f3144071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:48.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.261+0000 7f3143fff640 1 --2- 172.21.15.100:0/3715789530 >> v2:172.21.15.167:3300/0 conn(0x7f31440c63b0 0x7f3144071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.261+0000 7f3143fff640 1 -- 172.21.15.100:0/3715789530 >> v1:172.21.15.100:6789/0 conn(0x7f3144162ac0 legacy=0x7f31440cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.261+0000 7f3143fff640 1 -- 172.21.15.100:0/3715789530 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31440c7550 con 0x7f314415f8d0 2024-09-11T22:20:48.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.263+0000 7f3143fff640 1 --2- 172.21.15.100:0/3715789530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f314415f8d0 0x7f31440c6890 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f31440c83f0 tx=0x7f313802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45fba2d37f109a05 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.263+0000 7f3142ffd640 1 -- 172.21.15.100:0/3715789530 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3138037070 con 0x7f314415f8d0 2024-09-11T22:20:48.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.263+0000 7f3142ffd640 1 -- 172.21.15.100:0/3715789530 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3138032440 con 0x7f314415f8d0 2024-09-11T22:20:48.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.264+0000 7f314a6e6640 1 -- 172.21.15.100:0/3715789530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f314415f8d0 msgr2=0x7f31440c6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.264+0000 7f314a6e6640 1 --2- 172.21.15.100:0/3715789530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f314415f8d0 0x7f31440c6890 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f31440c83f0 tx=0x7f313802a250 comp rx=0 tx=0).stop 2024-09-11T22:20:48.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.265+0000 7f314a6e6640 1 -- 172.21.15.100:0/3715789530 shutdown_connections 2024-09-11T22:20:48.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.265+0000 7f314a6e6640 1 --2- 172.21.15.100:0/3715789530 >> v2:172.21.15.167:3300/0 conn(0x7f31440c63b0 0x7f3144071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.265+0000 7f314a6e6640 1 --2- 172.21.15.100:0/3715789530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f314415f8d0 0x7f31440c6890 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.265+0000 7f314a6e6640 1 -- 172.21.15.100:0/3715789530 >> 172.21.15.100:0/3715789530 conn(0x7f314406fa70 msgr2=0x7f314406fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:48.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.265+0000 7f314a6e6640 1 -- 172.21.15.100:0/3715789530 shutdown_connections 2024-09-11T22:20:48.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.265+0000 7f314a6e6640 1 -- 172.21.15.100:0/3715789530 wait complete. 2024-09-11T22:20:48.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.267+0000 7f314a6e6640 1 Processor -- start 2024-09-11T22:20:48.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.267+0000 7f314a6e6640 1 -- start start 2024-09-11T22:20:48.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.268+0000 7f314a6e6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31440c63b0 0x7f314408c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.268+0000 7f314a6e6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f314415f8d0 0x7f31441501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.269+0000 7f31437fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f314415f8d0 0x7f31441501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.269+0000 7f31437fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f314415f8d0 0x7f31441501b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47476/0 (socket says 172.21.15.100:47476) 2024-09-11T22:20:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.269+0000 7f31437fe640 1 -- 172.21.15.100:0/4238686094 learned_addr learned my addr 172.21.15.100:0/4238686094 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.269+0000 7f314a6e6640 1 --2- 172.21.15.100:0/4238686094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3144162ac0 0x7f31441512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.270+0000 7f314a6e6640 1 -- 172.21.15.100:0/4238686094 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f31440c7b10 con 0x7f314415f8d0 2024-09-11T22:20:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.270+0000 7f314a6e6640 1 -- 172.21.15.100:0/4238686094 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f31440c72f0 con 0x7f3144162ac0 2024-09-11T22:20:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.270+0000 7f314a6e6640 1 -- 172.21.15.100:0/4238686094 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f314415ecf0 con 0x7f31440c63b0 2024-09-11T22:20:48.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.270+0000 7f3148c83640 1 --2- 172.21.15.100:0/4238686094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3144162ac0 0x7f31441512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.271+0000 7f31437fe640 1 -- 172.21.15.100:0/4238686094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31440c63b0 msgr2=0x7f314408c670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:20:48.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.271+0000 7f31437fe640 1 --2- 172.21.15.100:0/4238686094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31440c63b0 0x7f314408c670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.271+0000 7f31437fe640 1 -- 172.21.15.100:0/4238686094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3144162ac0 msgr2=0x7f31441512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.271+0000 7f31437fe640 1 --2- 172.21.15.100:0/4238686094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3144162ac0 0x7f31441512d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.271+0000 7f31437fe640 1 -- 172.21.15.100:0/4238686094 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3144161920 con 0x7f314415f8d0 2024-09-11T22:20:48.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.271+0000 7f31437fe640 1 --2- 172.21.15.100:0/4238686094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f314415f8d0 0x7f31441501b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f313400d920 tx=0x7f313400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.272+0000 7f3140ff9640 1 -- 172.21.15.100:0/4238686094 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313400b780 con 0x7f314415f8d0 2024-09-11T22:20:48.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.272+0000 7f314a6e6640 1 -- 172.21.15.100:0/4238686094 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3144155900 con 0x7f314415f8d0 2024-09-11T22:20:48.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.274+0000 7f314a6e6640 1 -- 172.21.15.100:0/4238686094 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3144158920 con 0x7f314415f8d0 2024-09-11T22:20:48.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.275+0000 7f3140ff9640 1 -- 172.21.15.100:0/4238686094 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3134019070 con 0x7f314415f8d0 2024-09-11T22:20:48.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.275+0000 7f3140ff9640 1 -- 172.21.15.100:0/4238686094 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313400bb40 con 0x7f314415f8d0 2024-09-11T22:20:48.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.276+0000 7f3140ff9640 1 -- 172.21.15.100:0/4238686094 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f313400bce0 con 0x7f314415f8d0 2024-09-11T22:20:48.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.278+0000 7f3140ff9640 1 --2- 172.21.15.100:0/4238686094 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f313006bf60 0x7f313006e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.279+0000 7f3143fff640 1 --2- 172.21.15.100:0/4238686094 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f313006bf60 0x7f313006e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.279+0000 7f3140ff9640 1 -- 172.21.15.100:0/4238686094 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f313408aee0 con 0x7f314415f8d0 2024-09-11T22:20:48.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.279+0000 7f314a6e6640 1 -- 172.21.15.100:0/4238686094 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3124005290 con 0x7f314415f8d0 2024-09-11T22:20:48.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.280+0000 7f3143fff640 1 --2- 172.21.15.100:0/4238686094 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f313006bf60 0x7f313006e420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3138034000 tx=0x7f313802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.288+0000 7f3140ff9640 1 -- 172.21.15.100:0/4238686094 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3134059590 con 0x7f314415f8d0 2024-09-11T22:20:48.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.312+0000 7fba1b46e640 1 Processor -- start 2024-09-11T22:20:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.313+0000 7fb383fff640 1 Processor -- start 2024-09-11T22:20:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.313+0000 7fb383fff640 1 -- start start 2024-09-11T22:20:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.313+0000 7fd00759e640 1 Processor -- start 2024-09-11T22:20:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.313+0000 7fd00759e640 1 -- start start 2024-09-11T22:20:48.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.314+0000 7f7c11191640 1 Processor -- start 2024-09-11T22:20:48.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.314+0000 7f7c11191640 1 -- start start 2024-09-11T22:20:48.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.313+0000 7fba1b46e640 1 -- start start 2024-09-11T22:20:48.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.314+0000 7fba1b46e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba140c78a0 0x7fba1415ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.314+0000 7fba1b46e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba14151b00 con 0x7fba1415b1b0 2024-09-11T22:20:48.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fba1b46e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba14072800 con 0x7fba14151720 2024-09-11T22:20:48.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fba1b46e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fba140c8e70 con 0x7fba140c78a0 2024-09-11T22:20:48.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fb383fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb37c0dccc0 0x7fb37c0091b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fd00759e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd0000d4f90 0x7fd000046fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fd00759e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0000dbb50 con 0x7fd00004c950 2024-09-11T22:20:48.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fd00759e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0000db870 con 0x7fd0000dabc0 2024-09-11T22:20:48.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fd00759e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fd0000d5390 con 0x7fd0000d4f90 2024-09-11T22:20:48.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fd005d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd0000d4f90 0x7fd000046fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fd005d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd0000d4f90 0x7fd000046fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44294/0 (socket says 172.21.15.100:44294) 2024-09-11T22:20:48.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fd005d9b640 1 -- 172.21.15.100:0/1810150116 learned_addr learned my addr 172.21.15.100:0/1810150116 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:48.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fd005d9b640 1 -- 172.21.15.100:0/1810150116 >> v1:172.21.15.167:6789/0 conn(0x7fd0000dabc0 legacy=0x7fd0000db050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fd005d9b640 1 -- 172.21.15.100:0/1810150116 >> v1:172.21.15.100:6789/0 conn(0x7fd00004c950 legacy=0x7fd00004b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:48.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fd005d9b640 1 -- 172.21.15.100:0/1810150116 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd000046200 con 0x7fd0000d4f90 2024-09-11T22:20:48.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fb383fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb37c04e330 0x7fb37c0e6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fb383fff640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb37c04df00 con 0x7fb37c04cc50 2024-09-11T22:20:48.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fb383fff640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb37c04e750 con 0x7fb37c04e330 2024-09-11T22:20:48.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fb383fff640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fb37c0e60b0 con 0x7fb37c0dccc0 2024-09-11T22:20:48.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7f2ee68af640 1 Processor -- start 2024-09-11T22:20:48.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fe41aed9640 1 Processor -- start 2024-09-11T22:20:48.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fe41aed9640 1 -- start start 2024-09-11T22:20:48.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7f7c11191640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7c0c0b2170 0x7f7c0c068150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7f7c11191640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7c0c0c3f50 0x7f7c0c15a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7f7c11191640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c0c074120 con 0x7f7c0c06ce70 2024-09-11T22:20:48.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7f7c11191640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f7c0c0b2550 con 0x7f7c0c0b2170 2024-09-11T22:20:48.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7f7c11191640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f7c0c067cc0 con 0x7f7c0c0c3f50 2024-09-11T22:20:48.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7f7c0ad9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7c0c0b2170 0x7f7c0c068150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7f7c0ad9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7c0c0b2170 0x7f7c0c068150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47486/0 (socket says 172.21.15.100:47486) 2024-09-11T22:20:48.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7f7c0ad9d640 1 -- 172.21.15.100:0/4219049252 learned_addr learned my addr 172.21.15.100:0/4219049252 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:48.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7f7c0ad9d640 1 -- 172.21.15.100:0/4219049252 >> v2:172.21.15.167:3300/0 conn(0x7f7c0c0c3f50 msgr2=0x7f7c0c15a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:48.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7f3c2f227640 1 Processor -- start 2024-09-11T22:20:48.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7f3c2f227640 1 -- start start 2024-09-11T22:20:48.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7f7c0a59c640 1 --2- 172.21.15.100:0/4219049252 >> v2:172.21.15.167:3300/0 conn(0x7f7c0c0c3f50 0x7f7c0c15a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7f7c0ad9d640 1 --2- 172.21.15.100:0/4219049252 >> v2:172.21.15.167:3300/0 conn(0x7f7c0c0c3f50 0x7f7c0c15a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7f7c0ad9d640 1 -- 172.21.15.100:0/4219049252 >> v1:172.21.15.100:6789/0 conn(0x7f7c0c06ce70 legacy=0x7f7c0c073620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:20:48.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fba1ac6d640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fba1415b1b0 0x7fba14161d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33378/0 (socket says 172.21.15.100:33378) 2024-09-11T22:20:48.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fba1ac6d640 1 -- 172.21.15.100:0/229526684 learned_addr learned my addr 172.21.15.100:0/229526684 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:48.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7fba1946a640 1 -- 172.21.15.100:0/229526684 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1679706702 0 0) 0x7fba14072800 con 0x7fba14151720 2024-09-11T22:20:48.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7fba1946a640 1 -- 172.21.15.100:0/229526684 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9fc005730 con 0x7fba14151720 2024-09-11T22:20:48.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7fba1946a640 1 -- 172.21.15.100:0/229526684 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3898122290 0 0) 0x7fba14151b00 con 0x7fba1415b1b0 2024-09-11T22:20:48.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7fba1946a640 1 -- 172.21.15.100:0/229526684 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba14072800 con 0x7fba1415b1b0 2024-09-11T22:20:48.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7fba1946a640 1 -- 172.21.15.100:0/229526684 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2050985207 0 0) 0x7fb9fc005730 con 0x7fba14151720 2024-09-11T22:20:48.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7fba1946a640 1 -- 172.21.15.100:0/229526684 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba140c78a0 msgr2=0x7fba1415ac70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:20:48.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7fba1946a640 1 --2- 172.21.15.100:0/229526684 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba140c78a0 0x7fba1415ac70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7fba1946a640 1 -- 172.21.15.100:0/229526684 >> v1:172.21.15.100:6789/0 conn(0x7fba1415b1b0 legacy=0x7fba14161d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7fba1946a640 1 -- 172.21.15.100:0/229526684 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba140741f0 con 0x7fba14151720 2024-09-11T22:20:48.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7fba1946a640 1 -- 172.21.15.100:0/229526684 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fba0c0015f0 con 0x7fba14151720 2024-09-11T22:20:48.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7fba1946a640 1 -- 172.21.15.100:0/229526684 >> v1:172.21.15.167:6789/0 conn(0x7fba14151720 legacy=0x7fba1406e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7fba1946a640 1 --2- 172.21.15.100:0/229526684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9fc005d80 0x7fb9fc006160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7fba1946a640 1 --2- 172.21.15.100:0/229526684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9fc006a10 0x7fb9fc006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7fba1946a640 1 --2- 172.21.15.100:0/229526684 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9fc0073d0 0x7fb9fc00bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7fba1946a640 1 -- 172.21.15.100:0/229526684 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fba140c8e70 con 0x7fb9fc005d80 2024-09-11T22:20:48.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7fba1946a640 1 -- 172.21.15.100:0/229526684 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc00c100 con 0x7fb9fc006a10 2024-09-11T22:20:48.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7fba1946a640 1 -- 172.21.15.100:0/229526684 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb9fc00c300 con 0x7fb9fc0073d0 2024-09-11T22:20:48.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7fba1a46c640 1 --2- 172.21.15.100:0/229526684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9fc005d80 0x7fb9fc006160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7fba1ac6d640 1 --2- 172.21.15.100:0/229526684 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9fc0073d0 0x7fb9fc00bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fb3827fc640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb37c04e330 0x7fb37c0e6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7f3c2f227640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3c28154c00 0x7f3c280cc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7f3c2f227640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3c2815afb0 0x7f3c2815b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7f3c2f227640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c2815dfa0 con 0x7f3c280c5a90 2024-09-11T22:20:48.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7f3c2f227640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f3c2815ab20 con 0x7f3c2815afb0 2024-09-11T22:20:48.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7f3c2f227640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f3c2815e220 con 0x7f3c28154c00 2024-09-11T22:20:48.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7fe41aed9640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe40c0450f0 0x7fe40c0da680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7f2ee68af640 1 -- start start 2024-09-11T22:20:48.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7f2ee68af640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2ee015f2d0 0x7f2ee015f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7f2ee68af640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2ee00c8c40 0x7f2ee00c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.316+0000 7f2ee68af640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ee00c8920 con 0x7f2ee0158ff0 2024-09-11T22:20:48.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7f2ee68af640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f2ee01630f0 con 0x7f2ee015f2d0 2024-09-11T22:20:48.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7f2ee68af640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f2ee015fc40 con 0x7f2ee00c8c40 2024-09-11T22:20:48.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7fba19c6b640 1 --2- 172.21.15.100:0/229526684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9fc006a10 0x7fb9fc006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7fd005d9b640 1 --2- 172.21.15.100:0/1810150116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0000d4f90 0x7fd000046fc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009870 tx=0x7fcff802a2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e9263acdf530a14 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fb3827fc640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb37c04e330 0x7fb37c0e6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47482/0 (socket says 172.21.15.100:47482) 2024-09-11T22:20:48.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7f3c2cfc3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3c28154c00 0x7f3c280cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7f3c2cfc3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3c28154c00 0x7f3c280cc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44324/0 (socket says 172.21.15.100:44324) 2024-09-11T22:20:48.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7f3c2cfc3640 1 -- 172.21.15.100:0/2108144189 learned_addr learned my addr 172.21.15.100:0/2108144189 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:48.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7fba1a46c640 1 -- 172.21.15.100:0/229526684 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9fc0073d0 msgr2=0x7fb9fc00bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:48.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7fba1a46c640 1 --2- 172.21.15.100:0/229526684 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9fc0073d0 0x7fb9fc00bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7fba1a46c640 1 -- 172.21.15.100:0/229526684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9fc006a10 msgr2=0x7fb9fc006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:48.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7fba1a46c640 1 --2- 172.21.15.100:0/229526684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9fc006a10 0x7fb9fc006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7fba1a46c640 1 -- 172.21.15.100:0/229526684 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9fc005730 con 0x7fb9fc005d80 2024-09-11T22:20:48.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fb3827fc640 1 -- 172.21.15.100:0/4163005847 learned_addr learned my addr 172.21.15.100:0/4163005847 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:48.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7fe41aed9640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe40c04aa40 con 0x7fe40c0d4940 2024-09-11T22:20:48.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7f3c2d7c4640 1 --2- 172.21.15.100:0/2108144189 >> v2:172.21.15.100:3300/0 conn(0x7f3c2815afb0 0x7f3c2815b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7fe41a6d8640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fe40c04c090 0x7fe40c0dabc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:44256/0 (socket says 172.21.15.100:44256) 2024-09-11T22:20:48.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7fe41a6d8640 1 -- 172.21.15.100:0/742098832 learned_addr learned my addr 172.21.15.100:0/742098832 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:48.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7fe4196d6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe40c0450f0 0x7fe40c0da680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7f2ee4e4c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2ee00c8c40 0x7f2ee00c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7f2ee4e4c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2ee00c8c40 0x7f2ee00c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44310/0 (socket says 172.21.15.100:44310) 2024-09-11T22:20:48.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7f2ee4e4c640 1 -- 172.21.15.100:0/3923218909 learned_addr learned my addr 172.21.15.100:0/3923218909 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:48.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7f2edf7fe640 1 --2- 172.21.15.100:0/3923218909 >> v2:172.21.15.100:3300/0 conn(0x7f2ee015f2d0 0x7f2ee015f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fe41aed9640 1 -- 172.21.15.100:0/742098832 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe40c04ace0 con 0x7fe40c04c090 2024-09-11T22:20:48.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7f3c2cfc3640 1 -- 172.21.15.100:0/2108144189 >> v2:172.21.15.100:3300/0 conn(0x7f3c2815afb0 msgr2=0x7f3c2815b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:48.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7f7c0ad9d640 1 -- 172.21.15.100:0/4219049252 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0c0c7cf0 con 0x7f7c0c0b2170 2024-09-11T22:20:48.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7f7c0a59c640 1 --2- 172.21.15.100:0/4219049252 >> v2:172.21.15.167:3300/0 conn(0x7f7c0c0c3f50 0x7f7c0c15a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:48.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fe41aed9640 1 -- 172.21.15.100:0/742098832 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fe40c044c60 con 0x7fe40c0450f0 2024-09-11T22:20:48.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7f3c2cfc3640 1 --2- 172.21.15.100:0/2108144189 >> v2:172.21.15.100:3300/0 conn(0x7f3c2815afb0 0x7f3c2815b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7f3c2cfc3640 1 -- 172.21.15.100:0/2108144189 >> v1:172.21.15.167:6789/0 conn(0x7f3c280c5a90 legacy=0x7f3c280d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7f3c2cfc3640 1 -- 172.21.15.100:0/2108144189 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2815e500 con 0x7f3c28154c00 2024-09-11T22:20:48.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fe418ed5640 1 -- 172.21.15.100:0/742098832 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2472120845 0 0) 0x7fe40c04ace0 con 0x7fe40c04c090 2024-09-11T22:20:48.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fe418ed5640 1 -- 172.21.15.100:0/742098832 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe400003520 con 0x7fe40c04c090 2024-09-11T22:20:48.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fd00559a640 1 -- 172.21.15.100:0/1810150116 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff8037070 con 0x7fd0000d4f90 2024-09-11T22:20:48.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fba1ac6d640 1 --2- 172.21.15.100:0/229526684 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9fc0073d0 0x7fb9fc00bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:48.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7f2ee4e4c640 1 -- 172.21.15.100:0/3923218909 >> v2:172.21.15.100:3300/0 conn(0x7f2ee015f2d0 msgr2=0x7f2ee015f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:48.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7f2ee4e4c640 1 --2- 172.21.15.100:0/3923218909 >> v2:172.21.15.100:3300/0 conn(0x7f2ee015f2d0 0x7f2ee015f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7f2ee4e4c640 1 -- 172.21.15.100:0/3923218909 >> v1:172.21.15.100:6789/0 conn(0x7f2ee0158ff0 legacy=0x7f2ee00c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:48.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7f2ee4e4c640 1 -- 172.21.15.100:0/3923218909 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee00c95d0 con 0x7f2ee00c8c40 2024-09-11T22:20:48.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fd00559a640 1 -- 172.21.15.100:0/1810150116 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcff8032440 con 0x7fd0000d4f90 2024-09-11T22:20:48.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fb3827fc640 1 -- 172.21.15.100:0/4163005847 >> v2:172.21.15.167:3300/0 conn(0x7fb37c0dccc0 msgr2=0x7fb37c0091b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:20:48.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fb3827fc640 1 --2- 172.21.15.100:0/4163005847 >> v2:172.21.15.167:3300/0 conn(0x7fb37c0dccc0 0x7fb37c0091b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fb3827fc640 1 -- 172.21.15.100:0/4163005847 >> v1:172.21.15.167:6789/0 conn(0x7fb37c04cc50 legacy=0x7fb37c051df0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:20:48.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.315+0000 7fb3827fc640 1 -- 172.21.15.100:0/4163005847 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37c046e50 con 0x7fb37c04e330 2024-09-11T22:20:48.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7fb3827fc640 1 --2- 172.21.15.100:0/4163005847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb37c04e330 0x7fb37c0e6b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb37c04e8d0 tx=0x7fb3840a6d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd5d6b0ecadf89a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7fb381ffb640 1 -- 172.21.15.100:0/4163005847 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3840b4070 con 0x7fb37c04e330 2024-09-11T22:20:48.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7fb381ffb640 1 -- 172.21.15.100:0/4163005847 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3840a78c0 con 0x7fb37c04e330 2024-09-11T22:20:48.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.317+0000 7fb381ffb640 1 -- 172.21.15.100:0/4163005847 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3840a7d30 con 0x7fb37c04e330 2024-09-11T22:20:48.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fe418ed5640 1 -- 172.21.15.100:0/742098832 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3116804821 0 0) 0x7fe400003520 con 0x7fe40c04c090 2024-09-11T22:20:48.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fe418ed5640 1 -- 172.21.15.100:0/742098832 >> v2:172.21.15.100:3300/0 conn(0x7fe40c0450f0 msgr2=0x7fe40c0da680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:48.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fe418ed5640 1 --2- 172.21.15.100:0/742098832 >> v2:172.21.15.100:3300/0 conn(0x7fe40c0450f0 0x7fe40c0da680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fe418ed5640 1 -- 172.21.15.100:0/742098832 >> v1:172.21.15.100:6789/0 conn(0x7fe40c0d4940 legacy=0x7fe40c005a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:48.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fe418ed5640 1 -- 172.21.15.100:0/742098832 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe40c04afa0 con 0x7fe40c04c090 2024-09-11T22:20:48.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fe418ed5640 1 -- 172.21.15.100:0/742098832 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fe414063850 con 0x7fe40c04c090 2024-09-11T22:20:48.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fe418ed5640 1 -- 172.21.15.100:0/742098832 >> v1:172.21.15.167:6789/0 conn(0x7fe40c04c090 legacy=0x7fe40c0dabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fe418ed5640 1 --2- 172.21.15.100:0/742098832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4000039b0 0x7fe400003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fe418ed5640 1 --2- 172.21.15.100:0/742098832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe400004800 0x7fe400004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fe418ed5640 1 --2- 172.21.15.100:0/742098832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4000051c0 0x7fe40000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fe418ed5640 1 -- 172.21.15.100:0/742098832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c044c60 con 0x7fe4000051c0 2024-09-11T22:20:48.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fe418ed5640 1 -- 172.21.15.100:0/742098832 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe40000bfe0 con 0x7fe4000039b0 2024-09-11T22:20:48.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fe418ed5640 1 -- 172.21.15.100:0/742098832 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe40000c1e0 con 0x7fe400004800 2024-09-11T22:20:48.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fba1a46c640 1 --2- 172.21.15.100:0/229526684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9fc005d80 0x7fb9fc006160 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fba0c007e90 tx=0x7fb9fc007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ee07e9eedc6768 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fd00559a640 1 -- 172.21.15.100:0/1810150116 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff8032810 con 0x7fd0000d4f90 2024-09-11T22:20:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fb383fff640 1 -- 172.21.15.100:0/4163005847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb37c04e330 msgr2=0x7fb37c0e6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fb383fff640 1 --2- 172.21.15.100:0/4163005847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb37c04e330 0x7fb37c0e6b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb37c04e8d0 tx=0x7fb3840a6d80 comp rx=0 tx=0).stop 2024-09-11T22:20:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fba1946a640 1 -- 172.21.15.100:0/229526684 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c007ab0 con 0x7fb9fc005d80 2024-09-11T22:20:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fba1946a640 1 -- 172.21.15.100:0/229526684 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba0c031600 con 0x7fb9fc005d80 2024-09-11T22:20:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.318+0000 7fe41a6d8640 1 --2- 172.21.15.100:0/742098832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4000051c0 0x7fe40000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7fe419ed7640 1 --2- 172.21.15.100:0/742098832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4000039b0 0x7fe400003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7f7c0ad9d640 1 --2- 172.21.15.100:0/4219049252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c0c0b2170 0x7f7c0c068150 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0c9030 tx=0x7f7bfc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6824f981065ed55c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7f3c2d7c4640 1 --2- 172.21.15.100:0/2108144189 >> v2:172.21.15.100:3300/0 conn(0x7f3c2815afb0 0x7f3c2815b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:48.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7fd00759e640 1 -- 172.21.15.100:0/1810150116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0000d4f90 msgr2=0x7fd000046fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7fd00759e640 1 --2- 172.21.15.100:0/1810150116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0000d4f90 0x7fd000046fc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcff8009870 tx=0x7fcff802a2a0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7fe4196d6640 1 --2- 172.21.15.100:0/742098832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe400004800 0x7fe400004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7fe41a6d8640 1 -- 172.21.15.100:0/742098832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe400004800 msgr2=0x7fe400004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:48.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7fd00759e640 1 -- 172.21.15.100:0/1810150116 shutdown_connections 2024-09-11T22:20:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7fe41a6d8640 1 --2- 172.21.15.100:0/742098832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe400004800 0x7fe400004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7fe41a6d8640 1 -- 172.21.15.100:0/742098832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4000039b0 msgr2=0x7fe400003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7fe41a6d8640 1 --2- 172.21.15.100:0/742098832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4000039b0 0x7fe400003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7fe41a6d8640 1 -- 172.21.15.100:0/742098832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe40c04afa0 con 0x7fe4000051c0 2024-09-11T22:20:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7fe4196d6640 1 --2- 172.21.15.100:0/742098832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe400004800 0x7fe400004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:48.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7fd00759e640 1 --2- 172.21.15.100:0/1810150116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0000d4f90 0x7fd000046fc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7fd00759e640 1 -- 172.21.15.100:0/1810150116 >> 172.21.15.100:0/1810150116 conn(0x7fd000050560 msgr2=0x7fd000050940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:48.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7fd00759e640 1 -- 172.21.15.100:0/1810150116 shutdown_connections 2024-09-11T22:20:48.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7fb383fff640 1 -- 172.21.15.100:0/4163005847 shutdown_connections 2024-09-11T22:20:48.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7fb383fff640 1 --2- 172.21.15.100:0/4163005847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb37c04e330 0x7fb37c0e6b50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7fb383fff640 1 --2- 172.21.15.100:0/4163005847 >> v2:172.21.15.167:3300/0 conn(0x7fb37c0dccc0 0x7fb37c0091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7fb383fff640 1 -- 172.21.15.100:0/4163005847 >> 172.21.15.100:0/4163005847 conn(0x7fb37c00db90 msgr2=0x7fb37c00df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:48.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7f7c09d9b640 1 -- 172.21.15.100:0/4219049252 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc037070 con 0x7f7c0c0b2170 2024-09-11T22:20:48.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7fd00759e640 1 -- 172.21.15.100:0/1810150116 wait complete. 2024-09-11T22:20:48.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7f7c09d9b640 1 -- 172.21.15.100:0/4219049252 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bfc032440 con 0x7f7c0c0b2170 2024-09-11T22:20:48.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7f3c2cfc3640 1 --2- 172.21.15.100:0/2108144189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c28154c00 0x7f3c280cc700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3c280cde40 tx=0x7f3c1802a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b374f6a2ba3e5b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.319+0000 7fba1b46e640 1 -- 172.21.15.100:0/229526684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9fc005d80 msgr2=0x7fb9fc006160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7fba1b46e640 1 --2- 172.21.15.100:0/229526684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9fc005d80 0x7fb9fc006160 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fba0c007e90 tx=0x7fb9fc007a40 comp rx=0 tx=0).stop 2024-09-11T22:20:48.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7fba1946a640 1 -- 172.21.15.100:0/229526684 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c031a50 con 0x7fb9fc005d80 2024-09-11T22:20:48.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7fb383fff640 1 -- 172.21.15.100:0/4163005847 shutdown_connections 2024-09-11T22:20:48.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7f2ee4e4c640 1 --2- 172.21.15.100:0/3923218909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ee00c8c40 0x7f2ee00c9090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2ee006d7f0 tx=0x7f2ed402a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3b8f6feb9defa51 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7f3c277fe640 1 -- 172.21.15.100:0/2108144189 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18004230 con 0x7f3c28154c00 2024-09-11T22:20:48.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7fba1ac6d640 1 -- 172.21.15.100:0/229526684 reap_dead start 2024-09-11T22:20:48.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7fba1b46e640 1 -- 172.21.15.100:0/229526684 shutdown_connections 2024-09-11T22:20:48.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7fba1b46e640 1 -- 172.21.15.100:0/229526684 >> 172.21.15.100:0/229526684 conn(0x7fba140cd2c0 msgr2=0x7fba140cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:48.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7f7c09d9b640 1 -- 172.21.15.100:0/4219049252 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc032810 con 0x7f7c0c0b2170 2024-09-11T22:20:48.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7f3c277fe640 1 -- 172.21.15.100:0/2108144189 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c1802ae50 con 0x7f3c28154c00 2024-09-11T22:20:48.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7f3c277fe640 1 -- 172.21.15.100:0/2108144189 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18003610 con 0x7f3c28154c00 2024-09-11T22:20:48.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7f2edeffd640 1 -- 172.21.15.100:0/3923218909 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4037070 con 0x7f2ee00c8c40 2024-09-11T22:20:48.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7fb383fff640 1 -- 172.21.15.100:0/4163005847 wait complete. 2024-09-11T22:20:48.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7f7c11191640 1 -- 172.21.15.100:0/4219049252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c0c0b2170 msgr2=0x7f7c0c068150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7f7c11191640 1 --2- 172.21.15.100:0/4219049252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c0c0b2170 0x7f7c0c068150 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0c9030 tx=0x7f7bfc02a230 comp rx=0 tx=0).stop 2024-09-11T22:20:48.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7f7c11191640 1 -- 172.21.15.100:0/4219049252 shutdown_connections 2024-09-11T22:20:48.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7f7c11191640 1 --2- 172.21.15.100:0/4219049252 >> v2:172.21.15.167:3300/0 conn(0x7f7c0c0c3f50 0x7f7c0c15a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7f7c11191640 1 --2- 172.21.15.100:0/4219049252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c0c0b2170 0x7f7c0c068150 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7f7c11191640 1 -- 172.21.15.100:0/4219049252 >> 172.21.15.100:0/4219049252 conn(0x7f7c0c06ee80 msgr2=0x7f7c0c070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:48.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.321+0000 7f7c11191640 1 -- 172.21.15.100:0/4219049252 shutdown_connections 2024-09-11T22:20:48.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.321+0000 7f3c2f227640 1 -- 172.21.15.100:0/2108144189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c28154c00 msgr2=0x7f3c280cc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.321+0000 7f3c2f227640 1 --2- 172.21.15.100:0/2108144189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c28154c00 0x7f3c280cc700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3c280cde40 tx=0x7f3c1802a300 comp rx=0 tx=0).stop 2024-09-11T22:20:48.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7f2edeffd640 1 -- 172.21.15.100:0/3923218909 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed4032440 con 0x7f2ee00c8c40 2024-09-11T22:20:48.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.321+0000 7f2ee68af640 1 -- 172.21.15.100:0/3923218909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ee00c8c40 msgr2=0x7f2ee00c9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.321+0000 7f2ee68af640 1 --2- 172.21.15.100:0/3923218909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ee00c8c40 0x7f2ee00c9090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2ee006d7f0 tx=0x7f2ed402a2c0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7fba1b46e640 1 -- 172.21.15.100:0/229526684 shutdown_connections 2024-09-11T22:20:48.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7fba1b46e640 1 -- 172.21.15.100:0/229526684 wait complete. 2024-09-11T22:20:48.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.321+0000 7f2ee68af640 1 -- 172.21.15.100:0/3923218909 shutdown_connections 2024-09-11T22:20:48.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7fe41a6d8640 1 --2- 172.21.15.100:0/742098832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4000051c0 0x7fe40000b9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe41406b3b0 tx=0x7fe400005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f034194a1a3342 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7fe41a6d8640 1 -- 172.21.15.100:0/742098832 reap_dead start 2024-09-11T22:20:48.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.320+0000 7fe418ed5640 1 -- 172.21.15.100:0/742098832 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4140b2070 con 0x7fe4000051c0 2024-09-11T22:20:48.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.321+0000 7fe418ed5640 1 -- 172.21.15.100:0/742098832 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4140ac600 con 0x7fe4000051c0 2024-09-11T22:20:48.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.321+0000 7f2ee68af640 1 --2- 172.21.15.100:0/3923218909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ee00c8c40 0x7f2ee00c9090 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.321+0000 7f2ee68af640 1 --2- 172.21.15.100:0/3923218909 >> v2:172.21.15.100:3300/0 conn(0x7f2ee015f2d0 0x7f2ee015f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.321+0000 7f2ee68af640 1 -- 172.21.15.100:0/3923218909 >> 172.21.15.100:0/3923218909 conn(0x7f2ee006f5b0 msgr2=0x7f2ee006f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:48.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.321+0000 7fe418ed5640 1 -- 172.21.15.100:0/742098832 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41406a120 con 0x7fe4000051c0 2024-09-11T22:20:48.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.321+0000 7f2ee68af640 1 -- 172.21.15.100:0/3923218909 shutdown_connections 2024-09-11T22:20:48.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.321+0000 7f2ee68af640 1 -- 172.21.15.100:0/3923218909 wait complete. 2024-09-11T22:20:48.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.321+0000 7fd00759e640 1 Processor -- start 2024-09-11T22:20:48.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.321+0000 7fd00759e640 1 -- start start 2024-09-11T22:20:48.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.321+0000 7f7c11191640 1 -- 172.21.15.100:0/4219049252 wait complete. 2024-09-11T22:20:48.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.322+0000 7fb383fff640 1 Processor -- start 2024-09-11T22:20:48.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.322+0000 7f3c2f227640 1 -- 172.21.15.100:0/2108144189 shutdown_connections 2024-09-11T22:20:48.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.322+0000 7f3c2f227640 1 --2- 172.21.15.100:0/2108144189 >> v2:172.21.15.100:3300/0 conn(0x7f3c2815afb0 0x7f3c2815b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.322+0000 7fe41aed9640 1 -- 172.21.15.100:0/742098832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4000051c0 msgr2=0x7fe40000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.322+0000 7fe41aed9640 1 --2- 172.21.15.100:0/742098832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4000051c0 0x7fe40000b9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe41406b3b0 tx=0x7fe400005830 comp rx=0 tx=0).stop 2024-09-11T22:20:48.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.322+0000 7f3c2f227640 1 --2- 172.21.15.100:0/2108144189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c28154c00 0x7f3c280cc700 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.322+0000 7fe41aed9640 1 -- 172.21.15.100:0/742098832 shutdown_connections 2024-09-11T22:20:48.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.322+0000 7fe41aed9640 1 --2- 172.21.15.100:0/742098832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4000051c0 0x7fe40000b9c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.322+0000 7fe41aed9640 1 -- 172.21.15.100:0/742098832 >> 172.21.15.100:0/742098832 conn(0x7fe40c04fc50 msgr2=0x7fe40c050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:48.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.322+0000 7f3c2f227640 1 -- 172.21.15.100:0/2108144189 >> 172.21.15.100:0/2108144189 conn(0x7f3c2806cf50 msgr2=0x7f3c2806d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:48.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.322+0000 7fe41aed9640 1 -- 172.21.15.100:0/742098832 shutdown_connections 2024-09-11T22:20:48.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.322+0000 7fe41aed9640 1 -- 172.21.15.100:0/742098832 wait complete. 2024-09-11T22:20:48.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.322+0000 7fba1b46e640 1 Processor -- start 2024-09-11T22:20:48.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.322+0000 7fba1b46e640 1 -- start start 2024-09-11T22:20:48.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.322+0000 7fb383fff640 1 -- start start 2024-09-11T22:20:48.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.323+0000 7f2ee68af640 1 Processor -- start 2024-09-11T22:20:48.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.323+0000 7f2ee68af640 1 -- start start 2024-09-11T22:20:48.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.323+0000 7f3c2f227640 1 -- 172.21.15.100:0/2108144189 shutdown_connections 2024-09-11T22:20:48.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fd00759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd00004c950 0x7fd000033420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fba1b46e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba140cc090 0x7fba14155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fd00759e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0000d4f90 0x7fd000176750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fba1b46e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba140cc470 0x7fba14158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fba1b46e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba14159470 0x7fba141ef310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fd00659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd00004c950 0x7fd000033420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fd00659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd00004c950 0x7fd000033420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44360/0 (socket says 172.21.15.100:44360) 2024-09-11T22:20:48.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fba1b46e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fba140725a0 con 0x7fba14159470 2024-09-11T22:20:48.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fd00659c640 1 -- 172.21.15.100:0/236966504 learned_addr learned my addr 172.21.15.100:0/236966504 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:48.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fd005d9b640 1 --2- 172.21.15.100:0/236966504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0000d4f90 0x7fd000176750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fd00759e640 1 --2- 172.21.15.100:0/236966504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0000dabc0 0x7fd0000355d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fba1b46e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fba1415b660 con 0x7fba140cc470 2024-09-11T22:20:48.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fba1b46e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fba140c8540 con 0x7fba140cc090 2024-09-11T22:20:48.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fd00759e640 1 -- 172.21.15.100:0/236966504 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd0000467c0 con 0x7fd0000dabc0 2024-09-11T22:20:48.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fba1ac6d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba14159470 0x7fba141ef310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fba1ac6d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba14159470 0x7fba141ef310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47566/0 (socket says 172.21.15.100:47566) 2024-09-11T22:20:48.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fba1ac6d640 1 -- 172.21.15.100:0/463275962 learned_addr learned my addr 172.21.15.100:0/463275962 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:48.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.323+0000 7fb383fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb37c04cc50 0x7fb37c035e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.323+0000 7fb383fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb37c0dccc0 0x7fb37c16be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fb382ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb37c04cc50 0x7fb37c035e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fb382ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb37c04cc50 0x7fb37c035e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47556/0 (socket says 172.21.15.100:47556) 2024-09-11T22:20:48.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fb383fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb37c1794b0 0x7fb37c034c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fd00759e640 1 -- 172.21.15.100:0/236966504 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd000046b30 con 0x7fd00004c950 2024-09-11T22:20:48.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fd00759e640 1 -- 172.21.15.100:0/236966504 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd00004bb80 con 0x7fd0000d4f90 2024-09-11T22:20:48.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fe41aed9640 1 Processor -- start 2024-09-11T22:20:48.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fe41aed9640 1 -- start start 2024-09-11T22:20:48.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fd006d9d640 1 --2- 172.21.15.100:0/236966504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0000dabc0 0x7fd0000355d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fba1ac6d640 1 -- 172.21.15.100:0/463275962 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba140cc090 msgr2=0x7fba14155d80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:20:48.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fba1ac6d640 1 --2- 172.21.15.100:0/463275962 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba140cc090 0x7fba14155d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fba1ac6d640 1 -- 172.21.15.100:0/463275962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba140cc470 msgr2=0x7fba14158f30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:20:48.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fba1ac6d640 1 --2- 172.21.15.100:0/463275962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba140cc470 0x7fba14158f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7fba1ac6d640 1 -- 172.21.15.100:0/463275962 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba14156720 con 0x7fba14159470 2024-09-11T22:20:48.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.323+0000 7f3c2f227640 1 -- 172.21.15.100:0/2108144189 wait complete. 2024-09-11T22:20:48.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.325+0000 7f3c2f227640 1 Processor -- start 2024-09-11T22:20:48.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.325+0000 7fd00659c640 1 -- 172.21.15.100:0/236966504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0000d4f90 msgr2=0x7fd000176750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.325+0000 7fd00659c640 1 --2- 172.21.15.100:0/236966504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0000d4f90 0x7fd000176750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.325+0000 7fd00659c640 1 -- 172.21.15.100:0/236966504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0000dabc0 msgr2=0x7fd0000355d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.325+0000 7fd00659c640 1 --2- 172.21.15.100:0/236966504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0000dabc0 0x7fd0000355d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.325+0000 7fd00659c640 1 -- 172.21.15.100:0/236966504 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd000033960 con 0x7fd00004c950 2024-09-11T22:20:48.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.325+0000 7fba1ac6d640 1 --2- 172.21.15.100:0/463275962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba14159470 0x7fba141ef310 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fba140c2940 tx=0x7fba0400b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.325+0000 7f2ee68af640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ee00c8c40 0x7f2ee015cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.323+0000 7f7c11191640 1 Processor -- start 2024-09-11T22:20:48.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.324+0000 7f7c11191640 1 -- start start 2024-09-11T22:20:48.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.325+0000 7f7c11191640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c0c06ce70 0x7f7c0c1491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.325+0000 7f7c11191640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c0c0b2170 0x7f7c0c15b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.325+0000 7f2edffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ee00c8c40 0x7f2ee015cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.325+0000 7f2edffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ee00c8c40 0x7f2ee015cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47572/0 (socket says 172.21.15.100:47572) 2024-09-11T22:20:48.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.325+0000 7f2edffff640 1 -- 172.21.15.100:0/998436443 learned_addr learned my addr 172.21.15.100:0/998436443 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:48.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.325+0000 7fba12ffd640 1 -- 172.21.15.100:0/463275962 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0400b8d0 con 0x7fba14159470 2024-09-11T22:20:48.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.325+0000 7f2ee68af640 1 --2- 172.21.15.100:0/998436443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ee0158ff0 0x7f2ee0161a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.325+0000 7fd00659c640 1 --2- 172.21.15.100:0/236966504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd00004c950 0x7fd000033420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00b3e0 tx=0x7fcffc00b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.325+0000 7f7c11191640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c0c0c3f50 0x7f7c0c1ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.325+0000 7fba1b46e640 1 -- 172.21.15.100:0/463275962 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba14156a00 con 0x7fba14159470 2024-09-11T22:20:48.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.325+0000 7fba1b46e640 1 -- 172.21.15.100:0/463275962 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba141552a0 con 0x7fba14159470 2024-09-11T22:20:48.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.325+0000 7fba12ffd640 1 -- 172.21.15.100:0/463275962 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba0400ba70 con 0x7fba14159470 2024-09-11T22:20:48.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7f7c11191640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0c06c640 con 0x7f7c0c0c3f50 2024-09-11T22:20:48.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7fb383fff640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb37c0e6630 con 0x7fb37c04cc50 2024-09-11T22:20:48.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7fb383fff640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb37c0e6350 con 0x7fb37c0dccc0 2024-09-11T22:20:48.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7fb383fff640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb37c0473f0 con 0x7fb37c1794b0 2024-09-11T22:20:48.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7f7c0a59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c0c0b2170 0x7f7c0c15b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7f7c0a59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c0c0b2170 0x7f7c0c15b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44364/0 (socket says 172.21.15.100:44364) 2024-09-11T22:20:48.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7f7c0a59c640 1 -- 172.21.15.100:0/220150131 learned_addr learned my addr 172.21.15.100:0/220150131 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:48.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7f7c11191640 1 -- 172.21.15.100:0/220150131 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0c06c360 con 0x7f7c0c0b2170 2024-09-11T22:20:48.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7f7c11191640 1 -- 172.21.15.100:0/220150131 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7c0c06c920 con 0x7f7c0c06ce70 2024-09-11T22:20:48.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7fb3827fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb37c0dccc0 0x7fb37c16be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7fb3827fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb37c0dccc0 0x7fb37c16be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44344/0 (socket says 172.21.15.100:44344) 2024-09-11T22:20:48.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7f2ee68af640 1 --2- 172.21.15.100:0/998436443 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ee015f2d0 0x7f2ee0155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7fb3827fc640 1 -- 172.21.15.100:0/2266510582 learned_addr learned my addr 172.21.15.100:0/2266510582 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:48.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7fb3837fe640 1 --2- 172.21.15.100:0/2266510582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb37c1794b0 0x7fb37c034c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7f2ee68af640 1 -- 172.21.15.100:0/998436443 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee0162850 con 0x7f2ee00c8c40 2024-09-11T22:20:48.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7f2ee68af640 1 -- 172.21.15.100:0/998436443 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee0162570 con 0x7f2ee0158ff0 2024-09-11T22:20:48.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7fcff6ffd640 1 -- 172.21.15.100:0/236966504 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcffc015020 con 0x7fd00004c950 2024-09-11T22:20:48.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7f2ee68af640 1 -- 172.21.15.100:0/998436443 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee0162b30 con 0x7f2ee015f2d0 2024-09-11T22:20:48.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7fcff6ffd640 1 -- 172.21.15.100:0/236966504 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcffc011850 con 0x7fd00004c950 2024-09-11T22:20:48.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7fcff6ffd640 1 -- 172.21.15.100:0/236966504 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcffc011c40 con 0x7fd00004c950 2024-09-11T22:20:48.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7fd00759e640 1 -- 172.21.15.100:0/236966504 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd000177010 con 0x7fd00004c950 2024-09-11T22:20:48.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.325+0000 7f3c2f227640 1 -- start start 2024-09-11T22:20:48.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7f3c2f227640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c280c5a90 0x7f3c28156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7f3c2f227640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c28154c00 0x7f3c28156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7f3c2f227640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c2815afb0 0x7f3c281f8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7f3c2f227640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2815eda0 con 0x7f3c28154c00 2024-09-11T22:20:48.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7f3c2f227640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2815eac0 con 0x7f3c2815afb0 2024-09-11T22:20:48.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7f3c2f227640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3c2815b910 con 0x7f3c280c5a90 2024-09-11T22:20:48.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7fe41aed9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4000051c0 0x7fe40c0de550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7f2ee4e4c640 1 --2- 172.21.15.100:0/998436443 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ee015f2d0 0x7f2ee0155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7fd00759e640 1 -- 172.21.15.100:0/236966504 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0000d6b70 con 0x7fd00004c950 2024-09-11T22:20:48.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7fe41aed9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe40c0cb6e0 0x7fe40c047ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7f7c0a59c640 1 -- 172.21.15.100:0/220150131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c0c06ce70 msgr2=0x7f7c0c1491d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:20:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7f3c2cfc3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c280c5a90 0x7f3c28156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7f3c2cfc3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c280c5a90 0x7f3c28156300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45350/0 (socket says 172.21.15.100:45350) 2024-09-11T22:20:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7f3c2cfc3640 1 -- 172.21.15.100:0/389353000 learned_addr learned my addr 172.21.15.100:0/389353000 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7f3c2d7c4640 1 --2- 172.21.15.100:0/389353000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c2815afb0 0x7f3c281f8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7f2edffff640 1 -- 172.21.15.100:0/998436443 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ee015f2d0 msgr2=0x7f2ee0155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7f2edffff640 1 --2- 172.21.15.100:0/998436443 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ee015f2d0 0x7f2ee0155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7f2edffff640 1 -- 172.21.15.100:0/998436443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ee0158ff0 msgr2=0x7f2ee0161a00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:20:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7f2edffff640 1 --2- 172.21.15.100:0/998436443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ee0158ff0 0x7f2ee0161a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7f2edffff640 1 -- 172.21.15.100:0/998436443 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee01440b0 con 0x7f2ee00c8c40 2024-09-11T22:20:48.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7f7c0a59c640 1 --2- 172.21.15.100:0/220150131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c0c06ce70 0x7f7c0c1491d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7f7c0a59c640 1 -- 172.21.15.100:0/220150131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c0c0c3f50 msgr2=0x7f7c0c1ffca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7f7c0a59c640 1 --2- 172.21.15.100:0/220150131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c0c0c3f50 0x7f7c0c1ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.326+0000 7f7c0a59c640 1 -- 172.21.15.100:0/220150131 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0c2016b0 con 0x7f7c0c0b2170 2024-09-11T22:20:48.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7fb3827fc640 1 -- 172.21.15.100:0/2266510582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb37c1794b0 msgr2=0x7fb37c034c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7fb3827fc640 1 --2- 172.21.15.100:0/2266510582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb37c1794b0 0x7fb37c034c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7fb3827fc640 1 -- 172.21.15.100:0/2266510582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb37c04cc50 msgr2=0x7fb37c035e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7fb3827fc640 1 --2- 172.21.15.100:0/2266510582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb37c04cc50 0x7fb37c035e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7fb3827fc640 1 -- 172.21.15.100:0/2266510582 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37c0d8df0 con 0x7fb37c0dccc0 2024-09-11T22:20:48.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7fb3827fc640 1 --2- 172.21.15.100:0/2266510582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb37c0dccc0 0x7fb37c16be30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb384069460 tx=0x7fb384069df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7fe419ed7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4000051c0 0x7fe40c0de550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7fe419ed7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4000051c0 0x7fe40c0de550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47606/0 (socket says 172.21.15.100:47606) 2024-09-11T22:20:48.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7fe419ed7640 1 -- 172.21.15.100:0/1069156123 learned_addr learned my addr 172.21.15.100:0/1069156123 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:48.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7fe41aed9640 1 --2- 172.21.15.100:0/1069156123 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe40c173e70 0x7fe40c0c3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7fe41aed9640 1 -- 172.21.15.100:0/1069156123 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c046770 con 0x7fe4000051c0 2024-09-11T22:20:48.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7fe41aed9640 1 -- 172.21.15.100:0/1069156123 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe40c046490 con 0x7fe40c0cb6e0 2024-09-11T22:20:48.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7fe41aed9640 1 -- 172.21.15.100:0/1069156123 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe40c04b2e0 con 0x7fe40c173e70 2024-09-11T22:20:48.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7fb36b7fe640 1 -- 172.21.15.100:0/2266510582 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3840b4050 con 0x7fb37c0dccc0 2024-09-11T22:20:48.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7fb36b7fe640 1 -- 172.21.15.100:0/2266510582 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3840c0070 con 0x7fb37c0dccc0 2024-09-11T22:20:48.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7fb36b7fe640 1 -- 172.21.15.100:0/2266510582 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3840afe60 con 0x7fb37c0dccc0 2024-09-11T22:20:48.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7f2edffff640 1 --2- 172.21.15.100:0/998436443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ee00c8c40 0x7f2ee015cf70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000c780 tx=0x7f2ed000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7fb383fff640 1 -- 172.21.15.100:0/2266510582 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb37c0d90d0 con 0x7fb37c0dccc0 2024-09-11T22:20:48.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7fb383fff640 1 -- 172.21.15.100:0/2266510582 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb37c178cb0 con 0x7fb37c0dccc0 2024-09-11T22:20:48.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.327+0000 7fe4196d6640 1 --2- 172.21.15.100:0/1069156123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe40c0cb6e0 0x7fe40c047ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.328+0000 7fe41a6d8640 1 --2- 172.21.15.100:0/1069156123 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe40c173e70 0x7fe40c0c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.328+0000 7f7c0a59c640 1 --2- 172.21.15.100:0/220150131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c0c0b2170 0x7f7c0c15b1c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7c0000c850 tx=0x7f7c0000cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.328+0000 7f3c2cfc3640 1 -- 172.21.15.100:0/389353000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c2815afb0 msgr2=0x7f3c281f8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.328+0000 7f3c2cfc3640 1 --2- 172.21.15.100:0/389353000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c2815afb0 0x7f3c281f8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.328+0000 7f2edcff9640 1 -- 172.21.15.100:0/998436443 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0016020 con 0x7f2ee00c8c40 2024-09-11T22:20:48.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.328+0000 7f2edcff9640 1 -- 172.21.15.100:0/998436443 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed000a840 con 0x7f2ee00c8c40 2024-09-11T22:20:48.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.328+0000 7f2edcff9640 1 -- 172.21.15.100:0/998436443 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed000ac70 con 0x7f2ee00c8c40 2024-09-11T22:20:48.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.329+0000 7fb383fff640 1 -- 172.21.15.100:0/2266510582 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb37c1787c0 con 0x7fb37c0dccc0 2024-09-11T22:20:48.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.328+0000 7f2ee68af640 1 -- 172.21.15.100:0/998436443 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee0143dd0 con 0x7f2ee00c8c40 2024-09-11T22:20:48.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.328+0000 7f2ee68af640 1 -- 172.21.15.100:0/998436443 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee0161200 con 0x7f2ee00c8c40 2024-09-11T22:20:48.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.328+0000 7f7bf37fe640 1 -- 172.21.15.100:0/220150131 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c00015070 con 0x7f7c0c0b2170 2024-09-11T22:20:48.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.328+0000 7f7bf37fe640 1 -- 172.21.15.100:0/220150131 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c00007a30 con 0x7f7c0c0b2170 2024-09-11T22:20:48.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.328+0000 7f7bf37fe640 1 -- 172.21.15.100:0/220150131 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0000cea0 con 0x7f7c0c0b2170 2024-09-11T22:20:48.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.329+0000 7f7c11191640 1 -- 172.21.15.100:0/220150131 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c0c1465e0 con 0x7f7c0c0b2170 2024-09-11T22:20:48.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.329+0000 7f7c11191640 1 -- 172.21.15.100:0/220150131 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c0c1ff4a0 con 0x7f7c0c0b2170 2024-09-11T22:20:48.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.328+0000 7f3c2cfc3640 1 -- 172.21.15.100:0/389353000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c28154c00 msgr2=0x7f3c28156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.329+0000 7fcff6ffd640 1 -- 172.21.15.100:0/236966504 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcffc018020 con 0x7fd00004c950 2024-09-11T22:20:48.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.328+0000 7f3c2cfc3640 1 --2- 172.21.15.100:0/389353000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c28154c00 0x7f3c28156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.328+0000 7f3c2cfc3640 1 -- 172.21.15.100:0/389353000 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2815a370 con 0x7f3c280c5a90 2024-09-11T22:20:48.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.330+0000 7f2ec67fc640 1 -- 172.21.15.100:0/998436443 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee0162e10 con 0x7f2ee00c8c40 2024-09-11T22:20:48.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.329+0000 7fb36b7fe640 1 -- 172.21.15.100:0/2266510582 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3840a7760 con 0x7fb37c0dccc0 2024-09-11T22:20:48.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.330+0000 7f3c2d7c4640 1 --2- 172.21.15.100:0/389353000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c2815afb0 0x7f3c281f8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:48.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.329+0000 7fcff6ffd640 1 --2- 172.21.15.100:0/236966504 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcfe806bf00 0x7fcfe806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.329+0000 7fcff6ffd640 1 -- 172.21.15.100:0/236966504 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fcffc08b040 con 0x7fd00004c950 2024-09-11T22:20:48.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.330+0000 7f3c2cfc3640 1 --2- 172.21.15.100:0/389353000 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c280c5a90 0x7f3c28156300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3c1802a340 tx=0x7f3c180046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.330+0000 7fe4196d6640 1 -- 172.21.15.100:0/1069156123 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe40c173e70 msgr2=0x7fe40c0c3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.330+0000 7fe4196d6640 1 --2- 172.21.15.100:0/1069156123 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe40c173e70 0x7fe40c0c3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.330+0000 7fe4196d6640 1 -- 172.21.15.100:0/1069156123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4000051c0 msgr2=0x7fe40c0de550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.330+0000 7fe4196d6640 1 --2- 172.21.15.100:0/1069156123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4000051c0 0x7fe40c0de550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.330+0000 7fe4196d6640 1 -- 172.21.15.100:0/1069156123 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe40c0cb200 con 0x7fe40c0cb6e0 2024-09-11T22:20:48.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.330+0000 7fe4196d6640 1 --2- 172.21.15.100:0/1069156123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe40c0cb6e0 0x7fe40c047ba0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe40400e780 tx=0x7fe40400ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.330+0000 7f7c11191640 1 -- 172.21.15.100:0/220150131 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c0c067950 con 0x7f7c0c0b2170 2024-09-11T22:20:48.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.330+0000 7fb36b7fe640 1 --2- 172.21.15.100:0/2266510582 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb37006be30 0x7fb37006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.330+0000 7fb382ffd640 1 --2- 172.21.15.100:0/2266510582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb37c04cc50 0x7fb37c035e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-11T22:20:48.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.330+0000 7fb36b7fe640 1 -- 172.21.15.100:0/2266510582 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb384128460 con 0x7fb37c0dccc0 2024-09-11T22:20:48.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.330+0000 7fb382ffd640 1 --2- 172.21.15.100:0/2266510582 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb37006be30 0x7fb37006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.330+0000 7fba12ffd640 1 -- 172.21.15.100:0/463275962 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0400be40 con 0x7fba14159470 2024-09-11T22:20:48.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.331+0000 7f3c257fa640 1 -- 172.21.15.100:0/389353000 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18042020 con 0x7f3c280c5a90 2024-09-11T22:20:48.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.331+0000 7fb382ffd640 1 --2- 172.21.15.100:0/2266510582 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb37006be30 0x7fb37006e2f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb37400a890 tx=0x7fb374008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.331+0000 7fd005d9b640 1 --2- 172.21.15.100:0/236966504 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcfe806bf00 0x7fcfe806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.331+0000 7f7bf37fe640 1 -- 172.21.15.100:0/220150131 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7c00018070 con 0x7f7c0c0b2170 2024-09-11T22:20:48.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.331+0000 7fba12ffd640 1 -- 172.21.15.100:0/463275962 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba0401b020 con 0x7fba14159470 2024-09-11T22:20:48.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.332+0000 7f7bf37fe640 1 --2- 172.21.15.100:0/220150131 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7bf806bf00 0x7f7bf806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.332+0000 7f7bf37fe640 1 -- 172.21.15.100:0/220150131 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7c0008b1b0 con 0x7f7c0c0b2170 2024-09-11T22:20:48.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.331+0000 7fba12ffd640 1 --2- 172.21.15.100:0/463275962 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fba0006be30 0x7fba0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.331+0000 7fba1b46e640 1 -- 172.21.15.100:0/463275962 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba140cdff0 con 0x7fba14159470 2024-09-11T22:20:48.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.332+0000 7fba12ffd640 1 -- 172.21.15.100:0/463275962 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fba0408b310 con 0x7fba14159470 2024-09-11T22:20:48.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.332+0000 7fba1a46c640 1 --2- 172.21.15.100:0/463275962 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fba0006be30 0x7fba0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.331+0000 7f3c2f227640 1 -- 172.21.15.100:0/389353000 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c2815a8f0 con 0x7f3c280c5a90 2024-09-11T22:20:48.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.331+0000 7f3c2f227640 1 -- 172.21.15.100:0/389353000 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c28155e00 con 0x7f3c280c5a90 2024-09-11T22:20:48.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.332+0000 7f3c257fa640 1 -- 172.21.15.100:0/389353000 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c18003b20 con 0x7f3c280c5a90 2024-09-11T22:20:48.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.332+0000 7f3c257fa640 1 -- 172.21.15.100:0/389353000 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18006040 con 0x7f3c280c5a90 2024-09-11T22:20:48.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.332+0000 7fd00759e640 1 -- 172.21.15.100:0/236966504 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfec005290 con 0x7fd00004c950 2024-09-11T22:20:48.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.332+0000 7f7c0ad9d640 1 --2- 172.21.15.100:0/220150131 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7bf806bf00 0x7f7bf806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.333+0000 7f2edcff9640 1 -- 172.21.15.100:0/998436443 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2ed0019020 con 0x7f2ee00c8c40 2024-09-11T22:20:48.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.333+0000 7fd005d9b640 1 --2- 172.21.15.100:0/236966504 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcfe806bf00 0x7fcfe806e3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcff8034000 tx=0x7fcff802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.333+0000 7f7c0ad9d640 1 --2- 172.21.15.100:0/220150131 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7bf806bf00 0x7f7bf806e3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc034000 tx=0x7f7bfc02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.333+0000 7fba1a46c640 1 --2- 172.21.15.100:0/463275962 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fba0006be30 0x7fba0006e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fba0c007e60 tx=0x7fba0c02f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.333+0000 7f3c2f227640 1 -- 172.21.15.100:0/389353000 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c08005290 con 0x7f3c280c5a90 2024-09-11T22:20:48.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.333+0000 7f2edcff9640 1 --2- 172.21.15.100:0/998436443 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2ecc06be80 0x7f2ecc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.333+0000 7f2edcff9640 1 -- 172.21.15.100:0/998436443 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2ed008af50 con 0x7f2ee00c8c40 2024-09-11T22:20:48.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.334+0000 7f2edf7fe640 1 --2- 172.21.15.100:0/998436443 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2ecc06be80 0x7f2ecc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.334+0000 7f3c257fa640 1 -- 172.21.15.100:0/389353000 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3c18045020 con 0x7f3c280c5a90 2024-09-11T22:20:48.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.334+0000 7f2edf7fe640 1 --2- 172.21.15.100:0/998436443 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2ecc06be80 0x7f2ecc06e340 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00c33c0 tx=0x7f2ed8009790 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.334+0000 7f3c257fa640 1 --2- 172.21.15.100:0/389353000 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3c1406be80 0x7f3c1406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.335+0000 7f3c27fff640 1 --2- 172.21.15.100:0/389353000 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3c1406be80 0x7f3c1406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.335+0000 7f3c257fa640 1 -- 172.21.15.100:0/389353000 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3c180ac0a0 con 0x7f3c280c5a90 2024-09-11T22:20:48.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.335+0000 7f3c27fff640 1 --2- 172.21.15.100:0/389353000 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3c1406be80 0x7f3c1406e340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3c200012e0 tx=0x7f3c20007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.335+0000 7fe40a7fc640 1 -- 172.21.15.100:0/1069156123 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe404008890 con 0x7fe40c0cb6e0 2024-09-11T22:20:48.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.335+0000 7fe41aed9640 1 -- 172.21.15.100:0/1069156123 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe40c0480e0 con 0x7fe40c0cb6e0 2024-09-11T22:20:48.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.335+0000 7fb36b7fe640 1 -- 172.21.15.100:0/2266510582 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb3840f6b50 con 0x7fb37c0dccc0 2024-09-11T22:20:48.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.335+0000 7fe41aed9640 1 -- 172.21.15.100:0/1069156123 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe40c0d1010 con 0x7fe40c0cb6e0 2024-09-11T22:20:48.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.336+0000 7fe41aed9640 1 -- 172.21.15.100:0/1069156123 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe40c0d3730 con 0x7fe40c0cb6e0 2024-09-11T22:20:48.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.338+0000 7fba12ffd640 1 -- 172.21.15.100:0/463275962 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fba040598e0 con 0x7fba14159470 2024-09-11T22:20:48.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.342+0000 7f2edcff9640 1 -- 172.21.15.100:0/998436443 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2ed0020030 con 0x7f2ee00c8c40 2024-09-11T22:20:48.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.345+0000 7fcff6ffd640 1 -- 172.21.15.100:0/236966504 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcffc01f020 con 0x7fd00004c950 2024-09-11T22:20:48.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.344+0000 7f3c257fa640 1 -- 172.21.15.100:0/389353000 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3c1807a800 con 0x7f3c280c5a90 2024-09-11T22:20:48.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.349+0000 7fe40a7fc640 1 -- 172.21.15.100:0/1069156123 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe404019070 con 0x7fe40c0cb6e0 2024-09-11T22:20:48.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.349+0000 7fe40a7fc640 1 -- 172.21.15.100:0/1069156123 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe404008c30 con 0x7fe40c0cb6e0 2024-09-11T22:20:48.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.349+0000 7f7bf37fe640 1 -- 172.21.15.100:0/220150131 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7c00059800 con 0x7f7c0c0b2170 2024-09-11T22:20:48.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.355+0000 7fe40a7fc640 1 -- 172.21.15.100:0/1069156123 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe40401e460 con 0x7fe40c0cb6e0 2024-09-11T22:20:48.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.356+0000 7fe40a7fc640 1 --2- 172.21.15.100:0/1069156123 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe3f806be30 0x7fe3f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:48.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.356+0000 7fe40a7fc640 1 -- 172.21.15.100:0/1069156123 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe40408bc70 con 0x7fe40c0cb6e0 2024-09-11T22:20:48.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.356+0000 7fe419ed7640 1 --2- 172.21.15.100:0/1069156123 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe3f806be30 0x7fe3f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:48.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.356+0000 7fe40a7fc640 1 -- 172.21.15.100:0/1069156123 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe40c0d3730 con 0x7fe40c0cb6e0 2024-09-11T22:20:48.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.357+0000 7fe419ed7640 1 --2- 172.21.15.100:0/1069156123 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe3f806be30 0x7fe3f806e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe4100017e0 tx=0x7fe410009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:48.487 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:20:48.493 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:20:48.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.667+0000 7f314a6e6640 1 -- 172.21.15.100:0/4238686094 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f3124005850 con 0x7f314415f8d0 2024-09-11T22:20:48.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.668+0000 7f3140ff9640 1 -- 172.21.15.100:0/4238686094 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3134058e90 con 0x7f314415f8d0 2024-09-11T22:20:48.669 INFO:teuthology.orchestra.run.smithi100.stdout:64424509449 2024-09-11T22:20:48.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.671+0000 7f312a7fc640 1 -- 172.21.15.100:0/4238686094 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f313006bf60 msgr2=0x7f313006e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.671+0000 7f312a7fc640 1 --2- 172.21.15.100:0/4238686094 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f313006bf60 0x7f313006e420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3138034000 tx=0x7f313802e000 comp rx=0 tx=0).stop 2024-09-11T22:20:48.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.672+0000 7f312a7fc640 1 -- 172.21.15.100:0/4238686094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f314415f8d0 msgr2=0x7f31441501b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.672+0000 7f312a7fc640 1 --2- 172.21.15.100:0/4238686094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f314415f8d0 0x7f31441501b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f313400d920 tx=0x7f313400dde0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.672+0000 7f312a7fc640 1 -- 172.21.15.100:0/4238686094 shutdown_connections 2024-09-11T22:20:48.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.672+0000 7f312a7fc640 1 --2- 172.21.15.100:0/4238686094 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f313006bf60 0x7f313006e420 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.672+0000 7f312a7fc640 1 --2- 172.21.15.100:0/4238686094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3144162ac0 0x7f31441512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.672+0000 7f312a7fc640 1 --2- 172.21.15.100:0/4238686094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f314415f8d0 0x7f31441501b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.672+0000 7f312a7fc640 1 --2- 172.21.15.100:0/4238686094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31440c63b0 0x7f314408c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.672+0000 7f312a7fc640 1 -- 172.21.15.100:0/4238686094 >> 172.21.15.100:0/4238686094 conn(0x7f314406fa70 msgr2=0x7f314415d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:48.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.673+0000 7f312a7fc640 1 -- 172.21.15.100:0/4238686094 shutdown_connections 2024-09-11T22:20:48.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.673+0000 7f312a7fc640 1 -- 172.21.15.100:0/4238686094 wait complete. 2024-09-11T22:20:48.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.6 2024-09-11T22:20:48.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.710+0000 7fd00759e640 1 -- 172.21.15.100:0/236966504 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fcfec005580 con 0x7fd00004c950 2024-09-11T22:20:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.710+0000 7fcff6ffd640 1 -- 172.21.15.100:0/236966504 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcffc059720 con 0x7fd00004c950 2024-09-11T22:20:48.711 INFO:teuthology.orchestra.run.smithi100.stdout:64424509449 2024-09-11T22:20:48.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.712+0000 7fd00759e640 1 -- 172.21.15.100:0/236966504 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcfe806bf00 msgr2=0x7fcfe806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.712+0000 7fd00759e640 1 --2- 172.21.15.100:0/236966504 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcfe806bf00 0x7fcfe806e3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcff8034000 tx=0x7fcff802e000 comp rx=0 tx=0).stop 2024-09-11T22:20:48.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.712+0000 7fd00759e640 1 -- 172.21.15.100:0/236966504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd00004c950 msgr2=0x7fd000033420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.712+0000 7fd00759e640 1 --2- 172.21.15.100:0/236966504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd00004c950 0x7fd000033420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00b3e0 tx=0x7fcffc00b8a0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.712+0000 7fd00759e640 1 -- 172.21.15.100:0/236966504 shutdown_connections 2024-09-11T22:20:48.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.712+0000 7fd00759e640 1 --2- 172.21.15.100:0/236966504 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcfe806bf00 0x7fcfe806e3c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.712+0000 7fd00759e640 1 --2- 172.21.15.100:0/236966504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0000dabc0 0x7fd0000355d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.712+0000 7fd00759e640 1 --2- 172.21.15.100:0/236966504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0000d4f90 0x7fd000176750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.712+0000 7fd00759e640 1 --2- 172.21.15.100:0/236966504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd00004c950 0x7fd000033420 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.712+0000 7fd00759e640 1 -- 172.21.15.100:0/236966504 >> 172.21.15.100:0/236966504 conn(0x7fd000050560 msgr2=0x7fd0000cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:48.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.713+0000 7fd00759e640 1 -- 172.21.15.100:0/236966504 shutdown_connections 2024-09-11T22:20:48.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.713+0000 7fd00759e640 1 -- 172.21.15.100:0/236966504 wait complete. 2024-09-11T22:20:48.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.3 2024-09-11T22:20:48.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.736+0000 7fba1b46e640 1 -- 172.21.15.100:0/463275962 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fba14072c20 con 0x7fba14159470 2024-09-11T22:20:48.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.736+0000 7fba12ffd640 1 -- 172.21.15.100:0/463275962 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fba040591e0 con 0x7fba14159470 2024-09-11T22:20:48.737 INFO:teuthology.orchestra.run.smithi100.stdout:55834574858 2024-09-11T22:20:48.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.739+0000 7fba1b46e640 1 -- 172.21.15.100:0/463275962 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fba0006be30 msgr2=0x7fba0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.739+0000 7fba1b46e640 1 --2- 172.21.15.100:0/463275962 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fba0006be30 0x7fba0006e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fba0c007e60 tx=0x7fba0c02f000 comp rx=0 tx=0).stop 2024-09-11T22:20:48.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.739+0000 7fba1b46e640 1 -- 172.21.15.100:0/463275962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba14159470 msgr2=0x7fba141ef310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.739+0000 7fba1b46e640 1 --2- 172.21.15.100:0/463275962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba14159470 0x7fba141ef310 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fba140c2940 tx=0x7fba0400b0d0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.739+0000 7fba1b46e640 1 -- 172.21.15.100:0/463275962 shutdown_connections 2024-09-11T22:20:48.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.739+0000 7fba1b46e640 1 --2- 172.21.15.100:0/463275962 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fba0006be30 0x7fba0006e2f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.739+0000 7fba1b46e640 1 --2- 172.21.15.100:0/463275962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba14159470 0x7fba141ef310 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.739+0000 7fba1b46e640 1 --2- 172.21.15.100:0/463275962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba140cc470 0x7fba14158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.739+0000 7fba1b46e640 1 --2- 172.21.15.100:0/463275962 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba140cc090 0x7fba14155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.739+0000 7fba1b46e640 1 -- 172.21.15.100:0/463275962 >> 172.21.15.100:0/463275962 conn(0x7fba140cd2c0 msgr2=0x7fba1406e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:48.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.739+0000 7fba1b46e640 1 -- 172.21.15.100:0/463275962 shutdown_connections 2024-09-11T22:20:48.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.739+0000 7fba1b46e640 1 -- 172.21.15.100:0/463275962 wait complete. 2024-09-11T22:20:48.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.742+0000 7f3c2f227640 1 -- 172.21.15.100:0/389353000 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3c08005850 con 0x7f3c280c5a90 2024-09-11T22:20:48.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.742+0000 7f2ec67fc640 1 -- 172.21.15.100:0/998436443 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f2ee00c7700 con 0x7f2ee00c8c40 2024-09-11T22:20:48.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.743+0000 7f3c257fa640 1 -- 172.21.15.100:0/389353000 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3c1807a100 con 0x7f3c280c5a90 2024-09-11T22:20:48.743 INFO:teuthology.orchestra.run.smithi100.stdout:60129542152 2024-09-11T22:20:48.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.743+0000 7f2edcff9640 1 -- 172.21.15.100:0/998436443 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2ed00212b0 con 0x7f2ee00c8c40 2024-09-11T22:20:48.744 INFO:teuthology.orchestra.run.smithi100.stdout:64424509448 2024-09-11T22:20:48.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.744+0000 7fb383fff640 1 -- 172.21.15.100:0/2266510582 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb37c0dd0a0 con 0x7fb37c0dccc0 2024-09-11T22:20:48.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.745+0000 7fb36b7fe640 1 -- 172.21.15.100:0/2266510582 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb3840f6450 con 0x7fb37c0dccc0 2024-09-11T22:20:48.745 INFO:teuthology.orchestra.run.smithi100.stdout:64424509450 2024-09-11T22:20:48.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.746+0000 7f3c2f227640 1 -- 172.21.15.100:0/389353000 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3c1406be80 msgr2=0x7f3c1406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.746+0000 7f3c2f227640 1 --2- 172.21.15.100:0/389353000 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3c1406be80 0x7f3c1406e340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3c200012e0 tx=0x7f3c20007d30 comp rx=0 tx=0).stop 2024-09-11T22:20:48.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.746+0000 7f3c2f227640 1 -- 172.21.15.100:0/389353000 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c280c5a90 msgr2=0x7f3c28156300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.746+0000 7f3c2f227640 1 --2- 172.21.15.100:0/389353000 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c280c5a90 0x7f3c28156300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3c1802a340 tx=0x7f3c180046c0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.746+0000 7f3c2f227640 1 -- 172.21.15.100:0/389353000 shutdown_connections 2024-09-11T22:20:48.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.746+0000 7f3c2f227640 1 --2- 172.21.15.100:0/389353000 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3c1406be80 0x7f3c1406e340 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.746+0000 7f3c2f227640 1 --2- 172.21.15.100:0/389353000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c2815afb0 0x7f3c281f8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.746+0000 7f3c2f227640 1 --2- 172.21.15.100:0/389353000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c28154c00 0x7f3c28156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.746+0000 7f3c2f227640 1 --2- 172.21.15.100:0/389353000 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c280c5a90 0x7f3c28156300 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.746+0000 7f3c2f227640 1 -- 172.21.15.100:0/389353000 >> 172.21.15.100:0/389353000 conn(0x7f3c2806cf50 msgr2=0x7f3c28152420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:48.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.746+0000 7f3c2f227640 1 -- 172.21.15.100:0/389353000 shutdown_connections 2024-09-11T22:20:48.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.747+0000 7f3c2f227640 1 -- 172.21.15.100:0/389353000 wait complete. 2024-09-11T22:20:48.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.747+0000 7f2ec67fc640 1 -- 172.21.15.100:0/998436443 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2ecc06be80 msgr2=0x7f2ecc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.747+0000 7f2ec67fc640 1 --2- 172.21.15.100:0/998436443 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2ecc06be80 0x7f2ecc06e340 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00c33c0 tx=0x7f2ed8009790 comp rx=0 tx=0).stop 2024-09-11T22:20:48.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.747+0000 7f2ec67fc640 1 -- 172.21.15.100:0/998436443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ee00c8c40 msgr2=0x7f2ee015cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.747+0000 7f2ec67fc640 1 --2- 172.21.15.100:0/998436443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ee00c8c40 0x7f2ee015cf70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000c780 tx=0x7f2ed000cc40 comp rx=0 tx=0).stop 2024-09-11T22:20:48.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.747+0000 7f2ec67fc640 1 -- 172.21.15.100:0/998436443 shutdown_connections 2024-09-11T22:20:48.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.747+0000 7f2ec67fc640 1 --2- 172.21.15.100:0/998436443 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2ecc06be80 0x7f2ecc06e340 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.747+0000 7f2ec67fc640 1 --2- 172.21.15.100:0/998436443 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ee015f2d0 0x7f2ee0155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.747+0000 7f2ec67fc640 1 --2- 172.21.15.100:0/998436443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ee0158ff0 0x7f2ee0161a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.747+0000 7f2ec67fc640 1 --2- 172.21.15.100:0/998436443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ee00c8c40 0x7f2ee015cf70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.747+0000 7f2ec67fc640 1 -- 172.21.15.100:0/998436443 >> 172.21.15.100:0/998436443 conn(0x7f2ee006f5b0 msgr2=0x7f2ee0157dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:48.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.748+0000 7fb383fff640 1 -- 172.21.15.100:0/2266510582 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb37006be30 msgr2=0x7fb37006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.748+0000 7f2ec67fc640 1 -- 172.21.15.100:0/998436443 shutdown_connections 2024-09-11T22:20:48.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.748+0000 7fb383fff640 1 --2- 172.21.15.100:0/2266510582 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb37006be30 0x7fb37006e2f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb37400a890 tx=0x7fb374008040 comp rx=0 tx=0).stop 2024-09-11T22:20:48.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.748+0000 7f2ec67fc640 1 -- 172.21.15.100:0/998436443 wait complete. 2024-09-11T22:20:48.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.748+0000 7fb383fff640 1 -- 172.21.15.100:0/2266510582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb37c0dccc0 msgr2=0x7fb37c16be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.748+0000 7fb383fff640 1 --2- 172.21.15.100:0/2266510582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb37c0dccc0 0x7fb37c16be30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb384069460 tx=0x7fb384069df0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.748+0000 7fb383fff640 1 -- 172.21.15.100:0/2266510582 shutdown_connections 2024-09-11T22:20:48.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.748+0000 7fb383fff640 1 --2- 172.21.15.100:0/2266510582 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb37006be30 0x7fb37006e2f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.748+0000 7fb383fff640 1 --2- 172.21.15.100:0/2266510582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb37c1794b0 0x7fb37c034c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.748+0000 7fb383fff640 1 --2- 172.21.15.100:0/2266510582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb37c0dccc0 0x7fb37c16be30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.748+0000 7fb383fff640 1 --2- 172.21.15.100:0/2266510582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb37c04cc50 0x7fb37c035e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.748+0000 7fb383fff640 1 -- 172.21.15.100:0/2266510582 >> 172.21.15.100:0/2266510582 conn(0x7fb37c00db90 msgr2=0x7fb37c004f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:48.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.748+0000 7fb383fff640 1 -- 172.21.15.100:0/2266510582 shutdown_connections 2024-09-11T22:20:48.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.748+0000 7fb383fff640 1 -- 172.21.15.100:0/2266510582 wait complete. 2024-09-11T22:20:48.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.752+0000 7fe41aed9640 1 -- 172.21.15.100:0/1069156123 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe40c04a2a0 con 0x7fe40c0cb6e0 2024-09-11T22:20:48.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.753+0000 7fe40a7fc640 1 -- 172.21.15.100:0/1069156123 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe40405a230 con 0x7fe40c0cb6e0 2024-09-11T22:20:48.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.753+0000 7f7c11191640 1 -- 172.21.15.100:0/220150131 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f7c0c0c8340 con 0x7f7c0c0b2170 2024-09-11T22:20:48.754 INFO:teuthology.orchestra.run.smithi100.stdout:60129542152 2024-09-11T22:20:48.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.753+0000 7f7bf37fe640 1 -- 172.21.15.100:0/220150131 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7c00059100 con 0x7f7c0c0b2170 2024-09-11T22:20:48.754 INFO:teuthology.orchestra.run.smithi100.stdout:64424509449 2024-09-11T22:20:48.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.755+0000 7fe41aed9640 1 -- 172.21.15.100:0/1069156123 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe3f806be30 msgr2=0x7fe3f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.755+0000 7fe41aed9640 1 --2- 172.21.15.100:0/1069156123 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe3f806be30 0x7fe3f806e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe4100017e0 tx=0x7fe410009040 comp rx=0 tx=0).stop 2024-09-11T22:20:48.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.755+0000 7fe41aed9640 1 -- 172.21.15.100:0/1069156123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe40c0cb6e0 msgr2=0x7fe40c047ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.755+0000 7fe41aed9640 1 --2- 172.21.15.100:0/1069156123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe40c0cb6e0 0x7fe40c047ba0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe40400e780 tx=0x7fe40400ec40 comp rx=0 tx=0).stop 2024-09-11T22:20:48.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.756+0000 7fe41aed9640 1 -- 172.21.15.100:0/1069156123 shutdown_connections 2024-09-11T22:20:48.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.756+0000 7fe41aed9640 1 --2- 172.21.15.100:0/1069156123 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe3f806be30 0x7fe3f806e2f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.756+0000 7fe41aed9640 1 --2- 172.21.15.100:0/1069156123 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe40c173e70 0x7fe40c0c3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.756+0000 7fe41aed9640 1 --2- 172.21.15.100:0/1069156123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe40c0cb6e0 0x7fe40c047ba0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.756+0000 7fe41aed9640 1 --2- 172.21.15.100:0/1069156123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4000051c0 0x7fe40c0de550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.756+0000 7fe41aed9640 1 -- 172.21.15.100:0/1069156123 >> 172.21.15.100:0/1069156123 conn(0x7fe40c04fc50 msgr2=0x7fe40c04cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:48.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.756+0000 7f7c11191640 1 -- 172.21.15.100:0/220150131 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7bf806bf00 msgr2=0x7f7bf806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.756+0000 7f7c11191640 1 --2- 172.21.15.100:0/220150131 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7bf806bf00 0x7f7bf806e3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc034000 tx=0x7f7bfc02e000 comp rx=0 tx=0).stop 2024-09-11T22:20:48.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.756+0000 7f7c11191640 1 -- 172.21.15.100:0/220150131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c0c0b2170 msgr2=0x7f7c0c15b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:48.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.756+0000 7f7c11191640 1 --2- 172.21.15.100:0/220150131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c0c0b2170 0x7f7c0c15b1c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7c0000c850 tx=0x7f7c0000cc50 comp rx=0 tx=0).stop 2024-09-11T22:20:48.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.756+0000 7fe41aed9640 1 -- 172.21.15.100:0/1069156123 shutdown_connections 2024-09-11T22:20:48.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.756+0000 7fe41aed9640 1 -- 172.21.15.100:0/1069156123 wait complete. 2024-09-11T22:20:48.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.756+0000 7f7c11191640 1 -- 172.21.15.100:0/220150131 shutdown_connections 2024-09-11T22:20:48.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.756+0000 7f7c11191640 1 --2- 172.21.15.100:0/220150131 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7bf806bf00 0x7f7bf806e3c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.756+0000 7f7c11191640 1 --2- 172.21.15.100:0/220150131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c0c0c3f50 0x7f7c0c1ffca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.756+0000 7f7c11191640 1 --2- 172.21.15.100:0/220150131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c0c0b2170 0x7f7c0c15b1c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.756+0000 7f7c11191640 1 --2- 172.21.15.100:0/220150131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c0c06ce70 0x7f7c0c1491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:48.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.756+0000 7f7c11191640 1 -- 172.21.15.100:0/220150131 >> 172.21.15.100:0/220150131 conn(0x7f7c0c06ee80 msgr2=0x7f7c0c142510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:48.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.756+0000 7f7c11191640 1 -- 172.21.15.100:0/220150131 shutdown_connections 2024-09-11T22:20:48.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:48.756+0000 7f7c11191640 1 -- 172.21.15.100:0/220150131 wait complete. 2024-09-11T22:20:48.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2024-09-11T22:20:48.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.7 2024-09-11T22:20:48.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542152 for osd.0 2024-09-11T22:20:48.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.5 2024-09-11T22:20:48.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542152 for osd.2 2024-09-11T22:20:48.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.4 2024-09-11T22:20:49.690 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T22:20:49.725 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T22:20:49.761 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T22:20:49.767 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T22:20:49.768 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T22:20:49.769 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T22:20:49.772 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T22:20:49.772 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T22:20:49.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.811+0000 7f9d9716d640 1 Processor -- start 2024-09-11T22:20:49.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.811+0000 7f9d9716d640 1 -- start start 2024-09-11T22:20:49.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.812+0000 7f9d9716d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d9015aeb0 0x7f9d90071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.812+0000 7f9d9716d640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d90072a40 con 0x7f9d90150e00 2024-09-11T22:20:49.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.812+0000 7f9d9716d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d900724a0 con 0x7f9d90156cb0 2024-09-11T22:20:49.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.812+0000 7f9d9716d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9d90075d80 con 0x7f9d9015aeb0 2024-09-11T22:20:49.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.813+0000 7f9d9570a640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f9d90150e00 0x7f9d90075670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33426/0 (socket says 172.21.15.100:33426) 2024-09-11T22:20:49.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.813+0000 7f9d9570a640 1 -- 172.21.15.100:0/4001648551 learned_addr learned my addr 172.21.15.100:0/4001648551 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:49.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.813+0000 7f9d94f09640 1 --2- 172.21.15.100:0/4001648551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d9015aeb0 0x7f9d90071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.814+0000 7f9d94f09640 1 -- 172.21.15.100:0/4001648551 >> v1:172.21.15.167:6789/0 conn(0x7f9d90156cb0 legacy=0x7f9d900c7a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:20:49.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.814+0000 7f9d94f09640 1 -- 172.21.15.100:0/4001648551 >> v1:172.21.15.100:6789/0 conn(0x7f9d90150e00 legacy=0x7f9d90075670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.814+0000 7f9d94f09640 1 -- 172.21.15.100:0/4001648551 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d90072760 con 0x7f9d9015aeb0 2024-09-11T22:20:49.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.815+0000 7f9d94f09640 1 --2- 172.21.15.100:0/4001648551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d9015aeb0 0x7f9d90071e80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9d780097d0 tx=0x7f9d7802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c68bd41971f7b805 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.815+0000 7f9d8f7fe640 1 -- 172.21.15.100:0/4001648551 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d78037070 con 0x7f9d9015aeb0 2024-09-11T22:20:49.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.815+0000 7f9d8f7fe640 1 -- 172.21.15.100:0/4001648551 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d78032440 con 0x7f9d9015aeb0 2024-09-11T22:20:49.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.816+0000 7f9d8f7fe640 1 -- 172.21.15.100:0/4001648551 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d78037070 con 0x7f9d9015aeb0 2024-09-11T22:20:49.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.816+0000 7f9d9716d640 1 -- 172.21.15.100:0/4001648551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d9015aeb0 msgr2=0x7f9d90071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.816+0000 7f9d9716d640 1 --2- 172.21.15.100:0/4001648551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d9015aeb0 0x7f9d90071e80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9d780097d0 tx=0x7f9d7802a250 comp rx=0 tx=0).stop 2024-09-11T22:20:49.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.817+0000 7f9d9716d640 1 -- 172.21.15.100:0/4001648551 shutdown_connections 2024-09-11T22:20:49.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.817+0000 7f9d9716d640 1 --2- 172.21.15.100:0/4001648551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d9015aeb0 0x7f9d90071e80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.817+0000 7f9d9716d640 1 -- 172.21.15.100:0/4001648551 >> 172.21.15.100:0/4001648551 conn(0x7f9d9006fa70 msgr2=0x7f9d9006fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:49.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.817+0000 7f9d9716d640 1 -- 172.21.15.100:0/4001648551 shutdown_connections 2024-09-11T22:20:49.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.817+0000 7f9d9716d640 1 -- 172.21.15.100:0/4001648551 wait complete. 2024-09-11T22:20:49.819 INFO:tasks.ceph.mds.f.smithi167.stderr:2024-09-11T22:20:49.818+0000 7fcf973ca640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-11T22:20:49.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.819+0000 7f9d9716d640 1 Processor -- start 2024-09-11T22:20:49.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.819+0000 7f9d9716d640 1 -- start start 2024-09-11T22:20:49.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.820+0000 7f9d9716d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d90150e00 0x7f9d900c2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.821+0000 7f9d9716d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d90156cb0 0x7f9d900c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.821+0000 7f9d9716d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d9015aeb0 0x7f9d9014ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.821+0000 7f9d9716d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9015a990 con 0x7f9d9015aeb0 2024-09-11T22:20:49.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.821+0000 7f9d9716d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9015a6b0 con 0x7f9d90156cb0 2024-09-11T22:20:49.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.821+0000 7f9d9716d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9d90157090 con 0x7f9d90150e00 2024-09-11T22:20:49.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.821+0000 7f9d9570a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d9015aeb0 0x7f9d9014ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.822+0000 7f9d94f09640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d90150e00 0x7f9d900c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.822+0000 7f9d94f09640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d90150e00 0x7f9d900c2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45374/0 (socket says 172.21.15.100:45374) 2024-09-11T22:20:49.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.822+0000 7f9d94f09640 1 -- 172.21.15.100:0/3055497478 learned_addr learned my addr 172.21.15.100:0/3055497478 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:49.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.822+0000 7f9d8ffff640 1 --2- 172.21.15.100:0/3055497478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d90156cb0 0x7f9d900c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.822+0000 7f9d9570a640 1 -- 172.21.15.100:0/3055497478 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d90150e00 msgr2=0x7f9d900c2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.823+0000 7f9d9570a640 1 --2- 172.21.15.100:0/3055497478 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d90150e00 0x7f9d900c2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.823+0000 7f9d9570a640 1 -- 172.21.15.100:0/3055497478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d90156cb0 msgr2=0x7f9d900c2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.823+0000 7f9d9570a640 1 --2- 172.21.15.100:0/3055497478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d90156cb0 0x7f9d900c2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.823+0000 7f9d9570a640 1 -- 172.21.15.100:0/3055497478 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d9014e750 con 0x7f9d9015aeb0 2024-09-11T22:20:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.823+0000 7f9d9570a640 1 --2- 172.21.15.100:0/3055497478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d9015aeb0 0x7f9d9014ba90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000c3c0 tx=0x7f9d8000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.824+0000 7f9d8d7fa640 1 -- 172.21.15.100:0/3055497478 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d80017070 con 0x7f9d9015aeb0 2024-09-11T22:20:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.824+0000 7f9d9716d640 1 -- 172.21.15.100:0/3055497478 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d9014b2b0 con 0x7f9d9015aeb0 2024-09-11T22:20:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.824+0000 7f9d9716d640 1 -- 172.21.15.100:0/3055497478 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d9014e9f0 con 0x7f9d9015aeb0 2024-09-11T22:20:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.826+0000 7f9d8d7fa640 1 -- 172.21.15.100:0/3055497478 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d80005da0 con 0x7f9d9015aeb0 2024-09-11T22:20:49.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.827+0000 7f9d8d7fa640 1 -- 172.21.15.100:0/3055497478 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d80017070 con 0x7f9d9015aeb0 2024-09-11T22:20:49.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.829+0000 7f9d86ffd640 1 -- 172.21.15.100:0/3055497478 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d74005290 con 0x7f9d9015aeb0 2024-09-11T22:20:49.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.840+0000 7f9d8d7fa640 1 -- 172.21.15.100:0/3055497478 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d8001a070 con 0x7f9d9015aeb0 2024-09-11T22:20:49.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.841+0000 7f9d8d7fa640 1 --2- 172.21.15.100:0/3055497478 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9d7006c230 0x7f9d7006e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.842+0000 7f9d94f09640 1 --2- 172.21.15.100:0/3055497478 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9d7006c230 0x7f9d7006e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.842+0000 7f9d8d7fa640 1 -- 172.21.15.100:0/3055497478 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9d80005ba0 con 0x7f9d9015aeb0 2024-09-11T22:20:49.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.842+0000 7f9d8d7fa640 1 -- 172.21.15.100:0/3055497478 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9d80021080 con 0x7f9d9015aeb0 2024-09-11T22:20:49.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.843+0000 7f9d94f09640 1 --2- 172.21.15.100:0/3055497478 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9d7006c230 0x7f9d7006e6f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9d78009720 tx=0x7f9d7802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.877+0000 7fca3f152640 1 Processor -- start 2024-09-11T22:20:49.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.877+0000 7fca3f152640 1 -- start start 2024-09-11T22:20:49.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.878+0000 7fca3f152640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca380c8b70 0x7fca380c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.878+0000 7fca3f152640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fca3816b4b0 0x7fca3816b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.878+0000 7fca3f152640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca38073290 con 0x7fca380c8f50 2024-09-11T22:20:49.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.878+0000 7fca3f152640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fca380c2440 con 0x7fca3816b4b0 2024-09-11T22:20:49.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.878+0000 7fca3f152640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fca380c8570 con 0x7fca380c8b70 2024-09-11T22:20:49.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.879+0000 7fca37fff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fca380c8f50 0x7fca380c1d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33440/0 (socket says 172.21.15.100:33440) 2024-09-11T22:20:49.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.879+0000 7fca37fff640 1 -- 172.21.15.100:0/716611987 learned_addr learned my addr 172.21.15.100:0/716611987 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:49.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.879+0000 7fca3d6ef640 1 --2- 172.21.15.100:0/716611987 >> v2:172.21.15.167:3300/0 conn(0x7fca3816b4b0 0x7fca3816b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.879+0000 7fca377fe640 1 -- 172.21.15.100:0/716611987 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1575249686 0 0) 0x7fca38073290 con 0x7fca380c8f50 2024-09-11T22:20:49.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.879+0000 7fca377fe640 1 -- 172.21.15.100:0/716611987 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca20003500 con 0x7fca380c8f50 2024-09-11T22:20:49.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.880+0000 7fca3d6ef640 1 -- 172.21.15.100:0/716611987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca380c8b70 msgr2=0x7fca380c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:49.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.880+0000 7fca3d6ef640 1 --2- 172.21.15.100:0/716611987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca380c8b70 0x7fca380c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.880+0000 7fca3d6ef640 1 -- 172.21.15.100:0/716611987 >> v1:172.21.15.100:6789/0 conn(0x7fca380c8f50 legacy=0x7fca380c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.880+0000 7fca3d6ef640 1 -- 172.21.15.100:0/716611987 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca380c1230 con 0x7fca3816b4b0 2024-09-11T22:20:49.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.881+0000 7fca3d6ef640 1 --2- 172.21.15.100:0/716611987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca3816b4b0 0x7fca3816b8b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca3000b250 tx=0x7fca30008740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdc37554df8d3969 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.881+0000 7fca377fe640 1 -- 172.21.15.100:0/716611987 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3000a0d0 con 0x7fca3816b4b0 2024-09-11T22:20:49.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.881+0000 7fca377fe640 1 -- 172.21.15.100:0/716611987 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca3000a270 con 0x7fca3816b4b0 2024-09-11T22:20:49.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.881+0000 7fca377fe640 1 -- 172.21.15.100:0/716611987 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3000a620 con 0x7fca3816b4b0 2024-09-11T22:20:49.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.882+0000 7fca3f152640 1 -- 172.21.15.100:0/716611987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca3816b4b0 msgr2=0x7fca3816b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.882+0000 7fca3f152640 1 --2- 172.21.15.100:0/716611987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca3816b4b0 0x7fca3816b8b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca3000b250 tx=0x7fca30008740 comp rx=0 tx=0).stop 2024-09-11T22:20:49.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.882+0000 7fca3f152640 1 -- 172.21.15.100:0/716611987 shutdown_connections 2024-09-11T22:20:49.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.882+0000 7fca3f152640 1 --2- 172.21.15.100:0/716611987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca3816b4b0 0x7fca3816b8b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.882+0000 7fca3f152640 1 --2- 172.21.15.100:0/716611987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca380c8b70 0x7fca380c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.882+0000 7fca3f152640 1 -- 172.21.15.100:0/716611987 >> 172.21.15.100:0/716611987 conn(0x7fca3806f360 msgr2=0x7fca3806f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:49.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.882+0000 7fca3f152640 1 -- 172.21.15.100:0/716611987 shutdown_connections 2024-09-11T22:20:49.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.882+0000 7fca3f152640 1 -- 172.21.15.100:0/716611987 wait complete. 2024-09-11T22:20:49.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.884+0000 7fca3f152640 1 Processor -- start 2024-09-11T22:20:49.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.884+0000 7fca3f152640 1 -- start start 2024-09-11T22:20:49.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.886+0000 7fca3f152640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca380c8b70 0x7fca38161560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.886+0000 7fca3f152640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca380c8f50 0x7fca380ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.886+0000 7fca3f152640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca3816b4b0 0x7fca380ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.886+0000 7fca37fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca380c8f50 0x7fca380ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.886+0000 7fca3ceee640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca380c8b70 0x7fca38161560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.886+0000 7fca37fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca380c8f50 0x7fca380ca540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45380/0 (socket says 172.21.15.100:45380) 2024-09-11T22:20:49.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.886+0000 7fca3ceee640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca380c8b70 0x7fca38161560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44438/0 (socket says 172.21.15.100:44438) 2024-09-11T22:20:49.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.886+0000 7fca3d6ef640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca3816b4b0 0x7fca380ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.886+0000 7fca3d6ef640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca3816b4b0 0x7fca380ada00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47624/0 (socket says 172.21.15.100:47624) 2024-09-11T22:20:49.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.886+0000 7fca37fff640 1 -- 172.21.15.100:0/3324157271 learned_addr learned my addr 172.21.15.100:0/3324157271 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:49.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.886+0000 7fca3f152640 1 -- 172.21.15.100:0/3324157271 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fca38072fb0 con 0x7fca3816b4b0 2024-09-11T22:20:49.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.886+0000 7fca3f152640 1 -- 172.21.15.100:0/3324157271 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fca38072cd0 con 0x7fca380c8b70 2024-09-11T22:20:49.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.886+0000 7fca3f152640 1 -- 172.21.15.100:0/3324157271 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fca380c14d0 con 0x7fca380c8f50 2024-09-11T22:20:49.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.887+0000 7fca37fff640 1 -- 172.21.15.100:0/3324157271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca380c8b70 msgr2=0x7fca38161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.887+0000 7fca37fff640 1 --2- 172.21.15.100:0/3324157271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca380c8b70 0x7fca38161560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.887+0000 7fca37fff640 1 -- 172.21.15.100:0/3324157271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca3816b4b0 msgr2=0x7fca380ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.887+0000 7fca37fff640 1 --2- 172.21.15.100:0/3324157271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca3816b4b0 0x7fca380ada00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.887+0000 7fca37fff640 1 -- 172.21.15.100:0/3324157271 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca38164170 con 0x7fca380c8f50 2024-09-11T22:20:49.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.887+0000 7fca3d6ef640 1 --2- 172.21.15.100:0/3324157271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca3816b4b0 0x7fca380ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:49.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.888+0000 7fca37fff640 1 --2- 172.21.15.100:0/3324157271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca380c8f50 0x7fca380ca540 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fca2800c430 tx=0x7fca2800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.888+0000 7fca357fa640 1 -- 172.21.15.100:0/3324157271 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca28017070 con 0x7fca380c8f50 2024-09-11T22:20:49.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.888+0000 7fca3f152640 1 -- 172.21.15.100:0/3324157271 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca38164410 con 0x7fca380c8f50 2024-09-11T22:20:49.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.888+0000 7fca3f152640 1 -- 172.21.15.100:0/3324157271 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fca381649d0 con 0x7fca380c8f50 2024-09-11T22:20:49.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.889+0000 7fca357fa640 1 -- 172.21.15.100:0/3324157271 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca28005ce0 con 0x7fca380c8f50 2024-09-11T22:20:49.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.889+0000 7fca357fa640 1 -- 172.21.15.100:0/3324157271 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca280072d0 con 0x7fca380c8f50 2024-09-11T22:20:49.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.891+0000 7fca3f152640 1 -- 172.21.15.100:0/3324157271 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca18005290 con 0x7fca380c8f50 2024-09-11T22:20:49.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.892+0000 7fca357fa640 1 -- 172.21.15.100:0/3324157271 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca2801a070 con 0x7fca380c8f50 2024-09-11T22:20:49.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.893+0000 7fca357fa640 1 --2- 172.21.15.100:0/3324157271 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fca2406bf00 0x7fca2406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.893+0000 7fca357fa640 1 -- 172.21.15.100:0/3324157271 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fca2808a470 con 0x7fca380c8f50 2024-09-11T22:20:49.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.894+0000 7fca3ceee640 1 --2- 172.21.15.100:0/3324157271 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fca2406bf00 0x7fca2406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.895+0000 7fca3ceee640 1 --2- 172.21.15.100:0/3324157271 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fca2406bf00 0x7fca2406e3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fca2c0098e0 tx=0x7fca2c009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.898+0000 7fca357fa640 1 -- 172.21.15.100:0/3324157271 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fca28058470 con 0x7fca380c8f50 2024-09-11T22:20:49.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.941+0000 7f74e3bbd640 1 Processor -- start 2024-09-11T22:20:49.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.942+0000 7f74e3bbd640 1 -- start start 2024-09-11T22:20:49.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.943+0000 7fe7deb9f640 1 Processor -- start 2024-09-11T22:20:49.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.943+0000 7f74e3bbd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f74dc0c7510 0x7f74dc0c7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.943+0000 7fe7deb9f640 1 -- start start 2024-09-11T22:20:49.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.943+0000 7f74e3bbd640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74dc073470 con 0x7f74dc15ab30 2024-09-11T22:20:49.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.943+0000 7f74e3bbd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74dc156e70 con 0x7f74dc06fe50 2024-09-11T22:20:49.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.943+0000 7f74e3bbd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f74dc157150 con 0x7f74dc0c7510 2024-09-11T22:20:49.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.944+0000 7f74e1158640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f74dc15ab30 0x7f74dc0c8ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33454/0 (socket says 172.21.15.100:33454) 2024-09-11T22:20:49.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.944+0000 7f74e1158640 1 -- 172.21.15.100:0/3127674073 learned_addr learned my addr 172.21.15.100:0/3127674073 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:49.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.944+0000 7fcbc9b24640 1 Processor -- start 2024-09-11T22:20:49.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.944+0000 7f74e215a640 1 --2- 172.21.15.100:0/3127674073 >> v2:172.21.15.167:3300/0 conn(0x7f74dc0c7510 0x7f74dc0c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.944+0000 7fe7deb9f640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe7d00d45f0 0x7fe7d00da540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.944+0000 7fe7deb9f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7d0005a00 0x7fe7d0034250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.944+0000 7fe7deb9f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7d00d49d0 con 0x7fe7d0034790 2024-09-11T22:20:49.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.944+0000 7fe7deb9f640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fe7d0032c10 con 0x7fe7d00d45f0 2024-09-11T22:20:49.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.944+0000 7fe7deb9f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe7d0005fd0 con 0x7fe7d0005a00 2024-09-11T22:20:49.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.945+0000 7f74e0957640 1 -- 172.21.15.100:0/3127674073 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1292511178 0 0) 0x7f74dc073470 con 0x7f74dc15ab30 2024-09-11T22:20:49.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.945+0000 7f74e0957640 1 -- 172.21.15.100:0/3127674073 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74c8003520 con 0x7f74dc15ab30 2024-09-11T22:20:49.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.945+0000 7fe7dd39c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7d0005a00 0x7fe7d0034250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.945+0000 7f74e215a640 1 -- 172.21.15.100:0/3127674073 >> v1:172.21.15.167:6789/0 conn(0x7f74dc06fe50 legacy=0x7f74dc072c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.945+0000 7f74e215a640 1 -- 172.21.15.100:0/3127674073 >> v1:172.21.15.100:6789/0 conn(0x7f74dc15ab30 legacy=0x7f74dc0c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.945+0000 7f74e215a640 1 -- 172.21.15.100:0/3127674073 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74dc157430 con 0x7f74dc0c7510 2024-09-11T22:20:49.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.945+0000 7fe7dd39c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7d0005a00 0x7fe7d0034250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45386/0 (socket says 172.21.15.100:45386) 2024-09-11T22:20:49.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.945+0000 7fe7dd39c640 1 -- 172.21.15.100:0/3335287276 learned_addr learned my addr 172.21.15.100:0/3335287276 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:49.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.945+0000 7f63d6f36640 1 Processor -- start 2024-09-11T22:20:49.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.945+0000 7fcbc9b24640 1 -- start start 2024-09-11T22:20:49.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.946+0000 7f74e215a640 1 --2- 172.21.15.100:0/3127674073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74dc0c7510 0x7f74dc0c7920 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f74d4009d90 tx=0x7f74d402a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5b0732c6ff46ba2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.945+0000 7fe7dd39c640 1 -- 172.21.15.100:0/3335287276 >> v2:172.21.15.100:3300/0 conn(0x7fe7d00d45f0 msgr2=0x7fe7d00da540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:49.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.945+0000 7fe7dd39c640 1 --2- 172.21.15.100:0/3335287276 >> v2:172.21.15.100:3300/0 conn(0x7fe7d00d45f0 0x7fe7d00da540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.946+0000 7fcbc9b24640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcbbc0d8870 0x7fcbbc049950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.946+0000 7f74e0957640 1 -- 172.21.15.100:0/3127674073 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d4007740 con 0x7f74dc0c7510 2024-09-11T22:20:49.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.946+0000 7fcbc9b24640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbbc0dee40 0x7fcbbc049e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.946+0000 7fcbc9b24640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbbc050850 con 0x7fcbbc0502d0 2024-09-11T22:20:49.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.946+0000 7fcbc9b24640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fcbbc0e1c60 con 0x7fcbbc0d8870 2024-09-11T22:20:49.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.946+0000 7fcbc9b24640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcbbc0e1f40 con 0x7fcbbc0dee40 2024-09-11T22:20:49.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.945+0000 7fe7dd39c640 1 -- 172.21.15.100:0/3335287276 >> v1:172.21.15.167:6789/0 conn(0x7fe7d0034790 legacy=0x7fe7d004ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:49.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.946+0000 7f74e0957640 1 -- 172.21.15.100:0/3127674073 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74d40078e0 con 0x7f74dc0c7510 2024-09-11T22:20:49.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.946+0000 7f74e0957640 1 -- 172.21.15.100:0/3127674073 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d4007cf0 con 0x7f74dc0c7510 2024-09-11T22:20:49.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.945+0000 7fe7dd39c640 1 -- 172.21.15.100:0/3335287276 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d00062b0 con 0x7fe7d0005a00 2024-09-11T22:20:49.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.946+0000 7fcbc3fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fcbbc0502d0 0x7fcbbc0de730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:44300/0 (socket says 172.21.15.100:44300) 2024-09-11T22:20:49.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.946+0000 7fcbc8b22640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcbbc0d8870 0x7fcbbc049950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.946+0000 7fcbc8b22640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcbbc0d8870 0x7fcbbc049950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44456/0 (socket says 172.21.15.100:44456) 2024-09-11T22:20:49.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.946+0000 7fcbc8b22640 1 -- 172.21.15.100:0/2059815015 learned_addr learned my addr 172.21.15.100:0/2059815015 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:49.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7fe7dd39c640 1 --2- 172.21.15.100:0/3335287276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7d0005a00 0x7fe7d0034250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8074630 tx=0x7fe7d80a6b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dd0cbf856bc75c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.946+0000 7fcbc9323640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbbc0dee40 0x7fcbbc049e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.945+0000 7f63d6f36640 1 -- start start 2024-09-11T22:20:49.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7f63d6f36640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c80da540 0x7f63c80e5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7f63d6f36640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63c80d49d0 con 0x7f63c80d45f0 2024-09-11T22:20:49.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7f63d6f36640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63c8005fd0 con 0x7f63c8005a00 2024-09-11T22:20:49.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7f63d6f36640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f63c8032c10 con 0x7f63c80da540 2024-09-11T22:20:49.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7f63d5f34640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f63c80d45f0 0x7f63c8034250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33464/0 (socket says 172.21.15.100:33464) 2024-09-11T22:20:49.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7f63d6735640 1 --2- 172.21.15.100:0/402719513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c80da540 0x7f63c80e5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7f63d5f34640 1 -- 172.21.15.100:0/402719513 learned_addr learned my addr 172.21.15.100:0/402719513 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:49.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7fcbc8b22640 1 -- 172.21.15.100:0/2059815015 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbbc0dee40 msgr2=0x7fcbbc049e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:49.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7fcbc8b22640 1 --2- 172.21.15.100:0/2059815015 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbbc0dee40 0x7fcbbc049e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7fcbc37fe640 1 -- 172.21.15.100:0/2059815015 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2672249977 0 0) 0x7fcbbc050850 con 0x7fcbbc0502d0 2024-09-11T22:20:49.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7fcbc8b22640 1 -- 172.21.15.100:0/2059815015 >> v1:172.21.15.167:6789/0 conn(0x7fcbbc0502d0 legacy=0x7fcbbc0de730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7fcbc8b22640 1 -- 172.21.15.100:0/2059815015 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbbc0e2220 con 0x7fcbbc0d8870 2024-09-11T22:20:49.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.948+0000 7f74e3bbd640 1 -- 172.21.15.100:0/3127674073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74dc0c7510 msgr2=0x7f74dc0c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.948+0000 7f74e3bbd640 1 --2- 172.21.15.100:0/3127674073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74dc0c7510 0x7f74dc0c7920 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f74d4009d90 tx=0x7f74d402a6c0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.948+0000 7f74e3bbd640 1 -- 172.21.15.100:0/3127674073 shutdown_connections 2024-09-11T22:20:49.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.948+0000 7f74e3bbd640 1 --2- 172.21.15.100:0/3127674073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74dc0c7510 0x7f74dc0c7920 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.948+0000 7f74e3bbd640 1 -- 172.21.15.100:0/3127674073 >> 172.21.15.100:0/3127674073 conn(0x7f74dc06f360 msgr2=0x7f74dc06f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:49.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.948+0000 7fe7dcb9b640 1 -- 172.21.15.100:0/3335287276 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d80a8910 con 0x7fe7d0005a00 2024-09-11T22:20:49.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.948+0000 7fe7dcb9b640 1 -- 172.21.15.100:0/3335287276 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7d80a8ab0 con 0x7fe7d0005a00 2024-09-11T22:20:49.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.948+0000 7f63d6735640 1 -- 172.21.15.100:0/402719513 >> v1:172.21.15.167:6789/0 conn(0x7f63c8005a00 legacy=0x7f63c804ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7f63d4f32640 1 -- 172.21.15.100:0/402719513 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1907845379 0 0) 0x7f63c8005fd0 con 0x7f63c8005a00 2024-09-11T22:20:49.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.948+0000 7f63d6735640 1 -- 172.21.15.100:0/402719513 >> v1:172.21.15.100:6789/0 conn(0x7f63c80d45f0 legacy=0x7f63c8034250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.948+0000 7f63d6735640 1 -- 172.21.15.100:0/402719513 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c80062b0 con 0x7f63c80da540 2024-09-11T22:20:49.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.948+0000 7f74e3bbd640 1 -- 172.21.15.100:0/3127674073 shutdown_connections 2024-09-11T22:20:49.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.949+0000 7f63d6735640 1 --2- 172.21.15.100:0/402719513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c80da540 0x7f63c80e5ed0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f63c000c980 tx=0x7f63c002a2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d48eaf6275122fb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.949+0000 7fcbc8b22640 1 --2- 172.21.15.100:0/2059815015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbbc0d8870 0x7fcbbc049950 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009870 tx=0x7fcbb002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b594e271acf2ba0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.945+0000 7ff9fd10c640 1 Processor -- start 2024-09-11T22:20:49.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.945+0000 7ff9fd10c640 1 -- start start 2024-09-11T22:20:49.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7ff9fd10c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9f00d4ad0 0x7ff9f0005e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7ff9fd10c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff9f004ae90 0x7ff9f00467e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7ff9fd10c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff9f00ddc70 0x7ff9f00de120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7ff9fd10c640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7ff9f0045ab0 con 0x7ff9f00ddc70 2024-09-11T22:20:49.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7ff9fd10c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7ff9f0046350 con 0x7ff9f004ae90 2024-09-11T22:20:49.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7ff9fd10c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff9f00d4eb0 con 0x7ff9f00d4ad0 2024-09-11T22:20:49.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7ff9f659c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff9f004ae90 0x7ff9f00467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7ff9f6d9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9f00d4ad0 0x7ff9f0005e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7ff9f659c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff9f004ae90 0x7ff9f00467e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44464/0 (socket says 172.21.15.100:44464) 2024-09-11T22:20:49.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7ff9f659c640 1 -- 172.21.15.100:0/673929994 learned_addr learned my addr 172.21.15.100:0/673929994 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:49.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.949+0000 7fe7deb9f640 1 -- 172.21.15.100:0/3335287276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7d0005a00 msgr2=0x7fe7d0034250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.949+0000 7fe7deb9f640 1 --2- 172.21.15.100:0/3335287276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7d0005a00 0x7fe7d0034250 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8074630 tx=0x7fe7d80a6b30 comp rx=0 tx=0).stop 2024-09-11T22:20:49.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.949+0000 7f63d4f32640 1 -- 172.21.15.100:0/402719513 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c000c2d0 con 0x7f63c80da540 2024-09-11T22:20:49.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.949+0000 7f63d4f32640 1 -- 172.21.15.100:0/402719513 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63c000c470 con 0x7f63c80da540 2024-09-11T22:20:49.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.947+0000 7ff9f759e640 1 --2- 172.21.15.100:0/673929994 >> v2:172.21.15.100:3300/0 conn(0x7ff9f00ddc70 0x7ff9f00de120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.948+0000 7ff9f659c640 1 -- 172.21.15.100:0/673929994 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9f00d4ad0 msgr2=0x7ff9f0005e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:49.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.948+0000 7ff9f659c640 1 --2- 172.21.15.100:0/673929994 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9f00d4ad0 0x7ff9f0005e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.948+0000 7ff9f659c640 1 -- 172.21.15.100:0/673929994 >> v2:172.21.15.100:3300/0 conn(0x7ff9f00ddc70 msgr2=0x7ff9f00de120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:49.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.948+0000 7ff9f659c640 1 --2- 172.21.15.100:0/673929994 >> v2:172.21.15.100:3300/0 conn(0x7ff9f00ddc70 0x7ff9f00de120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.949+0000 7f63d4f32640 1 -- 172.21.15.100:0/402719513 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c000a750 con 0x7f63c80da540 2024-09-11T22:20:49.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.948+0000 7ff9f659c640 1 -- 172.21.15.100:0/673929994 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f0046d20 con 0x7ff9f004ae90 2024-09-11T22:20:49.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.949+0000 7ff9f759e640 1 --2- 172.21.15.100:0/673929994 >> v2:172.21.15.100:3300/0 conn(0x7ff9f00ddc70 0x7ff9f00de120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:49.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.949+0000 7ff9f659c640 1 --2- 172.21.15.100:0/673929994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9f004ae90 0x7ff9f00467e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff9f806b1f0 tx=0x7ff9f80b7ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3aa0782b0fe17cdd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.949+0000 7fcbc37fe640 1 -- 172.21.15.100:0/2059815015 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0037070 con 0x7fcbbc0d8870 2024-09-11T22:20:49.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.949+0000 7fe7deb9f640 1 -- 172.21.15.100:0/3335287276 shutdown_connections 2024-09-11T22:20:49.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.949+0000 7fe7deb9f640 1 --2- 172.21.15.100:0/3335287276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7d0005a00 0x7fe7d0034250 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.949+0000 7fe7deb9f640 1 --2- 172.21.15.100:0/3335287276 >> v2:172.21.15.100:3300/0 conn(0x7fe7d00d45f0 0x7fe7d00da540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.949+0000 7fe7deb9f640 1 -- 172.21.15.100:0/3335287276 >> 172.21.15.100:0/3335287276 conn(0x7fe7d004fc50 msgr2=0x7fe7d0050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:49.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.949+0000 7fcbc37fe640 1 -- 172.21.15.100:0/2059815015 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbb0032440 con 0x7fcbbc0d8870 2024-09-11T22:20:49.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.949+0000 7fe7deb9f640 1 -- 172.21.15.100:0/3335287276 shutdown_connections 2024-09-11T22:20:49.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.949+0000 7fcbc37fe640 1 -- 172.21.15.100:0/2059815015 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0032810 con 0x7fcbbc0d8870 2024-09-11T22:20:49.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.949+0000 7fe7deb9f640 1 -- 172.21.15.100:0/3335287276 wait complete. 2024-09-11T22:20:49.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.948+0000 7f74e3bbd640 1 -- 172.21.15.100:0/3127674073 wait complete. 2024-09-11T22:20:49.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.950+0000 7f69681f6640 1 Processor -- start 2024-09-11T22:20:49.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.950+0000 7f69681f6640 1 -- start start 2024-09-11T22:20:49.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.950+0000 7fcbc9b24640 1 -- 172.21.15.100:0/2059815015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbbc0d8870 msgr2=0x7fcbbc049950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.950+0000 7fcbc9b24640 1 --2- 172.21.15.100:0/2059815015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbbc0d8870 0x7fcbbc049950 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009870 tx=0x7fcbb002a250 comp rx=0 tx=0).stop 2024-09-11T22:20:49.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.950+0000 7fcbc9b24640 1 -- 172.21.15.100:0/2059815015 shutdown_connections 2024-09-11T22:20:49.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.950+0000 7fcbc9b24640 1 --2- 172.21.15.100:0/2059815015 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbbc0dee40 0x7fcbbc049e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.950+0000 7fcbc9b24640 1 --2- 172.21.15.100:0/2059815015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbbc0d8870 0x7fcbbc049950 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.950+0000 7fcbc9b24640 1 -- 172.21.15.100:0/2059815015 >> 172.21.15.100:0/2059815015 conn(0x7fcbbc054450 msgr2=0x7fcbbc054860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:49.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.950+0000 7fcbc9b24640 1 -- 172.21.15.100:0/2059815015 shutdown_connections 2024-09-11T22:20:49.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.950+0000 7fcbc9b24640 1 -- 172.21.15.100:0/2059815015 wait complete. 2024-09-11T22:20:49.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.950+0000 7f74e3bbd640 1 Processor -- start 2024-09-11T22:20:49.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.950+0000 7f74e3bbd640 1 -- start start 2024-09-11T22:20:49.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.951+0000 7fe7deb9f640 1 Processor -- start 2024-09-11T22:20:49.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.951+0000 7f63d6f36640 1 -- 172.21.15.100:0/402719513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c80da540 msgr2=0x7f63c80e5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.951+0000 7f63d6f36640 1 --2- 172.21.15.100:0/402719513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c80da540 0x7f63c80e5ed0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f63c000c980 tx=0x7f63c002a2d0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.950+0000 7ff9f5d9b640 1 -- 172.21.15.100:0/673929994 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f80b98f0 con 0x7ff9f004ae90 2024-09-11T22:20:49.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.950+0000 7ff9f5d9b640 1 -- 172.21.15.100:0/673929994 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9f80b9a90 con 0x7ff9f004ae90 2024-09-11T22:20:49.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.951+0000 7fe7deb9f640 1 -- start start 2024-09-11T22:20:49.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.951+0000 7ff9f5d9b640 1 -- 172.21.15.100:0/673929994 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f80c3400 con 0x7ff9f004ae90 2024-09-11T22:20:49.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.951+0000 7ff9fd10c640 1 -- 172.21.15.100:0/673929994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9f004ae90 msgr2=0x7ff9f00467e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.951+0000 7ff9fd10c640 1 --2- 172.21.15.100:0/673929994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9f004ae90 0x7ff9f00467e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff9f806b1f0 tx=0x7ff9f80b7ad0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7f6965f92640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f69580d5690 0x7f69580087d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33468/0 (socket says 172.21.15.100:33468) 2024-09-11T22:20:49.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7f74e3bbd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74dc06fe50 0x7f74dc150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7fcbc9b24640 1 Processor -- start 2024-09-11T22:20:49.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7f6965f92640 1 -- 172.21.15.100:0/2811984311 learned_addr learned my addr 172.21.15.100:0/2811984311 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:49.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7fcbc9b24640 1 -- start start 2024-09-11T22:20:49.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7f74e3bbd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74dc0c7510 0x7f74dc159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7f74e3bbd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74dc15ab30 0x7f74dc152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7fe7deb9f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7d0005a00 0x7fe7d00cf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7fe7deb9f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d0034790 0x7fe7d00c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7fe7deb9f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7d00d45f0 0x7fe7d00ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7f69681f6640 1 --2- 172.21.15.100:0/2811984311 >> v2:172.21.15.167:3300/0 conn(0x7f695804bae0 0x7f695804bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7fe7deb9f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d0006b50 con 0x7fe7d00d45f0 2024-09-11T22:20:49.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7fe7deb9f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d0006870 con 0x7fe7d0034790 2024-09-11T22:20:49.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7fe7deb9f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe7d0006e30 con 0x7fe7d0005a00 2024-09-11T22:20:49.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7fe7dd39c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d0034790 0x7fe7d00c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7fe7dd39c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d0034790 0x7fe7d00c9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44486/0 (socket says 172.21.15.100:44486) 2024-09-11T22:20:49.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7fe7dd39c640 1 -- 172.21.15.100:0/1747784867 learned_addr learned my addr 172.21.15.100:0/1747784867 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:49.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7fe7de39e640 1 --2- 172.21.15.100:0/1747784867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7d00d45f0 0x7fe7d00ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7f6966793640 1 --2- 172.21.15.100:0/2811984311 >> v2:172.21.15.167:3300/0 conn(0x7f695804bae0 0x7f695804bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7f69681f6640 1 -- 172.21.15.100:0/2811984311 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6958045c40 con 0x7f69580d5690 2024-09-11T22:20:49.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7f69681f6640 1 -- 172.21.15.100:0/2811984311 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6958007770 con 0x7f69580dbdd0 2024-09-11T22:20:49.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7fe7dd39c640 1 -- 172.21.15.100:0/1747784867 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7d0005a00 msgr2=0x7fe7d00cf120 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:20:49.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7f69681f6640 1 -- 172.21.15.100:0/2811984311 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f69580dc1b0 con 0x7f695804bae0 2024-09-11T22:20:49.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7fe7ddb9d640 1 --2- 172.21.15.100:0/1747784867 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7d0005a00 0x7fe7d00cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7f6964f90640 1 -- 172.21.15.100:0/2811984311 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2909845541 0 0) 0x7f6958007770 con 0x7f69580dbdd0 2024-09-11T22:20:49.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7fe7dd39c640 1 --2- 172.21.15.100:0/1747784867 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7d0005a00 0x7fe7d00cf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7fe7dd39c640 1 -- 172.21.15.100:0/1747784867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7d00d45f0 msgr2=0x7fe7d00ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7f6964f90640 1 -- 172.21.15.100:0/2811984311 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f694c003520 con 0x7f69580dbdd0 2024-09-11T22:20:49.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7fe7dd39c640 1 --2- 172.21.15.100:0/1747784867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7d00d45f0 0x7fe7d00ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7fe7dd39c640 1 -- 172.21.15.100:0/1747784867 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d0047130 con 0x7fe7d0034790 2024-09-11T22:20:49.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7f63d6f36640 1 -- 172.21.15.100:0/402719513 shutdown_connections 2024-09-11T22:20:49.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7f63d6f36640 1 --2- 172.21.15.100:0/402719513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c80da540 0x7f63c80e5ed0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7f63d6f36640 1 -- 172.21.15.100:0/402719513 >> 172.21.15.100:0/402719513 conn(0x7f63c804fc50 msgr2=0x7f63c8050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:49.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7f6964f90640 1 -- 172.21.15.100:0/2811984311 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277301941 0 0) 0x7f6958045c40 con 0x7f69580d5690 2024-09-11T22:20:49.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7f74e1158640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74dc0c7510 0x7f74dc159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7f74e1158640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74dc0c7510 0x7f74dc159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44470/0 (socket says 172.21.15.100:44470) 2024-09-11T22:20:49.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.952+0000 7f74e215a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74dc15ab30 0x7f74dc152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7f74e1959640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74dc06fe50 0x7f74dc150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7f74e1959640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74dc06fe50 0x7f74dc150e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45430/0 (socket says 172.21.15.100:45430) 2024-09-11T22:20:49.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7f74e215a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74dc15ab30 0x7f74dc152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47652/0 (socket says 172.21.15.100:47652) 2024-09-11T22:20:49.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7f74e215a640 1 -- 172.21.15.100:0/823347186 learned_addr learned my addr 172.21.15.100:0/823347186 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:49.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7f74e3bbd640 1 -- 172.21.15.100:0/823347186 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc15afa0 con 0x7f74dc15ab30 2024-09-11T22:20:49.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7f74e3bbd640 1 -- 172.21.15.100:0/823347186 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc0c13a0 con 0x7f74dc0c7510 2024-09-11T22:20:49.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7f74e3bbd640 1 -- 172.21.15.100:0/823347186 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f74dc0c9700 con 0x7f74dc06fe50 2024-09-11T22:20:49.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7fe7dd39c640 1 --2- 172.21.15.100:0/1747784867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d0034790 0x7fe7d00c9f60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8065710 tx=0x7fe7d8069df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7f6964f90640 1 -- 172.21.15.100:0/2811984311 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6958007770 con 0x7f69580d5690 2024-09-11T22:20:49.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7fcbc9b24640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbbc0502d0 0x7fcbbc0d1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7fcbc9b24640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbbc0d8870 0x7fcbbc038300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7fcbc9b24640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbbc0dee40 0x7fcbbc0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7fcbc9b24640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcbbc0d8c50 con 0x7fcbbc0502d0 2024-09-11T22:20:49.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7fcbc9b24640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcbbc00f720 con 0x7fcbbc0d8870 2024-09-11T22:20:49.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7fcbc9b24640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcbbc0d8dd0 con 0x7fcbbc0dee40 2024-09-11T22:20:49.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7ff9fd10c640 1 -- 172.21.15.100:0/673929994 shutdown_connections 2024-09-11T22:20:49.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7ff9fd10c640 1 --2- 172.21.15.100:0/673929994 >> v2:172.21.15.100:3300/0 conn(0x7ff9f00ddc70 0x7ff9f00de120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7ff9fd10c640 1 --2- 172.21.15.100:0/673929994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9f004ae90 0x7ff9f00467e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7ff9fd10c640 1 --2- 172.21.15.100:0/673929994 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9f00d4ad0 0x7ff9f0005e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7ff9fd10c640 1 -- 172.21.15.100:0/673929994 >> 172.21.15.100:0/673929994 conn(0x7ff9f00500a0 msgr2=0x7ff9f00504b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:49.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7fcbc8b22640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbbc0502d0 0x7fcbbc0d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7fcbc8b22640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbbc0502d0 0x7fcbbc0d1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47670/0 (socket says 172.21.15.100:47670) 2024-09-11T22:20:49.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7fcbc8b22640 1 -- 172.21.15.100:0/1727492192 learned_addr learned my addr 172.21.15.100:0/1727492192 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:49.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7fcbc3fff640 1 --2- 172.21.15.100:0/1727492192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbbc0d8870 0x7fcbbc038300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7fe7ce7fc640 1 -- 172.21.15.100:0/1747784867 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d80bd480 con 0x7fe7d0034790 2024-09-11T22:20:49.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7f63d6f36640 1 -- 172.21.15.100:0/402719513 shutdown_connections 2024-09-11T22:20:49.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7f63d6f36640 1 -- 172.21.15.100:0/402719513 wait complete. 2024-09-11T22:20:49.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7fcbc9323640 1 --2- 172.21.15.100:0/1727492192 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbbc0dee40 0x7fcbbc0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7fe7ce7fc640 1 -- 172.21.15.100:0/1747784867 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7d80bd620 con 0x7fe7d0034790 2024-09-11T22:20:49.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7fe7deb9f640 1 -- 172.21.15.100:0/1747784867 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d0047410 con 0x7fe7d0034790 2024-09-11T22:20:49.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.953+0000 7fe7deb9f640 1 -- 172.21.15.100:0/1747784867 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d00479d0 con 0x7fe7d0034790 2024-09-11T22:20:49.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.954+0000 7f6964f90640 1 -- 172.21.15.100:0/2811984311 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 892388492 0 0) 0x7f694c003520 con 0x7f69580dbdd0 2024-09-11T22:20:49.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.954+0000 7f74e1158640 1 -- 172.21.15.100:0/823347186 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74dc06fe50 msgr2=0x7f74dc150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.954+0000 7f74e1158640 1 --2- 172.21.15.100:0/823347186 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74dc06fe50 0x7f74dc150e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.954+0000 7f74e1158640 1 -- 172.21.15.100:0/823347186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74dc15ab30 msgr2=0x7f74dc152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.954+0000 7fcbc8b22640 1 -- 172.21.15.100:0/1727492192 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbbc0dee40 msgr2=0x7fcbbc0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.954+0000 7fcbc8b22640 1 --2- 172.21.15.100:0/1727492192 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbbc0dee40 0x7fcbbc0cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.954+0000 7fcbc8b22640 1 -- 172.21.15.100:0/1727492192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbbc0d8870 msgr2=0x7fcbbc038300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.954+0000 7fcbc8b22640 1 --2- 172.21.15.100:0/1727492192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbbc0d8870 0x7fcbbc038300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.954+0000 7fcbc8b22640 1 -- 172.21.15.100:0/1727492192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbbc0d32f0 con 0x7fcbbc0502d0 2024-09-11T22:20:49.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.954+0000 7fcbc3fff640 1 --2- 172.21.15.100:0/1727492192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbbc0d8870 0x7fcbbc038300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:49.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.954+0000 7f74e1158640 1 --2- 172.21.15.100:0/823347186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74dc15ab30 0x7f74dc152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.954+0000 7f74e1158640 1 -- 172.21.15.100:0/823347186 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74dc1fdf10 con 0x7f74dc0c7510 2024-09-11T22:20:49.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.954+0000 7fcbc8b22640 1 --2- 172.21.15.100:0/1727492192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbbc0502d0 0x7fcbbc0d1120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcbb002a290 tx=0x7fcbb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.954+0000 7fe7ce7fc640 1 -- 172.21.15.100:0/1747784867 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d80bd9d0 con 0x7fe7d0034790 2024-09-11T22:20:49.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.954+0000 7f6966793640 1 -- 172.21.15.100:0/2811984311 >> v1:172.21.15.167:6789/0 conn(0x7f69580dbdd0 legacy=0x7f695804cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.954+0000 7fcbc17fa640 1 -- 172.21.15.100:0/1727492192 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0037040 con 0x7fcbbc0502d0 2024-09-11T22:20:49.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.954+0000 7f6966793640 1 -- 172.21.15.100:0/2811984311 >> v1:172.21.15.100:6789/0 conn(0x7f69580d5690 legacy=0x7f69580087d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.954+0000 7fcbc17fa640 1 -- 172.21.15.100:0/1727492192 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbb0042070 con 0x7fcbbc0502d0 2024-09-11T22:20:49.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.954+0000 7fcbc9b24640 1 -- 172.21.15.100:0/1727492192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbbc0d3590 con 0x7fcbbc0502d0 2024-09-11T22:20:49.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.955+0000 7fcbc17fa640 1 -- 172.21.15.100:0/1727492192 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0030860 con 0x7fcbbc0502d0 2024-09-11T22:20:49.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.955+0000 7fcbc9b24640 1 -- 172.21.15.100:0/1727492192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbbc0d3b50 con 0x7fcbbc0502d0 2024-09-11T22:20:49.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.955+0000 7f74e215a640 1 --2- 172.21.15.100:0/823347186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74dc15ab30 0x7f74dc152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:49.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.955+0000 7fe7deb9f640 1 -- 172.21.15.100:0/1747784867 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7c0005290 con 0x7fe7d0034790 2024-09-11T22:20:49.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.954+0000 7f6966793640 1 -- 172.21.15.100:0/2811984311 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6958007a10 con 0x7f695804bae0 2024-09-11T22:20:49.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.956+0000 7ff9fd10c640 1 -- 172.21.15.100:0/673929994 shutdown_connections 2024-09-11T22:20:49.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.955+0000 7f63d6f36640 1 Processor -- start 2024-09-11T22:20:49.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.955+0000 7f63d6f36640 1 -- start start 2024-09-11T22:20:49.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.956+0000 7fe7ce7fc640 1 -- 172.21.15.100:0/1747784867 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe7d80c4030 con 0x7fe7d0034790 2024-09-11T22:20:49.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.956+0000 7f74e1158640 1 --2- 172.21.15.100:0/823347186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74dc0c7510 0x7f74dc159b90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00c450 tx=0x7f74cc00c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.956+0000 7f63d6f36640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63c8005a00 0x7f63c8179380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.956+0000 7f63d6f36640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c80d45f0 0x7f63c80cf330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.956+0000 7f63d6f36640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63c80da540 0x7f63c804ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.956+0000 7f63d6f36640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f63c8006b50 con 0x7f63c8005a00 2024-09-11T22:20:49.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.956+0000 7f63d6f36640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f63c8006870 con 0x7f63c80da540 2024-09-11T22:20:49.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.956+0000 7f63d6f36640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f63c8006e30 con 0x7f63c80d45f0 2024-09-11T22:20:49.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.956+0000 7fe7ce7fc640 1 --2- 172.21.15.100:0/1747784867 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe7bc06be80 0x7fe7bc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.956+0000 7fcbc9b24640 1 -- 172.21.15.100:0/1727492192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcba4005290 con 0x7fcbbc0502d0 2024-09-11T22:20:49.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.957+0000 7fe7ce7fc640 1 -- 172.21.15.100:0/1747784867 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe7d8128450 con 0x7fe7d0034790 2024-09-11T22:20:49.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.956+0000 7f63d5f34640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63c8005a00 0x7f63c8179380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.957+0000 7f63d5733640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c80d45f0 0x7f63c80cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.957+0000 7f63d5733640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c80d45f0 0x7f63c80cf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45448/0 (socket says 172.21.15.100:45448) 2024-09-11T22:20:49.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.957+0000 7f63d5733640 1 -- 172.21.15.100:0/2234482591 learned_addr learned my addr 172.21.15.100:0/2234482591 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:49.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.956+0000 7ff9fd10c640 1 -- 172.21.15.100:0/673929994 wait complete. 2024-09-11T22:20:49.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.956+0000 7f6966793640 1 --2- 172.21.15.100:0/2811984311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f695804bae0 0x7f695804bee0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f69500097a0 tx=0x7f695002a030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19e5578ed819d88d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.957+0000 7f63d5f34640 1 -- 172.21.15.100:0/2234482591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c80d45f0 msgr2=0x7f63c80cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:49.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.957+0000 7fe7ddb9d640 1 --2- 172.21.15.100:0/1747784867 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe7bc06be80 0x7fe7bc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.957+0000 7f63d5f34640 1 --2- 172.21.15.100:0/2234482591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c80d45f0 0x7f63c80cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.957+0000 7f63d5f34640 1 -- 172.21.15.100:0/2234482591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63c80da540 msgr2=0x7f63c804ecf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:20:49.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.957+0000 7f63d5f34640 1 --2- 172.21.15.100:0/2234482591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63c80da540 0x7f63c804ecf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:49.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.957+0000 7f63d5f34640 1 -- 172.21.15.100:0/2234482591 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c80ce890 con 0x7f63c8005a00 2024-09-11T22:20:49.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.957+0000 7f63d5733640 1 --2- 172.21.15.100:0/2234482591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c80d45f0 0x7f63c80cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:49.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.957+0000 7f63d5f34640 1 --2- 172.21.15.100:0/2234482591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63c8005a00 0x7f63c8179380 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f63d006b3b0 tx=0x7f63d0069890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.958+0000 7fe7ddb9d640 1 --2- 172.21.15.100:0/1747784867 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe7bc06be80 0x7fe7bc06e340 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe7c800a7c0 tx=0x7fe7c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.958+0000 7fcbc17fa640 1 -- 172.21.15.100:0/1727492192 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcbb0030a00 con 0x7fcbbc0502d0 2024-09-11T22:20:49.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.958+0000 7ff9fd10c640 1 Processor -- start 2024-09-11T22:20:49.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.958+0000 7ff9fd10c640 1 -- start start 2024-09-11T22:20:49.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.959+0000 7fcbc17fa640 1 --2- 172.21.15.100:0/1727492192 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcba806bf00 0x7fcba806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.959+0000 7fcbc17fa640 1 -- 172.21.15.100:0/1727492192 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fcbb00ac3b0 con 0x7fcbbc0502d0 2024-09-11T22:20:49.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.959+0000 7fcbc3fff640 1 --2- 172.21.15.100:0/1727492192 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcba806bf00 0x7fcba806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.959+0000 7fcbc3fff640 1 --2- 172.21.15.100:0/1727492192 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcba806bf00 0x7fcba806e3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8007fd0 tx=0x7fcbb8007dc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:49.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.959+0000 7ff9fd10c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9f004ae90 0x7ff9f0174430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.959+0000 7ff9fd10c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9f00d4ad0 0x7ff9f004ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.959+0000 7ff9fd10c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f00ddc70 0x7ff9f00c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:49.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.959+0000 7ff9fd10c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f0045d00 con 0x7ff9f00ddc70 2024-09-11T22:20:49.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.959+0000 7ff9fd10c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f00dea00 con 0x7ff9f004ae90 2024-09-11T22:20:49.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.959+0000 7ff9fd10c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff9f0045fe0 con 0x7ff9f00d4ad0 2024-09-11T22:20:49.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.959+0000 7ff9f759e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f00ddc70 0x7ff9f00c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:49.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.959+0000 7ff9f759e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f00ddc70 0x7ff9f00c7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47684/0 (socket says 172.21.15.100:47684) 2024-09-11T22:20:49.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.959+0000 7ff9f759e640 1 -- 172.21.15.100:0/1449105428 learned_addr learned my addr 172.21.15.100:0/1449105428 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:50.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.960+0000 7ff9f659c640 1 --2- 172.21.15.100:0/1449105428 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9f00d4ad0 0x7ff9f004ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.960+0000 7ff9f6d9d640 1 --2- 172.21.15.100:0/1449105428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9f004ae90 0x7ff9f0174430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.960+0000 7ff9f759e640 1 -- 172.21.15.100:0/1449105428 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9f00d4ad0 msgr2=0x7ff9f004ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.960+0000 7ff9f759e640 1 --2- 172.21.15.100:0/1449105428 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9f00d4ad0 0x7ff9f004ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.960+0000 7ff9f759e640 1 -- 172.21.15.100:0/1449105428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9f004ae90 msgr2=0x7ff9f0174430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.960+0000 7ff9f759e640 1 --2- 172.21.15.100:0/1449105428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9f004ae90 0x7ff9f0174430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.960+0000 7ff9f759e640 1 -- 172.21.15.100:0/1449105428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f00475b0 con 0x7ff9f00ddc70 2024-09-11T22:20:50.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.960+0000 7ff9f759e640 1 --2- 172.21.15.100:0/1449105428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f00ddc70 0x7ff9f00c7840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800e880 tx=0x7ff9e800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:50.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.961+0000 7f74d27fc640 1 -- 172.21.15.100:0/823347186 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc018070 con 0x7f74dc0c7510 2024-09-11T22:20:50.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.961+0000 7f74d27fc640 1 -- 172.21.15.100:0/823347186 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74cc0074e0 con 0x7f74dc0c7510 2024-09-11T22:20:50.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.961+0000 7f74e3bbd640 1 -- 172.21.15.100:0/823347186 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74dc1fd390 con 0x7f74dc0c7510 2024-09-11T22:20:50.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.961+0000 7f6964f90640 1 -- 172.21.15.100:0/2811984311 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6950037070 con 0x7f695804bae0 2024-09-11T22:20:50.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.961+0000 7f74e3bbd640 1 -- 172.21.15.100:0/823347186 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74dc1fd950 con 0x7f74dc0c7510 2024-09-11T22:20:50.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.961+0000 7f6964f90640 1 -- 172.21.15.100:0/2811984311 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f695002aac0 con 0x7f695804bae0 2024-09-11T22:20:50.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.961+0000 7fe7ce7fc640 1 -- 172.21.15.100:0/1747784867 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe7d80cb020 con 0x7fe7d0034790 2024-09-11T22:20:50.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.961+0000 7f6964f90640 1 -- 172.21.15.100:0/2811984311 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6960063850 con 0x7f695804bae0 2024-09-11T22:20:50.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.961+0000 7f74d27fc640 1 -- 172.21.15.100:0/823347186 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc004a00 con 0x7f74dc0c7510 2024-09-11T22:20:50.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.962+0000 7f69681f6640 1 -- 172.21.15.100:0/2811984311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f695804bae0 msgr2=0x7f695804bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.962+0000 7f69681f6640 1 --2- 172.21.15.100:0/2811984311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f695804bae0 0x7f695804bee0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f69500097a0 tx=0x7f695002a030 comp rx=0 tx=0).stop 2024-09-11T22:20:50.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.962+0000 7f74e3bbd640 1 -- 172.21.15.100:0/823347186 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74dc06f150 con 0x7f74dc0c7510 2024-09-11T22:20:50.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.962+0000 7f69681f6640 1 -- 172.21.15.100:0/2811984311 shutdown_connections 2024-09-11T22:20:50.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.962+0000 7f69681f6640 1 --2- 172.21.15.100:0/2811984311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f695804bae0 0x7f695804bee0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.962+0000 7f69681f6640 1 -- 172.21.15.100:0/2811984311 >> 172.21.15.100:0/2811984311 conn(0x7f6958050d60 msgr2=0x7f6958051170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:50.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.963+0000 7f69681f6640 1 -- 172.21.15.100:0/2811984311 shutdown_connections 2024-09-11T22:20:50.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.963+0000 7f69681f6640 1 -- 172.21.15.100:0/2811984311 wait complete. 2024-09-11T22:20:50.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.963+0000 7f74d27fc640 1 -- 172.21.15.100:0/823347186 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f74cc01b070 con 0x7f74dc0c7510 2024-09-11T22:20:50.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.964+0000 7f74d27fc640 1 --2- 172.21.15.100:0/823347186 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f74c006be80 0x7f74c006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.964+0000 7f74e1959640 1 --2- 172.21.15.100:0/823347186 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f74c006be80 0x7f74c006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.964+0000 7f69681f6640 1 Processor -- start 2024-09-11T22:20:50.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.964+0000 7f69681f6640 1 -- start start 2024-09-11T22:20:50.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.964+0000 7f74e1959640 1 --2- 172.21.15.100:0/823347186 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f74c006be80 0x7f74c006e340 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f74d8007fd0 tx=0x7f74d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:50.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.964+0000 7f74d27fc640 1 -- 172.21.15.100:0/823347186 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f74cc08a490 con 0x7f74dc0c7510 2024-09-11T22:20:50.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.965+0000 7f69681f6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f695804bae0 0x7f6958170ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.965+0000 7f69681f6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69580d5690 0x7f69580da420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.965+0000 7f69681f6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69580dbdd0 0x7f69580d7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.965+0000 7f69681f6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f695804d580 con 0x7f69580d5690 2024-09-11T22:20:50.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.965+0000 7f69681f6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6958007fd0 con 0x7f695804bae0 2024-09-11T22:20:50.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.965+0000 7f69681f6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f6958008ee0 con 0x7f69580dbdd0 2024-09-11T22:20:50.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.965+0000 7f6965791640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69580d5690 0x7f69580da420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.965+0000 7f6966793640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69580dbdd0 0x7f69580d7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.965+0000 7f6965791640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69580d5690 0x7f69580da420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47694/0 (socket says 172.21.15.100:47694) 2024-09-11T22:20:50.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.965+0000 7f6965791640 1 -- 172.21.15.100:0/2166542513 learned_addr learned my addr 172.21.15.100:0/2166542513 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:50.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.965+0000 7f6965f92640 1 --2- 172.21.15.100:0/2166542513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f695804bae0 0x7f6958170ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.966+0000 7f6965791640 1 -- 172.21.15.100:0/2166542513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69580dbdd0 msgr2=0x7f69580d7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.966+0000 7f6965791640 1 --2- 172.21.15.100:0/2166542513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69580dbdd0 0x7f69580d7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.966+0000 7f6965791640 1 -- 172.21.15.100:0/2166542513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f695804bae0 msgr2=0x7f6958170ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.966+0000 7f6965791640 1 --2- 172.21.15.100:0/2166542513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f695804bae0 0x7f6958170ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.966+0000 7f6965791640 1 -- 172.21.15.100:0/2166542513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69580d6c80 con 0x7f69580d5690 2024-09-11T22:20:50.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.966+0000 7f6965f92640 1 --2- 172.21.15.100:0/2166542513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f695804bae0 0x7f6958170ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:20:50.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.966+0000 7fcbc17fa640 1 -- 172.21.15.100:0/1727492192 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcbb007aa90 con 0x7fcbbc0502d0 2024-09-11T22:20:50.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.966+0000 7f6965791640 1 --2- 172.21.15.100:0/2166542513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69580d5690 0x7f69580da420 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f695c00c780 tx=0x7f695c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:50.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.966+0000 7ff9df7fe640 1 -- 172.21.15.100:0/1449105428 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8017070 con 0x7ff9f00ddc70 2024-09-11T22:20:50.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.967+0000 7ff9fd10c640 1 -- 172.21.15.100:0/1449105428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f0047890 con 0x7ff9f00ddc70 2024-09-11T22:20:50.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.967+0000 7ff9fd10c640 1 -- 172.21.15.100:0/1449105428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f0177db0 con 0x7ff9f00ddc70 2024-09-11T22:20:50.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.967+0000 7f63c67fc640 1 -- 172.21.15.100:0/2234482591 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d0071690 con 0x7f63c8005a00 2024-09-11T22:20:50.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.967+0000 7f63d6f36640 1 -- 172.21.15.100:0/2234482591 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63c80d0220 con 0x7f63c8005a00 2024-09-11T22:20:50.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.967+0000 7f63d6f36640 1 -- 172.21.15.100:0/2234482591 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63c80d07c0 con 0x7f63c8005a00 2024-09-11T22:20:50.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.967+0000 7f69567fc640 1 -- 172.21.15.100:0/2166542513 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c00ce30 con 0x7f69580d5690 2024-09-11T22:20:50.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.967+0000 7f69681f6640 1 -- 172.21.15.100:0/2166542513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69580ce420 con 0x7f69580d5690 2024-09-11T22:20:50.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.967+0000 7f63c67fc640 1 -- 172.21.15.100:0/2234482591 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63d0071830 con 0x7f63c8005a00 2024-09-11T22:20:50.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.967+0000 7f69681f6640 1 -- 172.21.15.100:0/2166542513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69580d7220 con 0x7f69580d5690 2024-09-11T22:20:50.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.967+0000 7f63c67fc640 1 -- 172.21.15.100:0/2234482591 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d0071c20 con 0x7f63c8005a00 2024-09-11T22:20:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.968+0000 7f74d27fc640 1 -- 172.21.15.100:0/823347186 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f74dc06f150 con 0x7f74dc0c7510 2024-09-11T22:20:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.969+0000 7ff9fd10c640 1 -- 172.21.15.100:0/1449105428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9f0005c80 con 0x7ff9f00ddc70 2024-09-11T22:20:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.969+0000 7f69681f6640 1 -- 172.21.15.100:0/2166542513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f695804bee0 con 0x7f69580d5690 2024-09-11T22:20:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.969+0000 7f69567fc640 1 -- 172.21.15.100:0/2166542513 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f695c00a640 con 0x7f69580d5690 2024-09-11T22:20:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.969+0000 7f69567fc640 1 -- 172.21.15.100:0/2166542513 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c00a9f0 con 0x7f69580d5690 2024-09-11T22:20:50.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.969+0000 7ff9df7fe640 1 -- 172.21.15.100:0/1449105428 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e8004020 con 0x7ff9f00ddc70 2024-09-11T22:20:50.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.971+0000 7ff9df7fe640 1 -- 172.21.15.100:0/1449105428 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8020060 con 0x7ff9f00ddc70 2024-09-11T22:20:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.970+0000 7f63d6f36640 1 -- 172.21.15.100:0/2234482591 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63b8005290 con 0x7f63c8005a00 2024-09-11T22:20:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.970+0000 7f63c67fc640 1 -- 172.21.15.100:0/2234482591 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f63d0096030 con 0x7f63c8005a00 2024-09-11T22:20:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.971+0000 7f63c67fc640 1 --2- 172.21.15.100:0/2234482591 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f63b406be60 0x7f63b406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.972+0000 7f63d5733640 1 --2- 172.21.15.100:0/2234482591 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f63b406be60 0x7f63b406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.972+0000 7f63d5733640 1 --2- 172.21.15.100:0/2234482591 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f63b406be60 0x7f63b406e320 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f63c80d79a0 tx=0x7f63cc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.974+0000 7f63c67fc640 1 -- 172.21.15.100:0/2234482591 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f63d0099e00 con 0x7f63c8005a00 2024-09-11T22:20:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.973+0000 7ff9df7fe640 1 -- 172.21.15.100:0/1449105428 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff9e800c8e0 con 0x7ff9f00ddc70 2024-09-11T22:20:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.974+0000 7ff9df7fe640 1 --2- 172.21.15.100:0/1449105428 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff9e406be30 0x7ff9e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.974+0000 7ff9df7fe640 1 -- 172.21.15.100:0/1449105428 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff9e808b960 con 0x7ff9f00ddc70 2024-09-11T22:20:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.974+0000 7ff9f6d9d640 1 --2- 172.21.15.100:0/1449105428 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff9e406be30 0x7ff9e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.975+0000 7ff9f6d9d640 1 --2- 172.21.15.100:0/1449105428 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff9e406be30 0x7ff9e406e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec00aaf0 tx=0x7ff9ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.974+0000 7f69567fc640 1 -- 172.21.15.100:0/2166542513 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f695c00ab90 con 0x7f69580d5690 2024-09-11T22:20:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.975+0000 7f69567fc640 1 --2- 172.21.15.100:0/2166542513 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f694406be30 0x7f694406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.975+0000 7f69567fc640 1 -- 172.21.15.100:0/2166542513 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f695c08bbb0 con 0x7f69580d5690 2024-09-11T22:20:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.976+0000 7f6965f92640 1 --2- 172.21.15.100:0/2166542513 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f694406be30 0x7f694406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.976+0000 7f6965f92640 1 --2- 172.21.15.100:0/2166542513 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f694406be30 0x7f694406e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6960051790 tx=0x7f696006e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.981+0000 7ff9df7fe640 1 -- 172.21.15.100:0/1449105428 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff9e8059970 con 0x7ff9f00ddc70 2024-09-11T22:20:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:49.993+0000 7f69567fc640 1 -- 172.21.15.100:0/2166542513 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f695c05a170 con 0x7f69580d5690 2024-09-11T22:20:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.002+0000 7f63c67fc640 1 -- 172.21.15.100:0/2234482591 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f63d009d020 con 0x7f63c8005a00 2024-09-11T22:20:50.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.201+0000 7f9d86ffd640 1 -- 172.21.15.100:0/3055497478 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9d74005850 con 0x7f9d9015aeb0 2024-09-11T22:20:50.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.202+0000 7f9d8d7fa640 1 -- 172.21.15.100:0/3055497478 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9d80021080 con 0x7f9d9015aeb0 2024-09-11T22:20:50.203 INFO:teuthology.orchestra.run.smithi100.stdout:64424509450 2024-09-11T22:20:50.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.205+0000 7f9d9716d640 1 -- 172.21.15.100:0/3055497478 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9d7006c230 msgr2=0x7f9d7006e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.205+0000 7f9d9716d640 1 --2- 172.21.15.100:0/3055497478 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9d7006c230 0x7f9d7006e6f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9d78009720 tx=0x7f9d7802e000 comp rx=0 tx=0).stop 2024-09-11T22:20:50.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.206+0000 7f9d9716d640 1 -- 172.21.15.100:0/3055497478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d9015aeb0 msgr2=0x7f9d9014ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.206+0000 7f9d9716d640 1 --2- 172.21.15.100:0/3055497478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d9015aeb0 0x7f9d9014ba90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000c3c0 tx=0x7f9d8000c7c0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.206+0000 7f9d9716d640 1 -- 172.21.15.100:0/3055497478 shutdown_connections 2024-09-11T22:20:50.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.206+0000 7f9d9716d640 1 --2- 172.21.15.100:0/3055497478 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9d7006c230 0x7f9d7006e6f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.206+0000 7f9d9716d640 1 --2- 172.21.15.100:0/3055497478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d9015aeb0 0x7f9d9014ba90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.206+0000 7f9d9716d640 1 --2- 172.21.15.100:0/3055497478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d90156cb0 0x7f9d900c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.206+0000 7f9d9716d640 1 --2- 172.21.15.100:0/3055497478 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d90150e00 0x7f9d900c2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.206+0000 7f9d9716d640 1 -- 172.21.15.100:0/3055497478 >> 172.21.15.100:0/3055497478 conn(0x7f9d9006fa70 msgr2=0x7f9d9014d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:50.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.207+0000 7f9d9716d640 1 -- 172.21.15.100:0/3055497478 shutdown_connections 2024-09-11T22:20:50.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.207+0000 7f9d9716d640 1 -- 172.21.15.100:0/3055497478 wait complete. 2024-09-11T22:20:50.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.6 2024-09-11T22:20:50.223 DEBUG:teuthology.parallel:result is None 2024-09-11T22:20:50.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.264+0000 7fca3f152640 1 -- 172.21.15.100:0/3324157271 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fca18005580 con 0x7fca380c8f50 2024-09-11T22:20:50.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.265+0000 7fca357fa640 1 -- 172.21.15.100:0/3324157271 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fca2805c770 con 0x7fca380c8f50 2024-09-11T22:20:50.266 INFO:teuthology.orchestra.run.smithi100.stdout:64424509450 2024-09-11T22:20:50.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.267+0000 7fca3f152640 1 -- 172.21.15.100:0/3324157271 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fca2406bf00 msgr2=0x7fca2406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.267+0000 7fca3f152640 1 --2- 172.21.15.100:0/3324157271 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fca2406bf00 0x7fca2406e3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fca2c0098e0 tx=0x7fca2c009060 comp rx=0 tx=0).stop 2024-09-11T22:20:50.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.268+0000 7fca3f152640 1 -- 172.21.15.100:0/3324157271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca380c8f50 msgr2=0x7fca380ca540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.268+0000 7fca3f152640 1 --2- 172.21.15.100:0/3324157271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca380c8f50 0x7fca380ca540 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fca2800c430 tx=0x7fca2800c8f0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.268+0000 7fca3f152640 1 -- 172.21.15.100:0/3324157271 shutdown_connections 2024-09-11T22:20:50.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.268+0000 7fca3f152640 1 --2- 172.21.15.100:0/3324157271 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fca2406bf00 0x7fca2406e3c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.268+0000 7fca3f152640 1 --2- 172.21.15.100:0/3324157271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca3816b4b0 0x7fca380ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.268+0000 7fca3f152640 1 --2- 172.21.15.100:0/3324157271 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca380c8f50 0x7fca380ca540 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.268+0000 7fca3f152640 1 --2- 172.21.15.100:0/3324157271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca380c8b70 0x7fca38161560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.268+0000 7fca3f152640 1 -- 172.21.15.100:0/3324157271 >> 172.21.15.100:0/3324157271 conn(0x7fca3806f360 msgr2=0x7fca380cb670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:50.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.268+0000 7fca3f152640 1 -- 172.21.15.100:0/3324157271 shutdown_connections 2024-09-11T22:20:50.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.268+0000 7fca3f152640 1 -- 172.21.15.100:0/3324157271 wait complete. 2024-09-11T22:20:50.280 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.3 2024-09-11T22:20:50.280 DEBUG:teuthology.parallel:result is None 2024-09-11T22:20:50.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.336+0000 7ff9fd10c640 1 -- 172.21.15.100:0/1449105428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff9f0046f00 con 0x7ff9f00ddc70 2024-09-11T22:20:50.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.337+0000 7ff9df7fe640 1 -- 172.21.15.100:0/1449105428 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff9e805dc70 con 0x7ff9f00ddc70 2024-09-11T22:20:50.337 INFO:teuthology.orchestra.run.smithi100.stdout:64424509451 2024-09-11T22:20:50.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.339+0000 7ff9fd10c640 1 -- 172.21.15.100:0/1449105428 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff9e406be30 msgr2=0x7ff9e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.339+0000 7ff9fd10c640 1 --2- 172.21.15.100:0/1449105428 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff9e406be30 0x7ff9e406e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec00aaf0 tx=0x7ff9ec008040 comp rx=0 tx=0).stop 2024-09-11T22:20:50.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.339+0000 7ff9fd10c640 1 -- 172.21.15.100:0/1449105428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f00ddc70 msgr2=0x7ff9f00c7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.339+0000 7ff9fd10c640 1 --2- 172.21.15.100:0/1449105428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f00ddc70 0x7ff9f00c7840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800e880 tx=0x7ff9e800ed40 comp rx=0 tx=0).stop 2024-09-11T22:20:50.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.339+0000 7ff9fd10c640 1 -- 172.21.15.100:0/1449105428 shutdown_connections 2024-09-11T22:20:50.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.339+0000 7ff9fd10c640 1 --2- 172.21.15.100:0/1449105428 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff9e406be30 0x7ff9e406e2f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.339+0000 7ff9fd10c640 1 --2- 172.21.15.100:0/1449105428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9f00ddc70 0x7ff9f00c7840 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.339+0000 7ff9fd10c640 1 --2- 172.21.15.100:0/1449105428 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9f00d4ad0 0x7ff9f004ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.339+0000 7ff9fd10c640 1 --2- 172.21.15.100:0/1449105428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9f004ae90 0x7ff9f0174430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.339+0000 7ff9fd10c640 1 -- 172.21.15.100:0/1449105428 >> 172.21.15.100:0/1449105428 conn(0x7ff9f00500a0 msgr2=0x7ff9f0050480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:50.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.339+0000 7ff9fd10c640 1 -- 172.21.15.100:0/1449105428 shutdown_connections 2024-09-11T22:20:50.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.339+0000 7ff9fd10c640 1 -- 172.21.15.100:0/1449105428 wait complete. 2024-09-11T22:20:50.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.339+0000 7fe7deb9f640 1 -- 172.21.15.100:0/1747784867 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe7c0005580 con 0x7fe7d0034790 2024-09-11T22:20:50.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.340+0000 7fe7ce7fc640 1 -- 172.21.15.100:0/1747784867 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe7d80ae030 con 0x7fe7d0034790 2024-09-11T22:20:50.341 INFO:teuthology.orchestra.run.smithi100.stdout:60129542154 2024-09-11T22:20:50.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.342+0000 7fe7deb9f640 1 -- 172.21.15.100:0/1747784867 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe7bc06be80 msgr2=0x7fe7bc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.342+0000 7fe7deb9f640 1 --2- 172.21.15.100:0/1747784867 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe7bc06be80 0x7fe7bc06e340 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe7c800a7c0 tx=0x7fe7c8008040 comp rx=0 tx=0).stop 2024-09-11T22:20:50.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.342+0000 7fe7deb9f640 1 -- 172.21.15.100:0/1747784867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d0034790 msgr2=0x7fe7d00c9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.342+0000 7fe7deb9f640 1 --2- 172.21.15.100:0/1747784867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d0034790 0x7fe7d00c9f60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8065710 tx=0x7fe7d8069df0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.342+0000 7fe7deb9f640 1 -- 172.21.15.100:0/1747784867 shutdown_connections 2024-09-11T22:20:50.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.342+0000 7fe7deb9f640 1 --2- 172.21.15.100:0/1747784867 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe7bc06be80 0x7fe7bc06e340 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.342+0000 7fe7deb9f640 1 --2- 172.21.15.100:0/1747784867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7d00d45f0 0x7fe7d00ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.342+0000 7fe7deb9f640 1 --2- 172.21.15.100:0/1747784867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d0034790 0x7fe7d00c9f60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.342+0000 7fe7deb9f640 1 --2- 172.21.15.100:0/1747784867 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7d0005a00 0x7fe7d00cf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.342+0000 7fe7deb9f640 1 -- 172.21.15.100:0/1747784867 >> 172.21.15.100:0/1747784867 conn(0x7fe7d004fc50 msgr2=0x7fe7d00d38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:50.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.342+0000 7fe7deb9f640 1 -- 172.21.15.100:0/1747784867 shutdown_connections 2024-09-11T22:20:50.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.342+0000 7fe7deb9f640 1 -- 172.21.15.100:0/1747784867 wait complete. 2024-09-11T22:20:50.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.5 2024-09-11T22:20:50.353 DEBUG:teuthology.parallel:result is None 2024-09-11T22:20:50.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.2 2024-09-11T22:20:50.355 DEBUG:teuthology.parallel:result is None 2024-09-11T22:20:50.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.363+0000 7f74e3bbd640 1 -- 172.21.15.100:0/823347186 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f74dc0c7920 con 0x7f74dc0c7510 2024-09-11T22:20:50.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.363+0000 7f74d27fc640 1 -- 172.21.15.100:0/823347186 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f74cc058d30 con 0x7f74dc0c7510 2024-09-11T22:20:50.364 INFO:teuthology.orchestra.run.smithi100.stdout:60129542154 2024-09-11T22:20:50.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.365+0000 7fcbc9b24640 1 -- 172.21.15.100:0/1727492192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fcba4005850 con 0x7fcbbc0502d0 2024-09-11T22:20:50.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.365+0000 7f74e3bbd640 1 -- 172.21.15.100:0/823347186 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f74c006be80 msgr2=0x7f74c006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.365+0000 7f74e3bbd640 1 --2- 172.21.15.100:0/823347186 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f74c006be80 0x7f74c006e340 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f74d8007fd0 tx=0x7f74d8009040 comp rx=0 tx=0).stop 2024-09-11T22:20:50.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.365+0000 7f74e3bbd640 1 -- 172.21.15.100:0/823347186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74dc0c7510 msgr2=0x7f74dc159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.365+0000 7f74e3bbd640 1 --2- 172.21.15.100:0/823347186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74dc0c7510 0x7f74dc159b90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00c450 tx=0x7f74cc00c910 comp rx=0 tx=0).stop 2024-09-11T22:20:50.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.365+0000 7f74e3bbd640 1 -- 172.21.15.100:0/823347186 shutdown_connections 2024-09-11T22:20:50.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.365+0000 7f74e3bbd640 1 --2- 172.21.15.100:0/823347186 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f74c006be80 0x7f74c006e340 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.365+0000 7f74e3bbd640 1 --2- 172.21.15.100:0/823347186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74dc15ab30 0x7f74dc152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.365+0000 7f74e3bbd640 1 --2- 172.21.15.100:0/823347186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74dc0c7510 0x7f74dc159b90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.365+0000 7f74e3bbd640 1 --2- 172.21.15.100:0/823347186 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74dc06fe50 0x7f74dc150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.365+0000 7f74e3bbd640 1 -- 172.21.15.100:0/823347186 >> 172.21.15.100:0/823347186 conn(0x7f74dc06f360 msgr2=0x7f74dc153c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:50.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.365+0000 7fcbc17fa640 1 -- 172.21.15.100:0/1727492192 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcbb007a390 con 0x7fcbbc0502d0 2024-09-11T22:20:50.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.366+0000 7f74e3bbd640 1 -- 172.21.15.100:0/823347186 shutdown_connections 2024-09-11T22:20:50.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.366+0000 7f74e3bbd640 1 -- 172.21.15.100:0/823347186 wait complete. 2024-09-11T22:20:50.368 INFO:teuthology.orchestra.run.smithi100.stdout:55834574859 2024-09-11T22:20:50.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.368+0000 7fcbc9b24640 1 -- 172.21.15.100:0/1727492192 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcba806bf00 msgr2=0x7fcba806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.369+0000 7fcbc9b24640 1 --2- 172.21.15.100:0/1727492192 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcba806bf00 0x7fcba806e3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8007fd0 tx=0x7fcbb8007dc0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.369+0000 7fcbc9b24640 1 -- 172.21.15.100:0/1727492192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbbc0502d0 msgr2=0x7fcbbc0d1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.369+0000 7fcbc9b24640 1 --2- 172.21.15.100:0/1727492192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbbc0502d0 0x7fcbbc0d1120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcbb002a290 tx=0x7fcbb00046c0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.369+0000 7fcbc9b24640 1 -- 172.21.15.100:0/1727492192 shutdown_connections 2024-09-11T22:20:50.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.369+0000 7fcbc9b24640 1 --2- 172.21.15.100:0/1727492192 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcba806bf00 0x7fcba806e3c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.369+0000 7fcbc9b24640 1 --2- 172.21.15.100:0/1727492192 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbbc0dee40 0x7fcbbc0cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.369+0000 7fcbc9b24640 1 --2- 172.21.15.100:0/1727492192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbbc0d8870 0x7fcbbc038300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.369+0000 7fcbc9b24640 1 --2- 172.21.15.100:0/1727492192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbbc0502d0 0x7fcbbc0d1120 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.369+0000 7fcbc9b24640 1 -- 172.21.15.100:0/1727492192 >> 172.21.15.100:0/1727492192 conn(0x7fcbbc054450 msgr2=0x7fcbbc052620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:50.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.369+0000 7fcbc9b24640 1 -- 172.21.15.100:0/1727492192 shutdown_connections 2024-09-11T22:20:50.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.369+0000 7fcbc9b24640 1 -- 172.21.15.100:0/1727492192 wait complete. 2024-09-11T22:20:50.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.372+0000 7f69681f6640 1 -- 172.21.15.100:0/2166542513 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f695804c600 con 0x7f69580d5690 2024-09-11T22:20:50.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.372+0000 7f69567fc640 1 -- 172.21.15.100:0/2166542513 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f695c059a70 con 0x7f69580d5690 2024-09-11T22:20:50.373 INFO:teuthology.orchestra.run.smithi100.stdout:64424509449 2024-09-11T22:20:50.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.374+0000 7f69681f6640 1 -- 172.21.15.100:0/2166542513 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f694406be30 msgr2=0x7f694406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.374+0000 7f69681f6640 1 --2- 172.21.15.100:0/2166542513 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f694406be30 0x7f694406e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6960051790 tx=0x7f696006e040 comp rx=0 tx=0).stop 2024-09-11T22:20:50.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.374+0000 7f69681f6640 1 -- 172.21.15.100:0/2166542513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69580d5690 msgr2=0x7f69580da420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.374+0000 7f69681f6640 1 --2- 172.21.15.100:0/2166542513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69580d5690 0x7f69580da420 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f695c00c780 tx=0x7f695c00cc40 comp rx=0 tx=0).stop 2024-09-11T22:20:50.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.375+0000 7f69681f6640 1 -- 172.21.15.100:0/2166542513 shutdown_connections 2024-09-11T22:20:50.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.375+0000 7f69681f6640 1 --2- 172.21.15.100:0/2166542513 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f694406be30 0x7f694406e2f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.375+0000 7f69681f6640 1 --2- 172.21.15.100:0/2166542513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69580dbdd0 0x7f69580d7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.375+0000 7f69681f6640 1 --2- 172.21.15.100:0/2166542513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69580d5690 0x7f69580da420 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.375+0000 7f69681f6640 1 --2- 172.21.15.100:0/2166542513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f695804bae0 0x7f6958170ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.375+0000 7f69681f6640 1 -- 172.21.15.100:0/2166542513 >> 172.21.15.100:0/2166542513 conn(0x7f6958050d60 msgr2=0x7f69580d94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:50.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.375+0000 7f69681f6640 1 -- 172.21.15.100:0/2166542513 shutdown_connections 2024-09-11T22:20:50.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.375+0000 7f69681f6640 1 -- 172.21.15.100:0/2166542513 wait complete. 2024-09-11T22:20:50.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.0 2024-09-11T22:20:50.379 DEBUG:teuthology.parallel:result is None 2024-09-11T22:20:50.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2024-09-11T22:20:50.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.382+0000 7f63d6f36640 1 -- 172.21.15.100:0/2234482591 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f63b8005850 con 0x7f63c8005a00 2024-09-11T22:20:50.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.383+0000 7f63c67fc640 1 -- 172.21.15.100:0/2234482591 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f63d00d4fb0 con 0x7f63c8005a00 2024-09-11T22:20:50.384 DEBUG:teuthology.parallel:result is None 2024-09-11T22:20:50.384 INFO:teuthology.orchestra.run.smithi100.stdout:64424509450 2024-09-11T22:20:50.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.385+0000 7f63d6f36640 1 -- 172.21.15.100:0/2234482591 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f63b406be60 msgr2=0x7f63b406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.385+0000 7f63d6f36640 1 --2- 172.21.15.100:0/2234482591 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f63b406be60 0x7f63b406e320 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f63c80d79a0 tx=0x7f63cc009040 comp rx=0 tx=0).stop 2024-09-11T22:20:50.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.385+0000 7f63d6f36640 1 -- 172.21.15.100:0/2234482591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63c8005a00 msgr2=0x7f63c8179380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.385+0000 7f63d6f36640 1 --2- 172.21.15.100:0/2234482591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63c8005a00 0x7f63c8179380 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f63d006b3b0 tx=0x7f63d0069890 comp rx=0 tx=0).stop 2024-09-11T22:20:50.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.385+0000 7f63d6f36640 1 -- 172.21.15.100:0/2234482591 shutdown_connections 2024-09-11T22:20:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.385+0000 7f63d6f36640 1 --2- 172.21.15.100:0/2234482591 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f63b406be60 0x7f63b406e320 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.385+0000 7f63d6f36640 1 --2- 172.21.15.100:0/2234482591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63c80da540 0x7f63c804ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.385+0000 7f63d6f36640 1 --2- 172.21.15.100:0/2234482591 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63c80d45f0 0x7f63c80cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.385+0000 7f63d6f36640 1 --2- 172.21.15.100:0/2234482591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63c8005a00 0x7f63c8179380 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.385+0000 7f63d6f36640 1 -- 172.21.15.100:0/2234482591 >> 172.21.15.100:0/2234482591 conn(0x7f63c804fc50 msgr2=0x7f63c80340c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.385+0000 7f63d6f36640 1 -- 172.21.15.100:0/2234482591 shutdown_connections 2024-09-11T22:20:50.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.385+0000 7f63d6f36640 1 -- 172.21.15.100:0/2234482591 wait complete. 2024-09-11T22:20:50.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.7 2024-09-11T22:20:50.388 DEBUG:teuthology.parallel:result is None 2024-09-11T22:20:50.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.4 2024-09-11T22:20:50.397 DEBUG:teuthology.parallel:result is None 2024-09-11T22:20:50.397 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T22:20:50.397 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:20:50.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.535+0000 7f7fc814b640 1 Processor -- start 2024-09-11T22:20:50.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.535+0000 7f7fc814b640 1 -- start start 2024-09-11T22:20:50.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.536+0000 7f7fc814b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fc0154710 0x7f7fc00c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.536+0000 7f7fc814b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7fc006e140 0x7f7fc0067950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.536+0000 7f7fc814b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7fc0067e90 0x7f7fc015ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.536+0000 7f7fc814b640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f7fc006ced0 con 0x7f7fc0067e90 2024-09-11T22:20:50.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.536+0000 7f7fc814b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f7fc00c7f00 con 0x7f7fc006e140 2024-09-11T22:20:50.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.536+0000 7f7fc814b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc006d100 con 0x7f7fc0154710 2024-09-11T22:20:50.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.536+0000 7f7fc66e8640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7fc0067e90 0x7f7fc015ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.536+0000 7f7fc66e8640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7fc0067e90 0x7f7fc015ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47706/0 (socket says 172.21.15.100:47706) 2024-09-11T22:20:50.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.536+0000 7f7fc66e8640 1 -- 172.21.15.100:0/2584360760 learned_addr learned my addr 172.21.15.100:0/2584360760 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:50.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.536+0000 7f7fc5ee7640 1 --2- 172.21.15.100:0/2584360760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fc0154710 0x7f7fc00c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.537+0000 7f7fc66e8640 1 -- 172.21.15.100:0/2584360760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fc0154710 msgr2=0x7f7fc00c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:50.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.536+0000 7f7fc56e6640 1 --2- 172.21.15.100:0/2584360760 >> v2:172.21.15.167:3300/0 conn(0x7f7fc006e140 0x7f7fc0067950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.537+0000 7f7fc66e8640 1 --2- 172.21.15.100:0/2584360760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fc0154710 0x7f7fc00c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.537+0000 7f7fc66e8640 1 -- 172.21.15.100:0/2584360760 >> v2:172.21.15.167:3300/0 conn(0x7f7fc006e140 msgr2=0x7f7fc0067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:50.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.537+0000 7f7fc66e8640 1 --2- 172.21.15.100:0/2584360760 >> v2:172.21.15.167:3300/0 conn(0x7f7fc006e140 0x7f7fc0067950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.537+0000 7f7fc66e8640 1 -- 172.21.15.100:0/2584360760 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc006d3c0 con 0x7f7fc0067e90 2024-09-11T22:20:50.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.537+0000 7f7fc5ee7640 1 --2- 172.21.15.100:0/2584360760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fc0154710 0x7f7fc00c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:50.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.537+0000 7f7fc56e6640 1 --2- 172.21.15.100:0/2584360760 >> v2:172.21.15.167:3300/0 conn(0x7f7fc006e140 0x7f7fc0067950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:50.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.537+0000 7f7fc66e8640 1 --2- 172.21.15.100:0/2584360760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fc0067e90 0x7f7fc015ddf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0068840 tx=0x7f7fb002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a79869ef7304c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:50.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.537+0000 7f7fc4ee5640 1 -- 172.21.15.100:0/2584360760 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0036070 con 0x7f7fc0067e90 2024-09-11T22:20:50.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.537+0000 7f7fc4ee5640 1 -- 172.21.15.100:0/2584360760 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb0031600 con 0x7f7fc0067e90 2024-09-11T22:20:50.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.537+0000 7f7fc4ee5640 1 -- 172.21.15.100:0/2584360760 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb00319d0 con 0x7f7fc0067e90 2024-09-11T22:20:50.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.538+0000 7f7fc814b640 1 -- 172.21.15.100:0/2584360760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fc0067e90 msgr2=0x7f7fc015ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.538+0000 7f7fc814b640 1 --2- 172.21.15.100:0/2584360760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fc0067e90 0x7f7fc015ddf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0068840 tx=0x7f7fb002a730 comp rx=0 tx=0).stop 2024-09-11T22:20:50.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.538+0000 7f7fc814b640 1 -- 172.21.15.100:0/2584360760 shutdown_connections 2024-09-11T22:20:50.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.538+0000 7f7fc814b640 1 --2- 172.21.15.100:0/2584360760 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fc0067e90 0x7f7fc015ddf0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.538+0000 7f7fc814b640 1 --2- 172.21.15.100:0/2584360760 >> v2:172.21.15.167:3300/0 conn(0x7f7fc006e140 0x7f7fc0067950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.538+0000 7f7fc814b640 1 --2- 172.21.15.100:0/2584360760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fc0154710 0x7f7fc00c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.538+0000 7f7fc814b640 1 -- 172.21.15.100:0/2584360760 >> 172.21.15.100:0/2584360760 conn(0x7f7fc0070b80 msgr2=0x7f7fc00ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.538+0000 7f7fc814b640 1 -- 172.21.15.100:0/2584360760 shutdown_connections 2024-09-11T22:20:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.538+0000 7f7fc814b640 1 -- 172.21.15.100:0/2584360760 wait complete. 2024-09-11T22:20:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.539+0000 7f7fc814b640 1 Processor -- start 2024-09-11T22:20:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.539+0000 7f7fc814b640 1 -- start start 2024-09-11T22:20:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.540+0000 7f7fc814b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fc0067e90 0x7f7fc015b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.540+0000 7f7fc814b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fc006e140 0x7f7fc015d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.540+0000 7f7fc814b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fc0154710 0x7f7fc0157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.540+0000 7f7fc814b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc015b110 con 0x7f7fc006e140 2024-09-11T22:20:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.540+0000 7f7fc814b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc015ae30 con 0x7f7fc0154710 2024-09-11T22:20:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.540+0000 7f7fc814b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc015b3f0 con 0x7f7fc0067e90 2024-09-11T22:20:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.540+0000 7f7fc56e6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fc006e140 0x7f7fc015d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.540+0000 7f7fc56e6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fc006e140 0x7f7fc015d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47714/0 (socket says 172.21.15.100:47714) 2024-09-11T22:20:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.540+0000 7f7fc56e6640 1 -- 172.21.15.100:0/2993422784 learned_addr learned my addr 172.21.15.100:0/2993422784 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.540+0000 7f7fc66e8640 1 --2- 172.21.15.100:0/2993422784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fc0154710 0x7f7fc0157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.540+0000 7f7fc5ee7640 1 --2- 172.21.15.100:0/2993422784 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fc0067e90 0x7f7fc015b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.540+0000 7f7fc56e6640 1 -- 172.21.15.100:0/2993422784 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fc0067e90 msgr2=0x7f7fc015b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.540+0000 7f7fc56e6640 1 --2- 172.21.15.100:0/2993422784 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fc0067e90 0x7f7fc015b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.540+0000 7f7fc56e6640 1 -- 172.21.15.100:0/2993422784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fc0154710 msgr2=0x7f7fc0157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.540+0000 7f7fc56e6640 1 --2- 172.21.15.100:0/2993422784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fc0154710 0x7f7fc0157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.540+0000 7f7fc56e6640 1 -- 172.21.15.100:0/2993422784 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc01efd80 con 0x7f7fc006e140 2024-09-11T22:20:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.540+0000 7f7fc5ee7640 1 --2- 172.21.15.100:0/2993422784 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fc0067e90 0x7f7fc015b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.540+0000 7f7fc66e8640 1 --2- 172.21.15.100:0/2993422784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fc0154710 0x7f7fc0157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.540+0000 7f7fc56e6640 1 --2- 172.21.15.100:0/2993422784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fc006e140 0x7f7fc015d100 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7fb400c820 tx=0x7f7fb400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.541+0000 7f7fbe7fc640 1 -- 172.21.15.100:0/2993422784 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4004230 con 0x7f7fc006e140 2024-09-11T22:20:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.541+0000 7f7fbe7fc640 1 -- 172.21.15.100:0/2993422784 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb40043d0 con 0x7f7fc006e140 2024-09-11T22:20:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.541+0000 7f7fc814b640 1 -- 172.21.15.100:0/2993422784 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc00c6ad0 con 0x7f7fc006e140 2024-09-11T22:20:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.541+0000 7f7fbe7fc640 1 -- 172.21.15.100:0/2993422784 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4007a10 con 0x7f7fc006e140 2024-09-11T22:20:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.541+0000 7f7fc814b640 1 -- 172.21.15.100:0/2993422784 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc01f0320 con 0x7f7fc006e140 2024-09-11T22:20:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.541+0000 7f7fc814b640 1 -- 172.21.15.100:0/2993422784 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc015a800 con 0x7f7fc006e140 2024-09-11T22:20:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.542+0000 7f7fbe7fc640 1 -- 172.21.15.100:0/2993422784 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7fb4007bb0 con 0x7f7fc006e140 2024-09-11T22:20:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.543+0000 7f7fbe7fc640 1 --2- 172.21.15.100:0/2993422784 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7fac06be30 0x7f7fac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.543+0000 7f7fc5ee7640 1 --2- 172.21.15.100:0/2993422784 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7fac06be30 0x7f7fac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.543+0000 7f7fbe7fc640 1 -- 172.21.15.100:0/2993422784 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7fb408b230 con 0x7f7fc006e140 2024-09-11T22:20:50.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.543+0000 7f7fc5ee7640 1 --2- 172.21.15.100:0/2993422784 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7fac06be30 0x7f7fac06e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800a9b0 tx=0x7f7fb8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:50.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.547+0000 7f7fbe7fc640 1 -- 172.21.15.100:0/2993422784 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7fb4015020 con 0x7f7fc006e140 2024-09-11T22:20:50.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.708+0000 7f7fc814b640 1 -- 172.21.15.100:0/2993422784 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7fc0159220 con 0x7f7fac06be30 2024-09-11T22:20:50.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.715+0000 7f7fbe7fc640 1 -- 172.21.15.100:0/2993422784 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332714 (secure 0 0 0) 0x7f7fc0159220 con 0x7f7fac06be30 2024-09-11T22:20:50.721 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:50.723 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-11T22:20:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.718+0000 7f7fc814b640 1 -- 172.21.15.100:0/2993422784 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7fac06be30 msgr2=0x7f7fac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.718+0000 7f7fc814b640 1 --2- 172.21.15.100:0/2993422784 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7fac06be30 0x7f7fac06e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800a9b0 tx=0x7f7fb8008040 comp rx=0 tx=0).stop 2024-09-11T22:20:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.718+0000 7f7fc814b640 1 -- 172.21.15.100:0/2993422784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fc006e140 msgr2=0x7f7fc015d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.718+0000 7f7fc814b640 1 --2- 172.21.15.100:0/2993422784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fc006e140 0x7f7fc015d100 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7fb400c820 tx=0x7f7fb400cce0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.719+0000 7f7fc814b640 1 -- 172.21.15.100:0/2993422784 shutdown_connections 2024-09-11T22:20:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.719+0000 7f7fc814b640 1 --2- 172.21.15.100:0/2993422784 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7fac06be30 0x7f7fac06e2f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.719+0000 7f7fc814b640 1 --2- 172.21.15.100:0/2993422784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fc0154710 0x7f7fc0157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.719+0000 7f7fc814b640 1 --2- 172.21.15.100:0/2993422784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fc006e140 0x7f7fc015d100 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.719+0000 7f7fc814b640 1 --2- 172.21.15.100:0/2993422784 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fc0067e90 0x7f7fc015b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.719+0000 7f7fc814b640 1 -- 172.21.15.100:0/2993422784 >> 172.21.15.100:0/2993422784 conn(0x7f7fc0070b80 msgr2=0x7f7fc0159a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.719+0000 7f7fc814b640 1 -- 172.21.15.100:0/2993422784 shutdown_connections 2024-09-11T22:20:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.719+0000 7f7fc814b640 1 -- 172.21.15.100:0/2993422784 wait complete. 2024-09-11T22:20:50.730 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-09-11T22:20:50.311272+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595744,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":235,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":184,"ondisk_log_size":184,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218548,"kb_used_data":2340,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756172,"statfs":{"total":773094113280,"available":772870320128,"internally_reserved":0,"allocated":2396160,"data_stored":2050682,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":734,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003005"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048242+0000","last_change":"2024-09-11T22:20:18.853007+0000","last_active":"2024-09-11T22:20:27.048242+0000","last_peered":"2024-09-11T22:20:27.048242+0000","last_clean":"2024-09-11T22:20:27.048242+0000","last_became_active":"2024-09-11T22:20:18.852740+0000","last_became_peered":"2024-09-11T22:20:18.852740+0000","last_unstale":"2024-09-11T22:20:27.048242+0000","last_undegraded":"2024-09-11T22:20:27.048242+0000","last_fullsized":"2024-09-11T22:20:27.048242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:46.710328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887920+0000","last_change":"2024-09-11T22:20:19.849765+0000","last_active":"2024-09-11T22:20:24.887920+0000","last_peered":"2024-09-11T22:20:24.887920+0000","last_clean":"2024-09-11T22:20:24.887920+0000","last_became_active":"2024-09-11T22:20:19.848619+0000","last_became_peered":"2024-09-11T22:20:19.848619+0000","last_unstale":"2024-09-11T22:20:24.887920+0000","last_undegraded":"2024-09-11T22:20:24.887920+0000","last_fullsized":"2024-09-11T22:20:24.887920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:57.621624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887250+0000","last_change":"2024-09-11T22:20:24.078618+0000","last_active":"2024-09-11T22:20:24.887250+0000","last_peered":"2024-09-11T22:20:24.887250+0000","last_clean":"2024-09-11T22:20:24.887250+0000","last_became_active":"2024-09-11T22:20:24.078283+0000","last_became_peered":"2024-09-11T22:20:24.078283+0000","last_unstale":"2024-09-11T22:20:24.887250+0000","last_undegraded":"2024-09-11T22:20:24.887250+0000","last_fullsized":"2024-09-11T22:20:24.887250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:01.901307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888010+0000","last_change":"2024-09-11T22:20:18.855945+0000","last_active":"2024-09-11T22:20:24.888010+0000","last_peered":"2024-09-11T22:20:24.888010+0000","last_clean":"2024-09-11T22:20:24.888010+0000","last_became_active":"2024-09-11T22:20:18.854811+0000","last_became_peered":"2024-09-11T22:20:18.854811+0000","last_unstale":"2024-09-11T22:20:24.888010+0000","last_undegraded":"2024-09-11T22:20:24.888010+0000","last_fullsized":"2024-09-11T22:20:24.888010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:47.508920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048102+0000","last_change":"2024-09-11T22:20:19.862436+0000","last_active":"2024-09-11T22:20:27.048102+0000","last_peered":"2024-09-11T22:20:27.048102+0000","last_clean":"2024-09-11T22:20:27.048102+0000","last_became_active":"2024-09-11T22:20:19.862061+0000","last_became_peered":"2024-09-11T22:20:19.862061+0000","last_unstale":"2024-09-11T22:20:27.048102+0000","last_undegraded":"2024-09-11T22:20:27.048102+0000","last_fullsized":"2024-09-11T22:20:27.048102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047627+0000","last_change":"2024-09-11T22:20:23.879729+0000","last_active":"2024-09-11T22:20:27.047627+0000","last_peered":"2024-09-11T22:20:27.047627+0000","last_clean":"2024-09-11T22:20:27.047627+0000","last_became_active":"2024-09-11T22:20:23.879245+0000","last_became_peered":"2024-09-11T22:20:23.879245+0000","last_unstale":"2024-09-11T22:20:27.047627+0000","last_undegraded":"2024-09-11T22:20:27.047627+0000","last_fullsized":"2024-09-11T22:20:27.047627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:36.836842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048249+0000","last_change":"2024-09-11T22:20:18.853076+0000","last_active":"2024-09-11T22:20:27.048249+0000","last_peered":"2024-09-11T22:20:27.048249+0000","last_clean":"2024-09-11T22:20:27.048249+0000","last_became_active":"2024-09-11T22:20:18.852728+0000","last_became_peered":"2024-09-11T22:20:18.852728+0000","last_unstale":"2024-09-11T22:20:27.048249+0000","last_undegraded":"2024-09-11T22:20:27.048249+0000","last_fullsized":"2024-09-11T22:20:27.048249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890308+0000","last_change":"2024-09-11T22:20:19.864544+0000","last_active":"2024-09-11T22:20:24.890308+0000","last_peered":"2024-09-11T22:20:24.890308+0000","last_clean":"2024-09-11T22:20:24.890308+0000","last_became_active":"2024-09-11T22:20:19.864234+0000","last_became_peered":"2024-09-11T22:20:19.864234+0000","last_unstale":"2024-09-11T22:20:24.890308+0000","last_undegraded":"2024-09-11T22:20:24.890308+0000","last_fullsized":"2024-09-11T22:20:24.890308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048400+0000","last_change":"2024-09-11T22:20:23.873783+0000","last_active":"2024-09-11T22:20:27.048400+0000","last_peered":"2024-09-11T22:20:27.048400+0000","last_clean":"2024-09-11T22:20:27.048400+0000","last_became_active":"2024-09-11T22:20:23.873385+0000","last_became_peered":"2024-09-11T22:20:23.873385+0000","last_unstale":"2024-09-11T22:20:27.048400+0000","last_undegraded":"2024-09-11T22:20:27.048400+0000","last_fullsized":"2024-09-11T22:20:27.048400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048092+0000","last_change":"2024-09-11T22:20:18.861530+0000","last_active":"2024-09-11T22:20:27.048092+0000","last_peered":"2024-09-11T22:20:27.048092+0000","last_clean":"2024-09-11T22:20:27.048092+0000","last_became_active":"2024-09-11T22:20:18.861230+0000","last_became_peered":"2024-09-11T22:20:18.861230+0000","last_unstale":"2024-09-11T22:20:27.048092+0000","last_undegraded":"2024-09-11T22:20:27.048092+0000","last_fullsized":"2024-09-11T22:20:27.048092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890615+0000","last_change":"2024-09-11T22:20:19.863401+0000","last_active":"2024-09-11T22:20:24.890615+0000","last_peered":"2024-09-11T22:20:24.890615+0000","last_clean":"2024-09-11T22:20:24.890615+0000","last_became_active":"2024-09-11T22:20:19.863127+0000","last_became_peered":"2024-09-11T22:20:19.863127+0000","last_unstale":"2024-09-11T22:20:24.890615+0000","last_undegraded":"2024-09-11T22:20:24.890615+0000","last_fullsized":"2024-09-11T22:20:24.890615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:36.888544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048021+0000","last_change":"2024-09-11T22:20:23.874650+0000","last_active":"2024-09-11T22:20:27.048021+0000","last_peered":"2024-09-11T22:20:27.048021+0000","last_clean":"2024-09-11T22:20:27.048021+0000","last_became_active":"2024-09-11T22:20:23.874040+0000","last_became_peered":"2024-09-11T22:20:23.874040+0000","last_unstale":"2024-09-11T22:20:27.048021+0000","last_undegraded":"2024-09-11T22:20:27.048021+0000","last_fullsized":"2024-09-11T22:20:27.048021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888158+0000","last_change":"2024-09-11T22:20:19.859446+0000","last_active":"2024-09-11T22:20:24.888158+0000","last_peered":"2024-09-11T22:20:24.888158+0000","last_clean":"2024-09-11T22:20:24.888158+0000","last_became_active":"2024-09-11T22:20:19.859106+0000","last_became_peered":"2024-09-11T22:20:19.859106+0000","last_unstale":"2024-09-11T22:20:24.888158+0000","last_undegraded":"2024-09-11T22:20:24.888158+0000","last_fullsized":"2024-09-11T22:20:24.888158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.944022+0000","last_change":"2024-09-11T22:20:18.856475+0000","last_active":"2024-09-11T22:20:46.944022+0000","last_peered":"2024-09-11T22:20:46.944022+0000","last_clean":"2024-09-11T22:20:46.944022+0000","last_became_active":"2024-09-11T22:20:18.856165+0000","last_became_peered":"2024-09-11T22:20:18.856165+0000","last_unstale":"2024-09-11T22:20:46.944022+0000","last_undegraded":"2024-09-11T22:20:46.944022+0000","last_fullsized":"2024-09-11T22:20:46.944022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048102+0000","last_change":"2024-09-11T22:20:23.878121+0000","last_active":"2024-09-11T22:20:27.048102+0000","last_peered":"2024-09-11T22:20:27.048102+0000","last_clean":"2024-09-11T22:20:27.048102+0000","last_became_active":"2024-09-11T22:20:23.877713+0000","last_became_peered":"2024-09-11T22:20:23.877713+0000","last_unstale":"2024-09-11T22:20:27.048102+0000","last_undegraded":"2024-09-11T22:20:27.048102+0000","last_fullsized":"2024-09-11T22:20:27.048102+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887604+0000","last_change":"2024-09-11T22:20:19.858358+0000","last_active":"2024-09-11T22:20:24.887604+0000","last_peered":"2024-09-11T22:20:24.887604+0000","last_clean":"2024-09-11T22:20:24.887604+0000","last_became_active":"2024-09-11T22:20:19.858057+0000","last_became_peered":"2024-09-11T22:20:19.858057+0000","last_unstale":"2024-09-11T22:20:24.887604+0000","last_undegraded":"2024-09-11T22:20:24.887604+0000","last_fullsized":"2024-09-11T22:20:24.887604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:07.839926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998178+0000","last_change":"2024-09-11T22:20:18.853818+0000","last_active":"2024-09-11T22:20:24.998178+0000","last_peered":"2024-09-11T22:20:24.998178+0000","last_clean":"2024-09-11T22:20:24.998178+0000","last_became_active":"2024-09-11T22:20:18.853508+0000","last_became_peered":"2024-09-11T22:20:18.853508+0000","last_unstale":"2024-09-11T22:20:24.998178+0000","last_undegraded":"2024-09-11T22:20:24.998178+0000","last_fullsized":"2024-09-11T22:20:24.998178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:58.141587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047962+0000","last_change":"2024-09-11T22:20:23.879226+0000","last_active":"2024-09-11T22:20:27.047962+0000","last_peered":"2024-09-11T22:20:27.047962+0000","last_clean":"2024-09-11T22:20:27.047962+0000","last_became_active":"2024-09-11T22:20:23.878199+0000","last_became_peered":"2024-09-11T22:20:23.878199+0000","last_unstale":"2024-09-11T22:20:27.047962+0000","last_undegraded":"2024-09-11T22:20:27.047962+0000","last_fullsized":"2024-09-11T22:20:27.047962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:13.245927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887402+0000","last_change":"2024-09-11T22:20:19.844748+0000","last_active":"2024-09-11T22:20:24.887402+0000","last_peered":"2024-09-11T22:20:24.887402+0000","last_clean":"2024-09-11T22:20:24.887402+0000","last_became_active":"2024-09-11T22:20:19.844446+0000","last_became_peered":"2024-09-11T22:20:19.844446+0000","last_unstale":"2024-09-11T22:20:24.887402+0000","last_undegraded":"2024-09-11T22:20:24.887402+0000","last_fullsized":"2024-09-11T22:20:24.887402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:13.319918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997785+0000","last_change":"2024-09-11T22:20:18.847388+0000","last_active":"2024-09-11T22:20:24.997785+0000","last_peered":"2024-09-11T22:20:24.997785+0000","last_clean":"2024-09-11T22:20:24.997785+0000","last_became_active":"2024-09-11T22:20:18.847118+0000","last_became_peered":"2024-09-11T22:20:18.847118+0000","last_unstale":"2024-09-11T22:20:24.997785+0000","last_undegraded":"2024-09-11T22:20:24.997785+0000","last_fullsized":"2024-09-11T22:20:24.997785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:47.360920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998393+0000","last_change":"2024-09-11T22:20:24.077604+0000","last_active":"2024-09-11T22:20:24.998393+0000","last_peered":"2024-09-11T22:20:24.998393+0000","last_clean":"2024-09-11T22:20:24.998393+0000","last_became_active":"2024-09-11T22:20:24.077231+0000","last_became_peered":"2024-09-11T22:20:24.077231+0000","last_unstale":"2024-09-11T22:20:24.998393+0000","last_undegraded":"2024-09-11T22:20:24.998393+0000","last_fullsized":"2024-09-11T22:20:24.998393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:38.846688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048647+0000","last_change":"2024-09-11T22:20:19.854453+0000","last_active":"2024-09-11T22:20:27.048647+0000","last_peered":"2024-09-11T22:20:27.048647+0000","last_clean":"2024-09-11T22:20:27.048647+0000","last_became_active":"2024-09-11T22:20:19.854100+0000","last_became_peered":"2024-09-11T22:20:19.854100+0000","last_unstale":"2024-09-11T22:20:27.048647+0000","last_undegraded":"2024-09-11T22:20:27.048647+0000","last_fullsized":"2024-09-11T22:20:27.048647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:06.166813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.944339+0000","last_change":"2024-09-11T22:20:18.854889+0000","last_active":"2024-09-11T22:20:46.944339+0000","last_peered":"2024-09-11T22:20:46.944339+0000","last_clean":"2024-09-11T22:20:46.944339+0000","last_became_active":"2024-09-11T22:20:18.854552+0000","last_became_peered":"2024-09-11T22:20:18.854552+0000","last_unstale":"2024-09-11T22:20:46.944339+0000","last_undegraded":"2024-09-11T22:20:46.944339+0000","last_fullsized":"2024-09-11T22:20:46.944339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:33.612126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048443+0000","last_change":"2024-09-11T22:20:23.878932+0000","last_active":"2024-09-11T22:20:27.048443+0000","last_peered":"2024-09-11T22:20:27.048443+0000","last_clean":"2024-09-11T22:20:27.048443+0000","last_became_active":"2024-09-11T22:20:23.878305+0000","last_became_peered":"2024-09-11T22:20:23.878305+0000","last_unstale":"2024-09-11T22:20:27.048443+0000","last_undegraded":"2024-09-11T22:20:27.048443+0000","last_fullsized":"2024-09-11T22:20:27.048443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048250+0000","last_change":"2024-09-11T22:20:19.856318+0000","last_active":"2024-09-11T22:20:27.048250+0000","last_peered":"2024-09-11T22:20:27.048250+0000","last_clean":"2024-09-11T22:20:27.048250+0000","last_became_active":"2024-09-11T22:20:19.855992+0000","last_became_peered":"2024-09-11T22:20:19.855992+0000","last_unstale":"2024-09-11T22:20:27.048250+0000","last_undegraded":"2024-09-11T22:20:27.048250+0000","last_fullsized":"2024-09-11T22:20:27.048250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:57.709140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.944255+0000","last_change":"2024-09-11T22:20:18.850750+0000","last_active":"2024-09-11T22:20:46.944255+0000","last_peered":"2024-09-11T22:20:46.944255+0000","last_clean":"2024-09-11T22:20:46.944255+0000","last_became_active":"2024-09-11T22:20:18.849621+0000","last_became_peered":"2024-09-11T22:20:18.849621+0000","last_unstale":"2024-09-11T22:20:46.944255+0000","last_undegraded":"2024-09-11T22:20:46.944255+0000","last_fullsized":"2024-09-11T22:20:46.944255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047710+0000","last_change":"2024-09-11T22:20:24.077741+0000","last_active":"2024-09-11T22:20:27.047710+0000","last_peered":"2024-09-11T22:20:27.047710+0000","last_clean":"2024-09-11T22:20:27.047710+0000","last_became_active":"2024-09-11T22:20:24.077325+0000","last_became_peered":"2024-09-11T22:20:24.077325+0000","last_unstale":"2024-09-11T22:20:27.047710+0000","last_undegraded":"2024-09-11T22:20:27.047710+0000","last_fullsized":"2024-09-11T22:20:27.047710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:18.656529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888138+0000","last_change":"2024-09-11T22:20:19.850738+0000","last_active":"2024-09-11T22:20:24.888138+0000","last_peered":"2024-09-11T22:20:24.888138+0000","last_clean":"2024-09-11T22:20:24.888138+0000","last_became_active":"2024-09-11T22:20:19.850441+0000","last_became_peered":"2024-09-11T22:20:19.850441+0000","last_unstale":"2024-09-11T22:20:24.888138+0000","last_undegraded":"2024-09-11T22:20:24.888138+0000","last_fullsized":"2024-09-11T22:20:24.888138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:47.552343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998291+0000","last_change":"2024-09-11T22:20:18.845173+0000","last_active":"2024-09-11T22:20:24.998291+0000","last_peered":"2024-09-11T22:20:24.998291+0000","last_clean":"2024-09-11T22:20:24.998291+0000","last_became_active":"2024-09-11T22:20:18.844731+0000","last_became_peered":"2024-09-11T22:20:18.844731+0000","last_unstale":"2024-09-11T22:20:24.998291+0000","last_undegraded":"2024-09-11T22:20:24.998291+0000","last_fullsized":"2024-09-11T22:20:24.998291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:32.963285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887172+0000","last_change":"2024-09-11T22:20:24.078020+0000","last_active":"2024-09-11T22:20:24.887172+0000","last_peered":"2024-09-11T22:20:24.887172+0000","last_clean":"2024-09-11T22:20:24.887172+0000","last_became_active":"2024-09-11T22:20:24.077541+0000","last_became_peered":"2024-09-11T22:20:24.077541+0000","last_unstale":"2024-09-11T22:20:24.887172+0000","last_undegraded":"2024-09-11T22:20:24.887172+0000","last_fullsized":"2024-09-11T22:20:24.887172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:36.122714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998068+0000","last_change":"2024-09-11T22:20:19.845497+0000","last_active":"2024-09-11T22:20:24.998068+0000","last_peered":"2024-09-11T22:20:24.998068+0000","last_clean":"2024-09-11T22:20:24.998068+0000","last_became_active":"2024-09-11T22:20:19.845203+0000","last_became_peered":"2024-09-11T22:20:19.845203+0000","last_unstale":"2024-09-11T22:20:24.998068+0000","last_undegraded":"2024-09-11T22:20:24.998068+0000","last_fullsized":"2024-09-11T22:20:24.998068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:12.086231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048907+0000","last_change":"2024-09-11T22:20:18.856263+0000","last_active":"2024-09-11T22:20:27.048907+0000","last_peered":"2024-09-11T22:20:27.048907+0000","last_clean":"2024-09-11T22:20:27.048907+0000","last_became_active":"2024-09-11T22:20:18.855968+0000","last_became_peered":"2024-09-11T22:20:18.855968+0000","last_unstale":"2024-09-11T22:20:27.048907+0000","last_undegraded":"2024-09-11T22:20:27.048907+0000","last_fullsized":"2024-09-11T22:20:27.048907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047968+0000","last_change":"2024-09-11T22:20:24.075030+0000","last_active":"2024-09-11T22:20:27.047968+0000","last_peered":"2024-09-11T22:20:27.047968+0000","last_clean":"2024-09-11T22:20:27.047968+0000","last_became_active":"2024-09-11T22:20:24.074588+0000","last_became_peered":"2024-09-11T22:20:24.074588+0000","last_unstale":"2024-09-11T22:20:27.047968+0000","last_undegraded":"2024-09-11T22:20:27.047968+0000","last_fullsized":"2024-09-11T22:20:27.047968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890676+0000","last_change":"2024-09-11T22:20:19.859010+0000","last_active":"2024-09-11T22:20:24.890676+0000","last_peered":"2024-09-11T22:20:24.890676+0000","last_clean":"2024-09-11T22:20:24.890676+0000","last_became_active":"2024-09-11T22:20:19.858585+0000","last_became_peered":"2024-09-11T22:20:19.858585+0000","last_unstale":"2024-09-11T22:20:24.890676+0000","last_undegraded":"2024-09-11T22:20:24.890676+0000","last_fullsized":"2024-09-11T22:20:24.890676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998168+0000","last_change":"2024-09-11T22:20:18.847904+0000","last_active":"2024-09-11T22:20:24.998168+0000","last_peered":"2024-09-11T22:20:24.998168+0000","last_clean":"2024-09-11T22:20:24.998168+0000","last_became_active":"2024-09-11T22:20:18.847669+0000","last_became_peered":"2024-09-11T22:20:18.847669+0000","last_unstale":"2024-09-11T22:20:24.998168+0000","last_undegraded":"2024-09-11T22:20:24.998168+0000","last_fullsized":"2024-09-11T22:20:24.998168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:08.717999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997794+0000","last_change":"2024-09-11T22:20:23.881067+0000","last_active":"2024-09-11T22:20:24.997794+0000","last_peered":"2024-09-11T22:20:24.997794+0000","last_clean":"2024-09-11T22:20:24.997794+0000","last_became_active":"2024-09-11T22:20:23.880468+0000","last_became_peered":"2024-09-11T22:20:23.880468+0000","last_unstale":"2024-09-11T22:20:24.997794+0000","last_undegraded":"2024-09-11T22:20:24.997794+0000","last_fullsized":"2024-09-11T22:20:24.997794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:23.480547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048637+0000","last_change":"2024-09-11T22:20:19.860423+0000","last_active":"2024-09-11T22:20:27.048637+0000","last_peered":"2024-09-11T22:20:27.048637+0000","last_clean":"2024-09-11T22:20:27.048637+0000","last_became_active":"2024-09-11T22:20:19.858932+0000","last_became_peered":"2024-09-11T22:20:19.858932+0000","last_unstale":"2024-09-11T22:20:27.048637+0000","last_undegraded":"2024-09-11T22:20:27.048637+0000","last_fullsized":"2024-09-11T22:20:27.048637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:53.255932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889986+0000","last_change":"2024-09-11T22:20:18.854973+0000","last_active":"2024-09-11T22:20:24.889986+0000","last_peered":"2024-09-11T22:20:24.889986+0000","last_clean":"2024-09-11T22:20:24.889986+0000","last_became_active":"2024-09-11T22:20:18.854725+0000","last_became_peered":"2024-09-11T22:20:18.854725+0000","last_unstale":"2024-09-11T22:20:24.889986+0000","last_undegraded":"2024-09-11T22:20:24.889986+0000","last_fullsized":"2024-09-11T22:20:24.889986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998393+0000","last_change":"2024-09-11T22:20:23.880693+0000","last_active":"2024-09-11T22:20:24.998393+0000","last_peered":"2024-09-11T22:20:24.998393+0000","last_clean":"2024-09-11T22:20:24.998393+0000","last_became_active":"2024-09-11T22:20:23.880243+0000","last_became_peered":"2024-09-11T22:20:23.880243+0000","last_unstale":"2024-09-11T22:20:24.998393+0000","last_undegraded":"2024-09-11T22:20:24.998393+0000","last_fullsized":"2024-09-11T22:20:24.998393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.659287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997954+0000","last_change":"2024-09-11T22:20:19.844808+0000","last_active":"2024-09-11T22:20:24.997954+0000","last_peered":"2024-09-11T22:20:24.997954+0000","last_clean":"2024-09-11T22:20:24.997954+0000","last_became_active":"2024-09-11T22:20:19.844536+0000","last_became_peered":"2024-09-11T22:20:19.844536+0000","last_unstale":"2024-09-11T22:20:24.997954+0000","last_undegraded":"2024-09-11T22:20:24.997954+0000","last_fullsized":"2024-09-11T22:20:24.997954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:57.142383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951217+0000","last_change":"2024-09-11T22:20:18.855640+0000","last_active":"2024-09-11T22:20:26.951217+0000","last_peered":"2024-09-11T22:20:26.951217+0000","last_clean":"2024-09-11T22:20:26.951217+0000","last_became_active":"2024-09-11T22:20:18.855394+0000","last_became_peered":"2024-09-11T22:20:18.855394+0000","last_unstale":"2024-09-11T22:20:26.951217+0000","last_undegraded":"2024-09-11T22:20:26.951217+0000","last_fullsized":"2024-09-11T22:20:26.951217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998458+0000","last_change":"2024-09-11T22:20:23.882554+0000","last_active":"2024-09-11T22:20:24.998458+0000","last_peered":"2024-09-11T22:20:24.998458+0000","last_clean":"2024-09-11T22:20:24.998458+0000","last_became_active":"2024-09-11T22:20:23.881642+0000","last_became_peered":"2024-09-11T22:20:23.881642+0000","last_unstale":"2024-09-11T22:20:24.998458+0000","last_undegraded":"2024-09-11T22:20:24.998458+0000","last_fullsized":"2024-09-11T22:20:24.998458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:16.696043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047535+0000","last_change":"2024-09-11T22:20:19.859429+0000","last_active":"2024-09-11T22:20:27.047535+0000","last_peered":"2024-09-11T22:20:27.047535+0000","last_clean":"2024-09-11T22:20:27.047535+0000","last_became_active":"2024-09-11T22:20:19.859159+0000","last_became_peered":"2024-09-11T22:20:19.859159+0000","last_unstale":"2024-09-11T22:20:27.047535+0000","last_undegraded":"2024-09-11T22:20:27.047535+0000","last_fullsized":"2024-09-11T22:20:27.047535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:02.696450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047221+0000","last_change":"2024-09-11T22:20:18.856144+0000","last_active":"2024-09-11T22:20:27.047221+0000","last_peered":"2024-09-11T22:20:27.047221+0000","last_clean":"2024-09-11T22:20:27.047221+0000","last_became_active":"2024-09-11T22:20:18.855866+0000","last_became_peered":"2024-09-11T22:20:18.855866+0000","last_unstale":"2024-09-11T22:20:27.047221+0000","last_undegraded":"2024-09-11T22:20:27.047221+0000","last_fullsized":"2024-09-11T22:20:27.047221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:37.259393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048214+0000","last_change":"2024-09-11T22:20:24.075154+0000","last_active":"2024-09-11T22:20:27.048214+0000","last_peered":"2024-09-11T22:20:27.048214+0000","last_clean":"2024-09-11T22:20:27.048214+0000","last_became_active":"2024-09-11T22:20:24.074568+0000","last_became_peered":"2024-09-11T22:20:24.074568+0000","last_unstale":"2024-09-11T22:20:27.048214+0000","last_undegraded":"2024-09-11T22:20:27.048214+0000","last_fullsized":"2024-09-11T22:20:27.048214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:09.804991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887321+0000","last_change":"2024-09-11T22:20:19.861236+0000","last_active":"2024-09-11T22:20:24.887321+0000","last_peered":"2024-09-11T22:20:24.887321+0000","last_clean":"2024-09-11T22:20:24.887321+0000","last_became_active":"2024-09-11T22:20:19.860938+0000","last_became_peered":"2024-09-11T22:20:19.860938+0000","last_unstale":"2024-09-11T22:20:24.887321+0000","last_undegraded":"2024-09-11T22:20:24.887321+0000","last_fullsized":"2024-09-11T22:20:24.887321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:42.015334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.943429+0000","last_change":"2024-09-11T22:20:18.853467+0000","last_active":"2024-09-11T22:20:46.943429+0000","last_peered":"2024-09-11T22:20:46.943429+0000","last_clean":"2024-09-11T22:20:46.943429+0000","last_became_active":"2024-09-11T22:20:18.853182+0000","last_became_peered":"2024-09-11T22:20:18.853182+0000","last_unstale":"2024-09-11T22:20:46.943429+0000","last_undegraded":"2024-09-11T22:20:46.943429+0000","last_fullsized":"2024-09-11T22:20:46.943429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047625+0000","last_change":"2024-09-11T22:20:09.425648+0000","last_active":"2024-09-11T22:20:27.047625+0000","last_peered":"2024-09-11T22:20:27.047625+0000","last_clean":"2024-09-11T22:20:27.047625+0000","last_became_active":"2024-09-11T22:20:09.424591+0000","last_became_peered":"2024-09-11T22:20:09.424591+0000","last_unstale":"2024-09-11T22:20:27.047625+0000","last_undegraded":"2024-09-11T22:20:27.047625+0000","last_fullsized":"2024-09-11T22:20:27.047625+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_clean_scrub_stamp":"2024-09-11T22:20:08.334092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:53.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888536+0000","last_change":"2024-09-11T22:20:24.077007+0000","last_active":"2024-09-11T22:20:24.888536+0000","last_peered":"2024-09-11T22:20:24.888536+0000","last_clean":"2024-09-11T22:20:24.888536+0000","last_became_active":"2024-09-11T22:20:24.076601+0000","last_became_peered":"2024-09-11T22:20:24.076601+0000","last_unstale":"2024-09-11T22:20:24.888536+0000","last_undegraded":"2024-09-11T22:20:24.888536+0000","last_fullsized":"2024-09-11T22:20:24.888536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048600+0000","last_change":"2024-09-11T22:20:19.863279+0000","last_active":"2024-09-11T22:20:27.048600+0000","last_peered":"2024-09-11T22:20:27.048600+0000","last_clean":"2024-09-11T22:20:27.048600+0000","last_became_active":"2024-09-11T22:20:19.861322+0000","last_became_peered":"2024-09-11T22:20:19.861322+0000","last_unstale":"2024-09-11T22:20:27.048600+0000","last_undegraded":"2024-09-11T22:20:27.048600+0000","last_fullsized":"2024-09-11T22:20:27.048600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951240+0000","last_change":"2024-09-11T22:20:18.853343+0000","last_active":"2024-09-11T22:20:26.951240+0000","last_peered":"2024-09-11T22:20:26.951240+0000","last_clean":"2024-09-11T22:20:26.951240+0000","last_became_active":"2024-09-11T22:20:18.853069+0000","last_became_peered":"2024-09-11T22:20:18.853069+0000","last_unstale":"2024-09-11T22:20:26.951240+0000","last_undegraded":"2024-09-11T22:20:26.951240+0000","last_fullsized":"2024-09-11T22:20:26.951240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888655+0000","last_change":"2024-09-11T22:20:24.075350+0000","last_active":"2024-09-11T22:20:24.888655+0000","last_peered":"2024-09-11T22:20:24.888655+0000","last_clean":"2024-09-11T22:20:24.888655+0000","last_became_active":"2024-09-11T22:20:24.074789+0000","last_became_peered":"2024-09-11T22:20:24.074789+0000","last_unstale":"2024-09-11T22:20:24.888655+0000","last_undegraded":"2024-09-11T22:20:24.888655+0000","last_fullsized":"2024-09-11T22:20:24.888655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890400+0000","last_change":"2024-09-11T22:20:19.866331+0000","last_active":"2024-09-11T22:20:24.890400+0000","last_peered":"2024-09-11T22:20:24.890400+0000","last_clean":"2024-09-11T22:20:24.890400+0000","last_became_active":"2024-09-11T22:20:19.865535+0000","last_became_peered":"2024-09-11T22:20:19.865535+0000","last_unstale":"2024-09-11T22:20:24.890400+0000","last_undegraded":"2024-09-11T22:20:24.890400+0000","last_fullsized":"2024-09-11T22:20:24.890400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998164+0000","last_change":"2024-09-11T22:20:18.849434+0000","last_active":"2024-09-11T22:20:24.998164+0000","last_peered":"2024-09-11T22:20:24.998164+0000","last_clean":"2024-09-11T22:20:24.998164+0000","last_became_active":"2024-09-11T22:20:18.848787+0000","last_became_peered":"2024-09-11T22:20:18.848787+0000","last_unstale":"2024-09-11T22:20:24.998164+0000","last_undegraded":"2024-09-11T22:20:24.998164+0000","last_fullsized":"2024-09-11T22:20:24.998164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:25.689495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048087+0000","last_change":"2024-09-11T22:20:23.879962+0000","last_active":"2024-09-11T22:20:27.048087+0000","last_peered":"2024-09-11T22:20:27.048087+0000","last_clean":"2024-09-11T22:20:27.048087+0000","last_became_active":"2024-09-11T22:20:23.879586+0000","last_became_peered":"2024-09-11T22:20:23.879586+0000","last_unstale":"2024-09-11T22:20:27.048087+0000","last_undegraded":"2024-09-11T22:20:27.048087+0000","last_fullsized":"2024-09-11T22:20:27.048087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:27.323116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.049164+0000","last_change":"2024-09-11T22:20:19.860411+0000","last_active":"2024-09-11T22:20:27.049164+0000","last_peered":"2024-09-11T22:20:27.049164+0000","last_clean":"2024-09-11T22:20:27.049164+0000","last_became_active":"2024-09-11T22:20:19.860076+0000","last_became_peered":"2024-09-11T22:20:19.860076+0000","last_unstale":"2024-09-11T22:20:27.049164+0000","last_undegraded":"2024-09-11T22:20:27.049164+0000","last_fullsized":"2024-09-11T22:20:27.049164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951255+0000","last_change":"2024-09-11T22:20:18.856020+0000","last_active":"2024-09-11T22:20:26.951255+0000","last_peered":"2024-09-11T22:20:26.951255+0000","last_clean":"2024-09-11T22:20:26.951255+0000","last_became_active":"2024-09-11T22:20:18.855753+0000","last_became_peered":"2024-09-11T22:20:18.855753+0000","last_unstale":"2024-09-11T22:20:26.951255+0000","last_undegraded":"2024-09-11T22:20:26.951255+0000","last_fullsized":"2024-09-11T22:20:26.951255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888726+0000","last_change":"2024-09-11T22:20:24.077975+0000","last_active":"2024-09-11T22:20:24.888726+0000","last_peered":"2024-09-11T22:20:24.888726+0000","last_clean":"2024-09-11T22:20:24.888726+0000","last_became_active":"2024-09-11T22:20:24.077502+0000","last_became_peered":"2024-09-11T22:20:24.077502+0000","last_unstale":"2024-09-11T22:20:24.888726+0000","last_undegraded":"2024-09-11T22:20:24.888726+0000","last_fullsized":"2024-09-11T22:20:24.888726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:16.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047781+0000","last_change":"2024-09-11T22:20:19.856986+0000","last_active":"2024-09-11T22:20:27.047781+0000","last_peered":"2024-09-11T22:20:27.047781+0000","last_clean":"2024-09-11T22:20:27.047781+0000","last_became_active":"2024-09-11T22:20:19.856739+0000","last_became_peered":"2024-09-11T22:20:19.856739+0000","last_unstale":"2024-09-11T22:20:27.047781+0000","last_undegraded":"2024-09-11T22:20:27.047781+0000","last_fullsized":"2024-09-11T22:20:27.047781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048306+0000","last_change":"2024-09-11T22:20:18.855044+0000","last_active":"2024-09-11T22:20:27.048306+0000","last_peered":"2024-09-11T22:20:27.048306+0000","last_clean":"2024-09-11T22:20:27.048306+0000","last_became_active":"2024-09-11T22:20:18.854764+0000","last_became_peered":"2024-09-11T22:20:18.854764+0000","last_unstale":"2024-09-11T22:20:27.048306+0000","last_undegraded":"2024-09-11T22:20:27.048306+0000","last_fullsized":"2024-09-11T22:20:27.048306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:22.207278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047516+0000","last_change":"2024-09-11T22:20:23.878383+0000","last_active":"2024-09-11T22:20:27.047516+0000","last_peered":"2024-09-11T22:20:27.047516+0000","last_clean":"2024-09-11T22:20:27.047516+0000","last_became_active":"2024-09-11T22:20:23.877890+0000","last_became_peered":"2024-09-11T22:20:23.877890+0000","last_unstale":"2024-09-11T22:20:27.047516+0000","last_undegraded":"2024-09-11T22:20:27.047516+0000","last_fullsized":"2024-09-11T22:20:27.047516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:18.876485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048434+0000","last_change":"2024-09-11T22:20:19.861242+0000","last_active":"2024-09-11T22:20:27.048434+0000","last_peered":"2024-09-11T22:20:27.048434+0000","last_clean":"2024-09-11T22:20:27.048434+0000","last_became_active":"2024-09-11T22:20:19.860988+0000","last_became_peered":"2024-09-11T22:20:19.860988+0000","last_unstale":"2024-09-11T22:20:27.048434+0000","last_undegraded":"2024-09-11T22:20:27.048434+0000","last_fullsized":"2024-09-11T22:20:27.048434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951217+0000","last_change":"2024-09-11T22:20:18.852459+0000","last_active":"2024-09-11T22:20:26.951217+0000","last_peered":"2024-09-11T22:20:26.951217+0000","last_clean":"2024-09-11T22:20:26.951217+0000","last_became_active":"2024-09-11T22:20:18.852153+0000","last_became_peered":"2024-09-11T22:20:18.852153+0000","last_unstale":"2024-09-11T22:20:26.951217+0000","last_undegraded":"2024-09-11T22:20:26.951217+0000","last_fullsized":"2024-09-11T22:20:26.951217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048026+0000","last_change":"2024-09-11T22:20:23.874062+0000","last_active":"2024-09-11T22:20:27.048026+0000","last_peered":"2024-09-11T22:20:27.048026+0000","last_clean":"2024-09-11T22:20:27.048026+0000","last_became_active":"2024-09-11T22:20:23.873635+0000","last_became_peered":"2024-09-11T22:20:23.873635+0000","last_unstale":"2024-09-11T22:20:27.048026+0000","last_undegraded":"2024-09-11T22:20:27.048026+0000","last_fullsized":"2024-09-11T22:20:27.048026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:40.914142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888125+0000","last_change":"2024-09-11T22:20:19.851577+0000","last_active":"2024-09-11T22:20:24.888125+0000","last_peered":"2024-09-11T22:20:24.888125+0000","last_clean":"2024-09-11T22:20:24.888125+0000","last_became_active":"2024-09-11T22:20:19.851286+0000","last_became_peered":"2024-09-11T22:20:19.851286+0000","last_unstale":"2024-09-11T22:20:24.888125+0000","last_undegraded":"2024-09-11T22:20:24.888125+0000","last_fullsized":"2024-09-11T22:20:24.888125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:32.025931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888304+0000","last_change":"2024-09-11T22:20:18.853301+0000","last_active":"2024-09-11T22:20:24.888304+0000","last_peered":"2024-09-11T22:20:24.888304+0000","last_clean":"2024-09-11T22:20:24.888304+0000","last_became_active":"2024-09-11T22:20:18.852978+0000","last_became_peered":"2024-09-11T22:20:18.852978+0000","last_unstale":"2024-09-11T22:20:24.888304+0000","last_undegraded":"2024-09-11T22:20:24.888304+0000","last_fullsized":"2024-09-11T22:20:24.888304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888069+0000","last_change":"2024-09-11T22:20:24.077636+0000","last_active":"2024-09-11T22:20:24.888069+0000","last_peered":"2024-09-11T22:20:24.888069+0000","last_clean":"2024-09-11T22:20:24.888069+0000","last_became_active":"2024-09-11T22:20:24.077313+0000","last_became_peered":"2024-09-11T22:20:24.077313+0000","last_unstale":"2024-09-11T22:20:24.888069+0000","last_undegraded":"2024-09-11T22:20:24.888069+0000","last_fullsized":"2024-09-11T22:20:24.888069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:23.154027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048723+0000","last_change":"2024-09-11T22:20:19.862562+0000","last_active":"2024-09-11T22:20:27.048723+0000","last_peered":"2024-09-11T22:20:27.048723+0000","last_clean":"2024-09-11T22:20:27.048723+0000","last_became_active":"2024-09-11T22:20:19.862267+0000","last_became_peered":"2024-09-11T22:20:19.862267+0000","last_unstale":"2024-09-11T22:20:27.048723+0000","last_undegraded":"2024-09-11T22:20:27.048723+0000","last_fullsized":"2024-09-11T22:20:27.048723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.948867+0000","last_change":"2024-09-11T22:20:18.858002+0000","last_active":"2024-09-11T22:20:46.948867+0000","last_peered":"2024-09-11T22:20:46.948867+0000","last_clean":"2024-09-11T22:20:46.948867+0000","last_became_active":"2024-09-11T22:20:18.857419+0000","last_became_peered":"2024-09-11T22:20:18.857419+0000","last_unstale":"2024-09-11T22:20:46.948867+0000","last_undegraded":"2024-09-11T22:20:46.948867+0000","last_fullsized":"2024-09-11T22:20:46.948867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887723+0000","last_change":"2024-09-11T22:20:24.074971+0000","last_active":"2024-09-11T22:20:24.887723+0000","last_peered":"2024-09-11T22:20:24.887723+0000","last_clean":"2024-09-11T22:20:24.887723+0000","last_became_active":"2024-09-11T22:20:24.074609+0000","last_became_peered":"2024-09-11T22:20:24.074609+0000","last_unstale":"2024-09-11T22:20:24.887723+0000","last_undegraded":"2024-09-11T22:20:24.887723+0000","last_fullsized":"2024-09-11T22:20:24.887723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:55.318904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047865+0000","last_change":"2024-09-11T22:20:19.857276+0000","last_active":"2024-09-11T22:20:27.047865+0000","last_peered":"2024-09-11T22:20:27.047865+0000","last_clean":"2024-09-11T22:20:27.047865+0000","last_became_active":"2024-09-11T22:20:19.857027+0000","last_became_peered":"2024-09-11T22:20:19.857027+0000","last_unstale":"2024-09-11T22:20:27.047865+0000","last_undegraded":"2024-09-11T22:20:27.047865+0000","last_fullsized":"2024-09-11T22:20:27.047865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048222+0000","last_change":"2024-09-11T22:20:18.848671+0000","last_active":"2024-09-11T22:20:27.048222+0000","last_peered":"2024-09-11T22:20:27.048222+0000","last_clean":"2024-09-11T22:20:27.048222+0000","last_became_active":"2024-09-11T22:20:18.848405+0000","last_became_peered":"2024-09-11T22:20:18.848405+0000","last_unstale":"2024-09-11T22:20:27.048222+0000","last_undegraded":"2024-09-11T22:20:27.048222+0000","last_fullsized":"2024-09-11T22:20:27.048222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890660+0000","last_change":"2024-09-11T22:20:24.076835+0000","last_active":"2024-09-11T22:20:24.890660+0000","last_peered":"2024-09-11T22:20:24.890660+0000","last_clean":"2024-09-11T22:20:24.890660+0000","last_became_active":"2024-09-11T22:20:24.076200+0000","last_became_peered":"2024-09-11T22:20:24.076200+0000","last_unstale":"2024-09-11T22:20:24.890660+0000","last_undegraded":"2024-09-11T22:20:24.890660+0000","last_fullsized":"2024-09-11T22:20:24.890660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:48.150778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048503+0000","last_change":"2024-09-11T22:20:19.855334+0000","last_active":"2024-09-11T22:20:27.048503+0000","last_peered":"2024-09-11T22:20:27.048503+0000","last_clean":"2024-09-11T22:20:27.048503+0000","last_became_active":"2024-09-11T22:20:19.855018+0000","last_became_peered":"2024-09-11T22:20:19.855018+0000","last_unstale":"2024-09-11T22:20:27.048503+0000","last_undegraded":"2024-09-11T22:20:27.048503+0000","last_fullsized":"2024-09-11T22:20:27.048503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'11","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.946283+0000","last_change":"2024-09-11T22:20:18.855665+0000","last_active":"2024-09-11T22:20:46.946283+0000","last_peered":"2024-09-11T22:20:46.946283+0000","last_clean":"2024-09-11T22:20:46.946283+0000","last_became_active":"2024-09-11T22:20:18.855386+0000","last_became_peered":"2024-09-11T22:20:18.855386+0000","last_unstale":"2024-09-11T22:20:46.946283+0000","last_undegraded":"2024-09-11T22:20:46.946283+0000","last_fullsized":"2024-09-11T22:20:46.946283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998100+0000","last_change":"2024-09-11T22:20:23.880793+0000","last_active":"2024-09-11T22:20:24.998100+0000","last_peered":"2024-09-11T22:20:24.998100+0000","last_clean":"2024-09-11T22:20:24.998100+0000","last_became_active":"2024-09-11T22:20:23.879993+0000","last_became_peered":"2024-09-11T22:20:23.879993+0000","last_unstale":"2024-09-11T22:20:24.998100+0000","last_undegraded":"2024-09-11T22:20:24.998100+0000","last_fullsized":"2024-09-11T22:20:24.998100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:50.449090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048075+0000","last_change":"2024-09-11T22:20:19.858588+0000","last_active":"2024-09-11T22:20:27.048075+0000","last_peered":"2024-09-11T22:20:27.048075+0000","last_clean":"2024-09-11T22:20:27.048075+0000","last_became_active":"2024-09-11T22:20:19.858322+0000","last_became_peered":"2024-09-11T22:20:19.858322+0000","last_unstale":"2024-09-11T22:20:27.048075+0000","last_undegraded":"2024-09-11T22:20:27.048075+0000","last_fullsized":"2024-09-11T22:20:27.048075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998071+0000","last_change":"2024-09-11T22:20:18.855056+0000","last_active":"2024-09-11T22:20:24.998071+0000","last_peered":"2024-09-11T22:20:24.998071+0000","last_clean":"2024-09-11T22:20:24.998071+0000","last_became_active":"2024-09-11T22:20:18.854784+0000","last_became_peered":"2024-09-11T22:20:18.854784+0000","last_unstale":"2024-09-11T22:20:24.998071+0000","last_undegraded":"2024-09-11T22:20:24.998071+0000","last_fullsized":"2024-09-11T22:20:24.998071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:38.916121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048044+0000","last_change":"2024-09-11T22:20:23.879768+0000","last_active":"2024-09-11T22:20:27.048044+0000","last_peered":"2024-09-11T22:20:27.048044+0000","last_clean":"2024-09-11T22:20:27.048044+0000","last_became_active":"2024-09-11T22:20:23.878794+0000","last_became_peered":"2024-09-11T22:20:23.878794+0000","last_unstale":"2024-09-11T22:20:27.048044+0000","last_undegraded":"2024-09-11T22:20:27.048044+0000","last_fullsized":"2024-09-11T22:20:27.048044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:07.301587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048230+0000","last_change":"2024-09-11T22:20:19.862315+0000","last_active":"2024-09-11T22:20:27.048230+0000","last_peered":"2024-09-11T22:20:27.048230+0000","last_clean":"2024-09-11T22:20:27.048230+0000","last_became_active":"2024-09-11T22:20:19.861607+0000","last_became_peered":"2024-09-11T22:20:19.861607+0000","last_unstale":"2024-09-11T22:20:27.048230+0000","last_undegraded":"2024-09-11T22:20:27.048230+0000","last_fullsized":"2024-09-11T22:20:27.048230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.946689+0000","last_change":"2024-09-11T22:20:18.853382+0000","last_active":"2024-09-11T22:20:46.946689+0000","last_peered":"2024-09-11T22:20:46.946689+0000","last_clean":"2024-09-11T22:20:46.946689+0000","last_became_active":"2024-09-11T22:20:18.853103+0000","last_became_peered":"2024-09-11T22:20:18.853103+0000","last_unstale":"2024-09-11T22:20:46.946689+0000","last_undegraded":"2024-09-11T22:20:46.946689+0000","last_fullsized":"2024-09-11T22:20:46.946689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887490+0000","last_change":"2024-09-11T22:20:23.876997+0000","last_active":"2024-09-11T22:20:24.887490+0000","last_peered":"2024-09-11T22:20:24.887490+0000","last_clean":"2024-09-11T22:20:24.887490+0000","last_became_active":"2024-09-11T22:20:23.876587+0000","last_became_peered":"2024-09-11T22:20:23.876587+0000","last_unstale":"2024-09-11T22:20:24.887490+0000","last_undegraded":"2024-09-11T22:20:24.887490+0000","last_fullsized":"2024-09-11T22:20:24.887490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:19.670665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889342+0000","last_change":"2024-09-11T22:20:19.866624+0000","last_active":"2024-09-11T22:20:24.889342+0000","last_peered":"2024-09-11T22:20:24.889342+0000","last_clean":"2024-09-11T22:20:24.889342+0000","last_became_active":"2024-09-11T22:20:19.866303+0000","last_became_peered":"2024-09-11T22:20:19.866303+0000","last_unstale":"2024-09-11T22:20:24.889342+0000","last_undegraded":"2024-09-11T22:20:24.889342+0000","last_fullsized":"2024-09-11T22:20:24.889342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.946175+0000","last_change":"2024-09-11T22:20:18.854361+0000","last_active":"2024-09-11T22:20:46.946175+0000","last_peered":"2024-09-11T22:20:46.946175+0000","last_clean":"2024-09-11T22:20:46.946175+0000","last_became_active":"2024-09-11T22:20:18.854019+0000","last_became_peered":"2024-09-11T22:20:18.854019+0000","last_unstale":"2024-09-11T22:20:46.946175+0000","last_undegraded":"2024-09-11T22:20:46.946175+0000","last_fullsized":"2024-09-11T22:20:46.946175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887284+0000","last_change":"2024-09-11T22:20:24.077476+0000","last_active":"2024-09-11T22:20:24.887284+0000","last_peered":"2024-09-11T22:20:24.887284+0000","last_clean":"2024-09-11T22:20:24.887284+0000","last_became_active":"2024-09-11T22:20:24.077134+0000","last_became_peered":"2024-09-11T22:20:24.077134+0000","last_unstale":"2024-09-11T22:20:24.887284+0000","last_undegraded":"2024-09-11T22:20:24.887284+0000","last_fullsized":"2024-09-11T22:20:24.887284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:03.186460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048035+0000","last_change":"2024-09-11T22:20:24.077143+0000","last_active":"2024-09-11T22:20:27.048035+0000","last_peered":"2024-09-11T22:20:27.048035+0000","last_clean":"2024-09-11T22:20:27.048035+0000","last_became_active":"2024-09-11T22:20:24.076592+0000","last_became_peered":"2024-09-11T22:20:24.076592+0000","last_unstale":"2024-09-11T22:20:27.048035+0000","last_undegraded":"2024-09-11T22:20:27.048035+0000","last_fullsized":"2024-09-11T22:20:27.048035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:02.661077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997676+0000","last_change":"2024-09-11T22:20:19.845776+0000","last_active":"2024-09-11T22:20:24.997676+0000","last_peered":"2024-09-11T22:20:24.997676+0000","last_clean":"2024-09-11T22:20:24.997676+0000","last_became_active":"2024-09-11T22:20:19.845425+0000","last_became_peered":"2024-09-11T22:20:19.845425+0000","last_unstale":"2024-09-11T22:20:24.997676+0000","last_undegraded":"2024-09-11T22:20:24.997676+0000","last_fullsized":"2024-09-11T22:20:24.997676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:07.187533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889087+0000","last_change":"2024-09-11T22:20:18.852446+0000","last_active":"2024-09-11T22:20:24.889087+0000","last_peered":"2024-09-11T22:20:24.889087+0000","last_clean":"2024-09-11T22:20:24.889087+0000","last_became_active":"2024-09-11T22:20:18.852155+0000","last_became_peered":"2024-09-11T22:20:18.852155+0000","last_unstale":"2024-09-11T22:20:24.889087+0000","last_undegraded":"2024-09-11T22:20:24.889087+0000","last_fullsized":"2024-09-11T22:20:24.889087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889233+0000","last_change":"2024-09-11T22:20:23.876503+0000","last_active":"2024-09-11T22:20:24.889233+0000","last_peered":"2024-09-11T22:20:24.889233+0000","last_clean":"2024-09-11T22:20:24.889233+0000","last_became_active":"2024-09-11T22:20:23.876100+0000","last_became_peered":"2024-09-11T22:20:23.876100+0000","last_unstale":"2024-09-11T22:20:24.889233+0000","last_undegraded":"2024-09-11T22:20:24.889233+0000","last_fullsized":"2024-09-11T22:20:24.889233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887311+0000","last_change":"2024-09-11T22:20:19.852606+0000","last_active":"2024-09-11T22:20:24.887311+0000","last_peered":"2024-09-11T22:20:24.887311+0000","last_clean":"2024-09-11T22:20:24.887311+0000","last_became_active":"2024-09-11T22:20:19.852333+0000","last_became_peered":"2024-09-11T22:20:19.852333+0000","last_unstale":"2024-09-11T22:20:24.887311+0000","last_undegraded":"2024-09-11T22:20:24.887311+0000","last_fullsized":"2024-09-11T22:20:24.887311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:56.940278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887444+0000","last_change":"2024-09-11T22:20:18.853767+0000","last_active":"2024-09-11T22:20:24.887444+0000","last_peered":"2024-09-11T22:20:24.887444+0000","last_clean":"2024-09-11T22:20:24.887444+0000","last_became_active":"2024-09-11T22:20:18.853533+0000","last_became_peered":"2024-09-11T22:20:18.853533+0000","last_unstale":"2024-09-11T22:20:24.887444+0000","last_undegraded":"2024-09-11T22:20:24.887444+0000","last_fullsized":"2024-09-11T22:20:24.887444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:36.662271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888381+0000","last_change":"2024-09-11T22:20:18.847133+0000","last_active":"2024-09-11T22:20:24.888381+0000","last_peered":"2024-09-11T22:20:24.888381+0000","last_clean":"2024-09-11T22:20:24.888381+0000","last_became_active":"2024-09-11T22:20:18.846321+0000","last_became_peered":"2024-09-11T22:20:18.846321+0000","last_unstale":"2024-09-11T22:20:24.888381+0000","last_undegraded":"2024-09-11T22:20:24.888381+0000","last_fullsized":"2024-09-11T22:20:24.888381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048164+0000","last_change":"2024-09-11T22:20:19.861445+0000","last_active":"2024-09-11T22:20:27.048164+0000","last_peered":"2024-09-11T22:20:27.048164+0000","last_clean":"2024-09-11T22:20:27.048164+0000","last_became_active":"2024-09-11T22:20:19.861154+0000","last_became_peered":"2024-09-11T22:20:19.861154+0000","last_unstale":"2024-09-11T22:20:27.048164+0000","last_undegraded":"2024-09-11T22:20:27.048164+0000","last_fullsized":"2024-09-11T22:20:27.048164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951525+0000","last_change":"2024-09-11T22:20:23.877973+0000","last_active":"2024-09-11T22:20:26.951525+0000","last_peered":"2024-09-11T22:20:26.951525+0000","last_clean":"2024-09-11T22:20:26.951525+0000","last_became_active":"2024-09-11T22:20:23.877578+0000","last_became_peered":"2024-09-11T22:20:23.877578+0000","last_unstale":"2024-09-11T22:20:26.951525+0000","last_undegraded":"2024-09-11T22:20:26.951525+0000","last_fullsized":"2024-09-11T22:20:26.951525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:27.826669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.948565+0000","last_change":"2024-09-11T22:20:18.854142+0000","last_active":"2024-09-11T22:20:46.948565+0000","last_peered":"2024-09-11T22:20:46.948565+0000","last_clean":"2024-09-11T22:20:46.948565+0000","last_became_active":"2024-09-11T22:20:18.853872+0000","last_became_peered":"2024-09-11T22:20:18.853872+0000","last_unstale":"2024-09-11T22:20:46.948565+0000","last_undegraded":"2024-09-11T22:20:46.948565+0000","last_fullsized":"2024-09-11T22:20:46.948565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:22.513242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047903+0000","last_change":"2024-09-11T22:20:19.852580+0000","last_active":"2024-09-11T22:20:27.047903+0000","last_peered":"2024-09-11T22:20:27.047903+0000","last_clean":"2024-09-11T22:20:27.047903+0000","last_became_active":"2024-09-11T22:20:19.850175+0000","last_became_peered":"2024-09-11T22:20:19.850175+0000","last_unstale":"2024-09-11T22:20:27.047903+0000","last_undegraded":"2024-09-11T22:20:27.047903+0000","last_fullsized":"2024-09-11T22:20:27.047903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:11.937256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887822+0000","last_change":"2024-09-11T22:20:23.878004+0000","last_active":"2024-09-11T22:20:24.887822+0000","last_peered":"2024-09-11T22:20:24.887822+0000","last_clean":"2024-09-11T22:20:24.887822+0000","last_became_active":"2024-09-11T22:20:23.876776+0000","last_became_peered":"2024-09-11T22:20:23.876776+0000","last_unstale":"2024-09-11T22:20:24.887822+0000","last_undegraded":"2024-09-11T22:20:24.887822+0000","last_fullsized":"2024-09-11T22:20:24.887822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:11.254248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887933+0000","last_change":"2024-09-11T22:20:19.853439+0000","last_active":"2024-09-11T22:20:24.887933+0000","last_peered":"2024-09-11T22:20:24.887933+0000","last_clean":"2024-09-11T22:20:24.887933+0000","last_became_active":"2024-09-11T22:20:19.852937+0000","last_became_peered":"2024-09-11T22:20:19.852937+0000","last_unstale":"2024-09-11T22:20:24.887933+0000","last_undegraded":"2024-09-11T22:20:24.887933+0000","last_fullsized":"2024-09-11T22:20:24.887933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951404+0000","last_change":"2024-09-11T22:20:19.861003+0000","last_active":"2024-09-11T22:20:26.951404+0000","last_peered":"2024-09-11T22:20:26.951404+0000","last_clean":"2024-09-11T22:20:26.951404+0000","last_became_active":"2024-09-11T22:20:19.860690+0000","last_became_peered":"2024-09-11T22:20:19.860690+0000","last_unstale":"2024-09-11T22:20:26.951404+0000","last_undegraded":"2024-09-11T22:20:26.951404+0000","last_fullsized":"2024-09-11T22:20:26.951404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889798+0000","last_change":"2024-09-11T22:20:19.856756+0000","last_active":"2024-09-11T22:20:24.889798+0000","last_peered":"2024-09-11T22:20:24.889798+0000","last_clean":"2024-09-11T22:20:24.889798+0000","last_became_active":"2024-09-11T22:20:19.856460+0000","last_became_peered":"2024-09-11T22:20:19.856460+0000","last_unstale":"2024-09-11T22:20:24.889798+0000","last_undegraded":"2024-09-11T22:20:24.889798+0000","last_fullsized":"2024-09-11T22:20:24.889798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048092+0000","last_change":"2024-09-11T22:20:19.855629+0000","last_active":"2024-09-11T22:20:27.048092+0000","last_peered":"2024-09-11T22:20:27.048092+0000","last_clean":"2024-09-11T22:20:27.048092+0000","last_became_active":"2024-09-11T22:20:19.855363+0000","last_became_peered":"2024-09-11T22:20:19.855363+0000","last_unstale":"2024-09-11T22:20:27.048092+0000","last_undegraded":"2024-09-11T22:20:27.048092+0000","last_fullsized":"2024-09-11T22:20:27.048092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887872+0000","last_change":"2024-09-11T22:20:19.863122+0000","last_active":"2024-09-11T22:20:24.887872+0000","last_peered":"2024-09-11T22:20:24.887872+0000","last_clean":"2024-09-11T22:20:24.887872+0000","last_became_active":"2024-09-11T22:20:19.862828+0000","last_became_peered":"2024-09-11T22:20:19.862828+0000","last_unstale":"2024-09-11T22:20:24.887872+0000","last_undegraded":"2024-09-11T22:20:24.887872+0000","last_fullsized":"2024-09-11T22:20:24.887872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:10.868762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997865+0000","last_change":"2024-09-11T22:20:19.846453+0000","last_active":"2024-09-11T22:20:24.997865+0000","last_peered":"2024-09-11T22:20:24.997865+0000","last_clean":"2024-09-11T22:20:24.997865+0000","last_became_active":"2024-09-11T22:20:19.846186+0000","last_became_peered":"2024-09-11T22:20:19.846186+0000","last_unstale":"2024-09-11T22:20:24.997865+0000","last_undegraded":"2024-09-11T22:20:24.997865+0000","last_fullsized":"2024-09-11T22:20:24.997865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:24.032365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888935+0000","last_change":"2024-09-11T22:20:19.860632+0000","last_active":"2024-09-11T22:20:24.888935+0000","last_peered":"2024-09-11T22:20:24.888935+0000","last_clean":"2024-09-11T22:20:24.888935+0000","last_became_active":"2024-09-11T22:20:19.860005+0000","last_became_peered":"2024-09-11T22:20:19.860005+0000","last_unstale":"2024-09-11T22:20:24.888935+0000","last_undegraded":"2024-09-11T22:20:24.888935+0000","last_fullsized":"2024-09-11T22:20:24.888935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888034+0000","last_change":"2024-09-11T22:20:19.859195+0000","last_active":"2024-09-11T22:20:24.888034+0000","last_peered":"2024-09-11T22:20:24.888034+0000","last_clean":"2024-09-11T22:20:24.888034+0000","last_became_active":"2024-09-11T22:20:19.858832+0000","last_became_peered":"2024-09-11T22:20:19.858832+0000","last_unstale":"2024-09-11T22:20:24.888034+0000","last_undegraded":"2024-09-11T22:20:24.888034+0000","last_fullsized":"2024-09-11T22:20:24.888034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:56.259074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888950+0000","last_change":"2024-09-11T22:20:19.858969+0000","last_active":"2024-09-11T22:20:24.888950+0000","last_peered":"2024-09-11T22:20:24.888950+0000","last_clean":"2024-09-11T22:20:24.888950+0000","last_became_active":"2024-09-11T22:20:19.857847+0000","last_became_peered":"2024-09-11T22:20:19.857847+0000","last_unstale":"2024-09-11T22:20:24.888950+0000","last_undegraded":"2024-09-11T22:20:24.888950+0000","last_fullsized":"2024-09-11T22:20:24.888950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887453+0000","last_change":"2024-09-11T22:20:19.863294+0000","last_active":"2024-09-11T22:20:24.887453+0000","last_peered":"2024-09-11T22:20:24.887453+0000","last_clean":"2024-09-11T22:20:24.887453+0000","last_became_active":"2024-09-11T22:20:19.863007+0000","last_became_peered":"2024-09-11T22:20:19.863007+0000","last_unstale":"2024-09-11T22:20:24.887453+0000","last_undegraded":"2024-09-11T22:20:24.887453+0000","last_fullsized":"2024-09-11T22:20:24.887453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:06.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889706+0000","last_change":"2024-09-11T22:20:19.858414+0000","last_active":"2024-09-11T22:20:24.889706+0000","last_peered":"2024-09-11T22:20:24.889706+0000","last_clean":"2024-09-11T22:20:24.889706+0000","last_became_active":"2024-09-11T22:20:19.857790+0000","last_became_peered":"2024-09-11T22:20:19.857790+0000","last_unstale":"2024-09-11T22:20:24.889706+0000","last_undegraded":"2024-09-11T22:20:24.889706+0000","last_fullsized":"2024-09-11T22:20:24.889706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047879+0000","last_change":"2024-09-11T22:20:19.855053+0000","last_active":"2024-09-11T22:20:27.047879+0000","last_peered":"2024-09-11T22:20:27.047879+0000","last_clean":"2024-09-11T22:20:27.047879+0000","last_became_active":"2024-09-11T22:20:19.854774+0000","last_became_peered":"2024-09-11T22:20:19.854774+0000","last_unstale":"2024-09-11T22:20:27.047879+0000","last_undegraded":"2024-09-11T22:20:27.047879+0000","last_fullsized":"2024-09-11T22:20:27.047879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:32.025931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888845+0000","last_change":"2024-09-11T22:20:19.864700+0000","last_active":"2024-09-11T22:20:24.888845+0000","last_peered":"2024-09-11T22:20:24.888845+0000","last_clean":"2024-09-11T22:20:24.888845+0000","last_became_active":"2024-09-11T22:20:19.862296+0000","last_became_peered":"2024-09-11T22:20:19.862296+0000","last_unstale":"2024-09-11T22:20:24.888845+0000","last_undegraded":"2024-09-11T22:20:24.888845+0000","last_fullsized":"2024-09-11T22:20:24.888845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048773+0000","last_change":"2024-09-11T22:20:19.855253+0000","last_active":"2024-09-11T22:20:27.048773+0000","last_peered":"2024-09-11T22:20:27.048773+0000","last_clean":"2024-09-11T22:20:27.048773+0000","last_became_active":"2024-09-11T22:20:19.854970+0000","last_became_peered":"2024-09-11T22:20:19.854970+0000","last_unstale":"2024-09-11T22:20:27.048773+0000","last_undegraded":"2024-09-11T22:20:27.048773+0000","last_fullsized":"2024-09-11T22:20:27.048773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951690+0000","last_change":"2024-09-11T22:20:19.850202+0000","last_active":"2024-09-11T22:20:26.951690+0000","last_peered":"2024-09-11T22:20:26.951690+0000","last_clean":"2024-09-11T22:20:26.951690+0000","last_became_active":"2024-09-11T22:20:19.849815+0000","last_became_peered":"2024-09-11T22:20:19.849815+0000","last_unstale":"2024-09-11T22:20:26.951690+0000","last_undegraded":"2024-09-11T22:20:26.951690+0000","last_fullsized":"2024-09-11T22:20:26.951690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:56.480679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889814+0000","last_change":"2024-09-11T22:20:19.866864+0000","last_active":"2024-09-11T22:20:24.889814+0000","last_peered":"2024-09-11T22:20:24.889814+0000","last_clean":"2024-09-11T22:20:24.889814+0000","last_became_active":"2024-09-11T22:20:19.866484+0000","last_became_peered":"2024-09-11T22:20:19.866484+0000","last_unstale":"2024-09-11T22:20:24.889814+0000","last_undegraded":"2024-09-11T22:20:24.889814+0000","last_fullsized":"2024-09-11T22:20:24.889814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888850+0000","last_change":"2024-09-11T22:20:19.859573+0000","last_active":"2024-09-11T22:20:24.888850+0000","last_peered":"2024-09-11T22:20:24.888850+0000","last_clean":"2024-09-11T22:20:24.888850+0000","last_became_active":"2024-09-11T22:20:19.859266+0000","last_became_peered":"2024-09-11T22:20:19.859266+0000","last_unstale":"2024-09-11T22:20:24.888850+0000","last_undegraded":"2024-09-11T22:20:24.888850+0000","last_fullsized":"2024-09-11T22:20:24.888850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997750+0000","last_change":"2024-09-11T22:20:19.860050+0000","last_active":"2024-09-11T22:20:24.997750+0000","last_peered":"2024-09-11T22:20:24.997750+0000","last_clean":"2024-09-11T22:20:24.997750+0000","last_became_active":"2024-09-11T22:20:19.859755+0000","last_became_peered":"2024-09-11T22:20:19.859755+0000","last_unstale":"2024-09-11T22:20:24.997750+0000","last_undegraded":"2024-09-11T22:20:24.997750+0000","last_fullsized":"2024-09-11T22:20:24.997750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:42.487669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047797+0000","last_change":"2024-09-11T22:20:19.853902+0000","last_active":"2024-09-11T22:20:27.047797+0000","last_peered":"2024-09-11T22:20:27.047797+0000","last_clean":"2024-09-11T22:20:27.047797+0000","last_became_active":"2024-09-11T22:20:19.853563+0000","last_became_peered":"2024-09-11T22:20:19.853563+0000","last_unstale":"2024-09-11T22:20:27.047797+0000","last_undegraded":"2024-09-11T22:20:27.047797+0000","last_fullsized":"2024-09-11T22:20:27.047797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887571+0000","last_change":"2024-09-11T22:20:19.849490+0000","last_active":"2024-09-11T22:20:24.887571+0000","last_peered":"2024-09-11T22:20:24.887571+0000","last_clean":"2024-09-11T22:20:24.887571+0000","last_became_active":"2024-09-11T22:20:19.848965+0000","last_became_peered":"2024-09-11T22:20:19.848965+0000","last_unstale":"2024-09-11T22:20:24.887571+0000","last_undegraded":"2024-09-11T22:20:24.887571+0000","last_fullsized":"2024-09-11T22:20:24.887571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:10.387663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048041+0000","last_change":"2024-09-11T22:20:19.860457+0000","last_active":"2024-09-11T22:20:27.048041+0000","last_peered":"2024-09-11T22:20:27.048041+0000","last_clean":"2024-09-11T22:20:27.048041+0000","last_became_active":"2024-09-11T22:20:19.858887+0000","last_became_peered":"2024-09-11T22:20:19.858887+0000","last_unstale":"2024-09-11T22:20:27.048041+0000","last_undegraded":"2024-09-11T22:20:27.048041+0000","last_fullsized":"2024-09-11T22:20:27.048041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:34.620956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888481+0000","last_change":"2024-09-11T22:20:19.862347+0000","last_active":"2024-09-11T22:20:24.888481+0000","last_peered":"2024-09-11T22:20:24.888481+0000","last_clean":"2024-09-11T22:20:24.888481+0000","last_became_active":"2024-09-11T22:20:19.861965+0000","last_became_peered":"2024-09-11T22:20:19.861965+0000","last_unstale":"2024-09-11T22:20:24.888481+0000","last_undegraded":"2024-09-11T22:20:24.888481+0000","last_fullsized":"2024-09-11T22:20:24.888481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888938+0000","last_change":"2024-09-11T22:20:19.862065+0000","last_active":"2024-09-11T22:20:24.888938+0000","last_peered":"2024-09-11T22:20:24.888938+0000","last_clean":"2024-09-11T22:20:24.888938+0000","last_became_active":"2024-09-11T22:20:19.861765+0000","last_became_peered":"2024-09-11T22:20:19.861765+0000","last_unstale":"2024-09-11T22:20:24.888938+0000","last_undegraded":"2024-09-11T22:20:24.888938+0000","last_fullsized":"2024-09-11T22:20:24.888938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.049117+0000","last_change":"2024-09-11T22:20:19.865064+0000","last_active":"2024-09-11T22:20:27.049117+0000","last_peered":"2024-09-11T22:20:27.049117+0000","last_clean":"2024-09-11T22:20:27.049117+0000","last_became_active":"2024-09-11T22:20:19.864697+0000","last_became_peered":"2024-09-11T22:20:19.864697+0000","last_unstale":"2024-09-11T22:20:27.049117+0000","last_undegraded":"2024-09-11T22:20:27.049117+0000","last_fullsized":"2024-09-11T22:20:27.049117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887201+0000","last_change":"2024-09-11T22:20:19.861293+0000","last_active":"2024-09-11T22:20:24.887201+0000","last_peered":"2024-09-11T22:20:24.887201+0000","last_clean":"2024-09-11T22:20:24.887201+0000","last_became_active":"2024-09-11T22:20:19.861013+0000","last_became_peered":"2024-09-11T22:20:19.861013+0000","last_unstale":"2024-09-11T22:20:24.887201+0000","last_undegraded":"2024-09-11T22:20:24.887201+0000","last_fullsized":"2024-09-11T22:20:24.887201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:13.178404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048303+0000","last_change":"2024-09-11T22:20:19.858131+0000","last_active":"2024-09-11T22:20:27.048303+0000","last_peered":"2024-09-11T22:20:27.048303+0000","last_clean":"2024-09-11T22:20:27.048303+0000","last_became_active":"2024-09-11T22:20:19.857842+0000","last_became_peered":"2024-09-11T22:20:19.857842+0000","last_unstale":"2024-09-11T22:20:27.048303+0000","last_undegraded":"2024-09-11T22:20:27.048303+0000","last_fullsized":"2024-09-11T22:20:27.048303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889602+0000","last_change":"2024-09-11T22:20:19.859667+0000","last_active":"2024-09-11T22:20:24.889602+0000","last_peered":"2024-09-11T22:20:24.889602+0000","last_clean":"2024-09-11T22:20:24.889602+0000","last_became_active":"2024-09-11T22:20:19.859306+0000","last_became_peered":"2024-09-11T22:20:19.859306+0000","last_unstale":"2024-09-11T22:20:24.889602+0000","last_undegraded":"2024-09-11T22:20:24.889602+0000","last_fullsized":"2024-09-11T22:20:24.889602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048551+0000","last_change":"2024-09-11T22:20:19.848821+0000","last_active":"2024-09-11T22:20:27.048551+0000","last_peered":"2024-09-11T22:20:27.048551+0000","last_clean":"2024-09-11T22:20:27.048551+0000","last_became_active":"2024-09-11T22:20:19.848531+0000","last_became_peered":"2024-09-11T22:20:19.848531+0000","last_unstale":"2024-09-11T22:20:27.048551+0000","last_undegraded":"2024-09-11T22:20:27.048551+0000","last_fullsized":"2024-09-11T22:20:27.048551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890212+0000","last_change":"2024-09-11T22:20:19.866300+0000","last_active":"2024-09-11T22:20:24.890212+0000","last_peered":"2024-09-11T22:20:24.890212+0000","last_clean":"2024-09-11T22:20:24.890212+0000","last_became_active":"2024-09-11T22:20:19.865939+0000","last_became_peered":"2024-09-11T22:20:19.865939+0000","last_unstale":"2024-09-11T22:20:24.890212+0000","last_undegraded":"2024-09-11T22:20:24.890212+0000","last_fullsized":"2024-09-11T22:20:24.890212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047932+0000","last_change":"2024-09-11T22:20:19.858144+0000","last_active":"2024-09-11T22:20:27.047932+0000","last_peered":"2024-09-11T22:20:27.047932+0000","last_clean":"2024-09-11T22:20:27.047932+0000","last_became_active":"2024-09-11T22:20:19.857840+0000","last_became_peered":"2024-09-11T22:20:19.857840+0000","last_unstale":"2024-09-11T22:20:27.047932+0000","last_undegraded":"2024-09-11T22:20:27.047932+0000","last_fullsized":"2024-09-11T22:20:27.047932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:23.801072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998195+0000","last_change":"2024-09-11T22:20:19.857378+0000","last_active":"2024-09-11T22:20:24.998195+0000","last_peered":"2024-09-11T22:20:24.998195+0000","last_clean":"2024-09-11T22:20:24.998195+0000","last_became_active":"2024-09-11T22:20:19.857089+0000","last_became_peered":"2024-09-11T22:20:19.857089+0000","last_unstale":"2024-09-11T22:20:24.998195+0000","last_undegraded":"2024-09-11T22:20:24.998195+0000","last_fullsized":"2024-09-11T22:20:24.998195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:29.835695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.049018+0000","last_change":"2024-09-11T22:20:19.852827+0000","last_active":"2024-09-11T22:20:27.049018+0000","last_peered":"2024-09-11T22:20:27.049018+0000","last_clean":"2024-09-11T22:20:27.049018+0000","last_became_active":"2024-09-11T22:20:19.852251+0000","last_became_peered":"2024-09-11T22:20:19.852251+0000","last_unstale":"2024-09-11T22:20:27.049018+0000","last_undegraded":"2024-09-11T22:20:27.049018+0000","last_fullsized":"2024-09-11T22:20:27.049018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:36.888544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5376,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":11402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":67,"ondisk_log_size":67,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":699002,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":111252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509452,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":108080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":107444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":111784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":107318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":348160,"data_stored":698324,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":107478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:20:50.737 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:20:50.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.870+0000 7f0d46752640 1 Processor -- start 2024-09-11T22:20:50.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.870+0000 7f0d46752640 1 -- start start 2024-09-11T22:20:50.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.871+0000 7f0d46752640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0d400cad20 0x7f0d40154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.871+0000 7f0d46752640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d400d0f00 0x7f0d40154d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.871+0000 7f0d46752640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d400cd4c0 con 0x7f0d400d0b20 2024-09-11T22:20:50.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.871+0000 7f0d46752640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f0d400c55d0 con 0x7f0d400cad20 2024-09-11T22:20:50.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.871+0000 7f0d46752640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0d400c58b0 con 0x7f0d400d0f00 2024-09-11T22:20:50.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.871+0000 7f0d44cef640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d400d0f00 0x7f0d40154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.871+0000 7f0d3f7fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0d400cad20 0x7f0d40154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.871+0000 7f0d44cef640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d400d0f00 0x7f0d40154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45500/0 (socket says 172.21.15.100:45500) 2024-09-11T22:20:50.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.871+0000 7f0d44cef640 1 -- 172.21.15.100:0/1841944289 learned_addr learned my addr 172.21.15.100:0/1841944289 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:50.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.871+0000 7f0d44cef640 1 -- 172.21.15.100:0/1841944289 >> v2:172.21.15.167:3300/0 conn(0x7f0d400cad20 msgr2=0x7f0d40154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:50.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.871+0000 7f0d44cef640 1 --2- 172.21.15.100:0/1841944289 >> v2:172.21.15.167:3300/0 conn(0x7f0d400cad20 0x7f0d40154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.871+0000 7f0d44cef640 1 -- 172.21.15.100:0/1841944289 >> v1:172.21.15.167:6789/0 conn(0x7f0d400d0b20 legacy=0x7f0d400ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.871+0000 7f0d44cef640 1 -- 172.21.15.100:0/1841944289 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d4015ad20 con 0x7f0d400d0f00 2024-09-11T22:20:50.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.872+0000 7f0d44cef640 1 --2- 172.21.15.100:0/1841944289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d400d0f00 0x7f0d40154d70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0d38009e50 tx=0x7f0d3802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c913eddfd27f7fd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:50.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.872+0000 7f0d3effd640 1 -- 172.21.15.100:0/1841944289 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d38036070 con 0x7f0d400d0f00 2024-09-11T22:20:50.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.872+0000 7f0d3effd640 1 -- 172.21.15.100:0/1841944289 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d38031600 con 0x7f0d400d0f00 2024-09-11T22:20:50.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.872+0000 7f0d3effd640 1 -- 172.21.15.100:0/1841944289 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d380319d0 con 0x7f0d400d0f00 2024-09-11T22:20:50.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.873+0000 7f0d46752640 1 -- 172.21.15.100:0/1841944289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d400d0f00 msgr2=0x7f0d40154d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.873+0000 7f0d46752640 1 --2- 172.21.15.100:0/1841944289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d400d0f00 0x7f0d40154d70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0d38009e50 tx=0x7f0d3802a710 comp rx=0 tx=0).stop 2024-09-11T22:20:50.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.873+0000 7f0d46752640 1 -- 172.21.15.100:0/1841944289 shutdown_connections 2024-09-11T22:20:50.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.873+0000 7f0d46752640 1 --2- 172.21.15.100:0/1841944289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d400d0f00 0x7f0d40154d70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.873+0000 7f0d46752640 1 --2- 172.21.15.100:0/1841944289 >> v2:172.21.15.167:3300/0 conn(0x7f0d400cad20 0x7f0d40154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.873+0000 7f0d46752640 1 -- 172.21.15.100:0/1841944289 >> 172.21.15.100:0/1841944289 conn(0x7f0d4006d160 msgr2=0x7f0d4006d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:50.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.873+0000 7f0d46752640 1 -- 172.21.15.100:0/1841944289 shutdown_connections 2024-09-11T22:20:50.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.873+0000 7f0d46752640 1 -- 172.21.15.100:0/1841944289 wait complete. 2024-09-11T22:20:50.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.874+0000 7f0d46752640 1 Processor -- start 2024-09-11T22:20:50.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.874+0000 7f0d46752640 1 -- start start 2024-09-11T22:20:50.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.875+0000 7f0d46752640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d400cad20 0x7f0d400c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.875+0000 7f0d46752640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d400d0b20 0x7f0d4015e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.875+0000 7f0d46752640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d400d0f00 0x7f0d400c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.875+0000 7f0d46752640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4015a9f0 con 0x7f0d400d0b20 2024-09-11T22:20:50.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.875+0000 7f0d46752640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4015b2e0 con 0x7f0d400d0f00 2024-09-11T22:20:50.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.875+0000 7f0d46752640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0d4015b800 con 0x7f0d400cad20 2024-09-11T22:20:50.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.875+0000 7f0d3f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d400d0b20 0x7f0d4015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.875+0000 7f0d3ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d400cad20 0x7f0d400c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.875+0000 7f0d3f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d400d0b20 0x7f0d4015e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47722/0 (socket says 172.21.15.100:47722) 2024-09-11T22:20:50.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.875+0000 7f0d3f7fe640 1 -- 172.21.15.100:0/3991980790 learned_addr learned my addr 172.21.15.100:0/3991980790 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:50.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.875+0000 7f0d44cef640 1 --2- 172.21.15.100:0/3991980790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d400d0f00 0x7f0d400c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.875+0000 7f0d3f7fe640 1 -- 172.21.15.100:0/3991980790 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d400cad20 msgr2=0x7f0d400c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.875+0000 7f0d3f7fe640 1 --2- 172.21.15.100:0/3991980790 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d400cad20 0x7f0d400c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.875+0000 7f0d3f7fe640 1 -- 172.21.15.100:0/3991980790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d400d0f00 msgr2=0x7f0d400c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:50.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.875+0000 7f0d3f7fe640 1 --2- 172.21.15.100:0/3991980790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d400d0f00 0x7f0d400c9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:50.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.875+0000 7f0d3f7fe640 1 -- 172.21.15.100:0/3991980790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d400c8ca0 con 0x7f0d400d0b20 2024-09-11T22:20:50.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.875+0000 7f0d3f7fe640 1 --2- 172.21.15.100:0/3991980790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d400d0b20 0x7f0d4015e790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400e9e0 tx=0x7f0d3400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:50.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.876+0000 7f0d3cff9640 1 -- 172.21.15.100:0/3991980790 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34017070 con 0x7f0d400d0b20 2024-09-11T22:20:50.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.876+0000 7f0d3cff9640 1 -- 172.21.15.100:0/3991980790 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d3400c9d0 con 0x7f0d400d0b20 2024-09-11T22:20:50.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.876+0000 7f0d46752640 1 -- 172.21.15.100:0/3991980790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d4015d630 con 0x7f0d400d0b20 2024-09-11T22:20:50.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.876+0000 7f0d3cff9640 1 -- 172.21.15.100:0/3991980790 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3400cdc0 con 0x7f0d400d0b20 2024-09-11T22:20:50.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.876+0000 7f0d46752640 1 -- 172.21.15.100:0/3991980790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d4015dbf0 con 0x7f0d400d0b20 2024-09-11T22:20:50.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.877+0000 7f0d46752640 1 -- 172.21.15.100:0/3991980790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d40069290 con 0x7f0d400d0b20 2024-09-11T22:20:50.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.877+0000 7f0d3cff9640 1 -- 172.21.15.100:0/3991980790 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0d3401a070 con 0x7f0d400d0b20 2024-09-11T22:20:50.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.877+0000 7f0d3cff9640 1 --2- 172.21.15.100:0/3991980790 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0d2c06be30 0x7f0d2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:50.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.878+0000 7f0d3cff9640 1 -- 172.21.15.100:0/3991980790 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0d3408b1c0 con 0x7f0d400d0b20 2024-09-11T22:20:50.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.878+0000 7f0d3ffff640 1 --2- 172.21.15.100:0/3991980790 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0d2c06be30 0x7f0d2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:50.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.878+0000 7f0d3ffff640 1 --2- 172.21.15.100:0/3991980790 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0d2c06be30 0x7f0d2c06e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0d30001780 tx=0x7f0d30009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:50.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:50.882+0000 7f0d3cff9640 1 -- 172.21.15.100:0/3991980790 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0d400c8ca0 con 0x7f0d400d0b20 2024-09-11T22:20:51.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.046+0000 7f0d46752640 1 -- 172.21.15.100:0/3991980790 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0d400ccb40 con 0x7f0d2c06be30 2024-09-11T22:20:51.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.053+0000 7f0d3cff9640 1 -- 172.21.15.100:0/3991980790 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332714 (secure 0 0 0) 0x7f0d400ccb40 con 0x7f0d2c06be30 2024-09-11T22:20:51.057 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:51.059 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-11T22:20:51.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.056+0000 7f0d46752640 1 -- 172.21.15.100:0/3991980790 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0d2c06be30 msgr2=0x7f0d2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.056+0000 7f0d46752640 1 --2- 172.21.15.100:0/3991980790 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0d2c06be30 0x7f0d2c06e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0d30001780 tx=0x7f0d30009040 comp rx=0 tx=0).stop 2024-09-11T22:20:51.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.056+0000 7f0d46752640 1 -- 172.21.15.100:0/3991980790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d400d0b20 msgr2=0x7f0d4015e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.056+0000 7f0d46752640 1 --2- 172.21.15.100:0/3991980790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d400d0b20 0x7f0d4015e790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400e9e0 tx=0x7f0d3400eea0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.056+0000 7f0d46752640 1 -- 172.21.15.100:0/3991980790 shutdown_connections 2024-09-11T22:20:51.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.056+0000 7f0d46752640 1 --2- 172.21.15.100:0/3991980790 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0d2c06be30 0x7f0d2c06e2f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.056+0000 7f0d46752640 1 --2- 172.21.15.100:0/3991980790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d400d0f00 0x7f0d400c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.056+0000 7f0d46752640 1 --2- 172.21.15.100:0/3991980790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d400d0b20 0x7f0d4015e790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.056+0000 7f0d46752640 1 --2- 172.21.15.100:0/3991980790 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d400cad20 0x7f0d400c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.057+0000 7f0d46752640 1 -- 172.21.15.100:0/3991980790 >> 172.21.15.100:0/3991980790 conn(0x7f0d4006d160 msgr2=0x7f0d400ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.057+0000 7f0d46752640 1 -- 172.21.15.100:0/3991980790 shutdown_connections 2024-09-11T22:20:51.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.057+0000 7f0d46752640 1 -- 172.21.15.100:0/3991980790 wait complete. 2024-09-11T22:20:51.068 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-09-11T22:20:50.311272+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595744,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":235,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":184,"ondisk_log_size":184,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218548,"kb_used_data":2340,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756172,"statfs":{"total":773094113280,"available":772870320128,"internally_reserved":0,"allocated":2396160,"data_stored":2050682,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":734,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003005"},"pg_stats":[{"pgid":"2.1f","version":"25'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048242+0000","last_change":"2024-09-11T22:20:18.853007+0000","last_active":"2024-09-11T22:20:27.048242+0000","last_peered":"2024-09-11T22:20:27.048242+0000","last_clean":"2024-09-11T22:20:27.048242+0000","last_became_active":"2024-09-11T22:20:18.852740+0000","last_became_peered":"2024-09-11T22:20:18.852740+0000","last_unstale":"2024-09-11T22:20:27.048242+0000","last_undegraded":"2024-09-11T22:20:27.048242+0000","last_fullsized":"2024-09-11T22:20:27.048242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:46.710328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887920+0000","last_change":"2024-09-11T22:20:19.849765+0000","last_active":"2024-09-11T22:20:24.887920+0000","last_peered":"2024-09-11T22:20:24.887920+0000","last_clean":"2024-09-11T22:20:24.887920+0000","last_became_active":"2024-09-11T22:20:19.848619+0000","last_became_peered":"2024-09-11T22:20:19.848619+0000","last_unstale":"2024-09-11T22:20:24.887920+0000","last_undegraded":"2024-09-11T22:20:24.887920+0000","last_fullsized":"2024-09-11T22:20:24.887920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:57.621624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887250+0000","last_change":"2024-09-11T22:20:24.078618+0000","last_active":"2024-09-11T22:20:24.887250+0000","last_peered":"2024-09-11T22:20:24.887250+0000","last_clean":"2024-09-11T22:20:24.887250+0000","last_became_active":"2024-09-11T22:20:24.078283+0000","last_became_peered":"2024-09-11T22:20:24.078283+0000","last_unstale":"2024-09-11T22:20:24.887250+0000","last_undegraded":"2024-09-11T22:20:24.887250+0000","last_fullsized":"2024-09-11T22:20:24.887250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:01.901307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888010+0000","last_change":"2024-09-11T22:20:18.855945+0000","last_active":"2024-09-11T22:20:24.888010+0000","last_peered":"2024-09-11T22:20:24.888010+0000","last_clean":"2024-09-11T22:20:24.888010+0000","last_became_active":"2024-09-11T22:20:18.854811+0000","last_became_peered":"2024-09-11T22:20:18.854811+0000","last_unstale":"2024-09-11T22:20:24.888010+0000","last_undegraded":"2024-09-11T22:20:24.888010+0000","last_fullsized":"2024-09-11T22:20:24.888010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:47.508920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048102+0000","last_change":"2024-09-11T22:20:19.862436+0000","last_active":"2024-09-11T22:20:27.048102+0000","last_peered":"2024-09-11T22:20:27.048102+0000","last_clean":"2024-09-11T22:20:27.048102+0000","last_became_active":"2024-09-11T22:20:19.862061+0000","last_became_peered":"2024-09-11T22:20:19.862061+0000","last_unstale":"2024-09-11T22:20:27.048102+0000","last_undegraded":"2024-09-11T22:20:27.048102+0000","last_fullsized":"2024-09-11T22:20:27.048102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047627+0000","last_change":"2024-09-11T22:20:23.879729+0000","last_active":"2024-09-11T22:20:27.047627+0000","last_peered":"2024-09-11T22:20:27.047627+0000","last_clean":"2024-09-11T22:20:27.047627+0000","last_became_active":"2024-09-11T22:20:23.879245+0000","last_became_peered":"2024-09-11T22:20:23.879245+0000","last_unstale":"2024-09-11T22:20:27.047627+0000","last_undegraded":"2024-09-11T22:20:27.047627+0000","last_fullsized":"2024-09-11T22:20:27.047627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:36.836842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048249+0000","last_change":"2024-09-11T22:20:18.853076+0000","last_active":"2024-09-11T22:20:27.048249+0000","last_peered":"2024-09-11T22:20:27.048249+0000","last_clean":"2024-09-11T22:20:27.048249+0000","last_became_active":"2024-09-11T22:20:18.852728+0000","last_became_peered":"2024-09-11T22:20:18.852728+0000","last_unstale":"2024-09-11T22:20:27.048249+0000","last_undegraded":"2024-09-11T22:20:27.048249+0000","last_fullsized":"2024-09-11T22:20:27.048249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890308+0000","last_change":"2024-09-11T22:20:19.864544+0000","last_active":"2024-09-11T22:20:24.890308+0000","last_peered":"2024-09-11T22:20:24.890308+0000","last_clean":"2024-09-11T22:20:24.890308+0000","last_became_active":"2024-09-11T22:20:19.864234+0000","last_became_peered":"2024-09-11T22:20:19.864234+0000","last_unstale":"2024-09-11T22:20:24.890308+0000","last_undegraded":"2024-09-11T22:20:24.890308+0000","last_fullsized":"2024-09-11T22:20:24.890308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048400+0000","last_change":"2024-09-11T22:20:23.873783+0000","last_active":"2024-09-11T22:20:27.048400+0000","last_peered":"2024-09-11T22:20:27.048400+0000","last_clean":"2024-09-11T22:20:27.048400+0000","last_became_active":"2024-09-11T22:20:23.873385+0000","last_became_peered":"2024-09-11T22:20:23.873385+0000","last_unstale":"2024-09-11T22:20:27.048400+0000","last_undegraded":"2024-09-11T22:20:27.048400+0000","last_fullsized":"2024-09-11T22:20:27.048400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048092+0000","last_change":"2024-09-11T22:20:18.861530+0000","last_active":"2024-09-11T22:20:27.048092+0000","last_peered":"2024-09-11T22:20:27.048092+0000","last_clean":"2024-09-11T22:20:27.048092+0000","last_became_active":"2024-09-11T22:20:18.861230+0000","last_became_peered":"2024-09-11T22:20:18.861230+0000","last_unstale":"2024-09-11T22:20:27.048092+0000","last_undegraded":"2024-09-11T22:20:27.048092+0000","last_fullsized":"2024-09-11T22:20:27.048092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890615+0000","last_change":"2024-09-11T22:20:19.863401+0000","last_active":"2024-09-11T22:20:24.890615+0000","last_peered":"2024-09-11T22:20:24.890615+0000","last_clean":"2024-09-11T22:20:24.890615+0000","last_became_active":"2024-09-11T22:20:19.863127+0000","last_became_peered":"2024-09-11T22:20:19.863127+0000","last_unstale":"2024-09-11T22:20:24.890615+0000","last_undegraded":"2024-09-11T22:20:24.890615+0000","last_fullsized":"2024-09-11T22:20:24.890615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:36.888544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048021+0000","last_change":"2024-09-11T22:20:23.874650+0000","last_active":"2024-09-11T22:20:27.048021+0000","last_peered":"2024-09-11T22:20:27.048021+0000","last_clean":"2024-09-11T22:20:27.048021+0000","last_became_active":"2024-09-11T22:20:23.874040+0000","last_became_peered":"2024-09-11T22:20:23.874040+0000","last_unstale":"2024-09-11T22:20:27.048021+0000","last_undegraded":"2024-09-11T22:20:27.048021+0000","last_fullsized":"2024-09-11T22:20:27.048021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888158+0000","last_change":"2024-09-11T22:20:19.859446+0000","last_active":"2024-09-11T22:20:24.888158+0000","last_peered":"2024-09-11T22:20:24.888158+0000","last_clean":"2024-09-11T22:20:24.888158+0000","last_became_active":"2024-09-11T22:20:19.859106+0000","last_became_peered":"2024-09-11T22:20:19.859106+0000","last_unstale":"2024-09-11T22:20:24.888158+0000","last_undegraded":"2024-09-11T22:20:24.888158+0000","last_fullsized":"2024-09-11T22:20:24.888158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.944022+0000","last_change":"2024-09-11T22:20:18.856475+0000","last_active":"2024-09-11T22:20:46.944022+0000","last_peered":"2024-09-11T22:20:46.944022+0000","last_clean":"2024-09-11T22:20:46.944022+0000","last_became_active":"2024-09-11T22:20:18.856165+0000","last_became_peered":"2024-09-11T22:20:18.856165+0000","last_unstale":"2024-09-11T22:20:46.944022+0000","last_undegraded":"2024-09-11T22:20:46.944022+0000","last_fullsized":"2024-09-11T22:20:46.944022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048102+0000","last_change":"2024-09-11T22:20:23.878121+0000","last_active":"2024-09-11T22:20:27.048102+0000","last_peered":"2024-09-11T22:20:27.048102+0000","last_clean":"2024-09-11T22:20:27.048102+0000","last_became_active":"2024-09-11T22:20:23.877713+0000","last_became_peered":"2024-09-11T22:20:23.877713+0000","last_unstale":"2024-09-11T22:20:27.048102+0000","last_undegraded":"2024-09-11T22:20:27.048102+0000","last_fullsized":"2024-09-11T22:20:27.048102+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887604+0000","last_change":"2024-09-11T22:20:19.858358+0000","last_active":"2024-09-11T22:20:24.887604+0000","last_peered":"2024-09-11T22:20:24.887604+0000","last_clean":"2024-09-11T22:20:24.887604+0000","last_became_active":"2024-09-11T22:20:19.858057+0000","last_became_peered":"2024-09-11T22:20:19.858057+0000","last_unstale":"2024-09-11T22:20:24.887604+0000","last_undegraded":"2024-09-11T22:20:24.887604+0000","last_fullsized":"2024-09-11T22:20:24.887604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:07.839926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998178+0000","last_change":"2024-09-11T22:20:18.853818+0000","last_active":"2024-09-11T22:20:24.998178+0000","last_peered":"2024-09-11T22:20:24.998178+0000","last_clean":"2024-09-11T22:20:24.998178+0000","last_became_active":"2024-09-11T22:20:18.853508+0000","last_became_peered":"2024-09-11T22:20:18.853508+0000","last_unstale":"2024-09-11T22:20:24.998178+0000","last_undegraded":"2024-09-11T22:20:24.998178+0000","last_fullsized":"2024-09-11T22:20:24.998178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:58.141587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047962+0000","last_change":"2024-09-11T22:20:23.879226+0000","last_active":"2024-09-11T22:20:27.047962+0000","last_peered":"2024-09-11T22:20:27.047962+0000","last_clean":"2024-09-11T22:20:27.047962+0000","last_became_active":"2024-09-11T22:20:23.878199+0000","last_became_peered":"2024-09-11T22:20:23.878199+0000","last_unstale":"2024-09-11T22:20:27.047962+0000","last_undegraded":"2024-09-11T22:20:27.047962+0000","last_fullsized":"2024-09-11T22:20:27.047962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:13.245927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887402+0000","last_change":"2024-09-11T22:20:19.844748+0000","last_active":"2024-09-11T22:20:24.887402+0000","last_peered":"2024-09-11T22:20:24.887402+0000","last_clean":"2024-09-11T22:20:24.887402+0000","last_became_active":"2024-09-11T22:20:19.844446+0000","last_became_peered":"2024-09-11T22:20:19.844446+0000","last_unstale":"2024-09-11T22:20:24.887402+0000","last_undegraded":"2024-09-11T22:20:24.887402+0000","last_fullsized":"2024-09-11T22:20:24.887402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:13.319918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997785+0000","last_change":"2024-09-11T22:20:18.847388+0000","last_active":"2024-09-11T22:20:24.997785+0000","last_peered":"2024-09-11T22:20:24.997785+0000","last_clean":"2024-09-11T22:20:24.997785+0000","last_became_active":"2024-09-11T22:20:18.847118+0000","last_became_peered":"2024-09-11T22:20:18.847118+0000","last_unstale":"2024-09-11T22:20:24.997785+0000","last_undegraded":"2024-09-11T22:20:24.997785+0000","last_fullsized":"2024-09-11T22:20:24.997785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:47.360920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998393+0000","last_change":"2024-09-11T22:20:24.077604+0000","last_active":"2024-09-11T22:20:24.998393+0000","last_peered":"2024-09-11T22:20:24.998393+0000","last_clean":"2024-09-11T22:20:24.998393+0000","last_became_active":"2024-09-11T22:20:24.077231+0000","last_became_peered":"2024-09-11T22:20:24.077231+0000","last_unstale":"2024-09-11T22:20:24.998393+0000","last_undegraded":"2024-09-11T22:20:24.998393+0000","last_fullsized":"2024-09-11T22:20:24.998393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:38.846688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048647+0000","last_change":"2024-09-11T22:20:19.854453+0000","last_active":"2024-09-11T22:20:27.048647+0000","last_peered":"2024-09-11T22:20:27.048647+0000","last_clean":"2024-09-11T22:20:27.048647+0000","last_became_active":"2024-09-11T22:20:19.854100+0000","last_became_peered":"2024-09-11T22:20:19.854100+0000","last_unstale":"2024-09-11T22:20:27.048647+0000","last_undegraded":"2024-09-11T22:20:27.048647+0000","last_fullsized":"2024-09-11T22:20:27.048647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:06.166813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.944339+0000","last_change":"2024-09-11T22:20:18.854889+0000","last_active":"2024-09-11T22:20:46.944339+0000","last_peered":"2024-09-11T22:20:46.944339+0000","last_clean":"2024-09-11T22:20:46.944339+0000","last_became_active":"2024-09-11T22:20:18.854552+0000","last_became_peered":"2024-09-11T22:20:18.854552+0000","last_unstale":"2024-09-11T22:20:46.944339+0000","last_undegraded":"2024-09-11T22:20:46.944339+0000","last_fullsized":"2024-09-11T22:20:46.944339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:33.612126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048443+0000","last_change":"2024-09-11T22:20:23.878932+0000","last_active":"2024-09-11T22:20:27.048443+0000","last_peered":"2024-09-11T22:20:27.048443+0000","last_clean":"2024-09-11T22:20:27.048443+0000","last_became_active":"2024-09-11T22:20:23.878305+0000","last_became_peered":"2024-09-11T22:20:23.878305+0000","last_unstale":"2024-09-11T22:20:27.048443+0000","last_undegraded":"2024-09-11T22:20:27.048443+0000","last_fullsized":"2024-09-11T22:20:27.048443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048250+0000","last_change":"2024-09-11T22:20:19.856318+0000","last_active":"2024-09-11T22:20:27.048250+0000","last_peered":"2024-09-11T22:20:27.048250+0000","last_clean":"2024-09-11T22:20:27.048250+0000","last_became_active":"2024-09-11T22:20:19.855992+0000","last_became_peered":"2024-09-11T22:20:19.855992+0000","last_unstale":"2024-09-11T22:20:27.048250+0000","last_undegraded":"2024-09-11T22:20:27.048250+0000","last_fullsized":"2024-09-11T22:20:27.048250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:57.709140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.944255+0000","last_change":"2024-09-11T22:20:18.850750+0000","last_active":"2024-09-11T22:20:46.944255+0000","last_peered":"2024-09-11T22:20:46.944255+0000","last_clean":"2024-09-11T22:20:46.944255+0000","last_became_active":"2024-09-11T22:20:18.849621+0000","last_became_peered":"2024-09-11T22:20:18.849621+0000","last_unstale":"2024-09-11T22:20:46.944255+0000","last_undegraded":"2024-09-11T22:20:46.944255+0000","last_fullsized":"2024-09-11T22:20:46.944255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047710+0000","last_change":"2024-09-11T22:20:24.077741+0000","last_active":"2024-09-11T22:20:27.047710+0000","last_peered":"2024-09-11T22:20:27.047710+0000","last_clean":"2024-09-11T22:20:27.047710+0000","last_became_active":"2024-09-11T22:20:24.077325+0000","last_became_peered":"2024-09-11T22:20:24.077325+0000","last_unstale":"2024-09-11T22:20:27.047710+0000","last_undegraded":"2024-09-11T22:20:27.047710+0000","last_fullsized":"2024-09-11T22:20:27.047710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:18.656529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888138+0000","last_change":"2024-09-11T22:20:19.850738+0000","last_active":"2024-09-11T22:20:24.888138+0000","last_peered":"2024-09-11T22:20:24.888138+0000","last_clean":"2024-09-11T22:20:24.888138+0000","last_became_active":"2024-09-11T22:20:19.850441+0000","last_became_peered":"2024-09-11T22:20:19.850441+0000","last_unstale":"2024-09-11T22:20:24.888138+0000","last_undegraded":"2024-09-11T22:20:24.888138+0000","last_fullsized":"2024-09-11T22:20:24.888138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:47.552343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998291+0000","last_change":"2024-09-11T22:20:18.845173+0000","last_active":"2024-09-11T22:20:24.998291+0000","last_peered":"2024-09-11T22:20:24.998291+0000","last_clean":"2024-09-11T22:20:24.998291+0000","last_became_active":"2024-09-11T22:20:18.844731+0000","last_became_peered":"2024-09-11T22:20:18.844731+0000","last_unstale":"2024-09-11T22:20:24.998291+0000","last_undegraded":"2024-09-11T22:20:24.998291+0000","last_fullsized":"2024-09-11T22:20:24.998291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:32.963285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887172+0000","last_change":"2024-09-11T22:20:24.078020+0000","last_active":"2024-09-11T22:20:24.887172+0000","last_peered":"2024-09-11T22:20:24.887172+0000","last_clean":"2024-09-11T22:20:24.887172+0000","last_became_active":"2024-09-11T22:20:24.077541+0000","last_became_peered":"2024-09-11T22:20:24.077541+0000","last_unstale":"2024-09-11T22:20:24.887172+0000","last_undegraded":"2024-09-11T22:20:24.887172+0000","last_fullsized":"2024-09-11T22:20:24.887172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:36.122714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998068+0000","last_change":"2024-09-11T22:20:19.845497+0000","last_active":"2024-09-11T22:20:24.998068+0000","last_peered":"2024-09-11T22:20:24.998068+0000","last_clean":"2024-09-11T22:20:24.998068+0000","last_became_active":"2024-09-11T22:20:19.845203+0000","last_became_peered":"2024-09-11T22:20:19.845203+0000","last_unstale":"2024-09-11T22:20:24.998068+0000","last_undegraded":"2024-09-11T22:20:24.998068+0000","last_fullsized":"2024-09-11T22:20:24.998068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:12.086231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048907+0000","last_change":"2024-09-11T22:20:18.856263+0000","last_active":"2024-09-11T22:20:27.048907+0000","last_peered":"2024-09-11T22:20:27.048907+0000","last_clean":"2024-09-11T22:20:27.048907+0000","last_became_active":"2024-09-11T22:20:18.855968+0000","last_became_peered":"2024-09-11T22:20:18.855968+0000","last_unstale":"2024-09-11T22:20:27.048907+0000","last_undegraded":"2024-09-11T22:20:27.048907+0000","last_fullsized":"2024-09-11T22:20:27.048907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047968+0000","last_change":"2024-09-11T22:20:24.075030+0000","last_active":"2024-09-11T22:20:27.047968+0000","last_peered":"2024-09-11T22:20:27.047968+0000","last_clean":"2024-09-11T22:20:27.047968+0000","last_became_active":"2024-09-11T22:20:24.074588+0000","last_became_peered":"2024-09-11T22:20:24.074588+0000","last_unstale":"2024-09-11T22:20:27.047968+0000","last_undegraded":"2024-09-11T22:20:27.047968+0000","last_fullsized":"2024-09-11T22:20:27.047968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890676+0000","last_change":"2024-09-11T22:20:19.859010+0000","last_active":"2024-09-11T22:20:24.890676+0000","last_peered":"2024-09-11T22:20:24.890676+0000","last_clean":"2024-09-11T22:20:24.890676+0000","last_became_active":"2024-09-11T22:20:19.858585+0000","last_became_peered":"2024-09-11T22:20:19.858585+0000","last_unstale":"2024-09-11T22:20:24.890676+0000","last_undegraded":"2024-09-11T22:20:24.890676+0000","last_fullsized":"2024-09-11T22:20:24.890676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998168+0000","last_change":"2024-09-11T22:20:18.847904+0000","last_active":"2024-09-11T22:20:24.998168+0000","last_peered":"2024-09-11T22:20:24.998168+0000","last_clean":"2024-09-11T22:20:24.998168+0000","last_became_active":"2024-09-11T22:20:18.847669+0000","last_became_peered":"2024-09-11T22:20:18.847669+0000","last_unstale":"2024-09-11T22:20:24.998168+0000","last_undegraded":"2024-09-11T22:20:24.998168+0000","last_fullsized":"2024-09-11T22:20:24.998168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:08.717999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997794+0000","last_change":"2024-09-11T22:20:23.881067+0000","last_active":"2024-09-11T22:20:24.997794+0000","last_peered":"2024-09-11T22:20:24.997794+0000","last_clean":"2024-09-11T22:20:24.997794+0000","last_became_active":"2024-09-11T22:20:23.880468+0000","last_became_peered":"2024-09-11T22:20:23.880468+0000","last_unstale":"2024-09-11T22:20:24.997794+0000","last_undegraded":"2024-09-11T22:20:24.997794+0000","last_fullsized":"2024-09-11T22:20:24.997794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:23.480547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048637+0000","last_change":"2024-09-11T22:20:19.860423+0000","last_active":"2024-09-11T22:20:27.048637+0000","last_peered":"2024-09-11T22:20:27.048637+0000","last_clean":"2024-09-11T22:20:27.048637+0000","last_became_active":"2024-09-11T22:20:19.858932+0000","last_became_peered":"2024-09-11T22:20:19.858932+0000","last_unstale":"2024-09-11T22:20:27.048637+0000","last_undegraded":"2024-09-11T22:20:27.048637+0000","last_fullsized":"2024-09-11T22:20:27.048637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:53.255932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889986+0000","last_change":"2024-09-11T22:20:18.854973+0000","last_active":"2024-09-11T22:20:24.889986+0000","last_peered":"2024-09-11T22:20:24.889986+0000","last_clean":"2024-09-11T22:20:24.889986+0000","last_became_active":"2024-09-11T22:20:18.854725+0000","last_became_peered":"2024-09-11T22:20:18.854725+0000","last_unstale":"2024-09-11T22:20:24.889986+0000","last_undegraded":"2024-09-11T22:20:24.889986+0000","last_fullsized":"2024-09-11T22:20:24.889986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998393+0000","last_change":"2024-09-11T22:20:23.880693+0000","last_active":"2024-09-11T22:20:24.998393+0000","last_peered":"2024-09-11T22:20:24.998393+0000","last_clean":"2024-09-11T22:20:24.998393+0000","last_became_active":"2024-09-11T22:20:23.880243+0000","last_became_peered":"2024-09-11T22:20:23.880243+0000","last_unstale":"2024-09-11T22:20:24.998393+0000","last_undegraded":"2024-09-11T22:20:24.998393+0000","last_fullsized":"2024-09-11T22:20:24.998393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.659287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997954+0000","last_change":"2024-09-11T22:20:19.844808+0000","last_active":"2024-09-11T22:20:24.997954+0000","last_peered":"2024-09-11T22:20:24.997954+0000","last_clean":"2024-09-11T22:20:24.997954+0000","last_became_active":"2024-09-11T22:20:19.844536+0000","last_became_peered":"2024-09-11T22:20:19.844536+0000","last_unstale":"2024-09-11T22:20:24.997954+0000","last_undegraded":"2024-09-11T22:20:24.997954+0000","last_fullsized":"2024-09-11T22:20:24.997954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:57.142383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951217+0000","last_change":"2024-09-11T22:20:18.855640+0000","last_active":"2024-09-11T22:20:26.951217+0000","last_peered":"2024-09-11T22:20:26.951217+0000","last_clean":"2024-09-11T22:20:26.951217+0000","last_became_active":"2024-09-11T22:20:18.855394+0000","last_became_peered":"2024-09-11T22:20:18.855394+0000","last_unstale":"2024-09-11T22:20:26.951217+0000","last_undegraded":"2024-09-11T22:20:26.951217+0000","last_fullsized":"2024-09-11T22:20:26.951217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998458+0000","last_change":"2024-09-11T22:20:23.882554+0000","last_active":"2024-09-11T22:20:24.998458+0000","last_peered":"2024-09-11T22:20:24.998458+0000","last_clean":"2024-09-11T22:20:24.998458+0000","last_became_active":"2024-09-11T22:20:23.881642+0000","last_became_peered":"2024-09-11T22:20:23.881642+0000","last_unstale":"2024-09-11T22:20:24.998458+0000","last_undegraded":"2024-09-11T22:20:24.998458+0000","last_fullsized":"2024-09-11T22:20:24.998458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:16.696043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047535+0000","last_change":"2024-09-11T22:20:19.859429+0000","last_active":"2024-09-11T22:20:27.047535+0000","last_peered":"2024-09-11T22:20:27.047535+0000","last_clean":"2024-09-11T22:20:27.047535+0000","last_became_active":"2024-09-11T22:20:19.859159+0000","last_became_peered":"2024-09-11T22:20:19.859159+0000","last_unstale":"2024-09-11T22:20:27.047535+0000","last_undegraded":"2024-09-11T22:20:27.047535+0000","last_fullsized":"2024-09-11T22:20:27.047535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:02.696450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047221+0000","last_change":"2024-09-11T22:20:18.856144+0000","last_active":"2024-09-11T22:20:27.047221+0000","last_peered":"2024-09-11T22:20:27.047221+0000","last_clean":"2024-09-11T22:20:27.047221+0000","last_became_active":"2024-09-11T22:20:18.855866+0000","last_became_peered":"2024-09-11T22:20:18.855866+0000","last_unstale":"2024-09-11T22:20:27.047221+0000","last_undegraded":"2024-09-11T22:20:27.047221+0000","last_fullsized":"2024-09-11T22:20:27.047221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:37.259393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048214+0000","last_change":"2024-09-11T22:20:24.075154+0000","last_active":"2024-09-11T22:20:27.048214+0000","last_peered":"2024-09-11T22:20:27.048214+0000","last_clean":"2024-09-11T22:20:27.048214+0000","last_became_active":"2024-09-11T22:20:24.074568+0000","last_became_peered":"2024-09-11T22:20:24.074568+0000","last_unstale":"2024-09-11T22:20:27.048214+0000","last_undegraded":"2024-09-11T22:20:27.048214+0000","last_fullsized":"2024-09-11T22:20:27.048214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:09.804991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887321+0000","last_change":"2024-09-11T22:20:19.861236+0000","last_active":"2024-09-11T22:20:24.887321+0000","last_peered":"2024-09-11T22:20:24.887321+0000","last_clean":"2024-09-11T22:20:24.887321+0000","last_became_active":"2024-09-11T22:20:19.860938+0000","last_became_peered":"2024-09-11T22:20:19.860938+0000","last_unstale":"2024-09-11T22:20:24.887321+0000","last_undegraded":"2024-09-11T22:20:24.887321+0000","last_fullsized":"2024-09-11T22:20:24.887321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:42.015334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.943429+0000","last_change":"2024-09-11T22:20:18.853467+0000","last_active":"2024-09-11T22:20:46.943429+0000","last_peered":"2024-09-11T22:20:46.943429+0000","last_clean":"2024-09-11T22:20:46.943429+0000","last_became_active":"2024-09-11T22:20:18.853182+0000","last_became_peered":"2024-09-11T22:20:18.853182+0000","last_unstale":"2024-09-11T22:20:46.943429+0000","last_undegraded":"2024-09-11T22:20:46.943429+0000","last_fullsized":"2024-09-11T22:20:46.943429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047625+0000","last_change":"2024-09-11T22:20:09.425648+0000","last_active":"2024-09-11T22:20:27.047625+0000","last_peered":"2024-09-11T22:20:27.047625+0000","last_clean":"2024-09-11T22:20:27.047625+0000","last_became_active":"2024-09-11T22:20:09.424591+0000","last_became_peered":"2024-09-11T22:20:09.424591+0000","last_unstale":"2024-09-11T22:20:27.047625+0000","last_undegraded":"2024-09-11T22:20:27.047625+0000","last_fullsized":"2024-09-11T22:20:27.047625+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_clean_scrub_stamp":"2024-09-11T22:20:08.334092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:53.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888536+0000","last_change":"2024-09-11T22:20:24.077007+0000","last_active":"2024-09-11T22:20:24.888536+0000","last_peered":"2024-09-11T22:20:24.888536+0000","last_clean":"2024-09-11T22:20:24.888536+0000","last_became_active":"2024-09-11T22:20:24.076601+0000","last_became_peered":"2024-09-11T22:20:24.076601+0000","last_unstale":"2024-09-11T22:20:24.888536+0000","last_undegraded":"2024-09-11T22:20:24.888536+0000","last_fullsized":"2024-09-11T22:20:24.888536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048600+0000","last_change":"2024-09-11T22:20:19.863279+0000","last_active":"2024-09-11T22:20:27.048600+0000","last_peered":"2024-09-11T22:20:27.048600+0000","last_clean":"2024-09-11T22:20:27.048600+0000","last_became_active":"2024-09-11T22:20:19.861322+0000","last_became_peered":"2024-09-11T22:20:19.861322+0000","last_unstale":"2024-09-11T22:20:27.048600+0000","last_undegraded":"2024-09-11T22:20:27.048600+0000","last_fullsized":"2024-09-11T22:20:27.048600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951240+0000","last_change":"2024-09-11T22:20:18.853343+0000","last_active":"2024-09-11T22:20:26.951240+0000","last_peered":"2024-09-11T22:20:26.951240+0000","last_clean":"2024-09-11T22:20:26.951240+0000","last_became_active":"2024-09-11T22:20:18.853069+0000","last_became_peered":"2024-09-11T22:20:18.853069+0000","last_unstale":"2024-09-11T22:20:26.951240+0000","last_undegraded":"2024-09-11T22:20:26.951240+0000","last_fullsized":"2024-09-11T22:20:26.951240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888655+0000","last_change":"2024-09-11T22:20:24.075350+0000","last_active":"2024-09-11T22:20:24.888655+0000","last_peered":"2024-09-11T22:20:24.888655+0000","last_clean":"2024-09-11T22:20:24.888655+0000","last_became_active":"2024-09-11T22:20:24.074789+0000","last_became_peered":"2024-09-11T22:20:24.074789+0000","last_unstale":"2024-09-11T22:20:24.888655+0000","last_undegraded":"2024-09-11T22:20:24.888655+0000","last_fullsized":"2024-09-11T22:20:24.888655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890400+0000","last_change":"2024-09-11T22:20:19.866331+0000","last_active":"2024-09-11T22:20:24.890400+0000","last_peered":"2024-09-11T22:20:24.890400+0000","last_clean":"2024-09-11T22:20:24.890400+0000","last_became_active":"2024-09-11T22:20:19.865535+0000","last_became_peered":"2024-09-11T22:20:19.865535+0000","last_unstale":"2024-09-11T22:20:24.890400+0000","last_undegraded":"2024-09-11T22:20:24.890400+0000","last_fullsized":"2024-09-11T22:20:24.890400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998164+0000","last_change":"2024-09-11T22:20:18.849434+0000","last_active":"2024-09-11T22:20:24.998164+0000","last_peered":"2024-09-11T22:20:24.998164+0000","last_clean":"2024-09-11T22:20:24.998164+0000","last_became_active":"2024-09-11T22:20:18.848787+0000","last_became_peered":"2024-09-11T22:20:18.848787+0000","last_unstale":"2024-09-11T22:20:24.998164+0000","last_undegraded":"2024-09-11T22:20:24.998164+0000","last_fullsized":"2024-09-11T22:20:24.998164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:25.689495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048087+0000","last_change":"2024-09-11T22:20:23.879962+0000","last_active":"2024-09-11T22:20:27.048087+0000","last_peered":"2024-09-11T22:20:27.048087+0000","last_clean":"2024-09-11T22:20:27.048087+0000","last_became_active":"2024-09-11T22:20:23.879586+0000","last_became_peered":"2024-09-11T22:20:23.879586+0000","last_unstale":"2024-09-11T22:20:27.048087+0000","last_undegraded":"2024-09-11T22:20:27.048087+0000","last_fullsized":"2024-09-11T22:20:27.048087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:27.323116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.049164+0000","last_change":"2024-09-11T22:20:19.860411+0000","last_active":"2024-09-11T22:20:27.049164+0000","last_peered":"2024-09-11T22:20:27.049164+0000","last_clean":"2024-09-11T22:20:27.049164+0000","last_became_active":"2024-09-11T22:20:19.860076+0000","last_became_peered":"2024-09-11T22:20:19.860076+0000","last_unstale":"2024-09-11T22:20:27.049164+0000","last_undegraded":"2024-09-11T22:20:27.049164+0000","last_fullsized":"2024-09-11T22:20:27.049164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951255+0000","last_change":"2024-09-11T22:20:18.856020+0000","last_active":"2024-09-11T22:20:26.951255+0000","last_peered":"2024-09-11T22:20:26.951255+0000","last_clean":"2024-09-11T22:20:26.951255+0000","last_became_active":"2024-09-11T22:20:18.855753+0000","last_became_peered":"2024-09-11T22:20:18.855753+0000","last_unstale":"2024-09-11T22:20:26.951255+0000","last_undegraded":"2024-09-11T22:20:26.951255+0000","last_fullsized":"2024-09-11T22:20:26.951255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888726+0000","last_change":"2024-09-11T22:20:24.077975+0000","last_active":"2024-09-11T22:20:24.888726+0000","last_peered":"2024-09-11T22:20:24.888726+0000","last_clean":"2024-09-11T22:20:24.888726+0000","last_became_active":"2024-09-11T22:20:24.077502+0000","last_became_peered":"2024-09-11T22:20:24.077502+0000","last_unstale":"2024-09-11T22:20:24.888726+0000","last_undegraded":"2024-09-11T22:20:24.888726+0000","last_fullsized":"2024-09-11T22:20:24.888726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:16.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047781+0000","last_change":"2024-09-11T22:20:19.856986+0000","last_active":"2024-09-11T22:20:27.047781+0000","last_peered":"2024-09-11T22:20:27.047781+0000","last_clean":"2024-09-11T22:20:27.047781+0000","last_became_active":"2024-09-11T22:20:19.856739+0000","last_became_peered":"2024-09-11T22:20:19.856739+0000","last_unstale":"2024-09-11T22:20:27.047781+0000","last_undegraded":"2024-09-11T22:20:27.047781+0000","last_fullsized":"2024-09-11T22:20:27.047781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048306+0000","last_change":"2024-09-11T22:20:18.855044+0000","last_active":"2024-09-11T22:20:27.048306+0000","last_peered":"2024-09-11T22:20:27.048306+0000","last_clean":"2024-09-11T22:20:27.048306+0000","last_became_active":"2024-09-11T22:20:18.854764+0000","last_became_peered":"2024-09-11T22:20:18.854764+0000","last_unstale":"2024-09-11T22:20:27.048306+0000","last_undegraded":"2024-09-11T22:20:27.048306+0000","last_fullsized":"2024-09-11T22:20:27.048306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:22.207278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047516+0000","last_change":"2024-09-11T22:20:23.878383+0000","last_active":"2024-09-11T22:20:27.047516+0000","last_peered":"2024-09-11T22:20:27.047516+0000","last_clean":"2024-09-11T22:20:27.047516+0000","last_became_active":"2024-09-11T22:20:23.877890+0000","last_became_peered":"2024-09-11T22:20:23.877890+0000","last_unstale":"2024-09-11T22:20:27.047516+0000","last_undegraded":"2024-09-11T22:20:27.047516+0000","last_fullsized":"2024-09-11T22:20:27.047516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:18.876485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048434+0000","last_change":"2024-09-11T22:20:19.861242+0000","last_active":"2024-09-11T22:20:27.048434+0000","last_peered":"2024-09-11T22:20:27.048434+0000","last_clean":"2024-09-11T22:20:27.048434+0000","last_became_active":"2024-09-11T22:20:19.860988+0000","last_became_peered":"2024-09-11T22:20:19.860988+0000","last_unstale":"2024-09-11T22:20:27.048434+0000","last_undegraded":"2024-09-11T22:20:27.048434+0000","last_fullsized":"2024-09-11T22:20:27.048434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951217+0000","last_change":"2024-09-11T22:20:18.852459+0000","last_active":"2024-09-11T22:20:26.951217+0000","last_peered":"2024-09-11T22:20:26.951217+0000","last_clean":"2024-09-11T22:20:26.951217+0000","last_became_active":"2024-09-11T22:20:18.852153+0000","last_became_peered":"2024-09-11T22:20:18.852153+0000","last_unstale":"2024-09-11T22:20:26.951217+0000","last_undegraded":"2024-09-11T22:20:26.951217+0000","last_fullsized":"2024-09-11T22:20:26.951217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048026+0000","last_change":"2024-09-11T22:20:23.874062+0000","last_active":"2024-09-11T22:20:27.048026+0000","last_peered":"2024-09-11T22:20:27.048026+0000","last_clean":"2024-09-11T22:20:27.048026+0000","last_became_active":"2024-09-11T22:20:23.873635+0000","last_became_peered":"2024-09-11T22:20:23.873635+0000","last_unstale":"2024-09-11T22:20:27.048026+0000","last_undegraded":"2024-09-11T22:20:27.048026+0000","last_fullsized":"2024-09-11T22:20:27.048026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:40.914142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888125+0000","last_change":"2024-09-11T22:20:19.851577+0000","last_active":"2024-09-11T22:20:24.888125+0000","last_peered":"2024-09-11T22:20:24.888125+0000","last_clean":"2024-09-11T22:20:24.888125+0000","last_became_active":"2024-09-11T22:20:19.851286+0000","last_became_peered":"2024-09-11T22:20:19.851286+0000","last_unstale":"2024-09-11T22:20:24.888125+0000","last_undegraded":"2024-09-11T22:20:24.888125+0000","last_fullsized":"2024-09-11T22:20:24.888125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:32.025931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888304+0000","last_change":"2024-09-11T22:20:18.853301+0000","last_active":"2024-09-11T22:20:24.888304+0000","last_peered":"2024-09-11T22:20:24.888304+0000","last_clean":"2024-09-11T22:20:24.888304+0000","last_became_active":"2024-09-11T22:20:18.852978+0000","last_became_peered":"2024-09-11T22:20:18.852978+0000","last_unstale":"2024-09-11T22:20:24.888304+0000","last_undegraded":"2024-09-11T22:20:24.888304+0000","last_fullsized":"2024-09-11T22:20:24.888304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888069+0000","last_change":"2024-09-11T22:20:24.077636+0000","last_active":"2024-09-11T22:20:24.888069+0000","last_peered":"2024-09-11T22:20:24.888069+0000","last_clean":"2024-09-11T22:20:24.888069+0000","last_became_active":"2024-09-11T22:20:24.077313+0000","last_became_peered":"2024-09-11T22:20:24.077313+0000","last_unstale":"2024-09-11T22:20:24.888069+0000","last_undegraded":"2024-09-11T22:20:24.888069+0000","last_fullsized":"2024-09-11T22:20:24.888069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:23.154027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048723+0000","last_change":"2024-09-11T22:20:19.862562+0000","last_active":"2024-09-11T22:20:27.048723+0000","last_peered":"2024-09-11T22:20:27.048723+0000","last_clean":"2024-09-11T22:20:27.048723+0000","last_became_active":"2024-09-11T22:20:19.862267+0000","last_became_peered":"2024-09-11T22:20:19.862267+0000","last_unstale":"2024-09-11T22:20:27.048723+0000","last_undegraded":"2024-09-11T22:20:27.048723+0000","last_fullsized":"2024-09-11T22:20:27.048723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.948867+0000","last_change":"2024-09-11T22:20:18.858002+0000","last_active":"2024-09-11T22:20:46.948867+0000","last_peered":"2024-09-11T22:20:46.948867+0000","last_clean":"2024-09-11T22:20:46.948867+0000","last_became_active":"2024-09-11T22:20:18.857419+0000","last_became_peered":"2024-09-11T22:20:18.857419+0000","last_unstale":"2024-09-11T22:20:46.948867+0000","last_undegraded":"2024-09-11T22:20:46.948867+0000","last_fullsized":"2024-09-11T22:20:46.948867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887723+0000","last_change":"2024-09-11T22:20:24.074971+0000","last_active":"2024-09-11T22:20:24.887723+0000","last_peered":"2024-09-11T22:20:24.887723+0000","last_clean":"2024-09-11T22:20:24.887723+0000","last_became_active":"2024-09-11T22:20:24.074609+0000","last_became_peered":"2024-09-11T22:20:24.074609+0000","last_unstale":"2024-09-11T22:20:24.887723+0000","last_undegraded":"2024-09-11T22:20:24.887723+0000","last_fullsized":"2024-09-11T22:20:24.887723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:55.318904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047865+0000","last_change":"2024-09-11T22:20:19.857276+0000","last_active":"2024-09-11T22:20:27.047865+0000","last_peered":"2024-09-11T22:20:27.047865+0000","last_clean":"2024-09-11T22:20:27.047865+0000","last_became_active":"2024-09-11T22:20:19.857027+0000","last_became_peered":"2024-09-11T22:20:19.857027+0000","last_unstale":"2024-09-11T22:20:27.047865+0000","last_undegraded":"2024-09-11T22:20:27.047865+0000","last_fullsized":"2024-09-11T22:20:27.047865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048222+0000","last_change":"2024-09-11T22:20:18.848671+0000","last_active":"2024-09-11T22:20:27.048222+0000","last_peered":"2024-09-11T22:20:27.048222+0000","last_clean":"2024-09-11T22:20:27.048222+0000","last_became_active":"2024-09-11T22:20:18.848405+0000","last_became_peered":"2024-09-11T22:20:18.848405+0000","last_unstale":"2024-09-11T22:20:27.048222+0000","last_undegraded":"2024-09-11T22:20:27.048222+0000","last_fullsized":"2024-09-11T22:20:27.048222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890660+0000","last_change":"2024-09-11T22:20:24.076835+0000","last_active":"2024-09-11T22:20:24.890660+0000","last_peered":"2024-09-11T22:20:24.890660+0000","last_clean":"2024-09-11T22:20:24.890660+0000","last_became_active":"2024-09-11T22:20:24.076200+0000","last_became_peered":"2024-09-11T22:20:24.076200+0000","last_unstale":"2024-09-11T22:20:24.890660+0000","last_undegraded":"2024-09-11T22:20:24.890660+0000","last_fullsized":"2024-09-11T22:20:24.890660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:48.150778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048503+0000","last_change":"2024-09-11T22:20:19.855334+0000","last_active":"2024-09-11T22:20:27.048503+0000","last_peered":"2024-09-11T22:20:27.048503+0000","last_clean":"2024-09-11T22:20:27.048503+0000","last_became_active":"2024-09-11T22:20:19.855018+0000","last_became_peered":"2024-09-11T22:20:19.855018+0000","last_unstale":"2024-09-11T22:20:27.048503+0000","last_undegraded":"2024-09-11T22:20:27.048503+0000","last_fullsized":"2024-09-11T22:20:27.048503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'11","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.946283+0000","last_change":"2024-09-11T22:20:18.855665+0000","last_active":"2024-09-11T22:20:46.946283+0000","last_peered":"2024-09-11T22:20:46.946283+0000","last_clean":"2024-09-11T22:20:46.946283+0000","last_became_active":"2024-09-11T22:20:18.855386+0000","last_became_peered":"2024-09-11T22:20:18.855386+0000","last_unstale":"2024-09-11T22:20:46.946283+0000","last_undegraded":"2024-09-11T22:20:46.946283+0000","last_fullsized":"2024-09-11T22:20:46.946283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998100+0000","last_change":"2024-09-11T22:20:23.880793+0000","last_active":"2024-09-11T22:20:24.998100+0000","last_peered":"2024-09-11T22:20:24.998100+0000","last_clean":"2024-09-11T22:20:24.998100+0000","last_became_active":"2024-09-11T22:20:23.879993+0000","last_became_peered":"2024-09-11T22:20:23.879993+0000","last_unstale":"2024-09-11T22:20:24.998100+0000","last_undegraded":"2024-09-11T22:20:24.998100+0000","last_fullsized":"2024-09-11T22:20:24.998100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:50.449090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048075+0000","last_change":"2024-09-11T22:20:19.858588+0000","last_active":"2024-09-11T22:20:27.048075+0000","last_peered":"2024-09-11T22:20:27.048075+0000","last_clean":"2024-09-11T22:20:27.048075+0000","last_became_active":"2024-09-11T22:20:19.858322+0000","last_became_peered":"2024-09-11T22:20:19.858322+0000","last_unstale":"2024-09-11T22:20:27.048075+0000","last_undegraded":"2024-09-11T22:20:27.048075+0000","last_fullsized":"2024-09-11T22:20:27.048075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"25'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998071+0000","last_change":"2024-09-11T22:20:18.855056+0000","last_active":"2024-09-11T22:20:24.998071+0000","last_peered":"2024-09-11T22:20:24.998071+0000","last_clean":"2024-09-11T22:20:24.998071+0000","last_became_active":"2024-09-11T22:20:18.854784+0000","last_became_peered":"2024-09-11T22:20:18.854784+0000","last_unstale":"2024-09-11T22:20:24.998071+0000","last_undegraded":"2024-09-11T22:20:24.998071+0000","last_fullsized":"2024-09-11T22:20:24.998071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:38.916121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048044+0000","last_change":"2024-09-11T22:20:23.879768+0000","last_active":"2024-09-11T22:20:27.048044+0000","last_peered":"2024-09-11T22:20:27.048044+0000","last_clean":"2024-09-11T22:20:27.048044+0000","last_became_active":"2024-09-11T22:20:23.878794+0000","last_became_peered":"2024-09-11T22:20:23.878794+0000","last_unstale":"2024-09-11T22:20:27.048044+0000","last_undegraded":"2024-09-11T22:20:27.048044+0000","last_fullsized":"2024-09-11T22:20:27.048044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:07.301587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048230+0000","last_change":"2024-09-11T22:20:19.862315+0000","last_active":"2024-09-11T22:20:27.048230+0000","last_peered":"2024-09-11T22:20:27.048230+0000","last_clean":"2024-09-11T22:20:27.048230+0000","last_became_active":"2024-09-11T22:20:19.861607+0000","last_became_peered":"2024-09-11T22:20:19.861607+0000","last_unstale":"2024-09-11T22:20:27.048230+0000","last_undegraded":"2024-09-11T22:20:27.048230+0000","last_fullsized":"2024-09-11T22:20:27.048230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.946689+0000","last_change":"2024-09-11T22:20:18.853382+0000","last_active":"2024-09-11T22:20:46.946689+0000","last_peered":"2024-09-11T22:20:46.946689+0000","last_clean":"2024-09-11T22:20:46.946689+0000","last_became_active":"2024-09-11T22:20:18.853103+0000","last_became_peered":"2024-09-11T22:20:18.853103+0000","last_unstale":"2024-09-11T22:20:46.946689+0000","last_undegraded":"2024-09-11T22:20:46.946689+0000","last_fullsized":"2024-09-11T22:20:46.946689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887490+0000","last_change":"2024-09-11T22:20:23.876997+0000","last_active":"2024-09-11T22:20:24.887490+0000","last_peered":"2024-09-11T22:20:24.887490+0000","last_clean":"2024-09-11T22:20:24.887490+0000","last_became_active":"2024-09-11T22:20:23.876587+0000","last_became_peered":"2024-09-11T22:20:23.876587+0000","last_unstale":"2024-09-11T22:20:24.887490+0000","last_undegraded":"2024-09-11T22:20:24.887490+0000","last_fullsized":"2024-09-11T22:20:24.887490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:19.670665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889342+0000","last_change":"2024-09-11T22:20:19.866624+0000","last_active":"2024-09-11T22:20:24.889342+0000","last_peered":"2024-09-11T22:20:24.889342+0000","last_clean":"2024-09-11T22:20:24.889342+0000","last_became_active":"2024-09-11T22:20:19.866303+0000","last_became_peered":"2024-09-11T22:20:19.866303+0000","last_unstale":"2024-09-11T22:20:24.889342+0000","last_undegraded":"2024-09-11T22:20:24.889342+0000","last_fullsized":"2024-09-11T22:20:24.889342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.946175+0000","last_change":"2024-09-11T22:20:18.854361+0000","last_active":"2024-09-11T22:20:46.946175+0000","last_peered":"2024-09-11T22:20:46.946175+0000","last_clean":"2024-09-11T22:20:46.946175+0000","last_became_active":"2024-09-11T22:20:18.854019+0000","last_became_peered":"2024-09-11T22:20:18.854019+0000","last_unstale":"2024-09-11T22:20:46.946175+0000","last_undegraded":"2024-09-11T22:20:46.946175+0000","last_fullsized":"2024-09-11T22:20:46.946175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887284+0000","last_change":"2024-09-11T22:20:24.077476+0000","last_active":"2024-09-11T22:20:24.887284+0000","last_peered":"2024-09-11T22:20:24.887284+0000","last_clean":"2024-09-11T22:20:24.887284+0000","last_became_active":"2024-09-11T22:20:24.077134+0000","last_became_peered":"2024-09-11T22:20:24.077134+0000","last_unstale":"2024-09-11T22:20:24.887284+0000","last_undegraded":"2024-09-11T22:20:24.887284+0000","last_fullsized":"2024-09-11T22:20:24.887284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:03.186460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048035+0000","last_change":"2024-09-11T22:20:24.077143+0000","last_active":"2024-09-11T22:20:27.048035+0000","last_peered":"2024-09-11T22:20:27.048035+0000","last_clean":"2024-09-11T22:20:27.048035+0000","last_became_active":"2024-09-11T22:20:24.076592+0000","last_became_peered":"2024-09-11T22:20:24.076592+0000","last_unstale":"2024-09-11T22:20:27.048035+0000","last_undegraded":"2024-09-11T22:20:27.048035+0000","last_fullsized":"2024-09-11T22:20:27.048035+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:02.661077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997676+0000","last_change":"2024-09-11T22:20:19.845776+0000","last_active":"2024-09-11T22:20:24.997676+0000","last_peered":"2024-09-11T22:20:24.997676+0000","last_clean":"2024-09-11T22:20:24.997676+0000","last_became_active":"2024-09-11T22:20:19.845425+0000","last_became_peered":"2024-09-11T22:20:19.845425+0000","last_unstale":"2024-09-11T22:20:24.997676+0000","last_undegraded":"2024-09-11T22:20:24.997676+0000","last_fullsized":"2024-09-11T22:20:24.997676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:07.187533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889087+0000","last_change":"2024-09-11T22:20:18.852446+0000","last_active":"2024-09-11T22:20:24.889087+0000","last_peered":"2024-09-11T22:20:24.889087+0000","last_clean":"2024-09-11T22:20:24.889087+0000","last_became_active":"2024-09-11T22:20:18.852155+0000","last_became_peered":"2024-09-11T22:20:18.852155+0000","last_unstale":"2024-09-11T22:20:24.889087+0000","last_undegraded":"2024-09-11T22:20:24.889087+0000","last_fullsized":"2024-09-11T22:20:24.889087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889233+0000","last_change":"2024-09-11T22:20:23.876503+0000","last_active":"2024-09-11T22:20:24.889233+0000","last_peered":"2024-09-11T22:20:24.889233+0000","last_clean":"2024-09-11T22:20:24.889233+0000","last_became_active":"2024-09-11T22:20:23.876100+0000","last_became_peered":"2024-09-11T22:20:23.876100+0000","last_unstale":"2024-09-11T22:20:24.889233+0000","last_undegraded":"2024-09-11T22:20:24.889233+0000","last_fullsized":"2024-09-11T22:20:24.889233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887311+0000","last_change":"2024-09-11T22:20:19.852606+0000","last_active":"2024-09-11T22:20:24.887311+0000","last_peered":"2024-09-11T22:20:24.887311+0000","last_clean":"2024-09-11T22:20:24.887311+0000","last_became_active":"2024-09-11T22:20:19.852333+0000","last_became_peered":"2024-09-11T22:20:19.852333+0000","last_unstale":"2024-09-11T22:20:24.887311+0000","last_undegraded":"2024-09-11T22:20:24.887311+0000","last_fullsized":"2024-09-11T22:20:24.887311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:56.940278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887444+0000","last_change":"2024-09-11T22:20:18.853767+0000","last_active":"2024-09-11T22:20:24.887444+0000","last_peered":"2024-09-11T22:20:24.887444+0000","last_clean":"2024-09-11T22:20:24.887444+0000","last_became_active":"2024-09-11T22:20:18.853533+0000","last_became_peered":"2024-09-11T22:20:18.853533+0000","last_unstale":"2024-09-11T22:20:24.887444+0000","last_undegraded":"2024-09-11T22:20:24.887444+0000","last_fullsized":"2024-09-11T22:20:24.887444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:36.662271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888381+0000","last_change":"2024-09-11T22:20:18.847133+0000","last_active":"2024-09-11T22:20:24.888381+0000","last_peered":"2024-09-11T22:20:24.888381+0000","last_clean":"2024-09-11T22:20:24.888381+0000","last_became_active":"2024-09-11T22:20:18.846321+0000","last_became_peered":"2024-09-11T22:20:18.846321+0000","last_unstale":"2024-09-11T22:20:24.888381+0000","last_undegraded":"2024-09-11T22:20:24.888381+0000","last_fullsized":"2024-09-11T22:20:24.888381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048164+0000","last_change":"2024-09-11T22:20:19.861445+0000","last_active":"2024-09-11T22:20:27.048164+0000","last_peered":"2024-09-11T22:20:27.048164+0000","last_clean":"2024-09-11T22:20:27.048164+0000","last_became_active":"2024-09-11T22:20:19.861154+0000","last_became_peered":"2024-09-11T22:20:19.861154+0000","last_unstale":"2024-09-11T22:20:27.048164+0000","last_undegraded":"2024-09-11T22:20:27.048164+0000","last_fullsized":"2024-09-11T22:20:27.048164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951525+0000","last_change":"2024-09-11T22:20:23.877973+0000","last_active":"2024-09-11T22:20:26.951525+0000","last_peered":"2024-09-11T22:20:26.951525+0000","last_clean":"2024-09-11T22:20:26.951525+0000","last_became_active":"2024-09-11T22:20:23.877578+0000","last_became_peered":"2024-09-11T22:20:23.877578+0000","last_unstale":"2024-09-11T22:20:26.951525+0000","last_undegraded":"2024-09-11T22:20:26.951525+0000","last_fullsized":"2024-09-11T22:20:26.951525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:27.826669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.948565+0000","last_change":"2024-09-11T22:20:18.854142+0000","last_active":"2024-09-11T22:20:46.948565+0000","last_peered":"2024-09-11T22:20:46.948565+0000","last_clean":"2024-09-11T22:20:46.948565+0000","last_became_active":"2024-09-11T22:20:18.853872+0000","last_became_peered":"2024-09-11T22:20:18.853872+0000","last_unstale":"2024-09-11T22:20:46.948565+0000","last_undegraded":"2024-09-11T22:20:46.948565+0000","last_fullsized":"2024-09-11T22:20:46.948565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:22.513242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047903+0000","last_change":"2024-09-11T22:20:19.852580+0000","last_active":"2024-09-11T22:20:27.047903+0000","last_peered":"2024-09-11T22:20:27.047903+0000","last_clean":"2024-09-11T22:20:27.047903+0000","last_became_active":"2024-09-11T22:20:19.850175+0000","last_became_peered":"2024-09-11T22:20:19.850175+0000","last_unstale":"2024-09-11T22:20:27.047903+0000","last_undegraded":"2024-09-11T22:20:27.047903+0000","last_fullsized":"2024-09-11T22:20:27.047903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:11.937256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887822+0000","last_change":"2024-09-11T22:20:23.878004+0000","last_active":"2024-09-11T22:20:24.887822+0000","last_peered":"2024-09-11T22:20:24.887822+0000","last_clean":"2024-09-11T22:20:24.887822+0000","last_became_active":"2024-09-11T22:20:23.876776+0000","last_became_peered":"2024-09-11T22:20:23.876776+0000","last_unstale":"2024-09-11T22:20:24.887822+0000","last_undegraded":"2024-09-11T22:20:24.887822+0000","last_fullsized":"2024-09-11T22:20:24.887822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:11.254248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887933+0000","last_change":"2024-09-11T22:20:19.853439+0000","last_active":"2024-09-11T22:20:24.887933+0000","last_peered":"2024-09-11T22:20:24.887933+0000","last_clean":"2024-09-11T22:20:24.887933+0000","last_became_active":"2024-09-11T22:20:19.852937+0000","last_became_peered":"2024-09-11T22:20:19.852937+0000","last_unstale":"2024-09-11T22:20:24.887933+0000","last_undegraded":"2024-09-11T22:20:24.887933+0000","last_fullsized":"2024-09-11T22:20:24.887933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951404+0000","last_change":"2024-09-11T22:20:19.861003+0000","last_active":"2024-09-11T22:20:26.951404+0000","last_peered":"2024-09-11T22:20:26.951404+0000","last_clean":"2024-09-11T22:20:26.951404+0000","last_became_active":"2024-09-11T22:20:19.860690+0000","last_became_peered":"2024-09-11T22:20:19.860690+0000","last_unstale":"2024-09-11T22:20:26.951404+0000","last_undegraded":"2024-09-11T22:20:26.951404+0000","last_fullsized":"2024-09-11T22:20:26.951404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889798+0000","last_change":"2024-09-11T22:20:19.856756+0000","last_active":"2024-09-11T22:20:24.889798+0000","last_peered":"2024-09-11T22:20:24.889798+0000","last_clean":"2024-09-11T22:20:24.889798+0000","last_became_active":"2024-09-11T22:20:19.856460+0000","last_became_peered":"2024-09-11T22:20:19.856460+0000","last_unstale":"2024-09-11T22:20:24.889798+0000","last_undegraded":"2024-09-11T22:20:24.889798+0000","last_fullsized":"2024-09-11T22:20:24.889798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048092+0000","last_change":"2024-09-11T22:20:19.855629+0000","last_active":"2024-09-11T22:20:27.048092+0000","last_peered":"2024-09-11T22:20:27.048092+0000","last_clean":"2024-09-11T22:20:27.048092+0000","last_became_active":"2024-09-11T22:20:19.855363+0000","last_became_peered":"2024-09-11T22:20:19.855363+0000","last_unstale":"2024-09-11T22:20:27.048092+0000","last_undegraded":"2024-09-11T22:20:27.048092+0000","last_fullsized":"2024-09-11T22:20:27.048092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887872+0000","last_change":"2024-09-11T22:20:19.863122+0000","last_active":"2024-09-11T22:20:24.887872+0000","last_peered":"2024-09-11T22:20:24.887872+0000","last_clean":"2024-09-11T22:20:24.887872+0000","last_became_active":"2024-09-11T22:20:19.862828+0000","last_became_peered":"2024-09-11T22:20:19.862828+0000","last_unstale":"2024-09-11T22:20:24.887872+0000","last_undegraded":"2024-09-11T22:20:24.887872+0000","last_fullsized":"2024-09-11T22:20:24.887872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:10.868762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997865+0000","last_change":"2024-09-11T22:20:19.846453+0000","last_active":"2024-09-11T22:20:24.997865+0000","last_peered":"2024-09-11T22:20:24.997865+0000","last_clean":"2024-09-11T22:20:24.997865+0000","last_became_active":"2024-09-11T22:20:19.846186+0000","last_became_peered":"2024-09-11T22:20:19.846186+0000","last_unstale":"2024-09-11T22:20:24.997865+0000","last_undegraded":"2024-09-11T22:20:24.997865+0000","last_fullsized":"2024-09-11T22:20:24.997865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:24.032365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888935+0000","last_change":"2024-09-11T22:20:19.860632+0000","last_active":"2024-09-11T22:20:24.888935+0000","last_peered":"2024-09-11T22:20:24.888935+0000","last_clean":"2024-09-11T22:20:24.888935+0000","last_became_active":"2024-09-11T22:20:19.860005+0000","last_became_peered":"2024-09-11T22:20:19.860005+0000","last_unstale":"2024-09-11T22:20:24.888935+0000","last_undegraded":"2024-09-11T22:20:24.888935+0000","last_fullsized":"2024-09-11T22:20:24.888935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888034+0000","last_change":"2024-09-11T22:20:19.859195+0000","last_active":"2024-09-11T22:20:24.888034+0000","last_peered":"2024-09-11T22:20:24.888034+0000","last_clean":"2024-09-11T22:20:24.888034+0000","last_became_active":"2024-09-11T22:20:19.858832+0000","last_became_peered":"2024-09-11T22:20:19.858832+0000","last_unstale":"2024-09-11T22:20:24.888034+0000","last_undegraded":"2024-09-11T22:20:24.888034+0000","last_fullsized":"2024-09-11T22:20:24.888034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:56.259074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888950+0000","last_change":"2024-09-11T22:20:19.858969+0000","last_active":"2024-09-11T22:20:24.888950+0000","last_peered":"2024-09-11T22:20:24.888950+0000","last_clean":"2024-09-11T22:20:24.888950+0000","last_became_active":"2024-09-11T22:20:19.857847+0000","last_became_peered":"2024-09-11T22:20:19.857847+0000","last_unstale":"2024-09-11T22:20:24.888950+0000","last_undegraded":"2024-09-11T22:20:24.888950+0000","last_fullsized":"2024-09-11T22:20:24.888950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887453+0000","last_change":"2024-09-11T22:20:19.863294+0000","last_active":"2024-09-11T22:20:24.887453+0000","last_peered":"2024-09-11T22:20:24.887453+0000","last_clean":"2024-09-11T22:20:24.887453+0000","last_became_active":"2024-09-11T22:20:19.863007+0000","last_became_peered":"2024-09-11T22:20:19.863007+0000","last_unstale":"2024-09-11T22:20:24.887453+0000","last_undegraded":"2024-09-11T22:20:24.887453+0000","last_fullsized":"2024-09-11T22:20:24.887453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:06.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889706+0000","last_change":"2024-09-11T22:20:19.858414+0000","last_active":"2024-09-11T22:20:24.889706+0000","last_peered":"2024-09-11T22:20:24.889706+0000","last_clean":"2024-09-11T22:20:24.889706+0000","last_became_active":"2024-09-11T22:20:19.857790+0000","last_became_peered":"2024-09-11T22:20:19.857790+0000","last_unstale":"2024-09-11T22:20:24.889706+0000","last_undegraded":"2024-09-11T22:20:24.889706+0000","last_fullsized":"2024-09-11T22:20:24.889706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047879+0000","last_change":"2024-09-11T22:20:19.855053+0000","last_active":"2024-09-11T22:20:27.047879+0000","last_peered":"2024-09-11T22:20:27.047879+0000","last_clean":"2024-09-11T22:20:27.047879+0000","last_became_active":"2024-09-11T22:20:19.854774+0000","last_became_peered":"2024-09-11T22:20:19.854774+0000","last_unstale":"2024-09-11T22:20:27.047879+0000","last_undegraded":"2024-09-11T22:20:27.047879+0000","last_fullsized":"2024-09-11T22:20:27.047879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:32.025931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888845+0000","last_change":"2024-09-11T22:20:19.864700+0000","last_active":"2024-09-11T22:20:24.888845+0000","last_peered":"2024-09-11T22:20:24.888845+0000","last_clean":"2024-09-11T22:20:24.888845+0000","last_became_active":"2024-09-11T22:20:19.862296+0000","last_became_peered":"2024-09-11T22:20:19.862296+0000","last_unstale":"2024-09-11T22:20:24.888845+0000","last_undegraded":"2024-09-11T22:20:24.888845+0000","last_fullsized":"2024-09-11T22:20:24.888845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048773+0000","last_change":"2024-09-11T22:20:19.855253+0000","last_active":"2024-09-11T22:20:27.048773+0000","last_peered":"2024-09-11T22:20:27.048773+0000","last_clean":"2024-09-11T22:20:27.048773+0000","last_became_active":"2024-09-11T22:20:19.854970+0000","last_became_peered":"2024-09-11T22:20:19.854970+0000","last_unstale":"2024-09-11T22:20:27.048773+0000","last_undegraded":"2024-09-11T22:20:27.048773+0000","last_fullsized":"2024-09-11T22:20:27.048773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:26.951690+0000","last_change":"2024-09-11T22:20:19.850202+0000","last_active":"2024-09-11T22:20:26.951690+0000","last_peered":"2024-09-11T22:20:26.951690+0000","last_clean":"2024-09-11T22:20:26.951690+0000","last_became_active":"2024-09-11T22:20:19.849815+0000","last_became_peered":"2024-09-11T22:20:19.849815+0000","last_unstale":"2024-09-11T22:20:26.951690+0000","last_undegraded":"2024-09-11T22:20:26.951690+0000","last_fullsized":"2024-09-11T22:20:26.951690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:56.480679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889814+0000","last_change":"2024-09-11T22:20:19.866864+0000","last_active":"2024-09-11T22:20:24.889814+0000","last_peered":"2024-09-11T22:20:24.889814+0000","last_clean":"2024-09-11T22:20:24.889814+0000","last_became_active":"2024-09-11T22:20:19.866484+0000","last_became_peered":"2024-09-11T22:20:19.866484+0000","last_unstale":"2024-09-11T22:20:24.889814+0000","last_undegraded":"2024-09-11T22:20:24.889814+0000","last_fullsized":"2024-09-11T22:20:24.889814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888850+0000","last_change":"2024-09-11T22:20:19.859573+0000","last_active":"2024-09-11T22:20:24.888850+0000","last_peered":"2024-09-11T22:20:24.888850+0000","last_clean":"2024-09-11T22:20:24.888850+0000","last_became_active":"2024-09-11T22:20:19.859266+0000","last_became_peered":"2024-09-11T22:20:19.859266+0000","last_unstale":"2024-09-11T22:20:24.888850+0000","last_undegraded":"2024-09-11T22:20:24.888850+0000","last_fullsized":"2024-09-11T22:20:24.888850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997750+0000","last_change":"2024-09-11T22:20:19.860050+0000","last_active":"2024-09-11T22:20:24.997750+0000","last_peered":"2024-09-11T22:20:24.997750+0000","last_clean":"2024-09-11T22:20:24.997750+0000","last_became_active":"2024-09-11T22:20:19.859755+0000","last_became_peered":"2024-09-11T22:20:19.859755+0000","last_unstale":"2024-09-11T22:20:24.997750+0000","last_undegraded":"2024-09-11T22:20:24.997750+0000","last_fullsized":"2024-09-11T22:20:24.997750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:42.487669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047797+0000","last_change":"2024-09-11T22:20:19.853902+0000","last_active":"2024-09-11T22:20:27.047797+0000","last_peered":"2024-09-11T22:20:27.047797+0000","last_clean":"2024-09-11T22:20:27.047797+0000","last_became_active":"2024-09-11T22:20:19.853563+0000","last_became_peered":"2024-09-11T22:20:19.853563+0000","last_unstale":"2024-09-11T22:20:27.047797+0000","last_undegraded":"2024-09-11T22:20:27.047797+0000","last_fullsized":"2024-09-11T22:20:27.047797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887571+0000","last_change":"2024-09-11T22:20:19.849490+0000","last_active":"2024-09-11T22:20:24.887571+0000","last_peered":"2024-09-11T22:20:24.887571+0000","last_clean":"2024-09-11T22:20:24.887571+0000","last_became_active":"2024-09-11T22:20:19.848965+0000","last_became_peered":"2024-09-11T22:20:19.848965+0000","last_unstale":"2024-09-11T22:20:24.887571+0000","last_undegraded":"2024-09-11T22:20:24.887571+0000","last_fullsized":"2024-09-11T22:20:24.887571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:10.387663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048041+0000","last_change":"2024-09-11T22:20:19.860457+0000","last_active":"2024-09-11T22:20:27.048041+0000","last_peered":"2024-09-11T22:20:27.048041+0000","last_clean":"2024-09-11T22:20:27.048041+0000","last_became_active":"2024-09-11T22:20:19.858887+0000","last_became_peered":"2024-09-11T22:20:19.858887+0000","last_unstale":"2024-09-11T22:20:27.048041+0000","last_undegraded":"2024-09-11T22:20:27.048041+0000","last_fullsized":"2024-09-11T22:20:27.048041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:34.620956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888481+0000","last_change":"2024-09-11T22:20:19.862347+0000","last_active":"2024-09-11T22:20:24.888481+0000","last_peered":"2024-09-11T22:20:24.888481+0000","last_clean":"2024-09-11T22:20:24.888481+0000","last_became_active":"2024-09-11T22:20:19.861965+0000","last_became_peered":"2024-09-11T22:20:19.861965+0000","last_unstale":"2024-09-11T22:20:24.888481+0000","last_undegraded":"2024-09-11T22:20:24.888481+0000","last_fullsized":"2024-09-11T22:20:24.888481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888938+0000","last_change":"2024-09-11T22:20:19.862065+0000","last_active":"2024-09-11T22:20:24.888938+0000","last_peered":"2024-09-11T22:20:24.888938+0000","last_clean":"2024-09-11T22:20:24.888938+0000","last_became_active":"2024-09-11T22:20:19.861765+0000","last_became_peered":"2024-09-11T22:20:19.861765+0000","last_unstale":"2024-09-11T22:20:24.888938+0000","last_undegraded":"2024-09-11T22:20:24.888938+0000","last_fullsized":"2024-09-11T22:20:24.888938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.049117+0000","last_change":"2024-09-11T22:20:19.865064+0000","last_active":"2024-09-11T22:20:27.049117+0000","last_peered":"2024-09-11T22:20:27.049117+0000","last_clean":"2024-09-11T22:20:27.049117+0000","last_became_active":"2024-09-11T22:20:19.864697+0000","last_became_peered":"2024-09-11T22:20:19.864697+0000","last_unstale":"2024-09-11T22:20:27.049117+0000","last_undegraded":"2024-09-11T22:20:27.049117+0000","last_fullsized":"2024-09-11T22:20:27.049117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887201+0000","last_change":"2024-09-11T22:20:19.861293+0000","last_active":"2024-09-11T22:20:24.887201+0000","last_peered":"2024-09-11T22:20:24.887201+0000","last_clean":"2024-09-11T22:20:24.887201+0000","last_became_active":"2024-09-11T22:20:19.861013+0000","last_became_peered":"2024-09-11T22:20:19.861013+0000","last_unstale":"2024-09-11T22:20:24.887201+0000","last_undegraded":"2024-09-11T22:20:24.887201+0000","last_fullsized":"2024-09-11T22:20:24.887201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:13.178404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048303+0000","last_change":"2024-09-11T22:20:19.858131+0000","last_active":"2024-09-11T22:20:27.048303+0000","last_peered":"2024-09-11T22:20:27.048303+0000","last_clean":"2024-09-11T22:20:27.048303+0000","last_became_active":"2024-09-11T22:20:19.857842+0000","last_became_peered":"2024-09-11T22:20:19.857842+0000","last_unstale":"2024-09-11T22:20:27.048303+0000","last_undegraded":"2024-09-11T22:20:27.048303+0000","last_fullsized":"2024-09-11T22:20:27.048303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889602+0000","last_change":"2024-09-11T22:20:19.859667+0000","last_active":"2024-09-11T22:20:24.889602+0000","last_peered":"2024-09-11T22:20:24.889602+0000","last_clean":"2024-09-11T22:20:24.889602+0000","last_became_active":"2024-09-11T22:20:19.859306+0000","last_became_peered":"2024-09-11T22:20:19.859306+0000","last_unstale":"2024-09-11T22:20:24.889602+0000","last_undegraded":"2024-09-11T22:20:24.889602+0000","last_fullsized":"2024-09-11T22:20:24.889602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048551+0000","last_change":"2024-09-11T22:20:19.848821+0000","last_active":"2024-09-11T22:20:27.048551+0000","last_peered":"2024-09-11T22:20:27.048551+0000","last_clean":"2024-09-11T22:20:27.048551+0000","last_became_active":"2024-09-11T22:20:19.848531+0000","last_became_peered":"2024-09-11T22:20:19.848531+0000","last_unstale":"2024-09-11T22:20:27.048551+0000","last_undegraded":"2024-09-11T22:20:27.048551+0000","last_fullsized":"2024-09-11T22:20:27.048551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890212+0000","last_change":"2024-09-11T22:20:19.866300+0000","last_active":"2024-09-11T22:20:24.890212+0000","last_peered":"2024-09-11T22:20:24.890212+0000","last_clean":"2024-09-11T22:20:24.890212+0000","last_became_active":"2024-09-11T22:20:19.865939+0000","last_became_peered":"2024-09-11T22:20:19.865939+0000","last_unstale":"2024-09-11T22:20:24.890212+0000","last_undegraded":"2024-09-11T22:20:24.890212+0000","last_fullsized":"2024-09-11T22:20:24.890212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047932+0000","last_change":"2024-09-11T22:20:19.858144+0000","last_active":"2024-09-11T22:20:27.047932+0000","last_peered":"2024-09-11T22:20:27.047932+0000","last_clean":"2024-09-11T22:20:27.047932+0000","last_became_active":"2024-09-11T22:20:19.857840+0000","last_became_peered":"2024-09-11T22:20:19.857840+0000","last_unstale":"2024-09-11T22:20:27.047932+0000","last_undegraded":"2024-09-11T22:20:27.047932+0000","last_fullsized":"2024-09-11T22:20:27.047932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:23.801072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998195+0000","last_change":"2024-09-11T22:20:19.857378+0000","last_active":"2024-09-11T22:20:24.998195+0000","last_peered":"2024-09-11T22:20:24.998195+0000","last_clean":"2024-09-11T22:20:24.998195+0000","last_became_active":"2024-09-11T22:20:19.857089+0000","last_became_peered":"2024-09-11T22:20:19.857089+0000","last_unstale":"2024-09-11T22:20:24.998195+0000","last_undegraded":"2024-09-11T22:20:24.998195+0000","last_fullsized":"2024-09-11T22:20:24.998195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:29.835695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.049018+0000","last_change":"2024-09-11T22:20:19.852827+0000","last_active":"2024-09-11T22:20:27.049018+0000","last_peered":"2024-09-11T22:20:27.049018+0000","last_clean":"2024-09-11T22:20:27.049018+0000","last_became_active":"2024-09-11T22:20:19.852251+0000","last_became_peered":"2024-09-11T22:20:19.852251+0000","last_unstale":"2024-09-11T22:20:27.049018+0000","last_undegraded":"2024-09-11T22:20:27.049018+0000","last_fullsized":"2024-09-11T22:20:27.049018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:36.888544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5376,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":11402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":67,"ondisk_log_size":67,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":699002,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":111252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509452,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":108080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":107444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":111784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":107318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":348160,"data_stored":698324,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":278528,"data_stored":107478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:20:51.073 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T22:20:51.073 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T22:20:51.073 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-11T22:20:51.073 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-11T22:20:51.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.206+0000 7fc3bc55f640 1 Processor -- start 2024-09-11T22:20:51.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.206+0000 7fc3bc55f640 1 -- start start 2024-09-11T22:20:51.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.207+0000 7fc3bc55f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc3b4154c20 0x7fc3b40cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.207+0000 7fc3bc55f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3b40b3190 0x7fc3b415e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.207+0000 7fc3bc55f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3b415ac90 con 0x7fc3b415a7e0 2024-09-11T22:20:51.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.207+0000 7fc3bc55f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fc3b415e000 con 0x7fc3b4154c20 2024-09-11T22:20:51.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.207+0000 7fc3bc55f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc3b415af70 con 0x7fc3b40b3190 2024-09-11T22:20:51.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.208+0000 7fc3b9afa640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3b40b3190 0x7fc3b415e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.208+0000 7fc3ba2fb640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc3b4154c20 0x7fc3b40cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.208+0000 7fc3baafc640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fc3b415a7e0 0x7fc3b40cbd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:44330/0 (socket says 172.21.15.100:44330) 2024-09-11T22:20:51.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.208+0000 7fc3baafc640 1 -- 172.21.15.100:0/2595349953 learned_addr learned my addr 172.21.15.100:0/2595349953 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:51.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.208+0000 7fc3b92f9640 1 -- 172.21.15.100:0/2595349953 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1452209688 0 0) 0x7fc3b415ac90 con 0x7fc3b415a7e0 2024-09-11T22:20:51.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.208+0000 7fc3b9afa640 1 -- 172.21.15.100:0/2595349953 >> v2:172.21.15.167:3300/0 conn(0x7fc3b4154c20 msgr2=0x7fc3b40cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:51.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.208+0000 7fc3b9afa640 1 --2- 172.21.15.100:0/2595349953 >> v2:172.21.15.167:3300/0 conn(0x7fc3b4154c20 0x7fc3b40cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.208+0000 7fc3b9afa640 1 -- 172.21.15.100:0/2595349953 >> v1:172.21.15.167:6789/0 conn(0x7fc3b415a7e0 legacy=0x7fc3b40cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.208+0000 7fc3b9afa640 1 -- 172.21.15.100:0/2595349953 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b415b250 con 0x7fc3b40b3190 2024-09-11T22:20:51.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.209+0000 7fc3b9afa640 1 --2- 172.21.15.100:0/2595349953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3b40b3190 0x7fc3b415e490 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc3a40097a0 tx=0x7fc3a402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cce1d6e8ca447b5a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.209+0000 7fc3b92f9640 1 -- 172.21.15.100:0/2595349953 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4037070 con 0x7fc3b40b3190 2024-09-11T22:20:51.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.209+0000 7fc3b92f9640 1 -- 172.21.15.100:0/2595349953 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3a4032440 con 0x7fc3b40b3190 2024-09-11T22:20:51.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.209+0000 7fc3b92f9640 1 -- 172.21.15.100:0/2595349953 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4032810 con 0x7fc3b40b3190 2024-09-11T22:20:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.210+0000 7fc3bc55f640 1 -- 172.21.15.100:0/2595349953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3b40b3190 msgr2=0x7fc3b415e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.210+0000 7fc3bc55f640 1 --2- 172.21.15.100:0/2595349953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3b40b3190 0x7fc3b415e490 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc3a40097a0 tx=0x7fc3a402a180 comp rx=0 tx=0).stop 2024-09-11T22:20:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.210+0000 7fc3bc55f640 1 -- 172.21.15.100:0/2595349953 shutdown_connections 2024-09-11T22:20:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.210+0000 7fc3bc55f640 1 --2- 172.21.15.100:0/2595349953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3b40b3190 0x7fc3b415e490 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.210+0000 7fc3bc55f640 1 --2- 172.21.15.100:0/2595349953 >> v2:172.21.15.167:3300/0 conn(0x7fc3b4154c20 0x7fc3b40cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.210+0000 7fc3bc55f640 1 -- 172.21.15.100:0/2595349953 >> 172.21.15.100:0/2595349953 conn(0x7fc3b4067d40 msgr2=0x7fc3b406d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.210+0000 7fc3bc55f640 1 -- 172.21.15.100:0/2595349953 shutdown_connections 2024-09-11T22:20:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.210+0000 7fc3bc55f640 1 -- 172.21.15.100:0/2595349953 wait complete. 2024-09-11T22:20:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.211+0000 7fc3bc55f640 1 Processor -- start 2024-09-11T22:20:51.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.211+0000 7fc3bc55f640 1 -- start start 2024-09-11T22:20:51.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.212+0000 7fc3bc55f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3b40b3190 0x7fc3b41f4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.212+0000 7fc3bc55f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3b4154c20 0x7fc3b4153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.212+0000 7fc3bc55f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3b415a7e0 0x7fc3b41539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.212+0000 7fc3bc55f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b40cc5a0 con 0x7fc3b4154c20 2024-09-11T22:20:51.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.212+0000 7fc3bc55f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b40cc420 con 0x7fc3b40b3190 2024-09-11T22:20:51.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.212+0000 7fc3bc55f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc3b40cb660 con 0x7fc3b415a7e0 2024-09-11T22:20:51.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.212+0000 7fc3b9afa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3b4154c20 0x7fc3b4153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.212+0000 7fc3b9afa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3b4154c20 0x7fc3b4153490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47726/0 (socket says 172.21.15.100:47726) 2024-09-11T22:20:51.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.212+0000 7fc3b9afa640 1 -- 172.21.15.100:0/255275480 learned_addr learned my addr 172.21.15.100:0/255275480 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:51.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.212+0000 7fc3ba2fb640 1 --2- 172.21.15.100:0/255275480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3b40b3190 0x7fc3b41f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.212+0000 7fc3baafc640 1 --2- 172.21.15.100:0/255275480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3b415a7e0 0x7fc3b41539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.212+0000 7fc3b9afa640 1 -- 172.21.15.100:0/255275480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3b415a7e0 msgr2=0x7fc3b41539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.212+0000 7fc3b9afa640 1 --2- 172.21.15.100:0/255275480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3b415a7e0 0x7fc3b41539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.212+0000 7fc3b9afa640 1 -- 172.21.15.100:0/255275480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3b40b3190 msgr2=0x7fc3b41f4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.212+0000 7fc3b9afa640 1 --2- 172.21.15.100:0/255275480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3b40b3190 0x7fc3b41f4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.212+0000 7fc3b9afa640 1 -- 172.21.15.100:0/255275480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b41f14d0 con 0x7fc3b4154c20 2024-09-11T22:20:51.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.212+0000 7fc3b9afa640 1 --2- 172.21.15.100:0/255275480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3b4154c20 0x7fc3b4153490 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4000c00 tx=0x7fc3a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.212+0000 7fc3aaffd640 1 -- 172.21.15.100:0/255275480 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4037050 con 0x7fc3b4154c20 2024-09-11T22:20:51.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.212+0000 7fc3aaffd640 1 -- 172.21.15.100:0/255275480 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3a4038040 con 0x7fc3b4154c20 2024-09-11T22:20:51.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.212+0000 7fc3bc55f640 1 -- 172.21.15.100:0/255275480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b414e200 con 0x7fc3b4154c20 2024-09-11T22:20:51.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.212+0000 7fc3aaffd640 1 -- 172.21.15.100:0/255275480 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4004470 con 0x7fc3b4154c20 2024-09-11T22:20:51.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.213+0000 7fc3bc55f640 1 -- 172.21.15.100:0/255275480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b414e7a0 con 0x7fc3b4154c20 2024-09-11T22:20:51.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.213+0000 7fc3bc55f640 1 -- 172.21.15.100:0/255275480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3b40cb120 con 0x7fc3b4154c20 2024-09-11T22:20:51.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.214+0000 7fc3aaffd640 1 -- 172.21.15.100:0/255275480 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc3a403c6d0 con 0x7fc3b4154c20 2024-09-11T22:20:51.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.214+0000 7fc3aaffd640 1 --2- 172.21.15.100:0/255275480 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc39806be60 0x7fc39806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.214+0000 7fc3aaffd640 1 -- 172.21.15.100:0/255275480 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc3a40aba90 con 0x7fc3b4154c20 2024-09-11T22:20:51.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.214+0000 7fc3ba2fb640 1 --2- 172.21.15.100:0/255275480 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc39806be60 0x7fc39806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.215+0000 7fc3ba2fb640 1 --2- 172.21.15.100:0/255275480 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc39806be60 0x7fc39806e320 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0009b40 tx=0x7fc3b0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.219+0000 7fc3aaffd640 1 -- 172.21.15.100:0/255275480 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc3a4079a30 con 0x7fc3b4154c20 2024-09-11T22:20:51.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.418+0000 7fc3bc55f640 1 -- 172.21.15.100:0/255275480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc3b40cbaf0 con 0x7fc3b4154c20 2024-09-11T22:20:51.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.419+0000 7fc3aaffd640 1 -- 172.21.15.100:0/255275480 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fc3a407dd30 con 0x7fc3b4154c20 2024-09-11T22:20:51.420 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:51.420 INFO:teuthology.orchestra.run.smithi100.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.421+0000 7fc3bc55f640 1 -- 172.21.15.100:0/255275480 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc39806be60 msgr2=0x7fc39806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.421+0000 7fc3bc55f640 1 --2- 172.21.15.100:0/255275480 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc39806be60 0x7fc39806e320 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0009b40 tx=0x7fc3b0009190 comp rx=0 tx=0).stop 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.421+0000 7fc3bc55f640 1 -- 172.21.15.100:0/255275480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3b4154c20 msgr2=0x7fc3b4153490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.421+0000 7fc3bc55f640 1 --2- 172.21.15.100:0/255275480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3b4154c20 0x7fc3b4153490 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4000c00 tx=0x7fc3a40046c0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.421+0000 7fc3bc55f640 1 -- 172.21.15.100:0/255275480 shutdown_connections 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.421+0000 7fc3bc55f640 1 --2- 172.21.15.100:0/255275480 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc39806be60 0x7fc39806e320 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.421+0000 7fc3bc55f640 1 --2- 172.21.15.100:0/255275480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3b415a7e0 0x7fc3b41539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.421+0000 7fc3bc55f640 1 --2- 172.21.15.100:0/255275480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3b4154c20 0x7fc3b4153490 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.421+0000 7fc3bc55f640 1 --2- 172.21.15.100:0/255275480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3b40b3190 0x7fc3b41f4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.421+0000 7fc3bc55f640 1 -- 172.21.15.100:0/255275480 >> 172.21.15.100:0/255275480 conn(0x7fc3b4067d40 msgr2=0x7fc3b40b4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.421+0000 7fc3bc55f640 1 -- 172.21.15.100:0/255275480 shutdown_connections 2024-09-11T22:20:51.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.421+0000 7fc3bc55f640 1 -- 172.21.15.100:0/255275480 wait complete. 2024-09-11T22:20:51.432 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-11T22:20:51.432 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:51.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.529+0000 7f7682ed9640 1 Processor -- start 2024-09-11T22:20:51.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.529+0000 7f7682ed9640 1 -- start start 2024-09-11T22:20:51.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.530+0000 7f7682ed9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f767c0c6940 0x7f767c0c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.530+0000 7f7682ed9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f767c0c3f30 0x7f767c158540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.530+0000 7f7682ed9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f767c06c060 con 0x7f767c0c6d20 2024-09-11T22:20:51.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.530+0000 7f7682ed9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f767c06f1d0 con 0x7f767c0c3f30 2024-09-11T22:20:51.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.530+0000 7f7682ed9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f767c06c340 con 0x7f767c0c6940 2024-09-11T22:20:51.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.530+0000 7f7680c75640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f767c0c6940 0x7f767c0c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.530+0000 7f7681476640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f767c0c3f30 0x7f767c158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.530+0000 7f7680c75640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f767c0c6940 0x7f767c0c79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45528/0 (socket says 172.21.15.100:45528) 2024-09-11T22:20:51.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.530+0000 7f7681476640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f767c0c3f30 0x7f767c158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44616/0 (socket says 172.21.15.100:44616) 2024-09-11T22:20:51.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.530+0000 7f7680c75640 1 -- 172.21.15.100:0/3677388377 learned_addr learned my addr 172.21.15.100:0/3677388377 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:51.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.530+0000 7f767bfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f767c0c6d20 0x7f767c1523e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:44336/0 (socket says 172.21.15.100:44336) 2024-09-11T22:20:51.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.530+0000 7f7680c75640 1 -- 172.21.15.100:0/3677388377 >> v2:172.21.15.167:3300/0 conn(0x7f767c0c3f30 msgr2=0x7f767c158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:51.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.530+0000 7f7680c75640 1 --2- 172.21.15.100:0/3677388377 >> v2:172.21.15.167:3300/0 conn(0x7f767c0c3f30 0x7f767c158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.530+0000 7f7680c75640 1 -- 172.21.15.100:0/3677388377 >> v1:172.21.15.167:6789/0 conn(0x7f767c0c6d20 legacy=0x7f767c1523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.530+0000 7f7680c75640 1 -- 172.21.15.100:0/3677388377 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767c06f420 con 0x7f767c0c6940 2024-09-11T22:20:51.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.531+0000 7f7680c75640 1 --2- 172.21.15.100:0/3677388377 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f767c0c6940 0x7f767c0c79c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7670009870 tx=0x7f767002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f73c7afd6a83162 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.531+0000 7f767b7fe640 1 -- 172.21.15.100:0/3677388377 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7670037070 con 0x7f767c0c6940 2024-09-11T22:20:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.531+0000 7f767b7fe640 1 -- 172.21.15.100:0/3677388377 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7670032440 con 0x7f767c0c6940 2024-09-11T22:20:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.531+0000 7f767b7fe640 1 -- 172.21.15.100:0/3677388377 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7670032810 con 0x7f767c0c6940 2024-09-11T22:20:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.532+0000 7f7682ed9640 1 -- 172.21.15.100:0/3677388377 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f767c0c6940 msgr2=0x7f767c0c79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.532+0000 7f7682ed9640 1 --2- 172.21.15.100:0/3677388377 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f767c0c6940 0x7f767c0c79c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7670009870 tx=0x7f767002a1c0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.532+0000 7f7682ed9640 1 -- 172.21.15.100:0/3677388377 shutdown_connections 2024-09-11T22:20:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.532+0000 7f7682ed9640 1 --2- 172.21.15.100:0/3677388377 >> v2:172.21.15.167:3300/0 conn(0x7f767c0c3f30 0x7f767c158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.532+0000 7f7682ed9640 1 --2- 172.21.15.100:0/3677388377 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f767c0c6940 0x7f767c0c79c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.532+0000 7f7682ed9640 1 -- 172.21.15.100:0/3677388377 >> 172.21.15.100:0/3677388377 conn(0x7f767c070b80 msgr2=0x7f767c0ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.532+0000 7f7682ed9640 1 -- 172.21.15.100:0/3677388377 shutdown_connections 2024-09-11T22:20:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.532+0000 7f7682ed9640 1 -- 172.21.15.100:0/3677388377 wait complete. 2024-09-11T22:20:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.533+0000 7f7682ed9640 1 Processor -- start 2024-09-11T22:20:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.533+0000 7f7682ed9640 1 -- start start 2024-09-11T22:20:51.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.534+0000 7f7682ed9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f767c0c3f30 0x7f767c155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.534+0000 7f7682ed9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f767c0c6940 0x7f767c15a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.534+0000 7f7682ed9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f767c0c6d20 0x7f767c1ee7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.534+0000 7f7682ed9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f767c152af0 con 0x7f767c0c6940 2024-09-11T22:20:51.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.534+0000 7f7682ed9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f767c06f9e0 con 0x7f767c0c6d20 2024-09-11T22:20:51.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.534+0000 7f7682ed9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f767c152c70 con 0x7f767c0c3f30 2024-09-11T22:20:51.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.534+0000 7f767bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f767c0c6940 0x7f767c15a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.534+0000 7f767bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f767c0c6940 0x7f767c15a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47732/0 (socket says 172.21.15.100:47732) 2024-09-11T22:20:51.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.534+0000 7f767bfff640 1 -- 172.21.15.100:0/3042842670 learned_addr learned my addr 172.21.15.100:0/3042842670 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:51.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.534+0000 7f7680c75640 1 --2- 172.21.15.100:0/3042842670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f767c0c3f30 0x7f767c155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.534+0000 7f7681476640 1 --2- 172.21.15.100:0/3042842670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f767c0c6d20 0x7f767c1ee7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.534+0000 7f767bfff640 1 -- 172.21.15.100:0/3042842670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f767c0c3f30 msgr2=0x7f767c155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.534+0000 7f767bfff640 1 --2- 172.21.15.100:0/3042842670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f767c0c3f30 0x7f767c155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.534+0000 7f767bfff640 1 -- 172.21.15.100:0/3042842670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f767c0c6d20 msgr2=0x7f767c1ee7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.534+0000 7f767bfff640 1 --2- 172.21.15.100:0/3042842670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f767c0c6d20 0x7f767c1ee7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.534+0000 7f767bfff640 1 -- 172.21.15.100:0/3042842670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767c1547d0 con 0x7f767c0c6940 2024-09-11T22:20:51.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.535+0000 7f767bfff640 1 --2- 172.21.15.100:0/3042842670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f767c0c6940 0x7f767c15a3a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f766800c3d0 tx=0x7f766800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.535+0000 7f76797fa640 1 -- 172.21.15.100:0/3042842670 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76680074e0 con 0x7f767c0c6940 2024-09-11T22:20:51.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.535+0000 7f76797fa640 1 -- 172.21.15.100:0/3042842670 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7668007680 con 0x7f767c0c6940 2024-09-11T22:20:51.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.535+0000 7f7682ed9640 1 -- 172.21.15.100:0/3042842670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f767c159810 con 0x7f767c0c6940 2024-09-11T22:20:51.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.535+0000 7f76797fa640 1 -- 172.21.15.100:0/3042842670 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7668004a00 con 0x7f767c0c6940 2024-09-11T22:20:51.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.535+0000 7f7682ed9640 1 -- 172.21.15.100:0/3042842670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f767c154bc0 con 0x7f767c0c6940 2024-09-11T22:20:51.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.536+0000 7f7682ed9640 1 -- 172.21.15.100:0/3042842670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f767c0c9430 con 0x7f767c0c6940 2024-09-11T22:20:51.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.536+0000 7f76797fa640 1 -- 172.21.15.100:0/3042842670 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f766801a020 con 0x7f767c0c6940 2024-09-11T22:20:51.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.537+0000 7f76797fa640 1 --2- 172.21.15.100:0/3042842670 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f766006be60 0x7f766006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.537+0000 7f7680c75640 1 --2- 172.21.15.100:0/3042842670 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f766006be60 0x7f766006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.537+0000 7f76797fa640 1 -- 172.21.15.100:0/3042842670 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f766808a7f0 con 0x7f767c0c6940 2024-09-11T22:20:51.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.537+0000 7f7680c75640 1 --2- 172.21.15.100:0/3042842670 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f766006be60 0x7f766006e320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7670034000 tx=0x7f767002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.541+0000 7f76797fa640 1 -- 172.21.15.100:0/3042842670 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7668058820 con 0x7f767c0c6940 2024-09-11T22:20:51.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.737+0000 7f7682ed9640 1 -- 172.21.15.100:0/3042842670 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f767c0c9c00 con 0x7f767c0c6940 2024-09-11T22:20:51.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.737+0000 7f76797fa640 1 -- 172.21.15.100:0/3042842670 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6922 (secure 0 0 0) 0x7f766805cb20 con 0x7f767c0c6940 2024-09-11T22:20:51.738 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:51.738 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":13,"btime":"2024-09-11T22:20:47:956918+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2075802330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":2075802330},{"type":"v1","addr":"172.21.15.100:6837","nonce":2075802330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/1727733473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1727733473},{"type":"v1","addr":"172.21.15.167:6836","nonce":1727733473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/880809662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":880809662},{"type":"v1","addr":"172.21.15.167:6837","nonce":880809662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:19.171222+0000","modified":"2024-09-11T22:20:47.956908+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4296,"mds_1":4281,"mds_2":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":2,"incarnation":13,"state":"up:creating","state_seq":1,"addr":"172.21.15.100:6836/1912241808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1912241808},{"type":"v1","addr":"172.21.15.100:6836","nonce":1912241808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4281":{"gid":4281,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6839/3236256661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3236256661},{"type":"v1","addr":"172.21.15.100:6839","nonce":3236256661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4296":{"gid":4296,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6834/1651678197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1651678197},{"type":"v1","addr":"172.21.15.167:6834","nonce":1651678197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296,4281]},"id":1}]} 2024-09-11T22:20:51.738 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2024-09-11T22:20:51.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.739+0000 7f7682ed9640 1 -- 172.21.15.100:0/3042842670 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f766006be60 msgr2=0x7f766006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.739+0000 7f7682ed9640 1 --2- 172.21.15.100:0/3042842670 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f766006be60 0x7f766006e320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7670034000 tx=0x7f767002e000 comp rx=0 tx=0).stop 2024-09-11T22:20:51.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.739+0000 7f7682ed9640 1 -- 172.21.15.100:0/3042842670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f767c0c6940 msgr2=0x7f767c15a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.739+0000 7f7682ed9640 1 --2- 172.21.15.100:0/3042842670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f767c0c6940 0x7f767c15a3a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f766800c3d0 tx=0x7f766800c890 comp rx=0 tx=0).stop 2024-09-11T22:20:51.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.739+0000 7f7682ed9640 1 -- 172.21.15.100:0/3042842670 shutdown_connections 2024-09-11T22:20:51.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.739+0000 7f7682ed9640 1 --2- 172.21.15.100:0/3042842670 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f766006be60 0x7f766006e320 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.739+0000 7f7682ed9640 1 --2- 172.21.15.100:0/3042842670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f767c0c6d20 0x7f767c1ee7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.739+0000 7f7682ed9640 1 --2- 172.21.15.100:0/3042842670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f767c0c6940 0x7f767c15a3a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.739+0000 7f7682ed9640 1 --2- 172.21.15.100:0/3042842670 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f767c0c3f30 0x7f767c155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.739+0000 7f7682ed9640 1 -- 172.21.15.100:0/3042842670 >> 172.21.15.100:0/3042842670 conn(0x7f767c070b80 msgr2=0x7f767c1521b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.739+0000 7f7682ed9640 1 -- 172.21.15.100:0/3042842670 shutdown_connections 2024-09-11T22:20:51.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.739+0000 7f7682ed9640 1 -- 172.21.15.100:0/3042842670 wait complete. 2024-09-11T22:20:51.751 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:51.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.848+0000 7f6b83d13640 1 Processor -- start 2024-09-11T22:20:51.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.848+0000 7f6b83d13640 1 -- start start 2024-09-11T22:20:51.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.849+0000 7f6b83d13640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b7c154c20 0x7f6b7c0cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.849+0000 7f6b83d13640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b7c15ac90 con 0x7f6b7c15a7e0 2024-09-11T22:20:51.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.849+0000 7f6b83d13640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b7c15af70 con 0x7f6b7c0b3190 2024-09-11T22:20:51.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.849+0000 7f6b83d13640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f6b7c15e000 con 0x7f6b7c154c20 2024-09-11T22:20:51.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.849+0000 7f6b822b0640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6b7c15a7e0 0x7f6b7c0cbd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33478/0 (socket says 172.21.15.100:33478) 2024-09-11T22:20:51.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.849+0000 7f6b822b0640 1 -- 172.21.15.100:0/4184469896 learned_addr learned my addr 172.21.15.100:0/4184469896 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:51.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.849+0000 7f6b81aaf640 1 --2- 172.21.15.100:0/4184469896 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b7c154c20 0x7f6b7c0cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.849+0000 7f6b80aad640 1 -- 172.21.15.100:0/4184469896 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3089302052 0 0) 0x7f6b7c15ac90 con 0x7f6b7c15a7e0 2024-09-11T22:20:51.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.849+0000 7f6b80aad640 1 -- 172.21.15.100:0/4184469896 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b64003520 con 0x7f6b7c15a7e0 2024-09-11T22:20:51.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.849+0000 7f6b80aad640 1 -- 172.21.15.100:0/4184469896 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3423490470 0 0) 0x7f6b7c15af70 con 0x7f6b7c0b3190 2024-09-11T22:20:51.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.849+0000 7f6b80aad640 1 -- 172.21.15.100:0/4184469896 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b7c15ac90 con 0x7f6b7c0b3190 2024-09-11T22:20:51.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.849+0000 7f6b81aaf640 1 -- 172.21.15.100:0/4184469896 >> v1:172.21.15.167:6789/0 conn(0x7f6b7c0b3190 legacy=0x7f6b7c15e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.849+0000 7f6b81aaf640 1 -- 172.21.15.100:0/4184469896 >> v1:172.21.15.100:6789/0 conn(0x7f6b7c15a7e0 legacy=0x7f6b7c0cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.849+0000 7f6b81aaf640 1 -- 172.21.15.100:0/4184469896 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b7c15b250 con 0x7f6b7c154c20 2024-09-11T22:20:51.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.850+0000 7f6b81aaf640 1 --2- 172.21.15.100:0/4184469896 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b7c154c20 0x7f6b7c0cb120 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6b740097d0 tx=0x7f6b7402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ae7b7c6da085ef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.850+0000 7f6b80aad640 1 -- 172.21.15.100:0/4184469896 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b74037070 con 0x7f6b7c154c20 2024-09-11T22:20:51.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.850+0000 7f6b80aad640 1 -- 172.21.15.100:0/4184469896 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b74032440 con 0x7f6b7c154c20 2024-09-11T22:20:51.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.850+0000 7f6b80aad640 1 -- 172.21.15.100:0/4184469896 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b740327f0 con 0x7f6b7c154c20 2024-09-11T22:20:51.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.851+0000 7f6b83d13640 1 -- 172.21.15.100:0/4184469896 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b7c154c20 msgr2=0x7f6b7c0cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.851+0000 7f6b83d13640 1 --2- 172.21.15.100:0/4184469896 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b7c154c20 0x7f6b7c0cb120 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6b740097d0 tx=0x7f6b7402a210 comp rx=0 tx=0).stop 2024-09-11T22:20:51.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.851+0000 7f6b83d13640 1 -- 172.21.15.100:0/4184469896 shutdown_connections 2024-09-11T22:20:51.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.851+0000 7f6b83d13640 1 --2- 172.21.15.100:0/4184469896 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b7c154c20 0x7f6b7c0cb120 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.851+0000 7f6b83d13640 1 -- 172.21.15.100:0/4184469896 >> 172.21.15.100:0/4184469896 conn(0x7f6b7c067d40 msgr2=0x7f6b7c06d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:51.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.851+0000 7f6b83d13640 1 -- 172.21.15.100:0/4184469896 shutdown_connections 2024-09-11T22:20:51.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.851+0000 7f6b83d13640 1 -- 172.21.15.100:0/4184469896 wait complete. 2024-09-11T22:20:51.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.852+0000 7f6b83d13640 1 Processor -- start 2024-09-11T22:20:51.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.852+0000 7f6b83d13640 1 -- start start 2024-09-11T22:20:51.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.853+0000 7f6b83d13640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b7c0b3190 0x7f6b7c1f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.853+0000 7f6b83d13640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b7c154c20 0x7f6b7c15cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.853+0000 7f6b83d13640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b7c15a7e0 0x7f6b7c1f3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.853+0000 7f6b83d13640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c15ed20 con 0x7f6b7c0b3190 2024-09-11T22:20:51.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.853+0000 7f6b83d13640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c15eba0 con 0x7f6b7c154c20 2024-09-11T22:20:51.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.853+0000 7f6b83d13640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f6b7c0cc420 con 0x7f6b7c15a7e0 2024-09-11T22:20:51.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.853+0000 7f6b81aaf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b7c0b3190 0x7f6b7c1f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.853+0000 7f6b81aaf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b7c0b3190 0x7f6b7c1f1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47740/0 (socket says 172.21.15.100:47740) 2024-09-11T22:20:51.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.853+0000 7f6b81aaf640 1 -- 172.21.15.100:0/1917299228 learned_addr learned my addr 172.21.15.100:0/1917299228 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:51.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.853+0000 7f6b822b0640 1 --2- 172.21.15.100:0/1917299228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b7c15a7e0 0x7f6b7c1f3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.853+0000 7f6b812ae640 1 --2- 172.21.15.100:0/1917299228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b7c154c20 0x7f6b7c15cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.853+0000 7f6b81aaf640 1 -- 172.21.15.100:0/1917299228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b7c15a7e0 msgr2=0x7f6b7c1f3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.853+0000 7f6b81aaf640 1 --2- 172.21.15.100:0/1917299228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b7c15a7e0 0x7f6b7c1f3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.853+0000 7f6b81aaf640 1 -- 172.21.15.100:0/1917299228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b7c154c20 msgr2=0x7f6b7c15cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:51.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.853+0000 7f6b81aaf640 1 --2- 172.21.15.100:0/1917299228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b7c154c20 0x7f6b7c15cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:51.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.853+0000 7f6b81aaf640 1 -- 172.21.15.100:0/1917299228 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b7c1f1ff0 con 0x7f6b7c0b3190 2024-09-11T22:20:51.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.853+0000 7f6b812ae640 1 --2- 172.21.15.100:0/1917299228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b7c154c20 0x7f6b7c15cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:51.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.853+0000 7f6b81aaf640 1 --2- 172.21.15.100:0/1917299228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b7c0b3190 0x7f6b7c1f1ab0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6b7402a250 tx=0x7f6b740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.853+0000 7f6b7a7fc640 1 -- 172.21.15.100:0/1917299228 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b74041020 con 0x7f6b7c0b3190 2024-09-11T22:20:51.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.853+0000 7f6b7a7fc640 1 -- 172.21.15.100:0/1917299228 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b7403d620 con 0x7f6b7c0b3190 2024-09-11T22:20:51.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.853+0000 7f6b83d13640 1 -- 172.21.15.100:0/1917299228 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b7c1f0850 con 0x7f6b7c0b3190 2024-09-11T22:20:51.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.854+0000 7f6b7a7fc640 1 -- 172.21.15.100:0/1917299228 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b74037040 con 0x7f6b7c0b3190 2024-09-11T22:20:51.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.854+0000 7f6b83d13640 1 -- 172.21.15.100:0/1917299228 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b7c14f3f0 con 0x7f6b7c0b3190 2024-09-11T22:20:51.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.854+0000 7f6b83d13640 1 -- 172.21.15.100:0/1917299228 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b7c15e490 con 0x7f6b7c0b3190 2024-09-11T22:20:51.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.855+0000 7f6b7a7fc640 1 -- 172.21.15.100:0/1917299228 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b74044020 con 0x7f6b7c0b3190 2024-09-11T22:20:51.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.856+0000 7f6b7a7fc640 1 --2- 172.21.15.100:0/1917299228 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6b6806be60 0x7f6b6806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:51.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.856+0000 7f6b7a7fc640 1 -- 172.21.15.100:0/1917299228 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6b740ab620 con 0x7f6b7c0b3190 2024-09-11T22:20:51.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.856+0000 7f6b812ae640 1 --2- 172.21.15.100:0/1917299228 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6b6806be60 0x7f6b6806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:51.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.856+0000 7f6b812ae640 1 --2- 172.21.15.100:0/1917299228 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6b6806be60 0x7f6b6806e320 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0d0de0 tx=0x7f6b70009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:51.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:51.860+0000 7f6b7a7fc640 1 -- 172.21.15.100:0/1917299228 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b7404b070 con 0x7f6b7c0b3190 2024-09-11T22:20:52.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.062+0000 7f6b83d13640 1 -- 172.21.15.100:0/1917299228 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b7c0cbaf0 con 0x7f6b7c0b3190 2024-09-11T22:20:52.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.063+0000 7f6b7a7fc640 1 -- 172.21.15.100:0/1917299228 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6922 (secure 0 0 0) 0x7f6b74079ca0 con 0x7f6b7c0b3190 2024-09-11T22:20:52.064 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:52.064 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":13,"btime":"2024-09-11T22:20:47:956918+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2075802330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":2075802330},{"type":"v1","addr":"172.21.15.100:6837","nonce":2075802330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/1727733473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1727733473},{"type":"v1","addr":"172.21.15.167:6836","nonce":1727733473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/880809662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":880809662},{"type":"v1","addr":"172.21.15.167:6837","nonce":880809662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:19.171222+0000","modified":"2024-09-11T22:20:47.956908+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4296,"mds_1":4281,"mds_2":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":2,"incarnation":13,"state":"up:creating","state_seq":1,"addr":"172.21.15.100:6836/1912241808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1912241808},{"type":"v1","addr":"172.21.15.100:6836","nonce":1912241808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4281":{"gid":4281,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6839/3236256661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3236256661},{"type":"v1","addr":"172.21.15.100:6839","nonce":3236256661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4296":{"gid":4296,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6834/1651678197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1651678197},{"type":"v1","addr":"172.21.15.167:6834","nonce":1651678197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296,4281]},"id":1}]} 2024-09-11T22:20:52.064 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2024-09-11T22:20:52.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.065+0000 7f6b83d13640 1 -- 172.21.15.100:0/1917299228 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6b6806be60 msgr2=0x7f6b6806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.065+0000 7f6b83d13640 1 --2- 172.21.15.100:0/1917299228 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6b6806be60 0x7f6b6806e320 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0d0de0 tx=0x7f6b70009040 comp rx=0 tx=0).stop 2024-09-11T22:20:52.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.065+0000 7f6b83d13640 1 -- 172.21.15.100:0/1917299228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b7c0b3190 msgr2=0x7f6b7c1f1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.065+0000 7f6b83d13640 1 --2- 172.21.15.100:0/1917299228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b7c0b3190 0x7f6b7c1f1ab0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6b7402a250 tx=0x7f6b740046c0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.065+0000 7f6b83d13640 1 -- 172.21.15.100:0/1917299228 shutdown_connections 2024-09-11T22:20:52.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.065+0000 7f6b83d13640 1 --2- 172.21.15.100:0/1917299228 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6b6806be60 0x7f6b6806e320 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.065+0000 7f6b83d13640 1 --2- 172.21.15.100:0/1917299228 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b7c15a7e0 0x7f6b7c1f3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.065+0000 7f6b83d13640 1 --2- 172.21.15.100:0/1917299228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b7c154c20 0x7f6b7c15cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.065+0000 7f6b83d13640 1 --2- 172.21.15.100:0/1917299228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b7c0b3190 0x7f6b7c1f1ab0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.065+0000 7f6b83d13640 1 -- 172.21.15.100:0/1917299228 >> 172.21.15.100:0/1917299228 conn(0x7f6b7c067d40 msgr2=0x7f6b7c158440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:52.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.066+0000 7f6b83d13640 1 -- 172.21.15.100:0/1917299228 shutdown_connections 2024-09-11T22:20:52.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.066+0000 7f6b83d13640 1 -- 172.21.15.100:0/1917299228 wait complete. 2024-09-11T22:20:52.077 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:20:52.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.174+0000 7f4ad8ae4640 1 Processor -- start 2024-09-11T22:20:52.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.174+0000 7f4ad8ae4640 1 -- start start 2024-09-11T22:20:52.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.175+0000 7f4ad8ae4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ad40d0b20 0x7f4ad40ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.175+0000 7f4ad8ae4640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ad40c55d0 con 0x7f4ad40cad20 2024-09-11T22:20:52.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.175+0000 7f4ad8ae4640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ad40c58b0 con 0x7f4ad40d0f00 2024-09-11T22:20:52.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.175+0000 7f4ad8ae4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4ad415ad20 con 0x7f4ad40d0b20 2024-09-11T22:20:52.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.175+0000 7f4ac9d9b640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f4ad40cad20 0x7f4ad4154830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33490/0 (socket says 172.21.15.100:33490) 2024-09-11T22:20:52.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.175+0000 7f4ac9d9b640 1 -- 172.21.15.100:0/2547558158 learned_addr learned my addr 172.21.15.100:0/2547558158 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:52.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.175+0000 7f4ad1d9b640 1 -- 172.21.15.100:0/2547558158 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2062619068 0 0) 0x7f4ad40c55d0 con 0x7f4ad40cad20 2024-09-11T22:20:52.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.175+0000 7f4ad259c640 1 --2- 172.21.15.100:0/2547558158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ad40d0b20 0x7f4ad40ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.175+0000 7f4ad1d9b640 1 -- 172.21.15.100:0/2547558158 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ac0003520 con 0x7f4ad40cad20 2024-09-11T22:20:52.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.175+0000 7f4ad1d9b640 1 -- 172.21.15.100:0/2547558158 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 579624033 0 0) 0x7f4ac0003520 con 0x7f4ad40cad20 2024-09-11T22:20:52.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.175+0000 7f4ad1d9b640 1 -- 172.21.15.100:0/2547558158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ad40d0b20 msgr2=0x7f4ad40ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:52.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.175+0000 7f4ad1d9b640 1 --2- 172.21.15.100:0/2547558158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ad40d0b20 0x7f4ad40ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.175+0000 7f4ad1d9b640 1 -- 172.21.15.100:0/2547558158 >> v1:172.21.15.167:6789/0 conn(0x7f4ad40d0f00 legacy=0x7f4ad4165370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.175+0000 7f4ad1d9b640 1 -- 172.21.15.100:0/2547558158 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad415b000 con 0x7f4ad40cad20 2024-09-11T22:20:52.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.175+0000 7f4ad259c640 1 --2- 172.21.15.100:0/2547558158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ad40d0b20 0x7f4ad40ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:52.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.175+0000 7f4ad1d9b640 1 -- 172.21.15.100:0/2547558158 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f4abc001670 con 0x7f4ad40cad20 2024-09-11T22:20:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.176+0000 7f4ad1d9b640 1 -- 172.21.15.100:0/2547558158 >> v1:172.21.15.100:6789/0 conn(0x7f4ad40cad20 legacy=0x7f4ad4154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.176+0000 7f4ad1d9b640 1 --2- 172.21.15.100:0/2547558158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ad40d0b20 0x7f4ac00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.176+0000 7f4ad1d9b640 1 --2- 172.21.15.100:0/2547558158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ac0003fd0 0x7f4ac0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.176+0000 7f4ad1d9b640 1 --2- 172.21.15.100:0/2547558158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ac0004d40 0x7f4ac00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.176+0000 7f4ad1d9b640 1 -- 172.21.15.100:0/2547558158 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad415ad20 con 0x7f4ac0003fd0 2024-09-11T22:20:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.176+0000 7f4ad1d9b640 1 -- 172.21.15.100:0/2547558158 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac000bb20 con 0x7f4ac0004d40 2024-09-11T22:20:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.176+0000 7f4ad1d9b640 1 -- 172.21.15.100:0/2547558158 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac000bd20 con 0x7f4ad40d0b20 2024-09-11T22:20:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.176+0000 7f4ac9d9b640 1 --2- 172.21.15.100:0/2547558158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ac0003fd0 0x7f4ac0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.176+0000 7f4ad259c640 1 --2- 172.21.15.100:0/2547558158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ad40d0b20 0x7f4ac00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.176+0000 7f4ad2d9d640 1 --2- 172.21.15.100:0/2547558158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ac0004d40 0x7f4ac00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.176+0000 7f4ac9d9b640 1 -- 172.21.15.100:0/2547558158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ad40d0b20 msgr2=0x7f4ac00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.176+0000 7f4ac9d9b640 1 --2- 172.21.15.100:0/2547558158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ad40d0b20 0x7f4ac00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.176+0000 7f4ac9d9b640 1 -- 172.21.15.100:0/2547558158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ac0004d40 msgr2=0x7f4ac00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.176+0000 7f4ac9d9b640 1 --2- 172.21.15.100:0/2547558158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ac0004d40 0x7f4ac00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.176+0000 7f4ac9d9b640 1 -- 172.21.15.100:0/2547558158 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac0003520 con 0x7f4ac0003fd0 2024-09-11T22:20:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.177+0000 7f4ac9d9b640 1 --2- 172.21.15.100:0/2547558158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ac0003fd0 0x7f4ac0004800 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00c240 tx=0x7f4ac0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea411897066a2312 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.177+0000 7f4ad1d9b640 1 -- 172.21.15.100:0/2547558158 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc007cf0 con 0x7f4ac0003fd0 2024-09-11T22:20:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.177+0000 7f4ad1d9b640 1 -- 172.21.15.100:0/2547558158 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4abc005af0 con 0x7f4ac0003fd0 2024-09-11T22:20:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.177+0000 7f4ad1d9b640 1 -- 172.21.15.100:0/2547558158 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc007070 con 0x7f4ac0003fd0 2024-09-11T22:20:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.177+0000 7f4ad8ae4640 1 -- 172.21.15.100:0/2547558158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ac0003fd0 msgr2=0x7f4ac0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.177+0000 7f4ad8ae4640 1 --2- 172.21.15.100:0/2547558158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ac0003fd0 0x7f4ac0004800 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00c240 tx=0x7f4ac0005830 comp rx=0 tx=0).stop 2024-09-11T22:20:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.177+0000 7f4ad2d9d640 1 -- 172.21.15.100:0/2547558158 reap_dead start 2024-09-11T22:20:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.177+0000 7f4ad8ae4640 1 -- 172.21.15.100:0/2547558158 shutdown_connections 2024-09-11T22:20:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.177+0000 7f4ad8ae4640 1 -- 172.21.15.100:0/2547558158 >> 172.21.15.100:0/2547558158 conn(0x7f4ad406d160 msgr2=0x7f4ad406d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:52.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.177+0000 7f4ad8ae4640 1 -- 172.21.15.100:0/2547558158 shutdown_connections 2024-09-11T22:20:52.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.177+0000 7f4ad8ae4640 1 -- 172.21.15.100:0/2547558158 wait complete. 2024-09-11T22:20:52.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.179+0000 7f4ad8ae4640 1 Processor -- start 2024-09-11T22:20:52.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.179+0000 7f4ad8ae4640 1 -- start start 2024-09-11T22:20:52.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.179+0000 7f4ad8ae4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ac0003fd0 0x7f4ad40cf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.179+0000 7f4ad8ae4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ad41f2800 0x7f4ad41f2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.179+0000 7f4ad8ae4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ad41f1930 0x7f4ad41f1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.180+0000 7f4ad8ae4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad415b800 con 0x7f4ad41f2800 2024-09-11T22:20:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.180+0000 7f4ad8ae4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad415a9f0 con 0x7f4ad41f1930 2024-09-11T22:20:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.180+0000 7f4ad8ae4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4ad40b3290 con 0x7f4ac0003fd0 2024-09-11T22:20:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.180+0000 7f4ac9d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ad41f2800 0x7f4ad41f2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.180+0000 7f4ac9d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ad41f2800 0x7f4ad41f2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47744/0 (socket says 172.21.15.100:47744) 2024-09-11T22:20:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.180+0000 7f4ac9d9b640 1 -- 172.21.15.100:0/547874293 learned_addr learned my addr 172.21.15.100:0/547874293 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.180+0000 7f4ad259c640 1 --2- 172.21.15.100:0/547874293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ac0003fd0 0x7f4ad40cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.180+0000 7f4ad2d9d640 1 --2- 172.21.15.100:0/547874293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ad41f1930 0x7f4ad41f1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.180+0000 7f4ac9d9b640 1 -- 172.21.15.100:0/547874293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ac0003fd0 msgr2=0x7f4ad40cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.180+0000 7f4ac9d9b640 1 --2- 172.21.15.100:0/547874293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ac0003fd0 0x7f4ad40cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.180+0000 7f4ac9d9b640 1 -- 172.21.15.100:0/547874293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ad41f1930 msgr2=0x7f4ad41f1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.180+0000 7f4ac9d9b640 1 --2- 172.21.15.100:0/547874293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ad41f1930 0x7f4ad41f1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.180+0000 7f4ac9d9b640 1 -- 172.21.15.100:0/547874293 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad41f22d0 con 0x7f4ad41f2800 2024-09-11T22:20:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.180+0000 7f4ac9d9b640 1 --2- 172.21.15.100:0/547874293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ad41f2800 0x7f4ad41f2c00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4abc02ad30 tx=0x7f4ad40c5a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.180+0000 7f4acb7fe640 1 -- 172.21.15.100:0/547874293 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc037040 con 0x7f4ad41f2800 2024-09-11T22:20:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.180+0000 7f4acb7fe640 1 -- 172.21.15.100:0/547874293 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4abc041070 con 0x7f4ad41f2800 2024-09-11T22:20:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.180+0000 7f4ad8ae4640 1 -- 172.21.15.100:0/547874293 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ad4156c30 con 0x7f4ad41f2800 2024-09-11T22:20:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.180+0000 7f4acb7fe640 1 -- 172.21.15.100:0/547874293 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc001630 con 0x7f4ad41f2800 2024-09-11T22:20:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.180+0000 7f4ad8ae4640 1 -- 172.21.15.100:0/547874293 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ad4156ef0 con 0x7f4ad41f2800 2024-09-11T22:20:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.181+0000 7f4ad8ae4640 1 -- 172.21.15.100:0/547874293 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ad4069290 con 0x7f4ad41f2800 2024-09-11T22:20:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.182+0000 7f4acb7fe640 1 -- 172.21.15.100:0/547874293 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4abc007070 con 0x7f4ad41f2800 2024-09-11T22:20:52.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.182+0000 7f4acb7fe640 1 --2- 172.21.15.100:0/547874293 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4ab406be30 0x7f4ab406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.182+0000 7f4acb7fe640 1 -- 172.21.15.100:0/547874293 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4abc0aa930 con 0x7f4ad41f2800 2024-09-11T22:20:52.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.182+0000 7f4ad259c640 1 --2- 172.21.15.100:0/547874293 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4ab406be30 0x7f4ab406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.183+0000 7f4ad259c640 1 --2- 172.21.15.100:0/547874293 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4ab406be30 0x7f4ab406e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4006fa0 tx=0x7f4ac4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.186+0000 7f4acb7fe640 1 -- 172.21.15.100:0/547874293 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4abc0789e0 con 0x7f4ad41f2800 2024-09-11T22:20:52.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.354+0000 7f4ad8ae4640 1 -- 172.21.15.100:0/547874293 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4ad4073090 con 0x7f4ad41f2800 2024-09-11T22:20:52.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.355+0000 7f4acb7fe640 1 -- 172.21.15.100:0/547874293 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18646 (secure 0 0 0) 0x7f4abc07cce0 con 0x7f4ad41f2800 2024-09-11T22:20:52.356 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:52.356 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":26,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","created":"2024-09-11T22:19:56.198855+0000","modified":"2024-09-11T22:20:24.213024+0000","last_up_change":"2024-09-11T22:20:07.328863+0000","last_in_change":"2024-09-11T22:19:58.294227+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:20:08.333538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:20:16.995279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:20:18.147950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:20:21.873694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5de0ba54-34c5-4343-b19a-1f675efc49c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6809","nonce":2008454847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6811","nonce":2008454847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6815","nonce":2008454847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6813","nonce":2008454847}]},"public_addr":"172.21.15.100:6809/2008454847","cluster_addr":"172.21.15.100:6811/2008454847","heartbeat_back_addr":"172.21.15.100:6815/2008454847","heartbeat_front_addr":"172.21.15.100:6813/2008454847","state":["exists","up"]},{"osd":1,"uuid":"5a1f6456-6604-4b41-b9b9-52ae8d6616ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6801","nonce":1802107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6803","nonce":1802107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6807","nonce":1802107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6805","nonce":1802107101}]},"public_addr":"172.21.15.100:6801/1802107101","cluster_addr":"172.21.15.100:6803/1802107101","heartbeat_back_addr":"172.21.15.100:6807/1802107101","heartbeat_front_addr":"172.21.15.100:6805/1802107101","state":["exists","up"]},{"osd":2,"uuid":"a604cb26-7b0f-402d-b6ac-3652884b4b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6817","nonce":644491349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6819","nonce":644491349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6823","nonce":644491349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6821","nonce":644491349}]},"public_addr":"172.21.15.100:6817/644491349","cluster_addr":"172.21.15.100:6819/644491349","heartbeat_back_addr":"172.21.15.100:6823/644491349","heartbeat_front_addr":"172.21.15.100:6821/644491349","state":["exists","up"]},{"osd":3,"uuid":"73dc2cbb-70ff-4d12-ba2f-8778a49892f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6825","nonce":2519160882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6827","nonce":2519160882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6831","nonce":2519160882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6829","nonce":2519160882}]},"public_addr":"172.21.15.100:6825/2519160882","cluster_addr":"172.21.15.100:6827/2519160882","heartbeat_back_addr":"172.21.15.100:6831/2519160882","heartbeat_front_addr":"172.21.15.100:6829/2519160882","state":["exists","up"]},{"osd":4,"uuid":"07960648-04df-4aec-a72c-c29e28b74bcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6817","nonce":736010951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6819","nonce":736010951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6823","nonce":736010951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6821","nonce":736010951}]},"public_addr":"172.21.15.167:6817/736010951","cluster_addr":"172.21.15.167:6819/736010951","heartbeat_back_addr":"172.21.15.167:6823/736010951","heartbeat_front_addr":"172.21.15.167:6821/736010951","state":["exists","up"]},{"osd":5,"uuid":"2b4767e6-cab7-4b45-9150-55432f5576aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6825","nonce":2479173909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6827","nonce":2479173909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6831","nonce":2479173909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6829","nonce":2479173909}]},"public_addr":"172.21.15.167:6825/2479173909","cluster_addr":"172.21.15.167:6827/2479173909","heartbeat_back_addr":"172.21.15.167:6831/2479173909","heartbeat_front_addr":"172.21.15.167:6829/2479173909","state":["exists","up"]},{"osd":6,"uuid":"4ef2c4b5-52f4-4f69-8fca-2334077ed8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6809","nonce":2825112504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6811","nonce":2825112504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6815","nonce":2825112504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6813","nonce":2825112504}]},"public_addr":"172.21.15.167:6809/2825112504","cluster_addr":"172.21.15.167:6811/2825112504","heartbeat_back_addr":"172.21.15.167:6815/2825112504","heartbeat_front_addr":"172.21.15.167:6813/2825112504","state":["exists","up"]},{"osd":7,"uuid":"761673d8-d6fc-4ded-a9f3-d49ab8f7c969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337015843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337015843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337015843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337015843}]},"public_addr":"172.21.15.167:6801/1337015843","cluster_addr":"172.21.15.167:6803/1337015843","heartbeat_back_addr":"172.21.15.167:6807/1337015843","heartbeat_front_addr":"172.21.15.167:6805/1337015843","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.833280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.080311+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.100648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.544261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.670353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.880921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.365441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.366659+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:20:52.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.357+0000 7f4ad8ae4640 1 -- 172.21.15.100:0/547874293 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4ab406be30 msgr2=0x7f4ab406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.357+0000 7f4ad8ae4640 1 --2- 172.21.15.100:0/547874293 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4ab406be30 0x7f4ab406e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4006fa0 tx=0x7f4ac4008040 comp rx=0 tx=0).stop 2024-09-11T22:20:52.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.357+0000 7f4ad8ae4640 1 -- 172.21.15.100:0/547874293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ad41f2800 msgr2=0x7f4ad41f2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.357+0000 7f4ad8ae4640 1 --2- 172.21.15.100:0/547874293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ad41f2800 0x7f4ad41f2c00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4abc02ad30 tx=0x7f4ad40c5a80 comp rx=0 tx=0).stop 2024-09-11T22:20:52.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.357+0000 7f4ad8ae4640 1 -- 172.21.15.100:0/547874293 shutdown_connections 2024-09-11T22:20:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.357+0000 7f4ad8ae4640 1 --2- 172.21.15.100:0/547874293 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4ab406be30 0x7f4ab406e2f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.357+0000 7f4ad8ae4640 1 --2- 172.21.15.100:0/547874293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ad41f1930 0x7f4ad41f1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.357+0000 7f4ad8ae4640 1 --2- 172.21.15.100:0/547874293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ad41f2800 0x7f4ad41f2c00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.357+0000 7f4ad8ae4640 1 --2- 172.21.15.100:0/547874293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ac0003fd0 0x7f4ad40cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.357+0000 7f4ad8ae4640 1 -- 172.21.15.100:0/547874293 >> 172.21.15.100:0/547874293 conn(0x7f4ad406d160 msgr2=0x7f4ad4159d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.357+0000 7f4ad8ae4640 1 -- 172.21.15.100:0/547874293 shutdown_connections 2024-09-11T22:20:52.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.357+0000 7f4ad8ae4640 1 -- 172.21.15.100:0/547874293 wait complete. 2024-09-11T22:20:52.369 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:52.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.469+0000 7f9c8b55f640 1 Processor -- start 2024-09-11T22:20:52.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.469+0000 7f9c8b55f640 1 -- start start 2024-09-11T22:20:52.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.470+0000 7f9c8b55f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c840c6940 0x7f9c840c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.470+0000 7f9c8b55f640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9c840c6d20 0x7f9c841523e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.470+0000 7f9c8b55f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9c840c3f30 0x7f9c84152920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.470+0000 7f9c8b55f640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f9c8406f1d0 con 0x7f9c840c6d20 2024-09-11T22:20:52.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.470+0000 7f9c8b55f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f9c8406c060 con 0x7f9c840c3f30 2024-09-11T22:20:52.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.470+0000 7f9c8b55f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9c8406c340 con 0x7f9c840c6940 2024-09-11T22:20:52.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.470+0000 7f9c88afa640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9c840c6d20 0x7f9c841523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.470+0000 7f9c88afa640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9c840c6d20 0x7f9c841523e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39362/0 (socket says 172.21.15.100:39362) 2024-09-11T22:20:52.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.470+0000 7f9c88afa640 1 -- 172.21.15.100:0/1734075563 learned_addr learned my addr 172.21.15.100:0/1734075563 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:52.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.470+0000 7f9c89afc640 1 --2- 172.21.15.100:0/1734075563 >> v2:172.21.15.167:3300/0 conn(0x7f9c840c3f30 0x7f9c84152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.470+0000 7f9c88afa640 1 -- 172.21.15.100:0/1734075563 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c840c6940 msgr2=0x7f9c840c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:52.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.470+0000 7f9c88afa640 1 --2- 172.21.15.100:0/1734075563 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c840c6940 0x7f9c840c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.470+0000 7f9c88afa640 1 -- 172.21.15.100:0/1734075563 >> v2:172.21.15.167:3300/0 conn(0x7f9c840c3f30 msgr2=0x7f9c84152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:52.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.470+0000 7f9c88afa640 1 --2- 172.21.15.100:0/1734075563 >> v2:172.21.15.167:3300/0 conn(0x7f9c840c3f30 0x7f9c84152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.470+0000 7f9c88afa640 1 -- 172.21.15.100:0/1734075563 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c8406f420 con 0x7f9c840c6d20 2024-09-11T22:20:52.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.471+0000 7f9c88afa640 1 --2- 172.21.15.100:0/1734075563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c840c6d20 0x7f9c841523e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9c840cd9a0 tx=0x7f9c7402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b01edddab74cb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.471+0000 7f9c7bfff640 1 -- 172.21.15.100:0/1734075563 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c74037070 con 0x7f9c840c6d20 2024-09-11T22:20:52.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.471+0000 7f9c7bfff640 1 -- 172.21.15.100:0/1734075563 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c74032440 con 0x7f9c840c6d20 2024-09-11T22:20:52.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.471+0000 7f9c7bfff640 1 -- 172.21.15.100:0/1734075563 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c74032810 con 0x7f9c840c6d20 2024-09-11T22:20:52.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.472+0000 7f9c8b55f640 1 -- 172.21.15.100:0/1734075563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c840c6d20 msgr2=0x7f9c841523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.472+0000 7f9c8b55f640 1 --2- 172.21.15.100:0/1734075563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c840c6d20 0x7f9c841523e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9c840cd9a0 tx=0x7f9c7402a140 comp rx=0 tx=0).stop 2024-09-11T22:20:52.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.472+0000 7f9c8b55f640 1 -- 172.21.15.100:0/1734075563 shutdown_connections 2024-09-11T22:20:52.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.472+0000 7f9c8b55f640 1 --2- 172.21.15.100:0/1734075563 >> v2:172.21.15.167:3300/0 conn(0x7f9c840c3f30 0x7f9c84152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.472+0000 7f9c8b55f640 1 --2- 172.21.15.100:0/1734075563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c840c6d20 0x7f9c841523e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.472+0000 7f9c8b55f640 1 --2- 172.21.15.100:0/1734075563 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c840c6940 0x7f9c840c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.472+0000 7f9c8b55f640 1 -- 172.21.15.100:0/1734075563 >> 172.21.15.100:0/1734075563 conn(0x7f9c84070b80 msgr2=0x7f9c840ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:52.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.472+0000 7f9c8b55f640 1 -- 172.21.15.100:0/1734075563 shutdown_connections 2024-09-11T22:20:52.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.472+0000 7f9c8b55f640 1 -- 172.21.15.100:0/1734075563 wait complete. 2024-09-11T22:20:52.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.473+0000 7f9c8b55f640 1 Processor -- start 2024-09-11T22:20:52.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.473+0000 7f9c8b55f640 1 -- start start 2024-09-11T22:20:52.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.473+0000 7f9c8b55f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c840c3f30 0x7f9c840c10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.473+0000 7f9c8b55f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c840c6940 0x7f9c841f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.473+0000 7f9c8b55f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c840c6d20 0x7f9c841f4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.473+0000 7f9c8b55f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9c840c9430 con 0x7f9c840c6940 2024-09-11T22:20:52.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.473+0000 7f9c8b55f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8406f9e0 con 0x7f9c840c3f30 2024-09-11T22:20:52.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.473+0000 7f9c8b55f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9c840c95b0 con 0x7f9c840c6d20 2024-09-11T22:20:52.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.474+0000 7f9c88afa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c840c6940 0x7f9c841f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.474+0000 7f9c88afa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c840c6940 0x7f9c841f4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39372/0 (socket says 172.21.15.100:39372) 2024-09-11T22:20:52.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.474+0000 7f9c88afa640 1 -- 172.21.15.100:0/2484786355 learned_addr learned my addr 172.21.15.100:0/2484786355 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:52.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.474+0000 7f9c892fb640 1 --2- 172.21.15.100:0/2484786355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c840c3f30 0x7f9c840c10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.474+0000 7f9c89afc640 1 --2- 172.21.15.100:0/2484786355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c840c6d20 0x7f9c841f4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.474+0000 7f9c88afa640 1 -- 172.21.15.100:0/2484786355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c840c6d20 msgr2=0x7f9c841f4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.474+0000 7f9c88afa640 1 --2- 172.21.15.100:0/2484786355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c840c6d20 0x7f9c841f4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.474+0000 7f9c88afa640 1 -- 172.21.15.100:0/2484786355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c840c3f30 msgr2=0x7f9c840c10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.474+0000 7f9c88afa640 1 --2- 172.21.15.100:0/2484786355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c840c3f30 0x7f9c840c10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.474+0000 7f9c88afa640 1 -- 172.21.15.100:0/2484786355 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c840bd480 con 0x7f9c840c6940 2024-09-11T22:20:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.474+0000 7f9c88afa640 1 --2- 172.21.15.100:0/2484786355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c840c6940 0x7f9c841f4610 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9c74000c00 tx=0x7f9c740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.474+0000 7f9c79ffb640 1 -- 172.21.15.100:0/2484786355 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c74037040 con 0x7f9c840c6940 2024-09-11T22:20:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.474+0000 7f9c79ffb640 1 -- 172.21.15.100:0/2484786355 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c74042070 con 0x7f9c840c6940 2024-09-11T22:20:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.474+0000 7f9c8b55f640 1 -- 172.21.15.100:0/2484786355 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c840bd760 con 0x7f9c840c6940 2024-09-11T22:20:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.474+0000 7f9c79ffb640 1 -- 172.21.15.100:0/2484786355 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c74030bd0 con 0x7f9c840c6940 2024-09-11T22:20:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.475+0000 7f9c8b55f640 1 -- 172.21.15.100:0/2484786355 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c8414d780 con 0x7f9c840c6940 2024-09-11T22:20:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.475+0000 7f9c8b55f640 1 -- 172.21.15.100:0/2484786355 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c840c79c0 con 0x7f9c840c6940 2024-09-11T22:20:52.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.476+0000 7f9c79ffb640 1 -- 172.21.15.100:0/2484786355 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c74047460 con 0x7f9c840c6940 2024-09-11T22:20:52.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.476+0000 7f9c79ffb640 1 --2- 172.21.15.100:0/2484786355 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9c6806be30 0x7f9c6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:52.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.476+0000 7f9c79ffb640 1 -- 172.21.15.100:0/2484786355 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9c740abb60 con 0x7f9c840c6940 2024-09-11T22:20:52.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.476+0000 7f9c892fb640 1 --2- 172.21.15.100:0/2484786355 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9c6806be30 0x7f9c6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:52.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.477+0000 7f9c892fb640 1 --2- 172.21.15.100:0/2484786355 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9c6806be30 0x7f9c6806e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9c800098e0 tx=0x7f9c80009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:52.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.481+0000 7f9c79ffb640 1 -- 172.21.15.100:0/2484786355 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9c74079c10 con 0x7f9c840c6940 2024-09-11T22:20:52.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.680+0000 7f9c8b55f640 1 -- 172.21.15.100:0/2484786355 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c840c3a00 con 0x7f9c840c6940 2024-09-11T22:20:52.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.680+0000 7f9c79ffb640 1 -- 172.21.15.100:0/2484786355 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6922 (secure 0 0 0) 0x7f9c7407df10 con 0x7f9c840c6940 2024-09-11T22:20:52.681 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:52.681 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":13,"btime":"2024-09-11T22:20:47:956918+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2075802330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":2075802330},{"type":"v1","addr":"172.21.15.100:6837","nonce":2075802330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/1727733473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1727733473},{"type":"v1","addr":"172.21.15.167:6836","nonce":1727733473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/880809662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":880809662},{"type":"v1","addr":"172.21.15.167:6837","nonce":880809662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:19.171222+0000","modified":"2024-09-11T22:20:47.956908+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4296,"mds_1":4281,"mds_2":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":2,"incarnation":13,"state":"up:creating","state_seq":1,"addr":"172.21.15.100:6836/1912241808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1912241808},{"type":"v1","addr":"172.21.15.100:6836","nonce":1912241808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4281":{"gid":4281,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6839/3236256661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3236256661},{"type":"v1","addr":"172.21.15.100:6839","nonce":3236256661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4296":{"gid":4296,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6834/1651678197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1651678197},{"type":"v1","addr":"172.21.15.167:6834","nonce":1651678197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296,4281]},"id":1}]} 2024-09-11T22:20:52.681 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 13 2024-09-11T22:20:52.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.682+0000 7f9c8b55f640 1 -- 172.21.15.100:0/2484786355 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9c6806be30 msgr2=0x7f9c6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.682+0000 7f9c8b55f640 1 --2- 172.21.15.100:0/2484786355 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9c6806be30 0x7f9c6806e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9c800098e0 tx=0x7f9c80009060 comp rx=0 tx=0).stop 2024-09-11T22:20:52.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.682+0000 7f9c8b55f640 1 -- 172.21.15.100:0/2484786355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c840c6940 msgr2=0x7f9c841f4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:52.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.682+0000 7f9c8b55f640 1 --2- 172.21.15.100:0/2484786355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c840c6940 0x7f9c841f4610 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9c74000c00 tx=0x7f9c740046c0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.682+0000 7f9c8b55f640 1 -- 172.21.15.100:0/2484786355 shutdown_connections 2024-09-11T22:20:52.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.682+0000 7f9c8b55f640 1 --2- 172.21.15.100:0/2484786355 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9c6806be30 0x7f9c6806e2f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.682+0000 7f9c8b55f640 1 --2- 172.21.15.100:0/2484786355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c840c6d20 0x7f9c841f4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.682+0000 7f9c8b55f640 1 --2- 172.21.15.100:0/2484786355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c840c6940 0x7f9c841f4610 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.682+0000 7f9c8b55f640 1 --2- 172.21.15.100:0/2484786355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c840c3f30 0x7f9c840c10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:52.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.682+0000 7f9c8b55f640 1 -- 172.21.15.100:0/2484786355 >> 172.21.15.100:0/2484786355 conn(0x7f9c84070b80 msgr2=0x7f9c84151880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:52.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.682+0000 7f9c8b55f640 1 -- 172.21.15.100:0/2484786355 shutdown_connections 2024-09-11T22:20:52.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:52.682+0000 7f9c8b55f640 1 -- 172.21.15.100:0/2484786355 wait complete. 2024-09-11T22:20:53.299 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:20:19.171222+0000', 'modified': '2024-09-11T22:20:47.956908+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4296, 'mds_1': 4281, 'mds_2': 4275}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4275': {'gid': 4275, 'name': 'a', 'rank': 2, 'incarnation': 13, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.100:6836/1912241808', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6834', 'nonce': 1912241808}, {'type': 'v1', 'addr': '172.21.15.100:6836', 'nonce': 1912241808}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4281': {'gid': 4281, 'name': 'e', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.100:6839/3236256661', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6838', 'nonce': 3236256661}, {'type': 'v1', 'addr': '172.21.15.100:6839', 'nonce': 3236256661}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4296': {'gid': 4296, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.167:6834/1651678197', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6832', 'nonce': 1651678197}, {'type': 'v1', 'addr': '172.21.15.167:6834', 'nonce': 1651678197}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4296, 'qdb_cluster': [4296, 4281]} 2024-09-11T22:20:53.299 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4275:up:creating 2024-09-11T22:20:54.300 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:20:54.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.411+0000 7f0ee7166640 1 Processor -- start 2024-09-11T22:20:54.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.411+0000 7f0ee7166640 1 -- start start 2024-09-11T22:20:54.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.412+0000 7f0ee7166640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0ee015def0 0x7f0ee015b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:54.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.412+0000 7f0ee7166640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ee015e3a0 con 0x7f0ee00cb9b0 2024-09-11T22:20:54.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.412+0000 7f0ee7166640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ee015e680 con 0x7f0ee0154c50 2024-09-11T22:20:54.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.412+0000 7f0ee7166640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f0ee015b940 con 0x7f0ee015def0 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.412+0000 7f0ee5703640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f0ee00cb9b0 0x7f0ee00ca1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49168/0 (socket says 172.21.15.100:49168) 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.412+0000 7f0ee5703640 1 -- 172.21.15.100:0/796257915 learned_addr learned my addr 172.21.15.100:0/796257915 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.412+0000 7f0edffff640 1 --2- 172.21.15.100:0/796257915 >> v2:172.21.15.167:3300/0 conn(0x7f0ee015def0 0x7f0ee015b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.412+0000 7f0edf7fe640 1 -- 172.21.15.100:0/796257915 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3457252495 0 0) 0x7f0ee015e3a0 con 0x7f0ee00cb9b0 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.412+0000 7f0edf7fe640 1 -- 172.21.15.100:0/796257915 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ed0003520 con 0x7f0ee00cb9b0 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.412+0000 7f0edf7fe640 1 -- 172.21.15.100:0/796257915 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1756550197 0 0) 0x7f0ee015e680 con 0x7f0ee0154c50 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.412+0000 7f0edf7fe640 1 -- 172.21.15.100:0/796257915 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ee015e3a0 con 0x7f0ee0154c50 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.413+0000 7f0edf7fe640 1 -- 172.21.15.100:0/796257915 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2947697667 0 0) 0x7f0ed0003520 con 0x7f0ee00cb9b0 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.413+0000 7f0edffff640 1 -- 172.21.15.100:0/796257915 >> v1:172.21.15.167:6789/0 conn(0x7f0ee0154c50 legacy=0x7f0ee0071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.413+0000 7f0edffff640 1 -- 172.21.15.100:0/796257915 >> v1:172.21.15.100:6789/0 conn(0x7f0ee00cb9b0 legacy=0x7f0ee00ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:54.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.413+0000 7f0edffff640 1 -- 172.21.15.100:0/796257915 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee015e960 con 0x7f0ee015def0 2024-09-11T22:20:54.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.413+0000 7f0edffff640 1 --2- 172.21.15.100:0/796257915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee015def0 0x7f0ee015b400 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0097a0 tx=0x7f0ecc02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69f91dcd9c447ad9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:54.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.414+0000 7f0edf7fe640 1 -- 172.21.15.100:0/796257915 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc037070 con 0x7f0ee015def0 2024-09-11T22:20:54.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.414+0000 7f0edf7fe640 1 -- 172.21.15.100:0/796257915 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ecc02ace0 con 0x7f0ee015def0 2024-09-11T22:20:54.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.414+0000 7f0edf7fe640 1 -- 172.21.15.100:0/796257915 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed80019f0 con 0x7f0ee015def0 2024-09-11T22:20:54.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.414+0000 7f0ee7166640 1 -- 172.21.15.100:0/796257915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee015def0 msgr2=0x7f0ee015b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:54.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.414+0000 7f0ee7166640 1 --2- 172.21.15.100:0/796257915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee015def0 0x7f0ee015b400 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc0097a0 tx=0x7f0ecc02a250 comp rx=0 tx=0).stop 2024-09-11T22:20:54.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.414+0000 7f0ee7166640 1 -- 172.21.15.100:0/796257915 shutdown_connections 2024-09-11T22:20:54.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.414+0000 7f0ee7166640 1 --2- 172.21.15.100:0/796257915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee015def0 0x7f0ee015b400 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:54.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.414+0000 7f0ee7166640 1 -- 172.21.15.100:0/796257915 >> 172.21.15.100:0/796257915 conn(0x7f0ee006fb50 msgr2=0x7f0ee006ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:54.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.414+0000 7f0ee7166640 1 -- 172.21.15.100:0/796257915 shutdown_connections 2024-09-11T22:20:54.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.414+0000 7f0ee7166640 1 -- 172.21.15.100:0/796257915 wait complete. 2024-09-11T22:20:54.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.415+0000 7f0ee7166640 1 Processor -- start 2024-09-11T22:20:54.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.415+0000 7f0ee7166640 1 -- start start 2024-09-11T22:20:54.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.416+0000 7f0ee7166640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ee00cb9b0 0x7f0ee0155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:54.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.416+0000 7f0ee7166640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee0154c50 0x7f0ee00b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:54.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.416+0000 7f0ee7166640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee015def0 0x7f0ee01f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:54.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.416+0000 7f0ee7166640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee0155030 con 0x7f0ee00cb9b0 2024-09-11T22:20:54.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.416+0000 7f0ee7166640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee00c9c90 con 0x7f0ee0154c50 2024-09-11T22:20:54.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.416+0000 7f0ee7166640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0ee0071b60 con 0x7f0ee015def0 2024-09-11T22:20:54.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.416+0000 7f0ee4f02640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ee00cb9b0 0x7f0ee0155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:54.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.416+0000 7f0ee4f02640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ee00cb9b0 0x7f0ee0155f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39386/0 (socket says 172.21.15.100:39386) 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.416+0000 7f0ee4f02640 1 -- 172.21.15.100:0/2367089272 learned_addr learned my addr 172.21.15.100:0/2367089272 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.417+0000 7f0edffff640 1 --2- 172.21.15.100:0/2367089272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee0154c50 0x7f0ee00b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.417+0000 7f0ee4f02640 1 -- 172.21.15.100:0/2367089272 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee015def0 msgr2=0x7f0ee01f3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.417+0000 7f0ee4f02640 1 --2- 172.21.15.100:0/2367089272 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee015def0 0x7f0ee01f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.417+0000 7f0ee4f02640 1 -- 172.21.15.100:0/2367089272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee0154c50 msgr2=0x7f0ee00b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.417+0000 7f0ee4f02640 1 --2- 172.21.15.100:0/2367089272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee0154c50 0x7f0ee00b0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.417+0000 7f0ee4f02640 1 -- 172.21.15.100:0/2367089272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee00af270 con 0x7f0ee00cb9b0 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.417+0000 7f0ee4f02640 1 --2- 172.21.15.100:0/2367089272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ee00cb9b0 0x7f0ee0155f70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0ed400c430 tx=0x7f0ed400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.417+0000 7f0edd7fa640 1 -- 172.21.15.100:0/2367089272 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4017070 con 0x7f0ee00cb9b0 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.417+0000 7f0edd7fa640 1 -- 172.21.15.100:0/2367089272 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed40052f0 con 0x7f0ee00cb9b0 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.417+0000 7f0ee7166640 1 -- 172.21.15.100:0/2367089272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee00aecb0 con 0x7f0ee00cb9b0 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.417+0000 7f0edd7fa640 1 -- 172.21.15.100:0/2367089272 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4003830 con 0x7f0ee00cb9b0 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.417+0000 7f0ee7166640 1 -- 172.21.15.100:0/2367089272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee00b0020 con 0x7f0ee00cb9b0 2024-09-11T22:20:54.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.418+0000 7f0ee7166640 1 -- 172.21.15.100:0/2367089272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ee00cafb0 con 0x7f0ee00cb9b0 2024-09-11T22:20:54.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.418+0000 7f0edd7fa640 1 -- 172.21.15.100:0/2367089272 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ed401a070 con 0x7f0ee00cb9b0 2024-09-11T22:20:54.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.419+0000 7f0edd7fa640 1 --2- 172.21.15.100:0/2367089272 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0ec406be60 0x7f0ec406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:54.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.419+0000 7f0edd7fa640 1 -- 172.21.15.100:0/2367089272 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0ed408a550 con 0x7f0ee00cb9b0 2024-09-11T22:20:54.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.419+0000 7f0edffff640 1 --2- 172.21.15.100:0/2367089272 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0ec406be60 0x7f0ec406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:54.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.419+0000 7f0edffff640 1 --2- 172.21.15.100:0/2367089272 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0ec406be60 0x7f0ec406e320 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc034000 tx=0x7f0ecc02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:54.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.423+0000 7f0edd7fa640 1 -- 172.21.15.100:0/2367089272 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0ee00af270 con 0x7f0ee00cb9b0 2024-09-11T22:20:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.624+0000 7f0ee7166640 1 -- 172.21.15.100:0/2367089272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ee00c9300 con 0x7f0ee00cb9b0 2024-09-11T22:20:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.625+0000 7f0edd7fa640 1 -- 172.21.15.100:0/2367089272 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6926 (secure 0 0 0) 0x7f0ed4058c50 con 0x7f0ee00cb9b0 2024-09-11T22:20:54.625 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:20:54.625 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":14,"btime":"2024-09-11T22:20:52:989866+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2075802330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":2075802330},{"type":"v1","addr":"172.21.15.100:6837","nonce":2075802330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/1727733473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1727733473},{"type":"v1","addr":"172.21.15.167:6836","nonce":1727733473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/880809662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":880809662},{"type":"v1","addr":"172.21.15.167:6837","nonce":880809662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:19.171222+0000","modified":"2024-09-11T22:20:52.989862+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4296,"mds_1":4281,"mds_2":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.100:6836/1912241808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1912241808},{"type":"v1","addr":"172.21.15.100:6836","nonce":1912241808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4281":{"gid":4281,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6839/3236256661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3236256661},{"type":"v1","addr":"172.21.15.100:6839","nonce":3236256661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4296":{"gid":4296,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6834/1651678197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1651678197},{"type":"v1","addr":"172.21.15.167:6834","nonce":1651678197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4275,4281,4296]},"id":1}]} 2024-09-11T22:20:54.626 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 14 2024-09-11T22:20:54.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.627+0000 7f0ee7166640 1 -- 172.21.15.100:0/2367089272 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0ec406be60 msgr2=0x7f0ec406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:54.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.627+0000 7f0ee7166640 1 --2- 172.21.15.100:0/2367089272 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0ec406be60 0x7f0ec406e320 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc034000 tx=0x7f0ecc02e000 comp rx=0 tx=0).stop 2024-09-11T22:20:54.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.627+0000 7f0ee7166640 1 -- 172.21.15.100:0/2367089272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ee00cb9b0 msgr2=0x7f0ee0155f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:54.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.627+0000 7f0ee7166640 1 --2- 172.21.15.100:0/2367089272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ee00cb9b0 0x7f0ee0155f70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0ed400c430 tx=0x7f0ed400c8f0 comp rx=0 tx=0).stop 2024-09-11T22:20:54.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.627+0000 7f0ee7166640 1 -- 172.21.15.100:0/2367089272 shutdown_connections 2024-09-11T22:20:54.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.627+0000 7f0ee7166640 1 --2- 172.21.15.100:0/2367089272 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0ec406be60 0x7f0ec406e320 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:54.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.627+0000 7f0ee7166640 1 --2- 172.21.15.100:0/2367089272 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee015def0 0x7f0ee01f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:54.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.627+0000 7f0ee7166640 1 --2- 172.21.15.100:0/2367089272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee0154c50 0x7f0ee00b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:54.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.627+0000 7f0ee7166640 1 --2- 172.21.15.100:0/2367089272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ee00cb9b0 0x7f0ee0155f70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:54.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.627+0000 7f0ee7166640 1 -- 172.21.15.100:0/2367089272 >> 172.21.15.100:0/2367089272 conn(0x7f0ee006fb50 msgr2=0x7f0ee00c3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:54.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.627+0000 7f0ee7166640 1 -- 172.21.15.100:0/2367089272 shutdown_connections 2024-09-11T22:20:54.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:54.627+0000 7f0ee7166640 1 -- 172.21.15.100:0/2367089272 wait complete. 2024-09-11T22:20:54.820 INFO:tasks.ceph.mds.f.smithi167.stderr:2024-09-11T22:20:54.819+0000 7fcf973ca640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-11T22:20:55.242 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T22:20:19.171222+0000', 'modified': '2024-09-11T22:20:52.989862+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4296, 'mds_1': 4281, 'mds_2': 4275}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4275': {'gid': 4275, 'name': 'a', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.100:6836/1912241808', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6834', 'nonce': 1912241808}, {'type': 'v1', 'addr': '172.21.15.100:6836', 'nonce': 1912241808}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4281': {'gid': 4281, 'name': 'e', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.100:6839/3236256661', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6838', 'nonce': 3236256661}, {'type': 'v1', 'addr': '172.21.15.100:6839', 'nonce': 3236256661}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4296': {'gid': 4296, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.167:6834/1651678197', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6832', 'nonce': 1651678197}, {'type': 'v1', 'addr': '172.21.15.167:6834', 'nonce': 1651678197}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4296, 'qdb_cluster': [4275, 4281, 4296]} 2024-09-11T22:20:55.242 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-11T22:20:55.242 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-11T22:20:55.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.346+0000 7f2f9b88d640 1 Processor -- start 2024-09-11T22:20:55.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.346+0000 7f2f9b88d640 1 -- start start 2024-09-11T22:20:55.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.347+0000 7f2f9b88d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f940c1370 0x7f2f940739e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:55.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.347+0000 7f2f9b88d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2f940c1750 0x7f2f94157d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:55.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.347+0000 7f2f9b88d640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f94071840 con 0x7f2f94073f20 2024-09-11T22:20:55.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.347+0000 7f2f9b88d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f2f940c2db0 con 0x7f2f940c1750 2024-09-11T22:20:55.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.347+0000 7f2f9b88d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2f94071ae0 con 0x7f2f940c1370 2024-09-11T22:20:55.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.347+0000 7f2f99e2a640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2f94073f20 0x7f2f941515a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49174/0 (socket says 172.21.15.100:49174) 2024-09-11T22:20:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.347+0000 7f2f99e2a640 1 -- 172.21.15.100:0/597306132 learned_addr learned my addr 172.21.15.100:0/597306132 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.347+0000 7f2f93fff640 1 -- 172.21.15.100:0/597306132 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4217310548 0 0) 0x7f2f94071840 con 0x7f2f94073f20 2024-09-11T22:20:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f93fff640 1 -- 172.21.15.100:0/597306132 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f7c003520 con 0x7f2f94073f20 2024-09-11T22:20:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f99629640 1 --2- 172.21.15.100:0/597306132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f940c1370 0x7f2f940739e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f98e28640 1 --2- 172.21.15.100:0/597306132 >> v2:172.21.15.167:3300/0 conn(0x7f2f940c1750 0x7f2f94157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f93fff640 1 -- 172.21.15.100:0/597306132 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3423101836 0 0) 0x7f2f7c003520 con 0x7f2f94073f20 2024-09-11T22:20:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f93fff640 1 -- 172.21.15.100:0/597306132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f940c1370 msgr2=0x7f2f940739e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f93fff640 1 --2- 172.21.15.100:0/597306132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f940c1370 0x7f2f940739e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f93fff640 1 -- 172.21.15.100:0/597306132 >> v2:172.21.15.167:3300/0 conn(0x7f2f940c1750 msgr2=0x7f2f94157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f93fff640 1 --2- 172.21.15.100:0/597306132 >> v2:172.21.15.167:3300/0 conn(0x7f2f940c1750 0x7f2f94157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f93fff640 1 -- 172.21.15.100:0/597306132 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f94071dc0 con 0x7f2f94073f20 2024-09-11T22:20:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f93fff640 1 -- 172.21.15.100:0/597306132 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f2f8c001690 con 0x7f2f94073f20 2024-09-11T22:20:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f93fff640 1 -- 172.21.15.100:0/597306132 >> v1:172.21.15.100:6789/0 conn(0x7f2f94073f20 legacy=0x7f2f941515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:55.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f93fff640 1 --2- 172.21.15.100:0/597306132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f7c0039b0 0x7f2f7c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:55.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f93fff640 1 --2- 172.21.15.100:0/597306132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f940c1370 0x7f2f7c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:55.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f93fff640 1 --2- 172.21.15.100:0/597306132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f7c004d40 0x7f2f7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:55.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f93fff640 1 -- 172.21.15.100:0/597306132 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2f94071ae0 con 0x7f2f7c0039b0 2024-09-11T22:20:55.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f93fff640 1 -- 172.21.15.100:0/597306132 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7c00b9c0 con 0x7f2f7c004d40 2024-09-11T22:20:55.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f93fff640 1 -- 172.21.15.100:0/597306132 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2f7c00bb40 con 0x7f2f940c1370 2024-09-11T22:20:55.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f99629640 1 --2- 172.21.15.100:0/597306132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f7c0039b0 0x7f2f7c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:55.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f99e2a640 1 --2- 172.21.15.100:0/597306132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f7c004d40 0x7f2f7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:55.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f98e28640 1 --2- 172.21.15.100:0/597306132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f940c1370 0x7f2f7c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:55.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f99629640 1 -- 172.21.15.100:0/597306132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f940c1370 msgr2=0x7f2f7c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:55.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f99629640 1 --2- 172.21.15.100:0/597306132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f940c1370 0x7f2f7c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:55.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f99629640 1 -- 172.21.15.100:0/597306132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f7c004d40 msgr2=0x7f2f7c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:55.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f99629640 1 --2- 172.21.15.100:0/597306132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f7c004d40 0x7f2f7c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:55.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f99629640 1 -- 172.21.15.100:0/597306132 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7c003520 con 0x7f2f7c0039b0 2024-09-11T22:20:55.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.348+0000 7f2f98e28640 1 --2- 172.21.15.100:0/597306132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f940c1370 0x7f2f7c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:55.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.349+0000 7f2f99629640 1 --2- 172.21.15.100:0/597306132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f7c0039b0 0x7f2f7c003dd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009fc0 tx=0x7f2f7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02b2cd6847081fe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:55.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.349+0000 7f2f93fff640 1 -- 172.21.15.100:0/597306132 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f84009c10 con 0x7f2f7c0039b0 2024-09-11T22:20:55.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.349+0000 7f2f93fff640 1 -- 172.21.15.100:0/597306132 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f84036070 con 0x7f2f7c0039b0 2024-09-11T22:20:55.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.349+0000 7f2f93fff640 1 -- 172.21.15.100:0/597306132 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f84031880 con 0x7f2f7c0039b0 2024-09-11T22:20:55.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.350+0000 7f2f9b88d640 1 -- 172.21.15.100:0/597306132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f7c0039b0 msgr2=0x7f2f7c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:55.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.350+0000 7f2f9b88d640 1 --2- 172.21.15.100:0/597306132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f7c0039b0 0x7f2f7c003dd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009fc0 tx=0x7f2f7c005830 comp rx=0 tx=0).stop 2024-09-11T22:20:55.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.350+0000 7f2f99e2a640 1 -- 172.21.15.100:0/597306132 reap_dead start 2024-09-11T22:20:55.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.350+0000 7f2f9b88d640 1 -- 172.21.15.100:0/597306132 shutdown_connections 2024-09-11T22:20:55.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.350+0000 7f2f9b88d640 1 -- 172.21.15.100:0/597306132 >> 172.21.15.100:0/597306132 conn(0x7f2f9406f360 msgr2=0x7f2f9406f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:55.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.350+0000 7f2f9b88d640 1 -- 172.21.15.100:0/597306132 shutdown_connections 2024-09-11T22:20:55.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.350+0000 7f2f9b88d640 1 -- 172.21.15.100:0/597306132 wait complete. 2024-09-11T22:20:55.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.351+0000 7f2f9b88d640 1 Processor -- start 2024-09-11T22:20:55.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.351+0000 7f2f9b88d640 1 -- start start 2024-09-11T22:20:55.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.352+0000 7f2f9b88d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f7c0039b0 0x7f2f940b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:55.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.352+0000 7f2f9b88d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f940af5d0 0x7f2f94144450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:55.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.352+0000 7f2f9b88d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f940b0d40 0x7f2f940b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:55.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.352+0000 7f2f9b88d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2f94072500 con 0x7f2f940af5d0 2024-09-11T22:20:55.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.352+0000 7f2f9b88d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2f94072380 con 0x7f2f940b0d40 2024-09-11T22:20:55.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.352+0000 7f2f9b88d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2f94151cb0 con 0x7f2f7c0039b0 2024-09-11T22:20:55.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.352+0000 7f2f98e28640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f940af5d0 0x7f2f94144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:55.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.352+0000 7f2f98e28640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f940af5d0 0x7f2f94144450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39396/0 (socket says 172.21.15.100:39396) 2024-09-11T22:20:55.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.352+0000 7f2f98e28640 1 -- 172.21.15.100:0/1638263360 learned_addr learned my addr 172.21.15.100:0/1638263360 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:55.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.352+0000 7f2f99629640 1 --2- 172.21.15.100:0/1638263360 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f7c0039b0 0x7f2f940b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:55.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.352+0000 7f2f99e2a640 1 --2- 172.21.15.100:0/1638263360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f940b0d40 0x7f2f940b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:55.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.352+0000 7f2f98e28640 1 -- 172.21.15.100:0/1638263360 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f7c0039b0 msgr2=0x7f2f940b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:55.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.352+0000 7f2f98e28640 1 --2- 172.21.15.100:0/1638263360 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f7c0039b0 0x7f2f940b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:55.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.352+0000 7f2f98e28640 1 -- 172.21.15.100:0/1638263360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f940b0d40 msgr2=0x7f2f940b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:55.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.352+0000 7f2f98e28640 1 --2- 172.21.15.100:0/1638263360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f940b0d40 0x7f2f940b11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:55.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.352+0000 7f2f98e28640 1 -- 172.21.15.100:0/1638263360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f940b1e50 con 0x7f2f940af5d0 2024-09-11T22:20:55.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.352+0000 7f2f98e28640 1 --2- 172.21.15.100:0/1638263360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f940af5d0 0x7f2f94144450 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2f88006c00 tx=0x7f2f880119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:55.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.352+0000 7f2f91ffb640 1 -- 172.21.15.100:0/1638263360 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f88015870 con 0x7f2f940af5d0 2024-09-11T22:20:55.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.352+0000 7f2f91ffb640 1 -- 172.21.15.100:0/1638263360 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f88015a10 con 0x7f2f940af5d0 2024-09-11T22:20:55.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.352+0000 7f2f9b88d640 1 -- 172.21.15.100:0/1638263360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f941ee2a0 con 0x7f2f940af5d0 2024-09-11T22:20:55.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.352+0000 7f2f91ffb640 1 -- 172.21.15.100:0/1638263360 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f88015de0 con 0x7f2f940af5d0 2024-09-11T22:20:55.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.353+0000 7f2f9b88d640 1 -- 172.21.15.100:0/1638263360 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f941ee820 con 0x7f2f940af5d0 2024-09-11T22:20:55.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.354+0000 7f2f91ffb640 1 -- 172.21.15.100:0/1638263360 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2f8801d400 con 0x7f2f940af5d0 2024-09-11T22:20:55.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.354+0000 7f2f91ffb640 1 --2- 172.21.15.100:0/1638263360 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2f8006be60 0x7f2f8006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:55.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.355+0000 7f2f91ffb640 1 -- 172.21.15.100:0/1638263360 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2f8808ba30 con 0x7f2f940af5d0 2024-09-11T22:20:55.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.355+0000 7f2f99629640 1 --2- 172.21.15.100:0/1638263360 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2f8006be60 0x7f2f8006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:55.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.355+0000 7f2f99629640 1 --2- 172.21.15.100:0/1638263360 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2f8006be60 0x7f2f8006e320 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2f84035000 tx=0x7f2f8402f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:55.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.355+0000 7f2f9e628740 1 Processor -- start 2024-09-11T22:20:55.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.355+0000 7f2f9e628740 1 -- start start 2024-09-11T22:20:55.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.356+0000 7f2f9e628740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557877730750 0x5578777689e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:55.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.356+0000 7f2f9e628740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55787772df80 0x557877768f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:55.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.356+0000 7f2f9e628740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557877730b30 0x55787772ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:55.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.356+0000 7f2f9e628740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557877691520 con 0x55787772df80 2024-09-11T22:20:55.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.356+0000 7f2f9e628740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5578776393e0 con 0x557877730b30 2024-09-11T22:20:55.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.356+0000 7f2f9e628740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55787768d4e0 con 0x557877730750 2024-09-11T22:20:55.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.356+0000 7f2f98e28640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55787772df80 0x557877768f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:55.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.356+0000 7f2f98e28640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55787772df80 0x557877768f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39400/0 (socket says 172.21.15.100:39400) 2024-09-11T22:20:55.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.356+0000 7f2f98e28640 1 -- 172.21.15.100:0/1444960899 learned_addr learned my addr 172.21.15.100:0/1444960899 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:55.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.356+0000 7f2f99e2a640 1 --2- 172.21.15.100:0/1444960899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557877730b30 0x55787772ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:55.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.356+0000 7f2f99629640 1 --2- 172.21.15.100:0/1444960899 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557877730750 0x5578777689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:55.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.356+0000 7f2f98e28640 1 -- 172.21.15.100:0/1444960899 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557877730750 msgr2=0x5578777689e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:55.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.356+0000 7f2f98e28640 1 --2- 172.21.15.100:0/1444960899 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557877730750 0x5578777689e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:55.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.356+0000 7f2f98e28640 1 -- 172.21.15.100:0/1444960899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557877730b30 msgr2=0x55787772ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:55.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.356+0000 7f2f98e28640 1 --2- 172.21.15.100:0/1444960899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557877730b30 0x55787772ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:55.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.356+0000 7f2f98e28640 1 -- 172.21.15.100:0/1444960899 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578776542f0 con 0x55787772df80 2024-09-11T22:20:55.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.356+0000 7f2f99629640 1 --2- 172.21.15.100:0/1444960899 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557877730750 0x5578777689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:55.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.357+0000 7f2f98e28640 1 --2- 172.21.15.100:0/1444960899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55787772df80 0x557877768f20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2f88089b90 tx=0x7f2f88059580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63351de6dba94622 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:55.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.357+0000 7f2f7affd640 1 -- 172.21.15.100:0/1444960899 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f88088070 con 0x55787772df80 2024-09-11T22:20:55.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.357+0000 7f2f7affd640 1 -- 172.21.15.100:0/1444960899 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f88062580 con 0x55787772df80 2024-09-11T22:20:55.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.357+0000 7f2f7affd640 1 -- 172.21.15.100:0/1444960899 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f88071030 con 0x55787772df80 2024-09-11T22:20:55.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.357+0000 7f2f9e628740 1 -- 172.21.15.100:0/1444960899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55787772df80 msgr2=0x557877768f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:55.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.357+0000 7f2f9e628740 1 --2- 172.21.15.100:0/1444960899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55787772df80 0x557877768f20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2f88089b90 tx=0x7f2f88059580 comp rx=0 tx=0).stop 2024-09-11T22:20:55.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.357+0000 7f2f9e628740 1 -- 172.21.15.100:0/1444960899 shutdown_connections 2024-09-11T22:20:55.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.357+0000 7f2f9e628740 1 --2- 172.21.15.100:0/1444960899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557877730b30 0x55787772ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:55.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.357+0000 7f2f9e628740 1 --2- 172.21.15.100:0/1444960899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55787772df80 0x557877768f20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:55.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.357+0000 7f2f9e628740 1 --2- 172.21.15.100:0/1444960899 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557877730750 0x5578777689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:55.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.357+0000 7f2f9e628740 1 -- 172.21.15.100:0/1444960899 >> 172.21.15.100:0/1444960899 conn(0x55787772ee70 msgr2=0x55787772f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:55.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.357+0000 7f2f9e628740 1 -- 172.21.15.100:0/1444960899 shutdown_connections 2024-09-11T22:20:55.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.357+0000 7f2f9e628740 1 -- 172.21.15.100:0/1444960899 wait complete. 2024-09-11T22:20:55.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.358+0000 7f2f9e628740 1 -- start start 2024-09-11T22:20:55.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.358+0000 7f2f9e628740 1 Processor -- start 2024-09-11T22:20:55.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.359+0000 7f2f9e628740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55787772df80 0x5578777830f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:55.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.359+0000 7f2f9e628740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557877730750 0x557877758920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:55.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.359+0000 7f2f9e628740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557877730b30 0x557877759520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:55.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.359+0000 7f2f9e628740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55787772ffe0 con 0x557877730b30 2024-09-11T22:20:55.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.359+0000 7f2f9e628740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55787761a450 con 0x557877730750 2024-09-11T22:20:55.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.359+0000 7f2f9e628740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x557877768550 con 0x55787772df80 2024-09-11T22:20:55.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.359+0000 7f2f9e628740 10 client.0 _ll_register_callbacks cb 0x5578773a3ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:55.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.359+0000 7f2f99e2a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557877730b30 0x557877759520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:55.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.359+0000 7f2f99e2a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557877730b30 0x557877759520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39416/0 (socket says 172.21.15.100:39416) 2024-09-11T22:20:55.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.359+0000 7f2f99e2a640 1 -- 172.21.15.100:0/600799843 learned_addr learned my addr 172.21.15.100:0/600799843 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:55.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.359+0000 7f2f99629640 1 --2- 172.21.15.100:0/600799843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55787772df80 0x5578777830f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:55.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.359+0000 7f2f98e28640 1 --2- 172.21.15.100:0/600799843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557877730750 0x557877758920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:55.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.359+0000 7f2f99e2a640 1 -- 172.21.15.100:0/600799843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55787772df80 msgr2=0x5578777830f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:55.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.359+0000 7f2f99e2a640 1 --2- 172.21.15.100:0/600799843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55787772df80 0x5578777830f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:55.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.359+0000 7f2f99e2a640 1 -- 172.21.15.100:0/600799843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557877730750 msgr2=0x557877758920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:55.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.359+0000 7f2f99e2a640 1 --2- 172.21.15.100:0/600799843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557877730750 0x557877758920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:55.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.359+0000 7f2f99e2a640 1 -- 172.21.15.100:0/600799843 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578773a42d0 con 0x557877730b30 2024-09-11T22:20:55.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.359+0000 7f2f99e2a640 1 --2- 172.21.15.100:0/600799843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557877730b30 0x557877759520 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2f940c9ca0 tx=0x7f2f8c007060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa019a9416943d5c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:55.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.359+0000 7f2f73fff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-11T22:20:55.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.360+0000 7f2f73fff640 1 -- 172.21.15.100:0/600799843 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c013540 con 0x557877730b30 2024-09-11T22:20:55.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.360+0000 7f2f73fff640 1 -- 172.21.15.100:0/600799843 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2f8c010040 con 0x557877730b30 2024-09-11T22:20:55.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.360+0000 7f2f9e628740 1 -- 172.21.15.100:0/600799843 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f88062580 con 0x557877730b30 2024-09-11T22:20:55.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.360+0000 7f2f73fff640 1 -- 172.21.15.100:0/600799843 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f2f8c0136e0 con 0x557877730b30 2024-09-11T22:20:55.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.360+0000 7f2f9e628740 10 client.4749 fetch_fsmap learned FSMap version 14 2024-09-11T22:20:55.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.360+0000 7f2f9e628740 1 -- 172.21.15.100:0/600799843 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55787746e6b0 con 0x557877730b30 2024-09-11T22:20:55.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.360+0000 7f2f73fff640 1 -- 172.21.15.100:0/600799843 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f88062580 con 0x557877730b30 2024-09-11T22:20:55.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.360+0000 7f2f73fff640 1 -- 172.21.15.100:0/600799843 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 14) ==== 4760+0+0 (secure 0 0 0) 0x7f2f8c013880 con 0x557877730b30 2024-09-11T22:20:55.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.360+0000 7f2f9e628740 10 client.4749 fetch_fsmap finished waiting for FSMap version 14 2024-09-11T22:20:55.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.360+0000 7f2f9e628740 10 client.4749 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T22:20:55.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.360+0000 7f2f9e628740 20 client.4749 populate_metadata read hostname 'smithi100' 2024-09-11T22:20:55.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.360+0000 7f2f9e628740 1 --2- 172.21.15.100:0/600799843 >> [v2:172.21.15.100:6834/1912241808,v1:172.21.15.100:6836/1912241808] conn(0x557877762970 0x55787778e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:55.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.360+0000 7f2f9e628740 4 client.4749 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:55.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.360+0000 7f2f9e628740 1 -- 172.21.15.100:0/600799843 --> [v2:172.21.15.100:6834/1912241808,v1:172.21.15.100:6836/1912241808] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55787769ec50 con 0x557877762970 2024-09-11T22:20:55.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.360+0000 7f2f99629640 1 --2- 172.21.15.100:0/600799843 >> [v2:172.21.15.100:6834/1912241808,v1:172.21.15.100:6836/1912241808] conn(0x557877762970 0x55787778e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:55.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.361+0000 7f2f73fff640 10 client.4749 ms_handle_connect on v2:172.21.15.100:6834/1912241808 2024-09-11T22:20:55.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:55.361+0000 7f2f99629640 1 --2- 172.21.15.100:0/600799843 >> [v2:172.21.15.100:6834/1912241808,v1:172.21.15.100:6836/1912241808] conn(0x557877762970 0x55787778e790 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=77acb233f71de208 server_cookie=3769751bfb69ea3b in_seq=0 out_seq=0 2024-09-11T22:20:57.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:57.992+0000 7f2f73fff640 1 -- 172.21.15.100:0/600799843 <== mds.2 v2:172.21.15.100:6834/1912241808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55787769ec50 con 0x557877762970 2024-09-11T22:20:57.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:57.992+0000 7f2f73fff640 10 client.4749 handle_command_reply: tid=0 2024-09-11T22:20:57.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:57.992+0000 7f2f9e628740 1 client.4749 shutdown 2024-09-11T22:20:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:57.992+0000 7f2f9e628740 1 -- 172.21.15.100:0/600799843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557877730b30 msgr2=0x557877759520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:57.992+0000 7f2f9e628740 1 --2- 172.21.15.100:0/600799843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557877730b30 0x557877759520 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2f940c9ca0 tx=0x7f2f8c007060 comp rx=0 tx=0).stop 2024-09-11T22:20:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:57.992+0000 7f2f9e628740 1 -- 172.21.15.100:0/600799843 shutdown_connections 2024-09-11T22:20:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:57.992+0000 7f2f9e628740 1 --2- 172.21.15.100:0/600799843 >> [v2:172.21.15.100:6834/1912241808,v1:172.21.15.100:6836/1912241808] conn(0x557877762970 0x55787778e790 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:57.992+0000 7f2f9e628740 1 --2- 172.21.15.100:0/600799843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557877730b30 0x557877759520 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:57.992+0000 7f2f9e628740 1 --2- 172.21.15.100:0/600799843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557877730750 0x557877758920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:57.992+0000 7f2f9e628740 1 --2- 172.21.15.100:0/600799843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55787772df80 0x5578777830f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:57.992+0000 7f2f73fff640 0 client.4749 ms_handle_reset on v2:172.21.15.100:6834/1912241808 2024-09-11T22:20:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:57.992+0000 7f2f9e628740 1 -- 172.21.15.100:0/600799843 >> 172.21.15.100:0/600799843 conn(0x55787772ee70 msgr2=0x557877763c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:57.992+0000 7f2f9e628740 1 -- 172.21.15.100:0/600799843 shutdown_connections 2024-09-11T22:20:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:57.992+0000 7f2f9e628740 1 -- 172.21.15.100:0/600799843 wait complete. 2024-09-11T22:20:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:57.993+0000 7f2f9e628740 20 client.4749 trim_cache size 0 max 16384 2024-09-11T22:20:58.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.012+0000 7f2f9e628740 1 Processor -- start 2024-09-11T22:20:58.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.012+0000 7f2f9e628740 1 -- start start 2024-09-11T22:20:58.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.013+0000 7f2f9e628740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55787772df80 0x55787775dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.013+0000 7f2f9e628740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557877730750 0x557877768420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.013+0000 7f2f9e628740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557877730b30 0x557877768960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.013+0000 7f2f9e628740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2f941fafe0 con 0x557877730750 2024-09-11T22:20:58.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.013+0000 7f2f9e628740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557877758e60 con 0x557877730b30 2024-09-11T22:20:58.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.013+0000 7f2f9e628740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x55787777fb00 con 0x55787772df80 2024-09-11T22:20:58.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.013+0000 7f2f98e28640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557877730750 0x557877768420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.013+0000 7f2f98e28640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557877730750 0x557877768420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39420/0 (socket says 172.21.15.100:39420) 2024-09-11T22:20:58.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.013+0000 7f2f98e28640 1 -- 172.21.15.100:0/261716388 learned_addr learned my addr 172.21.15.100:0/261716388 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:58.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.013+0000 7f2f99629640 1 --2- 172.21.15.100:0/261716388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55787772df80 0x55787775dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.013+0000 7f2f99e2a640 1 --2- 172.21.15.100:0/261716388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557877730b30 0x557877768960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.014+0000 7f2f98e28640 1 -- 172.21.15.100:0/261716388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55787772df80 msgr2=0x55787775dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.014+0000 7f2f98e28640 1 --2- 172.21.15.100:0/261716388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55787772df80 0x55787775dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.014+0000 7f2f98e28640 1 -- 172.21.15.100:0/261716388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557877730b30 msgr2=0x557877768960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.014+0000 7f2f98e28640 1 --2- 172.21.15.100:0/261716388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557877730b30 0x557877768960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.014+0000 7f2f98e28640 1 -- 172.21.15.100:0/261716388 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55787772c580 con 0x557877730750 2024-09-11T22:20:58.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.014+0000 7f2f98e28640 1 --2- 172.21.15.100:0/261716388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557877730750 0x557877768420 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2f88089b90 tx=0x7f2f8805c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f3c688ed112e66 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.014+0000 7f2f7a7fc640 1 -- 172.21.15.100:0/261716388 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8807d070 con 0x557877730750 2024-09-11T22:20:58.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.014+0000 7f2f7a7fc640 1 -- 172.21.15.100:0/261716388 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f88057c10 con 0x557877730750 2024-09-11T22:20:58.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.014+0000 7f2f7a7fc640 1 -- 172.21.15.100:0/261716388 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f88088040 con 0x557877730750 2024-09-11T22:20:58.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.015+0000 7f2f9e628740 1 -- 172.21.15.100:0/261716388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557877730750 msgr2=0x557877768420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.015+0000 7f2f9e628740 1 --2- 172.21.15.100:0/261716388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557877730750 0x557877768420 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2f88089b90 tx=0x7f2f8805c000 comp rx=0 tx=0).stop 2024-09-11T22:20:58.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.015+0000 7f2f9e628740 1 -- 172.21.15.100:0/261716388 shutdown_connections 2024-09-11T22:20:58.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.015+0000 7f2f9e628740 1 --2- 172.21.15.100:0/261716388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557877730b30 0x557877768960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.015+0000 7f2f9e628740 1 --2- 172.21.15.100:0/261716388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557877730750 0x557877768420 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.015+0000 7f2f9e628740 1 --2- 172.21.15.100:0/261716388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55787772df80 0x55787775dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.015+0000 7f2f9e628740 1 -- 172.21.15.100:0/261716388 >> 172.21.15.100:0/261716388 conn(0x55787772ee70 msgr2=0x557877758500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.015+0000 7f2f9e628740 1 -- 172.21.15.100:0/261716388 shutdown_connections 2024-09-11T22:20:58.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.015+0000 7f2f9e628740 1 -- 172.21.15.100:0/261716388 wait complete. 2024-09-11T22:20:58.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.015+0000 7f2f9e628740 1 -- start start 2024-09-11T22:20:58.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.016+0000 7f2f9e628740 1 Processor -- start 2024-09-11T22:20:58.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.017+0000 7f2f9e628740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55787772df80 0x5578777734a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.017+0000 7f2f9e628740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557877730750 0x5578777578f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.017+0000 7f2f9e628740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557877730b30 0x557877763cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.017+0000 7f2f9e628740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557877763390 con 0x55787772df80 2024-09-11T22:20:58.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.017+0000 7f2f9e628740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557877759ab0 con 0x557877730b30 2024-09-11T22:20:58.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.017+0000 7f2f9e628740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x557877769810 con 0x557877730750 2024-09-11T22:20:58.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.017+0000 7f2f9e628740 10 client.0 _ll_register_callbacks cb 0x7f2f8c007b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:58.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.017+0000 7f2f99629640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55787772df80 0x5578777734a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.017+0000 7f2f99629640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55787772df80 0x5578777734a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39424/0 (socket says 172.21.15.100:39424) 2024-09-11T22:20:58.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.017+0000 7f2f99629640 1 -- 172.21.15.100:0/4129299692 learned_addr learned my addr 172.21.15.100:0/4129299692 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:58.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.017+0000 7f2f98e28640 1 --2- 172.21.15.100:0/4129299692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557877730750 0x5578777578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.017+0000 7f2f99e2a640 1 --2- 172.21.15.100:0/4129299692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557877730b30 0x557877763cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.017+0000 7f2f99629640 1 -- 172.21.15.100:0/4129299692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557877730750 msgr2=0x5578777578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.017+0000 7f2f99629640 1 --2- 172.21.15.100:0/4129299692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557877730750 0x5578777578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.017+0000 7f2f99629640 1 -- 172.21.15.100:0/4129299692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557877730b30 msgr2=0x557877763cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.017+0000 7f2f99629640 1 --2- 172.21.15.100:0/4129299692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557877730b30 0x557877763cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.017+0000 7f2f99629640 1 -- 172.21.15.100:0/4129299692 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557877762610 con 0x55787772df80 2024-09-11T22:20:58.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.017+0000 7f2f99e2a640 1 --2- 172.21.15.100:0/4129299692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557877730b30 0x557877763cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:58.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.017+0000 7f2f99629640 1 --2- 172.21.15.100:0/4129299692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55787772df80 0x5578777734a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400e230 tx=0x7f2f84004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=856e68ea919ca7b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.017+0000 7f2f73fff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-11T22:20:58.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.018+0000 7f2f73fff640 1 -- 172.21.15.100:0/4129299692 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f84004790 con 0x55787772df80 2024-09-11T22:20:58.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.018+0000 7f2f73fff640 1 -- 172.21.15.100:0/4129299692 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2f84046450 con 0x55787772df80 2024-09-11T22:20:58.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.018+0000 7f2f9e628740 1 -- 172.21.15.100:0/4129299692 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f88057c10 con 0x55787772df80 2024-09-11T22:20:58.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.018+0000 7f2f73fff640 1 -- 172.21.15.100:0/4129299692 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f2f84063050 con 0x55787772df80 2024-09-11T22:20:58.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.018+0000 7f2f9e628740 10 client.4755 fetch_fsmap learned FSMap version 14 2024-09-11T22:20:58.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.018+0000 7f2f9e628740 1 -- 172.21.15.100:0/4129299692 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x557877772360 con 0x55787772df80 2024-09-11T22:20:58.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.018+0000 7f2f73fff640 1 -- 172.21.15.100:0/4129299692 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f88057c10 con 0x55787772df80 2024-09-11T22:20:58.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.018+0000 7f2f73fff640 1 -- 172.21.15.100:0/4129299692 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 14) ==== 4760+0+0 (secure 0 0 0) 0x7f2f84066020 con 0x55787772df80 2024-09-11T22:20:58.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.018+0000 7f2f9e628740 10 client.4755 fetch_fsmap finished waiting for FSMap version 14 2024-09-11T22:20:58.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.018+0000 7f2f9e628740 10 client.4755 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-11T22:20:58.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.018+0000 7f2f9e628740 20 client.4755 populate_metadata read hostname 'smithi100' 2024-09-11T22:20:58.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.018+0000 7f2f9e628740 1 --2- 172.21.15.100:0/4129299692 >> [v2:172.21.15.100:6834/1912241808,v1:172.21.15.100:6836/1912241808] conn(0x5578777edf60 0x5578777603d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.018+0000 7f2f9e628740 4 client.4755 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:20:58.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.018+0000 7f2f9e628740 1 -- 172.21.15.100:0/4129299692 --> [v2:172.21.15.100:6834/1912241808,v1:172.21.15.100:6836/1912241808] -- command(tid 0: {"prefix": "status"}) -- 0x5578777835c0 con 0x5578777edf60 2024-09-11T22:20:58.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.018+0000 7f2f98e28640 1 --2- 172.21.15.100:0/4129299692 >> [v2:172.21.15.100:6834/1912241808,v1:172.21.15.100:6836/1912241808] conn(0x5578777edf60 0x5578777603d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.019+0000 7f2f73fff640 10 client.4755 ms_handle_connect on v2:172.21.15.100:6834/1912241808 2024-09-11T22:20:58.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.019+0000 7f2f98e28640 1 --2- 172.21.15.100:0/4129299692 >> [v2:172.21.15.100:6834/1912241808,v1:172.21.15.100:6836/1912241808] conn(0x5578777edf60 0x5578777603d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=34e5a3634cfdded2 server_cookie=14ad5d0330b60460 in_seq=0 out_seq=0 2024-09-11T22:20:58.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.019+0000 7f2f73fff640 1 -- 172.21.15.100:0/4129299692 <== mds.2 v2:172.21.15.100:6834/1912241808 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5578777835c0 con 0x5578777edf60 2024-09-11T22:20:58.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.019+0000 7f2f73fff640 10 client.4755 handle_command_reply: tid=0 2024-09-11T22:20:58.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.019+0000 7f2f9e628740 1 client.4755 shutdown 2024-09-11T22:20:58.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.019+0000 7f2f9e628740 1 -- 172.21.15.100:0/4129299692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55787772df80 msgr2=0x5578777734a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.019+0000 7f2f9e628740 1 --2- 172.21.15.100:0/4129299692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55787772df80 0x5578777734a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400e230 tx=0x7f2f84004ab0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.019+0000 7f2f9e628740 1 -- 172.21.15.100:0/4129299692 shutdown_connections 2024-09-11T22:20:58.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.019+0000 7f2f9e628740 1 --2- 172.21.15.100:0/4129299692 >> [v2:172.21.15.100:6834/1912241808,v1:172.21.15.100:6836/1912241808] conn(0x5578777edf60 0x5578777603d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.019+0000 7f2f9e628740 1 --2- 172.21.15.100:0/4129299692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557877730b30 0x557877763cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.019+0000 7f2f9e628740 1 --2- 172.21.15.100:0/4129299692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557877730750 0x5578777578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.019+0000 7f2f9e628740 1 --2- 172.21.15.100:0/4129299692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55787772df80 0x5578777734a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.019+0000 7f2f9e628740 1 -- 172.21.15.100:0/4129299692 >> 172.21.15.100:0/4129299692 conn(0x55787772ee70 msgr2=0x557877756310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.019+0000 7f2f73fff640 0 client.4755 ms_handle_reset on v2:172.21.15.100:6834/1912241808 2024-09-11T22:20:58.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.019+0000 7f2f9e628740 1 -- 172.21.15.100:0/4129299692 shutdown_connections 2024-09-11T22:20:58.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.019+0000 7f2f9e628740 1 -- 172.21.15.100:0/4129299692 wait complete. 2024-09-11T22:20:58.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.020+0000 7f2f9e628740 20 client.4755 trim_cache size 0 max 16384 2024-09-11T22:20:58.025 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:20:58.025 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:20:58.025 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 2, 2024-09-11T22:20:58.025 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4275, 2024-09-11T22:20:58.025 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-11T22:20:58.025 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-11T22:20:58.025 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-11T22:20:58.025 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 10.060993398000001, 2024-09-11T22:20:58.026 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 14, 2024-09-11T22:20:58.026 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 26, 2024-09-11T22:20:58.026 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 26, 2024-09-11T22:20:58.026 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 44.215212786999999 2024-09-11T22:20:58.026 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:20:58.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.020+0000 7f2f9b88d640 1 -- 172.21.15.100:0/1638263360 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2f8006be60 msgr2=0x7f2f8006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.020+0000 7f2f9b88d640 1 --2- 172.21.15.100:0/1638263360 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2f8006be60 0x7f2f8006e320 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2f84035000 tx=0x7f2f8402f000 comp rx=0 tx=0).stop 2024-09-11T22:20:58.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.020+0000 7f2f9b88d640 1 -- 172.21.15.100:0/1638263360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f940af5d0 msgr2=0x7f2f94144450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.020+0000 7f2f9b88d640 1 --2- 172.21.15.100:0/1638263360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f940af5d0 0x7f2f94144450 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2f88006c00 tx=0x7f2f880119f0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.020+0000 7f2f9b88d640 1 -- 172.21.15.100:0/1638263360 shutdown_connections 2024-09-11T22:20:58.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.020+0000 7f2f9b88d640 1 --2- 172.21.15.100:0/1638263360 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2f8006be60 0x7f2f8006e320 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.020+0000 7f2f9b88d640 1 --2- 172.21.15.100:0/1638263360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f940b0d40 0x7f2f940b11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.020+0000 7f2f9b88d640 1 --2- 172.21.15.100:0/1638263360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f940af5d0 0x7f2f94144450 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.020+0000 7f2f9b88d640 1 --2- 172.21.15.100:0/1638263360 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f7c0039b0 0x7f2f940b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.020+0000 7f2f9b88d640 1 -- 172.21.15.100:0/1638263360 >> 172.21.15.100:0/1638263360 conn(0x7f2f9406f360 msgr2=0x7f2f940c8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.020+0000 7f2f9b88d640 1 -- 172.21.15.100:0/1638263360 shutdown_connections 2024-09-11T22:20:58.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.020+0000 7f2f9b88d640 1 -- 172.21.15.100:0/1638263360 wait complete. 2024-09-11T22:20:58.034 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-09-11T22:20:58.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.138+0000 7f13e5042640 1 Processor -- start 2024-09-11T22:20:58.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.139+0000 7f13e5042640 1 -- start start 2024-09-11T22:20:58.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.139+0000 7f13e5042640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f13e0158460 0x7f13e01515a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.139+0000 7f13e5042640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e0071840 con 0x7f13e00c1750 2024-09-11T22:20:58.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.139+0000 7f13e5042640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e0071ae0 con 0x7f13e00c1370 2024-09-11T22:20:58.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.139+0000 7f13e5042640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f13e00c2db0 con 0x7f13e0158460 2024-09-11T22:20:58.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.140+0000 7f13de59c640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f13e00c1750 0x7f13e0157d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49184/0 (socket says 172.21.15.100:49184) 2024-09-11T22:20:58.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.140+0000 7f13de59c640 1 -- 172.21.15.100:0/803487150 learned_addr learned my addr 172.21.15.100:0/803487150 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:20:58.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.140+0000 7f13df59e640 1 --2- 172.21.15.100:0/803487150 >> v2:172.21.15.167:3300/0 conn(0x7f13e0158460 0x7f13e01515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.140+0000 7f13ddd9b640 1 -- 172.21.15.100:0/803487150 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 570554451 0 0) 0x7f13e0071840 con 0x7f13e00c1750 2024-09-11T22:20:58.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.140+0000 7f13ddd9b640 1 -- 172.21.15.100:0/803487150 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13cc003520 con 0x7f13e00c1750 2024-09-11T22:20:58.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.140+0000 7f13ddd9b640 1 -- 172.21.15.100:0/803487150 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3611423012 0 0) 0x7f13cc003520 con 0x7f13e00c1750 2024-09-11T22:20:58.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.140+0000 7f13ddd9b640 1 -- 172.21.15.100:0/803487150 >> v2:172.21.15.167:3300/0 conn(0x7f13e0158460 msgr2=0x7f13e01515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.140+0000 7f13ddd9b640 1 --2- 172.21.15.100:0/803487150 >> v2:172.21.15.167:3300/0 conn(0x7f13e0158460 0x7f13e01515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.140+0000 7f13ddd9b640 1 -- 172.21.15.100:0/803487150 >> v1:172.21.15.167:6789/0 conn(0x7f13e00c1370 legacy=0x7f13e00739e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.140+0000 7f13ddd9b640 1 -- 172.21.15.100:0/803487150 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e0071dc0 con 0x7f13e00c1750 2024-09-11T22:20:58.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.140+0000 7f13ddd9b640 1 -- 172.21.15.100:0/803487150 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f13d0001670 con 0x7f13e00c1750 2024-09-11T22:20:58.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.140+0000 7f13ddd9b640 1 -- 172.21.15.100:0/803487150 >> v1:172.21.15.100:6789/0 conn(0x7f13e00c1750 legacy=0x7f13e0157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.140+0000 7f13ddd9b640 1 --2- 172.21.15.100:0/803487150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13cc0039b0 0x7f13cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.140+0000 7f13ddd9b640 1 --2- 172.21.15.100:0/803487150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13cc004800 0x7f13cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.140+0000 7f13ddd9b640 1 --2- 172.21.15.100:0/803487150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13cc0051c0 0x7f13cc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.140+0000 7f13ddd9b640 1 -- 172.21.15.100:0/803487150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc00c040 con 0x7f13cc004800 2024-09-11T22:20:58.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.140+0000 7f13ddd9b640 1 -- 172.21.15.100:0/803487150 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc00c1f0 con 0x7f13cc0039b0 2024-09-11T22:20:58.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.140+0000 7f13ddd9b640 1 -- 172.21.15.100:0/803487150 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f13cc00c3f0 con 0x7f13cc0051c0 2024-09-11T22:20:58.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.140+0000 7f13de59c640 1 --2- 172.21.15.100:0/803487150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13cc004800 0x7f13cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.140+0000 7f13ded9d640 1 --2- 172.21.15.100:0/803487150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13cc0039b0 0x7f13cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.140+0000 7f13df59e640 1 --2- 172.21.15.100:0/803487150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13cc0051c0 0x7f13cc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.141+0000 7f13de59c640 1 -- 172.21.15.100:0/803487150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13cc0051c0 msgr2=0x7f13cc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.141+0000 7f13de59c640 1 --2- 172.21.15.100:0/803487150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13cc0051c0 0x7f13cc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.141+0000 7f13de59c640 1 -- 172.21.15.100:0/803487150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13cc0039b0 msgr2=0x7f13cc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.141+0000 7f13de59c640 1 --2- 172.21.15.100:0/803487150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13cc0039b0 0x7f13cc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.141+0000 7f13de59c640 1 -- 172.21.15.100:0/803487150 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13cc003520 con 0x7f13cc004800 2024-09-11T22:20:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.141+0000 7f13df59e640 1 -- 172.21.15.100:0/803487150 reap_dead start 2024-09-11T22:20:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.141+0000 7f13de59c640 1 --2- 172.21.15.100:0/803487150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13cc004800 0x7f13cc004c80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f13d000c240 tx=0x7f13cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2b3444b63e3188 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.141+0000 7f13ddd9b640 1 -- 172.21.15.100:0/803487150 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d0007cf0 con 0x7f13cc004800 2024-09-11T22:20:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.141+0000 7f13ddd9b640 1 -- 172.21.15.100:0/803487150 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d0005af0 con 0x7f13cc004800 2024-09-11T22:20:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.141+0000 7f13ddd9b640 1 -- 172.21.15.100:0/803487150 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d0007070 con 0x7f13cc004800 2024-09-11T22:20:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.142+0000 7f13e5042640 1 -- 172.21.15.100:0/803487150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13cc004800 msgr2=0x7f13cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.142+0000 7f13e5042640 1 --2- 172.21.15.100:0/803487150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13cc004800 0x7f13cc004c80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f13d000c240 tx=0x7f13cc005830 comp rx=0 tx=0).stop 2024-09-11T22:20:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.142+0000 7f13e5042640 1 -- 172.21.15.100:0/803487150 shutdown_connections 2024-09-11T22:20:58.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.142+0000 7f13e5042640 1 --2- 172.21.15.100:0/803487150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13cc004800 0x7f13cc004c80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.142+0000 7f13e5042640 1 -- 172.21.15.100:0/803487150 >> 172.21.15.100:0/803487150 conn(0x7f13e006f360 msgr2=0x7f13e006f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.142+0000 7f13e5042640 1 -- 172.21.15.100:0/803487150 shutdown_connections 2024-09-11T22:20:58.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.142+0000 7f13e5042640 1 -- 172.21.15.100:0/803487150 wait complete. 2024-09-11T22:20:58.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.143+0000 7f13e5042640 1 Processor -- start 2024-09-11T22:20:58.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.143+0000 7f13e5042640 1 -- start start 2024-09-11T22:20:58.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.144+0000 7f13e5042640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13cc004800 0x7f13e00c5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.144+0000 7f13e5042640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13e00c47d0 0x7f13e01520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.144+0000 7f13e5042640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0152610 0x7f13e01ef3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.144+0000 7f13e5042640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f13e0072500 con 0x7f13e00c47d0 2024-09-11T22:20:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.144+0000 7f13e5042640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f13e0072380 con 0x7f13e0152610 2024-09-11T22:20:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.144+0000 7f13e5042640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f13e00c2fc0 con 0x7f13cc004800 2024-09-11T22:20:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.144+0000 7f13de59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13e00c47d0 0x7f13e01520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.144+0000 7f13de59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13e00c47d0 0x7f13e01520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39430/0 (socket says 172.21.15.100:39430) 2024-09-11T22:20:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.144+0000 7f13de59c640 1 -- 172.21.15.100:0/2742002650 learned_addr learned my addr 172.21.15.100:0/2742002650 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.144+0000 7f13df59e640 1 --2- 172.21.15.100:0/2742002650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0152610 0x7f13e01ef3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.144+0000 7f13ded9d640 1 --2- 172.21.15.100:0/2742002650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13cc004800 0x7f13e00c5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.145+0000 7f13de59c640 1 -- 172.21.15.100:0/2742002650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13cc004800 msgr2=0x7f13e00c5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.145+0000 7f13de59c640 1 --2- 172.21.15.100:0/2742002650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13cc004800 0x7f13e00c5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.145+0000 7f13de59c640 1 -- 172.21.15.100:0/2742002650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0152610 msgr2=0x7f13e01ef3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.145+0000 7f13de59c640 1 --2- 172.21.15.100:0/2742002650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0152610 0x7f13e01ef3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.145+0000 7f13de59c640 1 -- 172.21.15.100:0/2742002650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e0152a90 con 0x7f13e00c47d0 2024-09-11T22:20:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.145+0000 7f13de59c640 1 --2- 172.21.15.100:0/2742002650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13e00c47d0 0x7f13e01520d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f13d000c360 tx=0x7f13e00c1fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.145+0000 7f13d77fe640 1 -- 172.21.15.100:0/2742002650 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d0040030 con 0x7f13e00c47d0 2024-09-11T22:20:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.145+0000 7f13d77fe640 1 -- 172.21.15.100:0/2742002650 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d0001470 con 0x7f13e00c47d0 2024-09-11T22:20:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.145+0000 7f13e5042640 1 -- 172.21.15.100:0/2742002650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e0154d30 con 0x7f13e00c47d0 2024-09-11T22:20:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.145+0000 7f13d77fe640 1 -- 172.21.15.100:0/2742002650 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d0037040 con 0x7f13e00c47d0 2024-09-11T22:20:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.145+0000 7f13e5042640 1 -- 172.21.15.100:0/2742002650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e00c3760 con 0x7f13e00c47d0 2024-09-11T22:20:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.147+0000 7f13d77fe640 1 -- 172.21.15.100:0/2742002650 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f13d0043070 con 0x7f13e00c47d0 2024-09-11T22:20:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.147+0000 7f13d77fe640 1 --2- 172.21.15.100:0/2742002650 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f13c006be60 0x7f13c006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.147+0000 7f13d77fe640 1 -- 172.21.15.100:0/2742002650 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f13d00aaa00 con 0x7f13e00c47d0 2024-09-11T22:20:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.147+0000 7f13ded9d640 1 --2- 172.21.15.100:0/2742002650 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f13c006be60 0x7f13c006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.148+0000 7f13ded9d640 1 --2- 172.21.15.100:0/2742002650 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f13c006be60 0x7f13c006e320 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f13c8000c00 tx=0x7f13c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.148+0000 7f13e7dd3740 1 Processor -- start 2024-09-11T22:20:58.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.148+0000 7f13e7dd3740 1 -- start start 2024-09-11T22:20:58.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.149+0000 7f13e7dd3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fcb750 0x5596e7fc5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.149+0000 7f13e7dd3740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596e7fc8f80 0x5596e80174d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.149+0000 7f13e7dd3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596e7fcbb30 0x5596e8017a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.149+0000 7f13e7dd3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5596e7f2c520 con 0x5596e7fcb750 2024-09-11T22:20:58.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.149+0000 7f13e7dd3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5596e7ed43e0 con 0x5596e7fcbb30 2024-09-11T22:20:58.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.149+0000 7f13e7dd3740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5596e7f284e0 con 0x5596e7fc8f80 2024-09-11T22:20:58.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.149+0000 7f13ded9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fcb750 0x5596e7fc5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.149+0000 7f13ded9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fcb750 0x5596e7fc5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39444/0 (socket says 172.21.15.100:39444) 2024-09-11T22:20:58.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.149+0000 7f13ded9d640 1 -- 172.21.15.100:0/2721741797 learned_addr learned my addr 172.21.15.100:0/2721741797 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:58.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.149+0000 7f13df59e640 1 --2- 172.21.15.100:0/2721741797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596e7fcbb30 0x5596e8017a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.149+0000 7f13de59c640 1 --2- 172.21.15.100:0/2721741797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596e7fc8f80 0x5596e80174d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.149+0000 7f13ded9d640 1 -- 172.21.15.100:0/2721741797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596e7fc8f80 msgr2=0x5596e80174d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.149+0000 7f13ded9d640 1 --2- 172.21.15.100:0/2721741797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596e7fc8f80 0x5596e80174d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.149+0000 7f13ded9d640 1 -- 172.21.15.100:0/2721741797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596e7fcbb30 msgr2=0x5596e8017a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.149+0000 7f13ded9d640 1 --2- 172.21.15.100:0/2721741797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596e7fcbb30 0x5596e8017a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.149+0000 7f13ded9d640 1 -- 172.21.15.100:0/2721741797 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596e7eef2f0 con 0x5596e7fcb750 2024-09-11T22:20:58.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.149+0000 7f13de59c640 1 --2- 172.21.15.100:0/2721741797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596e7fc8f80 0x5596e80174d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:58.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.149+0000 7f13ded9d640 1 --2- 172.21.15.100:0/2721741797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fcb750 0x5596e7fc5bd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f13c8012bb0 tx=0x7f13c8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433b87e165beb599 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.149+0000 7f13d4ff9640 1 -- 172.21.15.100:0/2721741797 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c8028070 con 0x5596e7fcb750 2024-09-11T22:20:58.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.149+0000 7f13d4ff9640 1 -- 172.21.15.100:0/2721741797 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c8007670 con 0x5596e7fcb750 2024-09-11T22:20:58.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.149+0000 7f13d4ff9640 1 -- 172.21.15.100:0/2721741797 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c80069d0 con 0x5596e7fcb750 2024-09-11T22:20:58.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.150+0000 7f13e7dd3740 1 -- 172.21.15.100:0/2721741797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fcb750 msgr2=0x5596e7fc5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.150+0000 7f13e7dd3740 1 --2- 172.21.15.100:0/2721741797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fcb750 0x5596e7fc5bd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f13c8012bb0 tx=0x7f13c8015000 comp rx=0 tx=0).stop 2024-09-11T22:20:58.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.150+0000 7f13e7dd3740 1 -- 172.21.15.100:0/2721741797 shutdown_connections 2024-09-11T22:20:58.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.150+0000 7f13e7dd3740 1 --2- 172.21.15.100:0/2721741797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596e7fcbb30 0x5596e8017a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.150+0000 7f13e7dd3740 1 --2- 172.21.15.100:0/2721741797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596e7fc8f80 0x5596e80174d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.150+0000 7f13e7dd3740 1 --2- 172.21.15.100:0/2721741797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fcb750 0x5596e7fc5bd0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.150+0000 7f13e7dd3740 1 -- 172.21.15.100:0/2721741797 >> 172.21.15.100:0/2721741797 conn(0x5596e7fc9e70 msgr2=0x5596e7fca270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.150+0000 7f13e7dd3740 1 -- 172.21.15.100:0/2721741797 shutdown_connections 2024-09-11T22:20:58.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.150+0000 7f13e7dd3740 1 -- 172.21.15.100:0/2721741797 wait complete. 2024-09-11T22:20:58.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.151+0000 7f13e7dd3740 1 -- start start 2024-09-11T22:20:58.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.151+0000 7f13e7dd3740 1 Processor -- start 2024-09-11T22:20:58.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.151+0000 7f13e7dd3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fc8f80 0x5596e801f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.151+0000 7f13e7dd3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596e7fcb750 0x5596e8001b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.151+0000 7f13e7dd3740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596e7fcbb30 0x5596e7fffa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.151+0000 7f13e7dd3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5596e7eb5450 con 0x5596e7fc8f80 2024-09-11T22:20:58.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.151+0000 7f13e7dd3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5596e80022c0 con 0x5596e7fcb750 2024-09-11T22:20:58.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.151+0000 7f13e7dd3740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5596e8001260 con 0x5596e7fcbb30 2024-09-11T22:20:58.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.152+0000 7f13e7dd3740 10 client.0 _ll_register_callbacks cb 0x5596e7c3eac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.152+0000 7f13ded9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fc8f80 0x5596e801f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.152+0000 7f13ded9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fc8f80 0x5596e801f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39450/0 (socket says 172.21.15.100:39450) 2024-09-11T22:20:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.152+0000 7f13ded9d640 1 -- 172.21.15.100:0/312275324 learned_addr learned my addr 172.21.15.100:0/312275324 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.152+0000 7f13de59c640 1 --2- 172.21.15.100:0/312275324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596e7fcb750 0x5596e8001b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.152+0000 7f13df59e640 1 --2- 172.21.15.100:0/312275324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596e7fcbb30 0x5596e7fffa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.152+0000 7f13ded9d640 1 -- 172.21.15.100:0/312275324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596e7fcbb30 msgr2=0x5596e7fffa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.152+0000 7f13ded9d640 1 --2- 172.21.15.100:0/312275324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596e7fcbb30 0x5596e7fffa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.152+0000 7f13ded9d640 1 -- 172.21.15.100:0/312275324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596e7fcb750 msgr2=0x5596e8001b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.152+0000 7f13ded9d640 1 --2- 172.21.15.100:0/312275324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596e7fcb750 0x5596e8001b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.152+0000 7f13ded9d640 1 -- 172.21.15.100:0/312275324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596e7c3f2d0 con 0x5596e7fc8f80 2024-09-11T22:20:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.152+0000 7f13ded9d640 1 --2- 172.21.15.100:0/312275324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fc8f80 0x5596e801f660 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f13c8026040 tx=0x7f13c8001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4416c24f563372 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.152+0000 7f13bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-11T22:20:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.152+0000 7f13bdffb640 1 -- 172.21.15.100:0/312275324 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c8028070 con 0x5596e7fc8f80 2024-09-11T22:20:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.152+0000 7f13bdffb640 1 -- 172.21.15.100:0/312275324 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f13c8015850 con 0x5596e7fc8f80 2024-09-11T22:20:58.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.152+0000 7f13e7dd3740 1 -- 172.21.15.100:0/312275324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13c8007670 con 0x5596e7fc8f80 2024-09-11T22:20:58.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.152+0000 7f13bdffb640 1 -- 172.21.15.100:0/312275324 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f13c803b050 con 0x5596e7fc8f80 2024-09-11T22:20:58.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.152+0000 7f13e7dd3740 10 client.4767 fetch_fsmap learned FSMap version 14 2024-09-11T22:20:58.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.152+0000 7f13e7dd3740 1 -- 172.21.15.100:0/312275324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5596e7d096b0 con 0x5596e7fc8f80 2024-09-11T22:20:58.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.152+0000 7f13bdffb640 1 -- 172.21.15.100:0/312275324 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c8007670 con 0x5596e7fc8f80 2024-09-11T22:20:58.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.153+0000 7f13bdffb640 1 -- 172.21.15.100:0/312275324 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 14) ==== 4760+0+0 (secure 0 0 0) 0x7f13c803e020 con 0x5596e7fc8f80 2024-09-11T22:20:58.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.153+0000 7f13e7dd3740 10 client.4767 fetch_fsmap finished waiting for FSMap version 14 2024-09-11T22:20:58.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.153+0000 7f13e7dd3740 10 client.4767 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-11T22:20:58.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.153+0000 7f13e7dd3740 20 client.4767 populate_metadata read hostname 'smithi100' 2024-09-11T22:20:58.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.153+0000 7f13e7dd3740 1 --2- 172.21.15.100:0/312275324 >> [v2:172.21.15.100:6838/3236256661,v1:172.21.15.100:6839/3236256661] conn(0x5596e7ff92a0 0x5596e7ff9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.153+0000 7f13e7dd3740 4 client.4767 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:58.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.153+0000 7f13e7dd3740 1 -- 172.21.15.100:0/312275324 --> [v2:172.21.15.100:6838/3236256661,v1:172.21.15.100:6839/3236256661] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596e7f39c50 con 0x5596e7ff92a0 2024-09-11T22:20:58.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.153+0000 7f13de59c640 1 --2- 172.21.15.100:0/312275324 >> [v2:172.21.15.100:6838/3236256661,v1:172.21.15.100:6839/3236256661] conn(0x5596e7ff92a0 0x5596e7ff9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.153+0000 7f13bdffb640 10 client.4767 ms_handle_connect on v2:172.21.15.100:6838/3236256661 2024-09-11T22:20:58.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.153+0000 7f13de59c640 1 --2- 172.21.15.100:0/312275324 >> [v2:172.21.15.100:6838/3236256661,v1:172.21.15.100:6839/3236256661] conn(0x5596e7ff92a0 0x5596e7ff9870 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a592c6b4f81ec659 server_cookie=dd309538cc6ac0da in_seq=0 out_seq=0 2024-09-11T22:20:58.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.154+0000 7f13bdffb640 1 -- 172.21.15.100:0/312275324 <== mds.1 v2:172.21.15.100:6838/3236256661 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5596e7f39c50 con 0x5596e7ff92a0 2024-09-11T22:20:58.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.154+0000 7f13bdffb640 10 client.4767 handle_command_reply: tid=0 2024-09-11T22:20:58.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.154+0000 7f13e7dd3740 1 client.4767 shutdown 2024-09-11T22:20:58.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.154+0000 7f13e7dd3740 1 -- 172.21.15.100:0/312275324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fc8f80 msgr2=0x5596e801f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.154+0000 7f13e7dd3740 1 --2- 172.21.15.100:0/312275324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fc8f80 0x5596e801f660 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f13c8026040 tx=0x7f13c8001120 comp rx=0 tx=0).stop 2024-09-11T22:20:58.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.154+0000 7f13e7dd3740 1 -- 172.21.15.100:0/312275324 shutdown_connections 2024-09-11T22:20:58.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.154+0000 7f13e7dd3740 1 --2- 172.21.15.100:0/312275324 >> [v2:172.21.15.100:6838/3236256661,v1:172.21.15.100:6839/3236256661] conn(0x5596e7ff92a0 0x5596e7ff9870 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.154+0000 7f13e7dd3740 1 --2- 172.21.15.100:0/312275324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596e7fcbb30 0x5596e7fffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.154+0000 7f13e7dd3740 1 --2- 172.21.15.100:0/312275324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596e7fcb750 0x5596e8001b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.154+0000 7f13bdffb640 0 client.4767 ms_handle_reset on v2:172.21.15.100:6838/3236256661 2024-09-11T22:20:58.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.154+0000 7f13e7dd3740 1 --2- 172.21.15.100:0/312275324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fc8f80 0x5596e801f660 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.154+0000 7f13e7dd3740 1 -- 172.21.15.100:0/312275324 >> 172.21.15.100:0/312275324 conn(0x5596e7fc9e70 msgr2=0x5596e7fcacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.154+0000 7f13e7dd3740 1 -- 172.21.15.100:0/312275324 shutdown_connections 2024-09-11T22:20:58.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.154+0000 7f13e7dd3740 1 -- 172.21.15.100:0/312275324 wait complete. 2024-09-11T22:20:58.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.154+0000 7f13e7dd3740 20 client.4767 trim_cache size 0 max 16384 2024-09-11T22:20:58.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.171+0000 7f13e7dd3740 1 Processor -- start 2024-09-11T22:20:58.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.171+0000 7f13e7dd3740 1 -- start start 2024-09-11T22:20:58.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.172+0000 7f13e7dd3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596e7fc8f80 0x5596e7fc9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.172+0000 7f13e7dd3740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596e7fcb750 0x5596e7fc98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.172+0000 7f13e7dd3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fcbb30 0x5596e801ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.172+0000 7f13e7dd3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f13e01f8fa0 con 0x5596e7fcbb30 2024-09-11T22:20:58.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.172+0000 7f13e7dd3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5596e8018c70 con 0x5596e7fc8f80 2024-09-11T22:20:58.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.172+0000 7f13e7dd3740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5596e8000e00 con 0x5596e7fcb750 2024-09-11T22:20:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.172+0000 7f13df59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fcbb30 0x5596e801ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.172+0000 7f13df59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fcbb30 0x5596e801ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39458/0 (socket says 172.21.15.100:39458) 2024-09-11T22:20:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.172+0000 7f13df59e640 1 -- 172.21.15.100:0/485554401 learned_addr learned my addr 172.21.15.100:0/485554401 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.172+0000 7f13df59e640 1 -- 172.21.15.100:0/485554401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596e7fcb750 msgr2=0x5596e7fc98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.172+0000 7f13df59e640 1 --2- 172.21.15.100:0/485554401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596e7fcb750 0x5596e7fc98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.172+0000 7f13df59e640 1 -- 172.21.15.100:0/485554401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596e7fc8f80 msgr2=0x5596e7fc9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.172+0000 7f13df59e640 1 --2- 172.21.15.100:0/485554401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596e7fc8f80 0x5596e7fc9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.172+0000 7f13df59e640 1 -- 172.21.15.100:0/485554401 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596e7fc69e0 con 0x5596e7fcbb30 2024-09-11T22:20:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.172+0000 7f13df59e640 1 --2- 172.21.15.100:0/485554401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fcbb30 0x5596e801ebb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f13e0071580 tx=0x7f13d8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2360256d6cf24017 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.173+0000 7f13bffff640 1 -- 172.21.15.100:0/485554401 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d8024020 con 0x5596e7fcbb30 2024-09-11T22:20:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.173+0000 7f13bffff640 1 -- 172.21.15.100:0/485554401 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d8003990 con 0x5596e7fcbb30 2024-09-11T22:20:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.173+0000 7f13bffff640 1 -- 172.21.15.100:0/485554401 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d8003d60 con 0x5596e7fcbb30 2024-09-11T22:20:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.173+0000 7f13e7dd3740 1 -- 172.21.15.100:0/485554401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fcbb30 msgr2=0x5596e801ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.173+0000 7f13e7dd3740 1 --2- 172.21.15.100:0/485554401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fcbb30 0x5596e801ebb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f13e0071580 tx=0x7f13d8009750 comp rx=0 tx=0).stop 2024-09-11T22:20:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.173+0000 7f13e7dd3740 1 -- 172.21.15.100:0/485554401 shutdown_connections 2024-09-11T22:20:58.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.173+0000 7f13e7dd3740 1 --2- 172.21.15.100:0/485554401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fcbb30 0x5596e801ebb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.173+0000 7f13e7dd3740 1 --2- 172.21.15.100:0/485554401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596e7fcb750 0x5596e7fc98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.173+0000 7f13e7dd3740 1 --2- 172.21.15.100:0/485554401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596e7fc8f80 0x5596e7fc9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.173+0000 7f13e7dd3740 1 -- 172.21.15.100:0/485554401 >> 172.21.15.100:0/485554401 conn(0x5596e7fc9e70 msgr2=0x5596e7fca250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.173+0000 7f13e7dd3740 1 -- 172.21.15.100:0/485554401 shutdown_connections 2024-09-11T22:20:58.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.173+0000 7f13e7dd3740 1 -- 172.21.15.100:0/485554401 wait complete. 2024-09-11T22:20:58.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.174+0000 7f13e7dd3740 1 -- start start 2024-09-11T22:20:58.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.174+0000 7f13e7dd3740 1 Processor -- start 2024-09-11T22:20:58.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.174+0000 7f13e7dd3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596e7fc8f80 0x5596e8031800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.174+0000 7f13e7dd3740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596e7fcb750 0x5596e801be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.174+0000 7f13e7dd3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fcbb30 0x5596e8087c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.174+0000 7f13e7dd3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5596e7ff96f0 con 0x5596e7fcbb30 2024-09-11T22:20:58.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.174+0000 7f13e7dd3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5596e8000150 con 0x5596e7fc8f80 2024-09-11T22:20:58.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.174+0000 7f13e7dd3740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5596e80221a0 con 0x5596e7fcb750 2024-09-11T22:20:58.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.174+0000 7f13e7dd3740 10 client.0 _ll_register_callbacks cb 0x7f13c8001e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:58.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.174+0000 7f13df59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fcbb30 0x5596e8087c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.175+0000 7f13df59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fcbb30 0x5596e8087c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39468/0 (socket says 172.21.15.100:39468) 2024-09-11T22:20:58.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.175+0000 7f13df59e640 1 -- 172.21.15.100:0/1692114413 learned_addr learned my addr 172.21.15.100:0/1692114413 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:58.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.175+0000 7f13ded9d640 1 --2- 172.21.15.100:0/1692114413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596e7fc8f80 0x5596e8031800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.175+0000 7f13de59c640 1 --2- 172.21.15.100:0/1692114413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596e7fcb750 0x5596e801be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.175+0000 7f13df59e640 1 -- 172.21.15.100:0/1692114413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596e7fcb750 msgr2=0x5596e801be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.175+0000 7f13df59e640 1 --2- 172.21.15.100:0/1692114413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596e7fcb750 0x5596e801be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.175+0000 7f13df59e640 1 -- 172.21.15.100:0/1692114413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596e7fc8f80 msgr2=0x5596e8031800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.175+0000 7f13df59e640 1 --2- 172.21.15.100:0/1692114413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596e7fc8f80 0x5596e8031800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.175+0000 7f13df59e640 1 -- 172.21.15.100:0/1692114413 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596e7ff9ec0 con 0x5596e7fcbb30 2024-09-11T22:20:58.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.175+0000 7f13ded9d640 1 --2- 172.21.15.100:0/1692114413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596e7fc8f80 0x5596e8031800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:58.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.175+0000 7f13df59e640 1 --2- 172.21.15.100:0/1692114413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fcbb30 0x5596e8087c30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f13d8017f70 tx=0x7f13d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34fd711b025eb45 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.175+0000 7f13bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-11T22:20:58.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.175+0000 7f13bdffb640 1 -- 172.21.15.100:0/1692114413 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d802f060 con 0x5596e7fcbb30 2024-09-11T22:20:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.175+0000 7f13bdffb640 1 -- 172.21.15.100:0/1692114413 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f13d80158f0 con 0x5596e7fcbb30 2024-09-11T22:20:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.175+0000 7f13e7dd3740 1 -- 172.21.15.100:0/1692114413 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13d8003990 con 0x5596e7fcbb30 2024-09-11T22:20:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.175+0000 7f13bdffb640 1 -- 172.21.15.100:0/1692114413 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f13d8035050 con 0x5596e7fcbb30 2024-09-11T22:20:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.175+0000 7f13e7dd3740 10 client.4773 fetch_fsmap learned FSMap version 14 2024-09-11T22:20:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.175+0000 7f13e7dd3740 1 -- 172.21.15.100:0/1692114413 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5596e8003a10 con 0x5596e7fcbb30 2024-09-11T22:20:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.175+0000 7f13bdffb640 1 -- 172.21.15.100:0/1692114413 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d8003990 con 0x5596e7fcbb30 2024-09-11T22:20:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.175+0000 7f13bdffb640 1 -- 172.21.15.100:0/1692114413 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 14) ==== 4760+0+0 (secure 0 0 0) 0x7f13d8038020 con 0x5596e7fcbb30 2024-09-11T22:20:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.175+0000 7f13e7dd3740 10 client.4773 fetch_fsmap finished waiting for FSMap version 14 2024-09-11T22:20:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.176+0000 7f13e7dd3740 10 client.4773 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-11T22:20:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.176+0000 7f13e7dd3740 20 client.4773 populate_metadata read hostname 'smithi100' 2024-09-11T22:20:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.176+0000 7f13e7dd3740 1 --2- 172.21.15.100:0/1692114413 >> [v2:172.21.15.100:6838/3236256661,v1:172.21.15.100:6839/3236256661] conn(0x5596e7ffe350 0x5596e809a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.176+0000 7f13e7dd3740 4 client.4773 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:20:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.176+0000 7f13e7dd3740 1 -- 172.21.15.100:0/1692114413 --> [v2:172.21.15.100:6838/3236256661,v1:172.21.15.100:6839/3236256661] -- command(tid 0: {"prefix": "status"}) -- 0x5596e7f33fa0 con 0x5596e7ffe350 2024-09-11T22:20:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.176+0000 7f13ded9d640 1 --2- 172.21.15.100:0/1692114413 >> [v2:172.21.15.100:6838/3236256661,v1:172.21.15.100:6839/3236256661] conn(0x5596e7ffe350 0x5596e809a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.176+0000 7f13bdffb640 10 client.4773 ms_handle_connect on v2:172.21.15.100:6838/3236256661 2024-09-11T22:20:58.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.176+0000 7f13ded9d640 1 --2- 172.21.15.100:0/1692114413 >> [v2:172.21.15.100:6838/3236256661,v1:172.21.15.100:6839/3236256661] conn(0x5596e7ffe350 0x5596e809a640 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=32abf88ba5e5f219 server_cookie=c10d47a999868f0 in_seq=0 out_seq=0 2024-09-11T22:20:58.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.176+0000 7f13bdffb640 1 -- 172.21.15.100:0/1692114413 <== mds.1 v2:172.21.15.100:6838/3236256661 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5596e7f33fa0 con 0x5596e7ffe350 2024-09-11T22:20:58.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.176+0000 7f13bdffb640 10 client.4773 handle_command_reply: tid=0 2024-09-11T22:20:58.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.176+0000 7f13e7dd3740 1 client.4773 shutdown 2024-09-11T22:20:58.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.176+0000 7f13e7dd3740 1 -- 172.21.15.100:0/1692114413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fcbb30 msgr2=0x5596e8087c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.176+0000 7f13e7dd3740 1 --2- 172.21.15.100:0/1692114413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fcbb30 0x5596e8087c30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f13d8017f70 tx=0x7f13d8004a40 comp rx=0 tx=0).stop 2024-09-11T22:20:58.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.176+0000 7f13e7dd3740 1 -- 172.21.15.100:0/1692114413 shutdown_connections 2024-09-11T22:20:58.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.176+0000 7f13e7dd3740 1 --2- 172.21.15.100:0/1692114413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596e7fcbb30 0x5596e8087c30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.176+0000 7f13e7dd3740 1 --2- 172.21.15.100:0/1692114413 >> [v2:172.21.15.100:6838/3236256661,v1:172.21.15.100:6839/3236256661] conn(0x5596e7ffe350 0x5596e809a640 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.176+0000 7f13e7dd3740 1 --2- 172.21.15.100:0/1692114413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5596e7fcb750 0x5596e801be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.176+0000 7f13bdffb640 0 client.4773 ms_handle_reset on v2:172.21.15.100:6838/3236256661 2024-09-11T22:20:58.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.176+0000 7f13e7dd3740 1 --2- 172.21.15.100:0/1692114413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596e7fc8f80 0x5596e8031800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.176+0000 7f13e7dd3740 1 -- 172.21.15.100:0/1692114413 >> 172.21.15.100:0/1692114413 conn(0x5596e7fc9e70 msgr2=0x5596e7fc9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.176+0000 7f13e7dd3740 1 -- 172.21.15.100:0/1692114413 shutdown_connections 2024-09-11T22:20:58.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.176+0000 7f13e7dd3740 1 -- 172.21.15.100:0/1692114413 wait complete. 2024-09-11T22:20:58.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.176+0000 7f13e7dd3740 20 client.4773 trim_cache size 0 max 16384 2024-09-11T22:20:58.184 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:20:58.184 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:20:58.184 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 1, 2024-09-11T22:20:58.184 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4281, 2024-09-11T22:20:58.184 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-11T22:20:58.184 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-11T22:20:58.184 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-11T22:20:58.184 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 16.251369632999999, 2024-09-11T22:20:58.184 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 14, 2024-09-11T22:20:58.184 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 26, 2024-09-11T22:20:58.185 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 26, 2024-09-11T22:20:58.185 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 44.370122389000002 2024-09-11T22:20:58.185 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:20:58.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.177+0000 7f13e5042640 1 -- 172.21.15.100:0/2742002650 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f13c006be60 msgr2=0x7f13c006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.177+0000 7f13e5042640 1 --2- 172.21.15.100:0/2742002650 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f13c006be60 0x7f13c006e320 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f13c8000c00 tx=0x7f13c8009040 comp rx=0 tx=0).stop 2024-09-11T22:20:58.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.177+0000 7f13e5042640 1 -- 172.21.15.100:0/2742002650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13e00c47d0 msgr2=0x7f13e01520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.177+0000 7f13e5042640 1 --2- 172.21.15.100:0/2742002650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13e00c47d0 0x7f13e01520d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f13d000c360 tx=0x7f13e00c1fc0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.177+0000 7f13e5042640 1 -- 172.21.15.100:0/2742002650 shutdown_connections 2024-09-11T22:20:58.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.177+0000 7f13e5042640 1 --2- 172.21.15.100:0/2742002650 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f13c006be60 0x7f13c006e320 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.177+0000 7f13e5042640 1 --2- 172.21.15.100:0/2742002650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13e0152610 0x7f13e01ef3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.177+0000 7f13e5042640 1 --2- 172.21.15.100:0/2742002650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13e00c47d0 0x7f13e01520d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.177+0000 7f13e5042640 1 --2- 172.21.15.100:0/2742002650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13cc004800 0x7f13e00c5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.177+0000 7f13e5042640 1 -- 172.21.15.100:0/2742002650 >> 172.21.15.100:0/2742002650 conn(0x7f13e006f360 msgr2=0x7f13e00c7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.177+0000 7f13e5042640 1 -- 172.21.15.100:0/2742002650 shutdown_connections 2024-09-11T22:20:58.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.177+0000 7f13e5042640 1 -- 172.21.15.100:0/2742002650 wait complete. 2024-09-11T22:20:58.188 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-09-11T22:20:58.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.287+0000 7f3422c2e640 1 Processor -- start 2024-09-11T22:20:58.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.287+0000 7f3422c2e640 1 -- start start 2024-09-11T22:20:58.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.288+0000 7f3422c2e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f341c154be0 0x7f341c0c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.288+0000 7f3422c2e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f341c0c4070 0x7f341c0c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.288+0000 7f3422c2e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f341c0c37e0 0x7f341c15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.288+0000 7f3422c2e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f341c0cec00 con 0x7f341c0c4070 2024-09-11T22:20:58.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.288+0000 7f3422c2e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f341c0ca3d0 con 0x7f341c154be0 2024-09-11T22:20:58.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.288+0000 7f3422c2e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f341c0ce360 con 0x7f341c0c37e0 2024-09-11T22:20:58.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.288+0000 7f341bfff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f341c0c4070 0x7f341c0c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.288+0000 7f341bfff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f341c0c4070 0x7f341c0c32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39476/0 (socket says 172.21.15.100:39476) 2024-09-11T22:20:58.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.288+0000 7f341bfff640 1 -- 172.21.15.100:0/3138436836 learned_addr learned my addr 172.21.15.100:0/3138436836 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:58.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.288+0000 7f34209ca640 1 --2- 172.21.15.100:0/3138436836 >> v2:172.21.15.167:3300/0 conn(0x7f341c154be0 0x7f341c0c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.288+0000 7f34211cb640 1 --2- 172.21.15.100:0/3138436836 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f341c0c37e0 0x7f341c15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.288+0000 7f341bfff640 1 -- 172.21.15.100:0/3138436836 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f341c0c37e0 msgr2=0x7f341c15e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.288+0000 7f341bfff640 1 --2- 172.21.15.100:0/3138436836 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f341c0c37e0 0x7f341c15e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.288+0000 7f341bfff640 1 -- 172.21.15.100:0/3138436836 >> v2:172.21.15.167:3300/0 conn(0x7f341c154be0 msgr2=0x7f341c0c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.288+0000 7f341bfff640 1 --2- 172.21.15.100:0/3138436836 >> v2:172.21.15.167:3300/0 conn(0x7f341c154be0 0x7f341c0c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.288+0000 7f341bfff640 1 -- 172.21.15.100:0/3138436836 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341c0ce640 con 0x7f341c0c4070 2024-09-11T22:20:58.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.288+0000 7f34209ca640 1 --2- 172.21.15.100:0/3138436836 >> v2:172.21.15.167:3300/0 conn(0x7f341c154be0 0x7f341c0c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:58.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.288+0000 7f34211cb640 1 --2- 172.21.15.100:0/3138436836 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f341c0c37e0 0x7f341c15e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:58.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.289+0000 7f341bfff640 1 --2- 172.21.15.100:0/3138436836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f341c0c4070 0x7f341c0c32a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f341c0cef80 tx=0x7f340802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d33e057fcd747f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.289+0000 7f341b7fe640 1 -- 172.21.15.100:0/3138436836 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3408037070 con 0x7f341c0c4070 2024-09-11T22:20:58.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.289+0000 7f341b7fe640 1 -- 172.21.15.100:0/3138436836 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3408032440 con 0x7f341c0c4070 2024-09-11T22:20:58.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.289+0000 7f341b7fe640 1 -- 172.21.15.100:0/3138436836 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3408032810 con 0x7f341c0c4070 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.290+0000 7f3422c2e640 1 -- 172.21.15.100:0/3138436836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f341c0c4070 msgr2=0x7f341c0c32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.290+0000 7f3422c2e640 1 --2- 172.21.15.100:0/3138436836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f341c0c4070 0x7f341c0c32a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f341c0cef80 tx=0x7f340802a270 comp rx=0 tx=0).stop 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.290+0000 7f3422c2e640 1 -- 172.21.15.100:0/3138436836 shutdown_connections 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.290+0000 7f3422c2e640 1 --2- 172.21.15.100:0/3138436836 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f341c0c37e0 0x7f341c15e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.290+0000 7f3422c2e640 1 --2- 172.21.15.100:0/3138436836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f341c0c4070 0x7f341c0c32a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.290+0000 7f3422c2e640 1 --2- 172.21.15.100:0/3138436836 >> v2:172.21.15.167:3300/0 conn(0x7f341c154be0 0x7f341c0c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.290+0000 7f3422c2e640 1 -- 172.21.15.100:0/3138436836 >> 172.21.15.100:0/3138436836 conn(0x7f341c0714a0 msgr2=0x7f341c071880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.290+0000 7f3422c2e640 1 -- 172.21.15.100:0/3138436836 shutdown_connections 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.290+0000 7f3422c2e640 1 -- 172.21.15.100:0/3138436836 wait complete. 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.291+0000 7f3422c2e640 1 Processor -- start 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.291+0000 7f3422c2e640 1 -- start start 2024-09-11T22:20:58.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.292+0000 7f3422c2e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f341c0c37e0 0x7f341c157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.292+0000 7f3422c2e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f341c0c4070 0x7f341c1f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.292+0000 7f3422c2e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f341c154be0 0x7f341c06cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.292+0000 7f3422c2e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f341c0c9d10 con 0x7f341c154be0 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.292+0000 7f3422c2e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f341c0af700 con 0x7f341c0c37e0 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.292+0000 7f3422c2e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f341c154fc0 con 0x7f341c0c4070 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.292+0000 7f34211cb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f341c154be0 0x7f341c06cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.292+0000 7f34211cb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f341c154be0 0x7f341c06cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39488/0 (socket says 172.21.15.100:39488) 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.292+0000 7f34211cb640 1 -- 172.21.15.100:0/259649507 learned_addr learned my addr 172.21.15.100:0/259649507 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.292+0000 7f341bfff640 1 --2- 172.21.15.100:0/259649507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f341c0c4070 0x7f341c1f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.292+0000 7f34209ca640 1 --2- 172.21.15.100:0/259649507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f341c0c37e0 0x7f341c157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.292+0000 7f34211cb640 1 -- 172.21.15.100:0/259649507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f341c0c4070 msgr2=0x7f341c1f3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.292+0000 7f34211cb640 1 --2- 172.21.15.100:0/259649507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f341c0c4070 0x7f341c1f3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.292+0000 7f34211cb640 1 -- 172.21.15.100:0/259649507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f341c0c37e0 msgr2=0x7f341c157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.292+0000 7f34211cb640 1 --2- 172.21.15.100:0/259649507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f341c0c37e0 0x7f341c157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.292+0000 7f34211cb640 1 -- 172.21.15.100:0/259649507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341c14e5c0 con 0x7f341c154be0 2024-09-11T22:20:58.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.292+0000 7f34211cb640 1 --2- 172.21.15.100:0/259649507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f341c154be0 0x7f341c06cc50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f341400cef0 tx=0x7f341400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.292+0000 7f34197fa640 1 -- 172.21.15.100:0/259649507 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341401a070 con 0x7f341c154be0 2024-09-11T22:20:58.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.292+0000 7f34197fa640 1 -- 172.21.15.100:0/259649507 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f341400d840 con 0x7f341c154be0 2024-09-11T22:20:58.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.292+0000 7f34197fa640 1 -- 172.21.15.100:0/259649507 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341400dc30 con 0x7f341c154be0 2024-09-11T22:20:58.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.292+0000 7f3422c2e640 1 -- 172.21.15.100:0/259649507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f341c1efea0 con 0x7f341c154be0 2024-09-11T22:20:58.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.293+0000 7f3422c2e640 1 -- 172.21.15.100:0/259649507 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f341c1f0160 con 0x7f341c154be0 2024-09-11T22:20:58.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.294+0000 7f34197fa640 1 -- 172.21.15.100:0/259649507 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f341401d070 con 0x7f341c154be0 2024-09-11T22:20:58.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.294+0000 7f34197fa640 1 --2- 172.21.15.100:0/259649507 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f340006be30 0x7f340006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.294+0000 7f34197fa640 1 -- 172.21.15.100:0/259649507 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f341408ba90 con 0x7f341c154be0 2024-09-11T22:20:58.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.294+0000 7f34209ca640 1 --2- 172.21.15.100:0/259649507 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f340006be30 0x7f340006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.295+0000 7f34209ca640 1 --2- 172.21.15.100:0/259649507 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f340006be30 0x7f340006e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f341000b840 tx=0x7f3410008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.295+0000 7f34259cd740 1 Processor -- start 2024-09-11T22:20:58.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.295+0000 7f34259cd740 1 -- start start 2024-09-11T22:20:58.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.296+0000 7f34259cd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5584f9948750 0x5584f99809e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.296+0000 7f34259cd740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5584f9945f80 0x5584f9980f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.296+0000 7f34259cd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948b30 0x5584f9944a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.296+0000 7f34259cd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5584f98a9520 con 0x5584f9948b30 2024-09-11T22:20:58.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.296+0000 7f34259cd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5584f98513e0 con 0x5584f9948750 2024-09-11T22:20:58.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.296+0000 7f34259cd740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5584f98a54e0 con 0x5584f9945f80 2024-09-11T22:20:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.296+0000 7f34211cb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948b30 0x5584f9944a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.296+0000 7f34211cb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948b30 0x5584f9944a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39502/0 (socket says 172.21.15.100:39502) 2024-09-11T22:20:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.296+0000 7f34211cb640 1 -- 172.21.15.100:0/3394649121 learned_addr learned my addr 172.21.15.100:0/3394649121 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.296+0000 7f34209ca640 1 --2- 172.21.15.100:0/3394649121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5584f9948750 0x5584f99809e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.296+0000 7f341bfff640 1 --2- 172.21.15.100:0/3394649121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5584f9945f80 0x5584f9980f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.296+0000 7f34211cb640 1 -- 172.21.15.100:0/3394649121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5584f9945f80 msgr2=0x5584f9980f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.296+0000 7f34211cb640 1 --2- 172.21.15.100:0/3394649121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5584f9945f80 0x5584f9980f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.296+0000 7f34211cb640 1 -- 172.21.15.100:0/3394649121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5584f9948750 msgr2=0x5584f99809e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.296+0000 7f34211cb640 1 --2- 172.21.15.100:0/3394649121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5584f9948750 0x5584f99809e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.296+0000 7f34211cb640 1 -- 172.21.15.100:0/3394649121 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584f986c2f0 con 0x5584f9948b30 2024-09-11T22:20:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.296+0000 7f34211cb640 1 --2- 172.21.15.100:0/3394649121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948b30 0x5584f9944a60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3414089bf0 tx=0x7f34140595e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3b7611349eed80 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.296+0000 7f34067fc640 1 -- 172.21.15.100:0/3394649121 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34140625e0 con 0x5584f9948b30 2024-09-11T22:20:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.297+0000 7f34067fc640 1 -- 172.21.15.100:0/3394649121 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3414057a10 con 0x5584f9948b30 2024-09-11T22:20:58.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.297+0000 7f34067fc640 1 -- 172.21.15.100:0/3394649121 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3414055fe0 con 0x5584f9948b30 2024-09-11T22:20:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.297+0000 7f34259cd740 1 -- 172.21.15.100:0/3394649121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948b30 msgr2=0x5584f9944a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.297+0000 7f34259cd740 1 --2- 172.21.15.100:0/3394649121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948b30 0x5584f9944a60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3414089bf0 tx=0x7f34140595e0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.297+0000 7f34259cd740 1 -- 172.21.15.100:0/3394649121 shutdown_connections 2024-09-11T22:20:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.297+0000 7f34259cd740 1 --2- 172.21.15.100:0/3394649121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948b30 0x5584f9944a60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.297+0000 7f34259cd740 1 --2- 172.21.15.100:0/3394649121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5584f9945f80 0x5584f9980f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.297+0000 7f34259cd740 1 --2- 172.21.15.100:0/3394649121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5584f9948750 0x5584f99809e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.297+0000 7f34259cd740 1 -- 172.21.15.100:0/3394649121 >> 172.21.15.100:0/3394649121 conn(0x5584f9946e70 msgr2=0x5584f9947270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.297+0000 7f34259cd740 1 -- 172.21.15.100:0/3394649121 shutdown_connections 2024-09-11T22:20:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.297+0000 7f34259cd740 1 -- 172.21.15.100:0/3394649121 wait complete. 2024-09-11T22:20:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.298+0000 7f34259cd740 1 -- start start 2024-09-11T22:20:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.298+0000 7f34259cd740 1 Processor -- start 2024-09-11T22:20:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.299+0000 7f34259cd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5584f9945f80 0x5584f9977a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.299+0000 7f34259cd740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5584f9948750 0x5584f9965c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.299+0000 7f34259cd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948b30 0x5584f99661a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.299+0000 7f34259cd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5584f9947fe0 con 0x5584f9948b30 2024-09-11T22:20:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.299+0000 7f34259cd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5584f9832450 con 0x5584f9945f80 2024-09-11T22:20:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.299+0000 7f34259cd740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5584f9980550 con 0x5584f9948750 2024-09-11T22:20:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.299+0000 7f34259cd740 10 client.0 _ll_register_callbacks cb 0x5584f95bbac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.299+0000 7f34211cb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948b30 0x5584f99661a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.299+0000 7f34211cb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948b30 0x5584f99661a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39514/0 (socket says 172.21.15.100:39514) 2024-09-11T22:20:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.299+0000 7f34211cb640 1 -- 172.21.15.100:0/3270733732 learned_addr learned my addr 172.21.15.100:0/3270733732 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.299+0000 7f34209ca640 1 --2- 172.21.15.100:0/3270733732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5584f9945f80 0x5584f9977a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.299+0000 7f341bfff640 1 --2- 172.21.15.100:0/3270733732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5584f9948750 0x5584f9965c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.299+0000 7f34211cb640 1 -- 172.21.15.100:0/3270733732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5584f9948750 msgr2=0x5584f9965c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.299+0000 7f34211cb640 1 --2- 172.21.15.100:0/3270733732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5584f9948750 0x5584f9965c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.299+0000 7f34211cb640 1 -- 172.21.15.100:0/3270733732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5584f9945f80 msgr2=0x5584f9977a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.299+0000 7f34211cb640 1 --2- 172.21.15.100:0/3270733732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5584f9945f80 0x5584f9977a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.299+0000 7f34211cb640 1 -- 172.21.15.100:0/3270733732 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584f95bc2d0 con 0x5584f9948b30 2024-09-11T22:20:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.299+0000 7f34211cb640 1 --2- 172.21.15.100:0/3270733732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948b30 0x5584f99661a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3414004b10 tx=0x7f3414004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897084d2ce8074de server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.299+0000 7f33fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-11T22:20:58.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.299+0000 7f33fb7fe640 1 -- 172.21.15.100:0/3270733732 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3414062350 con 0x5584f9948b30 2024-09-11T22:20:58.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.299+0000 7f33fb7fe640 1 -- 172.21.15.100:0/3270733732 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3414058dc0 con 0x5584f9948b30 2024-09-11T22:20:58.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.299+0000 7f34259cd740 1 -- 172.21.15.100:0/3270733732 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3414057a10 con 0x5584f9948b30 2024-09-11T22:20:58.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.300+0000 7f33fb7fe640 1 -- 172.21.15.100:0/3270733732 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f3414080050 con 0x5584f9948b30 2024-09-11T22:20:58.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.300+0000 7f34259cd740 10 client.4785 fetch_fsmap learned FSMap version 14 2024-09-11T22:20:58.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.300+0000 7f34259cd740 1 -- 172.21.15.100:0/3270733732 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5584f96866b0 con 0x5584f9948b30 2024-09-11T22:20:58.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.300+0000 7f33fb7fe640 1 -- 172.21.15.100:0/3270733732 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3414057a10 con 0x5584f9948b30 2024-09-11T22:20:58.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.300+0000 7f33fb7fe640 1 -- 172.21.15.100:0/3270733732 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 14) ==== 4760+0+0 (secure 0 0 0) 0x7f3414083020 con 0x5584f9948b30 2024-09-11T22:20:58.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.300+0000 7f34259cd740 10 client.4785 fetch_fsmap finished waiting for FSMap version 14 2024-09-11T22:20:58.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.300+0000 7f34259cd740 10 client.4785 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-11T22:20:58.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.300+0000 7f34259cd740 20 client.4785 populate_metadata read hostname 'smithi100' 2024-09-11T22:20:58.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.300+0000 7f34259cd740 1 --2- 172.21.15.100:0/3270733732 >> [v2:172.21.15.167:6832/1651678197,v1:172.21.15.167:6834/1651678197] conn(0x5584f999ba60 0x5584f999be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.300+0000 7f34259cd740 4 client.4785 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T22:20:58.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.300+0000 7f34259cd740 1 -- 172.21.15.100:0/3270733732 --> [v2:172.21.15.167:6832/1651678197,v1:172.21.15.167:6834/1651678197] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584f98b6c50 con 0x5584f999ba60 2024-09-11T22:20:58.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.300+0000 7f34209ca640 1 --2- 172.21.15.100:0/3270733732 >> [v2:172.21.15.167:6832/1651678197,v1:172.21.15.167:6834/1651678197] conn(0x5584f999ba60 0x5584f999be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.301+0000 7f33fb7fe640 10 client.4785 ms_handle_connect on v2:172.21.15.167:6832/1651678197 2024-09-11T22:20:58.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.301+0000 7f34209ca640 1 --2- 172.21.15.100:0/3270733732 >> [v2:172.21.15.167:6832/1651678197,v1:172.21.15.167:6834/1651678197] conn(0x5584f999ba60 0x5584f999be40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c285beb0ab493ef server_cookie=9839e69ca1c16813 in_seq=0 out_seq=0 2024-09-11T22:20:58.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.301+0000 7f33fb7fe640 1 -- 172.21.15.100:0/3270733732 <== mds.0 v2:172.21.15.167:6832/1651678197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5584f98b6c50 con 0x5584f999ba60 2024-09-11T22:20:58.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.301+0000 7f33fb7fe640 10 client.4785 handle_command_reply: tid=0 2024-09-11T22:20:58.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.301+0000 7f34259cd740 1 client.4785 shutdown 2024-09-11T22:20:58.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.302+0000 7f34259cd740 1 -- 172.21.15.100:0/3270733732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948b30 msgr2=0x5584f99661a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.302+0000 7f34259cd740 1 --2- 172.21.15.100:0/3270733732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948b30 0x5584f99661a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3414004b10 tx=0x7f3414004a40 comp rx=0 tx=0).stop 2024-09-11T22:20:58.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.302+0000 7f34259cd740 1 -- 172.21.15.100:0/3270733732 shutdown_connections 2024-09-11T22:20:58.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.302+0000 7f34259cd740 1 --2- 172.21.15.100:0/3270733732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948b30 0x5584f99661a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.302+0000 7f34259cd740 1 --2- 172.21.15.100:0/3270733732 >> [v2:172.21.15.167:6832/1651678197,v1:172.21.15.167:6834/1651678197] conn(0x5584f999ba60 0x5584f999be40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.302+0000 7f34259cd740 1 --2- 172.21.15.100:0/3270733732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5584f9948750 0x5584f9965c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.302+0000 7f34259cd740 1 --2- 172.21.15.100:0/3270733732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5584f9945f80 0x5584f9977a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.302+0000 7f33fb7fe640 0 client.4785 ms_handle_reset on v2:172.21.15.167:6832/1651678197 2024-09-11T22:20:58.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.302+0000 7f34259cd740 1 -- 172.21.15.100:0/3270733732 >> 172.21.15.100:0/3270733732 conn(0x5584f9946e70 msgr2=0x5584f997bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.302+0000 7f34259cd740 1 -- 172.21.15.100:0/3270733732 shutdown_connections 2024-09-11T22:20:58.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.302+0000 7f34259cd740 1 -- 172.21.15.100:0/3270733732 wait complete. 2024-09-11T22:20:58.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.302+0000 7f34259cd740 20 client.4785 trim_cache size 0 max 16384 2024-09-11T22:20:58.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.319+0000 7f34259cd740 1 Processor -- start 2024-09-11T22:20:58.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.319+0000 7f34259cd740 1 -- start start 2024-09-11T22:20:58.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.320+0000 7f34259cd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5584f9945f80 0x5584f9946360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.320+0000 7f34259cd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948750 0x5584f99468a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.320+0000 7f34259cd740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5584f9948b30 0x5584f99ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.320+0000 7f34259cd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f341c1fca50 con 0x5584f9948750 2024-09-11T22:20:58.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.320+0000 7f34259cd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5584f9832450 con 0x5584f9945f80 2024-09-11T22:20:58.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.320+0000 7f34259cd740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5584f9947fe0 con 0x5584f9948b30 2024-09-11T22:20:58.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.320+0000 7f341bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948750 0x5584f99468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.320+0000 7f341bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948750 0x5584f99468a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39522/0 (socket says 172.21.15.100:39522) 2024-09-11T22:20:58.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.320+0000 7f341bfff640 1 -- 172.21.15.100:0/3528100427 learned_addr learned my addr 172.21.15.100:0/3528100427 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:58.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.320+0000 7f34209ca640 1 --2- 172.21.15.100:0/3528100427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5584f9945f80 0x5584f9946360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.320+0000 7f34211cb640 1 --2- 172.21.15.100:0/3528100427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5584f9948b30 0x5584f99ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.320+0000 7f341bfff640 1 -- 172.21.15.100:0/3528100427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5584f9948b30 msgr2=0x5584f99ab9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.320+0000 7f341bfff640 1 --2- 172.21.15.100:0/3528100427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5584f9948b30 0x5584f99ab9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.320+0000 7f341bfff640 1 -- 172.21.15.100:0/3528100427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5584f9945f80 msgr2=0x5584f9946360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.320+0000 7f341bfff640 1 --2- 172.21.15.100:0/3528100427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5584f9945f80 0x5584f9946360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.320+0000 7f341bfff640 1 -- 172.21.15.100:0/3528100427 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584f99788a0 con 0x5584f9948750 2024-09-11T22:20:58.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.320+0000 7f34211cb640 1 --2- 172.21.15.100:0/3528100427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5584f9948b30 0x5584f99ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:20:58.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.321+0000 7f341bfff640 1 --2- 172.21.15.100:0/3528100427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948750 0x5584f99468a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f340802a860 tx=0x7f340802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b0844764b9eabd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.321+0000 7f3405ffb640 1 -- 172.21.15.100:0/3528100427 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3408037040 con 0x5584f9948750 2024-09-11T22:20:58.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.321+0000 7f3405ffb640 1 -- 172.21.15.100:0/3528100427 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3408032780 con 0x5584f9948750 2024-09-11T22:20:58.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.321+0000 7f3405ffb640 1 -- 172.21.15.100:0/3528100427 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3408032b30 con 0x5584f9948750 2024-09-11T22:20:58.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.321+0000 7f34259cd740 1 -- 172.21.15.100:0/3528100427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948750 msgr2=0x5584f99468a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.321+0000 7f34259cd740 1 --2- 172.21.15.100:0/3528100427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948750 0x5584f99468a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f340802a860 tx=0x7f340802c000 comp rx=0 tx=0).stop 2024-09-11T22:20:58.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.321+0000 7f34259cd740 1 -- 172.21.15.100:0/3528100427 shutdown_connections 2024-09-11T22:20:58.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.321+0000 7f34259cd740 1 --2- 172.21.15.100:0/3528100427 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5584f9948b30 0x5584f99ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.321+0000 7f34259cd740 1 --2- 172.21.15.100:0/3528100427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948750 0x5584f99468a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.321+0000 7f34259cd740 1 --2- 172.21.15.100:0/3528100427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5584f9945f80 0x5584f9946360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.321+0000 7f34259cd740 1 -- 172.21.15.100:0/3528100427 >> 172.21.15.100:0/3528100427 conn(0x5584f9946e70 msgr2=0x5584f9947250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.321+0000 7f34259cd740 1 -- 172.21.15.100:0/3528100427 shutdown_connections 2024-09-11T22:20:58.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.321+0000 7f34259cd740 1 -- 172.21.15.100:0/3528100427 wait complete. 2024-09-11T22:20:58.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.322+0000 7f34259cd740 1 -- start start 2024-09-11T22:20:58.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.322+0000 7f34259cd740 1 Processor -- start 2024-09-11T22:20:58.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.323+0000 7f34259cd740 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5584f9945f80 0x5584f99aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.323+0000 7f34259cd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5584f9948750 0x5584f99abba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.323+0000 7f34259cd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948b30 0x5584f9965a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.323+0000 7f34259cd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5584f996f0f0 con 0x5584f9948b30 2024-09-11T22:20:58.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.323+0000 7f34259cd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5584f997ff50 con 0x5584f9948750 2024-09-11T22:20:58.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.323+0000 7f34259cd740 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x5584f9997f80 con 0x5584f9945f80 2024-09-11T22:20:58.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.323+0000 7f34259cd740 10 client.0 _ll_register_callbacks cb 0x7f341000bec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T22:20:58.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.323+0000 7f34211cb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948b30 0x5584f9965a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.323+0000 7f34211cb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948b30 0x5584f9965a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39534/0 (socket says 172.21.15.100:39534) 2024-09-11T22:20:58.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.323+0000 7f34211cb640 1 -- 172.21.15.100:0/1220008585 learned_addr learned my addr 172.21.15.100:0/1220008585 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:58.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.323+0000 7f34209ca640 1 --2- 172.21.15.100:0/1220008585 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5584f9945f80 0x5584f99aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.323+0000 7f341bfff640 1 --2- 172.21.15.100:0/1220008585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5584f9948750 0x5584f99abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.323+0000 7f34211cb640 1 -- 172.21.15.100:0/1220008585 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5584f9945f80 msgr2=0x5584f99aa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.323+0000 7f34211cb640 1 --2- 172.21.15.100:0/1220008585 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5584f9945f80 0x5584f99aa9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.323+0000 7f34211cb640 1 -- 172.21.15.100:0/1220008585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5584f9948750 msgr2=0x5584f99abba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.323+0000 7f34211cb640 1 --2- 172.21.15.100:0/1220008585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5584f9948750 0x5584f99abba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.323+0000 7f34211cb640 1 -- 172.21.15.100:0/1220008585 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584f9a0e820 con 0x5584f9948b30 2024-09-11T22:20:58.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.324+0000 7f34211cb640 1 --2- 172.21.15.100:0/1220008585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948b30 0x5584f9965a80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3414089d30 tx=0x7f341400f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1421fc6eb6001b64 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.324+0000 7f33fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-11T22:20:58.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.324+0000 7f33fb7fe640 1 -- 172.21.15.100:0/1220008585 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3414058a30 con 0x5584f9948b30 2024-09-11T22:20:58.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.324+0000 7f33fb7fe640 1 -- 172.21.15.100:0/1220008585 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3414058dc0 con 0x5584f9948b30 2024-09-11T22:20:58.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.324+0000 7f34259cd740 1 -- 172.21.15.100:0/1220008585 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3408032780 con 0x5584f9948b30 2024-09-11T22:20:58.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.324+0000 7f33fb7fe640 1 -- 172.21.15.100:0/1220008585 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f3414083390 con 0x5584f9948b30 2024-09-11T22:20:58.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.324+0000 7f34259cd740 10 client.4791 fetch_fsmap learned FSMap version 14 2024-09-11T22:20:58.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.324+0000 7f34259cd740 1 -- 172.21.15.100:0/1220008585 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5584f999b050 con 0x5584f9948b30 2024-09-11T22:20:58.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.324+0000 7f33fb7fe640 1 -- 172.21.15.100:0/1220008585 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3408032780 con 0x5584f9948b30 2024-09-11T22:20:58.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.324+0000 7f33fb7fe640 1 -- 172.21.15.100:0/1220008585 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 14) ==== 4760+0+0 (secure 0 0 0) 0x7f3414083020 con 0x5584f9948b30 2024-09-11T22:20:58.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.324+0000 7f34259cd740 10 client.4791 fetch_fsmap finished waiting for FSMap version 14 2024-09-11T22:20:58.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.324+0000 7f34259cd740 10 client.4791 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-11T22:20:58.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.324+0000 7f34259cd740 20 client.4791 populate_metadata read hostname 'smithi100' 2024-09-11T22:20:58.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.324+0000 7f34259cd740 1 --2- 172.21.15.100:0/1220008585 >> [v2:172.21.15.167:6832/1651678197,v1:172.21.15.167:6834/1651678197] conn(0x5584f997bfd0 0x5584f997c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.324+0000 7f34259cd740 4 client.4791 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T22:20:58.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.324+0000 7f34259cd740 1 -- 172.21.15.100:0/1220008585 --> [v2:172.21.15.167:6832/1651678197,v1:172.21.15.167:6834/1651678197] -- command(tid 0: {"prefix": "status"}) -- 0x5584f98b0fa0 con 0x5584f997bfd0 2024-09-11T22:20:58.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.324+0000 7f34209ca640 1 --2- 172.21.15.100:0/1220008585 >> [v2:172.21.15.167:6832/1651678197,v1:172.21.15.167:6834/1651678197] conn(0x5584f997bfd0 0x5584f997c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.325+0000 7f33fb7fe640 10 client.4791 ms_handle_connect on v2:172.21.15.167:6832/1651678197 2024-09-11T22:20:58.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.325+0000 7f34209ca640 1 --2- 172.21.15.100:0/1220008585 >> [v2:172.21.15.167:6832/1651678197,v1:172.21.15.167:6834/1651678197] conn(0x5584f997bfd0 0x5584f997c3b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6282d52fecea9b85 server_cookie=6fc9b15a06100ced in_seq=0 out_seq=0 2024-09-11T22:20:58.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.325+0000 7f33fb7fe640 1 -- 172.21.15.100:0/1220008585 <== mds.0 v2:172.21.15.167:6832/1651678197 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x5584f98b0fa0 con 0x5584f997bfd0 2024-09-11T22:20:58.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.325+0000 7f33fb7fe640 10 client.4791 handle_command_reply: tid=0 2024-09-11T22:20:58.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.325+0000 7f34259cd740 1 client.4791 shutdown 2024-09-11T22:20:58.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.325+0000 7f34259cd740 1 -- 172.21.15.100:0/1220008585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948b30 msgr2=0x5584f9965a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.325+0000 7f34259cd740 1 --2- 172.21.15.100:0/1220008585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948b30 0x5584f9965a80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3414089d30 tx=0x7f341400f040 comp rx=0 tx=0).stop 2024-09-11T22:20:58.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.325+0000 7f34259cd740 1 -- 172.21.15.100:0/1220008585 shutdown_connections 2024-09-11T22:20:58.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.325+0000 7f34259cd740 1 --2- 172.21.15.100:0/1220008585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5584f9948b30 0x5584f9965a80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.325+0000 7f34259cd740 1 --2- 172.21.15.100:0/1220008585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5584f9948750 0x5584f99abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.325+0000 7f34259cd740 1 --2- 172.21.15.100:0/1220008585 >> [v2:172.21.15.167:6832/1651678197,v1:172.21.15.167:6834/1651678197] conn(0x5584f997bfd0 0x5584f997c3b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.325+0000 7f34259cd740 1 --2- 172.21.15.100:0/1220008585 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5584f9945f80 0x5584f99aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.325+0000 7f33fb7fe640 0 client.4791 ms_handle_reset on v2:172.21.15.167:6832/1651678197 2024-09-11T22:20:58.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.325+0000 7f34259cd740 1 -- 172.21.15.100:0/1220008585 >> 172.21.15.100:0/1220008585 conn(0x5584f9946e70 msgr2=0x5584f9946360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.325+0000 7f34259cd740 1 -- 172.21.15.100:0/1220008585 shutdown_connections 2024-09-11T22:20:58.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.325+0000 7f34259cd740 1 -- 172.21.15.100:0/1220008585 wait complete. 2024-09-11T22:20:58.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.325+0000 7f34259cd740 20 client.4791 trim_cache size 0 max 16384 2024-09-11T22:20:58.333 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:20:58.333 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:20:58.333 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-09-11T22:20:58.333 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4296, 2024-09-11T22:20:58.333 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-09-11T22:20:58.333 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-09-11T22:20:58.333 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-09-11T22:20:58.334 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 38.490194494000001, 2024-09-11T22:20:58.334 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 14, 2024-09-11T22:20:58.334 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 26, 2024-09-11T22:20:58.334 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 26, 2024-09-11T22:20:58.334 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 44.50131726 2024-09-11T22:20:58.334 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:20:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.326+0000 7f3422c2e640 1 -- 172.21.15.100:0/259649507 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f340006be30 msgr2=0x7f340006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.326+0000 7f3422c2e640 1 --2- 172.21.15.100:0/259649507 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f340006be30 0x7f340006e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f341000b840 tx=0x7f3410008040 comp rx=0 tx=0).stop 2024-09-11T22:20:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.326+0000 7f3422c2e640 1 -- 172.21.15.100:0/259649507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f341c154be0 msgr2=0x7f341c06cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.326+0000 7f3422c2e640 1 --2- 172.21.15.100:0/259649507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f341c154be0 0x7f341c06cc50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f341400cef0 tx=0x7f341400a710 comp rx=0 tx=0).stop 2024-09-11T22:20:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.326+0000 7f3422c2e640 1 -- 172.21.15.100:0/259649507 shutdown_connections 2024-09-11T22:20:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.326+0000 7f3422c2e640 1 --2- 172.21.15.100:0/259649507 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f340006be30 0x7f340006e2f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.326+0000 7f3422c2e640 1 --2- 172.21.15.100:0/259649507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f341c154be0 0x7f341c06cc50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.326+0000 7f3422c2e640 1 --2- 172.21.15.100:0/259649507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f341c0c4070 0x7f341c1f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.326+0000 7f3422c2e640 1 --2- 172.21.15.100:0/259649507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f341c0c37e0 0x7f341c157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.326+0000 7f3422c2e640 1 -- 172.21.15.100:0/259649507 >> 172.21.15.100:0/259649507 conn(0x7f341c0714a0 msgr2=0x7f341c153720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.326+0000 7f3422c2e640 1 -- 172.21.15.100:0/259649507 shutdown_connections 2024-09-11T22:20:58.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.326+0000 7f3422c2e640 1 -- 172.21.15.100:0/259649507 wait complete. 2024-09-11T22:20:58.339 INFO:teuthology.run_tasks:Running task sequential... 2024-09-11T22:20:58.348 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-11T22:20:58.348 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-11T22:20:58.348 INFO:teuthology.task.print:Enabling mgr modules 2024-09-11T22:20:58.349 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-11T22:20:58.358 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-11T22:20:58.358 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-11T22:20:58.359 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-11T22:20:58.359 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T22:20:58.359 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T22:20:58.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:58.359 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-11T22:20:58.375 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-11T22:20:58.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:58.375 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T22:20:58.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:58.440 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-09-11T22:20:58.541 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-11T22:20:58.541 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-11T22:20:58.541 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-11T22:20:58.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.638+0000 7fed0ad2c640 1 Processor -- start 2024-09-11T22:20:58.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.638+0000 7fed0ad2c640 1 -- start start 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.638+0000 7fed0ad2c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fed04151090 0x7fed04071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.638+0000 7fed0ad2c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fed040c0f90 0x7fed0406d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.638+0000 7fed0ad2c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed040c80f0 con 0x7fed040b1e80 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.638+0000 7fed0ad2c640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fed040b16c0 con 0x7fed04151090 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.638+0000 7fed0ad2c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fed04073070 con 0x7fed040c0f90 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.639+0000 7fed08ac8640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fed04151090 0x7fed04071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.639+0000 7fed08ac8640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fed04151090 0x7fed04071780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39546/0 (socket says 172.21.15.100:39546) 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.639+0000 7fed08ac8640 1 -- 172.21.15.100:0/2360298513 learned_addr learned my addr 172.21.15.100:0/2360298513 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.639+0000 7fed092c9640 1 --2- 172.21.15.100:0/2360298513 >> v2:172.21.15.167:3300/0 conn(0x7fed040c0f90 0x7fed0406d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.639+0000 7fed08ac8640 1 -- 172.21.15.100:0/2360298513 >> v2:172.21.15.167:3300/0 conn(0x7fed040c0f90 msgr2=0x7fed0406d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.639+0000 7fed08ac8640 1 --2- 172.21.15.100:0/2360298513 >> v2:172.21.15.167:3300/0 conn(0x7fed040c0f90 0x7fed0406d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.639+0000 7fed08ac8640 1 -- 172.21.15.100:0/2360298513 >> v1:172.21.15.167:6789/0 conn(0x7fed040b1e80 legacy=0x7fed04156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:20:58.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.639+0000 7fed08ac8640 1 -- 172.21.15.100:0/2360298513 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed04073350 con 0x7fed04151090 2024-09-11T22:20:58.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.640+0000 7fed08ac8640 1 --2- 172.21.15.100:0/2360298513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed04151090 0x7fed04071780 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fed040c9b00 tx=0x7fecfc02a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b5788fa5289999 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.640+0000 7fed037fe640 1 -- 172.21.15.100:0/2360298513 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecfc037070 con 0x7fed04151090 2024-09-11T22:20:58.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.640+0000 7fed037fe640 1 -- 172.21.15.100:0/2360298513 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecfc032440 con 0x7fed04151090 2024-09-11T22:20:58.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.640+0000 7fed037fe640 1 -- 172.21.15.100:0/2360298513 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecfc032810 con 0x7fed04151090 2024-09-11T22:20:58.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.640+0000 7fed0ad2c640 1 -- 172.21.15.100:0/2360298513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed04151090 msgr2=0x7fed04071780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.640+0000 7fed0ad2c640 1 --2- 172.21.15.100:0/2360298513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed04151090 0x7fed04071780 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fed040c9b00 tx=0x7fecfc02a290 comp rx=0 tx=0).stop 2024-09-11T22:20:58.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.640+0000 7fed0ad2c640 1 -- 172.21.15.100:0/2360298513 shutdown_connections 2024-09-11T22:20:58.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.640+0000 7fed0ad2c640 1 --2- 172.21.15.100:0/2360298513 >> v2:172.21.15.167:3300/0 conn(0x7fed040c0f90 0x7fed0406d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.640+0000 7fed0ad2c640 1 --2- 172.21.15.100:0/2360298513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed04151090 0x7fed04071780 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.640+0000 7fed0ad2c640 1 -- 172.21.15.100:0/2360298513 >> 172.21.15.100:0/2360298513 conn(0x7fed040cbf70 msgr2=0x7fed040cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.641+0000 7fed0ad2c640 1 -- 172.21.15.100:0/2360298513 shutdown_connections 2024-09-11T22:20:58.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.641+0000 7fed0ad2c640 1 -- 172.21.15.100:0/2360298513 wait complete. 2024-09-11T22:20:58.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.642+0000 7fed0ad2c640 1 Processor -- start 2024-09-11T22:20:58.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.642+0000 7fed0ad2c640 1 -- start start 2024-09-11T22:20:58.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.642+0000 7fed0ad2c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed040b1e80 0x7fed04159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.642+0000 7fed0ad2c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed040c0f90 0x7fed04157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.642+0000 7fed0ad2c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed04151090 0x7fed041e4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.643+0000 7fed0ad2c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fed040b1960 con 0x7fed04151090 2024-09-11T22:20:58.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.643+0000 7fed0ad2c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fed04073910 con 0x7fed040b1e80 2024-09-11T22:20:58.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.643+0000 7fed0ad2c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fed04151470 con 0x7fed040c0f90 2024-09-11T22:20:58.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.643+0000 7fed092c9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed04151090 0x7fed041e4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.643+0000 7fed092c9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed04151090 0x7fed041e4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39560/0 (socket says 172.21.15.100:39560) 2024-09-11T22:20:58.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.643+0000 7fed092c9640 1 -- 172.21.15.100:0/3894135852 learned_addr learned my addr 172.21.15.100:0/3894135852 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:20:58.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.643+0000 7fed08ac8640 1 --2- 172.21.15.100:0/3894135852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed040b1e80 0x7fed04159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.643+0000 7fed03fff640 1 --2- 172.21.15.100:0/3894135852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed040c0f90 0x7fed04157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.643+0000 7fed092c9640 1 -- 172.21.15.100:0/3894135852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed040c0f90 msgr2=0x7fed04157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.643+0000 7fed092c9640 1 --2- 172.21.15.100:0/3894135852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed040c0f90 0x7fed04157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.643+0000 7fed092c9640 1 -- 172.21.15.100:0/3894135852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed040b1e80 msgr2=0x7fed04159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.643+0000 7fed092c9640 1 --2- 172.21.15.100:0/3894135852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed040b1e80 0x7fed04159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.643+0000 7fed092c9640 1 -- 172.21.15.100:0/3894135852 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed04152aa0 con 0x7fed04151090 2024-09-11T22:20:58.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.643+0000 7fed08ac8640 1 --2- 172.21.15.100:0/3894135852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed040b1e80 0x7fed04159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:20:58.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.643+0000 7fed092c9640 1 --2- 172.21.15.100:0/3894135852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed04151090 0x7fed041e4790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fecec00c540 tx=0x7fecec00ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.643+0000 7fed017fa640 1 -- 172.21.15.100:0/3894135852 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec015070 con 0x7fed04151090 2024-09-11T22:20:58.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.643+0000 7fed017fa640 1 -- 172.21.15.100:0/3894135852 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecec004220 con 0x7fed04151090 2024-09-11T22:20:58.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.643+0000 7fed017fa640 1 -- 172.21.15.100:0/3894135852 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec003610 con 0x7fed04151090 2024-09-11T22:20:58.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.643+0000 7fed0ad2c640 1 -- 172.21.15.100:0/3894135852 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed04152800 con 0x7fed04151090 2024-09-11T22:20:58.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.643+0000 7fed0ad2c640 1 -- 172.21.15.100:0/3894135852 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed041f3f20 con 0x7fed04151090 2024-09-11T22:20:58.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.644+0000 7fed0ad2c640 1 -- 172.21.15.100:0/3894135852 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed04150700 con 0x7fed04151090 2024-09-11T22:20:58.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.645+0000 7fed017fa640 1 -- 172.21.15.100:0/3894135852 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fecec0037b0 con 0x7fed04151090 2024-09-11T22:20:58.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.645+0000 7fed017fa640 1 --2- 172.21.15.100:0/3894135852 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fece406be30 0x7fece406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:20:58.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.645+0000 7fed017fa640 1 -- 172.21.15.100:0/3894135852 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fecec08b300 con 0x7fed04151090 2024-09-11T22:20:58.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.645+0000 7fed08ac8640 1 --2- 172.21.15.100:0/3894135852 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fece406be30 0x7fece406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:20:58.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.646+0000 7fed08ac8640 1 --2- 172.21.15.100:0/3894135852 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fece406be30 0x7fece406e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fecfc034000 tx=0x7fecfc02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:20:58.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.650+0000 7fed017fa640 1 -- 172.21.15.100:0/3894135852 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fecec0598e0 con 0x7fed04151090 2024-09-11T22:20:58.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.849+0000 7fed0ad2c640 1 -- 172.21.15.100:0/3894135852 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fed04150420 con 0x7fed04151090 2024-09-11T22:20:58.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.850+0000 7fed017fa640 1 -- 172.21.15.100:0/3894135852 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+88 (secure 0 0 0) 0x7fecec0591e0 con 0x7fed04151090 2024-09-11T22:20:58.852 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T22:20:58.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.852+0000 7fed0ad2c640 1 -- 172.21.15.100:0/3894135852 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fece406be30 msgr2=0x7fece406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.852+0000 7fed0ad2c640 1 --2- 172.21.15.100:0/3894135852 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fece406be30 0x7fece406e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fecfc034000 tx=0x7fecfc02e000 comp rx=0 tx=0).stop 2024-09-11T22:20:58.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.852+0000 7fed0ad2c640 1 -- 172.21.15.100:0/3894135852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed04151090 msgr2=0x7fed041e4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:20:58.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.852+0000 7fed0ad2c640 1 --2- 172.21.15.100:0/3894135852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed04151090 0x7fed041e4790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fecec00c540 tx=0x7fecec00ca00 comp rx=0 tx=0).stop 2024-09-11T22:20:58.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.852+0000 7fed0ad2c640 1 -- 172.21.15.100:0/3894135852 shutdown_connections 2024-09-11T22:20:58.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.852+0000 7fed0ad2c640 1 --2- 172.21.15.100:0/3894135852 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fece406be30 0x7fece406e2f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.852+0000 7fed0ad2c640 1 --2- 172.21.15.100:0/3894135852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed04151090 0x7fed041e4790 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.852+0000 7fed0ad2c640 1 --2- 172.21.15.100:0/3894135852 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed040c0f90 0x7fed04157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.852+0000 7fed0ad2c640 1 --2- 172.21.15.100:0/3894135852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed040b1e80 0x7fed04159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:20:58.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.852+0000 7fed0ad2c640 1 -- 172.21.15.100:0/3894135852 >> 172.21.15.100:0/3894135852 conn(0x7fed040cbf70 msgr2=0x7fed0414f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:20:58.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.852+0000 7fed0ad2c640 1 -- 172.21.15.100:0/3894135852 shutdown_connections 2024-09-11T22:20:58.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58.852+0000 7fed0ad2c640 1 -- 172.21.15.100:0/3894135852 wait complete. 2024-09-11T22:20:58.865 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T22:20:58.865 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T22:20:58.865 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-09-11T22:20:58.865 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T22:20:58.865 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T22:20:58.865 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T22:20:58.865 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T22:20:58.865 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T22:20:58.866 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:20:58.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:58.866 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-09-11T22:20:58.881 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T22:20:58.881 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T22:20:58.881 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T22:20:58.881 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:20:58.882 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-09-11T22:20:58.882 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:20:58.882 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:20:58.882 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:20:58.882 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-09-11T22:20:58.882 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:20:58.882 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:20:58.882 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-09-11T22:20:58.882 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T22:20:58.882 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:20:58.882 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T22:20:58.882 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-09-11T22:20:58.882 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T22:20:58.882 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42730sec preferred_lft 42730sec 2024-09-11T22:20:58.883 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link noprefixroute 2024-09-11T22:20:58.883 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-09-11T22:20:58.883 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T22:20:58.883 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:20:58.883 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-11T22:20:58.883 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add name ceph-brx type bridge 2024-09-11T22:20:58.883 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr flush dev ceph-brx 2024-09-11T22:20:58.883 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set ceph-brx up 2024-09-11T22:20:58.883 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T22:20:58.883 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-11T22:20:58.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:20:59.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:59.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:59.019 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T22:20:59.043 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-09-11T22:20:59.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:59.045 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-09-11T22:20:59.102 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-09-11T22:20:59.112 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T22:20:59.112 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T22:20:59.112 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T22:20:59.112 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T22:20:59.112 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:20:59.112 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-11T22:20:59.112 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T22:20:59.112 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T22:20:59.113 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T22:20:59.113 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-11T22:20:59.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:20:59.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:59.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:59.228 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-11T22:20:59.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:59.244 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2024-09-11T22:20:59.299 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:20:59.299 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-11T22:20:59.299 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:20:59.299 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-11T22:20:59.300 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-11T22:20:59.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:20:59.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:59.415 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-11T22:20:59.416 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:20:59.416 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-11T22:20:59.416 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-11T22:20:59.416 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T22:20:59.416 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-11T22:20:59.416 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-11T22:20:59.416 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-11T22:20:59.416 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-11T22:20:59.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:20:59.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:59.528 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T22:20:59.528 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-09-11T22:20:59.528 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-09-11T22:20:59.528 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T22:20:59.528 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-09-11T22:20:59.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T22:20:59.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:20:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:20:59.605 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-11T22:20:59.605 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:20:59.606 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T22:20:59.621 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T22:20:59.621 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T22:20:59.621 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:20:59.677 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-09-11T22:20:59.742 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T22:20:59.797 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2024-09-11T22:20:59.797 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2024-09-11T22:20:59.798 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2024-09-11T22:20:59.798 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2024-09-11T22:20:59.798 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2024-09-11T22:20:59.798 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2024-09-11T22:20:59.798 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2024-09-11T22:20:59.798 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2024-09-11T22:20:59.798 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2024-09-11T22:20:59.798 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2024-09-11T22:20:59.798 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2024-09-11T22:20:59.798 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/selinux 2024-09-11T22:20:59.798 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T22:20:59.798 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2024-09-11T22:20:59.798 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2024-09-11T22:20:59.799 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2024-09-11T22:20:59.799 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2024-09-11T22:20:59.799 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T22:20:59.799 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2024-09-11T22:20:59.799 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2024-09-11T22:20:59.799 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T22:20:59.799 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T22:20:59.799 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T22:20:59.799 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2024-09-11T22:20:59.799 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2024-09-11T22:20:59.799 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T22:20:59.799 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T22:20:59.799 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T22:20:59.799 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T22:20:59.800 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2024-09-11T22:20:59.800 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:20:59.800 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:20:59.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:59.801 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-09-11T22:20:59.855 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T22:20:59.856 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-11T22:20:59.897 DEBUG:teuthology.orchestra.run.smithi100:> sudo modprobe fuse 2024-09-11T22:20:59.921 DEBUG:teuthology.orchestra.run.smithi100:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T22:20:59.977 INFO:teuthology.orchestra.run.smithi100.stdout:/proc 2024-09-11T22:20:59.977 INFO:teuthology.orchestra.run.smithi100.stdout:/sys 2024-09-11T22:20:59.977 INFO:teuthology.orchestra.run.smithi100.stdout:/dev 2024-09-11T22:20:59.977 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/security 2024-09-11T22:20:59.977 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/shm 2024-09-11T22:20:59.977 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/pts 2024-09-11T22:20:59.977 INFO:teuthology.orchestra.run.smithi100.stdout:/run 2024-09-11T22:20:59.977 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/cgroup 2024-09-11T22:20:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/pstore 2024-09-11T22:20:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/bpf 2024-09-11T22:20:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/ 2024-09-11T22:20:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/selinux 2024-09-11T22:20:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T22:20:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/debug 2024-09-11T22:20:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/hugepages 2024-09-11T22:20:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/dev/mqueue 2024-09-11T22:20:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/tracing 2024-09-11T22:20:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T22:20:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/fs/fuse/connections 2024-09-11T22:20:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/sys/kernel/config 2024-09-11T22:20:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T22:20:59.978 INFO:teuthology.orchestra.run.smithi100.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T22:20:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T22:20:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/run/user/1000 2024-09-11T22:20:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph 2024-09-11T22:20:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-0 2024-09-11T22:20:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-1 2024-09-11T22:20:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-2 2024-09-11T22:20:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/var/lib/ceph/osd/ceph-3 2024-09-11T22:20:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns 2024-09-11T22:20:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:20:59.979 INFO:teuthology.orchestra.run.smithi100.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:20:59.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:20:59.981 DEBUG:teuthology.orchestra.run.smithi100:> ls /sys/fs/fuse/connections 2024-09-11T22:20:59.981 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:2024-09-11T22:20:59.979+0000 7f108c11b480 -1 init, newargv = 0x559b178756b0 newargc=15 2024-09-11T22:20:59.981 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[44867]: starting ceph client 2024-09-11T22:20:59.984 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[44867]: starting fuse 2024-09-11T22:20:59.998 INFO:teuthology.orchestra.run.smithi100.stdout:42 2024-09-11T22:20:59.999 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-09-11T22:20:59.999 DEBUG:teuthology.orchestra.run.smithi100:> sudo stdin-killer -- python3 -c ' 2024-09-11T22:20:59.999 DEBUG:teuthology.orchestra.run.smithi100:> import glob 2024-09-11T22:20:59.999 DEBUG:teuthology.orchestra.run.smithi100:> import re 2024-09-11T22:20:59.999 DEBUG:teuthology.orchestra.run.smithi100:> import os 2024-09-11T22:20:59.999 DEBUG:teuthology.orchestra.run.smithi100:> import subprocess 2024-09-11T22:20:59.999 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-11T22:20:59.999 DEBUG:teuthology.orchestra.run.smithi100:> def _find_admin_socket(client_name): 2024-09-11T22:20:59.999 DEBUG:teuthology.orchestra.run.smithi100:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-11T22:20:59.999 DEBUG:teuthology.orchestra.run.smithi100:> files = glob.glob(asok_path) 2024-09-11T22:20:59.999 DEBUG:teuthology.orchestra.run.smithi100:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-11T22:21:00.000 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-11T22:21:00.000 DEBUG:teuthology.orchestra.run.smithi100:> # Given a non-glob path, it better be there 2024-09-11T22:21:00.000 DEBUG:teuthology.orchestra.run.smithi100:> if "*" not in asok_path: 2024-09-11T22:21:00.000 DEBUG:teuthology.orchestra.run.smithi100:> assert(len(files) == 1) 2024-09-11T22:21:00.000 DEBUG:teuthology.orchestra.run.smithi100:> return files[0] 2024-09-11T22:21:00.000 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-11T22:21:00.000 DEBUG:teuthology.orchestra.run.smithi100:> for f in files: 2024-09-11T22:21:00.000 DEBUG:teuthology.orchestra.run.smithi100:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T22:21:00.000 DEBUG:teuthology.orchestra.run.smithi100:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T22:21:00.000 DEBUG:teuthology.orchestra.run.smithi100:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T22:21:00.000 DEBUG:teuthology.orchestra.run.smithi100:> contents = proc_f.read() 2024-09-11T22:21:00.000 DEBUG:teuthology.orchestra.run.smithi100:> if mountpoint in contents: 2024-09-11T22:21:00.000 DEBUG:teuthology.orchestra.run.smithi100:> return f 2024-09-11T22:21:00.000 DEBUG:teuthology.orchestra.run.smithi100:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T22:21:00.000 DEBUG:teuthology.orchestra.run.smithi100:> 2024-09-11T22:21:00.001 DEBUG:teuthology.orchestra.run.smithi100:> print(_find_admin_socket("client.0")) 2024-09-11T22:21:00.001 DEBUG:teuthology.orchestra.run.smithi100:> ' 2024-09-11T22:21:00.118 INFO:teuthology.orchestra.run.smithi100.stdout:/var/run/ceph/ceph-client.0.44867.asok 2024-09-11T22:21:00.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T22:21:00.130 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44867.asok 2024-09-11T22:21:00.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:21:00.130 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44867.asok status 2024-09-11T22:21:00.264 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:21:00.264 INFO:teuthology.orchestra.run.smithi100.stdout: "metadata": { 2024-09-11T22:21:00.264 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_sha1": "b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", 2024-09-11T22:21:00.264 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)", 2024-09-11T22:21:00.265 INFO:teuthology.orchestra.run.smithi100.stdout: "entity_id": "0", 2024-09-11T22:21:00.265 INFO:teuthology.orchestra.run.smithi100.stdout: "hostname": "smithi100", 2024-09-11T22:21:00.265 INFO:teuthology.orchestra.run.smithi100.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-11T22:21:00.265 INFO:teuthology.orchestra.run.smithi100.stdout: "pid": "44867", 2024-09-11T22:21:00.265 INFO:teuthology.orchestra.run.smithi100.stdout: "root": "/" 2024-09-11T22:21:00.265 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:00.265 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_count": 0, 2024-09-11T22:21:00.265 INFO:teuthology.orchestra.run.smithi100.stdout: "dentry_pinned_count": 0, 2024-09-11T22:21:00.265 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4803, 2024-09-11T22:21:00.265 INFO:teuthology.orchestra.run.smithi100.stdout: "inst": { 2024-09-11T22:21:00.265 INFO:teuthology.orchestra.run.smithi100.stdout: "name": { 2024-09-11T22:21:00.265 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "client", 2024-09-11T22:21:00.265 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4803 2024-09-11T22:21:00.266 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:00.266 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-09-11T22:21:00.266 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:00.266 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-09-11T22:21:00.266 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 2504440378 2024-09-11T22:21:00.266 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:00.266 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:00.266 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": { 2024-09-11T22:21:00.266 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:00.266 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "192.168.0.1:0", 2024-09-11T22:21:00.266 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 2504440378 2024-09-11T22:21:00.266 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:00.266 INFO:teuthology.orchestra.run.smithi100.stdout: "inst_str": "client.4803 192.168.0.1:0/2504440378", 2024-09-11T22:21:00.266 INFO:teuthology.orchestra.run.smithi100.stdout: "addr_str": "192.168.0.1:0/2504440378", 2024-09-11T22:21:00.267 INFO:teuthology.orchestra.run.smithi100.stdout: "inode_count": 1, 2024-09-11T22:21:00.267 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_epoch": 14, 2024-09-11T22:21:00.267 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch": 26, 2024-09-11T22:21:00.267 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_epoch_barrier": 0, 2024-09-11T22:21:00.267 INFO:teuthology.orchestra.run.smithi100.stdout: "blocklisted": false, 2024-09-11T22:21:00.267 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs" 2024-09-11T22:21:00.267 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:21:00.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:21:00.273 DEBUG:teuthology.orchestra.run.smithi100:> stat --file-system '--printf=%T 2024-09-11T22:21:00.273 DEBUG:teuthology.orchestra.run.smithi100:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-11T22:21:00.289 INFO:teuthology.orchestra.run.smithi100.stdout:fuseblk 2024-09-11T22:21:00.289 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-11T22:21:00.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:21:00.289 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T22:21:00.355 INFO:teuthology.run_tasks:Running task mon_thrash... 2024-09-11T22:21:00.393 INFO:tasks.mon_thrash:Beginning mon_thrash... 2024-09-11T22:21:00.393 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:21:00.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.495+0000 7fd1b640e640 1 Processor -- start 2024-09-11T22:21:00.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.496+0000 7fd1b640e640 1 -- start start 2024-09-11T22:21:00.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.496+0000 7fd1b640e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd1b006be80 0x7fd1b015c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:00.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.496+0000 7fd1b640e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd1b006c260 0x7fd1b0155940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:00.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.496+0000 7fd1b640e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1b00b18d0 0x7fd1b0155e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:00.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.496+0000 7fd1b640e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fd1b015cc60 con 0x7fd1b006c260 2024-09-11T22:21:00.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.496+0000 7fd1b640e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fd1b00b2310 con 0x7fd1b006be80 2024-09-11T22:21:00.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.496+0000 7fd1b640e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd1b0158940 con 0x7fd1b00b18d0 2024-09-11T22:21:00.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.496+0000 7fd1af7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd1b006c260 0x7fd1b0155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:00.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.496+0000 7fd1af7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd1b006c260 0x7fd1b0155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39564/0 (socket says 172.21.15.100:39564) 2024-09-11T22:21:00.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.496+0000 7fd1af7fe640 1 -- 172.21.15.100:0/1674549508 learned_addr learned my addr 172.21.15.100:0/1674549508 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:00.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.497+0000 7fd1affff640 1 --2- 172.21.15.100:0/1674549508 >> v2:172.21.15.167:3300/0 conn(0x7fd1b006be80 0x7fd1b015c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:00.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.497+0000 7fd1b49ab640 1 --2- 172.21.15.100:0/1674549508 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1b00b18d0 0x7fd1b0155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:00.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.497+0000 7fd1af7fe640 1 -- 172.21.15.100:0/1674549508 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1b00b18d0 msgr2=0x7fd1b0155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:00.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.497+0000 7fd1af7fe640 1 --2- 172.21.15.100:0/1674549508 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1b00b18d0 0x7fd1b0155e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.497+0000 7fd1af7fe640 1 -- 172.21.15.100:0/1674549508 >> v2:172.21.15.167:3300/0 conn(0x7fd1b006be80 msgr2=0x7fd1b015c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:00.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.497+0000 7fd1af7fe640 1 --2- 172.21.15.100:0/1674549508 >> v2:172.21.15.167:3300/0 conn(0x7fd1b006be80 0x7fd1b015c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.497+0000 7fd1af7fe640 1 -- 172.21.15.100:0/1674549508 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b0158c20 con 0x7fd1b006c260 2024-09-11T22:21:00.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.497+0000 7fd1af7fe640 1 --2- 172.21.15.100:0/1674549508 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1b006c260 0x7fd1b0155940 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd1b00cd000 tx=0x7fd1a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42d1661a780aca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:00.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.498+0000 7fd1aeffd640 1 -- 172.21.15.100:0/1674549508 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4037070 con 0x7fd1b006c260 2024-09-11T22:21:00.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.498+0000 7fd1aeffd640 1 -- 172.21.15.100:0/1674549508 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1a4032440 con 0x7fd1b006c260 2024-09-11T22:21:00.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.498+0000 7fd1aeffd640 1 -- 172.21.15.100:0/1674549508 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4032810 con 0x7fd1b006c260 2024-09-11T22:21:00.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.498+0000 7fd1b640e640 1 -- 172.21.15.100:0/1674549508 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1b006c260 msgr2=0x7fd1b0155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:00.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.498+0000 7fd1b640e640 1 --2- 172.21.15.100:0/1674549508 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1b006c260 0x7fd1b0155940 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd1b00cd000 tx=0x7fd1a402a270 comp rx=0 tx=0).stop 2024-09-11T22:21:00.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.498+0000 7fd1b640e640 1 -- 172.21.15.100:0/1674549508 shutdown_connections 2024-09-11T22:21:00.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.498+0000 7fd1b640e640 1 --2- 172.21.15.100:0/1674549508 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1b00b18d0 0x7fd1b0155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.498+0000 7fd1b640e640 1 --2- 172.21.15.100:0/1674549508 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1b006c260 0x7fd1b0155940 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.498+0000 7fd1b640e640 1 --2- 172.21.15.100:0/1674549508 >> v2:172.21.15.167:3300/0 conn(0x7fd1b006be80 0x7fd1b015c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.498+0000 7fd1b640e640 1 -- 172.21.15.100:0/1674549508 >> 172.21.15.100:0/1674549508 conn(0x7fd1b00cbf70 msgr2=0x7fd1b00cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:00.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.498+0000 7fd1b640e640 1 -- 172.21.15.100:0/1674549508 shutdown_connections 2024-09-11T22:21:00.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.499+0000 7fd1b640e640 1 -- 172.21.15.100:0/1674549508 wait complete. 2024-09-11T22:21:00.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.500+0000 7fd1b640e640 1 Processor -- start 2024-09-11T22:21:00.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.500+0000 7fd1b640e640 1 -- start start 2024-09-11T22:21:00.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.501+0000 7fd1b640e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1b006be80 0x7fd1b00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:00.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.501+0000 7fd1b640e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1b006c260 0x7fd1b01471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:00.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.501+0000 7fd1b640e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1b00b18d0 0x7fd1b0147730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:00.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.501+0000 7fd1b640e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b01594c0 con 0x7fd1b00b18d0 2024-09-11T22:21:00.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.501+0000 7fd1b640e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b01591e0 con 0x7fd1b006c260 2024-09-11T22:21:00.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.501+0000 7fd1b640e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd1b00b1db0 con 0x7fd1b006be80 2024-09-11T22:21:00.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.501+0000 7fd1b49ab640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1b00b18d0 0x7fd1b0147730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:00.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.501+0000 7fd1b49ab640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1b00b18d0 0x7fd1b0147730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39580/0 (socket says 172.21.15.100:39580) 2024-09-11T22:21:00.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.501+0000 7fd1b49ab640 1 -- 172.21.15.100:0/2555064319 learned_addr learned my addr 172.21.15.100:0/2555064319 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:00.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.501+0000 7fd1af7fe640 1 --2- 172.21.15.100:0/2555064319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1b006c260 0x7fd1b01471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:00.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.501+0000 7fd1affff640 1 --2- 172.21.15.100:0/2555064319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1b006be80 0x7fd1b00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:00.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.501+0000 7fd1b49ab640 1 -- 172.21.15.100:0/2555064319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1b006be80 msgr2=0x7fd1b00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:00.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.501+0000 7fd1b49ab640 1 --2- 172.21.15.100:0/2555064319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1b006be80 0x7fd1b00cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.501+0000 7fd1b49ab640 1 -- 172.21.15.100:0/2555064319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1b006c260 msgr2=0x7fd1b01471f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:00.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.501+0000 7fd1b49ab640 1 --2- 172.21.15.100:0/2555064319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1b006c260 0x7fd1b01471f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.501+0000 7fd1b49ab640 1 -- 172.21.15.100:0/2555064319 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b015b610 con 0x7fd1b00b18d0 2024-09-11T22:21:00.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.501+0000 7fd1b49ab640 1 --2- 172.21.15.100:0/2555064319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1b00b18d0 0x7fd1b0147730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8007d20 tx=0x7fd1a800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:00.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.501+0000 7fd1acff9640 1 -- 172.21.15.100:0/2555064319 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a8014420 con 0x7fd1b00b18d0 2024-09-11T22:21:00.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.501+0000 7fd1acff9640 1 -- 172.21.15.100:0/2555064319 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1a8019070 con 0x7fd1b00b18d0 2024-09-11T22:21:00.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.501+0000 7fd1b640e640 1 -- 172.21.15.100:0/2555064319 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1b015ac10 con 0x7fd1b00b18d0 2024-09-11T22:21:00.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.501+0000 7fd1acff9640 1 -- 172.21.15.100:0/2555064319 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a8014820 con 0x7fd1b00b18d0 2024-09-11T22:21:00.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.501+0000 7fd1b640e640 1 -- 172.21.15.100:0/2555064319 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1b014f850 con 0x7fd1b00b18d0 2024-09-11T22:21:00.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.503+0000 7fd1b640e640 1 -- 172.21.15.100:0/2555064319 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1b0146ee0 con 0x7fd1b00b18d0 2024-09-11T22:21:00.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.503+0000 7fd1acff9640 1 -- 172.21.15.100:0/2555064319 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd1a80149c0 con 0x7fd1b00b18d0 2024-09-11T22:21:00.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.503+0000 7fd1acff9640 1 --2- 172.21.15.100:0/2555064319 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd19c06be30 0x7fd19c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:00.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.503+0000 7fd1acff9640 1 -- 172.21.15.100:0/2555064319 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd1a808b7f0 con 0x7fd1b00b18d0 2024-09-11T22:21:00.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.503+0000 7fd1affff640 1 --2- 172.21.15.100:0/2555064319 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd19c06be30 0x7fd19c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:00.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.504+0000 7fd1affff640 1 --2- 172.21.15.100:0/2555064319 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd19c06be30 0x7fd19c06e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0006fd0 tx=0x7fd1a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:00.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.512+0000 7fd1acff9640 1 -- 172.21.15.100:0/2555064319 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd1a80598a0 con 0x7fd1b00b18d0 2024-09-11T22:21:00.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.687+0000 7fd1b640e640 1 -- 172.21.15.100:0/2555064319 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd1b015c720 con 0x7fd1b00b18d0 2024-09-11T22:21:00.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.689+0000 7fd1acff9640 1 -- 172.21.15.100:0/2555064319 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18646 (secure 0 0 0) 0x7fd1a805dba0 con 0x7fd1b00b18d0 2024-09-11T22:21:00.689 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:21:00.690 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":26,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","created":"2024-09-11T22:19:56.198855+0000","modified":"2024-09-11T22:20:24.213024+0000","last_up_change":"2024-09-11T22:20:07.328863+0000","last_in_change":"2024-09-11T22:19:58.294227+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:20:08.333538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:20:16.995279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:20:18.147950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:20:21.873694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5de0ba54-34c5-4343-b19a-1f675efc49c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6809","nonce":2008454847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6811","nonce":2008454847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6815","nonce":2008454847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6813","nonce":2008454847}]},"public_addr":"172.21.15.100:6809/2008454847","cluster_addr":"172.21.15.100:6811/2008454847","heartbeat_back_addr":"172.21.15.100:6815/2008454847","heartbeat_front_addr":"172.21.15.100:6813/2008454847","state":["exists","up"]},{"osd":1,"uuid":"5a1f6456-6604-4b41-b9b9-52ae8d6616ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6801","nonce":1802107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6803","nonce":1802107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6807","nonce":1802107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6805","nonce":1802107101}]},"public_addr":"172.21.15.100:6801/1802107101","cluster_addr":"172.21.15.100:6803/1802107101","heartbeat_back_addr":"172.21.15.100:6807/1802107101","heartbeat_front_addr":"172.21.15.100:6805/1802107101","state":["exists","up"]},{"osd":2,"uuid":"a604cb26-7b0f-402d-b6ac-3652884b4b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6817","nonce":644491349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6819","nonce":644491349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6823","nonce":644491349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6821","nonce":644491349}]},"public_addr":"172.21.15.100:6817/644491349","cluster_addr":"172.21.15.100:6819/644491349","heartbeat_back_addr":"172.21.15.100:6823/644491349","heartbeat_front_addr":"172.21.15.100:6821/644491349","state":["exists","up"]},{"osd":3,"uuid":"73dc2cbb-70ff-4d12-ba2f-8778a49892f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6825","nonce":2519160882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6827","nonce":2519160882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6831","nonce":2519160882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6829","nonce":2519160882}]},"public_addr":"172.21.15.100:6825/2519160882","cluster_addr":"172.21.15.100:6827/2519160882","heartbeat_back_addr":"172.21.15.100:6831/2519160882","heartbeat_front_addr":"172.21.15.100:6829/2519160882","state":["exists","up"]},{"osd":4,"uuid":"07960648-04df-4aec-a72c-c29e28b74bcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6817","nonce":736010951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6819","nonce":736010951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6823","nonce":736010951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6821","nonce":736010951}]},"public_addr":"172.21.15.167:6817/736010951","cluster_addr":"172.21.15.167:6819/736010951","heartbeat_back_addr":"172.21.15.167:6823/736010951","heartbeat_front_addr":"172.21.15.167:6821/736010951","state":["exists","up"]},{"osd":5,"uuid":"2b4767e6-cab7-4b45-9150-55432f5576aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6825","nonce":2479173909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6827","nonce":2479173909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6831","nonce":2479173909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6829","nonce":2479173909}]},"public_addr":"172.21.15.167:6825/2479173909","cluster_addr":"172.21.15.167:6827/2479173909","heartbeat_back_addr":"172.21.15.167:6831/2479173909","heartbeat_front_addr":"172.21.15.167:6829/2479173909","state":["exists","up"]},{"osd":6,"uuid":"4ef2c4b5-52f4-4f69-8fca-2334077ed8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6809","nonce":2825112504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6811","nonce":2825112504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6815","nonce":2825112504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6813","nonce":2825112504}]},"public_addr":"172.21.15.167:6809/2825112504","cluster_addr":"172.21.15.167:6811/2825112504","heartbeat_back_addr":"172.21.15.167:6815/2825112504","heartbeat_front_addr":"172.21.15.167:6813/2825112504","state":["exists","up"]},{"osd":7,"uuid":"761673d8-d6fc-4ded-a9f3-d49ab8f7c969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337015843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337015843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337015843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337015843}]},"public_addr":"172.21.15.167:6801/1337015843","cluster_addr":"172.21.15.167:6803/1337015843","heartbeat_back_addr":"172.21.15.167:6807/1337015843","heartbeat_front_addr":"172.21.15.167:6805/1337015843","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.833280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.080311+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.100648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.544261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.670353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.880921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.365441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.366659+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:21:00.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.690+0000 7fd1b640e640 1 -- 172.21.15.100:0/2555064319 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd19c06be30 msgr2=0x7fd19c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:00.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.690+0000 7fd1b640e640 1 --2- 172.21.15.100:0/2555064319 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd19c06be30 0x7fd19c06e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0006fd0 tx=0x7fd1a0008040 comp rx=0 tx=0).stop 2024-09-11T22:21:00.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.690+0000 7fd1b640e640 1 -- 172.21.15.100:0/2555064319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1b00b18d0 msgr2=0x7fd1b0147730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:00.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.690+0000 7fd1b640e640 1 --2- 172.21.15.100:0/2555064319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1b00b18d0 0x7fd1b0147730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8007d20 tx=0x7fd1a800e4b0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.691+0000 7fd1b640e640 1 -- 172.21.15.100:0/2555064319 shutdown_connections 2024-09-11T22:21:00.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.691+0000 7fd1b640e640 1 --2- 172.21.15.100:0/2555064319 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd19c06be30 0x7fd19c06e2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.691+0000 7fd1b640e640 1 --2- 172.21.15.100:0/2555064319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1b00b18d0 0x7fd1b0147730 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.691+0000 7fd1b640e640 1 --2- 172.21.15.100:0/2555064319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd1b006c260 0x7fd1b01471f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.691+0000 7fd1b640e640 1 --2- 172.21.15.100:0/2555064319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd1b006be80 0x7fd1b00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.691+0000 7fd1b640e640 1 -- 172.21.15.100:0/2555064319 >> 172.21.15.100:0/2555064319 conn(0x7fd1b00cbf70 msgr2=0x7fd1b00cc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:00.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.691+0000 7fd1b640e640 1 -- 172.21.15.100:0/2555064319 shutdown_connections 2024-09-11T22:21:00.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.691+0000 7fd1b640e640 1 -- 172.21.15.100:0/2555064319 wait complete. 2024-09-11T22:21:00.702 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T22:20:08.333538+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-11T22:20:16.995279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-11T22:20:18.147950+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-11T22:20:21.873694+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-11T22:21:00.703 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T22:21:00.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.806+0000 7ff129082640 1 Processor -- start 2024-09-11T22:21:00.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.806+0000 7ff129082640 1 -- start start 2024-09-11T22:21:00.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.807+0000 7ff129082640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff12406c3a0 0x7ff124073880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:00.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.807+0000 7ff129082640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1240687e0 con 0x7ff1240b20e0 2024-09-11T22:21:00.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.807+0000 7ff129082640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff12406c890 con 0x7ff12406cee0 2024-09-11T22:21:00.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.807+0000 7ff129082640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff1240c41a0 con 0x7ff12406c3a0 2024-09-11T22:21:00.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.807+0000 7ff122d9d640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff1240b20e0 0x7ff124072cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49192/0 (socket says 172.21.15.100:49192) 2024-09-11T22:21:00.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.807+0000 7ff122d9d640 1 -- 172.21.15.100:0/1677658312 learned_addr learned my addr 172.21.15.100:0/1677658312 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:21:00.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.807+0000 7ff121d9b640 1 -- 172.21.15.100:0/1677658312 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4100501102 0 0) 0x7ff1240687e0 con 0x7ff1240b20e0 2024-09-11T22:21:00.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.807+0000 7ff121d9b640 1 -- 172.21.15.100:0/1677658312 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff10c003520 con 0x7ff1240b20e0 2024-09-11T22:21:00.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.807+0000 7ff12259c640 1 --2- 172.21.15.100:0/1677658312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff12406c3a0 0x7ff124073880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:00.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.807+0000 7ff121d9b640 1 -- 172.21.15.100:0/1677658312 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3675721422 0 0) 0x7ff10c003520 con 0x7ff1240b20e0 2024-09-11T22:21:00.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.807+0000 7ff121d9b640 1 -- 172.21.15.100:0/1677658312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff12406c3a0 msgr2=0x7ff124073880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:00.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.807+0000 7ff121d9b640 1 --2- 172.21.15.100:0/1677658312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff12406c3a0 0x7ff124073880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.808+0000 7ff121d9b640 1 -- 172.21.15.100:0/1677658312 >> v1:172.21.15.167:6789/0 conn(0x7ff12406cee0 legacy=0x7ff124165360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:00.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.808+0000 7ff121d9b640 1 -- 172.21.15.100:0/1677658312 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1240c7b80 con 0x7ff1240b20e0 2024-09-11T22:21:00.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.808+0000 7ff121d9b640 1 -- 172.21.15.100:0/1677658312 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7ff11c001690 con 0x7ff1240b20e0 2024-09-11T22:21:00.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.808+0000 7ff121d9b640 1 -- 172.21.15.100:0/1677658312 >> v1:172.21.15.100:6789/0 conn(0x7ff1240b20e0 legacy=0x7ff124072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:00.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.808+0000 7ff121d9b640 1 --2- 172.21.15.100:0/1677658312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff12406c3a0 0x7ff10c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:00.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.808+0000 7ff121d9b640 1 --2- 172.21.15.100:0/1677658312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff10c003f60 0x7ff10c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:00.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.808+0000 7ff121d9b640 1 --2- 172.21.15.100:0/1677658312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff10c004d40 0x7ff10c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:00.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.808+0000 7ff121d9b640 1 -- 172.21.15.100:0/1677658312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff10c00bb00 con 0x7ff10c003f60 2024-09-11T22:21:00.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.808+0000 7ff121d9b640 1 -- 172.21.15.100:0/1677658312 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff10c00bcb0 con 0x7ff10c004d40 2024-09-11T22:21:00.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.808+0000 7ff121d9b640 1 -- 172.21.15.100:0/1677658312 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff10c00beb0 con 0x7ff12406c3a0 2024-09-11T22:21:00.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.808+0000 7ff12259c640 1 --2- 172.21.15.100:0/1677658312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff10c003f60 0x7ff10c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:00.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.808+0000 7ff122d9d640 1 --2- 172.21.15.100:0/1677658312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff12406c3a0 0x7ff10c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:00.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.808+0000 7ff12359e640 1 --2- 172.21.15.100:0/1677658312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff10c004d40 0x7ff10c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:00.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.808+0000 7ff12259c640 1 -- 172.21.15.100:0/1677658312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff12406c3a0 msgr2=0x7ff10c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:00.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.808+0000 7ff12259c640 1 --2- 172.21.15.100:0/1677658312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff12406c3a0 0x7ff10c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.808+0000 7ff12259c640 1 -- 172.21.15.100:0/1677658312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff10c004d40 msgr2=0x7ff10c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:00.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.808+0000 7ff12259c640 1 --2- 172.21.15.100:0/1677658312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff10c004d40 0x7ff10c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.808+0000 7ff12259c640 1 -- 172.21.15.100:0/1677658312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff10c003520 con 0x7ff10c003f60 2024-09-11T22:21:00.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.809+0000 7ff12259c640 1 --2- 172.21.15.100:0/1677658312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff10c003f60 0x7ff10c004800 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff118009f90 tx=0x7ff10c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56957beb05a07257 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:00.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.809+0000 7ff121d9b640 1 -- 172.21.15.100:0/1677658312 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118009c10 con 0x7ff10c003f60 2024-09-11T22:21:00.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.809+0000 7ff121d9b640 1 -- 172.21.15.100:0/1677658312 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff118036070 con 0x7ff10c003f60 2024-09-11T22:21:00.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.809+0000 7ff121d9b640 1 -- 172.21.15.100:0/1677658312 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118031810 con 0x7ff10c003f60 2024-09-11T22:21:00.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.810+0000 7ff129082640 1 -- 172.21.15.100:0/1677658312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff10c003f60 msgr2=0x7ff10c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:00.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.810+0000 7ff129082640 1 --2- 172.21.15.100:0/1677658312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff10c003f60 0x7ff10c004800 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff118009f90 tx=0x7ff10c005830 comp rx=0 tx=0).stop 2024-09-11T22:21:00.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.810+0000 7ff12359e640 1 -- 172.21.15.100:0/1677658312 reap_dead start 2024-09-11T22:21:00.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.810+0000 7ff129082640 1 -- 172.21.15.100:0/1677658312 shutdown_connections 2024-09-11T22:21:00.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.810+0000 7ff129082640 1 -- 172.21.15.100:0/1677658312 >> 172.21.15.100:0/1677658312 conn(0x7ff12406ee80 msgr2=0x7ff124070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:00.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.810+0000 7ff129082640 1 -- 172.21.15.100:0/1677658312 shutdown_connections 2024-09-11T22:21:00.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.810+0000 7ff129082640 1 -- 172.21.15.100:0/1677658312 wait complete. 2024-09-11T22:21:00.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.811+0000 7ff129082640 1 Processor -- start 2024-09-11T22:21:00.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.811+0000 7ff129082640 1 -- start start 2024-09-11T22:21:00.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.812+0000 7ff129082640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff10c003f60 0x7ff1240c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:00.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.812+0000 7ff129082640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff124158720 0x7ff1240c4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:00.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.812+0000 7ff129082640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1240c5f50 0x7ff1240c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:00.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.812+0000 7ff129082640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff1240b24c0 con 0x7ff124158720 2024-09-11T22:21:00.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.812+0000 7ff129082640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff124072860 con 0x7ff10c003f60 2024-09-11T22:21:00.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.812+0000 7ff129082640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff1240c8140 con 0x7ff1240c5f50 2024-09-11T22:21:00.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.812+0000 7ff12259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff124158720 0x7ff1240c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:00.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.812+0000 7ff12259c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff124158720 0x7ff1240c4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39586/0 (socket says 172.21.15.100:39586) 2024-09-11T22:21:00.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.812+0000 7ff12259c640 1 -- 172.21.15.100:0/1848392727 learned_addr learned my addr 172.21.15.100:0/1848392727 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:00.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.812+0000 7ff122d9d640 1 --2- 172.21.15.100:0/1848392727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff10c003f60 0x7ff1240c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:00.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.812+0000 7ff12359e640 1 --2- 172.21.15.100:0/1848392727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1240c5f50 0x7ff1240c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:00.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.813+0000 7ff12259c640 1 -- 172.21.15.100:0/1848392727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1240c5f50 msgr2=0x7ff1240c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:00.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.813+0000 7ff12259c640 1 --2- 172.21.15.100:0/1848392727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1240c5f50 0x7ff1240c63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.813+0000 7ff12259c640 1 -- 172.21.15.100:0/1848392727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff10c003f60 msgr2=0x7ff1240c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:00.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.813+0000 7ff12259c640 1 --2- 172.21.15.100:0/1848392727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff10c003f60 0x7ff1240c4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.813+0000 7ff12259c640 1 -- 172.21.15.100:0/1848392727 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1241e44b0 con 0x7ff124158720 2024-09-11T22:21:00.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.813+0000 7ff12259c640 1 --2- 172.21.15.100:0/1848392727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff124158720 0x7ff1240c4840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff118033040 tx=0x7ff118009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:00.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.813+0000 7ff10b7fe640 1 -- 172.21.15.100:0/1848392727 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118009c10 con 0x7ff124158720 2024-09-11T22:21:00.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.813+0000 7ff10b7fe640 1 -- 172.21.15.100:0/1848392727 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff118045650 con 0x7ff124158720 2024-09-11T22:21:00.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.813+0000 7ff10b7fe640 1 -- 172.21.15.100:0/1848392727 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff118045a40 con 0x7ff124158720 2024-09-11T22:21:00.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.813+0000 7ff129082640 1 -- 172.21.15.100:0/1848392727 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1241f0d00 con 0x7ff124158720 2024-09-11T22:21:00.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.813+0000 7ff129082640 1 -- 172.21.15.100:0/1848392727 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1240c3b00 con 0x7ff124158720 2024-09-11T22:21:00.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.814+0000 7ff129082640 1 -- 172.21.15.100:0/1848392727 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1240c9710 con 0x7ff124158720 2024-09-11T22:21:00.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.815+0000 7ff10b7fe640 1 -- 172.21.15.100:0/1848392727 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff118005d10 con 0x7ff124158720 2024-09-11T22:21:00.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.815+0000 7ff10b7fe640 1 --2- 172.21.15.100:0/1848392727 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff11006be30 0x7ff11006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:00.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.815+0000 7ff10b7fe640 1 -- 172.21.15.100:0/1848392727 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff1180ac880 con 0x7ff124158720 2024-09-11T22:21:00.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.815+0000 7ff122d9d640 1 --2- 172.21.15.100:0/1848392727 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff11006be30 0x7ff11006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:00.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.816+0000 7ff122d9d640 1 --2- 172.21.15.100:0/1848392727 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff11006be30 0x7ff11006e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff11c001050 tx=0x7ff11c000f80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:00.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.819+0000 7ff10b7fe640 1 -- 172.21.15.100:0/1848392727 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff11802e050 con 0x7ff124158720 2024-09-11T22:21:00.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.989+0000 7ff129082640 1 -- 172.21.15.100:0/1848392727 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff12406ccc0 con 0x7ff124158720 2024-09-11T22:21:00.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.989+0000 7ff10b7fe640 1 -- 172.21.15.100:0/1848392727 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7ff11807a9f0 con 0x7ff124158720 2024-09-11T22:21:00.990 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-09-11T22:21:00.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.991+0000 7ff129082640 1 -- 172.21.15.100:0/1848392727 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff11006be30 msgr2=0x7ff11006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:00.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.991+0000 7ff129082640 1 --2- 172.21.15.100:0/1848392727 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff11006be30 0x7ff11006e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff11c001050 tx=0x7ff11c000f80 comp rx=0 tx=0).stop 2024-09-11T22:21:00.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.991+0000 7ff129082640 1 -- 172.21.15.100:0/1848392727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff124158720 msgr2=0x7ff1240c4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:00.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.991+0000 7ff129082640 1 --2- 172.21.15.100:0/1848392727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff124158720 0x7ff1240c4840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff118033040 tx=0x7ff118009750 comp rx=0 tx=0).stop 2024-09-11T22:21:00.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.991+0000 7ff129082640 1 -- 172.21.15.100:0/1848392727 shutdown_connections 2024-09-11T22:21:00.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.991+0000 7ff129082640 1 --2- 172.21.15.100:0/1848392727 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff11006be30 0x7ff11006e2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.991+0000 7ff129082640 1 --2- 172.21.15.100:0/1848392727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1240c5f50 0x7ff1240c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.991+0000 7ff129082640 1 --2- 172.21.15.100:0/1848392727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff124158720 0x7ff1240c4840 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.991+0000 7ff129082640 1 --2- 172.21.15.100:0/1848392727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff10c003f60 0x7ff1240c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:00.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.991+0000 7ff129082640 1 -- 172.21.15.100:0/1848392727 >> 172.21.15.100:0/1848392727 conn(0x7ff12406ee80 msgr2=0x7ff1240c31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:00.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.992+0000 7ff129082640 1 -- 172.21.15.100:0/1848392727 shutdown_connections 2024-09-11T22:21:00.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:00.992+0000 7ff129082640 1 -- 172.21.15.100:0/1848392727 wait complete. 2024-09-11T22:21:01.003 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-11T22:21:01.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.112+0000 7f04289f8640 1 Processor -- start 2024-09-11T22:21:01.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.112+0000 7f04289f8640 1 -- start start 2024-09-11T22:21:01.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.113+0000 7f04289f8640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0424158210 0x7f04240707a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.113+0000 7f04289f8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f042415e100 0x7f04240ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.113+0000 7f04289f8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04241585f0 con 0x7f04240b0ca0 2024-09-11T22:21:01.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.113+0000 7f04289f8640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f0424070310 con 0x7f0424158210 2024-09-11T22:21:01.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.113+0000 7f04289f8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f04240c9430 con 0x7f042415e100 2024-09-11T22:21:01.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.113+0000 7f042259c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0424158210 0x7f04240707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.113+0000 7f042259c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0424158210 0x7f04240707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39602/0 (socket says 172.21.15.100:39602) 2024-09-11T22:21:01.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.113+0000 7f042259c640 1 -- 172.21.15.100:0/3387376070 learned_addr learned my addr 172.21.15.100:0/3387376070 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:01.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.113+0000 7f0422d9d640 1 --2- 172.21.15.100:0/3387376070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f042415e100 0x7f04240ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.113+0000 7f042259c640 1 -- 172.21.15.100:0/3387376070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f042415e100 msgr2=0x7f04240ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:01.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.113+0000 7f042259c640 1 --2- 172.21.15.100:0/3387376070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f042415e100 0x7f04240ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.113+0000 7f042259c640 1 -- 172.21.15.100:0/3387376070 >> v1:172.21.15.167:6789/0 conn(0x7f04240b0ca0 legacy=0x7f042406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:01.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.113+0000 7f042259c640 1 -- 172.21.15.100:0/3387376070 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04240c96d0 con 0x7f0424158210 2024-09-11T22:21:01.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.114+0000 7f042259c640 1 --2- 172.21.15.100:0/3387376070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0424158210 0x7f04240707a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0414009870 tx=0x7f041402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d896d0bdc87096b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:01.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.114+0000 7f042159a640 1 -- 172.21.15.100:0/3387376070 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0414037070 con 0x7f0424158210 2024-09-11T22:21:01.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.114+0000 7f042159a640 1 -- 172.21.15.100:0/3387376070 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f041402ae50 con 0x7f0424158210 2024-09-11T22:21:01.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.114+0000 7f042159a640 1 -- 172.21.15.100:0/3387376070 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0414032860 con 0x7f0424158210 2024-09-11T22:21:01.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.115+0000 7f04289f8640 1 -- 172.21.15.100:0/3387376070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0424158210 msgr2=0x7f04240707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:01.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.115+0000 7f04289f8640 1 --2- 172.21.15.100:0/3387376070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0424158210 0x7f04240707a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0414009870 tx=0x7f041402a300 comp rx=0 tx=0).stop 2024-09-11T22:21:01.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.115+0000 7f04289f8640 1 -- 172.21.15.100:0/3387376070 shutdown_connections 2024-09-11T22:21:01.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.115+0000 7f04289f8640 1 --2- 172.21.15.100:0/3387376070 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f042415e100 0x7f04240ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.115+0000 7f04289f8640 1 --2- 172.21.15.100:0/3387376070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0424158210 0x7f04240707a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.115+0000 7f04289f8640 1 -- 172.21.15.100:0/3387376070 >> 172.21.15.100:0/3387376070 conn(0x7f042406de20 msgr2=0x7f042406e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:01.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.115+0000 7f04289f8640 1 -- 172.21.15.100:0/3387376070 shutdown_connections 2024-09-11T22:21:01.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.115+0000 7f04289f8640 1 -- 172.21.15.100:0/3387376070 wait complete. 2024-09-11T22:21:01.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.116+0000 7f04289f8640 1 Processor -- start 2024-09-11T22:21:01.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.116+0000 7f04289f8640 1 -- start start 2024-09-11T22:21:01.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.117+0000 7f04289f8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f04240b0ca0 0x7f0424154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.117+0000 7f04289f8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0424158210 0x7f04241f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.117+0000 7f04289f8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f042415e100 0x7f04240ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.117+0000 7f04289f8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f042406ffa0 con 0x7f0424158210 2024-09-11T22:21:01.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.117+0000 7f04289f8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f04240c9c90 con 0x7f042415e100 2024-09-11T22:21:01.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.117+0000 7f04289f8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f042406db40 con 0x7f04240b0ca0 2024-09-11T22:21:01.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.117+0000 7f0421d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0424158210 0x7f04241f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.117+0000 7f0421d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0424158210 0x7f04241f0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39606/0 (socket says 172.21.15.100:39606) 2024-09-11T22:21:01.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.117+0000 7f0421d9b640 1 -- 172.21.15.100:0/3127674391 learned_addr learned my addr 172.21.15.100:0/3127674391 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:01.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.117+0000 7f042259c640 1 --2- 172.21.15.100:0/3127674391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f04240b0ca0 0x7f0424154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.117+0000 7f0422d9d640 1 --2- 172.21.15.100:0/3127674391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f042415e100 0x7f04240ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.118+0000 7f0421d9b640 1 -- 172.21.15.100:0/3127674391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f04240b0ca0 msgr2=0x7f0424154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:01.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.118+0000 7f0421d9b640 1 --2- 172.21.15.100:0/3127674391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f04240b0ca0 0x7f0424154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.118+0000 7f0421d9b640 1 -- 172.21.15.100:0/3127674391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f042415e100 msgr2=0x7f04240ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:01.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.118+0000 7f0421d9b640 1 --2- 172.21.15.100:0/3127674391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f042415e100 0x7f04240ccb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.118+0000 7f0421d9b640 1 -- 172.21.15.100:0/3127674391 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04240b2f90 con 0x7f0424158210 2024-09-11T22:21:01.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.118+0000 7f0421d9b640 1 --2- 172.21.15.100:0/3127674391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0424158210 0x7f04241f0d60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f040c00c400 tx=0x7f040c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:01.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.118+0000 7f041affd640 1 -- 172.21.15.100:0/3127674391 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040c0052d0 con 0x7f0424158210 2024-09-11T22:21:01.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.118+0000 7f041affd640 1 -- 172.21.15.100:0/3127674391 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f040c005490 con 0x7f0424158210 2024-09-11T22:21:01.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.118+0000 7f04289f8640 1 -- 172.21.15.100:0/3127674391 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04240b2890 con 0x7f0424158210 2024-09-11T22:21:01.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.118+0000 7f041affd640 1 -- 172.21.15.100:0/3127674391 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040c007260 con 0x7f0424158210 2024-09-11T22:21:01.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.118+0000 7f04289f8640 1 -- 172.21.15.100:0/3127674391 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04241f0840 con 0x7f0424158210 2024-09-11T22:21:01.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.119+0000 7f04289f8640 1 -- 172.21.15.100:0/3127674391 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04240cc900 con 0x7f0424158210 2024-09-11T22:21:01.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.120+0000 7f041affd640 1 -- 172.21.15.100:0/3127674391 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f040c007400 con 0x7f0424158210 2024-09-11T22:21:01.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.120+0000 7f041affd640 1 --2- 172.21.15.100:0/3127674391 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f040406be30 0x7f040406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.121+0000 7f042259c640 1 --2- 172.21.15.100:0/3127674391 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f040406be30 0x7f040406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.121+0000 7f041affd640 1 -- 172.21.15.100:0/3127674391 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f040c08a680 con 0x7f0424158210 2024-09-11T22:21:01.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.121+0000 7f042259c640 1 --2- 172.21.15.100:0/3127674391 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f040406be30 0x7f040406e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0414034000 tx=0x7f041402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:01.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.125+0000 7f041affd640 1 -- 172.21.15.100:0/3127674391 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f040c058650 con 0x7f0424158210 2024-09-11T22:21:01.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.296+0000 7f04289f8640 1 -- 172.21.15.100:0/3127674391 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0424070da0 con 0x7f0424158210 2024-09-11T22:21:01.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.297+0000 7f041affd640 1 -- 172.21.15.100:0/3127674391 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f040c05c950 con 0x7f0424158210 2024-09-11T22:21:01.298 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-09-11T22:21:01.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.299+0000 7f04289f8640 1 -- 172.21.15.100:0/3127674391 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f040406be30 msgr2=0x7f040406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:01.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.299+0000 7f04289f8640 1 --2- 172.21.15.100:0/3127674391 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f040406be30 0x7f040406e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0414034000 tx=0x7f041402e000 comp rx=0 tx=0).stop 2024-09-11T22:21:01.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.299+0000 7f04289f8640 1 -- 172.21.15.100:0/3127674391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0424158210 msgr2=0x7f04241f0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:01.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.299+0000 7f04289f8640 1 --2- 172.21.15.100:0/3127674391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0424158210 0x7f04241f0d60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f040c00c400 tx=0x7f040c00c8c0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.299+0000 7f04289f8640 1 -- 172.21.15.100:0/3127674391 shutdown_connections 2024-09-11T22:21:01.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.299+0000 7f04289f8640 1 --2- 172.21.15.100:0/3127674391 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f040406be30 0x7f040406e2f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.299+0000 7f04289f8640 1 --2- 172.21.15.100:0/3127674391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f042415e100 0x7f04240ccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.299+0000 7f04289f8640 1 --2- 172.21.15.100:0/3127674391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0424158210 0x7f04241f0d60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.299+0000 7f04289f8640 1 --2- 172.21.15.100:0/3127674391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f04240b0ca0 0x7f0424154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.299+0000 7f04289f8640 1 -- 172.21.15.100:0/3127674391 >> 172.21.15.100:0/3127674391 conn(0x7f042406de20 msgr2=0x7f04240c4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:01.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.299+0000 7f04289f8640 1 -- 172.21.15.100:0/3127674391 shutdown_connections 2024-09-11T22:21:01.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.299+0000 7f04289f8640 1 -- 172.21.15.100:0/3127674391 wait complete. 2024-09-11T22:21:01.310 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-11T22:21:01.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.412+0000 7f6bf2a5a640 1 Processor -- start 2024-09-11T22:21:01.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.412+0000 7f6bf2a5a640 1 -- start start 2024-09-11T22:21:01.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.413+0000 7f6bf2a5a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6bec154c00 0x7f6bec0cc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.413+0000 7f6bf2a5a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6bec15afb0 0x7f6bec15b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.413+0000 7f6bf2a5a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bec15dfa0 con 0x7f6bec0c5a90 2024-09-11T22:21:01.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.413+0000 7f6bf2a5a640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f6bec15ab20 con 0x7f6bec154c00 2024-09-11T22:21:01.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.413+0000 7f6bf2a5a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f6bec15b960 con 0x7f6bec15afb0 2024-09-11T22:21:01.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.413+0000 7f6bebfff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6bec154c00 0x7f6bec0cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.413+0000 7f6bebfff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6bec154c00 0x7f6bec0cc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39608/0 (socket says 172.21.15.100:39608) 2024-09-11T22:21:01.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.413+0000 7f6bebfff640 1 -- 172.21.15.100:0/4079297517 learned_addr learned my addr 172.21.15.100:0/4079297517 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:01.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.413+0000 7f6bf0ff7640 1 --2- 172.21.15.100:0/4079297517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6bec15afb0 0x7f6bec15b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.413+0000 7f6bebfff640 1 -- 172.21.15.100:0/4079297517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6bec15afb0 msgr2=0x7f6bec15b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:01.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.413+0000 7f6bebfff640 1 --2- 172.21.15.100:0/4079297517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6bec15afb0 0x7f6bec15b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.413+0000 7f6bebfff640 1 -- 172.21.15.100:0/4079297517 >> v1:172.21.15.167:6789/0 conn(0x7f6bec0c5a90 legacy=0x7f6bec0d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:01.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.413+0000 7f6bebfff640 1 -- 172.21.15.100:0/4079297517 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bec15e220 con 0x7f6bec154c00 2024-09-11T22:21:01.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.413+0000 7f6bf0ff7640 1 --2- 172.21.15.100:0/4079297517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6bec15afb0 0x7f6bec15b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:01.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.414+0000 7f6bebfff640 1 --2- 172.21.15.100:0/4079297517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bec154c00 0x7f6bec0cc700 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0cde40 tx=0x7f6bdc02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7b7cf900a7f915 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:01.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.414+0000 7f6beaffd640 1 -- 172.21.15.100:0/4079297517 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc004030 con 0x7f6bec154c00 2024-09-11T22:21:01.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.414+0000 7f6beaffd640 1 -- 172.21.15.100:0/4079297517 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bdc0041d0 con 0x7f6bec154c00 2024-09-11T22:21:01.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.414+0000 7f6beaffd640 1 -- 172.21.15.100:0/4079297517 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc003610 con 0x7f6bec154c00 2024-09-11T22:21:01.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.414+0000 7f6bf2a5a640 1 -- 172.21.15.100:0/4079297517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bec154c00 msgr2=0x7f6bec0cc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:01.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.414+0000 7f6bf2a5a640 1 --2- 172.21.15.100:0/4079297517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bec154c00 0x7f6bec0cc700 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0cde40 tx=0x7f6bdc02a250 comp rx=0 tx=0).stop 2024-09-11T22:21:01.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.414+0000 7f6bf2a5a640 1 -- 172.21.15.100:0/4079297517 shutdown_connections 2024-09-11T22:21:01.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.414+0000 7f6bf2a5a640 1 --2- 172.21.15.100:0/4079297517 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6bec15afb0 0x7f6bec15b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.414+0000 7f6bf2a5a640 1 --2- 172.21.15.100:0/4079297517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bec154c00 0x7f6bec0cc700 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.414+0000 7f6bf2a5a640 1 -- 172.21.15.100:0/4079297517 >> 172.21.15.100:0/4079297517 conn(0x7f6bec06cf50 msgr2=0x7f6bec06d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:01.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.415+0000 7f6bf2a5a640 1 -- 172.21.15.100:0/4079297517 shutdown_connections 2024-09-11T22:21:01.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.415+0000 7f6bf2a5a640 1 -- 172.21.15.100:0/4079297517 wait complete. 2024-09-11T22:21:01.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.416+0000 7f6bf2a5a640 1 Processor -- start 2024-09-11T22:21:01.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.416+0000 7f6bf2a5a640 1 -- start start 2024-09-11T22:21:01.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.416+0000 7f6bf2a5a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6bec0c5a90 0x7f6bec1f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.416+0000 7f6bf2a5a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bec154c00 0x7f6bec15d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.416+0000 7f6bf2a5a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bec15afb0 0x7f6bec14a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.416+0000 7f6bf2a5a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6bec15eac0 con 0x7f6bec154c00 2024-09-11T22:21:01.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.416+0000 7f6bf2a5a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6bec15e7e0 con 0x7f6bec15afb0 2024-09-11T22:21:01.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.416+0000 7f6bf2a5a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f6bec15eda0 con 0x7f6bec0c5a90 2024-09-11T22:21:01.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.417+0000 7f6beb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bec154c00 0x7f6bec15d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.417+0000 7f6beb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bec154c00 0x7f6bec15d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39616/0 (socket says 172.21.15.100:39616) 2024-09-11T22:21:01.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.417+0000 7f6beb7fe640 1 -- 172.21.15.100:0/1041013077 learned_addr learned my addr 172.21.15.100:0/1041013077 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:01.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.417+0000 7f6bebfff640 1 --2- 172.21.15.100:0/1041013077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6bec0c5a90 0x7f6bec1f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.417+0000 7f6bf0ff7640 1 --2- 172.21.15.100:0/1041013077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bec15afb0 0x7f6bec14a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.417+0000 7f6beb7fe640 1 -- 172.21.15.100:0/1041013077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6bec0c5a90 msgr2=0x7f6bec1f3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:01.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.417+0000 7f6beb7fe640 1 --2- 172.21.15.100:0/1041013077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6bec0c5a90 0x7f6bec1f3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.417+0000 7f6beb7fe640 1 -- 172.21.15.100:0/1041013077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bec15afb0 msgr2=0x7f6bec14a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:01.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.417+0000 7f6beb7fe640 1 --2- 172.21.15.100:0/1041013077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bec15afb0 0x7f6bec14a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.417+0000 7f6beb7fe640 1 -- 172.21.15.100:0/1041013077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bec14dc70 con 0x7f6bec154c00 2024-09-11T22:21:01.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.417+0000 7f6beb7fe640 1 --2- 172.21.15.100:0/1041013077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bec154c00 0x7f6bec15d530 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6be000c430 tx=0x7f6be000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:01.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.417+0000 7f6be8ff9640 1 -- 172.21.15.100:0/1041013077 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be0011790 con 0x7f6bec154c00 2024-09-11T22:21:01.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.417+0000 7f6be8ff9640 1 -- 172.21.15.100:0/1041013077 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be0017070 con 0x7f6bec154c00 2024-09-11T22:21:01.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.417+0000 7f6bf2a5a640 1 -- 172.21.15.100:0/1041013077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bec155a60 con 0x7f6bec154c00 2024-09-11T22:21:01.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.417+0000 7f6be8ff9640 1 -- 172.21.15.100:0/1041013077 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be0011bb0 con 0x7f6bec154c00 2024-09-11T22:21:01.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.417+0000 7f6bf2a5a640 1 -- 172.21.15.100:0/1041013077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bec156020 con 0x7f6bec154c00 2024-09-11T22:21:01.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.418+0000 7f6bf2a5a640 1 -- 172.21.15.100:0/1041013077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bec154fe0 con 0x7f6bec154c00 2024-09-11T22:21:01.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.419+0000 7f6be8ff9640 1 -- 172.21.15.100:0/1041013077 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6be001c460 con 0x7f6bec154c00 2024-09-11T22:21:01.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.419+0000 7f6be8ff9640 1 --2- 172.21.15.100:0/1041013077 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6bd806be30 0x7f6bd806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.419+0000 7f6be8ff9640 1 -- 172.21.15.100:0/1041013077 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f6be008b0b0 con 0x7f6bec154c00 2024-09-11T22:21:01.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.419+0000 7f6bebfff640 1 --2- 172.21.15.100:0/1041013077 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6bd806be30 0x7f6bd806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.419+0000 7f6bebfff640 1 --2- 172.21.15.100:0/1041013077 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6bd806be30 0x7f6bd806e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc033000 tx=0x7f6bdc02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:01.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.423+0000 7f6be8ff9640 1 -- 172.21.15.100:0/1041013077 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6be0059640 con 0x7f6bec154c00 2024-09-11T22:21:01.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.589+0000 7f6bf2a5a640 1 -- 172.21.15.100:0/1041013077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6bec0cbe60 con 0x7f6bec154c00 2024-09-11T22:21:01.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.590+0000 7f6be8ff9640 1 -- 172.21.15.100:0/1041013077 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f6be0058f40 con 0x7f6bec154c00 2024-09-11T22:21:01.590 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-09-11T22:21:01.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.591+0000 7f6bf2a5a640 1 -- 172.21.15.100:0/1041013077 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6bd806be30 msgr2=0x7f6bd806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:01.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.591+0000 7f6bf2a5a640 1 --2- 172.21.15.100:0/1041013077 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6bd806be30 0x7f6bd806e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc033000 tx=0x7f6bdc02e000 comp rx=0 tx=0).stop 2024-09-11T22:21:01.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.591+0000 7f6bf2a5a640 1 -- 172.21.15.100:0/1041013077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bec154c00 msgr2=0x7f6bec15d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:01.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.591+0000 7f6bf2a5a640 1 --2- 172.21.15.100:0/1041013077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bec154c00 0x7f6bec15d530 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6be000c430 tx=0x7f6be000c8f0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.591+0000 7f6bf2a5a640 1 -- 172.21.15.100:0/1041013077 shutdown_connections 2024-09-11T22:21:01.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.591+0000 7f6bf2a5a640 1 --2- 172.21.15.100:0/1041013077 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6bd806be30 0x7f6bd806e2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.591+0000 7f6bf2a5a640 1 --2- 172.21.15.100:0/1041013077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6bec15afb0 0x7f6bec14a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.592+0000 7f6bf2a5a640 1 --2- 172.21.15.100:0/1041013077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bec154c00 0x7f6bec15d530 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.592+0000 7f6bf2a5a640 1 --2- 172.21.15.100:0/1041013077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6bec0c5a90 0x7f6bec1f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.592+0000 7f6bf2a5a640 1 -- 172.21.15.100:0/1041013077 >> 172.21.15.100:0/1041013077 conn(0x7f6bec06cf50 msgr2=0x7f6bec152420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:01.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.592+0000 7f6bf2a5a640 1 -- 172.21.15.100:0/1041013077 shutdown_connections 2024-09-11T22:21:01.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.592+0000 7f6bf2a5a640 1 -- 172.21.15.100:0/1041013077 wait complete. 2024-09-11T22:21:01.603 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-11T22:21:01.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.703+0000 7f994327b640 1 Processor -- start 2024-09-11T22:21:01.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.704+0000 7f994327b640 1 -- start start 2024-09-11T22:21:01.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.704+0000 7f994327b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f993c15b2e0 0x7f993c1661f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.704+0000 7f994327b640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f993c0c6510 con 0x7f993c06ce60 2024-09-11T22:21:01.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.704+0000 7f994327b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f993c0c5470 con 0x7f993c06d240 2024-09-11T22:21:01.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.704+0000 7f994327b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f993c15b820 con 0x7f993c15b2e0 2024-09-11T22:21:01.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.705+0000 7f9941017640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f993c06ce60 0x7f993c15bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49204/0 (socket says 172.21.15.100:49204) 2024-09-11T22:21:01.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.705+0000 7f9941017640 1 -- 172.21.15.100:0/3097290082 learned_addr learned my addr 172.21.15.100:0/3097290082 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:21:01.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.705+0000 7f9933fff640 1 -- 172.21.15.100:0/3097290082 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2032662864 0 0) 0x7f993c0c6510 con 0x7f993c06ce60 2024-09-11T22:21:01.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.705+0000 7f9933fff640 1 -- 172.21.15.100:0/3097290082 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9928003520 con 0x7f993c06ce60 2024-09-11T22:21:01.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.705+0000 7f9941818640 1 --2- 172.21.15.100:0/3097290082 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f993c15b2e0 0x7f993c1661f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.705+0000 7f9933fff640 1 -- 172.21.15.100:0/3097290082 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3817655754 0 0) 0x7f9928003520 con 0x7f993c06ce60 2024-09-11T22:21:01.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.705+0000 7f9933fff640 1 -- 172.21.15.100:0/3097290082 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f993c15b2e0 msgr2=0x7f993c1661f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:01.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.705+0000 7f9933fff640 1 --2- 172.21.15.100:0/3097290082 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f993c15b2e0 0x7f993c1661f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.705+0000 7f9933fff640 1 -- 172.21.15.100:0/3097290082 >> v1:172.21.15.167:6789/0 conn(0x7f993c06d240 legacy=0x7f993c1546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:01.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.705+0000 7f9933fff640 1 -- 172.21.15.100:0/3097290082 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f993c0c5750 con 0x7f993c06ce60 2024-09-11T22:21:01.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.705+0000 7f9933fff640 1 -- 172.21.15.100:0/3097290082 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f9938001670 con 0x7f993c06ce60 2024-09-11T22:21:01.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.705+0000 7f9933fff640 1 -- 172.21.15.100:0/3097290082 >> v1:172.21.15.100:6789/0 conn(0x7f993c06ce60 legacy=0x7f993c15bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:01.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.705+0000 7f9933fff640 1 --2- 172.21.15.100:0/3097290082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99280039e0 0x7f9928003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.705+0000 7f9933fff640 1 --2- 172.21.15.100:0/3097290082 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f993c15b2e0 0x7f9928004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.705+0000 7f9933fff640 1 --2- 172.21.15.100:0/3097290082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9928004d40 0x7f99280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.705+0000 7f9933fff640 1 -- 172.21.15.100:0/3097290082 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f993c15b820 con 0x7f9928004d40 2024-09-11T22:21:01.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.705+0000 7f9933fff640 1 -- 172.21.15.100:0/3097290082 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f992800ba70 con 0x7f99280039e0 2024-09-11T22:21:01.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.705+0000 7f9933fff640 1 -- 172.21.15.100:0/3097290082 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f992800bc70 con 0x7f993c15b2e0 2024-09-11T22:21:01.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.705+0000 7f9941818640 1 --2- 172.21.15.100:0/3097290082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9928004d40 0x7f99280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.705+0000 7f9941017640 1 --2- 172.21.15.100:0/3097290082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99280039e0 0x7f9928003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.705+0000 7f9940816640 1 --2- 172.21.15.100:0/3097290082 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f993c15b2e0 0x7f9928004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.706+0000 7f9941818640 1 -- 172.21.15.100:0/3097290082 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f993c15b2e0 msgr2=0x7f9928004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:01.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.706+0000 7f9941818640 1 --2- 172.21.15.100:0/3097290082 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f993c15b2e0 0x7f9928004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.706+0000 7f9941818640 1 -- 172.21.15.100:0/3097290082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99280039e0 msgr2=0x7f9928003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:01.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.706+0000 7f9941818640 1 --2- 172.21.15.100:0/3097290082 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99280039e0 0x7f9928003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.706+0000 7f9941818640 1 -- 172.21.15.100:0/3097290082 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9928003520 con 0x7f9928004d40 2024-09-11T22:21:01.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.706+0000 7f9941818640 1 --2- 172.21.15.100:0/3097290082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9928004d40 0x7f99280051c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f993c15b750 tx=0x7f9928005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd9db07480fedf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:01.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.706+0000 7f9933fff640 1 -- 172.21.15.100:0/3097290082 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9934037070 con 0x7f9928004d40 2024-09-11T22:21:01.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.706+0000 7f9933fff640 1 -- 172.21.15.100:0/3097290082 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f993402e050 con 0x7f9928004d40 2024-09-11T22:21:01.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.706+0000 7f9933fff640 1 -- 172.21.15.100:0/3097290082 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9934009c10 con 0x7f9928004d40 2024-09-11T22:21:01.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.707+0000 7f994327b640 1 -- 172.21.15.100:0/3097290082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9928004d40 msgr2=0x7f99280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:01.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.707+0000 7f994327b640 1 --2- 172.21.15.100:0/3097290082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9928004d40 0x7f99280051c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f993c15b750 tx=0x7f9928005830 comp rx=0 tx=0).stop 2024-09-11T22:21:01.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.707+0000 7f9941818640 1 -- 172.21.15.100:0/3097290082 reap_dead start 2024-09-11T22:21:01.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.707+0000 7f994327b640 1 -- 172.21.15.100:0/3097290082 shutdown_connections 2024-09-11T22:21:01.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.707+0000 7f994327b640 1 -- 172.21.15.100:0/3097290082 >> 172.21.15.100:0/3097290082 conn(0x7f993c06bc10 msgr2=0x7f993c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:01.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.707+0000 7f994327b640 1 -- 172.21.15.100:0/3097290082 shutdown_connections 2024-09-11T22:21:01.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.707+0000 7f994327b640 1 -- 172.21.15.100:0/3097290082 wait complete. 2024-09-11T22:21:01.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.708+0000 7f994327b640 1 Processor -- start 2024-09-11T22:21:01.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.708+0000 7f994327b640 1 -- start start 2024-09-11T22:21:01.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.709+0000 7f994327b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9928004d40 0x7f993c150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.709+0000 7f994327b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f993c0cd780 0x7f993c0cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.709+0000 7f994327b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f993c151a40 0x7f993c1f37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.709+0000 7f994327b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f993c15c460 con 0x7f993c0cd780 2024-09-11T22:21:01.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.709+0000 7f994327b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f993c0c5d10 con 0x7f9928004d40 2024-09-11T22:21:01.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.709+0000 7f994327b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f993c0cb1b0 con 0x7f993c151a40 2024-09-11T22:21:01.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.709+0000 7f9940816640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f993c0cd780 0x7f993c0cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.709+0000 7f9940816640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f993c0cd780 0x7f993c0cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39630/0 (socket says 172.21.15.100:39630) 2024-09-11T22:21:01.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.709+0000 7f9940816640 1 -- 172.21.15.100:0/2162539771 learned_addr learned my addr 172.21.15.100:0/2162539771 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:01.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.709+0000 7f9941017640 1 --2- 172.21.15.100:0/2162539771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9928004d40 0x7f993c150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.709+0000 7f9941818640 1 --2- 172.21.15.100:0/2162539771 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f993c151a40 0x7f993c1f37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.709+0000 7f9940816640 1 -- 172.21.15.100:0/2162539771 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f993c151a40 msgr2=0x7f993c1f37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:01.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.709+0000 7f9940816640 1 --2- 172.21.15.100:0/2162539771 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f993c151a40 0x7f993c1f37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.709+0000 7f9940816640 1 -- 172.21.15.100:0/2162539771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9928004d40 msgr2=0x7f993c150750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:01.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.709+0000 7f9940816640 1 --2- 172.21.15.100:0/2162539771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9928004d40 0x7f993c150750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.709+0000 7f9940816640 1 -- 172.21.15.100:0/2162539771 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f993c1f02d0 con 0x7f993c0cd780 2024-09-11T22:21:01.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.709+0000 7f9940816640 1 --2- 172.21.15.100:0/2162539771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f993c0cd780 0x7f993c0cc680 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f992c00f7f0 tx=0x7f992c00fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:01.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.709+0000 7f9931ffb640 1 -- 172.21.15.100:0/2162539771 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992c0050d0 con 0x7f993c0cd780 2024-09-11T22:21:01.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.710+0000 7f9931ffb640 1 -- 172.21.15.100:0/2162539771 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f992c018070 con 0x7f993c0cd780 2024-09-11T22:21:01.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.710+0000 7f9931ffb640 1 -- 172.21.15.100:0/2162539771 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992c00d6d0 con 0x7f993c0cd780 2024-09-11T22:21:01.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.710+0000 7f994327b640 1 -- 172.21.15.100:0/2162539771 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f993c1f05b0 con 0x7f993c0cd780 2024-09-11T22:21:01.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.710+0000 7f994327b640 1 -- 172.21.15.100:0/2162539771 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f993c1f0b70 con 0x7f993c0cd780 2024-09-11T22:21:01.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.711+0000 7f994327b640 1 -- 172.21.15.100:0/2162539771 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f993c0cad20 con 0x7f993c0cd780 2024-09-11T22:21:01.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.711+0000 7f9931ffb640 1 -- 172.21.15.100:0/2162539771 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f992c00d870 con 0x7f993c0cd780 2024-09-11T22:21:01.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.712+0000 7f9931ffb640 1 --2- 172.21.15.100:0/2162539771 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f992006be30 0x7f992006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.712+0000 7f9931ffb640 1 -- 172.21.15.100:0/2162539771 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f992c08ae60 con 0x7f993c0cd780 2024-09-11T22:21:01.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.712+0000 7f9941017640 1 --2- 172.21.15.100:0/2162539771 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f992006be30 0x7f992006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.712+0000 7f9941017640 1 --2- 172.21.15.100:0/2162539771 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f992006be30 0x7f992006e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f99380011e0 tx=0x7f9938001150 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:01.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.716+0000 7f9931ffb640 1 -- 172.21.15.100:0/2162539771 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f992c059480 con 0x7f993c0cd780 2024-09-11T22:21:01.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.882+0000 7f994327b640 1 -- 172.21.15.100:0/2162539771 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f993c0b4c30 con 0x7f993c0cd780 2024-09-11T22:21:01.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.882+0000 7f9931ffb640 1 -- 172.21.15.100:0/2162539771 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f992c058d80 con 0x7f993c0cd780 2024-09-11T22:21:01.883 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-09-11T22:21:01.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.884+0000 7f994327b640 1 -- 172.21.15.100:0/2162539771 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f992006be30 msgr2=0x7f992006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:01.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.884+0000 7f994327b640 1 --2- 172.21.15.100:0/2162539771 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f992006be30 0x7f992006e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f99380011e0 tx=0x7f9938001150 comp rx=0 tx=0).stop 2024-09-11T22:21:01.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.884+0000 7f994327b640 1 -- 172.21.15.100:0/2162539771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f993c0cd780 msgr2=0x7f993c0cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:01.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.884+0000 7f994327b640 1 --2- 172.21.15.100:0/2162539771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f993c0cd780 0x7f993c0cc680 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f992c00f7f0 tx=0x7f992c00fbf0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.884+0000 7f994327b640 1 -- 172.21.15.100:0/2162539771 shutdown_connections 2024-09-11T22:21:01.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.884+0000 7f994327b640 1 --2- 172.21.15.100:0/2162539771 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f992006be30 0x7f992006e2f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.884+0000 7f994327b640 1 --2- 172.21.15.100:0/2162539771 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f993c151a40 0x7f993c1f37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.884+0000 7f994327b640 1 --2- 172.21.15.100:0/2162539771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f993c0cd780 0x7f993c0cc680 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.884+0000 7f994327b640 1 --2- 172.21.15.100:0/2162539771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9928004d40 0x7f993c150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.884+0000 7f994327b640 1 -- 172.21.15.100:0/2162539771 >> 172.21.15.100:0/2162539771 conn(0x7f993c06bc10 msgr2=0x7f993c0cf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:01.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.884+0000 7f994327b640 1 -- 172.21.15.100:0/2162539771 shutdown_connections 2024-09-11T22:21:01.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.884+0000 7f994327b640 1 -- 172.21.15.100:0/2162539771 wait complete. 2024-09-11T22:21:01.896 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2024-09-11T22:21:01.896 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:21:01.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.993+0000 7ff09eadd640 1 Processor -- start 2024-09-11T22:21:01.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.993+0000 7ff09eadd640 1 -- start start 2024-09-11T22:21:01.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.994+0000 7ff09eadd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff098154c20 0x7ff0980cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.994+0000 7ff09eadd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0980b3190 0x7ff09815e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.994+0000 7ff09eadd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff09815a7e0 0x7ff09815e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:01.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.994+0000 7ff09eadd640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7ff09815e000 con 0x7ff09815a7e0 2024-09-11T22:21:01.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.994+0000 7ff09eadd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7ff09815ac90 con 0x7ff098154c20 2024-09-11T22:21:01.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.994+0000 7ff09eadd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff09815af70 con 0x7ff0980b3190 2024-09-11T22:21:01.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.994+0000 7ff09d07a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff09815a7e0 0x7ff09815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.994+0000 7ff09d07a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff09815a7e0 0x7ff09815e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39636/0 (socket says 172.21.15.100:39636) 2024-09-11T22:21:01.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.994+0000 7ff09d07a640 1 -- 172.21.15.100:0/2201855472 learned_addr learned my addr 172.21.15.100:0/2201855472 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:01.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.995+0000 7ff08ffff640 1 --2- 172.21.15.100:0/2201855472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0980b3190 0x7ff09815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.995+0000 7ff09c879640 1 --2- 172.21.15.100:0/2201855472 >> v2:172.21.15.167:3300/0 conn(0x7ff098154c20 0x7ff0980cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:01.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.995+0000 7ff09d07a640 1 -- 172.21.15.100:0/2201855472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0980b3190 msgr2=0x7ff09815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:01.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.995+0000 7ff09d07a640 1 --2- 172.21.15.100:0/2201855472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0980b3190 0x7ff09815e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.995+0000 7ff09d07a640 1 -- 172.21.15.100:0/2201855472 >> v2:172.21.15.167:3300/0 conn(0x7ff098154c20 msgr2=0x7ff0980cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:01.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.995+0000 7ff09d07a640 1 --2- 172.21.15.100:0/2201855472 >> v2:172.21.15.167:3300/0 conn(0x7ff098154c20 0x7ff0980cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.995+0000 7ff09d07a640 1 -- 172.21.15.100:0/2201855472 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09815b250 con 0x7ff09815a7e0 2024-09-11T22:21:01.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.995+0000 7ff09d07a640 1 --2- 172.21.15.100:0/2201855472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff09815a7e0 0x7ff09815e9d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff0980732d0 tx=0x7ff09002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cfeb6eb993cb826 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:01.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.996+0000 7ff08f7fe640 1 -- 172.21.15.100:0/2201855472 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff090036070 con 0x7ff09815a7e0 2024-09-11T22:21:01.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.996+0000 7ff08f7fe640 1 -- 172.21.15.100:0/2201855472 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff090031600 con 0x7ff09815a7e0 2024-09-11T22:21:01.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.996+0000 7ff08f7fe640 1 -- 172.21.15.100:0/2201855472 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0900319d0 con 0x7ff09815a7e0 2024-09-11T22:21:01.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.996+0000 7ff09eadd640 1 -- 172.21.15.100:0/2201855472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff09815a7e0 msgr2=0x7ff09815e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:01.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.996+0000 7ff09eadd640 1 --2- 172.21.15.100:0/2201855472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff09815a7e0 0x7ff09815e9d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff0980732d0 tx=0x7ff09002a6a0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.996+0000 7ff09eadd640 1 -- 172.21.15.100:0/2201855472 shutdown_connections 2024-09-11T22:21:01.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.996+0000 7ff09eadd640 1 --2- 172.21.15.100:0/2201855472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff09815a7e0 0x7ff09815e9d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.996+0000 7ff09eadd640 1 --2- 172.21.15.100:0/2201855472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0980b3190 0x7ff09815e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.996+0000 7ff09eadd640 1 --2- 172.21.15.100:0/2201855472 >> v2:172.21.15.167:3300/0 conn(0x7ff098154c20 0x7ff0980cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:01.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.996+0000 7ff09eadd640 1 -- 172.21.15.100:0/2201855472 >> 172.21.15.100:0/2201855472 conn(0x7ff098067d40 msgr2=0x7ff09806d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:01.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.996+0000 7ff09eadd640 1 -- 172.21.15.100:0/2201855472 shutdown_connections 2024-09-11T22:21:01.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.996+0000 7ff09eadd640 1 -- 172.21.15.100:0/2201855472 wait complete. 2024-09-11T22:21:02.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.997+0000 7ff09eadd640 1 Processor -- start 2024-09-11T22:21:02.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.997+0000 7ff09eadd640 1 -- start start 2024-09-11T22:21:02.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.998+0000 7ff09eadd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0980b3190 0x7ff09815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:02.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.998+0000 7ff09eadd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff098154c20 0x7ff0981f1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:02.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.998+0000 7ff09eadd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff09815a7e0 0x7ff09814aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:02.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.998+0000 7ff09eadd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff0980cb7e0 con 0x7ff0980b3190 2024-09-11T22:21:02.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.998+0000 7ff09eadd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff0980cb660 con 0x7ff098154c20 2024-09-11T22:21:02.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.998+0000 7ff09eadd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff0980cbd10 con 0x7ff09815a7e0 2024-09-11T22:21:02.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.998+0000 7ff09c879640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0980b3190 0x7ff09815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:02.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.998+0000 7ff09c879640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0980b3190 0x7ff09815cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39642/0 (socket says 172.21.15.100:39642) 2024-09-11T22:21:02.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.998+0000 7ff09c879640 1 -- 172.21.15.100:0/2176210824 learned_addr learned my addr 172.21.15.100:0/2176210824 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:02.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.998+0000 7ff09d07a640 1 --2- 172.21.15.100:0/2176210824 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff09815a7e0 0x7ff09814aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:02.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.998+0000 7ff09c879640 1 -- 172.21.15.100:0/2176210824 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff09815a7e0 msgr2=0x7ff09814aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:02.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.998+0000 7ff08ffff640 1 --2- 172.21.15.100:0/2176210824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff098154c20 0x7ff0981f1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:02.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.999+0000 7ff09c879640 1 --2- 172.21.15.100:0/2176210824 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff09815a7e0 0x7ff09814aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.999+0000 7ff09c879640 1 -- 172.21.15.100:0/2176210824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff098154c20 msgr2=0x7ff0981f1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:02.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.999+0000 7ff09c879640 1 --2- 172.21.15.100:0/2176210824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff098154c20 0x7ff0981f1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.999+0000 7ff09c879640 1 -- 172.21.15.100:0/2176210824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0980c9eb0 con 0x7ff0980b3190 2024-09-11T22:21:02.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.999+0000 7ff09c879640 1 --2- 172.21.15.100:0/2176210824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0980b3190 0x7ff09815cc60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff09400c7f0 tx=0x7ff09400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:02.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.999+0000 7ff08d7fa640 1 -- 172.21.15.100:0/2176210824 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff094015070 con 0x7ff0980b3190 2024-09-11T22:21:02.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.999+0000 7ff08d7fa640 1 -- 172.21.15.100:0/2176210824 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff094004240 con 0x7ff0980b3190 2024-09-11T22:21:02.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.999+0000 7ff09eadd640 1 -- 172.21.15.100:0/2176210824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0980ca350 con 0x7ff0980b3190 2024-09-11T22:21:02.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.999+0000 7ff08d7fa640 1 -- 172.21.15.100:0/2176210824 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff094003610 con 0x7ff0980b3190 2024-09-11T22:21:02.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:01.999+0000 7ff09eadd640 1 -- 172.21.15.100:0/2176210824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0980c8130 con 0x7ff0980b3190 2024-09-11T22:21:02.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.000+0000 7ff09eadd640 1 -- 172.21.15.100:0/2176210824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0980cb120 con 0x7ff0980b3190 2024-09-11T22:21:02.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.000+0000 7ff08d7fa640 1 -- 172.21.15.100:0/2176210824 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0940037b0 con 0x7ff0980b3190 2024-09-11T22:21:02.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.001+0000 7ff08d7fa640 1 --2- 172.21.15.100:0/2176210824 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff08406be30 0x7ff08406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:02.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.001+0000 7ff08d7fa640 1 -- 172.21.15.100:0/2176210824 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7ff09408b400 con 0x7ff0980b3190 2024-09-11T22:21:02.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.001+0000 7ff08ffff640 1 --2- 172.21.15.100:0/2176210824 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff08406be30 0x7ff08406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:02.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.001+0000 7ff08ffff640 1 --2- 172.21.15.100:0/2176210824 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff08406be30 0x7ff08406e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff0981f1620 tx=0x7ff088008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:02.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.005+0000 7ff08d7fa640 1 -- 172.21.15.100:0/2176210824 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff0980c9eb0 con 0x7ff0980b3190 2024-09-11T22:21:02.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.175+0000 7ff09eadd640 1 -- 172.21.15.100:0/2176210824 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff0980c8c10 con 0x7ff08406be30 2024-09-11T22:21:02.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.183+0000 7ff08d7fa640 1 -- 172.21.15.100:0/2176210824 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332415 (secure 0 0 0) 0x7ff0980c8c10 con 0x7ff08406be30 2024-09-11T22:21:02.187 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:21:02.189 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-11T22:21:02.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.186+0000 7ff09eadd640 1 -- 172.21.15.100:0/2176210824 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff08406be30 msgr2=0x7ff08406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:02.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.186+0000 7ff09eadd640 1 --2- 172.21.15.100:0/2176210824 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff08406be30 0x7ff08406e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff0981f1620 tx=0x7ff088008040 comp rx=0 tx=0).stop 2024-09-11T22:21:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.186+0000 7ff09eadd640 1 -- 172.21.15.100:0/2176210824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0980b3190 msgr2=0x7ff09815cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.186+0000 7ff09eadd640 1 --2- 172.21.15.100:0/2176210824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0980b3190 0x7ff09815cc60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff09400c7f0 tx=0x7ff09400ccb0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.187+0000 7ff09eadd640 1 -- 172.21.15.100:0/2176210824 shutdown_connections 2024-09-11T22:21:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.187+0000 7ff09eadd640 1 --2- 172.21.15.100:0/2176210824 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff08406be30 0x7ff08406e2f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.187+0000 7ff09eadd640 1 --2- 172.21.15.100:0/2176210824 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff09815a7e0 0x7ff09814aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.187+0000 7ff09eadd640 1 --2- 172.21.15.100:0/2176210824 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff098154c20 0x7ff0981f1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.187+0000 7ff09eadd640 1 --2- 172.21.15.100:0/2176210824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0980b3190 0x7ff09815cc60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.187+0000 7ff09eadd640 1 -- 172.21.15.100:0/2176210824 >> 172.21.15.100:0/2176210824 conn(0x7ff098067d40 msgr2=0x7ff098159580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.187+0000 7ff09eadd640 1 -- 172.21.15.100:0/2176210824 shutdown_connections 2024-09-11T22:21:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.187+0000 7ff09eadd640 1 -- 172.21.15.100:0/2176210824 wait complete. 2024-09-11T22:21:02.197 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-09-11T22:21:02.025440+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597822,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":287,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218592,"kb_used_data":2400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756128,"statfs":{"total":773094113280,"available":772870275072,"internally_reserved":0,"allocated":2457600,"data_stored":2054188,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1406,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.713714"},"pg_stats":[{"pgid":"2.1f","version":"26'9","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.034259+0000","last_change":"2024-09-11T22:20:18.853007+0000","last_active":"2024-09-11T22:21:01.034259+0000","last_peered":"2024-09-11T22:21:01.034259+0000","last_clean":"2024-09-11T22:21:01.034259+0000","last_became_active":"2024-09-11T22:20:18.852740+0000","last_became_peered":"2024-09-11T22:20:18.852740+0000","last_unstale":"2024-09-11T22:21:01.034259+0000","last_undegraded":"2024-09-11T22:21:01.034259+0000","last_fullsized":"2024-09-11T22:21:01.034259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:46.710328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887920+0000","last_change":"2024-09-11T22:20:19.849765+0000","last_active":"2024-09-11T22:20:24.887920+0000","last_peered":"2024-09-11T22:20:24.887920+0000","last_clean":"2024-09-11T22:20:24.887920+0000","last_became_active":"2024-09-11T22:20:19.848619+0000","last_became_peered":"2024-09-11T22:20:19.848619+0000","last_unstale":"2024-09-11T22:20:24.887920+0000","last_undegraded":"2024-09-11T22:20:24.887920+0000","last_fullsized":"2024-09-11T22:20:24.887920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:57.621624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887250+0000","last_change":"2024-09-11T22:20:24.078618+0000","last_active":"2024-09-11T22:20:24.887250+0000","last_peered":"2024-09-11T22:20:24.887250+0000","last_clean":"2024-09-11T22:20:24.887250+0000","last_became_active":"2024-09-11T22:20:24.078283+0000","last_became_peered":"2024-09-11T22:20:24.078283+0000","last_unstale":"2024-09-11T22:20:24.887250+0000","last_undegraded":"2024-09-11T22:20:24.887250+0000","last_fullsized":"2024-09-11T22:20:24.887250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:01.901307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888040+0000","last_change":"2024-09-11T22:20:18.855945+0000","last_active":"2024-09-11T22:20:24.888040+0000","last_peered":"2024-09-11T22:20:24.888040+0000","last_clean":"2024-09-11T22:20:24.888040+0000","last_became_active":"2024-09-11T22:20:18.854811+0000","last_became_peered":"2024-09-11T22:20:18.854811+0000","last_unstale":"2024-09-11T22:20:24.888040+0000","last_undegraded":"2024-09-11T22:20:24.888040+0000","last_fullsized":"2024-09-11T22:20:24.888040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:47.508920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033442+0000","last_change":"2024-09-11T22:20:19.862436+0000","last_active":"2024-09-11T22:21:01.033442+0000","last_peered":"2024-09-11T22:21:01.033442+0000","last_clean":"2024-09-11T22:21:01.033442+0000","last_became_active":"2024-09-11T22:20:19.862061+0000","last_became_peered":"2024-09-11T22:20:19.862061+0000","last_unstale":"2024-09-11T22:21:01.033442+0000","last_undegraded":"2024-09-11T22:21:01.033442+0000","last_fullsized":"2024-09-11T22:21:01.033442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047627+0000","last_change":"2024-09-11T22:20:23.879729+0000","last_active":"2024-09-11T22:20:27.047627+0000","last_peered":"2024-09-11T22:20:27.047627+0000","last_clean":"2024-09-11T22:20:27.047627+0000","last_became_active":"2024-09-11T22:20:23.879245+0000","last_became_peered":"2024-09-11T22:20:23.879245+0000","last_unstale":"2024-09-11T22:20:27.047627+0000","last_undegraded":"2024-09-11T22:20:27.047627+0000","last_fullsized":"2024-09-11T22:20:27.047627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:36.836842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.964933+0000","last_change":"2024-09-11T22:20:18.853076+0000","last_active":"2024-09-11T22:20:52.964933+0000","last_peered":"2024-09-11T22:20:52.964933+0000","last_clean":"2024-09-11T22:20:52.964933+0000","last_became_active":"2024-09-11T22:20:18.852728+0000","last_became_peered":"2024-09-11T22:20:18.852728+0000","last_unstale":"2024-09-11T22:20:52.964933+0000","last_undegraded":"2024-09-11T22:20:52.964933+0000","last_fullsized":"2024-09-11T22:20:52.964933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890308+0000","last_change":"2024-09-11T22:20:19.864544+0000","last_active":"2024-09-11T22:20:24.890308+0000","last_peered":"2024-09-11T22:20:24.890308+0000","last_clean":"2024-09-11T22:20:24.890308+0000","last_became_active":"2024-09-11T22:20:19.864234+0000","last_became_peered":"2024-09-11T22:20:19.864234+0000","last_unstale":"2024-09-11T22:20:24.890308+0000","last_undegraded":"2024-09-11T22:20:24.890308+0000","last_fullsized":"2024-09-11T22:20:24.890308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048400+0000","last_change":"2024-09-11T22:20:23.873783+0000","last_active":"2024-09-11T22:20:27.048400+0000","last_peered":"2024-09-11T22:20:27.048400+0000","last_clean":"2024-09-11T22:20:27.048400+0000","last_became_active":"2024-09-11T22:20:23.873385+0000","last_became_peered":"2024-09-11T22:20:23.873385+0000","last_unstale":"2024-09-11T22:20:27.048400+0000","last_undegraded":"2024-09-11T22:20:27.048400+0000","last_fullsized":"2024-09-11T22:20:27.048400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048092+0000","last_change":"2024-09-11T22:20:18.861530+0000","last_active":"2024-09-11T22:20:27.048092+0000","last_peered":"2024-09-11T22:20:27.048092+0000","last_clean":"2024-09-11T22:20:27.048092+0000","last_became_active":"2024-09-11T22:20:18.861230+0000","last_became_peered":"2024-09-11T22:20:18.861230+0000","last_unstale":"2024-09-11T22:20:27.048092+0000","last_undegraded":"2024-09-11T22:20:27.048092+0000","last_fullsized":"2024-09-11T22:20:27.048092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890615+0000","last_change":"2024-09-11T22:20:19.863401+0000","last_active":"2024-09-11T22:20:24.890615+0000","last_peered":"2024-09-11T22:20:24.890615+0000","last_clean":"2024-09-11T22:20:24.890615+0000","last_became_active":"2024-09-11T22:20:19.863127+0000","last_became_peered":"2024-09-11T22:20:19.863127+0000","last_unstale":"2024-09-11T22:20:24.890615+0000","last_undegraded":"2024-09-11T22:20:24.890615+0000","last_fullsized":"2024-09-11T22:20:24.890615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:36.888544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048021+0000","last_change":"2024-09-11T22:20:23.874650+0000","last_active":"2024-09-11T22:20:27.048021+0000","last_peered":"2024-09-11T22:20:27.048021+0000","last_clean":"2024-09-11T22:20:27.048021+0000","last_became_active":"2024-09-11T22:20:23.874040+0000","last_became_peered":"2024-09-11T22:20:23.874040+0000","last_unstale":"2024-09-11T22:20:27.048021+0000","last_undegraded":"2024-09-11T22:20:27.048021+0000","last_fullsized":"2024-09-11T22:20:27.048021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888158+0000","last_change":"2024-09-11T22:20:19.859446+0000","last_active":"2024-09-11T22:20:24.888158+0000","last_peered":"2024-09-11T22:20:24.888158+0000","last_clean":"2024-09-11T22:20:24.888158+0000","last_became_active":"2024-09-11T22:20:19.859106+0000","last_became_peered":"2024-09-11T22:20:19.859106+0000","last_unstale":"2024-09-11T22:20:24.888158+0000","last_undegraded":"2024-09-11T22:20:24.888158+0000","last_fullsized":"2024-09-11T22:20:24.888158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.944022+0000","last_change":"2024-09-11T22:20:18.856475+0000","last_active":"2024-09-11T22:20:46.944022+0000","last_peered":"2024-09-11T22:20:46.944022+0000","last_clean":"2024-09-11T22:20:46.944022+0000","last_became_active":"2024-09-11T22:20:18.856165+0000","last_became_peered":"2024-09-11T22:20:18.856165+0000","last_unstale":"2024-09-11T22:20:46.944022+0000","last_undegraded":"2024-09-11T22:20:46.944022+0000","last_fullsized":"2024-09-11T22:20:46.944022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048102+0000","last_change":"2024-09-11T22:20:23.878121+0000","last_active":"2024-09-11T22:20:27.048102+0000","last_peered":"2024-09-11T22:20:27.048102+0000","last_clean":"2024-09-11T22:20:27.048102+0000","last_became_active":"2024-09-11T22:20:23.877713+0000","last_became_peered":"2024-09-11T22:20:23.877713+0000","last_unstale":"2024-09-11T22:20:27.048102+0000","last_undegraded":"2024-09-11T22:20:27.048102+0000","last_fullsized":"2024-09-11T22:20:27.048102+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887604+0000","last_change":"2024-09-11T22:20:19.858358+0000","last_active":"2024-09-11T22:20:24.887604+0000","last_peered":"2024-09-11T22:20:24.887604+0000","last_clean":"2024-09-11T22:20:24.887604+0000","last_became_active":"2024-09-11T22:20:19.858057+0000","last_became_peered":"2024-09-11T22:20:19.858057+0000","last_unstale":"2024-09-11T22:20:24.887604+0000","last_undegraded":"2024-09-11T22:20:24.887604+0000","last_fullsized":"2024-09-11T22:20:24.887604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:07.839926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998226+0000","last_change":"2024-09-11T22:20:18.853818+0000","last_active":"2024-09-11T22:20:24.998226+0000","last_peered":"2024-09-11T22:20:24.998226+0000","last_clean":"2024-09-11T22:20:24.998226+0000","last_became_active":"2024-09-11T22:20:18.853508+0000","last_became_peered":"2024-09-11T22:20:18.853508+0000","last_unstale":"2024-09-11T22:20:24.998226+0000","last_undegraded":"2024-09-11T22:20:24.998226+0000","last_fullsized":"2024-09-11T22:20:24.998226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:58.141587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047962+0000","last_change":"2024-09-11T22:20:23.879226+0000","last_active":"2024-09-11T22:20:27.047962+0000","last_peered":"2024-09-11T22:20:27.047962+0000","last_clean":"2024-09-11T22:20:27.047962+0000","last_became_active":"2024-09-11T22:20:23.878199+0000","last_became_peered":"2024-09-11T22:20:23.878199+0000","last_unstale":"2024-09-11T22:20:27.047962+0000","last_undegraded":"2024-09-11T22:20:27.047962+0000","last_fullsized":"2024-09-11T22:20:27.047962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:13.245927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887402+0000","last_change":"2024-09-11T22:20:19.844748+0000","last_active":"2024-09-11T22:20:24.887402+0000","last_peered":"2024-09-11T22:20:24.887402+0000","last_clean":"2024-09-11T22:20:24.887402+0000","last_became_active":"2024-09-11T22:20:19.844446+0000","last_became_peered":"2024-09-11T22:20:19.844446+0000","last_unstale":"2024-09-11T22:20:24.887402+0000","last_undegraded":"2024-09-11T22:20:24.887402+0000","last_fullsized":"2024-09-11T22:20:24.887402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:13.319918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.948253+0000","last_change":"2024-09-11T22:20:18.847388+0000","last_active":"2024-09-11T22:20:46.948253+0000","last_peered":"2024-09-11T22:20:46.948253+0000","last_clean":"2024-09-11T22:20:46.948253+0000","last_became_active":"2024-09-11T22:20:18.847118+0000","last_became_peered":"2024-09-11T22:20:18.847118+0000","last_unstale":"2024-09-11T22:20:46.948253+0000","last_undegraded":"2024-09-11T22:20:46.948253+0000","last_fullsized":"2024-09-11T22:20:46.948253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:47.360920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998393+0000","last_change":"2024-09-11T22:20:24.077604+0000","last_active":"2024-09-11T22:20:24.998393+0000","last_peered":"2024-09-11T22:20:24.998393+0000","last_clean":"2024-09-11T22:20:24.998393+0000","last_became_active":"2024-09-11T22:20:24.077231+0000","last_became_peered":"2024-09-11T22:20:24.077231+0000","last_unstale":"2024-09-11T22:20:24.998393+0000","last_undegraded":"2024-09-11T22:20:24.998393+0000","last_fullsized":"2024-09-11T22:20:24.998393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:38.846688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048647+0000","last_change":"2024-09-11T22:20:19.854453+0000","last_active":"2024-09-11T22:20:27.048647+0000","last_peered":"2024-09-11T22:20:27.048647+0000","last_clean":"2024-09-11T22:20:27.048647+0000","last_became_active":"2024-09-11T22:20:19.854100+0000","last_became_peered":"2024-09-11T22:20:19.854100+0000","last_unstale":"2024-09-11T22:20:27.048647+0000","last_undegraded":"2024-09-11T22:20:27.048647+0000","last_fullsized":"2024-09-11T22:20:27.048647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:06.166813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.944339+0000","last_change":"2024-09-11T22:20:18.854889+0000","last_active":"2024-09-11T22:20:46.944339+0000","last_peered":"2024-09-11T22:20:46.944339+0000","last_clean":"2024-09-11T22:20:46.944339+0000","last_became_active":"2024-09-11T22:20:18.854552+0000","last_became_peered":"2024-09-11T22:20:18.854552+0000","last_unstale":"2024-09-11T22:20:46.944339+0000","last_undegraded":"2024-09-11T22:20:46.944339+0000","last_fullsized":"2024-09-11T22:20:46.944339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:33.612126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048443+0000","last_change":"2024-09-11T22:20:23.878932+0000","last_active":"2024-09-11T22:20:27.048443+0000","last_peered":"2024-09-11T22:20:27.048443+0000","last_clean":"2024-09-11T22:20:27.048443+0000","last_became_active":"2024-09-11T22:20:23.878305+0000","last_became_peered":"2024-09-11T22:20:23.878305+0000","last_unstale":"2024-09-11T22:20:27.048443+0000","last_undegraded":"2024-09-11T22:20:27.048443+0000","last_fullsized":"2024-09-11T22:20:27.048443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033835+0000","last_change":"2024-09-11T22:20:19.856318+0000","last_active":"2024-09-11T22:21:01.033835+0000","last_peered":"2024-09-11T22:21:01.033835+0000","last_clean":"2024-09-11T22:21:01.033835+0000","last_became_active":"2024-09-11T22:20:19.855992+0000","last_became_peered":"2024-09-11T22:20:19.855992+0000","last_unstale":"2024-09-11T22:21:01.033835+0000","last_undegraded":"2024-09-11T22:21:01.033835+0000","last_fullsized":"2024-09-11T22:21:01.033835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:57.709140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.944255+0000","last_change":"2024-09-11T22:20:18.850750+0000","last_active":"2024-09-11T22:20:46.944255+0000","last_peered":"2024-09-11T22:20:46.944255+0000","last_clean":"2024-09-11T22:20:46.944255+0000","last_became_active":"2024-09-11T22:20:18.849621+0000","last_became_peered":"2024-09-11T22:20:18.849621+0000","last_unstale":"2024-09-11T22:20:46.944255+0000","last_undegraded":"2024-09-11T22:20:46.944255+0000","last_fullsized":"2024-09-11T22:20:46.944255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047710+0000","last_change":"2024-09-11T22:20:24.077741+0000","last_active":"2024-09-11T22:20:27.047710+0000","last_peered":"2024-09-11T22:20:27.047710+0000","last_clean":"2024-09-11T22:20:27.047710+0000","last_became_active":"2024-09-11T22:20:24.077325+0000","last_became_peered":"2024-09-11T22:20:24.077325+0000","last_unstale":"2024-09-11T22:20:27.047710+0000","last_undegraded":"2024-09-11T22:20:27.047710+0000","last_fullsized":"2024-09-11T22:20:27.047710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:18.656529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888138+0000","last_change":"2024-09-11T22:20:19.850738+0000","last_active":"2024-09-11T22:20:24.888138+0000","last_peered":"2024-09-11T22:20:24.888138+0000","last_clean":"2024-09-11T22:20:24.888138+0000","last_became_active":"2024-09-11T22:20:19.850441+0000","last_became_peered":"2024-09-11T22:20:19.850441+0000","last_unstale":"2024-09-11T22:20:24.888138+0000","last_undegraded":"2024-09-11T22:20:24.888138+0000","last_fullsized":"2024-09-11T22:20:24.888138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:47.552343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.966090+0000","last_change":"2024-09-11T22:20:18.845173+0000","last_active":"2024-09-11T22:20:52.966090+0000","last_peered":"2024-09-11T22:20:52.966090+0000","last_clean":"2024-09-11T22:20:52.966090+0000","last_became_active":"2024-09-11T22:20:18.844731+0000","last_became_peered":"2024-09-11T22:20:18.844731+0000","last_unstale":"2024-09-11T22:20:52.966090+0000","last_undegraded":"2024-09-11T22:20:52.966090+0000","last_fullsized":"2024-09-11T22:20:52.966090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:32.963285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887172+0000","last_change":"2024-09-11T22:20:24.078020+0000","last_active":"2024-09-11T22:20:24.887172+0000","last_peered":"2024-09-11T22:20:24.887172+0000","last_clean":"2024-09-11T22:20:24.887172+0000","last_became_active":"2024-09-11T22:20:24.077541+0000","last_became_peered":"2024-09-11T22:20:24.077541+0000","last_unstale":"2024-09-11T22:20:24.887172+0000","last_undegraded":"2024-09-11T22:20:24.887172+0000","last_fullsized":"2024-09-11T22:20:24.887172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:36.122714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998068+0000","last_change":"2024-09-11T22:20:19.845497+0000","last_active":"2024-09-11T22:20:24.998068+0000","last_peered":"2024-09-11T22:20:24.998068+0000","last_clean":"2024-09-11T22:20:24.998068+0000","last_became_active":"2024-09-11T22:20:19.845203+0000","last_became_peered":"2024-09-11T22:20:19.845203+0000","last_unstale":"2024-09-11T22:20:24.998068+0000","last_undegraded":"2024-09-11T22:20:24.998068+0000","last_fullsized":"2024-09-11T22:20:24.998068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:12.086231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048907+0000","last_change":"2024-09-11T22:20:18.856263+0000","last_active":"2024-09-11T22:20:27.048907+0000","last_peered":"2024-09-11T22:20:27.048907+0000","last_clean":"2024-09-11T22:20:27.048907+0000","last_became_active":"2024-09-11T22:20:18.855968+0000","last_became_peered":"2024-09-11T22:20:18.855968+0000","last_unstale":"2024-09-11T22:20:27.048907+0000","last_undegraded":"2024-09-11T22:20:27.048907+0000","last_fullsized":"2024-09-11T22:20:27.048907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033466+0000","last_change":"2024-09-11T22:20:24.075030+0000","last_active":"2024-09-11T22:21:01.033466+0000","last_peered":"2024-09-11T22:21:01.033466+0000","last_clean":"2024-09-11T22:21:01.033466+0000","last_became_active":"2024-09-11T22:20:24.074588+0000","last_became_peered":"2024-09-11T22:20:24.074588+0000","last_unstale":"2024-09-11T22:21:01.033466+0000","last_undegraded":"2024-09-11T22:21:01.033466+0000","last_fullsized":"2024-09-11T22:21:01.033466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890676+0000","last_change":"2024-09-11T22:20:19.859010+0000","last_active":"2024-09-11T22:20:24.890676+0000","last_peered":"2024-09-11T22:20:24.890676+0000","last_clean":"2024-09-11T22:20:24.890676+0000","last_became_active":"2024-09-11T22:20:19.858585+0000","last_became_peered":"2024-09-11T22:20:19.858585+0000","last_unstale":"2024-09-11T22:20:24.890676+0000","last_undegraded":"2024-09-11T22:20:24.890676+0000","last_fullsized":"2024-09-11T22:20:24.890676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998168+0000","last_change":"2024-09-11T22:20:18.847904+0000","last_active":"2024-09-11T22:20:24.998168+0000","last_peered":"2024-09-11T22:20:24.998168+0000","last_clean":"2024-09-11T22:20:24.998168+0000","last_became_active":"2024-09-11T22:20:18.847669+0000","last_became_peered":"2024-09-11T22:20:18.847669+0000","last_unstale":"2024-09-11T22:20:24.998168+0000","last_undegraded":"2024-09-11T22:20:24.998168+0000","last_fullsized":"2024-09-11T22:20:24.998168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:08.717999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997794+0000","last_change":"2024-09-11T22:20:23.881067+0000","last_active":"2024-09-11T22:20:24.997794+0000","last_peered":"2024-09-11T22:20:24.997794+0000","last_clean":"2024-09-11T22:20:24.997794+0000","last_became_active":"2024-09-11T22:20:23.880468+0000","last_became_peered":"2024-09-11T22:20:23.880468+0000","last_unstale":"2024-09-11T22:20:24.997794+0000","last_undegraded":"2024-09-11T22:20:24.997794+0000","last_fullsized":"2024-09-11T22:20:24.997794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:23.480547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048637+0000","last_change":"2024-09-11T22:20:19.860423+0000","last_active":"2024-09-11T22:20:27.048637+0000","last_peered":"2024-09-11T22:20:27.048637+0000","last_clean":"2024-09-11T22:20:27.048637+0000","last_became_active":"2024-09-11T22:20:19.858932+0000","last_became_peered":"2024-09-11T22:20:19.858932+0000","last_unstale":"2024-09-11T22:20:27.048637+0000","last_undegraded":"2024-09-11T22:20:27.048637+0000","last_fullsized":"2024-09-11T22:20:27.048637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:53.255932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890029+0000","last_change":"2024-09-11T22:20:18.854973+0000","last_active":"2024-09-11T22:20:24.890029+0000","last_peered":"2024-09-11T22:20:24.890029+0000","last_clean":"2024-09-11T22:20:24.890029+0000","last_became_active":"2024-09-11T22:20:18.854725+0000","last_became_peered":"2024-09-11T22:20:18.854725+0000","last_unstale":"2024-09-11T22:20:24.890029+0000","last_undegraded":"2024-09-11T22:20:24.890029+0000","last_fullsized":"2024-09-11T22:20:24.890029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998393+0000","last_change":"2024-09-11T22:20:23.880693+0000","last_active":"2024-09-11T22:20:24.998393+0000","last_peered":"2024-09-11T22:20:24.998393+0000","last_clean":"2024-09-11T22:20:24.998393+0000","last_became_active":"2024-09-11T22:20:23.880243+0000","last_became_peered":"2024-09-11T22:20:23.880243+0000","last_unstale":"2024-09-11T22:20:24.998393+0000","last_undegraded":"2024-09-11T22:20:24.998393+0000","last_fullsized":"2024-09-11T22:20:24.998393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.659287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997954+0000","last_change":"2024-09-11T22:20:19.844808+0000","last_active":"2024-09-11T22:20:24.997954+0000","last_peered":"2024-09-11T22:20:24.997954+0000","last_clean":"2024-09-11T22:20:24.997954+0000","last_became_active":"2024-09-11T22:20:19.844536+0000","last_became_peered":"2024-09-11T22:20:19.844536+0000","last_unstale":"2024-09-11T22:20:24.997954+0000","last_undegraded":"2024-09-11T22:20:24.997954+0000","last_fullsized":"2024-09-11T22:20:24.997954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:57.142383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025228+0000","last_change":"2024-09-11T22:20:18.855640+0000","last_active":"2024-09-11T22:21:01.025228+0000","last_peered":"2024-09-11T22:21:01.025228+0000","last_clean":"2024-09-11T22:21:01.025228+0000","last_became_active":"2024-09-11T22:20:18.855394+0000","last_became_peered":"2024-09-11T22:20:18.855394+0000","last_unstale":"2024-09-11T22:21:01.025228+0000","last_undegraded":"2024-09-11T22:21:01.025228+0000","last_fullsized":"2024-09-11T22:21:01.025228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998458+0000","last_change":"2024-09-11T22:20:23.882554+0000","last_active":"2024-09-11T22:20:24.998458+0000","last_peered":"2024-09-11T22:20:24.998458+0000","last_clean":"2024-09-11T22:20:24.998458+0000","last_became_active":"2024-09-11T22:20:23.881642+0000","last_became_peered":"2024-09-11T22:20:23.881642+0000","last_unstale":"2024-09-11T22:20:24.998458+0000","last_undegraded":"2024-09-11T22:20:24.998458+0000","last_fullsized":"2024-09-11T22:20:24.998458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:16.696043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033143+0000","last_change":"2024-09-11T22:20:19.859429+0000","last_active":"2024-09-11T22:21:01.033143+0000","last_peered":"2024-09-11T22:21:01.033143+0000","last_clean":"2024-09-11T22:21:01.033143+0000","last_became_active":"2024-09-11T22:20:19.859159+0000","last_became_peered":"2024-09-11T22:20:19.859159+0000","last_unstale":"2024-09-11T22:21:01.033143+0000","last_undegraded":"2024-09-11T22:21:01.033143+0000","last_fullsized":"2024-09-11T22:21:01.033143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:02.696450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.967996+0000","last_change":"2024-09-11T22:20:18.856144+0000","last_active":"2024-09-11T22:20:52.967996+0000","last_peered":"2024-09-11T22:20:52.967996+0000","last_clean":"2024-09-11T22:20:52.967996+0000","last_became_active":"2024-09-11T22:20:18.855866+0000","last_became_peered":"2024-09-11T22:20:18.855866+0000","last_unstale":"2024-09-11T22:20:52.967996+0000","last_undegraded":"2024-09-11T22:20:52.967996+0000","last_fullsized":"2024-09-11T22:20:52.967996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:37.259393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033635+0000","last_change":"2024-09-11T22:20:24.075154+0000","last_active":"2024-09-11T22:21:01.033635+0000","last_peered":"2024-09-11T22:21:01.033635+0000","last_clean":"2024-09-11T22:21:01.033635+0000","last_became_active":"2024-09-11T22:20:24.074568+0000","last_became_peered":"2024-09-11T22:20:24.074568+0000","last_unstale":"2024-09-11T22:21:01.033635+0000","last_undegraded":"2024-09-11T22:21:01.033635+0000","last_fullsized":"2024-09-11T22:21:01.033635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:09.804991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887321+0000","last_change":"2024-09-11T22:20:19.861236+0000","last_active":"2024-09-11T22:20:24.887321+0000","last_peered":"2024-09-11T22:20:24.887321+0000","last_clean":"2024-09-11T22:20:24.887321+0000","last_became_active":"2024-09-11T22:20:19.860938+0000","last_became_peered":"2024-09-11T22:20:19.860938+0000","last_unstale":"2024-09-11T22:20:24.887321+0000","last_undegraded":"2024-09-11T22:20:24.887321+0000","last_fullsized":"2024-09-11T22:20:24.887321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:42.015334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.946546+0000","last_change":"2024-09-11T22:20:18.853467+0000","last_active":"2024-09-11T22:20:46.946546+0000","last_peered":"2024-09-11T22:20:46.946546+0000","last_clean":"2024-09-11T22:20:46.946546+0000","last_became_active":"2024-09-11T22:20:18.853182+0000","last_became_peered":"2024-09-11T22:20:18.853182+0000","last_unstale":"2024-09-11T22:20:46.946546+0000","last_undegraded":"2024-09-11T22:20:46.946546+0000","last_fullsized":"2024-09-11T22:20:46.946546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047625+0000","last_change":"2024-09-11T22:20:09.425648+0000","last_active":"2024-09-11T22:20:27.047625+0000","last_peered":"2024-09-11T22:20:27.047625+0000","last_clean":"2024-09-11T22:20:27.047625+0000","last_became_active":"2024-09-11T22:20:09.424591+0000","last_became_peered":"2024-09-11T22:20:09.424591+0000","last_unstale":"2024-09-11T22:20:27.047625+0000","last_undegraded":"2024-09-11T22:20:27.047625+0000","last_fullsized":"2024-09-11T22:20:27.047625+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_clean_scrub_stamp":"2024-09-11T22:20:08.334092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:53.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888536+0000","last_change":"2024-09-11T22:20:24.077007+0000","last_active":"2024-09-11T22:20:24.888536+0000","last_peered":"2024-09-11T22:20:24.888536+0000","last_clean":"2024-09-11T22:20:24.888536+0000","last_became_active":"2024-09-11T22:20:24.076601+0000","last_became_peered":"2024-09-11T22:20:24.076601+0000","last_unstale":"2024-09-11T22:20:24.888536+0000","last_undegraded":"2024-09-11T22:20:24.888536+0000","last_fullsized":"2024-09-11T22:20:24.888536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048600+0000","last_change":"2024-09-11T22:20:19.863279+0000","last_active":"2024-09-11T22:20:27.048600+0000","last_peered":"2024-09-11T22:20:27.048600+0000","last_clean":"2024-09-11T22:20:27.048600+0000","last_became_active":"2024-09-11T22:20:19.861322+0000","last_became_peered":"2024-09-11T22:20:19.861322+0000","last_unstale":"2024-09-11T22:20:27.048600+0000","last_undegraded":"2024-09-11T22:20:27.048600+0000","last_fullsized":"2024-09-11T22:20:27.048600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025479+0000","last_change":"2024-09-11T22:20:18.853343+0000","last_active":"2024-09-11T22:21:01.025479+0000","last_peered":"2024-09-11T22:21:01.025479+0000","last_clean":"2024-09-11T22:21:01.025479+0000","last_became_active":"2024-09-11T22:20:18.853069+0000","last_became_peered":"2024-09-11T22:20:18.853069+0000","last_unstale":"2024-09-11T22:21:01.025479+0000","last_undegraded":"2024-09-11T22:21:01.025479+0000","last_fullsized":"2024-09-11T22:21:01.025479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888655+0000","last_change":"2024-09-11T22:20:24.075350+0000","last_active":"2024-09-11T22:20:24.888655+0000","last_peered":"2024-09-11T22:20:24.888655+0000","last_clean":"2024-09-11T22:20:24.888655+0000","last_became_active":"2024-09-11T22:20:24.074789+0000","last_became_peered":"2024-09-11T22:20:24.074789+0000","last_unstale":"2024-09-11T22:20:24.888655+0000","last_undegraded":"2024-09-11T22:20:24.888655+0000","last_fullsized":"2024-09-11T22:20:24.888655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890400+0000","last_change":"2024-09-11T22:20:19.866331+0000","last_active":"2024-09-11T22:20:24.890400+0000","last_peered":"2024-09-11T22:20:24.890400+0000","last_clean":"2024-09-11T22:20:24.890400+0000","last_became_active":"2024-09-11T22:20:19.865535+0000","last_became_peered":"2024-09-11T22:20:19.865535+0000","last_unstale":"2024-09-11T22:20:24.890400+0000","last_undegraded":"2024-09-11T22:20:24.890400+0000","last_fullsized":"2024-09-11T22:20:24.890400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998164+0000","last_change":"2024-09-11T22:20:18.849434+0000","last_active":"2024-09-11T22:20:24.998164+0000","last_peered":"2024-09-11T22:20:24.998164+0000","last_clean":"2024-09-11T22:20:24.998164+0000","last_became_active":"2024-09-11T22:20:18.848787+0000","last_became_peered":"2024-09-11T22:20:18.848787+0000","last_unstale":"2024-09-11T22:20:24.998164+0000","last_undegraded":"2024-09-11T22:20:24.998164+0000","last_fullsized":"2024-09-11T22:20:24.998164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:25.689495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033577+0000","last_change":"2024-09-11T22:20:23.879962+0000","last_active":"2024-09-11T22:21:01.033577+0000","last_peered":"2024-09-11T22:21:01.033577+0000","last_clean":"2024-09-11T22:21:01.033577+0000","last_became_active":"2024-09-11T22:20:23.879586+0000","last_became_peered":"2024-09-11T22:20:23.879586+0000","last_unstale":"2024-09-11T22:21:01.033577+0000","last_undegraded":"2024-09-11T22:21:01.033577+0000","last_fullsized":"2024-09-11T22:21:01.033577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:27.323116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.049164+0000","last_change":"2024-09-11T22:20:19.860411+0000","last_active":"2024-09-11T22:20:27.049164+0000","last_peered":"2024-09-11T22:20:27.049164+0000","last_clean":"2024-09-11T22:20:27.049164+0000","last_became_active":"2024-09-11T22:20:19.860076+0000","last_became_peered":"2024-09-11T22:20:19.860076+0000","last_unstale":"2024-09-11T22:20:27.049164+0000","last_undegraded":"2024-09-11T22:20:27.049164+0000","last_fullsized":"2024-09-11T22:20:27.049164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025282+0000","last_change":"2024-09-11T22:20:18.856020+0000","last_active":"2024-09-11T22:21:01.025282+0000","last_peered":"2024-09-11T22:21:01.025282+0000","last_clean":"2024-09-11T22:21:01.025282+0000","last_became_active":"2024-09-11T22:20:18.855753+0000","last_became_peered":"2024-09-11T22:20:18.855753+0000","last_unstale":"2024-09-11T22:21:01.025282+0000","last_undegraded":"2024-09-11T22:21:01.025282+0000","last_fullsized":"2024-09-11T22:21:01.025282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888726+0000","last_change":"2024-09-11T22:20:24.077975+0000","last_active":"2024-09-11T22:20:24.888726+0000","last_peered":"2024-09-11T22:20:24.888726+0000","last_clean":"2024-09-11T22:20:24.888726+0000","last_became_active":"2024-09-11T22:20:24.077502+0000","last_became_peered":"2024-09-11T22:20:24.077502+0000","last_unstale":"2024-09-11T22:20:24.888726+0000","last_undegraded":"2024-09-11T22:20:24.888726+0000","last_fullsized":"2024-09-11T22:20:24.888726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:16.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047781+0000","last_change":"2024-09-11T22:20:19.856986+0000","last_active":"2024-09-11T22:20:27.047781+0000","last_peered":"2024-09-11T22:20:27.047781+0000","last_clean":"2024-09-11T22:20:27.047781+0000","last_became_active":"2024-09-11T22:20:19.856739+0000","last_became_peered":"2024-09-11T22:20:19.856739+0000","last_unstale":"2024-09-11T22:20:27.047781+0000","last_undegraded":"2024-09-11T22:20:27.047781+0000","last_fullsized":"2024-09-11T22:20:27.047781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048583+0000","last_change":"2024-09-11T22:20:18.855044+0000","last_active":"2024-09-11T22:20:27.048583+0000","last_peered":"2024-09-11T22:20:27.048583+0000","last_clean":"2024-09-11T22:20:27.048583+0000","last_became_active":"2024-09-11T22:20:18.854764+0000","last_became_peered":"2024-09-11T22:20:18.854764+0000","last_unstale":"2024-09-11T22:20:27.048583+0000","last_undegraded":"2024-09-11T22:20:27.048583+0000","last_fullsized":"2024-09-11T22:20:27.048583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:22.207278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047516+0000","last_change":"2024-09-11T22:20:23.878383+0000","last_active":"2024-09-11T22:20:27.047516+0000","last_peered":"2024-09-11T22:20:27.047516+0000","last_clean":"2024-09-11T22:20:27.047516+0000","last_became_active":"2024-09-11T22:20:23.877890+0000","last_became_peered":"2024-09-11T22:20:23.877890+0000","last_unstale":"2024-09-11T22:20:27.047516+0000","last_undegraded":"2024-09-11T22:20:27.047516+0000","last_fullsized":"2024-09-11T22:20:27.047516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:18.876485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048434+0000","last_change":"2024-09-11T22:20:19.861242+0000","last_active":"2024-09-11T22:20:27.048434+0000","last_peered":"2024-09-11T22:20:27.048434+0000","last_clean":"2024-09-11T22:20:27.048434+0000","last_became_active":"2024-09-11T22:20:19.860988+0000","last_became_peered":"2024-09-11T22:20:19.860988+0000","last_unstale":"2024-09-11T22:20:27.048434+0000","last_undegraded":"2024-09-11T22:20:27.048434+0000","last_fullsized":"2024-09-11T22:20:27.048434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.024956+0000","last_change":"2024-09-11T22:20:18.852459+0000","last_active":"2024-09-11T22:21:01.024956+0000","last_peered":"2024-09-11T22:21:01.024956+0000","last_clean":"2024-09-11T22:21:01.024956+0000","last_became_active":"2024-09-11T22:20:18.852153+0000","last_became_peered":"2024-09-11T22:20:18.852153+0000","last_unstale":"2024-09-11T22:21:01.024956+0000","last_undegraded":"2024-09-11T22:21:01.024956+0000","last_fullsized":"2024-09-11T22:21:01.024956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033546+0000","last_change":"2024-09-11T22:20:23.874062+0000","last_active":"2024-09-11T22:21:01.033546+0000","last_peered":"2024-09-11T22:21:01.033546+0000","last_clean":"2024-09-11T22:21:01.033546+0000","last_became_active":"2024-09-11T22:20:23.873635+0000","last_became_peered":"2024-09-11T22:20:23.873635+0000","last_unstale":"2024-09-11T22:21:01.033546+0000","last_undegraded":"2024-09-11T22:21:01.033546+0000","last_fullsized":"2024-09-11T22:21:01.033546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:40.914142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888125+0000","last_change":"2024-09-11T22:20:19.851577+0000","last_active":"2024-09-11T22:20:24.888125+0000","last_peered":"2024-09-11T22:20:24.888125+0000","last_clean":"2024-09-11T22:20:24.888125+0000","last_became_active":"2024-09-11T22:20:19.851286+0000","last_became_peered":"2024-09-11T22:20:19.851286+0000","last_unstale":"2024-09-11T22:20:24.888125+0000","last_undegraded":"2024-09-11T22:20:24.888125+0000","last_fullsized":"2024-09-11T22:20:24.888125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:32.025931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.968016+0000","last_change":"2024-09-11T22:20:18.853301+0000","last_active":"2024-09-11T22:20:52.968016+0000","last_peered":"2024-09-11T22:20:52.968016+0000","last_clean":"2024-09-11T22:20:52.968016+0000","last_became_active":"2024-09-11T22:20:18.852978+0000","last_became_peered":"2024-09-11T22:20:18.852978+0000","last_unstale":"2024-09-11T22:20:52.968016+0000","last_undegraded":"2024-09-11T22:20:52.968016+0000","last_fullsized":"2024-09-11T22:20:52.968016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888069+0000","last_change":"2024-09-11T22:20:24.077636+0000","last_active":"2024-09-11T22:20:24.888069+0000","last_peered":"2024-09-11T22:20:24.888069+0000","last_clean":"2024-09-11T22:20:24.888069+0000","last_became_active":"2024-09-11T22:20:24.077313+0000","last_became_peered":"2024-09-11T22:20:24.077313+0000","last_unstale":"2024-09-11T22:20:24.888069+0000","last_undegraded":"2024-09-11T22:20:24.888069+0000","last_fullsized":"2024-09-11T22:20:24.888069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:23.154027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048723+0000","last_change":"2024-09-11T22:20:19.862562+0000","last_active":"2024-09-11T22:20:27.048723+0000","last_peered":"2024-09-11T22:20:27.048723+0000","last_clean":"2024-09-11T22:20:27.048723+0000","last_became_active":"2024-09-11T22:20:19.862267+0000","last_became_peered":"2024-09-11T22:20:19.862267+0000","last_unstale":"2024-09-11T22:20:27.048723+0000","last_undegraded":"2024-09-11T22:20:27.048723+0000","last_fullsized":"2024-09-11T22:20:27.048723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.948867+0000","last_change":"2024-09-11T22:20:18.858002+0000","last_active":"2024-09-11T22:20:46.948867+0000","last_peered":"2024-09-11T22:20:46.948867+0000","last_clean":"2024-09-11T22:20:46.948867+0000","last_became_active":"2024-09-11T22:20:18.857419+0000","last_became_peered":"2024-09-11T22:20:18.857419+0000","last_unstale":"2024-09-11T22:20:46.948867+0000","last_undegraded":"2024-09-11T22:20:46.948867+0000","last_fullsized":"2024-09-11T22:20:46.948867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887723+0000","last_change":"2024-09-11T22:20:24.074971+0000","last_active":"2024-09-11T22:20:24.887723+0000","last_peered":"2024-09-11T22:20:24.887723+0000","last_clean":"2024-09-11T22:20:24.887723+0000","last_became_active":"2024-09-11T22:20:24.074609+0000","last_became_peered":"2024-09-11T22:20:24.074609+0000","last_unstale":"2024-09-11T22:20:24.887723+0000","last_undegraded":"2024-09-11T22:20:24.887723+0000","last_fullsized":"2024-09-11T22:20:24.887723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:55.318904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033588+0000","last_change":"2024-09-11T22:20:19.857276+0000","last_active":"2024-09-11T22:21:01.033588+0000","last_peered":"2024-09-11T22:21:01.033588+0000","last_clean":"2024-09-11T22:21:01.033588+0000","last_became_active":"2024-09-11T22:20:19.857027+0000","last_became_peered":"2024-09-11T22:20:19.857027+0000","last_unstale":"2024-09-11T22:21:01.033588+0000","last_undegraded":"2024-09-11T22:21:01.033588+0000","last_fullsized":"2024-09-11T22:21:01.033588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033832+0000","last_change":"2024-09-11T22:20:18.848671+0000","last_active":"2024-09-11T22:21:01.033832+0000","last_peered":"2024-09-11T22:21:01.033832+0000","last_clean":"2024-09-11T22:21:01.033832+0000","last_became_active":"2024-09-11T22:20:18.848405+0000","last_became_peered":"2024-09-11T22:20:18.848405+0000","last_unstale":"2024-09-11T22:21:01.033832+0000","last_undegraded":"2024-09-11T22:21:01.033832+0000","last_fullsized":"2024-09-11T22:21:01.033832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890660+0000","last_change":"2024-09-11T22:20:24.076835+0000","last_active":"2024-09-11T22:20:24.890660+0000","last_peered":"2024-09-11T22:20:24.890660+0000","last_clean":"2024-09-11T22:20:24.890660+0000","last_became_active":"2024-09-11T22:20:24.076200+0000","last_became_peered":"2024-09-11T22:20:24.076200+0000","last_unstale":"2024-09-11T22:20:24.890660+0000","last_undegraded":"2024-09-11T22:20:24.890660+0000","last_fullsized":"2024-09-11T22:20:24.890660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:48.150778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048503+0000","last_change":"2024-09-11T22:20:19.855334+0000","last_active":"2024-09-11T22:20:27.048503+0000","last_peered":"2024-09-11T22:20:27.048503+0000","last_clean":"2024-09-11T22:20:27.048503+0000","last_became_active":"2024-09-11T22:20:19.855018+0000","last_became_peered":"2024-09-11T22:20:19.855018+0000","last_unstale":"2024-09-11T22:20:27.048503+0000","last_undegraded":"2024-09-11T22:20:27.048503+0000","last_fullsized":"2024-09-11T22:20:27.048503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'11","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.946283+0000","last_change":"2024-09-11T22:20:18.855665+0000","last_active":"2024-09-11T22:20:46.946283+0000","last_peered":"2024-09-11T22:20:46.946283+0000","last_clean":"2024-09-11T22:20:46.946283+0000","last_became_active":"2024-09-11T22:20:18.855386+0000","last_became_peered":"2024-09-11T22:20:18.855386+0000","last_unstale":"2024-09-11T22:20:46.946283+0000","last_undegraded":"2024-09-11T22:20:46.946283+0000","last_fullsized":"2024-09-11T22:20:46.946283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998100+0000","last_change":"2024-09-11T22:20:23.880793+0000","last_active":"2024-09-11T22:20:24.998100+0000","last_peered":"2024-09-11T22:20:24.998100+0000","last_clean":"2024-09-11T22:20:24.998100+0000","last_became_active":"2024-09-11T22:20:23.879993+0000","last_became_peered":"2024-09-11T22:20:23.879993+0000","last_unstale":"2024-09-11T22:20:24.998100+0000","last_undegraded":"2024-09-11T22:20:24.998100+0000","last_fullsized":"2024-09-11T22:20:24.998100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:50.449090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048075+0000","last_change":"2024-09-11T22:20:19.858588+0000","last_active":"2024-09-11T22:20:27.048075+0000","last_peered":"2024-09-11T22:20:27.048075+0000","last_clean":"2024-09-11T22:20:27.048075+0000","last_became_active":"2024-09-11T22:20:19.858322+0000","last_became_peered":"2024-09-11T22:20:19.858322+0000","last_unstale":"2024-09-11T22:20:27.048075+0000","last_undegraded":"2024-09-11T22:20:27.048075+0000","last_fullsized":"2024-09-11T22:20:27.048075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998118+0000","last_change":"2024-09-11T22:20:18.855056+0000","last_active":"2024-09-11T22:20:24.998118+0000","last_peered":"2024-09-11T22:20:24.998118+0000","last_clean":"2024-09-11T22:20:24.998118+0000","last_became_active":"2024-09-11T22:20:18.854784+0000","last_became_peered":"2024-09-11T22:20:18.854784+0000","last_unstale":"2024-09-11T22:20:24.998118+0000","last_undegraded":"2024-09-11T22:20:24.998118+0000","last_fullsized":"2024-09-11T22:20:24.998118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:38.916121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048044+0000","last_change":"2024-09-11T22:20:23.879768+0000","last_active":"2024-09-11T22:20:27.048044+0000","last_peered":"2024-09-11T22:20:27.048044+0000","last_clean":"2024-09-11T22:20:27.048044+0000","last_became_active":"2024-09-11T22:20:23.878794+0000","last_became_peered":"2024-09-11T22:20:23.878794+0000","last_unstale":"2024-09-11T22:20:27.048044+0000","last_undegraded":"2024-09-11T22:20:27.048044+0000","last_fullsized":"2024-09-11T22:20:27.048044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:07.301587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-11T22:20:27.048280+0000","last_change":"2024-09-11T22:21:01.034302+0000","last_active":"2024-09-11T22:21:01.034302+0000","last_peered":"2024-09-11T22:20:27.048280+0000","last_clean":"2024-09-11T22:20:27.048280+0000","last_became_active":"2024-09-11T22:20:19.861607+0000","last_became_peered":"2024-09-11T22:20:19.861607+0000","last_unstale":"2024-09-11T22:20:27.048280+0000","last_undegraded":"2024-09-11T22:20:27.048280+0000","last_fullsized":"2024-09-11T22:20:27.048280+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.946689+0000","last_change":"2024-09-11T22:20:18.853382+0000","last_active":"2024-09-11T22:20:46.946689+0000","last_peered":"2024-09-11T22:20:46.946689+0000","last_clean":"2024-09-11T22:20:46.946689+0000","last_became_active":"2024-09-11T22:20:18.853103+0000","last_became_peered":"2024-09-11T22:20:18.853103+0000","last_unstale":"2024-09-11T22:20:46.946689+0000","last_undegraded":"2024-09-11T22:20:46.946689+0000","last_fullsized":"2024-09-11T22:20:46.946689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887490+0000","last_change":"2024-09-11T22:20:23.876997+0000","last_active":"2024-09-11T22:20:24.887490+0000","last_peered":"2024-09-11T22:20:24.887490+0000","last_clean":"2024-09-11T22:20:24.887490+0000","last_became_active":"2024-09-11T22:20:23.876587+0000","last_became_peered":"2024-09-11T22:20:23.876587+0000","last_unstale":"2024-09-11T22:20:24.887490+0000","last_undegraded":"2024-09-11T22:20:24.887490+0000","last_fullsized":"2024-09-11T22:20:24.887490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:19.670665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889342+0000","last_change":"2024-09-11T22:20:19.866624+0000","last_active":"2024-09-11T22:20:24.889342+0000","last_peered":"2024-09-11T22:20:24.889342+0000","last_clean":"2024-09-11T22:20:24.889342+0000","last_became_active":"2024-09-11T22:20:19.866303+0000","last_became_peered":"2024-09-11T22:20:19.866303+0000","last_unstale":"2024-09-11T22:20:24.889342+0000","last_undegraded":"2024-09-11T22:20:24.889342+0000","last_fullsized":"2024-09-11T22:20:24.889342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.946175+0000","last_change":"2024-09-11T22:20:18.854361+0000","last_active":"2024-09-11T22:20:46.946175+0000","last_peered":"2024-09-11T22:20:46.946175+0000","last_clean":"2024-09-11T22:20:46.946175+0000","last_became_active":"2024-09-11T22:20:18.854019+0000","last_became_peered":"2024-09-11T22:20:18.854019+0000","last_unstale":"2024-09-11T22:20:46.946175+0000","last_undegraded":"2024-09-11T22:20:46.946175+0000","last_fullsized":"2024-09-11T22:20:46.946175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887284+0000","last_change":"2024-09-11T22:20:24.077476+0000","last_active":"2024-09-11T22:20:24.887284+0000","last_peered":"2024-09-11T22:20:24.887284+0000","last_clean":"2024-09-11T22:20:24.887284+0000","last_became_active":"2024-09-11T22:20:24.077134+0000","last_became_peered":"2024-09-11T22:20:24.077134+0000","last_unstale":"2024-09-11T22:20:24.887284+0000","last_undegraded":"2024-09-11T22:20:24.887284+0000","last_fullsized":"2024-09-11T22:20:24.887284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:03.186460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-11T22:20:27.048088+0000","last_change":"2024-09-11T22:21:01.033206+0000","last_active":"2024-09-11T22:21:01.033206+0000","last_peered":"2024-09-11T22:20:27.048088+0000","last_clean":"2024-09-11T22:20:27.048088+0000","last_became_active":"2024-09-11T22:20:24.076592+0000","last_became_peered":"2024-09-11T22:20:24.076592+0000","last_unstale":"2024-09-11T22:20:27.048088+0000","last_undegraded":"2024-09-11T22:20:27.048088+0000","last_fullsized":"2024-09-11T22:20:27.048088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2,3,7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997676+0000","last_change":"2024-09-11T22:20:19.845776+0000","last_active":"2024-09-11T22:20:24.997676+0000","last_peered":"2024-09-11T22:20:24.997676+0000","last_clean":"2024-09-11T22:20:24.997676+0000","last_became_active":"2024-09-11T22:20:19.845425+0000","last_became_peered":"2024-09-11T22:20:19.845425+0000","last_unstale":"2024-09-11T22:20:24.997676+0000","last_undegraded":"2024-09-11T22:20:24.997676+0000","last_fullsized":"2024-09-11T22:20:24.997676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:07.187533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889087+0000","last_change":"2024-09-11T22:20:18.852446+0000","last_active":"2024-09-11T22:20:24.889087+0000","last_peered":"2024-09-11T22:20:24.889087+0000","last_clean":"2024-09-11T22:20:24.889087+0000","last_became_active":"2024-09-11T22:20:18.852155+0000","last_became_peered":"2024-09-11T22:20:18.852155+0000","last_unstale":"2024-09-11T22:20:24.889087+0000","last_undegraded":"2024-09-11T22:20:24.889087+0000","last_fullsized":"2024-09-11T22:20:24.889087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889233+0000","last_change":"2024-09-11T22:20:23.876503+0000","last_active":"2024-09-11T22:20:24.889233+0000","last_peered":"2024-09-11T22:20:24.889233+0000","last_clean":"2024-09-11T22:20:24.889233+0000","last_became_active":"2024-09-11T22:20:23.876100+0000","last_became_peered":"2024-09-11T22:20:23.876100+0000","last_unstale":"2024-09-11T22:20:24.889233+0000","last_undegraded":"2024-09-11T22:20:24.889233+0000","last_fullsized":"2024-09-11T22:20:24.889233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887311+0000","last_change":"2024-09-11T22:20:19.852606+0000","last_active":"2024-09-11T22:20:24.887311+0000","last_peered":"2024-09-11T22:20:24.887311+0000","last_clean":"2024-09-11T22:20:24.887311+0000","last_became_active":"2024-09-11T22:20:19.852333+0000","last_became_peered":"2024-09-11T22:20:19.852333+0000","last_unstale":"2024-09-11T22:20:24.887311+0000","last_undegraded":"2024-09-11T22:20:24.887311+0000","last_fullsized":"2024-09-11T22:20:24.887311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:56.940278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.965701+0000","last_change":"2024-09-11T22:20:18.853767+0000","last_active":"2024-09-11T22:20:52.965701+0000","last_peered":"2024-09-11T22:20:52.965701+0000","last_clean":"2024-09-11T22:20:52.965701+0000","last_became_active":"2024-09-11T22:20:18.853533+0000","last_became_peered":"2024-09-11T22:20:18.853533+0000","last_unstale":"2024-09-11T22:20:52.965701+0000","last_undegraded":"2024-09-11T22:20:52.965701+0000","last_fullsized":"2024-09-11T22:20:52.965701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:36.662271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.967351+0000","last_change":"2024-09-11T22:20:18.847133+0000","last_active":"2024-09-11T22:20:52.967351+0000","last_peered":"2024-09-11T22:20:52.967351+0000","last_clean":"2024-09-11T22:20:52.967351+0000","last_became_active":"2024-09-11T22:20:18.846321+0000","last_became_peered":"2024-09-11T22:20:18.846321+0000","last_unstale":"2024-09-11T22:20:52.967351+0000","last_undegraded":"2024-09-11T22:20:52.967351+0000","last_fullsized":"2024-09-11T22:20:52.967351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033751+0000","last_change":"2024-09-11T22:20:19.861445+0000","last_active":"2024-09-11T22:21:01.033751+0000","last_peered":"2024-09-11T22:21:01.033751+0000","last_clean":"2024-09-11T22:21:01.033751+0000","last_became_active":"2024-09-11T22:20:19.861154+0000","last_became_peered":"2024-09-11T22:20:19.861154+0000","last_unstale":"2024-09-11T22:21:01.033751+0000","last_undegraded":"2024-09-11T22:21:01.033751+0000","last_fullsized":"2024-09-11T22:21:01.033751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025275+0000","last_change":"2024-09-11T22:20:23.877973+0000","last_active":"2024-09-11T22:21:01.025275+0000","last_peered":"2024-09-11T22:21:01.025275+0000","last_clean":"2024-09-11T22:21:01.025275+0000","last_became_active":"2024-09-11T22:20:23.877578+0000","last_became_peered":"2024-09-11T22:20:23.877578+0000","last_unstale":"2024-09-11T22:21:01.025275+0000","last_undegraded":"2024-09-11T22:21:01.025275+0000","last_fullsized":"2024-09-11T22:21:01.025275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:27.826669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.948565+0000","last_change":"2024-09-11T22:20:18.854142+0000","last_active":"2024-09-11T22:20:46.948565+0000","last_peered":"2024-09-11T22:20:46.948565+0000","last_clean":"2024-09-11T22:20:46.948565+0000","last_became_active":"2024-09-11T22:20:18.853872+0000","last_became_peered":"2024-09-11T22:20:18.853872+0000","last_unstale":"2024-09-11T22:20:46.948565+0000","last_undegraded":"2024-09-11T22:20:46.948565+0000","last_fullsized":"2024-09-11T22:20:46.948565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:22.513242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047903+0000","last_change":"2024-09-11T22:20:19.852580+0000","last_active":"2024-09-11T22:20:27.047903+0000","last_peered":"2024-09-11T22:20:27.047903+0000","last_clean":"2024-09-11T22:20:27.047903+0000","last_became_active":"2024-09-11T22:20:19.850175+0000","last_became_peered":"2024-09-11T22:20:19.850175+0000","last_unstale":"2024-09-11T22:20:27.047903+0000","last_undegraded":"2024-09-11T22:20:27.047903+0000","last_fullsized":"2024-09-11T22:20:27.047903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:11.937256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887822+0000","last_change":"2024-09-11T22:20:23.878004+0000","last_active":"2024-09-11T22:20:24.887822+0000","last_peered":"2024-09-11T22:20:24.887822+0000","last_clean":"2024-09-11T22:20:24.887822+0000","last_became_active":"2024-09-11T22:20:23.876776+0000","last_became_peered":"2024-09-11T22:20:23.876776+0000","last_unstale":"2024-09-11T22:20:24.887822+0000","last_undegraded":"2024-09-11T22:20:24.887822+0000","last_fullsized":"2024-09-11T22:20:24.887822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:11.254248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887933+0000","last_change":"2024-09-11T22:20:19.853439+0000","last_active":"2024-09-11T22:20:24.887933+0000","last_peered":"2024-09-11T22:20:24.887933+0000","last_clean":"2024-09-11T22:20:24.887933+0000","last_became_active":"2024-09-11T22:20:19.852937+0000","last_became_peered":"2024-09-11T22:20:19.852937+0000","last_unstale":"2024-09-11T22:20:24.887933+0000","last_undegraded":"2024-09-11T22:20:24.887933+0000","last_fullsized":"2024-09-11T22:20:24.887933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025127+0000","last_change":"2024-09-11T22:20:19.861003+0000","last_active":"2024-09-11T22:21:01.025127+0000","last_peered":"2024-09-11T22:21:01.025127+0000","last_clean":"2024-09-11T22:21:01.025127+0000","last_became_active":"2024-09-11T22:20:19.860690+0000","last_became_peered":"2024-09-11T22:20:19.860690+0000","last_unstale":"2024-09-11T22:21:01.025127+0000","last_undegraded":"2024-09-11T22:21:01.025127+0000","last_fullsized":"2024-09-11T22:21:01.025127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889798+0000","last_change":"2024-09-11T22:20:19.856756+0000","last_active":"2024-09-11T22:20:24.889798+0000","last_peered":"2024-09-11T22:20:24.889798+0000","last_clean":"2024-09-11T22:20:24.889798+0000","last_became_active":"2024-09-11T22:20:19.856460+0000","last_became_peered":"2024-09-11T22:20:19.856460+0000","last_unstale":"2024-09-11T22:20:24.889798+0000","last_undegraded":"2024-09-11T22:20:24.889798+0000","last_fullsized":"2024-09-11T22:20:24.889798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033665+0000","last_change":"2024-09-11T22:20:19.855629+0000","last_active":"2024-09-11T22:21:01.033665+0000","last_peered":"2024-09-11T22:21:01.033665+0000","last_clean":"2024-09-11T22:21:01.033665+0000","last_became_active":"2024-09-11T22:20:19.855363+0000","last_became_peered":"2024-09-11T22:20:19.855363+0000","last_unstale":"2024-09-11T22:21:01.033665+0000","last_undegraded":"2024-09-11T22:21:01.033665+0000","last_fullsized":"2024-09-11T22:21:01.033665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887872+0000","last_change":"2024-09-11T22:20:19.863122+0000","last_active":"2024-09-11T22:20:24.887872+0000","last_peered":"2024-09-11T22:20:24.887872+0000","last_clean":"2024-09-11T22:20:24.887872+0000","last_became_active":"2024-09-11T22:20:19.862828+0000","last_became_peered":"2024-09-11T22:20:19.862828+0000","last_unstale":"2024-09-11T22:20:24.887872+0000","last_undegraded":"2024-09-11T22:20:24.887872+0000","last_fullsized":"2024-09-11T22:20:24.887872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:10.868762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997865+0000","last_change":"2024-09-11T22:20:19.846453+0000","last_active":"2024-09-11T22:20:24.997865+0000","last_peered":"2024-09-11T22:20:24.997865+0000","last_clean":"2024-09-11T22:20:24.997865+0000","last_became_active":"2024-09-11T22:20:19.846186+0000","last_became_peered":"2024-09-11T22:20:19.846186+0000","last_unstale":"2024-09-11T22:20:24.997865+0000","last_undegraded":"2024-09-11T22:20:24.997865+0000","last_fullsized":"2024-09-11T22:20:24.997865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:24.032365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888935+0000","last_change":"2024-09-11T22:20:19.860632+0000","last_active":"2024-09-11T22:20:24.888935+0000","last_peered":"2024-09-11T22:20:24.888935+0000","last_clean":"2024-09-11T22:20:24.888935+0000","last_became_active":"2024-09-11T22:20:19.860005+0000","last_became_peered":"2024-09-11T22:20:19.860005+0000","last_unstale":"2024-09-11T22:20:24.888935+0000","last_undegraded":"2024-09-11T22:20:24.888935+0000","last_fullsized":"2024-09-11T22:20:24.888935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888034+0000","last_change":"2024-09-11T22:20:19.859195+0000","last_active":"2024-09-11T22:20:24.888034+0000","last_peered":"2024-09-11T22:20:24.888034+0000","last_clean":"2024-09-11T22:20:24.888034+0000","last_became_active":"2024-09-11T22:20:19.858832+0000","last_became_peered":"2024-09-11T22:20:19.858832+0000","last_unstale":"2024-09-11T22:20:24.888034+0000","last_undegraded":"2024-09-11T22:20:24.888034+0000","last_fullsized":"2024-09-11T22:20:24.888034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:56.259074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888950+0000","last_change":"2024-09-11T22:20:19.858969+0000","last_active":"2024-09-11T22:20:24.888950+0000","last_peered":"2024-09-11T22:20:24.888950+0000","last_clean":"2024-09-11T22:20:24.888950+0000","last_became_active":"2024-09-11T22:20:19.857847+0000","last_became_peered":"2024-09-11T22:20:19.857847+0000","last_unstale":"2024-09-11T22:20:24.888950+0000","last_undegraded":"2024-09-11T22:20:24.888950+0000","last_fullsized":"2024-09-11T22:20:24.888950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887453+0000","last_change":"2024-09-11T22:20:19.863294+0000","last_active":"2024-09-11T22:20:24.887453+0000","last_peered":"2024-09-11T22:20:24.887453+0000","last_clean":"2024-09-11T22:20:24.887453+0000","last_became_active":"2024-09-11T22:20:19.863007+0000","last_became_peered":"2024-09-11T22:20:19.863007+0000","last_unstale":"2024-09-11T22:20:24.887453+0000","last_undegraded":"2024-09-11T22:20:24.887453+0000","last_fullsized":"2024-09-11T22:20:24.887453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:06.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889706+0000","last_change":"2024-09-11T22:20:19.858414+0000","last_active":"2024-09-11T22:20:24.889706+0000","last_peered":"2024-09-11T22:20:24.889706+0000","last_clean":"2024-09-11T22:20:24.889706+0000","last_became_active":"2024-09-11T22:20:19.857790+0000","last_became_peered":"2024-09-11T22:20:19.857790+0000","last_unstale":"2024-09-11T22:20:24.889706+0000","last_undegraded":"2024-09-11T22:20:24.889706+0000","last_fullsized":"2024-09-11T22:20:24.889706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":2,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-11T22:20:27.047940+0000","last_change":"2024-09-11T22:21:01.323256+0000","last_active":"2024-09-11T22:21:01.323256+0000","last_peered":"2024-09-11T22:20:27.047940+0000","last_clean":"2024-09-11T22:20:27.047940+0000","last_became_active":"2024-09-11T22:20:19.854774+0000","last_became_peered":"2024-09-11T22:20:19.854774+0000","last_unstale":"2024-09-11T22:20:27.047940+0000","last_undegraded":"2024-09-11T22:20:27.047940+0000","last_fullsized":"2024-09-11T22:20:27.047940+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888845+0000","last_change":"2024-09-11T22:20:19.864700+0000","last_active":"2024-09-11T22:20:24.888845+0000","last_peered":"2024-09-11T22:20:24.888845+0000","last_clean":"2024-09-11T22:20:24.888845+0000","last_became_active":"2024-09-11T22:20:19.862296+0000","last_became_peered":"2024-09-11T22:20:19.862296+0000","last_unstale":"2024-09-11T22:20:24.888845+0000","last_undegraded":"2024-09-11T22:20:24.888845+0000","last_fullsized":"2024-09-11T22:20:24.888845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048773+0000","last_change":"2024-09-11T22:20:19.855253+0000","last_active":"2024-09-11T22:20:27.048773+0000","last_peered":"2024-09-11T22:20:27.048773+0000","last_clean":"2024-09-11T22:20:27.048773+0000","last_became_active":"2024-09-11T22:20:19.854970+0000","last_became_peered":"2024-09-11T22:20:19.854970+0000","last_unstale":"2024-09-11T22:20:27.048773+0000","last_undegraded":"2024-09-11T22:20:27.048773+0000","last_fullsized":"2024-09-11T22:20:27.048773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025225+0000","last_change":"2024-09-11T22:20:19.850202+0000","last_active":"2024-09-11T22:21:01.025225+0000","last_peered":"2024-09-11T22:21:01.025225+0000","last_clean":"2024-09-11T22:21:01.025225+0000","last_became_active":"2024-09-11T22:20:19.849815+0000","last_became_peered":"2024-09-11T22:20:19.849815+0000","last_unstale":"2024-09-11T22:21:01.025225+0000","last_undegraded":"2024-09-11T22:21:01.025225+0000","last_fullsized":"2024-09-11T22:21:01.025225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:56.480679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889814+0000","last_change":"2024-09-11T22:20:19.866864+0000","last_active":"2024-09-11T22:20:24.889814+0000","last_peered":"2024-09-11T22:20:24.889814+0000","last_clean":"2024-09-11T22:20:24.889814+0000","last_became_active":"2024-09-11T22:20:19.866484+0000","last_became_peered":"2024-09-11T22:20:19.866484+0000","last_unstale":"2024-09-11T22:20:24.889814+0000","last_undegraded":"2024-09-11T22:20:24.889814+0000","last_fullsized":"2024-09-11T22:20:24.889814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":2,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-11T22:20:19.847772+0000","last_change":"2024-09-11T22:21:01.323220+0000","last_active":"2024-09-11T22:20:18.828308+0000","last_peered":"2024-09-11T22:20:18.828308+0000","last_clean":"2024-09-11T22:20:18.828308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:19.847772+0000","last_undegraded":"2024-09-11T22:20:19.847772+0000","last_fullsized":"2024-09-11T22:20:19.847772+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997750+0000","last_change":"2024-09-11T22:20:19.860050+0000","last_active":"2024-09-11T22:20:24.997750+0000","last_peered":"2024-09-11T22:20:24.997750+0000","last_clean":"2024-09-11T22:20:24.997750+0000","last_became_active":"2024-09-11T22:20:19.859755+0000","last_became_peered":"2024-09-11T22:20:19.859755+0000","last_unstale":"2024-09-11T22:20:24.997750+0000","last_undegraded":"2024-09-11T22:20:24.997750+0000","last_fullsized":"2024-09-11T22:20:24.997750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:42.487669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033495+0000","last_change":"2024-09-11T22:20:19.853902+0000","last_active":"2024-09-11T22:21:01.033495+0000","last_peered":"2024-09-11T22:21:01.033495+0000","last_clean":"2024-09-11T22:21:01.033495+0000","last_became_active":"2024-09-11T22:20:19.853563+0000","last_became_peered":"2024-09-11T22:20:19.853563+0000","last_unstale":"2024-09-11T22:21:01.033495+0000","last_undegraded":"2024-09-11T22:21:01.033495+0000","last_fullsized":"2024-09-11T22:21:01.033495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887571+0000","last_change":"2024-09-11T22:20:19.849490+0000","last_active":"2024-09-11T22:20:24.887571+0000","last_peered":"2024-09-11T22:20:24.887571+0000","last_clean":"2024-09-11T22:20:24.887571+0000","last_became_active":"2024-09-11T22:20:19.848965+0000","last_became_peered":"2024-09-11T22:20:19.848965+0000","last_unstale":"2024-09-11T22:20:24.887571+0000","last_undegraded":"2024-09-11T22:20:24.887571+0000","last_fullsized":"2024-09-11T22:20:24.887571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:10.387663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048041+0000","last_change":"2024-09-11T22:20:19.860457+0000","last_active":"2024-09-11T22:20:27.048041+0000","last_peered":"2024-09-11T22:20:27.048041+0000","last_clean":"2024-09-11T22:20:27.048041+0000","last_became_active":"2024-09-11T22:20:19.858887+0000","last_became_peered":"2024-09-11T22:20:19.858887+0000","last_unstale":"2024-09-11T22:20:27.048041+0000","last_undegraded":"2024-09-11T22:20:27.048041+0000","last_fullsized":"2024-09-11T22:20:27.048041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:34.620956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888481+0000","last_change":"2024-09-11T22:20:19.862347+0000","last_active":"2024-09-11T22:20:24.888481+0000","last_peered":"2024-09-11T22:20:24.888481+0000","last_clean":"2024-09-11T22:20:24.888481+0000","last_became_active":"2024-09-11T22:20:19.861965+0000","last_became_peered":"2024-09-11T22:20:19.861965+0000","last_unstale":"2024-09-11T22:20:24.888481+0000","last_undegraded":"2024-09-11T22:20:24.888481+0000","last_fullsized":"2024-09-11T22:20:24.888481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888938+0000","last_change":"2024-09-11T22:20:19.862065+0000","last_active":"2024-09-11T22:20:24.888938+0000","last_peered":"2024-09-11T22:20:24.888938+0000","last_clean":"2024-09-11T22:20:24.888938+0000","last_became_active":"2024-09-11T22:20:19.861765+0000","last_became_peered":"2024-09-11T22:20:19.861765+0000","last_unstale":"2024-09-11T22:20:24.888938+0000","last_undegraded":"2024-09-11T22:20:24.888938+0000","last_fullsized":"2024-09-11T22:20:24.888938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.049117+0000","last_change":"2024-09-11T22:20:19.865064+0000","last_active":"2024-09-11T22:20:27.049117+0000","last_peered":"2024-09-11T22:20:27.049117+0000","last_clean":"2024-09-11T22:20:27.049117+0000","last_became_active":"2024-09-11T22:20:19.864697+0000","last_became_peered":"2024-09-11T22:20:19.864697+0000","last_unstale":"2024-09-11T22:20:27.049117+0000","last_undegraded":"2024-09-11T22:20:27.049117+0000","last_fullsized":"2024-09-11T22:20:27.049117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887201+0000","last_change":"2024-09-11T22:20:19.861293+0000","last_active":"2024-09-11T22:20:24.887201+0000","last_peered":"2024-09-11T22:20:24.887201+0000","last_clean":"2024-09-11T22:20:24.887201+0000","last_became_active":"2024-09-11T22:20:19.861013+0000","last_became_peered":"2024-09-11T22:20:19.861013+0000","last_unstale":"2024-09-11T22:20:24.887201+0000","last_undegraded":"2024-09-11T22:20:24.887201+0000","last_fullsized":"2024-09-11T22:20:24.887201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:13.178404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048303+0000","last_change":"2024-09-11T22:20:19.858131+0000","last_active":"2024-09-11T22:20:27.048303+0000","last_peered":"2024-09-11T22:20:27.048303+0000","last_clean":"2024-09-11T22:20:27.048303+0000","last_became_active":"2024-09-11T22:20:19.857842+0000","last_became_peered":"2024-09-11T22:20:19.857842+0000","last_unstale":"2024-09-11T22:20:27.048303+0000","last_undegraded":"2024-09-11T22:20:27.048303+0000","last_fullsized":"2024-09-11T22:20:27.048303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889602+0000","last_change":"2024-09-11T22:20:19.859667+0000","last_active":"2024-09-11T22:20:24.889602+0000","last_peered":"2024-09-11T22:20:24.889602+0000","last_clean":"2024-09-11T22:20:24.889602+0000","last_became_active":"2024-09-11T22:20:19.859306+0000","last_became_peered":"2024-09-11T22:20:19.859306+0000","last_unstale":"2024-09-11T22:20:24.889602+0000","last_undegraded":"2024-09-11T22:20:24.889602+0000","last_fullsized":"2024-09-11T22:20:24.889602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048551+0000","last_change":"2024-09-11T22:20:19.848821+0000","last_active":"2024-09-11T22:20:27.048551+0000","last_peered":"2024-09-11T22:20:27.048551+0000","last_clean":"2024-09-11T22:20:27.048551+0000","last_became_active":"2024-09-11T22:20:19.848531+0000","last_became_peered":"2024-09-11T22:20:19.848531+0000","last_unstale":"2024-09-11T22:20:27.048551+0000","last_undegraded":"2024-09-11T22:20:27.048551+0000","last_fullsized":"2024-09-11T22:20:27.048551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890212+0000","last_change":"2024-09-11T22:20:19.866300+0000","last_active":"2024-09-11T22:20:24.890212+0000","last_peered":"2024-09-11T22:20:24.890212+0000","last_clean":"2024-09-11T22:20:24.890212+0000","last_became_active":"2024-09-11T22:20:19.865939+0000","last_became_peered":"2024-09-11T22:20:19.865939+0000","last_unstale":"2024-09-11T22:20:24.890212+0000","last_undegraded":"2024-09-11T22:20:24.890212+0000","last_fullsized":"2024-09-11T22:20:24.890212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033602+0000","last_change":"2024-09-11T22:20:19.858144+0000","last_active":"2024-09-11T22:21:01.033602+0000","last_peered":"2024-09-11T22:21:01.033602+0000","last_clean":"2024-09-11T22:21:01.033602+0000","last_became_active":"2024-09-11T22:20:19.857840+0000","last_became_peered":"2024-09-11T22:20:19.857840+0000","last_unstale":"2024-09-11T22:21:01.033602+0000","last_undegraded":"2024-09-11T22:21:01.033602+0000","last_fullsized":"2024-09-11T22:21:01.033602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:23.801072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998195+0000","last_change":"2024-09-11T22:20:19.857378+0000","last_active":"2024-09-11T22:20:24.998195+0000","last_peered":"2024-09-11T22:20:24.998195+0000","last_clean":"2024-09-11T22:20:24.998195+0000","last_became_active":"2024-09-11T22:20:19.857089+0000","last_became_peered":"2024-09-11T22:20:19.857089+0000","last_unstale":"2024-09-11T22:20:24.998195+0000","last_undegraded":"2024-09-11T22:20:24.998195+0000","last_fullsized":"2024-09-11T22:20:24.998195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:29.835695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":2,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-11T22:20:19.843776+0000","last_change":"2024-09-11T22:21:01.323294+0000","last_active":"2024-09-11T22:20:18.828308+0000","last_peered":"2024-09-11T22:20:18.828308+0000","last_clean":"2024-09-11T22:20:18.828308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:19.843776+0000","last_undegraded":"2024-09-11T22:20:19.843776+0000","last_fullsized":"2024-09-11T22:20:19.843776+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7454,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":699002,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":111840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":108696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":108032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":111874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":108136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":698346,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":108262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:21:02.202 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:21:02.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.336+0000 7f82714dd640 1 Processor -- start 2024-09-11T22:21:02.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.336+0000 7f82714dd640 1 -- start start 2024-09-11T22:21:02.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.337+0000 7f82714dd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f826c0c68a0 0x7f826c06e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:02.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.337+0000 7f82714dd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f826c0c7320 0x7f826c1513b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:02.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.337+0000 7f82714dd640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f826c0c49e0 con 0x7f826c0c64c0 2024-09-11T22:21:02.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.337+0000 7f82714dd640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f826c06d4c0 con 0x7f826c0c7320 2024-09-11T22:21:02.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.337+0000 7f82714dd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f826c06c6e0 con 0x7f826c0c68a0 2024-09-11T22:21:02.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.337+0000 7f826b7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f826c0c7320 0x7f826c1513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:02.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.337+0000 7f826affd640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f826c0c64c0 0x7f826c15b5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59608/0 (socket says 172.21.15.100:59608) 2024-09-11T22:21:02.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.337+0000 7f826affd640 1 -- 172.21.15.100:0/758739907 learned_addr learned my addr 172.21.15.100:0/758739907 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:21:02.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.337+0000 7f826b7fe640 1 -- 172.21.15.100:0/758739907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f826c0c68a0 msgr2=0x7f826c06e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:02.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.337+0000 7f826b7fe640 1 --2- 172.21.15.100:0/758739907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f826c0c68a0 0x7f826c06e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.337+0000 7f826b7fe640 1 -- 172.21.15.100:0/758739907 >> v1:172.21.15.100:6789/0 conn(0x7f826c0c64c0 legacy=0x7f826c15b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:02.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.337+0000 7f826b7fe640 1 -- 172.21.15.100:0/758739907 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f826c06bdb0 con 0x7f826c0c7320 2024-09-11T22:21:02.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.337+0000 7f8269ffb640 1 -- 172.21.15.100:0/758739907 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3431721592 0 0) 0x7f826c0c49e0 con 0x7f826c0c64c0 2024-09-11T22:21:02.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.338+0000 7f826b7fe640 1 --2- 172.21.15.100:0/758739907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f826c0c7320 0x7f826c1513b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f826c06c860 tx=0x7f826402a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0540e9c1bc962dd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:02.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.338+0000 7f8269ffb640 1 -- 172.21.15.100:0/758739907 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8264007740 con 0x7f826c0c7320 2024-09-11T22:21:02.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.338+0000 7f8269ffb640 1 -- 172.21.15.100:0/758739907 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82640078e0 con 0x7f826c0c7320 2024-09-11T22:21:02.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.338+0000 7f8269ffb640 1 -- 172.21.15.100:0/758739907 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8264007cb0 con 0x7f826c0c7320 2024-09-11T22:21:02.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.339+0000 7f82714dd640 1 -- 172.21.15.100:0/758739907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f826c0c7320 msgr2=0x7f826c1513b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:02.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.339+0000 7f82714dd640 1 --2- 172.21.15.100:0/758739907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f826c0c7320 0x7f826c1513b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f826c06c860 tx=0x7f826402a6d0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.339+0000 7f82714dd640 1 -- 172.21.15.100:0/758739907 shutdown_connections 2024-09-11T22:21:02.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.339+0000 7f82714dd640 1 --2- 172.21.15.100:0/758739907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f826c0c7320 0x7f826c1513b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.339+0000 7f82714dd640 1 --2- 172.21.15.100:0/758739907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f826c0c68a0 0x7f826c06e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.339+0000 7f82714dd640 1 -- 172.21.15.100:0/758739907 >> 172.21.15.100:0/758739907 conn(0x7f826c0cd110 msgr2=0x7f826c0cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:02.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.339+0000 7f82714dd640 1 -- 172.21.15.100:0/758739907 shutdown_connections 2024-09-11T22:21:02.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.339+0000 7f82714dd640 1 -- 172.21.15.100:0/758739907 wait complete. 2024-09-11T22:21:02.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.340+0000 7f82714dd640 1 Processor -- start 2024-09-11T22:21:02.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.340+0000 7f82714dd640 1 -- start start 2024-09-11T22:21:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.341+0000 7f82714dd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f826c0c64c0 0x7f826c067bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.341+0000 7f82714dd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f826c0c68a0 0x7f826c1f1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.341+0000 7f82714dd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f826c0c7320 0x7f826c1f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:02.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.341+0000 7f82714dd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f826c06cb70 con 0x7f826c0c68a0 2024-09-11T22:21:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.341+0000 7f82714dd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f826c06c370 con 0x7f826c0c64c0 2024-09-11T22:21:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.341+0000 7f82714dd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f826c0c4610 con 0x7f826c0c7320 2024-09-11T22:21:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.341+0000 7f826a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f826c0c68a0 0x7f826c1f1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.341+0000 7f826a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f826c0c68a0 0x7f826c1f1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37952/0 (socket says 172.21.15.100:37952) 2024-09-11T22:21:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.341+0000 7f826a7fc640 1 -- 172.21.15.100:0/2818550904 learned_addr learned my addr 172.21.15.100:0/2818550904 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.341+0000 7f826affd640 1 --2- 172.21.15.100:0/2818550904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f826c0c64c0 0x7f826c067bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.341+0000 7f826b7fe640 1 --2- 172.21.15.100:0/2818550904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f826c0c7320 0x7f826c1f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.341+0000 7f826a7fc640 1 -- 172.21.15.100:0/2818550904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f826c0c7320 msgr2=0x7f826c1f2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.341+0000 7f826a7fc640 1 --2- 172.21.15.100:0/2818550904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f826c0c7320 0x7f826c1f2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.341+0000 7f826a7fc640 1 -- 172.21.15.100:0/2818550904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f826c0c64c0 msgr2=0x7f826c067bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.341+0000 7f826a7fc640 1 --2- 172.21.15.100:0/2818550904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f826c0c64c0 0x7f826c067bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.341+0000 7f826a7fc640 1 -- 172.21.15.100:0/2818550904 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f826c147e80 con 0x7f826c0c68a0 2024-09-11T22:21:02.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.341+0000 7f826a7fc640 1 --2- 172.21.15.100:0/2818550904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f826c0c68a0 0x7f826c1f1af0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f826000b480 tx=0x7f826000b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.342+0000 7f82537fe640 1 -- 172.21.15.100:0/2818550904 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8260014070 con 0x7f826c0c68a0 2024-09-11T22:21:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.342+0000 7f82537fe640 1 -- 172.21.15.100:0/2818550904 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8260010870 con 0x7f826c0c68a0 2024-09-11T22:21:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.342+0000 7f82714dd640 1 -- 172.21.15.100:0/2818550904 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f826c142e00 con 0x7f826c0c68a0 2024-09-11T22:21:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.342+0000 7f82537fe640 1 -- 172.21.15.100:0/2818550904 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8260010c60 con 0x7f826c0c68a0 2024-09-11T22:21:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.342+0000 7f82714dd640 1 -- 172.21.15.100:0/2818550904 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f826c1461e0 con 0x7f826c0c68a0 2024-09-11T22:21:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.343+0000 7f82714dd640 1 -- 172.21.15.100:0/2818550904 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f826c15b5d0 con 0x7f826c0c68a0 2024-09-11T22:21:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.343+0000 7f82537fe640 1 -- 172.21.15.100:0/2818550904 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8260017070 con 0x7f826c0c68a0 2024-09-11T22:21:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.343+0000 7f82537fe640 1 --2- 172.21.15.100:0/2818550904 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f825806be30 0x7f825806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.344+0000 7f82537fe640 1 -- 172.21.15.100:0/2818550904 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f826008b0c0 con 0x7f826c0c68a0 2024-09-11T22:21:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.344+0000 7f826affd640 1 --2- 172.21.15.100:0/2818550904 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f825806be30 0x7f825806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:02.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.344+0000 7f826affd640 1 --2- 172.21.15.100:0/2818550904 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f825806be30 0x7f825806e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f825c000f60 tx=0x7f825c007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:02.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.348+0000 7f82537fe640 1 -- 172.21.15.100:0/2818550904 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f82600596e0 con 0x7f826c0c68a0 2024-09-11T22:21:02.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.512+0000 7f82714dd640 1 -- 172.21.15.100:0/2818550904 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f826c147c30 con 0x7f825806be30 2024-09-11T22:21:02.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.519+0000 7f82537fe640 1 -- 172.21.15.100:0/2818550904 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332412 (secure 0 0 0) 0x7f826c147c30 con 0x7f825806be30 2024-09-11T22:21:02.524 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:21:02.527 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-11T22:21:02.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.523+0000 7f82714dd640 1 -- 172.21.15.100:0/2818550904 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f825806be30 msgr2=0x7f825806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:02.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.523+0000 7f82714dd640 1 --2- 172.21.15.100:0/2818550904 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f825806be30 0x7f825806e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f825c000f60 tx=0x7f825c007c00 comp rx=0 tx=0).stop 2024-09-11T22:21:02.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.523+0000 7f82714dd640 1 -- 172.21.15.100:0/2818550904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f826c0c68a0 msgr2=0x7f826c1f1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:02.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.523+0000 7f82714dd640 1 --2- 172.21.15.100:0/2818550904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f826c0c68a0 0x7f826c1f1af0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f826000b480 tx=0x7f826000b940 comp rx=0 tx=0).stop 2024-09-11T22:21:02.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.523+0000 7f82714dd640 1 -- 172.21.15.100:0/2818550904 shutdown_connections 2024-09-11T22:21:02.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.523+0000 7f82714dd640 1 --2- 172.21.15.100:0/2818550904 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f825806be30 0x7f825806e2f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.523+0000 7f82714dd640 1 --2- 172.21.15.100:0/2818550904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f826c0c7320 0x7f826c1f2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.523+0000 7f82714dd640 1 --2- 172.21.15.100:0/2818550904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f826c0c68a0 0x7f826c1f1af0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.523+0000 7f82714dd640 1 --2- 172.21.15.100:0/2818550904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f826c0c64c0 0x7f826c067bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.523+0000 7f82714dd640 1 -- 172.21.15.100:0/2818550904 >> 172.21.15.100:0/2818550904 conn(0x7f826c0cd110 msgr2=0x7f826c14ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:02.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.523+0000 7f82714dd640 1 -- 172.21.15.100:0/2818550904 shutdown_connections 2024-09-11T22:21:02.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.523+0000 7f82714dd640 1 -- 172.21.15.100:0/2818550904 wait complete. 2024-09-11T22:21:02.534 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-09-11T22:21:02.314004+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597822,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":287,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218592,"kb_used_data":2400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756128,"statfs":{"total":773094113280,"available":772870275072,"internally_reserved":0,"allocated":2457600,"data_stored":2054188,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":784,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001916"},"pg_stats":[{"pgid":"2.1f","version":"26'9","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.034259+0000","last_change":"2024-09-11T22:20:18.853007+0000","last_active":"2024-09-11T22:21:01.034259+0000","last_peered":"2024-09-11T22:21:01.034259+0000","last_clean":"2024-09-11T22:21:01.034259+0000","last_became_active":"2024-09-11T22:20:18.852740+0000","last_became_peered":"2024-09-11T22:20:18.852740+0000","last_unstale":"2024-09-11T22:21:01.034259+0000","last_undegraded":"2024-09-11T22:21:01.034259+0000","last_fullsized":"2024-09-11T22:21:01.034259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:46.710328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887920+0000","last_change":"2024-09-11T22:20:19.849765+0000","last_active":"2024-09-11T22:20:24.887920+0000","last_peered":"2024-09-11T22:20:24.887920+0000","last_clean":"2024-09-11T22:20:24.887920+0000","last_became_active":"2024-09-11T22:20:19.848619+0000","last_became_peered":"2024-09-11T22:20:19.848619+0000","last_unstale":"2024-09-11T22:20:24.887920+0000","last_undegraded":"2024-09-11T22:20:24.887920+0000","last_fullsized":"2024-09-11T22:20:24.887920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:57.621624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887250+0000","last_change":"2024-09-11T22:20:24.078618+0000","last_active":"2024-09-11T22:20:24.887250+0000","last_peered":"2024-09-11T22:20:24.887250+0000","last_clean":"2024-09-11T22:20:24.887250+0000","last_became_active":"2024-09-11T22:20:24.078283+0000","last_became_peered":"2024-09-11T22:20:24.078283+0000","last_unstale":"2024-09-11T22:20:24.887250+0000","last_undegraded":"2024-09-11T22:20:24.887250+0000","last_fullsized":"2024-09-11T22:20:24.887250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:01.901307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888040+0000","last_change":"2024-09-11T22:20:18.855945+0000","last_active":"2024-09-11T22:20:24.888040+0000","last_peered":"2024-09-11T22:20:24.888040+0000","last_clean":"2024-09-11T22:20:24.888040+0000","last_became_active":"2024-09-11T22:20:18.854811+0000","last_became_peered":"2024-09-11T22:20:18.854811+0000","last_unstale":"2024-09-11T22:20:24.888040+0000","last_undegraded":"2024-09-11T22:20:24.888040+0000","last_fullsized":"2024-09-11T22:20:24.888040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:47.508920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033442+0000","last_change":"2024-09-11T22:20:19.862436+0000","last_active":"2024-09-11T22:21:01.033442+0000","last_peered":"2024-09-11T22:21:01.033442+0000","last_clean":"2024-09-11T22:21:01.033442+0000","last_became_active":"2024-09-11T22:20:19.862061+0000","last_became_peered":"2024-09-11T22:20:19.862061+0000","last_unstale":"2024-09-11T22:21:01.033442+0000","last_undegraded":"2024-09-11T22:21:01.033442+0000","last_fullsized":"2024-09-11T22:21:01.033442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047627+0000","last_change":"2024-09-11T22:20:23.879729+0000","last_active":"2024-09-11T22:20:27.047627+0000","last_peered":"2024-09-11T22:20:27.047627+0000","last_clean":"2024-09-11T22:20:27.047627+0000","last_became_active":"2024-09-11T22:20:23.879245+0000","last_became_peered":"2024-09-11T22:20:23.879245+0000","last_unstale":"2024-09-11T22:20:27.047627+0000","last_undegraded":"2024-09-11T22:20:27.047627+0000","last_fullsized":"2024-09-11T22:20:27.047627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:36.836842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.964933+0000","last_change":"2024-09-11T22:20:18.853076+0000","last_active":"2024-09-11T22:20:52.964933+0000","last_peered":"2024-09-11T22:20:52.964933+0000","last_clean":"2024-09-11T22:20:52.964933+0000","last_became_active":"2024-09-11T22:20:18.852728+0000","last_became_peered":"2024-09-11T22:20:18.852728+0000","last_unstale":"2024-09-11T22:20:52.964933+0000","last_undegraded":"2024-09-11T22:20:52.964933+0000","last_fullsized":"2024-09-11T22:20:52.964933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890308+0000","last_change":"2024-09-11T22:20:19.864544+0000","last_active":"2024-09-11T22:20:24.890308+0000","last_peered":"2024-09-11T22:20:24.890308+0000","last_clean":"2024-09-11T22:20:24.890308+0000","last_became_active":"2024-09-11T22:20:19.864234+0000","last_became_peered":"2024-09-11T22:20:19.864234+0000","last_unstale":"2024-09-11T22:20:24.890308+0000","last_undegraded":"2024-09-11T22:20:24.890308+0000","last_fullsized":"2024-09-11T22:20:24.890308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048400+0000","last_change":"2024-09-11T22:20:23.873783+0000","last_active":"2024-09-11T22:20:27.048400+0000","last_peered":"2024-09-11T22:20:27.048400+0000","last_clean":"2024-09-11T22:20:27.048400+0000","last_became_active":"2024-09-11T22:20:23.873385+0000","last_became_peered":"2024-09-11T22:20:23.873385+0000","last_unstale":"2024-09-11T22:20:27.048400+0000","last_undegraded":"2024-09-11T22:20:27.048400+0000","last_fullsized":"2024-09-11T22:20:27.048400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048092+0000","last_change":"2024-09-11T22:20:18.861530+0000","last_active":"2024-09-11T22:20:27.048092+0000","last_peered":"2024-09-11T22:20:27.048092+0000","last_clean":"2024-09-11T22:20:27.048092+0000","last_became_active":"2024-09-11T22:20:18.861230+0000","last_became_peered":"2024-09-11T22:20:18.861230+0000","last_unstale":"2024-09-11T22:20:27.048092+0000","last_undegraded":"2024-09-11T22:20:27.048092+0000","last_fullsized":"2024-09-11T22:20:27.048092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890615+0000","last_change":"2024-09-11T22:20:19.863401+0000","last_active":"2024-09-11T22:20:24.890615+0000","last_peered":"2024-09-11T22:20:24.890615+0000","last_clean":"2024-09-11T22:20:24.890615+0000","last_became_active":"2024-09-11T22:20:19.863127+0000","last_became_peered":"2024-09-11T22:20:19.863127+0000","last_unstale":"2024-09-11T22:20:24.890615+0000","last_undegraded":"2024-09-11T22:20:24.890615+0000","last_fullsized":"2024-09-11T22:20:24.890615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:36.888544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048021+0000","last_change":"2024-09-11T22:20:23.874650+0000","last_active":"2024-09-11T22:20:27.048021+0000","last_peered":"2024-09-11T22:20:27.048021+0000","last_clean":"2024-09-11T22:20:27.048021+0000","last_became_active":"2024-09-11T22:20:23.874040+0000","last_became_peered":"2024-09-11T22:20:23.874040+0000","last_unstale":"2024-09-11T22:20:27.048021+0000","last_undegraded":"2024-09-11T22:20:27.048021+0000","last_fullsized":"2024-09-11T22:20:27.048021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888158+0000","last_change":"2024-09-11T22:20:19.859446+0000","last_active":"2024-09-11T22:20:24.888158+0000","last_peered":"2024-09-11T22:20:24.888158+0000","last_clean":"2024-09-11T22:20:24.888158+0000","last_became_active":"2024-09-11T22:20:19.859106+0000","last_became_peered":"2024-09-11T22:20:19.859106+0000","last_unstale":"2024-09-11T22:20:24.888158+0000","last_undegraded":"2024-09-11T22:20:24.888158+0000","last_fullsized":"2024-09-11T22:20:24.888158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.944022+0000","last_change":"2024-09-11T22:20:18.856475+0000","last_active":"2024-09-11T22:20:46.944022+0000","last_peered":"2024-09-11T22:20:46.944022+0000","last_clean":"2024-09-11T22:20:46.944022+0000","last_became_active":"2024-09-11T22:20:18.856165+0000","last_became_peered":"2024-09-11T22:20:18.856165+0000","last_unstale":"2024-09-11T22:20:46.944022+0000","last_undegraded":"2024-09-11T22:20:46.944022+0000","last_fullsized":"2024-09-11T22:20:46.944022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048102+0000","last_change":"2024-09-11T22:20:23.878121+0000","last_active":"2024-09-11T22:20:27.048102+0000","last_peered":"2024-09-11T22:20:27.048102+0000","last_clean":"2024-09-11T22:20:27.048102+0000","last_became_active":"2024-09-11T22:20:23.877713+0000","last_became_peered":"2024-09-11T22:20:23.877713+0000","last_unstale":"2024-09-11T22:20:27.048102+0000","last_undegraded":"2024-09-11T22:20:27.048102+0000","last_fullsized":"2024-09-11T22:20:27.048102+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887604+0000","last_change":"2024-09-11T22:20:19.858358+0000","last_active":"2024-09-11T22:20:24.887604+0000","last_peered":"2024-09-11T22:20:24.887604+0000","last_clean":"2024-09-11T22:20:24.887604+0000","last_became_active":"2024-09-11T22:20:19.858057+0000","last_became_peered":"2024-09-11T22:20:19.858057+0000","last_unstale":"2024-09-11T22:20:24.887604+0000","last_undegraded":"2024-09-11T22:20:24.887604+0000","last_fullsized":"2024-09-11T22:20:24.887604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:07.839926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998226+0000","last_change":"2024-09-11T22:20:18.853818+0000","last_active":"2024-09-11T22:20:24.998226+0000","last_peered":"2024-09-11T22:20:24.998226+0000","last_clean":"2024-09-11T22:20:24.998226+0000","last_became_active":"2024-09-11T22:20:18.853508+0000","last_became_peered":"2024-09-11T22:20:18.853508+0000","last_unstale":"2024-09-11T22:20:24.998226+0000","last_undegraded":"2024-09-11T22:20:24.998226+0000","last_fullsized":"2024-09-11T22:20:24.998226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:58.141587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047962+0000","last_change":"2024-09-11T22:20:23.879226+0000","last_active":"2024-09-11T22:20:27.047962+0000","last_peered":"2024-09-11T22:20:27.047962+0000","last_clean":"2024-09-11T22:20:27.047962+0000","last_became_active":"2024-09-11T22:20:23.878199+0000","last_became_peered":"2024-09-11T22:20:23.878199+0000","last_unstale":"2024-09-11T22:20:27.047962+0000","last_undegraded":"2024-09-11T22:20:27.047962+0000","last_fullsized":"2024-09-11T22:20:27.047962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:13.245927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887402+0000","last_change":"2024-09-11T22:20:19.844748+0000","last_active":"2024-09-11T22:20:24.887402+0000","last_peered":"2024-09-11T22:20:24.887402+0000","last_clean":"2024-09-11T22:20:24.887402+0000","last_became_active":"2024-09-11T22:20:19.844446+0000","last_became_peered":"2024-09-11T22:20:19.844446+0000","last_unstale":"2024-09-11T22:20:24.887402+0000","last_undegraded":"2024-09-11T22:20:24.887402+0000","last_fullsized":"2024-09-11T22:20:24.887402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:13.319918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.948253+0000","last_change":"2024-09-11T22:20:18.847388+0000","last_active":"2024-09-11T22:20:46.948253+0000","last_peered":"2024-09-11T22:20:46.948253+0000","last_clean":"2024-09-11T22:20:46.948253+0000","last_became_active":"2024-09-11T22:20:18.847118+0000","last_became_peered":"2024-09-11T22:20:18.847118+0000","last_unstale":"2024-09-11T22:20:46.948253+0000","last_undegraded":"2024-09-11T22:20:46.948253+0000","last_fullsized":"2024-09-11T22:20:46.948253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:47.360920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998393+0000","last_change":"2024-09-11T22:20:24.077604+0000","last_active":"2024-09-11T22:20:24.998393+0000","last_peered":"2024-09-11T22:20:24.998393+0000","last_clean":"2024-09-11T22:20:24.998393+0000","last_became_active":"2024-09-11T22:20:24.077231+0000","last_became_peered":"2024-09-11T22:20:24.077231+0000","last_unstale":"2024-09-11T22:20:24.998393+0000","last_undegraded":"2024-09-11T22:20:24.998393+0000","last_fullsized":"2024-09-11T22:20:24.998393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:38.846688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048647+0000","last_change":"2024-09-11T22:20:19.854453+0000","last_active":"2024-09-11T22:20:27.048647+0000","last_peered":"2024-09-11T22:20:27.048647+0000","last_clean":"2024-09-11T22:20:27.048647+0000","last_became_active":"2024-09-11T22:20:19.854100+0000","last_became_peered":"2024-09-11T22:20:19.854100+0000","last_unstale":"2024-09-11T22:20:27.048647+0000","last_undegraded":"2024-09-11T22:20:27.048647+0000","last_fullsized":"2024-09-11T22:20:27.048647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:06.166813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.944339+0000","last_change":"2024-09-11T22:20:18.854889+0000","last_active":"2024-09-11T22:20:46.944339+0000","last_peered":"2024-09-11T22:20:46.944339+0000","last_clean":"2024-09-11T22:20:46.944339+0000","last_became_active":"2024-09-11T22:20:18.854552+0000","last_became_peered":"2024-09-11T22:20:18.854552+0000","last_unstale":"2024-09-11T22:20:46.944339+0000","last_undegraded":"2024-09-11T22:20:46.944339+0000","last_fullsized":"2024-09-11T22:20:46.944339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:33.612126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048443+0000","last_change":"2024-09-11T22:20:23.878932+0000","last_active":"2024-09-11T22:20:27.048443+0000","last_peered":"2024-09-11T22:20:27.048443+0000","last_clean":"2024-09-11T22:20:27.048443+0000","last_became_active":"2024-09-11T22:20:23.878305+0000","last_became_peered":"2024-09-11T22:20:23.878305+0000","last_unstale":"2024-09-11T22:20:27.048443+0000","last_undegraded":"2024-09-11T22:20:27.048443+0000","last_fullsized":"2024-09-11T22:20:27.048443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033835+0000","last_change":"2024-09-11T22:20:19.856318+0000","last_active":"2024-09-11T22:21:01.033835+0000","last_peered":"2024-09-11T22:21:01.033835+0000","last_clean":"2024-09-11T22:21:01.033835+0000","last_became_active":"2024-09-11T22:20:19.855992+0000","last_became_peered":"2024-09-11T22:20:19.855992+0000","last_unstale":"2024-09-11T22:21:01.033835+0000","last_undegraded":"2024-09-11T22:21:01.033835+0000","last_fullsized":"2024-09-11T22:21:01.033835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:57.709140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.944255+0000","last_change":"2024-09-11T22:20:18.850750+0000","last_active":"2024-09-11T22:20:46.944255+0000","last_peered":"2024-09-11T22:20:46.944255+0000","last_clean":"2024-09-11T22:20:46.944255+0000","last_became_active":"2024-09-11T22:20:18.849621+0000","last_became_peered":"2024-09-11T22:20:18.849621+0000","last_unstale":"2024-09-11T22:20:46.944255+0000","last_undegraded":"2024-09-11T22:20:46.944255+0000","last_fullsized":"2024-09-11T22:20:46.944255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047710+0000","last_change":"2024-09-11T22:20:24.077741+0000","last_active":"2024-09-11T22:20:27.047710+0000","last_peered":"2024-09-11T22:20:27.047710+0000","last_clean":"2024-09-11T22:20:27.047710+0000","last_became_active":"2024-09-11T22:20:24.077325+0000","last_became_peered":"2024-09-11T22:20:24.077325+0000","last_unstale":"2024-09-11T22:20:27.047710+0000","last_undegraded":"2024-09-11T22:20:27.047710+0000","last_fullsized":"2024-09-11T22:20:27.047710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:18.656529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888138+0000","last_change":"2024-09-11T22:20:19.850738+0000","last_active":"2024-09-11T22:20:24.888138+0000","last_peered":"2024-09-11T22:20:24.888138+0000","last_clean":"2024-09-11T22:20:24.888138+0000","last_became_active":"2024-09-11T22:20:19.850441+0000","last_became_peered":"2024-09-11T22:20:19.850441+0000","last_unstale":"2024-09-11T22:20:24.888138+0000","last_undegraded":"2024-09-11T22:20:24.888138+0000","last_fullsized":"2024-09-11T22:20:24.888138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:47.552343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.966090+0000","last_change":"2024-09-11T22:20:18.845173+0000","last_active":"2024-09-11T22:20:52.966090+0000","last_peered":"2024-09-11T22:20:52.966090+0000","last_clean":"2024-09-11T22:20:52.966090+0000","last_became_active":"2024-09-11T22:20:18.844731+0000","last_became_peered":"2024-09-11T22:20:18.844731+0000","last_unstale":"2024-09-11T22:20:52.966090+0000","last_undegraded":"2024-09-11T22:20:52.966090+0000","last_fullsized":"2024-09-11T22:20:52.966090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:32.963285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887172+0000","last_change":"2024-09-11T22:20:24.078020+0000","last_active":"2024-09-11T22:20:24.887172+0000","last_peered":"2024-09-11T22:20:24.887172+0000","last_clean":"2024-09-11T22:20:24.887172+0000","last_became_active":"2024-09-11T22:20:24.077541+0000","last_became_peered":"2024-09-11T22:20:24.077541+0000","last_unstale":"2024-09-11T22:20:24.887172+0000","last_undegraded":"2024-09-11T22:20:24.887172+0000","last_fullsized":"2024-09-11T22:20:24.887172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:36.122714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998068+0000","last_change":"2024-09-11T22:20:19.845497+0000","last_active":"2024-09-11T22:20:24.998068+0000","last_peered":"2024-09-11T22:20:24.998068+0000","last_clean":"2024-09-11T22:20:24.998068+0000","last_became_active":"2024-09-11T22:20:19.845203+0000","last_became_peered":"2024-09-11T22:20:19.845203+0000","last_unstale":"2024-09-11T22:20:24.998068+0000","last_undegraded":"2024-09-11T22:20:24.998068+0000","last_fullsized":"2024-09-11T22:20:24.998068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:12.086231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048907+0000","last_change":"2024-09-11T22:20:18.856263+0000","last_active":"2024-09-11T22:20:27.048907+0000","last_peered":"2024-09-11T22:20:27.048907+0000","last_clean":"2024-09-11T22:20:27.048907+0000","last_became_active":"2024-09-11T22:20:18.855968+0000","last_became_peered":"2024-09-11T22:20:18.855968+0000","last_unstale":"2024-09-11T22:20:27.048907+0000","last_undegraded":"2024-09-11T22:20:27.048907+0000","last_fullsized":"2024-09-11T22:20:27.048907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033466+0000","last_change":"2024-09-11T22:20:24.075030+0000","last_active":"2024-09-11T22:21:01.033466+0000","last_peered":"2024-09-11T22:21:01.033466+0000","last_clean":"2024-09-11T22:21:01.033466+0000","last_became_active":"2024-09-11T22:20:24.074588+0000","last_became_peered":"2024-09-11T22:20:24.074588+0000","last_unstale":"2024-09-11T22:21:01.033466+0000","last_undegraded":"2024-09-11T22:21:01.033466+0000","last_fullsized":"2024-09-11T22:21:01.033466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890676+0000","last_change":"2024-09-11T22:20:19.859010+0000","last_active":"2024-09-11T22:20:24.890676+0000","last_peered":"2024-09-11T22:20:24.890676+0000","last_clean":"2024-09-11T22:20:24.890676+0000","last_became_active":"2024-09-11T22:20:19.858585+0000","last_became_peered":"2024-09-11T22:20:19.858585+0000","last_unstale":"2024-09-11T22:20:24.890676+0000","last_undegraded":"2024-09-11T22:20:24.890676+0000","last_fullsized":"2024-09-11T22:20:24.890676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998168+0000","last_change":"2024-09-11T22:20:18.847904+0000","last_active":"2024-09-11T22:20:24.998168+0000","last_peered":"2024-09-11T22:20:24.998168+0000","last_clean":"2024-09-11T22:20:24.998168+0000","last_became_active":"2024-09-11T22:20:18.847669+0000","last_became_peered":"2024-09-11T22:20:18.847669+0000","last_unstale":"2024-09-11T22:20:24.998168+0000","last_undegraded":"2024-09-11T22:20:24.998168+0000","last_fullsized":"2024-09-11T22:20:24.998168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:08.717999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997794+0000","last_change":"2024-09-11T22:20:23.881067+0000","last_active":"2024-09-11T22:20:24.997794+0000","last_peered":"2024-09-11T22:20:24.997794+0000","last_clean":"2024-09-11T22:20:24.997794+0000","last_became_active":"2024-09-11T22:20:23.880468+0000","last_became_peered":"2024-09-11T22:20:23.880468+0000","last_unstale":"2024-09-11T22:20:24.997794+0000","last_undegraded":"2024-09-11T22:20:24.997794+0000","last_fullsized":"2024-09-11T22:20:24.997794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:23.480547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048637+0000","last_change":"2024-09-11T22:20:19.860423+0000","last_active":"2024-09-11T22:20:27.048637+0000","last_peered":"2024-09-11T22:20:27.048637+0000","last_clean":"2024-09-11T22:20:27.048637+0000","last_became_active":"2024-09-11T22:20:19.858932+0000","last_became_peered":"2024-09-11T22:20:19.858932+0000","last_unstale":"2024-09-11T22:20:27.048637+0000","last_undegraded":"2024-09-11T22:20:27.048637+0000","last_fullsized":"2024-09-11T22:20:27.048637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:53.255932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890029+0000","last_change":"2024-09-11T22:20:18.854973+0000","last_active":"2024-09-11T22:20:24.890029+0000","last_peered":"2024-09-11T22:20:24.890029+0000","last_clean":"2024-09-11T22:20:24.890029+0000","last_became_active":"2024-09-11T22:20:18.854725+0000","last_became_peered":"2024-09-11T22:20:18.854725+0000","last_unstale":"2024-09-11T22:20:24.890029+0000","last_undegraded":"2024-09-11T22:20:24.890029+0000","last_fullsized":"2024-09-11T22:20:24.890029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998393+0000","last_change":"2024-09-11T22:20:23.880693+0000","last_active":"2024-09-11T22:20:24.998393+0000","last_peered":"2024-09-11T22:20:24.998393+0000","last_clean":"2024-09-11T22:20:24.998393+0000","last_became_active":"2024-09-11T22:20:23.880243+0000","last_became_peered":"2024-09-11T22:20:23.880243+0000","last_unstale":"2024-09-11T22:20:24.998393+0000","last_undegraded":"2024-09-11T22:20:24.998393+0000","last_fullsized":"2024-09-11T22:20:24.998393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.659287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997954+0000","last_change":"2024-09-11T22:20:19.844808+0000","last_active":"2024-09-11T22:20:24.997954+0000","last_peered":"2024-09-11T22:20:24.997954+0000","last_clean":"2024-09-11T22:20:24.997954+0000","last_became_active":"2024-09-11T22:20:19.844536+0000","last_became_peered":"2024-09-11T22:20:19.844536+0000","last_unstale":"2024-09-11T22:20:24.997954+0000","last_undegraded":"2024-09-11T22:20:24.997954+0000","last_fullsized":"2024-09-11T22:20:24.997954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:57.142383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025228+0000","last_change":"2024-09-11T22:20:18.855640+0000","last_active":"2024-09-11T22:21:01.025228+0000","last_peered":"2024-09-11T22:21:01.025228+0000","last_clean":"2024-09-11T22:21:01.025228+0000","last_became_active":"2024-09-11T22:20:18.855394+0000","last_became_peered":"2024-09-11T22:20:18.855394+0000","last_unstale":"2024-09-11T22:21:01.025228+0000","last_undegraded":"2024-09-11T22:21:01.025228+0000","last_fullsized":"2024-09-11T22:21:01.025228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998458+0000","last_change":"2024-09-11T22:20:23.882554+0000","last_active":"2024-09-11T22:20:24.998458+0000","last_peered":"2024-09-11T22:20:24.998458+0000","last_clean":"2024-09-11T22:20:24.998458+0000","last_became_active":"2024-09-11T22:20:23.881642+0000","last_became_peered":"2024-09-11T22:20:23.881642+0000","last_unstale":"2024-09-11T22:20:24.998458+0000","last_undegraded":"2024-09-11T22:20:24.998458+0000","last_fullsized":"2024-09-11T22:20:24.998458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:16.696043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033143+0000","last_change":"2024-09-11T22:20:19.859429+0000","last_active":"2024-09-11T22:21:01.033143+0000","last_peered":"2024-09-11T22:21:01.033143+0000","last_clean":"2024-09-11T22:21:01.033143+0000","last_became_active":"2024-09-11T22:20:19.859159+0000","last_became_peered":"2024-09-11T22:20:19.859159+0000","last_unstale":"2024-09-11T22:21:01.033143+0000","last_undegraded":"2024-09-11T22:21:01.033143+0000","last_fullsized":"2024-09-11T22:21:01.033143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:02.696450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.967996+0000","last_change":"2024-09-11T22:20:18.856144+0000","last_active":"2024-09-11T22:20:52.967996+0000","last_peered":"2024-09-11T22:20:52.967996+0000","last_clean":"2024-09-11T22:20:52.967996+0000","last_became_active":"2024-09-11T22:20:18.855866+0000","last_became_peered":"2024-09-11T22:20:18.855866+0000","last_unstale":"2024-09-11T22:20:52.967996+0000","last_undegraded":"2024-09-11T22:20:52.967996+0000","last_fullsized":"2024-09-11T22:20:52.967996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:37.259393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033635+0000","last_change":"2024-09-11T22:20:24.075154+0000","last_active":"2024-09-11T22:21:01.033635+0000","last_peered":"2024-09-11T22:21:01.033635+0000","last_clean":"2024-09-11T22:21:01.033635+0000","last_became_active":"2024-09-11T22:20:24.074568+0000","last_became_peered":"2024-09-11T22:20:24.074568+0000","last_unstale":"2024-09-11T22:21:01.033635+0000","last_undegraded":"2024-09-11T22:21:01.033635+0000","last_fullsized":"2024-09-11T22:21:01.033635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:09.804991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887321+0000","last_change":"2024-09-11T22:20:19.861236+0000","last_active":"2024-09-11T22:20:24.887321+0000","last_peered":"2024-09-11T22:20:24.887321+0000","last_clean":"2024-09-11T22:20:24.887321+0000","last_became_active":"2024-09-11T22:20:19.860938+0000","last_became_peered":"2024-09-11T22:20:19.860938+0000","last_unstale":"2024-09-11T22:20:24.887321+0000","last_undegraded":"2024-09-11T22:20:24.887321+0000","last_fullsized":"2024-09-11T22:20:24.887321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:42.015334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.946546+0000","last_change":"2024-09-11T22:20:18.853467+0000","last_active":"2024-09-11T22:20:46.946546+0000","last_peered":"2024-09-11T22:20:46.946546+0000","last_clean":"2024-09-11T22:20:46.946546+0000","last_became_active":"2024-09-11T22:20:18.853182+0000","last_became_peered":"2024-09-11T22:20:18.853182+0000","last_unstale":"2024-09-11T22:20:46.946546+0000","last_undegraded":"2024-09-11T22:20:46.946546+0000","last_fullsized":"2024-09-11T22:20:46.946546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047625+0000","last_change":"2024-09-11T22:20:09.425648+0000","last_active":"2024-09-11T22:20:27.047625+0000","last_peered":"2024-09-11T22:20:27.047625+0000","last_clean":"2024-09-11T22:20:27.047625+0000","last_became_active":"2024-09-11T22:20:09.424591+0000","last_became_peered":"2024-09-11T22:20:09.424591+0000","last_unstale":"2024-09-11T22:20:27.047625+0000","last_undegraded":"2024-09-11T22:20:27.047625+0000","last_fullsized":"2024-09-11T22:20:27.047625+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_clean_scrub_stamp":"2024-09-11T22:20:08.334092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:53.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888536+0000","last_change":"2024-09-11T22:20:24.077007+0000","last_active":"2024-09-11T22:20:24.888536+0000","last_peered":"2024-09-11T22:20:24.888536+0000","last_clean":"2024-09-11T22:20:24.888536+0000","last_became_active":"2024-09-11T22:20:24.076601+0000","last_became_peered":"2024-09-11T22:20:24.076601+0000","last_unstale":"2024-09-11T22:20:24.888536+0000","last_undegraded":"2024-09-11T22:20:24.888536+0000","last_fullsized":"2024-09-11T22:20:24.888536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048600+0000","last_change":"2024-09-11T22:20:19.863279+0000","last_active":"2024-09-11T22:20:27.048600+0000","last_peered":"2024-09-11T22:20:27.048600+0000","last_clean":"2024-09-11T22:20:27.048600+0000","last_became_active":"2024-09-11T22:20:19.861322+0000","last_became_peered":"2024-09-11T22:20:19.861322+0000","last_unstale":"2024-09-11T22:20:27.048600+0000","last_undegraded":"2024-09-11T22:20:27.048600+0000","last_fullsized":"2024-09-11T22:20:27.048600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025479+0000","last_change":"2024-09-11T22:20:18.853343+0000","last_active":"2024-09-11T22:21:01.025479+0000","last_peered":"2024-09-11T22:21:01.025479+0000","last_clean":"2024-09-11T22:21:01.025479+0000","last_became_active":"2024-09-11T22:20:18.853069+0000","last_became_peered":"2024-09-11T22:20:18.853069+0000","last_unstale":"2024-09-11T22:21:01.025479+0000","last_undegraded":"2024-09-11T22:21:01.025479+0000","last_fullsized":"2024-09-11T22:21:01.025479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888655+0000","last_change":"2024-09-11T22:20:24.075350+0000","last_active":"2024-09-11T22:20:24.888655+0000","last_peered":"2024-09-11T22:20:24.888655+0000","last_clean":"2024-09-11T22:20:24.888655+0000","last_became_active":"2024-09-11T22:20:24.074789+0000","last_became_peered":"2024-09-11T22:20:24.074789+0000","last_unstale":"2024-09-11T22:20:24.888655+0000","last_undegraded":"2024-09-11T22:20:24.888655+0000","last_fullsized":"2024-09-11T22:20:24.888655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890400+0000","last_change":"2024-09-11T22:20:19.866331+0000","last_active":"2024-09-11T22:20:24.890400+0000","last_peered":"2024-09-11T22:20:24.890400+0000","last_clean":"2024-09-11T22:20:24.890400+0000","last_became_active":"2024-09-11T22:20:19.865535+0000","last_became_peered":"2024-09-11T22:20:19.865535+0000","last_unstale":"2024-09-11T22:20:24.890400+0000","last_undegraded":"2024-09-11T22:20:24.890400+0000","last_fullsized":"2024-09-11T22:20:24.890400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998164+0000","last_change":"2024-09-11T22:20:18.849434+0000","last_active":"2024-09-11T22:20:24.998164+0000","last_peered":"2024-09-11T22:20:24.998164+0000","last_clean":"2024-09-11T22:20:24.998164+0000","last_became_active":"2024-09-11T22:20:18.848787+0000","last_became_peered":"2024-09-11T22:20:18.848787+0000","last_unstale":"2024-09-11T22:20:24.998164+0000","last_undegraded":"2024-09-11T22:20:24.998164+0000","last_fullsized":"2024-09-11T22:20:24.998164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:25.689495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033577+0000","last_change":"2024-09-11T22:20:23.879962+0000","last_active":"2024-09-11T22:21:01.033577+0000","last_peered":"2024-09-11T22:21:01.033577+0000","last_clean":"2024-09-11T22:21:01.033577+0000","last_became_active":"2024-09-11T22:20:23.879586+0000","last_became_peered":"2024-09-11T22:20:23.879586+0000","last_unstale":"2024-09-11T22:21:01.033577+0000","last_undegraded":"2024-09-11T22:21:01.033577+0000","last_fullsized":"2024-09-11T22:21:01.033577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:27.323116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.049164+0000","last_change":"2024-09-11T22:20:19.860411+0000","last_active":"2024-09-11T22:20:27.049164+0000","last_peered":"2024-09-11T22:20:27.049164+0000","last_clean":"2024-09-11T22:20:27.049164+0000","last_became_active":"2024-09-11T22:20:19.860076+0000","last_became_peered":"2024-09-11T22:20:19.860076+0000","last_unstale":"2024-09-11T22:20:27.049164+0000","last_undegraded":"2024-09-11T22:20:27.049164+0000","last_fullsized":"2024-09-11T22:20:27.049164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025282+0000","last_change":"2024-09-11T22:20:18.856020+0000","last_active":"2024-09-11T22:21:01.025282+0000","last_peered":"2024-09-11T22:21:01.025282+0000","last_clean":"2024-09-11T22:21:01.025282+0000","last_became_active":"2024-09-11T22:20:18.855753+0000","last_became_peered":"2024-09-11T22:20:18.855753+0000","last_unstale":"2024-09-11T22:21:01.025282+0000","last_undegraded":"2024-09-11T22:21:01.025282+0000","last_fullsized":"2024-09-11T22:21:01.025282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888726+0000","last_change":"2024-09-11T22:20:24.077975+0000","last_active":"2024-09-11T22:20:24.888726+0000","last_peered":"2024-09-11T22:20:24.888726+0000","last_clean":"2024-09-11T22:20:24.888726+0000","last_became_active":"2024-09-11T22:20:24.077502+0000","last_became_peered":"2024-09-11T22:20:24.077502+0000","last_unstale":"2024-09-11T22:20:24.888726+0000","last_undegraded":"2024-09-11T22:20:24.888726+0000","last_fullsized":"2024-09-11T22:20:24.888726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:16.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047781+0000","last_change":"2024-09-11T22:20:19.856986+0000","last_active":"2024-09-11T22:20:27.047781+0000","last_peered":"2024-09-11T22:20:27.047781+0000","last_clean":"2024-09-11T22:20:27.047781+0000","last_became_active":"2024-09-11T22:20:19.856739+0000","last_became_peered":"2024-09-11T22:20:19.856739+0000","last_unstale":"2024-09-11T22:20:27.047781+0000","last_undegraded":"2024-09-11T22:20:27.047781+0000","last_fullsized":"2024-09-11T22:20:27.047781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048583+0000","last_change":"2024-09-11T22:20:18.855044+0000","last_active":"2024-09-11T22:20:27.048583+0000","last_peered":"2024-09-11T22:20:27.048583+0000","last_clean":"2024-09-11T22:20:27.048583+0000","last_became_active":"2024-09-11T22:20:18.854764+0000","last_became_peered":"2024-09-11T22:20:18.854764+0000","last_unstale":"2024-09-11T22:20:27.048583+0000","last_undegraded":"2024-09-11T22:20:27.048583+0000","last_fullsized":"2024-09-11T22:20:27.048583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:22.207278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047516+0000","last_change":"2024-09-11T22:20:23.878383+0000","last_active":"2024-09-11T22:20:27.047516+0000","last_peered":"2024-09-11T22:20:27.047516+0000","last_clean":"2024-09-11T22:20:27.047516+0000","last_became_active":"2024-09-11T22:20:23.877890+0000","last_became_peered":"2024-09-11T22:20:23.877890+0000","last_unstale":"2024-09-11T22:20:27.047516+0000","last_undegraded":"2024-09-11T22:20:27.047516+0000","last_fullsized":"2024-09-11T22:20:27.047516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:18.876485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048434+0000","last_change":"2024-09-11T22:20:19.861242+0000","last_active":"2024-09-11T22:20:27.048434+0000","last_peered":"2024-09-11T22:20:27.048434+0000","last_clean":"2024-09-11T22:20:27.048434+0000","last_became_active":"2024-09-11T22:20:19.860988+0000","last_became_peered":"2024-09-11T22:20:19.860988+0000","last_unstale":"2024-09-11T22:20:27.048434+0000","last_undegraded":"2024-09-11T22:20:27.048434+0000","last_fullsized":"2024-09-11T22:20:27.048434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.024956+0000","last_change":"2024-09-11T22:20:18.852459+0000","last_active":"2024-09-11T22:21:01.024956+0000","last_peered":"2024-09-11T22:21:01.024956+0000","last_clean":"2024-09-11T22:21:01.024956+0000","last_became_active":"2024-09-11T22:20:18.852153+0000","last_became_peered":"2024-09-11T22:20:18.852153+0000","last_unstale":"2024-09-11T22:21:01.024956+0000","last_undegraded":"2024-09-11T22:21:01.024956+0000","last_fullsized":"2024-09-11T22:21:01.024956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033546+0000","last_change":"2024-09-11T22:20:23.874062+0000","last_active":"2024-09-11T22:21:01.033546+0000","last_peered":"2024-09-11T22:21:01.033546+0000","last_clean":"2024-09-11T22:21:01.033546+0000","last_became_active":"2024-09-11T22:20:23.873635+0000","last_became_peered":"2024-09-11T22:20:23.873635+0000","last_unstale":"2024-09-11T22:21:01.033546+0000","last_undegraded":"2024-09-11T22:21:01.033546+0000","last_fullsized":"2024-09-11T22:21:01.033546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:40.914142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888125+0000","last_change":"2024-09-11T22:20:19.851577+0000","last_active":"2024-09-11T22:20:24.888125+0000","last_peered":"2024-09-11T22:20:24.888125+0000","last_clean":"2024-09-11T22:20:24.888125+0000","last_became_active":"2024-09-11T22:20:19.851286+0000","last_became_peered":"2024-09-11T22:20:19.851286+0000","last_unstale":"2024-09-11T22:20:24.888125+0000","last_undegraded":"2024-09-11T22:20:24.888125+0000","last_fullsized":"2024-09-11T22:20:24.888125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:32.025931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.968016+0000","last_change":"2024-09-11T22:20:18.853301+0000","last_active":"2024-09-11T22:20:52.968016+0000","last_peered":"2024-09-11T22:20:52.968016+0000","last_clean":"2024-09-11T22:20:52.968016+0000","last_became_active":"2024-09-11T22:20:18.852978+0000","last_became_peered":"2024-09-11T22:20:18.852978+0000","last_unstale":"2024-09-11T22:20:52.968016+0000","last_undegraded":"2024-09-11T22:20:52.968016+0000","last_fullsized":"2024-09-11T22:20:52.968016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888069+0000","last_change":"2024-09-11T22:20:24.077636+0000","last_active":"2024-09-11T22:20:24.888069+0000","last_peered":"2024-09-11T22:20:24.888069+0000","last_clean":"2024-09-11T22:20:24.888069+0000","last_became_active":"2024-09-11T22:20:24.077313+0000","last_became_peered":"2024-09-11T22:20:24.077313+0000","last_unstale":"2024-09-11T22:20:24.888069+0000","last_undegraded":"2024-09-11T22:20:24.888069+0000","last_fullsized":"2024-09-11T22:20:24.888069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:23.154027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048723+0000","last_change":"2024-09-11T22:20:19.862562+0000","last_active":"2024-09-11T22:20:27.048723+0000","last_peered":"2024-09-11T22:20:27.048723+0000","last_clean":"2024-09-11T22:20:27.048723+0000","last_became_active":"2024-09-11T22:20:19.862267+0000","last_became_peered":"2024-09-11T22:20:19.862267+0000","last_unstale":"2024-09-11T22:20:27.048723+0000","last_undegraded":"2024-09-11T22:20:27.048723+0000","last_fullsized":"2024-09-11T22:20:27.048723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.948867+0000","last_change":"2024-09-11T22:20:18.858002+0000","last_active":"2024-09-11T22:20:46.948867+0000","last_peered":"2024-09-11T22:20:46.948867+0000","last_clean":"2024-09-11T22:20:46.948867+0000","last_became_active":"2024-09-11T22:20:18.857419+0000","last_became_peered":"2024-09-11T22:20:18.857419+0000","last_unstale":"2024-09-11T22:20:46.948867+0000","last_undegraded":"2024-09-11T22:20:46.948867+0000","last_fullsized":"2024-09-11T22:20:46.948867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887723+0000","last_change":"2024-09-11T22:20:24.074971+0000","last_active":"2024-09-11T22:20:24.887723+0000","last_peered":"2024-09-11T22:20:24.887723+0000","last_clean":"2024-09-11T22:20:24.887723+0000","last_became_active":"2024-09-11T22:20:24.074609+0000","last_became_peered":"2024-09-11T22:20:24.074609+0000","last_unstale":"2024-09-11T22:20:24.887723+0000","last_undegraded":"2024-09-11T22:20:24.887723+0000","last_fullsized":"2024-09-11T22:20:24.887723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:55.318904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033588+0000","last_change":"2024-09-11T22:20:19.857276+0000","last_active":"2024-09-11T22:21:01.033588+0000","last_peered":"2024-09-11T22:21:01.033588+0000","last_clean":"2024-09-11T22:21:01.033588+0000","last_became_active":"2024-09-11T22:20:19.857027+0000","last_became_peered":"2024-09-11T22:20:19.857027+0000","last_unstale":"2024-09-11T22:21:01.033588+0000","last_undegraded":"2024-09-11T22:21:01.033588+0000","last_fullsized":"2024-09-11T22:21:01.033588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033832+0000","last_change":"2024-09-11T22:20:18.848671+0000","last_active":"2024-09-11T22:21:01.033832+0000","last_peered":"2024-09-11T22:21:01.033832+0000","last_clean":"2024-09-11T22:21:01.033832+0000","last_became_active":"2024-09-11T22:20:18.848405+0000","last_became_peered":"2024-09-11T22:20:18.848405+0000","last_unstale":"2024-09-11T22:21:01.033832+0000","last_undegraded":"2024-09-11T22:21:01.033832+0000","last_fullsized":"2024-09-11T22:21:01.033832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890660+0000","last_change":"2024-09-11T22:20:24.076835+0000","last_active":"2024-09-11T22:20:24.890660+0000","last_peered":"2024-09-11T22:20:24.890660+0000","last_clean":"2024-09-11T22:20:24.890660+0000","last_became_active":"2024-09-11T22:20:24.076200+0000","last_became_peered":"2024-09-11T22:20:24.076200+0000","last_unstale":"2024-09-11T22:20:24.890660+0000","last_undegraded":"2024-09-11T22:20:24.890660+0000","last_fullsized":"2024-09-11T22:20:24.890660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:48.150778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048503+0000","last_change":"2024-09-11T22:20:19.855334+0000","last_active":"2024-09-11T22:20:27.048503+0000","last_peered":"2024-09-11T22:20:27.048503+0000","last_clean":"2024-09-11T22:20:27.048503+0000","last_became_active":"2024-09-11T22:20:19.855018+0000","last_became_peered":"2024-09-11T22:20:19.855018+0000","last_unstale":"2024-09-11T22:20:27.048503+0000","last_undegraded":"2024-09-11T22:20:27.048503+0000","last_fullsized":"2024-09-11T22:20:27.048503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'11","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.946283+0000","last_change":"2024-09-11T22:20:18.855665+0000","last_active":"2024-09-11T22:20:46.946283+0000","last_peered":"2024-09-11T22:20:46.946283+0000","last_clean":"2024-09-11T22:20:46.946283+0000","last_became_active":"2024-09-11T22:20:18.855386+0000","last_became_peered":"2024-09-11T22:20:18.855386+0000","last_unstale":"2024-09-11T22:20:46.946283+0000","last_undegraded":"2024-09-11T22:20:46.946283+0000","last_fullsized":"2024-09-11T22:20:46.946283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998100+0000","last_change":"2024-09-11T22:20:23.880793+0000","last_active":"2024-09-11T22:20:24.998100+0000","last_peered":"2024-09-11T22:20:24.998100+0000","last_clean":"2024-09-11T22:20:24.998100+0000","last_became_active":"2024-09-11T22:20:23.879993+0000","last_became_peered":"2024-09-11T22:20:23.879993+0000","last_unstale":"2024-09-11T22:20:24.998100+0000","last_undegraded":"2024-09-11T22:20:24.998100+0000","last_fullsized":"2024-09-11T22:20:24.998100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:50.449090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048075+0000","last_change":"2024-09-11T22:20:19.858588+0000","last_active":"2024-09-11T22:20:27.048075+0000","last_peered":"2024-09-11T22:20:27.048075+0000","last_clean":"2024-09-11T22:20:27.048075+0000","last_became_active":"2024-09-11T22:20:19.858322+0000","last_became_peered":"2024-09-11T22:20:19.858322+0000","last_unstale":"2024-09-11T22:20:27.048075+0000","last_undegraded":"2024-09-11T22:20:27.048075+0000","last_fullsized":"2024-09-11T22:20:27.048075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998118+0000","last_change":"2024-09-11T22:20:18.855056+0000","last_active":"2024-09-11T22:20:24.998118+0000","last_peered":"2024-09-11T22:20:24.998118+0000","last_clean":"2024-09-11T22:20:24.998118+0000","last_became_active":"2024-09-11T22:20:18.854784+0000","last_became_peered":"2024-09-11T22:20:18.854784+0000","last_unstale":"2024-09-11T22:20:24.998118+0000","last_undegraded":"2024-09-11T22:20:24.998118+0000","last_fullsized":"2024-09-11T22:20:24.998118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:38.916121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048044+0000","last_change":"2024-09-11T22:20:23.879768+0000","last_active":"2024-09-11T22:20:27.048044+0000","last_peered":"2024-09-11T22:20:27.048044+0000","last_clean":"2024-09-11T22:20:27.048044+0000","last_became_active":"2024-09-11T22:20:23.878794+0000","last_became_peered":"2024-09-11T22:20:23.878794+0000","last_unstale":"2024-09-11T22:20:27.048044+0000","last_undegraded":"2024-09-11T22:20:27.048044+0000","last_fullsized":"2024-09-11T22:20:27.048044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:07.301587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-11T22:20:27.048280+0000","last_change":"2024-09-11T22:21:01.034302+0000","last_active":"2024-09-11T22:21:01.034302+0000","last_peered":"2024-09-11T22:20:27.048280+0000","last_clean":"2024-09-11T22:20:27.048280+0000","last_became_active":"2024-09-11T22:20:19.861607+0000","last_became_peered":"2024-09-11T22:20:19.861607+0000","last_unstale":"2024-09-11T22:20:27.048280+0000","last_undegraded":"2024-09-11T22:20:27.048280+0000","last_fullsized":"2024-09-11T22:20:27.048280+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.946689+0000","last_change":"2024-09-11T22:20:18.853382+0000","last_active":"2024-09-11T22:20:46.946689+0000","last_peered":"2024-09-11T22:20:46.946689+0000","last_clean":"2024-09-11T22:20:46.946689+0000","last_became_active":"2024-09-11T22:20:18.853103+0000","last_became_peered":"2024-09-11T22:20:18.853103+0000","last_unstale":"2024-09-11T22:20:46.946689+0000","last_undegraded":"2024-09-11T22:20:46.946689+0000","last_fullsized":"2024-09-11T22:20:46.946689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887490+0000","last_change":"2024-09-11T22:20:23.876997+0000","last_active":"2024-09-11T22:20:24.887490+0000","last_peered":"2024-09-11T22:20:24.887490+0000","last_clean":"2024-09-11T22:20:24.887490+0000","last_became_active":"2024-09-11T22:20:23.876587+0000","last_became_peered":"2024-09-11T22:20:23.876587+0000","last_unstale":"2024-09-11T22:20:24.887490+0000","last_undegraded":"2024-09-11T22:20:24.887490+0000","last_fullsized":"2024-09-11T22:20:24.887490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:19.670665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889342+0000","last_change":"2024-09-11T22:20:19.866624+0000","last_active":"2024-09-11T22:20:24.889342+0000","last_peered":"2024-09-11T22:20:24.889342+0000","last_clean":"2024-09-11T22:20:24.889342+0000","last_became_active":"2024-09-11T22:20:19.866303+0000","last_became_peered":"2024-09-11T22:20:19.866303+0000","last_unstale":"2024-09-11T22:20:24.889342+0000","last_undegraded":"2024-09-11T22:20:24.889342+0000","last_fullsized":"2024-09-11T22:20:24.889342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.946175+0000","last_change":"2024-09-11T22:20:18.854361+0000","last_active":"2024-09-11T22:20:46.946175+0000","last_peered":"2024-09-11T22:20:46.946175+0000","last_clean":"2024-09-11T22:20:46.946175+0000","last_became_active":"2024-09-11T22:20:18.854019+0000","last_became_peered":"2024-09-11T22:20:18.854019+0000","last_unstale":"2024-09-11T22:20:46.946175+0000","last_undegraded":"2024-09-11T22:20:46.946175+0000","last_fullsized":"2024-09-11T22:20:46.946175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887284+0000","last_change":"2024-09-11T22:20:24.077476+0000","last_active":"2024-09-11T22:20:24.887284+0000","last_peered":"2024-09-11T22:20:24.887284+0000","last_clean":"2024-09-11T22:20:24.887284+0000","last_became_active":"2024-09-11T22:20:24.077134+0000","last_became_peered":"2024-09-11T22:20:24.077134+0000","last_unstale":"2024-09-11T22:20:24.887284+0000","last_undegraded":"2024-09-11T22:20:24.887284+0000","last_fullsized":"2024-09-11T22:20:24.887284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:03.186460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-11T22:20:27.048088+0000","last_change":"2024-09-11T22:21:01.033206+0000","last_active":"2024-09-11T22:21:01.033206+0000","last_peered":"2024-09-11T22:20:27.048088+0000","last_clean":"2024-09-11T22:20:27.048088+0000","last_became_active":"2024-09-11T22:20:24.076592+0000","last_became_peered":"2024-09-11T22:20:24.076592+0000","last_unstale":"2024-09-11T22:20:27.048088+0000","last_undegraded":"2024-09-11T22:20:27.048088+0000","last_fullsized":"2024-09-11T22:20:27.048088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2,3,7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997676+0000","last_change":"2024-09-11T22:20:19.845776+0000","last_active":"2024-09-11T22:20:24.997676+0000","last_peered":"2024-09-11T22:20:24.997676+0000","last_clean":"2024-09-11T22:20:24.997676+0000","last_became_active":"2024-09-11T22:20:19.845425+0000","last_became_peered":"2024-09-11T22:20:19.845425+0000","last_unstale":"2024-09-11T22:20:24.997676+0000","last_undegraded":"2024-09-11T22:20:24.997676+0000","last_fullsized":"2024-09-11T22:20:24.997676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:07.187533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889087+0000","last_change":"2024-09-11T22:20:18.852446+0000","last_active":"2024-09-11T22:20:24.889087+0000","last_peered":"2024-09-11T22:20:24.889087+0000","last_clean":"2024-09-11T22:20:24.889087+0000","last_became_active":"2024-09-11T22:20:18.852155+0000","last_became_peered":"2024-09-11T22:20:18.852155+0000","last_unstale":"2024-09-11T22:20:24.889087+0000","last_undegraded":"2024-09-11T22:20:24.889087+0000","last_fullsized":"2024-09-11T22:20:24.889087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889233+0000","last_change":"2024-09-11T22:20:23.876503+0000","last_active":"2024-09-11T22:20:24.889233+0000","last_peered":"2024-09-11T22:20:24.889233+0000","last_clean":"2024-09-11T22:20:24.889233+0000","last_became_active":"2024-09-11T22:20:23.876100+0000","last_became_peered":"2024-09-11T22:20:23.876100+0000","last_unstale":"2024-09-11T22:20:24.889233+0000","last_undegraded":"2024-09-11T22:20:24.889233+0000","last_fullsized":"2024-09-11T22:20:24.889233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887311+0000","last_change":"2024-09-11T22:20:19.852606+0000","last_active":"2024-09-11T22:20:24.887311+0000","last_peered":"2024-09-11T22:20:24.887311+0000","last_clean":"2024-09-11T22:20:24.887311+0000","last_became_active":"2024-09-11T22:20:19.852333+0000","last_became_peered":"2024-09-11T22:20:19.852333+0000","last_unstale":"2024-09-11T22:20:24.887311+0000","last_undegraded":"2024-09-11T22:20:24.887311+0000","last_fullsized":"2024-09-11T22:20:24.887311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:56.940278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.965701+0000","last_change":"2024-09-11T22:20:18.853767+0000","last_active":"2024-09-11T22:20:52.965701+0000","last_peered":"2024-09-11T22:20:52.965701+0000","last_clean":"2024-09-11T22:20:52.965701+0000","last_became_active":"2024-09-11T22:20:18.853533+0000","last_became_peered":"2024-09-11T22:20:18.853533+0000","last_unstale":"2024-09-11T22:20:52.965701+0000","last_undegraded":"2024-09-11T22:20:52.965701+0000","last_fullsized":"2024-09-11T22:20:52.965701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:36.662271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.967351+0000","last_change":"2024-09-11T22:20:18.847133+0000","last_active":"2024-09-11T22:20:52.967351+0000","last_peered":"2024-09-11T22:20:52.967351+0000","last_clean":"2024-09-11T22:20:52.967351+0000","last_became_active":"2024-09-11T22:20:18.846321+0000","last_became_peered":"2024-09-11T22:20:18.846321+0000","last_unstale":"2024-09-11T22:20:52.967351+0000","last_undegraded":"2024-09-11T22:20:52.967351+0000","last_fullsized":"2024-09-11T22:20:52.967351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033751+0000","last_change":"2024-09-11T22:20:19.861445+0000","last_active":"2024-09-11T22:21:01.033751+0000","last_peered":"2024-09-11T22:21:01.033751+0000","last_clean":"2024-09-11T22:21:01.033751+0000","last_became_active":"2024-09-11T22:20:19.861154+0000","last_became_peered":"2024-09-11T22:20:19.861154+0000","last_unstale":"2024-09-11T22:21:01.033751+0000","last_undegraded":"2024-09-11T22:21:01.033751+0000","last_fullsized":"2024-09-11T22:21:01.033751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025275+0000","last_change":"2024-09-11T22:20:23.877973+0000","last_active":"2024-09-11T22:21:01.025275+0000","last_peered":"2024-09-11T22:21:01.025275+0000","last_clean":"2024-09-11T22:21:01.025275+0000","last_became_active":"2024-09-11T22:20:23.877578+0000","last_became_peered":"2024-09-11T22:20:23.877578+0000","last_unstale":"2024-09-11T22:21:01.025275+0000","last_undegraded":"2024-09-11T22:21:01.025275+0000","last_fullsized":"2024-09-11T22:21:01.025275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:27.826669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.948565+0000","last_change":"2024-09-11T22:20:18.854142+0000","last_active":"2024-09-11T22:20:46.948565+0000","last_peered":"2024-09-11T22:20:46.948565+0000","last_clean":"2024-09-11T22:20:46.948565+0000","last_became_active":"2024-09-11T22:20:18.853872+0000","last_became_peered":"2024-09-11T22:20:18.853872+0000","last_unstale":"2024-09-11T22:20:46.948565+0000","last_undegraded":"2024-09-11T22:20:46.948565+0000","last_fullsized":"2024-09-11T22:20:46.948565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:22.513242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047903+0000","last_change":"2024-09-11T22:20:19.852580+0000","last_active":"2024-09-11T22:20:27.047903+0000","last_peered":"2024-09-11T22:20:27.047903+0000","last_clean":"2024-09-11T22:20:27.047903+0000","last_became_active":"2024-09-11T22:20:19.850175+0000","last_became_peered":"2024-09-11T22:20:19.850175+0000","last_unstale":"2024-09-11T22:20:27.047903+0000","last_undegraded":"2024-09-11T22:20:27.047903+0000","last_fullsized":"2024-09-11T22:20:27.047903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:11.937256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887822+0000","last_change":"2024-09-11T22:20:23.878004+0000","last_active":"2024-09-11T22:20:24.887822+0000","last_peered":"2024-09-11T22:20:24.887822+0000","last_clean":"2024-09-11T22:20:24.887822+0000","last_became_active":"2024-09-11T22:20:23.876776+0000","last_became_peered":"2024-09-11T22:20:23.876776+0000","last_unstale":"2024-09-11T22:20:24.887822+0000","last_undegraded":"2024-09-11T22:20:24.887822+0000","last_fullsized":"2024-09-11T22:20:24.887822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:11.254248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887933+0000","last_change":"2024-09-11T22:20:19.853439+0000","last_active":"2024-09-11T22:20:24.887933+0000","last_peered":"2024-09-11T22:20:24.887933+0000","last_clean":"2024-09-11T22:20:24.887933+0000","last_became_active":"2024-09-11T22:20:19.852937+0000","last_became_peered":"2024-09-11T22:20:19.852937+0000","last_unstale":"2024-09-11T22:20:24.887933+0000","last_undegraded":"2024-09-11T22:20:24.887933+0000","last_fullsized":"2024-09-11T22:20:24.887933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025127+0000","last_change":"2024-09-11T22:20:19.861003+0000","last_active":"2024-09-11T22:21:01.025127+0000","last_peered":"2024-09-11T22:21:01.025127+0000","last_clean":"2024-09-11T22:21:01.025127+0000","last_became_active":"2024-09-11T22:20:19.860690+0000","last_became_peered":"2024-09-11T22:20:19.860690+0000","last_unstale":"2024-09-11T22:21:01.025127+0000","last_undegraded":"2024-09-11T22:21:01.025127+0000","last_fullsized":"2024-09-11T22:21:01.025127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889798+0000","last_change":"2024-09-11T22:20:19.856756+0000","last_active":"2024-09-11T22:20:24.889798+0000","last_peered":"2024-09-11T22:20:24.889798+0000","last_clean":"2024-09-11T22:20:24.889798+0000","last_became_active":"2024-09-11T22:20:19.856460+0000","last_became_peered":"2024-09-11T22:20:19.856460+0000","last_unstale":"2024-09-11T22:20:24.889798+0000","last_undegraded":"2024-09-11T22:20:24.889798+0000","last_fullsized":"2024-09-11T22:20:24.889798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033665+0000","last_change":"2024-09-11T22:20:19.855629+0000","last_active":"2024-09-11T22:21:01.033665+0000","last_peered":"2024-09-11T22:21:01.033665+0000","last_clean":"2024-09-11T22:21:01.033665+0000","last_became_active":"2024-09-11T22:20:19.855363+0000","last_became_peered":"2024-09-11T22:20:19.855363+0000","last_unstale":"2024-09-11T22:21:01.033665+0000","last_undegraded":"2024-09-11T22:21:01.033665+0000","last_fullsized":"2024-09-11T22:21:01.033665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887872+0000","last_change":"2024-09-11T22:20:19.863122+0000","last_active":"2024-09-11T22:20:24.887872+0000","last_peered":"2024-09-11T22:20:24.887872+0000","last_clean":"2024-09-11T22:20:24.887872+0000","last_became_active":"2024-09-11T22:20:19.862828+0000","last_became_peered":"2024-09-11T22:20:19.862828+0000","last_unstale":"2024-09-11T22:20:24.887872+0000","last_undegraded":"2024-09-11T22:20:24.887872+0000","last_fullsized":"2024-09-11T22:20:24.887872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:10.868762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997865+0000","last_change":"2024-09-11T22:20:19.846453+0000","last_active":"2024-09-11T22:20:24.997865+0000","last_peered":"2024-09-11T22:20:24.997865+0000","last_clean":"2024-09-11T22:20:24.997865+0000","last_became_active":"2024-09-11T22:20:19.846186+0000","last_became_peered":"2024-09-11T22:20:19.846186+0000","last_unstale":"2024-09-11T22:20:24.997865+0000","last_undegraded":"2024-09-11T22:20:24.997865+0000","last_fullsized":"2024-09-11T22:20:24.997865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:24.032365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888935+0000","last_change":"2024-09-11T22:20:19.860632+0000","last_active":"2024-09-11T22:20:24.888935+0000","last_peered":"2024-09-11T22:20:24.888935+0000","last_clean":"2024-09-11T22:20:24.888935+0000","last_became_active":"2024-09-11T22:20:19.860005+0000","last_became_peered":"2024-09-11T22:20:19.860005+0000","last_unstale":"2024-09-11T22:20:24.888935+0000","last_undegraded":"2024-09-11T22:20:24.888935+0000","last_fullsized":"2024-09-11T22:20:24.888935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888034+0000","last_change":"2024-09-11T22:20:19.859195+0000","last_active":"2024-09-11T22:20:24.888034+0000","last_peered":"2024-09-11T22:20:24.888034+0000","last_clean":"2024-09-11T22:20:24.888034+0000","last_became_active":"2024-09-11T22:20:19.858832+0000","last_became_peered":"2024-09-11T22:20:19.858832+0000","last_unstale":"2024-09-11T22:20:24.888034+0000","last_undegraded":"2024-09-11T22:20:24.888034+0000","last_fullsized":"2024-09-11T22:20:24.888034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:56.259074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888950+0000","last_change":"2024-09-11T22:20:19.858969+0000","last_active":"2024-09-11T22:20:24.888950+0000","last_peered":"2024-09-11T22:20:24.888950+0000","last_clean":"2024-09-11T22:20:24.888950+0000","last_became_active":"2024-09-11T22:20:19.857847+0000","last_became_peered":"2024-09-11T22:20:19.857847+0000","last_unstale":"2024-09-11T22:20:24.888950+0000","last_undegraded":"2024-09-11T22:20:24.888950+0000","last_fullsized":"2024-09-11T22:20:24.888950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887453+0000","last_change":"2024-09-11T22:20:19.863294+0000","last_active":"2024-09-11T22:20:24.887453+0000","last_peered":"2024-09-11T22:20:24.887453+0000","last_clean":"2024-09-11T22:20:24.887453+0000","last_became_active":"2024-09-11T22:20:19.863007+0000","last_became_peered":"2024-09-11T22:20:19.863007+0000","last_unstale":"2024-09-11T22:20:24.887453+0000","last_undegraded":"2024-09-11T22:20:24.887453+0000","last_fullsized":"2024-09-11T22:20:24.887453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:06.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889706+0000","last_change":"2024-09-11T22:20:19.858414+0000","last_active":"2024-09-11T22:20:24.889706+0000","last_peered":"2024-09-11T22:20:24.889706+0000","last_clean":"2024-09-11T22:20:24.889706+0000","last_became_active":"2024-09-11T22:20:19.857790+0000","last_became_peered":"2024-09-11T22:20:19.857790+0000","last_unstale":"2024-09-11T22:20:24.889706+0000","last_undegraded":"2024-09-11T22:20:24.889706+0000","last_fullsized":"2024-09-11T22:20:24.889706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":2,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-11T22:20:27.047940+0000","last_change":"2024-09-11T22:21:01.323256+0000","last_active":"2024-09-11T22:21:01.323256+0000","last_peered":"2024-09-11T22:20:27.047940+0000","last_clean":"2024-09-11T22:20:27.047940+0000","last_became_active":"2024-09-11T22:20:19.854774+0000","last_became_peered":"2024-09-11T22:20:19.854774+0000","last_unstale":"2024-09-11T22:20:27.047940+0000","last_undegraded":"2024-09-11T22:20:27.047940+0000","last_fullsized":"2024-09-11T22:20:27.047940+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888845+0000","last_change":"2024-09-11T22:20:19.864700+0000","last_active":"2024-09-11T22:20:24.888845+0000","last_peered":"2024-09-11T22:20:24.888845+0000","last_clean":"2024-09-11T22:20:24.888845+0000","last_became_active":"2024-09-11T22:20:19.862296+0000","last_became_peered":"2024-09-11T22:20:19.862296+0000","last_unstale":"2024-09-11T22:20:24.888845+0000","last_undegraded":"2024-09-11T22:20:24.888845+0000","last_fullsized":"2024-09-11T22:20:24.888845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048773+0000","last_change":"2024-09-11T22:20:19.855253+0000","last_active":"2024-09-11T22:20:27.048773+0000","last_peered":"2024-09-11T22:20:27.048773+0000","last_clean":"2024-09-11T22:20:27.048773+0000","last_became_active":"2024-09-11T22:20:19.854970+0000","last_became_peered":"2024-09-11T22:20:19.854970+0000","last_unstale":"2024-09-11T22:20:27.048773+0000","last_undegraded":"2024-09-11T22:20:27.048773+0000","last_fullsized":"2024-09-11T22:20:27.048773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025225+0000","last_change":"2024-09-11T22:20:19.850202+0000","last_active":"2024-09-11T22:21:01.025225+0000","last_peered":"2024-09-11T22:21:01.025225+0000","last_clean":"2024-09-11T22:21:01.025225+0000","last_became_active":"2024-09-11T22:20:19.849815+0000","last_became_peered":"2024-09-11T22:20:19.849815+0000","last_unstale":"2024-09-11T22:21:01.025225+0000","last_undegraded":"2024-09-11T22:21:01.025225+0000","last_fullsized":"2024-09-11T22:21:01.025225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:56.480679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889814+0000","last_change":"2024-09-11T22:20:19.866864+0000","last_active":"2024-09-11T22:20:24.889814+0000","last_peered":"2024-09-11T22:20:24.889814+0000","last_clean":"2024-09-11T22:20:24.889814+0000","last_became_active":"2024-09-11T22:20:19.866484+0000","last_became_peered":"2024-09-11T22:20:19.866484+0000","last_unstale":"2024-09-11T22:20:24.889814+0000","last_undegraded":"2024-09-11T22:20:24.889814+0000","last_fullsized":"2024-09-11T22:20:24.889814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":2,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-11T22:20:19.847772+0000","last_change":"2024-09-11T22:21:01.323220+0000","last_active":"2024-09-11T22:20:18.828308+0000","last_peered":"2024-09-11T22:20:18.828308+0000","last_clean":"2024-09-11T22:20:18.828308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:19.847772+0000","last_undegraded":"2024-09-11T22:20:19.847772+0000","last_fullsized":"2024-09-11T22:20:19.847772+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997750+0000","last_change":"2024-09-11T22:20:19.860050+0000","last_active":"2024-09-11T22:20:24.997750+0000","last_peered":"2024-09-11T22:20:24.997750+0000","last_clean":"2024-09-11T22:20:24.997750+0000","last_became_active":"2024-09-11T22:20:19.859755+0000","last_became_peered":"2024-09-11T22:20:19.859755+0000","last_unstale":"2024-09-11T22:20:24.997750+0000","last_undegraded":"2024-09-11T22:20:24.997750+0000","last_fullsized":"2024-09-11T22:20:24.997750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:42.487669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033495+0000","last_change":"2024-09-11T22:20:19.853902+0000","last_active":"2024-09-11T22:21:01.033495+0000","last_peered":"2024-09-11T22:21:01.033495+0000","last_clean":"2024-09-11T22:21:01.033495+0000","last_became_active":"2024-09-11T22:20:19.853563+0000","last_became_peered":"2024-09-11T22:20:19.853563+0000","last_unstale":"2024-09-11T22:21:01.033495+0000","last_undegraded":"2024-09-11T22:21:01.033495+0000","last_fullsized":"2024-09-11T22:21:01.033495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887571+0000","last_change":"2024-09-11T22:20:19.849490+0000","last_active":"2024-09-11T22:20:24.887571+0000","last_peered":"2024-09-11T22:20:24.887571+0000","last_clean":"2024-09-11T22:20:24.887571+0000","last_became_active":"2024-09-11T22:20:19.848965+0000","last_became_peered":"2024-09-11T22:20:19.848965+0000","last_unstale":"2024-09-11T22:20:24.887571+0000","last_undegraded":"2024-09-11T22:20:24.887571+0000","last_fullsized":"2024-09-11T22:20:24.887571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:10.387663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048041+0000","last_change":"2024-09-11T22:20:19.860457+0000","last_active":"2024-09-11T22:20:27.048041+0000","last_peered":"2024-09-11T22:20:27.048041+0000","last_clean":"2024-09-11T22:20:27.048041+0000","last_became_active":"2024-09-11T22:20:19.858887+0000","last_became_peered":"2024-09-11T22:20:19.858887+0000","last_unstale":"2024-09-11T22:20:27.048041+0000","last_undegraded":"2024-09-11T22:20:27.048041+0000","last_fullsized":"2024-09-11T22:20:27.048041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:34.620956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888481+0000","last_change":"2024-09-11T22:20:19.862347+0000","last_active":"2024-09-11T22:20:24.888481+0000","last_peered":"2024-09-11T22:20:24.888481+0000","last_clean":"2024-09-11T22:20:24.888481+0000","last_became_active":"2024-09-11T22:20:19.861965+0000","last_became_peered":"2024-09-11T22:20:19.861965+0000","last_unstale":"2024-09-11T22:20:24.888481+0000","last_undegraded":"2024-09-11T22:20:24.888481+0000","last_fullsized":"2024-09-11T22:20:24.888481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888938+0000","last_change":"2024-09-11T22:20:19.862065+0000","last_active":"2024-09-11T22:20:24.888938+0000","last_peered":"2024-09-11T22:20:24.888938+0000","last_clean":"2024-09-11T22:20:24.888938+0000","last_became_active":"2024-09-11T22:20:19.861765+0000","last_became_peered":"2024-09-11T22:20:19.861765+0000","last_unstale":"2024-09-11T22:20:24.888938+0000","last_undegraded":"2024-09-11T22:20:24.888938+0000","last_fullsized":"2024-09-11T22:20:24.888938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.049117+0000","last_change":"2024-09-11T22:20:19.865064+0000","last_active":"2024-09-11T22:20:27.049117+0000","last_peered":"2024-09-11T22:20:27.049117+0000","last_clean":"2024-09-11T22:20:27.049117+0000","last_became_active":"2024-09-11T22:20:19.864697+0000","last_became_peered":"2024-09-11T22:20:19.864697+0000","last_unstale":"2024-09-11T22:20:27.049117+0000","last_undegraded":"2024-09-11T22:20:27.049117+0000","last_fullsized":"2024-09-11T22:20:27.049117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887201+0000","last_change":"2024-09-11T22:20:19.861293+0000","last_active":"2024-09-11T22:20:24.887201+0000","last_peered":"2024-09-11T22:20:24.887201+0000","last_clean":"2024-09-11T22:20:24.887201+0000","last_became_active":"2024-09-11T22:20:19.861013+0000","last_became_peered":"2024-09-11T22:20:19.861013+0000","last_unstale":"2024-09-11T22:20:24.887201+0000","last_undegraded":"2024-09-11T22:20:24.887201+0000","last_fullsized":"2024-09-11T22:20:24.887201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:13.178404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048303+0000","last_change":"2024-09-11T22:20:19.858131+0000","last_active":"2024-09-11T22:20:27.048303+0000","last_peered":"2024-09-11T22:20:27.048303+0000","last_clean":"2024-09-11T22:20:27.048303+0000","last_became_active":"2024-09-11T22:20:19.857842+0000","last_became_peered":"2024-09-11T22:20:19.857842+0000","last_unstale":"2024-09-11T22:20:27.048303+0000","last_undegraded":"2024-09-11T22:20:27.048303+0000","last_fullsized":"2024-09-11T22:20:27.048303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889602+0000","last_change":"2024-09-11T22:20:19.859667+0000","last_active":"2024-09-11T22:20:24.889602+0000","last_peered":"2024-09-11T22:20:24.889602+0000","last_clean":"2024-09-11T22:20:24.889602+0000","last_became_active":"2024-09-11T22:20:19.859306+0000","last_became_peered":"2024-09-11T22:20:19.859306+0000","last_unstale":"2024-09-11T22:20:24.889602+0000","last_undegraded":"2024-09-11T22:20:24.889602+0000","last_fullsized":"2024-09-11T22:20:24.889602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048551+0000","last_change":"2024-09-11T22:20:19.848821+0000","last_active":"2024-09-11T22:20:27.048551+0000","last_peered":"2024-09-11T22:20:27.048551+0000","last_clean":"2024-09-11T22:20:27.048551+0000","last_became_active":"2024-09-11T22:20:19.848531+0000","last_became_peered":"2024-09-11T22:20:19.848531+0000","last_unstale":"2024-09-11T22:20:27.048551+0000","last_undegraded":"2024-09-11T22:20:27.048551+0000","last_fullsized":"2024-09-11T22:20:27.048551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890212+0000","last_change":"2024-09-11T22:20:19.866300+0000","last_active":"2024-09-11T22:20:24.890212+0000","last_peered":"2024-09-11T22:20:24.890212+0000","last_clean":"2024-09-11T22:20:24.890212+0000","last_became_active":"2024-09-11T22:20:19.865939+0000","last_became_peered":"2024-09-11T22:20:19.865939+0000","last_unstale":"2024-09-11T22:20:24.890212+0000","last_undegraded":"2024-09-11T22:20:24.890212+0000","last_fullsized":"2024-09-11T22:20:24.890212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033602+0000","last_change":"2024-09-11T22:20:19.858144+0000","last_active":"2024-09-11T22:21:01.033602+0000","last_peered":"2024-09-11T22:21:01.033602+0000","last_clean":"2024-09-11T22:21:01.033602+0000","last_became_active":"2024-09-11T22:20:19.857840+0000","last_became_peered":"2024-09-11T22:20:19.857840+0000","last_unstale":"2024-09-11T22:21:01.033602+0000","last_undegraded":"2024-09-11T22:21:01.033602+0000","last_fullsized":"2024-09-11T22:21:01.033602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:23.801072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998195+0000","last_change":"2024-09-11T22:20:19.857378+0000","last_active":"2024-09-11T22:20:24.998195+0000","last_peered":"2024-09-11T22:20:24.998195+0000","last_clean":"2024-09-11T22:20:24.998195+0000","last_became_active":"2024-09-11T22:20:19.857089+0000","last_became_peered":"2024-09-11T22:20:19.857089+0000","last_unstale":"2024-09-11T22:20:24.998195+0000","last_undegraded":"2024-09-11T22:20:24.998195+0000","last_fullsized":"2024-09-11T22:20:24.998195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:29.835695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":2,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-11T22:20:19.843776+0000","last_change":"2024-09-11T22:21:01.323294+0000","last_active":"2024-09-11T22:20:18.828308+0000","last_peered":"2024-09-11T22:20:18.828308+0000","last_clean":"2024-09-11T22:20:18.828308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:19.843776+0000","last_undegraded":"2024-09-11T22:20:19.843776+0000","last_fullsized":"2024-09-11T22:20:19.843776+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7454,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":699002,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":111840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":108696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":108032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":111874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":108136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":698346,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":108262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:21:02.541 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:21:02.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.672+0000 7f4a9212c640 1 Processor -- start 2024-09-11T22:21:02.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.673+0000 7f4a9212c640 1 -- start start 2024-09-11T22:21:02.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.673+0000 7f4a9212c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4a8c1527d0 0x7f4a8c06e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:02.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.673+0000 7f4a9212c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4a8c0c8a70 0x7f4a8c0c9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:02.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.673+0000 7f4a9212c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a8c0c8250 0x7f4a8c0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:02.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.673+0000 7f4a9212c640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f4a8c0c5080 con 0x7f4a8c1527d0 2024-09-11T22:21:02.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.673+0000 7f4a9212c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f4a8c0ca3b0 con 0x7f4a8c0c8a70 2024-09-11T22:21:02.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.673+0000 7f4a9212c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4a8c0ca690 con 0x7f4a8c0c8250 2024-09-11T22:21:02.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.673+0000 7f4a8b7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4a8c1527d0 0x7f4a8c06e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:02.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.673+0000 7f4a8b7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4a8c1527d0 0x7f4a8c06e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37966/0 (socket says 172.21.15.100:37966) 2024-09-11T22:21:02.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.673+0000 7f4a8b7fe640 1 -- 172.21.15.100:0/42136024 learned_addr learned my addr 172.21.15.100:0/42136024 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:02.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.674+0000 7f4a8b7fe640 1 -- 172.21.15.100:0/42136024 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a8c0c8250 msgr2=0x7f4a8c0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:02.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.674+0000 7f4a8b7fe640 1 --2- 172.21.15.100:0/42136024 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a8c0c8250 0x7f4a8c0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.674+0000 7f4a8b7fe640 1 -- 172.21.15.100:0/42136024 >> v2:172.21.15.167:3300/0 conn(0x7f4a8c0c8a70 msgr2=0x7f4a8c0c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:02.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.674+0000 7f4a8affd640 1 --2- 172.21.15.100:0/42136024 >> v2:172.21.15.167:3300/0 conn(0x7f4a8c0c8a70 0x7f4a8c0c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:02.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.674+0000 7f4a8b7fe640 1 --2- 172.21.15.100:0/42136024 >> v2:172.21.15.167:3300/0 conn(0x7f4a8c0c8a70 0x7f4a8c0c9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.674+0000 7f4a8b7fe640 1 -- 172.21.15.100:0/42136024 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a8c06edc0 con 0x7f4a8c1527d0 2024-09-11T22:21:02.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.674+0000 7f4a8b7fe640 1 --2- 172.21.15.100:0/42136024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a8c1527d0 0x7f4a8c06e120 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4a80009870 tx=0x7f4a8002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5337eec3ae2bee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:02.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.675+0000 7f4a8a7fc640 1 -- 172.21.15.100:0/42136024 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a80037070 con 0x7f4a8c1527d0 2024-09-11T22:21:02.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.675+0000 7f4a8a7fc640 1 -- 172.21.15.100:0/42136024 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a80032440 con 0x7f4a8c1527d0 2024-09-11T22:21:02.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.675+0000 7f4a8a7fc640 1 -- 172.21.15.100:0/42136024 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a80032810 con 0x7f4a8c1527d0 2024-09-11T22:21:02.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.675+0000 7f4a9212c640 1 -- 172.21.15.100:0/42136024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a8c1527d0 msgr2=0x7f4a8c06e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:02.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.675+0000 7f4a9212c640 1 --2- 172.21.15.100:0/42136024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a8c1527d0 0x7f4a8c06e120 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4a80009870 tx=0x7f4a8002a210 comp rx=0 tx=0).stop 2024-09-11T22:21:02.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.675+0000 7f4a9212c640 1 -- 172.21.15.100:0/42136024 shutdown_connections 2024-09-11T22:21:02.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.675+0000 7f4a9212c640 1 --2- 172.21.15.100:0/42136024 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a8c0c8250 0x7f4a8c0cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.675+0000 7f4a9212c640 1 --2- 172.21.15.100:0/42136024 >> v2:172.21.15.167:3300/0 conn(0x7f4a8c0c8a70 0x7f4a8c0c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.675+0000 7f4a9212c640 1 --2- 172.21.15.100:0/42136024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a8c1527d0 0x7f4a8c06e120 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.675+0000 7f4a9212c640 1 -- 172.21.15.100:0/42136024 >> 172.21.15.100:0/42136024 conn(0x7f4a8c073900 msgr2=0x7f4a8c073ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:02.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.675+0000 7f4a9212c640 1 -- 172.21.15.100:0/42136024 shutdown_connections 2024-09-11T22:21:02.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.675+0000 7f4a9212c640 1 -- 172.21.15.100:0/42136024 wait complete. 2024-09-11T22:21:02.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.676+0000 7f4a9212c640 1 Processor -- start 2024-09-11T22:21:02.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.676+0000 7f4a9212c640 1 -- start start 2024-09-11T22:21:02.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.677+0000 7f4a9212c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a8c0c8250 0x7f4a8c0c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:02.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.677+0000 7f4a9212c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a8c0c8a70 0x7f4a8c06c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:02.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.677+0000 7f4a9212c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a8c1527d0 0x7f4a8c14bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:02.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.677+0000 7f4a9212c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c0c99c0 con 0x7f4a8c0c8250 2024-09-11T22:21:02.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.677+0000 7f4a9212c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c0c9840 con 0x7f4a8c1527d0 2024-09-11T22:21:02.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.677+0000 7f4a9212c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4a8c0cb040 con 0x7f4a8c0c8a70 2024-09-11T22:21:02.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.677+0000 7f4a8b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a8c0c8250 0x7f4a8c0c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:02.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.677+0000 7f4a8b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a8c0c8250 0x7f4a8c0c6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37972/0 (socket says 172.21.15.100:37972) 2024-09-11T22:21:02.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.677+0000 7f4a8b7fe640 1 -- 172.21.15.100:0/408214650 learned_addr learned my addr 172.21.15.100:0/408214650 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:02.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.677+0000 7f4a8bfff640 1 --2- 172.21.15.100:0/408214650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a8c1527d0 0x7f4a8c14bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:02.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.677+0000 7f4a8affd640 1 --2- 172.21.15.100:0/408214650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a8c0c8a70 0x7f4a8c06c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:02.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.677+0000 7f4a8b7fe640 1 -- 172.21.15.100:0/408214650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a8c0c8a70 msgr2=0x7f4a8c06c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:02.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.677+0000 7f4a8b7fe640 1 --2- 172.21.15.100:0/408214650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a8c0c8a70 0x7f4a8c06c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.677+0000 7f4a8b7fe640 1 -- 172.21.15.100:0/408214650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a8c1527d0 msgr2=0x7f4a8c14bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:02.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.677+0000 7f4a8b7fe640 1 --2- 172.21.15.100:0/408214650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a8c1527d0 0x7f4a8c14bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.677+0000 7f4a8b7fe640 1 -- 172.21.15.100:0/408214650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a8c14fa90 con 0x7f4a8c0c8250 2024-09-11T22:21:02.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.677+0000 7f4a8bfff640 1 --2- 172.21.15.100:0/408214650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a8c1527d0 0x7f4a8c14bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:02.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.678+0000 7f4a8b7fe640 1 --2- 172.21.15.100:0/408214650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a8c0c8250 0x7f4a8c0c6750 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4a80000c00 tx=0x7f4a800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:02.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.678+0000 7f4a73fff640 1 -- 172.21.15.100:0/408214650 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a80037040 con 0x7f4a8c0c8250 2024-09-11T22:21:02.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.678+0000 7f4a73fff640 1 -- 172.21.15.100:0/408214650 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a80042070 con 0x7f4a8c0c8250 2024-09-11T22:21:02.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.678+0000 7f4a73fff640 1 -- 172.21.15.100:0/408214650 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a80030bd0 con 0x7f4a8c0c8250 2024-09-11T22:21:02.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.678+0000 7f4a9212c640 1 -- 172.21.15.100:0/408214650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a8c14f7b0 con 0x7f4a8c0c8250 2024-09-11T22:21:02.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.678+0000 7f4a9212c640 1 -- 172.21.15.100:0/408214650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a8c1f1480 con 0x7f4a8c0c8250 2024-09-11T22:21:02.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.679+0000 7f4a9212c640 1 -- 172.21.15.100:0/408214650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a8c0c9300 con 0x7f4a8c0c8250 2024-09-11T22:21:02.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.679+0000 7f4a73fff640 1 -- 172.21.15.100:0/408214650 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a80047460 con 0x7f4a8c0c8250 2024-09-11T22:21:02.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.680+0000 7f4a73fff640 1 --2- 172.21.15.100:0/408214650 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4a7806be30 0x7f4a7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:02.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.680+0000 7f4a73fff640 1 -- 172.21.15.100:0/408214650 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f4a800abe40 con 0x7f4a8c0c8250 2024-09-11T22:21:02.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.680+0000 7f4a8affd640 1 --2- 172.21.15.100:0/408214650 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4a7806be30 0x7f4a7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:02.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.680+0000 7f4a8affd640 1 --2- 172.21.15.100:0/408214650 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4a7806be30 0x7f4a7806e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c006fd0 tx=0x7f4a7c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:02.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.684+0000 7f4a73fff640 1 -- 172.21.15.100:0/408214650 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4a80045360 con 0x7f4a8c0c8250 2024-09-11T22:21:02.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.846+0000 7f4a9212c640 1 -- 172.21.15.100:0/408214650 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4a8c0740f0 con 0x7f4a7806be30 2024-09-11T22:21:02.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.854+0000 7f4a73fff640 1 -- 172.21.15.100:0/408214650 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332412 (secure 0 0 0) 0x7f4a8c0740f0 con 0x7f4a7806be30 2024-09-11T22:21:02.858 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:21:02.860 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-11T22:21:02.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.857+0000 7f4a9212c640 1 -- 172.21.15.100:0/408214650 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4a7806be30 msgr2=0x7f4a7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:02.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.857+0000 7f4a9212c640 1 --2- 172.21.15.100:0/408214650 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4a7806be30 0x7f4a7806e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c006fd0 tx=0x7f4a7c008040 comp rx=0 tx=0).stop 2024-09-11T22:21:02.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.857+0000 7f4a9212c640 1 -- 172.21.15.100:0/408214650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a8c0c8250 msgr2=0x7f4a8c0c6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:02.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.857+0000 7f4a9212c640 1 --2- 172.21.15.100:0/408214650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a8c0c8250 0x7f4a8c0c6750 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4a80000c00 tx=0x7f4a800046c0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.857+0000 7f4a9212c640 1 -- 172.21.15.100:0/408214650 shutdown_connections 2024-09-11T22:21:02.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.857+0000 7f4a9212c640 1 --2- 172.21.15.100:0/408214650 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4a7806be30 0x7f4a7806e2f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.857+0000 7f4a9212c640 1 --2- 172.21.15.100:0/408214650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a8c1527d0 0x7f4a8c14bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.857+0000 7f4a9212c640 1 --2- 172.21.15.100:0/408214650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a8c0c8a70 0x7f4a8c06c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.857+0000 7f4a9212c640 1 --2- 172.21.15.100:0/408214650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a8c0c8250 0x7f4a8c0c6750 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:02.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.857+0000 7f4a9212c640 1 -- 172.21.15.100:0/408214650 >> 172.21.15.100:0/408214650 conn(0x7f4a8c073900 msgr2=0x7f4a8c150830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:02.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.857+0000 7f4a9212c640 1 -- 172.21.15.100:0/408214650 shutdown_connections 2024-09-11T22:21:02.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:02.857+0000 7f4a9212c640 1 -- 172.21.15.100:0/408214650 wait complete. 2024-09-11T22:21:02.869 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-09-11T22:21:02.314004+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597822,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":287,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218592,"kb_used_data":2400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756128,"statfs":{"total":773094113280,"available":772870275072,"internally_reserved":0,"allocated":2457600,"data_stored":2054188,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":784,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001916"},"pg_stats":[{"pgid":"2.1f","version":"26'9","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.034259+0000","last_change":"2024-09-11T22:20:18.853007+0000","last_active":"2024-09-11T22:21:01.034259+0000","last_peered":"2024-09-11T22:21:01.034259+0000","last_clean":"2024-09-11T22:21:01.034259+0000","last_became_active":"2024-09-11T22:20:18.852740+0000","last_became_peered":"2024-09-11T22:20:18.852740+0000","last_unstale":"2024-09-11T22:21:01.034259+0000","last_undegraded":"2024-09-11T22:21:01.034259+0000","last_fullsized":"2024-09-11T22:21:01.034259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:46.710328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887920+0000","last_change":"2024-09-11T22:20:19.849765+0000","last_active":"2024-09-11T22:20:24.887920+0000","last_peered":"2024-09-11T22:20:24.887920+0000","last_clean":"2024-09-11T22:20:24.887920+0000","last_became_active":"2024-09-11T22:20:19.848619+0000","last_became_peered":"2024-09-11T22:20:19.848619+0000","last_unstale":"2024-09-11T22:20:24.887920+0000","last_undegraded":"2024-09-11T22:20:24.887920+0000","last_fullsized":"2024-09-11T22:20:24.887920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:57.621624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887250+0000","last_change":"2024-09-11T22:20:24.078618+0000","last_active":"2024-09-11T22:20:24.887250+0000","last_peered":"2024-09-11T22:20:24.887250+0000","last_clean":"2024-09-11T22:20:24.887250+0000","last_became_active":"2024-09-11T22:20:24.078283+0000","last_became_peered":"2024-09-11T22:20:24.078283+0000","last_unstale":"2024-09-11T22:20:24.887250+0000","last_undegraded":"2024-09-11T22:20:24.887250+0000","last_fullsized":"2024-09-11T22:20:24.887250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:01.901307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888040+0000","last_change":"2024-09-11T22:20:18.855945+0000","last_active":"2024-09-11T22:20:24.888040+0000","last_peered":"2024-09-11T22:20:24.888040+0000","last_clean":"2024-09-11T22:20:24.888040+0000","last_became_active":"2024-09-11T22:20:18.854811+0000","last_became_peered":"2024-09-11T22:20:18.854811+0000","last_unstale":"2024-09-11T22:20:24.888040+0000","last_undegraded":"2024-09-11T22:20:24.888040+0000","last_fullsized":"2024-09-11T22:20:24.888040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:47.508920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033442+0000","last_change":"2024-09-11T22:20:19.862436+0000","last_active":"2024-09-11T22:21:01.033442+0000","last_peered":"2024-09-11T22:21:01.033442+0000","last_clean":"2024-09-11T22:21:01.033442+0000","last_became_active":"2024-09-11T22:20:19.862061+0000","last_became_peered":"2024-09-11T22:20:19.862061+0000","last_unstale":"2024-09-11T22:21:01.033442+0000","last_undegraded":"2024-09-11T22:21:01.033442+0000","last_fullsized":"2024-09-11T22:21:01.033442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047627+0000","last_change":"2024-09-11T22:20:23.879729+0000","last_active":"2024-09-11T22:20:27.047627+0000","last_peered":"2024-09-11T22:20:27.047627+0000","last_clean":"2024-09-11T22:20:27.047627+0000","last_became_active":"2024-09-11T22:20:23.879245+0000","last_became_peered":"2024-09-11T22:20:23.879245+0000","last_unstale":"2024-09-11T22:20:27.047627+0000","last_undegraded":"2024-09-11T22:20:27.047627+0000","last_fullsized":"2024-09-11T22:20:27.047627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:36.836842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.964933+0000","last_change":"2024-09-11T22:20:18.853076+0000","last_active":"2024-09-11T22:20:52.964933+0000","last_peered":"2024-09-11T22:20:52.964933+0000","last_clean":"2024-09-11T22:20:52.964933+0000","last_became_active":"2024-09-11T22:20:18.852728+0000","last_became_peered":"2024-09-11T22:20:18.852728+0000","last_unstale":"2024-09-11T22:20:52.964933+0000","last_undegraded":"2024-09-11T22:20:52.964933+0000","last_fullsized":"2024-09-11T22:20:52.964933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890308+0000","last_change":"2024-09-11T22:20:19.864544+0000","last_active":"2024-09-11T22:20:24.890308+0000","last_peered":"2024-09-11T22:20:24.890308+0000","last_clean":"2024-09-11T22:20:24.890308+0000","last_became_active":"2024-09-11T22:20:19.864234+0000","last_became_peered":"2024-09-11T22:20:19.864234+0000","last_unstale":"2024-09-11T22:20:24.890308+0000","last_undegraded":"2024-09-11T22:20:24.890308+0000","last_fullsized":"2024-09-11T22:20:24.890308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048400+0000","last_change":"2024-09-11T22:20:23.873783+0000","last_active":"2024-09-11T22:20:27.048400+0000","last_peered":"2024-09-11T22:20:27.048400+0000","last_clean":"2024-09-11T22:20:27.048400+0000","last_became_active":"2024-09-11T22:20:23.873385+0000","last_became_peered":"2024-09-11T22:20:23.873385+0000","last_unstale":"2024-09-11T22:20:27.048400+0000","last_undegraded":"2024-09-11T22:20:27.048400+0000","last_fullsized":"2024-09-11T22:20:27.048400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048092+0000","last_change":"2024-09-11T22:20:18.861530+0000","last_active":"2024-09-11T22:20:27.048092+0000","last_peered":"2024-09-11T22:20:27.048092+0000","last_clean":"2024-09-11T22:20:27.048092+0000","last_became_active":"2024-09-11T22:20:18.861230+0000","last_became_peered":"2024-09-11T22:20:18.861230+0000","last_unstale":"2024-09-11T22:20:27.048092+0000","last_undegraded":"2024-09-11T22:20:27.048092+0000","last_fullsized":"2024-09-11T22:20:27.048092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890615+0000","last_change":"2024-09-11T22:20:19.863401+0000","last_active":"2024-09-11T22:20:24.890615+0000","last_peered":"2024-09-11T22:20:24.890615+0000","last_clean":"2024-09-11T22:20:24.890615+0000","last_became_active":"2024-09-11T22:20:19.863127+0000","last_became_peered":"2024-09-11T22:20:19.863127+0000","last_unstale":"2024-09-11T22:20:24.890615+0000","last_undegraded":"2024-09-11T22:20:24.890615+0000","last_fullsized":"2024-09-11T22:20:24.890615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:36.888544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048021+0000","last_change":"2024-09-11T22:20:23.874650+0000","last_active":"2024-09-11T22:20:27.048021+0000","last_peered":"2024-09-11T22:20:27.048021+0000","last_clean":"2024-09-11T22:20:27.048021+0000","last_became_active":"2024-09-11T22:20:23.874040+0000","last_became_peered":"2024-09-11T22:20:23.874040+0000","last_unstale":"2024-09-11T22:20:27.048021+0000","last_undegraded":"2024-09-11T22:20:27.048021+0000","last_fullsized":"2024-09-11T22:20:27.048021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888158+0000","last_change":"2024-09-11T22:20:19.859446+0000","last_active":"2024-09-11T22:20:24.888158+0000","last_peered":"2024-09-11T22:20:24.888158+0000","last_clean":"2024-09-11T22:20:24.888158+0000","last_became_active":"2024-09-11T22:20:19.859106+0000","last_became_peered":"2024-09-11T22:20:19.859106+0000","last_unstale":"2024-09-11T22:20:24.888158+0000","last_undegraded":"2024-09-11T22:20:24.888158+0000","last_fullsized":"2024-09-11T22:20:24.888158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.944022+0000","last_change":"2024-09-11T22:20:18.856475+0000","last_active":"2024-09-11T22:20:46.944022+0000","last_peered":"2024-09-11T22:20:46.944022+0000","last_clean":"2024-09-11T22:20:46.944022+0000","last_became_active":"2024-09-11T22:20:18.856165+0000","last_became_peered":"2024-09-11T22:20:18.856165+0000","last_unstale":"2024-09-11T22:20:46.944022+0000","last_undegraded":"2024-09-11T22:20:46.944022+0000","last_fullsized":"2024-09-11T22:20:46.944022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048102+0000","last_change":"2024-09-11T22:20:23.878121+0000","last_active":"2024-09-11T22:20:27.048102+0000","last_peered":"2024-09-11T22:20:27.048102+0000","last_clean":"2024-09-11T22:20:27.048102+0000","last_became_active":"2024-09-11T22:20:23.877713+0000","last_became_peered":"2024-09-11T22:20:23.877713+0000","last_unstale":"2024-09-11T22:20:27.048102+0000","last_undegraded":"2024-09-11T22:20:27.048102+0000","last_fullsized":"2024-09-11T22:20:27.048102+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887604+0000","last_change":"2024-09-11T22:20:19.858358+0000","last_active":"2024-09-11T22:20:24.887604+0000","last_peered":"2024-09-11T22:20:24.887604+0000","last_clean":"2024-09-11T22:20:24.887604+0000","last_became_active":"2024-09-11T22:20:19.858057+0000","last_became_peered":"2024-09-11T22:20:19.858057+0000","last_unstale":"2024-09-11T22:20:24.887604+0000","last_undegraded":"2024-09-11T22:20:24.887604+0000","last_fullsized":"2024-09-11T22:20:24.887604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:07.839926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998226+0000","last_change":"2024-09-11T22:20:18.853818+0000","last_active":"2024-09-11T22:20:24.998226+0000","last_peered":"2024-09-11T22:20:24.998226+0000","last_clean":"2024-09-11T22:20:24.998226+0000","last_became_active":"2024-09-11T22:20:18.853508+0000","last_became_peered":"2024-09-11T22:20:18.853508+0000","last_unstale":"2024-09-11T22:20:24.998226+0000","last_undegraded":"2024-09-11T22:20:24.998226+0000","last_fullsized":"2024-09-11T22:20:24.998226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:58.141587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047962+0000","last_change":"2024-09-11T22:20:23.879226+0000","last_active":"2024-09-11T22:20:27.047962+0000","last_peered":"2024-09-11T22:20:27.047962+0000","last_clean":"2024-09-11T22:20:27.047962+0000","last_became_active":"2024-09-11T22:20:23.878199+0000","last_became_peered":"2024-09-11T22:20:23.878199+0000","last_unstale":"2024-09-11T22:20:27.047962+0000","last_undegraded":"2024-09-11T22:20:27.047962+0000","last_fullsized":"2024-09-11T22:20:27.047962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:13.245927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887402+0000","last_change":"2024-09-11T22:20:19.844748+0000","last_active":"2024-09-11T22:20:24.887402+0000","last_peered":"2024-09-11T22:20:24.887402+0000","last_clean":"2024-09-11T22:20:24.887402+0000","last_became_active":"2024-09-11T22:20:19.844446+0000","last_became_peered":"2024-09-11T22:20:19.844446+0000","last_unstale":"2024-09-11T22:20:24.887402+0000","last_undegraded":"2024-09-11T22:20:24.887402+0000","last_fullsized":"2024-09-11T22:20:24.887402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:13.319918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.948253+0000","last_change":"2024-09-11T22:20:18.847388+0000","last_active":"2024-09-11T22:20:46.948253+0000","last_peered":"2024-09-11T22:20:46.948253+0000","last_clean":"2024-09-11T22:20:46.948253+0000","last_became_active":"2024-09-11T22:20:18.847118+0000","last_became_peered":"2024-09-11T22:20:18.847118+0000","last_unstale":"2024-09-11T22:20:46.948253+0000","last_undegraded":"2024-09-11T22:20:46.948253+0000","last_fullsized":"2024-09-11T22:20:46.948253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:47.360920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998393+0000","last_change":"2024-09-11T22:20:24.077604+0000","last_active":"2024-09-11T22:20:24.998393+0000","last_peered":"2024-09-11T22:20:24.998393+0000","last_clean":"2024-09-11T22:20:24.998393+0000","last_became_active":"2024-09-11T22:20:24.077231+0000","last_became_peered":"2024-09-11T22:20:24.077231+0000","last_unstale":"2024-09-11T22:20:24.998393+0000","last_undegraded":"2024-09-11T22:20:24.998393+0000","last_fullsized":"2024-09-11T22:20:24.998393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:38.846688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048647+0000","last_change":"2024-09-11T22:20:19.854453+0000","last_active":"2024-09-11T22:20:27.048647+0000","last_peered":"2024-09-11T22:20:27.048647+0000","last_clean":"2024-09-11T22:20:27.048647+0000","last_became_active":"2024-09-11T22:20:19.854100+0000","last_became_peered":"2024-09-11T22:20:19.854100+0000","last_unstale":"2024-09-11T22:20:27.048647+0000","last_undegraded":"2024-09-11T22:20:27.048647+0000","last_fullsized":"2024-09-11T22:20:27.048647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:06.166813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.944339+0000","last_change":"2024-09-11T22:20:18.854889+0000","last_active":"2024-09-11T22:20:46.944339+0000","last_peered":"2024-09-11T22:20:46.944339+0000","last_clean":"2024-09-11T22:20:46.944339+0000","last_became_active":"2024-09-11T22:20:18.854552+0000","last_became_peered":"2024-09-11T22:20:18.854552+0000","last_unstale":"2024-09-11T22:20:46.944339+0000","last_undegraded":"2024-09-11T22:20:46.944339+0000","last_fullsized":"2024-09-11T22:20:46.944339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:33.612126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048443+0000","last_change":"2024-09-11T22:20:23.878932+0000","last_active":"2024-09-11T22:20:27.048443+0000","last_peered":"2024-09-11T22:20:27.048443+0000","last_clean":"2024-09-11T22:20:27.048443+0000","last_became_active":"2024-09-11T22:20:23.878305+0000","last_became_peered":"2024-09-11T22:20:23.878305+0000","last_unstale":"2024-09-11T22:20:27.048443+0000","last_undegraded":"2024-09-11T22:20:27.048443+0000","last_fullsized":"2024-09-11T22:20:27.048443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033835+0000","last_change":"2024-09-11T22:20:19.856318+0000","last_active":"2024-09-11T22:21:01.033835+0000","last_peered":"2024-09-11T22:21:01.033835+0000","last_clean":"2024-09-11T22:21:01.033835+0000","last_became_active":"2024-09-11T22:20:19.855992+0000","last_became_peered":"2024-09-11T22:20:19.855992+0000","last_unstale":"2024-09-11T22:21:01.033835+0000","last_undegraded":"2024-09-11T22:21:01.033835+0000","last_fullsized":"2024-09-11T22:21:01.033835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:57.709140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.944255+0000","last_change":"2024-09-11T22:20:18.850750+0000","last_active":"2024-09-11T22:20:46.944255+0000","last_peered":"2024-09-11T22:20:46.944255+0000","last_clean":"2024-09-11T22:20:46.944255+0000","last_became_active":"2024-09-11T22:20:18.849621+0000","last_became_peered":"2024-09-11T22:20:18.849621+0000","last_unstale":"2024-09-11T22:20:46.944255+0000","last_undegraded":"2024-09-11T22:20:46.944255+0000","last_fullsized":"2024-09-11T22:20:46.944255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047710+0000","last_change":"2024-09-11T22:20:24.077741+0000","last_active":"2024-09-11T22:20:27.047710+0000","last_peered":"2024-09-11T22:20:27.047710+0000","last_clean":"2024-09-11T22:20:27.047710+0000","last_became_active":"2024-09-11T22:20:24.077325+0000","last_became_peered":"2024-09-11T22:20:24.077325+0000","last_unstale":"2024-09-11T22:20:27.047710+0000","last_undegraded":"2024-09-11T22:20:27.047710+0000","last_fullsized":"2024-09-11T22:20:27.047710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:18.656529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888138+0000","last_change":"2024-09-11T22:20:19.850738+0000","last_active":"2024-09-11T22:20:24.888138+0000","last_peered":"2024-09-11T22:20:24.888138+0000","last_clean":"2024-09-11T22:20:24.888138+0000","last_became_active":"2024-09-11T22:20:19.850441+0000","last_became_peered":"2024-09-11T22:20:19.850441+0000","last_unstale":"2024-09-11T22:20:24.888138+0000","last_undegraded":"2024-09-11T22:20:24.888138+0000","last_fullsized":"2024-09-11T22:20:24.888138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:47.552343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.966090+0000","last_change":"2024-09-11T22:20:18.845173+0000","last_active":"2024-09-11T22:20:52.966090+0000","last_peered":"2024-09-11T22:20:52.966090+0000","last_clean":"2024-09-11T22:20:52.966090+0000","last_became_active":"2024-09-11T22:20:18.844731+0000","last_became_peered":"2024-09-11T22:20:18.844731+0000","last_unstale":"2024-09-11T22:20:52.966090+0000","last_undegraded":"2024-09-11T22:20:52.966090+0000","last_fullsized":"2024-09-11T22:20:52.966090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:32.963285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887172+0000","last_change":"2024-09-11T22:20:24.078020+0000","last_active":"2024-09-11T22:20:24.887172+0000","last_peered":"2024-09-11T22:20:24.887172+0000","last_clean":"2024-09-11T22:20:24.887172+0000","last_became_active":"2024-09-11T22:20:24.077541+0000","last_became_peered":"2024-09-11T22:20:24.077541+0000","last_unstale":"2024-09-11T22:20:24.887172+0000","last_undegraded":"2024-09-11T22:20:24.887172+0000","last_fullsized":"2024-09-11T22:20:24.887172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:36.122714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998068+0000","last_change":"2024-09-11T22:20:19.845497+0000","last_active":"2024-09-11T22:20:24.998068+0000","last_peered":"2024-09-11T22:20:24.998068+0000","last_clean":"2024-09-11T22:20:24.998068+0000","last_became_active":"2024-09-11T22:20:19.845203+0000","last_became_peered":"2024-09-11T22:20:19.845203+0000","last_unstale":"2024-09-11T22:20:24.998068+0000","last_undegraded":"2024-09-11T22:20:24.998068+0000","last_fullsized":"2024-09-11T22:20:24.998068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:12.086231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048907+0000","last_change":"2024-09-11T22:20:18.856263+0000","last_active":"2024-09-11T22:20:27.048907+0000","last_peered":"2024-09-11T22:20:27.048907+0000","last_clean":"2024-09-11T22:20:27.048907+0000","last_became_active":"2024-09-11T22:20:18.855968+0000","last_became_peered":"2024-09-11T22:20:18.855968+0000","last_unstale":"2024-09-11T22:20:27.048907+0000","last_undegraded":"2024-09-11T22:20:27.048907+0000","last_fullsized":"2024-09-11T22:20:27.048907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033466+0000","last_change":"2024-09-11T22:20:24.075030+0000","last_active":"2024-09-11T22:21:01.033466+0000","last_peered":"2024-09-11T22:21:01.033466+0000","last_clean":"2024-09-11T22:21:01.033466+0000","last_became_active":"2024-09-11T22:20:24.074588+0000","last_became_peered":"2024-09-11T22:20:24.074588+0000","last_unstale":"2024-09-11T22:21:01.033466+0000","last_undegraded":"2024-09-11T22:21:01.033466+0000","last_fullsized":"2024-09-11T22:21:01.033466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890676+0000","last_change":"2024-09-11T22:20:19.859010+0000","last_active":"2024-09-11T22:20:24.890676+0000","last_peered":"2024-09-11T22:20:24.890676+0000","last_clean":"2024-09-11T22:20:24.890676+0000","last_became_active":"2024-09-11T22:20:19.858585+0000","last_became_peered":"2024-09-11T22:20:19.858585+0000","last_unstale":"2024-09-11T22:20:24.890676+0000","last_undegraded":"2024-09-11T22:20:24.890676+0000","last_fullsized":"2024-09-11T22:20:24.890676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998168+0000","last_change":"2024-09-11T22:20:18.847904+0000","last_active":"2024-09-11T22:20:24.998168+0000","last_peered":"2024-09-11T22:20:24.998168+0000","last_clean":"2024-09-11T22:20:24.998168+0000","last_became_active":"2024-09-11T22:20:18.847669+0000","last_became_peered":"2024-09-11T22:20:18.847669+0000","last_unstale":"2024-09-11T22:20:24.998168+0000","last_undegraded":"2024-09-11T22:20:24.998168+0000","last_fullsized":"2024-09-11T22:20:24.998168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:08.717999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997794+0000","last_change":"2024-09-11T22:20:23.881067+0000","last_active":"2024-09-11T22:20:24.997794+0000","last_peered":"2024-09-11T22:20:24.997794+0000","last_clean":"2024-09-11T22:20:24.997794+0000","last_became_active":"2024-09-11T22:20:23.880468+0000","last_became_peered":"2024-09-11T22:20:23.880468+0000","last_unstale":"2024-09-11T22:20:24.997794+0000","last_undegraded":"2024-09-11T22:20:24.997794+0000","last_fullsized":"2024-09-11T22:20:24.997794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:23.480547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048637+0000","last_change":"2024-09-11T22:20:19.860423+0000","last_active":"2024-09-11T22:20:27.048637+0000","last_peered":"2024-09-11T22:20:27.048637+0000","last_clean":"2024-09-11T22:20:27.048637+0000","last_became_active":"2024-09-11T22:20:19.858932+0000","last_became_peered":"2024-09-11T22:20:19.858932+0000","last_unstale":"2024-09-11T22:20:27.048637+0000","last_undegraded":"2024-09-11T22:20:27.048637+0000","last_fullsized":"2024-09-11T22:20:27.048637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:53.255932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890029+0000","last_change":"2024-09-11T22:20:18.854973+0000","last_active":"2024-09-11T22:20:24.890029+0000","last_peered":"2024-09-11T22:20:24.890029+0000","last_clean":"2024-09-11T22:20:24.890029+0000","last_became_active":"2024-09-11T22:20:18.854725+0000","last_became_peered":"2024-09-11T22:20:18.854725+0000","last_unstale":"2024-09-11T22:20:24.890029+0000","last_undegraded":"2024-09-11T22:20:24.890029+0000","last_fullsized":"2024-09-11T22:20:24.890029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998393+0000","last_change":"2024-09-11T22:20:23.880693+0000","last_active":"2024-09-11T22:20:24.998393+0000","last_peered":"2024-09-11T22:20:24.998393+0000","last_clean":"2024-09-11T22:20:24.998393+0000","last_became_active":"2024-09-11T22:20:23.880243+0000","last_became_peered":"2024-09-11T22:20:23.880243+0000","last_unstale":"2024-09-11T22:20:24.998393+0000","last_undegraded":"2024-09-11T22:20:24.998393+0000","last_fullsized":"2024-09-11T22:20:24.998393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.659287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997954+0000","last_change":"2024-09-11T22:20:19.844808+0000","last_active":"2024-09-11T22:20:24.997954+0000","last_peered":"2024-09-11T22:20:24.997954+0000","last_clean":"2024-09-11T22:20:24.997954+0000","last_became_active":"2024-09-11T22:20:19.844536+0000","last_became_peered":"2024-09-11T22:20:19.844536+0000","last_unstale":"2024-09-11T22:20:24.997954+0000","last_undegraded":"2024-09-11T22:20:24.997954+0000","last_fullsized":"2024-09-11T22:20:24.997954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:57.142383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025228+0000","last_change":"2024-09-11T22:20:18.855640+0000","last_active":"2024-09-11T22:21:01.025228+0000","last_peered":"2024-09-11T22:21:01.025228+0000","last_clean":"2024-09-11T22:21:01.025228+0000","last_became_active":"2024-09-11T22:20:18.855394+0000","last_became_peered":"2024-09-11T22:20:18.855394+0000","last_unstale":"2024-09-11T22:21:01.025228+0000","last_undegraded":"2024-09-11T22:21:01.025228+0000","last_fullsized":"2024-09-11T22:21:01.025228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998458+0000","last_change":"2024-09-11T22:20:23.882554+0000","last_active":"2024-09-11T22:20:24.998458+0000","last_peered":"2024-09-11T22:20:24.998458+0000","last_clean":"2024-09-11T22:20:24.998458+0000","last_became_active":"2024-09-11T22:20:23.881642+0000","last_became_peered":"2024-09-11T22:20:23.881642+0000","last_unstale":"2024-09-11T22:20:24.998458+0000","last_undegraded":"2024-09-11T22:20:24.998458+0000","last_fullsized":"2024-09-11T22:20:24.998458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:16.696043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033143+0000","last_change":"2024-09-11T22:20:19.859429+0000","last_active":"2024-09-11T22:21:01.033143+0000","last_peered":"2024-09-11T22:21:01.033143+0000","last_clean":"2024-09-11T22:21:01.033143+0000","last_became_active":"2024-09-11T22:20:19.859159+0000","last_became_peered":"2024-09-11T22:20:19.859159+0000","last_unstale":"2024-09-11T22:21:01.033143+0000","last_undegraded":"2024-09-11T22:21:01.033143+0000","last_fullsized":"2024-09-11T22:21:01.033143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:02.696450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.967996+0000","last_change":"2024-09-11T22:20:18.856144+0000","last_active":"2024-09-11T22:20:52.967996+0000","last_peered":"2024-09-11T22:20:52.967996+0000","last_clean":"2024-09-11T22:20:52.967996+0000","last_became_active":"2024-09-11T22:20:18.855866+0000","last_became_peered":"2024-09-11T22:20:18.855866+0000","last_unstale":"2024-09-11T22:20:52.967996+0000","last_undegraded":"2024-09-11T22:20:52.967996+0000","last_fullsized":"2024-09-11T22:20:52.967996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:37.259393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033635+0000","last_change":"2024-09-11T22:20:24.075154+0000","last_active":"2024-09-11T22:21:01.033635+0000","last_peered":"2024-09-11T22:21:01.033635+0000","last_clean":"2024-09-11T22:21:01.033635+0000","last_became_active":"2024-09-11T22:20:24.074568+0000","last_became_peered":"2024-09-11T22:20:24.074568+0000","last_unstale":"2024-09-11T22:21:01.033635+0000","last_undegraded":"2024-09-11T22:21:01.033635+0000","last_fullsized":"2024-09-11T22:21:01.033635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:09.804991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887321+0000","last_change":"2024-09-11T22:20:19.861236+0000","last_active":"2024-09-11T22:20:24.887321+0000","last_peered":"2024-09-11T22:20:24.887321+0000","last_clean":"2024-09-11T22:20:24.887321+0000","last_became_active":"2024-09-11T22:20:19.860938+0000","last_became_peered":"2024-09-11T22:20:19.860938+0000","last_unstale":"2024-09-11T22:20:24.887321+0000","last_undegraded":"2024-09-11T22:20:24.887321+0000","last_fullsized":"2024-09-11T22:20:24.887321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:42.015334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.946546+0000","last_change":"2024-09-11T22:20:18.853467+0000","last_active":"2024-09-11T22:20:46.946546+0000","last_peered":"2024-09-11T22:20:46.946546+0000","last_clean":"2024-09-11T22:20:46.946546+0000","last_became_active":"2024-09-11T22:20:18.853182+0000","last_became_peered":"2024-09-11T22:20:18.853182+0000","last_unstale":"2024-09-11T22:20:46.946546+0000","last_undegraded":"2024-09-11T22:20:46.946546+0000","last_fullsized":"2024-09-11T22:20:46.946546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047625+0000","last_change":"2024-09-11T22:20:09.425648+0000","last_active":"2024-09-11T22:20:27.047625+0000","last_peered":"2024-09-11T22:20:27.047625+0000","last_clean":"2024-09-11T22:20:27.047625+0000","last_became_active":"2024-09-11T22:20:09.424591+0000","last_became_peered":"2024-09-11T22:20:09.424591+0000","last_unstale":"2024-09-11T22:20:27.047625+0000","last_undegraded":"2024-09-11T22:20:27.047625+0000","last_fullsized":"2024-09-11T22:20:27.047625+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_clean_scrub_stamp":"2024-09-11T22:20:08.334092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:53.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888536+0000","last_change":"2024-09-11T22:20:24.077007+0000","last_active":"2024-09-11T22:20:24.888536+0000","last_peered":"2024-09-11T22:20:24.888536+0000","last_clean":"2024-09-11T22:20:24.888536+0000","last_became_active":"2024-09-11T22:20:24.076601+0000","last_became_peered":"2024-09-11T22:20:24.076601+0000","last_unstale":"2024-09-11T22:20:24.888536+0000","last_undegraded":"2024-09-11T22:20:24.888536+0000","last_fullsized":"2024-09-11T22:20:24.888536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048600+0000","last_change":"2024-09-11T22:20:19.863279+0000","last_active":"2024-09-11T22:20:27.048600+0000","last_peered":"2024-09-11T22:20:27.048600+0000","last_clean":"2024-09-11T22:20:27.048600+0000","last_became_active":"2024-09-11T22:20:19.861322+0000","last_became_peered":"2024-09-11T22:20:19.861322+0000","last_unstale":"2024-09-11T22:20:27.048600+0000","last_undegraded":"2024-09-11T22:20:27.048600+0000","last_fullsized":"2024-09-11T22:20:27.048600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025479+0000","last_change":"2024-09-11T22:20:18.853343+0000","last_active":"2024-09-11T22:21:01.025479+0000","last_peered":"2024-09-11T22:21:01.025479+0000","last_clean":"2024-09-11T22:21:01.025479+0000","last_became_active":"2024-09-11T22:20:18.853069+0000","last_became_peered":"2024-09-11T22:20:18.853069+0000","last_unstale":"2024-09-11T22:21:01.025479+0000","last_undegraded":"2024-09-11T22:21:01.025479+0000","last_fullsized":"2024-09-11T22:21:01.025479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888655+0000","last_change":"2024-09-11T22:20:24.075350+0000","last_active":"2024-09-11T22:20:24.888655+0000","last_peered":"2024-09-11T22:20:24.888655+0000","last_clean":"2024-09-11T22:20:24.888655+0000","last_became_active":"2024-09-11T22:20:24.074789+0000","last_became_peered":"2024-09-11T22:20:24.074789+0000","last_unstale":"2024-09-11T22:20:24.888655+0000","last_undegraded":"2024-09-11T22:20:24.888655+0000","last_fullsized":"2024-09-11T22:20:24.888655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890400+0000","last_change":"2024-09-11T22:20:19.866331+0000","last_active":"2024-09-11T22:20:24.890400+0000","last_peered":"2024-09-11T22:20:24.890400+0000","last_clean":"2024-09-11T22:20:24.890400+0000","last_became_active":"2024-09-11T22:20:19.865535+0000","last_became_peered":"2024-09-11T22:20:19.865535+0000","last_unstale":"2024-09-11T22:20:24.890400+0000","last_undegraded":"2024-09-11T22:20:24.890400+0000","last_fullsized":"2024-09-11T22:20:24.890400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998164+0000","last_change":"2024-09-11T22:20:18.849434+0000","last_active":"2024-09-11T22:20:24.998164+0000","last_peered":"2024-09-11T22:20:24.998164+0000","last_clean":"2024-09-11T22:20:24.998164+0000","last_became_active":"2024-09-11T22:20:18.848787+0000","last_became_peered":"2024-09-11T22:20:18.848787+0000","last_unstale":"2024-09-11T22:20:24.998164+0000","last_undegraded":"2024-09-11T22:20:24.998164+0000","last_fullsized":"2024-09-11T22:20:24.998164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:25.689495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033577+0000","last_change":"2024-09-11T22:20:23.879962+0000","last_active":"2024-09-11T22:21:01.033577+0000","last_peered":"2024-09-11T22:21:01.033577+0000","last_clean":"2024-09-11T22:21:01.033577+0000","last_became_active":"2024-09-11T22:20:23.879586+0000","last_became_peered":"2024-09-11T22:20:23.879586+0000","last_unstale":"2024-09-11T22:21:01.033577+0000","last_undegraded":"2024-09-11T22:21:01.033577+0000","last_fullsized":"2024-09-11T22:21:01.033577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:27.323116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.049164+0000","last_change":"2024-09-11T22:20:19.860411+0000","last_active":"2024-09-11T22:20:27.049164+0000","last_peered":"2024-09-11T22:20:27.049164+0000","last_clean":"2024-09-11T22:20:27.049164+0000","last_became_active":"2024-09-11T22:20:19.860076+0000","last_became_peered":"2024-09-11T22:20:19.860076+0000","last_unstale":"2024-09-11T22:20:27.049164+0000","last_undegraded":"2024-09-11T22:20:27.049164+0000","last_fullsized":"2024-09-11T22:20:27.049164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025282+0000","last_change":"2024-09-11T22:20:18.856020+0000","last_active":"2024-09-11T22:21:01.025282+0000","last_peered":"2024-09-11T22:21:01.025282+0000","last_clean":"2024-09-11T22:21:01.025282+0000","last_became_active":"2024-09-11T22:20:18.855753+0000","last_became_peered":"2024-09-11T22:20:18.855753+0000","last_unstale":"2024-09-11T22:21:01.025282+0000","last_undegraded":"2024-09-11T22:21:01.025282+0000","last_fullsized":"2024-09-11T22:21:01.025282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888726+0000","last_change":"2024-09-11T22:20:24.077975+0000","last_active":"2024-09-11T22:20:24.888726+0000","last_peered":"2024-09-11T22:20:24.888726+0000","last_clean":"2024-09-11T22:20:24.888726+0000","last_became_active":"2024-09-11T22:20:24.077502+0000","last_became_peered":"2024-09-11T22:20:24.077502+0000","last_unstale":"2024-09-11T22:20:24.888726+0000","last_undegraded":"2024-09-11T22:20:24.888726+0000","last_fullsized":"2024-09-11T22:20:24.888726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:16.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047781+0000","last_change":"2024-09-11T22:20:19.856986+0000","last_active":"2024-09-11T22:20:27.047781+0000","last_peered":"2024-09-11T22:20:27.047781+0000","last_clean":"2024-09-11T22:20:27.047781+0000","last_became_active":"2024-09-11T22:20:19.856739+0000","last_became_peered":"2024-09-11T22:20:19.856739+0000","last_unstale":"2024-09-11T22:20:27.047781+0000","last_undegraded":"2024-09-11T22:20:27.047781+0000","last_fullsized":"2024-09-11T22:20:27.047781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048583+0000","last_change":"2024-09-11T22:20:18.855044+0000","last_active":"2024-09-11T22:20:27.048583+0000","last_peered":"2024-09-11T22:20:27.048583+0000","last_clean":"2024-09-11T22:20:27.048583+0000","last_became_active":"2024-09-11T22:20:18.854764+0000","last_became_peered":"2024-09-11T22:20:18.854764+0000","last_unstale":"2024-09-11T22:20:27.048583+0000","last_undegraded":"2024-09-11T22:20:27.048583+0000","last_fullsized":"2024-09-11T22:20:27.048583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:22.207278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047516+0000","last_change":"2024-09-11T22:20:23.878383+0000","last_active":"2024-09-11T22:20:27.047516+0000","last_peered":"2024-09-11T22:20:27.047516+0000","last_clean":"2024-09-11T22:20:27.047516+0000","last_became_active":"2024-09-11T22:20:23.877890+0000","last_became_peered":"2024-09-11T22:20:23.877890+0000","last_unstale":"2024-09-11T22:20:27.047516+0000","last_undegraded":"2024-09-11T22:20:27.047516+0000","last_fullsized":"2024-09-11T22:20:27.047516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:18.876485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048434+0000","last_change":"2024-09-11T22:20:19.861242+0000","last_active":"2024-09-11T22:20:27.048434+0000","last_peered":"2024-09-11T22:20:27.048434+0000","last_clean":"2024-09-11T22:20:27.048434+0000","last_became_active":"2024-09-11T22:20:19.860988+0000","last_became_peered":"2024-09-11T22:20:19.860988+0000","last_unstale":"2024-09-11T22:20:27.048434+0000","last_undegraded":"2024-09-11T22:20:27.048434+0000","last_fullsized":"2024-09-11T22:20:27.048434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.024956+0000","last_change":"2024-09-11T22:20:18.852459+0000","last_active":"2024-09-11T22:21:01.024956+0000","last_peered":"2024-09-11T22:21:01.024956+0000","last_clean":"2024-09-11T22:21:01.024956+0000","last_became_active":"2024-09-11T22:20:18.852153+0000","last_became_peered":"2024-09-11T22:20:18.852153+0000","last_unstale":"2024-09-11T22:21:01.024956+0000","last_undegraded":"2024-09-11T22:21:01.024956+0000","last_fullsized":"2024-09-11T22:21:01.024956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033546+0000","last_change":"2024-09-11T22:20:23.874062+0000","last_active":"2024-09-11T22:21:01.033546+0000","last_peered":"2024-09-11T22:21:01.033546+0000","last_clean":"2024-09-11T22:21:01.033546+0000","last_became_active":"2024-09-11T22:20:23.873635+0000","last_became_peered":"2024-09-11T22:20:23.873635+0000","last_unstale":"2024-09-11T22:21:01.033546+0000","last_undegraded":"2024-09-11T22:21:01.033546+0000","last_fullsized":"2024-09-11T22:21:01.033546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:40.914142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888125+0000","last_change":"2024-09-11T22:20:19.851577+0000","last_active":"2024-09-11T22:20:24.888125+0000","last_peered":"2024-09-11T22:20:24.888125+0000","last_clean":"2024-09-11T22:20:24.888125+0000","last_became_active":"2024-09-11T22:20:19.851286+0000","last_became_peered":"2024-09-11T22:20:19.851286+0000","last_unstale":"2024-09-11T22:20:24.888125+0000","last_undegraded":"2024-09-11T22:20:24.888125+0000","last_fullsized":"2024-09-11T22:20:24.888125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:32.025931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.968016+0000","last_change":"2024-09-11T22:20:18.853301+0000","last_active":"2024-09-11T22:20:52.968016+0000","last_peered":"2024-09-11T22:20:52.968016+0000","last_clean":"2024-09-11T22:20:52.968016+0000","last_became_active":"2024-09-11T22:20:18.852978+0000","last_became_peered":"2024-09-11T22:20:18.852978+0000","last_unstale":"2024-09-11T22:20:52.968016+0000","last_undegraded":"2024-09-11T22:20:52.968016+0000","last_fullsized":"2024-09-11T22:20:52.968016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888069+0000","last_change":"2024-09-11T22:20:24.077636+0000","last_active":"2024-09-11T22:20:24.888069+0000","last_peered":"2024-09-11T22:20:24.888069+0000","last_clean":"2024-09-11T22:20:24.888069+0000","last_became_active":"2024-09-11T22:20:24.077313+0000","last_became_peered":"2024-09-11T22:20:24.077313+0000","last_unstale":"2024-09-11T22:20:24.888069+0000","last_undegraded":"2024-09-11T22:20:24.888069+0000","last_fullsized":"2024-09-11T22:20:24.888069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:23.154027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048723+0000","last_change":"2024-09-11T22:20:19.862562+0000","last_active":"2024-09-11T22:20:27.048723+0000","last_peered":"2024-09-11T22:20:27.048723+0000","last_clean":"2024-09-11T22:20:27.048723+0000","last_became_active":"2024-09-11T22:20:19.862267+0000","last_became_peered":"2024-09-11T22:20:19.862267+0000","last_unstale":"2024-09-11T22:20:27.048723+0000","last_undegraded":"2024-09-11T22:20:27.048723+0000","last_fullsized":"2024-09-11T22:20:27.048723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.948867+0000","last_change":"2024-09-11T22:20:18.858002+0000","last_active":"2024-09-11T22:20:46.948867+0000","last_peered":"2024-09-11T22:20:46.948867+0000","last_clean":"2024-09-11T22:20:46.948867+0000","last_became_active":"2024-09-11T22:20:18.857419+0000","last_became_peered":"2024-09-11T22:20:18.857419+0000","last_unstale":"2024-09-11T22:20:46.948867+0000","last_undegraded":"2024-09-11T22:20:46.948867+0000","last_fullsized":"2024-09-11T22:20:46.948867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887723+0000","last_change":"2024-09-11T22:20:24.074971+0000","last_active":"2024-09-11T22:20:24.887723+0000","last_peered":"2024-09-11T22:20:24.887723+0000","last_clean":"2024-09-11T22:20:24.887723+0000","last_became_active":"2024-09-11T22:20:24.074609+0000","last_became_peered":"2024-09-11T22:20:24.074609+0000","last_unstale":"2024-09-11T22:20:24.887723+0000","last_undegraded":"2024-09-11T22:20:24.887723+0000","last_fullsized":"2024-09-11T22:20:24.887723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:55.318904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033588+0000","last_change":"2024-09-11T22:20:19.857276+0000","last_active":"2024-09-11T22:21:01.033588+0000","last_peered":"2024-09-11T22:21:01.033588+0000","last_clean":"2024-09-11T22:21:01.033588+0000","last_became_active":"2024-09-11T22:20:19.857027+0000","last_became_peered":"2024-09-11T22:20:19.857027+0000","last_unstale":"2024-09-11T22:21:01.033588+0000","last_undegraded":"2024-09-11T22:21:01.033588+0000","last_fullsized":"2024-09-11T22:21:01.033588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033832+0000","last_change":"2024-09-11T22:20:18.848671+0000","last_active":"2024-09-11T22:21:01.033832+0000","last_peered":"2024-09-11T22:21:01.033832+0000","last_clean":"2024-09-11T22:21:01.033832+0000","last_became_active":"2024-09-11T22:20:18.848405+0000","last_became_peered":"2024-09-11T22:20:18.848405+0000","last_unstale":"2024-09-11T22:21:01.033832+0000","last_undegraded":"2024-09-11T22:21:01.033832+0000","last_fullsized":"2024-09-11T22:21:01.033832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890660+0000","last_change":"2024-09-11T22:20:24.076835+0000","last_active":"2024-09-11T22:20:24.890660+0000","last_peered":"2024-09-11T22:20:24.890660+0000","last_clean":"2024-09-11T22:20:24.890660+0000","last_became_active":"2024-09-11T22:20:24.076200+0000","last_became_peered":"2024-09-11T22:20:24.076200+0000","last_unstale":"2024-09-11T22:20:24.890660+0000","last_undegraded":"2024-09-11T22:20:24.890660+0000","last_fullsized":"2024-09-11T22:20:24.890660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:48.150778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048503+0000","last_change":"2024-09-11T22:20:19.855334+0000","last_active":"2024-09-11T22:20:27.048503+0000","last_peered":"2024-09-11T22:20:27.048503+0000","last_clean":"2024-09-11T22:20:27.048503+0000","last_became_active":"2024-09-11T22:20:19.855018+0000","last_became_peered":"2024-09-11T22:20:19.855018+0000","last_unstale":"2024-09-11T22:20:27.048503+0000","last_undegraded":"2024-09-11T22:20:27.048503+0000","last_fullsized":"2024-09-11T22:20:27.048503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'11","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.946283+0000","last_change":"2024-09-11T22:20:18.855665+0000","last_active":"2024-09-11T22:20:46.946283+0000","last_peered":"2024-09-11T22:20:46.946283+0000","last_clean":"2024-09-11T22:20:46.946283+0000","last_became_active":"2024-09-11T22:20:18.855386+0000","last_became_peered":"2024-09-11T22:20:18.855386+0000","last_unstale":"2024-09-11T22:20:46.946283+0000","last_undegraded":"2024-09-11T22:20:46.946283+0000","last_fullsized":"2024-09-11T22:20:46.946283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998100+0000","last_change":"2024-09-11T22:20:23.880793+0000","last_active":"2024-09-11T22:20:24.998100+0000","last_peered":"2024-09-11T22:20:24.998100+0000","last_clean":"2024-09-11T22:20:24.998100+0000","last_became_active":"2024-09-11T22:20:23.879993+0000","last_became_peered":"2024-09-11T22:20:23.879993+0000","last_unstale":"2024-09-11T22:20:24.998100+0000","last_undegraded":"2024-09-11T22:20:24.998100+0000","last_fullsized":"2024-09-11T22:20:24.998100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:50.449090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048075+0000","last_change":"2024-09-11T22:20:19.858588+0000","last_active":"2024-09-11T22:20:27.048075+0000","last_peered":"2024-09-11T22:20:27.048075+0000","last_clean":"2024-09-11T22:20:27.048075+0000","last_became_active":"2024-09-11T22:20:19.858322+0000","last_became_peered":"2024-09-11T22:20:19.858322+0000","last_unstale":"2024-09-11T22:20:27.048075+0000","last_undegraded":"2024-09-11T22:20:27.048075+0000","last_fullsized":"2024-09-11T22:20:27.048075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998118+0000","last_change":"2024-09-11T22:20:18.855056+0000","last_active":"2024-09-11T22:20:24.998118+0000","last_peered":"2024-09-11T22:20:24.998118+0000","last_clean":"2024-09-11T22:20:24.998118+0000","last_became_active":"2024-09-11T22:20:18.854784+0000","last_became_peered":"2024-09-11T22:20:18.854784+0000","last_unstale":"2024-09-11T22:20:24.998118+0000","last_undegraded":"2024-09-11T22:20:24.998118+0000","last_fullsized":"2024-09-11T22:20:24.998118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:38.916121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048044+0000","last_change":"2024-09-11T22:20:23.879768+0000","last_active":"2024-09-11T22:20:27.048044+0000","last_peered":"2024-09-11T22:20:27.048044+0000","last_clean":"2024-09-11T22:20:27.048044+0000","last_became_active":"2024-09-11T22:20:23.878794+0000","last_became_peered":"2024-09-11T22:20:23.878794+0000","last_unstale":"2024-09-11T22:20:27.048044+0000","last_undegraded":"2024-09-11T22:20:27.048044+0000","last_fullsized":"2024-09-11T22:20:27.048044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:07.301587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-11T22:20:27.048280+0000","last_change":"2024-09-11T22:21:01.034302+0000","last_active":"2024-09-11T22:21:01.034302+0000","last_peered":"2024-09-11T22:20:27.048280+0000","last_clean":"2024-09-11T22:20:27.048280+0000","last_became_active":"2024-09-11T22:20:19.861607+0000","last_became_peered":"2024-09-11T22:20:19.861607+0000","last_unstale":"2024-09-11T22:20:27.048280+0000","last_undegraded":"2024-09-11T22:20:27.048280+0000","last_fullsized":"2024-09-11T22:20:27.048280+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.946689+0000","last_change":"2024-09-11T22:20:18.853382+0000","last_active":"2024-09-11T22:20:46.946689+0000","last_peered":"2024-09-11T22:20:46.946689+0000","last_clean":"2024-09-11T22:20:46.946689+0000","last_became_active":"2024-09-11T22:20:18.853103+0000","last_became_peered":"2024-09-11T22:20:18.853103+0000","last_unstale":"2024-09-11T22:20:46.946689+0000","last_undegraded":"2024-09-11T22:20:46.946689+0000","last_fullsized":"2024-09-11T22:20:46.946689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887490+0000","last_change":"2024-09-11T22:20:23.876997+0000","last_active":"2024-09-11T22:20:24.887490+0000","last_peered":"2024-09-11T22:20:24.887490+0000","last_clean":"2024-09-11T22:20:24.887490+0000","last_became_active":"2024-09-11T22:20:23.876587+0000","last_became_peered":"2024-09-11T22:20:23.876587+0000","last_unstale":"2024-09-11T22:20:24.887490+0000","last_undegraded":"2024-09-11T22:20:24.887490+0000","last_fullsized":"2024-09-11T22:20:24.887490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:19.670665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889342+0000","last_change":"2024-09-11T22:20:19.866624+0000","last_active":"2024-09-11T22:20:24.889342+0000","last_peered":"2024-09-11T22:20:24.889342+0000","last_clean":"2024-09-11T22:20:24.889342+0000","last_became_active":"2024-09-11T22:20:19.866303+0000","last_became_peered":"2024-09-11T22:20:19.866303+0000","last_unstale":"2024-09-11T22:20:24.889342+0000","last_undegraded":"2024-09-11T22:20:24.889342+0000","last_fullsized":"2024-09-11T22:20:24.889342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.946175+0000","last_change":"2024-09-11T22:20:18.854361+0000","last_active":"2024-09-11T22:20:46.946175+0000","last_peered":"2024-09-11T22:20:46.946175+0000","last_clean":"2024-09-11T22:20:46.946175+0000","last_became_active":"2024-09-11T22:20:18.854019+0000","last_became_peered":"2024-09-11T22:20:18.854019+0000","last_unstale":"2024-09-11T22:20:46.946175+0000","last_undegraded":"2024-09-11T22:20:46.946175+0000","last_fullsized":"2024-09-11T22:20:46.946175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887284+0000","last_change":"2024-09-11T22:20:24.077476+0000","last_active":"2024-09-11T22:20:24.887284+0000","last_peered":"2024-09-11T22:20:24.887284+0000","last_clean":"2024-09-11T22:20:24.887284+0000","last_became_active":"2024-09-11T22:20:24.077134+0000","last_became_peered":"2024-09-11T22:20:24.077134+0000","last_unstale":"2024-09-11T22:20:24.887284+0000","last_undegraded":"2024-09-11T22:20:24.887284+0000","last_fullsized":"2024-09-11T22:20:24.887284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:03.186460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-11T22:20:27.048088+0000","last_change":"2024-09-11T22:21:01.033206+0000","last_active":"2024-09-11T22:21:01.033206+0000","last_peered":"2024-09-11T22:20:27.048088+0000","last_clean":"2024-09-11T22:20:27.048088+0000","last_became_active":"2024-09-11T22:20:24.076592+0000","last_became_peered":"2024-09-11T22:20:24.076592+0000","last_unstale":"2024-09-11T22:20:27.048088+0000","last_undegraded":"2024-09-11T22:20:27.048088+0000","last_fullsized":"2024-09-11T22:20:27.048088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2,3,7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997676+0000","last_change":"2024-09-11T22:20:19.845776+0000","last_active":"2024-09-11T22:20:24.997676+0000","last_peered":"2024-09-11T22:20:24.997676+0000","last_clean":"2024-09-11T22:20:24.997676+0000","last_became_active":"2024-09-11T22:20:19.845425+0000","last_became_peered":"2024-09-11T22:20:19.845425+0000","last_unstale":"2024-09-11T22:20:24.997676+0000","last_undegraded":"2024-09-11T22:20:24.997676+0000","last_fullsized":"2024-09-11T22:20:24.997676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:07.187533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889087+0000","last_change":"2024-09-11T22:20:18.852446+0000","last_active":"2024-09-11T22:20:24.889087+0000","last_peered":"2024-09-11T22:20:24.889087+0000","last_clean":"2024-09-11T22:20:24.889087+0000","last_became_active":"2024-09-11T22:20:18.852155+0000","last_became_peered":"2024-09-11T22:20:18.852155+0000","last_unstale":"2024-09-11T22:20:24.889087+0000","last_undegraded":"2024-09-11T22:20:24.889087+0000","last_fullsized":"2024-09-11T22:20:24.889087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889233+0000","last_change":"2024-09-11T22:20:23.876503+0000","last_active":"2024-09-11T22:20:24.889233+0000","last_peered":"2024-09-11T22:20:24.889233+0000","last_clean":"2024-09-11T22:20:24.889233+0000","last_became_active":"2024-09-11T22:20:23.876100+0000","last_became_peered":"2024-09-11T22:20:23.876100+0000","last_unstale":"2024-09-11T22:20:24.889233+0000","last_undegraded":"2024-09-11T22:20:24.889233+0000","last_fullsized":"2024-09-11T22:20:24.889233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887311+0000","last_change":"2024-09-11T22:20:19.852606+0000","last_active":"2024-09-11T22:20:24.887311+0000","last_peered":"2024-09-11T22:20:24.887311+0000","last_clean":"2024-09-11T22:20:24.887311+0000","last_became_active":"2024-09-11T22:20:19.852333+0000","last_became_peered":"2024-09-11T22:20:19.852333+0000","last_unstale":"2024-09-11T22:20:24.887311+0000","last_undegraded":"2024-09-11T22:20:24.887311+0000","last_fullsized":"2024-09-11T22:20:24.887311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:56.940278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.965701+0000","last_change":"2024-09-11T22:20:18.853767+0000","last_active":"2024-09-11T22:20:52.965701+0000","last_peered":"2024-09-11T22:20:52.965701+0000","last_clean":"2024-09-11T22:20:52.965701+0000","last_became_active":"2024-09-11T22:20:18.853533+0000","last_became_peered":"2024-09-11T22:20:18.853533+0000","last_unstale":"2024-09-11T22:20:52.965701+0000","last_undegraded":"2024-09-11T22:20:52.965701+0000","last_fullsized":"2024-09-11T22:20:52.965701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:36.662271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.967351+0000","last_change":"2024-09-11T22:20:18.847133+0000","last_active":"2024-09-11T22:20:52.967351+0000","last_peered":"2024-09-11T22:20:52.967351+0000","last_clean":"2024-09-11T22:20:52.967351+0000","last_became_active":"2024-09-11T22:20:18.846321+0000","last_became_peered":"2024-09-11T22:20:18.846321+0000","last_unstale":"2024-09-11T22:20:52.967351+0000","last_undegraded":"2024-09-11T22:20:52.967351+0000","last_fullsized":"2024-09-11T22:20:52.967351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033751+0000","last_change":"2024-09-11T22:20:19.861445+0000","last_active":"2024-09-11T22:21:01.033751+0000","last_peered":"2024-09-11T22:21:01.033751+0000","last_clean":"2024-09-11T22:21:01.033751+0000","last_became_active":"2024-09-11T22:20:19.861154+0000","last_became_peered":"2024-09-11T22:20:19.861154+0000","last_unstale":"2024-09-11T22:21:01.033751+0000","last_undegraded":"2024-09-11T22:21:01.033751+0000","last_fullsized":"2024-09-11T22:21:01.033751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025275+0000","last_change":"2024-09-11T22:20:23.877973+0000","last_active":"2024-09-11T22:21:01.025275+0000","last_peered":"2024-09-11T22:21:01.025275+0000","last_clean":"2024-09-11T22:21:01.025275+0000","last_became_active":"2024-09-11T22:20:23.877578+0000","last_became_peered":"2024-09-11T22:20:23.877578+0000","last_unstale":"2024-09-11T22:21:01.025275+0000","last_undegraded":"2024-09-11T22:21:01.025275+0000","last_fullsized":"2024-09-11T22:21:01.025275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:27.826669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.948565+0000","last_change":"2024-09-11T22:20:18.854142+0000","last_active":"2024-09-11T22:20:46.948565+0000","last_peered":"2024-09-11T22:20:46.948565+0000","last_clean":"2024-09-11T22:20:46.948565+0000","last_became_active":"2024-09-11T22:20:18.853872+0000","last_became_peered":"2024-09-11T22:20:18.853872+0000","last_unstale":"2024-09-11T22:20:46.948565+0000","last_undegraded":"2024-09-11T22:20:46.948565+0000","last_fullsized":"2024-09-11T22:20:46.948565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:22.513242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047903+0000","last_change":"2024-09-11T22:20:19.852580+0000","last_active":"2024-09-11T22:20:27.047903+0000","last_peered":"2024-09-11T22:20:27.047903+0000","last_clean":"2024-09-11T22:20:27.047903+0000","last_became_active":"2024-09-11T22:20:19.850175+0000","last_became_peered":"2024-09-11T22:20:19.850175+0000","last_unstale":"2024-09-11T22:20:27.047903+0000","last_undegraded":"2024-09-11T22:20:27.047903+0000","last_fullsized":"2024-09-11T22:20:27.047903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:11.937256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887822+0000","last_change":"2024-09-11T22:20:23.878004+0000","last_active":"2024-09-11T22:20:24.887822+0000","last_peered":"2024-09-11T22:20:24.887822+0000","last_clean":"2024-09-11T22:20:24.887822+0000","last_became_active":"2024-09-11T22:20:23.876776+0000","last_became_peered":"2024-09-11T22:20:23.876776+0000","last_unstale":"2024-09-11T22:20:24.887822+0000","last_undegraded":"2024-09-11T22:20:24.887822+0000","last_fullsized":"2024-09-11T22:20:24.887822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:11.254248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887933+0000","last_change":"2024-09-11T22:20:19.853439+0000","last_active":"2024-09-11T22:20:24.887933+0000","last_peered":"2024-09-11T22:20:24.887933+0000","last_clean":"2024-09-11T22:20:24.887933+0000","last_became_active":"2024-09-11T22:20:19.852937+0000","last_became_peered":"2024-09-11T22:20:19.852937+0000","last_unstale":"2024-09-11T22:20:24.887933+0000","last_undegraded":"2024-09-11T22:20:24.887933+0000","last_fullsized":"2024-09-11T22:20:24.887933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025127+0000","last_change":"2024-09-11T22:20:19.861003+0000","last_active":"2024-09-11T22:21:01.025127+0000","last_peered":"2024-09-11T22:21:01.025127+0000","last_clean":"2024-09-11T22:21:01.025127+0000","last_became_active":"2024-09-11T22:20:19.860690+0000","last_became_peered":"2024-09-11T22:20:19.860690+0000","last_unstale":"2024-09-11T22:21:01.025127+0000","last_undegraded":"2024-09-11T22:21:01.025127+0000","last_fullsized":"2024-09-11T22:21:01.025127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889798+0000","last_change":"2024-09-11T22:20:19.856756+0000","last_active":"2024-09-11T22:20:24.889798+0000","last_peered":"2024-09-11T22:20:24.889798+0000","last_clean":"2024-09-11T22:20:24.889798+0000","last_became_active":"2024-09-11T22:20:19.856460+0000","last_became_peered":"2024-09-11T22:20:19.856460+0000","last_unstale":"2024-09-11T22:20:24.889798+0000","last_undegraded":"2024-09-11T22:20:24.889798+0000","last_fullsized":"2024-09-11T22:20:24.889798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033665+0000","last_change":"2024-09-11T22:20:19.855629+0000","last_active":"2024-09-11T22:21:01.033665+0000","last_peered":"2024-09-11T22:21:01.033665+0000","last_clean":"2024-09-11T22:21:01.033665+0000","last_became_active":"2024-09-11T22:20:19.855363+0000","last_became_peered":"2024-09-11T22:20:19.855363+0000","last_unstale":"2024-09-11T22:21:01.033665+0000","last_undegraded":"2024-09-11T22:21:01.033665+0000","last_fullsized":"2024-09-11T22:21:01.033665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887872+0000","last_change":"2024-09-11T22:20:19.863122+0000","last_active":"2024-09-11T22:20:24.887872+0000","last_peered":"2024-09-11T22:20:24.887872+0000","last_clean":"2024-09-11T22:20:24.887872+0000","last_became_active":"2024-09-11T22:20:19.862828+0000","last_became_peered":"2024-09-11T22:20:19.862828+0000","last_unstale":"2024-09-11T22:20:24.887872+0000","last_undegraded":"2024-09-11T22:20:24.887872+0000","last_fullsized":"2024-09-11T22:20:24.887872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:10.868762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997865+0000","last_change":"2024-09-11T22:20:19.846453+0000","last_active":"2024-09-11T22:20:24.997865+0000","last_peered":"2024-09-11T22:20:24.997865+0000","last_clean":"2024-09-11T22:20:24.997865+0000","last_became_active":"2024-09-11T22:20:19.846186+0000","last_became_peered":"2024-09-11T22:20:19.846186+0000","last_unstale":"2024-09-11T22:20:24.997865+0000","last_undegraded":"2024-09-11T22:20:24.997865+0000","last_fullsized":"2024-09-11T22:20:24.997865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:24.032365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888935+0000","last_change":"2024-09-11T22:20:19.860632+0000","last_active":"2024-09-11T22:20:24.888935+0000","last_peered":"2024-09-11T22:20:24.888935+0000","last_clean":"2024-09-11T22:20:24.888935+0000","last_became_active":"2024-09-11T22:20:19.860005+0000","last_became_peered":"2024-09-11T22:20:19.860005+0000","last_unstale":"2024-09-11T22:20:24.888935+0000","last_undegraded":"2024-09-11T22:20:24.888935+0000","last_fullsized":"2024-09-11T22:20:24.888935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888034+0000","last_change":"2024-09-11T22:20:19.859195+0000","last_active":"2024-09-11T22:20:24.888034+0000","last_peered":"2024-09-11T22:20:24.888034+0000","last_clean":"2024-09-11T22:20:24.888034+0000","last_became_active":"2024-09-11T22:20:19.858832+0000","last_became_peered":"2024-09-11T22:20:19.858832+0000","last_unstale":"2024-09-11T22:20:24.888034+0000","last_undegraded":"2024-09-11T22:20:24.888034+0000","last_fullsized":"2024-09-11T22:20:24.888034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:56.259074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888950+0000","last_change":"2024-09-11T22:20:19.858969+0000","last_active":"2024-09-11T22:20:24.888950+0000","last_peered":"2024-09-11T22:20:24.888950+0000","last_clean":"2024-09-11T22:20:24.888950+0000","last_became_active":"2024-09-11T22:20:19.857847+0000","last_became_peered":"2024-09-11T22:20:19.857847+0000","last_unstale":"2024-09-11T22:20:24.888950+0000","last_undegraded":"2024-09-11T22:20:24.888950+0000","last_fullsized":"2024-09-11T22:20:24.888950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887453+0000","last_change":"2024-09-11T22:20:19.863294+0000","last_active":"2024-09-11T22:20:24.887453+0000","last_peered":"2024-09-11T22:20:24.887453+0000","last_clean":"2024-09-11T22:20:24.887453+0000","last_became_active":"2024-09-11T22:20:19.863007+0000","last_became_peered":"2024-09-11T22:20:19.863007+0000","last_unstale":"2024-09-11T22:20:24.887453+0000","last_undegraded":"2024-09-11T22:20:24.887453+0000","last_fullsized":"2024-09-11T22:20:24.887453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:06.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889706+0000","last_change":"2024-09-11T22:20:19.858414+0000","last_active":"2024-09-11T22:20:24.889706+0000","last_peered":"2024-09-11T22:20:24.889706+0000","last_clean":"2024-09-11T22:20:24.889706+0000","last_became_active":"2024-09-11T22:20:19.857790+0000","last_became_peered":"2024-09-11T22:20:19.857790+0000","last_unstale":"2024-09-11T22:20:24.889706+0000","last_undegraded":"2024-09-11T22:20:24.889706+0000","last_fullsized":"2024-09-11T22:20:24.889706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":2,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-11T22:20:27.047940+0000","last_change":"2024-09-11T22:21:01.323256+0000","last_active":"2024-09-11T22:21:01.323256+0000","last_peered":"2024-09-11T22:20:27.047940+0000","last_clean":"2024-09-11T22:20:27.047940+0000","last_became_active":"2024-09-11T22:20:19.854774+0000","last_became_peered":"2024-09-11T22:20:19.854774+0000","last_unstale":"2024-09-11T22:20:27.047940+0000","last_undegraded":"2024-09-11T22:20:27.047940+0000","last_fullsized":"2024-09-11T22:20:27.047940+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888845+0000","last_change":"2024-09-11T22:20:19.864700+0000","last_active":"2024-09-11T22:20:24.888845+0000","last_peered":"2024-09-11T22:20:24.888845+0000","last_clean":"2024-09-11T22:20:24.888845+0000","last_became_active":"2024-09-11T22:20:19.862296+0000","last_became_peered":"2024-09-11T22:20:19.862296+0000","last_unstale":"2024-09-11T22:20:24.888845+0000","last_undegraded":"2024-09-11T22:20:24.888845+0000","last_fullsized":"2024-09-11T22:20:24.888845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048773+0000","last_change":"2024-09-11T22:20:19.855253+0000","last_active":"2024-09-11T22:20:27.048773+0000","last_peered":"2024-09-11T22:20:27.048773+0000","last_clean":"2024-09-11T22:20:27.048773+0000","last_became_active":"2024-09-11T22:20:19.854970+0000","last_became_peered":"2024-09-11T22:20:19.854970+0000","last_unstale":"2024-09-11T22:20:27.048773+0000","last_undegraded":"2024-09-11T22:20:27.048773+0000","last_fullsized":"2024-09-11T22:20:27.048773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025225+0000","last_change":"2024-09-11T22:20:19.850202+0000","last_active":"2024-09-11T22:21:01.025225+0000","last_peered":"2024-09-11T22:21:01.025225+0000","last_clean":"2024-09-11T22:21:01.025225+0000","last_became_active":"2024-09-11T22:20:19.849815+0000","last_became_peered":"2024-09-11T22:20:19.849815+0000","last_unstale":"2024-09-11T22:21:01.025225+0000","last_undegraded":"2024-09-11T22:21:01.025225+0000","last_fullsized":"2024-09-11T22:21:01.025225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:56.480679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889814+0000","last_change":"2024-09-11T22:20:19.866864+0000","last_active":"2024-09-11T22:20:24.889814+0000","last_peered":"2024-09-11T22:20:24.889814+0000","last_clean":"2024-09-11T22:20:24.889814+0000","last_became_active":"2024-09-11T22:20:19.866484+0000","last_became_peered":"2024-09-11T22:20:19.866484+0000","last_unstale":"2024-09-11T22:20:24.889814+0000","last_undegraded":"2024-09-11T22:20:24.889814+0000","last_fullsized":"2024-09-11T22:20:24.889814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":2,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-11T22:20:19.847772+0000","last_change":"2024-09-11T22:21:01.323220+0000","last_active":"2024-09-11T22:20:18.828308+0000","last_peered":"2024-09-11T22:20:18.828308+0000","last_clean":"2024-09-11T22:20:18.828308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:19.847772+0000","last_undegraded":"2024-09-11T22:20:19.847772+0000","last_fullsized":"2024-09-11T22:20:19.847772+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997750+0000","last_change":"2024-09-11T22:20:19.860050+0000","last_active":"2024-09-11T22:20:24.997750+0000","last_peered":"2024-09-11T22:20:24.997750+0000","last_clean":"2024-09-11T22:20:24.997750+0000","last_became_active":"2024-09-11T22:20:19.859755+0000","last_became_peered":"2024-09-11T22:20:19.859755+0000","last_unstale":"2024-09-11T22:20:24.997750+0000","last_undegraded":"2024-09-11T22:20:24.997750+0000","last_fullsized":"2024-09-11T22:20:24.997750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:42.487669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033495+0000","last_change":"2024-09-11T22:20:19.853902+0000","last_active":"2024-09-11T22:21:01.033495+0000","last_peered":"2024-09-11T22:21:01.033495+0000","last_clean":"2024-09-11T22:21:01.033495+0000","last_became_active":"2024-09-11T22:20:19.853563+0000","last_became_peered":"2024-09-11T22:20:19.853563+0000","last_unstale":"2024-09-11T22:21:01.033495+0000","last_undegraded":"2024-09-11T22:21:01.033495+0000","last_fullsized":"2024-09-11T22:21:01.033495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887571+0000","last_change":"2024-09-11T22:20:19.849490+0000","last_active":"2024-09-11T22:20:24.887571+0000","last_peered":"2024-09-11T22:20:24.887571+0000","last_clean":"2024-09-11T22:20:24.887571+0000","last_became_active":"2024-09-11T22:20:19.848965+0000","last_became_peered":"2024-09-11T22:20:19.848965+0000","last_unstale":"2024-09-11T22:20:24.887571+0000","last_undegraded":"2024-09-11T22:20:24.887571+0000","last_fullsized":"2024-09-11T22:20:24.887571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:10.387663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048041+0000","last_change":"2024-09-11T22:20:19.860457+0000","last_active":"2024-09-11T22:20:27.048041+0000","last_peered":"2024-09-11T22:20:27.048041+0000","last_clean":"2024-09-11T22:20:27.048041+0000","last_became_active":"2024-09-11T22:20:19.858887+0000","last_became_peered":"2024-09-11T22:20:19.858887+0000","last_unstale":"2024-09-11T22:20:27.048041+0000","last_undegraded":"2024-09-11T22:20:27.048041+0000","last_fullsized":"2024-09-11T22:20:27.048041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:34.620956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888481+0000","last_change":"2024-09-11T22:20:19.862347+0000","last_active":"2024-09-11T22:20:24.888481+0000","last_peered":"2024-09-11T22:20:24.888481+0000","last_clean":"2024-09-11T22:20:24.888481+0000","last_became_active":"2024-09-11T22:20:19.861965+0000","last_became_peered":"2024-09-11T22:20:19.861965+0000","last_unstale":"2024-09-11T22:20:24.888481+0000","last_undegraded":"2024-09-11T22:20:24.888481+0000","last_fullsized":"2024-09-11T22:20:24.888481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888938+0000","last_change":"2024-09-11T22:20:19.862065+0000","last_active":"2024-09-11T22:20:24.888938+0000","last_peered":"2024-09-11T22:20:24.888938+0000","last_clean":"2024-09-11T22:20:24.888938+0000","last_became_active":"2024-09-11T22:20:19.861765+0000","last_became_peered":"2024-09-11T22:20:19.861765+0000","last_unstale":"2024-09-11T22:20:24.888938+0000","last_undegraded":"2024-09-11T22:20:24.888938+0000","last_fullsized":"2024-09-11T22:20:24.888938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.049117+0000","last_change":"2024-09-11T22:20:19.865064+0000","last_active":"2024-09-11T22:20:27.049117+0000","last_peered":"2024-09-11T22:20:27.049117+0000","last_clean":"2024-09-11T22:20:27.049117+0000","last_became_active":"2024-09-11T22:20:19.864697+0000","last_became_peered":"2024-09-11T22:20:19.864697+0000","last_unstale":"2024-09-11T22:20:27.049117+0000","last_undegraded":"2024-09-11T22:20:27.049117+0000","last_fullsized":"2024-09-11T22:20:27.049117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887201+0000","last_change":"2024-09-11T22:20:19.861293+0000","last_active":"2024-09-11T22:20:24.887201+0000","last_peered":"2024-09-11T22:20:24.887201+0000","last_clean":"2024-09-11T22:20:24.887201+0000","last_became_active":"2024-09-11T22:20:19.861013+0000","last_became_peered":"2024-09-11T22:20:19.861013+0000","last_unstale":"2024-09-11T22:20:24.887201+0000","last_undegraded":"2024-09-11T22:20:24.887201+0000","last_fullsized":"2024-09-11T22:20:24.887201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:13.178404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048303+0000","last_change":"2024-09-11T22:20:19.858131+0000","last_active":"2024-09-11T22:20:27.048303+0000","last_peered":"2024-09-11T22:20:27.048303+0000","last_clean":"2024-09-11T22:20:27.048303+0000","last_became_active":"2024-09-11T22:20:19.857842+0000","last_became_peered":"2024-09-11T22:20:19.857842+0000","last_unstale":"2024-09-11T22:20:27.048303+0000","last_undegraded":"2024-09-11T22:20:27.048303+0000","last_fullsized":"2024-09-11T22:20:27.048303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889602+0000","last_change":"2024-09-11T22:20:19.859667+0000","last_active":"2024-09-11T22:20:24.889602+0000","last_peered":"2024-09-11T22:20:24.889602+0000","last_clean":"2024-09-11T22:20:24.889602+0000","last_became_active":"2024-09-11T22:20:19.859306+0000","last_became_peered":"2024-09-11T22:20:19.859306+0000","last_unstale":"2024-09-11T22:20:24.889602+0000","last_undegraded":"2024-09-11T22:20:24.889602+0000","last_fullsized":"2024-09-11T22:20:24.889602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048551+0000","last_change":"2024-09-11T22:20:19.848821+0000","last_active":"2024-09-11T22:20:27.048551+0000","last_peered":"2024-09-11T22:20:27.048551+0000","last_clean":"2024-09-11T22:20:27.048551+0000","last_became_active":"2024-09-11T22:20:19.848531+0000","last_became_peered":"2024-09-11T22:20:19.848531+0000","last_unstale":"2024-09-11T22:20:27.048551+0000","last_undegraded":"2024-09-11T22:20:27.048551+0000","last_fullsized":"2024-09-11T22:20:27.048551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890212+0000","last_change":"2024-09-11T22:20:19.866300+0000","last_active":"2024-09-11T22:20:24.890212+0000","last_peered":"2024-09-11T22:20:24.890212+0000","last_clean":"2024-09-11T22:20:24.890212+0000","last_became_active":"2024-09-11T22:20:19.865939+0000","last_became_peered":"2024-09-11T22:20:19.865939+0000","last_unstale":"2024-09-11T22:20:24.890212+0000","last_undegraded":"2024-09-11T22:20:24.890212+0000","last_fullsized":"2024-09-11T22:20:24.890212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033602+0000","last_change":"2024-09-11T22:20:19.858144+0000","last_active":"2024-09-11T22:21:01.033602+0000","last_peered":"2024-09-11T22:21:01.033602+0000","last_clean":"2024-09-11T22:21:01.033602+0000","last_became_active":"2024-09-11T22:20:19.857840+0000","last_became_peered":"2024-09-11T22:20:19.857840+0000","last_unstale":"2024-09-11T22:21:01.033602+0000","last_undegraded":"2024-09-11T22:21:01.033602+0000","last_fullsized":"2024-09-11T22:21:01.033602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:23.801072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998195+0000","last_change":"2024-09-11T22:20:19.857378+0000","last_active":"2024-09-11T22:20:24.998195+0000","last_peered":"2024-09-11T22:20:24.998195+0000","last_clean":"2024-09-11T22:20:24.998195+0000","last_became_active":"2024-09-11T22:20:19.857089+0000","last_became_peered":"2024-09-11T22:20:19.857089+0000","last_unstale":"2024-09-11T22:20:24.998195+0000","last_undegraded":"2024-09-11T22:20:24.998195+0000","last_fullsized":"2024-09-11T22:20:24.998195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:29.835695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":2,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-11T22:20:19.843776+0000","last_change":"2024-09-11T22:21:01.323294+0000","last_active":"2024-09-11T22:20:18.828308+0000","last_peered":"2024-09-11T22:20:18.828308+0000","last_clean":"2024-09-11T22:20:18.828308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:19.843776+0000","last_undegraded":"2024-09-11T22:20:19.843776+0000","last_fullsized":"2024-09-11T22:20:19.843776+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7454,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":699002,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":111840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":108696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":108032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":111874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":108136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":698346,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":108262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:21:02.873 INFO:tasks.mon_thrash.ceph_manager:PG 3.17 is not active+clean 2024-09-11T22:21:02.874 INFO:tasks.mon_thrash.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 21, 'reported_epoch': 26, 'state': 'peering', 'last_fresh': '2024-09-11T22:20:27.048280+0000', 'last_change': '2024-09-11T22:21:01.034302+0000', 'last_active': '2024-09-11T22:21:01.034302+0000', 'last_peered': '2024-09-11T22:20:27.048280+0000', 'last_clean': '2024-09-11T22:20:27.048280+0000', 'last_became_active': '2024-09-11T22:20:19.861607+0000', 'last_became_peered': '2024-09-11T22:20:19.861607+0000', 'last_unstale': '2024-09-11T22:20:27.048280+0000', 'last_undegraded': '2024-09-11T22:20:27.048280+0000', 'last_fullsized': '2024-09-11T22:20:27.048280+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 21, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'last_clean_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1, 5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:21:02.874 INFO:tasks.mon_thrash.ceph_manager:PG 4.1e is not active+clean 2024-09-11T22:21:02.874 INFO:tasks.mon_thrash.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 15, 'reported_epoch': 26, 'state': 'peering', 'last_fresh': '2024-09-11T22:20:27.048088+0000', 'last_change': '2024-09-11T22:21:01.033206+0000', 'last_active': '2024-09-11T22:21:01.033206+0000', 'last_peered': '2024-09-11T22:20:27.048088+0000', 'last_clean': '2024-09-11T22:20:27.048088+0000', 'last_became_active': '2024-09-11T22:20:24.076592+0000', 'last_became_peered': '2024-09-11T22:20:24.076592+0000', 'last_unstale': '2024-09-11T22:20:27.048088+0000', 'last_undegraded': '2024-09-11T22:20:27.048088+0000', 'last_fullsized': '2024-09-11T22:20:27.048088+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 24, 'last_epoch_clean': 25, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:20:22.853906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:20:22.853906+0000', 'last_clean_scrub_stamp': '2024-09-11T22:20:22.853906+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7, 3, 2], 'acting': [0, 7, 3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1, 2, 3, 7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:21:02.874 INFO:tasks.mon_thrash.ceph_manager:PG 3.2b is not active+clean 2024-09-11T22:21:02.874 INFO:tasks.mon_thrash.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 27, 'state': 'peering', 'last_fresh': '2024-09-11T22:20:27.047940+0000', 'last_change': '2024-09-11T22:21:01.323256+0000', 'last_active': '2024-09-11T22:21:01.323256+0000', 'last_peered': '2024-09-11T22:20:27.047940+0000', 'last_clean': '2024-09-11T22:20:27.047940+0000', 'last_became_active': '2024-09-11T22:20:19.854774+0000', 'last_became_peered': '2024-09-11T22:20:19.854774+0000', 'last_unstale': '2024-09-11T22:20:27.047940+0000', 'last_undegraded': '2024-09-11T22:20:27.047940+0000', 'last_fullsized': '2024-09-11T22:20:27.047940+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 21, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'last_clean_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T22:21:02.874 INFO:tasks.mon_thrash.ceph_manager:PG 3.30 is not active+clean 2024-09-11T22:21:02.874 INFO:tasks.mon_thrash.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 27, 'state': 'peering', 'last_fresh': '2024-09-11T22:20:19.847772+0000', 'last_change': '2024-09-11T22:21:01.323220+0000', 'last_active': '2024-09-11T22:20:18.828308+0000', 'last_peered': '2024-09-11T22:20:18.828308+0000', 'last_clean': '2024-09-11T22:20:18.828308+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:20:19.847772+0000', 'last_undegraded': '2024-09-11T22:20:19.847772+0000', 'last_fullsized': '2024-09-11T22:20:19.847772+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 21, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'last_clean_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T22:21:02.874 INFO:tasks.mon_thrash.ceph_manager:PG 3.3f is not active+clean 2024-09-11T22:21:02.874 INFO:tasks.mon_thrash.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 27, 'state': 'peering', 'last_fresh': '2024-09-11T22:20:19.843776+0000', 'last_change': '2024-09-11T22:21:01.323294+0000', 'last_active': '2024-09-11T22:20:18.828308+0000', 'last_peered': '2024-09-11T22:20:18.828308+0000', 'last_clean': '2024-09-11T22:20:18.828308+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:20:19.843776+0000', 'last_undegraded': '2024-09-11T22:20:19.843776+0000', 'last_fullsized': '2024-09-11T22:20:19.843776+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 21, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'last_clean_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T22:21:02.875 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:21:03.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.006+0000 7f2f7808c640 1 Processor -- start 2024-09-11T22:21:03.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.006+0000 7f2f7808c640 1 -- start start 2024-09-11T22:21:03.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.007+0000 7f2f7808c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2f70154c50 0x7f2f7015b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:03.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.007+0000 7f2f7808c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f7015def0 0x7f2f70071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:03.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.007+0000 7f2f7808c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2f700cb9b0 0x7f2f70071990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:03.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.007+0000 7f2f7808c640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f2f7015b940 con 0x7f2f70154c50 2024-09-11T22:21:03.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.007+0000 7f2f7808c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f2f7015e3a0 con 0x7f2f700cb9b0 2024-09-11T22:21:03.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.007+0000 7f2f7808c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2f7015e680 con 0x7f2f7015def0 2024-09-11T22:21:03.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.007+0000 7f2f75e28640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2f70154c50 0x7f2f7015b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:03.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.007+0000 7f2f75e28640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2f70154c50 0x7f2f7015b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37978/0 (socket says 172.21.15.100:37978) 2024-09-11T22:21:03.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.007+0000 7f2f75e28640 1 -- 172.21.15.100:0/3997570282 learned_addr learned my addr 172.21.15.100:0/3997570282 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:03.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.007+0000 7f2f75627640 1 --2- 172.21.15.100:0/3997570282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f7015def0 0x7f2f70071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:03.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.007+0000 7f2f75e28640 1 -- 172.21.15.100:0/3997570282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f7015def0 msgr2=0x7f2f70071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:03.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.007+0000 7f2f76629640 1 --2- 172.21.15.100:0/3997570282 >> v2:172.21.15.167:3300/0 conn(0x7f2f700cb9b0 0x7f2f70071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:03.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.007+0000 7f2f75e28640 1 --2- 172.21.15.100:0/3997570282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f7015def0 0x7f2f70071450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.007+0000 7f2f75e28640 1 -- 172.21.15.100:0/3997570282 >> v2:172.21.15.167:3300/0 conn(0x7f2f700cb9b0 msgr2=0x7f2f70071990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:03.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.007+0000 7f2f75e28640 1 --2- 172.21.15.100:0/3997570282 >> v2:172.21.15.167:3300/0 conn(0x7f2f700cb9b0 0x7f2f70071990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.007+0000 7f2f75e28640 1 -- 172.21.15.100:0/3997570282 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7015e960 con 0x7f2f70154c50 2024-09-11T22:21:03.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.008+0000 7f2f75e28640 1 --2- 172.21.15.100:0/3997570282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f70154c50 0x7f2f7015b400 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2f700c3960 tx=0x7f2f6c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6cf0104256e790 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:03.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.008+0000 7f2f74e26640 1 -- 172.21.15.100:0/3997570282 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c037070 con 0x7f2f70154c50 2024-09-11T22:21:03.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.008+0000 7f2f74e26640 1 -- 172.21.15.100:0/3997570282 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f6c032440 con 0x7f2f70154c50 2024-09-11T22:21:03.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.008+0000 7f2f74e26640 1 -- 172.21.15.100:0/3997570282 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c032810 con 0x7f2f70154c50 2024-09-11T22:21:03.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.008+0000 7f2f7808c640 1 -- 172.21.15.100:0/3997570282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f70154c50 msgr2=0x7f2f7015b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:03.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.008+0000 7f2f7808c640 1 --2- 172.21.15.100:0/3997570282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f70154c50 0x7f2f7015b400 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2f700c3960 tx=0x7f2f6c02a1e0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.009+0000 7f2f7808c640 1 -- 172.21.15.100:0/3997570282 shutdown_connections 2024-09-11T22:21:03.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.009+0000 7f2f7808c640 1 --2- 172.21.15.100:0/3997570282 >> v2:172.21.15.167:3300/0 conn(0x7f2f700cb9b0 0x7f2f70071990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.009+0000 7f2f7808c640 1 --2- 172.21.15.100:0/3997570282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f7015def0 0x7f2f70071450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.009+0000 7f2f7808c640 1 --2- 172.21.15.100:0/3997570282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f70154c50 0x7f2f7015b400 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.009+0000 7f2f7808c640 1 -- 172.21.15.100:0/3997570282 >> 172.21.15.100:0/3997570282 conn(0x7f2f7006fb50 msgr2=0x7f2f7006ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:03.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.009+0000 7f2f7808c640 1 -- 172.21.15.100:0/3997570282 shutdown_connections 2024-09-11T22:21:03.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.009+0000 7f2f7808c640 1 -- 172.21.15.100:0/3997570282 wait complete. 2024-09-11T22:21:03.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.010+0000 7f2f7808c640 1 Processor -- start 2024-09-11T22:21:03.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.010+0000 7f2f7808c640 1 -- start start 2024-09-11T22:21:03.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.010+0000 7f2f7808c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f700cb9b0 0x7f2f7014d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:03.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.010+0000 7f2f7808c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f70154c50 0x7f2f700afc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:03.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.010+0000 7f2f7808c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f7015def0 0x7f2f7014c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:03.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.010+0000 7f2f7808c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2f70155030 con 0x7f2f700cb9b0 2024-09-11T22:21:03.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.010+0000 7f2f7808c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2f700c9c90 con 0x7f2f7015def0 2024-09-11T22:21:03.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.010+0000 7f2f7808c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2f700ca1b0 con 0x7f2f70154c50 2024-09-11T22:21:03.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.010+0000 7f2f75e28640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f700cb9b0 0x7f2f7014d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:03.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.011+0000 7f2f75e28640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f700cb9b0 0x7f2f7014d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37984/0 (socket says 172.21.15.100:37984) 2024-09-11T22:21:03.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.011+0000 7f2f75e28640 1 -- 172.21.15.100:0/2944323159 learned_addr learned my addr 172.21.15.100:0/2944323159 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:03.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.011+0000 7f2f75627640 1 --2- 172.21.15.100:0/2944323159 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f70154c50 0x7f2f700afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:03.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.011+0000 7f2f76629640 1 --2- 172.21.15.100:0/2944323159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f7015def0 0x7f2f7014c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:03.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.011+0000 7f2f75e28640 1 -- 172.21.15.100:0/2944323159 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f70154c50 msgr2=0x7f2f700afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:03.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.011+0000 7f2f75e28640 1 --2- 172.21.15.100:0/2944323159 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f70154c50 0x7f2f700afc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.011+0000 7f2f75e28640 1 -- 172.21.15.100:0/2944323159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f7015def0 msgr2=0x7f2f7014c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:03.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.011+0000 7f2f75e28640 1 --2- 172.21.15.100:0/2944323159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f7015def0 0x7f2f7014c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.011+0000 7f2f75e28640 1 -- 172.21.15.100:0/2944323159 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f70157800 con 0x7f2f700cb9b0 2024-09-11T22:21:03.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.011+0000 7f2f75e28640 1 --2- 172.21.15.100:0/2944323159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f700cb9b0 0x7f2f7014d940 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c000c00 tx=0x7f2f6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:03.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.011+0000 7f2f667fc640 1 -- 172.21.15.100:0/2944323159 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c037040 con 0x7f2f700cb9b0 2024-09-11T22:21:03.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.011+0000 7f2f667fc640 1 -- 172.21.15.100:0/2944323159 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f6c042070 con 0x7f2f700cb9b0 2024-09-11T22:21:03.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.011+0000 7f2f7808c640 1 -- 172.21.15.100:0/2944323159 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f701f1200 con 0x7f2f700cb9b0 2024-09-11T22:21:03.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.011+0000 7f2f667fc640 1 -- 172.21.15.100:0/2944323159 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c030bb0 con 0x7f2f700cb9b0 2024-09-11T22:21:03.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.011+0000 7f2f7808c640 1 -- 172.21.15.100:0/2944323159 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f7006ccc0 con 0x7f2f700cb9b0 2024-09-11T22:21:03.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.012+0000 7f2f7808c640 1 -- 172.21.15.100:0/2944323159 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f7015b400 con 0x7f2f700cb9b0 2024-09-11T22:21:03.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.013+0000 7f2f667fc640 1 -- 172.21.15.100:0/2944323159 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2f6c047460 con 0x7f2f700cb9b0 2024-09-11T22:21:03.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.013+0000 7f2f667fc640 1 --2- 172.21.15.100:0/2944323159 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2f5406be30 0x7f2f5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:03.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.013+0000 7f2f667fc640 1 -- 172.21.15.100:0/2944323159 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f2f6c0abee0 con 0x7f2f700cb9b0 2024-09-11T22:21:03.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.013+0000 7f2f75627640 1 --2- 172.21.15.100:0/2944323159 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2f5406be30 0x7f2f5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:03.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.014+0000 7f2f75627640 1 --2- 172.21.15.100:0/2944323159 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2f5406be30 0x7f2f5406e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2f60006fd0 tx=0x7f2f60008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:03.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.017+0000 7f2f667fc640 1 -- 172.21.15.100:0/2944323159 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f6c045360 con 0x7f2f700cb9b0 2024-09-11T22:21:03.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.246+0000 7f2f7808c640 1 -- 172.21.15.100:0/2944323159 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f2f700cafb0 con 0x7f2f700cb9b0 2024-09-11T22:21:03.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.247+0000 7f2f667fc640 1 -- 172.21.15.100:0/2944323159 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+3147 (secure 0 0 0) 0x7f2f6c07a470 con 0x7f2f700cb9b0 2024-09-11T22:21:03.248 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:21:03.248 INFO:teuthology.orchestra.run.smithi100.stdout:{"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":67,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":28,"num_osds":8,"num_up_osds":8,"osd_up_since":1726093207,"num_in_osds":8,"osd_in_since":1726093198,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":124},{"state_name":"peering","count":5}],"num_pgs":129,"num_pools":4,"num_objects":62,"data_bytes":597822,"bytes_used":223838208,"bytes_avail":772870275072,"bytes_total":773094113280,"inactive_pgs_ratio":0.038759689778089523,"write_bytes_sec":511,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":14,"btime":"2024-09-11T22:20:52:989866+0000","id":1,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":1,"rank":2,"name":"a","status":"up:active","gid":4275},{"filesystem_id":1,"rank":1,"name":"e","status":"up:active","gid":4281},{"filesystem_id":1,"rank":0,"name":"f","status":"up:active","gid":4296}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-11T22:21:02.314042+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:21:03.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.249+0000 7f2f7808c640 1 -- 172.21.15.100:0/2944323159 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2f5406be30 msgr2=0x7f2f5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:03.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.249+0000 7f2f7808c640 1 --2- 172.21.15.100:0/2944323159 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2f5406be30 0x7f2f5406e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2f60006fd0 tx=0x7f2f60008040 comp rx=0 tx=0).stop 2024-09-11T22:21:03.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.249+0000 7f2f7808c640 1 -- 172.21.15.100:0/2944323159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f700cb9b0 msgr2=0x7f2f7014d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:03.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.249+0000 7f2f7808c640 1 --2- 172.21.15.100:0/2944323159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f700cb9b0 0x7f2f7014d940 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c000c00 tx=0x7f2f6c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.249+0000 7f2f7808c640 1 -- 172.21.15.100:0/2944323159 shutdown_connections 2024-09-11T22:21:03.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.249+0000 7f2f7808c640 1 --2- 172.21.15.100:0/2944323159 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2f5406be30 0x7f2f5406e2f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.249+0000 7f2f7808c640 1 --2- 172.21.15.100:0/2944323159 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f7015def0 0x7f2f7014c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.249+0000 7f2f7808c640 1 --2- 172.21.15.100:0/2944323159 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f70154c50 0x7f2f700afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.249+0000 7f2f7808c640 1 --2- 172.21.15.100:0/2944323159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f700cb9b0 0x7f2f7014d940 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.249+0000 7f2f7808c640 1 -- 172.21.15.100:0/2944323159 >> 172.21.15.100:0/2944323159 conn(0x7f2f7006fb50 msgr2=0x7f2f70071450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:03.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.249+0000 7f2f7808c640 1 -- 172.21.15.100:0/2944323159 shutdown_connections 2024-09-11T22:21:03.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.249+0000 7f2f7808c640 1 -- 172.21.15.100:0/2944323159 wait complete. 2024-09-11T22:21:03.260 INFO:tasks.mon_thrash.ceph_manager:no progress seen, keeping timeout for now 2024-09-11T22:21:03.261 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:21:03.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.359+0000 7fe101ea5640 1 Processor -- start 2024-09-11T22:21:03.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.359+0000 7fe101ea5640 1 -- start start 2024-09-11T22:21:03.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.360+0000 7fe101ea5640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe0fc06be80 0x7fe0fc070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:03.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.360+0000 7fe101ea5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe0fc15b630 0x7fe0fc06c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:03.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.360+0000 7fe101ea5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0fc0cb120 0x7fe0fc157c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:03.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.360+0000 7fe101ea5640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fe0fc06c7a0 con 0x7fe0fc06be80 2024-09-11T22:21:03.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.360+0000 7fe101ea5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fe0fc0cac90 con 0x7fe0fc15b630 2024-09-11T22:21:03.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.360+0000 7fe101ea5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe0fc0b39c0 con 0x7fe0fc0cb120 2024-09-11T22:21:03.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.360+0000 7fe0fb7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe0fc06be80 0x7fe0fc070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:03.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.360+0000 7fe0fb7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe0fc06be80 0x7fe0fc070530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37998/0 (socket says 172.21.15.100:37998) 2024-09-11T22:21:03.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.360+0000 7fe0fb7fe640 1 -- 172.21.15.100:0/472724040 learned_addr learned my addr 172.21.15.100:0/472724040 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:03.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.360+0000 7fe0faffd640 1 --2- 172.21.15.100:0/472724040 >> v2:172.21.15.167:3300/0 conn(0x7fe0fc15b630 0x7fe0fc06c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:03.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.360+0000 7fe0fbfff640 1 --2- 172.21.15.100:0/472724040 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0fc0cb120 0x7fe0fc157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:03.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.361+0000 7fe0fb7fe640 1 -- 172.21.15.100:0/472724040 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0fc0cb120 msgr2=0x7fe0fc157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:03.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.361+0000 7fe0fb7fe640 1 --2- 172.21.15.100:0/472724040 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0fc0cb120 0x7fe0fc157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.361+0000 7fe0fb7fe640 1 -- 172.21.15.100:0/472724040 >> v2:172.21.15.167:3300/0 conn(0x7fe0fc15b630 msgr2=0x7fe0fc06c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:03.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.361+0000 7fe0fb7fe640 1 --2- 172.21.15.100:0/472724040 >> v2:172.21.15.167:3300/0 conn(0x7fe0fc15b630 0x7fe0fc06c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.361+0000 7fe0fb7fe640 1 -- 172.21.15.100:0/472724040 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0fc0b3ca0 con 0x7fe0fc06be80 2024-09-11T22:21:03.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.361+0000 7fe0fb7fe640 1 --2- 172.21.15.100:0/472724040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0fc06be80 0x7fe0fc070530 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc06ef00 tx=0x7fe0ec02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399882d2b108885f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:03.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.361+0000 7fe0fa7fc640 1 -- 172.21.15.100:0/472724040 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec036070 con 0x7fe0fc06be80 2024-09-11T22:21:03.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.361+0000 7fe0fa7fc640 1 -- 172.21.15.100:0/472724040 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0ec031600 con 0x7fe0fc06be80 2024-09-11T22:21:03.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.361+0000 7fe0fa7fc640 1 -- 172.21.15.100:0/472724040 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec0319d0 con 0x7fe0fc06be80 2024-09-11T22:21:03.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.362+0000 7fe101ea5640 1 -- 172.21.15.100:0/472724040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0fc06be80 msgr2=0x7fe0fc070530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:03.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.362+0000 7fe101ea5640 1 --2- 172.21.15.100:0/472724040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0fc06be80 0x7fe0fc070530 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc06ef00 tx=0x7fe0ec02a6a0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.362+0000 7fe101ea5640 1 -- 172.21.15.100:0/472724040 shutdown_connections 2024-09-11T22:21:03.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.362+0000 7fe101ea5640 1 --2- 172.21.15.100:0/472724040 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0fc0cb120 0x7fe0fc157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.362+0000 7fe101ea5640 1 --2- 172.21.15.100:0/472724040 >> v2:172.21.15.167:3300/0 conn(0x7fe0fc15b630 0x7fe0fc06c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.362+0000 7fe101ea5640 1 --2- 172.21.15.100:0/472724040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0fc06be80 0x7fe0fc070530 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.362+0000 7fe101ea5640 1 -- 172.21.15.100:0/472724040 >> 172.21.15.100:0/472724040 conn(0x7fe0fc06de20 msgr2=0x7fe0fc06e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:03.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.362+0000 7fe101ea5640 1 -- 172.21.15.100:0/472724040 shutdown_connections 2024-09-11T22:21:03.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.362+0000 7fe101ea5640 1 -- 172.21.15.100:0/472724040 wait complete. 2024-09-11T22:21:03.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.363+0000 7fe101ea5640 1 Processor -- start 2024-09-11T22:21:03.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.363+0000 7fe101ea5640 1 -- start start 2024-09-11T22:21:03.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.364+0000 7fe101ea5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0fc06be80 0x7fe0fc1f43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:03.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.364+0000 7fe101ea5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0fc0cb120 0x7fe0fc1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:03.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.364+0000 7fe101ea5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0fc15b630 0x7fe0fc0c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:03.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.364+0000 7fe101ea5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc0cb5b0 con 0x7fe0fc06be80 2024-09-11T22:21:03.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.364+0000 7fe101ea5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc15ba60 con 0x7fe0fc15b630 2024-09-11T22:21:03.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.364+0000 7fe101ea5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe0fc0cb730 con 0x7fe0fc0cb120 2024-09-11T22:21:03.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.364+0000 7fe0fb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0fc06be80 0x7fe0fc1f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:03.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.364+0000 7fe0fb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0fc06be80 0x7fe0fc1f43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38008/0 (socket says 172.21.15.100:38008) 2024-09-11T22:21:03.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.364+0000 7fe0fb7fe640 1 -- 172.21.15.100:0/3812881193 learned_addr learned my addr 172.21.15.100:0/3812881193 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:03.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.364+0000 7fe0fbfff640 1 --2- 172.21.15.100:0/3812881193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0fc15b630 0x7fe0fc0c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:03.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.364+0000 7fe0faffd640 1 --2- 172.21.15.100:0/3812881193 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0fc0cb120 0x7fe0fc1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:03.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.364+0000 7fe0fb7fe640 1 -- 172.21.15.100:0/3812881193 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0fc0cb120 msgr2=0x7fe0fc1568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:03.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.364+0000 7fe0fb7fe640 1 --2- 172.21.15.100:0/3812881193 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0fc0cb120 0x7fe0fc1568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.364+0000 7fe0fb7fe640 1 -- 172.21.15.100:0/3812881193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0fc15b630 msgr2=0x7fe0fc0c57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:03.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.364+0000 7fe0fb7fe640 1 --2- 172.21.15.100:0/3812881193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0fc15b630 0x7fe0fc0c57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.364+0000 7fe0fb7fe640 1 -- 172.21.15.100:0/3812881193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0fc0cc310 con 0x7fe0fc06be80 2024-09-11T22:21:03.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.364+0000 7fe0faffd640 1 --2- 172.21.15.100:0/3812881193 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0fc0cb120 0x7fe0fc1568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:03.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.365+0000 7fe0fb7fe640 1 --2- 172.21.15.100:0/3812881193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0fc06be80 0x7fe0fc1f43f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009e20 tx=0x7fe0ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:03.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.365+0000 7fe0e3fff640 1 -- 172.21.15.100:0/3812881193 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec036050 con 0x7fe0fc06be80 2024-09-11T22:21:03.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.365+0000 7fe0e3fff640 1 -- 172.21.15.100:0/3812881193 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0ec042070 con 0x7fe0fc06be80 2024-09-11T22:21:03.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.365+0000 7fe101ea5640 1 -- 172.21.15.100:0/3812881193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0fc157230 con 0x7fe0fc06be80 2024-09-11T22:21:03.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.365+0000 7fe0e3fff640 1 -- 172.21.15.100:0/3812881193 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec009510 con 0x7fe0fc06be80 2024-09-11T22:21:03.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.365+0000 7fe101ea5640 1 -- 172.21.15.100:0/3812881193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0fc0cc870 con 0x7fe0fc06be80 2024-09-11T22:21:03.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.366+0000 7fe101ea5640 1 -- 172.21.15.100:0/3812881193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0fc0c8df0 con 0x7fe0fc06be80 2024-09-11T22:21:03.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.366+0000 7fe0e3fff640 1 -- 172.21.15.100:0/3812881193 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe0ec007c70 con 0x7fe0fc06be80 2024-09-11T22:21:03.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.367+0000 7fe0e3fff640 1 --2- 172.21.15.100:0/3812881193 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe0e806be30 0x7fe0e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:03.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.367+0000 7fe0e3fff640 1 -- 172.21.15.100:0/3812881193 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fe0ec0abf20 con 0x7fe0fc06be80 2024-09-11T22:21:03.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.367+0000 7fe0faffd640 1 --2- 172.21.15.100:0/3812881193 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe0e806be30 0x7fe0e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:03.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.367+0000 7fe0faffd640 1 --2- 172.21.15.100:0/3812881193 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe0e806be30 0x7fe0e806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc15afb0 tx=0x7fe0f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:03.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.371+0000 7fe0e3fff640 1 -- 172.21.15.100:0/3812881193 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe0fc0cc310 con 0x7fe0fc06be80 2024-09-11T22:21:03.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.532+0000 7fe101ea5640 1 -- 172.21.15.100:0/3812881193 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0fc0c5640 con 0x7fe0e806be30 2024-09-11T22:21:03.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.540+0000 7fe0e3fff640 1 -- 172.21.15.100:0/3812881193 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332412 (secure 0 0 0) 0x7fe0fc0c5640 con 0x7fe0e806be30 2024-09-11T22:21:03.545 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:21:03.547 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-11T22:21:03.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.543+0000 7fe101ea5640 1 -- 172.21.15.100:0/3812881193 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe0e806be30 msgr2=0x7fe0e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:03.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.543+0000 7fe101ea5640 1 --2- 172.21.15.100:0/3812881193 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe0e806be30 0x7fe0e806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc15afb0 tx=0x7fe0f0008040 comp rx=0 tx=0).stop 2024-09-11T22:21:03.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.543+0000 7fe101ea5640 1 -- 172.21.15.100:0/3812881193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0fc06be80 msgr2=0x7fe0fc1f43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.543+0000 7fe101ea5640 1 --2- 172.21.15.100:0/3812881193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0fc06be80 0x7fe0fc1f43f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009e20 tx=0x7fe0ec004a40 comp rx=0 tx=0).stop 2024-09-11T22:21:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.543+0000 7fe101ea5640 1 -- 172.21.15.100:0/3812881193 shutdown_connections 2024-09-11T22:21:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.543+0000 7fe101ea5640 1 --2- 172.21.15.100:0/3812881193 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe0e806be30 0x7fe0e806e2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.543+0000 7fe101ea5640 1 --2- 172.21.15.100:0/3812881193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0fc15b630 0x7fe0fc0c57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.543+0000 7fe101ea5640 1 --2- 172.21.15.100:0/3812881193 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0fc0cb120 0x7fe0fc1568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.543+0000 7fe101ea5640 1 --2- 172.21.15.100:0/3812881193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0fc06be80 0x7fe0fc1f43f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.543+0000 7fe101ea5640 1 -- 172.21.15.100:0/3812881193 >> 172.21.15.100:0/3812881193 conn(0x7fe0fc06de20 msgr2=0x7fe0fc0c9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.543+0000 7fe101ea5640 1 -- 172.21.15.100:0/3812881193 shutdown_connections 2024-09-11T22:21:03.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:03.543+0000 7fe101ea5640 1 -- 172.21.15.100:0/3812881193 wait complete. 2024-09-11T22:21:03.555 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-09-11T22:21:02.314004+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597822,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":287,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218592,"kb_used_data":2400,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756128,"statfs":{"total":773094113280,"available":772870275072,"internally_reserved":0,"allocated":2457600,"data_stored":2054188,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":784,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001916"},"pg_stats":[{"pgid":"2.1f","version":"26'9","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.034259+0000","last_change":"2024-09-11T22:20:18.853007+0000","last_active":"2024-09-11T22:21:01.034259+0000","last_peered":"2024-09-11T22:21:01.034259+0000","last_clean":"2024-09-11T22:21:01.034259+0000","last_became_active":"2024-09-11T22:20:18.852740+0000","last_became_peered":"2024-09-11T22:20:18.852740+0000","last_unstale":"2024-09-11T22:21:01.034259+0000","last_undegraded":"2024-09-11T22:21:01.034259+0000","last_fullsized":"2024-09-11T22:21:01.034259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:46.710328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887920+0000","last_change":"2024-09-11T22:20:19.849765+0000","last_active":"2024-09-11T22:20:24.887920+0000","last_peered":"2024-09-11T22:20:24.887920+0000","last_clean":"2024-09-11T22:20:24.887920+0000","last_became_active":"2024-09-11T22:20:19.848619+0000","last_became_peered":"2024-09-11T22:20:19.848619+0000","last_unstale":"2024-09-11T22:20:24.887920+0000","last_undegraded":"2024-09-11T22:20:24.887920+0000","last_fullsized":"2024-09-11T22:20:24.887920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:57.621624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887250+0000","last_change":"2024-09-11T22:20:24.078618+0000","last_active":"2024-09-11T22:20:24.887250+0000","last_peered":"2024-09-11T22:20:24.887250+0000","last_clean":"2024-09-11T22:20:24.887250+0000","last_became_active":"2024-09-11T22:20:24.078283+0000","last_became_peered":"2024-09-11T22:20:24.078283+0000","last_unstale":"2024-09-11T22:20:24.887250+0000","last_undegraded":"2024-09-11T22:20:24.887250+0000","last_fullsized":"2024-09-11T22:20:24.887250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:01.901307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888040+0000","last_change":"2024-09-11T22:20:18.855945+0000","last_active":"2024-09-11T22:20:24.888040+0000","last_peered":"2024-09-11T22:20:24.888040+0000","last_clean":"2024-09-11T22:20:24.888040+0000","last_became_active":"2024-09-11T22:20:18.854811+0000","last_became_peered":"2024-09-11T22:20:18.854811+0000","last_unstale":"2024-09-11T22:20:24.888040+0000","last_undegraded":"2024-09-11T22:20:24.888040+0000","last_fullsized":"2024-09-11T22:20:24.888040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:47.508920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033442+0000","last_change":"2024-09-11T22:20:19.862436+0000","last_active":"2024-09-11T22:21:01.033442+0000","last_peered":"2024-09-11T22:21:01.033442+0000","last_clean":"2024-09-11T22:21:01.033442+0000","last_became_active":"2024-09-11T22:20:19.862061+0000","last_became_peered":"2024-09-11T22:20:19.862061+0000","last_unstale":"2024-09-11T22:21:01.033442+0000","last_undegraded":"2024-09-11T22:21:01.033442+0000","last_fullsized":"2024-09-11T22:21:01.033442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047627+0000","last_change":"2024-09-11T22:20:23.879729+0000","last_active":"2024-09-11T22:20:27.047627+0000","last_peered":"2024-09-11T22:20:27.047627+0000","last_clean":"2024-09-11T22:20:27.047627+0000","last_became_active":"2024-09-11T22:20:23.879245+0000","last_became_peered":"2024-09-11T22:20:23.879245+0000","last_unstale":"2024-09-11T22:20:27.047627+0000","last_undegraded":"2024-09-11T22:20:27.047627+0000","last_fullsized":"2024-09-11T22:20:27.047627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:36.836842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.964933+0000","last_change":"2024-09-11T22:20:18.853076+0000","last_active":"2024-09-11T22:20:52.964933+0000","last_peered":"2024-09-11T22:20:52.964933+0000","last_clean":"2024-09-11T22:20:52.964933+0000","last_became_active":"2024-09-11T22:20:18.852728+0000","last_became_peered":"2024-09-11T22:20:18.852728+0000","last_unstale":"2024-09-11T22:20:52.964933+0000","last_undegraded":"2024-09-11T22:20:52.964933+0000","last_fullsized":"2024-09-11T22:20:52.964933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890308+0000","last_change":"2024-09-11T22:20:19.864544+0000","last_active":"2024-09-11T22:20:24.890308+0000","last_peered":"2024-09-11T22:20:24.890308+0000","last_clean":"2024-09-11T22:20:24.890308+0000","last_became_active":"2024-09-11T22:20:19.864234+0000","last_became_peered":"2024-09-11T22:20:19.864234+0000","last_unstale":"2024-09-11T22:20:24.890308+0000","last_undegraded":"2024-09-11T22:20:24.890308+0000","last_fullsized":"2024-09-11T22:20:24.890308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048400+0000","last_change":"2024-09-11T22:20:23.873783+0000","last_active":"2024-09-11T22:20:27.048400+0000","last_peered":"2024-09-11T22:20:27.048400+0000","last_clean":"2024-09-11T22:20:27.048400+0000","last_became_active":"2024-09-11T22:20:23.873385+0000","last_became_peered":"2024-09-11T22:20:23.873385+0000","last_unstale":"2024-09-11T22:20:27.048400+0000","last_undegraded":"2024-09-11T22:20:27.048400+0000","last_fullsized":"2024-09-11T22:20:27.048400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048092+0000","last_change":"2024-09-11T22:20:18.861530+0000","last_active":"2024-09-11T22:20:27.048092+0000","last_peered":"2024-09-11T22:20:27.048092+0000","last_clean":"2024-09-11T22:20:27.048092+0000","last_became_active":"2024-09-11T22:20:18.861230+0000","last_became_peered":"2024-09-11T22:20:18.861230+0000","last_unstale":"2024-09-11T22:20:27.048092+0000","last_undegraded":"2024-09-11T22:20:27.048092+0000","last_fullsized":"2024-09-11T22:20:27.048092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890615+0000","last_change":"2024-09-11T22:20:19.863401+0000","last_active":"2024-09-11T22:20:24.890615+0000","last_peered":"2024-09-11T22:20:24.890615+0000","last_clean":"2024-09-11T22:20:24.890615+0000","last_became_active":"2024-09-11T22:20:19.863127+0000","last_became_peered":"2024-09-11T22:20:19.863127+0000","last_unstale":"2024-09-11T22:20:24.890615+0000","last_undegraded":"2024-09-11T22:20:24.890615+0000","last_fullsized":"2024-09-11T22:20:24.890615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:36.888544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048021+0000","last_change":"2024-09-11T22:20:23.874650+0000","last_active":"2024-09-11T22:20:27.048021+0000","last_peered":"2024-09-11T22:20:27.048021+0000","last_clean":"2024-09-11T22:20:27.048021+0000","last_became_active":"2024-09-11T22:20:23.874040+0000","last_became_peered":"2024-09-11T22:20:23.874040+0000","last_unstale":"2024-09-11T22:20:27.048021+0000","last_undegraded":"2024-09-11T22:20:27.048021+0000","last_fullsized":"2024-09-11T22:20:27.048021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888158+0000","last_change":"2024-09-11T22:20:19.859446+0000","last_active":"2024-09-11T22:20:24.888158+0000","last_peered":"2024-09-11T22:20:24.888158+0000","last_clean":"2024-09-11T22:20:24.888158+0000","last_became_active":"2024-09-11T22:20:19.859106+0000","last_became_peered":"2024-09-11T22:20:19.859106+0000","last_unstale":"2024-09-11T22:20:24.888158+0000","last_undegraded":"2024-09-11T22:20:24.888158+0000","last_fullsized":"2024-09-11T22:20:24.888158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.944022+0000","last_change":"2024-09-11T22:20:18.856475+0000","last_active":"2024-09-11T22:20:46.944022+0000","last_peered":"2024-09-11T22:20:46.944022+0000","last_clean":"2024-09-11T22:20:46.944022+0000","last_became_active":"2024-09-11T22:20:18.856165+0000","last_became_peered":"2024-09-11T22:20:18.856165+0000","last_unstale":"2024-09-11T22:20:46.944022+0000","last_undegraded":"2024-09-11T22:20:46.944022+0000","last_fullsized":"2024-09-11T22:20:46.944022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048102+0000","last_change":"2024-09-11T22:20:23.878121+0000","last_active":"2024-09-11T22:20:27.048102+0000","last_peered":"2024-09-11T22:20:27.048102+0000","last_clean":"2024-09-11T22:20:27.048102+0000","last_became_active":"2024-09-11T22:20:23.877713+0000","last_became_peered":"2024-09-11T22:20:23.877713+0000","last_unstale":"2024-09-11T22:20:27.048102+0000","last_undegraded":"2024-09-11T22:20:27.048102+0000","last_fullsized":"2024-09-11T22:20:27.048102+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887604+0000","last_change":"2024-09-11T22:20:19.858358+0000","last_active":"2024-09-11T22:20:24.887604+0000","last_peered":"2024-09-11T22:20:24.887604+0000","last_clean":"2024-09-11T22:20:24.887604+0000","last_became_active":"2024-09-11T22:20:19.858057+0000","last_became_peered":"2024-09-11T22:20:19.858057+0000","last_unstale":"2024-09-11T22:20:24.887604+0000","last_undegraded":"2024-09-11T22:20:24.887604+0000","last_fullsized":"2024-09-11T22:20:24.887604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:07.839926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998226+0000","last_change":"2024-09-11T22:20:18.853818+0000","last_active":"2024-09-11T22:20:24.998226+0000","last_peered":"2024-09-11T22:20:24.998226+0000","last_clean":"2024-09-11T22:20:24.998226+0000","last_became_active":"2024-09-11T22:20:18.853508+0000","last_became_peered":"2024-09-11T22:20:18.853508+0000","last_unstale":"2024-09-11T22:20:24.998226+0000","last_undegraded":"2024-09-11T22:20:24.998226+0000","last_fullsized":"2024-09-11T22:20:24.998226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:58.141587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047962+0000","last_change":"2024-09-11T22:20:23.879226+0000","last_active":"2024-09-11T22:20:27.047962+0000","last_peered":"2024-09-11T22:20:27.047962+0000","last_clean":"2024-09-11T22:20:27.047962+0000","last_became_active":"2024-09-11T22:20:23.878199+0000","last_became_peered":"2024-09-11T22:20:23.878199+0000","last_unstale":"2024-09-11T22:20:27.047962+0000","last_undegraded":"2024-09-11T22:20:27.047962+0000","last_fullsized":"2024-09-11T22:20:27.047962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:13.245927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887402+0000","last_change":"2024-09-11T22:20:19.844748+0000","last_active":"2024-09-11T22:20:24.887402+0000","last_peered":"2024-09-11T22:20:24.887402+0000","last_clean":"2024-09-11T22:20:24.887402+0000","last_became_active":"2024-09-11T22:20:19.844446+0000","last_became_peered":"2024-09-11T22:20:19.844446+0000","last_unstale":"2024-09-11T22:20:24.887402+0000","last_undegraded":"2024-09-11T22:20:24.887402+0000","last_fullsized":"2024-09-11T22:20:24.887402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:13.319918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.948253+0000","last_change":"2024-09-11T22:20:18.847388+0000","last_active":"2024-09-11T22:20:46.948253+0000","last_peered":"2024-09-11T22:20:46.948253+0000","last_clean":"2024-09-11T22:20:46.948253+0000","last_became_active":"2024-09-11T22:20:18.847118+0000","last_became_peered":"2024-09-11T22:20:18.847118+0000","last_unstale":"2024-09-11T22:20:46.948253+0000","last_undegraded":"2024-09-11T22:20:46.948253+0000","last_fullsized":"2024-09-11T22:20:46.948253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:47.360920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998393+0000","last_change":"2024-09-11T22:20:24.077604+0000","last_active":"2024-09-11T22:20:24.998393+0000","last_peered":"2024-09-11T22:20:24.998393+0000","last_clean":"2024-09-11T22:20:24.998393+0000","last_became_active":"2024-09-11T22:20:24.077231+0000","last_became_peered":"2024-09-11T22:20:24.077231+0000","last_unstale":"2024-09-11T22:20:24.998393+0000","last_undegraded":"2024-09-11T22:20:24.998393+0000","last_fullsized":"2024-09-11T22:20:24.998393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:38.846688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048647+0000","last_change":"2024-09-11T22:20:19.854453+0000","last_active":"2024-09-11T22:20:27.048647+0000","last_peered":"2024-09-11T22:20:27.048647+0000","last_clean":"2024-09-11T22:20:27.048647+0000","last_became_active":"2024-09-11T22:20:19.854100+0000","last_became_peered":"2024-09-11T22:20:19.854100+0000","last_unstale":"2024-09-11T22:20:27.048647+0000","last_undegraded":"2024-09-11T22:20:27.048647+0000","last_fullsized":"2024-09-11T22:20:27.048647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:06.166813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.944339+0000","last_change":"2024-09-11T22:20:18.854889+0000","last_active":"2024-09-11T22:20:46.944339+0000","last_peered":"2024-09-11T22:20:46.944339+0000","last_clean":"2024-09-11T22:20:46.944339+0000","last_became_active":"2024-09-11T22:20:18.854552+0000","last_became_peered":"2024-09-11T22:20:18.854552+0000","last_unstale":"2024-09-11T22:20:46.944339+0000","last_undegraded":"2024-09-11T22:20:46.944339+0000","last_fullsized":"2024-09-11T22:20:46.944339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:33.612126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048443+0000","last_change":"2024-09-11T22:20:23.878932+0000","last_active":"2024-09-11T22:20:27.048443+0000","last_peered":"2024-09-11T22:20:27.048443+0000","last_clean":"2024-09-11T22:20:27.048443+0000","last_became_active":"2024-09-11T22:20:23.878305+0000","last_became_peered":"2024-09-11T22:20:23.878305+0000","last_unstale":"2024-09-11T22:20:27.048443+0000","last_undegraded":"2024-09-11T22:20:27.048443+0000","last_fullsized":"2024-09-11T22:20:27.048443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033835+0000","last_change":"2024-09-11T22:20:19.856318+0000","last_active":"2024-09-11T22:21:01.033835+0000","last_peered":"2024-09-11T22:21:01.033835+0000","last_clean":"2024-09-11T22:21:01.033835+0000","last_became_active":"2024-09-11T22:20:19.855992+0000","last_became_peered":"2024-09-11T22:20:19.855992+0000","last_unstale":"2024-09-11T22:21:01.033835+0000","last_undegraded":"2024-09-11T22:21:01.033835+0000","last_fullsized":"2024-09-11T22:21:01.033835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:57.709140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.944255+0000","last_change":"2024-09-11T22:20:18.850750+0000","last_active":"2024-09-11T22:20:46.944255+0000","last_peered":"2024-09-11T22:20:46.944255+0000","last_clean":"2024-09-11T22:20:46.944255+0000","last_became_active":"2024-09-11T22:20:18.849621+0000","last_became_peered":"2024-09-11T22:20:18.849621+0000","last_unstale":"2024-09-11T22:20:46.944255+0000","last_undegraded":"2024-09-11T22:20:46.944255+0000","last_fullsized":"2024-09-11T22:20:46.944255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047710+0000","last_change":"2024-09-11T22:20:24.077741+0000","last_active":"2024-09-11T22:20:27.047710+0000","last_peered":"2024-09-11T22:20:27.047710+0000","last_clean":"2024-09-11T22:20:27.047710+0000","last_became_active":"2024-09-11T22:20:24.077325+0000","last_became_peered":"2024-09-11T22:20:24.077325+0000","last_unstale":"2024-09-11T22:20:27.047710+0000","last_undegraded":"2024-09-11T22:20:27.047710+0000","last_fullsized":"2024-09-11T22:20:27.047710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:18.656529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888138+0000","last_change":"2024-09-11T22:20:19.850738+0000","last_active":"2024-09-11T22:20:24.888138+0000","last_peered":"2024-09-11T22:20:24.888138+0000","last_clean":"2024-09-11T22:20:24.888138+0000","last_became_active":"2024-09-11T22:20:19.850441+0000","last_became_peered":"2024-09-11T22:20:19.850441+0000","last_unstale":"2024-09-11T22:20:24.888138+0000","last_undegraded":"2024-09-11T22:20:24.888138+0000","last_fullsized":"2024-09-11T22:20:24.888138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:47.552343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.966090+0000","last_change":"2024-09-11T22:20:18.845173+0000","last_active":"2024-09-11T22:20:52.966090+0000","last_peered":"2024-09-11T22:20:52.966090+0000","last_clean":"2024-09-11T22:20:52.966090+0000","last_became_active":"2024-09-11T22:20:18.844731+0000","last_became_peered":"2024-09-11T22:20:18.844731+0000","last_unstale":"2024-09-11T22:20:52.966090+0000","last_undegraded":"2024-09-11T22:20:52.966090+0000","last_fullsized":"2024-09-11T22:20:52.966090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:32.963285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887172+0000","last_change":"2024-09-11T22:20:24.078020+0000","last_active":"2024-09-11T22:20:24.887172+0000","last_peered":"2024-09-11T22:20:24.887172+0000","last_clean":"2024-09-11T22:20:24.887172+0000","last_became_active":"2024-09-11T22:20:24.077541+0000","last_became_peered":"2024-09-11T22:20:24.077541+0000","last_unstale":"2024-09-11T22:20:24.887172+0000","last_undegraded":"2024-09-11T22:20:24.887172+0000","last_fullsized":"2024-09-11T22:20:24.887172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:36.122714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998068+0000","last_change":"2024-09-11T22:20:19.845497+0000","last_active":"2024-09-11T22:20:24.998068+0000","last_peered":"2024-09-11T22:20:24.998068+0000","last_clean":"2024-09-11T22:20:24.998068+0000","last_became_active":"2024-09-11T22:20:19.845203+0000","last_became_peered":"2024-09-11T22:20:19.845203+0000","last_unstale":"2024-09-11T22:20:24.998068+0000","last_undegraded":"2024-09-11T22:20:24.998068+0000","last_fullsized":"2024-09-11T22:20:24.998068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:12.086231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048907+0000","last_change":"2024-09-11T22:20:18.856263+0000","last_active":"2024-09-11T22:20:27.048907+0000","last_peered":"2024-09-11T22:20:27.048907+0000","last_clean":"2024-09-11T22:20:27.048907+0000","last_became_active":"2024-09-11T22:20:18.855968+0000","last_became_peered":"2024-09-11T22:20:18.855968+0000","last_unstale":"2024-09-11T22:20:27.048907+0000","last_undegraded":"2024-09-11T22:20:27.048907+0000","last_fullsized":"2024-09-11T22:20:27.048907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033466+0000","last_change":"2024-09-11T22:20:24.075030+0000","last_active":"2024-09-11T22:21:01.033466+0000","last_peered":"2024-09-11T22:21:01.033466+0000","last_clean":"2024-09-11T22:21:01.033466+0000","last_became_active":"2024-09-11T22:20:24.074588+0000","last_became_peered":"2024-09-11T22:20:24.074588+0000","last_unstale":"2024-09-11T22:21:01.033466+0000","last_undegraded":"2024-09-11T22:21:01.033466+0000","last_fullsized":"2024-09-11T22:21:01.033466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890676+0000","last_change":"2024-09-11T22:20:19.859010+0000","last_active":"2024-09-11T22:20:24.890676+0000","last_peered":"2024-09-11T22:20:24.890676+0000","last_clean":"2024-09-11T22:20:24.890676+0000","last_became_active":"2024-09-11T22:20:19.858585+0000","last_became_peered":"2024-09-11T22:20:19.858585+0000","last_unstale":"2024-09-11T22:20:24.890676+0000","last_undegraded":"2024-09-11T22:20:24.890676+0000","last_fullsized":"2024-09-11T22:20:24.890676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998168+0000","last_change":"2024-09-11T22:20:18.847904+0000","last_active":"2024-09-11T22:20:24.998168+0000","last_peered":"2024-09-11T22:20:24.998168+0000","last_clean":"2024-09-11T22:20:24.998168+0000","last_became_active":"2024-09-11T22:20:18.847669+0000","last_became_peered":"2024-09-11T22:20:18.847669+0000","last_unstale":"2024-09-11T22:20:24.998168+0000","last_undegraded":"2024-09-11T22:20:24.998168+0000","last_fullsized":"2024-09-11T22:20:24.998168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:08.717999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997794+0000","last_change":"2024-09-11T22:20:23.881067+0000","last_active":"2024-09-11T22:20:24.997794+0000","last_peered":"2024-09-11T22:20:24.997794+0000","last_clean":"2024-09-11T22:20:24.997794+0000","last_became_active":"2024-09-11T22:20:23.880468+0000","last_became_peered":"2024-09-11T22:20:23.880468+0000","last_unstale":"2024-09-11T22:20:24.997794+0000","last_undegraded":"2024-09-11T22:20:24.997794+0000","last_fullsized":"2024-09-11T22:20:24.997794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:23.480547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048637+0000","last_change":"2024-09-11T22:20:19.860423+0000","last_active":"2024-09-11T22:20:27.048637+0000","last_peered":"2024-09-11T22:20:27.048637+0000","last_clean":"2024-09-11T22:20:27.048637+0000","last_became_active":"2024-09-11T22:20:19.858932+0000","last_became_peered":"2024-09-11T22:20:19.858932+0000","last_unstale":"2024-09-11T22:20:27.048637+0000","last_undegraded":"2024-09-11T22:20:27.048637+0000","last_fullsized":"2024-09-11T22:20:27.048637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:53.255932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890029+0000","last_change":"2024-09-11T22:20:18.854973+0000","last_active":"2024-09-11T22:20:24.890029+0000","last_peered":"2024-09-11T22:20:24.890029+0000","last_clean":"2024-09-11T22:20:24.890029+0000","last_became_active":"2024-09-11T22:20:18.854725+0000","last_became_peered":"2024-09-11T22:20:18.854725+0000","last_unstale":"2024-09-11T22:20:24.890029+0000","last_undegraded":"2024-09-11T22:20:24.890029+0000","last_fullsized":"2024-09-11T22:20:24.890029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998393+0000","last_change":"2024-09-11T22:20:23.880693+0000","last_active":"2024-09-11T22:20:24.998393+0000","last_peered":"2024-09-11T22:20:24.998393+0000","last_clean":"2024-09-11T22:20:24.998393+0000","last_became_active":"2024-09-11T22:20:23.880243+0000","last_became_peered":"2024-09-11T22:20:23.880243+0000","last_unstale":"2024-09-11T22:20:24.998393+0000","last_undegraded":"2024-09-11T22:20:24.998393+0000","last_fullsized":"2024-09-11T22:20:24.998393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.659287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997954+0000","last_change":"2024-09-11T22:20:19.844808+0000","last_active":"2024-09-11T22:20:24.997954+0000","last_peered":"2024-09-11T22:20:24.997954+0000","last_clean":"2024-09-11T22:20:24.997954+0000","last_became_active":"2024-09-11T22:20:19.844536+0000","last_became_peered":"2024-09-11T22:20:19.844536+0000","last_unstale":"2024-09-11T22:20:24.997954+0000","last_undegraded":"2024-09-11T22:20:24.997954+0000","last_fullsized":"2024-09-11T22:20:24.997954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:57.142383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025228+0000","last_change":"2024-09-11T22:20:18.855640+0000","last_active":"2024-09-11T22:21:01.025228+0000","last_peered":"2024-09-11T22:21:01.025228+0000","last_clean":"2024-09-11T22:21:01.025228+0000","last_became_active":"2024-09-11T22:20:18.855394+0000","last_became_peered":"2024-09-11T22:20:18.855394+0000","last_unstale":"2024-09-11T22:21:01.025228+0000","last_undegraded":"2024-09-11T22:21:01.025228+0000","last_fullsized":"2024-09-11T22:21:01.025228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998458+0000","last_change":"2024-09-11T22:20:23.882554+0000","last_active":"2024-09-11T22:20:24.998458+0000","last_peered":"2024-09-11T22:20:24.998458+0000","last_clean":"2024-09-11T22:20:24.998458+0000","last_became_active":"2024-09-11T22:20:23.881642+0000","last_became_peered":"2024-09-11T22:20:23.881642+0000","last_unstale":"2024-09-11T22:20:24.998458+0000","last_undegraded":"2024-09-11T22:20:24.998458+0000","last_fullsized":"2024-09-11T22:20:24.998458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:16.696043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033143+0000","last_change":"2024-09-11T22:20:19.859429+0000","last_active":"2024-09-11T22:21:01.033143+0000","last_peered":"2024-09-11T22:21:01.033143+0000","last_clean":"2024-09-11T22:21:01.033143+0000","last_became_active":"2024-09-11T22:20:19.859159+0000","last_became_peered":"2024-09-11T22:20:19.859159+0000","last_unstale":"2024-09-11T22:21:01.033143+0000","last_undegraded":"2024-09-11T22:21:01.033143+0000","last_fullsized":"2024-09-11T22:21:01.033143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:02.696450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.967996+0000","last_change":"2024-09-11T22:20:18.856144+0000","last_active":"2024-09-11T22:20:52.967996+0000","last_peered":"2024-09-11T22:20:52.967996+0000","last_clean":"2024-09-11T22:20:52.967996+0000","last_became_active":"2024-09-11T22:20:18.855866+0000","last_became_peered":"2024-09-11T22:20:18.855866+0000","last_unstale":"2024-09-11T22:20:52.967996+0000","last_undegraded":"2024-09-11T22:20:52.967996+0000","last_fullsized":"2024-09-11T22:20:52.967996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:37.259393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033635+0000","last_change":"2024-09-11T22:20:24.075154+0000","last_active":"2024-09-11T22:21:01.033635+0000","last_peered":"2024-09-11T22:21:01.033635+0000","last_clean":"2024-09-11T22:21:01.033635+0000","last_became_active":"2024-09-11T22:20:24.074568+0000","last_became_peered":"2024-09-11T22:20:24.074568+0000","last_unstale":"2024-09-11T22:21:01.033635+0000","last_undegraded":"2024-09-11T22:21:01.033635+0000","last_fullsized":"2024-09-11T22:21:01.033635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:09.804991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887321+0000","last_change":"2024-09-11T22:20:19.861236+0000","last_active":"2024-09-11T22:20:24.887321+0000","last_peered":"2024-09-11T22:20:24.887321+0000","last_clean":"2024-09-11T22:20:24.887321+0000","last_became_active":"2024-09-11T22:20:19.860938+0000","last_became_peered":"2024-09-11T22:20:19.860938+0000","last_unstale":"2024-09-11T22:20:24.887321+0000","last_undegraded":"2024-09-11T22:20:24.887321+0000","last_fullsized":"2024-09-11T22:20:24.887321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:42.015334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.946546+0000","last_change":"2024-09-11T22:20:18.853467+0000","last_active":"2024-09-11T22:20:46.946546+0000","last_peered":"2024-09-11T22:20:46.946546+0000","last_clean":"2024-09-11T22:20:46.946546+0000","last_became_active":"2024-09-11T22:20:18.853182+0000","last_became_peered":"2024-09-11T22:20:18.853182+0000","last_unstale":"2024-09-11T22:20:46.946546+0000","last_undegraded":"2024-09-11T22:20:46.946546+0000","last_fullsized":"2024-09-11T22:20:46.946546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047625+0000","last_change":"2024-09-11T22:20:09.425648+0000","last_active":"2024-09-11T22:20:27.047625+0000","last_peered":"2024-09-11T22:20:27.047625+0000","last_clean":"2024-09-11T22:20:27.047625+0000","last_became_active":"2024-09-11T22:20:09.424591+0000","last_became_peered":"2024-09-11T22:20:09.424591+0000","last_unstale":"2024-09-11T22:20:27.047625+0000","last_undegraded":"2024-09-11T22:20:27.047625+0000","last_fullsized":"2024-09-11T22:20:27.047625+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_clean_scrub_stamp":"2024-09-11T22:20:08.334092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:53.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888536+0000","last_change":"2024-09-11T22:20:24.077007+0000","last_active":"2024-09-11T22:20:24.888536+0000","last_peered":"2024-09-11T22:20:24.888536+0000","last_clean":"2024-09-11T22:20:24.888536+0000","last_became_active":"2024-09-11T22:20:24.076601+0000","last_became_peered":"2024-09-11T22:20:24.076601+0000","last_unstale":"2024-09-11T22:20:24.888536+0000","last_undegraded":"2024-09-11T22:20:24.888536+0000","last_fullsized":"2024-09-11T22:20:24.888536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048600+0000","last_change":"2024-09-11T22:20:19.863279+0000","last_active":"2024-09-11T22:20:27.048600+0000","last_peered":"2024-09-11T22:20:27.048600+0000","last_clean":"2024-09-11T22:20:27.048600+0000","last_became_active":"2024-09-11T22:20:19.861322+0000","last_became_peered":"2024-09-11T22:20:19.861322+0000","last_unstale":"2024-09-11T22:20:27.048600+0000","last_undegraded":"2024-09-11T22:20:27.048600+0000","last_fullsized":"2024-09-11T22:20:27.048600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025479+0000","last_change":"2024-09-11T22:20:18.853343+0000","last_active":"2024-09-11T22:21:01.025479+0000","last_peered":"2024-09-11T22:21:01.025479+0000","last_clean":"2024-09-11T22:21:01.025479+0000","last_became_active":"2024-09-11T22:20:18.853069+0000","last_became_peered":"2024-09-11T22:20:18.853069+0000","last_unstale":"2024-09-11T22:21:01.025479+0000","last_undegraded":"2024-09-11T22:21:01.025479+0000","last_fullsized":"2024-09-11T22:21:01.025479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888655+0000","last_change":"2024-09-11T22:20:24.075350+0000","last_active":"2024-09-11T22:20:24.888655+0000","last_peered":"2024-09-11T22:20:24.888655+0000","last_clean":"2024-09-11T22:20:24.888655+0000","last_became_active":"2024-09-11T22:20:24.074789+0000","last_became_peered":"2024-09-11T22:20:24.074789+0000","last_unstale":"2024-09-11T22:20:24.888655+0000","last_undegraded":"2024-09-11T22:20:24.888655+0000","last_fullsized":"2024-09-11T22:20:24.888655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890400+0000","last_change":"2024-09-11T22:20:19.866331+0000","last_active":"2024-09-11T22:20:24.890400+0000","last_peered":"2024-09-11T22:20:24.890400+0000","last_clean":"2024-09-11T22:20:24.890400+0000","last_became_active":"2024-09-11T22:20:19.865535+0000","last_became_peered":"2024-09-11T22:20:19.865535+0000","last_unstale":"2024-09-11T22:20:24.890400+0000","last_undegraded":"2024-09-11T22:20:24.890400+0000","last_fullsized":"2024-09-11T22:20:24.890400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998164+0000","last_change":"2024-09-11T22:20:18.849434+0000","last_active":"2024-09-11T22:20:24.998164+0000","last_peered":"2024-09-11T22:20:24.998164+0000","last_clean":"2024-09-11T22:20:24.998164+0000","last_became_active":"2024-09-11T22:20:18.848787+0000","last_became_peered":"2024-09-11T22:20:18.848787+0000","last_unstale":"2024-09-11T22:20:24.998164+0000","last_undegraded":"2024-09-11T22:20:24.998164+0000","last_fullsized":"2024-09-11T22:20:24.998164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:25.689495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033577+0000","last_change":"2024-09-11T22:20:23.879962+0000","last_active":"2024-09-11T22:21:01.033577+0000","last_peered":"2024-09-11T22:21:01.033577+0000","last_clean":"2024-09-11T22:21:01.033577+0000","last_became_active":"2024-09-11T22:20:23.879586+0000","last_became_peered":"2024-09-11T22:20:23.879586+0000","last_unstale":"2024-09-11T22:21:01.033577+0000","last_undegraded":"2024-09-11T22:21:01.033577+0000","last_fullsized":"2024-09-11T22:21:01.033577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:27.323116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.049164+0000","last_change":"2024-09-11T22:20:19.860411+0000","last_active":"2024-09-11T22:20:27.049164+0000","last_peered":"2024-09-11T22:20:27.049164+0000","last_clean":"2024-09-11T22:20:27.049164+0000","last_became_active":"2024-09-11T22:20:19.860076+0000","last_became_peered":"2024-09-11T22:20:19.860076+0000","last_unstale":"2024-09-11T22:20:27.049164+0000","last_undegraded":"2024-09-11T22:20:27.049164+0000","last_fullsized":"2024-09-11T22:20:27.049164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025282+0000","last_change":"2024-09-11T22:20:18.856020+0000","last_active":"2024-09-11T22:21:01.025282+0000","last_peered":"2024-09-11T22:21:01.025282+0000","last_clean":"2024-09-11T22:21:01.025282+0000","last_became_active":"2024-09-11T22:20:18.855753+0000","last_became_peered":"2024-09-11T22:20:18.855753+0000","last_unstale":"2024-09-11T22:21:01.025282+0000","last_undegraded":"2024-09-11T22:21:01.025282+0000","last_fullsized":"2024-09-11T22:21:01.025282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888726+0000","last_change":"2024-09-11T22:20:24.077975+0000","last_active":"2024-09-11T22:20:24.888726+0000","last_peered":"2024-09-11T22:20:24.888726+0000","last_clean":"2024-09-11T22:20:24.888726+0000","last_became_active":"2024-09-11T22:20:24.077502+0000","last_became_peered":"2024-09-11T22:20:24.077502+0000","last_unstale":"2024-09-11T22:20:24.888726+0000","last_undegraded":"2024-09-11T22:20:24.888726+0000","last_fullsized":"2024-09-11T22:20:24.888726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:16.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047781+0000","last_change":"2024-09-11T22:20:19.856986+0000","last_active":"2024-09-11T22:20:27.047781+0000","last_peered":"2024-09-11T22:20:27.047781+0000","last_clean":"2024-09-11T22:20:27.047781+0000","last_became_active":"2024-09-11T22:20:19.856739+0000","last_became_peered":"2024-09-11T22:20:19.856739+0000","last_unstale":"2024-09-11T22:20:27.047781+0000","last_undegraded":"2024-09-11T22:20:27.047781+0000","last_fullsized":"2024-09-11T22:20:27.047781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048583+0000","last_change":"2024-09-11T22:20:18.855044+0000","last_active":"2024-09-11T22:20:27.048583+0000","last_peered":"2024-09-11T22:20:27.048583+0000","last_clean":"2024-09-11T22:20:27.048583+0000","last_became_active":"2024-09-11T22:20:18.854764+0000","last_became_peered":"2024-09-11T22:20:18.854764+0000","last_unstale":"2024-09-11T22:20:27.048583+0000","last_undegraded":"2024-09-11T22:20:27.048583+0000","last_fullsized":"2024-09-11T22:20:27.048583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:22.207278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047516+0000","last_change":"2024-09-11T22:20:23.878383+0000","last_active":"2024-09-11T22:20:27.047516+0000","last_peered":"2024-09-11T22:20:27.047516+0000","last_clean":"2024-09-11T22:20:27.047516+0000","last_became_active":"2024-09-11T22:20:23.877890+0000","last_became_peered":"2024-09-11T22:20:23.877890+0000","last_unstale":"2024-09-11T22:20:27.047516+0000","last_undegraded":"2024-09-11T22:20:27.047516+0000","last_fullsized":"2024-09-11T22:20:27.047516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:18.876485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048434+0000","last_change":"2024-09-11T22:20:19.861242+0000","last_active":"2024-09-11T22:20:27.048434+0000","last_peered":"2024-09-11T22:20:27.048434+0000","last_clean":"2024-09-11T22:20:27.048434+0000","last_became_active":"2024-09-11T22:20:19.860988+0000","last_became_peered":"2024-09-11T22:20:19.860988+0000","last_unstale":"2024-09-11T22:20:27.048434+0000","last_undegraded":"2024-09-11T22:20:27.048434+0000","last_fullsized":"2024-09-11T22:20:27.048434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.024956+0000","last_change":"2024-09-11T22:20:18.852459+0000","last_active":"2024-09-11T22:21:01.024956+0000","last_peered":"2024-09-11T22:21:01.024956+0000","last_clean":"2024-09-11T22:21:01.024956+0000","last_became_active":"2024-09-11T22:20:18.852153+0000","last_became_peered":"2024-09-11T22:20:18.852153+0000","last_unstale":"2024-09-11T22:21:01.024956+0000","last_undegraded":"2024-09-11T22:21:01.024956+0000","last_fullsized":"2024-09-11T22:21:01.024956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033546+0000","last_change":"2024-09-11T22:20:23.874062+0000","last_active":"2024-09-11T22:21:01.033546+0000","last_peered":"2024-09-11T22:21:01.033546+0000","last_clean":"2024-09-11T22:21:01.033546+0000","last_became_active":"2024-09-11T22:20:23.873635+0000","last_became_peered":"2024-09-11T22:20:23.873635+0000","last_unstale":"2024-09-11T22:21:01.033546+0000","last_undegraded":"2024-09-11T22:21:01.033546+0000","last_fullsized":"2024-09-11T22:21:01.033546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:40.914142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888125+0000","last_change":"2024-09-11T22:20:19.851577+0000","last_active":"2024-09-11T22:20:24.888125+0000","last_peered":"2024-09-11T22:20:24.888125+0000","last_clean":"2024-09-11T22:20:24.888125+0000","last_became_active":"2024-09-11T22:20:19.851286+0000","last_became_peered":"2024-09-11T22:20:19.851286+0000","last_unstale":"2024-09-11T22:20:24.888125+0000","last_undegraded":"2024-09-11T22:20:24.888125+0000","last_fullsized":"2024-09-11T22:20:24.888125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:32.025931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.968016+0000","last_change":"2024-09-11T22:20:18.853301+0000","last_active":"2024-09-11T22:20:52.968016+0000","last_peered":"2024-09-11T22:20:52.968016+0000","last_clean":"2024-09-11T22:20:52.968016+0000","last_became_active":"2024-09-11T22:20:18.852978+0000","last_became_peered":"2024-09-11T22:20:18.852978+0000","last_unstale":"2024-09-11T22:20:52.968016+0000","last_undegraded":"2024-09-11T22:20:52.968016+0000","last_fullsized":"2024-09-11T22:20:52.968016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888069+0000","last_change":"2024-09-11T22:20:24.077636+0000","last_active":"2024-09-11T22:20:24.888069+0000","last_peered":"2024-09-11T22:20:24.888069+0000","last_clean":"2024-09-11T22:20:24.888069+0000","last_became_active":"2024-09-11T22:20:24.077313+0000","last_became_peered":"2024-09-11T22:20:24.077313+0000","last_unstale":"2024-09-11T22:20:24.888069+0000","last_undegraded":"2024-09-11T22:20:24.888069+0000","last_fullsized":"2024-09-11T22:20:24.888069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:23.154027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048723+0000","last_change":"2024-09-11T22:20:19.862562+0000","last_active":"2024-09-11T22:20:27.048723+0000","last_peered":"2024-09-11T22:20:27.048723+0000","last_clean":"2024-09-11T22:20:27.048723+0000","last_became_active":"2024-09-11T22:20:19.862267+0000","last_became_peered":"2024-09-11T22:20:19.862267+0000","last_unstale":"2024-09-11T22:20:27.048723+0000","last_undegraded":"2024-09-11T22:20:27.048723+0000","last_fullsized":"2024-09-11T22:20:27.048723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.948867+0000","last_change":"2024-09-11T22:20:18.858002+0000","last_active":"2024-09-11T22:20:46.948867+0000","last_peered":"2024-09-11T22:20:46.948867+0000","last_clean":"2024-09-11T22:20:46.948867+0000","last_became_active":"2024-09-11T22:20:18.857419+0000","last_became_peered":"2024-09-11T22:20:18.857419+0000","last_unstale":"2024-09-11T22:20:46.948867+0000","last_undegraded":"2024-09-11T22:20:46.948867+0000","last_fullsized":"2024-09-11T22:20:46.948867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887723+0000","last_change":"2024-09-11T22:20:24.074971+0000","last_active":"2024-09-11T22:20:24.887723+0000","last_peered":"2024-09-11T22:20:24.887723+0000","last_clean":"2024-09-11T22:20:24.887723+0000","last_became_active":"2024-09-11T22:20:24.074609+0000","last_became_peered":"2024-09-11T22:20:24.074609+0000","last_unstale":"2024-09-11T22:20:24.887723+0000","last_undegraded":"2024-09-11T22:20:24.887723+0000","last_fullsized":"2024-09-11T22:20:24.887723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:55.318904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033588+0000","last_change":"2024-09-11T22:20:19.857276+0000","last_active":"2024-09-11T22:21:01.033588+0000","last_peered":"2024-09-11T22:21:01.033588+0000","last_clean":"2024-09-11T22:21:01.033588+0000","last_became_active":"2024-09-11T22:20:19.857027+0000","last_became_peered":"2024-09-11T22:20:19.857027+0000","last_unstale":"2024-09-11T22:21:01.033588+0000","last_undegraded":"2024-09-11T22:21:01.033588+0000","last_fullsized":"2024-09-11T22:21:01.033588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033832+0000","last_change":"2024-09-11T22:20:18.848671+0000","last_active":"2024-09-11T22:21:01.033832+0000","last_peered":"2024-09-11T22:21:01.033832+0000","last_clean":"2024-09-11T22:21:01.033832+0000","last_became_active":"2024-09-11T22:20:18.848405+0000","last_became_peered":"2024-09-11T22:20:18.848405+0000","last_unstale":"2024-09-11T22:21:01.033832+0000","last_undegraded":"2024-09-11T22:21:01.033832+0000","last_fullsized":"2024-09-11T22:21:01.033832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890660+0000","last_change":"2024-09-11T22:20:24.076835+0000","last_active":"2024-09-11T22:20:24.890660+0000","last_peered":"2024-09-11T22:20:24.890660+0000","last_clean":"2024-09-11T22:20:24.890660+0000","last_became_active":"2024-09-11T22:20:24.076200+0000","last_became_peered":"2024-09-11T22:20:24.076200+0000","last_unstale":"2024-09-11T22:20:24.890660+0000","last_undegraded":"2024-09-11T22:20:24.890660+0000","last_fullsized":"2024-09-11T22:20:24.890660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:48.150778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048503+0000","last_change":"2024-09-11T22:20:19.855334+0000","last_active":"2024-09-11T22:20:27.048503+0000","last_peered":"2024-09-11T22:20:27.048503+0000","last_clean":"2024-09-11T22:20:27.048503+0000","last_became_active":"2024-09-11T22:20:19.855018+0000","last_became_peered":"2024-09-11T22:20:19.855018+0000","last_unstale":"2024-09-11T22:20:27.048503+0000","last_undegraded":"2024-09-11T22:20:27.048503+0000","last_fullsized":"2024-09-11T22:20:27.048503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'11","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.946283+0000","last_change":"2024-09-11T22:20:18.855665+0000","last_active":"2024-09-11T22:20:46.946283+0000","last_peered":"2024-09-11T22:20:46.946283+0000","last_clean":"2024-09-11T22:20:46.946283+0000","last_became_active":"2024-09-11T22:20:18.855386+0000","last_became_peered":"2024-09-11T22:20:18.855386+0000","last_unstale":"2024-09-11T22:20:46.946283+0000","last_undegraded":"2024-09-11T22:20:46.946283+0000","last_fullsized":"2024-09-11T22:20:46.946283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998100+0000","last_change":"2024-09-11T22:20:23.880793+0000","last_active":"2024-09-11T22:20:24.998100+0000","last_peered":"2024-09-11T22:20:24.998100+0000","last_clean":"2024-09-11T22:20:24.998100+0000","last_became_active":"2024-09-11T22:20:23.879993+0000","last_became_peered":"2024-09-11T22:20:23.879993+0000","last_unstale":"2024-09-11T22:20:24.998100+0000","last_undegraded":"2024-09-11T22:20:24.998100+0000","last_fullsized":"2024-09-11T22:20:24.998100+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:50.449090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048075+0000","last_change":"2024-09-11T22:20:19.858588+0000","last_active":"2024-09-11T22:20:27.048075+0000","last_peered":"2024-09-11T22:20:27.048075+0000","last_clean":"2024-09-11T22:20:27.048075+0000","last_became_active":"2024-09-11T22:20:19.858322+0000","last_became_peered":"2024-09-11T22:20:19.858322+0000","last_unstale":"2024-09-11T22:20:27.048075+0000","last_undegraded":"2024-09-11T22:20:27.048075+0000","last_fullsized":"2024-09-11T22:20:27.048075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998118+0000","last_change":"2024-09-11T22:20:18.855056+0000","last_active":"2024-09-11T22:20:24.998118+0000","last_peered":"2024-09-11T22:20:24.998118+0000","last_clean":"2024-09-11T22:20:24.998118+0000","last_became_active":"2024-09-11T22:20:18.854784+0000","last_became_peered":"2024-09-11T22:20:18.854784+0000","last_unstale":"2024-09-11T22:20:24.998118+0000","last_undegraded":"2024-09-11T22:20:24.998118+0000","last_fullsized":"2024-09-11T22:20:24.998118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:38.916121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048044+0000","last_change":"2024-09-11T22:20:23.879768+0000","last_active":"2024-09-11T22:20:27.048044+0000","last_peered":"2024-09-11T22:20:27.048044+0000","last_clean":"2024-09-11T22:20:27.048044+0000","last_became_active":"2024-09-11T22:20:23.878794+0000","last_became_peered":"2024-09-11T22:20:23.878794+0000","last_unstale":"2024-09-11T22:20:27.048044+0000","last_undegraded":"2024-09-11T22:20:27.048044+0000","last_fullsized":"2024-09-11T22:20:27.048044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:07.301587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-11T22:20:27.048280+0000","last_change":"2024-09-11T22:21:01.034302+0000","last_active":"2024-09-11T22:21:01.034302+0000","last_peered":"2024-09-11T22:20:27.048280+0000","last_clean":"2024-09-11T22:20:27.048280+0000","last_became_active":"2024-09-11T22:20:19.861607+0000","last_became_peered":"2024-09-11T22:20:19.861607+0000","last_unstale":"2024-09-11T22:20:27.048280+0000","last_undegraded":"2024-09-11T22:20:27.048280+0000","last_fullsized":"2024-09-11T22:20:27.048280+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.946689+0000","last_change":"2024-09-11T22:20:18.853382+0000","last_active":"2024-09-11T22:20:46.946689+0000","last_peered":"2024-09-11T22:20:46.946689+0000","last_clean":"2024-09-11T22:20:46.946689+0000","last_became_active":"2024-09-11T22:20:18.853103+0000","last_became_peered":"2024-09-11T22:20:18.853103+0000","last_unstale":"2024-09-11T22:20:46.946689+0000","last_undegraded":"2024-09-11T22:20:46.946689+0000","last_fullsized":"2024-09-11T22:20:46.946689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887490+0000","last_change":"2024-09-11T22:20:23.876997+0000","last_active":"2024-09-11T22:20:24.887490+0000","last_peered":"2024-09-11T22:20:24.887490+0000","last_clean":"2024-09-11T22:20:24.887490+0000","last_became_active":"2024-09-11T22:20:23.876587+0000","last_became_peered":"2024-09-11T22:20:23.876587+0000","last_unstale":"2024-09-11T22:20:24.887490+0000","last_undegraded":"2024-09-11T22:20:24.887490+0000","last_fullsized":"2024-09-11T22:20:24.887490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:19.670665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889342+0000","last_change":"2024-09-11T22:20:19.866624+0000","last_active":"2024-09-11T22:20:24.889342+0000","last_peered":"2024-09-11T22:20:24.889342+0000","last_clean":"2024-09-11T22:20:24.889342+0000","last_became_active":"2024-09-11T22:20:19.866303+0000","last_became_peered":"2024-09-11T22:20:19.866303+0000","last_unstale":"2024-09-11T22:20:24.889342+0000","last_undegraded":"2024-09-11T22:20:24.889342+0000","last_fullsized":"2024-09-11T22:20:24.889342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.946175+0000","last_change":"2024-09-11T22:20:18.854361+0000","last_active":"2024-09-11T22:20:46.946175+0000","last_peered":"2024-09-11T22:20:46.946175+0000","last_clean":"2024-09-11T22:20:46.946175+0000","last_became_active":"2024-09-11T22:20:18.854019+0000","last_became_peered":"2024-09-11T22:20:18.854019+0000","last_unstale":"2024-09-11T22:20:46.946175+0000","last_undegraded":"2024-09-11T22:20:46.946175+0000","last_fullsized":"2024-09-11T22:20:46.946175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887284+0000","last_change":"2024-09-11T22:20:24.077476+0000","last_active":"2024-09-11T22:20:24.887284+0000","last_peered":"2024-09-11T22:20:24.887284+0000","last_clean":"2024-09-11T22:20:24.887284+0000","last_became_active":"2024-09-11T22:20:24.077134+0000","last_became_peered":"2024-09-11T22:20:24.077134+0000","last_unstale":"2024-09-11T22:20:24.887284+0000","last_undegraded":"2024-09-11T22:20:24.887284+0000","last_fullsized":"2024-09-11T22:20:24.887284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:03.186460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-11T22:20:27.048088+0000","last_change":"2024-09-11T22:21:01.033206+0000","last_active":"2024-09-11T22:21:01.033206+0000","last_peered":"2024-09-11T22:20:27.048088+0000","last_clean":"2024-09-11T22:20:27.048088+0000","last_became_active":"2024-09-11T22:20:24.076592+0000","last_became_peered":"2024-09-11T22:20:24.076592+0000","last_unstale":"2024-09-11T22:20:27.048088+0000","last_undegraded":"2024-09-11T22:20:27.048088+0000","last_fullsized":"2024-09-11T22:20:27.048088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2,3,7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997676+0000","last_change":"2024-09-11T22:20:19.845776+0000","last_active":"2024-09-11T22:20:24.997676+0000","last_peered":"2024-09-11T22:20:24.997676+0000","last_clean":"2024-09-11T22:20:24.997676+0000","last_became_active":"2024-09-11T22:20:19.845425+0000","last_became_peered":"2024-09-11T22:20:19.845425+0000","last_unstale":"2024-09-11T22:20:24.997676+0000","last_undegraded":"2024-09-11T22:20:24.997676+0000","last_fullsized":"2024-09-11T22:20:24.997676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:07.187533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889087+0000","last_change":"2024-09-11T22:20:18.852446+0000","last_active":"2024-09-11T22:20:24.889087+0000","last_peered":"2024-09-11T22:20:24.889087+0000","last_clean":"2024-09-11T22:20:24.889087+0000","last_became_active":"2024-09-11T22:20:18.852155+0000","last_became_peered":"2024-09-11T22:20:18.852155+0000","last_unstale":"2024-09-11T22:20:24.889087+0000","last_undegraded":"2024-09-11T22:20:24.889087+0000","last_fullsized":"2024-09-11T22:20:24.889087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889233+0000","last_change":"2024-09-11T22:20:23.876503+0000","last_active":"2024-09-11T22:20:24.889233+0000","last_peered":"2024-09-11T22:20:24.889233+0000","last_clean":"2024-09-11T22:20:24.889233+0000","last_became_active":"2024-09-11T22:20:23.876100+0000","last_became_peered":"2024-09-11T22:20:23.876100+0000","last_unstale":"2024-09-11T22:20:24.889233+0000","last_undegraded":"2024-09-11T22:20:24.889233+0000","last_fullsized":"2024-09-11T22:20:24.889233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887311+0000","last_change":"2024-09-11T22:20:19.852606+0000","last_active":"2024-09-11T22:20:24.887311+0000","last_peered":"2024-09-11T22:20:24.887311+0000","last_clean":"2024-09-11T22:20:24.887311+0000","last_became_active":"2024-09-11T22:20:19.852333+0000","last_became_peered":"2024-09-11T22:20:19.852333+0000","last_unstale":"2024-09-11T22:20:24.887311+0000","last_undegraded":"2024-09-11T22:20:24.887311+0000","last_fullsized":"2024-09-11T22:20:24.887311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:56.940278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.965701+0000","last_change":"2024-09-11T22:20:18.853767+0000","last_active":"2024-09-11T22:20:52.965701+0000","last_peered":"2024-09-11T22:20:52.965701+0000","last_clean":"2024-09-11T22:20:52.965701+0000","last_became_active":"2024-09-11T22:20:18.853533+0000","last_became_peered":"2024-09-11T22:20:18.853533+0000","last_unstale":"2024-09-11T22:20:52.965701+0000","last_undegraded":"2024-09-11T22:20:52.965701+0000","last_fullsized":"2024-09-11T22:20:52.965701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:36.662271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:52.967351+0000","last_change":"2024-09-11T22:20:18.847133+0000","last_active":"2024-09-11T22:20:52.967351+0000","last_peered":"2024-09-11T22:20:52.967351+0000","last_clean":"2024-09-11T22:20:52.967351+0000","last_became_active":"2024-09-11T22:20:18.846321+0000","last_became_peered":"2024-09-11T22:20:18.846321+0000","last_unstale":"2024-09-11T22:20:52.967351+0000","last_undegraded":"2024-09-11T22:20:52.967351+0000","last_fullsized":"2024-09-11T22:20:52.967351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033751+0000","last_change":"2024-09-11T22:20:19.861445+0000","last_active":"2024-09-11T22:21:01.033751+0000","last_peered":"2024-09-11T22:21:01.033751+0000","last_clean":"2024-09-11T22:21:01.033751+0000","last_became_active":"2024-09-11T22:20:19.861154+0000","last_became_peered":"2024-09-11T22:20:19.861154+0000","last_unstale":"2024-09-11T22:21:01.033751+0000","last_undegraded":"2024-09-11T22:21:01.033751+0000","last_fullsized":"2024-09-11T22:21:01.033751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025275+0000","last_change":"2024-09-11T22:20:23.877973+0000","last_active":"2024-09-11T22:21:01.025275+0000","last_peered":"2024-09-11T22:21:01.025275+0000","last_clean":"2024-09-11T22:21:01.025275+0000","last_became_active":"2024-09-11T22:20:23.877578+0000","last_became_peered":"2024-09-11T22:20:23.877578+0000","last_unstale":"2024-09-11T22:21:01.025275+0000","last_undegraded":"2024-09-11T22:21:01.025275+0000","last_fullsized":"2024-09-11T22:21:01.025275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:27.826669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:46.948565+0000","last_change":"2024-09-11T22:20:18.854142+0000","last_active":"2024-09-11T22:20:46.948565+0000","last_peered":"2024-09-11T22:20:46.948565+0000","last_clean":"2024-09-11T22:20:46.948565+0000","last_became_active":"2024-09-11T22:20:18.853872+0000","last_became_peered":"2024-09-11T22:20:18.853872+0000","last_unstale":"2024-09-11T22:20:46.948565+0000","last_undegraded":"2024-09-11T22:20:46.948565+0000","last_fullsized":"2024-09-11T22:20:46.948565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:22.513242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.047903+0000","last_change":"2024-09-11T22:20:19.852580+0000","last_active":"2024-09-11T22:20:27.047903+0000","last_peered":"2024-09-11T22:20:27.047903+0000","last_clean":"2024-09-11T22:20:27.047903+0000","last_became_active":"2024-09-11T22:20:19.850175+0000","last_became_peered":"2024-09-11T22:20:19.850175+0000","last_unstale":"2024-09-11T22:20:27.047903+0000","last_undegraded":"2024-09-11T22:20:27.047903+0000","last_fullsized":"2024-09-11T22:20:27.047903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:11.937256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887822+0000","last_change":"2024-09-11T22:20:23.878004+0000","last_active":"2024-09-11T22:20:24.887822+0000","last_peered":"2024-09-11T22:20:24.887822+0000","last_clean":"2024-09-11T22:20:24.887822+0000","last_became_active":"2024-09-11T22:20:23.876776+0000","last_became_peered":"2024-09-11T22:20:23.876776+0000","last_unstale":"2024-09-11T22:20:24.887822+0000","last_undegraded":"2024-09-11T22:20:24.887822+0000","last_fullsized":"2024-09-11T22:20:24.887822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:11.254248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887933+0000","last_change":"2024-09-11T22:20:19.853439+0000","last_active":"2024-09-11T22:20:24.887933+0000","last_peered":"2024-09-11T22:20:24.887933+0000","last_clean":"2024-09-11T22:20:24.887933+0000","last_became_active":"2024-09-11T22:20:19.852937+0000","last_became_peered":"2024-09-11T22:20:19.852937+0000","last_unstale":"2024-09-11T22:20:24.887933+0000","last_undegraded":"2024-09-11T22:20:24.887933+0000","last_fullsized":"2024-09-11T22:20:24.887933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025127+0000","last_change":"2024-09-11T22:20:19.861003+0000","last_active":"2024-09-11T22:21:01.025127+0000","last_peered":"2024-09-11T22:21:01.025127+0000","last_clean":"2024-09-11T22:21:01.025127+0000","last_became_active":"2024-09-11T22:20:19.860690+0000","last_became_peered":"2024-09-11T22:20:19.860690+0000","last_unstale":"2024-09-11T22:21:01.025127+0000","last_undegraded":"2024-09-11T22:21:01.025127+0000","last_fullsized":"2024-09-11T22:21:01.025127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889798+0000","last_change":"2024-09-11T22:20:19.856756+0000","last_active":"2024-09-11T22:20:24.889798+0000","last_peered":"2024-09-11T22:20:24.889798+0000","last_clean":"2024-09-11T22:20:24.889798+0000","last_became_active":"2024-09-11T22:20:19.856460+0000","last_became_peered":"2024-09-11T22:20:19.856460+0000","last_unstale":"2024-09-11T22:20:24.889798+0000","last_undegraded":"2024-09-11T22:20:24.889798+0000","last_fullsized":"2024-09-11T22:20:24.889798+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033665+0000","last_change":"2024-09-11T22:20:19.855629+0000","last_active":"2024-09-11T22:21:01.033665+0000","last_peered":"2024-09-11T22:21:01.033665+0000","last_clean":"2024-09-11T22:21:01.033665+0000","last_became_active":"2024-09-11T22:20:19.855363+0000","last_became_peered":"2024-09-11T22:20:19.855363+0000","last_unstale":"2024-09-11T22:21:01.033665+0000","last_undegraded":"2024-09-11T22:21:01.033665+0000","last_fullsized":"2024-09-11T22:21:01.033665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887872+0000","last_change":"2024-09-11T22:20:19.863122+0000","last_active":"2024-09-11T22:20:24.887872+0000","last_peered":"2024-09-11T22:20:24.887872+0000","last_clean":"2024-09-11T22:20:24.887872+0000","last_became_active":"2024-09-11T22:20:19.862828+0000","last_became_peered":"2024-09-11T22:20:19.862828+0000","last_unstale":"2024-09-11T22:20:24.887872+0000","last_undegraded":"2024-09-11T22:20:24.887872+0000","last_fullsized":"2024-09-11T22:20:24.887872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:10.868762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997865+0000","last_change":"2024-09-11T22:20:19.846453+0000","last_active":"2024-09-11T22:20:24.997865+0000","last_peered":"2024-09-11T22:20:24.997865+0000","last_clean":"2024-09-11T22:20:24.997865+0000","last_became_active":"2024-09-11T22:20:19.846186+0000","last_became_peered":"2024-09-11T22:20:19.846186+0000","last_unstale":"2024-09-11T22:20:24.997865+0000","last_undegraded":"2024-09-11T22:20:24.997865+0000","last_fullsized":"2024-09-11T22:20:24.997865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:24.032365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888935+0000","last_change":"2024-09-11T22:20:19.860632+0000","last_active":"2024-09-11T22:20:24.888935+0000","last_peered":"2024-09-11T22:20:24.888935+0000","last_clean":"2024-09-11T22:20:24.888935+0000","last_became_active":"2024-09-11T22:20:19.860005+0000","last_became_peered":"2024-09-11T22:20:19.860005+0000","last_unstale":"2024-09-11T22:20:24.888935+0000","last_undegraded":"2024-09-11T22:20:24.888935+0000","last_fullsized":"2024-09-11T22:20:24.888935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888034+0000","last_change":"2024-09-11T22:20:19.859195+0000","last_active":"2024-09-11T22:20:24.888034+0000","last_peered":"2024-09-11T22:20:24.888034+0000","last_clean":"2024-09-11T22:20:24.888034+0000","last_became_active":"2024-09-11T22:20:19.858832+0000","last_became_peered":"2024-09-11T22:20:19.858832+0000","last_unstale":"2024-09-11T22:20:24.888034+0000","last_undegraded":"2024-09-11T22:20:24.888034+0000","last_fullsized":"2024-09-11T22:20:24.888034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:56.259074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888950+0000","last_change":"2024-09-11T22:20:19.858969+0000","last_active":"2024-09-11T22:20:24.888950+0000","last_peered":"2024-09-11T22:20:24.888950+0000","last_clean":"2024-09-11T22:20:24.888950+0000","last_became_active":"2024-09-11T22:20:19.857847+0000","last_became_peered":"2024-09-11T22:20:19.857847+0000","last_unstale":"2024-09-11T22:20:24.888950+0000","last_undegraded":"2024-09-11T22:20:24.888950+0000","last_fullsized":"2024-09-11T22:20:24.888950+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887453+0000","last_change":"2024-09-11T22:20:19.863294+0000","last_active":"2024-09-11T22:20:24.887453+0000","last_peered":"2024-09-11T22:20:24.887453+0000","last_clean":"2024-09-11T22:20:24.887453+0000","last_became_active":"2024-09-11T22:20:19.863007+0000","last_became_peered":"2024-09-11T22:20:19.863007+0000","last_unstale":"2024-09-11T22:20:24.887453+0000","last_undegraded":"2024-09-11T22:20:24.887453+0000","last_fullsized":"2024-09-11T22:20:24.887453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:06.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889706+0000","last_change":"2024-09-11T22:20:19.858414+0000","last_active":"2024-09-11T22:20:24.889706+0000","last_peered":"2024-09-11T22:20:24.889706+0000","last_clean":"2024-09-11T22:20:24.889706+0000","last_became_active":"2024-09-11T22:20:19.857790+0000","last_became_peered":"2024-09-11T22:20:19.857790+0000","last_unstale":"2024-09-11T22:20:24.889706+0000","last_undegraded":"2024-09-11T22:20:24.889706+0000","last_fullsized":"2024-09-11T22:20:24.889706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":2,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-11T22:20:27.047940+0000","last_change":"2024-09-11T22:21:01.323256+0000","last_active":"2024-09-11T22:21:01.323256+0000","last_peered":"2024-09-11T22:20:27.047940+0000","last_clean":"2024-09-11T22:20:27.047940+0000","last_became_active":"2024-09-11T22:20:19.854774+0000","last_became_peered":"2024-09-11T22:20:19.854774+0000","last_unstale":"2024-09-11T22:20:27.047940+0000","last_undegraded":"2024-09-11T22:20:27.047940+0000","last_fullsized":"2024-09-11T22:20:27.047940+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888845+0000","last_change":"2024-09-11T22:20:19.864700+0000","last_active":"2024-09-11T22:20:24.888845+0000","last_peered":"2024-09-11T22:20:24.888845+0000","last_clean":"2024-09-11T22:20:24.888845+0000","last_became_active":"2024-09-11T22:20:19.862296+0000","last_became_peered":"2024-09-11T22:20:19.862296+0000","last_unstale":"2024-09-11T22:20:24.888845+0000","last_undegraded":"2024-09-11T22:20:24.888845+0000","last_fullsized":"2024-09-11T22:20:24.888845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048773+0000","last_change":"2024-09-11T22:20:19.855253+0000","last_active":"2024-09-11T22:20:27.048773+0000","last_peered":"2024-09-11T22:20:27.048773+0000","last_clean":"2024-09-11T22:20:27.048773+0000","last_became_active":"2024-09-11T22:20:19.854970+0000","last_became_peered":"2024-09-11T22:20:19.854970+0000","last_unstale":"2024-09-11T22:20:27.048773+0000","last_undegraded":"2024-09-11T22:20:27.048773+0000","last_fullsized":"2024-09-11T22:20:27.048773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025225+0000","last_change":"2024-09-11T22:20:19.850202+0000","last_active":"2024-09-11T22:21:01.025225+0000","last_peered":"2024-09-11T22:21:01.025225+0000","last_clean":"2024-09-11T22:21:01.025225+0000","last_became_active":"2024-09-11T22:20:19.849815+0000","last_became_peered":"2024-09-11T22:20:19.849815+0000","last_unstale":"2024-09-11T22:21:01.025225+0000","last_undegraded":"2024-09-11T22:21:01.025225+0000","last_fullsized":"2024-09-11T22:21:01.025225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:56.480679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889814+0000","last_change":"2024-09-11T22:20:19.866864+0000","last_active":"2024-09-11T22:20:24.889814+0000","last_peered":"2024-09-11T22:20:24.889814+0000","last_clean":"2024-09-11T22:20:24.889814+0000","last_became_active":"2024-09-11T22:20:19.866484+0000","last_became_peered":"2024-09-11T22:20:19.866484+0000","last_unstale":"2024-09-11T22:20:24.889814+0000","last_undegraded":"2024-09-11T22:20:24.889814+0000","last_fullsized":"2024-09-11T22:20:24.889814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":2,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-11T22:20:19.847772+0000","last_change":"2024-09-11T22:21:01.323220+0000","last_active":"2024-09-11T22:20:18.828308+0000","last_peered":"2024-09-11T22:20:18.828308+0000","last_clean":"2024-09-11T22:20:18.828308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:19.847772+0000","last_undegraded":"2024-09-11T22:20:19.847772+0000","last_fullsized":"2024-09-11T22:20:19.847772+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.997750+0000","last_change":"2024-09-11T22:20:19.860050+0000","last_active":"2024-09-11T22:20:24.997750+0000","last_peered":"2024-09-11T22:20:24.997750+0000","last_clean":"2024-09-11T22:20:24.997750+0000","last_became_active":"2024-09-11T22:20:19.859755+0000","last_became_peered":"2024-09-11T22:20:19.859755+0000","last_unstale":"2024-09-11T22:20:24.997750+0000","last_undegraded":"2024-09-11T22:20:24.997750+0000","last_fullsized":"2024-09-11T22:20:24.997750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:42.487669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033495+0000","last_change":"2024-09-11T22:20:19.853902+0000","last_active":"2024-09-11T22:21:01.033495+0000","last_peered":"2024-09-11T22:21:01.033495+0000","last_clean":"2024-09-11T22:21:01.033495+0000","last_became_active":"2024-09-11T22:20:19.853563+0000","last_became_peered":"2024-09-11T22:20:19.853563+0000","last_unstale":"2024-09-11T22:21:01.033495+0000","last_undegraded":"2024-09-11T22:21:01.033495+0000","last_fullsized":"2024-09-11T22:21:01.033495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887571+0000","last_change":"2024-09-11T22:20:19.849490+0000","last_active":"2024-09-11T22:20:24.887571+0000","last_peered":"2024-09-11T22:20:24.887571+0000","last_clean":"2024-09-11T22:20:24.887571+0000","last_became_active":"2024-09-11T22:20:19.848965+0000","last_became_peered":"2024-09-11T22:20:19.848965+0000","last_unstale":"2024-09-11T22:20:24.887571+0000","last_undegraded":"2024-09-11T22:20:24.887571+0000","last_fullsized":"2024-09-11T22:20:24.887571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:10.387663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048041+0000","last_change":"2024-09-11T22:20:19.860457+0000","last_active":"2024-09-11T22:20:27.048041+0000","last_peered":"2024-09-11T22:20:27.048041+0000","last_clean":"2024-09-11T22:20:27.048041+0000","last_became_active":"2024-09-11T22:20:19.858887+0000","last_became_peered":"2024-09-11T22:20:19.858887+0000","last_unstale":"2024-09-11T22:20:27.048041+0000","last_undegraded":"2024-09-11T22:20:27.048041+0000","last_fullsized":"2024-09-11T22:20:27.048041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:34.620956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888481+0000","last_change":"2024-09-11T22:20:19.862347+0000","last_active":"2024-09-11T22:20:24.888481+0000","last_peered":"2024-09-11T22:20:24.888481+0000","last_clean":"2024-09-11T22:20:24.888481+0000","last_became_active":"2024-09-11T22:20:19.861965+0000","last_became_peered":"2024-09-11T22:20:19.861965+0000","last_unstale":"2024-09-11T22:20:24.888481+0000","last_undegraded":"2024-09-11T22:20:24.888481+0000","last_fullsized":"2024-09-11T22:20:24.888481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.888938+0000","last_change":"2024-09-11T22:20:19.862065+0000","last_active":"2024-09-11T22:20:24.888938+0000","last_peered":"2024-09-11T22:20:24.888938+0000","last_clean":"2024-09-11T22:20:24.888938+0000","last_became_active":"2024-09-11T22:20:19.861765+0000","last_became_peered":"2024-09-11T22:20:19.861765+0000","last_unstale":"2024-09-11T22:20:24.888938+0000","last_undegraded":"2024-09-11T22:20:24.888938+0000","last_fullsized":"2024-09-11T22:20:24.888938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.049117+0000","last_change":"2024-09-11T22:20:19.865064+0000","last_active":"2024-09-11T22:20:27.049117+0000","last_peered":"2024-09-11T22:20:27.049117+0000","last_clean":"2024-09-11T22:20:27.049117+0000","last_became_active":"2024-09-11T22:20:19.864697+0000","last_became_peered":"2024-09-11T22:20:19.864697+0000","last_unstale":"2024-09-11T22:20:27.049117+0000","last_undegraded":"2024-09-11T22:20:27.049117+0000","last_fullsized":"2024-09-11T22:20:27.049117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.887201+0000","last_change":"2024-09-11T22:20:19.861293+0000","last_active":"2024-09-11T22:20:24.887201+0000","last_peered":"2024-09-11T22:20:24.887201+0000","last_clean":"2024-09-11T22:20:24.887201+0000","last_became_active":"2024-09-11T22:20:19.861013+0000","last_became_peered":"2024-09-11T22:20:19.861013+0000","last_unstale":"2024-09-11T22:20:24.887201+0000","last_undegraded":"2024-09-11T22:20:24.887201+0000","last_fullsized":"2024-09-11T22:20:24.887201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:13.178404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048303+0000","last_change":"2024-09-11T22:20:19.858131+0000","last_active":"2024-09-11T22:20:27.048303+0000","last_peered":"2024-09-11T22:20:27.048303+0000","last_clean":"2024-09-11T22:20:27.048303+0000","last_became_active":"2024-09-11T22:20:19.857842+0000","last_became_peered":"2024-09-11T22:20:19.857842+0000","last_unstale":"2024-09-11T22:20:27.048303+0000","last_undegraded":"2024-09-11T22:20:27.048303+0000","last_fullsized":"2024-09-11T22:20:27.048303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.889602+0000","last_change":"2024-09-11T22:20:19.859667+0000","last_active":"2024-09-11T22:20:24.889602+0000","last_peered":"2024-09-11T22:20:24.889602+0000","last_clean":"2024-09-11T22:20:24.889602+0000","last_became_active":"2024-09-11T22:20:19.859306+0000","last_became_peered":"2024-09-11T22:20:19.859306+0000","last_unstale":"2024-09-11T22:20:24.889602+0000","last_undegraded":"2024-09-11T22:20:24.889602+0000","last_fullsized":"2024-09-11T22:20:24.889602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:27.048551+0000","last_change":"2024-09-11T22:20:19.848821+0000","last_active":"2024-09-11T22:20:27.048551+0000","last_peered":"2024-09-11T22:20:27.048551+0000","last_clean":"2024-09-11T22:20:27.048551+0000","last_became_active":"2024-09-11T22:20:19.848531+0000","last_became_peered":"2024-09-11T22:20:19.848531+0000","last_unstale":"2024-09-11T22:20:27.048551+0000","last_undegraded":"2024-09-11T22:20:27.048551+0000","last_fullsized":"2024-09-11T22:20:27.048551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.890212+0000","last_change":"2024-09-11T22:20:19.866300+0000","last_active":"2024-09-11T22:20:24.890212+0000","last_peered":"2024-09-11T22:20:24.890212+0000","last_clean":"2024-09-11T22:20:24.890212+0000","last_became_active":"2024-09-11T22:20:19.865939+0000","last_became_peered":"2024-09-11T22:20:19.865939+0000","last_unstale":"2024-09-11T22:20:24.890212+0000","last_undegraded":"2024-09-11T22:20:24.890212+0000","last_fullsized":"2024-09-11T22:20:24.890212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033602+0000","last_change":"2024-09-11T22:20:19.858144+0000","last_active":"2024-09-11T22:21:01.033602+0000","last_peered":"2024-09-11T22:21:01.033602+0000","last_clean":"2024-09-11T22:21:01.033602+0000","last_became_active":"2024-09-11T22:20:19.857840+0000","last_became_peered":"2024-09-11T22:20:19.857840+0000","last_unstale":"2024-09-11T22:21:01.033602+0000","last_undegraded":"2024-09-11T22:21:01.033602+0000","last_fullsized":"2024-09-11T22:21:01.033602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:23.801072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-11T22:20:24.998195+0000","last_change":"2024-09-11T22:20:19.857378+0000","last_active":"2024-09-11T22:20:24.998195+0000","last_peered":"2024-09-11T22:20:24.998195+0000","last_clean":"2024-09-11T22:20:24.998195+0000","last_became_active":"2024-09-11T22:20:19.857089+0000","last_became_peered":"2024-09-11T22:20:19.857089+0000","last_unstale":"2024-09-11T22:20:24.998195+0000","last_undegraded":"2024-09-11T22:20:24.998195+0000","last_fullsized":"2024-09-11T22:20:24.998195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:29.835695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":2,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-11T22:20:19.843776+0000","last_change":"2024-09-11T22:21:01.323294+0000","last_active":"2024-09-11T22:20:18.828308+0000","last_peered":"2024-09-11T22:20:18.828308+0000","last_clean":"2024-09-11T22:20:18.828308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:19.843776+0000","last_undegraded":"2024-09-11T22:20:19.843776+0000","last_fullsized":"2024-09-11T22:20:19.843776+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7454,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":699002,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":111840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":108696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":108032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":111874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":108136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":698346,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":108262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:21:06.562 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:21:06.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.672+0000 7f6ed674b640 1 Processor -- start 2024-09-11T22:21:06.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.673+0000 7f6ed674b640 1 -- start start 2024-09-11T22:21:06.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.673+0000 7f6ed674b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6ed00c8a70 0x7f6ed006e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:06.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.673+0000 7f6ed674b640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ed00c9a10 con 0x7f6ed01527d0 2024-09-11T22:21:06.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.673+0000 7f6ed674b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ed00c5080 con 0x7f6ed00c8250 2024-09-11T22:21:06.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.673+0000 7f6ed674b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f6ed00ca3b0 con 0x7f6ed00c8a70 2024-09-11T22:21:06.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.673+0000 7f6ecffff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6ed01527d0 0x7f6ed00c9300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59616/0 (socket says 172.21.15.100:59616) 2024-09-11T22:21:06.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.673+0000 7f6ecffff640 1 -- 172.21.15.100:0/45384307 learned_addr learned my addr 172.21.15.100:0/45384307 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:21:06.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.674+0000 7f6ecf7fe640 1 --2- 172.21.15.100:0/45384307 >> v2:172.21.15.167:3300/0 conn(0x7f6ed00c8a70 0x7f6ed006e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:06.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.674+0000 7f6eceffd640 1 -- 172.21.15.100:0/45384307 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 522712234 0 0) 0x7f6ed00c9a10 con 0x7f6ed01527d0 2024-09-11T22:21:06.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.674+0000 7f6eceffd640 1 -- 172.21.15.100:0/45384307 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6eb8003520 con 0x7f6ed01527d0 2024-09-11T22:21:06.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.674+0000 7f6eceffd640 1 -- 172.21.15.100:0/45384307 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2801260847 0 0) 0x7f6eb8003520 con 0x7f6ed01527d0 2024-09-11T22:21:06.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.674+0000 7f6eceffd640 1 -- 172.21.15.100:0/45384307 >> v2:172.21.15.167:3300/0 conn(0x7f6ed00c8a70 msgr2=0x7f6ed006e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:06.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.674+0000 7f6eceffd640 1 --2- 172.21.15.100:0/45384307 >> v2:172.21.15.167:3300/0 conn(0x7f6ed00c8a70 0x7f6ed006e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:06.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.674+0000 7f6eceffd640 1 -- 172.21.15.100:0/45384307 >> v1:172.21.15.167:6789/0 conn(0x7f6ed00c8250 legacy=0x7f6ed00cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:06.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.674+0000 7f6eceffd640 1 -- 172.21.15.100:0/45384307 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed00ca690 con 0x7f6ed01527d0 2024-09-11T22:21:06.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.674+0000 7f6eceffd640 1 -- 172.21.15.100:0/45384307 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f6ec0001670 con 0x7f6ed01527d0 2024-09-11T22:21:06.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.674+0000 7f6eceffd640 1 -- 172.21.15.100:0/45384307 >> v1:172.21.15.100:6789/0 conn(0x7f6ed01527d0 legacy=0x7f6ed00c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:06.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.674+0000 7f6eceffd640 1 --2- 172.21.15.100:0/45384307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eb80039e0 0x7f6eb8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:06.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.674+0000 7f6eceffd640 1 --2- 172.21.15.100:0/45384307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb8004800 0x7f6eb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:06.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.674+0000 7f6eceffd640 1 --2- 172.21.15.100:0/45384307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6eb80051c0 0x7f6eb800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:06.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.674+0000 7f6eceffd640 1 -- 172.21.15.100:0/45384307 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed00ca3b0 con 0x7f6eb8004800 2024-09-11T22:21:06.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.674+0000 7f6eceffd640 1 -- 172.21.15.100:0/45384307 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb800c090 con 0x7f6eb80039e0 2024-09-11T22:21:06.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.674+0000 7f6eceffd640 1 -- 172.21.15.100:0/45384307 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f6eb800c290 con 0x7f6eb80051c0 2024-09-11T22:21:06.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.674+0000 7f6ecf7fe640 1 --2- 172.21.15.100:0/45384307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb8004800 0x7f6eb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:06.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.674+0000 7f6ecffff640 1 --2- 172.21.15.100:0/45384307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eb80039e0 0x7f6eb8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:06.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.674+0000 7f6ed4ce8640 1 --2- 172.21.15.100:0/45384307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6eb80051c0 0x7f6eb800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:06.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.674+0000 7f6ecf7fe640 1 -- 172.21.15.100:0/45384307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6eb80051c0 msgr2=0x7f6eb800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:06.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.674+0000 7f6ecf7fe640 1 --2- 172.21.15.100:0/45384307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6eb80051c0 0x7f6eb800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:06.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.674+0000 7f6ecf7fe640 1 -- 172.21.15.100:0/45384307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eb80039e0 msgr2=0x7f6eb8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:06.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.675+0000 7f6ecf7fe640 1 --2- 172.21.15.100:0/45384307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6eb80039e0 0x7f6eb8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:06.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.675+0000 7f6ed4ce8640 1 -- 172.21.15.100:0/45384307 reap_dead start 2024-09-11T22:21:06.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.675+0000 7f6ecf7fe640 1 -- 172.21.15.100:0/45384307 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb8003520 con 0x7f6eb8004800 2024-09-11T22:21:06.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.675+0000 7f6ecf7fe640 1 --2- 172.21.15.100:0/45384307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb8004800 0x7f6eb8004c80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009ac0 tx=0x7f6eb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804857ba99d01a8a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:06.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.675+0000 7f6eceffd640 1 -- 172.21.15.100:0/45384307 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4036070 con 0x7f6eb8004800 2024-09-11T22:21:06.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.675+0000 7f6eceffd640 1 -- 172.21.15.100:0/45384307 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec4031400 con 0x7f6eb8004800 2024-09-11T22:21:06.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.675+0000 7f6eceffd640 1 -- 172.21.15.100:0/45384307 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4009690 con 0x7f6eb8004800 2024-09-11T22:21:06.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.676+0000 7f6ed674b640 1 -- 172.21.15.100:0/45384307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb8004800 msgr2=0x7f6eb8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:06.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.676+0000 7f6ed674b640 1 --2- 172.21.15.100:0/45384307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb8004800 0x7f6eb8004c80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009ac0 tx=0x7f6eb8005830 comp rx=0 tx=0).stop 2024-09-11T22:21:06.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.676+0000 7f6ed674b640 1 -- 172.21.15.100:0/45384307 shutdown_connections 2024-09-11T22:21:06.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.676+0000 7f6ed674b640 1 --2- 172.21.15.100:0/45384307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb8004800 0x7f6eb8004c80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:06.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.676+0000 7f6ed674b640 1 -- 172.21.15.100:0/45384307 >> 172.21.15.100:0/45384307 conn(0x7f6ed0073900 msgr2=0x7f6ed0073ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:06.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.676+0000 7f6ed674b640 1 -- 172.21.15.100:0/45384307 shutdown_connections 2024-09-11T22:21:06.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.676+0000 7f6ed674b640 1 -- 172.21.15.100:0/45384307 wait complete. 2024-09-11T22:21:06.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.677+0000 7f6ed674b640 1 Processor -- start 2024-09-11T22:21:06.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.677+0000 7f6ed674b640 1 -- start start 2024-09-11T22:21:06.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.678+0000 7f6ed674b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb8004800 0x7f6ed0149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:06.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.678+0000 7f6ed674b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ed014d7a0 0x7f6ed014ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:06.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.678+0000 7f6ed674b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ed014e410 0x7f6ed0141600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:06.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.678+0000 7f6ed674b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed0152d30 con 0x7f6eb8004800 2024-09-11T22:21:06.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.678+0000 7f6ed674b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed0152bb0 con 0x7f6ed014d7a0 2024-09-11T22:21:06.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.678+0000 7f6ed674b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f6ed006e120 con 0x7f6ed014e410 2024-09-11T22:21:06.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.678+0000 7f6ecffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb8004800 0x7f6ed0149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:06.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.678+0000 7f6ecffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb8004800 0x7f6ed0149f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38028/0 (socket says 172.21.15.100:38028) 2024-09-11T22:21:06.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.678+0000 7f6ecffff640 1 -- 172.21.15.100:0/2389903210 learned_addr learned my addr 172.21.15.100:0/2389903210 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:06.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.678+0000 7f6ed4ce8640 1 --2- 172.21.15.100:0/2389903210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ed014e410 0x7f6ed0141600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:06.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.678+0000 7f6ecf7fe640 1 --2- 172.21.15.100:0/2389903210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ed014d7a0 0x7f6ed014ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:06.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.679+0000 7f6ecffff640 1 -- 172.21.15.100:0/2389903210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ed014e410 msgr2=0x7f6ed0141600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:06.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.679+0000 7f6ecffff640 1 --2- 172.21.15.100:0/2389903210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ed014e410 0x7f6ed0141600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:06.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.679+0000 7f6ecffff640 1 -- 172.21.15.100:0/2389903210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ed014d7a0 msgr2=0x7f6ed014ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:06.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.679+0000 7f6ecffff640 1 --2- 172.21.15.100:0/2389903210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ed014d7a0 0x7f6ed014ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:06.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.679+0000 7f6ecffff640 1 -- 172.21.15.100:0/2389903210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed014f510 con 0x7f6eb8004800 2024-09-11T22:21:06.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.679+0000 7f6ecf7fe640 1 --2- 172.21.15.100:0/2389903210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ed014d7a0 0x7f6ed014ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:06.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.679+0000 7f6ed4ce8640 1 --2- 172.21.15.100:0/2389903210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ed014e410 0x7f6ed0141600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:06.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.679+0000 7f6ecffff640 1 --2- 172.21.15.100:0/2389903210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb8004800 0x7f6ed0149f20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6ec00072c0 tx=0x7f6ec0007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:06.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.679+0000 7f6eccff9640 1 -- 172.21.15.100:0/2389903210 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec000f860 con 0x7f6eb8004800 2024-09-11T22:21:06.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.679+0000 7f6eccff9640 1 -- 172.21.15.100:0/2389903210 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec0018070 con 0x7f6eb8004800 2024-09-11T22:21:06.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.679+0000 7f6ed674b640 1 -- 172.21.15.100:0/2389903210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ed01ef0d0 con 0x7f6eb8004800 2024-09-11T22:21:06.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.679+0000 7f6eccff9640 1 -- 172.21.15.100:0/2389903210 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec000fc20 con 0x7f6eb8004800 2024-09-11T22:21:06.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.679+0000 7f6ed674b640 1 -- 172.21.15.100:0/2389903210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ed014b440 con 0x7f6eb8004800 2024-09-11T22:21:06.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.680+0000 7f6ed674b640 1 -- 172.21.15.100:0/2389903210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ed00c9300 con 0x7f6eb8004800 2024-09-11T22:21:06.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.680+0000 7f6eccff9640 1 -- 172.21.15.100:0/2389903210 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ec001d460 con 0x7f6eb8004800 2024-09-11T22:21:06.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.681+0000 7f6eccff9640 1 --2- 172.21.15.100:0/2389903210 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6ebc06be30 0x7f6ebc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:06.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.681+0000 7f6eccff9640 1 -- 172.21.15.100:0/2389903210 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f6ec008b3d0 con 0x7f6eb8004800 2024-09-11T22:21:06.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.681+0000 7f6ecf7fe640 1 --2- 172.21.15.100:0/2389903210 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6ebc06be30 0x7f6ebc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:06.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.681+0000 7f6ecf7fe640 1 --2- 172.21.15.100:0/2389903210 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6ebc06be30 0x7f6ebc06e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4033000 tx=0x7f6ec4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:06.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.685+0000 7f6eccff9640 1 -- 172.21.15.100:0/2389903210 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ec0059280 con 0x7f6eb8004800 2024-09-11T22:21:06.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.849+0000 7f6ed674b640 1 -- 172.21.15.100:0/2389903210 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ed00c9610 con 0x7f6ebc06be30 2024-09-11T22:21:06.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.857+0000 7f6eccff9640 1 -- 172.21.15.100:0/2389903210 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332445 (secure 0 0 0) 0x7f6ed00c9610 con 0x7f6ebc06be30 2024-09-11T22:21:06.861 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:21:06.863 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-11T22:21:06.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.860+0000 7f6ed674b640 1 -- 172.21.15.100:0/2389903210 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6ebc06be30 msgr2=0x7f6ebc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:06.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.860+0000 7f6ed674b640 1 --2- 172.21.15.100:0/2389903210 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6ebc06be30 0x7f6ebc06e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4033000 tx=0x7f6ec4008030 comp rx=0 tx=0).stop 2024-09-11T22:21:06.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.860+0000 7f6ed674b640 1 -- 172.21.15.100:0/2389903210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb8004800 msgr2=0x7f6ed0149f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:06.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.860+0000 7f6ed674b640 1 --2- 172.21.15.100:0/2389903210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb8004800 0x7f6ed0149f20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6ec00072c0 tx=0x7f6ec0007780 comp rx=0 tx=0).stop 2024-09-11T22:21:06.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.860+0000 7f6ed674b640 1 -- 172.21.15.100:0/2389903210 shutdown_connections 2024-09-11T22:21:06.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.860+0000 7f6ed674b640 1 --2- 172.21.15.100:0/2389903210 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6ebc06be30 0x7f6ebc06e2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:06.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.860+0000 7f6ed674b640 1 --2- 172.21.15.100:0/2389903210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ed014e410 0x7f6ed0141600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:06.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.860+0000 7f6ed674b640 1 --2- 172.21.15.100:0/2389903210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ed014d7a0 0x7f6ed014ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:06.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.860+0000 7f6ed674b640 1 --2- 172.21.15.100:0/2389903210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb8004800 0x7f6ed0149f20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:06.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.860+0000 7f6ed674b640 1 -- 172.21.15.100:0/2389903210 >> 172.21.15.100:0/2389903210 conn(0x7f6ed0073900 msgr2=0x7f6ed00c52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:06.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.860+0000 7f6ed674b640 1 -- 172.21.15.100:0/2389903210 shutdown_connections 2024-09-11T22:21:06.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:06.860+0000 7f6ed674b640 1 -- 172.21.15.100:0/2389903210 wait complete. 2024-09-11T22:21:06.872 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-09-11T22:21:06.314848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598265,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":319,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218784,"kb_used_data":2544,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755936,"statfs":{"total":773094113280,"available":772870078464,"internally_reserved":0,"allocated":2605056,"data_stored":2140274,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":443,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001744"},"pg_stats":[{"pgid":"2.1f","version":"26'9","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.034259+0000","last_change":"2024-09-11T22:20:18.853007+0000","last_active":"2024-09-11T22:21:01.034259+0000","last_peered":"2024-09-11T22:21:01.034259+0000","last_clean":"2024-09-11T22:21:01.034259+0000","last_became_active":"2024-09-11T22:20:18.852740+0000","last_became_peered":"2024-09-11T22:20:18.852740+0000","last_unstale":"2024-09-11T22:21:01.034259+0000","last_undegraded":"2024-09-11T22:21:01.034259+0000","last_fullsized":"2024-09-11T22:21:01.034259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:46.710328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033072+0000","last_change":"2024-09-11T22:20:19.849765+0000","last_active":"2024-09-11T22:21:02.033072+0000","last_peered":"2024-09-11T22:21:02.033072+0000","last_clean":"2024-09-11T22:21:02.033072+0000","last_became_active":"2024-09-11T22:20:19.848619+0000","last_became_peered":"2024-09-11T22:20:19.848619+0000","last_unstale":"2024-09-11T22:21:02.033072+0000","last_undegraded":"2024-09-11T22:21:02.033072+0000","last_fullsized":"2024-09-11T22:21:02.033072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:57.621624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031037+0000","last_change":"2024-09-11T22:20:24.078618+0000","last_active":"2024-09-11T22:21:02.031037+0000","last_peered":"2024-09-11T22:21:02.031037+0000","last_clean":"2024-09-11T22:21:02.031037+0000","last_became_active":"2024-09-11T22:20:24.078283+0000","last_became_peered":"2024-09-11T22:20:24.078283+0000","last_unstale":"2024-09-11T22:21:02.031037+0000","last_undegraded":"2024-09-11T22:21:02.031037+0000","last_fullsized":"2024-09-11T22:21:02.031037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:01.901307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033270+0000","last_change":"2024-09-11T22:20:18.855945+0000","last_active":"2024-09-11T22:21:02.033270+0000","last_peered":"2024-09-11T22:21:02.033270+0000","last_clean":"2024-09-11T22:21:02.033270+0000","last_became_active":"2024-09-11T22:20:18.854811+0000","last_became_peered":"2024-09-11T22:20:18.854811+0000","last_unstale":"2024-09-11T22:21:02.033270+0000","last_undegraded":"2024-09-11T22:21:02.033270+0000","last_fullsized":"2024-09-11T22:21:02.033270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:47.508920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033442+0000","last_change":"2024-09-11T22:20:19.862436+0000","last_active":"2024-09-11T22:21:01.033442+0000","last_peered":"2024-09-11T22:21:01.033442+0000","last_clean":"2024-09-11T22:21:01.033442+0000","last_became_active":"2024-09-11T22:20:19.862061+0000","last_became_peered":"2024-09-11T22:20:19.862061+0000","last_unstale":"2024-09-11T22:21:01.033442+0000","last_undegraded":"2024-09-11T22:21:01.033442+0000","last_fullsized":"2024-09-11T22:21:01.033442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028431+0000","last_change":"2024-09-11T22:20:23.879729+0000","last_active":"2024-09-11T22:21:02.028431+0000","last_peered":"2024-09-11T22:21:02.028431+0000","last_clean":"2024-09-11T22:21:02.028431+0000","last_became_active":"2024-09-11T22:20:23.879245+0000","last_became_peered":"2024-09-11T22:20:23.879245+0000","last_unstale":"2024-09-11T22:21:02.028431+0000","last_undegraded":"2024-09-11T22:21:02.028431+0000","last_fullsized":"2024-09-11T22:21:02.028431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:36.836842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030157+0000","last_change":"2024-09-11T22:20:18.853076+0000","last_active":"2024-09-11T22:21:02.030157+0000","last_peered":"2024-09-11T22:21:02.030157+0000","last_clean":"2024-09-11T22:21:02.030157+0000","last_became_active":"2024-09-11T22:20:18.852728+0000","last_became_peered":"2024-09-11T22:20:18.852728+0000","last_unstale":"2024-09-11T22:21:02.030157+0000","last_undegraded":"2024-09-11T22:21:02.030157+0000","last_fullsized":"2024-09-11T22:21:02.030157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227771+0000","last_change":"2024-09-11T22:20:19.864544+0000","last_active":"2024-09-11T22:21:02.227771+0000","last_peered":"2024-09-11T22:21:02.227771+0000","last_clean":"2024-09-11T22:21:02.227771+0000","last_became_active":"2024-09-11T22:20:19.864234+0000","last_became_peered":"2024-09-11T22:20:19.864234+0000","last_unstale":"2024-09-11T22:21:02.227771+0000","last_undegraded":"2024-09-11T22:21:02.227771+0000","last_fullsized":"2024-09-11T22:21:02.227771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028549+0000","last_change":"2024-09-11T22:20:23.873783+0000","last_active":"2024-09-11T22:21:02.028549+0000","last_peered":"2024-09-11T22:21:02.028549+0000","last_clean":"2024-09-11T22:21:02.028549+0000","last_became_active":"2024-09-11T22:20:23.873385+0000","last_became_peered":"2024-09-11T22:20:23.873385+0000","last_unstale":"2024-09-11T22:21:02.028549+0000","last_undegraded":"2024-09-11T22:21:02.028549+0000","last_fullsized":"2024-09-11T22:21:02.028549+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029609+0000","last_change":"2024-09-11T22:20:18.861530+0000","last_active":"2024-09-11T22:21:02.029609+0000","last_peered":"2024-09-11T22:21:02.029609+0000","last_clean":"2024-09-11T22:21:02.029609+0000","last_became_active":"2024-09-11T22:20:18.861230+0000","last_became_peered":"2024-09-11T22:20:18.861230+0000","last_unstale":"2024-09-11T22:21:02.029609+0000","last_undegraded":"2024-09-11T22:21:02.029609+0000","last_fullsized":"2024-09-11T22:21:02.029609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227926+0000","last_change":"2024-09-11T22:20:19.863401+0000","last_active":"2024-09-11T22:21:02.227926+0000","last_peered":"2024-09-11T22:21:02.227926+0000","last_clean":"2024-09-11T22:21:02.227926+0000","last_became_active":"2024-09-11T22:20:19.863127+0000","last_became_peered":"2024-09-11T22:20:19.863127+0000","last_unstale":"2024-09-11T22:21:02.227926+0000","last_undegraded":"2024-09-11T22:21:02.227926+0000","last_fullsized":"2024-09-11T22:21:02.227926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:36.888544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028135+0000","last_change":"2024-09-11T22:20:23.874650+0000","last_active":"2024-09-11T22:21:02.028135+0000","last_peered":"2024-09-11T22:21:02.028135+0000","last_clean":"2024-09-11T22:21:02.028135+0000","last_became_active":"2024-09-11T22:20:23.874040+0000","last_became_peered":"2024-09-11T22:20:23.874040+0000","last_unstale":"2024-09-11T22:21:02.028135+0000","last_undegraded":"2024-09-11T22:21:02.028135+0000","last_fullsized":"2024-09-11T22:21:02.028135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025493+0000","last_change":"2024-09-11T22:20:19.859446+0000","last_active":"2024-09-11T22:21:02.025493+0000","last_peered":"2024-09-11T22:21:02.025493+0000","last_clean":"2024-09-11T22:21:02.025493+0000","last_became_active":"2024-09-11T22:20:19.859106+0000","last_became_peered":"2024-09-11T22:20:19.859106+0000","last_unstale":"2024-09-11T22:21:02.025493+0000","last_undegraded":"2024-09-11T22:21:02.025493+0000","last_fullsized":"2024-09-11T22:21:02.025493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029766+0000","last_change":"2024-09-11T22:20:18.856475+0000","last_active":"2024-09-11T22:21:02.029766+0000","last_peered":"2024-09-11T22:21:02.029766+0000","last_clean":"2024-09-11T22:21:02.029766+0000","last_became_active":"2024-09-11T22:20:18.856165+0000","last_became_peered":"2024-09-11T22:20:18.856165+0000","last_unstale":"2024-09-11T22:21:02.029766+0000","last_undegraded":"2024-09-11T22:21:02.029766+0000","last_fullsized":"2024-09-11T22:21:02.029766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028970+0000","last_change":"2024-09-11T22:20:23.878121+0000","last_active":"2024-09-11T22:21:02.028970+0000","last_peered":"2024-09-11T22:21:02.028970+0000","last_clean":"2024-09-11T22:21:02.028970+0000","last_became_active":"2024-09-11T22:20:23.877713+0000","last_became_peered":"2024-09-11T22:20:23.877713+0000","last_unstale":"2024-09-11T22:21:02.028970+0000","last_undegraded":"2024-09-11T22:21:02.028970+0000","last_fullsized":"2024-09-11T22:21:02.028970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033716+0000","last_change":"2024-09-11T22:20:19.858358+0000","last_active":"2024-09-11T22:21:02.033716+0000","last_peered":"2024-09-11T22:21:02.033716+0000","last_clean":"2024-09-11T22:21:02.033716+0000","last_became_active":"2024-09-11T22:20:19.858057+0000","last_became_peered":"2024-09-11T22:20:19.858057+0000","last_unstale":"2024-09-11T22:21:02.033716+0000","last_undegraded":"2024-09-11T22:21:02.033716+0000","last_fullsized":"2024-09-11T22:21:02.033716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:07.839926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029718+0000","last_change":"2024-09-11T22:20:18.853818+0000","last_active":"2024-09-11T22:21:02.029718+0000","last_peered":"2024-09-11T22:21:02.029718+0000","last_clean":"2024-09-11T22:21:02.029718+0000","last_became_active":"2024-09-11T22:20:18.853508+0000","last_became_peered":"2024-09-11T22:20:18.853508+0000","last_unstale":"2024-09-11T22:21:02.029718+0000","last_undegraded":"2024-09-11T22:21:02.029718+0000","last_fullsized":"2024-09-11T22:21:02.029718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:58.141587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.037670+0000","last_change":"2024-09-11T22:21:02.037670+0000","last_active":"2024-09-11T22:21:02.037670+0000","last_peered":"2024-09-11T22:21:02.037670+0000","last_clean":"2024-09-11T22:21:02.037670+0000","last_became_active":"2024-09-11T22:21:02.036941+0000","last_became_peered":"2024-09-11T22:21:02.036941+0000","last_unstale":"2024-09-11T22:21:02.037670+0000","last_undegraded":"2024-09-11T22:21:02.037670+0000","last_fullsized":"2024-09-11T22:21:02.037670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:20.859515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031746+0000","last_change":"2024-09-11T22:20:19.844748+0000","last_active":"2024-09-11T22:21:02.031746+0000","last_peered":"2024-09-11T22:21:02.031746+0000","last_clean":"2024-09-11T22:21:02.031746+0000","last_became_active":"2024-09-11T22:20:19.844446+0000","last_became_peered":"2024-09-11T22:20:19.844446+0000","last_unstale":"2024-09-11T22:21:02.031746+0000","last_undegraded":"2024-09-11T22:21:02.031746+0000","last_fullsized":"2024-09-11T22:21:02.031746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:13.319918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029638+0000","last_change":"2024-09-11T22:20:18.847388+0000","last_active":"2024-09-11T22:21:02.029638+0000","last_peered":"2024-09-11T22:21:02.029638+0000","last_clean":"2024-09-11T22:21:02.029638+0000","last_became_active":"2024-09-11T22:20:18.847118+0000","last_became_peered":"2024-09-11T22:20:18.847118+0000","last_unstale":"2024-09-11T22:21:02.029638+0000","last_undegraded":"2024-09-11T22:21:02.029638+0000","last_fullsized":"2024-09-11T22:21:02.029638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:47.360920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029161+0000","last_change":"2024-09-11T22:20:24.077604+0000","last_active":"2024-09-11T22:21:02.029161+0000","last_peered":"2024-09-11T22:21:02.029161+0000","last_clean":"2024-09-11T22:21:02.029161+0000","last_became_active":"2024-09-11T22:20:24.077231+0000","last_became_peered":"2024-09-11T22:20:24.077231+0000","last_unstale":"2024-09-11T22:21:02.029161+0000","last_undegraded":"2024-09-11T22:21:02.029161+0000","last_fullsized":"2024-09-11T22:21:02.029161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:38.846688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028259+0000","last_change":"2024-09-11T22:20:19.854453+0000","last_active":"2024-09-11T22:21:02.028259+0000","last_peered":"2024-09-11T22:21:02.028259+0000","last_clean":"2024-09-11T22:21:02.028259+0000","last_became_active":"2024-09-11T22:20:19.854100+0000","last_became_peered":"2024-09-11T22:20:19.854100+0000","last_unstale":"2024-09-11T22:21:02.028259+0000","last_undegraded":"2024-09-11T22:21:02.028259+0000","last_fullsized":"2024-09-11T22:21:02.028259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:06.166813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029113+0000","last_change":"2024-09-11T22:20:18.854889+0000","last_active":"2024-09-11T22:21:02.029113+0000","last_peered":"2024-09-11T22:21:02.029113+0000","last_clean":"2024-09-11T22:21:02.029113+0000","last_became_active":"2024-09-11T22:20:18.854552+0000","last_became_peered":"2024-09-11T22:20:18.854552+0000","last_unstale":"2024-09-11T22:21:02.029113+0000","last_undegraded":"2024-09-11T22:21:02.029113+0000","last_fullsized":"2024-09-11T22:21:02.029113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:33.612126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028918+0000","last_change":"2024-09-11T22:20:23.878932+0000","last_active":"2024-09-11T22:21:02.028918+0000","last_peered":"2024-09-11T22:21:02.028918+0000","last_clean":"2024-09-11T22:21:02.028918+0000","last_became_active":"2024-09-11T22:20:23.878305+0000","last_became_peered":"2024-09-11T22:20:23.878305+0000","last_unstale":"2024-09-11T22:21:02.028918+0000","last_undegraded":"2024-09-11T22:21:02.028918+0000","last_fullsized":"2024-09-11T22:21:02.028918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033835+0000","last_change":"2024-09-11T22:20:19.856318+0000","last_active":"2024-09-11T22:21:01.033835+0000","last_peered":"2024-09-11T22:21:01.033835+0000","last_clean":"2024-09-11T22:21:01.033835+0000","last_became_active":"2024-09-11T22:20:19.855992+0000","last_became_peered":"2024-09-11T22:20:19.855992+0000","last_unstale":"2024-09-11T22:21:01.033835+0000","last_undegraded":"2024-09-11T22:21:01.033835+0000","last_fullsized":"2024-09-11T22:21:01.033835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:57.709140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026101+0000","last_change":"2024-09-11T22:20:18.850750+0000","last_active":"2024-09-11T22:21:02.026101+0000","last_peered":"2024-09-11T22:21:02.026101+0000","last_clean":"2024-09-11T22:21:02.026101+0000","last_became_active":"2024-09-11T22:20:18.849621+0000","last_became_peered":"2024-09-11T22:20:18.849621+0000","last_unstale":"2024-09-11T22:21:02.026101+0000","last_undegraded":"2024-09-11T22:21:02.026101+0000","last_fullsized":"2024-09-11T22:21:02.026101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028034+0000","last_change":"2024-09-11T22:20:24.077741+0000","last_active":"2024-09-11T22:21:02.028034+0000","last_peered":"2024-09-11T22:21:02.028034+0000","last_clean":"2024-09-11T22:21:02.028034+0000","last_became_active":"2024-09-11T22:20:24.077325+0000","last_became_peered":"2024-09-11T22:20:24.077325+0000","last_unstale":"2024-09-11T22:21:02.028034+0000","last_undegraded":"2024-09-11T22:21:02.028034+0000","last_fullsized":"2024-09-11T22:21:02.028034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:18.656529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033274+0000","last_change":"2024-09-11T22:20:19.850738+0000","last_active":"2024-09-11T22:21:02.033274+0000","last_peered":"2024-09-11T22:21:02.033274+0000","last_clean":"2024-09-11T22:21:02.033274+0000","last_became_active":"2024-09-11T22:20:19.850441+0000","last_became_peered":"2024-09-11T22:20:19.850441+0000","last_unstale":"2024-09-11T22:21:02.033274+0000","last_undegraded":"2024-09-11T22:21:02.033274+0000","last_fullsized":"2024-09-11T22:21:02.033274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:47.552343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029867+0000","last_change":"2024-09-11T22:20:18.845173+0000","last_active":"2024-09-11T22:21:02.029867+0000","last_peered":"2024-09-11T22:21:02.029867+0000","last_clean":"2024-09-11T22:21:02.029867+0000","last_became_active":"2024-09-11T22:20:18.844731+0000","last_became_peered":"2024-09-11T22:20:18.844731+0000","last_unstale":"2024-09-11T22:21:02.029867+0000","last_undegraded":"2024-09-11T22:21:02.029867+0000","last_fullsized":"2024-09-11T22:21:02.029867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:32.963285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.037927+0000","last_change":"2024-09-11T22:21:02.037927+0000","last_active":"2024-09-11T22:21:02.037927+0000","last_peered":"2024-09-11T22:21:02.037927+0000","last_clean":"2024-09-11T22:21:02.037927+0000","last_became_active":"2024-09-11T22:21:02.037520+0000","last_became_peered":"2024-09-11T22:21:02.037520+0000","last_unstale":"2024-09-11T22:21:02.037927+0000","last_undegraded":"2024-09-11T22:21:02.037927+0000","last_fullsized":"2024-09-11T22:21:02.037927+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:38.798530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.032044+0000","last_change":"2024-09-11T22:20:19.845497+0000","last_active":"2024-09-11T22:21:02.032044+0000","last_peered":"2024-09-11T22:21:02.032044+0000","last_clean":"2024-09-11T22:21:02.032044+0000","last_became_active":"2024-09-11T22:20:19.845203+0000","last_became_peered":"2024-09-11T22:20:19.845203+0000","last_unstale":"2024-09-11T22:21:02.032044+0000","last_undegraded":"2024-09-11T22:21:02.032044+0000","last_fullsized":"2024-09-11T22:21:02.032044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:12.086231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030346+0000","last_change":"2024-09-11T22:20:18.856263+0000","last_active":"2024-09-11T22:21:02.030346+0000","last_peered":"2024-09-11T22:21:02.030346+0000","last_clean":"2024-09-11T22:21:02.030346+0000","last_became_active":"2024-09-11T22:20:18.855968+0000","last_became_peered":"2024-09-11T22:20:18.855968+0000","last_unstale":"2024-09-11T22:21:02.030346+0000","last_undegraded":"2024-09-11T22:21:02.030346+0000","last_fullsized":"2024-09-11T22:21:02.030346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033466+0000","last_change":"2024-09-11T22:20:24.075030+0000","last_active":"2024-09-11T22:21:01.033466+0000","last_peered":"2024-09-11T22:21:01.033466+0000","last_clean":"2024-09-11T22:21:01.033466+0000","last_became_active":"2024-09-11T22:20:24.074588+0000","last_became_peered":"2024-09-11T22:20:24.074588+0000","last_unstale":"2024-09-11T22:21:01.033466+0000","last_undegraded":"2024-09-11T22:21:01.033466+0000","last_fullsized":"2024-09-11T22:21:01.033466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227987+0000","last_change":"2024-09-11T22:20:19.859010+0000","last_active":"2024-09-11T22:21:02.227987+0000","last_peered":"2024-09-11T22:21:02.227987+0000","last_clean":"2024-09-11T22:21:02.227987+0000","last_became_active":"2024-09-11T22:20:19.858585+0000","last_became_peered":"2024-09-11T22:20:19.858585+0000","last_unstale":"2024-09-11T22:21:02.227987+0000","last_undegraded":"2024-09-11T22:21:02.227987+0000","last_fullsized":"2024-09-11T22:21:02.227987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.032132+0000","last_change":"2024-09-11T22:20:18.847904+0000","last_active":"2024-09-11T22:21:02.032132+0000","last_peered":"2024-09-11T22:21:02.032132+0000","last_clean":"2024-09-11T22:21:02.032132+0000","last_became_active":"2024-09-11T22:20:18.847669+0000","last_became_peered":"2024-09-11T22:20:18.847669+0000","last_unstale":"2024-09-11T22:21:02.032132+0000","last_undegraded":"2024-09-11T22:21:02.032132+0000","last_fullsized":"2024-09-11T22:21:02.032132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:08.717999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029308+0000","last_change":"2024-09-11T22:20:23.881067+0000","last_active":"2024-09-11T22:21:02.029308+0000","last_peered":"2024-09-11T22:21:02.029308+0000","last_clean":"2024-09-11T22:21:02.029308+0000","last_became_active":"2024-09-11T22:20:23.880468+0000","last_became_peered":"2024-09-11T22:20:23.880468+0000","last_unstale":"2024-09-11T22:21:02.029308+0000","last_undegraded":"2024-09-11T22:21:02.029308+0000","last_fullsized":"2024-09-11T22:21:02.029308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:23.480547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028714+0000","last_change":"2024-09-11T22:20:19.860423+0000","last_active":"2024-09-11T22:21:02.028714+0000","last_peered":"2024-09-11T22:21:02.028714+0000","last_clean":"2024-09-11T22:21:02.028714+0000","last_became_active":"2024-09-11T22:20:19.858932+0000","last_became_peered":"2024-09-11T22:20:19.858932+0000","last_unstale":"2024-09-11T22:21:02.028714+0000","last_undegraded":"2024-09-11T22:21:02.028714+0000","last_fullsized":"2024-09-11T22:21:02.028714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:53.255932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227699+0000","last_change":"2024-09-11T22:20:18.854973+0000","last_active":"2024-09-11T22:21:02.227699+0000","last_peered":"2024-09-11T22:21:02.227699+0000","last_clean":"2024-09-11T22:21:02.227699+0000","last_became_active":"2024-09-11T22:20:18.854725+0000","last_became_peered":"2024-09-11T22:20:18.854725+0000","last_unstale":"2024-09-11T22:21:02.227699+0000","last_undegraded":"2024-09-11T22:21:02.227699+0000","last_fullsized":"2024-09-11T22:21:02.227699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031943+0000","last_change":"2024-09-11T22:20:23.880693+0000","last_active":"2024-09-11T22:21:02.031943+0000","last_peered":"2024-09-11T22:21:02.031943+0000","last_clean":"2024-09-11T22:21:02.031943+0000","last_became_active":"2024-09-11T22:20:23.880243+0000","last_became_peered":"2024-09-11T22:20:23.880243+0000","last_unstale":"2024-09-11T22:21:02.031943+0000","last_undegraded":"2024-09-11T22:21:02.031943+0000","last_fullsized":"2024-09-11T22:21:02.031943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.659287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029266+0000","last_change":"2024-09-11T22:20:19.844808+0000","last_active":"2024-09-11T22:21:02.029266+0000","last_peered":"2024-09-11T22:21:02.029266+0000","last_clean":"2024-09-11T22:21:02.029266+0000","last_became_active":"2024-09-11T22:20:19.844536+0000","last_became_peered":"2024-09-11T22:20:19.844536+0000","last_unstale":"2024-09-11T22:21:02.029266+0000","last_undegraded":"2024-09-11T22:21:02.029266+0000","last_fullsized":"2024-09-11T22:21:02.029266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:57.142383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025228+0000","last_change":"2024-09-11T22:20:18.855640+0000","last_active":"2024-09-11T22:21:01.025228+0000","last_peered":"2024-09-11T22:21:01.025228+0000","last_clean":"2024-09-11T22:21:01.025228+0000","last_became_active":"2024-09-11T22:20:18.855394+0000","last_became_peered":"2024-09-11T22:20:18.855394+0000","last_unstale":"2024-09-11T22:21:01.025228+0000","last_undegraded":"2024-09-11T22:21:01.025228+0000","last_fullsized":"2024-09-11T22:21:01.025228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029268+0000","last_change":"2024-09-11T22:20:23.882554+0000","last_active":"2024-09-11T22:21:02.029268+0000","last_peered":"2024-09-11T22:21:02.029268+0000","last_clean":"2024-09-11T22:21:02.029268+0000","last_became_active":"2024-09-11T22:20:23.881642+0000","last_became_peered":"2024-09-11T22:20:23.881642+0000","last_unstale":"2024-09-11T22:21:02.029268+0000","last_undegraded":"2024-09-11T22:21:02.029268+0000","last_fullsized":"2024-09-11T22:21:02.029268+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:16.696043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033143+0000","last_change":"2024-09-11T22:20:19.859429+0000","last_active":"2024-09-11T22:21:01.033143+0000","last_peered":"2024-09-11T22:21:01.033143+0000","last_clean":"2024-09-11T22:21:01.033143+0000","last_became_active":"2024-09-11T22:20:19.859159+0000","last_became_peered":"2024-09-11T22:20:19.859159+0000","last_unstale":"2024-09-11T22:21:01.033143+0000","last_undegraded":"2024-09-11T22:21:01.033143+0000","last_fullsized":"2024-09-11T22:21:01.033143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:02.696450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029225+0000","last_change":"2024-09-11T22:20:18.856144+0000","last_active":"2024-09-11T22:21:02.029225+0000","last_peered":"2024-09-11T22:21:02.029225+0000","last_clean":"2024-09-11T22:21:02.029225+0000","last_became_active":"2024-09-11T22:20:18.855866+0000","last_became_peered":"2024-09-11T22:20:18.855866+0000","last_unstale":"2024-09-11T22:21:02.029225+0000","last_undegraded":"2024-09-11T22:21:02.029225+0000","last_fullsized":"2024-09-11T22:21:02.029225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:37.259393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033635+0000","last_change":"2024-09-11T22:20:24.075154+0000","last_active":"2024-09-11T22:21:01.033635+0000","last_peered":"2024-09-11T22:21:01.033635+0000","last_clean":"2024-09-11T22:21:01.033635+0000","last_became_active":"2024-09-11T22:20:24.074568+0000","last_became_peered":"2024-09-11T22:20:24.074568+0000","last_unstale":"2024-09-11T22:21:01.033635+0000","last_undegraded":"2024-09-11T22:21:01.033635+0000","last_fullsized":"2024-09-11T22:21:01.033635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:09.804991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031694+0000","last_change":"2024-09-11T22:20:19.861236+0000","last_active":"2024-09-11T22:21:02.031694+0000","last_peered":"2024-09-11T22:21:02.031694+0000","last_clean":"2024-09-11T22:21:02.031694+0000","last_became_active":"2024-09-11T22:20:19.860938+0000","last_became_peered":"2024-09-11T22:20:19.860938+0000","last_unstale":"2024-09-11T22:21:02.031694+0000","last_undegraded":"2024-09-11T22:21:02.031694+0000","last_fullsized":"2024-09-11T22:21:02.031694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:42.015334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227590+0000","last_change":"2024-09-11T22:20:18.853467+0000","last_active":"2024-09-11T22:21:02.227590+0000","last_peered":"2024-09-11T22:21:02.227590+0000","last_clean":"2024-09-11T22:21:02.227590+0000","last_became_active":"2024-09-11T22:20:18.853182+0000","last_became_peered":"2024-09-11T22:20:18.853182+0000","last_unstale":"2024-09-11T22:21:02.227590+0000","last_undegraded":"2024-09-11T22:21:02.227590+0000","last_fullsized":"2024-09-11T22:21:02.227590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029398+0000","last_change":"2024-09-11T22:20:09.425648+0000","last_active":"2024-09-11T22:21:02.029398+0000","last_peered":"2024-09-11T22:21:02.029398+0000","last_clean":"2024-09-11T22:21:02.029398+0000","last_became_active":"2024-09-11T22:20:09.424591+0000","last_became_peered":"2024-09-11T22:20:09.424591+0000","last_unstale":"2024-09-11T22:21:02.029398+0000","last_undegraded":"2024-09-11T22:21:02.029398+0000","last_fullsized":"2024-09-11T22:21:02.029398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_clean_scrub_stamp":"2024-09-11T22:20:08.334092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:53.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025706+0000","last_change":"2024-09-11T22:20:24.077007+0000","last_active":"2024-09-11T22:21:02.025706+0000","last_peered":"2024-09-11T22:21:02.025706+0000","last_clean":"2024-09-11T22:21:02.025706+0000","last_became_active":"2024-09-11T22:20:24.076601+0000","last_became_peered":"2024-09-11T22:20:24.076601+0000","last_unstale":"2024-09-11T22:21:02.025706+0000","last_undegraded":"2024-09-11T22:21:02.025706+0000","last_fullsized":"2024-09-11T22:21:02.025706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030003+0000","last_change":"2024-09-11T22:20:19.863279+0000","last_active":"2024-09-11T22:21:02.030003+0000","last_peered":"2024-09-11T22:21:02.030003+0000","last_clean":"2024-09-11T22:21:02.030003+0000","last_became_active":"2024-09-11T22:20:19.861322+0000","last_became_peered":"2024-09-11T22:20:19.861322+0000","last_unstale":"2024-09-11T22:21:02.030003+0000","last_undegraded":"2024-09-11T22:21:02.030003+0000","last_fullsized":"2024-09-11T22:21:02.030003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025479+0000","last_change":"2024-09-11T22:20:18.853343+0000","last_active":"2024-09-11T22:21:01.025479+0000","last_peered":"2024-09-11T22:21:01.025479+0000","last_clean":"2024-09-11T22:21:01.025479+0000","last_became_active":"2024-09-11T22:20:18.853069+0000","last_became_peered":"2024-09-11T22:20:18.853069+0000","last_unstale":"2024-09-11T22:21:01.025479+0000","last_undegraded":"2024-09-11T22:21:01.025479+0000","last_fullsized":"2024-09-11T22:21:01.025479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025514+0000","last_change":"2024-09-11T22:20:24.075350+0000","last_active":"2024-09-11T22:21:02.025514+0000","last_peered":"2024-09-11T22:21:02.025514+0000","last_clean":"2024-09-11T22:21:02.025514+0000","last_became_active":"2024-09-11T22:20:24.074789+0000","last_became_peered":"2024-09-11T22:20:24.074789+0000","last_unstale":"2024-09-11T22:21:02.025514+0000","last_undegraded":"2024-09-11T22:21:02.025514+0000","last_fullsized":"2024-09-11T22:21:02.025514+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227845+0000","last_change":"2024-09-11T22:20:19.866331+0000","last_active":"2024-09-11T22:21:02.227845+0000","last_peered":"2024-09-11T22:21:02.227845+0000","last_clean":"2024-09-11T22:21:02.227845+0000","last_became_active":"2024-09-11T22:20:19.865535+0000","last_became_peered":"2024-09-11T22:20:19.865535+0000","last_unstale":"2024-09-11T22:21:02.227845+0000","last_undegraded":"2024-09-11T22:21:02.227845+0000","last_fullsized":"2024-09-11T22:21:02.227845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030534+0000","last_change":"2024-09-11T22:20:18.849434+0000","last_active":"2024-09-11T22:21:02.030534+0000","last_peered":"2024-09-11T22:21:02.030534+0000","last_clean":"2024-09-11T22:21:02.030534+0000","last_became_active":"2024-09-11T22:20:18.848787+0000","last_became_peered":"2024-09-11T22:20:18.848787+0000","last_unstale":"2024-09-11T22:21:02.030534+0000","last_undegraded":"2024-09-11T22:21:02.030534+0000","last_fullsized":"2024-09-11T22:21:02.030534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:25.689495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033577+0000","last_change":"2024-09-11T22:20:23.879962+0000","last_active":"2024-09-11T22:21:01.033577+0000","last_peered":"2024-09-11T22:21:01.033577+0000","last_clean":"2024-09-11T22:21:01.033577+0000","last_became_active":"2024-09-11T22:20:23.879586+0000","last_became_peered":"2024-09-11T22:20:23.879586+0000","last_unstale":"2024-09-11T22:21:01.033577+0000","last_undegraded":"2024-09-11T22:21:01.033577+0000","last_fullsized":"2024-09-11T22:21:01.033577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:27.323116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030163+0000","last_change":"2024-09-11T22:20:19.860411+0000","last_active":"2024-09-11T22:21:02.030163+0000","last_peered":"2024-09-11T22:21:02.030163+0000","last_clean":"2024-09-11T22:21:02.030163+0000","last_became_active":"2024-09-11T22:20:19.860076+0000","last_became_peered":"2024-09-11T22:20:19.860076+0000","last_unstale":"2024-09-11T22:21:02.030163+0000","last_undegraded":"2024-09-11T22:21:02.030163+0000","last_fullsized":"2024-09-11T22:21:02.030163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025282+0000","last_change":"2024-09-11T22:20:18.856020+0000","last_active":"2024-09-11T22:21:01.025282+0000","last_peered":"2024-09-11T22:21:01.025282+0000","last_clean":"2024-09-11T22:21:01.025282+0000","last_became_active":"2024-09-11T22:20:18.855753+0000","last_became_peered":"2024-09-11T22:20:18.855753+0000","last_unstale":"2024-09-11T22:21:01.025282+0000","last_undegraded":"2024-09-11T22:21:01.025282+0000","last_fullsized":"2024-09-11T22:21:01.025282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227177+0000","last_change":"2024-09-11T22:20:24.077975+0000","last_active":"2024-09-11T22:21:02.227177+0000","last_peered":"2024-09-11T22:21:02.227177+0000","last_clean":"2024-09-11T22:21:02.227177+0000","last_became_active":"2024-09-11T22:20:24.077502+0000","last_became_peered":"2024-09-11T22:20:24.077502+0000","last_unstale":"2024-09-11T22:21:02.227177+0000","last_undegraded":"2024-09-11T22:21:02.227177+0000","last_fullsized":"2024-09-11T22:21:02.227177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:16.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029605+0000","last_change":"2024-09-11T22:20:19.856986+0000","last_active":"2024-09-11T22:21:02.029605+0000","last_peered":"2024-09-11T22:21:02.029605+0000","last_clean":"2024-09-11T22:21:02.029605+0000","last_became_active":"2024-09-11T22:20:19.856739+0000","last_became_peered":"2024-09-11T22:20:19.856739+0000","last_unstale":"2024-09-11T22:21:02.029605+0000","last_undegraded":"2024-09-11T22:21:02.029605+0000","last_fullsized":"2024-09-11T22:21:02.029605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028636+0000","last_change":"2024-09-11T22:20:18.855044+0000","last_active":"2024-09-11T22:21:02.028636+0000","last_peered":"2024-09-11T22:21:02.028636+0000","last_clean":"2024-09-11T22:21:02.028636+0000","last_became_active":"2024-09-11T22:20:18.854764+0000","last_became_peered":"2024-09-11T22:20:18.854764+0000","last_unstale":"2024-09-11T22:21:02.028636+0000","last_undegraded":"2024-09-11T22:21:02.028636+0000","last_fullsized":"2024-09-11T22:21:02.028636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:22.207278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.027914+0000","last_change":"2024-09-11T22:20:23.878383+0000","last_active":"2024-09-11T22:21:02.027914+0000","last_peered":"2024-09-11T22:21:02.027914+0000","last_clean":"2024-09-11T22:21:02.027914+0000","last_became_active":"2024-09-11T22:20:23.877890+0000","last_became_peered":"2024-09-11T22:20:23.877890+0000","last_unstale":"2024-09-11T22:21:02.027914+0000","last_undegraded":"2024-09-11T22:21:02.027914+0000","last_fullsized":"2024-09-11T22:21:02.027914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:18.876485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029429+0000","last_change":"2024-09-11T22:20:19.861242+0000","last_active":"2024-09-11T22:21:02.029429+0000","last_peered":"2024-09-11T22:21:02.029429+0000","last_clean":"2024-09-11T22:21:02.029429+0000","last_became_active":"2024-09-11T22:20:19.860988+0000","last_became_peered":"2024-09-11T22:20:19.860988+0000","last_unstale":"2024-09-11T22:21:02.029429+0000","last_undegraded":"2024-09-11T22:21:02.029429+0000","last_fullsized":"2024-09-11T22:21:02.029429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.024956+0000","last_change":"2024-09-11T22:20:18.852459+0000","last_active":"2024-09-11T22:21:01.024956+0000","last_peered":"2024-09-11T22:21:01.024956+0000","last_clean":"2024-09-11T22:21:01.024956+0000","last_became_active":"2024-09-11T22:20:18.852153+0000","last_became_peered":"2024-09-11T22:20:18.852153+0000","last_unstale":"2024-09-11T22:21:01.024956+0000","last_undegraded":"2024-09-11T22:21:01.024956+0000","last_fullsized":"2024-09-11T22:21:01.024956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033546+0000","last_change":"2024-09-11T22:20:23.874062+0000","last_active":"2024-09-11T22:21:01.033546+0000","last_peered":"2024-09-11T22:21:01.033546+0000","last_clean":"2024-09-11T22:21:01.033546+0000","last_became_active":"2024-09-11T22:20:23.873635+0000","last_became_peered":"2024-09-11T22:20:23.873635+0000","last_unstale":"2024-09-11T22:21:01.033546+0000","last_undegraded":"2024-09-11T22:21:01.033546+0000","last_fullsized":"2024-09-11T22:21:01.033546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:40.914142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025507+0000","last_change":"2024-09-11T22:20:19.851577+0000","last_active":"2024-09-11T22:21:02.025507+0000","last_peered":"2024-09-11T22:21:02.025507+0000","last_clean":"2024-09-11T22:21:02.025507+0000","last_became_active":"2024-09-11T22:20:19.851286+0000","last_became_peered":"2024-09-11T22:20:19.851286+0000","last_unstale":"2024-09-11T22:21:02.025507+0000","last_undegraded":"2024-09-11T22:21:02.025507+0000","last_fullsized":"2024-09-11T22:21:02.025507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:32.025931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025532+0000","last_change":"2024-09-11T22:20:18.853301+0000","last_active":"2024-09-11T22:21:02.025532+0000","last_peered":"2024-09-11T22:21:02.025532+0000","last_clean":"2024-09-11T22:21:02.025532+0000","last_became_active":"2024-09-11T22:20:18.852978+0000","last_became_peered":"2024-09-11T22:20:18.852978+0000","last_unstale":"2024-09-11T22:21:02.025532+0000","last_undegraded":"2024-09-11T22:21:02.025532+0000","last_fullsized":"2024-09-11T22:21:02.025532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033106+0000","last_change":"2024-09-11T22:20:24.077636+0000","last_active":"2024-09-11T22:21:02.033106+0000","last_peered":"2024-09-11T22:21:02.033106+0000","last_clean":"2024-09-11T22:21:02.033106+0000","last_became_active":"2024-09-11T22:20:24.077313+0000","last_became_peered":"2024-09-11T22:20:24.077313+0000","last_unstale":"2024-09-11T22:21:02.033106+0000","last_undegraded":"2024-09-11T22:21:02.033106+0000","last_fullsized":"2024-09-11T22:21:02.033106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:23.154027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029676+0000","last_change":"2024-09-11T22:20:19.862562+0000","last_active":"2024-09-11T22:21:02.029676+0000","last_peered":"2024-09-11T22:21:02.029676+0000","last_clean":"2024-09-11T22:21:02.029676+0000","last_became_active":"2024-09-11T22:20:19.862267+0000","last_became_peered":"2024-09-11T22:20:19.862267+0000","last_unstale":"2024-09-11T22:21:02.029676+0000","last_undegraded":"2024-09-11T22:21:02.029676+0000","last_fullsized":"2024-09-11T22:21:02.029676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227615+0000","last_change":"2024-09-11T22:20:18.858002+0000","last_active":"2024-09-11T22:21:02.227615+0000","last_peered":"2024-09-11T22:21:02.227615+0000","last_clean":"2024-09-11T22:21:02.227615+0000","last_became_active":"2024-09-11T22:20:18.857419+0000","last_became_peered":"2024-09-11T22:20:18.857419+0000","last_unstale":"2024-09-11T22:21:02.227615+0000","last_undegraded":"2024-09-11T22:21:02.227615+0000","last_fullsized":"2024-09-11T22:21:02.227615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033675+0000","last_change":"2024-09-11T22:20:24.074971+0000","last_active":"2024-09-11T22:21:02.033675+0000","last_peered":"2024-09-11T22:21:02.033675+0000","last_clean":"2024-09-11T22:21:02.033675+0000","last_became_active":"2024-09-11T22:20:24.074609+0000","last_became_peered":"2024-09-11T22:20:24.074609+0000","last_unstale":"2024-09-11T22:21:02.033675+0000","last_undegraded":"2024-09-11T22:21:02.033675+0000","last_fullsized":"2024-09-11T22:21:02.033675+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:55.318904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033588+0000","last_change":"2024-09-11T22:20:19.857276+0000","last_active":"2024-09-11T22:21:01.033588+0000","last_peered":"2024-09-11T22:21:01.033588+0000","last_clean":"2024-09-11T22:21:01.033588+0000","last_became_active":"2024-09-11T22:20:19.857027+0000","last_became_peered":"2024-09-11T22:20:19.857027+0000","last_unstale":"2024-09-11T22:21:01.033588+0000","last_undegraded":"2024-09-11T22:21:01.033588+0000","last_fullsized":"2024-09-11T22:21:01.033588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033832+0000","last_change":"2024-09-11T22:20:18.848671+0000","last_active":"2024-09-11T22:21:01.033832+0000","last_peered":"2024-09-11T22:21:01.033832+0000","last_clean":"2024-09-11T22:21:01.033832+0000","last_became_active":"2024-09-11T22:20:18.848405+0000","last_became_peered":"2024-09-11T22:20:18.848405+0000","last_unstale":"2024-09-11T22:21:01.033832+0000","last_undegraded":"2024-09-11T22:21:01.033832+0000","last_fullsized":"2024-09-11T22:21:01.033832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227859+0000","last_change":"2024-09-11T22:20:24.076835+0000","last_active":"2024-09-11T22:21:02.227859+0000","last_peered":"2024-09-11T22:21:02.227859+0000","last_clean":"2024-09-11T22:21:02.227859+0000","last_became_active":"2024-09-11T22:20:24.076200+0000","last_became_peered":"2024-09-11T22:20:24.076200+0000","last_unstale":"2024-09-11T22:21:02.227859+0000","last_undegraded":"2024-09-11T22:21:02.227859+0000","last_fullsized":"2024-09-11T22:21:02.227859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:48.150778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033502+0000","last_change":"2024-09-11T22:21:02.033502+0000","last_active":"2024-09-11T22:21:02.033502+0000","last_peered":"2024-09-11T22:21:02.033502+0000","last_clean":"2024-09-11T22:21:02.033502+0000","last_became_active":"2024-09-11T22:21:02.033269+0000","last_became_peered":"2024-09-11T22:21:02.033269+0000","last_unstale":"2024-09-11T22:21:02.033502+0000","last_undegraded":"2024-09-11T22:21:02.033502+0000","last_fullsized":"2024-09-11T22:21:02.033502+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:31.993239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'11","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026204+0000","last_change":"2024-09-11T22:20:18.855665+0000","last_active":"2024-09-11T22:21:02.026204+0000","last_peered":"2024-09-11T22:21:02.026204+0000","last_clean":"2024-09-11T22:21:02.026204+0000","last_became_active":"2024-09-11T22:20:18.855386+0000","last_became_peered":"2024-09-11T22:20:18.855386+0000","last_unstale":"2024-09-11T22:21:02.026204+0000","last_undegraded":"2024-09-11T22:21:02.026204+0000","last_fullsized":"2024-09-11T22:21:02.026204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029520+0000","last_change":"2024-09-11T22:20:23.880793+0000","last_active":"2024-09-11T22:21:02.029520+0000","last_peered":"2024-09-11T22:21:02.029520+0000","last_clean":"2024-09-11T22:21:02.029520+0000","last_became_active":"2024-09-11T22:20:23.879993+0000","last_became_peered":"2024-09-11T22:20:23.879993+0000","last_unstale":"2024-09-11T22:21:02.029520+0000","last_undegraded":"2024-09-11T22:21:02.029520+0000","last_fullsized":"2024-09-11T22:21:02.029520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:50.449090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029237+0000","last_change":"2024-09-11T22:20:19.858588+0000","last_active":"2024-09-11T22:21:02.029237+0000","last_peered":"2024-09-11T22:21:02.029237+0000","last_clean":"2024-09-11T22:21:02.029237+0000","last_became_active":"2024-09-11T22:20:19.858322+0000","last_became_peered":"2024-09-11T22:20:19.858322+0000","last_unstale":"2024-09-11T22:21:02.029237+0000","last_undegraded":"2024-09-11T22:21:02.029237+0000","last_fullsized":"2024-09-11T22:21:02.029237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030283+0000","last_change":"2024-09-11T22:20:18.855056+0000","last_active":"2024-09-11T22:21:02.030283+0000","last_peered":"2024-09-11T22:21:02.030283+0000","last_clean":"2024-09-11T22:21:02.030283+0000","last_became_active":"2024-09-11T22:20:18.854784+0000","last_became_peered":"2024-09-11T22:20:18.854784+0000","last_unstale":"2024-09-11T22:21:02.030283+0000","last_undegraded":"2024-09-11T22:21:02.030283+0000","last_fullsized":"2024-09-11T22:21:02.030283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:38.916121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028248+0000","last_change":"2024-09-11T22:20:23.879768+0000","last_active":"2024-09-11T22:21:02.028248+0000","last_peered":"2024-09-11T22:21:02.028248+0000","last_clean":"2024-09-11T22:21:02.028248+0000","last_became_active":"2024-09-11T22:20:23.878794+0000","last_became_peered":"2024-09-11T22:20:23.878794+0000","last_unstale":"2024-09-11T22:21:02.028248+0000","last_undegraded":"2024-09-11T22:21:02.028248+0000","last_fullsized":"2024-09-11T22:21:02.028248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:07.301587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-11T22:20:27.048280+0000","last_change":"2024-09-11T22:21:01.034302+0000","last_active":"2024-09-11T22:21:01.034302+0000","last_peered":"2024-09-11T22:20:27.048280+0000","last_clean":"2024-09-11T22:20:27.048280+0000","last_became_active":"2024-09-11T22:20:19.861607+0000","last_became_peered":"2024-09-11T22:20:19.861607+0000","last_unstale":"2024-09-11T22:20:27.048280+0000","last_undegraded":"2024-09-11T22:20:27.048280+0000","last_fullsized":"2024-09-11T22:20:27.048280+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.228018+0000","last_change":"2024-09-11T22:20:18.853382+0000","last_active":"2024-09-11T22:21:02.228018+0000","last_peered":"2024-09-11T22:21:02.228018+0000","last_clean":"2024-09-11T22:21:02.228018+0000","last_became_active":"2024-09-11T22:20:18.853103+0000","last_became_peered":"2024-09-11T22:20:18.853103+0000","last_unstale":"2024-09-11T22:21:02.228018+0000","last_undegraded":"2024-09-11T22:21:02.228018+0000","last_fullsized":"2024-09-11T22:21:02.228018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031422+0000","last_change":"2024-09-11T22:20:23.876997+0000","last_active":"2024-09-11T22:21:02.031422+0000","last_peered":"2024-09-11T22:21:02.031422+0000","last_clean":"2024-09-11T22:21:02.031422+0000","last_became_active":"2024-09-11T22:20:23.876587+0000","last_became_peered":"2024-09-11T22:20:23.876587+0000","last_unstale":"2024-09-11T22:21:02.031422+0000","last_undegraded":"2024-09-11T22:21:02.031422+0000","last_fullsized":"2024-09-11T22:21:02.031422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:19.670665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227988+0000","last_change":"2024-09-11T22:20:19.866624+0000","last_active":"2024-09-11T22:21:02.227988+0000","last_peered":"2024-09-11T22:21:02.227988+0000","last_clean":"2024-09-11T22:21:02.227988+0000","last_became_active":"2024-09-11T22:20:19.866303+0000","last_became_peered":"2024-09-11T22:20:19.866303+0000","last_unstale":"2024-09-11T22:21:02.227988+0000","last_undegraded":"2024-09-11T22:21:02.227988+0000","last_fullsized":"2024-09-11T22:21:02.227988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025963+0000","last_change":"2024-09-11T22:20:18.854361+0000","last_active":"2024-09-11T22:21:02.025963+0000","last_peered":"2024-09-11T22:21:02.025963+0000","last_clean":"2024-09-11T22:21:02.025963+0000","last_became_active":"2024-09-11T22:20:18.854019+0000","last_became_peered":"2024-09-11T22:20:18.854019+0000","last_unstale":"2024-09-11T22:21:02.025963+0000","last_undegraded":"2024-09-11T22:21:02.025963+0000","last_fullsized":"2024-09-11T22:21:02.025963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031134+0000","last_change":"2024-09-11T22:20:24.077476+0000","last_active":"2024-09-11T22:21:02.031134+0000","last_peered":"2024-09-11T22:21:02.031134+0000","last_clean":"2024-09-11T22:21:02.031134+0000","last_became_active":"2024-09-11T22:20:24.077134+0000","last_became_peered":"2024-09-11T22:20:24.077134+0000","last_unstale":"2024-09-11T22:21:02.031134+0000","last_undegraded":"2024-09-11T22:21:02.031134+0000","last_fullsized":"2024-09-11T22:21:02.031134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:03.186460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-11T22:20:27.048088+0000","last_change":"2024-09-11T22:21:01.033206+0000","last_active":"2024-09-11T22:21:01.033206+0000","last_peered":"2024-09-11T22:20:27.048088+0000","last_clean":"2024-09-11T22:20:27.048088+0000","last_became_active":"2024-09-11T22:20:24.076592+0000","last_became_peered":"2024-09-11T22:20:24.076592+0000","last_unstale":"2024-09-11T22:20:27.048088+0000","last_undegraded":"2024-09-11T22:20:27.048088+0000","last_fullsized":"2024-09-11T22:20:27.048088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2,3,7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029432+0000","last_change":"2024-09-11T22:20:19.845776+0000","last_active":"2024-09-11T22:21:02.029432+0000","last_peered":"2024-09-11T22:21:02.029432+0000","last_clean":"2024-09-11T22:21:02.029432+0000","last_became_active":"2024-09-11T22:20:19.845425+0000","last_became_peered":"2024-09-11T22:20:19.845425+0000","last_unstale":"2024-09-11T22:21:02.029432+0000","last_undegraded":"2024-09-11T22:21:02.029432+0000","last_fullsized":"2024-09-11T22:21:02.029432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:07.187533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227442+0000","last_change":"2024-09-11T22:20:18.852446+0000","last_active":"2024-09-11T22:21:02.227442+0000","last_peered":"2024-09-11T22:21:02.227442+0000","last_clean":"2024-09-11T22:21:02.227442+0000","last_became_active":"2024-09-11T22:20:18.852155+0000","last_became_peered":"2024-09-11T22:20:18.852155+0000","last_unstale":"2024-09-11T22:21:02.227442+0000","last_undegraded":"2024-09-11T22:21:02.227442+0000","last_fullsized":"2024-09-11T22:21:02.227442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025729+0000","last_change":"2024-09-11T22:20:23.876503+0000","last_active":"2024-09-11T22:21:02.025729+0000","last_peered":"2024-09-11T22:21:02.025729+0000","last_clean":"2024-09-11T22:21:02.025729+0000","last_became_active":"2024-09-11T22:20:23.876100+0000","last_became_peered":"2024-09-11T22:20:23.876100+0000","last_unstale":"2024-09-11T22:21:02.025729+0000","last_undegraded":"2024-09-11T22:21:02.025729+0000","last_fullsized":"2024-09-11T22:21:02.025729+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031526+0000","last_change":"2024-09-11T22:20:19.852606+0000","last_active":"2024-09-11T22:21:02.031526+0000","last_peered":"2024-09-11T22:21:02.031526+0000","last_clean":"2024-09-11T22:21:02.031526+0000","last_became_active":"2024-09-11T22:20:19.852333+0000","last_became_peered":"2024-09-11T22:20:19.852333+0000","last_unstale":"2024-09-11T22:21:02.031526+0000","last_undegraded":"2024-09-11T22:21:02.031526+0000","last_fullsized":"2024-09-11T22:21:02.031526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:56.940278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031424+0000","last_change":"2024-09-11T22:20:18.853767+0000","last_active":"2024-09-11T22:21:02.031424+0000","last_peered":"2024-09-11T22:21:02.031424+0000","last_clean":"2024-09-11T22:21:02.031424+0000","last_became_active":"2024-09-11T22:20:18.853533+0000","last_became_peered":"2024-09-11T22:20:18.853533+0000","last_unstale":"2024-09-11T22:21:02.031424+0000","last_undegraded":"2024-09-11T22:21:02.031424+0000","last_fullsized":"2024-09-11T22:21:02.031424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:36.662271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026157+0000","last_change":"2024-09-11T22:20:18.847133+0000","last_active":"2024-09-11T22:21:02.026157+0000","last_peered":"2024-09-11T22:21:02.026157+0000","last_clean":"2024-09-11T22:21:02.026157+0000","last_became_active":"2024-09-11T22:20:18.846321+0000","last_became_peered":"2024-09-11T22:20:18.846321+0000","last_unstale":"2024-09-11T22:21:02.026157+0000","last_undegraded":"2024-09-11T22:21:02.026157+0000","last_fullsized":"2024-09-11T22:21:02.026157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033751+0000","last_change":"2024-09-11T22:20:19.861445+0000","last_active":"2024-09-11T22:21:01.033751+0000","last_peered":"2024-09-11T22:21:01.033751+0000","last_clean":"2024-09-11T22:21:01.033751+0000","last_became_active":"2024-09-11T22:20:19.861154+0000","last_became_peered":"2024-09-11T22:20:19.861154+0000","last_unstale":"2024-09-11T22:21:01.033751+0000","last_undegraded":"2024-09-11T22:21:01.033751+0000","last_fullsized":"2024-09-11T22:21:01.033751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025275+0000","last_change":"2024-09-11T22:20:23.877973+0000","last_active":"2024-09-11T22:21:01.025275+0000","last_peered":"2024-09-11T22:21:01.025275+0000","last_clean":"2024-09-11T22:21:01.025275+0000","last_became_active":"2024-09-11T22:20:23.877578+0000","last_became_peered":"2024-09-11T22:20:23.877578+0000","last_unstale":"2024-09-11T22:21:01.025275+0000","last_undegraded":"2024-09-11T22:21:01.025275+0000","last_fullsized":"2024-09-11T22:21:01.025275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:27.826669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033802+0000","last_change":"2024-09-11T22:20:18.854142+0000","last_active":"2024-09-11T22:21:02.033802+0000","last_peered":"2024-09-11T22:21:02.033802+0000","last_clean":"2024-09-11T22:21:02.033802+0000","last_became_active":"2024-09-11T22:20:18.853872+0000","last_became_peered":"2024-09-11T22:20:18.853872+0000","last_unstale":"2024-09-11T22:21:02.033802+0000","last_undegraded":"2024-09-11T22:21:02.033802+0000","last_fullsized":"2024-09-11T22:21:02.033802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:22.513242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1065,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028251+0000","last_change":"2024-09-11T22:20:19.852580+0000","last_active":"2024-09-11T22:21:02.028251+0000","last_peered":"2024-09-11T22:21:02.028251+0000","last_clean":"2024-09-11T22:21:02.028251+0000","last_became_active":"2024-09-11T22:20:19.850175+0000","last_became_peered":"2024-09-11T22:20:19.850175+0000","last_unstale":"2024-09-11T22:21:02.028251+0000","last_undegraded":"2024-09-11T22:21:02.028251+0000","last_fullsized":"2024-09-11T22:21:02.028251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:11.937256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.032982+0000","last_change":"2024-09-11T22:20:23.878004+0000","last_active":"2024-09-11T22:21:02.032982+0000","last_peered":"2024-09-11T22:21:02.032982+0000","last_clean":"2024-09-11T22:21:02.032982+0000","last_became_active":"2024-09-11T22:20:23.876776+0000","last_became_peered":"2024-09-11T22:20:23.876776+0000","last_unstale":"2024-09-11T22:21:02.032982+0000","last_undegraded":"2024-09-11T22:21:02.032982+0000","last_fullsized":"2024-09-11T22:21:02.032982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:11.254248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025354+0000","last_change":"2024-09-11T22:20:19.853439+0000","last_active":"2024-09-11T22:21:02.025354+0000","last_peered":"2024-09-11T22:21:02.025354+0000","last_clean":"2024-09-11T22:21:02.025354+0000","last_became_active":"2024-09-11T22:20:19.852937+0000","last_became_peered":"2024-09-11T22:20:19.852937+0000","last_unstale":"2024-09-11T22:21:02.025354+0000","last_undegraded":"2024-09-11T22:21:02.025354+0000","last_fullsized":"2024-09-11T22:21:02.025354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025127+0000","last_change":"2024-09-11T22:20:19.861003+0000","last_active":"2024-09-11T22:21:01.025127+0000","last_peered":"2024-09-11T22:21:01.025127+0000","last_clean":"2024-09-11T22:21:01.025127+0000","last_became_active":"2024-09-11T22:20:19.860690+0000","last_became_peered":"2024-09-11T22:20:19.860690+0000","last_unstale":"2024-09-11T22:21:01.025127+0000","last_undegraded":"2024-09-11T22:21:01.025127+0000","last_fullsized":"2024-09-11T22:21:01.025127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227573+0000","last_change":"2024-09-11T22:20:19.856756+0000","last_active":"2024-09-11T22:21:02.227573+0000","last_peered":"2024-09-11T22:21:02.227573+0000","last_clean":"2024-09-11T22:21:02.227573+0000","last_became_active":"2024-09-11T22:20:19.856460+0000","last_became_peered":"2024-09-11T22:20:19.856460+0000","last_unstale":"2024-09-11T22:21:02.227573+0000","last_undegraded":"2024-09-11T22:21:02.227573+0000","last_fullsized":"2024-09-11T22:21:02.227573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033665+0000","last_change":"2024-09-11T22:20:19.855629+0000","last_active":"2024-09-11T22:21:01.033665+0000","last_peered":"2024-09-11T22:21:01.033665+0000","last_clean":"2024-09-11T22:21:01.033665+0000","last_became_active":"2024-09-11T22:20:19.855363+0000","last_became_peered":"2024-09-11T22:20:19.855363+0000","last_unstale":"2024-09-11T22:21:01.033665+0000","last_undegraded":"2024-09-11T22:21:01.033665+0000","last_fullsized":"2024-09-11T22:21:01.033665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033889+0000","last_change":"2024-09-11T22:20:19.863122+0000","last_active":"2024-09-11T22:21:02.033889+0000","last_peered":"2024-09-11T22:21:02.033889+0000","last_clean":"2024-09-11T22:21:02.033889+0000","last_became_active":"2024-09-11T22:20:19.862828+0000","last_became_peered":"2024-09-11T22:20:19.862828+0000","last_unstale":"2024-09-11T22:21:02.033889+0000","last_undegraded":"2024-09-11T22:21:02.033889+0000","last_fullsized":"2024-09-11T22:21:02.033889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:10.868762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030114+0000","last_change":"2024-09-11T22:20:19.846453+0000","last_active":"2024-09-11T22:21:02.030114+0000","last_peered":"2024-09-11T22:21:02.030114+0000","last_clean":"2024-09-11T22:21:02.030114+0000","last_became_active":"2024-09-11T22:20:19.846186+0000","last_became_peered":"2024-09-11T22:20:19.846186+0000","last_unstale":"2024-09-11T22:21:02.030114+0000","last_undegraded":"2024-09-11T22:21:02.030114+0000","last_fullsized":"2024-09-11T22:21:02.030114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:24.032365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026220+0000","last_change":"2024-09-11T22:20:19.860632+0000","last_active":"2024-09-11T22:21:02.026220+0000","last_peered":"2024-09-11T22:21:02.026220+0000","last_clean":"2024-09-11T22:21:02.026220+0000","last_became_active":"2024-09-11T22:20:19.860005+0000","last_became_peered":"2024-09-11T22:20:19.860005+0000","last_unstale":"2024-09-11T22:21:02.026220+0000","last_undegraded":"2024-09-11T22:21:02.026220+0000","last_fullsized":"2024-09-11T22:21:02.026220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033193+0000","last_change":"2024-09-11T22:20:19.859195+0000","last_active":"2024-09-11T22:21:02.033193+0000","last_peered":"2024-09-11T22:21:02.033193+0000","last_clean":"2024-09-11T22:21:02.033193+0000","last_became_active":"2024-09-11T22:20:19.858832+0000","last_became_peered":"2024-09-11T22:20:19.858832+0000","last_unstale":"2024-09-11T22:21:02.033193+0000","last_undegraded":"2024-09-11T22:21:02.033193+0000","last_fullsized":"2024-09-11T22:21:02.033193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:56.259074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227399+0000","last_change":"2024-09-11T22:20:19.858969+0000","last_active":"2024-09-11T22:21:02.227399+0000","last_peered":"2024-09-11T22:21:02.227399+0000","last_clean":"2024-09-11T22:21:02.227399+0000","last_became_active":"2024-09-11T22:20:19.857847+0000","last_became_peered":"2024-09-11T22:20:19.857847+0000","last_unstale":"2024-09-11T22:21:02.227399+0000","last_undegraded":"2024-09-11T22:21:02.227399+0000","last_fullsized":"2024-09-11T22:21:02.227399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031335+0000","last_change":"2024-09-11T22:20:19.863294+0000","last_active":"2024-09-11T22:21:02.031335+0000","last_peered":"2024-09-11T22:21:02.031335+0000","last_clean":"2024-09-11T22:21:02.031335+0000","last_became_active":"2024-09-11T22:20:19.863007+0000","last_became_peered":"2024-09-11T22:20:19.863007+0000","last_unstale":"2024-09-11T22:21:02.031335+0000","last_undegraded":"2024-09-11T22:21:02.031335+0000","last_fullsized":"2024-09-11T22:21:02.031335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:06.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227487+0000","last_change":"2024-09-11T22:20:19.858414+0000","last_active":"2024-09-11T22:21:02.227487+0000","last_peered":"2024-09-11T22:21:02.227487+0000","last_clean":"2024-09-11T22:21:02.227487+0000","last_became_active":"2024-09-11T22:20:19.857790+0000","last_became_peered":"2024-09-11T22:20:19.857790+0000","last_unstale":"2024-09-11T22:21:02.227487+0000","last_undegraded":"2024-09-11T22:21:02.227487+0000","last_fullsized":"2024-09-11T22:21:02.227487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":2,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-11T22:20:27.047940+0000","last_change":"2024-09-11T22:21:01.323256+0000","last_active":"2024-09-11T22:21:01.323256+0000","last_peered":"2024-09-11T22:20:27.047940+0000","last_clean":"2024-09-11T22:20:27.047940+0000","last_became_active":"2024-09-11T22:20:19.854774+0000","last_became_peered":"2024-09-11T22:20:19.854774+0000","last_unstale":"2024-09-11T22:20:27.047940+0000","last_undegraded":"2024-09-11T22:20:27.047940+0000","last_fullsized":"2024-09-11T22:20:27.047940+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026014+0000","last_change":"2024-09-11T22:20:19.864700+0000","last_active":"2024-09-11T22:21:02.026014+0000","last_peered":"2024-09-11T22:21:02.026014+0000","last_clean":"2024-09-11T22:21:02.026014+0000","last_became_active":"2024-09-11T22:20:19.862296+0000","last_became_peered":"2024-09-11T22:20:19.862296+0000","last_unstale":"2024-09-11T22:21:02.026014+0000","last_undegraded":"2024-09-11T22:21:02.026014+0000","last_fullsized":"2024-09-11T22:21:02.026014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030247+0000","last_change":"2024-09-11T22:20:19.855253+0000","last_active":"2024-09-11T22:21:02.030247+0000","last_peered":"2024-09-11T22:21:02.030247+0000","last_clean":"2024-09-11T22:21:02.030247+0000","last_became_active":"2024-09-11T22:20:19.854970+0000","last_became_peered":"2024-09-11T22:20:19.854970+0000","last_unstale":"2024-09-11T22:21:02.030247+0000","last_undegraded":"2024-09-11T22:21:02.030247+0000","last_fullsized":"2024-09-11T22:21:02.030247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025225+0000","last_change":"2024-09-11T22:20:19.850202+0000","last_active":"2024-09-11T22:21:01.025225+0000","last_peered":"2024-09-11T22:21:01.025225+0000","last_clean":"2024-09-11T22:21:01.025225+0000","last_became_active":"2024-09-11T22:20:19.849815+0000","last_became_peered":"2024-09-11T22:20:19.849815+0000","last_unstale":"2024-09-11T22:21:01.025225+0000","last_undegraded":"2024-09-11T22:21:01.025225+0000","last_fullsized":"2024-09-11T22:21:01.025225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:56.480679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.228172+0000","last_change":"2024-09-11T22:20:19.866864+0000","last_active":"2024-09-11T22:21:02.228172+0000","last_peered":"2024-09-11T22:21:02.228172+0000","last_clean":"2024-09-11T22:21:02.228172+0000","last_became_active":"2024-09-11T22:20:19.866484+0000","last_became_peered":"2024-09-11T22:20:19.866484+0000","last_unstale":"2024-09-11T22:21:02.228172+0000","last_undegraded":"2024-09-11T22:21:02.228172+0000","last_fullsized":"2024-09-11T22:21:02.228172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":2,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-11T22:20:19.847772+0000","last_change":"2024-09-11T22:21:01.323220+0000","last_active":"2024-09-11T22:20:18.828308+0000","last_peered":"2024-09-11T22:20:18.828308+0000","last_clean":"2024-09-11T22:20:18.828308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:19.847772+0000","last_undegraded":"2024-09-11T22:20:19.847772+0000","last_fullsized":"2024-09-11T22:20:19.847772+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029536+0000","last_change":"2024-09-11T22:20:19.860050+0000","last_active":"2024-09-11T22:21:02.029536+0000","last_peered":"2024-09-11T22:21:02.029536+0000","last_clean":"2024-09-11T22:21:02.029536+0000","last_became_active":"2024-09-11T22:20:19.859755+0000","last_became_peered":"2024-09-11T22:20:19.859755+0000","last_unstale":"2024-09-11T22:21:02.029536+0000","last_undegraded":"2024-09-11T22:21:02.029536+0000","last_fullsized":"2024-09-11T22:21:02.029536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:42.487669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033495+0000","last_change":"2024-09-11T22:20:19.853902+0000","last_active":"2024-09-11T22:21:01.033495+0000","last_peered":"2024-09-11T22:21:01.033495+0000","last_clean":"2024-09-11T22:21:01.033495+0000","last_became_active":"2024-09-11T22:20:19.853563+0000","last_became_peered":"2024-09-11T22:20:19.853563+0000","last_unstale":"2024-09-11T22:21:01.033495+0000","last_undegraded":"2024-09-11T22:21:01.033495+0000","last_fullsized":"2024-09-11T22:21:01.033495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033630+0000","last_change":"2024-09-11T22:20:19.849490+0000","last_active":"2024-09-11T22:21:02.033630+0000","last_peered":"2024-09-11T22:21:02.033630+0000","last_clean":"2024-09-11T22:21:02.033630+0000","last_became_active":"2024-09-11T22:20:19.848965+0000","last_became_peered":"2024-09-11T22:20:19.848965+0000","last_unstale":"2024-09-11T22:21:02.033630+0000","last_undegraded":"2024-09-11T22:21:02.033630+0000","last_fullsized":"2024-09-11T22:21:02.033630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:10.387663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029136+0000","last_change":"2024-09-11T22:20:19.860457+0000","last_active":"2024-09-11T22:21:02.029136+0000","last_peered":"2024-09-11T22:21:02.029136+0000","last_clean":"2024-09-11T22:21:02.029136+0000","last_became_active":"2024-09-11T22:20:19.858887+0000","last_became_peered":"2024-09-11T22:20:19.858887+0000","last_unstale":"2024-09-11T22:21:02.029136+0000","last_undegraded":"2024-09-11T22:21:02.029136+0000","last_fullsized":"2024-09-11T22:21:02.029136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:34.620956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026280+0000","last_change":"2024-09-11T22:20:19.862347+0000","last_active":"2024-09-11T22:21:02.026280+0000","last_peered":"2024-09-11T22:21:02.026280+0000","last_clean":"2024-09-11T22:21:02.026280+0000","last_became_active":"2024-09-11T22:20:19.861965+0000","last_became_peered":"2024-09-11T22:20:19.861965+0000","last_unstale":"2024-09-11T22:21:02.026280+0000","last_undegraded":"2024-09-11T22:21:02.026280+0000","last_fullsized":"2024-09-11T22:21:02.026280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026130+0000","last_change":"2024-09-11T22:20:19.862065+0000","last_active":"2024-09-11T22:21:02.026130+0000","last_peered":"2024-09-11T22:21:02.026130+0000","last_clean":"2024-09-11T22:21:02.026130+0000","last_became_active":"2024-09-11T22:20:19.861765+0000","last_became_peered":"2024-09-11T22:20:19.861765+0000","last_unstale":"2024-09-11T22:21:02.026130+0000","last_undegraded":"2024-09-11T22:21:02.026130+0000","last_fullsized":"2024-09-11T22:21:02.026130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030078+0000","last_change":"2024-09-11T22:20:19.865064+0000","last_active":"2024-09-11T22:21:02.030078+0000","last_peered":"2024-09-11T22:21:02.030078+0000","last_clean":"2024-09-11T22:21:02.030078+0000","last_became_active":"2024-09-11T22:20:19.864697+0000","last_became_peered":"2024-09-11T22:20:19.864697+0000","last_unstale":"2024-09-11T22:21:02.030078+0000","last_undegraded":"2024-09-11T22:21:02.030078+0000","last_fullsized":"2024-09-11T22:21:02.030078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031325+0000","last_change":"2024-09-11T22:20:19.861293+0000","last_active":"2024-09-11T22:21:02.031325+0000","last_peered":"2024-09-11T22:21:02.031325+0000","last_clean":"2024-09-11T22:21:02.031325+0000","last_became_active":"2024-09-11T22:20:19.861013+0000","last_became_peered":"2024-09-11T22:20:19.861013+0000","last_unstale":"2024-09-11T22:21:02.031325+0000","last_undegraded":"2024-09-11T22:21:02.031325+0000","last_fullsized":"2024-09-11T22:21:02.031325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:13.178404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029254+0000","last_change":"2024-09-11T22:20:19.858131+0000","last_active":"2024-09-11T22:21:02.029254+0000","last_peered":"2024-09-11T22:21:02.029254+0000","last_clean":"2024-09-11T22:21:02.029254+0000","last_became_active":"2024-09-11T22:20:19.857842+0000","last_became_peered":"2024-09-11T22:20:19.857842+0000","last_unstale":"2024-09-11T22:21:02.029254+0000","last_undegraded":"2024-09-11T22:21:02.029254+0000","last_fullsized":"2024-09-11T22:21:02.029254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227444+0000","last_change":"2024-09-11T22:20:19.859667+0000","last_active":"2024-09-11T22:21:02.227444+0000","last_peered":"2024-09-11T22:21:02.227444+0000","last_clean":"2024-09-11T22:21:02.227444+0000","last_became_active":"2024-09-11T22:20:19.859306+0000","last_became_peered":"2024-09-11T22:20:19.859306+0000","last_unstale":"2024-09-11T22:21:02.227444+0000","last_undegraded":"2024-09-11T22:21:02.227444+0000","last_fullsized":"2024-09-11T22:21:02.227444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029504+0000","last_change":"2024-09-11T22:20:19.848821+0000","last_active":"2024-09-11T22:21:02.029504+0000","last_peered":"2024-09-11T22:21:02.029504+0000","last_clean":"2024-09-11T22:21:02.029504+0000","last_became_active":"2024-09-11T22:20:19.848531+0000","last_became_peered":"2024-09-11T22:20:19.848531+0000","last_unstale":"2024-09-11T22:21:02.029504+0000","last_undegraded":"2024-09-11T22:21:02.029504+0000","last_fullsized":"2024-09-11T22:21:02.029504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227722+0000","last_change":"2024-09-11T22:20:19.866300+0000","last_active":"2024-09-11T22:21:02.227722+0000","last_peered":"2024-09-11T22:21:02.227722+0000","last_clean":"2024-09-11T22:21:02.227722+0000","last_became_active":"2024-09-11T22:20:19.865939+0000","last_became_peered":"2024-09-11T22:20:19.865939+0000","last_unstale":"2024-09-11T22:21:02.227722+0000","last_undegraded":"2024-09-11T22:21:02.227722+0000","last_fullsized":"2024-09-11T22:21:02.227722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033602+0000","last_change":"2024-09-11T22:20:19.858144+0000","last_active":"2024-09-11T22:21:01.033602+0000","last_peered":"2024-09-11T22:21:01.033602+0000","last_clean":"2024-09-11T22:21:01.033602+0000","last_became_active":"2024-09-11T22:20:19.857840+0000","last_became_peered":"2024-09-11T22:20:19.857840+0000","last_unstale":"2024-09-11T22:21:01.033602+0000","last_undegraded":"2024-09-11T22:21:01.033602+0000","last_fullsized":"2024-09-11T22:21:01.033602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:23.801072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029762+0000","last_change":"2024-09-11T22:20:19.857378+0000","last_active":"2024-09-11T22:21:02.029762+0000","last_peered":"2024-09-11T22:21:02.029762+0000","last_clean":"2024-09-11T22:21:02.029762+0000","last_became_active":"2024-09-11T22:20:19.857089+0000","last_became_peered":"2024-09-11T22:20:19.857089+0000","last_unstale":"2024-09-11T22:21:02.029762+0000","last_undegraded":"2024-09-11T22:21:02.029762+0000","last_fullsized":"2024-09-11T22:21:02.029762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:29.835695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":2,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-11T22:20:19.843776+0000","last_change":"2024-09-11T22:21:01.323294+0000","last_active":"2024-09-11T22:20:18.828308+0000","last_peered":"2024-09-11T22:20:18.828308+0000","last_clean":"2024-09-11T22:20:18.828308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:19.843776+0000","last_undegraded":"2024-09-11T22:20:19.843776+0000","last_fullsized":"2024-09-11T22:20:19.843776+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7897,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":380928,"data_stored":713645,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":315392,"data_stored":126040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":315392,"data_stored":122896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":311296,"data_stored":122232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":319488,"data_stored":126517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":108136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":698346,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":319488,"data_stored":122462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:21:06.877 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:21:07.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.010+0000 7f6195f86640 1 Processor -- start 2024-09-11T22:21:07.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.011+0000 7f6195f86640 1 -- start start 2024-09-11T22:21:07.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.011+0000 7f6195f86640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f619015abb0 0x7f61900ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:07.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.011+0000 7f6195f86640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61900cb1f0 con 0x7f61900ce2e0 2024-09-11T22:21:07.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.011+0000 7f6195f86640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61900cb4d0 con 0x7f61900ce6c0 2024-09-11T22:21:07.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.011+0000 7f6195f86640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f61900cb7b0 con 0x7f619015abb0 2024-09-11T22:21:07.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.012+0000 7f618f7fe640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f61900ce2e0 0x7f61900c3f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59630/0 (socket says 172.21.15.100:59630) 2024-09-11T22:21:07.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.011+0000 7f618effd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f619015abb0 0x7f61900ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:07.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.012+0000 7f618f7fe640 1 -- 172.21.15.100:0/3608832067 learned_addr learned my addr 172.21.15.100:0/3608832067 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:21:07.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.012+0000 7f618effd640 1 -- 172.21.15.100:0/3608832067 >> v1:172.21.15.167:6789/0 conn(0x7f61900ce6c0 legacy=0x7f6190157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:07.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.012+0000 7f618effd640 1 -- 172.21.15.100:0/3608832067 >> v1:172.21.15.100:6789/0 conn(0x7f61900ce2e0 legacy=0x7f61900c3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:07.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.012+0000 7f618effd640 1 -- 172.21.15.100:0/3608832067 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61900c3790 con 0x7f619015abb0 2024-09-11T22:21:07.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.012+0000 7f618e7fc640 1 -- 172.21.15.100:0/3608832067 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3162939087 0 0) 0x7f61900cb1f0 con 0x7f61900ce2e0 2024-09-11T22:21:07.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.012+0000 7f618effd640 1 --2- 172.21.15.100:0/3608832067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f619015abb0 0x7f61900ca560 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f61800097a0 tx=0x7f618002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436c08ad45ac54c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:07.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.013+0000 7f618e7fc640 1 -- 172.21.15.100:0/3608832067 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6180037070 con 0x7f619015abb0 2024-09-11T22:21:07.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.013+0000 7f618e7fc640 1 -- 172.21.15.100:0/3608832067 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6180032440 con 0x7f619015abb0 2024-09-11T22:21:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.013+0000 7f618e7fc640 1 -- 172.21.15.100:0/3608832067 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6180032810 con 0x7f619015abb0 2024-09-11T22:21:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.013+0000 7f6195f86640 1 -- 172.21.15.100:0/3608832067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f619015abb0 msgr2=0x7f61900ca560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.013+0000 7f6195f86640 1 --2- 172.21.15.100:0/3608832067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f619015abb0 0x7f61900ca560 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f61800097a0 tx=0x7f618002a270 comp rx=0 tx=0).stop 2024-09-11T22:21:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.013+0000 7f6195f86640 1 -- 172.21.15.100:0/3608832067 shutdown_connections 2024-09-11T22:21:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.013+0000 7f6195f86640 1 --2- 172.21.15.100:0/3608832067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f619015abb0 0x7f61900ca560 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.013+0000 7f6195f86640 1 -- 172.21.15.100:0/3608832067 >> 172.21.15.100:0/3608832067 conn(0x7f6190073920 msgr2=0x7f6190073d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.013+0000 7f6195f86640 1 -- 172.21.15.100:0/3608832067 shutdown_connections 2024-09-11T22:21:07.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.013+0000 7f6195f86640 1 -- 172.21.15.100:0/3608832067 wait complete. 2024-09-11T22:21:07.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.014+0000 7f6195f86640 1 Processor -- start 2024-09-11T22:21:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.015+0000 7f6195f86640 1 -- start start 2024-09-11T22:21:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.015+0000 7f6195f86640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61900ce2e0 0x7f61900c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.015+0000 7f6195f86640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61900ce6c0 0x7f61901f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.015+0000 7f6195f86640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f619015abb0 0x7f61901f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.015+0000 7f6195f86640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f61900c4820 con 0x7f61900ce2e0 2024-09-11T22:21:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.015+0000 7f6195f86640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f61900c46a0 con 0x7f619015abb0 2024-09-11T22:21:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.015+0000 7f6195f86640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f61901f47e0 con 0x7f61900ce6c0 2024-09-11T22:21:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.015+0000 7f618f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61900ce2e0 0x7f61900c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.015+0000 7f618f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61900ce2e0 0x7f61900c9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38034/0 (socket says 172.21.15.100:38034) 2024-09-11T22:21:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.015+0000 7f618f7fe640 1 -- 172.21.15.100:0/953623364 learned_addr learned my addr 172.21.15.100:0/953623364 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.015+0000 7f618effd640 1 --2- 172.21.15.100:0/953623364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61900ce6c0 0x7f61901f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.016+0000 7f618ffff640 1 --2- 172.21.15.100:0/953623364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f619015abb0 0x7f61901f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:07.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.016+0000 7f618f7fe640 1 -- 172.21.15.100:0/953623364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61900ce6c0 msgr2=0x7f61901f06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.016+0000 7f618f7fe640 1 --2- 172.21.15.100:0/953623364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61900ce6c0 0x7f61901f06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.016+0000 7f618f7fe640 1 -- 172.21.15.100:0/953623364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f619015abb0 msgr2=0x7f61901f0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.016+0000 7f618f7fe640 1 --2- 172.21.15.100:0/953623364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f619015abb0 0x7f61901f0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.016+0000 7f618f7fe640 1 -- 172.21.15.100:0/953623364 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61900cbee0 con 0x7f61900ce2e0 2024-09-11T22:21:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.016+0000 7f618ffff640 1 --2- 172.21.15.100:0/953623364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f619015abb0 0x7f61901f0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.016+0000 7f618f7fe640 1 --2- 172.21.15.100:0/953623364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61900ce2e0 0x7f61900c9b50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f617800c4d0 tx=0x7f617800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.016+0000 7f6187fff640 1 -- 172.21.15.100:0/953623364 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6178018070 con 0x7f61900ce2e0 2024-09-11T22:21:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.016+0000 7f6187fff640 1 -- 172.21.15.100:0/953623364 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6178007500 con 0x7f61900ce2e0 2024-09-11T22:21:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.016+0000 7f6195f86640 1 -- 172.21.15.100:0/953623364 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61900cc180 con 0x7f61900ce2e0 2024-09-11T22:21:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.016+0000 7f6187fff640 1 -- 172.21.15.100:0/953623364 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6178004a20 con 0x7f61900ce2e0 2024-09-11T22:21:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.016+0000 7f6195f86640 1 -- 172.21.15.100:0/953623364 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61901f3eb0 con 0x7f61900ce2e0 2024-09-11T22:21:07.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.017+0000 7f6195f86640 1 -- 172.21.15.100:0/953623364 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61900c4d70 con 0x7f61900ce2e0 2024-09-11T22:21:07.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.018+0000 7f6187fff640 1 -- 172.21.15.100:0/953623364 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f617801b070 con 0x7f61900ce2e0 2024-09-11T22:21:07.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.018+0000 7f6187fff640 1 --2- 172.21.15.100:0/953623364 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f617006be60 0x7f617006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:07.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.018+0000 7f6187fff640 1 -- 172.21.15.100:0/953623364 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f617808a5b0 con 0x7f61900ce2e0 2024-09-11T22:21:07.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.018+0000 7f618effd640 1 --2- 172.21.15.100:0/953623364 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f617006be60 0x7f617006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:07.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.019+0000 7f618effd640 1 --2- 172.21.15.100:0/953623364 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f617006be60 0x7f617006e320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6180034000 tx=0x7f618002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:07.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.022+0000 7f6187fff640 1 -- 172.21.15.100:0/953623364 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f61900c4d70 con 0x7f61900ce2e0 2024-09-11T22:21:07.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.185+0000 7f6195f86640 1 -- 172.21.15.100:0/953623364 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f61900c3f90 con 0x7f617006be60 2024-09-11T22:21:07.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.193+0000 7f6187fff640 1 -- 172.21.15.100:0/953623364 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332445 (secure 0 0 0) 0x7f61900c3f90 con 0x7f617006be60 2024-09-11T22:21:07.197 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:21:07.199 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-11T22:21:07.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.196+0000 7f6195f86640 1 -- 172.21.15.100:0/953623364 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f617006be60 msgr2=0x7f617006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:07.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.196+0000 7f6195f86640 1 --2- 172.21.15.100:0/953623364 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f617006be60 0x7f617006e320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6180034000 tx=0x7f618002e000 comp rx=0 tx=0).stop 2024-09-11T22:21:07.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.196+0000 7f6195f86640 1 -- 172.21.15.100:0/953623364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61900ce2e0 msgr2=0x7f61900c9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:07.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.196+0000 7f6195f86640 1 --2- 172.21.15.100:0/953623364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61900ce2e0 0x7f61900c9b50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f617800c4d0 tx=0x7f617800c990 comp rx=0 tx=0).stop 2024-09-11T22:21:07.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.196+0000 7f6195f86640 1 -- 172.21.15.100:0/953623364 shutdown_connections 2024-09-11T22:21:07.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.196+0000 7f6195f86640 1 --2- 172.21.15.100:0/953623364 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f617006be60 0x7f617006e320 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.196+0000 7f6195f86640 1 --2- 172.21.15.100:0/953623364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f619015abb0 0x7f61901f0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.196+0000 7f6195f86640 1 --2- 172.21.15.100:0/953623364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61900ce6c0 0x7f61901f06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.196+0000 7f6195f86640 1 --2- 172.21.15.100:0/953623364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61900ce2e0 0x7f61900c9b50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.196+0000 7f6195f86640 1 -- 172.21.15.100:0/953623364 >> 172.21.15.100:0/953623364 conn(0x7f6190073920 msgr2=0x7f6190159020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:07.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.196+0000 7f6195f86640 1 -- 172.21.15.100:0/953623364 shutdown_connections 2024-09-11T22:21:07.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.196+0000 7f6195f86640 1 -- 172.21.15.100:0/953623364 wait complete. 2024-09-11T22:21:07.208 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-09-11T22:21:06.314848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598265,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":319,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218784,"kb_used_data":2544,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755936,"statfs":{"total":773094113280,"available":772870078464,"internally_reserved":0,"allocated":2605056,"data_stored":2140274,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":443,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001744"},"pg_stats":[{"pgid":"2.1f","version":"26'9","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.034259+0000","last_change":"2024-09-11T22:20:18.853007+0000","last_active":"2024-09-11T22:21:01.034259+0000","last_peered":"2024-09-11T22:21:01.034259+0000","last_clean":"2024-09-11T22:21:01.034259+0000","last_became_active":"2024-09-11T22:20:18.852740+0000","last_became_peered":"2024-09-11T22:20:18.852740+0000","last_unstale":"2024-09-11T22:21:01.034259+0000","last_undegraded":"2024-09-11T22:21:01.034259+0000","last_fullsized":"2024-09-11T22:21:01.034259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:46.710328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033072+0000","last_change":"2024-09-11T22:20:19.849765+0000","last_active":"2024-09-11T22:21:02.033072+0000","last_peered":"2024-09-11T22:21:02.033072+0000","last_clean":"2024-09-11T22:21:02.033072+0000","last_became_active":"2024-09-11T22:20:19.848619+0000","last_became_peered":"2024-09-11T22:20:19.848619+0000","last_unstale":"2024-09-11T22:21:02.033072+0000","last_undegraded":"2024-09-11T22:21:02.033072+0000","last_fullsized":"2024-09-11T22:21:02.033072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:57.621624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031037+0000","last_change":"2024-09-11T22:20:24.078618+0000","last_active":"2024-09-11T22:21:02.031037+0000","last_peered":"2024-09-11T22:21:02.031037+0000","last_clean":"2024-09-11T22:21:02.031037+0000","last_became_active":"2024-09-11T22:20:24.078283+0000","last_became_peered":"2024-09-11T22:20:24.078283+0000","last_unstale":"2024-09-11T22:21:02.031037+0000","last_undegraded":"2024-09-11T22:21:02.031037+0000","last_fullsized":"2024-09-11T22:21:02.031037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:01.901307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033270+0000","last_change":"2024-09-11T22:20:18.855945+0000","last_active":"2024-09-11T22:21:02.033270+0000","last_peered":"2024-09-11T22:21:02.033270+0000","last_clean":"2024-09-11T22:21:02.033270+0000","last_became_active":"2024-09-11T22:20:18.854811+0000","last_became_peered":"2024-09-11T22:20:18.854811+0000","last_unstale":"2024-09-11T22:21:02.033270+0000","last_undegraded":"2024-09-11T22:21:02.033270+0000","last_fullsized":"2024-09-11T22:21:02.033270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:47.508920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033442+0000","last_change":"2024-09-11T22:20:19.862436+0000","last_active":"2024-09-11T22:21:01.033442+0000","last_peered":"2024-09-11T22:21:01.033442+0000","last_clean":"2024-09-11T22:21:01.033442+0000","last_became_active":"2024-09-11T22:20:19.862061+0000","last_became_peered":"2024-09-11T22:20:19.862061+0000","last_unstale":"2024-09-11T22:21:01.033442+0000","last_undegraded":"2024-09-11T22:21:01.033442+0000","last_fullsized":"2024-09-11T22:21:01.033442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028431+0000","last_change":"2024-09-11T22:20:23.879729+0000","last_active":"2024-09-11T22:21:02.028431+0000","last_peered":"2024-09-11T22:21:02.028431+0000","last_clean":"2024-09-11T22:21:02.028431+0000","last_became_active":"2024-09-11T22:20:23.879245+0000","last_became_peered":"2024-09-11T22:20:23.879245+0000","last_unstale":"2024-09-11T22:21:02.028431+0000","last_undegraded":"2024-09-11T22:21:02.028431+0000","last_fullsized":"2024-09-11T22:21:02.028431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:36.836842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030157+0000","last_change":"2024-09-11T22:20:18.853076+0000","last_active":"2024-09-11T22:21:02.030157+0000","last_peered":"2024-09-11T22:21:02.030157+0000","last_clean":"2024-09-11T22:21:02.030157+0000","last_became_active":"2024-09-11T22:20:18.852728+0000","last_became_peered":"2024-09-11T22:20:18.852728+0000","last_unstale":"2024-09-11T22:21:02.030157+0000","last_undegraded":"2024-09-11T22:21:02.030157+0000","last_fullsized":"2024-09-11T22:21:02.030157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227771+0000","last_change":"2024-09-11T22:20:19.864544+0000","last_active":"2024-09-11T22:21:02.227771+0000","last_peered":"2024-09-11T22:21:02.227771+0000","last_clean":"2024-09-11T22:21:02.227771+0000","last_became_active":"2024-09-11T22:20:19.864234+0000","last_became_peered":"2024-09-11T22:20:19.864234+0000","last_unstale":"2024-09-11T22:21:02.227771+0000","last_undegraded":"2024-09-11T22:21:02.227771+0000","last_fullsized":"2024-09-11T22:21:02.227771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028549+0000","last_change":"2024-09-11T22:20:23.873783+0000","last_active":"2024-09-11T22:21:02.028549+0000","last_peered":"2024-09-11T22:21:02.028549+0000","last_clean":"2024-09-11T22:21:02.028549+0000","last_became_active":"2024-09-11T22:20:23.873385+0000","last_became_peered":"2024-09-11T22:20:23.873385+0000","last_unstale":"2024-09-11T22:21:02.028549+0000","last_undegraded":"2024-09-11T22:21:02.028549+0000","last_fullsized":"2024-09-11T22:21:02.028549+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029609+0000","last_change":"2024-09-11T22:20:18.861530+0000","last_active":"2024-09-11T22:21:02.029609+0000","last_peered":"2024-09-11T22:21:02.029609+0000","last_clean":"2024-09-11T22:21:02.029609+0000","last_became_active":"2024-09-11T22:20:18.861230+0000","last_became_peered":"2024-09-11T22:20:18.861230+0000","last_unstale":"2024-09-11T22:21:02.029609+0000","last_undegraded":"2024-09-11T22:21:02.029609+0000","last_fullsized":"2024-09-11T22:21:02.029609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227926+0000","last_change":"2024-09-11T22:20:19.863401+0000","last_active":"2024-09-11T22:21:02.227926+0000","last_peered":"2024-09-11T22:21:02.227926+0000","last_clean":"2024-09-11T22:21:02.227926+0000","last_became_active":"2024-09-11T22:20:19.863127+0000","last_became_peered":"2024-09-11T22:20:19.863127+0000","last_unstale":"2024-09-11T22:21:02.227926+0000","last_undegraded":"2024-09-11T22:21:02.227926+0000","last_fullsized":"2024-09-11T22:21:02.227926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:36.888544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028135+0000","last_change":"2024-09-11T22:20:23.874650+0000","last_active":"2024-09-11T22:21:02.028135+0000","last_peered":"2024-09-11T22:21:02.028135+0000","last_clean":"2024-09-11T22:21:02.028135+0000","last_became_active":"2024-09-11T22:20:23.874040+0000","last_became_peered":"2024-09-11T22:20:23.874040+0000","last_unstale":"2024-09-11T22:21:02.028135+0000","last_undegraded":"2024-09-11T22:21:02.028135+0000","last_fullsized":"2024-09-11T22:21:02.028135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025493+0000","last_change":"2024-09-11T22:20:19.859446+0000","last_active":"2024-09-11T22:21:02.025493+0000","last_peered":"2024-09-11T22:21:02.025493+0000","last_clean":"2024-09-11T22:21:02.025493+0000","last_became_active":"2024-09-11T22:20:19.859106+0000","last_became_peered":"2024-09-11T22:20:19.859106+0000","last_unstale":"2024-09-11T22:21:02.025493+0000","last_undegraded":"2024-09-11T22:21:02.025493+0000","last_fullsized":"2024-09-11T22:21:02.025493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029766+0000","last_change":"2024-09-11T22:20:18.856475+0000","last_active":"2024-09-11T22:21:02.029766+0000","last_peered":"2024-09-11T22:21:02.029766+0000","last_clean":"2024-09-11T22:21:02.029766+0000","last_became_active":"2024-09-11T22:20:18.856165+0000","last_became_peered":"2024-09-11T22:20:18.856165+0000","last_unstale":"2024-09-11T22:21:02.029766+0000","last_undegraded":"2024-09-11T22:21:02.029766+0000","last_fullsized":"2024-09-11T22:21:02.029766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028970+0000","last_change":"2024-09-11T22:20:23.878121+0000","last_active":"2024-09-11T22:21:02.028970+0000","last_peered":"2024-09-11T22:21:02.028970+0000","last_clean":"2024-09-11T22:21:02.028970+0000","last_became_active":"2024-09-11T22:20:23.877713+0000","last_became_peered":"2024-09-11T22:20:23.877713+0000","last_unstale":"2024-09-11T22:21:02.028970+0000","last_undegraded":"2024-09-11T22:21:02.028970+0000","last_fullsized":"2024-09-11T22:21:02.028970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033716+0000","last_change":"2024-09-11T22:20:19.858358+0000","last_active":"2024-09-11T22:21:02.033716+0000","last_peered":"2024-09-11T22:21:02.033716+0000","last_clean":"2024-09-11T22:21:02.033716+0000","last_became_active":"2024-09-11T22:20:19.858057+0000","last_became_peered":"2024-09-11T22:20:19.858057+0000","last_unstale":"2024-09-11T22:21:02.033716+0000","last_undegraded":"2024-09-11T22:21:02.033716+0000","last_fullsized":"2024-09-11T22:21:02.033716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:07.839926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029718+0000","last_change":"2024-09-11T22:20:18.853818+0000","last_active":"2024-09-11T22:21:02.029718+0000","last_peered":"2024-09-11T22:21:02.029718+0000","last_clean":"2024-09-11T22:21:02.029718+0000","last_became_active":"2024-09-11T22:20:18.853508+0000","last_became_peered":"2024-09-11T22:20:18.853508+0000","last_unstale":"2024-09-11T22:21:02.029718+0000","last_undegraded":"2024-09-11T22:21:02.029718+0000","last_fullsized":"2024-09-11T22:21:02.029718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:58.141587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.037670+0000","last_change":"2024-09-11T22:21:02.037670+0000","last_active":"2024-09-11T22:21:02.037670+0000","last_peered":"2024-09-11T22:21:02.037670+0000","last_clean":"2024-09-11T22:21:02.037670+0000","last_became_active":"2024-09-11T22:21:02.036941+0000","last_became_peered":"2024-09-11T22:21:02.036941+0000","last_unstale":"2024-09-11T22:21:02.037670+0000","last_undegraded":"2024-09-11T22:21:02.037670+0000","last_fullsized":"2024-09-11T22:21:02.037670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:20.859515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031746+0000","last_change":"2024-09-11T22:20:19.844748+0000","last_active":"2024-09-11T22:21:02.031746+0000","last_peered":"2024-09-11T22:21:02.031746+0000","last_clean":"2024-09-11T22:21:02.031746+0000","last_became_active":"2024-09-11T22:20:19.844446+0000","last_became_peered":"2024-09-11T22:20:19.844446+0000","last_unstale":"2024-09-11T22:21:02.031746+0000","last_undegraded":"2024-09-11T22:21:02.031746+0000","last_fullsized":"2024-09-11T22:21:02.031746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:13.319918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029638+0000","last_change":"2024-09-11T22:20:18.847388+0000","last_active":"2024-09-11T22:21:02.029638+0000","last_peered":"2024-09-11T22:21:02.029638+0000","last_clean":"2024-09-11T22:21:02.029638+0000","last_became_active":"2024-09-11T22:20:18.847118+0000","last_became_peered":"2024-09-11T22:20:18.847118+0000","last_unstale":"2024-09-11T22:21:02.029638+0000","last_undegraded":"2024-09-11T22:21:02.029638+0000","last_fullsized":"2024-09-11T22:21:02.029638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:47.360920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029161+0000","last_change":"2024-09-11T22:20:24.077604+0000","last_active":"2024-09-11T22:21:02.029161+0000","last_peered":"2024-09-11T22:21:02.029161+0000","last_clean":"2024-09-11T22:21:02.029161+0000","last_became_active":"2024-09-11T22:20:24.077231+0000","last_became_peered":"2024-09-11T22:20:24.077231+0000","last_unstale":"2024-09-11T22:21:02.029161+0000","last_undegraded":"2024-09-11T22:21:02.029161+0000","last_fullsized":"2024-09-11T22:21:02.029161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:38.846688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028259+0000","last_change":"2024-09-11T22:20:19.854453+0000","last_active":"2024-09-11T22:21:02.028259+0000","last_peered":"2024-09-11T22:21:02.028259+0000","last_clean":"2024-09-11T22:21:02.028259+0000","last_became_active":"2024-09-11T22:20:19.854100+0000","last_became_peered":"2024-09-11T22:20:19.854100+0000","last_unstale":"2024-09-11T22:21:02.028259+0000","last_undegraded":"2024-09-11T22:21:02.028259+0000","last_fullsized":"2024-09-11T22:21:02.028259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:06.166813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029113+0000","last_change":"2024-09-11T22:20:18.854889+0000","last_active":"2024-09-11T22:21:02.029113+0000","last_peered":"2024-09-11T22:21:02.029113+0000","last_clean":"2024-09-11T22:21:02.029113+0000","last_became_active":"2024-09-11T22:20:18.854552+0000","last_became_peered":"2024-09-11T22:20:18.854552+0000","last_unstale":"2024-09-11T22:21:02.029113+0000","last_undegraded":"2024-09-11T22:21:02.029113+0000","last_fullsized":"2024-09-11T22:21:02.029113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:33.612126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028918+0000","last_change":"2024-09-11T22:20:23.878932+0000","last_active":"2024-09-11T22:21:02.028918+0000","last_peered":"2024-09-11T22:21:02.028918+0000","last_clean":"2024-09-11T22:21:02.028918+0000","last_became_active":"2024-09-11T22:20:23.878305+0000","last_became_peered":"2024-09-11T22:20:23.878305+0000","last_unstale":"2024-09-11T22:21:02.028918+0000","last_undegraded":"2024-09-11T22:21:02.028918+0000","last_fullsized":"2024-09-11T22:21:02.028918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033835+0000","last_change":"2024-09-11T22:20:19.856318+0000","last_active":"2024-09-11T22:21:01.033835+0000","last_peered":"2024-09-11T22:21:01.033835+0000","last_clean":"2024-09-11T22:21:01.033835+0000","last_became_active":"2024-09-11T22:20:19.855992+0000","last_became_peered":"2024-09-11T22:20:19.855992+0000","last_unstale":"2024-09-11T22:21:01.033835+0000","last_undegraded":"2024-09-11T22:21:01.033835+0000","last_fullsized":"2024-09-11T22:21:01.033835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:57.709140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026101+0000","last_change":"2024-09-11T22:20:18.850750+0000","last_active":"2024-09-11T22:21:02.026101+0000","last_peered":"2024-09-11T22:21:02.026101+0000","last_clean":"2024-09-11T22:21:02.026101+0000","last_became_active":"2024-09-11T22:20:18.849621+0000","last_became_peered":"2024-09-11T22:20:18.849621+0000","last_unstale":"2024-09-11T22:21:02.026101+0000","last_undegraded":"2024-09-11T22:21:02.026101+0000","last_fullsized":"2024-09-11T22:21:02.026101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028034+0000","last_change":"2024-09-11T22:20:24.077741+0000","last_active":"2024-09-11T22:21:02.028034+0000","last_peered":"2024-09-11T22:21:02.028034+0000","last_clean":"2024-09-11T22:21:02.028034+0000","last_became_active":"2024-09-11T22:20:24.077325+0000","last_became_peered":"2024-09-11T22:20:24.077325+0000","last_unstale":"2024-09-11T22:21:02.028034+0000","last_undegraded":"2024-09-11T22:21:02.028034+0000","last_fullsized":"2024-09-11T22:21:02.028034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:18.656529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033274+0000","last_change":"2024-09-11T22:20:19.850738+0000","last_active":"2024-09-11T22:21:02.033274+0000","last_peered":"2024-09-11T22:21:02.033274+0000","last_clean":"2024-09-11T22:21:02.033274+0000","last_became_active":"2024-09-11T22:20:19.850441+0000","last_became_peered":"2024-09-11T22:20:19.850441+0000","last_unstale":"2024-09-11T22:21:02.033274+0000","last_undegraded":"2024-09-11T22:21:02.033274+0000","last_fullsized":"2024-09-11T22:21:02.033274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:47.552343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029867+0000","last_change":"2024-09-11T22:20:18.845173+0000","last_active":"2024-09-11T22:21:02.029867+0000","last_peered":"2024-09-11T22:21:02.029867+0000","last_clean":"2024-09-11T22:21:02.029867+0000","last_became_active":"2024-09-11T22:20:18.844731+0000","last_became_peered":"2024-09-11T22:20:18.844731+0000","last_unstale":"2024-09-11T22:21:02.029867+0000","last_undegraded":"2024-09-11T22:21:02.029867+0000","last_fullsized":"2024-09-11T22:21:02.029867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:32.963285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.037927+0000","last_change":"2024-09-11T22:21:02.037927+0000","last_active":"2024-09-11T22:21:02.037927+0000","last_peered":"2024-09-11T22:21:02.037927+0000","last_clean":"2024-09-11T22:21:02.037927+0000","last_became_active":"2024-09-11T22:21:02.037520+0000","last_became_peered":"2024-09-11T22:21:02.037520+0000","last_unstale":"2024-09-11T22:21:02.037927+0000","last_undegraded":"2024-09-11T22:21:02.037927+0000","last_fullsized":"2024-09-11T22:21:02.037927+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:38.798530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.032044+0000","last_change":"2024-09-11T22:20:19.845497+0000","last_active":"2024-09-11T22:21:02.032044+0000","last_peered":"2024-09-11T22:21:02.032044+0000","last_clean":"2024-09-11T22:21:02.032044+0000","last_became_active":"2024-09-11T22:20:19.845203+0000","last_became_peered":"2024-09-11T22:20:19.845203+0000","last_unstale":"2024-09-11T22:21:02.032044+0000","last_undegraded":"2024-09-11T22:21:02.032044+0000","last_fullsized":"2024-09-11T22:21:02.032044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:12.086231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030346+0000","last_change":"2024-09-11T22:20:18.856263+0000","last_active":"2024-09-11T22:21:02.030346+0000","last_peered":"2024-09-11T22:21:02.030346+0000","last_clean":"2024-09-11T22:21:02.030346+0000","last_became_active":"2024-09-11T22:20:18.855968+0000","last_became_peered":"2024-09-11T22:20:18.855968+0000","last_unstale":"2024-09-11T22:21:02.030346+0000","last_undegraded":"2024-09-11T22:21:02.030346+0000","last_fullsized":"2024-09-11T22:21:02.030346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033466+0000","last_change":"2024-09-11T22:20:24.075030+0000","last_active":"2024-09-11T22:21:01.033466+0000","last_peered":"2024-09-11T22:21:01.033466+0000","last_clean":"2024-09-11T22:21:01.033466+0000","last_became_active":"2024-09-11T22:20:24.074588+0000","last_became_peered":"2024-09-11T22:20:24.074588+0000","last_unstale":"2024-09-11T22:21:01.033466+0000","last_undegraded":"2024-09-11T22:21:01.033466+0000","last_fullsized":"2024-09-11T22:21:01.033466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227987+0000","last_change":"2024-09-11T22:20:19.859010+0000","last_active":"2024-09-11T22:21:02.227987+0000","last_peered":"2024-09-11T22:21:02.227987+0000","last_clean":"2024-09-11T22:21:02.227987+0000","last_became_active":"2024-09-11T22:20:19.858585+0000","last_became_peered":"2024-09-11T22:20:19.858585+0000","last_unstale":"2024-09-11T22:21:02.227987+0000","last_undegraded":"2024-09-11T22:21:02.227987+0000","last_fullsized":"2024-09-11T22:21:02.227987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.032132+0000","last_change":"2024-09-11T22:20:18.847904+0000","last_active":"2024-09-11T22:21:02.032132+0000","last_peered":"2024-09-11T22:21:02.032132+0000","last_clean":"2024-09-11T22:21:02.032132+0000","last_became_active":"2024-09-11T22:20:18.847669+0000","last_became_peered":"2024-09-11T22:20:18.847669+0000","last_unstale":"2024-09-11T22:21:02.032132+0000","last_undegraded":"2024-09-11T22:21:02.032132+0000","last_fullsized":"2024-09-11T22:21:02.032132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:08.717999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029308+0000","last_change":"2024-09-11T22:20:23.881067+0000","last_active":"2024-09-11T22:21:02.029308+0000","last_peered":"2024-09-11T22:21:02.029308+0000","last_clean":"2024-09-11T22:21:02.029308+0000","last_became_active":"2024-09-11T22:20:23.880468+0000","last_became_peered":"2024-09-11T22:20:23.880468+0000","last_unstale":"2024-09-11T22:21:02.029308+0000","last_undegraded":"2024-09-11T22:21:02.029308+0000","last_fullsized":"2024-09-11T22:21:02.029308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:23.480547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028714+0000","last_change":"2024-09-11T22:20:19.860423+0000","last_active":"2024-09-11T22:21:02.028714+0000","last_peered":"2024-09-11T22:21:02.028714+0000","last_clean":"2024-09-11T22:21:02.028714+0000","last_became_active":"2024-09-11T22:20:19.858932+0000","last_became_peered":"2024-09-11T22:20:19.858932+0000","last_unstale":"2024-09-11T22:21:02.028714+0000","last_undegraded":"2024-09-11T22:21:02.028714+0000","last_fullsized":"2024-09-11T22:21:02.028714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:53.255932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227699+0000","last_change":"2024-09-11T22:20:18.854973+0000","last_active":"2024-09-11T22:21:02.227699+0000","last_peered":"2024-09-11T22:21:02.227699+0000","last_clean":"2024-09-11T22:21:02.227699+0000","last_became_active":"2024-09-11T22:20:18.854725+0000","last_became_peered":"2024-09-11T22:20:18.854725+0000","last_unstale":"2024-09-11T22:21:02.227699+0000","last_undegraded":"2024-09-11T22:21:02.227699+0000","last_fullsized":"2024-09-11T22:21:02.227699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031943+0000","last_change":"2024-09-11T22:20:23.880693+0000","last_active":"2024-09-11T22:21:02.031943+0000","last_peered":"2024-09-11T22:21:02.031943+0000","last_clean":"2024-09-11T22:21:02.031943+0000","last_became_active":"2024-09-11T22:20:23.880243+0000","last_became_peered":"2024-09-11T22:20:23.880243+0000","last_unstale":"2024-09-11T22:21:02.031943+0000","last_undegraded":"2024-09-11T22:21:02.031943+0000","last_fullsized":"2024-09-11T22:21:02.031943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.659287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029266+0000","last_change":"2024-09-11T22:20:19.844808+0000","last_active":"2024-09-11T22:21:02.029266+0000","last_peered":"2024-09-11T22:21:02.029266+0000","last_clean":"2024-09-11T22:21:02.029266+0000","last_became_active":"2024-09-11T22:20:19.844536+0000","last_became_peered":"2024-09-11T22:20:19.844536+0000","last_unstale":"2024-09-11T22:21:02.029266+0000","last_undegraded":"2024-09-11T22:21:02.029266+0000","last_fullsized":"2024-09-11T22:21:02.029266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:57.142383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025228+0000","last_change":"2024-09-11T22:20:18.855640+0000","last_active":"2024-09-11T22:21:01.025228+0000","last_peered":"2024-09-11T22:21:01.025228+0000","last_clean":"2024-09-11T22:21:01.025228+0000","last_became_active":"2024-09-11T22:20:18.855394+0000","last_became_peered":"2024-09-11T22:20:18.855394+0000","last_unstale":"2024-09-11T22:21:01.025228+0000","last_undegraded":"2024-09-11T22:21:01.025228+0000","last_fullsized":"2024-09-11T22:21:01.025228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029268+0000","last_change":"2024-09-11T22:20:23.882554+0000","last_active":"2024-09-11T22:21:02.029268+0000","last_peered":"2024-09-11T22:21:02.029268+0000","last_clean":"2024-09-11T22:21:02.029268+0000","last_became_active":"2024-09-11T22:20:23.881642+0000","last_became_peered":"2024-09-11T22:20:23.881642+0000","last_unstale":"2024-09-11T22:21:02.029268+0000","last_undegraded":"2024-09-11T22:21:02.029268+0000","last_fullsized":"2024-09-11T22:21:02.029268+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:16.696043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033143+0000","last_change":"2024-09-11T22:20:19.859429+0000","last_active":"2024-09-11T22:21:01.033143+0000","last_peered":"2024-09-11T22:21:01.033143+0000","last_clean":"2024-09-11T22:21:01.033143+0000","last_became_active":"2024-09-11T22:20:19.859159+0000","last_became_peered":"2024-09-11T22:20:19.859159+0000","last_unstale":"2024-09-11T22:21:01.033143+0000","last_undegraded":"2024-09-11T22:21:01.033143+0000","last_fullsized":"2024-09-11T22:21:01.033143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:02.696450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029225+0000","last_change":"2024-09-11T22:20:18.856144+0000","last_active":"2024-09-11T22:21:02.029225+0000","last_peered":"2024-09-11T22:21:02.029225+0000","last_clean":"2024-09-11T22:21:02.029225+0000","last_became_active":"2024-09-11T22:20:18.855866+0000","last_became_peered":"2024-09-11T22:20:18.855866+0000","last_unstale":"2024-09-11T22:21:02.029225+0000","last_undegraded":"2024-09-11T22:21:02.029225+0000","last_fullsized":"2024-09-11T22:21:02.029225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:37.259393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033635+0000","last_change":"2024-09-11T22:20:24.075154+0000","last_active":"2024-09-11T22:21:01.033635+0000","last_peered":"2024-09-11T22:21:01.033635+0000","last_clean":"2024-09-11T22:21:01.033635+0000","last_became_active":"2024-09-11T22:20:24.074568+0000","last_became_peered":"2024-09-11T22:20:24.074568+0000","last_unstale":"2024-09-11T22:21:01.033635+0000","last_undegraded":"2024-09-11T22:21:01.033635+0000","last_fullsized":"2024-09-11T22:21:01.033635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:09.804991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031694+0000","last_change":"2024-09-11T22:20:19.861236+0000","last_active":"2024-09-11T22:21:02.031694+0000","last_peered":"2024-09-11T22:21:02.031694+0000","last_clean":"2024-09-11T22:21:02.031694+0000","last_became_active":"2024-09-11T22:20:19.860938+0000","last_became_peered":"2024-09-11T22:20:19.860938+0000","last_unstale":"2024-09-11T22:21:02.031694+0000","last_undegraded":"2024-09-11T22:21:02.031694+0000","last_fullsized":"2024-09-11T22:21:02.031694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:42.015334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227590+0000","last_change":"2024-09-11T22:20:18.853467+0000","last_active":"2024-09-11T22:21:02.227590+0000","last_peered":"2024-09-11T22:21:02.227590+0000","last_clean":"2024-09-11T22:21:02.227590+0000","last_became_active":"2024-09-11T22:20:18.853182+0000","last_became_peered":"2024-09-11T22:20:18.853182+0000","last_unstale":"2024-09-11T22:21:02.227590+0000","last_undegraded":"2024-09-11T22:21:02.227590+0000","last_fullsized":"2024-09-11T22:21:02.227590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029398+0000","last_change":"2024-09-11T22:20:09.425648+0000","last_active":"2024-09-11T22:21:02.029398+0000","last_peered":"2024-09-11T22:21:02.029398+0000","last_clean":"2024-09-11T22:21:02.029398+0000","last_became_active":"2024-09-11T22:20:09.424591+0000","last_became_peered":"2024-09-11T22:20:09.424591+0000","last_unstale":"2024-09-11T22:21:02.029398+0000","last_undegraded":"2024-09-11T22:21:02.029398+0000","last_fullsized":"2024-09-11T22:21:02.029398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_clean_scrub_stamp":"2024-09-11T22:20:08.334092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:53.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025706+0000","last_change":"2024-09-11T22:20:24.077007+0000","last_active":"2024-09-11T22:21:02.025706+0000","last_peered":"2024-09-11T22:21:02.025706+0000","last_clean":"2024-09-11T22:21:02.025706+0000","last_became_active":"2024-09-11T22:20:24.076601+0000","last_became_peered":"2024-09-11T22:20:24.076601+0000","last_unstale":"2024-09-11T22:21:02.025706+0000","last_undegraded":"2024-09-11T22:21:02.025706+0000","last_fullsized":"2024-09-11T22:21:02.025706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030003+0000","last_change":"2024-09-11T22:20:19.863279+0000","last_active":"2024-09-11T22:21:02.030003+0000","last_peered":"2024-09-11T22:21:02.030003+0000","last_clean":"2024-09-11T22:21:02.030003+0000","last_became_active":"2024-09-11T22:20:19.861322+0000","last_became_peered":"2024-09-11T22:20:19.861322+0000","last_unstale":"2024-09-11T22:21:02.030003+0000","last_undegraded":"2024-09-11T22:21:02.030003+0000","last_fullsized":"2024-09-11T22:21:02.030003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025479+0000","last_change":"2024-09-11T22:20:18.853343+0000","last_active":"2024-09-11T22:21:01.025479+0000","last_peered":"2024-09-11T22:21:01.025479+0000","last_clean":"2024-09-11T22:21:01.025479+0000","last_became_active":"2024-09-11T22:20:18.853069+0000","last_became_peered":"2024-09-11T22:20:18.853069+0000","last_unstale":"2024-09-11T22:21:01.025479+0000","last_undegraded":"2024-09-11T22:21:01.025479+0000","last_fullsized":"2024-09-11T22:21:01.025479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025514+0000","last_change":"2024-09-11T22:20:24.075350+0000","last_active":"2024-09-11T22:21:02.025514+0000","last_peered":"2024-09-11T22:21:02.025514+0000","last_clean":"2024-09-11T22:21:02.025514+0000","last_became_active":"2024-09-11T22:20:24.074789+0000","last_became_peered":"2024-09-11T22:20:24.074789+0000","last_unstale":"2024-09-11T22:21:02.025514+0000","last_undegraded":"2024-09-11T22:21:02.025514+0000","last_fullsized":"2024-09-11T22:21:02.025514+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227845+0000","last_change":"2024-09-11T22:20:19.866331+0000","last_active":"2024-09-11T22:21:02.227845+0000","last_peered":"2024-09-11T22:21:02.227845+0000","last_clean":"2024-09-11T22:21:02.227845+0000","last_became_active":"2024-09-11T22:20:19.865535+0000","last_became_peered":"2024-09-11T22:20:19.865535+0000","last_unstale":"2024-09-11T22:21:02.227845+0000","last_undegraded":"2024-09-11T22:21:02.227845+0000","last_fullsized":"2024-09-11T22:21:02.227845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030534+0000","last_change":"2024-09-11T22:20:18.849434+0000","last_active":"2024-09-11T22:21:02.030534+0000","last_peered":"2024-09-11T22:21:02.030534+0000","last_clean":"2024-09-11T22:21:02.030534+0000","last_became_active":"2024-09-11T22:20:18.848787+0000","last_became_peered":"2024-09-11T22:20:18.848787+0000","last_unstale":"2024-09-11T22:21:02.030534+0000","last_undegraded":"2024-09-11T22:21:02.030534+0000","last_fullsized":"2024-09-11T22:21:02.030534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:25.689495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033577+0000","last_change":"2024-09-11T22:20:23.879962+0000","last_active":"2024-09-11T22:21:01.033577+0000","last_peered":"2024-09-11T22:21:01.033577+0000","last_clean":"2024-09-11T22:21:01.033577+0000","last_became_active":"2024-09-11T22:20:23.879586+0000","last_became_peered":"2024-09-11T22:20:23.879586+0000","last_unstale":"2024-09-11T22:21:01.033577+0000","last_undegraded":"2024-09-11T22:21:01.033577+0000","last_fullsized":"2024-09-11T22:21:01.033577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:27.323116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030163+0000","last_change":"2024-09-11T22:20:19.860411+0000","last_active":"2024-09-11T22:21:02.030163+0000","last_peered":"2024-09-11T22:21:02.030163+0000","last_clean":"2024-09-11T22:21:02.030163+0000","last_became_active":"2024-09-11T22:20:19.860076+0000","last_became_peered":"2024-09-11T22:20:19.860076+0000","last_unstale":"2024-09-11T22:21:02.030163+0000","last_undegraded":"2024-09-11T22:21:02.030163+0000","last_fullsized":"2024-09-11T22:21:02.030163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025282+0000","last_change":"2024-09-11T22:20:18.856020+0000","last_active":"2024-09-11T22:21:01.025282+0000","last_peered":"2024-09-11T22:21:01.025282+0000","last_clean":"2024-09-11T22:21:01.025282+0000","last_became_active":"2024-09-11T22:20:18.855753+0000","last_became_peered":"2024-09-11T22:20:18.855753+0000","last_unstale":"2024-09-11T22:21:01.025282+0000","last_undegraded":"2024-09-11T22:21:01.025282+0000","last_fullsized":"2024-09-11T22:21:01.025282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227177+0000","last_change":"2024-09-11T22:20:24.077975+0000","last_active":"2024-09-11T22:21:02.227177+0000","last_peered":"2024-09-11T22:21:02.227177+0000","last_clean":"2024-09-11T22:21:02.227177+0000","last_became_active":"2024-09-11T22:20:24.077502+0000","last_became_peered":"2024-09-11T22:20:24.077502+0000","last_unstale":"2024-09-11T22:21:02.227177+0000","last_undegraded":"2024-09-11T22:21:02.227177+0000","last_fullsized":"2024-09-11T22:21:02.227177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:16.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029605+0000","last_change":"2024-09-11T22:20:19.856986+0000","last_active":"2024-09-11T22:21:02.029605+0000","last_peered":"2024-09-11T22:21:02.029605+0000","last_clean":"2024-09-11T22:21:02.029605+0000","last_became_active":"2024-09-11T22:20:19.856739+0000","last_became_peered":"2024-09-11T22:20:19.856739+0000","last_unstale":"2024-09-11T22:21:02.029605+0000","last_undegraded":"2024-09-11T22:21:02.029605+0000","last_fullsized":"2024-09-11T22:21:02.029605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028636+0000","last_change":"2024-09-11T22:20:18.855044+0000","last_active":"2024-09-11T22:21:02.028636+0000","last_peered":"2024-09-11T22:21:02.028636+0000","last_clean":"2024-09-11T22:21:02.028636+0000","last_became_active":"2024-09-11T22:20:18.854764+0000","last_became_peered":"2024-09-11T22:20:18.854764+0000","last_unstale":"2024-09-11T22:21:02.028636+0000","last_undegraded":"2024-09-11T22:21:02.028636+0000","last_fullsized":"2024-09-11T22:21:02.028636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:22.207278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.027914+0000","last_change":"2024-09-11T22:20:23.878383+0000","last_active":"2024-09-11T22:21:02.027914+0000","last_peered":"2024-09-11T22:21:02.027914+0000","last_clean":"2024-09-11T22:21:02.027914+0000","last_became_active":"2024-09-11T22:20:23.877890+0000","last_became_peered":"2024-09-11T22:20:23.877890+0000","last_unstale":"2024-09-11T22:21:02.027914+0000","last_undegraded":"2024-09-11T22:21:02.027914+0000","last_fullsized":"2024-09-11T22:21:02.027914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:18.876485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029429+0000","last_change":"2024-09-11T22:20:19.861242+0000","last_active":"2024-09-11T22:21:02.029429+0000","last_peered":"2024-09-11T22:21:02.029429+0000","last_clean":"2024-09-11T22:21:02.029429+0000","last_became_active":"2024-09-11T22:20:19.860988+0000","last_became_peered":"2024-09-11T22:20:19.860988+0000","last_unstale":"2024-09-11T22:21:02.029429+0000","last_undegraded":"2024-09-11T22:21:02.029429+0000","last_fullsized":"2024-09-11T22:21:02.029429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.024956+0000","last_change":"2024-09-11T22:20:18.852459+0000","last_active":"2024-09-11T22:21:01.024956+0000","last_peered":"2024-09-11T22:21:01.024956+0000","last_clean":"2024-09-11T22:21:01.024956+0000","last_became_active":"2024-09-11T22:20:18.852153+0000","last_became_peered":"2024-09-11T22:20:18.852153+0000","last_unstale":"2024-09-11T22:21:01.024956+0000","last_undegraded":"2024-09-11T22:21:01.024956+0000","last_fullsized":"2024-09-11T22:21:01.024956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033546+0000","last_change":"2024-09-11T22:20:23.874062+0000","last_active":"2024-09-11T22:21:01.033546+0000","last_peered":"2024-09-11T22:21:01.033546+0000","last_clean":"2024-09-11T22:21:01.033546+0000","last_became_active":"2024-09-11T22:20:23.873635+0000","last_became_peered":"2024-09-11T22:20:23.873635+0000","last_unstale":"2024-09-11T22:21:01.033546+0000","last_undegraded":"2024-09-11T22:21:01.033546+0000","last_fullsized":"2024-09-11T22:21:01.033546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:40.914142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025507+0000","last_change":"2024-09-11T22:20:19.851577+0000","last_active":"2024-09-11T22:21:02.025507+0000","last_peered":"2024-09-11T22:21:02.025507+0000","last_clean":"2024-09-11T22:21:02.025507+0000","last_became_active":"2024-09-11T22:20:19.851286+0000","last_became_peered":"2024-09-11T22:20:19.851286+0000","last_unstale":"2024-09-11T22:21:02.025507+0000","last_undegraded":"2024-09-11T22:21:02.025507+0000","last_fullsized":"2024-09-11T22:21:02.025507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:32.025931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025532+0000","last_change":"2024-09-11T22:20:18.853301+0000","last_active":"2024-09-11T22:21:02.025532+0000","last_peered":"2024-09-11T22:21:02.025532+0000","last_clean":"2024-09-11T22:21:02.025532+0000","last_became_active":"2024-09-11T22:20:18.852978+0000","last_became_peered":"2024-09-11T22:20:18.852978+0000","last_unstale":"2024-09-11T22:21:02.025532+0000","last_undegraded":"2024-09-11T22:21:02.025532+0000","last_fullsized":"2024-09-11T22:21:02.025532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033106+0000","last_change":"2024-09-11T22:20:24.077636+0000","last_active":"2024-09-11T22:21:02.033106+0000","last_peered":"2024-09-11T22:21:02.033106+0000","last_clean":"2024-09-11T22:21:02.033106+0000","last_became_active":"2024-09-11T22:20:24.077313+0000","last_became_peered":"2024-09-11T22:20:24.077313+0000","last_unstale":"2024-09-11T22:21:02.033106+0000","last_undegraded":"2024-09-11T22:21:02.033106+0000","last_fullsized":"2024-09-11T22:21:02.033106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:23.154027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029676+0000","last_change":"2024-09-11T22:20:19.862562+0000","last_active":"2024-09-11T22:21:02.029676+0000","last_peered":"2024-09-11T22:21:02.029676+0000","last_clean":"2024-09-11T22:21:02.029676+0000","last_became_active":"2024-09-11T22:20:19.862267+0000","last_became_peered":"2024-09-11T22:20:19.862267+0000","last_unstale":"2024-09-11T22:21:02.029676+0000","last_undegraded":"2024-09-11T22:21:02.029676+0000","last_fullsized":"2024-09-11T22:21:02.029676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227615+0000","last_change":"2024-09-11T22:20:18.858002+0000","last_active":"2024-09-11T22:21:02.227615+0000","last_peered":"2024-09-11T22:21:02.227615+0000","last_clean":"2024-09-11T22:21:02.227615+0000","last_became_active":"2024-09-11T22:20:18.857419+0000","last_became_peered":"2024-09-11T22:20:18.857419+0000","last_unstale":"2024-09-11T22:21:02.227615+0000","last_undegraded":"2024-09-11T22:21:02.227615+0000","last_fullsized":"2024-09-11T22:21:02.227615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033675+0000","last_change":"2024-09-11T22:20:24.074971+0000","last_active":"2024-09-11T22:21:02.033675+0000","last_peered":"2024-09-11T22:21:02.033675+0000","last_clean":"2024-09-11T22:21:02.033675+0000","last_became_active":"2024-09-11T22:20:24.074609+0000","last_became_peered":"2024-09-11T22:20:24.074609+0000","last_unstale":"2024-09-11T22:21:02.033675+0000","last_undegraded":"2024-09-11T22:21:02.033675+0000","last_fullsized":"2024-09-11T22:21:02.033675+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:55.318904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033588+0000","last_change":"2024-09-11T22:20:19.857276+0000","last_active":"2024-09-11T22:21:01.033588+0000","last_peered":"2024-09-11T22:21:01.033588+0000","last_clean":"2024-09-11T22:21:01.033588+0000","last_became_active":"2024-09-11T22:20:19.857027+0000","last_became_peered":"2024-09-11T22:20:19.857027+0000","last_unstale":"2024-09-11T22:21:01.033588+0000","last_undegraded":"2024-09-11T22:21:01.033588+0000","last_fullsized":"2024-09-11T22:21:01.033588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033832+0000","last_change":"2024-09-11T22:20:18.848671+0000","last_active":"2024-09-11T22:21:01.033832+0000","last_peered":"2024-09-11T22:21:01.033832+0000","last_clean":"2024-09-11T22:21:01.033832+0000","last_became_active":"2024-09-11T22:20:18.848405+0000","last_became_peered":"2024-09-11T22:20:18.848405+0000","last_unstale":"2024-09-11T22:21:01.033832+0000","last_undegraded":"2024-09-11T22:21:01.033832+0000","last_fullsized":"2024-09-11T22:21:01.033832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227859+0000","last_change":"2024-09-11T22:20:24.076835+0000","last_active":"2024-09-11T22:21:02.227859+0000","last_peered":"2024-09-11T22:21:02.227859+0000","last_clean":"2024-09-11T22:21:02.227859+0000","last_became_active":"2024-09-11T22:20:24.076200+0000","last_became_peered":"2024-09-11T22:20:24.076200+0000","last_unstale":"2024-09-11T22:21:02.227859+0000","last_undegraded":"2024-09-11T22:21:02.227859+0000","last_fullsized":"2024-09-11T22:21:02.227859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:48.150778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033502+0000","last_change":"2024-09-11T22:21:02.033502+0000","last_active":"2024-09-11T22:21:02.033502+0000","last_peered":"2024-09-11T22:21:02.033502+0000","last_clean":"2024-09-11T22:21:02.033502+0000","last_became_active":"2024-09-11T22:21:02.033269+0000","last_became_peered":"2024-09-11T22:21:02.033269+0000","last_unstale":"2024-09-11T22:21:02.033502+0000","last_undegraded":"2024-09-11T22:21:02.033502+0000","last_fullsized":"2024-09-11T22:21:02.033502+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:31.993239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'11","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026204+0000","last_change":"2024-09-11T22:20:18.855665+0000","last_active":"2024-09-11T22:21:02.026204+0000","last_peered":"2024-09-11T22:21:02.026204+0000","last_clean":"2024-09-11T22:21:02.026204+0000","last_became_active":"2024-09-11T22:20:18.855386+0000","last_became_peered":"2024-09-11T22:20:18.855386+0000","last_unstale":"2024-09-11T22:21:02.026204+0000","last_undegraded":"2024-09-11T22:21:02.026204+0000","last_fullsized":"2024-09-11T22:21:02.026204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029520+0000","last_change":"2024-09-11T22:20:23.880793+0000","last_active":"2024-09-11T22:21:02.029520+0000","last_peered":"2024-09-11T22:21:02.029520+0000","last_clean":"2024-09-11T22:21:02.029520+0000","last_became_active":"2024-09-11T22:20:23.879993+0000","last_became_peered":"2024-09-11T22:20:23.879993+0000","last_unstale":"2024-09-11T22:21:02.029520+0000","last_undegraded":"2024-09-11T22:21:02.029520+0000","last_fullsized":"2024-09-11T22:21:02.029520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:50.449090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029237+0000","last_change":"2024-09-11T22:20:19.858588+0000","last_active":"2024-09-11T22:21:02.029237+0000","last_peered":"2024-09-11T22:21:02.029237+0000","last_clean":"2024-09-11T22:21:02.029237+0000","last_became_active":"2024-09-11T22:20:19.858322+0000","last_became_peered":"2024-09-11T22:20:19.858322+0000","last_unstale":"2024-09-11T22:21:02.029237+0000","last_undegraded":"2024-09-11T22:21:02.029237+0000","last_fullsized":"2024-09-11T22:21:02.029237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030283+0000","last_change":"2024-09-11T22:20:18.855056+0000","last_active":"2024-09-11T22:21:02.030283+0000","last_peered":"2024-09-11T22:21:02.030283+0000","last_clean":"2024-09-11T22:21:02.030283+0000","last_became_active":"2024-09-11T22:20:18.854784+0000","last_became_peered":"2024-09-11T22:20:18.854784+0000","last_unstale":"2024-09-11T22:21:02.030283+0000","last_undegraded":"2024-09-11T22:21:02.030283+0000","last_fullsized":"2024-09-11T22:21:02.030283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:38.916121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028248+0000","last_change":"2024-09-11T22:20:23.879768+0000","last_active":"2024-09-11T22:21:02.028248+0000","last_peered":"2024-09-11T22:21:02.028248+0000","last_clean":"2024-09-11T22:21:02.028248+0000","last_became_active":"2024-09-11T22:20:23.878794+0000","last_became_peered":"2024-09-11T22:20:23.878794+0000","last_unstale":"2024-09-11T22:21:02.028248+0000","last_undegraded":"2024-09-11T22:21:02.028248+0000","last_fullsized":"2024-09-11T22:21:02.028248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:07.301587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-11T22:20:27.048280+0000","last_change":"2024-09-11T22:21:01.034302+0000","last_active":"2024-09-11T22:21:01.034302+0000","last_peered":"2024-09-11T22:20:27.048280+0000","last_clean":"2024-09-11T22:20:27.048280+0000","last_became_active":"2024-09-11T22:20:19.861607+0000","last_became_peered":"2024-09-11T22:20:19.861607+0000","last_unstale":"2024-09-11T22:20:27.048280+0000","last_undegraded":"2024-09-11T22:20:27.048280+0000","last_fullsized":"2024-09-11T22:20:27.048280+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.228018+0000","last_change":"2024-09-11T22:20:18.853382+0000","last_active":"2024-09-11T22:21:02.228018+0000","last_peered":"2024-09-11T22:21:02.228018+0000","last_clean":"2024-09-11T22:21:02.228018+0000","last_became_active":"2024-09-11T22:20:18.853103+0000","last_became_peered":"2024-09-11T22:20:18.853103+0000","last_unstale":"2024-09-11T22:21:02.228018+0000","last_undegraded":"2024-09-11T22:21:02.228018+0000","last_fullsized":"2024-09-11T22:21:02.228018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031422+0000","last_change":"2024-09-11T22:20:23.876997+0000","last_active":"2024-09-11T22:21:02.031422+0000","last_peered":"2024-09-11T22:21:02.031422+0000","last_clean":"2024-09-11T22:21:02.031422+0000","last_became_active":"2024-09-11T22:20:23.876587+0000","last_became_peered":"2024-09-11T22:20:23.876587+0000","last_unstale":"2024-09-11T22:21:02.031422+0000","last_undegraded":"2024-09-11T22:21:02.031422+0000","last_fullsized":"2024-09-11T22:21:02.031422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:19.670665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227988+0000","last_change":"2024-09-11T22:20:19.866624+0000","last_active":"2024-09-11T22:21:02.227988+0000","last_peered":"2024-09-11T22:21:02.227988+0000","last_clean":"2024-09-11T22:21:02.227988+0000","last_became_active":"2024-09-11T22:20:19.866303+0000","last_became_peered":"2024-09-11T22:20:19.866303+0000","last_unstale":"2024-09-11T22:21:02.227988+0000","last_undegraded":"2024-09-11T22:21:02.227988+0000","last_fullsized":"2024-09-11T22:21:02.227988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025963+0000","last_change":"2024-09-11T22:20:18.854361+0000","last_active":"2024-09-11T22:21:02.025963+0000","last_peered":"2024-09-11T22:21:02.025963+0000","last_clean":"2024-09-11T22:21:02.025963+0000","last_became_active":"2024-09-11T22:20:18.854019+0000","last_became_peered":"2024-09-11T22:20:18.854019+0000","last_unstale":"2024-09-11T22:21:02.025963+0000","last_undegraded":"2024-09-11T22:21:02.025963+0000","last_fullsized":"2024-09-11T22:21:02.025963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031134+0000","last_change":"2024-09-11T22:20:24.077476+0000","last_active":"2024-09-11T22:21:02.031134+0000","last_peered":"2024-09-11T22:21:02.031134+0000","last_clean":"2024-09-11T22:21:02.031134+0000","last_became_active":"2024-09-11T22:20:24.077134+0000","last_became_peered":"2024-09-11T22:20:24.077134+0000","last_unstale":"2024-09-11T22:21:02.031134+0000","last_undegraded":"2024-09-11T22:21:02.031134+0000","last_fullsized":"2024-09-11T22:21:02.031134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:03.186460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-11T22:20:27.048088+0000","last_change":"2024-09-11T22:21:01.033206+0000","last_active":"2024-09-11T22:21:01.033206+0000","last_peered":"2024-09-11T22:20:27.048088+0000","last_clean":"2024-09-11T22:20:27.048088+0000","last_became_active":"2024-09-11T22:20:24.076592+0000","last_became_peered":"2024-09-11T22:20:24.076592+0000","last_unstale":"2024-09-11T22:20:27.048088+0000","last_undegraded":"2024-09-11T22:20:27.048088+0000","last_fullsized":"2024-09-11T22:20:27.048088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2,3,7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029432+0000","last_change":"2024-09-11T22:20:19.845776+0000","last_active":"2024-09-11T22:21:02.029432+0000","last_peered":"2024-09-11T22:21:02.029432+0000","last_clean":"2024-09-11T22:21:02.029432+0000","last_became_active":"2024-09-11T22:20:19.845425+0000","last_became_peered":"2024-09-11T22:20:19.845425+0000","last_unstale":"2024-09-11T22:21:02.029432+0000","last_undegraded":"2024-09-11T22:21:02.029432+0000","last_fullsized":"2024-09-11T22:21:02.029432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:07.187533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227442+0000","last_change":"2024-09-11T22:20:18.852446+0000","last_active":"2024-09-11T22:21:02.227442+0000","last_peered":"2024-09-11T22:21:02.227442+0000","last_clean":"2024-09-11T22:21:02.227442+0000","last_became_active":"2024-09-11T22:20:18.852155+0000","last_became_peered":"2024-09-11T22:20:18.852155+0000","last_unstale":"2024-09-11T22:21:02.227442+0000","last_undegraded":"2024-09-11T22:21:02.227442+0000","last_fullsized":"2024-09-11T22:21:02.227442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025729+0000","last_change":"2024-09-11T22:20:23.876503+0000","last_active":"2024-09-11T22:21:02.025729+0000","last_peered":"2024-09-11T22:21:02.025729+0000","last_clean":"2024-09-11T22:21:02.025729+0000","last_became_active":"2024-09-11T22:20:23.876100+0000","last_became_peered":"2024-09-11T22:20:23.876100+0000","last_unstale":"2024-09-11T22:21:02.025729+0000","last_undegraded":"2024-09-11T22:21:02.025729+0000","last_fullsized":"2024-09-11T22:21:02.025729+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031526+0000","last_change":"2024-09-11T22:20:19.852606+0000","last_active":"2024-09-11T22:21:02.031526+0000","last_peered":"2024-09-11T22:21:02.031526+0000","last_clean":"2024-09-11T22:21:02.031526+0000","last_became_active":"2024-09-11T22:20:19.852333+0000","last_became_peered":"2024-09-11T22:20:19.852333+0000","last_unstale":"2024-09-11T22:21:02.031526+0000","last_undegraded":"2024-09-11T22:21:02.031526+0000","last_fullsized":"2024-09-11T22:21:02.031526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:56.940278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031424+0000","last_change":"2024-09-11T22:20:18.853767+0000","last_active":"2024-09-11T22:21:02.031424+0000","last_peered":"2024-09-11T22:21:02.031424+0000","last_clean":"2024-09-11T22:21:02.031424+0000","last_became_active":"2024-09-11T22:20:18.853533+0000","last_became_peered":"2024-09-11T22:20:18.853533+0000","last_unstale":"2024-09-11T22:21:02.031424+0000","last_undegraded":"2024-09-11T22:21:02.031424+0000","last_fullsized":"2024-09-11T22:21:02.031424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:36.662271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026157+0000","last_change":"2024-09-11T22:20:18.847133+0000","last_active":"2024-09-11T22:21:02.026157+0000","last_peered":"2024-09-11T22:21:02.026157+0000","last_clean":"2024-09-11T22:21:02.026157+0000","last_became_active":"2024-09-11T22:20:18.846321+0000","last_became_peered":"2024-09-11T22:20:18.846321+0000","last_unstale":"2024-09-11T22:21:02.026157+0000","last_undegraded":"2024-09-11T22:21:02.026157+0000","last_fullsized":"2024-09-11T22:21:02.026157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033751+0000","last_change":"2024-09-11T22:20:19.861445+0000","last_active":"2024-09-11T22:21:01.033751+0000","last_peered":"2024-09-11T22:21:01.033751+0000","last_clean":"2024-09-11T22:21:01.033751+0000","last_became_active":"2024-09-11T22:20:19.861154+0000","last_became_peered":"2024-09-11T22:20:19.861154+0000","last_unstale":"2024-09-11T22:21:01.033751+0000","last_undegraded":"2024-09-11T22:21:01.033751+0000","last_fullsized":"2024-09-11T22:21:01.033751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025275+0000","last_change":"2024-09-11T22:20:23.877973+0000","last_active":"2024-09-11T22:21:01.025275+0000","last_peered":"2024-09-11T22:21:01.025275+0000","last_clean":"2024-09-11T22:21:01.025275+0000","last_became_active":"2024-09-11T22:20:23.877578+0000","last_became_peered":"2024-09-11T22:20:23.877578+0000","last_unstale":"2024-09-11T22:21:01.025275+0000","last_undegraded":"2024-09-11T22:21:01.025275+0000","last_fullsized":"2024-09-11T22:21:01.025275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:27.826669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033802+0000","last_change":"2024-09-11T22:20:18.854142+0000","last_active":"2024-09-11T22:21:02.033802+0000","last_peered":"2024-09-11T22:21:02.033802+0000","last_clean":"2024-09-11T22:21:02.033802+0000","last_became_active":"2024-09-11T22:20:18.853872+0000","last_became_peered":"2024-09-11T22:20:18.853872+0000","last_unstale":"2024-09-11T22:21:02.033802+0000","last_undegraded":"2024-09-11T22:21:02.033802+0000","last_fullsized":"2024-09-11T22:21:02.033802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:22.513242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1065,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028251+0000","last_change":"2024-09-11T22:20:19.852580+0000","last_active":"2024-09-11T22:21:02.028251+0000","last_peered":"2024-09-11T22:21:02.028251+0000","last_clean":"2024-09-11T22:21:02.028251+0000","last_became_active":"2024-09-11T22:20:19.850175+0000","last_became_peered":"2024-09-11T22:20:19.850175+0000","last_unstale":"2024-09-11T22:21:02.028251+0000","last_undegraded":"2024-09-11T22:21:02.028251+0000","last_fullsized":"2024-09-11T22:21:02.028251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:11.937256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.032982+0000","last_change":"2024-09-11T22:20:23.878004+0000","last_active":"2024-09-11T22:21:02.032982+0000","last_peered":"2024-09-11T22:21:02.032982+0000","last_clean":"2024-09-11T22:21:02.032982+0000","last_became_active":"2024-09-11T22:20:23.876776+0000","last_became_peered":"2024-09-11T22:20:23.876776+0000","last_unstale":"2024-09-11T22:21:02.032982+0000","last_undegraded":"2024-09-11T22:21:02.032982+0000","last_fullsized":"2024-09-11T22:21:02.032982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:11.254248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025354+0000","last_change":"2024-09-11T22:20:19.853439+0000","last_active":"2024-09-11T22:21:02.025354+0000","last_peered":"2024-09-11T22:21:02.025354+0000","last_clean":"2024-09-11T22:21:02.025354+0000","last_became_active":"2024-09-11T22:20:19.852937+0000","last_became_peered":"2024-09-11T22:20:19.852937+0000","last_unstale":"2024-09-11T22:21:02.025354+0000","last_undegraded":"2024-09-11T22:21:02.025354+0000","last_fullsized":"2024-09-11T22:21:02.025354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025127+0000","last_change":"2024-09-11T22:20:19.861003+0000","last_active":"2024-09-11T22:21:01.025127+0000","last_peered":"2024-09-11T22:21:01.025127+0000","last_clean":"2024-09-11T22:21:01.025127+0000","last_became_active":"2024-09-11T22:20:19.860690+0000","last_became_peered":"2024-09-11T22:20:19.860690+0000","last_unstale":"2024-09-11T22:21:01.025127+0000","last_undegraded":"2024-09-11T22:21:01.025127+0000","last_fullsized":"2024-09-11T22:21:01.025127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227573+0000","last_change":"2024-09-11T22:20:19.856756+0000","last_active":"2024-09-11T22:21:02.227573+0000","last_peered":"2024-09-11T22:21:02.227573+0000","last_clean":"2024-09-11T22:21:02.227573+0000","last_became_active":"2024-09-11T22:20:19.856460+0000","last_became_peered":"2024-09-11T22:20:19.856460+0000","last_unstale":"2024-09-11T22:21:02.227573+0000","last_undegraded":"2024-09-11T22:21:02.227573+0000","last_fullsized":"2024-09-11T22:21:02.227573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033665+0000","last_change":"2024-09-11T22:20:19.855629+0000","last_active":"2024-09-11T22:21:01.033665+0000","last_peered":"2024-09-11T22:21:01.033665+0000","last_clean":"2024-09-11T22:21:01.033665+0000","last_became_active":"2024-09-11T22:20:19.855363+0000","last_became_peered":"2024-09-11T22:20:19.855363+0000","last_unstale":"2024-09-11T22:21:01.033665+0000","last_undegraded":"2024-09-11T22:21:01.033665+0000","last_fullsized":"2024-09-11T22:21:01.033665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033889+0000","last_change":"2024-09-11T22:20:19.863122+0000","last_active":"2024-09-11T22:21:02.033889+0000","last_peered":"2024-09-11T22:21:02.033889+0000","last_clean":"2024-09-11T22:21:02.033889+0000","last_became_active":"2024-09-11T22:20:19.862828+0000","last_became_peered":"2024-09-11T22:20:19.862828+0000","last_unstale":"2024-09-11T22:21:02.033889+0000","last_undegraded":"2024-09-11T22:21:02.033889+0000","last_fullsized":"2024-09-11T22:21:02.033889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:10.868762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030114+0000","last_change":"2024-09-11T22:20:19.846453+0000","last_active":"2024-09-11T22:21:02.030114+0000","last_peered":"2024-09-11T22:21:02.030114+0000","last_clean":"2024-09-11T22:21:02.030114+0000","last_became_active":"2024-09-11T22:20:19.846186+0000","last_became_peered":"2024-09-11T22:20:19.846186+0000","last_unstale":"2024-09-11T22:21:02.030114+0000","last_undegraded":"2024-09-11T22:21:02.030114+0000","last_fullsized":"2024-09-11T22:21:02.030114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:24.032365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026220+0000","last_change":"2024-09-11T22:20:19.860632+0000","last_active":"2024-09-11T22:21:02.026220+0000","last_peered":"2024-09-11T22:21:02.026220+0000","last_clean":"2024-09-11T22:21:02.026220+0000","last_became_active":"2024-09-11T22:20:19.860005+0000","last_became_peered":"2024-09-11T22:20:19.860005+0000","last_unstale":"2024-09-11T22:21:02.026220+0000","last_undegraded":"2024-09-11T22:21:02.026220+0000","last_fullsized":"2024-09-11T22:21:02.026220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033193+0000","last_change":"2024-09-11T22:20:19.859195+0000","last_active":"2024-09-11T22:21:02.033193+0000","last_peered":"2024-09-11T22:21:02.033193+0000","last_clean":"2024-09-11T22:21:02.033193+0000","last_became_active":"2024-09-11T22:20:19.858832+0000","last_became_peered":"2024-09-11T22:20:19.858832+0000","last_unstale":"2024-09-11T22:21:02.033193+0000","last_undegraded":"2024-09-11T22:21:02.033193+0000","last_fullsized":"2024-09-11T22:21:02.033193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:56.259074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227399+0000","last_change":"2024-09-11T22:20:19.858969+0000","last_active":"2024-09-11T22:21:02.227399+0000","last_peered":"2024-09-11T22:21:02.227399+0000","last_clean":"2024-09-11T22:21:02.227399+0000","last_became_active":"2024-09-11T22:20:19.857847+0000","last_became_peered":"2024-09-11T22:20:19.857847+0000","last_unstale":"2024-09-11T22:21:02.227399+0000","last_undegraded":"2024-09-11T22:21:02.227399+0000","last_fullsized":"2024-09-11T22:21:02.227399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031335+0000","last_change":"2024-09-11T22:20:19.863294+0000","last_active":"2024-09-11T22:21:02.031335+0000","last_peered":"2024-09-11T22:21:02.031335+0000","last_clean":"2024-09-11T22:21:02.031335+0000","last_became_active":"2024-09-11T22:20:19.863007+0000","last_became_peered":"2024-09-11T22:20:19.863007+0000","last_unstale":"2024-09-11T22:21:02.031335+0000","last_undegraded":"2024-09-11T22:21:02.031335+0000","last_fullsized":"2024-09-11T22:21:02.031335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:06.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227487+0000","last_change":"2024-09-11T22:20:19.858414+0000","last_active":"2024-09-11T22:21:02.227487+0000","last_peered":"2024-09-11T22:21:02.227487+0000","last_clean":"2024-09-11T22:21:02.227487+0000","last_became_active":"2024-09-11T22:20:19.857790+0000","last_became_peered":"2024-09-11T22:20:19.857790+0000","last_unstale":"2024-09-11T22:21:02.227487+0000","last_undegraded":"2024-09-11T22:21:02.227487+0000","last_fullsized":"2024-09-11T22:21:02.227487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":2,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-11T22:20:27.047940+0000","last_change":"2024-09-11T22:21:01.323256+0000","last_active":"2024-09-11T22:21:01.323256+0000","last_peered":"2024-09-11T22:20:27.047940+0000","last_clean":"2024-09-11T22:20:27.047940+0000","last_became_active":"2024-09-11T22:20:19.854774+0000","last_became_peered":"2024-09-11T22:20:19.854774+0000","last_unstale":"2024-09-11T22:20:27.047940+0000","last_undegraded":"2024-09-11T22:20:27.047940+0000","last_fullsized":"2024-09-11T22:20:27.047940+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026014+0000","last_change":"2024-09-11T22:20:19.864700+0000","last_active":"2024-09-11T22:21:02.026014+0000","last_peered":"2024-09-11T22:21:02.026014+0000","last_clean":"2024-09-11T22:21:02.026014+0000","last_became_active":"2024-09-11T22:20:19.862296+0000","last_became_peered":"2024-09-11T22:20:19.862296+0000","last_unstale":"2024-09-11T22:21:02.026014+0000","last_undegraded":"2024-09-11T22:21:02.026014+0000","last_fullsized":"2024-09-11T22:21:02.026014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030247+0000","last_change":"2024-09-11T22:20:19.855253+0000","last_active":"2024-09-11T22:21:02.030247+0000","last_peered":"2024-09-11T22:21:02.030247+0000","last_clean":"2024-09-11T22:21:02.030247+0000","last_became_active":"2024-09-11T22:20:19.854970+0000","last_became_peered":"2024-09-11T22:20:19.854970+0000","last_unstale":"2024-09-11T22:21:02.030247+0000","last_undegraded":"2024-09-11T22:21:02.030247+0000","last_fullsized":"2024-09-11T22:21:02.030247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025225+0000","last_change":"2024-09-11T22:20:19.850202+0000","last_active":"2024-09-11T22:21:01.025225+0000","last_peered":"2024-09-11T22:21:01.025225+0000","last_clean":"2024-09-11T22:21:01.025225+0000","last_became_active":"2024-09-11T22:20:19.849815+0000","last_became_peered":"2024-09-11T22:20:19.849815+0000","last_unstale":"2024-09-11T22:21:01.025225+0000","last_undegraded":"2024-09-11T22:21:01.025225+0000","last_fullsized":"2024-09-11T22:21:01.025225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:56.480679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.228172+0000","last_change":"2024-09-11T22:20:19.866864+0000","last_active":"2024-09-11T22:21:02.228172+0000","last_peered":"2024-09-11T22:21:02.228172+0000","last_clean":"2024-09-11T22:21:02.228172+0000","last_became_active":"2024-09-11T22:20:19.866484+0000","last_became_peered":"2024-09-11T22:20:19.866484+0000","last_unstale":"2024-09-11T22:21:02.228172+0000","last_undegraded":"2024-09-11T22:21:02.228172+0000","last_fullsized":"2024-09-11T22:21:02.228172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":2,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-11T22:20:19.847772+0000","last_change":"2024-09-11T22:21:01.323220+0000","last_active":"2024-09-11T22:20:18.828308+0000","last_peered":"2024-09-11T22:20:18.828308+0000","last_clean":"2024-09-11T22:20:18.828308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:19.847772+0000","last_undegraded":"2024-09-11T22:20:19.847772+0000","last_fullsized":"2024-09-11T22:20:19.847772+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029536+0000","last_change":"2024-09-11T22:20:19.860050+0000","last_active":"2024-09-11T22:21:02.029536+0000","last_peered":"2024-09-11T22:21:02.029536+0000","last_clean":"2024-09-11T22:21:02.029536+0000","last_became_active":"2024-09-11T22:20:19.859755+0000","last_became_peered":"2024-09-11T22:20:19.859755+0000","last_unstale":"2024-09-11T22:21:02.029536+0000","last_undegraded":"2024-09-11T22:21:02.029536+0000","last_fullsized":"2024-09-11T22:21:02.029536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:42.487669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033495+0000","last_change":"2024-09-11T22:20:19.853902+0000","last_active":"2024-09-11T22:21:01.033495+0000","last_peered":"2024-09-11T22:21:01.033495+0000","last_clean":"2024-09-11T22:21:01.033495+0000","last_became_active":"2024-09-11T22:20:19.853563+0000","last_became_peered":"2024-09-11T22:20:19.853563+0000","last_unstale":"2024-09-11T22:21:01.033495+0000","last_undegraded":"2024-09-11T22:21:01.033495+0000","last_fullsized":"2024-09-11T22:21:01.033495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033630+0000","last_change":"2024-09-11T22:20:19.849490+0000","last_active":"2024-09-11T22:21:02.033630+0000","last_peered":"2024-09-11T22:21:02.033630+0000","last_clean":"2024-09-11T22:21:02.033630+0000","last_became_active":"2024-09-11T22:20:19.848965+0000","last_became_peered":"2024-09-11T22:20:19.848965+0000","last_unstale":"2024-09-11T22:21:02.033630+0000","last_undegraded":"2024-09-11T22:21:02.033630+0000","last_fullsized":"2024-09-11T22:21:02.033630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:10.387663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029136+0000","last_change":"2024-09-11T22:20:19.860457+0000","last_active":"2024-09-11T22:21:02.029136+0000","last_peered":"2024-09-11T22:21:02.029136+0000","last_clean":"2024-09-11T22:21:02.029136+0000","last_became_active":"2024-09-11T22:20:19.858887+0000","last_became_peered":"2024-09-11T22:20:19.858887+0000","last_unstale":"2024-09-11T22:21:02.029136+0000","last_undegraded":"2024-09-11T22:21:02.029136+0000","last_fullsized":"2024-09-11T22:21:02.029136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:34.620956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026280+0000","last_change":"2024-09-11T22:20:19.862347+0000","last_active":"2024-09-11T22:21:02.026280+0000","last_peered":"2024-09-11T22:21:02.026280+0000","last_clean":"2024-09-11T22:21:02.026280+0000","last_became_active":"2024-09-11T22:20:19.861965+0000","last_became_peered":"2024-09-11T22:20:19.861965+0000","last_unstale":"2024-09-11T22:21:02.026280+0000","last_undegraded":"2024-09-11T22:21:02.026280+0000","last_fullsized":"2024-09-11T22:21:02.026280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026130+0000","last_change":"2024-09-11T22:20:19.862065+0000","last_active":"2024-09-11T22:21:02.026130+0000","last_peered":"2024-09-11T22:21:02.026130+0000","last_clean":"2024-09-11T22:21:02.026130+0000","last_became_active":"2024-09-11T22:20:19.861765+0000","last_became_peered":"2024-09-11T22:20:19.861765+0000","last_unstale":"2024-09-11T22:21:02.026130+0000","last_undegraded":"2024-09-11T22:21:02.026130+0000","last_fullsized":"2024-09-11T22:21:02.026130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030078+0000","last_change":"2024-09-11T22:20:19.865064+0000","last_active":"2024-09-11T22:21:02.030078+0000","last_peered":"2024-09-11T22:21:02.030078+0000","last_clean":"2024-09-11T22:21:02.030078+0000","last_became_active":"2024-09-11T22:20:19.864697+0000","last_became_peered":"2024-09-11T22:20:19.864697+0000","last_unstale":"2024-09-11T22:21:02.030078+0000","last_undegraded":"2024-09-11T22:21:02.030078+0000","last_fullsized":"2024-09-11T22:21:02.030078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031325+0000","last_change":"2024-09-11T22:20:19.861293+0000","last_active":"2024-09-11T22:21:02.031325+0000","last_peered":"2024-09-11T22:21:02.031325+0000","last_clean":"2024-09-11T22:21:02.031325+0000","last_became_active":"2024-09-11T22:20:19.861013+0000","last_became_peered":"2024-09-11T22:20:19.861013+0000","last_unstale":"2024-09-11T22:21:02.031325+0000","last_undegraded":"2024-09-11T22:21:02.031325+0000","last_fullsized":"2024-09-11T22:21:02.031325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:13.178404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029254+0000","last_change":"2024-09-11T22:20:19.858131+0000","last_active":"2024-09-11T22:21:02.029254+0000","last_peered":"2024-09-11T22:21:02.029254+0000","last_clean":"2024-09-11T22:21:02.029254+0000","last_became_active":"2024-09-11T22:20:19.857842+0000","last_became_peered":"2024-09-11T22:20:19.857842+0000","last_unstale":"2024-09-11T22:21:02.029254+0000","last_undegraded":"2024-09-11T22:21:02.029254+0000","last_fullsized":"2024-09-11T22:21:02.029254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227444+0000","last_change":"2024-09-11T22:20:19.859667+0000","last_active":"2024-09-11T22:21:02.227444+0000","last_peered":"2024-09-11T22:21:02.227444+0000","last_clean":"2024-09-11T22:21:02.227444+0000","last_became_active":"2024-09-11T22:20:19.859306+0000","last_became_peered":"2024-09-11T22:20:19.859306+0000","last_unstale":"2024-09-11T22:21:02.227444+0000","last_undegraded":"2024-09-11T22:21:02.227444+0000","last_fullsized":"2024-09-11T22:21:02.227444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029504+0000","last_change":"2024-09-11T22:20:19.848821+0000","last_active":"2024-09-11T22:21:02.029504+0000","last_peered":"2024-09-11T22:21:02.029504+0000","last_clean":"2024-09-11T22:21:02.029504+0000","last_became_active":"2024-09-11T22:20:19.848531+0000","last_became_peered":"2024-09-11T22:20:19.848531+0000","last_unstale":"2024-09-11T22:21:02.029504+0000","last_undegraded":"2024-09-11T22:21:02.029504+0000","last_fullsized":"2024-09-11T22:21:02.029504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227722+0000","last_change":"2024-09-11T22:20:19.866300+0000","last_active":"2024-09-11T22:21:02.227722+0000","last_peered":"2024-09-11T22:21:02.227722+0000","last_clean":"2024-09-11T22:21:02.227722+0000","last_became_active":"2024-09-11T22:20:19.865939+0000","last_became_peered":"2024-09-11T22:20:19.865939+0000","last_unstale":"2024-09-11T22:21:02.227722+0000","last_undegraded":"2024-09-11T22:21:02.227722+0000","last_fullsized":"2024-09-11T22:21:02.227722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033602+0000","last_change":"2024-09-11T22:20:19.858144+0000","last_active":"2024-09-11T22:21:01.033602+0000","last_peered":"2024-09-11T22:21:01.033602+0000","last_clean":"2024-09-11T22:21:01.033602+0000","last_became_active":"2024-09-11T22:20:19.857840+0000","last_became_peered":"2024-09-11T22:20:19.857840+0000","last_unstale":"2024-09-11T22:21:01.033602+0000","last_undegraded":"2024-09-11T22:21:01.033602+0000","last_fullsized":"2024-09-11T22:21:01.033602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:23.801072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029762+0000","last_change":"2024-09-11T22:20:19.857378+0000","last_active":"2024-09-11T22:21:02.029762+0000","last_peered":"2024-09-11T22:21:02.029762+0000","last_clean":"2024-09-11T22:21:02.029762+0000","last_became_active":"2024-09-11T22:20:19.857089+0000","last_became_peered":"2024-09-11T22:20:19.857089+0000","last_unstale":"2024-09-11T22:21:02.029762+0000","last_undegraded":"2024-09-11T22:21:02.029762+0000","last_fullsized":"2024-09-11T22:21:02.029762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:29.835695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":2,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-11T22:20:19.843776+0000","last_change":"2024-09-11T22:21:01.323294+0000","last_active":"2024-09-11T22:20:18.828308+0000","last_peered":"2024-09-11T22:20:18.828308+0000","last_clean":"2024-09-11T22:20:18.828308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:19.843776+0000","last_undegraded":"2024-09-11T22:20:19.843776+0000","last_fullsized":"2024-09-11T22:20:19.843776+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7897,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":380928,"data_stored":713645,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":315392,"data_stored":126040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":315392,"data_stored":122896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":311296,"data_stored":122232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":319488,"data_stored":126517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":108136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":698346,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":319488,"data_stored":122462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:21:07.216 INFO:tasks.mon_thrash.ceph_manager:PG 3.17 is not active+clean 2024-09-11T22:21:07.216 INFO:tasks.mon_thrash.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 21, 'reported_epoch': 26, 'state': 'peering', 'last_fresh': '2024-09-11T22:20:27.048280+0000', 'last_change': '2024-09-11T22:21:01.034302+0000', 'last_active': '2024-09-11T22:21:01.034302+0000', 'last_peered': '2024-09-11T22:20:27.048280+0000', 'last_clean': '2024-09-11T22:20:27.048280+0000', 'last_became_active': '2024-09-11T22:20:19.861607+0000', 'last_became_peered': '2024-09-11T22:20:19.861607+0000', 'last_unstale': '2024-09-11T22:20:27.048280+0000', 'last_undegraded': '2024-09-11T22:20:27.048280+0000', 'last_fullsized': '2024-09-11T22:20:27.048280+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 21, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'last_clean_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1, 5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:21:07.216 INFO:tasks.mon_thrash.ceph_manager:PG 4.1e is not active+clean 2024-09-11T22:21:07.216 INFO:tasks.mon_thrash.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 15, 'reported_epoch': 26, 'state': 'peering', 'last_fresh': '2024-09-11T22:20:27.048088+0000', 'last_change': '2024-09-11T22:21:01.033206+0000', 'last_active': '2024-09-11T22:21:01.033206+0000', 'last_peered': '2024-09-11T22:20:27.048088+0000', 'last_clean': '2024-09-11T22:20:27.048088+0000', 'last_became_active': '2024-09-11T22:20:24.076592+0000', 'last_became_peered': '2024-09-11T22:20:24.076592+0000', 'last_unstale': '2024-09-11T22:20:27.048088+0000', 'last_undegraded': '2024-09-11T22:20:27.048088+0000', 'last_fullsized': '2024-09-11T22:20:27.048088+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 24, 'last_epoch_clean': 25, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:20:22.853906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:20:22.853906+0000', 'last_clean_scrub_stamp': '2024-09-11T22:20:22.853906+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7, 3, 2], 'acting': [0, 7, 3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1, 2, 3, 7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-11T22:21:07.216 INFO:tasks.mon_thrash.ceph_manager:PG 3.2b is not active+clean 2024-09-11T22:21:07.217 INFO:tasks.mon_thrash.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 27, 'state': 'peering', 'last_fresh': '2024-09-11T22:20:27.047940+0000', 'last_change': '2024-09-11T22:21:01.323256+0000', 'last_active': '2024-09-11T22:21:01.323256+0000', 'last_peered': '2024-09-11T22:20:27.047940+0000', 'last_clean': '2024-09-11T22:20:27.047940+0000', 'last_became_active': '2024-09-11T22:20:19.854774+0000', 'last_became_peered': '2024-09-11T22:20:19.854774+0000', 'last_unstale': '2024-09-11T22:20:27.047940+0000', 'last_undegraded': '2024-09-11T22:20:27.047940+0000', 'last_fullsized': '2024-09-11T22:20:27.047940+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 21, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'last_clean_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T22:21:07.217 INFO:tasks.mon_thrash.ceph_manager:PG 3.30 is not active+clean 2024-09-11T22:21:07.217 INFO:tasks.mon_thrash.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 27, 'state': 'peering', 'last_fresh': '2024-09-11T22:20:19.847772+0000', 'last_change': '2024-09-11T22:21:01.323220+0000', 'last_active': '2024-09-11T22:20:18.828308+0000', 'last_peered': '2024-09-11T22:20:18.828308+0000', 'last_clean': '2024-09-11T22:20:18.828308+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:20:19.847772+0000', 'last_undegraded': '2024-09-11T22:20:19.847772+0000', 'last_fullsized': '2024-09-11T22:20:19.847772+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 21, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'last_clean_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T22:21:07.217 INFO:tasks.mon_thrash.ceph_manager:PG 3.3f is not active+clean 2024-09-11T22:21:07.218 INFO:tasks.mon_thrash.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 27, 'state': 'peering', 'last_fresh': '2024-09-11T22:20:19.843776+0000', 'last_change': '2024-09-11T22:21:01.323294+0000', 'last_active': '2024-09-11T22:20:18.828308+0000', 'last_peered': '2024-09-11T22:20:18.828308+0000', 'last_clean': '2024-09-11T22:20:18.828308+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-11T22:20:19.843776+0000', 'last_undegraded': '2024-09-11T22:20:19.843776+0000', 'last_fullsized': '2024-09-11T22:20:19.843776+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 21, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'last_clean_scrub_stamp': '2024-09-11T22:20:18.828308+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-11T22:21:07.219 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-11T22:21:07.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.344+0000 7fa48670a640 1 Processor -- start 2024-09-11T22:21:07.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.344+0000 7fa48670a640 1 -- start start 2024-09-11T22:21:07.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.345+0000 7fa48670a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa480154710 0x7fa4800c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:07.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.345+0000 7fa48670a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa48006e140 0x7fa480067950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.345+0000 7fa48670a640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4800c7f00 con 0x7fa480067e90 2024-09-11T22:21:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.345+0000 7fa48670a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fa48006ced0 con 0x7fa480154710 2024-09-11T22:21:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.345+0000 7fa48670a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa48006d100 con 0x7fa48006e140 2024-09-11T22:21:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.345+0000 7fa484ca7640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa480067e90 0x7fa48015ddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59634/0 (socket says 172.21.15.100:59634) 2024-09-11T22:21:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.345+0000 7fa484ca7640 1 -- 172.21.15.100:0/1095712775 learned_addr learned my addr 172.21.15.100:0/1095712775 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:21:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.345+0000 7fa47f7fe640 1 --2- 172.21.15.100:0/1095712775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa48006e140 0x7fa480067950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.345+0000 7fa47ffff640 1 --2- 172.21.15.100:0/1095712775 >> v2:172.21.15.167:3300/0 conn(0x7fa480154710 0x7fa4800c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.345+0000 7fa47effd640 1 -- 172.21.15.100:0/1095712775 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3562387832 0 0) 0x7fa4800c7f00 con 0x7fa480067e90 2024-09-11T22:21:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.345+0000 7fa47effd640 1 -- 172.21.15.100:0/1095712775 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa468003520 con 0x7fa480067e90 2024-09-11T22:21:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.345+0000 7fa47effd640 1 -- 172.21.15.100:0/1095712775 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3404142057 0 0) 0x7fa468003520 con 0x7fa480067e90 2024-09-11T22:21:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.345+0000 7fa47effd640 1 -- 172.21.15.100:0/1095712775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa48006e140 msgr2=0x7fa480067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:07.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.345+0000 7fa47effd640 1 --2- 172.21.15.100:0/1095712775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa48006e140 0x7fa480067950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.345+0000 7fa47effd640 1 -- 172.21.15.100:0/1095712775 >> v2:172.21.15.167:3300/0 conn(0x7fa480154710 msgr2=0x7fa4800c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:07.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.345+0000 7fa47effd640 1 --2- 172.21.15.100:0/1095712775 >> v2:172.21.15.167:3300/0 conn(0x7fa480154710 0x7fa4800c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.345+0000 7fa47effd640 1 -- 172.21.15.100:0/1095712775 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48006d3c0 con 0x7fa480067e90 2024-09-11T22:21:07.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.345+0000 7fa47effd640 1 -- 172.21.15.100:0/1095712775 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fa4780019f0 con 0x7fa480067e90 2024-09-11T22:21:07.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.345+0000 7fa47effd640 1 -- 172.21.15.100:0/1095712775 >> v1:172.21.15.100:6789/0 conn(0x7fa480067e90 legacy=0x7fa48015ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:07.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.345+0000 7fa47effd640 1 --2- 172.21.15.100:0/1095712775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa48006e140 0x7fa4680039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:07.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.345+0000 7fa47effd640 1 --2- 172.21.15.100:0/1095712775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa468003f30 0x7fa468004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:07.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.345+0000 7fa47effd640 1 --2- 172.21.15.100:0/1095712775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa468004d40 0x7fa4680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:07.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.345+0000 7fa47effd640 1 -- 172.21.15.100:0/1095712775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa48006d100 con 0x7fa468004d40 2024-09-11T22:21:07.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.346+0000 7fa47effd640 1 -- 172.21.15.100:0/1095712775 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa46800b9c0 con 0x7fa468003f30 2024-09-11T22:21:07.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.346+0000 7fa47effd640 1 -- 172.21.15.100:0/1095712775 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa46800bb70 con 0x7fa48006e140 2024-09-11T22:21:07.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.346+0000 7fa484ca7640 1 --2- 172.21.15.100:0/1095712775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa468004d40 0x7fa4680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:07.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.346+0000 7fa47f7fe640 1 --2- 172.21.15.100:0/1095712775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa468003f30 0x7fa468004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.346+0000 7fa47ffff640 1 --2- 172.21.15.100:0/1095712775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa48006e140 0x7fa4680039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.346+0000 7fa484ca7640 1 -- 172.21.15.100:0/1095712775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa48006e140 msgr2=0x7fa4680039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.346+0000 7fa484ca7640 1 --2- 172.21.15.100:0/1095712775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa48006e140 0x7fa4680039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.346+0000 7fa484ca7640 1 -- 172.21.15.100:0/1095712775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa468003f30 msgr2=0x7fa468004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.346+0000 7fa484ca7640 1 --2- 172.21.15.100:0/1095712775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa468003f30 0x7fa468004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.346+0000 7fa484ca7640 1 -- 172.21.15.100:0/1095712775 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa468003520 con 0x7fa468004d40 2024-09-11T22:21:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.346+0000 7fa484ca7640 1 --2- 172.21.15.100:0/1095712775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa468004d40 0x7fa4680051c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa4780013d0 tx=0x7fa468005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ea784529547429 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.347+0000 7fa47effd640 1 -- 172.21.15.100:0/1095712775 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47800a4e0 con 0x7fa468004d40 2024-09-11T22:21:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.347+0000 7fa47effd640 1 -- 172.21.15.100:0/1095712775 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa47802f070 con 0x7fa468004d40 2024-09-11T22:21:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.347+0000 7fa47effd640 1 -- 172.21.15.100:0/1095712775 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47802bce0 con 0x7fa468004d40 2024-09-11T22:21:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.347+0000 7fa48670a640 1 -- 172.21.15.100:0/1095712775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa468004d40 msgr2=0x7fa4680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.347+0000 7fa48670a640 1 --2- 172.21.15.100:0/1095712775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa468004d40 0x7fa4680051c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa4780013d0 tx=0x7fa468005830 comp rx=0 tx=0).stop 2024-09-11T22:21:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.347+0000 7fa484ca7640 1 -- 172.21.15.100:0/1095712775 reap_dead start 2024-09-11T22:21:07.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.347+0000 7fa48670a640 1 -- 172.21.15.100:0/1095712775 shutdown_connections 2024-09-11T22:21:07.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.347+0000 7fa48670a640 1 -- 172.21.15.100:0/1095712775 >> 172.21.15.100:0/1095712775 conn(0x7fa480070b80 msgr2=0x7fa4800ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:07.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.347+0000 7fa48670a640 1 -- 172.21.15.100:0/1095712775 shutdown_connections 2024-09-11T22:21:07.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.347+0000 7fa48670a640 1 -- 172.21.15.100:0/1095712775 wait complete. 2024-09-11T22:21:07.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.348+0000 7fa48670a640 1 Processor -- start 2024-09-11T22:21:07.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.349+0000 7fa48670a640 1 -- start start 2024-09-11T22:21:07.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.349+0000 7fa48670a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa468004d40 0x7fa4801efc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:07.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.349+0000 7fa48670a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa480148710 0x7fa4801f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:07.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.349+0000 7fa48670a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa48014e760 0x7fa48014f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:07.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.349+0000 7fa48670a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa48015b110 con 0x7fa48014e760 2024-09-11T22:21:07.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.349+0000 7fa48670a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa48015ae30 con 0x7fa468004d40 2024-09-11T22:21:07.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.349+0000 7fa48670a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa48015b3f0 con 0x7fa480148710 2024-09-11T22:21:07.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.349+0000 7fa484ca7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa48014e760 0x7fa48014f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:07.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.349+0000 7fa484ca7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa48014e760 0x7fa48014f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38050/0 (socket says 172.21.15.100:38050) 2024-09-11T22:21:07.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.349+0000 7fa484ca7640 1 -- 172.21.15.100:0/1832784991 learned_addr learned my addr 172.21.15.100:0/1832784991 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:07.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.349+0000 7fa47f7fe640 1 --2- 172.21.15.100:0/1832784991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa480148710 0x7fa4801f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:07.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.349+0000 7fa47ffff640 1 --2- 172.21.15.100:0/1832784991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa468004d40 0x7fa4801efc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:07.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.350+0000 7fa484ca7640 1 -- 172.21.15.100:0/1832784991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa480148710 msgr2=0x7fa4801f3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:07.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.350+0000 7fa484ca7640 1 --2- 172.21.15.100:0/1832784991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa480148710 0x7fa4801f3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.350+0000 7fa484ca7640 1 -- 172.21.15.100:0/1832784991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa468004d40 msgr2=0x7fa4801efc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:07.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.350+0000 7fa484ca7640 1 --2- 172.21.15.100:0/1832784991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa468004d40 0x7fa4801efc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.350+0000 7fa484ca7640 1 -- 172.21.15.100:0/1832784991 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4801f31e0 con 0x7fa48014e760 2024-09-11T22:21:07.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.350+0000 7fa484ca7640 1 --2- 172.21.15.100:0/1832784991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa48014e760 0x7fa48014f3a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa478001cf0 tx=0x7fa478001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:07.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.350+0000 7fa47cff9640 1 -- 172.21.15.100:0/1832784991 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478002040 con 0x7fa48014e760 2024-09-11T22:21:07.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.350+0000 7fa47cff9640 1 -- 172.21.15.100:0/1832784991 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa47800a4c0 con 0x7fa48014e760 2024-09-11T22:21:07.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.350+0000 7fa47cff9640 1 -- 172.21.15.100:0/1832784991 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478034670 con 0x7fa48014e760 2024-09-11T22:21:07.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.350+0000 7fa48670a640 1 -- 172.21.15.100:0/1832784991 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa480149200 con 0x7fa48014e760 2024-09-11T22:21:07.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.350+0000 7fa48670a640 1 -- 172.21.15.100:0/1832784991 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4801f34a0 con 0x7fa48014e760 2024-09-11T22:21:07.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.351+0000 7fa48670a640 1 -- 172.21.15.100:0/1832784991 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa48015a800 con 0x7fa48014e760 2024-09-11T22:21:07.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.351+0000 7fa47cff9640 1 -- 172.21.15.100:0/1832784991 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa478034810 con 0x7fa48014e760 2024-09-11T22:21:07.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.352+0000 7fa47cff9640 1 --2- 172.21.15.100:0/1832784991 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa46c06be60 0x7fa46c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:07.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.352+0000 7fa47cff9640 1 -- 172.21.15.100:0/1832784991 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fa4780ab180 con 0x7fa48014e760 2024-09-11T22:21:07.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.352+0000 7fa47ffff640 1 --2- 172.21.15.100:0/1832784991 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa46c06be60 0x7fa46c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:07.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.352+0000 7fa47ffff640 1 --2- 172.21.15.100:0/1832784991 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa46c06be60 0x7fa46c06e320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa470009c40 tx=0x7fa470009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:07.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.356+0000 7fa47cff9640 1 -- 172.21.15.100:0/1832784991 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa478046060 con 0x7fa48014e760 2024-09-11T22:21:07.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.584+0000 7fa48670a640 1 -- 172.21.15.100:0/1832784991 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa480153060 con 0x7fa48014e760 2024-09-11T22:21:07.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.584+0000 7fa47cff9640 1 -- 172.21.15.100:0/1832784991 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+3018 (secure 0 0 0) 0x7fa4780797d0 con 0x7fa48014e760 2024-09-11T22:21:07.585 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:21:07.585 INFO:teuthology.orchestra.run.smithi100.stdout:{"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":71,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":28,"num_osds":8,"num_up_osds":8,"osd_up_since":1726093207,"num_in_osds":8,"osd_in_since":1726093198,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":124},{"state_name":"peering","count":5}],"num_pgs":129,"num_pools":4,"num_objects":62,"data_bytes":598265,"bytes_used":224034816,"bytes_avail":772870078464,"bytes_total":773094113280,"inactive_pgs_ratio":0.038759689778089523,"write_bytes_sec":127,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":14,"btime":"2024-09-11T22:20:52:989866+0000","id":1,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":1,"rank":2,"name":"a","status":"up:active","gid":4275},{"filesystem_id":1,"rank":1,"name":"e","status":"up:active","gid":4281},{"filesystem_id":1,"rank":0,"name":"f","status":"up:active","gid":4296}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-09-11T22:21:06.315083+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-11T22:21:07.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.586+0000 7fa48670a640 1 -- 172.21.15.100:0/1832784991 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa46c06be60 msgr2=0x7fa46c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:07.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.586+0000 7fa48670a640 1 --2- 172.21.15.100:0/1832784991 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa46c06be60 0x7fa46c06e320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa470009c40 tx=0x7fa470009190 comp rx=0 tx=0).stop 2024-09-11T22:21:07.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.586+0000 7fa48670a640 1 -- 172.21.15.100:0/1832784991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa48014e760 msgr2=0x7fa48014f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:07.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.586+0000 7fa48670a640 1 --2- 172.21.15.100:0/1832784991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa48014e760 0x7fa48014f3a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa478001cf0 tx=0x7fa478001dc0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.586+0000 7fa48670a640 1 -- 172.21.15.100:0/1832784991 shutdown_connections 2024-09-11T22:21:07.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.586+0000 7fa48670a640 1 --2- 172.21.15.100:0/1832784991 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa46c06be60 0x7fa46c06e320 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.586+0000 7fa48670a640 1 --2- 172.21.15.100:0/1832784991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa48014e760 0x7fa48014f3a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.586+0000 7fa48670a640 1 --2- 172.21.15.100:0/1832784991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa480148710 0x7fa4801f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.586+0000 7fa48670a640 1 --2- 172.21.15.100:0/1832784991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa468004d40 0x7fa4801efc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.586+0000 7fa48670a640 1 -- 172.21.15.100:0/1832784991 >> 172.21.15.100:0/1832784991 conn(0x7fa480070b80 msgr2=0x7fa480158670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:07.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.586+0000 7fa48670a640 1 -- 172.21.15.100:0/1832784991 shutdown_connections 2024-09-11T22:21:07.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.586+0000 7fa48670a640 1 -- 172.21.15.100:0/1832784991 wait complete. 2024-09-11T22:21:07.598 INFO:tasks.mon_thrash.ceph_manager:no progress seen, keeping timeout for now 2024-09-11T22:21:07.598 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:21:07.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.696+0000 7fd01eb31640 1 Processor -- start 2024-09-11T22:21:07.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.696+0000 7fd01eb31640 1 -- start start 2024-09-11T22:21:07.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.696+0000 7fd01eb31640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd018154c20 0x7fd0180cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:07.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.696+0000 7fd01eb31640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd01815ac90 con 0x7fd0180b3190 2024-09-11T22:21:07.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.696+0000 7fd01eb31640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd01815af70 con 0x7fd01815a7e0 2024-09-11T22:21:07.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.696+0000 7fd01eb31640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fd01815e000 con 0x7fd018154c20 2024-09-11T22:21:07.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.697+0000 7fd01c8cd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd018154c20 0x7fd0180cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:07.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.697+0000 7fd017fff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd0180b3190 0x7fd01815e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59640/0 (socket says 172.21.15.100:59640) 2024-09-11T22:21:07.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.697+0000 7fd017fff640 1 -- 172.21.15.100:0/3157990391 learned_addr learned my addr 172.21.15.100:0/3157990391 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:21:07.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.697+0000 7fd01c8cd640 1 -- 172.21.15.100:0/3157990391 >> v1:172.21.15.167:6789/0 conn(0x7fd01815a7e0 legacy=0x7fd0180cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:07.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.697+0000 7fd01c8cd640 1 -- 172.21.15.100:0/3157990391 >> v1:172.21.15.100:6789/0 conn(0x7fd0180b3190 legacy=0x7fd01815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:07.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.697+0000 7fd01c8cd640 1 -- 172.21.15.100:0/3157990391 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd01815b250 con 0x7fd018154c20 2024-09-11T22:21:07.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.697+0000 7fd0177fe640 1 -- 172.21.15.100:0/3157990391 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2555492256 0 0) 0x7fd01815ac90 con 0x7fd0180b3190 2024-09-11T22:21:07.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.698+0000 7fd01c8cd640 1 --2- 172.21.15.100:0/3157990391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd018154c20 0x7fd0180cb120 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd01815e180 tx=0x7fd00c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3584a3c85853024 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:07.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.698+0000 7fd0177fe640 1 -- 172.21.15.100:0/3157990391 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c037070 con 0x7fd018154c20 2024-09-11T22:21:07.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.698+0000 7fd0177fe640 1 -- 172.21.15.100:0/3157990391 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd00c032440 con 0x7fd018154c20 2024-09-11T22:21:07.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.698+0000 7fd0177fe640 1 -- 172.21.15.100:0/3157990391 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c032810 con 0x7fd018154c20 2024-09-11T22:21:07.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.698+0000 7fd01eb31640 1 -- 172.21.15.100:0/3157990391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd018154c20 msgr2=0x7fd0180cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:07.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.698+0000 7fd01eb31640 1 --2- 172.21.15.100:0/3157990391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd018154c20 0x7fd0180cb120 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd01815e180 tx=0x7fd00c02a1c0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.698+0000 7fd01eb31640 1 -- 172.21.15.100:0/3157990391 shutdown_connections 2024-09-11T22:21:07.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.698+0000 7fd01eb31640 1 --2- 172.21.15.100:0/3157990391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd018154c20 0x7fd0180cb120 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.698+0000 7fd01eb31640 1 -- 172.21.15.100:0/3157990391 >> 172.21.15.100:0/3157990391 conn(0x7fd018067d40 msgr2=0x7fd01806d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:07.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.698+0000 7fd01eb31640 1 -- 172.21.15.100:0/3157990391 shutdown_connections 2024-09-11T22:21:07.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.698+0000 7fd01eb31640 1 -- 172.21.15.100:0/3157990391 wait complete. 2024-09-11T22:21:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.699+0000 7fd01eb31640 1 Processor -- start 2024-09-11T22:21:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.699+0000 7fd01eb31640 1 -- start start 2024-09-11T22:21:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.700+0000 7fd01eb31640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0180b3190 0x7fd018159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.700+0000 7fd01eb31640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd018154c20 0x7fd0180ce590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.700+0000 7fd01eb31640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd01815a7e0 0x7fd0180cf640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.700+0000 7fd01eb31640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd01815ed20 con 0x7fd0180b3190 2024-09-11T22:21:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.700+0000 7fd01eb31640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd01815eba0 con 0x7fd01815a7e0 2024-09-11T22:21:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.700+0000 7fd01eb31640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd0180cc420 con 0x7fd018154c20 2024-09-11T22:21:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.700+0000 7fd01c8cd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0180b3190 0x7fd018159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.700+0000 7fd01c8cd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0180b3190 0x7fd018159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38076/0 (socket says 172.21.15.100:38076) 2024-09-11T22:21:07.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.700+0000 7fd01c8cd640 1 -- 172.21.15.100:0/1173157717 learned_addr learned my addr 172.21.15.100:0/1173157717 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:07.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.701+0000 7fd01d0ce640 1 --2- 172.21.15.100:0/1173157717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd01815a7e0 0x7fd0180cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:07.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.701+0000 7fd017fff640 1 --2- 172.21.15.100:0/1173157717 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd018154c20 0x7fd0180ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:07.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.701+0000 7fd01c8cd640 1 -- 172.21.15.100:0/1173157717 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd018154c20 msgr2=0x7fd0180ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:07.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.701+0000 7fd01c8cd640 1 --2- 172.21.15.100:0/1173157717 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd018154c20 0x7fd0180ce590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.701+0000 7fd01c8cd640 1 -- 172.21.15.100:0/1173157717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd01815a7e0 msgr2=0x7fd0180cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:07.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.701+0000 7fd01c8cd640 1 --2- 172.21.15.100:0/1173157717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd01815a7e0 0x7fd0180cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.701+0000 7fd01c8cd640 1 -- 172.21.15.100:0/1173157717 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0181f3e00 con 0x7fd0180b3190 2024-09-11T22:21:07.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.701+0000 7fd01d0ce640 1 --2- 172.21.15.100:0/1173157717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd01815a7e0 0x7fd0180cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:07.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.701+0000 7fd01c8cd640 1 --2- 172.21.15.100:0/1173157717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0180b3190 0x7fd018159e30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd00c009890 tx=0x7fd00c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:07.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.701+0000 7fd0157fa640 1 -- 172.21.15.100:0/1173157717 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c041070 con 0x7fd0180b3190 2024-09-11T22:21:07.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.701+0000 7fd0157fa640 1 -- 172.21.15.100:0/1173157717 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd00c03c950 con 0x7fd0180b3190 2024-09-11T22:21:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.701+0000 7fd01eb31640 1 -- 172.21.15.100:0/1173157717 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0181f40a0 con 0x7fd0180b3190 2024-09-11T22:21:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.701+0000 7fd0157fa640 1 -- 172.21.15.100:0/1173157717 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c037040 con 0x7fd0180b3190 2024-09-11T22:21:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.701+0000 7fd01eb31640 1 -- 172.21.15.100:0/1173157717 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0181f4660 con 0x7fd0180b3190 2024-09-11T22:21:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.702+0000 7fd01eb31640 1 -- 172.21.15.100:0/1173157717 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0180ccfc0 con 0x7fd0180b3190 2024-09-11T22:21:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.703+0000 7fd0157fa640 1 -- 172.21.15.100:0/1173157717 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd00c044070 con 0x7fd0180b3190 2024-09-11T22:21:07.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.703+0000 7fd0157fa640 1 --2- 172.21.15.100:0/1173157717 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcffc06be60 0x7fcffc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:07.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.703+0000 7fd0157fa640 1 -- 172.21.15.100:0/1173157717 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fd00c0abea0 con 0x7fd0180b3190 2024-09-11T22:21:07.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.703+0000 7fd017fff640 1 --2- 172.21.15.100:0/1173157717 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcffc06be60 0x7fcffc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:07.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.703+0000 7fd017fff640 1 --2- 172.21.15.100:0/1173157717 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcffc06be60 0x7fcffc06e320 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd01815eae0 tx=0x7fd004009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:07.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.707+0000 7fd0157fa640 1 -- 172.21.15.100:0/1173157717 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd0180ccfc0 con 0x7fd0180b3190 2024-09-11T22:21:07.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.872+0000 7fd01eb31640 1 -- 172.21.15.100:0/1173157717 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd01815e490 con 0x7fcffc06be60 2024-09-11T22:21:07.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.879+0000 7fd0157fa640 1 -- 172.21.15.100:0/1173157717 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332445 (secure 0 0 0) 0x7fd01815e490 con 0x7fcffc06be60 2024-09-11T22:21:07.884 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:21:07.886 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-11T22:21:07.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.883+0000 7fd01eb31640 1 -- 172.21.15.100:0/1173157717 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcffc06be60 msgr2=0x7fcffc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:07.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.883+0000 7fd01eb31640 1 --2- 172.21.15.100:0/1173157717 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcffc06be60 0x7fcffc06e320 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd01815eae0 tx=0x7fd004009040 comp rx=0 tx=0).stop 2024-09-11T22:21:07.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.883+0000 7fd01eb31640 1 -- 172.21.15.100:0/1173157717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0180b3190 msgr2=0x7fd018159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:07.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.883+0000 7fd01eb31640 1 --2- 172.21.15.100:0/1173157717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0180b3190 0x7fd018159e30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd00c009890 tx=0x7fd00c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.883+0000 7fd01eb31640 1 -- 172.21.15.100:0/1173157717 shutdown_connections 2024-09-11T22:21:07.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.883+0000 7fd01eb31640 1 --2- 172.21.15.100:0/1173157717 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcffc06be60 0x7fcffc06e320 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.883+0000 7fd01eb31640 1 --2- 172.21.15.100:0/1173157717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd01815a7e0 0x7fd0180cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.883+0000 7fd01eb31640 1 --2- 172.21.15.100:0/1173157717 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd018154c20 0x7fd0180ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.883+0000 7fd01eb31640 1 --2- 172.21.15.100:0/1173157717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0180b3190 0x7fd018159e30 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:07.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.883+0000 7fd01eb31640 1 -- 172.21.15.100:0/1173157717 >> 172.21.15.100:0/1173157717 conn(0x7fd018067d40 msgr2=0x7fd0180b4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:07.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.883+0000 7fd01eb31640 1 -- 172.21.15.100:0/1173157717 shutdown_connections 2024-09-11T22:21:07.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:07.883+0000 7fd01eb31640 1 -- 172.21.15.100:0/1173157717 wait complete. 2024-09-11T22:21:07.894 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-09-11T22:21:06.314848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598265,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":319,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218784,"kb_used_data":2544,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755936,"statfs":{"total":773094113280,"available":772870078464,"internally_reserved":0,"allocated":2605056,"data_stored":2140274,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":443,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001744"},"pg_stats":[{"pgid":"2.1f","version":"26'9","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.034259+0000","last_change":"2024-09-11T22:20:18.853007+0000","last_active":"2024-09-11T22:21:01.034259+0000","last_peered":"2024-09-11T22:21:01.034259+0000","last_clean":"2024-09-11T22:21:01.034259+0000","last_became_active":"2024-09-11T22:20:18.852740+0000","last_became_peered":"2024-09-11T22:20:18.852740+0000","last_unstale":"2024-09-11T22:21:01.034259+0000","last_undegraded":"2024-09-11T22:21:01.034259+0000","last_fullsized":"2024-09-11T22:21:01.034259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:46.710328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033072+0000","last_change":"2024-09-11T22:20:19.849765+0000","last_active":"2024-09-11T22:21:02.033072+0000","last_peered":"2024-09-11T22:21:02.033072+0000","last_clean":"2024-09-11T22:21:02.033072+0000","last_became_active":"2024-09-11T22:20:19.848619+0000","last_became_peered":"2024-09-11T22:20:19.848619+0000","last_unstale":"2024-09-11T22:21:02.033072+0000","last_undegraded":"2024-09-11T22:21:02.033072+0000","last_fullsized":"2024-09-11T22:21:02.033072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:57.621624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031037+0000","last_change":"2024-09-11T22:20:24.078618+0000","last_active":"2024-09-11T22:21:02.031037+0000","last_peered":"2024-09-11T22:21:02.031037+0000","last_clean":"2024-09-11T22:21:02.031037+0000","last_became_active":"2024-09-11T22:20:24.078283+0000","last_became_peered":"2024-09-11T22:20:24.078283+0000","last_unstale":"2024-09-11T22:21:02.031037+0000","last_undegraded":"2024-09-11T22:21:02.031037+0000","last_fullsized":"2024-09-11T22:21:02.031037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:01.901307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033270+0000","last_change":"2024-09-11T22:20:18.855945+0000","last_active":"2024-09-11T22:21:02.033270+0000","last_peered":"2024-09-11T22:21:02.033270+0000","last_clean":"2024-09-11T22:21:02.033270+0000","last_became_active":"2024-09-11T22:20:18.854811+0000","last_became_peered":"2024-09-11T22:20:18.854811+0000","last_unstale":"2024-09-11T22:21:02.033270+0000","last_undegraded":"2024-09-11T22:21:02.033270+0000","last_fullsized":"2024-09-11T22:21:02.033270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:47.508920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033442+0000","last_change":"2024-09-11T22:20:19.862436+0000","last_active":"2024-09-11T22:21:01.033442+0000","last_peered":"2024-09-11T22:21:01.033442+0000","last_clean":"2024-09-11T22:21:01.033442+0000","last_became_active":"2024-09-11T22:20:19.862061+0000","last_became_peered":"2024-09-11T22:20:19.862061+0000","last_unstale":"2024-09-11T22:21:01.033442+0000","last_undegraded":"2024-09-11T22:21:01.033442+0000","last_fullsized":"2024-09-11T22:21:01.033442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028431+0000","last_change":"2024-09-11T22:20:23.879729+0000","last_active":"2024-09-11T22:21:02.028431+0000","last_peered":"2024-09-11T22:21:02.028431+0000","last_clean":"2024-09-11T22:21:02.028431+0000","last_became_active":"2024-09-11T22:20:23.879245+0000","last_became_peered":"2024-09-11T22:20:23.879245+0000","last_unstale":"2024-09-11T22:21:02.028431+0000","last_undegraded":"2024-09-11T22:21:02.028431+0000","last_fullsized":"2024-09-11T22:21:02.028431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:36.836842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030157+0000","last_change":"2024-09-11T22:20:18.853076+0000","last_active":"2024-09-11T22:21:02.030157+0000","last_peered":"2024-09-11T22:21:02.030157+0000","last_clean":"2024-09-11T22:21:02.030157+0000","last_became_active":"2024-09-11T22:20:18.852728+0000","last_became_peered":"2024-09-11T22:20:18.852728+0000","last_unstale":"2024-09-11T22:21:02.030157+0000","last_undegraded":"2024-09-11T22:21:02.030157+0000","last_fullsized":"2024-09-11T22:21:02.030157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227771+0000","last_change":"2024-09-11T22:20:19.864544+0000","last_active":"2024-09-11T22:21:02.227771+0000","last_peered":"2024-09-11T22:21:02.227771+0000","last_clean":"2024-09-11T22:21:02.227771+0000","last_became_active":"2024-09-11T22:20:19.864234+0000","last_became_peered":"2024-09-11T22:20:19.864234+0000","last_unstale":"2024-09-11T22:21:02.227771+0000","last_undegraded":"2024-09-11T22:21:02.227771+0000","last_fullsized":"2024-09-11T22:21:02.227771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028549+0000","last_change":"2024-09-11T22:20:23.873783+0000","last_active":"2024-09-11T22:21:02.028549+0000","last_peered":"2024-09-11T22:21:02.028549+0000","last_clean":"2024-09-11T22:21:02.028549+0000","last_became_active":"2024-09-11T22:20:23.873385+0000","last_became_peered":"2024-09-11T22:20:23.873385+0000","last_unstale":"2024-09-11T22:21:02.028549+0000","last_undegraded":"2024-09-11T22:21:02.028549+0000","last_fullsized":"2024-09-11T22:21:02.028549+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029609+0000","last_change":"2024-09-11T22:20:18.861530+0000","last_active":"2024-09-11T22:21:02.029609+0000","last_peered":"2024-09-11T22:21:02.029609+0000","last_clean":"2024-09-11T22:21:02.029609+0000","last_became_active":"2024-09-11T22:20:18.861230+0000","last_became_peered":"2024-09-11T22:20:18.861230+0000","last_unstale":"2024-09-11T22:21:02.029609+0000","last_undegraded":"2024-09-11T22:21:02.029609+0000","last_fullsized":"2024-09-11T22:21:02.029609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227926+0000","last_change":"2024-09-11T22:20:19.863401+0000","last_active":"2024-09-11T22:21:02.227926+0000","last_peered":"2024-09-11T22:21:02.227926+0000","last_clean":"2024-09-11T22:21:02.227926+0000","last_became_active":"2024-09-11T22:20:19.863127+0000","last_became_peered":"2024-09-11T22:20:19.863127+0000","last_unstale":"2024-09-11T22:21:02.227926+0000","last_undegraded":"2024-09-11T22:21:02.227926+0000","last_fullsized":"2024-09-11T22:21:02.227926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:36.888544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028135+0000","last_change":"2024-09-11T22:20:23.874650+0000","last_active":"2024-09-11T22:21:02.028135+0000","last_peered":"2024-09-11T22:21:02.028135+0000","last_clean":"2024-09-11T22:21:02.028135+0000","last_became_active":"2024-09-11T22:20:23.874040+0000","last_became_peered":"2024-09-11T22:20:23.874040+0000","last_unstale":"2024-09-11T22:21:02.028135+0000","last_undegraded":"2024-09-11T22:21:02.028135+0000","last_fullsized":"2024-09-11T22:21:02.028135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025493+0000","last_change":"2024-09-11T22:20:19.859446+0000","last_active":"2024-09-11T22:21:02.025493+0000","last_peered":"2024-09-11T22:21:02.025493+0000","last_clean":"2024-09-11T22:21:02.025493+0000","last_became_active":"2024-09-11T22:20:19.859106+0000","last_became_peered":"2024-09-11T22:20:19.859106+0000","last_unstale":"2024-09-11T22:21:02.025493+0000","last_undegraded":"2024-09-11T22:21:02.025493+0000","last_fullsized":"2024-09-11T22:21:02.025493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029766+0000","last_change":"2024-09-11T22:20:18.856475+0000","last_active":"2024-09-11T22:21:02.029766+0000","last_peered":"2024-09-11T22:21:02.029766+0000","last_clean":"2024-09-11T22:21:02.029766+0000","last_became_active":"2024-09-11T22:20:18.856165+0000","last_became_peered":"2024-09-11T22:20:18.856165+0000","last_unstale":"2024-09-11T22:21:02.029766+0000","last_undegraded":"2024-09-11T22:21:02.029766+0000","last_fullsized":"2024-09-11T22:21:02.029766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028970+0000","last_change":"2024-09-11T22:20:23.878121+0000","last_active":"2024-09-11T22:21:02.028970+0000","last_peered":"2024-09-11T22:21:02.028970+0000","last_clean":"2024-09-11T22:21:02.028970+0000","last_became_active":"2024-09-11T22:20:23.877713+0000","last_became_peered":"2024-09-11T22:20:23.877713+0000","last_unstale":"2024-09-11T22:21:02.028970+0000","last_undegraded":"2024-09-11T22:21:02.028970+0000","last_fullsized":"2024-09-11T22:21:02.028970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033716+0000","last_change":"2024-09-11T22:20:19.858358+0000","last_active":"2024-09-11T22:21:02.033716+0000","last_peered":"2024-09-11T22:21:02.033716+0000","last_clean":"2024-09-11T22:21:02.033716+0000","last_became_active":"2024-09-11T22:20:19.858057+0000","last_became_peered":"2024-09-11T22:20:19.858057+0000","last_unstale":"2024-09-11T22:21:02.033716+0000","last_undegraded":"2024-09-11T22:21:02.033716+0000","last_fullsized":"2024-09-11T22:21:02.033716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:07.839926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029718+0000","last_change":"2024-09-11T22:20:18.853818+0000","last_active":"2024-09-11T22:21:02.029718+0000","last_peered":"2024-09-11T22:21:02.029718+0000","last_clean":"2024-09-11T22:21:02.029718+0000","last_became_active":"2024-09-11T22:20:18.853508+0000","last_became_peered":"2024-09-11T22:20:18.853508+0000","last_unstale":"2024-09-11T22:21:02.029718+0000","last_undegraded":"2024-09-11T22:21:02.029718+0000","last_fullsized":"2024-09-11T22:21:02.029718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:58.141587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.037670+0000","last_change":"2024-09-11T22:21:02.037670+0000","last_active":"2024-09-11T22:21:02.037670+0000","last_peered":"2024-09-11T22:21:02.037670+0000","last_clean":"2024-09-11T22:21:02.037670+0000","last_became_active":"2024-09-11T22:21:02.036941+0000","last_became_peered":"2024-09-11T22:21:02.036941+0000","last_unstale":"2024-09-11T22:21:02.037670+0000","last_undegraded":"2024-09-11T22:21:02.037670+0000","last_fullsized":"2024-09-11T22:21:02.037670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:20.859515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031746+0000","last_change":"2024-09-11T22:20:19.844748+0000","last_active":"2024-09-11T22:21:02.031746+0000","last_peered":"2024-09-11T22:21:02.031746+0000","last_clean":"2024-09-11T22:21:02.031746+0000","last_became_active":"2024-09-11T22:20:19.844446+0000","last_became_peered":"2024-09-11T22:20:19.844446+0000","last_unstale":"2024-09-11T22:21:02.031746+0000","last_undegraded":"2024-09-11T22:21:02.031746+0000","last_fullsized":"2024-09-11T22:21:02.031746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:13.319918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029638+0000","last_change":"2024-09-11T22:20:18.847388+0000","last_active":"2024-09-11T22:21:02.029638+0000","last_peered":"2024-09-11T22:21:02.029638+0000","last_clean":"2024-09-11T22:21:02.029638+0000","last_became_active":"2024-09-11T22:20:18.847118+0000","last_became_peered":"2024-09-11T22:20:18.847118+0000","last_unstale":"2024-09-11T22:21:02.029638+0000","last_undegraded":"2024-09-11T22:21:02.029638+0000","last_fullsized":"2024-09-11T22:21:02.029638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:47.360920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029161+0000","last_change":"2024-09-11T22:20:24.077604+0000","last_active":"2024-09-11T22:21:02.029161+0000","last_peered":"2024-09-11T22:21:02.029161+0000","last_clean":"2024-09-11T22:21:02.029161+0000","last_became_active":"2024-09-11T22:20:24.077231+0000","last_became_peered":"2024-09-11T22:20:24.077231+0000","last_unstale":"2024-09-11T22:21:02.029161+0000","last_undegraded":"2024-09-11T22:21:02.029161+0000","last_fullsized":"2024-09-11T22:21:02.029161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:38.846688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028259+0000","last_change":"2024-09-11T22:20:19.854453+0000","last_active":"2024-09-11T22:21:02.028259+0000","last_peered":"2024-09-11T22:21:02.028259+0000","last_clean":"2024-09-11T22:21:02.028259+0000","last_became_active":"2024-09-11T22:20:19.854100+0000","last_became_peered":"2024-09-11T22:20:19.854100+0000","last_unstale":"2024-09-11T22:21:02.028259+0000","last_undegraded":"2024-09-11T22:21:02.028259+0000","last_fullsized":"2024-09-11T22:21:02.028259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:06.166813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029113+0000","last_change":"2024-09-11T22:20:18.854889+0000","last_active":"2024-09-11T22:21:02.029113+0000","last_peered":"2024-09-11T22:21:02.029113+0000","last_clean":"2024-09-11T22:21:02.029113+0000","last_became_active":"2024-09-11T22:20:18.854552+0000","last_became_peered":"2024-09-11T22:20:18.854552+0000","last_unstale":"2024-09-11T22:21:02.029113+0000","last_undegraded":"2024-09-11T22:21:02.029113+0000","last_fullsized":"2024-09-11T22:21:02.029113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:33.612126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028918+0000","last_change":"2024-09-11T22:20:23.878932+0000","last_active":"2024-09-11T22:21:02.028918+0000","last_peered":"2024-09-11T22:21:02.028918+0000","last_clean":"2024-09-11T22:21:02.028918+0000","last_became_active":"2024-09-11T22:20:23.878305+0000","last_became_peered":"2024-09-11T22:20:23.878305+0000","last_unstale":"2024-09-11T22:21:02.028918+0000","last_undegraded":"2024-09-11T22:21:02.028918+0000","last_fullsized":"2024-09-11T22:21:02.028918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033835+0000","last_change":"2024-09-11T22:20:19.856318+0000","last_active":"2024-09-11T22:21:01.033835+0000","last_peered":"2024-09-11T22:21:01.033835+0000","last_clean":"2024-09-11T22:21:01.033835+0000","last_became_active":"2024-09-11T22:20:19.855992+0000","last_became_peered":"2024-09-11T22:20:19.855992+0000","last_unstale":"2024-09-11T22:21:01.033835+0000","last_undegraded":"2024-09-11T22:21:01.033835+0000","last_fullsized":"2024-09-11T22:21:01.033835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:57.709140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026101+0000","last_change":"2024-09-11T22:20:18.850750+0000","last_active":"2024-09-11T22:21:02.026101+0000","last_peered":"2024-09-11T22:21:02.026101+0000","last_clean":"2024-09-11T22:21:02.026101+0000","last_became_active":"2024-09-11T22:20:18.849621+0000","last_became_peered":"2024-09-11T22:20:18.849621+0000","last_unstale":"2024-09-11T22:21:02.026101+0000","last_undegraded":"2024-09-11T22:21:02.026101+0000","last_fullsized":"2024-09-11T22:21:02.026101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028034+0000","last_change":"2024-09-11T22:20:24.077741+0000","last_active":"2024-09-11T22:21:02.028034+0000","last_peered":"2024-09-11T22:21:02.028034+0000","last_clean":"2024-09-11T22:21:02.028034+0000","last_became_active":"2024-09-11T22:20:24.077325+0000","last_became_peered":"2024-09-11T22:20:24.077325+0000","last_unstale":"2024-09-11T22:21:02.028034+0000","last_undegraded":"2024-09-11T22:21:02.028034+0000","last_fullsized":"2024-09-11T22:21:02.028034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:18.656529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033274+0000","last_change":"2024-09-11T22:20:19.850738+0000","last_active":"2024-09-11T22:21:02.033274+0000","last_peered":"2024-09-11T22:21:02.033274+0000","last_clean":"2024-09-11T22:21:02.033274+0000","last_became_active":"2024-09-11T22:20:19.850441+0000","last_became_peered":"2024-09-11T22:20:19.850441+0000","last_unstale":"2024-09-11T22:21:02.033274+0000","last_undegraded":"2024-09-11T22:21:02.033274+0000","last_fullsized":"2024-09-11T22:21:02.033274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:47.552343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029867+0000","last_change":"2024-09-11T22:20:18.845173+0000","last_active":"2024-09-11T22:21:02.029867+0000","last_peered":"2024-09-11T22:21:02.029867+0000","last_clean":"2024-09-11T22:21:02.029867+0000","last_became_active":"2024-09-11T22:20:18.844731+0000","last_became_peered":"2024-09-11T22:20:18.844731+0000","last_unstale":"2024-09-11T22:21:02.029867+0000","last_undegraded":"2024-09-11T22:21:02.029867+0000","last_fullsized":"2024-09-11T22:21:02.029867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:32.963285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.037927+0000","last_change":"2024-09-11T22:21:02.037927+0000","last_active":"2024-09-11T22:21:02.037927+0000","last_peered":"2024-09-11T22:21:02.037927+0000","last_clean":"2024-09-11T22:21:02.037927+0000","last_became_active":"2024-09-11T22:21:02.037520+0000","last_became_peered":"2024-09-11T22:21:02.037520+0000","last_unstale":"2024-09-11T22:21:02.037927+0000","last_undegraded":"2024-09-11T22:21:02.037927+0000","last_fullsized":"2024-09-11T22:21:02.037927+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:38.798530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.032044+0000","last_change":"2024-09-11T22:20:19.845497+0000","last_active":"2024-09-11T22:21:02.032044+0000","last_peered":"2024-09-11T22:21:02.032044+0000","last_clean":"2024-09-11T22:21:02.032044+0000","last_became_active":"2024-09-11T22:20:19.845203+0000","last_became_peered":"2024-09-11T22:20:19.845203+0000","last_unstale":"2024-09-11T22:21:02.032044+0000","last_undegraded":"2024-09-11T22:21:02.032044+0000","last_fullsized":"2024-09-11T22:21:02.032044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:12.086231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030346+0000","last_change":"2024-09-11T22:20:18.856263+0000","last_active":"2024-09-11T22:21:02.030346+0000","last_peered":"2024-09-11T22:21:02.030346+0000","last_clean":"2024-09-11T22:21:02.030346+0000","last_became_active":"2024-09-11T22:20:18.855968+0000","last_became_peered":"2024-09-11T22:20:18.855968+0000","last_unstale":"2024-09-11T22:21:02.030346+0000","last_undegraded":"2024-09-11T22:21:02.030346+0000","last_fullsized":"2024-09-11T22:21:02.030346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033466+0000","last_change":"2024-09-11T22:20:24.075030+0000","last_active":"2024-09-11T22:21:01.033466+0000","last_peered":"2024-09-11T22:21:01.033466+0000","last_clean":"2024-09-11T22:21:01.033466+0000","last_became_active":"2024-09-11T22:20:24.074588+0000","last_became_peered":"2024-09-11T22:20:24.074588+0000","last_unstale":"2024-09-11T22:21:01.033466+0000","last_undegraded":"2024-09-11T22:21:01.033466+0000","last_fullsized":"2024-09-11T22:21:01.033466+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227987+0000","last_change":"2024-09-11T22:20:19.859010+0000","last_active":"2024-09-11T22:21:02.227987+0000","last_peered":"2024-09-11T22:21:02.227987+0000","last_clean":"2024-09-11T22:21:02.227987+0000","last_became_active":"2024-09-11T22:20:19.858585+0000","last_became_peered":"2024-09-11T22:20:19.858585+0000","last_unstale":"2024-09-11T22:21:02.227987+0000","last_undegraded":"2024-09-11T22:21:02.227987+0000","last_fullsized":"2024-09-11T22:21:02.227987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.032132+0000","last_change":"2024-09-11T22:20:18.847904+0000","last_active":"2024-09-11T22:21:02.032132+0000","last_peered":"2024-09-11T22:21:02.032132+0000","last_clean":"2024-09-11T22:21:02.032132+0000","last_became_active":"2024-09-11T22:20:18.847669+0000","last_became_peered":"2024-09-11T22:20:18.847669+0000","last_unstale":"2024-09-11T22:21:02.032132+0000","last_undegraded":"2024-09-11T22:21:02.032132+0000","last_fullsized":"2024-09-11T22:21:02.032132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:08.717999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029308+0000","last_change":"2024-09-11T22:20:23.881067+0000","last_active":"2024-09-11T22:21:02.029308+0000","last_peered":"2024-09-11T22:21:02.029308+0000","last_clean":"2024-09-11T22:21:02.029308+0000","last_became_active":"2024-09-11T22:20:23.880468+0000","last_became_peered":"2024-09-11T22:20:23.880468+0000","last_unstale":"2024-09-11T22:21:02.029308+0000","last_undegraded":"2024-09-11T22:21:02.029308+0000","last_fullsized":"2024-09-11T22:21:02.029308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:23.480547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028714+0000","last_change":"2024-09-11T22:20:19.860423+0000","last_active":"2024-09-11T22:21:02.028714+0000","last_peered":"2024-09-11T22:21:02.028714+0000","last_clean":"2024-09-11T22:21:02.028714+0000","last_became_active":"2024-09-11T22:20:19.858932+0000","last_became_peered":"2024-09-11T22:20:19.858932+0000","last_unstale":"2024-09-11T22:21:02.028714+0000","last_undegraded":"2024-09-11T22:21:02.028714+0000","last_fullsized":"2024-09-11T22:21:02.028714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:53.255932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227699+0000","last_change":"2024-09-11T22:20:18.854973+0000","last_active":"2024-09-11T22:21:02.227699+0000","last_peered":"2024-09-11T22:21:02.227699+0000","last_clean":"2024-09-11T22:21:02.227699+0000","last_became_active":"2024-09-11T22:20:18.854725+0000","last_became_peered":"2024-09-11T22:20:18.854725+0000","last_unstale":"2024-09-11T22:21:02.227699+0000","last_undegraded":"2024-09-11T22:21:02.227699+0000","last_fullsized":"2024-09-11T22:21:02.227699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031943+0000","last_change":"2024-09-11T22:20:23.880693+0000","last_active":"2024-09-11T22:21:02.031943+0000","last_peered":"2024-09-11T22:21:02.031943+0000","last_clean":"2024-09-11T22:21:02.031943+0000","last_became_active":"2024-09-11T22:20:23.880243+0000","last_became_peered":"2024-09-11T22:20:23.880243+0000","last_unstale":"2024-09-11T22:21:02.031943+0000","last_undegraded":"2024-09-11T22:21:02.031943+0000","last_fullsized":"2024-09-11T22:21:02.031943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.659287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029266+0000","last_change":"2024-09-11T22:20:19.844808+0000","last_active":"2024-09-11T22:21:02.029266+0000","last_peered":"2024-09-11T22:21:02.029266+0000","last_clean":"2024-09-11T22:21:02.029266+0000","last_became_active":"2024-09-11T22:20:19.844536+0000","last_became_peered":"2024-09-11T22:20:19.844536+0000","last_unstale":"2024-09-11T22:21:02.029266+0000","last_undegraded":"2024-09-11T22:21:02.029266+0000","last_fullsized":"2024-09-11T22:21:02.029266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:57.142383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025228+0000","last_change":"2024-09-11T22:20:18.855640+0000","last_active":"2024-09-11T22:21:01.025228+0000","last_peered":"2024-09-11T22:21:01.025228+0000","last_clean":"2024-09-11T22:21:01.025228+0000","last_became_active":"2024-09-11T22:20:18.855394+0000","last_became_peered":"2024-09-11T22:20:18.855394+0000","last_unstale":"2024-09-11T22:21:01.025228+0000","last_undegraded":"2024-09-11T22:21:01.025228+0000","last_fullsized":"2024-09-11T22:21:01.025228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029268+0000","last_change":"2024-09-11T22:20:23.882554+0000","last_active":"2024-09-11T22:21:02.029268+0000","last_peered":"2024-09-11T22:21:02.029268+0000","last_clean":"2024-09-11T22:21:02.029268+0000","last_became_active":"2024-09-11T22:20:23.881642+0000","last_became_peered":"2024-09-11T22:20:23.881642+0000","last_unstale":"2024-09-11T22:21:02.029268+0000","last_undegraded":"2024-09-11T22:21:02.029268+0000","last_fullsized":"2024-09-11T22:21:02.029268+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:16.696043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033143+0000","last_change":"2024-09-11T22:20:19.859429+0000","last_active":"2024-09-11T22:21:01.033143+0000","last_peered":"2024-09-11T22:21:01.033143+0000","last_clean":"2024-09-11T22:21:01.033143+0000","last_became_active":"2024-09-11T22:20:19.859159+0000","last_became_peered":"2024-09-11T22:20:19.859159+0000","last_unstale":"2024-09-11T22:21:01.033143+0000","last_undegraded":"2024-09-11T22:21:01.033143+0000","last_fullsized":"2024-09-11T22:21:01.033143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:02.696450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029225+0000","last_change":"2024-09-11T22:20:18.856144+0000","last_active":"2024-09-11T22:21:02.029225+0000","last_peered":"2024-09-11T22:21:02.029225+0000","last_clean":"2024-09-11T22:21:02.029225+0000","last_became_active":"2024-09-11T22:20:18.855866+0000","last_became_peered":"2024-09-11T22:20:18.855866+0000","last_unstale":"2024-09-11T22:21:02.029225+0000","last_undegraded":"2024-09-11T22:21:02.029225+0000","last_fullsized":"2024-09-11T22:21:02.029225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:37.259393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033635+0000","last_change":"2024-09-11T22:20:24.075154+0000","last_active":"2024-09-11T22:21:01.033635+0000","last_peered":"2024-09-11T22:21:01.033635+0000","last_clean":"2024-09-11T22:21:01.033635+0000","last_became_active":"2024-09-11T22:20:24.074568+0000","last_became_peered":"2024-09-11T22:20:24.074568+0000","last_unstale":"2024-09-11T22:21:01.033635+0000","last_undegraded":"2024-09-11T22:21:01.033635+0000","last_fullsized":"2024-09-11T22:21:01.033635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:09.804991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031694+0000","last_change":"2024-09-11T22:20:19.861236+0000","last_active":"2024-09-11T22:21:02.031694+0000","last_peered":"2024-09-11T22:21:02.031694+0000","last_clean":"2024-09-11T22:21:02.031694+0000","last_became_active":"2024-09-11T22:20:19.860938+0000","last_became_peered":"2024-09-11T22:20:19.860938+0000","last_unstale":"2024-09-11T22:21:02.031694+0000","last_undegraded":"2024-09-11T22:21:02.031694+0000","last_fullsized":"2024-09-11T22:21:02.031694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:42.015334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227590+0000","last_change":"2024-09-11T22:20:18.853467+0000","last_active":"2024-09-11T22:21:02.227590+0000","last_peered":"2024-09-11T22:21:02.227590+0000","last_clean":"2024-09-11T22:21:02.227590+0000","last_became_active":"2024-09-11T22:20:18.853182+0000","last_became_peered":"2024-09-11T22:20:18.853182+0000","last_unstale":"2024-09-11T22:21:02.227590+0000","last_undegraded":"2024-09-11T22:21:02.227590+0000","last_fullsized":"2024-09-11T22:21:02.227590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029398+0000","last_change":"2024-09-11T22:20:09.425648+0000","last_active":"2024-09-11T22:21:02.029398+0000","last_peered":"2024-09-11T22:21:02.029398+0000","last_clean":"2024-09-11T22:21:02.029398+0000","last_became_active":"2024-09-11T22:20:09.424591+0000","last_became_peered":"2024-09-11T22:20:09.424591+0000","last_unstale":"2024-09-11T22:21:02.029398+0000","last_undegraded":"2024-09-11T22:21:02.029398+0000","last_fullsized":"2024-09-11T22:21:02.029398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_clean_scrub_stamp":"2024-09-11T22:20:08.334092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:53.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025706+0000","last_change":"2024-09-11T22:20:24.077007+0000","last_active":"2024-09-11T22:21:02.025706+0000","last_peered":"2024-09-11T22:21:02.025706+0000","last_clean":"2024-09-11T22:21:02.025706+0000","last_became_active":"2024-09-11T22:20:24.076601+0000","last_became_peered":"2024-09-11T22:20:24.076601+0000","last_unstale":"2024-09-11T22:21:02.025706+0000","last_undegraded":"2024-09-11T22:21:02.025706+0000","last_fullsized":"2024-09-11T22:21:02.025706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030003+0000","last_change":"2024-09-11T22:20:19.863279+0000","last_active":"2024-09-11T22:21:02.030003+0000","last_peered":"2024-09-11T22:21:02.030003+0000","last_clean":"2024-09-11T22:21:02.030003+0000","last_became_active":"2024-09-11T22:20:19.861322+0000","last_became_peered":"2024-09-11T22:20:19.861322+0000","last_unstale":"2024-09-11T22:21:02.030003+0000","last_undegraded":"2024-09-11T22:21:02.030003+0000","last_fullsized":"2024-09-11T22:21:02.030003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025479+0000","last_change":"2024-09-11T22:20:18.853343+0000","last_active":"2024-09-11T22:21:01.025479+0000","last_peered":"2024-09-11T22:21:01.025479+0000","last_clean":"2024-09-11T22:21:01.025479+0000","last_became_active":"2024-09-11T22:20:18.853069+0000","last_became_peered":"2024-09-11T22:20:18.853069+0000","last_unstale":"2024-09-11T22:21:01.025479+0000","last_undegraded":"2024-09-11T22:21:01.025479+0000","last_fullsized":"2024-09-11T22:21:01.025479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025514+0000","last_change":"2024-09-11T22:20:24.075350+0000","last_active":"2024-09-11T22:21:02.025514+0000","last_peered":"2024-09-11T22:21:02.025514+0000","last_clean":"2024-09-11T22:21:02.025514+0000","last_became_active":"2024-09-11T22:20:24.074789+0000","last_became_peered":"2024-09-11T22:20:24.074789+0000","last_unstale":"2024-09-11T22:21:02.025514+0000","last_undegraded":"2024-09-11T22:21:02.025514+0000","last_fullsized":"2024-09-11T22:21:02.025514+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227845+0000","last_change":"2024-09-11T22:20:19.866331+0000","last_active":"2024-09-11T22:21:02.227845+0000","last_peered":"2024-09-11T22:21:02.227845+0000","last_clean":"2024-09-11T22:21:02.227845+0000","last_became_active":"2024-09-11T22:20:19.865535+0000","last_became_peered":"2024-09-11T22:20:19.865535+0000","last_unstale":"2024-09-11T22:21:02.227845+0000","last_undegraded":"2024-09-11T22:21:02.227845+0000","last_fullsized":"2024-09-11T22:21:02.227845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030534+0000","last_change":"2024-09-11T22:20:18.849434+0000","last_active":"2024-09-11T22:21:02.030534+0000","last_peered":"2024-09-11T22:21:02.030534+0000","last_clean":"2024-09-11T22:21:02.030534+0000","last_became_active":"2024-09-11T22:20:18.848787+0000","last_became_peered":"2024-09-11T22:20:18.848787+0000","last_unstale":"2024-09-11T22:21:02.030534+0000","last_undegraded":"2024-09-11T22:21:02.030534+0000","last_fullsized":"2024-09-11T22:21:02.030534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:25.689495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033577+0000","last_change":"2024-09-11T22:20:23.879962+0000","last_active":"2024-09-11T22:21:01.033577+0000","last_peered":"2024-09-11T22:21:01.033577+0000","last_clean":"2024-09-11T22:21:01.033577+0000","last_became_active":"2024-09-11T22:20:23.879586+0000","last_became_peered":"2024-09-11T22:20:23.879586+0000","last_unstale":"2024-09-11T22:21:01.033577+0000","last_undegraded":"2024-09-11T22:21:01.033577+0000","last_fullsized":"2024-09-11T22:21:01.033577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:27.323116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030163+0000","last_change":"2024-09-11T22:20:19.860411+0000","last_active":"2024-09-11T22:21:02.030163+0000","last_peered":"2024-09-11T22:21:02.030163+0000","last_clean":"2024-09-11T22:21:02.030163+0000","last_became_active":"2024-09-11T22:20:19.860076+0000","last_became_peered":"2024-09-11T22:20:19.860076+0000","last_unstale":"2024-09-11T22:21:02.030163+0000","last_undegraded":"2024-09-11T22:21:02.030163+0000","last_fullsized":"2024-09-11T22:21:02.030163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025282+0000","last_change":"2024-09-11T22:20:18.856020+0000","last_active":"2024-09-11T22:21:01.025282+0000","last_peered":"2024-09-11T22:21:01.025282+0000","last_clean":"2024-09-11T22:21:01.025282+0000","last_became_active":"2024-09-11T22:20:18.855753+0000","last_became_peered":"2024-09-11T22:20:18.855753+0000","last_unstale":"2024-09-11T22:21:01.025282+0000","last_undegraded":"2024-09-11T22:21:01.025282+0000","last_fullsized":"2024-09-11T22:21:01.025282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227177+0000","last_change":"2024-09-11T22:20:24.077975+0000","last_active":"2024-09-11T22:21:02.227177+0000","last_peered":"2024-09-11T22:21:02.227177+0000","last_clean":"2024-09-11T22:21:02.227177+0000","last_became_active":"2024-09-11T22:20:24.077502+0000","last_became_peered":"2024-09-11T22:20:24.077502+0000","last_unstale":"2024-09-11T22:21:02.227177+0000","last_undegraded":"2024-09-11T22:21:02.227177+0000","last_fullsized":"2024-09-11T22:21:02.227177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:16.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029605+0000","last_change":"2024-09-11T22:20:19.856986+0000","last_active":"2024-09-11T22:21:02.029605+0000","last_peered":"2024-09-11T22:21:02.029605+0000","last_clean":"2024-09-11T22:21:02.029605+0000","last_became_active":"2024-09-11T22:20:19.856739+0000","last_became_peered":"2024-09-11T22:20:19.856739+0000","last_unstale":"2024-09-11T22:21:02.029605+0000","last_undegraded":"2024-09-11T22:21:02.029605+0000","last_fullsized":"2024-09-11T22:21:02.029605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028636+0000","last_change":"2024-09-11T22:20:18.855044+0000","last_active":"2024-09-11T22:21:02.028636+0000","last_peered":"2024-09-11T22:21:02.028636+0000","last_clean":"2024-09-11T22:21:02.028636+0000","last_became_active":"2024-09-11T22:20:18.854764+0000","last_became_peered":"2024-09-11T22:20:18.854764+0000","last_unstale":"2024-09-11T22:21:02.028636+0000","last_undegraded":"2024-09-11T22:21:02.028636+0000","last_fullsized":"2024-09-11T22:21:02.028636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:22.207278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.027914+0000","last_change":"2024-09-11T22:20:23.878383+0000","last_active":"2024-09-11T22:21:02.027914+0000","last_peered":"2024-09-11T22:21:02.027914+0000","last_clean":"2024-09-11T22:21:02.027914+0000","last_became_active":"2024-09-11T22:20:23.877890+0000","last_became_peered":"2024-09-11T22:20:23.877890+0000","last_unstale":"2024-09-11T22:21:02.027914+0000","last_undegraded":"2024-09-11T22:21:02.027914+0000","last_fullsized":"2024-09-11T22:21:02.027914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:18.876485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029429+0000","last_change":"2024-09-11T22:20:19.861242+0000","last_active":"2024-09-11T22:21:02.029429+0000","last_peered":"2024-09-11T22:21:02.029429+0000","last_clean":"2024-09-11T22:21:02.029429+0000","last_became_active":"2024-09-11T22:20:19.860988+0000","last_became_peered":"2024-09-11T22:20:19.860988+0000","last_unstale":"2024-09-11T22:21:02.029429+0000","last_undegraded":"2024-09-11T22:21:02.029429+0000","last_fullsized":"2024-09-11T22:21:02.029429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.024956+0000","last_change":"2024-09-11T22:20:18.852459+0000","last_active":"2024-09-11T22:21:01.024956+0000","last_peered":"2024-09-11T22:21:01.024956+0000","last_clean":"2024-09-11T22:21:01.024956+0000","last_became_active":"2024-09-11T22:20:18.852153+0000","last_became_peered":"2024-09-11T22:20:18.852153+0000","last_unstale":"2024-09-11T22:21:01.024956+0000","last_undegraded":"2024-09-11T22:21:01.024956+0000","last_fullsized":"2024-09-11T22:21:01.024956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033546+0000","last_change":"2024-09-11T22:20:23.874062+0000","last_active":"2024-09-11T22:21:01.033546+0000","last_peered":"2024-09-11T22:21:01.033546+0000","last_clean":"2024-09-11T22:21:01.033546+0000","last_became_active":"2024-09-11T22:20:23.873635+0000","last_became_peered":"2024-09-11T22:20:23.873635+0000","last_unstale":"2024-09-11T22:21:01.033546+0000","last_undegraded":"2024-09-11T22:21:01.033546+0000","last_fullsized":"2024-09-11T22:21:01.033546+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:40.914142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025507+0000","last_change":"2024-09-11T22:20:19.851577+0000","last_active":"2024-09-11T22:21:02.025507+0000","last_peered":"2024-09-11T22:21:02.025507+0000","last_clean":"2024-09-11T22:21:02.025507+0000","last_became_active":"2024-09-11T22:20:19.851286+0000","last_became_peered":"2024-09-11T22:20:19.851286+0000","last_unstale":"2024-09-11T22:21:02.025507+0000","last_undegraded":"2024-09-11T22:21:02.025507+0000","last_fullsized":"2024-09-11T22:21:02.025507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:32.025931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025532+0000","last_change":"2024-09-11T22:20:18.853301+0000","last_active":"2024-09-11T22:21:02.025532+0000","last_peered":"2024-09-11T22:21:02.025532+0000","last_clean":"2024-09-11T22:21:02.025532+0000","last_became_active":"2024-09-11T22:20:18.852978+0000","last_became_peered":"2024-09-11T22:20:18.852978+0000","last_unstale":"2024-09-11T22:21:02.025532+0000","last_undegraded":"2024-09-11T22:21:02.025532+0000","last_fullsized":"2024-09-11T22:21:02.025532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033106+0000","last_change":"2024-09-11T22:20:24.077636+0000","last_active":"2024-09-11T22:21:02.033106+0000","last_peered":"2024-09-11T22:21:02.033106+0000","last_clean":"2024-09-11T22:21:02.033106+0000","last_became_active":"2024-09-11T22:20:24.077313+0000","last_became_peered":"2024-09-11T22:20:24.077313+0000","last_unstale":"2024-09-11T22:21:02.033106+0000","last_undegraded":"2024-09-11T22:21:02.033106+0000","last_fullsized":"2024-09-11T22:21:02.033106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:23.154027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029676+0000","last_change":"2024-09-11T22:20:19.862562+0000","last_active":"2024-09-11T22:21:02.029676+0000","last_peered":"2024-09-11T22:21:02.029676+0000","last_clean":"2024-09-11T22:21:02.029676+0000","last_became_active":"2024-09-11T22:20:19.862267+0000","last_became_peered":"2024-09-11T22:20:19.862267+0000","last_unstale":"2024-09-11T22:21:02.029676+0000","last_undegraded":"2024-09-11T22:21:02.029676+0000","last_fullsized":"2024-09-11T22:21:02.029676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227615+0000","last_change":"2024-09-11T22:20:18.858002+0000","last_active":"2024-09-11T22:21:02.227615+0000","last_peered":"2024-09-11T22:21:02.227615+0000","last_clean":"2024-09-11T22:21:02.227615+0000","last_became_active":"2024-09-11T22:20:18.857419+0000","last_became_peered":"2024-09-11T22:20:18.857419+0000","last_unstale":"2024-09-11T22:21:02.227615+0000","last_undegraded":"2024-09-11T22:21:02.227615+0000","last_fullsized":"2024-09-11T22:21:02.227615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033675+0000","last_change":"2024-09-11T22:20:24.074971+0000","last_active":"2024-09-11T22:21:02.033675+0000","last_peered":"2024-09-11T22:21:02.033675+0000","last_clean":"2024-09-11T22:21:02.033675+0000","last_became_active":"2024-09-11T22:20:24.074609+0000","last_became_peered":"2024-09-11T22:20:24.074609+0000","last_unstale":"2024-09-11T22:21:02.033675+0000","last_undegraded":"2024-09-11T22:21:02.033675+0000","last_fullsized":"2024-09-11T22:21:02.033675+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:55.318904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033588+0000","last_change":"2024-09-11T22:20:19.857276+0000","last_active":"2024-09-11T22:21:01.033588+0000","last_peered":"2024-09-11T22:21:01.033588+0000","last_clean":"2024-09-11T22:21:01.033588+0000","last_became_active":"2024-09-11T22:20:19.857027+0000","last_became_peered":"2024-09-11T22:20:19.857027+0000","last_unstale":"2024-09-11T22:21:01.033588+0000","last_undegraded":"2024-09-11T22:21:01.033588+0000","last_fullsized":"2024-09-11T22:21:01.033588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033832+0000","last_change":"2024-09-11T22:20:18.848671+0000","last_active":"2024-09-11T22:21:01.033832+0000","last_peered":"2024-09-11T22:21:01.033832+0000","last_clean":"2024-09-11T22:21:01.033832+0000","last_became_active":"2024-09-11T22:20:18.848405+0000","last_became_peered":"2024-09-11T22:20:18.848405+0000","last_unstale":"2024-09-11T22:21:01.033832+0000","last_undegraded":"2024-09-11T22:21:01.033832+0000","last_fullsized":"2024-09-11T22:21:01.033832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227859+0000","last_change":"2024-09-11T22:20:24.076835+0000","last_active":"2024-09-11T22:21:02.227859+0000","last_peered":"2024-09-11T22:21:02.227859+0000","last_clean":"2024-09-11T22:21:02.227859+0000","last_became_active":"2024-09-11T22:20:24.076200+0000","last_became_peered":"2024-09-11T22:20:24.076200+0000","last_unstale":"2024-09-11T22:21:02.227859+0000","last_undegraded":"2024-09-11T22:21:02.227859+0000","last_fullsized":"2024-09-11T22:21:02.227859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:48.150778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033502+0000","last_change":"2024-09-11T22:21:02.033502+0000","last_active":"2024-09-11T22:21:02.033502+0000","last_peered":"2024-09-11T22:21:02.033502+0000","last_clean":"2024-09-11T22:21:02.033502+0000","last_became_active":"2024-09-11T22:21:02.033269+0000","last_became_peered":"2024-09-11T22:21:02.033269+0000","last_unstale":"2024-09-11T22:21:02.033502+0000","last_undegraded":"2024-09-11T22:21:02.033502+0000","last_fullsized":"2024-09-11T22:21:02.033502+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:31.993239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'11","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026204+0000","last_change":"2024-09-11T22:20:18.855665+0000","last_active":"2024-09-11T22:21:02.026204+0000","last_peered":"2024-09-11T22:21:02.026204+0000","last_clean":"2024-09-11T22:21:02.026204+0000","last_became_active":"2024-09-11T22:20:18.855386+0000","last_became_peered":"2024-09-11T22:20:18.855386+0000","last_unstale":"2024-09-11T22:21:02.026204+0000","last_undegraded":"2024-09-11T22:21:02.026204+0000","last_fullsized":"2024-09-11T22:21:02.026204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029520+0000","last_change":"2024-09-11T22:20:23.880793+0000","last_active":"2024-09-11T22:21:02.029520+0000","last_peered":"2024-09-11T22:21:02.029520+0000","last_clean":"2024-09-11T22:21:02.029520+0000","last_became_active":"2024-09-11T22:20:23.879993+0000","last_became_peered":"2024-09-11T22:20:23.879993+0000","last_unstale":"2024-09-11T22:21:02.029520+0000","last_undegraded":"2024-09-11T22:21:02.029520+0000","last_fullsized":"2024-09-11T22:21:02.029520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:50.449090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029237+0000","last_change":"2024-09-11T22:20:19.858588+0000","last_active":"2024-09-11T22:21:02.029237+0000","last_peered":"2024-09-11T22:21:02.029237+0000","last_clean":"2024-09-11T22:21:02.029237+0000","last_became_active":"2024-09-11T22:20:19.858322+0000","last_became_peered":"2024-09-11T22:20:19.858322+0000","last_unstale":"2024-09-11T22:21:02.029237+0000","last_undegraded":"2024-09-11T22:21:02.029237+0000","last_fullsized":"2024-09-11T22:21:02.029237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030283+0000","last_change":"2024-09-11T22:20:18.855056+0000","last_active":"2024-09-11T22:21:02.030283+0000","last_peered":"2024-09-11T22:21:02.030283+0000","last_clean":"2024-09-11T22:21:02.030283+0000","last_became_active":"2024-09-11T22:20:18.854784+0000","last_became_peered":"2024-09-11T22:20:18.854784+0000","last_unstale":"2024-09-11T22:21:02.030283+0000","last_undegraded":"2024-09-11T22:21:02.030283+0000","last_fullsized":"2024-09-11T22:21:02.030283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:38.916121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028248+0000","last_change":"2024-09-11T22:20:23.879768+0000","last_active":"2024-09-11T22:21:02.028248+0000","last_peered":"2024-09-11T22:21:02.028248+0000","last_clean":"2024-09-11T22:21:02.028248+0000","last_became_active":"2024-09-11T22:20:23.878794+0000","last_became_peered":"2024-09-11T22:20:23.878794+0000","last_unstale":"2024-09-11T22:21:02.028248+0000","last_undegraded":"2024-09-11T22:21:02.028248+0000","last_fullsized":"2024-09-11T22:21:02.028248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:07.301587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-11T22:20:27.048280+0000","last_change":"2024-09-11T22:21:01.034302+0000","last_active":"2024-09-11T22:21:01.034302+0000","last_peered":"2024-09-11T22:20:27.048280+0000","last_clean":"2024-09-11T22:20:27.048280+0000","last_became_active":"2024-09-11T22:20:19.861607+0000","last_became_peered":"2024-09-11T22:20:19.861607+0000","last_unstale":"2024-09-11T22:20:27.048280+0000","last_undegraded":"2024-09-11T22:20:27.048280+0000","last_fullsized":"2024-09-11T22:20:27.048280+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.228018+0000","last_change":"2024-09-11T22:20:18.853382+0000","last_active":"2024-09-11T22:21:02.228018+0000","last_peered":"2024-09-11T22:21:02.228018+0000","last_clean":"2024-09-11T22:21:02.228018+0000","last_became_active":"2024-09-11T22:20:18.853103+0000","last_became_peered":"2024-09-11T22:20:18.853103+0000","last_unstale":"2024-09-11T22:21:02.228018+0000","last_undegraded":"2024-09-11T22:21:02.228018+0000","last_fullsized":"2024-09-11T22:21:02.228018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031422+0000","last_change":"2024-09-11T22:20:23.876997+0000","last_active":"2024-09-11T22:21:02.031422+0000","last_peered":"2024-09-11T22:21:02.031422+0000","last_clean":"2024-09-11T22:21:02.031422+0000","last_became_active":"2024-09-11T22:20:23.876587+0000","last_became_peered":"2024-09-11T22:20:23.876587+0000","last_unstale":"2024-09-11T22:21:02.031422+0000","last_undegraded":"2024-09-11T22:21:02.031422+0000","last_fullsized":"2024-09-11T22:21:02.031422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:19.670665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227988+0000","last_change":"2024-09-11T22:20:19.866624+0000","last_active":"2024-09-11T22:21:02.227988+0000","last_peered":"2024-09-11T22:21:02.227988+0000","last_clean":"2024-09-11T22:21:02.227988+0000","last_became_active":"2024-09-11T22:20:19.866303+0000","last_became_peered":"2024-09-11T22:20:19.866303+0000","last_unstale":"2024-09-11T22:21:02.227988+0000","last_undegraded":"2024-09-11T22:21:02.227988+0000","last_fullsized":"2024-09-11T22:21:02.227988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025963+0000","last_change":"2024-09-11T22:20:18.854361+0000","last_active":"2024-09-11T22:21:02.025963+0000","last_peered":"2024-09-11T22:21:02.025963+0000","last_clean":"2024-09-11T22:21:02.025963+0000","last_became_active":"2024-09-11T22:20:18.854019+0000","last_became_peered":"2024-09-11T22:20:18.854019+0000","last_unstale":"2024-09-11T22:21:02.025963+0000","last_undegraded":"2024-09-11T22:21:02.025963+0000","last_fullsized":"2024-09-11T22:21:02.025963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031134+0000","last_change":"2024-09-11T22:20:24.077476+0000","last_active":"2024-09-11T22:21:02.031134+0000","last_peered":"2024-09-11T22:21:02.031134+0000","last_clean":"2024-09-11T22:21:02.031134+0000","last_became_active":"2024-09-11T22:20:24.077134+0000","last_became_peered":"2024-09-11T22:20:24.077134+0000","last_unstale":"2024-09-11T22:21:02.031134+0000","last_undegraded":"2024-09-11T22:21:02.031134+0000","last_fullsized":"2024-09-11T22:21:02.031134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:03.186460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"peering","last_fresh":"2024-09-11T22:20:27.048088+0000","last_change":"2024-09-11T22:21:01.033206+0000","last_active":"2024-09-11T22:21:01.033206+0000","last_peered":"2024-09-11T22:20:27.048088+0000","last_clean":"2024-09-11T22:20:27.048088+0000","last_became_active":"2024-09-11T22:20:24.076592+0000","last_became_peered":"2024-09-11T22:20:24.076592+0000","last_unstale":"2024-09-11T22:20:27.048088+0000","last_undegraded":"2024-09-11T22:20:27.048088+0000","last_fullsized":"2024-09-11T22:20:27.048088+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2,3,7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029432+0000","last_change":"2024-09-11T22:20:19.845776+0000","last_active":"2024-09-11T22:21:02.029432+0000","last_peered":"2024-09-11T22:21:02.029432+0000","last_clean":"2024-09-11T22:21:02.029432+0000","last_became_active":"2024-09-11T22:20:19.845425+0000","last_became_peered":"2024-09-11T22:20:19.845425+0000","last_unstale":"2024-09-11T22:21:02.029432+0000","last_undegraded":"2024-09-11T22:21:02.029432+0000","last_fullsized":"2024-09-11T22:21:02.029432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:07.187533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227442+0000","last_change":"2024-09-11T22:20:18.852446+0000","last_active":"2024-09-11T22:21:02.227442+0000","last_peered":"2024-09-11T22:21:02.227442+0000","last_clean":"2024-09-11T22:21:02.227442+0000","last_became_active":"2024-09-11T22:20:18.852155+0000","last_became_peered":"2024-09-11T22:20:18.852155+0000","last_unstale":"2024-09-11T22:21:02.227442+0000","last_undegraded":"2024-09-11T22:21:02.227442+0000","last_fullsized":"2024-09-11T22:21:02.227442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025729+0000","last_change":"2024-09-11T22:20:23.876503+0000","last_active":"2024-09-11T22:21:02.025729+0000","last_peered":"2024-09-11T22:21:02.025729+0000","last_clean":"2024-09-11T22:21:02.025729+0000","last_became_active":"2024-09-11T22:20:23.876100+0000","last_became_peered":"2024-09-11T22:20:23.876100+0000","last_unstale":"2024-09-11T22:21:02.025729+0000","last_undegraded":"2024-09-11T22:21:02.025729+0000","last_fullsized":"2024-09-11T22:21:02.025729+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031526+0000","last_change":"2024-09-11T22:20:19.852606+0000","last_active":"2024-09-11T22:21:02.031526+0000","last_peered":"2024-09-11T22:21:02.031526+0000","last_clean":"2024-09-11T22:21:02.031526+0000","last_became_active":"2024-09-11T22:20:19.852333+0000","last_became_peered":"2024-09-11T22:20:19.852333+0000","last_unstale":"2024-09-11T22:21:02.031526+0000","last_undegraded":"2024-09-11T22:21:02.031526+0000","last_fullsized":"2024-09-11T22:21:02.031526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:56.940278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031424+0000","last_change":"2024-09-11T22:20:18.853767+0000","last_active":"2024-09-11T22:21:02.031424+0000","last_peered":"2024-09-11T22:21:02.031424+0000","last_clean":"2024-09-11T22:21:02.031424+0000","last_became_active":"2024-09-11T22:20:18.853533+0000","last_became_peered":"2024-09-11T22:20:18.853533+0000","last_unstale":"2024-09-11T22:21:02.031424+0000","last_undegraded":"2024-09-11T22:21:02.031424+0000","last_fullsized":"2024-09-11T22:21:02.031424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:36.662271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026157+0000","last_change":"2024-09-11T22:20:18.847133+0000","last_active":"2024-09-11T22:21:02.026157+0000","last_peered":"2024-09-11T22:21:02.026157+0000","last_clean":"2024-09-11T22:21:02.026157+0000","last_became_active":"2024-09-11T22:20:18.846321+0000","last_became_peered":"2024-09-11T22:20:18.846321+0000","last_unstale":"2024-09-11T22:21:02.026157+0000","last_undegraded":"2024-09-11T22:21:02.026157+0000","last_fullsized":"2024-09-11T22:21:02.026157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033751+0000","last_change":"2024-09-11T22:20:19.861445+0000","last_active":"2024-09-11T22:21:01.033751+0000","last_peered":"2024-09-11T22:21:01.033751+0000","last_clean":"2024-09-11T22:21:01.033751+0000","last_became_active":"2024-09-11T22:20:19.861154+0000","last_became_peered":"2024-09-11T22:20:19.861154+0000","last_unstale":"2024-09-11T22:21:01.033751+0000","last_undegraded":"2024-09-11T22:21:01.033751+0000","last_fullsized":"2024-09-11T22:21:01.033751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025275+0000","last_change":"2024-09-11T22:20:23.877973+0000","last_active":"2024-09-11T22:21:01.025275+0000","last_peered":"2024-09-11T22:21:01.025275+0000","last_clean":"2024-09-11T22:21:01.025275+0000","last_became_active":"2024-09-11T22:20:23.877578+0000","last_became_peered":"2024-09-11T22:20:23.877578+0000","last_unstale":"2024-09-11T22:21:01.025275+0000","last_undegraded":"2024-09-11T22:21:01.025275+0000","last_fullsized":"2024-09-11T22:21:01.025275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:27.826669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033802+0000","last_change":"2024-09-11T22:20:18.854142+0000","last_active":"2024-09-11T22:21:02.033802+0000","last_peered":"2024-09-11T22:21:02.033802+0000","last_clean":"2024-09-11T22:21:02.033802+0000","last_became_active":"2024-09-11T22:20:18.853872+0000","last_became_peered":"2024-09-11T22:20:18.853872+0000","last_unstale":"2024-09-11T22:21:02.033802+0000","last_undegraded":"2024-09-11T22:21:02.033802+0000","last_fullsized":"2024-09-11T22:21:02.033802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:22.513242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1065,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028251+0000","last_change":"2024-09-11T22:20:19.852580+0000","last_active":"2024-09-11T22:21:02.028251+0000","last_peered":"2024-09-11T22:21:02.028251+0000","last_clean":"2024-09-11T22:21:02.028251+0000","last_became_active":"2024-09-11T22:20:19.850175+0000","last_became_peered":"2024-09-11T22:20:19.850175+0000","last_unstale":"2024-09-11T22:21:02.028251+0000","last_undegraded":"2024-09-11T22:21:02.028251+0000","last_fullsized":"2024-09-11T22:21:02.028251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:11.937256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.032982+0000","last_change":"2024-09-11T22:20:23.878004+0000","last_active":"2024-09-11T22:21:02.032982+0000","last_peered":"2024-09-11T22:21:02.032982+0000","last_clean":"2024-09-11T22:21:02.032982+0000","last_became_active":"2024-09-11T22:20:23.876776+0000","last_became_peered":"2024-09-11T22:20:23.876776+0000","last_unstale":"2024-09-11T22:21:02.032982+0000","last_undegraded":"2024-09-11T22:21:02.032982+0000","last_fullsized":"2024-09-11T22:21:02.032982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:11.254248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025354+0000","last_change":"2024-09-11T22:20:19.853439+0000","last_active":"2024-09-11T22:21:02.025354+0000","last_peered":"2024-09-11T22:21:02.025354+0000","last_clean":"2024-09-11T22:21:02.025354+0000","last_became_active":"2024-09-11T22:20:19.852937+0000","last_became_peered":"2024-09-11T22:20:19.852937+0000","last_unstale":"2024-09-11T22:21:02.025354+0000","last_undegraded":"2024-09-11T22:21:02.025354+0000","last_fullsized":"2024-09-11T22:21:02.025354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025127+0000","last_change":"2024-09-11T22:20:19.861003+0000","last_active":"2024-09-11T22:21:01.025127+0000","last_peered":"2024-09-11T22:21:01.025127+0000","last_clean":"2024-09-11T22:21:01.025127+0000","last_became_active":"2024-09-11T22:20:19.860690+0000","last_became_peered":"2024-09-11T22:20:19.860690+0000","last_unstale":"2024-09-11T22:21:01.025127+0000","last_undegraded":"2024-09-11T22:21:01.025127+0000","last_fullsized":"2024-09-11T22:21:01.025127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227573+0000","last_change":"2024-09-11T22:20:19.856756+0000","last_active":"2024-09-11T22:21:02.227573+0000","last_peered":"2024-09-11T22:21:02.227573+0000","last_clean":"2024-09-11T22:21:02.227573+0000","last_became_active":"2024-09-11T22:20:19.856460+0000","last_became_peered":"2024-09-11T22:20:19.856460+0000","last_unstale":"2024-09-11T22:21:02.227573+0000","last_undegraded":"2024-09-11T22:21:02.227573+0000","last_fullsized":"2024-09-11T22:21:02.227573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033665+0000","last_change":"2024-09-11T22:20:19.855629+0000","last_active":"2024-09-11T22:21:01.033665+0000","last_peered":"2024-09-11T22:21:01.033665+0000","last_clean":"2024-09-11T22:21:01.033665+0000","last_became_active":"2024-09-11T22:20:19.855363+0000","last_became_peered":"2024-09-11T22:20:19.855363+0000","last_unstale":"2024-09-11T22:21:01.033665+0000","last_undegraded":"2024-09-11T22:21:01.033665+0000","last_fullsized":"2024-09-11T22:21:01.033665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033889+0000","last_change":"2024-09-11T22:20:19.863122+0000","last_active":"2024-09-11T22:21:02.033889+0000","last_peered":"2024-09-11T22:21:02.033889+0000","last_clean":"2024-09-11T22:21:02.033889+0000","last_became_active":"2024-09-11T22:20:19.862828+0000","last_became_peered":"2024-09-11T22:20:19.862828+0000","last_unstale":"2024-09-11T22:21:02.033889+0000","last_undegraded":"2024-09-11T22:21:02.033889+0000","last_fullsized":"2024-09-11T22:21:02.033889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:10.868762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030114+0000","last_change":"2024-09-11T22:20:19.846453+0000","last_active":"2024-09-11T22:21:02.030114+0000","last_peered":"2024-09-11T22:21:02.030114+0000","last_clean":"2024-09-11T22:21:02.030114+0000","last_became_active":"2024-09-11T22:20:19.846186+0000","last_became_peered":"2024-09-11T22:20:19.846186+0000","last_unstale":"2024-09-11T22:21:02.030114+0000","last_undegraded":"2024-09-11T22:21:02.030114+0000","last_fullsized":"2024-09-11T22:21:02.030114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:24.032365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026220+0000","last_change":"2024-09-11T22:20:19.860632+0000","last_active":"2024-09-11T22:21:02.026220+0000","last_peered":"2024-09-11T22:21:02.026220+0000","last_clean":"2024-09-11T22:21:02.026220+0000","last_became_active":"2024-09-11T22:20:19.860005+0000","last_became_peered":"2024-09-11T22:20:19.860005+0000","last_unstale":"2024-09-11T22:21:02.026220+0000","last_undegraded":"2024-09-11T22:21:02.026220+0000","last_fullsized":"2024-09-11T22:21:02.026220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033193+0000","last_change":"2024-09-11T22:20:19.859195+0000","last_active":"2024-09-11T22:21:02.033193+0000","last_peered":"2024-09-11T22:21:02.033193+0000","last_clean":"2024-09-11T22:21:02.033193+0000","last_became_active":"2024-09-11T22:20:19.858832+0000","last_became_peered":"2024-09-11T22:20:19.858832+0000","last_unstale":"2024-09-11T22:21:02.033193+0000","last_undegraded":"2024-09-11T22:21:02.033193+0000","last_fullsized":"2024-09-11T22:21:02.033193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:56.259074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227399+0000","last_change":"2024-09-11T22:20:19.858969+0000","last_active":"2024-09-11T22:21:02.227399+0000","last_peered":"2024-09-11T22:21:02.227399+0000","last_clean":"2024-09-11T22:21:02.227399+0000","last_became_active":"2024-09-11T22:20:19.857847+0000","last_became_peered":"2024-09-11T22:20:19.857847+0000","last_unstale":"2024-09-11T22:21:02.227399+0000","last_undegraded":"2024-09-11T22:21:02.227399+0000","last_fullsized":"2024-09-11T22:21:02.227399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031335+0000","last_change":"2024-09-11T22:20:19.863294+0000","last_active":"2024-09-11T22:21:02.031335+0000","last_peered":"2024-09-11T22:21:02.031335+0000","last_clean":"2024-09-11T22:21:02.031335+0000","last_became_active":"2024-09-11T22:20:19.863007+0000","last_became_peered":"2024-09-11T22:20:19.863007+0000","last_unstale":"2024-09-11T22:21:02.031335+0000","last_undegraded":"2024-09-11T22:21:02.031335+0000","last_fullsized":"2024-09-11T22:21:02.031335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:06.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227487+0000","last_change":"2024-09-11T22:20:19.858414+0000","last_active":"2024-09-11T22:21:02.227487+0000","last_peered":"2024-09-11T22:21:02.227487+0000","last_clean":"2024-09-11T22:21:02.227487+0000","last_became_active":"2024-09-11T22:20:19.857790+0000","last_became_peered":"2024-09-11T22:20:19.857790+0000","last_unstale":"2024-09-11T22:21:02.227487+0000","last_undegraded":"2024-09-11T22:21:02.227487+0000","last_fullsized":"2024-09-11T22:21:02.227487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":2,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-11T22:20:27.047940+0000","last_change":"2024-09-11T22:21:01.323256+0000","last_active":"2024-09-11T22:21:01.323256+0000","last_peered":"2024-09-11T22:20:27.047940+0000","last_clean":"2024-09-11T22:20:27.047940+0000","last_became_active":"2024-09-11T22:20:19.854774+0000","last_became_peered":"2024-09-11T22:20:19.854774+0000","last_unstale":"2024-09-11T22:20:27.047940+0000","last_undegraded":"2024-09-11T22:20:27.047940+0000","last_fullsized":"2024-09-11T22:20:27.047940+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026014+0000","last_change":"2024-09-11T22:20:19.864700+0000","last_active":"2024-09-11T22:21:02.026014+0000","last_peered":"2024-09-11T22:21:02.026014+0000","last_clean":"2024-09-11T22:21:02.026014+0000","last_became_active":"2024-09-11T22:20:19.862296+0000","last_became_peered":"2024-09-11T22:20:19.862296+0000","last_unstale":"2024-09-11T22:21:02.026014+0000","last_undegraded":"2024-09-11T22:21:02.026014+0000","last_fullsized":"2024-09-11T22:21:02.026014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030247+0000","last_change":"2024-09-11T22:20:19.855253+0000","last_active":"2024-09-11T22:21:02.030247+0000","last_peered":"2024-09-11T22:21:02.030247+0000","last_clean":"2024-09-11T22:21:02.030247+0000","last_became_active":"2024-09-11T22:20:19.854970+0000","last_became_peered":"2024-09-11T22:20:19.854970+0000","last_unstale":"2024-09-11T22:21:02.030247+0000","last_undegraded":"2024-09-11T22:21:02.030247+0000","last_fullsized":"2024-09-11T22:21:02.030247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.025225+0000","last_change":"2024-09-11T22:20:19.850202+0000","last_active":"2024-09-11T22:21:01.025225+0000","last_peered":"2024-09-11T22:21:01.025225+0000","last_clean":"2024-09-11T22:21:01.025225+0000","last_became_active":"2024-09-11T22:20:19.849815+0000","last_became_peered":"2024-09-11T22:20:19.849815+0000","last_unstale":"2024-09-11T22:21:01.025225+0000","last_undegraded":"2024-09-11T22:21:01.025225+0000","last_fullsized":"2024-09-11T22:21:01.025225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:56.480679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.228172+0000","last_change":"2024-09-11T22:20:19.866864+0000","last_active":"2024-09-11T22:21:02.228172+0000","last_peered":"2024-09-11T22:21:02.228172+0000","last_clean":"2024-09-11T22:21:02.228172+0000","last_became_active":"2024-09-11T22:20:19.866484+0000","last_became_peered":"2024-09-11T22:20:19.866484+0000","last_unstale":"2024-09-11T22:21:02.228172+0000","last_undegraded":"2024-09-11T22:21:02.228172+0000","last_fullsized":"2024-09-11T22:21:02.228172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":2,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-11T22:20:19.847772+0000","last_change":"2024-09-11T22:21:01.323220+0000","last_active":"2024-09-11T22:20:18.828308+0000","last_peered":"2024-09-11T22:20:18.828308+0000","last_clean":"2024-09-11T22:20:18.828308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:19.847772+0000","last_undegraded":"2024-09-11T22:20:19.847772+0000","last_fullsized":"2024-09-11T22:20:19.847772+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029536+0000","last_change":"2024-09-11T22:20:19.860050+0000","last_active":"2024-09-11T22:21:02.029536+0000","last_peered":"2024-09-11T22:21:02.029536+0000","last_clean":"2024-09-11T22:21:02.029536+0000","last_became_active":"2024-09-11T22:20:19.859755+0000","last_became_peered":"2024-09-11T22:20:19.859755+0000","last_unstale":"2024-09-11T22:21:02.029536+0000","last_undegraded":"2024-09-11T22:21:02.029536+0000","last_fullsized":"2024-09-11T22:21:02.029536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:42.487669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033495+0000","last_change":"2024-09-11T22:20:19.853902+0000","last_active":"2024-09-11T22:21:01.033495+0000","last_peered":"2024-09-11T22:21:01.033495+0000","last_clean":"2024-09-11T22:21:01.033495+0000","last_became_active":"2024-09-11T22:20:19.853563+0000","last_became_peered":"2024-09-11T22:20:19.853563+0000","last_unstale":"2024-09-11T22:21:01.033495+0000","last_undegraded":"2024-09-11T22:21:01.033495+0000","last_fullsized":"2024-09-11T22:21:01.033495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033630+0000","last_change":"2024-09-11T22:20:19.849490+0000","last_active":"2024-09-11T22:21:02.033630+0000","last_peered":"2024-09-11T22:21:02.033630+0000","last_clean":"2024-09-11T22:21:02.033630+0000","last_became_active":"2024-09-11T22:20:19.848965+0000","last_became_peered":"2024-09-11T22:20:19.848965+0000","last_unstale":"2024-09-11T22:21:02.033630+0000","last_undegraded":"2024-09-11T22:21:02.033630+0000","last_fullsized":"2024-09-11T22:21:02.033630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:10.387663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029136+0000","last_change":"2024-09-11T22:20:19.860457+0000","last_active":"2024-09-11T22:21:02.029136+0000","last_peered":"2024-09-11T22:21:02.029136+0000","last_clean":"2024-09-11T22:21:02.029136+0000","last_became_active":"2024-09-11T22:20:19.858887+0000","last_became_peered":"2024-09-11T22:20:19.858887+0000","last_unstale":"2024-09-11T22:21:02.029136+0000","last_undegraded":"2024-09-11T22:21:02.029136+0000","last_fullsized":"2024-09-11T22:21:02.029136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:34.620956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026280+0000","last_change":"2024-09-11T22:20:19.862347+0000","last_active":"2024-09-11T22:21:02.026280+0000","last_peered":"2024-09-11T22:21:02.026280+0000","last_clean":"2024-09-11T22:21:02.026280+0000","last_became_active":"2024-09-11T22:20:19.861965+0000","last_became_peered":"2024-09-11T22:20:19.861965+0000","last_unstale":"2024-09-11T22:21:02.026280+0000","last_undegraded":"2024-09-11T22:21:02.026280+0000","last_fullsized":"2024-09-11T22:21:02.026280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026130+0000","last_change":"2024-09-11T22:20:19.862065+0000","last_active":"2024-09-11T22:21:02.026130+0000","last_peered":"2024-09-11T22:21:02.026130+0000","last_clean":"2024-09-11T22:21:02.026130+0000","last_became_active":"2024-09-11T22:20:19.861765+0000","last_became_peered":"2024-09-11T22:20:19.861765+0000","last_unstale":"2024-09-11T22:21:02.026130+0000","last_undegraded":"2024-09-11T22:21:02.026130+0000","last_fullsized":"2024-09-11T22:21:02.026130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030078+0000","last_change":"2024-09-11T22:20:19.865064+0000","last_active":"2024-09-11T22:21:02.030078+0000","last_peered":"2024-09-11T22:21:02.030078+0000","last_clean":"2024-09-11T22:21:02.030078+0000","last_became_active":"2024-09-11T22:20:19.864697+0000","last_became_peered":"2024-09-11T22:20:19.864697+0000","last_unstale":"2024-09-11T22:21:02.030078+0000","last_undegraded":"2024-09-11T22:21:02.030078+0000","last_fullsized":"2024-09-11T22:21:02.030078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031325+0000","last_change":"2024-09-11T22:20:19.861293+0000","last_active":"2024-09-11T22:21:02.031325+0000","last_peered":"2024-09-11T22:21:02.031325+0000","last_clean":"2024-09-11T22:21:02.031325+0000","last_became_active":"2024-09-11T22:20:19.861013+0000","last_became_peered":"2024-09-11T22:20:19.861013+0000","last_unstale":"2024-09-11T22:21:02.031325+0000","last_undegraded":"2024-09-11T22:21:02.031325+0000","last_fullsized":"2024-09-11T22:21:02.031325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:13.178404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029254+0000","last_change":"2024-09-11T22:20:19.858131+0000","last_active":"2024-09-11T22:21:02.029254+0000","last_peered":"2024-09-11T22:21:02.029254+0000","last_clean":"2024-09-11T22:21:02.029254+0000","last_became_active":"2024-09-11T22:20:19.857842+0000","last_became_peered":"2024-09-11T22:20:19.857842+0000","last_unstale":"2024-09-11T22:21:02.029254+0000","last_undegraded":"2024-09-11T22:21:02.029254+0000","last_fullsized":"2024-09-11T22:21:02.029254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227444+0000","last_change":"2024-09-11T22:20:19.859667+0000","last_active":"2024-09-11T22:21:02.227444+0000","last_peered":"2024-09-11T22:21:02.227444+0000","last_clean":"2024-09-11T22:21:02.227444+0000","last_became_active":"2024-09-11T22:20:19.859306+0000","last_became_peered":"2024-09-11T22:20:19.859306+0000","last_unstale":"2024-09-11T22:21:02.227444+0000","last_undegraded":"2024-09-11T22:21:02.227444+0000","last_fullsized":"2024-09-11T22:21:02.227444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029504+0000","last_change":"2024-09-11T22:20:19.848821+0000","last_active":"2024-09-11T22:21:02.029504+0000","last_peered":"2024-09-11T22:21:02.029504+0000","last_clean":"2024-09-11T22:21:02.029504+0000","last_became_active":"2024-09-11T22:20:19.848531+0000","last_became_peered":"2024-09-11T22:20:19.848531+0000","last_unstale":"2024-09-11T22:21:02.029504+0000","last_undegraded":"2024-09-11T22:21:02.029504+0000","last_fullsized":"2024-09-11T22:21:02.029504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227722+0000","last_change":"2024-09-11T22:20:19.866300+0000","last_active":"2024-09-11T22:21:02.227722+0000","last_peered":"2024-09-11T22:21:02.227722+0000","last_clean":"2024-09-11T22:21:02.227722+0000","last_became_active":"2024-09-11T22:20:19.865939+0000","last_became_peered":"2024-09-11T22:20:19.865939+0000","last_unstale":"2024-09-11T22:21:02.227722+0000","last_undegraded":"2024-09-11T22:21:02.227722+0000","last_fullsized":"2024-09-11T22:21:02.227722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T22:21:01.033602+0000","last_change":"2024-09-11T22:20:19.858144+0000","last_active":"2024-09-11T22:21:01.033602+0000","last_peered":"2024-09-11T22:21:01.033602+0000","last_clean":"2024-09-11T22:21:01.033602+0000","last_became_active":"2024-09-11T22:20:19.857840+0000","last_became_peered":"2024-09-11T22:20:19.857840+0000","last_unstale":"2024-09-11T22:21:01.033602+0000","last_undegraded":"2024-09-11T22:21:01.033602+0000","last_fullsized":"2024-09-11T22:21:01.033602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:23.801072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029762+0000","last_change":"2024-09-11T22:20:19.857378+0000","last_active":"2024-09-11T22:21:02.029762+0000","last_peered":"2024-09-11T22:21:02.029762+0000","last_clean":"2024-09-11T22:21:02.029762+0000","last_became_active":"2024-09-11T22:20:19.857089+0000","last_became_peered":"2024-09-11T22:20:19.857089+0000","last_unstale":"2024-09-11T22:21:02.029762+0000","last_undegraded":"2024-09-11T22:21:02.029762+0000","last_fullsized":"2024-09-11T22:21:02.029762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:29.835695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":2,"reported_epoch":27,"state":"peering","last_fresh":"2024-09-11T22:20:19.843776+0000","last_change":"2024-09-11T22:21:01.323294+0000","last_active":"2024-09-11T22:20:18.828308+0000","last_peered":"2024-09-11T22:20:18.828308+0000","last_clean":"2024-09-11T22:20:18.828308+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T22:20:19.843776+0000","last_undegraded":"2024-09-11T22:20:19.843776+0000","last_fullsized":"2024-09-11T22:20:19.843776+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7897,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":380928,"data_stored":713645,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":315392,"data_stored":126040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":315392,"data_stored":122896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":311296,"data_stored":122232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":319488,"data_stored":126517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542157,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":108136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":352256,"data_stored":698346,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":319488,"data_stored":122462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:21:10.901 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:21:11.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.008+0000 7f54e02e6640 1 Processor -- start 2024-09-11T22:21:11.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.008+0000 7f54e02e6640 1 -- start start 2024-09-11T22:21:11.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.009+0000 7f54e02e6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54d8151ae0 0x7f54d8071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.009+0000 7f54e02e6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f54d80c8570 0x7f54d80c0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.009+0000 7f54e02e6640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54d8071cc0 con 0x7f54d80c2de0 2024-09-11T22:21:11.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.009+0000 7f54e02e6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f54d80c1ec0 con 0x7f54d80c8570 2024-09-11T22:21:11.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.009+0000 7f54e02e6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f54d8071f50 con 0x7f54d8151ae0 2024-09-11T22:21:11.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.009+0000 7f54de883640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f54d80c2de0 0x7f54d806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59642/0 (socket says 172.21.15.100:59642) 2024-09-11T22:21:11.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.009+0000 7f54de883640 1 -- 172.21.15.100:0/3309118790 learned_addr learned my addr 172.21.15.100:0/3309118790 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:21:11.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.009+0000 7f54de082640 1 --2- 172.21.15.100:0/3309118790 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54d8151ae0 0x7f54d8071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.009+0000 7f54dd881640 1 --2- 172.21.15.100:0/3309118790 >> v2:172.21.15.167:3300/0 conn(0x7f54d80c8570 0x7f54d80c0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.009+0000 7f54dd080640 1 -- 172.21.15.100:0/3309118790 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 179786503 0 0) 0x7f54d8071cc0 con 0x7f54d80c2de0 2024-09-11T22:21:11.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.009+0000 7f54dd080640 1 -- 172.21.15.100:0/3309118790 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54c4003520 con 0x7f54d80c2de0 2024-09-11T22:21:11.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.009+0000 7f54dd080640 1 -- 172.21.15.100:0/3309118790 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1630444623 0 0) 0x7f54c4003520 con 0x7f54d80c2de0 2024-09-11T22:21:11.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.009+0000 7f54dd080640 1 -- 172.21.15.100:0/3309118790 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54d8151ae0 msgr2=0x7f54d8071780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.009+0000 7f54dd080640 1 --2- 172.21.15.100:0/3309118790 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54d8151ae0 0x7f54d8071780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.009+0000 7f54dd080640 1 -- 172.21.15.100:0/3309118790 >> v2:172.21.15.167:3300/0 conn(0x7f54d80c8570 msgr2=0x7f54d80c0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.009+0000 7f54dd080640 1 --2- 172.21.15.100:0/3309118790 >> v2:172.21.15.167:3300/0 conn(0x7f54d80c8570 0x7f54d80c0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.010+0000 7f54dd080640 1 -- 172.21.15.100:0/3309118790 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d8072230 con 0x7f54d80c2de0 2024-09-11T22:21:11.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.010+0000 7f54dd080640 1 -- 172.21.15.100:0/3309118790 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f54d00019f0 con 0x7f54d80c2de0 2024-09-11T22:21:11.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.010+0000 7f54dd080640 1 -- 172.21.15.100:0/3309118790 >> v1:172.21.15.100:6789/0 conn(0x7f54d80c2de0 legacy=0x7f54d806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.010+0000 7f54dd080640 1 --2- 172.21.15.100:0/3309118790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c40039b0 0x7f54c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.010+0000 7f54dd080640 1 --2- 172.21.15.100:0/3309118790 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54d8151ae0 0x7f54c4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.010+0000 7f54dd080640 1 --2- 172.21.15.100:0/3309118790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54c4004d40 0x7f54c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.010+0000 7f54dd080640 1 -- 172.21.15.100:0/3309118790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f54d80c1ec0 con 0x7f54c40039b0 2024-09-11T22:21:11.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.010+0000 7f54dd080640 1 -- 172.21.15.100:0/3309118790 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f54d8071f50 con 0x7f54c4004d40 2024-09-11T22:21:11.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.010+0000 7f54dd080640 1 -- 172.21.15.100:0/3309118790 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f54c400dbd0 con 0x7f54d8151ae0 2024-09-11T22:21:11.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.010+0000 7f54de082640 1 --2- 172.21.15.100:0/3309118790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c40039b0 0x7f54c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.010+0000 7f54dd881640 1 --2- 172.21.15.100:0/3309118790 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54d8151ae0 0x7f54c4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.010+0000 7f54de883640 1 --2- 172.21.15.100:0/3309118790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54c4004d40 0x7f54c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.010+0000 7f54de082640 1 -- 172.21.15.100:0/3309118790 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54d8151ae0 msgr2=0x7f54c4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.010+0000 7f54de082640 1 --2- 172.21.15.100:0/3309118790 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54d8151ae0 0x7f54c4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.010+0000 7f54de082640 1 -- 172.21.15.100:0/3309118790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54c4004d40 msgr2=0x7f54c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.010+0000 7f54de082640 1 --2- 172.21.15.100:0/3309118790 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54c4004d40 0x7f54c40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.010+0000 7f54de082640 1 -- 172.21.15.100:0/3309118790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c4003520 con 0x7f54c40039b0 2024-09-11T22:21:11.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.010+0000 7f54dd881640 1 --2- 172.21.15.100:0/3309118790 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54d8151ae0 0x7f54c4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:11.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.011+0000 7f54de082640 1 --2- 172.21.15.100:0/3309118790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c40039b0 0x7f54c4003dd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009ac0 tx=0x7f54c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585e1451af9936f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.011+0000 7f54dd080640 1 -- 172.21.15.100:0/3309118790 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d4036070 con 0x7f54c40039b0 2024-09-11T22:21:11.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.011+0000 7f54dd080640 1 -- 172.21.15.100:0/3309118790 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54d4031400 con 0x7f54c40039b0 2024-09-11T22:21:11.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.011+0000 7f54dd080640 1 -- 172.21.15.100:0/3309118790 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d4009690 con 0x7f54c40039b0 2024-09-11T22:21:11.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.011+0000 7f54e02e6640 1 -- 172.21.15.100:0/3309118790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c40039b0 msgr2=0x7f54c4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.011+0000 7f54e02e6640 1 --2- 172.21.15.100:0/3309118790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54c40039b0 0x7f54c4003dd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009ac0 tx=0x7f54c4005830 comp rx=0 tx=0).stop 2024-09-11T22:21:11.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.011+0000 7f54de883640 1 -- 172.21.15.100:0/3309118790 reap_dead start 2024-09-11T22:21:11.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.011+0000 7f54e02e6640 1 -- 172.21.15.100:0/3309118790 shutdown_connections 2024-09-11T22:21:11.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.011+0000 7f54e02e6640 1 -- 172.21.15.100:0/3309118790 >> 172.21.15.100:0/3309118790 conn(0x7f54d80cbf70 msgr2=0x7f54d80cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.011+0000 7f54e02e6640 1 -- 172.21.15.100:0/3309118790 shutdown_connections 2024-09-11T22:21:11.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.012+0000 7f54e02e6640 1 -- 172.21.15.100:0/3309118790 wait complete. 2024-09-11T22:21:11.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.013+0000 7f54e02e6640 1 Processor -- start 2024-09-11T22:21:11.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.013+0000 7f54e02e6640 1 -- start start 2024-09-11T22:21:11.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.013+0000 7f54e02e6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54c40039b0 0x7f54d814ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.013+0000 7f54e02e6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d81459c0 0x7f54d8144880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.013+0000 7f54e02e6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d81f0230 0x7f54d8146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.013+0000 7f54e02e6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f54d80c2720 con 0x7f54d81459c0 2024-09-11T22:21:11.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.013+0000 7f54e02e6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f54d80c2440 con 0x7f54d81f0230 2024-09-11T22:21:11.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.013+0000 7f54e02e6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f54d806c320 con 0x7f54c40039b0 2024-09-11T22:21:11.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.013+0000 7f54dd881640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d81459c0 0x7f54d8144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.013+0000 7f54dd881640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d81459c0 0x7f54d8144880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38090/0 (socket says 172.21.15.100:38090) 2024-09-11T22:21:11.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.013+0000 7f54dd881640 1 -- 172.21.15.100:0/1024708782 learned_addr learned my addr 172.21.15.100:0/1024708782 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:11.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.014+0000 7f54de883640 1 --2- 172.21.15.100:0/1024708782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d81f0230 0x7f54d8146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.014+0000 7f54de082640 1 --2- 172.21.15.100:0/1024708782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54c40039b0 0x7f54d814ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.014+0000 7f54dd881640 1 -- 172.21.15.100:0/1024708782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54c40039b0 msgr2=0x7f54d814ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.014+0000 7f54dd881640 1 --2- 172.21.15.100:0/1024708782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54c40039b0 0x7f54d814ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.014+0000 7f54dd881640 1 -- 172.21.15.100:0/1024708782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d81f0230 msgr2=0x7f54d8146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.014+0000 7f54dd881640 1 --2- 172.21.15.100:0/1024708782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d81f0230 0x7f54d8146660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.014+0000 7f54dd881640 1 -- 172.21.15.100:0/1024708782 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d81529c0 con 0x7f54d81459c0 2024-09-11T22:21:11.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.014+0000 7f54dd881640 1 --2- 172.21.15.100:0/1024708782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d81459c0 0x7f54d8144880 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f54c8011600 tx=0x7f54c8011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.014+0000 7f54ceffd640 1 -- 172.21.15.100:0/1024708782 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c800f920 con 0x7f54d81459c0 2024-09-11T22:21:11.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.014+0000 7f54ceffd640 1 -- 172.21.15.100:0/1024708782 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c800fac0 con 0x7f54d81459c0 2024-09-11T22:21:11.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.014+0000 7f54e02e6640 1 -- 172.21.15.100:0/1024708782 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54d8143da0 con 0x7f54d81459c0 2024-09-11T22:21:11.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.014+0000 7f54ceffd640 1 -- 172.21.15.100:0/1024708782 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c800fe90 con 0x7f54d81459c0 2024-09-11T22:21:11.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.014+0000 7f54e02e6640 1 -- 172.21.15.100:0/1024708782 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54d80c5f50 con 0x7f54d81459c0 2024-09-11T22:21:11.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.015+0000 7f54e02e6640 1 -- 172.21.15.100:0/1024708782 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54d8071780 con 0x7f54d81459c0 2024-09-11T22:21:11.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.016+0000 7f54ceffd640 1 -- 172.21.15.100:0/1024708782 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f54c8015460 con 0x7f54d81459c0 2024-09-11T22:21:11.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.016+0000 7f54ceffd640 1 --2- 172.21.15.100:0/1024708782 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f54bc06bfd0 0x7f54bc06e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.016+0000 7f54ceffd640 1 -- 172.21.15.100:0/1024708782 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f54c808ba70 con 0x7f54d81459c0 2024-09-11T22:21:11.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.016+0000 7f54de082640 1 --2- 172.21.15.100:0/1024708782 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f54bc06bfd0 0x7f54bc06e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.017+0000 7f54de082640 1 --2- 172.21.15.100:0/1024708782 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f54bc06bfd0 0x7f54bc06e490 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f54d4033000 tx=0x7f54d4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.020+0000 7f54ceffd640 1 -- 172.21.15.100:0/1024708782 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f54c8019030 con 0x7f54d81459c0 2024-09-11T22:21:11.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.183+0000 7f54e02e6640 1 -- 172.21.15.100:0/1024708782 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f54d8155070 con 0x7f54bc06bfd0 2024-09-11T22:21:11.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.190+0000 7f54ceffd640 1 -- 172.21.15.100:0/1024708782 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332716 (secure 0 0 0) 0x7f54d8155070 con 0x7f54bc06bfd0 2024-09-11T22:21:11.194 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:21:11.196 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-11T22:21:11.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.193+0000 7f54e02e6640 1 -- 172.21.15.100:0/1024708782 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f54bc06bfd0 msgr2=0x7f54bc06e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.193+0000 7f54e02e6640 1 --2- 172.21.15.100:0/1024708782 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f54bc06bfd0 0x7f54bc06e490 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f54d4033000 tx=0x7f54d4008030 comp rx=0 tx=0).stop 2024-09-11T22:21:11.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.193+0000 7f54e02e6640 1 -- 172.21.15.100:0/1024708782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d81459c0 msgr2=0x7f54d8144880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.193+0000 7f54e02e6640 1 --2- 172.21.15.100:0/1024708782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d81459c0 0x7f54d8144880 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f54c8011600 tx=0x7f54c8011ac0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.193+0000 7f54e02e6640 1 -- 172.21.15.100:0/1024708782 shutdown_connections 2024-09-11T22:21:11.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.193+0000 7f54e02e6640 1 --2- 172.21.15.100:0/1024708782 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f54bc06bfd0 0x7f54bc06e490 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.193+0000 7f54e02e6640 1 --2- 172.21.15.100:0/1024708782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d81f0230 0x7f54d8146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.193+0000 7f54e02e6640 1 --2- 172.21.15.100:0/1024708782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54d81459c0 0x7f54d8144880 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.193+0000 7f54e02e6640 1 --2- 172.21.15.100:0/1024708782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54c40039b0 0x7f54d814ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.193+0000 7f54e02e6640 1 -- 172.21.15.100:0/1024708782 >> 172.21.15.100:0/1024708782 conn(0x7f54d80cbf70 msgr2=0x7f54d80c7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.193+0000 7f54e02e6640 1 -- 172.21.15.100:0/1024708782 shutdown_connections 2024-09-11T22:21:11.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.194+0000 7f54e02e6640 1 -- 172.21.15.100:0/1024708782 wait complete. 2024-09-11T22:21:11.205 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-09-11T22:21:10.315975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598265,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":288,"num_write_kb":2459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218844,"kb_used_data":2592,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755876,"statfs":{"total":773094113280,"available":772870017024,"internally_reserved":0,"allocated":2654208,"data_stored":2168674,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":443,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.292146"},"pg_stats":[{"pgid":"2.1f","version":"26'9","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.032151+0000","last_change":"2024-09-11T22:20:18.853007+0000","last_active":"2024-09-11T22:21:02.032151+0000","last_peered":"2024-09-11T22:21:02.032151+0000","last_clean":"2024-09-11T22:21:02.032151+0000","last_became_active":"2024-09-11T22:20:18.852740+0000","last_became_peered":"2024-09-11T22:20:18.852740+0000","last_unstale":"2024-09-11T22:21:02.032151+0000","last_undegraded":"2024-09-11T22:21:02.032151+0000","last_fullsized":"2024-09-11T22:21:02.032151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:46.710328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033072+0000","last_change":"2024-09-11T22:20:19.849765+0000","last_active":"2024-09-11T22:21:02.033072+0000","last_peered":"2024-09-11T22:21:02.033072+0000","last_clean":"2024-09-11T22:21:02.033072+0000","last_became_active":"2024-09-11T22:20:19.848619+0000","last_became_peered":"2024-09-11T22:20:19.848619+0000","last_unstale":"2024-09-11T22:21:02.033072+0000","last_undegraded":"2024-09-11T22:21:02.033072+0000","last_fullsized":"2024-09-11T22:21:02.033072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:57.621624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031037+0000","last_change":"2024-09-11T22:20:24.078618+0000","last_active":"2024-09-11T22:21:02.031037+0000","last_peered":"2024-09-11T22:21:02.031037+0000","last_clean":"2024-09-11T22:21:02.031037+0000","last_became_active":"2024-09-11T22:20:24.078283+0000","last_became_peered":"2024-09-11T22:20:24.078283+0000","last_unstale":"2024-09-11T22:21:02.031037+0000","last_undegraded":"2024-09-11T22:21:02.031037+0000","last_fullsized":"2024-09-11T22:21:02.031037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:01.901307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033270+0000","last_change":"2024-09-11T22:20:18.855945+0000","last_active":"2024-09-11T22:21:02.033270+0000","last_peered":"2024-09-11T22:21:02.033270+0000","last_clean":"2024-09-11T22:21:02.033270+0000","last_became_active":"2024-09-11T22:20:18.854811+0000","last_became_peered":"2024-09-11T22:20:18.854811+0000","last_unstale":"2024-09-11T22:21:02.033270+0000","last_undegraded":"2024-09-11T22:21:02.033270+0000","last_fullsized":"2024-09-11T22:21:02.033270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:47.508920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031556+0000","last_change":"2024-09-11T22:20:19.862436+0000","last_active":"2024-09-11T22:21:02.031556+0000","last_peered":"2024-09-11T22:21:02.031556+0000","last_clean":"2024-09-11T22:21:02.031556+0000","last_became_active":"2024-09-11T22:20:19.862061+0000","last_became_peered":"2024-09-11T22:20:19.862061+0000","last_unstale":"2024-09-11T22:21:02.031556+0000","last_undegraded":"2024-09-11T22:21:02.031556+0000","last_fullsized":"2024-09-11T22:21:02.031556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028431+0000","last_change":"2024-09-11T22:20:23.879729+0000","last_active":"2024-09-11T22:21:02.028431+0000","last_peered":"2024-09-11T22:21:02.028431+0000","last_clean":"2024-09-11T22:21:02.028431+0000","last_became_active":"2024-09-11T22:20:23.879245+0000","last_became_peered":"2024-09-11T22:20:23.879245+0000","last_unstale":"2024-09-11T22:21:02.028431+0000","last_undegraded":"2024-09-11T22:21:02.028431+0000","last_fullsized":"2024-09-11T22:21:02.028431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:36.836842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030157+0000","last_change":"2024-09-11T22:20:18.853076+0000","last_active":"2024-09-11T22:21:02.030157+0000","last_peered":"2024-09-11T22:21:02.030157+0000","last_clean":"2024-09-11T22:21:02.030157+0000","last_became_active":"2024-09-11T22:20:18.852728+0000","last_became_peered":"2024-09-11T22:20:18.852728+0000","last_unstale":"2024-09-11T22:21:02.030157+0000","last_undegraded":"2024-09-11T22:21:02.030157+0000","last_fullsized":"2024-09-11T22:21:02.030157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227771+0000","last_change":"2024-09-11T22:20:19.864544+0000","last_active":"2024-09-11T22:21:02.227771+0000","last_peered":"2024-09-11T22:21:02.227771+0000","last_clean":"2024-09-11T22:21:02.227771+0000","last_became_active":"2024-09-11T22:20:19.864234+0000","last_became_peered":"2024-09-11T22:20:19.864234+0000","last_unstale":"2024-09-11T22:21:02.227771+0000","last_undegraded":"2024-09-11T22:21:02.227771+0000","last_fullsized":"2024-09-11T22:21:02.227771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028549+0000","last_change":"2024-09-11T22:20:23.873783+0000","last_active":"2024-09-11T22:21:02.028549+0000","last_peered":"2024-09-11T22:21:02.028549+0000","last_clean":"2024-09-11T22:21:02.028549+0000","last_became_active":"2024-09-11T22:20:23.873385+0000","last_became_peered":"2024-09-11T22:20:23.873385+0000","last_unstale":"2024-09-11T22:21:02.028549+0000","last_undegraded":"2024-09-11T22:21:02.028549+0000","last_fullsized":"2024-09-11T22:21:02.028549+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029609+0000","last_change":"2024-09-11T22:20:18.861530+0000","last_active":"2024-09-11T22:21:02.029609+0000","last_peered":"2024-09-11T22:21:02.029609+0000","last_clean":"2024-09-11T22:21:02.029609+0000","last_became_active":"2024-09-11T22:20:18.861230+0000","last_became_peered":"2024-09-11T22:20:18.861230+0000","last_unstale":"2024-09-11T22:21:02.029609+0000","last_undegraded":"2024-09-11T22:21:02.029609+0000","last_fullsized":"2024-09-11T22:21:02.029609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227926+0000","last_change":"2024-09-11T22:20:19.863401+0000","last_active":"2024-09-11T22:21:02.227926+0000","last_peered":"2024-09-11T22:21:02.227926+0000","last_clean":"2024-09-11T22:21:02.227926+0000","last_became_active":"2024-09-11T22:20:19.863127+0000","last_became_peered":"2024-09-11T22:20:19.863127+0000","last_unstale":"2024-09-11T22:21:02.227926+0000","last_undegraded":"2024-09-11T22:21:02.227926+0000","last_fullsized":"2024-09-11T22:21:02.227926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:36.888544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028135+0000","last_change":"2024-09-11T22:20:23.874650+0000","last_active":"2024-09-11T22:21:02.028135+0000","last_peered":"2024-09-11T22:21:02.028135+0000","last_clean":"2024-09-11T22:21:02.028135+0000","last_became_active":"2024-09-11T22:20:23.874040+0000","last_became_peered":"2024-09-11T22:20:23.874040+0000","last_unstale":"2024-09-11T22:21:02.028135+0000","last_undegraded":"2024-09-11T22:21:02.028135+0000","last_fullsized":"2024-09-11T22:21:02.028135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025493+0000","last_change":"2024-09-11T22:20:19.859446+0000","last_active":"2024-09-11T22:21:02.025493+0000","last_peered":"2024-09-11T22:21:02.025493+0000","last_clean":"2024-09-11T22:21:02.025493+0000","last_became_active":"2024-09-11T22:20:19.859106+0000","last_became_peered":"2024-09-11T22:20:19.859106+0000","last_unstale":"2024-09-11T22:21:02.025493+0000","last_undegraded":"2024-09-11T22:21:02.025493+0000","last_fullsized":"2024-09-11T22:21:02.025493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029766+0000","last_change":"2024-09-11T22:20:18.856475+0000","last_active":"2024-09-11T22:21:02.029766+0000","last_peered":"2024-09-11T22:21:02.029766+0000","last_clean":"2024-09-11T22:21:02.029766+0000","last_became_active":"2024-09-11T22:20:18.856165+0000","last_became_peered":"2024-09-11T22:20:18.856165+0000","last_unstale":"2024-09-11T22:21:02.029766+0000","last_undegraded":"2024-09-11T22:21:02.029766+0000","last_fullsized":"2024-09-11T22:21:02.029766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028970+0000","last_change":"2024-09-11T22:20:23.878121+0000","last_active":"2024-09-11T22:21:02.028970+0000","last_peered":"2024-09-11T22:21:02.028970+0000","last_clean":"2024-09-11T22:21:02.028970+0000","last_became_active":"2024-09-11T22:20:23.877713+0000","last_became_peered":"2024-09-11T22:20:23.877713+0000","last_unstale":"2024-09-11T22:21:02.028970+0000","last_undegraded":"2024-09-11T22:21:02.028970+0000","last_fullsized":"2024-09-11T22:21:02.028970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033716+0000","last_change":"2024-09-11T22:20:19.858358+0000","last_active":"2024-09-11T22:21:02.033716+0000","last_peered":"2024-09-11T22:21:02.033716+0000","last_clean":"2024-09-11T22:21:02.033716+0000","last_became_active":"2024-09-11T22:20:19.858057+0000","last_became_peered":"2024-09-11T22:20:19.858057+0000","last_unstale":"2024-09-11T22:21:02.033716+0000","last_undegraded":"2024-09-11T22:21:02.033716+0000","last_fullsized":"2024-09-11T22:21:02.033716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:07.839926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029718+0000","last_change":"2024-09-11T22:20:18.853818+0000","last_active":"2024-09-11T22:21:02.029718+0000","last_peered":"2024-09-11T22:21:02.029718+0000","last_clean":"2024-09-11T22:21:02.029718+0000","last_became_active":"2024-09-11T22:20:18.853508+0000","last_became_peered":"2024-09-11T22:20:18.853508+0000","last_unstale":"2024-09-11T22:21:02.029718+0000","last_undegraded":"2024-09-11T22:21:02.029718+0000","last_fullsized":"2024-09-11T22:21:02.029718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:58.141587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.037670+0000","last_change":"2024-09-11T22:21:02.037670+0000","last_active":"2024-09-11T22:21:02.037670+0000","last_peered":"2024-09-11T22:21:02.037670+0000","last_clean":"2024-09-11T22:21:02.037670+0000","last_became_active":"2024-09-11T22:21:02.036941+0000","last_became_peered":"2024-09-11T22:21:02.036941+0000","last_unstale":"2024-09-11T22:21:02.037670+0000","last_undegraded":"2024-09-11T22:21:02.037670+0000","last_fullsized":"2024-09-11T22:21:02.037670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:20.859515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031746+0000","last_change":"2024-09-11T22:20:19.844748+0000","last_active":"2024-09-11T22:21:02.031746+0000","last_peered":"2024-09-11T22:21:02.031746+0000","last_clean":"2024-09-11T22:21:02.031746+0000","last_became_active":"2024-09-11T22:20:19.844446+0000","last_became_peered":"2024-09-11T22:20:19.844446+0000","last_unstale":"2024-09-11T22:21:02.031746+0000","last_undegraded":"2024-09-11T22:21:02.031746+0000","last_fullsized":"2024-09-11T22:21:02.031746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:13.319918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029638+0000","last_change":"2024-09-11T22:20:18.847388+0000","last_active":"2024-09-11T22:21:02.029638+0000","last_peered":"2024-09-11T22:21:02.029638+0000","last_clean":"2024-09-11T22:21:02.029638+0000","last_became_active":"2024-09-11T22:20:18.847118+0000","last_became_peered":"2024-09-11T22:20:18.847118+0000","last_unstale":"2024-09-11T22:21:02.029638+0000","last_undegraded":"2024-09-11T22:21:02.029638+0000","last_fullsized":"2024-09-11T22:21:02.029638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:47.360920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029161+0000","last_change":"2024-09-11T22:20:24.077604+0000","last_active":"2024-09-11T22:21:02.029161+0000","last_peered":"2024-09-11T22:21:02.029161+0000","last_clean":"2024-09-11T22:21:02.029161+0000","last_became_active":"2024-09-11T22:20:24.077231+0000","last_became_peered":"2024-09-11T22:20:24.077231+0000","last_unstale":"2024-09-11T22:21:02.029161+0000","last_undegraded":"2024-09-11T22:21:02.029161+0000","last_fullsized":"2024-09-11T22:21:02.029161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:38.846688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028259+0000","last_change":"2024-09-11T22:20:19.854453+0000","last_active":"2024-09-11T22:21:02.028259+0000","last_peered":"2024-09-11T22:21:02.028259+0000","last_clean":"2024-09-11T22:21:02.028259+0000","last_became_active":"2024-09-11T22:20:19.854100+0000","last_became_peered":"2024-09-11T22:20:19.854100+0000","last_unstale":"2024-09-11T22:21:02.028259+0000","last_undegraded":"2024-09-11T22:21:02.028259+0000","last_fullsized":"2024-09-11T22:21:02.028259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:06.166813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029113+0000","last_change":"2024-09-11T22:20:18.854889+0000","last_active":"2024-09-11T22:21:02.029113+0000","last_peered":"2024-09-11T22:21:02.029113+0000","last_clean":"2024-09-11T22:21:02.029113+0000","last_became_active":"2024-09-11T22:20:18.854552+0000","last_became_peered":"2024-09-11T22:20:18.854552+0000","last_unstale":"2024-09-11T22:21:02.029113+0000","last_undegraded":"2024-09-11T22:21:02.029113+0000","last_fullsized":"2024-09-11T22:21:02.029113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:33.612126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028918+0000","last_change":"2024-09-11T22:20:23.878932+0000","last_active":"2024-09-11T22:21:02.028918+0000","last_peered":"2024-09-11T22:21:02.028918+0000","last_clean":"2024-09-11T22:21:02.028918+0000","last_became_active":"2024-09-11T22:20:23.878305+0000","last_became_peered":"2024-09-11T22:20:23.878305+0000","last_unstale":"2024-09-11T22:21:02.028918+0000","last_undegraded":"2024-09-11T22:21:02.028918+0000","last_fullsized":"2024-09-11T22:21:02.028918+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030486+0000","last_change":"2024-09-11T22:20:19.856318+0000","last_active":"2024-09-11T22:21:02.030486+0000","last_peered":"2024-09-11T22:21:02.030486+0000","last_clean":"2024-09-11T22:21:02.030486+0000","last_became_active":"2024-09-11T22:20:19.855992+0000","last_became_peered":"2024-09-11T22:20:19.855992+0000","last_unstale":"2024-09-11T22:21:02.030486+0000","last_undegraded":"2024-09-11T22:21:02.030486+0000","last_fullsized":"2024-09-11T22:21:02.030486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:57.709140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026101+0000","last_change":"2024-09-11T22:20:18.850750+0000","last_active":"2024-09-11T22:21:02.026101+0000","last_peered":"2024-09-11T22:21:02.026101+0000","last_clean":"2024-09-11T22:21:02.026101+0000","last_became_active":"2024-09-11T22:20:18.849621+0000","last_became_peered":"2024-09-11T22:20:18.849621+0000","last_unstale":"2024-09-11T22:21:02.026101+0000","last_undegraded":"2024-09-11T22:21:02.026101+0000","last_fullsized":"2024-09-11T22:21:02.026101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028034+0000","last_change":"2024-09-11T22:20:24.077741+0000","last_active":"2024-09-11T22:21:02.028034+0000","last_peered":"2024-09-11T22:21:02.028034+0000","last_clean":"2024-09-11T22:21:02.028034+0000","last_became_active":"2024-09-11T22:20:24.077325+0000","last_became_peered":"2024-09-11T22:20:24.077325+0000","last_unstale":"2024-09-11T22:21:02.028034+0000","last_undegraded":"2024-09-11T22:21:02.028034+0000","last_fullsized":"2024-09-11T22:21:02.028034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:18.656529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033274+0000","last_change":"2024-09-11T22:20:19.850738+0000","last_active":"2024-09-11T22:21:02.033274+0000","last_peered":"2024-09-11T22:21:02.033274+0000","last_clean":"2024-09-11T22:21:02.033274+0000","last_became_active":"2024-09-11T22:20:19.850441+0000","last_became_peered":"2024-09-11T22:20:19.850441+0000","last_unstale":"2024-09-11T22:21:02.033274+0000","last_undegraded":"2024-09-11T22:21:02.033274+0000","last_fullsized":"2024-09-11T22:21:02.033274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:47.552343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029867+0000","last_change":"2024-09-11T22:20:18.845173+0000","last_active":"2024-09-11T22:21:02.029867+0000","last_peered":"2024-09-11T22:21:02.029867+0000","last_clean":"2024-09-11T22:21:02.029867+0000","last_became_active":"2024-09-11T22:20:18.844731+0000","last_became_peered":"2024-09-11T22:20:18.844731+0000","last_unstale":"2024-09-11T22:21:02.029867+0000","last_undegraded":"2024-09-11T22:21:02.029867+0000","last_fullsized":"2024-09-11T22:21:02.029867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:32.963285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.037927+0000","last_change":"2024-09-11T22:21:02.037927+0000","last_active":"2024-09-11T22:21:02.037927+0000","last_peered":"2024-09-11T22:21:02.037927+0000","last_clean":"2024-09-11T22:21:02.037927+0000","last_became_active":"2024-09-11T22:21:02.037520+0000","last_became_peered":"2024-09-11T22:21:02.037520+0000","last_unstale":"2024-09-11T22:21:02.037927+0000","last_undegraded":"2024-09-11T22:21:02.037927+0000","last_fullsized":"2024-09-11T22:21:02.037927+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:38.798530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.032044+0000","last_change":"2024-09-11T22:20:19.845497+0000","last_active":"2024-09-11T22:21:02.032044+0000","last_peered":"2024-09-11T22:21:02.032044+0000","last_clean":"2024-09-11T22:21:02.032044+0000","last_became_active":"2024-09-11T22:20:19.845203+0000","last_became_peered":"2024-09-11T22:20:19.845203+0000","last_unstale":"2024-09-11T22:21:02.032044+0000","last_undegraded":"2024-09-11T22:21:02.032044+0000","last_fullsized":"2024-09-11T22:21:02.032044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:12.086231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030346+0000","last_change":"2024-09-11T22:20:18.856263+0000","last_active":"2024-09-11T22:21:02.030346+0000","last_peered":"2024-09-11T22:21:02.030346+0000","last_clean":"2024-09-11T22:21:02.030346+0000","last_became_active":"2024-09-11T22:20:18.855968+0000","last_became_peered":"2024-09-11T22:20:18.855968+0000","last_unstale":"2024-09-11T22:21:02.030346+0000","last_undegraded":"2024-09-11T22:21:02.030346+0000","last_fullsized":"2024-09-11T22:21:02.030346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029766+0000","last_change":"2024-09-11T22:20:24.075030+0000","last_active":"2024-09-11T22:21:02.029766+0000","last_peered":"2024-09-11T22:21:02.029766+0000","last_clean":"2024-09-11T22:21:02.029766+0000","last_became_active":"2024-09-11T22:20:24.074588+0000","last_became_peered":"2024-09-11T22:20:24.074588+0000","last_unstale":"2024-09-11T22:21:02.029766+0000","last_undegraded":"2024-09-11T22:21:02.029766+0000","last_fullsized":"2024-09-11T22:21:02.029766+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227987+0000","last_change":"2024-09-11T22:20:19.859010+0000","last_active":"2024-09-11T22:21:02.227987+0000","last_peered":"2024-09-11T22:21:02.227987+0000","last_clean":"2024-09-11T22:21:02.227987+0000","last_became_active":"2024-09-11T22:20:19.858585+0000","last_became_peered":"2024-09-11T22:20:19.858585+0000","last_unstale":"2024-09-11T22:21:02.227987+0000","last_undegraded":"2024-09-11T22:21:02.227987+0000","last_fullsized":"2024-09-11T22:21:02.227987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.032132+0000","last_change":"2024-09-11T22:20:18.847904+0000","last_active":"2024-09-11T22:21:02.032132+0000","last_peered":"2024-09-11T22:21:02.032132+0000","last_clean":"2024-09-11T22:21:02.032132+0000","last_became_active":"2024-09-11T22:20:18.847669+0000","last_became_peered":"2024-09-11T22:20:18.847669+0000","last_unstale":"2024-09-11T22:21:02.032132+0000","last_undegraded":"2024-09-11T22:21:02.032132+0000","last_fullsized":"2024-09-11T22:21:02.032132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:08.717999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029308+0000","last_change":"2024-09-11T22:20:23.881067+0000","last_active":"2024-09-11T22:21:02.029308+0000","last_peered":"2024-09-11T22:21:02.029308+0000","last_clean":"2024-09-11T22:21:02.029308+0000","last_became_active":"2024-09-11T22:20:23.880468+0000","last_became_peered":"2024-09-11T22:20:23.880468+0000","last_unstale":"2024-09-11T22:21:02.029308+0000","last_undegraded":"2024-09-11T22:21:02.029308+0000","last_fullsized":"2024-09-11T22:21:02.029308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:23.480547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028714+0000","last_change":"2024-09-11T22:20:19.860423+0000","last_active":"2024-09-11T22:21:02.028714+0000","last_peered":"2024-09-11T22:21:02.028714+0000","last_clean":"2024-09-11T22:21:02.028714+0000","last_became_active":"2024-09-11T22:20:19.858932+0000","last_became_peered":"2024-09-11T22:20:19.858932+0000","last_unstale":"2024-09-11T22:21:02.028714+0000","last_undegraded":"2024-09-11T22:21:02.028714+0000","last_fullsized":"2024-09-11T22:21:02.028714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:53.255932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227699+0000","last_change":"2024-09-11T22:20:18.854973+0000","last_active":"2024-09-11T22:21:02.227699+0000","last_peered":"2024-09-11T22:21:02.227699+0000","last_clean":"2024-09-11T22:21:02.227699+0000","last_became_active":"2024-09-11T22:20:18.854725+0000","last_became_peered":"2024-09-11T22:20:18.854725+0000","last_unstale":"2024-09-11T22:21:02.227699+0000","last_undegraded":"2024-09-11T22:21:02.227699+0000","last_fullsized":"2024-09-11T22:21:02.227699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031943+0000","last_change":"2024-09-11T22:20:23.880693+0000","last_active":"2024-09-11T22:21:02.031943+0000","last_peered":"2024-09-11T22:21:02.031943+0000","last_clean":"2024-09-11T22:21:02.031943+0000","last_became_active":"2024-09-11T22:20:23.880243+0000","last_became_peered":"2024-09-11T22:20:23.880243+0000","last_unstale":"2024-09-11T22:21:02.031943+0000","last_undegraded":"2024-09-11T22:21:02.031943+0000","last_fullsized":"2024-09-11T22:21:02.031943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.659287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029266+0000","last_change":"2024-09-11T22:20:19.844808+0000","last_active":"2024-09-11T22:21:02.029266+0000","last_peered":"2024-09-11T22:21:02.029266+0000","last_clean":"2024-09-11T22:21:02.029266+0000","last_became_active":"2024-09-11T22:20:19.844536+0000","last_became_peered":"2024-09-11T22:20:19.844536+0000","last_unstale":"2024-09-11T22:21:02.029266+0000","last_undegraded":"2024-09-11T22:21:02.029266+0000","last_fullsized":"2024-09-11T22:21:02.029266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:57.142383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029239+0000","last_change":"2024-09-11T22:20:18.855640+0000","last_active":"2024-09-11T22:21:02.029239+0000","last_peered":"2024-09-11T22:21:02.029239+0000","last_clean":"2024-09-11T22:21:02.029239+0000","last_became_active":"2024-09-11T22:20:18.855394+0000","last_became_peered":"2024-09-11T22:20:18.855394+0000","last_unstale":"2024-09-11T22:21:02.029239+0000","last_undegraded":"2024-09-11T22:21:02.029239+0000","last_fullsized":"2024-09-11T22:21:02.029239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029268+0000","last_change":"2024-09-11T22:20:23.882554+0000","last_active":"2024-09-11T22:21:02.029268+0000","last_peered":"2024-09-11T22:21:02.029268+0000","last_clean":"2024-09-11T22:21:02.029268+0000","last_became_active":"2024-09-11T22:20:23.881642+0000","last_became_peered":"2024-09-11T22:20:23.881642+0000","last_unstale":"2024-09-11T22:21:02.029268+0000","last_undegraded":"2024-09-11T22:21:02.029268+0000","last_fullsized":"2024-09-11T22:21:02.029268+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:16.696043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028790+0000","last_change":"2024-09-11T22:20:19.859429+0000","last_active":"2024-09-11T22:21:02.028790+0000","last_peered":"2024-09-11T22:21:02.028790+0000","last_clean":"2024-09-11T22:21:02.028790+0000","last_became_active":"2024-09-11T22:20:19.859159+0000","last_became_peered":"2024-09-11T22:20:19.859159+0000","last_unstale":"2024-09-11T22:21:02.028790+0000","last_undegraded":"2024-09-11T22:21:02.028790+0000","last_fullsized":"2024-09-11T22:21:02.028790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:02.696450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029225+0000","last_change":"2024-09-11T22:20:18.856144+0000","last_active":"2024-09-11T22:21:02.029225+0000","last_peered":"2024-09-11T22:21:02.029225+0000","last_clean":"2024-09-11T22:21:02.029225+0000","last_became_active":"2024-09-11T22:20:18.855866+0000","last_became_peered":"2024-09-11T22:20:18.855866+0000","last_unstale":"2024-09-11T22:21:02.029225+0000","last_undegraded":"2024-09-11T22:21:02.029225+0000","last_fullsized":"2024-09-11T22:21:02.029225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:37.259393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030341+0000","last_change":"2024-09-11T22:20:24.075154+0000","last_active":"2024-09-11T22:21:02.030341+0000","last_peered":"2024-09-11T22:21:02.030341+0000","last_clean":"2024-09-11T22:21:02.030341+0000","last_became_active":"2024-09-11T22:20:24.074568+0000","last_became_peered":"2024-09-11T22:20:24.074568+0000","last_unstale":"2024-09-11T22:21:02.030341+0000","last_undegraded":"2024-09-11T22:21:02.030341+0000","last_fullsized":"2024-09-11T22:21:02.030341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:09.804991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031694+0000","last_change":"2024-09-11T22:20:19.861236+0000","last_active":"2024-09-11T22:21:02.031694+0000","last_peered":"2024-09-11T22:21:02.031694+0000","last_clean":"2024-09-11T22:21:02.031694+0000","last_became_active":"2024-09-11T22:20:19.860938+0000","last_became_peered":"2024-09-11T22:20:19.860938+0000","last_unstale":"2024-09-11T22:21:02.031694+0000","last_undegraded":"2024-09-11T22:21:02.031694+0000","last_fullsized":"2024-09-11T22:21:02.031694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:42.015334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227590+0000","last_change":"2024-09-11T22:20:18.853467+0000","last_active":"2024-09-11T22:21:02.227590+0000","last_peered":"2024-09-11T22:21:02.227590+0000","last_clean":"2024-09-11T22:21:02.227590+0000","last_became_active":"2024-09-11T22:20:18.853182+0000","last_became_peered":"2024-09-11T22:20:18.853182+0000","last_unstale":"2024-09-11T22:21:02.227590+0000","last_undegraded":"2024-09-11T22:21:02.227590+0000","last_fullsized":"2024-09-11T22:21:02.227590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029398+0000","last_change":"2024-09-11T22:20:09.425648+0000","last_active":"2024-09-11T22:21:02.029398+0000","last_peered":"2024-09-11T22:21:02.029398+0000","last_clean":"2024-09-11T22:21:02.029398+0000","last_became_active":"2024-09-11T22:20:09.424591+0000","last_became_peered":"2024-09-11T22:20:09.424591+0000","last_unstale":"2024-09-11T22:21:02.029398+0000","last_undegraded":"2024-09-11T22:21:02.029398+0000","last_fullsized":"2024-09-11T22:21:02.029398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_clean_scrub_stamp":"2024-09-11T22:20:08.334092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:53.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025706+0000","last_change":"2024-09-11T22:20:24.077007+0000","last_active":"2024-09-11T22:21:02.025706+0000","last_peered":"2024-09-11T22:21:02.025706+0000","last_clean":"2024-09-11T22:21:02.025706+0000","last_became_active":"2024-09-11T22:20:24.076601+0000","last_became_peered":"2024-09-11T22:20:24.076601+0000","last_unstale":"2024-09-11T22:21:02.025706+0000","last_undegraded":"2024-09-11T22:21:02.025706+0000","last_fullsized":"2024-09-11T22:21:02.025706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030003+0000","last_change":"2024-09-11T22:20:19.863279+0000","last_active":"2024-09-11T22:21:02.030003+0000","last_peered":"2024-09-11T22:21:02.030003+0000","last_clean":"2024-09-11T22:21:02.030003+0000","last_became_active":"2024-09-11T22:20:19.861322+0000","last_became_peered":"2024-09-11T22:20:19.861322+0000","last_unstale":"2024-09-11T22:21:02.030003+0000","last_undegraded":"2024-09-11T22:21:02.030003+0000","last_fullsized":"2024-09-11T22:21:02.030003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029570+0000","last_change":"2024-09-11T22:20:18.853343+0000","last_active":"2024-09-11T22:21:02.029570+0000","last_peered":"2024-09-11T22:21:02.029570+0000","last_clean":"2024-09-11T22:21:02.029570+0000","last_became_active":"2024-09-11T22:20:18.853069+0000","last_became_peered":"2024-09-11T22:20:18.853069+0000","last_unstale":"2024-09-11T22:21:02.029570+0000","last_undegraded":"2024-09-11T22:21:02.029570+0000","last_fullsized":"2024-09-11T22:21:02.029570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025514+0000","last_change":"2024-09-11T22:20:24.075350+0000","last_active":"2024-09-11T22:21:02.025514+0000","last_peered":"2024-09-11T22:21:02.025514+0000","last_clean":"2024-09-11T22:21:02.025514+0000","last_became_active":"2024-09-11T22:20:24.074789+0000","last_became_peered":"2024-09-11T22:20:24.074789+0000","last_unstale":"2024-09-11T22:21:02.025514+0000","last_undegraded":"2024-09-11T22:21:02.025514+0000","last_fullsized":"2024-09-11T22:21:02.025514+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227845+0000","last_change":"2024-09-11T22:20:19.866331+0000","last_active":"2024-09-11T22:21:02.227845+0000","last_peered":"2024-09-11T22:21:02.227845+0000","last_clean":"2024-09-11T22:21:02.227845+0000","last_became_active":"2024-09-11T22:20:19.865535+0000","last_became_peered":"2024-09-11T22:20:19.865535+0000","last_unstale":"2024-09-11T22:21:02.227845+0000","last_undegraded":"2024-09-11T22:21:02.227845+0000","last_fullsized":"2024-09-11T22:21:02.227845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030534+0000","last_change":"2024-09-11T22:20:18.849434+0000","last_active":"2024-09-11T22:21:02.030534+0000","last_peered":"2024-09-11T22:21:02.030534+0000","last_clean":"2024-09-11T22:21:02.030534+0000","last_became_active":"2024-09-11T22:20:18.848787+0000","last_became_peered":"2024-09-11T22:20:18.848787+0000","last_unstale":"2024-09-11T22:21:02.030534+0000","last_undegraded":"2024-09-11T22:21:02.030534+0000","last_fullsized":"2024-09-11T22:21:02.030534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:25.689495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029553+0000","last_change":"2024-09-11T22:20:23.879962+0000","last_active":"2024-09-11T22:21:02.029553+0000","last_peered":"2024-09-11T22:21:02.029553+0000","last_clean":"2024-09-11T22:21:02.029553+0000","last_became_active":"2024-09-11T22:20:23.879586+0000","last_became_peered":"2024-09-11T22:20:23.879586+0000","last_unstale":"2024-09-11T22:21:02.029553+0000","last_undegraded":"2024-09-11T22:21:02.029553+0000","last_fullsized":"2024-09-11T22:21:02.029553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:27.323116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030163+0000","last_change":"2024-09-11T22:20:19.860411+0000","last_active":"2024-09-11T22:21:02.030163+0000","last_peered":"2024-09-11T22:21:02.030163+0000","last_clean":"2024-09-11T22:21:02.030163+0000","last_became_active":"2024-09-11T22:20:19.860076+0000","last_became_peered":"2024-09-11T22:20:19.860076+0000","last_unstale":"2024-09-11T22:21:02.030163+0000","last_undegraded":"2024-09-11T22:21:02.030163+0000","last_fullsized":"2024-09-11T22:21:02.030163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029843+0000","last_change":"2024-09-11T22:20:18.856020+0000","last_active":"2024-09-11T22:21:02.029843+0000","last_peered":"2024-09-11T22:21:02.029843+0000","last_clean":"2024-09-11T22:21:02.029843+0000","last_became_active":"2024-09-11T22:20:18.855753+0000","last_became_peered":"2024-09-11T22:20:18.855753+0000","last_unstale":"2024-09-11T22:21:02.029843+0000","last_undegraded":"2024-09-11T22:21:02.029843+0000","last_fullsized":"2024-09-11T22:21:02.029843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227177+0000","last_change":"2024-09-11T22:20:24.077975+0000","last_active":"2024-09-11T22:21:02.227177+0000","last_peered":"2024-09-11T22:21:02.227177+0000","last_clean":"2024-09-11T22:21:02.227177+0000","last_became_active":"2024-09-11T22:20:24.077502+0000","last_became_peered":"2024-09-11T22:20:24.077502+0000","last_unstale":"2024-09-11T22:21:02.227177+0000","last_undegraded":"2024-09-11T22:21:02.227177+0000","last_fullsized":"2024-09-11T22:21:02.227177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:16.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029605+0000","last_change":"2024-09-11T22:20:19.856986+0000","last_active":"2024-09-11T22:21:02.029605+0000","last_peered":"2024-09-11T22:21:02.029605+0000","last_clean":"2024-09-11T22:21:02.029605+0000","last_became_active":"2024-09-11T22:20:19.856739+0000","last_became_peered":"2024-09-11T22:20:19.856739+0000","last_unstale":"2024-09-11T22:21:02.029605+0000","last_undegraded":"2024-09-11T22:21:02.029605+0000","last_fullsized":"2024-09-11T22:21:02.029605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028636+0000","last_change":"2024-09-11T22:20:18.855044+0000","last_active":"2024-09-11T22:21:02.028636+0000","last_peered":"2024-09-11T22:21:02.028636+0000","last_clean":"2024-09-11T22:21:02.028636+0000","last_became_active":"2024-09-11T22:20:18.854764+0000","last_became_peered":"2024-09-11T22:20:18.854764+0000","last_unstale":"2024-09-11T22:21:02.028636+0000","last_undegraded":"2024-09-11T22:21:02.028636+0000","last_fullsized":"2024-09-11T22:21:02.028636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:22.207278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.027914+0000","last_change":"2024-09-11T22:20:23.878383+0000","last_active":"2024-09-11T22:21:02.027914+0000","last_peered":"2024-09-11T22:21:02.027914+0000","last_clean":"2024-09-11T22:21:02.027914+0000","last_became_active":"2024-09-11T22:20:23.877890+0000","last_became_peered":"2024-09-11T22:20:23.877890+0000","last_unstale":"2024-09-11T22:21:02.027914+0000","last_undegraded":"2024-09-11T22:21:02.027914+0000","last_fullsized":"2024-09-11T22:21:02.027914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:18.876485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029429+0000","last_change":"2024-09-11T22:20:19.861242+0000","last_active":"2024-09-11T22:21:02.029429+0000","last_peered":"2024-09-11T22:21:02.029429+0000","last_clean":"2024-09-11T22:21:02.029429+0000","last_became_active":"2024-09-11T22:20:19.860988+0000","last_became_peered":"2024-09-11T22:20:19.860988+0000","last_unstale":"2024-09-11T22:21:02.029429+0000","last_undegraded":"2024-09-11T22:21:02.029429+0000","last_fullsized":"2024-09-11T22:21:02.029429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028752+0000","last_change":"2024-09-11T22:20:18.852459+0000","last_active":"2024-09-11T22:21:02.028752+0000","last_peered":"2024-09-11T22:21:02.028752+0000","last_clean":"2024-09-11T22:21:02.028752+0000","last_became_active":"2024-09-11T22:20:18.852153+0000","last_became_peered":"2024-09-11T22:20:18.852153+0000","last_unstale":"2024-09-11T22:21:02.028752+0000","last_undegraded":"2024-09-11T22:21:02.028752+0000","last_fullsized":"2024-09-11T22:21:02.028752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030254+0000","last_change":"2024-09-11T22:20:23.874062+0000","last_active":"2024-09-11T22:21:02.030254+0000","last_peered":"2024-09-11T22:21:02.030254+0000","last_clean":"2024-09-11T22:21:02.030254+0000","last_became_active":"2024-09-11T22:20:23.873635+0000","last_became_peered":"2024-09-11T22:20:23.873635+0000","last_unstale":"2024-09-11T22:21:02.030254+0000","last_undegraded":"2024-09-11T22:21:02.030254+0000","last_fullsized":"2024-09-11T22:21:02.030254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:40.914142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025507+0000","last_change":"2024-09-11T22:20:19.851577+0000","last_active":"2024-09-11T22:21:02.025507+0000","last_peered":"2024-09-11T22:21:02.025507+0000","last_clean":"2024-09-11T22:21:02.025507+0000","last_became_active":"2024-09-11T22:20:19.851286+0000","last_became_peered":"2024-09-11T22:20:19.851286+0000","last_unstale":"2024-09-11T22:21:02.025507+0000","last_undegraded":"2024-09-11T22:21:02.025507+0000","last_fullsized":"2024-09-11T22:21:02.025507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:32.025931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025532+0000","last_change":"2024-09-11T22:20:18.853301+0000","last_active":"2024-09-11T22:21:02.025532+0000","last_peered":"2024-09-11T22:21:02.025532+0000","last_clean":"2024-09-11T22:21:02.025532+0000","last_became_active":"2024-09-11T22:20:18.852978+0000","last_became_peered":"2024-09-11T22:20:18.852978+0000","last_unstale":"2024-09-11T22:21:02.025532+0000","last_undegraded":"2024-09-11T22:21:02.025532+0000","last_fullsized":"2024-09-11T22:21:02.025532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033106+0000","last_change":"2024-09-11T22:20:24.077636+0000","last_active":"2024-09-11T22:21:02.033106+0000","last_peered":"2024-09-11T22:21:02.033106+0000","last_clean":"2024-09-11T22:21:02.033106+0000","last_became_active":"2024-09-11T22:20:24.077313+0000","last_became_peered":"2024-09-11T22:20:24.077313+0000","last_unstale":"2024-09-11T22:21:02.033106+0000","last_undegraded":"2024-09-11T22:21:02.033106+0000","last_fullsized":"2024-09-11T22:21:02.033106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:23.154027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029676+0000","last_change":"2024-09-11T22:20:19.862562+0000","last_active":"2024-09-11T22:21:02.029676+0000","last_peered":"2024-09-11T22:21:02.029676+0000","last_clean":"2024-09-11T22:21:02.029676+0000","last_became_active":"2024-09-11T22:20:19.862267+0000","last_became_peered":"2024-09-11T22:20:19.862267+0000","last_unstale":"2024-09-11T22:21:02.029676+0000","last_undegraded":"2024-09-11T22:21:02.029676+0000","last_fullsized":"2024-09-11T22:21:02.029676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227615+0000","last_change":"2024-09-11T22:20:18.858002+0000","last_active":"2024-09-11T22:21:02.227615+0000","last_peered":"2024-09-11T22:21:02.227615+0000","last_clean":"2024-09-11T22:21:02.227615+0000","last_became_active":"2024-09-11T22:20:18.857419+0000","last_became_peered":"2024-09-11T22:20:18.857419+0000","last_unstale":"2024-09-11T22:21:02.227615+0000","last_undegraded":"2024-09-11T22:21:02.227615+0000","last_fullsized":"2024-09-11T22:21:02.227615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033675+0000","last_change":"2024-09-11T22:20:24.074971+0000","last_active":"2024-09-11T22:21:02.033675+0000","last_peered":"2024-09-11T22:21:02.033675+0000","last_clean":"2024-09-11T22:21:02.033675+0000","last_became_active":"2024-09-11T22:20:24.074609+0000","last_became_peered":"2024-09-11T22:20:24.074609+0000","last_unstale":"2024-09-11T22:21:02.033675+0000","last_undegraded":"2024-09-11T22:21:02.033675+0000","last_fullsized":"2024-09-11T22:21:02.033675+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:55.318904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029249+0000","last_change":"2024-09-11T22:20:19.857276+0000","last_active":"2024-09-11T22:21:02.029249+0000","last_peered":"2024-09-11T22:21:02.029249+0000","last_clean":"2024-09-11T22:21:02.029249+0000","last_became_active":"2024-09-11T22:20:19.857027+0000","last_became_peered":"2024-09-11T22:20:19.857027+0000","last_unstale":"2024-09-11T22:21:02.029249+0000","last_undegraded":"2024-09-11T22:21:02.029249+0000","last_fullsized":"2024-09-11T22:21:02.029249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029830+0000","last_change":"2024-09-11T22:20:18.848671+0000","last_active":"2024-09-11T22:21:02.029830+0000","last_peered":"2024-09-11T22:21:02.029830+0000","last_clean":"2024-09-11T22:21:02.029830+0000","last_became_active":"2024-09-11T22:20:18.848405+0000","last_became_peered":"2024-09-11T22:20:18.848405+0000","last_unstale":"2024-09-11T22:21:02.029830+0000","last_undegraded":"2024-09-11T22:21:02.029830+0000","last_fullsized":"2024-09-11T22:21:02.029830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227859+0000","last_change":"2024-09-11T22:20:24.076835+0000","last_active":"2024-09-11T22:21:02.227859+0000","last_peered":"2024-09-11T22:21:02.227859+0000","last_clean":"2024-09-11T22:21:02.227859+0000","last_became_active":"2024-09-11T22:20:24.076200+0000","last_became_peered":"2024-09-11T22:20:24.076200+0000","last_unstale":"2024-09-11T22:21:02.227859+0000","last_undegraded":"2024-09-11T22:21:02.227859+0000","last_fullsized":"2024-09-11T22:21:02.227859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:48.150778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033502+0000","last_change":"2024-09-11T22:21:02.033502+0000","last_active":"2024-09-11T22:21:02.033502+0000","last_peered":"2024-09-11T22:21:02.033502+0000","last_clean":"2024-09-11T22:21:02.033502+0000","last_became_active":"2024-09-11T22:21:02.033269+0000","last_became_peered":"2024-09-11T22:21:02.033269+0000","last_unstale":"2024-09-11T22:21:02.033502+0000","last_undegraded":"2024-09-11T22:21:02.033502+0000","last_fullsized":"2024-09-11T22:21:02.033502+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:31.993239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'11","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026204+0000","last_change":"2024-09-11T22:20:18.855665+0000","last_active":"2024-09-11T22:21:02.026204+0000","last_peered":"2024-09-11T22:21:02.026204+0000","last_clean":"2024-09-11T22:21:02.026204+0000","last_became_active":"2024-09-11T22:20:18.855386+0000","last_became_peered":"2024-09-11T22:20:18.855386+0000","last_unstale":"2024-09-11T22:21:02.026204+0000","last_undegraded":"2024-09-11T22:21:02.026204+0000","last_fullsized":"2024-09-11T22:21:02.026204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029520+0000","last_change":"2024-09-11T22:20:23.880793+0000","last_active":"2024-09-11T22:21:02.029520+0000","last_peered":"2024-09-11T22:21:02.029520+0000","last_clean":"2024-09-11T22:21:02.029520+0000","last_became_active":"2024-09-11T22:20:23.879993+0000","last_became_peered":"2024-09-11T22:20:23.879993+0000","last_unstale":"2024-09-11T22:21:02.029520+0000","last_undegraded":"2024-09-11T22:21:02.029520+0000","last_fullsized":"2024-09-11T22:21:02.029520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:50.449090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029237+0000","last_change":"2024-09-11T22:20:19.858588+0000","last_active":"2024-09-11T22:21:02.029237+0000","last_peered":"2024-09-11T22:21:02.029237+0000","last_clean":"2024-09-11T22:21:02.029237+0000","last_became_active":"2024-09-11T22:20:19.858322+0000","last_became_peered":"2024-09-11T22:20:19.858322+0000","last_unstale":"2024-09-11T22:21:02.029237+0000","last_undegraded":"2024-09-11T22:21:02.029237+0000","last_fullsized":"2024-09-11T22:21:02.029237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":30,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030283+0000","last_change":"2024-09-11T22:20:18.855056+0000","last_active":"2024-09-11T22:21:02.030283+0000","last_peered":"2024-09-11T22:21:02.030283+0000","last_clean":"2024-09-11T22:21:02.030283+0000","last_became_active":"2024-09-11T22:20:18.854784+0000","last_became_peered":"2024-09-11T22:20:18.854784+0000","last_unstale":"2024-09-11T22:21:02.030283+0000","last_undegraded":"2024-09-11T22:21:02.030283+0000","last_fullsized":"2024-09-11T22:21:02.030283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:38.916121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028248+0000","last_change":"2024-09-11T22:20:23.879768+0000","last_active":"2024-09-11T22:21:02.028248+0000","last_peered":"2024-09-11T22:21:02.028248+0000","last_clean":"2024-09-11T22:21:02.028248+0000","last_became_active":"2024-09-11T22:20:23.878794+0000","last_became_peered":"2024-09-11T22:20:23.878794+0000","last_unstale":"2024-09-11T22:21:02.028248+0000","last_undegraded":"2024-09-11T22:21:02.028248+0000","last_fullsized":"2024-09-11T22:21:02.028248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:07.301587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.034590+0000","last_change":"2024-09-11T22:21:02.034590+0000","last_active":"2024-09-11T22:21:02.034590+0000","last_peered":"2024-09-11T22:21:02.034590+0000","last_clean":"2024-09-11T22:21:02.034590+0000","last_became_active":"2024-09-11T22:21:02.034349+0000","last_became_peered":"2024-09-11T22:21:02.034349+0000","last_unstale":"2024-09-11T22:21:02.034590+0000","last_undegraded":"2024-09-11T22:21:02.034590+0000","last_fullsized":"2024-09-11T22:21:02.034590+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:24.655612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.228018+0000","last_change":"2024-09-11T22:20:18.853382+0000","last_active":"2024-09-11T22:21:02.228018+0000","last_peered":"2024-09-11T22:21:02.228018+0000","last_clean":"2024-09-11T22:21:02.228018+0000","last_became_active":"2024-09-11T22:20:18.853103+0000","last_became_peered":"2024-09-11T22:20:18.853103+0000","last_unstale":"2024-09-11T22:21:02.228018+0000","last_undegraded":"2024-09-11T22:21:02.228018+0000","last_fullsized":"2024-09-11T22:21:02.228018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031422+0000","last_change":"2024-09-11T22:20:23.876997+0000","last_active":"2024-09-11T22:21:02.031422+0000","last_peered":"2024-09-11T22:21:02.031422+0000","last_clean":"2024-09-11T22:21:02.031422+0000","last_became_active":"2024-09-11T22:20:23.876587+0000","last_became_peered":"2024-09-11T22:20:23.876587+0000","last_unstale":"2024-09-11T22:21:02.031422+0000","last_undegraded":"2024-09-11T22:21:02.031422+0000","last_fullsized":"2024-09-11T22:21:02.031422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:19.670665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227988+0000","last_change":"2024-09-11T22:20:19.866624+0000","last_active":"2024-09-11T22:21:02.227988+0000","last_peered":"2024-09-11T22:21:02.227988+0000","last_clean":"2024-09-11T22:21:02.227988+0000","last_became_active":"2024-09-11T22:20:19.866303+0000","last_became_peered":"2024-09-11T22:20:19.866303+0000","last_unstale":"2024-09-11T22:21:02.227988+0000","last_undegraded":"2024-09-11T22:21:02.227988+0000","last_fullsized":"2024-09-11T22:21:02.227988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025963+0000","last_change":"2024-09-11T22:20:18.854361+0000","last_active":"2024-09-11T22:21:02.025963+0000","last_peered":"2024-09-11T22:21:02.025963+0000","last_clean":"2024-09-11T22:21:02.025963+0000","last_became_active":"2024-09-11T22:20:18.854019+0000","last_became_peered":"2024-09-11T22:20:18.854019+0000","last_unstale":"2024-09-11T22:21:02.025963+0000","last_undegraded":"2024-09-11T22:21:02.025963+0000","last_fullsized":"2024-09-11T22:21:02.025963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031134+0000","last_change":"2024-09-11T22:20:24.077476+0000","last_active":"2024-09-11T22:21:02.031134+0000","last_peered":"2024-09-11T22:21:02.031134+0000","last_clean":"2024-09-11T22:21:02.031134+0000","last_became_active":"2024-09-11T22:20:24.077134+0000","last_became_peered":"2024-09-11T22:20:24.077134+0000","last_unstale":"2024-09-11T22:21:02.031134+0000","last_undegraded":"2024-09-11T22:21:02.031134+0000","last_fullsized":"2024-09-11T22:21:02.031134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:03.186460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.037816+0000","last_change":"2024-09-11T22:21:02.037816+0000","last_active":"2024-09-11T22:21:02.037816+0000","last_peered":"2024-09-11T22:21:02.037816+0000","last_clean":"2024-09-11T22:21:02.037816+0000","last_became_active":"2024-09-11T22:21:02.037407+0000","last_became_peered":"2024-09-11T22:21:02.037407+0000","last_unstale":"2024-09-11T22:21:02.037816+0000","last_undegraded":"2024-09-11T22:21:02.037816+0000","last_fullsized":"2024-09-11T22:21:02.037816+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:36.018837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029432+0000","last_change":"2024-09-11T22:20:19.845776+0000","last_active":"2024-09-11T22:21:02.029432+0000","last_peered":"2024-09-11T22:21:02.029432+0000","last_clean":"2024-09-11T22:21:02.029432+0000","last_became_active":"2024-09-11T22:20:19.845425+0000","last_became_peered":"2024-09-11T22:20:19.845425+0000","last_unstale":"2024-09-11T22:21:02.029432+0000","last_undegraded":"2024-09-11T22:21:02.029432+0000","last_fullsized":"2024-09-11T22:21:02.029432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:07.187533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227442+0000","last_change":"2024-09-11T22:20:18.852446+0000","last_active":"2024-09-11T22:21:02.227442+0000","last_peered":"2024-09-11T22:21:02.227442+0000","last_clean":"2024-09-11T22:21:02.227442+0000","last_became_active":"2024-09-11T22:20:18.852155+0000","last_became_peered":"2024-09-11T22:20:18.852155+0000","last_unstale":"2024-09-11T22:21:02.227442+0000","last_undegraded":"2024-09-11T22:21:02.227442+0000","last_fullsized":"2024-09-11T22:21:02.227442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025729+0000","last_change":"2024-09-11T22:20:23.876503+0000","last_active":"2024-09-11T22:21:02.025729+0000","last_peered":"2024-09-11T22:21:02.025729+0000","last_clean":"2024-09-11T22:21:02.025729+0000","last_became_active":"2024-09-11T22:20:23.876100+0000","last_became_peered":"2024-09-11T22:20:23.876100+0000","last_unstale":"2024-09-11T22:21:02.025729+0000","last_undegraded":"2024-09-11T22:21:02.025729+0000","last_fullsized":"2024-09-11T22:21:02.025729+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031526+0000","last_change":"2024-09-11T22:20:19.852606+0000","last_active":"2024-09-11T22:21:02.031526+0000","last_peered":"2024-09-11T22:21:02.031526+0000","last_clean":"2024-09-11T22:21:02.031526+0000","last_became_active":"2024-09-11T22:20:19.852333+0000","last_became_peered":"2024-09-11T22:20:19.852333+0000","last_unstale":"2024-09-11T22:21:02.031526+0000","last_undegraded":"2024-09-11T22:21:02.031526+0000","last_fullsized":"2024-09-11T22:21:02.031526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:56.940278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":28,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031424+0000","last_change":"2024-09-11T22:20:18.853767+0000","last_active":"2024-09-11T22:21:02.031424+0000","last_peered":"2024-09-11T22:21:02.031424+0000","last_clean":"2024-09-11T22:21:02.031424+0000","last_became_active":"2024-09-11T22:20:18.853533+0000","last_became_peered":"2024-09-11T22:20:18.853533+0000","last_unstale":"2024-09-11T22:21:02.031424+0000","last_undegraded":"2024-09-11T22:21:02.031424+0000","last_fullsized":"2024-09-11T22:21:02.031424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:36.662271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026157+0000","last_change":"2024-09-11T22:20:18.847133+0000","last_active":"2024-09-11T22:21:02.026157+0000","last_peered":"2024-09-11T22:21:02.026157+0000","last_clean":"2024-09-11T22:21:02.026157+0000","last_became_active":"2024-09-11T22:20:18.846321+0000","last_became_peered":"2024-09-11T22:20:18.846321+0000","last_unstale":"2024-09-11T22:21:02.026157+0000","last_undegraded":"2024-09-11T22:21:02.026157+0000","last_fullsized":"2024-09-11T22:21:02.026157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029751+0000","last_change":"2024-09-11T22:20:19.861445+0000","last_active":"2024-09-11T22:21:02.029751+0000","last_peered":"2024-09-11T22:21:02.029751+0000","last_clean":"2024-09-11T22:21:02.029751+0000","last_became_active":"2024-09-11T22:20:19.861154+0000","last_became_peered":"2024-09-11T22:20:19.861154+0000","last_unstale":"2024-09-11T22:21:02.029751+0000","last_undegraded":"2024-09-11T22:21:02.029751+0000","last_fullsized":"2024-09-11T22:21:02.029751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029483+0000","last_change":"2024-09-11T22:20:23.877973+0000","last_active":"2024-09-11T22:21:02.029483+0000","last_peered":"2024-09-11T22:21:02.029483+0000","last_clean":"2024-09-11T22:21:02.029483+0000","last_became_active":"2024-09-11T22:20:23.877578+0000","last_became_peered":"2024-09-11T22:20:23.877578+0000","last_unstale":"2024-09-11T22:21:02.029483+0000","last_undegraded":"2024-09-11T22:21:02.029483+0000","last_fullsized":"2024-09-11T22:21:02.029483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:27.826669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'6","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033802+0000","last_change":"2024-09-11T22:20:18.854142+0000","last_active":"2024-09-11T22:21:02.033802+0000","last_peered":"2024-09-11T22:21:02.033802+0000","last_clean":"2024-09-11T22:21:02.033802+0000","last_became_active":"2024-09-11T22:20:18.853872+0000","last_became_peered":"2024-09-11T22:20:18.853872+0000","last_unstale":"2024-09-11T22:21:02.033802+0000","last_undegraded":"2024-09-11T22:21:02.033802+0000","last_fullsized":"2024-09-11T22:21:02.033802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:22.513242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1065,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.028251+0000","last_change":"2024-09-11T22:20:19.852580+0000","last_active":"2024-09-11T22:21:02.028251+0000","last_peered":"2024-09-11T22:21:02.028251+0000","last_clean":"2024-09-11T22:21:02.028251+0000","last_became_active":"2024-09-11T22:20:19.850175+0000","last_became_peered":"2024-09-11T22:20:19.850175+0000","last_unstale":"2024-09-11T22:21:02.028251+0000","last_undegraded":"2024-09-11T22:21:02.028251+0000","last_fullsized":"2024-09-11T22:21:02.028251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:11.937256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.032982+0000","last_change":"2024-09-11T22:20:23.878004+0000","last_active":"2024-09-11T22:21:02.032982+0000","last_peered":"2024-09-11T22:21:02.032982+0000","last_clean":"2024-09-11T22:21:02.032982+0000","last_became_active":"2024-09-11T22:20:23.876776+0000","last_became_peered":"2024-09-11T22:20:23.876776+0000","last_unstale":"2024-09-11T22:21:02.032982+0000","last_undegraded":"2024-09-11T22:21:02.032982+0000","last_fullsized":"2024-09-11T22:21:02.032982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:11.254248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.025354+0000","last_change":"2024-09-11T22:20:19.853439+0000","last_active":"2024-09-11T22:21:02.025354+0000","last_peered":"2024-09-11T22:21:02.025354+0000","last_clean":"2024-09-11T22:21:02.025354+0000","last_became_active":"2024-09-11T22:20:19.852937+0000","last_became_peered":"2024-09-11T22:20:19.852937+0000","last_unstale":"2024-09-11T22:21:02.025354+0000","last_undegraded":"2024-09-11T22:21:02.025354+0000","last_fullsized":"2024-09-11T22:21:02.025354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029151+0000","last_change":"2024-09-11T22:20:19.861003+0000","last_active":"2024-09-11T22:21:02.029151+0000","last_peered":"2024-09-11T22:21:02.029151+0000","last_clean":"2024-09-11T22:21:02.029151+0000","last_became_active":"2024-09-11T22:20:19.860690+0000","last_became_peered":"2024-09-11T22:20:19.860690+0000","last_unstale":"2024-09-11T22:21:02.029151+0000","last_undegraded":"2024-09-11T22:21:02.029151+0000","last_fullsized":"2024-09-11T22:21:02.029151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227573+0000","last_change":"2024-09-11T22:20:19.856756+0000","last_active":"2024-09-11T22:21:02.227573+0000","last_peered":"2024-09-11T22:21:02.227573+0000","last_clean":"2024-09-11T22:21:02.227573+0000","last_became_active":"2024-09-11T22:20:19.856460+0000","last_became_peered":"2024-09-11T22:20:19.856460+0000","last_unstale":"2024-09-11T22:21:02.227573+0000","last_undegraded":"2024-09-11T22:21:02.227573+0000","last_fullsized":"2024-09-11T22:21:02.227573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029670+0000","last_change":"2024-09-11T22:20:19.855629+0000","last_active":"2024-09-11T22:21:02.029670+0000","last_peered":"2024-09-11T22:21:02.029670+0000","last_clean":"2024-09-11T22:21:02.029670+0000","last_became_active":"2024-09-11T22:20:19.855363+0000","last_became_peered":"2024-09-11T22:20:19.855363+0000","last_unstale":"2024-09-11T22:21:02.029670+0000","last_undegraded":"2024-09-11T22:21:02.029670+0000","last_fullsized":"2024-09-11T22:21:02.029670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033889+0000","last_change":"2024-09-11T22:20:19.863122+0000","last_active":"2024-09-11T22:21:02.033889+0000","last_peered":"2024-09-11T22:21:02.033889+0000","last_clean":"2024-09-11T22:21:02.033889+0000","last_became_active":"2024-09-11T22:20:19.862828+0000","last_became_peered":"2024-09-11T22:20:19.862828+0000","last_unstale":"2024-09-11T22:21:02.033889+0000","last_undegraded":"2024-09-11T22:21:02.033889+0000","last_fullsized":"2024-09-11T22:21:02.033889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:10.868762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030114+0000","last_change":"2024-09-11T22:20:19.846453+0000","last_active":"2024-09-11T22:21:02.030114+0000","last_peered":"2024-09-11T22:21:02.030114+0000","last_clean":"2024-09-11T22:21:02.030114+0000","last_became_active":"2024-09-11T22:20:19.846186+0000","last_became_peered":"2024-09-11T22:20:19.846186+0000","last_unstale":"2024-09-11T22:21:02.030114+0000","last_undegraded":"2024-09-11T22:21:02.030114+0000","last_fullsized":"2024-09-11T22:21:02.030114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:24.032365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026220+0000","last_change":"2024-09-11T22:20:19.860632+0000","last_active":"2024-09-11T22:21:02.026220+0000","last_peered":"2024-09-11T22:21:02.026220+0000","last_clean":"2024-09-11T22:21:02.026220+0000","last_became_active":"2024-09-11T22:20:19.860005+0000","last_became_peered":"2024-09-11T22:20:19.860005+0000","last_unstale":"2024-09-11T22:21:02.026220+0000","last_undegraded":"2024-09-11T22:21:02.026220+0000","last_fullsized":"2024-09-11T22:21:02.026220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033193+0000","last_change":"2024-09-11T22:20:19.859195+0000","last_active":"2024-09-11T22:21:02.033193+0000","last_peered":"2024-09-11T22:21:02.033193+0000","last_clean":"2024-09-11T22:21:02.033193+0000","last_became_active":"2024-09-11T22:20:19.858832+0000","last_became_peered":"2024-09-11T22:20:19.858832+0000","last_unstale":"2024-09-11T22:21:02.033193+0000","last_undegraded":"2024-09-11T22:21:02.033193+0000","last_fullsized":"2024-09-11T22:21:02.033193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:56.259074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227399+0000","last_change":"2024-09-11T22:20:19.858969+0000","last_active":"2024-09-11T22:21:02.227399+0000","last_peered":"2024-09-11T22:21:02.227399+0000","last_clean":"2024-09-11T22:21:02.227399+0000","last_became_active":"2024-09-11T22:20:19.857847+0000","last_became_peered":"2024-09-11T22:20:19.857847+0000","last_unstale":"2024-09-11T22:21:02.227399+0000","last_undegraded":"2024-09-11T22:21:02.227399+0000","last_fullsized":"2024-09-11T22:21:02.227399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031335+0000","last_change":"2024-09-11T22:20:19.863294+0000","last_active":"2024-09-11T22:21:02.031335+0000","last_peered":"2024-09-11T22:21:02.031335+0000","last_clean":"2024-09-11T22:21:02.031335+0000","last_became_active":"2024-09-11T22:20:19.863007+0000","last_became_peered":"2024-09-11T22:20:19.863007+0000","last_unstale":"2024-09-11T22:21:02.031335+0000","last_undegraded":"2024-09-11T22:21:02.031335+0000","last_fullsized":"2024-09-11T22:21:02.031335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:06.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227487+0000","last_change":"2024-09-11T22:20:19.858414+0000","last_active":"2024-09-11T22:21:02.227487+0000","last_peered":"2024-09-11T22:21:02.227487+0000","last_clean":"2024-09-11T22:21:02.227487+0000","last_became_active":"2024-09-11T22:20:19.857790+0000","last_became_peered":"2024-09-11T22:20:19.857790+0000","last_unstale":"2024-09-11T22:21:02.227487+0000","last_undegraded":"2024-09-11T22:21:02.227487+0000","last_fullsized":"2024-09-11T22:21:02.227487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.034810+0000","last_change":"2024-09-11T22:21:02.034810+0000","last_active":"2024-09-11T22:21:02.034810+0000","last_peered":"2024-09-11T22:21:02.034810+0000","last_clean":"2024-09-11T22:21:02.034810+0000","last_became_active":"2024-09-11T22:21:02.034534+0000","last_became_peered":"2024-09-11T22:21:02.034534+0000","last_unstale":"2024-09-11T22:21:02.034810+0000","last_undegraded":"2024-09-11T22:21:02.034810+0000","last_fullsized":"2024-09-11T22:21:02.034810+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026014+0000","last_change":"2024-09-11T22:20:19.864700+0000","last_active":"2024-09-11T22:21:02.026014+0000","last_peered":"2024-09-11T22:21:02.026014+0000","last_clean":"2024-09-11T22:21:02.026014+0000","last_became_active":"2024-09-11T22:20:19.862296+0000","last_became_peered":"2024-09-11T22:20:19.862296+0000","last_unstale":"2024-09-11T22:21:02.026014+0000","last_undegraded":"2024-09-11T22:21:02.026014+0000","last_fullsized":"2024-09-11T22:21:02.026014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030247+0000","last_change":"2024-09-11T22:20:19.855253+0000","last_active":"2024-09-11T22:21:02.030247+0000","last_peered":"2024-09-11T22:21:02.030247+0000","last_clean":"2024-09-11T22:21:02.030247+0000","last_became_active":"2024-09-11T22:20:19.854970+0000","last_became_peered":"2024-09-11T22:20:19.854970+0000","last_unstale":"2024-09-11T22:21:02.030247+0000","last_undegraded":"2024-09-11T22:21:02.030247+0000","last_fullsized":"2024-09-11T22:21:02.030247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029763+0000","last_change":"2024-09-11T22:20:19.850202+0000","last_active":"2024-09-11T22:21:02.029763+0000","last_peered":"2024-09-11T22:21:02.029763+0000","last_clean":"2024-09-11T22:21:02.029763+0000","last_became_active":"2024-09-11T22:20:19.849815+0000","last_became_peered":"2024-09-11T22:20:19.849815+0000","last_unstale":"2024-09-11T22:21:02.029763+0000","last_undegraded":"2024-09-11T22:21:02.029763+0000","last_fullsized":"2024-09-11T22:21:02.029763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:56.480679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.228172+0000","last_change":"2024-09-11T22:20:19.866864+0000","last_active":"2024-09-11T22:21:02.228172+0000","last_peered":"2024-09-11T22:21:02.228172+0000","last_clean":"2024-09-11T22:21:02.228172+0000","last_became_active":"2024-09-11T22:20:19.866484+0000","last_became_peered":"2024-09-11T22:20:19.866484+0000","last_unstale":"2024-09-11T22:21:02.228172+0000","last_undegraded":"2024-09-11T22:21:02.228172+0000","last_fullsized":"2024-09-11T22:21:02.228172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.035254+0000","last_change":"2024-09-11T22:21:02.035254+0000","last_active":"2024-09-11T22:21:02.035254+0000","last_peered":"2024-09-11T22:21:02.035254+0000","last_clean":"2024-09-11T22:21:02.035254+0000","last_became_active":"2024-09-11T22:21:02.034985+0000","last_became_peered":"2024-09-11T22:21:02.034985+0000","last_unstale":"2024-09-11T22:21:02.035254+0000","last_undegraded":"2024-09-11T22:21:02.035254+0000","last_fullsized":"2024-09-11T22:21:02.035254+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029536+0000","last_change":"2024-09-11T22:20:19.860050+0000","last_active":"2024-09-11T22:21:02.029536+0000","last_peered":"2024-09-11T22:21:02.029536+0000","last_clean":"2024-09-11T22:21:02.029536+0000","last_became_active":"2024-09-11T22:20:19.859755+0000","last_became_peered":"2024-09-11T22:20:19.859755+0000","last_unstale":"2024-09-11T22:21:02.029536+0000","last_undegraded":"2024-09-11T22:21:02.029536+0000","last_fullsized":"2024-09-11T22:21:02.029536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:42.487669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029167+0000","last_change":"2024-09-11T22:20:19.853902+0000","last_active":"2024-09-11T22:21:02.029167+0000","last_peered":"2024-09-11T22:21:02.029167+0000","last_clean":"2024-09-11T22:21:02.029167+0000","last_became_active":"2024-09-11T22:20:19.853563+0000","last_became_peered":"2024-09-11T22:20:19.853563+0000","last_unstale":"2024-09-11T22:21:02.029167+0000","last_undegraded":"2024-09-11T22:21:02.029167+0000","last_fullsized":"2024-09-11T22:21:02.029167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.033630+0000","last_change":"2024-09-11T22:20:19.849490+0000","last_active":"2024-09-11T22:21:02.033630+0000","last_peered":"2024-09-11T22:21:02.033630+0000","last_clean":"2024-09-11T22:21:02.033630+0000","last_became_active":"2024-09-11T22:20:19.848965+0000","last_became_peered":"2024-09-11T22:20:19.848965+0000","last_unstale":"2024-09-11T22:21:02.033630+0000","last_undegraded":"2024-09-11T22:21:02.033630+0000","last_fullsized":"2024-09-11T22:21:02.033630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:10.387663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029136+0000","last_change":"2024-09-11T22:20:19.860457+0000","last_active":"2024-09-11T22:21:02.029136+0000","last_peered":"2024-09-11T22:21:02.029136+0000","last_clean":"2024-09-11T22:21:02.029136+0000","last_became_active":"2024-09-11T22:20:19.858887+0000","last_became_peered":"2024-09-11T22:20:19.858887+0000","last_unstale":"2024-09-11T22:21:02.029136+0000","last_undegraded":"2024-09-11T22:21:02.029136+0000","last_fullsized":"2024-09-11T22:21:02.029136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:34.620956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026280+0000","last_change":"2024-09-11T22:20:19.862347+0000","last_active":"2024-09-11T22:21:02.026280+0000","last_peered":"2024-09-11T22:21:02.026280+0000","last_clean":"2024-09-11T22:21:02.026280+0000","last_became_active":"2024-09-11T22:20:19.861965+0000","last_became_peered":"2024-09-11T22:20:19.861965+0000","last_unstale":"2024-09-11T22:21:02.026280+0000","last_undegraded":"2024-09-11T22:21:02.026280+0000","last_fullsized":"2024-09-11T22:21:02.026280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.026130+0000","last_change":"2024-09-11T22:20:19.862065+0000","last_active":"2024-09-11T22:21:02.026130+0000","last_peered":"2024-09-11T22:21:02.026130+0000","last_clean":"2024-09-11T22:21:02.026130+0000","last_became_active":"2024-09-11T22:20:19.861765+0000","last_became_peered":"2024-09-11T22:20:19.861765+0000","last_unstale":"2024-09-11T22:21:02.026130+0000","last_undegraded":"2024-09-11T22:21:02.026130+0000","last_fullsized":"2024-09-11T22:21:02.026130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.030078+0000","last_change":"2024-09-11T22:20:19.865064+0000","last_active":"2024-09-11T22:21:02.030078+0000","last_peered":"2024-09-11T22:21:02.030078+0000","last_clean":"2024-09-11T22:21:02.030078+0000","last_became_active":"2024-09-11T22:20:19.864697+0000","last_became_peered":"2024-09-11T22:20:19.864697+0000","last_unstale":"2024-09-11T22:21:02.030078+0000","last_undegraded":"2024-09-11T22:21:02.030078+0000","last_fullsized":"2024-09-11T22:21:02.030078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.031325+0000","last_change":"2024-09-11T22:20:19.861293+0000","last_active":"2024-09-11T22:21:02.031325+0000","last_peered":"2024-09-11T22:21:02.031325+0000","last_clean":"2024-09-11T22:21:02.031325+0000","last_became_active":"2024-09-11T22:20:19.861013+0000","last_became_peered":"2024-09-11T22:20:19.861013+0000","last_unstale":"2024-09-11T22:21:02.031325+0000","last_undegraded":"2024-09-11T22:21:02.031325+0000","last_fullsized":"2024-09-11T22:21:02.031325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:13.178404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029254+0000","last_change":"2024-09-11T22:20:19.858131+0000","last_active":"2024-09-11T22:21:02.029254+0000","last_peered":"2024-09-11T22:21:02.029254+0000","last_clean":"2024-09-11T22:21:02.029254+0000","last_became_active":"2024-09-11T22:20:19.857842+0000","last_became_peered":"2024-09-11T22:20:19.857842+0000","last_unstale":"2024-09-11T22:21:02.029254+0000","last_undegraded":"2024-09-11T22:21:02.029254+0000","last_fullsized":"2024-09-11T22:21:02.029254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227444+0000","last_change":"2024-09-11T22:20:19.859667+0000","last_active":"2024-09-11T22:21:02.227444+0000","last_peered":"2024-09-11T22:21:02.227444+0000","last_clean":"2024-09-11T22:21:02.227444+0000","last_became_active":"2024-09-11T22:20:19.859306+0000","last_became_peered":"2024-09-11T22:20:19.859306+0000","last_unstale":"2024-09-11T22:21:02.227444+0000","last_undegraded":"2024-09-11T22:21:02.227444+0000","last_fullsized":"2024-09-11T22:21:02.227444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029504+0000","last_change":"2024-09-11T22:20:19.848821+0000","last_active":"2024-09-11T22:21:02.029504+0000","last_peered":"2024-09-11T22:21:02.029504+0000","last_clean":"2024-09-11T22:21:02.029504+0000","last_became_active":"2024-09-11T22:20:19.848531+0000","last_became_peered":"2024-09-11T22:20:19.848531+0000","last_unstale":"2024-09-11T22:21:02.029504+0000","last_undegraded":"2024-09-11T22:21:02.029504+0000","last_fullsized":"2024-09-11T22:21:02.029504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.227722+0000","last_change":"2024-09-11T22:20:19.866300+0000","last_active":"2024-09-11T22:21:02.227722+0000","last_peered":"2024-09-11T22:21:02.227722+0000","last_clean":"2024-09-11T22:21:02.227722+0000","last_became_active":"2024-09-11T22:20:19.865939+0000","last_became_peered":"2024-09-11T22:20:19.865939+0000","last_unstale":"2024-09-11T22:21:02.227722+0000","last_undegraded":"2024-09-11T22:21:02.227722+0000","last_fullsized":"2024-09-11T22:21:02.227722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029695+0000","last_change":"2024-09-11T22:20:19.858144+0000","last_active":"2024-09-11T22:21:02.029695+0000","last_peered":"2024-09-11T22:21:02.029695+0000","last_clean":"2024-09-11T22:21:02.029695+0000","last_became_active":"2024-09-11T22:20:19.857840+0000","last_became_peered":"2024-09-11T22:20:19.857840+0000","last_unstale":"2024-09-11T22:21:02.029695+0000","last_undegraded":"2024-09-11T22:21:02.029695+0000","last_fullsized":"2024-09-11T22:21:02.029695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:23.801072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.029762+0000","last_change":"2024-09-11T22:20:19.857378+0000","last_active":"2024-09-11T22:21:02.029762+0000","last_peered":"2024-09-11T22:21:02.029762+0000","last_clean":"2024-09-11T22:21:02.029762+0000","last_became_active":"2024-09-11T22:20:19.857089+0000","last_became_peered":"2024-09-11T22:20:19.857089+0000","last_unstale":"2024-09-11T22:21:02.029762+0000","last_undegraded":"2024-09-11T22:21:02.029762+0000","last_fullsized":"2024-09-11T22:21:02.029762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:29.835695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:21:02.036200+0000","last_change":"2024-09-11T22:21:02.036200+0000","last_active":"2024-09-11T22:21:02.036200+0000","last_peered":"2024-09-11T22:21:02.036200+0000","last_clean":"2024-09-11T22:21:02.036200+0000","last_became_active":"2024-09-11T22:21:02.035889+0000","last_became_peered":"2024-09-11T22:21:02.035889+0000","last_unstale":"2024-09-11T22:21:02.036200+0000","last_undegraded":"2024-09-11T22:21:02.036200+0000","last_fullsized":"2024-09-11T22:21:02.036200+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7897,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":15794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":113,"ondisk_log_size":113,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":380928,"data_stored":713645,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":315392,"data_stored":126040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":315392,"data_stored":122896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":311296,"data_stored":122232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":319488,"data_stored":126517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":315392,"data_stored":122336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":712546,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":319488,"data_stored":122462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:21:11.210 INFO:tasks.mon_thrash.ceph_manager:clean! 2024-09-11T22:21:11.211 DEBUG:tasks.mon_thrash:Yielding 2024-09-11T22:21:11.211 INFO:teuthology.run_tasks:Running task workunit... 2024-09-11T22:21:11.224 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-11T22:21:11.224 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-11T22:21:11.224 INFO:tasks.workunit:timeout=3h 2024-09-11T22:21:11.224 INFO:tasks.workunit:cleanup=True 2024-09-11T22:21:11.225 DEBUG:teuthology.orchestra.run.smithi100:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-11T22:21:11.225 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:21:11.261 INFO:teuthology.orchestra.run.smithi100.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-11T22:21:11.261 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-11T22:21:11.261 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 2ah/42d Inode: 1 Links: 2 2024-09-11T22:21:11.261 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T22:21:11.261 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-11T22:21:11.261 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-11T22:21:11.261 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-11 22:20:24.838446606 +0000 2024-09-11T22:21:11.261 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-11 22:20:32.164462577 +0000 2024-09-11T22:21:11.261 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: - 2024-09-11T22:21:11.261 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-11T22:21:11.262 DEBUG:teuthology.orchestra.run.smithi100:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-11T22:21:11.338 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-11T22:21:11.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.346+0000 7f6cca1c4640 1 Processor -- start 2024-09-11T22:21:11.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.347+0000 7f6cca1c4640 1 -- start start 2024-09-11T22:21:11.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.347+0000 7f6cca1c4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6cc40b1240 0x7f6cc415b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.347+0000 7f6cca1c4640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6cc415e190 0x7f6cc40c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.347+0000 7f6cca1c4640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cc40b1640 con 0x7f6cc40cb450 2024-09-11T22:21:11.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.347+0000 7f6cca1c4640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f6cc41553e0 con 0x7f6cc415e190 2024-09-11T22:21:11.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.347+0000 7f6cca1c4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f6cc415ac20 con 0x7f6cc40b1240 2024-09-11T22:21:11.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.347+0000 7f6cc3fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6cc415e190 0x7f6cc40c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.347+0000 7f6cc37fe640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6cc40cb450 0x7f6cc40c9080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59646/0 (socket says 172.21.15.100:59646) 2024-09-11T22:21:11.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.347+0000 7f6cc37fe640 1 -- 172.21.15.100:0/1040324732 learned_addr learned my addr 172.21.15.100:0/1040324732 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:21:11.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.348+0000 7f6cc2ffd640 1 --2- 172.21.15.100:0/1040324732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6cc40b1240 0x7f6cc415b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.348+0000 7f6cc3fff640 1 -- 172.21.15.100:0/1040324732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6cc40b1240 msgr2=0x7f6cc415b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.348+0000 7f6cc3fff640 1 --2- 172.21.15.100:0/1040324732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6cc40b1240 0x7f6cc415b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.348+0000 7f6cc3fff640 1 -- 172.21.15.100:0/1040324732 >> v1:172.21.15.100:6789/0 conn(0x7f6cc40cb450 legacy=0x7f6cc40c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.348+0000 7f6cc27fc640 1 -- 172.21.15.100:0/1040324732 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3589232291 0 0) 0x7f6cc40b1640 con 0x7f6cc40cb450 2024-09-11T22:21:11.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.348+0000 7f6cc3fff640 1 -- 172.21.15.100:0/1040324732 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc415e8f0 con 0x7f6cc415e190 2024-09-11T22:21:11.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.348+0000 7f6cc3fff640 1 --2- 172.21.15.100:0/1040324732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc415e190 0x7f6cc40c9c20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009d90 tx=0x7f6cbc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a925a42f27eacdd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.349+0000 7f6cc27fc640 1 -- 172.21.15.100:0/1040324732 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc007740 con 0x7f6cc415e190 2024-09-11T22:21:11.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.349+0000 7f6cc27fc640 1 -- 172.21.15.100:0/1040324732 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cbc0078e0 con 0x7f6cc415e190 2024-09-11T22:21:11.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.349+0000 7f6cc27fc640 1 -- 172.21.15.100:0/1040324732 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc007cb0 con 0x7f6cc415e190 2024-09-11T22:21:11.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.349+0000 7f6cca1c4640 1 -- 172.21.15.100:0/1040324732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc415e190 msgr2=0x7f6cc40c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.349+0000 7f6cca1c4640 1 --2- 172.21.15.100:0/1040324732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc415e190 0x7f6cc40c9c20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009d90 tx=0x7f6cbc02a660 comp rx=0 tx=0).stop 2024-09-11T22:21:11.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.349+0000 7f6cca1c4640 1 -- 172.21.15.100:0/1040324732 shutdown_connections 2024-09-11T22:21:11.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.349+0000 7f6cca1c4640 1 --2- 172.21.15.100:0/1040324732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc415e190 0x7f6cc40c9c20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.349+0000 7f6cca1c4640 1 --2- 172.21.15.100:0/1040324732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6cc40b1240 0x7f6cc415b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.349+0000 7f6cca1c4640 1 -- 172.21.15.100:0/1040324732 >> 172.21.15.100:0/1040324732 conn(0x7f6cc4071560 msgr2=0x7f6cc4071940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.349+0000 7f6cca1c4640 1 -- 172.21.15.100:0/1040324732 shutdown_connections 2024-09-11T22:21:11.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.349+0000 7f6cca1c4640 1 -- 172.21.15.100:0/1040324732 wait complete. 2024-09-11T22:21:11.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.350+0000 7f6cca1c4640 1 Processor -- start 2024-09-11T22:21:11.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.351+0000 7f6cca1c4640 1 -- start start 2024-09-11T22:21:11.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.351+0000 7f6cca1c4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6cc40b1240 0x7f6cc4150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.351+0000 7f6cca1c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc40cb450 0x7f6cc41526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.351+0000 7f6cca1c4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cc415e190 0x7f6cc4152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.351+0000 7f6cca1c4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc415aee0 con 0x7f6cc40cb450 2024-09-11T22:21:11.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.351+0000 7f6cca1c4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc415eeb0 con 0x7f6cc415e190 2024-09-11T22:21:11.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.351+0000 7f6cca1c4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f6cc415b1c0 con 0x7f6cc40b1240 2024-09-11T22:21:11.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.351+0000 7f6cc2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc40cb450 0x7f6cc41526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.351+0000 7f6cc2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc40cb450 0x7f6cc41526b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38114/0 (socket says 172.21.15.100:38114) 2024-09-11T22:21:11.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.351+0000 7f6cc2ffd640 1 -- 172.21.15.100:0/45278274 learned_addr learned my addr 172.21.15.100:0/45278274 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:11.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.352+0000 7f6cc37fe640 1 --2- 172.21.15.100:0/45278274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6cc40b1240 0x7f6cc4150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.352+0000 7f6cc3fff640 1 --2- 172.21.15.100:0/45278274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cc415e190 0x7f6cc4152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.352+0000 7f6cc2ffd640 1 -- 172.21.15.100:0/45278274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6cc40b1240 msgr2=0x7f6cc4150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.352+0000 7f6cc2ffd640 1 --2- 172.21.15.100:0/45278274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6cc40b1240 0x7f6cc4150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.352+0000 7f6cc2ffd640 1 -- 172.21.15.100:0/45278274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cc415e190 msgr2=0x7f6cc4152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.352+0000 7f6cc2ffd640 1 --2- 172.21.15.100:0/45278274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cc415e190 0x7f6cc4152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.352+0000 7f6cc2ffd640 1 -- 172.21.15.100:0/45278274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc40c6b10 con 0x7f6cc40cb450 2024-09-11T22:21:11.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.352+0000 7f6cc3fff640 1 --2- 172.21.15.100:0/45278274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cc415e190 0x7f6cc4152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:11.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.352+0000 7f6cc2ffd640 1 --2- 172.21.15.100:0/45278274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc40cb450 0x7f6cc41526b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800c7f0 tx=0x7f6cb800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.352+0000 7f6cabfff640 1 -- 172.21.15.100:0/45278274 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8015070 con 0x7f6cc40cb450 2024-09-11T22:21:11.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.352+0000 7f6cabfff640 1 -- 172.21.15.100:0/45278274 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cb8004240 con 0x7f6cc40cb450 2024-09-11T22:21:11.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.352+0000 7f6cca1c4640 1 -- 172.21.15.100:0/45278274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc40c6390 con 0x7f6cc40cb450 2024-09-11T22:21:11.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.352+0000 7f6cabfff640 1 -- 172.21.15.100:0/45278274 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8007620 con 0x7f6cc40cb450 2024-09-11T22:21:11.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.352+0000 7f6cca1c4640 1 -- 172.21.15.100:0/45278274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc40c59d0 con 0x7f6cc40cb450 2024-09-11T22:21:11.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.353+0000 7f6cca1c4640 1 -- 172.21.15.100:0/45278274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cc415e600 con 0x7f6cc40cb450 2024-09-11T22:21:11.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.354+0000 7f6cabfff640 1 -- 172.21.15.100:0/45278274 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6cb80079d0 con 0x7f6cc40cb450 2024-09-11T22:21:11.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.354+0000 7f6cabfff640 1 --2- 172.21.15.100:0/45278274 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6cb006be30 0x7f6cb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.354+0000 7f6cabfff640 1 -- 172.21.15.100:0/45278274 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f6cb808b3c0 con 0x7f6cc40cb450 2024-09-11T22:21:11.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.354+0000 7f6cc37fe640 1 --2- 172.21.15.100:0/45278274 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6cb006be30 0x7f6cb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.355+0000 7f6cc37fe640 1 --2- 172.21.15.100:0/45278274 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6cb006be30 0x7f6cb006e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4000f60 tx=0x7f6cb4007b50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.359+0000 7f6cabfff640 1 -- 172.21.15.100:0/45278274 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6cb8059950 con 0x7f6cc40cb450 2024-09-11T22:21:11.363 INFO:tasks.workunit.client.0.smithi100.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-11T22:21:11.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.579+0000 7f6cca1c4640 1 -- 172.21.15.100:0/45278274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6cc40c9a00 con 0x7f6cc40cb450 2024-09-11T22:21:11.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.579+0000 7f6cabfff640 1 -- 172.21.15.100:0/45278274 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6926 (secure 0 0 0) 0x7f6cb8059250 con 0x7f6cc40cb450 2024-09-11T22:21:11.580 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:21:11.580 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":14,"btime":"2024-09-11T22:20:52:989866+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2075802330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":2075802330},{"type":"v1","addr":"172.21.15.100:6837","nonce":2075802330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/1727733473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1727733473},{"type":"v1","addr":"172.21.15.167:6836","nonce":1727733473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/880809662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":880809662},{"type":"v1","addr":"172.21.15.167:6837","nonce":880809662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:19.171222+0000","modified":"2024-09-11T22:20:52.989862+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4296,"mds_1":4281,"mds_2":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.100:6836/1912241808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1912241808},{"type":"v1","addr":"172.21.15.100:6836","nonce":1912241808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4281":{"gid":4281,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6839/3236256661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3236256661},{"type":"v1","addr":"172.21.15.100:6839","nonce":3236256661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4296":{"gid":4296,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6834/1651678197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1651678197},{"type":"v1","addr":"172.21.15.167:6834","nonce":1651678197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4275,4281,4296]},"id":1}]} 2024-09-11T22:21:11.581 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 14 2024-09-11T22:21:11.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.581+0000 7f6cca1c4640 1 -- 172.21.15.100:0/45278274 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6cb006be30 msgr2=0x7f6cb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.581+0000 7f6cca1c4640 1 --2- 172.21.15.100:0/45278274 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6cb006be30 0x7f6cb006e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4000f60 tx=0x7f6cb4007b50 comp rx=0 tx=0).stop 2024-09-11T22:21:11.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.582+0000 7f6cca1c4640 1 -- 172.21.15.100:0/45278274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc40cb450 msgr2=0x7f6cc41526b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.582+0000 7f6cca1c4640 1 --2- 172.21.15.100:0/45278274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc40cb450 0x7f6cc41526b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800c7f0 tx=0x7f6cb800ccb0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.582+0000 7f6cca1c4640 1 -- 172.21.15.100:0/45278274 shutdown_connections 2024-09-11T22:21:11.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.582+0000 7f6cca1c4640 1 --2- 172.21.15.100:0/45278274 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f6cb006be30 0x7f6cb006e2f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.582+0000 7f6cca1c4640 1 --2- 172.21.15.100:0/45278274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cc415e190 0x7f6cc4152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.582+0000 7f6cca1c4640 1 --2- 172.21.15.100:0/45278274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc40cb450 0x7f6cc41526b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.582+0000 7f6cca1c4640 1 --2- 172.21.15.100:0/45278274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6cc40b1240 0x7f6cc4150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.582+0000 7f6cca1c4640 1 -- 172.21.15.100:0/45278274 >> 172.21.15.100:0/45278274 conn(0x7f6cc4071560 msgr2=0x7f6cc4071940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.582+0000 7f6cca1c4640 1 -- 172.21.15.100:0/45278274 shutdown_connections 2024-09-11T22:21:11.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.582+0000 7f6cca1c4640 1 -- 172.21.15.100:0/45278274 wait complete. 2024-09-11T22:21:11.593 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2024-09-11T22:21:11.594 INFO:tasks.mon_thrash.mon_thrasher:seed: 1726093271, revive delay: 20.0, thrash delay: 10.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2024-09-11T22:21:11.594 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:21:11.594 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:21:11.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.733+0000 7fadc949b640 1 Processor -- start 2024-09-11T22:21:11.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.733+0000 7fadc949b640 1 -- start start 2024-09-11T22:21:11.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.734+0000 7fadc949b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fadc415a7e0 0x7fadc40cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.734+0000 7fadc949b640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadc415ac90 con 0x7fadc40b3190 2024-09-11T22:21:11.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.734+0000 7fadc949b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadc415af70 con 0x7fadc4154c20 2024-09-11T22:21:11.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.734+0000 7fadc949b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fadc415e000 con 0x7fadc415a7e0 2024-09-11T22:21:11.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.734+0000 7fadbbfff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fadc40b3190 0x7fadc415e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59652/0 (socket says 172.21.15.100:59652) 2024-09-11T22:21:11.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.734+0000 7fadbbfff640 1 -- 172.21.15.100:0/2338733723 learned_addr learned my addr 172.21.15.100:0/2338733723 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:21:11.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.734+0000 7fadc27fc640 1 -- 172.21.15.100:0/2338733723 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3523805140 0 0) 0x7fadc415ac90 con 0x7fadc40b3190 2024-09-11T22:21:11.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.734+0000 7fadc27fc640 1 -- 172.21.15.100:0/2338733723 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadb0003520 con 0x7fadc40b3190 2024-09-11T22:21:11.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.734+0000 7fadc37fe640 1 --2- 172.21.15.100:0/2338733723 >> v2:172.21.15.167:3300/0 conn(0x7fadc415a7e0 0x7fadc40cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.734+0000 7fadc27fc640 1 -- 172.21.15.100:0/2338733723 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3586088283 0 0) 0x7fadb0003520 con 0x7fadc40b3190 2024-09-11T22:21:11.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.734+0000 7fadc27fc640 1 -- 172.21.15.100:0/2338733723 >> v2:172.21.15.167:3300/0 conn(0x7fadc415a7e0 msgr2=0x7fadc40cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.734+0000 7fadc27fc640 1 --2- 172.21.15.100:0/2338733723 >> v2:172.21.15.167:3300/0 conn(0x7fadc415a7e0 0x7fadc40cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.734+0000 7fadc27fc640 1 -- 172.21.15.100:0/2338733723 >> v1:172.21.15.167:6789/0 conn(0x7fadc4154c20 legacy=0x7fadc40cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.734+0000 7fadc27fc640 1 -- 172.21.15.100:0/2338733723 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc415b250 con 0x7fadc40b3190 2024-09-11T22:21:11.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.734+0000 7fadc27fc640 1 -- 172.21.15.100:0/2338733723 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fadac001670 con 0x7fadc40b3190 2024-09-11T22:21:11.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.734+0000 7fadc27fc640 1 -- 172.21.15.100:0/2338733723 >> v1:172.21.15.100:6789/0 conn(0x7fadc40b3190 legacy=0x7fadc415e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.734+0000 7fadc27fc640 1 --2- 172.21.15.100:0/2338733723 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fadb00039b0 0x7fadb0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.734+0000 7fadc27fc640 1 --2- 172.21.15.100:0/2338733723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb0004800 0x7fadb0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.734+0000 7fadc27fc640 1 --2- 172.21.15.100:0/2338733723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadb00051c0 0x7fadb000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.735+0000 7fadc27fc640 1 -- 172.21.15.100:0/2338733723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fadc415e000 con 0x7fadb0004800 2024-09-11T22:21:11.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.735+0000 7fadc27fc640 1 -- 172.21.15.100:0/2338733723 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fadb000c090 con 0x7fadb00051c0 2024-09-11T22:21:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.735+0000 7fadc27fc640 1 -- 172.21.15.100:0/2338733723 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fadb000c290 con 0x7fadb00039b0 2024-09-11T22:21:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.735+0000 7fadbbfff640 1 --2- 172.21.15.100:0/2338733723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb0004800 0x7fadb0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.735+0000 7fadc2ffd640 1 --2- 172.21.15.100:0/2338733723 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fadb00039b0 0x7fadb0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.735+0000 7fadc37fe640 1 --2- 172.21.15.100:0/2338733723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadb00051c0 0x7fadb000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.735+0000 7fadbbfff640 1 -- 172.21.15.100:0/2338733723 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fadb00039b0 msgr2=0x7fadb0003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.735+0000 7fadbbfff640 1 --2- 172.21.15.100:0/2338733723 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fadb00039b0 0x7fadb0003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.735+0000 7fadbbfff640 1 -- 172.21.15.100:0/2338733723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadb00051c0 msgr2=0x7fadb000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.735+0000 7fadbbfff640 1 --2- 172.21.15.100:0/2338733723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadb00051c0 0x7fadb000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.735+0000 7fadbbfff640 1 -- 172.21.15.100:0/2338733723 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb0003520 con 0x7fadb0004800 2024-09-11T22:21:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.735+0000 7fadc37fe640 1 -- 172.21.15.100:0/2338733723 reap_dead start 2024-09-11T22:21:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.735+0000 7fadc2ffd640 1 --2- 172.21.15.100:0/2338733723 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fadb00039b0 0x7fadb0003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.736+0000 7fadbbfff640 1 --2- 172.21.15.100:0/2338733723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb0004800 0x7fadb0004c80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fadac00c240 tx=0x7fadb0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec25715cebd9203f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.736+0000 7fadc27fc640 1 -- 172.21.15.100:0/2338733723 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac007cf0 con 0x7fadb0004800 2024-09-11T22:21:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.736+0000 7fadc27fc640 1 -- 172.21.15.100:0/2338733723 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadac005af0 con 0x7fadb0004800 2024-09-11T22:21:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.736+0000 7fadc27fc640 1 -- 172.21.15.100:0/2338733723 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac007070 con 0x7fadb0004800 2024-09-11T22:21:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.736+0000 7fadc949b640 1 -- 172.21.15.100:0/2338733723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb0004800 msgr2=0x7fadb0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.736+0000 7fadc949b640 1 --2- 172.21.15.100:0/2338733723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb0004800 0x7fadb0004c80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fadac00c240 tx=0x7fadb0005830 comp rx=0 tx=0).stop 2024-09-11T22:21:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.736+0000 7fadc949b640 1 -- 172.21.15.100:0/2338733723 shutdown_connections 2024-09-11T22:21:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.736+0000 7fadc949b640 1 --2- 172.21.15.100:0/2338733723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb0004800 0x7fadb0004c80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.736+0000 7fadc949b640 1 -- 172.21.15.100:0/2338733723 >> 172.21.15.100:0/2338733723 conn(0x7fadc4067d40 msgr2=0x7fadc406d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.736+0000 7fadc949b640 1 -- 172.21.15.100:0/2338733723 shutdown_connections 2024-09-11T22:21:11.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.736+0000 7fadc949b640 1 -- 172.21.15.100:0/2338733723 wait complete. 2024-09-11T22:21:11.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.737+0000 7fadc949b640 1 Processor -- start 2024-09-11T22:21:11.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.737+0000 7fadc949b640 1 -- start start 2024-09-11T22:21:11.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.738+0000 7fadc949b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb0004800 0x7fadc40cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.738+0000 7fadc949b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fadc415b9a0 0x7fadc41f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.738+0000 7fadc949b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadc4153830 0x7fadc4146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.738+0000 7fadc949b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fadc40cb2a0 con 0x7fadb0004800 2024-09-11T22:21:11.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.738+0000 7fadc949b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fadc40cb120 con 0x7fadc4153830 2024-09-11T22:21:11.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.738+0000 7fadc949b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fadc40cb420 con 0x7fadc415b9a0 2024-09-11T22:21:11.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.738+0000 7fadc2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb0004800 0x7fadc40cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.738+0000 7fadc2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb0004800 0x7fadc40cf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38124/0 (socket says 172.21.15.100:38124) 2024-09-11T22:21:11.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.738+0000 7fadc2ffd640 1 -- 172.21.15.100:0/101115773 learned_addr learned my addr 172.21.15.100:0/101115773 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:11.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.738+0000 7fadc2ffd640 1 -- 172.21.15.100:0/101115773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fadc415b9a0 msgr2=0x7fadc41f3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.738+0000 7fadc2ffd640 1 --2- 172.21.15.100:0/101115773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fadc415b9a0 0x7fadc41f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.738+0000 7fadc2ffd640 1 -- 172.21.15.100:0/101115773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadc4153830 msgr2=0x7fadc4146b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:11.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.738+0000 7fadc2ffd640 1 --2- 172.21.15.100:0/101115773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadc4153830 0x7fadc4146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:11.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.738+0000 7fadc2ffd640 1 -- 172.21.15.100:0/101115773 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc40cf9d0 con 0x7fadb0004800 2024-09-11T22:21:11.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.739+0000 7fadc2ffd640 1 --2- 172.21.15.100:0/101115773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb0004800 0x7fadc40cf0a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fadb400e4b0 tx=0x7fadb400e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.739+0000 7fadbb7fe640 1 -- 172.21.15.100:0/101115773 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb4019070 con 0x7fadb0004800 2024-09-11T22:21:11.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.739+0000 7fadbb7fe640 1 -- 172.21.15.100:0/101115773 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb40052e0 con 0x7fadb0004800 2024-09-11T22:21:11.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.739+0000 7fadc949b640 1 -- 172.21.15.100:0/101115773 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc40cfcb0 con 0x7fadb0004800 2024-09-11T22:21:11.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.739+0000 7fadbb7fe640 1 -- 172.21.15.100:0/101115773 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb4003830 con 0x7fadb0004800 2024-09-11T22:21:11.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.739+0000 7fadc949b640 1 -- 172.21.15.100:0/101115773 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc40b5d60 con 0x7fadb0004800 2024-09-11T22:21:11.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.740+0000 7fadc949b640 1 -- 172.21.15.100:0/101115773 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadc40cb7b0 con 0x7fadb0004800 2024-09-11T22:21:11.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.740+0000 7fadbb7fe640 1 -- 172.21.15.100:0/101115773 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fadb401c070 con 0x7fadb0004800 2024-09-11T22:21:11.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.741+0000 7fadbb7fe640 1 --2- 172.21.15.100:0/101115773 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fada406be30 0x7fada406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:11.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.741+0000 7fadbb7fe640 1 -- 172.21.15.100:0/101115773 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fadb408a7d0 con 0x7fadb0004800 2024-09-11T22:21:11.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.741+0000 7fadbbfff640 1 --2- 172.21.15.100:0/101115773 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fada406be30 0x7fada406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:11.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.741+0000 7fadbbfff640 1 --2- 172.21.15.100:0/101115773 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fada406be30 0x7fada406e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fadac00c240 tx=0x7fadac007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:11.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:11.745+0000 7fadbb7fe640 1 -- 172.21.15.100:0/101115773 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fadb4058660 con 0x7fadb0004800 2024-09-11T22:21:12.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.013+0000 7fadc949b640 1 -- 172.21.15.100:0/101115773 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fadc40cbaf0 con 0x7fadb0004800 2024-09-11T22:21:12.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.014+0000 7fadbb7fe640 1 -- 172.21.15.100:0/101115773 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7fadb405c960 con 0x7fadb0004800 2024-09-11T22:21:12.015 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":75,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:21:12.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.016+0000 7fadc949b640 1 -- 172.21.15.100:0/101115773 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fada406be30 msgr2=0x7fada406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.016+0000 7fadc949b640 1 --2- 172.21.15.100:0/101115773 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fada406be30 0x7fada406e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fadac00c240 tx=0x7fadac007000 comp rx=0 tx=0).stop 2024-09-11T22:21:12.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.016+0000 7fadc949b640 1 -- 172.21.15.100:0/101115773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb0004800 msgr2=0x7fadc40cf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.016+0000 7fadc949b640 1 --2- 172.21.15.100:0/101115773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb0004800 0x7fadc40cf0a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fadb400e4b0 tx=0x7fadb400e970 comp rx=0 tx=0).stop 2024-09-11T22:21:12.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.016+0000 7fadc949b640 1 -- 172.21.15.100:0/101115773 shutdown_connections 2024-09-11T22:21:12.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.016+0000 7fadc949b640 1 --2- 172.21.15.100:0/101115773 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fada406be30 0x7fada406e2f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.016+0000 7fadc949b640 1 --2- 172.21.15.100:0/101115773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadc4153830 0x7fadc4146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.016+0000 7fadc949b640 1 --2- 172.21.15.100:0/101115773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fadc415b9a0 0x7fadc41f3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.016+0000 7fadc949b640 1 --2- 172.21.15.100:0/101115773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadb0004800 0x7fadc40cf0a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.016+0000 7fadc949b640 1 -- 172.21.15.100:0/101115773 >> 172.21.15.100:0/101115773 conn(0x7fadc4067d40 msgr2=0x7fadc40cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:12.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.016+0000 7fadc949b640 1 -- 172.21.15.100:0/101115773 shutdown_connections 2024-09-11T22:21:12.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.016+0000 7fadc949b640 1 -- 172.21.15.100:0/101115773 wait complete. 2024-09-11T22:21:12.028 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:21:12.028 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-11T22:21:12.028 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:21:12.028 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:21:12.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.129+0000 7f0dfb6ae640 1 Processor -- start 2024-09-11T22:21:12.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.129+0000 7f0dfb6ae640 1 -- start start 2024-09-11T22:21:12.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.130+0000 7f0dfb6ae640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0df40ce430 0x7f0df40ca700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.130+0000 7f0dfb6ae640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0df40ce810 0x7f0df406e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.130+0000 7f0dfb6ae640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0df41526b0 0x7f0df4152b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.130+0000 7f0dfb6ae640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f0df415bd60 con 0x7f0df41526b0 2024-09-11T22:21:12.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.130+0000 7f0dfb6ae640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f0df406eeb0 con 0x7f0df40ce810 2024-09-11T22:21:12.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.130+0000 7f0dfb6ae640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0df40c8dd0 con 0x7f0df40ce430 2024-09-11T22:21:12.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.130+0000 7f0df9c4b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0df41526b0 0x7f0df4152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.130+0000 7f0df9c4b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0df41526b0 0x7f0df4152b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38134/0 (socket says 172.21.15.100:38134) 2024-09-11T22:21:12.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.130+0000 7f0df9c4b640 1 -- 172.21.15.100:0/3730241506 learned_addr learned my addr 172.21.15.100:0/3730241506 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:12.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.130+0000 7f0df944a640 1 --2- 172.21.15.100:0/3730241506 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0df40ce430 0x7f0df40ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.130+0000 7f0df8c49640 1 --2- 172.21.15.100:0/3730241506 >> v2:172.21.15.167:3300/0 conn(0x7f0df40ce810 0x7f0df406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.130+0000 7f0df9c4b640 1 -- 172.21.15.100:0/3730241506 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0df40ce430 msgr2=0x7f0df40ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:12.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.130+0000 7f0df9c4b640 1 --2- 172.21.15.100:0/3730241506 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0df40ce430 0x7f0df40ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.130+0000 7f0df9c4b640 1 -- 172.21.15.100:0/3730241506 >> v2:172.21.15.167:3300/0 conn(0x7f0df40ce810 msgr2=0x7f0df406e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:12.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.130+0000 7f0df9c4b640 1 --2- 172.21.15.100:0/3730241506 >> v2:172.21.15.167:3300/0 conn(0x7f0df40ce810 0x7f0df406e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.130+0000 7f0df9c4b640 1 -- 172.21.15.100:0/3730241506 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df41587f0 con 0x7f0df41526b0 2024-09-11T22:21:12.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.130+0000 7f0df8c49640 1 --2- 172.21.15.100:0/3730241506 >> v2:172.21.15.167:3300/0 conn(0x7f0df40ce810 0x7f0df406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:12.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.131+0000 7f0df9c4b640 1 --2- 172.21.15.100:0/3730241506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df41526b0 0x7f0df4152b60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0df40cf0f0 tx=0x7f0de402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555fbcefab5ccb8c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:12.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.131+0000 7f0df3fff640 1 -- 172.21.15.100:0/3730241506 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4036070 con 0x7f0df41526b0 2024-09-11T22:21:12.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.131+0000 7f0df3fff640 1 -- 172.21.15.100:0/3730241506 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de4031600 con 0x7f0df41526b0 2024-09-11T22:21:12.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.131+0000 7f0df3fff640 1 -- 172.21.15.100:0/3730241506 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de40319d0 con 0x7f0df41526b0 2024-09-11T22:21:12.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.131+0000 7f0dfb6ae640 1 -- 172.21.15.100:0/3730241506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df41526b0 msgr2=0x7f0df4152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.131+0000 7f0dfb6ae640 1 --2- 172.21.15.100:0/3730241506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df41526b0 0x7f0df4152b60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0df40cf0f0 tx=0x7f0de402a6a0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.131+0000 7f0dfb6ae640 1 -- 172.21.15.100:0/3730241506 shutdown_connections 2024-09-11T22:21:12.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.131+0000 7f0dfb6ae640 1 --2- 172.21.15.100:0/3730241506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df41526b0 0x7f0df4152b60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.131+0000 7f0dfb6ae640 1 --2- 172.21.15.100:0/3730241506 >> v2:172.21.15.167:3300/0 conn(0x7f0df40ce810 0x7f0df406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.131+0000 7f0dfb6ae640 1 --2- 172.21.15.100:0/3730241506 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0df40ce430 0x7f0df40ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.131+0000 7f0dfb6ae640 1 -- 172.21.15.100:0/3730241506 >> 172.21.15.100:0/3730241506 conn(0x7f0df40714a0 msgr2=0x7f0df4071880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:12.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.132+0000 7f0dfb6ae640 1 -- 172.21.15.100:0/3730241506 shutdown_connections 2024-09-11T22:21:12.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.132+0000 7f0dfb6ae640 1 -- 172.21.15.100:0/3730241506 wait complete. 2024-09-11T22:21:12.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.133+0000 7f0dfb6ae640 1 Processor -- start 2024-09-11T22:21:12.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.133+0000 7f0dfb6ae640 1 -- start start 2024-09-11T22:21:12.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.133+0000 7f0dfb6ae640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df40ce430 0x7f0df414c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.133+0000 7f0dfb6ae640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0df40ce810 0x7f0df41f3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.133+0000 7f0dfb6ae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df41526b0 0x7f0df415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.133+0000 7f0dfb6ae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0df4158ff0 con 0x7f0df41526b0 2024-09-11T22:21:12.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.133+0000 7f0dfb6ae640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0df4158a90 con 0x7f0df40ce430 2024-09-11T22:21:12.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.133+0000 7f0dfb6ae640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0df41592d0 con 0x7f0df40ce810 2024-09-11T22:21:12.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.133+0000 7f0df9c4b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df41526b0 0x7f0df415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.133+0000 7f0df9c4b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df41526b0 0x7f0df415a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38140/0 (socket says 172.21.15.100:38140) 2024-09-11T22:21:12.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.133+0000 7f0df9c4b640 1 -- 172.21.15.100:0/86588901 learned_addr learned my addr 172.21.15.100:0/86588901 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:12.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.133+0000 7f0df944a640 1 --2- 172.21.15.100:0/86588901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df40ce430 0x7f0df414c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.134+0000 7f0df8c49640 1 --2- 172.21.15.100:0/86588901 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0df40ce810 0x7f0df41f3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.134+0000 7f0df9c4b640 1 -- 172.21.15.100:0/86588901 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0df40ce810 msgr2=0x7f0df41f3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.134+0000 7f0df9c4b640 1 --2- 172.21.15.100:0/86588901 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0df40ce810 0x7f0df41f3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.134+0000 7f0df9c4b640 1 -- 172.21.15.100:0/86588901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df40ce430 msgr2=0x7f0df414c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.134+0000 7f0df9c4b640 1 --2- 172.21.15.100:0/86588901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df40ce430 0x7f0df414c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.134+0000 7f0df9c4b640 1 -- 172.21.15.100:0/86588901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df414e680 con 0x7f0df41526b0 2024-09-11T22:21:12.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.134+0000 7f0df9c4b640 1 --2- 172.21.15.100:0/86588901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df41526b0 0x7f0df415a9c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0de4009f40 tx=0x7f0de4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:12.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.134+0000 7f0df1ffb640 1 -- 172.21.15.100:0/86588901 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4041020 con 0x7f0df41526b0 2024-09-11T22:21:12.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.134+0000 7f0df1ffb640 1 -- 172.21.15.100:0/86588901 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de40077a0 con 0x7f0df41526b0 2024-09-11T22:21:12.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.134+0000 7f0df1ffb640 1 -- 172.21.15.100:0/86588901 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4036040 con 0x7f0df41526b0 2024-09-11T22:21:12.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.134+0000 7f0dfb6ae640 1 -- 172.21.15.100:0/86588901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df415b790 con 0x7f0df41526b0 2024-09-11T22:21:12.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.134+0000 7f0dfb6ae640 1 -- 172.21.15.100:0/86588901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df414e3a0 con 0x7f0df41526b0 2024-09-11T22:21:12.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.135+0000 7f0dfb6ae640 1 --2- 172.21.15.100:0/86588901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df414e850 0x7f0df415af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.135+0000 7f0dfb6ae640 1 -- 172.21.15.100:0/86588901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0df40692a0 con 0x7f0df414e850 2024-09-11T22:21:12.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.135+0000 7f0df944a640 1 --2- 172.21.15.100:0/86588901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df414e850 0x7f0df415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.136+0000 7f0df944a640 1 -- 172.21.15.100:0/86588901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0df41595b0 con 0x7f0df414e850 2024-09-11T22:21:12.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.136+0000 7f0df944a640 1 --2- 172.21.15.100:0/86588901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df414e850 0x7f0df415af00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0dec011900 tx=0x7f0dec011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:12.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.136+0000 7f0df1ffb640 1 -- 172.21.15.100:0/86588901 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0de4044020 con 0x7f0df41526b0 2024-09-11T22:21:12.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.136+0000 7f0df1ffb640 1 --2- 172.21.15.100:0/86588901 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0de006be30 0x7f0de006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.136+0000 7f0df8c49640 1 --2- 172.21.15.100:0/86588901 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0de006be30 0x7f0de006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.136+0000 7f0df1ffb640 1 -- 172.21.15.100:0/86588901 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f0de40abe40 con 0x7f0df41526b0 2024-09-11T22:21:12.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.136+0000 7f0df1ffb640 1 -- 172.21.15.100:0/86588901 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec019070 con 0x7f0df414e850 2024-09-11T22:21:12.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.136+0000 7f0df1ffb640 1 -- 172.21.15.100:0/86588901 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0dec004300 con 0x7f0df414e850 2024-09-11T22:21:12.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.136+0000 7f0df1ffb640 1 -- 172.21.15.100:0/86588901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df414e850 msgr2=0x7f0df415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.136+0000 7f0df1ffb640 1 --2- 172.21.15.100:0/86588901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df414e850 0x7f0df415af00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0dec011900 tx=0x7f0dec011dc0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.136+0000 7f0df1ffb640 1 -- 172.21.15.100:0/86588901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df414e850 msgr2=0x7f0df415af00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:21:12.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.136+0000 7f0df1ffb640 1 --2- 172.21.15.100:0/86588901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df414e850 0x7f0df415af00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.137+0000 7f0df8c49640 1 --2- 172.21.15.100:0/86588901 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0de006be30 0x7f0de006e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0df41f12d0 tx=0x7f0de8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:12.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.143+0000 7f0dfb6ae640 1 --2- 172.21.15.100:0/86588901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df41f3c90 0x7f0df406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.143+0000 7f0dfb6ae640 1 -- 172.21.15.100:0/86588901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0df40c4230 con 0x7f0df41f3c90 2024-09-11T22:21:12.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.143+0000 7f0df944a640 1 --2- 172.21.15.100:0/86588901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df41f3c90 0x7f0df406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.143+0000 7f0df944a640 1 -- 172.21.15.100:0/86588901 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0df40c3f50 con 0x7f0df41f3c90 2024-09-11T22:21:12.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.143+0000 7f0df944a640 1 --2- 172.21.15.100:0/86588901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df41f3c90 0x7f0df406bc10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00f6b0 tx=0x7f0dec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:12.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.143+0000 7f0df1ffb640 1 -- 172.21.15.100:0/86588901 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec019040 con 0x7f0df41f3c90 2024-09-11T22:21:12.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.143+0000 7f0df1ffb640 1 -- 172.21.15.100:0/86588901 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7f0dec01e450 con 0x7f0df41f3c90 2024-09-11T22:21:12.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.143+0000 7f0df1ffb640 1 -- 172.21.15.100:0/86588901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df41f3c90 msgr2=0x7f0df406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.143+0000 7f0df1ffb640 1 --2- 172.21.15.100:0/86588901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df41f3c90 0x7f0df406bc10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00f6b0 tx=0x7f0dec0046c0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.143+0000 7f0df1ffb640 1 -- 172.21.15.100:0/86588901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df41f3c90 msgr2=0x7f0df406bc10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:21:12.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.143+0000 7f0df1ffb640 1 --2- 172.21.15.100:0/86588901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df41f3c90 0x7f0df406bc10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.145 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:21:12.145 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:21:12.145 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:21:12.145 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:21:12.145 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 4, 2024-09-11T22:21:12.145 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 76162, 2024-09-11T22:21:12.145 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:21:12.145 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:21:12.145 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:21:12.146 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:21:12.146 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:12.146 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 75, 2024-09-11T22:21:12.146 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:21:12.146 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:21:12.146 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:21:12.146 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:12.146 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:12.146 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:12.146 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:12.146 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:12.146 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:12.146 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:12.147 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:12.147 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:12.147 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:12.147 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:12.147 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:12.147 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:21:12.147 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:21:12.147 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:12.147 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:12.147 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:12.147 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:12.147 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:12.147 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:12.148 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:12.148 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:12.148 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:12.148 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:12.148 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:12.148 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:12.148 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.148 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:21:12.148 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:21:12.148 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:21:12.148 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:21:12.148 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:21:12.148 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:21:12.149 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:21:12.149 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:21:12.149 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:21:12.149 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:21:12.149 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:21:12.149 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:21:12.149 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:21:12.149 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:21:12.149 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:21:12.149 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:21:12.149 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:21:12.149 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:12.150 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:12.150 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:12.150 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:12.150 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:12.150 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:12.150 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:12.150 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:12.150 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:12.150 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:12.150 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:12.150 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:12.150 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:21:12.150 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.151 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:21:12.151 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.151 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:21:12.151 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:21:12.151 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:12.151 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:12.151 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.151 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:12.151 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:21:12.151 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:12.151 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.151 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.151 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:12.151 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:21:12.151 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:12.152 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.152 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:12.152 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.152 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:21:12.152 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:21:12.152 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:12.152 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:12.152 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:12.152 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.152 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.152 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:21:12.152 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:21:12.152 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:12.153 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:12.153 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.153 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:12.153 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:21:12.153 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:12.153 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.153 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.153 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:12.153 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:21:12.153 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:12.153 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.153 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:12.153 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.154 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:21:12.154 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:21:12.154 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:12.154 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:12.154 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:12.154 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.154 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.154 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:21:12.154 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:21:12.154 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:12.154 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:12.154 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.154 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:12.155 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:21:12.155 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:12.155 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.155 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.155 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:12.155 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:21:12.155 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:12.155 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.155 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:12.155 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.155 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:21:12.155 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:21:12.155 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:12.155 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:12.156 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:12.156 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.156 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:12.156 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.156 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:21:12.156 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:21:12.156 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.156 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:12.156 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:12.156 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:21:12.156 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.156 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:12.156 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:21:12.156 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.157 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:12.157 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:12.157 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:21:12.157 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.157 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:12.157 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:21:12.157 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.157 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:12.157 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:12.157 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:21:12.157 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.157 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:12.157 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:21:12.158 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.158 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:12.158 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:12.158 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:21:12.158 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.158 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:12.158 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:21:12.158 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.158 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:12.158 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:12.158 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:21:12.158 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.158 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:12.158 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.159 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:21:12.159 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:21:12.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.144+0000 7f0dfb6ae640 1 -- 172.21.15.100:0/86588901 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0de006be30 msgr2=0x7f0de006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.144+0000 7f0dfb6ae640 1 --2- 172.21.15.100:0/86588901 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0de006be30 0x7f0de006e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0df41f12d0 tx=0x7f0de8008040 comp rx=0 tx=0).stop 2024-09-11T22:21:12.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.144+0000 7f0dfb6ae640 1 -- 172.21.15.100:0/86588901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df41526b0 msgr2=0x7f0df415a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.144+0000 7f0dfb6ae640 1 --2- 172.21.15.100:0/86588901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df41526b0 0x7f0df415a9c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0de4009f40 tx=0x7f0de4004a40 comp rx=0 tx=0).stop 2024-09-11T22:21:12.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.144+0000 7f0df9c4b640 1 -- 172.21.15.100:0/86588901 reap_dead start 2024-09-11T22:21:12.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.144+0000 7f0df9c4b640 1 -- 172.21.15.100:0/86588901 reap_dead start 2024-09-11T22:21:12.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.144+0000 7f0dfb6ae640 1 -- 172.21.15.100:0/86588901 shutdown_connections 2024-09-11T22:21:12.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.144+0000 7f0dfb6ae640 1 -- 172.21.15.100:0/86588901 >> 172.21.15.100:0/86588901 conn(0x7f0df40714a0 msgr2=0x7f0df40c9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:12.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.144+0000 7f0dfb6ae640 1 -- 172.21.15.100:0/86588901 shutdown_connections 2024-09-11T22:21:12.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.144+0000 7f0dfb6ae640 1 -- 172.21.15.100:0/86588901 wait complete. 2024-09-11T22:21:12.161 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:21:12.161 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:21:12.161 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:21:12.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.260+0000 7f5f52fd8640 1 Processor -- start 2024-09-11T22:21:12.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.260+0000 7f5f52fd8640 1 -- start start 2024-09-11T22:21:12.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.260+0000 7f5f52fd8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f4c06ce60 0x7f5f4c15bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.260+0000 7f5f52fd8640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5f4c15c290 0x7f5f4c1546b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.260+0000 7f5f52fd8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5f4c06d240 0x7f5f4c154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.260+0000 7f5f52fd8640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f5f4c15b820 con 0x7f5f4c15c290 2024-09-11T22:21:12.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.260+0000 7f5f52fd8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f5f4c0c6510 con 0x7f5f4c06d240 2024-09-11T22:21:12.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.260+0000 7f5f52fd8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5f4c0c5470 con 0x7f5f4c06ce60 2024-09-11T22:21:12.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.261+0000 7f5f4bfff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5f4c15c290 0x7f5f4c1546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.261+0000 7f5f4bfff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5f4c15c290 0x7f5f4c1546b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44098/0 (socket says 172.21.15.100:44098) 2024-09-11T22:21:12.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.261+0000 7f5f4bfff640 1 -- 172.21.15.100:0/856223463 learned_addr learned my addr 172.21.15.100:0/856223463 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:12.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.261+0000 7f5f51575640 1 --2- 172.21.15.100:0/856223463 >> v2:172.21.15.167:3300/0 conn(0x7f5f4c06d240 0x7f5f4c154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.261+0000 7f5f50d74640 1 --2- 172.21.15.100:0/856223463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f4c06ce60 0x7f5f4c15bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.261+0000 7f5f4bfff640 1 -- 172.21.15.100:0/856223463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f4c06ce60 msgr2=0x7f5f4c15bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:12.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.261+0000 7f5f4bfff640 1 --2- 172.21.15.100:0/856223463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f4c06ce60 0x7f5f4c15bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.261+0000 7f5f4bfff640 1 -- 172.21.15.100:0/856223463 >> v2:172.21.15.167:3300/0 conn(0x7f5f4c06d240 msgr2=0x7f5f4c154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:12.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.261+0000 7f5f4bfff640 1 --2- 172.21.15.100:0/856223463 >> v2:172.21.15.167:3300/0 conn(0x7f5f4c06d240 0x7f5f4c154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.261+0000 7f5f4bfff640 1 -- 172.21.15.100:0/856223463 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4c0c5750 con 0x7f5f4c15c290 2024-09-11T22:21:12.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.262+0000 7f5f4bfff640 1 --2- 172.21.15.100:0/856223463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4c15c290 0x7f5f4c1546b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c0b5a80 tx=0x7f5f3802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5e9cfdc7b0b17 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:12.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.262+0000 7f5f4b7fe640 1 -- 172.21.15.100:0/856223463 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f38037070 con 0x7f5f4c15c290 2024-09-11T22:21:12.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.262+0000 7f5f4b7fe640 1 -- 172.21.15.100:0/856223463 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f38032440 con 0x7f5f4c15c290 2024-09-11T22:21:12.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.262+0000 7f5f4b7fe640 1 -- 172.21.15.100:0/856223463 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f38032810 con 0x7f5f4c15c290 2024-09-11T22:21:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.262+0000 7f5f52fd8640 1 -- 172.21.15.100:0/856223463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4c15c290 msgr2=0x7f5f4c1546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.262+0000 7f5f52fd8640 1 --2- 172.21.15.100:0/856223463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4c15c290 0x7f5f4c1546b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c0b5a80 tx=0x7f5f3802a1e0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.262+0000 7f5f52fd8640 1 -- 172.21.15.100:0/856223463 shutdown_connections 2024-09-11T22:21:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.262+0000 7f5f52fd8640 1 --2- 172.21.15.100:0/856223463 >> v2:172.21.15.167:3300/0 conn(0x7f5f4c06d240 0x7f5f4c154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.262+0000 7f5f52fd8640 1 --2- 172.21.15.100:0/856223463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4c15c290 0x7f5f4c1546b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.262+0000 7f5f52fd8640 1 --2- 172.21.15.100:0/856223463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f4c06ce60 0x7f5f4c15bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.262+0000 7f5f52fd8640 1 -- 172.21.15.100:0/856223463 >> 172.21.15.100:0/856223463 conn(0x7f5f4c06bc10 msgr2=0x7f5f4c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.262+0000 7f5f52fd8640 1 -- 172.21.15.100:0/856223463 shutdown_connections 2024-09-11T22:21:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.262+0000 7f5f52fd8640 1 -- 172.21.15.100:0/856223463 wait complete. 2024-09-11T22:21:12.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.263+0000 7f5f52fd8640 1 Processor -- start 2024-09-11T22:21:12.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.264+0000 7f5f52fd8640 1 -- start start 2024-09-11T22:21:12.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.264+0000 7f5f52fd8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4c06ce60 0x7f5f4c0c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.264+0000 7f5f52fd8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f4c06d240 0x7f5f4c0c7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.264+0000 7f5f52fd8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f4c15c290 0x7f5f4c14d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.264+0000 7f5f52fd8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4c0cb1b0 con 0x7f5f4c06ce60 2024-09-11T22:21:12.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.264+0000 7f5f52fd8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4c0c5d10 con 0x7f5f4c15c290 2024-09-11T22:21:12.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.264+0000 7f5f52fd8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5f4c0cad20 con 0x7f5f4c06d240 2024-09-11T22:21:12.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.264+0000 7f5f50d74640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4c06ce60 0x7f5f4c0c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.264+0000 7f5f50d74640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4c06ce60 0x7f5f4c0c9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44112/0 (socket says 172.21.15.100:44112) 2024-09-11T22:21:12.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.264+0000 7f5f50d74640 1 -- 172.21.15.100:0/841145672 learned_addr learned my addr 172.21.15.100:0/841145672 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:12.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.265+0000 7f5f4bfff640 1 --2- 172.21.15.100:0/841145672 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f4c06d240 0x7f5f4c0c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.265+0000 7f5f51575640 1 --2- 172.21.15.100:0/841145672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f4c15c290 0x7f5f4c14d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.265+0000 7f5f50d74640 1 -- 172.21.15.100:0/841145672 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f4c06d240 msgr2=0x7f5f4c0c7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.265+0000 7f5f50d74640 1 --2- 172.21.15.100:0/841145672 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f4c06d240 0x7f5f4c0c7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.265+0000 7f5f50d74640 1 -- 172.21.15.100:0/841145672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f4c15c290 msgr2=0x7f5f4c14d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.265+0000 7f5f50d74640 1 --2- 172.21.15.100:0/841145672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f4c15c290 0x7f5f4c14d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.265+0000 7f5f50d74640 1 -- 172.21.15.100:0/841145672 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4c14de50 con 0x7f5f4c06ce60 2024-09-11T22:21:12.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.265+0000 7f5f4bfff640 1 --2- 172.21.15.100:0/841145672 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f4c06d240 0x7f5f4c0c7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:12.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.265+0000 7f5f50d74640 1 --2- 172.21.15.100:0/841145672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4c06ce60 0x7f5f4c0c9080 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5f4000c820 tx=0x7f5f4000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:12.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.265+0000 7f5f497fa640 1 -- 172.21.15.100:0/841145672 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f40015070 con 0x7f5f4c06ce60 2024-09-11T22:21:12.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.265+0000 7f5f497fa640 1 -- 172.21.15.100:0/841145672 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f40004220 con 0x7f5f4c06ce60 2024-09-11T22:21:12.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.265+0000 7f5f52fd8640 1 -- 172.21.15.100:0/841145672 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f4c1f0800 con 0x7f5f4c06ce60 2024-09-11T22:21:12.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.265+0000 7f5f497fa640 1 -- 172.21.15.100:0/841145672 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4000ce10 con 0x7f5f4c06ce60 2024-09-11T22:21:12.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.265+0000 7f5f52fd8640 1 -- 172.21.15.100:0/841145672 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f4c1f0dc0 con 0x7f5f4c06ce60 2024-09-11T22:21:12.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.266+0000 7f5f52fd8640 1 --2- 172.21.15.100:0/841145672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f4c1f1000 0x7f5f4c14d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.266+0000 7f5f52fd8640 1 -- 172.21.15.100:0/841145672 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4c1f15c0 con 0x7f5f4c1f1000 2024-09-11T22:21:12.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.266+0000 7f5f4bfff640 1 --2- 172.21.15.100:0/841145672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f4c1f1000 0x7f5f4c14d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.266+0000 7f5f4bfff640 1 -- 172.21.15.100:0/841145672 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f4c15a890 con 0x7f5f4c1f1000 2024-09-11T22:21:12.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.266+0000 7f5f497fa640 1 -- 172.21.15.100:0/841145672 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5f40007830 con 0x7f5f4c06ce60 2024-09-11T22:21:12.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.267+0000 7f5f4bfff640 1 --2- 172.21.15.100:0/841145672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f4c1f1000 0x7f5f4c14d630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c06db90 tx=0x7f5f380046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:12.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.267+0000 7f5f497fa640 1 --2- 172.21.15.100:0/841145672 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5f3006be30 0x7f5f3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.267+0000 7f5f51575640 1 --2- 172.21.15.100:0/841145672 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5f3006be30 0x7f5f3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.267+0000 7f5f497fa640 1 -- 172.21.15.100:0/841145672 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f5f4008b170 con 0x7f5f4c06ce60 2024-09-11T22:21:12.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.267+0000 7f5f497fa640 1 -- 172.21.15.100:0/841145672 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f38037040 con 0x7f5f4c1f1000 2024-09-11T22:21:12.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.267+0000 7f5f497fa640 1 -- 172.21.15.100:0/841145672 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5f3803c640 con 0x7f5f4c1f1000 2024-09-11T22:21:12.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.267+0000 7f5f497fa640 1 -- 172.21.15.100:0/841145672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f4c1f1000 msgr2=0x7f5f4c14d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.267+0000 7f5f497fa640 1 --2- 172.21.15.100:0/841145672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f4c1f1000 0x7f5f4c14d630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c06db90 tx=0x7f5f380046c0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.267+0000 7f5f497fa640 1 -- 172.21.15.100:0/841145672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f4c1f1000 msgr2=0x7f5f4c14d630 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:21:12.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.267+0000 7f5f497fa640 1 --2- 172.21.15.100:0/841145672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f4c1f1000 0x7f5f4c14d630 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.267+0000 7f5f51575640 1 --2- 172.21.15.100:0/841145672 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5f3006be30 0x7f5f3006e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c0ce210 tx=0x7f5f440074b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:12.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.273+0000 7f5f52fd8640 1 --2- 172.21.15.100:0/841145672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f4c151250 0x7f5f4c1f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.273+0000 7f5f52fd8640 1 -- 172.21.15.100:0/841145672 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4c14db70 con 0x7f5f4c151250 2024-09-11T22:21:12.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.274+0000 7f5f4bfff640 1 --2- 172.21.15.100:0/841145672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f4c151250 0x7f5f4c1f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.274+0000 7f5f4bfff640 1 -- 172.21.15.100:0/841145672 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5f4c15b2e0 con 0x7f5f4c151250 2024-09-11T22:21:12.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.274+0000 7f5f4bfff640 1 --2- 172.21.15.100:0/841145672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f4c151250 0x7f5f4c1f3b80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5f3802a220 tx=0x7f5f38008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:12.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.275+0000 7f5f497fa640 1 -- 172.21.15.100:0/841145672 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f38037040 con 0x7f5f4c151250 2024-09-11T22:21:12.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.275+0000 7f5f497fa640 1 -- 172.21.15.100:0/841145672 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4886 (secure 0 0 0) 0x7f5f38003de0 con 0x7f5f4c151250 2024-09-11T22:21:12.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.275+0000 7f5f497fa640 1 -- 172.21.15.100:0/841145672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f4c151250 msgr2=0x7f5f4c1f3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.275+0000 7f5f497fa640 1 --2- 172.21.15.100:0/841145672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f4c151250 0x7f5f4c1f3b80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5f3802a220 tx=0x7f5f38008030 comp rx=0 tx=0).stop 2024-09-11T22:21:12.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.275+0000 7f5f497fa640 1 -- 172.21.15.100:0/841145672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f4c151250 msgr2=0x7f5f4c1f3b80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:21:12.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.275+0000 7f5f497fa640 1 --2- 172.21.15.100:0/841145672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f4c151250 0x7f5f4c1f3b80 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5f3802a220 tx=0x7f5f38008030 comp rx=0 tx=0).stop 2024-09-11T22:21:12.276 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:21:12.276 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:21:12.276 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:21:12.277 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:21:12.277 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 4, 2024-09-11T22:21:12.277 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 76253, 2024-09-11T22:21:12.277 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:21:12.277 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:21:12.277 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:21:12.277 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:21:12.277 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:12.277 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 76, 2024-09-11T22:21:12.277 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:21:12.277 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:21:12.277 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:21:12.277 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:12.277 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:12.278 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:12.278 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:12.278 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:12.278 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:12.278 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:12.278 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:12.278 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:12.278 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:12.278 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:12.278 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:12.278 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:21:12.278 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:21:12.278 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:12.278 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:12.279 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:12.279 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:12.279 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:12.279 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:12.279 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:12.279 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:12.279 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:12.279 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:12.279 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:12.279 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:12.279 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.279 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:21:12.279 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:21:12.280 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:21:12.280 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:21:12.280 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:21:12.280 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:21:12.280 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:21:12.280 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:21:12.280 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:21:12.280 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:21:12.280 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:21:12.280 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:21:12.280 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:21:12.280 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:21:12.280 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:21:12.280 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:21:12.281 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:21:12.281 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:12.281 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:12.281 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:12.281 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:12.281 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:12.281 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:12.281 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:12.281 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:12.281 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:12.281 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:12.281 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:12.281 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:12.282 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:21:12.282 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.282 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:21:12.282 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.282 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:21:12.282 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:21:12.282 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:12.282 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:12.282 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.282 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:12.282 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:21:12.282 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:12.282 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.283 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.283 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:12.283 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:21:12.283 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:12.283 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.283 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:12.283 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.283 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:21:12.283 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:21:12.283 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:12.283 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:12.283 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:12.283 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.283 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.284 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:21:12.284 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:21:12.284 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:12.284 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:12.284 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.284 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:12.284 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:21:12.284 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:12.284 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.284 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.284 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:12.284 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:21:12.284 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:12.285 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.285 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:12.285 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.285 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:21:12.285 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:21:12.285 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:12.285 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:12.285 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:12.285 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.285 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.285 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:21:12.285 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:21:12.285 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:12.285 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:12.286 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.286 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:12.286 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:21:12.286 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:12.286 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.286 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.286 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:12.286 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:21:12.286 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:12.286 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.286 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:12.286 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.286 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:21:12.286 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:21:12.287 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:12.287 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:12.287 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:12.287 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.287 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:12.287 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.287 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:21:12.287 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:21:12.287 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.287 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:12.287 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:12.287 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:21:12.287 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.288 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:12.288 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:21:12.288 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.288 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:12.288 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:12.288 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:21:12.288 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.288 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:12.288 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:21:12.288 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.288 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:12.288 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:12.288 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:21:12.289 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.289 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:12.289 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:21:12.289 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.289 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:12.289 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:12.289 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:21:12.289 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.289 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:12.289 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.289 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:21:12.289 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:21:12.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.275+0000 7f5f52fd8640 1 -- 172.21.15.100:0/841145672 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5f3006be30 msgr2=0x7f5f3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.275+0000 7f5f52fd8640 1 --2- 172.21.15.100:0/841145672 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5f3006be30 0x7f5f3006e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c0ce210 tx=0x7f5f440074b0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.275+0000 7f5f52fd8640 1 -- 172.21.15.100:0/841145672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4c06ce60 msgr2=0x7f5f4c0c9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.275+0000 7f5f52fd8640 1 --2- 172.21.15.100:0/841145672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4c06ce60 0x7f5f4c0c9080 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5f4000c820 tx=0x7f5f4000cce0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.275+0000 7f5f51575640 1 -- 172.21.15.100:0/841145672 reap_dead start 2024-09-11T22:21:12.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.275+0000 7f5f51575640 1 -- 172.21.15.100:0/841145672 reap_dead start 2024-09-11T22:21:12.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.275+0000 7f5f52fd8640 1 -- 172.21.15.100:0/841145672 shutdown_connections 2024-09-11T22:21:12.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.275+0000 7f5f52fd8640 1 -- 172.21.15.100:0/841145672 >> 172.21.15.100:0/841145672 conn(0x7f5f4c06bc10 msgr2=0x7f5f4c0cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:12.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.275+0000 7f5f52fd8640 1 -- 172.21.15.100:0/841145672 shutdown_connections 2024-09-11T22:21:12.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.275+0000 7f5f52fd8640 1 -- 172.21.15.100:0/841145672 wait complete. 2024-09-11T22:21:12.292 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:21:12.292 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:21:12.292 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:21:12.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.391+0000 7f1c2c78d640 1 Processor -- start 2024-09-11T22:21:12.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.391+0000 7f1c2c78d640 1 -- start start 2024-09-11T22:21:12.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.392+0000 7f1c2c78d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c240ce430 0x7f1c240ca700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.392+0000 7f1c2c78d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1c240ce810 0x7f1c2406e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.392+0000 7f1c2c78d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1c241526b0 0x7f1c24152b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.392+0000 7f1c2c78d640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f1c2415bd60 con 0x7f1c240ce810 2024-09-11T22:21:12.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.392+0000 7f1c2c78d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f1c2406eeb0 con 0x7f1c241526b0 2024-09-11T22:21:12.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.392+0000 7f1c2c78d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1c240c8dd0 con 0x7f1c240ce430 2024-09-11T22:21:12.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.392+0000 7f1c29d28640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1c240ce810 0x7f1c2406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.392+0000 7f1c29d28640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1c240ce810 0x7f1c2406e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44124/0 (socket says 172.21.15.100:44124) 2024-09-11T22:21:12.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.392+0000 7f1c29d28640 1 -- 172.21.15.100:0/2897938921 learned_addr learned my addr 172.21.15.100:0/2897938921 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:12.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.393+0000 7f1c2a529640 1 --2- 172.21.15.100:0/2897938921 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c240ce430 0x7f1c240ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.393+0000 7f1c29d28640 1 -- 172.21.15.100:0/2897938921 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c240ce430 msgr2=0x7f1c240ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:12.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.393+0000 7f1c29d28640 1 --2- 172.21.15.100:0/2897938921 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c240ce430 0x7f1c240ca700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.393+0000 7f1c29d28640 1 -- 172.21.15.100:0/2897938921 >> v2:172.21.15.167:3300/0 conn(0x7f1c241526b0 msgr2=0x7f1c24152b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:12.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.393+0000 7f1c29d28640 1 --2- 172.21.15.100:0/2897938921 >> v2:172.21.15.167:3300/0 conn(0x7f1c241526b0 0x7f1c24152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.393+0000 7f1c29d28640 1 -- 172.21.15.100:0/2897938921 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c241587f0 con 0x7f1c240ce810 2024-09-11T22:21:12.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.393+0000 7f1c29d28640 1 --2- 172.21.15.100:0/2897938921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c240ce810 0x7f1c2406e970 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1c240cc130 tx=0x7f1c1402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b3a43f06fa73a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:12.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.393+0000 7f1c29527640 1 -- 172.21.15.100:0/2897938921 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c14037070 con 0x7f1c240ce810 2024-09-11T22:21:12.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.393+0000 7f1c29527640 1 -- 172.21.15.100:0/2897938921 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c14032440 con 0x7f1c240ce810 2024-09-11T22:21:12.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.393+0000 7f1c29527640 1 -- 172.21.15.100:0/2897938921 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c14032810 con 0x7f1c240ce810 2024-09-11T22:21:12.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.394+0000 7f1c2c78d640 1 -- 172.21.15.100:0/2897938921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c240ce810 msgr2=0x7f1c2406e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.394+0000 7f1c2c78d640 1 --2- 172.21.15.100:0/2897938921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c240ce810 0x7f1c2406e970 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1c240cc130 tx=0x7f1c1402a1e0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.394+0000 7f1c2c78d640 1 -- 172.21.15.100:0/2897938921 shutdown_connections 2024-09-11T22:21:12.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.394+0000 7f1c2c78d640 1 --2- 172.21.15.100:0/2897938921 >> v2:172.21.15.167:3300/0 conn(0x7f1c241526b0 0x7f1c24152b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.394+0000 7f1c2c78d640 1 --2- 172.21.15.100:0/2897938921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c240ce810 0x7f1c2406e970 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.394+0000 7f1c2c78d640 1 --2- 172.21.15.100:0/2897938921 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c240ce430 0x7f1c240ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.394+0000 7f1c2c78d640 1 -- 172.21.15.100:0/2897938921 >> 172.21.15.100:0/2897938921 conn(0x7f1c240714a0 msgr2=0x7f1c24071880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:12.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.394+0000 7f1c2c78d640 1 -- 172.21.15.100:0/2897938921 shutdown_connections 2024-09-11T22:21:12.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.394+0000 7f1c2c78d640 1 -- 172.21.15.100:0/2897938921 wait complete. 2024-09-11T22:21:12.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.395+0000 7f1c2c78d640 1 Processor -- start 2024-09-11T22:21:12.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.395+0000 7f1c2c78d640 1 -- start start 2024-09-11T22:21:12.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.396+0000 7f1c2c78d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c240ce430 0x7f1c240c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.396+0000 7f1c2c78d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c240ce810 0x7f1c240c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.396+0000 7f1c2c78d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c241526b0 0x7f1c24153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.396+0000 7f1c2c78d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1c24158ff0 con 0x7f1c240ce810 2024-09-11T22:21:12.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.396+0000 7f1c2c78d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1c24158a90 con 0x7f1c240ce430 2024-09-11T22:21:12.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.396+0000 7f1c2c78d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1c241592d0 con 0x7f1c241526b0 2024-09-11T22:21:12.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.396+0000 7f1c29d28640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c240ce810 0x7f1c240c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.396+0000 7f1c29d28640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c240ce810 0x7f1c240c6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44130/0 (socket says 172.21.15.100:44130) 2024-09-11T22:21:12.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.396+0000 7f1c29d28640 1 -- 172.21.15.100:0/3944747021 learned_addr learned my addr 172.21.15.100:0/3944747021 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:12.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.396+0000 7f1c2ad2a640 1 --2- 172.21.15.100:0/3944747021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c241526b0 0x7f1c24153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.396+0000 7f1c2a529640 1 --2- 172.21.15.100:0/3944747021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c240ce430 0x7f1c240c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.396+0000 7f1c29d28640 1 -- 172.21.15.100:0/3944747021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c241526b0 msgr2=0x7f1c24153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.396+0000 7f1c29d28640 1 --2- 172.21.15.100:0/3944747021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c241526b0 0x7f1c24153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.396+0000 7f1c29d28640 1 -- 172.21.15.100:0/3944747021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c240ce430 msgr2=0x7f1c240c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.396+0000 7f1c29d28640 1 --2- 172.21.15.100:0/3944747021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c240ce430 0x7f1c240c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.396+0000 7f1c29d28640 1 -- 172.21.15.100:0/3944747021 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c240c7190 con 0x7f1c240ce810 2024-09-11T22:21:12.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.396+0000 7f1c2a529640 1 --2- 172.21.15.100:0/3944747021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c240ce430 0x7f1c240c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:12.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.397+0000 7f1c29d28640 1 --2- 172.21.15.100:0/3944747021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c240ce810 0x7f1c240c6b00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1c1402a220 tx=0x7f1c140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:12.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.397+0000 7f1c1affd640 1 -- 172.21.15.100:0/3944747021 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c14041070 con 0x7f1c240ce810 2024-09-11T22:21:12.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.397+0000 7f1c1affd640 1 -- 172.21.15.100:0/3944747021 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1403c870 con 0x7f1c240ce810 2024-09-11T22:21:12.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.397+0000 7f1c2c78d640 1 -- 172.21.15.100:0/3944747021 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c240c7430 con 0x7f1c240ce810 2024-09-11T22:21:12.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.397+0000 7f1c1affd640 1 -- 172.21.15.100:0/3944747021 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c14037040 con 0x7f1c240ce810 2024-09-11T22:21:12.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.397+0000 7f1c2c78d640 1 -- 172.21.15.100:0/3944747021 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c240c5a70 con 0x7f1c240ce810 2024-09-11T22:21:12.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.398+0000 7f1c2c78d640 1 --2- 172.21.15.100:0/3944747021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c240c5cb0 0x7f1c2415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.398+0000 7f1c2c78d640 1 -- 172.21.15.100:0/3944747021 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1c240c5600 con 0x7f1c240c5cb0 2024-09-11T22:21:12.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.398+0000 7f1c2a529640 1 --2- 172.21.15.100:0/3944747021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c240c5cb0 0x7f1c2415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.398+0000 7f1c1affd640 1 -- 172.21.15.100:0/3944747021 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1c14044070 con 0x7f1c240ce810 2024-09-11T22:21:12.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.398+0000 7f1c2a529640 1 -- 172.21.15.100:0/3944747021 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c240c76d0 con 0x7f1c240c5cb0 2024-09-11T22:21:12.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.398+0000 7f1c2a529640 1 --2- 172.21.15.100:0/3944747021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c240c5cb0 0x7f1c2415b0e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000f4d0 tx=0x7f1c2000f990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:12.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.398+0000 7f1c1affd640 1 --2- 172.21.15.100:0/3944747021 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1c0806be30 0x7f1c0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.399+0000 7f1c1affd640 1 -- 172.21.15.100:0/3944747021 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f1c140abc90 con 0x7f1c240ce810 2024-09-11T22:21:12.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.399+0000 7f1c2ad2a640 1 --2- 172.21.15.100:0/3944747021 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1c0806be30 0x7f1c0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.399+0000 7f1c1affd640 1 -- 172.21.15.100:0/3944747021 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c20018070 con 0x7f1c240c5cb0 2024-09-11T22:21:12.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.399+0000 7f1c1affd640 1 -- 172.21.15.100:0/3944747021 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1c20014890 con 0x7f1c240c5cb0 2024-09-11T22:21:12.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.399+0000 7f1c1affd640 1 -- 172.21.15.100:0/3944747021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c240c5cb0 msgr2=0x7f1c2415b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.399+0000 7f1c1affd640 1 --2- 172.21.15.100:0/3944747021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c240c5cb0 0x7f1c2415b0e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000f4d0 tx=0x7f1c2000f990 comp rx=0 tx=0).stop 2024-09-11T22:21:12.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.399+0000 7f1c1affd640 1 -- 172.21.15.100:0/3944747021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c240c5cb0 msgr2=0x7f1c2415b0e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:21:12.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.399+0000 7f1c1affd640 1 --2- 172.21.15.100:0/3944747021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c240c5cb0 0x7f1c2415b0e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.399+0000 7f1c2ad2a640 1 --2- 172.21.15.100:0/3944747021 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1c0806be30 0x7f1c0806e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009f60 tx=0x7f1c1c00d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:12.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.405+0000 7f1c2c78d640 1 --2- 172.21.15.100:0/3944747021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c241f1350 0x7f1c241f1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.405+0000 7f1c2c78d640 1 -- 172.21.15.100:0/3944747021 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1c240692a0 con 0x7f1c241f1350 2024-09-11T22:21:12.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.405+0000 7f1c2a529640 1 --2- 172.21.15.100:0/3944747021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c241f1350 0x7f1c241f1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.406+0000 7f1c2a529640 1 -- 172.21.15.100:0/3944747021 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1c241595b0 con 0x7f1c241f1350 2024-09-11T22:21:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.406+0000 7f1c2a529640 1 --2- 172.21.15.100:0/3944747021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c241f1350 0x7f1c241f1760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1c2001a000 tx=0x7f1c20004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.406+0000 7f1c1affd640 1 -- 172.21.15.100:0/3944747021 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c200137f0 con 0x7f1c241f1350 2024-09-11T22:21:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.407+0000 7f1c1affd640 1 -- 172.21.15.100:0/3944747021 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4886 (secure 0 0 0) 0x7f1c200137f0 con 0x7f1c241f1350 2024-09-11T22:21:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.407+0000 7f1c1affd640 1 -- 172.21.15.100:0/3944747021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c241f1350 msgr2=0x7f1c241f1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.407+0000 7f1c1affd640 1 --2- 172.21.15.100:0/3944747021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c241f1350 0x7f1c241f1760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1c2001a000 tx=0x7f1c20004730 comp rx=0 tx=0).stop 2024-09-11T22:21:12.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.407+0000 7f1c1affd640 1 -- 172.21.15.100:0/3944747021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c241f1350 msgr2=0x7f1c241f1760 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:21:12.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.407+0000 7f1c1affd640 1 --2- 172.21.15.100:0/3944747021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c241f1350 0x7f1c241f1760 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.408 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:21:12.408 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:21:12.408 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:21:12.408 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:21:12.408 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 4, 2024-09-11T22:21:12.408 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 76385, 2024-09-11T22:21:12.408 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:21:12.408 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:21:12.408 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:21:12.408 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:21:12.409 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:12.409 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 76, 2024-09-11T22:21:12.409 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:21:12.409 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:21:12.409 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:21:12.409 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:12.409 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:12.409 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:12.409 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:12.409 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:12.409 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:12.409 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:12.409 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:12.410 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:12.410 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:12.410 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:12.410 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:12.410 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:21:12.410 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:21:12.410 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:12.410 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:12.410 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:12.410 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:12.410 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:12.410 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:12.410 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:12.410 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:12.411 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:12.411 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:12.411 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:12.411 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:12.411 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.411 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:21:12.411 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:21:12.411 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:21:12.411 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:21:12.411 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:21:12.411 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:21:12.411 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:21:12.411 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:21:12.411 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:21:12.412 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:21:12.412 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:21:12.412 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:21:12.412 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:21:12.412 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:21:12.412 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:21:12.412 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:21:12.412 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:21:12.412 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:12.412 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:12.412 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:12.412 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:12.412 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:12.412 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:12.413 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:12.413 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:12.413 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:12.413 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:12.413 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:12.413 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:12.413 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:21:12.413 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.413 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:21:12.413 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.413 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:21:12.413 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:21:12.413 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:12.414 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:12.414 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.414 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:12.414 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:21:12.414 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:12.414 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.414 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.414 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:12.414 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:21:12.414 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:12.414 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.414 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:12.414 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.414 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:21:12.415 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:21:12.415 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:12.415 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:12.415 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:12.415 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.415 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.415 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:21:12.415 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:21:12.415 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:12.415 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:12.415 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.415 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:12.415 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:21:12.415 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:12.416 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.416 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.416 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:12.416 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:21:12.416 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:12.416 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.416 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:12.416 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.416 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:21:12.416 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:21:12.416 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:12.416 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:12.416 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:12.417 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.417 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.417 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:21:12.417 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:21:12.417 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:12.417 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:12.417 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.417 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:12.417 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:21:12.417 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:12.417 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.417 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.417 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:12.418 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:21:12.418 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:12.418 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.418 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:12.418 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.418 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:21:12.418 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:21:12.419 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:12.419 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:12.420 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:12.420 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.420 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:12.420 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.420 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:21:12.420 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:21:12.420 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.420 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:12.420 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:12.420 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:21:12.420 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.420 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:12.420 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:21:12.420 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.421 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:12.421 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:12.421 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:21:12.421 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.421 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:12.421 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:21:12.421 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.421 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:12.421 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:12.421 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:21:12.421 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.421 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:12.421 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:21:12.422 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:12.422 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:12.422 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:12.422 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:21:12.422 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:12.422 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:12.422 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:12.422 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:21:12.422 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:21:12.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.407+0000 7f1c2c78d640 1 -- 172.21.15.100:0/3944747021 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1c0806be30 msgr2=0x7f1c0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.407+0000 7f1c2c78d640 1 --2- 172.21.15.100:0/3944747021 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1c0806be30 0x7f1c0806e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009f60 tx=0x7f1c1c00d040 comp rx=0 tx=0).stop 2024-09-11T22:21:12.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.407+0000 7f1c2c78d640 1 -- 172.21.15.100:0/3944747021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c240ce810 msgr2=0x7f1c240c6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.407+0000 7f1c2c78d640 1 --2- 172.21.15.100:0/3944747021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c240ce810 0x7f1c240c6b00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1c1402a220 tx=0x7f1c140046c0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.407+0000 7f1c2ad2a640 1 -- 172.21.15.100:0/3944747021 reap_dead start 2024-09-11T22:21:12.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.407+0000 7f1c2ad2a640 1 -- 172.21.15.100:0/3944747021 reap_dead start 2024-09-11T22:21:12.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.407+0000 7f1c2c78d640 1 -- 172.21.15.100:0/3944747021 shutdown_connections 2024-09-11T22:21:12.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.407+0000 7f1c2c78d640 1 -- 172.21.15.100:0/3944747021 >> 172.21.15.100:0/3944747021 conn(0x7f1c240714a0 msgr2=0x7f1c240cca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:12.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.407+0000 7f1c2c78d640 1 -- 172.21.15.100:0/3944747021 shutdown_connections 2024-09-11T22:21:12.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.407+0000 7f1c2c78d640 1 -- 172.21.15.100:0/3944747021 wait complete. 2024-09-11T22:21:12.425 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:21:12.425 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-09-11T22:21:12.425 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-11T22:21:12.425 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-11T22:21:12.425 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-11T22:21:12.425 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-11T22:21:12.425 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:21:12.440 INFO:tasks.ceph.mon.c:Stopped 2024-09-11T22:21:12.440 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-11T22:21:12.440 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:21:12.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.537+0000 7fd567549640 1 Processor -- start 2024-09-11T22:21:12.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.537+0000 7fd567549640 1 -- start start 2024-09-11T22:21:12.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.538+0000 7fd567549640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd560151090 0x7fd560071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.538+0000 7fd567549640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd5600c0f90 0x7fd56006d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.538+0000 7fd567549640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5600c80f0 con 0x7fd5600b1e80 2024-09-11T22:21:12.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.538+0000 7fd567549640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fd5600b16c0 con 0x7fd5600c0f90 2024-09-11T22:21:12.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.538+0000 7fd567549640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd560073070 con 0x7fd560151090 2024-09-11T22:21:12.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.538+0000 7fd565ae6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd5600c0f90 0x7fd56006d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.538+0000 7fd564ae4640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd5600b1e80 0x7fd560156da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33058/0 (socket says 172.21.15.100:33058) 2024-09-11T22:21:12.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.538+0000 7fd564ae4640 1 -- 172.21.15.100:0/2224928460 learned_addr learned my addr 172.21.15.100:0/2224928460 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:21:12.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.538+0000 7fd5652e5640 1 -- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd560151090 msgr2=0x7fd560071780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3301/0 2024-09-11T22:21:12.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.538+0000 7fd5652e5640 1 --2- 172.21.15.100:0/2224928460 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd560151090 0x7fd560071780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:12.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.538+0000 7fd565ae6640 1 -- 172.21.15.100:0/2224928460 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd560151090 msgr2=0x7fd560071780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:21:12.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.538+0000 7fd565ae6640 1 --2- 172.21.15.100:0/2224928460 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd560151090 0x7fd560071780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.538+0000 7fd565ae6640 1 -- 172.21.15.100:0/2224928460 >> v1:172.21.15.100:6789/0 conn(0x7fd5600b1e80 legacy=0x7fd560156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.538+0000 7fd565ae6640 1 -- 172.21.15.100:0/2224928460 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd560073350 con 0x7fd5600c0f90 2024-09-11T22:21:12.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.538+0000 7fd557fff640 1 -- 172.21.15.100:0/2224928460 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 958374043 0 0) 0x7fd5600c80f0 con 0x7fd5600b1e80 2024-09-11T22:21:12.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.539+0000 7fd565ae6640 1 --2- 172.21.15.100:0/2224928460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5600c0f90 0x7fd56006d910 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd558009d90 tx=0x7fd55802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f7499f2e2b5399 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:12.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.539+0000 7fd557fff640 1 -- 172.21.15.100:0/2224928460 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558007740 con 0x7fd5600c0f90 2024-09-11T22:21:12.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.539+0000 7fd557fff640 1 -- 172.21.15.100:0/2224928460 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5580078e0 con 0x7fd5600c0f90 2024-09-11T22:21:12.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.539+0000 7fd557fff640 1 -- 172.21.15.100:0/2224928460 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558007cb0 con 0x7fd5600c0f90 2024-09-11T22:21:12.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.539+0000 7fd567549640 1 -- 172.21.15.100:0/2224928460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5600c0f90 msgr2=0x7fd56006d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.539+0000 7fd567549640 1 --2- 172.21.15.100:0/2224928460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5600c0f90 0x7fd56006d910 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd558009d90 tx=0x7fd55802a710 comp rx=0 tx=0).stop 2024-09-11T22:21:12.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.539+0000 7fd567549640 1 -- 172.21.15.100:0/2224928460 shutdown_connections 2024-09-11T22:21:12.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.539+0000 7fd567549640 1 --2- 172.21.15.100:0/2224928460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5600c0f90 0x7fd56006d910 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.539+0000 7fd567549640 1 --2- 172.21.15.100:0/2224928460 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd560151090 0x7fd560071780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.540+0000 7fd567549640 1 -- 172.21.15.100:0/2224928460 >> 172.21.15.100:0/2224928460 conn(0x7fd5600cbf70 msgr2=0x7fd5600cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:12.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.540+0000 7fd567549640 1 -- 172.21.15.100:0/2224928460 shutdown_connections 2024-09-11T22:21:12.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.540+0000 7fd567549640 1 -- 172.21.15.100:0/2224928460 wait complete. 2024-09-11T22:21:12.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.541+0000 7fd567549640 1 Processor -- start 2024-09-11T22:21:12.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.541+0000 7fd567549640 1 -- start start 2024-09-11T22:21:12.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.541+0000 7fd567549640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5600b1e80 0x7fd5601541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.541+0000 7fd567549640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5600c0f90 0x7fd560152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.541+0000 7fd567549640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd560151090 0x7fd5601529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.541+0000 7fd567549640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd5600b1960 con 0x7fd5600b1e80 2024-09-11T22:21:12.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.541+0000 7fd567549640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd560073910 con 0x7fd5600c0f90 2024-09-11T22:21:12.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.541+0000 7fd567549640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd560151470 con 0x7fd560151090 2024-09-11T22:21:12.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.541+0000 7fd5652e5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5600b1e80 0x7fd5601541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.541+0000 7fd565ae6640 1 -- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd560151090 msgr2=0x7fd5601529d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3301/0 2024-09-11T22:21:12.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.541+0000 7fd5652e5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5600b1e80 0x7fd5601541f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44158/0 (socket says 172.21.15.100:44158) 2024-09-11T22:21:12.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.542+0000 7fd5652e5640 1 -- 172.21.15.100:0/693950498 learned_addr learned my addr 172.21.15.100:0/693950498 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:12.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.542+0000 7fd565ae6640 1 --2- 172.21.15.100:0/693950498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd560151090 0x7fd5601529d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:12.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.542+0000 7fd564ae4640 1 --2- 172.21.15.100:0/693950498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5600c0f90 0x7fd560152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.542+0000 7fd5652e5640 1 -- 172.21.15.100:0/693950498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd560151090 msgr2=0x7fd5601529d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:21:12.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.542+0000 7fd5652e5640 1 --2- 172.21.15.100:0/693950498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd560151090 0x7fd5601529d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.542+0000 7fd5652e5640 1 -- 172.21.15.100:0/693950498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5600c0f90 msgr2=0x7fd560152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.542+0000 7fd5652e5640 1 --2- 172.21.15.100:0/693950498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5600c0f90 0x7fd560152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.542+0000 7fd5652e5640 1 -- 172.21.15.100:0/693950498 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd560154730 con 0x7fd5600b1e80 2024-09-11T22:21:12.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.542+0000 7fd5652e5640 1 --2- 172.21.15.100:0/693950498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5600b1e80 0x7fd5601541f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd55c00b550 tx=0x7fd55c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:12.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.542+0000 7fd555ffb640 1 -- 172.21.15.100:0/693950498 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd55c013020 con 0x7fd5600b1e80 2024-09-11T22:21:12.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.542+0000 7fd555ffb640 1 -- 172.21.15.100:0/693950498 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd55c006070 con 0x7fd5600b1e80 2024-09-11T22:21:12.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.542+0000 7fd555ffb640 1 -- 172.21.15.100:0/693950498 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd55c006460 con 0x7fd5600b1e80 2024-09-11T22:21:12.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.542+0000 7fd567549640 1 -- 172.21.15.100:0/693950498 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd560159ee0 con 0x7fd5600b1e80 2024-09-11T22:21:12.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.542+0000 7fd567549640 1 -- 172.21.15.100:0/693950498 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5600c6070 con 0x7fd5600b1e80 2024-09-11T22:21:12.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.543+0000 7fd567549640 1 -- 172.21.15.100:0/693950498 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5600c62b0 con 0x7fd5600b1e80 2024-09-11T22:21:12.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.544+0000 7fd555ffb640 1 -- 172.21.15.100:0/693950498 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd55c016020 con 0x7fd5600b1e80 2024-09-11T22:21:12.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.544+0000 7fd555ffb640 1 --2- 172.21.15.100:0/693950498 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd54406bde0 0x7fd54406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:12.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.544+0000 7fd555ffb640 1 -- 172.21.15.100:0/693950498 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fd55c08ae90 con 0x7fd5600b1e80 2024-09-11T22:21:12.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.544+0000 7fd564ae4640 1 --2- 172.21.15.100:0/693950498 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd54406bde0 0x7fd54406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:12.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.544+0000 7fd564ae4640 1 --2- 172.21.15.100:0/693950498 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd54406bde0 0x7fd54406e2a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd56014c870 tx=0x7fd550007b50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:12.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.548+0000 7fd555ffb640 1 -- 172.21.15.100:0/693950498 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd5600c62b0 con 0x7fd5600b1e80 2024-09-11T22:21:12.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.776+0000 7fd567549640 1 -- 172.21.15.100:0/693950498 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd5600c6970 con 0x7fd5600b1e80 2024-09-11T22:21:12.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.777+0000 7fd555ffb640 1 -- 172.21.15.100:0/693950498 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7fd55c01d020 con 0x7fd5600b1e80 2024-09-11T22:21:12.777 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":76,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:21:12.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.779+0000 7fd567549640 1 -- 172.21.15.100:0/693950498 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd54406bde0 msgr2=0x7fd54406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.779+0000 7fd567549640 1 --2- 172.21.15.100:0/693950498 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd54406bde0 0x7fd54406e2a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd56014c870 tx=0x7fd550007b50 comp rx=0 tx=0).stop 2024-09-11T22:21:12.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.779+0000 7fd567549640 1 -- 172.21.15.100:0/693950498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5600b1e80 msgr2=0x7fd5601541f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:12.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.779+0000 7fd567549640 1 --2- 172.21.15.100:0/693950498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5600b1e80 0x7fd5601541f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd55c00b550 tx=0x7fd55c00ba10 comp rx=0 tx=0).stop 2024-09-11T22:21:12.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.779+0000 7fd567549640 1 -- 172.21.15.100:0/693950498 shutdown_connections 2024-09-11T22:21:12.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.779+0000 7fd567549640 1 --2- 172.21.15.100:0/693950498 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd54406bde0 0x7fd54406e2a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.779+0000 7fd567549640 1 --2- 172.21.15.100:0/693950498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd560151090 0x7fd5601529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.779+0000 7fd567549640 1 --2- 172.21.15.100:0/693950498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5600c0f90 0x7fd560152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.779+0000 7fd567549640 1 --2- 172.21.15.100:0/693950498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5600b1e80 0x7fd5601541f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:12.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.779+0000 7fd567549640 1 -- 172.21.15.100:0/693950498 >> 172.21.15.100:0/693950498 conn(0x7fd5600cbf70 msgr2=0x7fd560156f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:12.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.779+0000 7fd567549640 1 -- 172.21.15.100:0/693950498 shutdown_connections 2024-09-11T22:21:12.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:12.779+0000 7fd567549640 1 -- 172.21.15.100:0/693950498 wait complete. 2024-09-11T22:21:15.790 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:21:15.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.903+0000 7f28d519f640 1 Processor -- start 2024-09-11T22:21:15.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.903+0000 7f28d519f640 1 -- start start 2024-09-11T22:21:15.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.904+0000 7f28d519f640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f28d0151ae0 0x7f28d0071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:15.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.904+0000 7f28d519f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28d00c2de0 0x7f28d006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.904+0000 7f28d519f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28d0071cc0 con 0x7f28d00c8570 2024-09-11T22:21:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.904+0000 7f28d519f640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f28d00c1ec0 con 0x7f28d0151ae0 2024-09-11T22:21:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.904+0000 7f28d519f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f28d0071f50 con 0x7f28d00c2de0 2024-09-11T22:21:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.904+0000 7f28ced9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f28d0151ae0 0x7f28d0071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:15.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.904+0000 7f28cf59e640 1 -- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28d00c2de0 msgr2=0x7f28d006bc10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3301/0 2024-09-11T22:21:15.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.904+0000 7f28cf59e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28d00c2de0 0x7f28d006bc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:15.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.904+0000 7f28ced9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f28d0151ae0 0x7f28d0071780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44164/0 (socket says 172.21.15.100:44164) 2024-09-11T22:21:15.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.904+0000 7f28ced9d640 1 -- 172.21.15.100:0/3802190084 learned_addr learned my addr 172.21.15.100:0/3802190084 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:15.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.904+0000 7f28ced9d640 1 -- 172.21.15.100:0/3802190084 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28d00c2de0 msgr2=0x7f28d006bc10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:21:15.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.904+0000 7f28ced9d640 1 --2- 172.21.15.100:0/3802190084 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28d00c2de0 0x7f28d006bc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.904+0000 7f28ced9d640 1 -- 172.21.15.100:0/3802190084 >> v1:172.21.15.167:6789/0 conn(0x7f28d00c8570 legacy=0x7f28d00c0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:15.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.904+0000 7f28ced9d640 1 -- 172.21.15.100:0/3802190084 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d0072230 con 0x7f28d0151ae0 2024-09-11T22:21:15.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.905+0000 7f28ced9d640 1 --2- 172.21.15.100:0/3802190084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d0151ae0 0x7f28d0071780 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f28c0009870 tx=0x7f28c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a382aac3a12a1bec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:15.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.905+0000 7f28ce59c640 1 -- 172.21.15.100:0/3802190084 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c0037070 con 0x7f28d0151ae0 2024-09-11T22:21:15.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.905+0000 7f28ce59c640 1 -- 172.21.15.100:0/3802190084 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28c0032440 con 0x7f28d0151ae0 2024-09-11T22:21:15.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.905+0000 7f28ce59c640 1 -- 172.21.15.100:0/3802190084 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c0032810 con 0x7f28d0151ae0 2024-09-11T22:21:15.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.906+0000 7f28d519f640 1 -- 172.21.15.100:0/3802190084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d0151ae0 msgr2=0x7f28d0071780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:15.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.906+0000 7f28d519f640 1 --2- 172.21.15.100:0/3802190084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d0151ae0 0x7f28d0071780 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f28c0009870 tx=0x7f28c002a270 comp rx=0 tx=0).stop 2024-09-11T22:21:15.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.906+0000 7f28d519f640 1 -- 172.21.15.100:0/3802190084 shutdown_connections 2024-09-11T22:21:15.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.906+0000 7f28d519f640 1 --2- 172.21.15.100:0/3802190084 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28d00c2de0 0x7f28d006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.906+0000 7f28d519f640 1 --2- 172.21.15.100:0/3802190084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d0151ae0 0x7f28d0071780 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.906+0000 7f28d519f640 1 -- 172.21.15.100:0/3802190084 >> 172.21.15.100:0/3802190084 conn(0x7f28d00cbf70 msgr2=0x7f28d00cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:15.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.906+0000 7f28d519f640 1 -- 172.21.15.100:0/3802190084 shutdown_connections 2024-09-11T22:21:15.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.906+0000 7f28d519f640 1 -- 172.21.15.100:0/3802190084 wait complete. 2024-09-11T22:21:15.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.907+0000 7f28d519f640 1 Processor -- start 2024-09-11T22:21:15.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.907+0000 7f28d519f640 1 -- start start 2024-09-11T22:21:15.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.908+0000 7f28d519f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d00c2de0 0x7f28d0147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:15.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.908+0000 7f28d519f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28d00c8570 0x7f28d00c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:15.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.908+0000 7f28d519f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28d0151ae0 0x7f28d0142650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:15.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.908+0000 7f28d519f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f28d00c2720 con 0x7f28d00c2de0 2024-09-11T22:21:15.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.908+0000 7f28d519f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f28d00c2440 con 0x7f28d00c8570 2024-09-11T22:21:15.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.908+0000 7f28d519f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f28d00c16a0 con 0x7f28d0151ae0 2024-09-11T22:21:15.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.908+0000 7f28ced9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d00c2de0 0x7f28d0147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:15.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.908+0000 7f28ced9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d00c2de0 0x7f28d0147120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44176/0 (socket says 172.21.15.100:44176) 2024-09-11T22:21:15.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.908+0000 7f28ced9d640 1 -- 172.21.15.100:0/286690398 learned_addr learned my addr 172.21.15.100:0/286690398 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:15.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.908+0000 7f28cf59e640 1 -- 172.21.15.100:0/286690398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28d0151ae0 msgr2=0x7f28d0142650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3301/0 2024-09-11T22:21:15.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.908+0000 7f28cf59e640 1 --2- 172.21.15.100:0/286690398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28d0151ae0 0x7f28d0142650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:15.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.908+0000 7f28c7fff640 1 --2- 172.21.15.100:0/286690398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28d00c8570 0x7f28d00c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:15.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.908+0000 7f28ced9d640 1 -- 172.21.15.100:0/286690398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28d0151ae0 msgr2=0x7f28d0142650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:21:15.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.908+0000 7f28ced9d640 1 --2- 172.21.15.100:0/286690398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28d0151ae0 0x7f28d0142650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.908+0000 7f28ced9d640 1 -- 172.21.15.100:0/286690398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28d00c8570 msgr2=0x7f28d00c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:15.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.908+0000 7f28ced9d640 1 --2- 172.21.15.100:0/286690398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28d00c8570 0x7f28d00c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:15.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.908+0000 7f28ced9d640 1 -- 172.21.15.100:0/286690398 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d01463a0 con 0x7f28d00c2de0 2024-09-11T22:21:15.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.908+0000 7f28c7fff640 1 --2- 172.21.15.100:0/286690398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28d00c8570 0x7f28d00c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:21:15.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.909+0000 7f28ced9d640 1 --2- 172.21.15.100:0/286690398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d00c2de0 0x7f28d0147120 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f28c0000c00 tx=0x7f28c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:15.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.909+0000 7f28c77fe640 1 -- 172.21.15.100:0/286690398 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c0041070 con 0x7f28d00c2de0 2024-09-11T22:21:15.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.909+0000 7f28c77fe640 1 -- 172.21.15.100:0/286690398 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28c003c870 con 0x7f28d00c2de0 2024-09-11T22:21:15.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.909+0000 7f28d519f640 1 -- 172.21.15.100:0/286690398 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28d01f4950 con 0x7f28d00c2de0 2024-09-11T22:21:15.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.909+0000 7f28c77fe640 1 -- 172.21.15.100:0/286690398 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c0037040 con 0x7f28d00c2de0 2024-09-11T22:21:15.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.909+0000 7f28d519f640 1 -- 172.21.15.100:0/286690398 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28d0146920 con 0x7f28d00c2de0 2024-09-11T22:21:15.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.910+0000 7f28d519f640 1 -- 172.21.15.100:0/286690398 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28d0071780 con 0x7f28d00c2de0 2024-09-11T22:21:15.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.910+0000 7f28c77fe640 1 -- 172.21.15.100:0/286690398 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f28c0044070 con 0x7f28d00c2de0 2024-09-11T22:21:15.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.911+0000 7f28c77fe640 1 --2- 172.21.15.100:0/286690398 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f28b006bde0 0x7f28b006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:15.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.911+0000 7f28c77fe640 1 -- 172.21.15.100:0/286690398 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f28c00ac150 con 0x7f28d00c2de0 2024-09-11T22:21:15.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.911+0000 7f28c7fff640 1 --2- 172.21.15.100:0/286690398 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f28b006bde0 0x7f28b006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:15.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.911+0000 7f28c7fff640 1 --2- 172.21.15.100:0/286690398 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f28b006bde0 0x7f28b006e2a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f28d01589a0 tx=0x7f28b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:15.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:15.915+0000 7f28c77fe640 1 -- 172.21.15.100:0/286690398 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f28c007a650 con 0x7f28d00c2de0 2024-09-11T22:21:16.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:16.144+0000 7f28d519f640 1 -- 172.21.15.100:0/286690398 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f28d00cbc70 con 0x7f28d00c2de0 2024-09-11T22:21:16.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:16.145+0000 7f28c77fe640 1 -- 172.21.15.100:0/286690398 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f28c0079f50 con 0x7f28d00c2de0 2024-09-11T22:21:16.146 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":79,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:21:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:16.147+0000 7f28d519f640 1 -- 172.21.15.100:0/286690398 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f28b006bde0 msgr2=0x7f28b006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:16.147+0000 7f28d519f640 1 --2- 172.21.15.100:0/286690398 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f28b006bde0 0x7f28b006e2a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f28d01589a0 tx=0x7f28b8009040 comp rx=0 tx=0).stop 2024-09-11T22:21:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:16.147+0000 7f28d519f640 1 -- 172.21.15.100:0/286690398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d00c2de0 msgr2=0x7f28d0147120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:16.147+0000 7f28d519f640 1 --2- 172.21.15.100:0/286690398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d00c2de0 0x7f28d0147120 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f28c0000c00 tx=0x7f28c00046c0 comp rx=0 tx=0).stop 2024-09-11T22:21:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:16.147+0000 7f28d519f640 1 -- 172.21.15.100:0/286690398 shutdown_connections 2024-09-11T22:21:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:16.147+0000 7f28d519f640 1 --2- 172.21.15.100:0/286690398 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f28b006bde0 0x7f28b006e2a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:16.147+0000 7f28d519f640 1 --2- 172.21.15.100:0/286690398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28d0151ae0 0x7f28d0142650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:16.147+0000 7f28d519f640 1 --2- 172.21.15.100:0/286690398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28d00c8570 0x7f28d00c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:16.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:16.147+0000 7f28d519f640 1 --2- 172.21.15.100:0/286690398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28d00c2de0 0x7f28d0147120 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:16.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:16.147+0000 7f28d519f640 1 -- 172.21.15.100:0/286690398 >> 172.21.15.100:0/286690398 conn(0x7f28d00cbf70 msgr2=0x7f28d01542e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:16.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:16.147+0000 7f28d519f640 1 -- 172.21.15.100:0/286690398 shutdown_connections 2024-09-11T22:21:16.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:16.147+0000 7f28d519f640 1 -- 172.21.15.100:0/286690398 wait complete. 2024-09-11T22:21:18.689 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:21:18.692 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:21:19.159 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:21:19.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.268+0000 7f4a9caaf640 1 Processor -- start 2024-09-11T22:21:19.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.268+0000 7f4a9caaf640 1 -- start start 2024-09-11T22:21:19.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.269+0000 7f4a9caaf640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4a981527d0 0x7f4a9806e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:19.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.269+0000 7f4a9caaf640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4a980c8250 0x7f4a980cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:19.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.269+0000 7f4a9caaf640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a980c9a10 con 0x7f4a980c8a70 2024-09-11T22:21:19.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.269+0000 7f4a9caaf640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f4a980c5080 con 0x7f4a980c8250 2024-09-11T22:21:19.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.269+0000 7f4a9caaf640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f4a980ca3b0 con 0x7f4a981527d0 2024-09-11T22:21:19.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.269+0000 7f4a96d9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4a980c8250 0x7f4a980cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:19.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.269+0000 7f4a95d9b640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f4a980c8a70 0x7f4a980c9300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33068/0 (socket says 172.21.15.100:33068) 2024-09-11T22:21:19.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.269+0000 7f4a95d9b640 1 -- 172.21.15.100:0/1382861303 learned_addr learned my addr 172.21.15.100:0/1382861303 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:21:19.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.270+0000 7f4a9659c640 1 --2- 172.21.15.100:0/1382861303 >> v2:172.21.15.167:3300/0 conn(0x7f4a981527d0 0x7f4a9806e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:19.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.270+0000 7f4a96d9d640 1 -- 172.21.15.100:0/1382861303 >> v2:172.21.15.167:3300/0 conn(0x7f4a981527d0 msgr2=0x7f4a9806e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:19.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.270+0000 7f4a96d9d640 1 --2- 172.21.15.100:0/1382861303 >> v2:172.21.15.167:3300/0 conn(0x7f4a981527d0 0x7f4a9806e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:19.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.270+0000 7f4a96d9d640 1 -- 172.21.15.100:0/1382861303 >> v1:172.21.15.100:6789/0 conn(0x7f4a980c8a70 legacy=0x7f4a980c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:19.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.270+0000 7f4a96d9d640 1 -- 172.21.15.100:0/1382861303 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a980ca690 con 0x7f4a980c8250 2024-09-11T22:21:19.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.270+0000 7f4a9659c640 1 --2- 172.21.15.100:0/1382861303 >> v2:172.21.15.167:3300/0 conn(0x7f4a981527d0 0x7f4a9806e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:19.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.270+0000 7f4a96d9d640 1 --2- 172.21.15.100:0/1382861303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a980c8250 0x7f4a980cab00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4a90009d90 tx=0x7f4a9002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0bd180d99fb4301 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:19.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.271+0000 7f4a9559a640 1 -- 172.21.15.100:0/1382861303 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a90007740 con 0x7f4a980c8250 2024-09-11T22:21:19.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.271+0000 7f4a9559a640 1 -- 172.21.15.100:0/1382861303 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a900078e0 con 0x7f4a980c8250 2024-09-11T22:21:19.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.271+0000 7f4a9559a640 1 -- 172.21.15.100:0/1382861303 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a90007cb0 con 0x7f4a980c8250 2024-09-11T22:21:19.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.271+0000 7f4a9caaf640 1 -- 172.21.15.100:0/1382861303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a980c8250 msgr2=0x7f4a980cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:19.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.271+0000 7f4a9caaf640 1 --2- 172.21.15.100:0/1382861303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a980c8250 0x7f4a980cab00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4a90009d90 tx=0x7f4a9002a6a0 comp rx=0 tx=0).stop 2024-09-11T22:21:19.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.271+0000 7f4a9caaf640 1 -- 172.21.15.100:0/1382861303 shutdown_connections 2024-09-11T22:21:19.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.271+0000 7f4a9caaf640 1 --2- 172.21.15.100:0/1382861303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a980c8250 0x7f4a980cab00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:19.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.271+0000 7f4a9caaf640 1 --2- 172.21.15.100:0/1382861303 >> v2:172.21.15.167:3300/0 conn(0x7f4a981527d0 0x7f4a9806e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:19.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.271+0000 7f4a9caaf640 1 -- 172.21.15.100:0/1382861303 >> 172.21.15.100:0/1382861303 conn(0x7f4a98073900 msgr2=0x7f4a98073ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:19.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.271+0000 7f4a9caaf640 1 -- 172.21.15.100:0/1382861303 shutdown_connections 2024-09-11T22:21:19.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.271+0000 7f4a9caaf640 1 -- 172.21.15.100:0/1382861303 wait complete. 2024-09-11T22:21:19.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.273+0000 7f4a9caaf640 1 Processor -- start 2024-09-11T22:21:19.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.273+0000 7f4a9caaf640 1 -- start start 2024-09-11T22:21:19.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.273+0000 7f4a9caaf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a980c8250 0x7f4a981553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:19.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.273+0000 7f4a9caaf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a980c8a70 0x7f4a981f3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:19.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.273+0000 7f4a9caaf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a981527d0 0x7f4a98153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:19.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.273+0000 7f4a9caaf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4a98152d30 con 0x7f4a980c8a70 2024-09-11T22:21:19.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.273+0000 7f4a9caaf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4a98152bb0 con 0x7f4a981527d0 2024-09-11T22:21:19.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.273+0000 7f4a9caaf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4a980cb040 con 0x7f4a980c8250 2024-09-11T22:21:19.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.274+0000 7f4a9659c640 1 -- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a980c8250 msgr2=0x7f4a981553b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3301/0 2024-09-11T22:21:19.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.274+0000 7f4a9659c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a980c8250 0x7f4a981553b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:19.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.274+0000 7f4a95d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a980c8a70 0x7f4a981f3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:19.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.274+0000 7f4a95d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a980c8a70 0x7f4a981f3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:44190/0 (socket says 172.21.15.100:44190) 2024-09-11T22:21:19.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.274+0000 7f4a95d9b640 1 -- 172.21.15.100:0/1427564139 learned_addr learned my addr 172.21.15.100:0/1427564139 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:19.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.274+0000 7f4a96d9d640 1 --2- 172.21.15.100:0/1427564139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a981527d0 0x7f4a98153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:19.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.274+0000 7f4a95d9b640 1 -- 172.21.15.100:0/1427564139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a980c8250 msgr2=0x7f4a981553b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:21:19.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.274+0000 7f4a95d9b640 1 --2- 172.21.15.100:0/1427564139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a980c8250 0x7f4a981553b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:19.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.274+0000 7f4a95d9b640 1 -- 172.21.15.100:0/1427564139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a981527d0 msgr2=0x7f4a98153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:19.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.274+0000 7f4a95d9b640 1 --2- 172.21.15.100:0/1427564139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a981527d0 0x7f4a98153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:19.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.274+0000 7f4a95d9b640 1 -- 172.21.15.100:0/1427564139 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a981f4260 con 0x7f4a980c8a70 2024-09-11T22:21:19.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.274+0000 7f4a95d9b640 1 --2- 172.21.15.100:0/1427564139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a980c8a70 0x7f4a981f3870 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c00c400 tx=0x7f4a8c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:19.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.274+0000 7f4a86ffd640 1 -- 172.21.15.100:0/1427564139 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c017070 con 0x7f4a980c8a70 2024-09-11T22:21:19.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.274+0000 7f4a86ffd640 1 -- 172.21.15.100:0/1427564139 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a8c005ce0 con 0x7f4a980c8a70 2024-09-11T22:21:19.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.274+0000 7f4a9caaf640 1 -- 172.21.15.100:0/1427564139 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a98153030 con 0x7f4a980c8a70 2024-09-11T22:21:19.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.274+0000 7f4a86ffd640 1 -- 172.21.15.100:0/1427564139 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c0072f0 con 0x7f4a980c8a70 2024-09-11T22:21:19.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.274+0000 7f4a9caaf640 1 -- 172.21.15.100:0/1427564139 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a981558f0 con 0x7f4a980c8a70 2024-09-11T22:21:19.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.275+0000 7f4a9caaf640 1 -- 172.21.15.100:0/1427564139 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a980cab00 con 0x7f4a980c8a70 2024-09-11T22:21:19.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.276+0000 7f4a86ffd640 1 -- 172.21.15.100:0/1427564139 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a8c01a070 con 0x7f4a980c8a70 2024-09-11T22:21:19.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.276+0000 7f4a86ffd640 1 --2- 172.21.15.100:0/1427564139 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4a7806bde0 0x7f4a7806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:19.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.277+0000 7f4a86ffd640 1 -- 172.21.15.100:0/1427564139 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f4a8c08a540 con 0x7f4a980c8a70 2024-09-11T22:21:19.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.277+0000 7f4a9659c640 1 --2- 172.21.15.100:0/1427564139 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4a7806bde0 0x7f4a7806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:19.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.277+0000 7f4a9659c640 1 --2- 172.21.15.100:0/1427564139 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4a7806bde0 0x7f4a7806e2a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4a88006bf0 tx=0x7f4a88008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:19.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.281+0000 7f4a86ffd640 1 -- 172.21.15.100:0/1427564139 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4a8c058510 con 0x7f4a980c8a70 2024-09-11T22:21:19.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.507+0000 7f4a9caaf640 1 -- 172.21.15.100:0/1427564139 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4a98155f30 con 0x7f4a980c8a70 2024-09-11T22:21:19.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.508+0000 7f4a86ffd640 1 -- 172.21.15.100:0/1427564139 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f4a8c05c810 con 0x7f4a980c8a70 2024-09-11T22:21:19.509 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":83,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:21:19.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.510+0000 7f4a9caaf640 1 -- 172.21.15.100:0/1427564139 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4a7806bde0 msgr2=0x7f4a7806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:19.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.510+0000 7f4a9caaf640 1 --2- 172.21.15.100:0/1427564139 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4a7806bde0 0x7f4a7806e2a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4a88006bf0 tx=0x7f4a88008040 comp rx=0 tx=0).stop 2024-09-11T22:21:19.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.510+0000 7f4a9caaf640 1 -- 172.21.15.100:0/1427564139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a980c8a70 msgr2=0x7f4a981f3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:19.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.510+0000 7f4a9caaf640 1 --2- 172.21.15.100:0/1427564139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a980c8a70 0x7f4a981f3870 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c00c400 tx=0x7f4a8c00c8c0 comp rx=0 tx=0).stop 2024-09-11T22:21:19.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.510+0000 7f4a9caaf640 1 -- 172.21.15.100:0/1427564139 shutdown_connections 2024-09-11T22:21:19.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.510+0000 7f4a9caaf640 1 --2- 172.21.15.100:0/1427564139 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4a7806bde0 0x7f4a7806e2a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:19.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.510+0000 7f4a9caaf640 1 --2- 172.21.15.100:0/1427564139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a981527d0 0x7f4a98153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:19.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.510+0000 7f4a9caaf640 1 --2- 172.21.15.100:0/1427564139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a980c8a70 0x7f4a981f3870 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:19.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.510+0000 7f4a9caaf640 1 --2- 172.21.15.100:0/1427564139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a980c8250 0x7f4a981553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:19.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.510+0000 7f4a9caaf640 1 -- 172.21.15.100:0/1427564139 >> 172.21.15.100:0/1427564139 conn(0x7f4a98073900 msgr2=0x7f4a9814fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:19.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.510+0000 7f4a9caaf640 1 -- 172.21.15.100:0/1427564139 shutdown_connections 2024-09-11T22:21:19.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:19.510+0000 7f4a9caaf640 1 -- 172.21.15.100:0/1427564139 wait complete. 2024-09-11T22:21:22.522 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:21:22.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:22.632+0000 7f4de9591640 1 Processor -- start 2024-09-11T22:21:22.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:22.632+0000 7f4de9591640 1 -- start start 2024-09-11T22:21:22.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:22.633+0000 7f4de9591640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4de406c260 0x7f4de415c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:22.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:22.633+0000 7f4de9591640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4de40b2310 con 0x7f4de40b18d0 2024-09-11T22:21:22.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:22.633+0000 7f4de9591640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4de4158940 con 0x7f4de406be80 2024-09-11T22:21:22.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:22.633+0000 7f4de9591640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f4de415cc60 con 0x7f4de406c260 2024-09-11T22:21:22.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:22.633+0000 7f4de37fe640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f4de40b18d0 0x7f4de4072070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:34750/0 (socket says 172.21.15.100:34750) 2024-09-11T22:21:22.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:22.633+0000 7f4de37fe640 1 -- 172.21.15.100:0/1570261146 learned_addr learned my addr 172.21.15.100:0/1570261146 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:21:22.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:22.634+0000 7f4de27fc640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4de406c260 0x7f4de415c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:22.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:22.634+0000 7f4de27fc640 1 -- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4de406c260 msgr2=0x7f4de415c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:21:22.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:22.634+0000 7f4de27fc640 1 -- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4de406c260 msgr2=0x7f4de415c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:21:22.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:22.634+0000 7f4de27fc640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4de406c260 0x7f4de415c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:22.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:22.634+0000 7f4de27fc640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4de406c260 0x7f4de415c720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:22.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:22.835+0000 7f4de27fc640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4de406c260 0x7f4de415c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:22.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:22.835+0000 7f4de27fc640 1 -- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4de406c260 msgr2=0x7f4de415c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:21:22.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:22.835+0000 7f4de27fc640 1 -- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4de406c260 msgr2=0x7f4de415c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:21:22.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:22.835+0000 7f4de27fc640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4de406c260 0x7f4de415c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:22.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:22.835+0000 7f4de27fc640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4de406c260 0x7f4de415c720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:21:23.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:23.236+0000 7f4de27fc640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4de406c260 0x7f4de415c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:23.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:23.236+0000 7f4de27fc640 1 -- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4de406c260 msgr2=0x7f4de415c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:21:23.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:23.236+0000 7f4de27fc640 1 -- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4de406c260 msgr2=0x7f4de415c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:21:23.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:23.236+0000 7f4de27fc640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4de406c260 0x7f4de415c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:23.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:23.236+0000 7f4de27fc640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4de406c260 0x7f4de415c720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:21:24.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:24.037+0000 7f4de27fc640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4de406c260 0x7f4de415c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:24.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:24.037+0000 7f4de27fc640 1 -- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4de406c260 msgr2=0x7f4de415c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:21:24.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:24.037+0000 7f4de27fc640 1 -- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4de406c260 msgr2=0x7f4de415c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:21:24.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:24.037+0000 7f4de27fc640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4de406c260 0x7f4de415c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:24.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:24.037+0000 7f4de27fc640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4de406c260 0x7f4de415c720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:21:25.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:25.634+0000 7f4de0ff9640 1 -- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4de406c260 msgr2=0x7f4de415c720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:21:25.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:25.634+0000 7f4de0ff9640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4de406c260 0x7f4de415c720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:25.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:25.634+0000 7f4de0ff9640 1 -- 172.21.15.100:0/1570261146 >> v1:172.21.15.167:6789/0 conn(0x7f4de406be80 legacy=0x7f4de4155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:25.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:25.634+0000 7f4de0ff9640 1 -- 172.21.15.100:0/1570261146 >> v1:172.21.15.100:6789/0 conn(0x7f4de40b18d0 legacy=0x7f4de4072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:25.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:25.634+0000 7f4de0ff9640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.100:3300/0 conn(0x7f4dd00036c0 0x7f4dd0005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:25.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:25.634+0000 7f4de0ff9640 1 --2- 172.21.15.100:0/1570261146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd0006210 0x7f4dd00086d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:25.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:25.634+0000 7f4de0ff9640 1 -- 172.21.15.100:0/1570261146 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f4de415cc60 con 0x7f4dd00036c0 2024-09-11T22:21:25.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:25.634+0000 7f4de0ff9640 1 -- 172.21.15.100:0/1570261146 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4dd0008df0 con 0x7f4dd0006210 2024-09-11T22:21:25.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:25.634+0000 7f4de27fc640 1 -- 172.21.15.100:0/1570261146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd0006210 msgr2=0x7f4dd00086d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3301/0 2024-09-11T22:21:25.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:25.634+0000 7f4de27fc640 1 --2- 172.21.15.100:0/1570261146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd0006210 0x7f4dd00086d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:25.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:25.634+0000 7f4de2ffd640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.100:3300/0 conn(0x7f4dd00036c0 0x7f4dd0005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:25.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:25.634+0000 7f4de2ffd640 1 -- 172.21.15.100:0/1570261146 >> v2:172.21.15.100:3300/0 conn(0x7f4dd00036c0 msgr2=0x7f4dd0005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:21:25.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:25.634+0000 7f4de2ffd640 1 -- 172.21.15.100:0/1570261146 >> v2:172.21.15.100:3300/0 conn(0x7f4dd00036c0 msgr2=0x7f4dd0005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:21:25.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:25.634+0000 7f4de2ffd640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.100:3300/0 conn(0x7f4dd00036c0 0x7f4dd0005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:25.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:25.634+0000 7f4de2ffd640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.100:3300/0 conn(0x7f4dd00036c0 0x7f4dd0005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:25.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:25.835+0000 7f4de27fc640 1 -- 172.21.15.100:0/1570261146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd0006210 msgr2=0x7f4dd00086d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3301/0 2024-09-11T22:21:25.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:25.835+0000 7f4de27fc640 1 --2- 172.21.15.100:0/1570261146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd0006210 0x7f4dd00086d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:21:25.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:25.835+0000 7f4de2ffd640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.100:3300/0 conn(0x7f4dd00036c0 0x7f4dd0005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:25.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:25.835+0000 7f4de2ffd640 1 -- 172.21.15.100:0/1570261146 >> v2:172.21.15.100:3300/0 conn(0x7f4dd00036c0 msgr2=0x7f4dd0005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:21:25.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:25.835+0000 7f4de2ffd640 1 -- 172.21.15.100:0/1570261146 >> v2:172.21.15.100:3300/0 conn(0x7f4dd00036c0 msgr2=0x7f4dd0005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:21:25.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:25.835+0000 7f4de2ffd640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.100:3300/0 conn(0x7f4dd00036c0 0x7f4dd0005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:25.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:25.835+0000 7f4de2ffd640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.100:3300/0 conn(0x7f4dd00036c0 0x7f4dd0005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:21:26.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:26.236+0000 7f4de27fc640 1 -- 172.21.15.100:0/1570261146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd0006210 msgr2=0x7f4dd00086d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3301/0 2024-09-11T22:21:26.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:26.236+0000 7f4de27fc640 1 --2- 172.21.15.100:0/1570261146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd0006210 0x7f4dd00086d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:21:26.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:26.236+0000 7f4de2ffd640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.100:3300/0 conn(0x7f4dd00036c0 0x7f4dd0005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:26.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:26.236+0000 7f4de2ffd640 1 -- 172.21.15.100:0/1570261146 >> v2:172.21.15.100:3300/0 conn(0x7f4dd00036c0 msgr2=0x7f4dd0005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:21:26.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:26.236+0000 7f4de2ffd640 1 -- 172.21.15.100:0/1570261146 >> v2:172.21.15.100:3300/0 conn(0x7f4dd00036c0 msgr2=0x7f4dd0005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:21:26.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:26.236+0000 7f4de2ffd640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.100:3300/0 conn(0x7f4dd00036c0 0x7f4dd0005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:26.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:26.236+0000 7f4de2ffd640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.100:3300/0 conn(0x7f4dd00036c0 0x7f4dd0005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:21:27.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:27.037+0000 7f4de2ffd640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.100:3300/0 conn(0x7f4dd00036c0 0x7f4dd0005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:27.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:27.037+0000 7f4de27fc640 1 -- 172.21.15.100:0/1570261146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd0006210 msgr2=0x7f4dd00086d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3301/0 2024-09-11T22:21:27.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:27.037+0000 7f4de27fc640 1 --2- 172.21.15.100:0/1570261146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd0006210 0x7f4dd00086d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:21:27.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:27.037+0000 7f4de2ffd640 1 -- 172.21.15.100:0/1570261146 >> v2:172.21.15.100:3300/0 conn(0x7f4dd00036c0 msgr2=0x7f4dd0005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:21:27.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:27.037+0000 7f4de2ffd640 1 -- 172.21.15.100:0/1570261146 >> v2:172.21.15.100:3300/0 conn(0x7f4dd00036c0 msgr2=0x7f4dd0005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:21:27.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:27.037+0000 7f4de2ffd640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.100:3300/0 conn(0x7f4dd00036c0 0x7f4dd0005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:27.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:27.037+0000 7f4de2ffd640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.100:3300/0 conn(0x7f4dd00036c0 0x7f4dd0005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:21:28.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.634+0000 7f4de0ff9640 1 -- 172.21.15.100:0/1570261146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd0006210 msgr2=0x7f4dd00086d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:21:28.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.634+0000 7f4de0ff9640 1 --2- 172.21.15.100:0/1570261146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd0006210 0x7f4dd00086d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.634+0000 7f4de0ff9640 1 -- 172.21.15.100:0/1570261146 >> v2:172.21.15.100:3300/0 conn(0x7f4dd00036c0 msgr2=0x7f4dd0005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:21:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.634+0000 7f4de0ff9640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.100:3300/0 conn(0x7f4dd00036c0 0x7f4dd0005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.634+0000 7f4de37fe640 1 -- 172.21.15.100:0/1570261146 reap_dead start 2024-09-11T22:21:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.634+0000 7f4de0ff9640 1 --2- 172.21.15.100:0/1570261146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd0003b30 0x7f4dd00066a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.634+0000 7f4de0ff9640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4dd0008760 0x7f4dd000d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.634+0000 7f4de0ff9640 1 -- 172.21.15.100:0/1570261146 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4de4158c20 con 0x7f4dd0006be0 2024-09-11T22:21:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.634+0000 7f4de0ff9640 1 -- 172.21.15.100:0/1570261146 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f4de415cc60 con 0x7f4dd0008760 2024-09-11T22:21:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.634+0000 7f4de0ff9640 1 -- 172.21.15.100:0/1570261146 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4dd0008df0 con 0x7f4dd0003b30 2024-09-11T22:21:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.634+0000 7f4de2ffd640 1 -- 172.21.15.100:0/1570261146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd0003b30 msgr2=0x7f4dd00066a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3301/0 2024-09-11T22:21:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.634+0000 7f4de2ffd640 1 --2- 172.21.15.100:0/1570261146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd0003b30 0x7f4dd00066a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.634+0000 7f4de37fe640 1 --2- 172.21.15.100:0/1570261146 >> v2:172.21.15.167:3300/0 conn(0x7f4dd0008760 0x7f4dd000d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.634+0000 7f4de1ffb640 1 -- 172.21.15.100:0/1570261146 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1688667767 0 0) 0x7f4de4158c20 con 0x7f4dd0006be0 2024-09-11T22:21:28.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.634+0000 7f4de1ffb640 1 -- 172.21.15.100:0/1570261146 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4dcc003520 con 0x7f4dd0006be0 2024-09-11T22:21:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.635+0000 7f4de37fe640 1 -- 172.21.15.100:0/1570261146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd0003b30 msgr2=0x7f4dd00066a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:21:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.635+0000 7f4de37fe640 1 --2- 172.21.15.100:0/1570261146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd0003b30 0x7f4dd00066a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.635+0000 7f4de37fe640 1 -- 172.21.15.100:0/1570261146 >> v1:172.21.15.167:6789/0 conn(0x7f4dd0006be0 legacy=0x7f4dd0007040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:28.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.635+0000 7f4de37fe640 1 -- 172.21.15.100:0/1570261146 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd000eaf0 con 0x7f4dd0008760 2024-09-11T22:21:28.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.636+0000 7f4de37fe640 1 --2- 172.21.15.100:0/1570261146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd0008760 0x7f4dd000d310 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4de41598d0 tx=0x7f4ddc02a610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89988035cfb2c8a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:28.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.636+0000 7f4de1ffb640 1 -- 172.21.15.100:0/1570261146 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc032630 con 0x7f4dd0008760 2024-09-11T22:21:28.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.636+0000 7f4de1ffb640 1 -- 172.21.15.100:0/1570261146 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ddc0327d0 con 0x7f4dd0008760 2024-09-11T22:21:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.636+0000 7f4de1ffb640 1 -- 172.21.15.100:0/1570261146 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc032b80 con 0x7f4dd0008760 2024-09-11T22:21:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.637+0000 7f4de9591640 1 -- 172.21.15.100:0/1570261146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd0008760 msgr2=0x7f4dd000d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.637+0000 7f4de9591640 1 --2- 172.21.15.100:0/1570261146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd0008760 0x7f4dd000d310 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4de41598d0 tx=0x7f4ddc02a610 comp rx=0 tx=0).stop 2024-09-11T22:21:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.637+0000 7f4de9591640 1 -- 172.21.15.100:0/1570261146 shutdown_connections 2024-09-11T22:21:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.637+0000 7f4de9591640 1 --2- 172.21.15.100:0/1570261146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd0008760 0x7f4dd000d310 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.637+0000 7f4de9591640 1 --2- 172.21.15.100:0/1570261146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd0003b30 0x7f4dd00066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.637+0000 7f4de9591640 1 -- 172.21.15.100:0/1570261146 >> 172.21.15.100:0/1570261146 conn(0x7f4de40cbf70 msgr2=0x7f4de40cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.637+0000 7f4de9591640 1 -- 172.21.15.100:0/1570261146 shutdown_connections 2024-09-11T22:21:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.637+0000 7f4de9591640 1 -- 172.21.15.100:0/1570261146 wait complete. 2024-09-11T22:21:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.638+0000 7f4de9591640 1 Processor -- start 2024-09-11T22:21:28.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.638+0000 7f4de9591640 1 -- start start 2024-09-11T22:21:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.639+0000 7f4de9591640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd0003b30 0x7f4de40c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.639+0000 7f4de9591640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd0006be0 0x7f4de40c2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.639+0000 7f4de9591640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dd0008760 0x7f4de41f3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.639+0000 7f4de9591640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4de41594c0 con 0x7f4dd0008760 2024-09-11T22:21:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.639+0000 7f4de9591640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4de41591e0 con 0x7f4dd0006be0 2024-09-11T22:21:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.639+0000 7f4de9591640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4de40b1db0 con 0x7f4dd0003b30 2024-09-11T22:21:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.639+0000 7f4de2ffd640 1 -- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd0003b30 msgr2=0x7f4de40c36e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3301/0 2024-09-11T22:21:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.639+0000 7f4de2ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd0003b30 0x7f4de40c36e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.639+0000 7f4de37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dd0008760 0x7f4de41f3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.639+0000 7f4de37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dd0008760 0x7f4de41f3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45060/0 (socket says 172.21.15.100:45060) 2024-09-11T22:21:28.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.639+0000 7f4de37fe640 1 -- 172.21.15.100:0/1477085359 learned_addr learned my addr 172.21.15.100:0/1477085359 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.639+0000 7f4de27fc640 1 --2- 172.21.15.100:0/1477085359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd0006be0 0x7f4de40c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.639+0000 7f4de37fe640 1 -- 172.21.15.100:0/1477085359 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd0003b30 msgr2=0x7f4de40c36e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:21:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.639+0000 7f4de37fe640 1 --2- 172.21.15.100:0/1477085359 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd0003b30 0x7f4de40c36e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.639+0000 7f4de37fe640 1 -- 172.21.15.100:0/1477085359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd0006be0 msgr2=0x7f4de40c2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.639+0000 7f4de37fe640 1 --2- 172.21.15.100:0/1477085359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd0006be0 0x7f4de40c2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.639+0000 7f4de37fe640 1 -- 172.21.15.100:0/1477085359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de40c6090 con 0x7f4dd0008760 2024-09-11T22:21:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.640+0000 7f4de37fe640 1 --2- 172.21.15.100:0/1477085359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dd0008760 0x7f4de41f3960 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4de40b1ce0 tx=0x7f4ddc0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.640+0000 7f4dcb7fe640 1 -- 172.21.15.100:0/1477085359 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc032b90 con 0x7f4dd0008760 2024-09-11T22:21:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.640+0000 7f4dcb7fe640 1 -- 172.21.15.100:0/1477085359 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ddc042070 con 0x7f4dd0008760 2024-09-11T22:21:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.640+0000 7f4de9591640 1 -- 172.21.15.100:0/1477085359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4de40c5510 con 0x7f4dd0008760 2024-09-11T22:21:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.640+0000 7f4dcb7fe640 1 -- 172.21.15.100:0/1477085359 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc03b400 con 0x7f4dd0008760 2024-09-11T22:21:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.640+0000 7f4de9591640 1 -- 172.21.15.100:0/1477085359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4de40c5ad0 con 0x7f4dd0008760 2024-09-11T22:21:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.641+0000 7f4de9591640 1 -- 172.21.15.100:0/1477085359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4de415c720 con 0x7f4dd0008760 2024-09-11T22:21:28.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.641+0000 7f4dcb7fe640 1 -- 172.21.15.100:0/1477085359 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ddc03a070 con 0x7f4dd0008760 2024-09-11T22:21:28.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.642+0000 7f4dcb7fe640 1 --2- 172.21.15.100:0/1477085359 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4dd006dac0 0x7f4dd006ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:28.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.642+0000 7f4dcb7fe640 1 -- 172.21.15.100:0/1477085359 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f4ddc0ab460 con 0x7f4dd0008760 2024-09-11T22:21:28.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.642+0000 7f4de2ffd640 1 --2- 172.21.15.100:0/1477085359 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4dd006dac0 0x7f4dd006ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:28.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.642+0000 7f4de2ffd640 1 --2- 172.21.15.100:0/1477085359 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4dd006dac0 0x7f4dd006ff80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4007c30 tx=0x7f4dd4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:28.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.646+0000 7f4dcb7fe640 1 -- 172.21.15.100:0/1477085359 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ddc079970 con 0x7f4dd0008760 2024-09-11T22:21:28.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.890+0000 7f4de9591640 1 -- 172.21.15.100:0/1477085359 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4de40c7f20 con 0x7f4dd0008760 2024-09-11T22:21:28.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.891+0000 7f4dcb7fe640 1 -- 172.21.15.100:0/1477085359 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1561 (secure 0 0 0) 0x7f4ddc079270 con 0x7f4dd0008760 2024-09-11T22:21:28.891 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":8,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:21:28.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.893+0000 7f4de9591640 1 -- 172.21.15.100:0/1477085359 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4dd006dac0 msgr2=0x7f4dd006ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.893+0000 7f4de9591640 1 --2- 172.21.15.100:0/1477085359 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4dd006dac0 0x7f4dd006ff80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4007c30 tx=0x7f4dd4009040 comp rx=0 tx=0).stop 2024-09-11T22:21:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.893+0000 7f4de9591640 1 -- 172.21.15.100:0/1477085359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dd0008760 msgr2=0x7f4de41f3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.893+0000 7f4de9591640 1 --2- 172.21.15.100:0/1477085359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dd0008760 0x7f4de41f3960 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4de40b1ce0 tx=0x7f4ddc0014a0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.893+0000 7f4de9591640 1 -- 172.21.15.100:0/1477085359 shutdown_connections 2024-09-11T22:21:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.893+0000 7f4de9591640 1 --2- 172.21.15.100:0/1477085359 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4dd006dac0 0x7f4dd006ff80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.893+0000 7f4de9591640 1 --2- 172.21.15.100:0/1477085359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dd0008760 0x7f4de41f3960 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.893+0000 7f4de9591640 1 --2- 172.21.15.100:0/1477085359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd0006be0 0x7f4de40c2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.893+0000 7f4de9591640 1 --2- 172.21.15.100:0/1477085359 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd0003b30 0x7f4de40c36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.893+0000 7f4de9591640 1 -- 172.21.15.100:0/1477085359 >> 172.21.15.100:0/1477085359 conn(0x7f4de40cbf70 msgr2=0x7f4de4072bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.893+0000 7f4de9591640 1 -- 172.21.15.100:0/1477085359 shutdown_connections 2024-09-11T22:21:28.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:28.893+0000 7f4de9591640 1 -- 172.21.15.100:0/1477085359 wait complete. 2024-09-11T22:21:28.905 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-11T22:21:28.905 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-11T22:21:28.905 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:21:29.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.010+0000 7f09669ef640 1 Processor -- start 2024-09-11T22:21:29.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.010+0000 7f09669ef640 1 -- start start 2024-09-11T22:21:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.011+0000 7f09669ef640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f09600c8b10 0x7f096006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.011+0000 7f09669ef640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f09600b0c00 0x7f09600cb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.011+0000 7f09669ef640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09600c98f0 con 0x7f0960152a80 2024-09-11T22:21:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.011+0000 7f09669ef640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f0960152e60 con 0x7f09600b0c00 2024-09-11T22:21:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.011+0000 7f09669ef640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f09600c9050 con 0x7f09600c8b10 2024-09-11T22:21:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.011+0000 7f0964f8c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f09600b0c00 0x7f09600cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.011+0000 7f095ffff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f0960152a80 0x7f0960159030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:34764/0 (socket says 172.21.15.100:34764) 2024-09-11T22:21:29.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.011+0000 7f095ffff640 1 -- 172.21.15.100:0/1840081542 learned_addr learned my addr 172.21.15.100:0/1840081542 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:21:29.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.011+0000 7f095f7fe640 1 --2- 172.21.15.100:0/1840081542 >> v2:172.21.15.167:3300/0 conn(0x7f09600c8b10 0x7f096006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:29.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.011+0000 7f0964f8c640 1 -- 172.21.15.100:0/1840081542 >> v2:172.21.15.167:3300/0 conn(0x7f09600c8b10 msgr2=0x7f096006ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:29.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.011+0000 7f0964f8c640 1 --2- 172.21.15.100:0/1840081542 >> v2:172.21.15.167:3300/0 conn(0x7f09600c8b10 0x7f096006ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:29.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.011+0000 7f0964f8c640 1 -- 172.21.15.100:0/1840081542 >> v1:172.21.15.100:6789/0 conn(0x7f0960152a80 legacy=0x7f0960159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:29.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.011+0000 7f0964f8c640 1 -- 172.21.15.100:0/1840081542 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09600c9330 con 0x7f09600b0c00 2024-09-11T22:21:29.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.011+0000 7f095effd640 1 -- 172.21.15.100:0/1840081542 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1557921567 0 0) 0x7f09600c98f0 con 0x7f0960152a80 2024-09-11T22:21:29.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.012+0000 7f0964f8c640 1 --2- 172.21.15.100:0/1840081542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09600b0c00 0x7f09600cb020 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f09600743b0 tx=0x7f095802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f121045d9a347a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:29.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.012+0000 7f095effd640 1 -- 172.21.15.100:0/1840081542 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958007740 con 0x7f09600b0c00 2024-09-11T22:21:29.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.012+0000 7f095effd640 1 -- 172.21.15.100:0/1840081542 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09580078e0 con 0x7f09600b0c00 2024-09-11T22:21:29.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.012+0000 7f095effd640 1 -- 172.21.15.100:0/1840081542 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958007cb0 con 0x7f09600b0c00 2024-09-11T22:21:29.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.013+0000 7f09669ef640 1 -- 172.21.15.100:0/1840081542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09600b0c00 msgr2=0x7f09600cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:29.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.013+0000 7f09669ef640 1 --2- 172.21.15.100:0/1840081542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09600b0c00 0x7f09600cb020 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f09600743b0 tx=0x7f095802a710 comp rx=0 tx=0).stop 2024-09-11T22:21:29.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.013+0000 7f09669ef640 1 -- 172.21.15.100:0/1840081542 shutdown_connections 2024-09-11T22:21:29.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.013+0000 7f09669ef640 1 --2- 172.21.15.100:0/1840081542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09600b0c00 0x7f09600cb020 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:29.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.013+0000 7f09669ef640 1 --2- 172.21.15.100:0/1840081542 >> v2:172.21.15.167:3300/0 conn(0x7f09600c8b10 0x7f096006ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:29.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.013+0000 7f09669ef640 1 -- 172.21.15.100:0/1840081542 >> 172.21.15.100:0/1840081542 conn(0x7f096006e000 msgr2=0x7f096006e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:29.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.013+0000 7f09669ef640 1 -- 172.21.15.100:0/1840081542 shutdown_connections 2024-09-11T22:21:29.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.013+0000 7f09669ef640 1 -- 172.21.15.100:0/1840081542 wait complete. 2024-09-11T22:21:29.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.014+0000 7f09669ef640 1 Processor -- start 2024-09-11T22:21:29.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.014+0000 7f09669ef640 1 -- start start 2024-09-11T22:21:29.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.015+0000 7f09669ef640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09600b0c00 0x7f09600c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:29.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.015+0000 7f09669ef640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09600c8b10 0x7f09600c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:29.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.015+0000 7f09669ef640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0960152a80 0x7f096014d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:29.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.015+0000 7f09669ef640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0960158b10 con 0x7f0960152a80 2024-09-11T22:21:29.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.015+0000 7f09669ef640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0960158830 con 0x7f09600b0c00 2024-09-11T22:21:29.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.015+0000 7f09669ef640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f096015bc60 con 0x7f09600c8b10 2024-09-11T22:21:29.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.015+0000 7f095f7fe640 1 -- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09600c8b10 msgr2=0x7f09600c66d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3301/0 2024-09-11T22:21:29.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.015+0000 7f095f7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09600c8b10 0x7f09600c66d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.015+0000 7f0964f8c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0960152a80 0x7f096014d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.015+0000 7f0964f8c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0960152a80 0x7f096014d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45078/0 (socket says 172.21.15.100:45078) 2024-09-11T22:21:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.015+0000 7f0964f8c640 1 -- 172.21.15.100:0/4045912490 learned_addr learned my addr 172.21.15.100:0/4045912490 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.015+0000 7f095ffff640 1 --2- 172.21.15.100:0/4045912490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09600b0c00 0x7f09600c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.015+0000 7f0964f8c640 1 -- 172.21.15.100:0/4045912490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09600c8b10 msgr2=0x7f09600c66d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:21:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.015+0000 7f0964f8c640 1 --2- 172.21.15.100:0/4045912490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09600c8b10 0x7f09600c66d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.015+0000 7f0964f8c640 1 -- 172.21.15.100:0/4045912490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09600b0c00 msgr2=0x7f09600c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.015+0000 7f0964f8c640 1 --2- 172.21.15.100:0/4045912490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09600b0c00 0x7f09600c6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.015+0000 7f0964f8c640 1 -- 172.21.15.100:0/4045912490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096015b2c0 con 0x7f0960152a80 2024-09-11T22:21:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.016+0000 7f0964f8c640 1 --2- 172.21.15.100:0/4045912490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0960152a80 0x7f096014d1f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0958009e80 tx=0x7f0958004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.016+0000 7f095cff9640 1 -- 172.21.15.100:0/4045912490 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095803f070 con 0x7f0960152a80 2024-09-11T22:21:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.016+0000 7f095cff9640 1 -- 172.21.15.100:0/4045912490 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0958031c40 con 0x7f0960152a80 2024-09-11T22:21:29.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.016+0000 7f09669ef640 1 -- 172.21.15.100:0/4045912490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f096015b950 con 0x7f0960152a80 2024-09-11T22:21:29.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.016+0000 7f095cff9640 1 -- 172.21.15.100:0/4045912490 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0958009450 con 0x7f0960152a80 2024-09-11T22:21:29.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.016+0000 7f09669ef640 1 -- 172.21.15.100:0/4045912490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09600c8440 con 0x7f0960152a80 2024-09-11T22:21:29.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.017+0000 7f09669ef640 1 --2- 172.21.15.100:0/4045912490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f096014b7a0 0x7f096014d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:29.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.017+0000 7f09669ef640 1 -- 172.21.15.100:0/4045912490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f096006ff90 con 0x7f096014b7a0 2024-09-11T22:21:29.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.017+0000 7f095ffff640 1 --2- 172.21.15.100:0/4045912490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f096014b7a0 0x7f096014d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:29.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.017+0000 7f095ffff640 1 -- 172.21.15.100:0/4045912490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0960158610 con 0x7f096014b7a0 2024-09-11T22:21:29.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.017+0000 7f095ffff640 1 --2- 172.21.15.100:0/4045912490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f096014b7a0 0x7f096014d730 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f09500011e0 tx=0x7f0950001990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:29.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.017+0000 7f095cff9640 1 -- 172.21.15.100:0/4045912490 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0958003b90 con 0x7f0960152a80 2024-09-11T22:21:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.018+0000 7f095cff9640 1 --2- 172.21.15.100:0/4045912490 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f094c06bde0 0x7f094c06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.018+0000 7f095cff9640 1 -- 172.21.15.100:0/4045912490 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f09580ac300 con 0x7f0960152a80 2024-09-11T22:21:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.018+0000 7f095f7fe640 1 --2- 172.21.15.100:0/4045912490 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f094c06bde0 0x7f094c06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.018+0000 7f095cff9640 1 -- 172.21.15.100:0/4045912490 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095000f600 con 0x7f096014b7a0 2024-09-11T22:21:29.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.018+0000 7f095cff9640 1 -- 172.21.15.100:0/4045912490 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0950018070 con 0x7f096014b7a0 2024-09-11T22:21:29.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.018+0000 7f095cff9640 1 -- 172.21.15.100:0/4045912490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f096014b7a0 msgr2=0x7f096014d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:29.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.018+0000 7f095cff9640 1 --2- 172.21.15.100:0/4045912490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f096014b7a0 0x7f096014d730 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f09500011e0 tx=0x7f0950001990 comp rx=0 tx=0).stop 2024-09-11T22:21:29.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.018+0000 7f095cff9640 1 -- 172.21.15.100:0/4045912490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f096014b7a0 msgr2=0x7f096014d730 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:21:29.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.018+0000 7f095cff9640 1 --2- 172.21.15.100:0/4045912490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f096014b7a0 0x7f096014d730 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:29.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.018+0000 7f095f7fe640 1 --2- 172.21.15.100:0/4045912490 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f094c06bde0 0x7f094c06e2a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0954006e80 tx=0x7f0954006e10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:29.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.024+0000 7f09669ef640 1 --2- 172.21.15.100:0/4045912490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09601f1350 0x7f09601f1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:29.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.024+0000 7f09669ef640 1 -- 172.21.15.100:0/4045912490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f09600ca1a0 con 0x7f09601f1350 2024-09-11T22:21:29.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.024+0000 7f095ffff640 1 --2- 172.21.15.100:0/4045912490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09601f1350 0x7f09601f1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:29.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.025+0000 7f095ffff640 1 -- 172.21.15.100:0/4045912490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f096014c8b0 con 0x7f09601f1350 2024-09-11T22:21:29.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.025+0000 7f095ffff640 1 --2- 172.21.15.100:0/4045912490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09601f1350 0x7f09601f1760 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f09500011e0 tx=0x7f0950001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:29.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.025+0000 7f095cff9640 1 -- 172.21.15.100:0/4045912490 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0950026450 con 0x7f09601f1350 2024-09-11T22:21:29.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.025+0000 7f095cff9640 1 -- 172.21.15.100:0/4045912490 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5043 (secure 0 0 0) 0x7f09500133f0 con 0x7f09601f1350 2024-09-11T22:21:29.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.025+0000 7f095cff9640 1 -- 172.21.15.100:0/4045912490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09601f1350 msgr2=0x7f09601f1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:29.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.025+0000 7f095cff9640 1 --2- 172.21.15.100:0/4045912490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09601f1350 0x7f09601f1760 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f09500011e0 tx=0x7f0950001080 comp rx=0 tx=0).stop 2024-09-11T22:21:29.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.025+0000 7f095cff9640 1 -- 172.21.15.100:0/4045912490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09601f1350 msgr2=0x7f09601f1760 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:21:29.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.025+0000 7f095cff9640 1 --2- 172.21.15.100:0/4045912490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09601f1350 0x7f09601f1760 secure :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f09500011e0 tx=0x7f0950001080 comp rx=0 tx=0).stop 2024-09-11T22:21:29.027 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:21:29.027 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:21:29.027 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:21:29.027 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:21:29.027 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 8, 2024-09-11T22:21:29.027 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 93044, 2024-09-11T22:21:29.027 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:21:29.027 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:21:29.028 INFO:teuthology.orchestra.run.smithi100.stdout: 1 2024-09-11T22:21:29.028 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:29.028 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:21:29.028 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:21:29.028 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:21:29.028 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:21:29.028 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:29.028 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:29.028 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:29.028 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:29.028 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:29.028 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:21:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:21:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:29.029 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:29.030 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:29.030 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:29.030 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:29.030 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:29.030 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:29.030 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:29.030 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:29.030 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.030 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:21:29.030 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:21:29.030 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:21:29.030 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:21:29.030 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:21:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:21:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:21:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:21:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:21:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:21:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:21:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:21:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:21:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:21:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:21:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:21:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:21:29.031 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:21:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.032 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:21:29.033 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.033 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:21:29.033 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:21:29.033 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:29.033 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:29.033 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.033 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:29.033 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:21:29.033 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:29.033 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.033 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.033 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:21:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:21:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:21:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:21:29.034 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:21:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:21:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:21:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:29.035 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:21:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:21:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:21:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:21:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:29.036 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:21:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:21:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:21:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:21:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:29.037 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:29.038 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:29.038 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:29.038 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.038 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:21:29.038 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:21:29.038 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.038 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:29.038 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:29.038 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:21:29.038 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:29.038 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:29.038 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:21:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 6 2024-09-11T22:21:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:21:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:21:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:29.039 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:21:29.040 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.040 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:29.040 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:29.040 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:21:29.040 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:29.040 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:29.040 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:21:29.040 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.040 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:29.040 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:29.040 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:21:29.040 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:29.040 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:29.041 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.041 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:21:29.041 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:21:29.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.025+0000 7f09669ef640 1 -- 172.21.15.100:0/4045912490 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f094c06bde0 msgr2=0x7f094c06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:29.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.025+0000 7f09669ef640 1 --2- 172.21.15.100:0/4045912490 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f094c06bde0 0x7f094c06e2a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0954006e80 tx=0x7f0954006e10 comp rx=0 tx=0).stop 2024-09-11T22:21:29.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.025+0000 7f09669ef640 1 -- 172.21.15.100:0/4045912490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0960152a80 msgr2=0x7f096014d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:29.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.025+0000 7f09669ef640 1 --2- 172.21.15.100:0/4045912490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0960152a80 0x7f096014d1f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0958009e80 tx=0x7f0958004a40 comp rx=0 tx=0).stop 2024-09-11T22:21:29.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.025+0000 7f0964f8c640 1 -- 172.21.15.100:0/4045912490 reap_dead start 2024-09-11T22:21:29.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.026+0000 7f09669ef640 1 -- 172.21.15.100:0/4045912490 shutdown_connections 2024-09-11T22:21:29.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.026+0000 7f09669ef640 1 --2- 172.21.15.100:0/4045912490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0960152a80 0x7f096014d1f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:29.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.026+0000 7f09669ef640 1 -- 172.21.15.100:0/4045912490 >> 172.21.15.100:0/4045912490 conn(0x7f096006e000 msgr2=0x7f09600c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:29.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.026+0000 7f09669ef640 1 -- 172.21.15.100:0/4045912490 shutdown_connections 2024-09-11T22:21:29.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.026+0000 7f09669ef640 1 -- 172.21.15.100:0/4045912490 wait complete. 2024-09-11T22:21:29.043 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:21:29.043 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-11T22:21:29.043 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:21:29.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.144+0000 7f9cd6cd9640 1 Processor -- start 2024-09-11T22:21:29.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.144+0000 7f9cd6cd9640 1 -- start start 2024-09-11T22:21:29.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.145+0000 7f9cd6cd9640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9cd006d240 0x7f9cd01546b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:29.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.145+0000 7f9cd6cd9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9cd015b2e0 0x7f9cd0154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:29.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.145+0000 7f9cd6cd9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cd00c6510 con 0x7f9cd006ce60 2024-09-11T22:21:29.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.145+0000 7f9cd6cd9640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f9cd015b820 con 0x7f9cd006d240 2024-09-11T22:21:29.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.145+0000 7f9cd6cd9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f9cd00c5470 con 0x7f9cd015b2e0 2024-09-11T22:21:29.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.145+0000 7f9ccffff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9cd006d240 0x7f9cd01546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:29.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.145+0000 7f9ccffff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9cd006d240 0x7f9cd01546b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45098/0 (socket says 172.21.15.100:45098) 2024-09-11T22:21:29.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.145+0000 7f9ccffff640 1 -- 172.21.15.100:0/2904289130 learned_addr learned my addr 172.21.15.100:0/2904289130 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:29.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.145+0000 7f9cd5276640 1 --2- 172.21.15.100:0/2904289130 >> v2:172.21.15.167:3300/0 conn(0x7f9cd015b2e0 0x7f9cd0154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:29.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.145+0000 7f9ccffff640 1 -- 172.21.15.100:0/2904289130 >> v2:172.21.15.167:3300/0 conn(0x7f9cd015b2e0 msgr2=0x7f9cd0154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:29.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.145+0000 7f9ccffff640 1 --2- 172.21.15.100:0/2904289130 >> v2:172.21.15.167:3300/0 conn(0x7f9cd015b2e0 0x7f9cd0154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:29.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.145+0000 7f9ccffff640 1 -- 172.21.15.100:0/2904289130 >> v1:172.21.15.167:6789/0 conn(0x7f9cd006ce60 legacy=0x7f9cd015bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:29.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.145+0000 7f9ccffff640 1 -- 172.21.15.100:0/2904289130 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd00c5750 con 0x7f9cd006d240 2024-09-11T22:21:29.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.146+0000 7f9ccffff640 1 --2- 172.21.15.100:0/2904289130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cd006d240 0x7f9cd01546b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9cd006d780 tx=0x7f9cbc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f75027f781a5946 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:29.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.146+0000 7f9ccf7fe640 1 -- 172.21.15.100:0/2904289130 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc037070 con 0x7f9cd006d240 2024-09-11T22:21:29.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.146+0000 7f9ccf7fe640 1 -- 172.21.15.100:0/2904289130 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cbc032440 con 0x7f9cd006d240 2024-09-11T22:21:29.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.146+0000 7f9ccf7fe640 1 -- 172.21.15.100:0/2904289130 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc032810 con 0x7f9cd006d240 2024-09-11T22:21:29.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.147+0000 7f9cd6cd9640 1 -- 172.21.15.100:0/2904289130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cd006d240 msgr2=0x7f9cd01546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:29.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.147+0000 7f9cd6cd9640 1 --2- 172.21.15.100:0/2904289130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cd006d240 0x7f9cd01546b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9cd006d780 tx=0x7f9cbc02a230 comp rx=0 tx=0).stop 2024-09-11T22:21:29.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.147+0000 7f9cd6cd9640 1 -- 172.21.15.100:0/2904289130 shutdown_connections 2024-09-11T22:21:29.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.147+0000 7f9cd6cd9640 1 --2- 172.21.15.100:0/2904289130 >> v2:172.21.15.167:3300/0 conn(0x7f9cd015b2e0 0x7f9cd0154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:29.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.147+0000 7f9cd6cd9640 1 --2- 172.21.15.100:0/2904289130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cd006d240 0x7f9cd01546b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:29.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.147+0000 7f9cd6cd9640 1 -- 172.21.15.100:0/2904289130 >> 172.21.15.100:0/2904289130 conn(0x7f9cd006bc10 msgr2=0x7f9cd006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:29.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.147+0000 7f9cd6cd9640 1 -- 172.21.15.100:0/2904289130 shutdown_connections 2024-09-11T22:21:29.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.147+0000 7f9cd6cd9640 1 -- 172.21.15.100:0/2904289130 wait complete. 2024-09-11T22:21:29.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.148+0000 7f9cd6cd9640 1 Processor -- start 2024-09-11T22:21:29.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.148+0000 7f9cd6cd9640 1 -- start start 2024-09-11T22:21:29.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.149+0000 7f9cd6cd9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cd006ce60 0x7f9cd014d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:29.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.149+0000 7f9cd6cd9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cd006d240 0x7f9cd014dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:29.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.149+0000 7f9cd6cd9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cd015b2e0 0x7f9cd0155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:29.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.149+0000 7f9cd6cd9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd015c460 con 0x7f9cd006d240 2024-09-11T22:21:29.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.149+0000 7f9cd6cd9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd00c5d10 con 0x7f9cd015b2e0 2024-09-11T22:21:29.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.149+0000 7f9cd6cd9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd00cb1b0 con 0x7f9cd006ce60 2024-09-11T22:21:29.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.149+0000 7f9ccffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cd006d240 0x7f9cd014dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:29.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.149+0000 7f9ccffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cd006d240 0x7f9cd014dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45100/0 (socket says 172.21.15.100:45100) 2024-09-11T22:21:29.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.149+0000 7f9ccffff640 1 -- 172.21.15.100:0/3193529184 learned_addr learned my addr 172.21.15.100:0/3193529184 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:29.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.149+0000 7f9cd4a75640 1 -- 172.21.15.100:0/3193529184 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cd006ce60 msgr2=0x7f9cd014d760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3301/0 2024-09-11T22:21:29.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.149+0000 7f9cd4a75640 1 --2- 172.21.15.100:0/3193529184 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cd006ce60 0x7f9cd014d760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:29.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.149+0000 7f9cd5276640 1 --2- 172.21.15.100:0/3193529184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cd015b2e0 0x7f9cd0155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:29.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.149+0000 7f9ccffff640 1 -- 172.21.15.100:0/3193529184 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cd006ce60 msgr2=0x7f9cd014d760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:21:29.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.149+0000 7f9ccffff640 1 --2- 172.21.15.100:0/3193529184 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cd006ce60 0x7f9cd014d760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:29.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.149+0000 7f9ccffff640 1 -- 172.21.15.100:0/3193529184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cd015b2e0 msgr2=0x7f9cd0155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:29.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.149+0000 7f9ccffff640 1 --2- 172.21.15.100:0/3193529184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cd015b2e0 0x7f9cd0155170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:29.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.149+0000 7f9ccffff640 1 -- 172.21.15.100:0/3193529184 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd00c78a0 con 0x7f9cd006d240 2024-09-11T22:21:29.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.149+0000 7f9ccffff640 1 --2- 172.21.15.100:0/3193529184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cd006d240 0x7f9cd014dca0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc02a270 tx=0x7f9cbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:29.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.150+0000 7f9ccd7fa640 1 -- 172.21.15.100:0/3193529184 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc037040 con 0x7f9cd006d240 2024-09-11T22:21:29.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.150+0000 7f9ccd7fa640 1 -- 172.21.15.100:0/3193529184 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cbc042070 con 0x7f9cd006d240 2024-09-11T22:21:29.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.150+0000 7f9cd6cd9640 1 -- 172.21.15.100:0/3193529184 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd01f0560 con 0x7f9cd006d240 2024-09-11T22:21:29.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.150+0000 7f9ccd7fa640 1 -- 172.21.15.100:0/3193529184 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc030bb0 con 0x7f9cd006d240 2024-09-11T22:21:29.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.150+0000 7f9cd6cd9640 1 -- 172.21.15.100:0/3193529184 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd01f0b00 con 0x7f9cd006d240 2024-09-11T22:21:29.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.150+0000 7f9cd6cd9640 1 --2- 172.21.15.100:0/3193529184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cd014e530 0x7f9cd01556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:29.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.151+0000 7f9cd6cd9640 1 -- 172.21.15.100:0/3193529184 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd00cad20 con 0x7f9cd014e530 2024-09-11T22:21:29.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.151+0000 7f9cd4a75640 1 --2- 172.21.15.100:0/3193529184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cd014e530 0x7f9cd01556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:29.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.151+0000 7f9ccd7fa640 1 -- 172.21.15.100:0/3193529184 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9cbc047460 con 0x7f9cd006d240 2024-09-11T22:21:29.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.151+0000 7f9cd4a75640 1 -- 172.21.15.100:0/3193529184 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9cd00b4860 con 0x7f9cd014e530 2024-09-11T22:21:29.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.151+0000 7f9cd4a75640 1 --2- 172.21.15.100:0/3193529184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cd014e530 0x7f9cd01556b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400c380 tx=0x7f9cc400c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:29.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.151+0000 7f9ccd7fa640 1 --2- 172.21.15.100:0/3193529184 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9cb406bde0 0x7f9cb406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:29.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.152+0000 7f9ccd7fa640 1 -- 172.21.15.100:0/3193529184 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f9cbc0abe70 con 0x7f9cd006d240 2024-09-11T22:21:29.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.152+0000 7f9cd5276640 1 --2- 172.21.15.100:0/3193529184 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9cb406bde0 0x7f9cb406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:29.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.152+0000 7f9ccd7fa640 1 -- 172.21.15.100:0/3193529184 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4017070 con 0x7f9cd014e530 2024-09-11T22:21:29.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.152+0000 7f9ccd7fa640 1 -- 172.21.15.100:0/3193529184 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9cc40074e0 con 0x7f9cd014e530 2024-09-11T22:21:29.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.152+0000 7f9ccd7fa640 1 -- 172.21.15.100:0/3193529184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cd014e530 msgr2=0x7f9cd01556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:29.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.152+0000 7f9ccd7fa640 1 --2- 172.21.15.100:0/3193529184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cd014e530 0x7f9cd01556b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400c380 tx=0x7f9cc400c840 comp rx=0 tx=0).stop 2024-09-11T22:21:29.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.152+0000 7f9ccd7fa640 1 -- 172.21.15.100:0/3193529184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cd014e530 msgr2=0x7f9cd01556b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:21:29.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.152+0000 7f9ccd7fa640 1 --2- 172.21.15.100:0/3193529184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cd014e530 0x7f9cd01556b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:29.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.152+0000 7f9cd5276640 1 --2- 172.21.15.100:0/3193529184 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9cb406bde0 0x7f9cb406e2a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8007f60 tx=0x7f9cc8007650 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:29.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.158+0000 7f9cd6cd9640 1 --2- 172.21.15.100:0/3193529184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cd01f0d40 0x7f9cd01565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:29.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.158+0000 7f9cd6cd9640 1 -- 172.21.15.100:0/3193529184 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd00b4580 con 0x7f9cd01f0d40 2024-09-11T22:21:29.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.159+0000 7f9cd4a75640 1 --2- 172.21.15.100:0/3193529184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cd01f0d40 0x7f9cd01565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:29.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.159+0000 7f9cd4a75640 1 -- 172.21.15.100:0/3193529184 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9cd00b42a0 con 0x7f9cd01f0d40 2024-09-11T22:21:29.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.159+0000 7f9cd4a75640 1 --2- 172.21.15.100:0/3193529184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cd01f0d40 0x7f9cd01565d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4014000 tx=0x7f9cc40037e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:29.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.160+0000 7f9ccd7fa640 1 -- 172.21.15.100:0/3193529184 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4017040 con 0x7f9cd01f0d40 2024-09-11T22:21:29.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.160+0000 7f9ccd7fa640 1 -- 172.21.15.100:0/3193529184 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4874 (secure 0 0 0) 0x7f9cc4012400 con 0x7f9cd01f0d40 2024-09-11T22:21:29.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.160+0000 7f9ccd7fa640 1 -- 172.21.15.100:0/3193529184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cd01f0d40 msgr2=0x7f9cd01565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:29.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.160+0000 7f9ccd7fa640 1 --2- 172.21.15.100:0/3193529184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cd01f0d40 0x7f9cd01565d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4014000 tx=0x7f9cc40037e0 comp rx=0 tx=0).stop 2024-09-11T22:21:29.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.160+0000 7f9ccd7fa640 1 -- 172.21.15.100:0/3193529184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cd01f0d40 msgr2=0x7f9cd01565d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:21:29.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.160+0000 7f9ccd7fa640 1 --2- 172.21.15.100:0/3193529184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cd01f0d40 0x7f9cd01565d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:29.161 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:21:29.161 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:21:29.161 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:21:29.161 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:21:29.162 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 8, 2024-09-11T22:21:29.162 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 93139, 2024-09-11T22:21:29.162 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:21:29.162 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:21:29.162 INFO:teuthology.orchestra.run.smithi100.stdout: 1 2024-09-11T22:21:29.162 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:29.162 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 2, 2024-09-11T22:21:29.162 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:21:29.162 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:21:29.162 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:21:29.162 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:29.163 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:29.163 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:29.163 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:29.163 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:29.163 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:29.163 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:29.163 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:29.163 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:29.163 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:29.163 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:29.163 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:29.163 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:21:29.164 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:21:29.164 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:29.164 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:29.164 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:29.164 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:29.164 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:29.164 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:29.164 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:29.164 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:29.164 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:29.164 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:29.164 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:29.164 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:29.165 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.165 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:21:29.165 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:21:29.165 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:21:29.165 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:21:29.165 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:21:29.165 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:21:29.165 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:21:29.165 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:21:29.165 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:21:29.165 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:21:29.165 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:21:29.165 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:21:29.166 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:21:29.166 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:21:29.166 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:21:29.166 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:21:29.166 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:21:29.166 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:29.166 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:29.166 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:29.166 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:29.166 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:29.166 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:29.166 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:29.166 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:29.166 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:29.167 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:29.167 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:29.167 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:29.167 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:21:29.167 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.167 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:21:29.167 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.167 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:21:29.167 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:21:29.167 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:29.167 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:29.167 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.167 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:29.167 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:21:29.168 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:29.168 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.168 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.168 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:29.168 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:21:29.168 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:29.168 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:29.168 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:29.168 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.168 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:21:29.168 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:21:29.168 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:29.168 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:29.169 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:29.169 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.169 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.169 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:21:29.169 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:21:29.169 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:29.169 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:29.169 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.169 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:29.169 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:21:29.169 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:29.169 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.169 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.170 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:29.170 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:21:29.170 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:29.170 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:29.170 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:29.170 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.170 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:21:29.170 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:21:29.170 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:29.170 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:29.170 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:29.170 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.170 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.171 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:21:29.171 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:21:29.171 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:29.171 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:29.171 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.171 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:29.171 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:21:29.171 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:29.171 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.171 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.171 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:29.171 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:21:29.171 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:29.172 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:29.172 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:29.172 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.172 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:21:29.172 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:21:29.172 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:29.172 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:29.172 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:29.172 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:29.172 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:29.172 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.172 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:21:29.172 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:21:29.173 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.173 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:29.173 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:29.173 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:21:29.173 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:29.173 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:29.173 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:21:29.173 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.173 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:29.173 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:29.173 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:21:29.173 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:29.173 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:29.174 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:21:29.174 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.174 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:29.174 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:29.174 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:21:29.174 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:29.174 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:29.174 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:21:29.174 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:29.174 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:29.174 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:29.174 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:21:29.174 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:29.175 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:29.175 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:29.175 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:21:29.175 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:21:29.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.160+0000 7f9cd6cd9640 1 -- 172.21.15.100:0/3193529184 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9cb406bde0 msgr2=0x7f9cb406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:29.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.160+0000 7f9cd6cd9640 1 --2- 172.21.15.100:0/3193529184 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9cb406bde0 0x7f9cb406e2a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8007f60 tx=0x7f9cc8007650 comp rx=0 tx=0).stop 2024-09-11T22:21:29.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.160+0000 7f9cd6cd9640 1 -- 172.21.15.100:0/3193529184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cd006d240 msgr2=0x7f9cd014dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:29.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.160+0000 7f9cd6cd9640 1 --2- 172.21.15.100:0/3193529184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cd006d240 0x7f9cd014dca0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc02a270 tx=0x7f9cbc0046c0 comp rx=0 tx=0).stop 2024-09-11T22:21:29.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.160+0000 7f9cd5276640 1 -- 172.21.15.100:0/3193529184 reap_dead start 2024-09-11T22:21:29.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.160+0000 7f9cd5276640 1 -- 172.21.15.100:0/3193529184 reap_dead start 2024-09-11T22:21:29.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.160+0000 7f9cd6cd9640 1 -- 172.21.15.100:0/3193529184 shutdown_connections 2024-09-11T22:21:29.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.160+0000 7f9cd6cd9640 1 -- 172.21.15.100:0/3193529184 >> 172.21.15.100:0/3193529184 conn(0x7f9cd006bc10 msgr2=0x7f9cd00b5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:29.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.160+0000 7f9cd6cd9640 1 -- 172.21.15.100:0/3193529184 shutdown_connections 2024-09-11T22:21:29.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:29.160+0000 7f9cd6cd9640 1 -- 172.21.15.100:0/3193529184 wait complete. 2024-09-11T22:21:29.177 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:21:29.177 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-11T22:21:48.777 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:21:48.781 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:21:49.178 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-11T22:21:49.178 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-11T22:21:49.179 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-11T22:21:49.179 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-11T22:21:49.182 INFO:tasks.ceph.mon.c:Started 2024-09-11T22:21:49.182 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:21:49.182 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:21:49.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.298+0000 7f055f5d8640 1 Processor -- start 2024-09-11T22:21:49.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.299+0000 7f055f5d8640 1 -- start start 2024-09-11T22:21:49.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.300+0000 7f055f5d8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0558154c20 0x7f05580cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.300+0000 7f055f5d8640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f05580b3190 0x7f055815e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.300+0000 7f055f5d8640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f055815ac90 con 0x7f055815a7e0 2024-09-11T22:21:49.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.300+0000 7f055f5d8640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f055815e000 con 0x7f05580b3190 2024-09-11T22:21:49.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.300+0000 7f055f5d8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f055815af70 con 0x7f0558154c20 2024-09-11T22:21:49.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.300+0000 7f055db75640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f055815a7e0 0x7f05580cbd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56040/0 (socket says 172.21.15.100:56040) 2024-09-11T22:21:49.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.300+0000 7f055db75640 1 -- 172.21.15.100:0/2011702537 learned_addr learned my addr 172.21.15.100:0/2011702537 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:21:49.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.300+0000 7f055cb73640 1 --2- 172.21.15.100:0/2011702537 >> v2:172.21.15.100:3300/0 conn(0x7f05580b3190 0x7f055815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.300+0000 7f055d374640 1 --2- 172.21.15.100:0/2011702537 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0558154c20 0x7f05580cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.300+0000 7f055d374640 1 -- 172.21.15.100:0/2011702537 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0558154c20 msgr2=0x7f05580cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:21:49.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.300+0000 7f055d374640 1 -- 172.21.15.100:0/2011702537 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0558154c20 msgr2=0x7f05580cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:21:49.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.300+0000 7f055d374640 1 --2- 172.21.15.100:0/2011702537 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0558154c20 0x7f05580cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:49.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.300+0000 7f055d374640 1 --2- 172.21.15.100:0/2011702537 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0558154c20 0x7f05580cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:49.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.300+0000 7f054ffff640 1 -- 172.21.15.100:0/2011702537 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1680559848 0 0) 0x7f055815ac90 con 0x7f055815a7e0 2024-09-11T22:21:49.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.300+0000 7f054ffff640 1 -- 172.21.15.100:0/2011702537 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0544003520 con 0x7f055815a7e0 2024-09-11T22:21:49.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.300+0000 7f055cb73640 1 -- 172.21.15.100:0/2011702537 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0558154c20 msgr2=0x7f05580cb120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:21:49.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.301+0000 7f055cb73640 1 --2- 172.21.15.100:0/2011702537 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0558154c20 0x7f05580cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.301+0000 7f055cb73640 1 -- 172.21.15.100:0/2011702537 >> v1:172.21.15.100:6789/0 conn(0x7f055815a7e0 legacy=0x7f05580cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.301+0000 7f054ffff640 1 -- 172.21.15.100:0/2011702537 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 505605595 0 0) 0x7f0544003520 con 0x7f055815a7e0 2024-09-11T22:21:49.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.301+0000 7f055cb73640 1 -- 172.21.15.100:0/2011702537 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055815b250 con 0x7f05580b3190 2024-09-11T22:21:49.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.302+0000 7f055cb73640 1 --2- 172.21.15.100:0/2011702537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05580b3190 0x7f055815e490 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0548009a00 tx=0x7f054802a390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a9b171e4dbab4f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:49.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.302+0000 7f054ffff640 1 -- 172.21.15.100:0/2011702537 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548037070 con 0x7f05580b3190 2024-09-11T22:21:49.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.302+0000 7f054ffff640 1 -- 172.21.15.100:0/2011702537 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f054802ac10 con 0x7f05580b3190 2024-09-11T22:21:49.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.302+0000 7f054ffff640 1 -- 172.21.15.100:0/2011702537 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05500019f0 con 0x7f05580b3190 2024-09-11T22:21:49.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.303+0000 7f055f5d8640 1 -- 172.21.15.100:0/2011702537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05580b3190 msgr2=0x7f055815e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.303+0000 7f055f5d8640 1 --2- 172.21.15.100:0/2011702537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05580b3190 0x7f055815e490 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0548009a00 tx=0x7f054802a390 comp rx=0 tx=0).stop 2024-09-11T22:21:49.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.303+0000 7f055f5d8640 1 -- 172.21.15.100:0/2011702537 shutdown_connections 2024-09-11T22:21:49.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.303+0000 7f055f5d8640 1 --2- 172.21.15.100:0/2011702537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05580b3190 0x7f055815e490 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.303+0000 7f055f5d8640 1 --2- 172.21.15.100:0/2011702537 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0558154c20 0x7f05580cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.303+0000 7f055f5d8640 1 -- 172.21.15.100:0/2011702537 >> 172.21.15.100:0/2011702537 conn(0x7f0558067d40 msgr2=0x7f055806d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:49.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.303+0000 7f055f5d8640 1 -- 172.21.15.100:0/2011702537 shutdown_connections 2024-09-11T22:21:49.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.303+0000 7f055f5d8640 1 -- 172.21.15.100:0/2011702537 wait complete. 2024-09-11T22:21:49.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.304+0000 7f055f5d8640 1 Processor -- start 2024-09-11T22:21:49.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.304+0000 7f055f5d8640 1 -- start start 2024-09-11T22:21:49.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.305+0000 7f055f5d8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05580b3190 0x7f05581553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.305+0000 7f055f5d8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0558154c20 0x7f0558155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.305+0000 7f055f5d8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f055815a7e0 0x7f0558157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.305+0000 7f055f5d8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f05580cc5a0 con 0x7f0558154c20 2024-09-11T22:21:49.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.305+0000 7f055f5d8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f05580cc420 con 0x7f055815a7e0 2024-09-11T22:21:49.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.305+0000 7f055f5d8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f05580cb660 con 0x7f05580b3190 2024-09-11T22:21:49.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.305+0000 7f055cb73640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0558154c20 0x7f0558155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.305+0000 7f055cb73640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0558154c20 0x7f0558155900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34254/0 (socket says 172.21.15.100:34254) 2024-09-11T22:21:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.305+0000 7f055cb73640 1 -- 172.21.15.100:0/732750418 learned_addr learned my addr 172.21.15.100:0/732750418 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.305+0000 7f055db75640 1 --2- 172.21.15.100:0/732750418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f055815a7e0 0x7f0558157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.305+0000 7f055d374640 1 --2- 172.21.15.100:0/732750418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05580b3190 0x7f05581553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.305+0000 7f055cb73640 1 -- 172.21.15.100:0/732750418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05580b3190 msgr2=0x7f05581553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.305+0000 7f055cb73640 1 --2- 172.21.15.100:0/732750418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05580b3190 0x7f05581553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.305+0000 7f055cb73640 1 -- 172.21.15.100:0/732750418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f055815a7e0 msgr2=0x7f0558157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.305+0000 7f055cb73640 1 --2- 172.21.15.100:0/732750418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f055815a7e0 0x7f0558157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.305+0000 7f055cb73640 1 -- 172.21.15.100:0/732750418 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05580d03f0 con 0x7f0558154c20 2024-09-11T22:21:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.306+0000 7f055cb73640 1 --2- 172.21.15.100:0/732750418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0558154c20 0x7f0558155900 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0548035040 tx=0x7f05480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.306+0000 7f054dffb640 1 -- 172.21.15.100:0/732750418 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548037040 con 0x7f0558154c20 2024-09-11T22:21:49.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.306+0000 7f054dffb640 1 -- 172.21.15.100:0/732750418 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0548041c70 con 0x7f0558154c20 2024-09-11T22:21:49.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.306+0000 7f055f5d8640 1 -- 172.21.15.100:0/732750418 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05580d06d0 con 0x7f0558154c20 2024-09-11T22:21:49.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.306+0000 7f054dffb640 1 -- 172.21.15.100:0/732750418 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054804c680 con 0x7f0558154c20 2024-09-11T22:21:49.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.306+0000 7f055f5d8640 1 -- 172.21.15.100:0/732750418 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0558151e90 con 0x7f0558154c20 2024-09-11T22:21:49.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.308+0000 7f055f5d8640 1 -- 172.21.15.100:0/732750418 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05580b3b30 con 0x7f0558154c20 2024-09-11T22:21:49.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.308+0000 7f054dffb640 1 -- 172.21.15.100:0/732750418 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f054803b070 con 0x7f0558154c20 2024-09-11T22:21:49.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.309+0000 7f054dffb640 1 --2- 172.21.15.100:0/732750418 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f053c06be60 0x7f053c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.309+0000 7f054dffb640 1 -- 172.21.15.100:0/732750418 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f05480ab270 con 0x7f0558154c20 2024-09-11T22:21:49.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.309+0000 7f055d374640 1 --2- 172.21.15.100:0/732750418 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f053c06be60 0x7f053c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.310+0000 7f055d374640 1 --2- 172.21.15.100:0/732750418 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f053c06be60 0x7f053c06e320 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0554006fd0 tx=0x7f0554008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:49.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.317+0000 7f054dffb640 1 -- 172.21.15.100:0/732750418 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05580b3b30 con 0x7f0558154c20 2024-09-11T22:21:49.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.571+0000 7f055f5d8640 1 -- 172.21.15.100:0/732750418 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f05580cb120 con 0x7f0558154c20 2024-09-11T22:21:49.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.572+0000 7f054dffb640 1 -- 172.21.15.100:0/732750418 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f0548079770 con 0x7f0558154c20 2024-09-11T22:21:49.572 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:21:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.574+0000 7f055f5d8640 1 -- 172.21.15.100:0/732750418 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f053c06be60 msgr2=0x7f053c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.574+0000 7f055f5d8640 1 --2- 172.21.15.100:0/732750418 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f053c06be60 0x7f053c06e320 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0554006fd0 tx=0x7f0554008040 comp rx=0 tx=0).stop 2024-09-11T22:21:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.574+0000 7f055f5d8640 1 -- 172.21.15.100:0/732750418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0558154c20 msgr2=0x7f0558155900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.574+0000 7f055f5d8640 1 --2- 172.21.15.100:0/732750418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0558154c20 0x7f0558155900 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0548035040 tx=0x7f05480046c0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.574+0000 7f055f5d8640 1 -- 172.21.15.100:0/732750418 shutdown_connections 2024-09-11T22:21:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.574+0000 7f055f5d8640 1 --2- 172.21.15.100:0/732750418 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f053c06be60 0x7f053c06e320 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.574+0000 7f055f5d8640 1 --2- 172.21.15.100:0/732750418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f055815a7e0 0x7f0558157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.574+0000 7f055f5d8640 1 --2- 172.21.15.100:0/732750418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0558154c20 0x7f0558155900 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.574+0000 7f055f5d8640 1 --2- 172.21.15.100:0/732750418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f05580b3190 0x7f05581553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.574+0000 7f055f5d8640 1 -- 172.21.15.100:0/732750418 >> 172.21.15.100:0/732750418 conn(0x7f0558067d40 msgr2=0x7f05580ccc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:49.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.574+0000 7f055f5d8640 1 -- 172.21.15.100:0/732750418 shutdown_connections 2024-09-11T22:21:49.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.574+0000 7f055f5d8640 1 -- 172.21.15.100:0/732750418 wait complete. 2024-09-11T22:21:49.587 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:21:49.587 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:21:49.587 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:21:49.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.707+0000 7f542ef33640 1 Processor -- start 2024-09-11T22:21:49.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.707+0000 7f542ef33640 1 -- start start 2024-09-11T22:21:49.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.709+0000 7f542ef33640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54280b20e0 0x7f5428072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.709+0000 7f542ef33640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f542806cee0 0x7f5428165360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.709+0000 7f542ef33640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54280687e0 con 0x7f542806c3a0 2024-09-11T22:21:49.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.709+0000 7f542ef33640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f54280c41a0 con 0x7f542806cee0 2024-09-11T22:21:49.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.709+0000 7f542ef33640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5428072860 con 0x7f54280b20e0 2024-09-11T22:21:49.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.709+0000 7f542d4d0640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f542806cee0 0x7f5428165360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.709+0000 7f542d4d0640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f542806cee0 0x7f5428165360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34262/0 (socket says 172.21.15.100:34262) 2024-09-11T22:21:49.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.709+0000 7f5427fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f542806c3a0 0x7f5428073880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:53178/0 (socket says 172.21.15.100:53178) 2024-09-11T22:21:49.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.709+0000 7f5427fff640 1 -- 172.21.15.100:0/410218421 learned_addr learned my addr 172.21.15.100:0/410218421 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:21:49.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.709+0000 7f542cccf640 1 --2- 172.21.15.100:0/410218421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54280b20e0 0x7f5428072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.709+0000 7f542cccf640 1 -- 172.21.15.100:0/410218421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54280b20e0 msgr2=0x7f5428072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:21:49.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.709+0000 7f542cccf640 1 -- 172.21.15.100:0/410218421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54280b20e0 msgr2=0x7f5428072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:21:49.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.709+0000 7f542cccf640 1 --2- 172.21.15.100:0/410218421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54280b20e0 0x7f5428072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:49.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.709+0000 7f542cccf640 1 --2- 172.21.15.100:0/410218421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54280b20e0 0x7f5428072cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:49.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.709+0000 7f54277fe640 1 -- 172.21.15.100:0/410218421 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 174630605 0 0) 0x7f54280687e0 con 0x7f542806c3a0 2024-09-11T22:21:49.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.709+0000 7f54277fe640 1 -- 172.21.15.100:0/410218421 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5410003520 con 0x7f542806c3a0 2024-09-11T22:21:49.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.710+0000 7f54277fe640 1 -- 172.21.15.100:0/410218421 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3881571872 0 0) 0x7f5410003520 con 0x7f542806c3a0 2024-09-11T22:21:49.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.710+0000 7f54277fe640 1 -- 172.21.15.100:0/410218421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54280b20e0 msgr2=0x7f5428072cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:21:49.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.710+0000 7f54277fe640 1 --2- 172.21.15.100:0/410218421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54280b20e0 0x7f5428072cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.710+0000 7f54277fe640 1 -- 172.21.15.100:0/410218421 >> v2:172.21.15.100:3300/0 conn(0x7f542806cee0 msgr2=0x7f5428165360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:49.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.710+0000 7f54277fe640 1 --2- 172.21.15.100:0/410218421 >> v2:172.21.15.100:3300/0 conn(0x7f542806cee0 0x7f5428165360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.710+0000 7f54277fe640 1 -- 172.21.15.100:0/410218421 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542806c890 con 0x7f542806c3a0 2024-09-11T22:21:49.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.710+0000 7f54277fe640 1 -- 172.21.15.100:0/410218421 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f541c001690 con 0x7f542806c3a0 2024-09-11T22:21:49.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.710+0000 7f54277fe640 1 -- 172.21.15.100:0/410218421 >> v1:172.21.15.167:6789/0 conn(0x7f542806c3a0 legacy=0x7f5428073880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.710+0000 7f54277fe640 1 --2- 172.21.15.100:0/410218421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54100039b0 0x7f5410003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.710+0000 7f54277fe640 1 --2- 172.21.15.100:0/410218421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54100043a0 0x7f5410004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.710+0000 7f54277fe640 1 --2- 172.21.15.100:0/410218421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5410004fa0 0x7f541000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.710+0000 7f54277fe640 1 -- 172.21.15.100:0/410218421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5428072860 con 0x7f5410004fa0 2024-09-11T22:21:49.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.710+0000 7f54277fe640 1 -- 172.21.15.100:0/410218421 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f541000bf00 con 0x7f54100043a0 2024-09-11T22:21:49.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.710+0000 7f54277fe640 1 -- 172.21.15.100:0/410218421 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f541000c0b0 con 0x7f54100039b0 2024-09-11T22:21:49.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.710+0000 7f5427fff640 1 --2- 172.21.15.100:0/410218421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54100043a0 0x7f5410004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.710+0000 7f542cccf640 1 --2- 172.21.15.100:0/410218421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54100039b0 0x7f5410003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.710+0000 7f5427fff640 1 -- 172.21.15.100:0/410218421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54100039b0 msgr2=0x7f5410003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:49.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.710+0000 7f5427fff640 1 --2- 172.21.15.100:0/410218421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54100039b0 0x7f5410003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.711+0000 7f5427fff640 1 -- 172.21.15.100:0/410218421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5410004fa0 msgr2=0x7f541000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:49.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.711+0000 7f542d4d0640 1 --2- 172.21.15.100:0/410218421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5410004fa0 0x7f541000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.711+0000 7f5427fff640 1 --2- 172.21.15.100:0/410218421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5410004fa0 0x7f541000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.711+0000 7f5427fff640 1 -- 172.21.15.100:0/410218421 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f542806c890 con 0x7f54100043a0 2024-09-11T22:21:49.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.711+0000 7f542d4d0640 1 --2- 172.21.15.100:0/410218421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5410004fa0 0x7f541000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:21:49.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.712+0000 7f5427fff640 1 --2- 172.21.15.100:0/410218421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54100043a0 0x7f5410004880 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f54280689b0 tx=0x7f5410005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa17c5a97508b22a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:49.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.712+0000 7f54277fe640 1 -- 172.21.15.100:0/410218421 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c036070 con 0x7f54100043a0 2024-09-11T22:21:49.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.712+0000 7f54277fe640 1 -- 172.21.15.100:0/410218421 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f541c005ad0 con 0x7f54100043a0 2024-09-11T22:21:49.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.712+0000 7f54277fe640 1 -- 172.21.15.100:0/410218421 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c007e00 con 0x7f54100043a0 2024-09-11T22:21:49.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.713+0000 7f542ef33640 1 -- 172.21.15.100:0/410218421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54100043a0 msgr2=0x7f5410004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.713+0000 7f542ef33640 1 --2- 172.21.15.100:0/410218421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54100043a0 0x7f5410004880 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f54280689b0 tx=0x7f5410005830 comp rx=0 tx=0).stop 2024-09-11T22:21:49.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.713+0000 7f542d4d0640 1 -- 172.21.15.100:0/410218421 reap_dead start 2024-09-11T22:21:49.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.713+0000 7f542ef33640 1 -- 172.21.15.100:0/410218421 shutdown_connections 2024-09-11T22:21:49.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.713+0000 7f542ef33640 1 -- 172.21.15.100:0/410218421 >> 172.21.15.100:0/410218421 conn(0x7f542806ee80 msgr2=0x7f5428070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:49.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.713+0000 7f542ef33640 1 -- 172.21.15.100:0/410218421 shutdown_connections 2024-09-11T22:21:49.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.713+0000 7f542ef33640 1 -- 172.21.15.100:0/410218421 wait complete. 2024-09-11T22:21:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.715+0000 7f542ef33640 1 Processor -- start 2024-09-11T22:21:49.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.715+0000 7f542ef33640 1 -- start start 2024-09-11T22:21:49.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.716+0000 7f542ef33640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54100043a0 0x7f54280c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.716+0000 7f542ef33640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54280c4930 0x7f54280b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.716+0000 7f542ef33640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5428153c20 0x7f54281540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.716+0000 7f542ef33640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f54280b24c0 con 0x7f5428153c20 2024-09-11T22:21:49.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.716+0000 7f542ef33640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f54280c7e60 con 0x7f54280c4930 2024-09-11T22:21:49.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.716+0000 7f542ef33640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f54280c8140 con 0x7f54100043a0 2024-09-11T22:21:49.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.716+0000 7f542cccf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54100043a0 0x7f54280c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.716+0000 7f542cccf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54100043a0 0x7f54280c41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:51848/0 (socket says 172.21.15.100:51848) 2024-09-11T22:21:49.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.716+0000 7f542cccf640 1 -- 172.21.15.100:0/1414831262 learned_addr learned my addr 172.21.15.100:0/1414831262 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:49.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.716+0000 7f5427fff640 1 --2- 172.21.15.100:0/1414831262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54280c4930 0x7f54280b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.717+0000 7f542d4d0640 1 --2- 172.21.15.100:0/1414831262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5428153c20 0x7f54281540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.717+0000 7f542cccf640 1 -- 172.21.15.100:0/1414831262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54100043a0 msgr2=0x7f54280c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-11T22:21:49.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.717+0000 7f542cccf640 1 -- 172.21.15.100:0/1414831262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54100043a0 msgr2=0x7f54280c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:21:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.717+0000 7f542cccf640 1 --2- 172.21.15.100:0/1414831262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54100043a0 0x7f54280c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.717+0000 7f542cccf640 1 --2- 172.21.15.100:0/1414831262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54100043a0 0x7f54280c41e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.717+0000 7f5427fff640 1 -- 172.21.15.100:0/1414831262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54100043a0 msgr2=0x7f54280c41e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:21:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.717+0000 7f5427fff640 1 --2- 172.21.15.100:0/1414831262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f54100043a0 0x7f54280c41e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.717+0000 7f5427fff640 1 -- 172.21.15.100:0/1414831262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5428153c20 msgr2=0x7f54281540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.717+0000 7f5427fff640 1 --2- 172.21.15.100:0/1414831262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5428153c20 0x7f54281540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.717+0000 7f5427fff640 1 -- 172.21.15.100:0/1414831262 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54281effa0 con 0x7f54280c4930 2024-09-11T22:21:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.717+0000 7f542d4d0640 1 --2- 172.21.15.100:0/1414831262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5428153c20 0x7f54281540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:21:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.717+0000 7f5427fff640 1 --2- 172.21.15.100:0/1414831262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54280c4930 0x7f54280b0cb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f541c030000 tx=0x7f541c001990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.717+0000 7f54257fa640 1 -- 172.21.15.100:0/1414831262 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c036040 con 0x7f54280c4930 2024-09-11T22:21:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.718+0000 7f54257fa640 1 -- 172.21.15.100:0/1414831262 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f541c042070 con 0x7f54280c4930 2024-09-11T22:21:49.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.718+0000 7f54257fa640 1 -- 172.21.15.100:0/1414831262 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c007e00 con 0x7f54280c4930 2024-09-11T22:21:49.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.718+0000 7f542ef33640 1 -- 172.21.15.100:0/1414831262 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54281f0260 con 0x7f54280c4930 2024-09-11T22:21:49.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.718+0000 7f542ef33640 1 -- 172.21.15.100:0/1414831262 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54281f0820 con 0x7f54280c4930 2024-09-11T22:21:49.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.719+0000 7f540effd640 1 --2- 172.21.15.100:0/1414831262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5400002a70 0x7f5400004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.719+0000 7f540effd640 1 -- 172.21.15.100:0/1414831262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5400007ec0 con 0x7f5400002a70 2024-09-11T22:21:49.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.719+0000 7f542cccf640 1 --2- 172.21.15.100:0/1414831262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5400002a70 0x7f5400004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.719+0000 7f542cccf640 1 -- 172.21.15.100:0/1414831262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54000080c0 con 0x7f5400002a70 2024-09-11T22:21:49.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.720+0000 7f542cccf640 1 --2- 172.21.15.100:0/1414831262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5400002a70 0x7f5400004f30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f541800b5f0 tx=0x7f541800bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:49.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.720+0000 7f54257fa640 1 -- 172.21.15.100:0/1414831262 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5418019030 con 0x7f5400002a70 2024-09-11T22:21:49.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.720+0000 7f54257fa640 1 -- 172.21.15.100:0/1414831262 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f54180126e0 con 0x7f5400002a70 2024-09-11T22:21:49.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.720+0000 7f54257fa640 1 -- 172.21.15.100:0/1414831262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5400002a70 msgr2=0x7f5400004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.720+0000 7f54257fa640 1 --2- 172.21.15.100:0/1414831262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5400002a70 0x7f5400004f30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f541800b5f0 tx=0x7f541800bab0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.720+0000 7f54257fa640 1 -- 172.21.15.100:0/1414831262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5400002a70 msgr2=0x7f5400004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:21:49.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.720+0000 7f54257fa640 1 --2- 172.21.15.100:0/1414831262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5400002a70 0x7f5400004f30 secure :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f541800b5f0 tx=0x7f541800bab0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.721+0000 7f54257fa640 1 -- 172.21.15.100:0/1414831262 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f541c047460 con 0x7f54280c4930 2024-09-11T22:21:49.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.724+0000 7f54257fa640 1 --2- 172.21.15.100:0/1414831262 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f541406b910 0x7f541406ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.724+0000 7f54257fa640 1 -- 172.21.15.100:0/1414831262 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f541c0ab610 con 0x7f54280c4930 2024-09-11T22:21:49.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.728+0000 7f542cccf640 1 --2- 172.21.15.100:0/1414831262 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f541406b910 0x7f541406ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.728+0000 7f542cccf640 1 --2- 172.21.15.100:0/1414831262 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f541406b910 0x7f541406ddd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f541800b5f0 tx=0x7f5418017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:49.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.733+0000 7f540effd640 1 --2- 172.21.15.100:0/1414831262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5400006eb0 0x7f5400007340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.733+0000 7f540effd640 1 -- 172.21.15.100:0/1414831262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f540000a4a0 con 0x7f5400006eb0 2024-09-11T22:21:49.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.733+0000 7f542d4d0640 1 --2- 172.21.15.100:0/1414831262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5400006eb0 0x7f5400007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.733+0000 7f542d4d0640 1 -- 172.21.15.100:0/1414831262 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5400007880 con 0x7f5400006eb0 2024-09-11T22:21:49.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.733+0000 7f542d4d0640 1 --2- 172.21.15.100:0/1414831262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5400006eb0 0x7f5400007340 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5428068480 tx=0x7f5420012bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:49.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.734+0000 7f54257fa640 1 -- 172.21.15.100:0/1414831262 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542001c030 con 0x7f5400006eb0 2024-09-11T22:21:49.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.734+0000 7f54257fa640 1 -- 172.21.15.100:0/1414831262 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5056 (secure 0 0 0) 0x7f54200105f0 con 0x7f5400006eb0 2024-09-11T22:21:49.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.734+0000 7f54257fa640 1 -- 172.21.15.100:0/1414831262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5400006eb0 msgr2=0x7f5400007340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.734+0000 7f54257fa640 1 --2- 172.21.15.100:0/1414831262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5400006eb0 0x7f5400007340 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5428068480 tx=0x7f5420012bb0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.734+0000 7f54257fa640 1 -- 172.21.15.100:0/1414831262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5400006eb0 msgr2=0x7f5400007340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:21:49.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.734+0000 7f54257fa640 1 --2- 172.21.15.100:0/1414831262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5400006eb0 0x7f5400007340 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.736 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:21:49.736 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:21:49.736 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:21:49.736 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:21:49.736 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 10, 2024-09-11T22:21:49.736 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 113753, 2024-09-11T22:21:49.736 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:21:49.736 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:21:49.736 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:21:49.736 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:21:49.736 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:49.736 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:21:49.736 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:21:49.737 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:21:49.737 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:21:49.737 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:49.737 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:49.737 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:49.737 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:49.737 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:49.737 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:49.737 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:49.737 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:49.737 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:49.737 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:49.737 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:49.738 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:49.738 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:21:49.738 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:21:49.738 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:49.738 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:49.738 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:49.738 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:49.738 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:49.738 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:49.738 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:49.738 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:49.738 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:49.738 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:49.738 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:49.739 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:49.739 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.739 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:21:49.739 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:21:49.739 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:21:49.739 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:21:49.739 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:21:49.739 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:21:49.739 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:21:49.739 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:21:49.739 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:21:49.739 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:21:49.740 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:21:49.740 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:21:49.740 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:21:49.740 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:21:49.740 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:21:49.740 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:21:49.740 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:21:49.740 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:49.740 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:49.740 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:49.740 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:49.740 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:49.740 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:49.740 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:49.741 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:49.741 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:49.741 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:49.741 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:49.741 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:49.741 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:21:49.741 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.741 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:21:49.741 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.741 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:21:49.741 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:21:49.742 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:49.742 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:49.742 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.742 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:49.742 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:21:49.742 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:49.742 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.742 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.742 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:49.742 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:21:49.742 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:49.742 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:49.743 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:49.743 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.743 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:21:49.743 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:21:49.743 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:49.743 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:49.743 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:49.743 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.743 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.743 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:21:49.743 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:21:49.743 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:49.743 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:49.744 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.744 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:49.744 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:21:49.744 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:49.744 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.744 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.744 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:49.744 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:21:49.744 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:49.744 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:49.744 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:49.745 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.745 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:21:49.745 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:21:49.745 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:49.745 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:49.745 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:49.745 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.745 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.745 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:21:49.745 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:21:49.745 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:49.745 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:49.745 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.745 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:49.746 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:21:49.746 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:49.746 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.746 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.746 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:49.746 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:21:49.746 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:49.746 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:49.746 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:49.746 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.746 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:21:49.746 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:21:49.746 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:49.746 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:49.747 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:49.747 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:49.747 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:49.747 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.747 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:21:49.747 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:21:49.747 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.747 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:49.747 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:49.747 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:21:49.747 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:49.747 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:49.747 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:21:49.747 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.748 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:49.748 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:49.748 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 6 2024-09-11T22:21:49.748 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:49.748 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:49.748 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:21:49.748 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.748 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:49.748 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:49.748 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:21:49.748 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:49.748 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:49.748 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:21:49.748 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.749 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:49.749 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:49.749 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 6 2024-09-11T22:21:49.749 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:49.749 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:49.749 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:21:49.749 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.749 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:49.749 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:49.749 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:21:49.749 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:49.749 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:49.750 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.750 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:21:49.750 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:21:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.734+0000 7f540effd640 1 -- 172.21.15.100:0/1414831262 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f541406b910 msgr2=0x7f541406ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.734+0000 7f540effd640 1 --2- 172.21.15.100:0/1414831262 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f541406b910 0x7f541406ddd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f541800b5f0 tx=0x7f5418017000 comp rx=0 tx=0).stop 2024-09-11T22:21:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.734+0000 7f540effd640 1 -- 172.21.15.100:0/1414831262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54280c4930 msgr2=0x7f54280b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.734+0000 7f540effd640 1 --2- 172.21.15.100:0/1414831262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54280c4930 0x7f54280b0cb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f541c030000 tx=0x7f541c001990 comp rx=0 tx=0).stop 2024-09-11T22:21:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.735+0000 7f542d4d0640 1 -- 172.21.15.100:0/1414831262 reap_dead start 2024-09-11T22:21:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.735+0000 7f540effd640 1 -- 172.21.15.100:0/1414831262 shutdown_connections 2024-09-11T22:21:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.735+0000 7f540effd640 1 -- 172.21.15.100:0/1414831262 >> 172.21.15.100:0/1414831262 conn(0x7f542806ee80 msgr2=0x7f542815e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.735+0000 7f540effd640 1 -- 172.21.15.100:0/1414831262 shutdown_connections 2024-09-11T22:21:49.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.735+0000 7f540effd640 1 -- 172.21.15.100:0/1414831262 wait complete. 2024-09-11T22:21:49.752 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:21:49.752 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:21:49.753 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:21:49.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.863+0000 7f232e1a6640 1 Processor -- start 2024-09-11T22:21:49.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.863+0000 7f232e1a6640 1 -- start start 2024-09-11T22:21:49.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.864+0000 7f232e1a6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f23280c8b10 0x7f232806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.864+0000 7f232e1a6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f23280b0c00 0x7f23280cb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.864+0000 7f232e1a6640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23280c98f0 con 0x7f2328152a80 2024-09-11T22:21:49.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.864+0000 7f232e1a6640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f2328152e60 con 0x7f23280c8b10 2024-09-11T22:21:49.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.864+0000 7f232e1a6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f23280c9050 con 0x7f23280b0c00 2024-09-11T22:21:49.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.864+0000 7f2326ffd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f23280c8b10 0x7f232806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.864+0000 7f2326ffd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f23280c8b10 0x7f232806ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34312/0 (socket says 172.21.15.100:34312) 2024-09-11T22:21:49.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.864+0000 7f2326ffd640 1 -- 172.21.15.100:0/640181614 learned_addr learned my addr 172.21.15.100:0/640181614 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:49.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.865+0000 7f2327fff640 1 --2- 172.21.15.100:0/640181614 >> v2:172.21.15.167:3300/0 conn(0x7f23280b0c00 0x7f23280cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.865+0000 7f2326ffd640 1 -- 172.21.15.100:0/640181614 >> v2:172.21.15.167:3300/0 conn(0x7f23280b0c00 msgr2=0x7f23280cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:49.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.865+0000 7f2326ffd640 1 --2- 172.21.15.100:0/640181614 >> v2:172.21.15.167:3300/0 conn(0x7f23280b0c00 0x7f23280cb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.865+0000 7f2326ffd640 1 -- 172.21.15.100:0/640181614 >> v1:172.21.15.100:6789/0 conn(0x7f2328152a80 legacy=0x7f2328159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:49.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.865+0000 7f2326ffd640 1 -- 172.21.15.100:0/640181614 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23280c9330 con 0x7f23280c8b10 2024-09-11T22:21:49.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.866+0000 7f2326ffd640 1 --2- 172.21.15.100:0/640181614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23280c8b10 0x7f232806ff90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2328073710 tx=0x7f231c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7b754a1cb7858e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:49.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.866+0000 7f23267fc640 1 -- 172.21.15.100:0/640181614 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c037070 con 0x7f23280c8b10 2024-09-11T22:21:49.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.866+0000 7f23267fc640 1 -- 172.21.15.100:0/640181614 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f231c032440 con 0x7f23280c8b10 2024-09-11T22:21:49.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.866+0000 7f23267fc640 1 -- 172.21.15.100:0/640181614 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c032810 con 0x7f23280c8b10 2024-09-11T22:21:49.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.867+0000 7f232e1a6640 1 -- 172.21.15.100:0/640181614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23280c8b10 msgr2=0x7f232806ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.867+0000 7f232e1a6640 1 --2- 172.21.15.100:0/640181614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23280c8b10 0x7f232806ff90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2328073710 tx=0x7f231c02a2c0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.867+0000 7f232e1a6640 1 -- 172.21.15.100:0/640181614 shutdown_connections 2024-09-11T22:21:49.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.867+0000 7f232e1a6640 1 --2- 172.21.15.100:0/640181614 >> v2:172.21.15.167:3300/0 conn(0x7f23280b0c00 0x7f23280cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.867+0000 7f232e1a6640 1 --2- 172.21.15.100:0/640181614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23280c8b10 0x7f232806ff90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.867+0000 7f232e1a6640 1 -- 172.21.15.100:0/640181614 >> 172.21.15.100:0/640181614 conn(0x7f232806e000 msgr2=0x7f232806e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:49.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.867+0000 7f232e1a6640 1 -- 172.21.15.100:0/640181614 shutdown_connections 2024-09-11T22:21:49.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.867+0000 7f232e1a6640 1 -- 172.21.15.100:0/640181614 wait complete. 2024-09-11T22:21:49.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.868+0000 7f232e1a6640 1 Processor -- start 2024-09-11T22:21:49.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.868+0000 7f232e1a6640 1 -- start start 2024-09-11T22:21:49.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.869+0000 7f232e1a6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23280b0c00 0x7f23280cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.869+0000 7f232e1a6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23280c8b10 0x7f23280c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.869+0000 7f232e1a6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2328152a80 0x7f23280c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.869+0000 7f232e1a6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2328158b10 con 0x7f2328152a80 2024-09-11T22:21:49.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.869+0000 7f232e1a6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2328158830 con 0x7f23280b0c00 2024-09-11T22:21:49.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.869+0000 7f232e1a6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f232815bc60 con 0x7f23280c8b10 2024-09-11T22:21:49.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.869+0000 7f2327fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2328152a80 0x7f23280c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.869+0000 7f2327fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2328152a80 0x7f23280c5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34326/0 (socket says 172.21.15.100:34326) 2024-09-11T22:21:49.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.869+0000 7f2327fff640 1 -- 172.21.15.100:0/378331776 learned_addr learned my addr 172.21.15.100:0/378331776 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:49.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.869+0000 7f23277fe640 1 --2- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23280b0c00 0x7f23280cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.869+0000 7f2326ffd640 1 --2- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23280c8b10 0x7f23280c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.870+0000 7f2326ffd640 1 -- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23280c8b10 msgr2=0x7f23280c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-11T22:21:49.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.870+0000 7f2326ffd640 1 -- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23280c8b10 msgr2=0x7f23280c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:21:49.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.870+0000 7f2326ffd640 1 --2- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23280c8b10 0x7f23280c5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:49.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.870+0000 7f2326ffd640 1 --2- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23280c8b10 0x7f23280c5610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:49.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.870+0000 7f2327fff640 1 -- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23280c8b10 msgr2=0x7f23280c5610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:21:49.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.870+0000 7f2327fff640 1 --2- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23280c8b10 0x7f23280c5610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.870+0000 7f2327fff640 1 -- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23280b0c00 msgr2=0x7f23280cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.870+0000 7f2327fff640 1 --2- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23280b0c00 0x7f23280cd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.870+0000 7f2327fff640 1 -- 172.21.15.100:0/378331776 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23281ee660 con 0x7f2328152a80 2024-09-11T22:21:49.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.870+0000 7f2327fff640 1 --2- 172.21.15.100:0/378331776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2328152a80 0x7f23280c5b50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2320007e90 tx=0x7f232000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:49.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.870+0000 7f230ffff640 1 -- 172.21.15.100:0/378331776 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2320014420 con 0x7f2328152a80 2024-09-11T22:21:49.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.870+0000 7f230ffff640 1 -- 172.21.15.100:0/378331776 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2320019070 con 0x7f2328152a80 2024-09-11T22:21:49.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.870+0000 7f230ffff640 1 -- 172.21.15.100:0/378331776 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2320014800 con 0x7f2328152a80 2024-09-11T22:21:49.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.870+0000 7f232e1a6640 1 -- 172.21.15.100:0/378331776 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23281ee900 con 0x7f2328152a80 2024-09-11T22:21:49.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.871+0000 7f232e1a6640 1 -- 172.21.15.100:0/378331776 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23281eeea0 con 0x7f2328152a80 2024-09-11T22:21:49.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.872+0000 7f232e1a6640 1 --2- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f232806ff90 0x7f232815a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.872+0000 7f232e1a6640 1 -- 172.21.15.100:0/378331776 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f23280c3d40 con 0x7f232806ff90 2024-09-11T22:21:49.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.872+0000 7f230ffff640 1 -- 172.21.15.100:0/378331776 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f23200149a0 con 0x7f2328152a80 2024-09-11T22:21:49.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.873+0000 7f23277fe640 1 --2- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f232806ff90 0x7f232815a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.873+0000 7f230ffff640 1 --2- 172.21.15.100:0/378331776 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f231406be60 0x7f231406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.873+0000 7f230ffff640 1 -- 172.21.15.100:0/378331776 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f232008b9b0 con 0x7f2328152a80 2024-09-11T22:21:49.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.873+0000 7f2326ffd640 1 --2- 172.21.15.100:0/378331776 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f231406be60 0x7f231406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.873+0000 7f23277fe640 1 -- 172.21.15.100:0/378331776 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f23280c3a60 con 0x7f232806ff90 2024-09-11T22:21:49.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.874+0000 7f23277fe640 1 --2- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f232806ff90 0x7f232815a7f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f231800f7a0 tx=0x7f231800fc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:49.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.874+0000 7f2326ffd640 1 --2- 172.21.15.100:0/378331776 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f231406be60 0x7f231406e320 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f231c034000 tx=0x7f231c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:49.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.874+0000 7f230ffff640 1 -- 172.21.15.100:0/378331776 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2318018030 con 0x7f232806ff90 2024-09-11T22:21:49.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.874+0000 7f230ffff640 1 -- 172.21.15.100:0/378331776 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2318003940 con 0x7f232806ff90 2024-09-11T22:21:49.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.874+0000 7f230ffff640 1 -- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f232806ff90 msgr2=0x7f232815a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.874+0000 7f230ffff640 1 --2- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f232806ff90 0x7f232815a7f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f231800f7a0 tx=0x7f231800fc60 comp rx=0 tx=0).stop 2024-09-11T22:21:49.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.874+0000 7f230ffff640 1 -- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f232806ff90 msgr2=0x7f232815a7f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:21:49.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.874+0000 7f230ffff640 1 --2- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f232806ff90 0x7f232815a7f0 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f231800f7a0 tx=0x7f231800fc60 comp rx=0 tx=0).stop 2024-09-11T22:21:49.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.886+0000 7f232e1a6640 1 --2- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f232815ad30 0x7f23280c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:49.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.886+0000 7f232e1a6640 1 -- 172.21.15.100:0/378331776 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2328075670 con 0x7f232815ad30 2024-09-11T22:21:49.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.887+0000 7f23277fe640 1 --2- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f232815ad30 0x7f23280c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:49.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.887+0000 7f23277fe640 1 -- 172.21.15.100:0/378331776 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f23280cd750 con 0x7f232815ad30 2024-09-11T22:21:49.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.887+0000 7f23277fe640 1 --2- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f232815ad30 0x7f23280c6d50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2318018000 tx=0x7f2318003760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:49.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.888+0000 7f230ffff640 1 -- 172.21.15.100:0/378331776 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231800d9b0 con 0x7f232815ad30 2024-09-11T22:21:49.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.888+0000 7f230ffff640 1 -- 172.21.15.100:0/378331776 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4887 (secure 0 0 0) 0x7f231800d9b0 con 0x7f232815ad30 2024-09-11T22:21:49.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.888+0000 7f230ffff640 1 -- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f232815ad30 msgr2=0x7f23280c6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.888+0000 7f230ffff640 1 --2- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f232815ad30 0x7f23280c6d50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2318018000 tx=0x7f2318003760 comp rx=0 tx=0).stop 2024-09-11T22:21:49.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.888+0000 7f230ffff640 1 -- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f232815ad30 msgr2=0x7f23280c6d50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:21:49.890 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:21:49.890 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:21:49.890 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:21:49.890 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:21:49.890 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 10, 2024-09-11T22:21:49.890 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 113866, 2024-09-11T22:21:49.890 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:21:49.890 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:21:49.891 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:21:49.891 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:21:49.891 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:49.891 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:21:49.891 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:21:49.891 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:21:49.891 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:21:49.891 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:49.891 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:49.891 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:49.891 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:49.891 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:49.892 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:49.892 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:49.892 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:49.892 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:49.892 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:49.892 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:49.892 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:49.892 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:21:49.892 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:21:49.892 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:49.892 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:49.892 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:49.892 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:49.893 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:49.893 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:49.893 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:49.893 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:49.893 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:49.893 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:49.893 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:49.893 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:49.893 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.893 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:21:49.893 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:21:49.893 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:21:49.893 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:21:49.894 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:21:49.894 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:21:49.894 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:21:49.894 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:21:49.894 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:21:49.894 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:21:49.894 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:21:49.894 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:21:49.894 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:21:49.894 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:21:49.894 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:21:49.894 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:21:49.895 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:21:49.895 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:49.895 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:49.895 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:49.895 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:49.895 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:49.895 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:49.895 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:49.895 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:49.895 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:49.895 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:49.895 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:49.896 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:49.896 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:21:49.896 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.896 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:21:49.896 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.896 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:21:49.896 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:21:49.896 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:49.897 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:49.897 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.897 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:49.897 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:21:49.897 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:49.897 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.897 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.897 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:49.897 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:21:49.897 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:49.897 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:49.897 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:49.897 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.898 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:21:49.898 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:21:49.898 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:49.898 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:49.898 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:49.898 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.898 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.898 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:21:49.898 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:21:49.898 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:49.899 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:49.899 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.899 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:49.899 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:21:49.899 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:49.899 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.899 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.899 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:49.899 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:21:49.899 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:49.899 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:49.899 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:49.900 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.900 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:21:49.900 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:21:49.900 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:49.900 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:49.900 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:49.900 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.900 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.900 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:21:49.900 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:21:49.900 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:49.900 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:49.901 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.901 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:49.901 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:21:49.901 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:49.901 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.901 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.901 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:49.901 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:21:49.901 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:49.901 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:49.901 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:49.901 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.901 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:21:49.902 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:21:49.902 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:49.902 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:49.902 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:49.902 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:49.902 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:49.902 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.902 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:21:49.902 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:21:49.902 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.902 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:49.902 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:49.902 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:21:49.902 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:49.903 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:49.903 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:21:49.903 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.903 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:49.903 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:49.903 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:21:49.903 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:49.903 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:49.903 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:21:49.903 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.903 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:49.903 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:49.903 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:21:49.903 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:49.903 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:49.904 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:21:49.904 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:49.904 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:49.904 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:49.904 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:21:49.904 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:49.904 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:49.904 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:49.904 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:21:49.904 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:21:49.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.888+0000 7f230ffff640 1 --2- 172.21.15.100:0/378331776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f232815ad30 0x7f23280c6d50 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2318018000 tx=0x7f2318003760 comp rx=0 tx=0).stop 2024-09-11T22:21:49.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.892+0000 7f232e1a6640 1 -- 172.21.15.100:0/378331776 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f231406be60 msgr2=0x7f231406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.892+0000 7f232e1a6640 1 --2- 172.21.15.100:0/378331776 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f231406be60 0x7f231406e320 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f231c034000 tx=0x7f231c02e000 comp rx=0 tx=0).stop 2024-09-11T22:21:49.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.892+0000 7f2327fff640 1 -- 172.21.15.100:0/378331776 reap_dead start 2024-09-11T22:21:49.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.892+0000 7f232e1a6640 1 -- 172.21.15.100:0/378331776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2328152a80 msgr2=0x7f23280c5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:49.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.892+0000 7f232e1a6640 1 --2- 172.21.15.100:0/378331776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2328152a80 0x7f23280c5b50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2320007e90 tx=0x7f232000e4b0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.892+0000 7f232e1a6640 1 -- 172.21.15.100:0/378331776 shutdown_connections 2024-09-11T22:21:49.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.892+0000 7f232e1a6640 1 --2- 172.21.15.100:0/378331776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2328152a80 0x7f23280c5b50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:49.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.892+0000 7f232e1a6640 1 -- 172.21.15.100:0/378331776 >> 172.21.15.100:0/378331776 conn(0x7f232806e000 msgr2=0x7f23280cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:49.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.893+0000 7f232e1a6640 1 -- 172.21.15.100:0/378331776 shutdown_connections 2024-09-11T22:21:49.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:49.893+0000 7f232e1a6640 1 -- 172.21.15.100:0/378331776 wait complete. 2024-09-11T22:21:49.907 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:21:49.907 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:21:49.908 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:21:50.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.061+0000 7f89a9d59640 1 Processor -- start 2024-09-11T22:21:50.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.061+0000 7f89a9d59640 1 -- start start 2024-09-11T22:21:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.062+0000 7f89a9d59640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f89a4152c70 0x7f89a40c9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.062+0000 7f89a9d59640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f89a40c9dd0 0x7f89a40ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.063+0000 7f89a9d59640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a40b0f00 con 0x7f89a40c4f80 2024-09-11T22:21:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.063+0000 7f89a9d59640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f89a4153050 con 0x7f89a4152c70 2024-09-11T22:21:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.063+0000 7f89a9d59640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f89a40ca440 con 0x7f89a40c9dd0 2024-09-11T22:21:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.063+0000 7f89a2ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f89a40c9dd0 0x7f89a40ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.063+0000 7f89a2ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f89a40c9dd0 0x7f89a40ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:36742/0 (socket says 172.21.15.100:36742) 2024-09-11T22:21:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.063+0000 7f89a2ffd640 1 -- 172.21.15.100:0/3438951921 learned_addr learned my addr 172.21.15.100:0/3438951921 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.063+0000 7f89a3fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f89a40c4f80 0x7f89a406ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:53194/0 (socket says 172.21.15.100:53194) 2024-09-11T22:21:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.063+0000 7f89a27fc640 1 -- 172.21.15.100:0/3438951921 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2212963066 0 0) 0x7f89a40b0f00 con 0x7f89a40c4f80 2024-09-11T22:21:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.063+0000 7f89a27fc640 1 -- 172.21.15.100:0/3438951921 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f898c003520 con 0x7f89a40c4f80 2024-09-11T22:21:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.063+0000 7f89a2ffd640 1 -- 172.21.15.100:0/3438951921 >> v2:172.21.15.100:3300/0 conn(0x7f89a4152c70 msgr2=0x7f89a40c9820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:21:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.063+0000 7f89a2ffd640 1 --2- 172.21.15.100:0/3438951921 >> v2:172.21.15.100:3300/0 conn(0x7f89a4152c70 0x7f89a40c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.063+0000 7f89a2ffd640 1 -- 172.21.15.100:0/3438951921 >> v1:172.21.15.167:6789/0 conn(0x7f89a40c4f80 legacy=0x7f89a406ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:50.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.063+0000 7f89a2ffd640 1 -- 172.21.15.100:0/3438951921 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a40c33d0 con 0x7f89a40c9dd0 2024-09-11T22:21:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.064+0000 7f89a2ffd640 1 --2- 172.21.15.100:0/3438951921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89a40c9dd0 0x7f89a40ce160 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f89a40c4930 tx=0x7f899802a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f28cbe90224e69e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.065+0000 7f89a27fc640 1 -- 172.21.15.100:0/3438951921 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8998037070 con 0x7f89a40c9dd0 2024-09-11T22:21:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.065+0000 7f89a27fc640 1 -- 172.21.15.100:0/3438951921 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8998032440 con 0x7f89a40c9dd0 2024-09-11T22:21:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.065+0000 7f89a27fc640 1 -- 172.21.15.100:0/3438951921 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8998032810 con 0x7f89a40c9dd0 2024-09-11T22:21:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.066+0000 7f89a9d59640 1 -- 172.21.15.100:0/3438951921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89a40c9dd0 msgr2=0x7f89a40ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.066+0000 7f89a9d59640 1 --2- 172.21.15.100:0/3438951921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89a40c9dd0 0x7f89a40ce160 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f89a40c4930 tx=0x7f899802a1e0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.066+0000 7f89a9d59640 1 -- 172.21.15.100:0/3438951921 shutdown_connections 2024-09-11T22:21:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.066+0000 7f89a9d59640 1 --2- 172.21.15.100:0/3438951921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89a40c9dd0 0x7f89a40ce160 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.066+0000 7f89a9d59640 1 --2- 172.21.15.100:0/3438951921 >> v2:172.21.15.100:3300/0 conn(0x7f89a4152c70 0x7f89a40c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.066+0000 7f89a9d59640 1 -- 172.21.15.100:0/3438951921 >> 172.21.15.100:0/3438951921 conn(0x7f89a406de20 msgr2=0x7f89a406e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:50.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.067+0000 7f89a9d59640 1 -- 172.21.15.100:0/3438951921 shutdown_connections 2024-09-11T22:21:50.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.067+0000 7f89a9d59640 1 -- 172.21.15.100:0/3438951921 wait complete. 2024-09-11T22:21:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.068+0000 7f89a9d59640 1 Processor -- start 2024-09-11T22:21:50.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.069+0000 7f89a9d59640 1 -- start start 2024-09-11T22:21:50.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.070+0000 7f89a9d59640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89a40c4f80 0x7f89a406be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:50.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.070+0000 7f89a9d59640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a40c9dd0 0x7f89a41e4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:50.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.070+0000 7f89a9d59640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89a4152c70 0x7f89a41f4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:50.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.070+0000 7f89a9d59640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f89a40c3990 con 0x7f89a4152c70 2024-09-11T22:21:50.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.070+0000 7f89a9d59640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f89a40ca6e0 con 0x7f89a40c4f80 2024-09-11T22:21:50.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.070+0000 7f89a9d59640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f89a4070610 con 0x7f89a40c9dd0 2024-09-11T22:21:50.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.070+0000 7f89a3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89a4152c70 0x7f89a41f4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:50.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.070+0000 7f89a3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89a4152c70 0x7f89a41f4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34336/0 (socket says 172.21.15.100:34336) 2024-09-11T22:21:50.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.070+0000 7f89a3fff640 1 -- 172.21.15.100:0/3799377062 learned_addr learned my addr 172.21.15.100:0/3799377062 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:50.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.070+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89a40c4f80 0x7f89a406be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:50.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.070+0000 7f89a2ffd640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a40c9dd0 0x7f89a41e4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:50.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.070+0000 7f89a2ffd640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a40c9dd0 msgr2=0x7f89a41e4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-11T22:21:50.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.070+0000 7f89a2ffd640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a40c9dd0 msgr2=0x7f89a41e4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:21:50.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.070+0000 7f89a2ffd640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a40c9dd0 0x7f89a41e4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:50.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.070+0000 7f89a2ffd640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a40c9dd0 0x7f89a41e4f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:50.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.070+0000 7f89a3fff640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a40c9dd0 msgr2=0x7f89a41e4f70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:21:50.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.070+0000 7f89a3fff640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a40c9dd0 0x7f89a41e4f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.070+0000 7f89a3fff640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89a40c4f80 msgr2=0x7f89a406be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:50.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.070+0000 7f89a3fff640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89a40c4f80 0x7f89a406be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:50.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.070+0000 7f89a3fff640 1 -- 172.21.15.100:0/3799377062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a406dbf0 con 0x7f89a4152c70 2024-09-11T22:21:50.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.070+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89a40c4f80 0x7f89a406be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:21:50.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.071+0000 7f89a3fff640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89a4152c70 0x7f89a41f4700 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f899c00c680 tx=0x7f899c00ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:50.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.071+0000 7f898bfff640 1 -- 172.21.15.100:0/3799377062 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c017070 con 0x7f89a4152c70 2024-09-11T22:21:50.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.071+0000 7f898bfff640 1 -- 172.21.15.100:0/3799377062 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f899c007070 con 0x7f89a4152c70 2024-09-11T22:21:50.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.071+0000 7f898bfff640 1 -- 172.21.15.100:0/3799377062 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c007460 con 0x7f89a4152c70 2024-09-11T22:21:50.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.071+0000 7f89a9d59640 1 -- 172.21.15.100:0/3799377062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a406d350 con 0x7f89a4152c70 2024-09-11T22:21:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.072+0000 7f89a9d59640 1 -- 172.21.15.100:0/3799377062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a41f3f00 con 0x7f89a4152c70 2024-09-11T22:21:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.073+0000 7f89a9d59640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 0x7f89a4148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.073+0000 7f89a9d59640 1 -- 172.21.15.100:0/3799377062 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f89a40ce120 con 0x7f89a41f08f0 2024-09-11T22:21:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.073+0000 7f898bfff640 1 -- 172.21.15.100:0/3799377062 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f899c01a070 con 0x7f89a4152c70 2024-09-11T22:21:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.074+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 0x7f89a4148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:50.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.074+0000 7f89a37fe640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 msgr2=0x7f89a4148af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-09-11T22:21:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.074+0000 7f89a37fe640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 msgr2=0x7f89a4148af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:21:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.074+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 0x7f89a4148af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.074+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 0x7f89a4148af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.074+0000 7f898bfff640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f899006be30 0x7f899006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.074+0000 7f898bfff640 1 -- 172.21.15.100:0/3799377062 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f899c08a580 con 0x7f89a4152c70 2024-09-11T22:21:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.074+0000 7f89a2ffd640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f899006be30 0x7f899006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:50.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.075+0000 7f89a2ffd640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f899006be30 0x7f899006e2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8998034000 tx=0x7f899802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:50.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.275+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 0x7f89a4148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:50.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.275+0000 7f89a37fe640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 msgr2=0x7f89a4148af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-11T22:21:50.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.275+0000 7f89a37fe640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 msgr2=0x7f89a4148af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:21:50.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.275+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 0x7f89a4148af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:50.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.275+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 0x7f89a4148af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:21:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.676+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 0x7f89a4148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.676+0000 7f89a37fe640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 msgr2=0x7f89a4148af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-11T22:21:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.676+0000 7f89a37fe640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 msgr2=0x7f89a4148af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:21:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.676+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 0x7f89a4148af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:50.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:50.676+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 0x7f89a4148af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:21:51.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:51.477+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 0x7f89a4148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:51.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:51.478+0000 7f89a37fe640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 msgr2=0x7f89a4148af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-11T22:21:51.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:51.478+0000 7f89a37fe640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 msgr2=0x7f89a4148af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:21:51.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:51.478+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 0x7f89a4148af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:51.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:51.478+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 0x7f89a4148af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:21:53.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:53.080+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 0x7f89a4148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:53.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:53.080+0000 7f89a37fe640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 msgr2=0x7f89a4148af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-11T22:21:53.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:53.080+0000 7f89a37fe640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 msgr2=0x7f89a4148af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:21:53.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:53.080+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 0x7f89a4148af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:53.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:53.080+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 0x7f89a4148af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-11T22:21:54.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.070+0000 7f898affd640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 msgr2=0x7f89a4148af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:21:54.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.070+0000 7f898affd640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 0x7f89a4148af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.070+0000 7f898affd640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f897c003540 0x7f897c0059d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.070+0000 7f898affd640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 msgr2=0x7f89a4148af0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:21:54.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.070+0000 7f898affd640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a41f08f0 0x7f89a4148af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.070+0000 7f898affd640 1 -- 172.21.15.100:0/3799377062 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f89a40ce120 con 0x7f897c003540 2024-09-11T22:21:54.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.070+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f897c003540 0x7f897c0059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.071+0000 7f89a37fe640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f897c003540 msgr2=0x7f897c0059d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-11T22:21:54.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.071+0000 7f89a37fe640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f897c003540 msgr2=0x7f897c0059d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:21:54.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.071+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f897c003540 0x7f897c0059d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:54.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.071+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f897c003540 0x7f897c0059d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:21:54.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.272+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f897c003540 0x7f897c0059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.272+0000 7f89a37fe640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f897c003540 msgr2=0x7f897c0059d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 21 2024-09-11T22:21:54.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.272+0000 7f89a37fe640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f897c003540 msgr2=0x7f897c0059d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:21:54.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.272+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f897c003540 0x7f897c0059d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:21:54.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.272+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f897c003540 0x7f897c0059d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:21:54.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.673+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f897c003540 0x7f897c0059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.673+0000 7f89a37fe640 1 -- 172.21.15.100:0/3799377062 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f897c0060b0 con 0x7f897c003540 2024-09-11T22:21:54.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.674+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f897c003540 0x7f897c0059d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f899401abb0 tx=0x7f8994017810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:54.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.674+0000 7f898bfff640 1 -- 172.21.15.100:0/3799377062 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8994018450 con 0x7f897c003540 2024-09-11T22:21:54.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.674+0000 7f898bfff640 1 -- 172.21.15.100:0/3799377062 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8994018450 con 0x7f897c003540 2024-09-11T22:21:54.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.674+0000 7f898bfff640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f897c003540 msgr2=0x7f897c0059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.674+0000 7f898bfff640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f897c003540 0x7f897c0059d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f899401abb0 tx=0x7f8994017810 comp rx=0 tx=0).stop 2024-09-11T22:21:54.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.674+0000 7f898bfff640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f897c003540 msgr2=0x7f897c0059d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:21:54.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.674+0000 7f898bfff640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f897c003540 0x7f897c0059d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.686+0000 7f89a9d59640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a406ce80 0x7f89a4149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.686+0000 7f89a9d59640 1 -- 172.21.15.100:0/3799377062 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f89a4070da0 con 0x7f89a406ce80 2024-09-11T22:21:54.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.687+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a406ce80 0x7f89a4149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.687+0000 7f89a37fe640 1 -- 172.21.15.100:0/3799377062 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f89a40c8a20 con 0x7f89a406ce80 2024-09-11T22:21:54.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.687+0000 7f89a37fe640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a406ce80 0x7f89a4149030 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f899401abb0 tx=0x7f89940046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:54.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.688+0000 7f898bfff640 1 -- 172.21.15.100:0/3799377062 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8994006510 con 0x7f89a406ce80 2024-09-11T22:21:54.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.688+0000 7f898bfff640 1 -- 172.21.15.100:0/3799377062 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4551 (secure 0 0 0) 0x7f899402a040 con 0x7f89a406ce80 2024-09-11T22:21:54.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.688+0000 7f898bfff640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a406ce80 msgr2=0x7f89a4149030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.688+0000 7f898bfff640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a406ce80 0x7f89a4149030 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f899401abb0 tx=0x7f89940046c0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.688+0000 7f898bfff640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a406ce80 msgr2=0x7f89a4149030 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:21:54.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.688+0000 7f898bfff640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f89a406ce80 0x7f89a4149030 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.689 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:21:54.689 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:21:54.690 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:21:54.690 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:21:54.690 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 10, 2024-09-11T22:21:54.690 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 5408, 2024-09-11T22:21:54.690 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:21:54.690 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:21:54.690 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:21:54.690 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:21:54.690 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:54.690 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 5, 2024-09-11T22:21:54.690 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:21:54.690 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:21:54.690 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:21:54.691 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:54.691 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:54.691 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:54.691 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:54.691 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:54.691 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:54.691 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:54.691 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:54.691 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:54.691 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:54.691 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:54.691 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:54.691 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:21:54.691 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:21:54.692 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:54.692 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:54.692 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:54.692 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:54.692 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:54.692 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:54.692 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:54.692 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:54.692 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:54.692 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:54.692 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:54.692 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:54.692 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:54.692 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:21:54.693 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:21:54.693 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:21:54.693 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:21:54.693 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:21:54.693 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:21:54.693 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:21:54.693 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:21:54.693 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:21:54.693 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:21:54.693 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:21:54.693 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:21:54.693 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:21:54.694 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:21:54.694 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:21:54.694 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:21:54.694 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:21:54.694 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:21:54.694 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:21:54.694 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:21:54.694 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:21:54.694 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:21:54.694 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:21:54.694 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:21:54.694 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:21:54.694 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:21:54.694 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:21:54.695 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:21:54.695 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:54.695 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:21:54.695 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:54.695 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:21:54.695 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:54.695 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:21:54.695 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:21:54.695 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:54.695 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:54.695 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:54.695 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:54.695 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:21:54.696 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:54.696 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:54.696 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:54.696 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:54.696 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:21:54.696 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:54.696 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:54.696 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:54.696 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:54.696 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:21:54.696 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:21:54.696 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:54.696 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:54.696 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:54.697 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:54.697 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:54.697 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:21:54.697 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:21:54.697 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:54.697 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:54.697 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:54.697 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:54.697 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:21:54.697 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:54.697 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:54.697 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:54.697 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:54.697 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:21:54.698 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:54.698 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:54.698 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:54.698 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:54.698 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:21:54.698 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:21:54.698 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:54.698 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:54.698 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:54.698 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:54.698 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:54.698 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:21:54.698 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:21:54.698 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:21:54.699 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:21:54.699 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:54.699 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:21:54.699 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:21:54.699 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:54.699 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:54.699 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:54.699 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:21:54.699 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:21:54.699 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:21:54.699 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:54.699 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:54.699 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:54.699 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:21:54.700 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:21:54.700 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:21:54.700 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:21:54.700 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:21:54.700 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:54.700 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:54.700 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:54.700 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:21:54.700 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:21:54.700 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:54.700 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:54.700 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:54.700 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:21:54.700 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:54.701 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:21:54.701 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:21:54.701 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:21:54.701 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:21:54.701 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:21:54.701 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:21:54.701 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:21:54.701 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:21:54.701 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:21:54.701 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:21:54.701 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:21:54.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.688+0000 7f89a3fff640 1 -- 172.21.15.100:0/3799377062 reap_dead start 2024-09-11T22:21:54.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.688+0000 7f89a9d59640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f899006be30 msgr2=0x7f899006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.688+0000 7f89a9d59640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f899006be30 0x7f899006e2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8998034000 tx=0x7f899802e000 comp rx=0 tx=0).stop 2024-09-11T22:21:54.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.688+0000 7f89a9d59640 1 -- 172.21.15.100:0/3799377062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89a4152c70 msgr2=0x7f89a41f4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.688+0000 7f89a9d59640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89a4152c70 0x7f89a41f4700 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f899c00c680 tx=0x7f899c00ca80 comp rx=0 tx=0).stop 2024-09-11T22:21:54.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.688+0000 7f89a9d59640 1 -- 172.21.15.100:0/3799377062 shutdown_connections 2024-09-11T22:21:54.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.688+0000 7f89a9d59640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f899006be30 0x7f899006e2f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.688+0000 7f89a9d59640 1 --2- 172.21.15.100:0/3799377062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89a4152c70 0x7f89a41f4700 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.688+0000 7f89a9d59640 1 -- 172.21.15.100:0/3799377062 >> 172.21.15.100:0/3799377062 conn(0x7f89a406de20 msgr2=0x7f89a40b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:54.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.689+0000 7f89a9d59640 1 -- 172.21.15.100:0/3799377062 shutdown_connections 2024-09-11T22:21:54.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.689+0000 7f89a9d59640 1 -- 172.21.15.100:0/3799377062 wait complete. 2024-09-11T22:21:54.704 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:21:54.704 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-11T22:21:54.704 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-11T22:21:54.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.804+0000 7fc4623a2640 1 Processor -- start 2024-09-11T22:21:54.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.804+0000 7fc4623a2640 1 -- start start 2024-09-11T22:21:54.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.805+0000 7fc4623a2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc45c067bc0 0x7fc45c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.805+0000 7fc4623a2640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc45c067fa0 0x7fc45c072e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.805+0000 7fc4623a2640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc45c073f90 con 0x7fc45c073a50 2024-09-11T22:21:54.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.805+0000 7fc4623a2640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fc45c0c76a0 con 0x7fc45c067fa0 2024-09-11T22:21:54.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.805+0000 7fc4623a2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc45c0c8220 con 0x7fc45c067bc0 2024-09-11T22:21:54.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.806+0000 7fc461ba1640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc45c073a50 0x7fc45c0c5d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57798/0 (socket says 172.21.15.100:57798) 2024-09-11T22:21:54.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.806+0000 7fc461ba1640 1 -- 172.21.15.100:0/390143337 learned_addr learned my addr 172.21.15.100:0/390143337 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:21:54.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.806+0000 7fc4613a0640 1 --2- 172.21.15.100:0/390143337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc45c067bc0 0x7fc45c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.806+0000 7fc460b9f640 1 --2- 172.21.15.100:0/390143337 >> v2:172.21.15.167:3300/0 conn(0x7fc45c067fa0 0x7fc45c072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.806+0000 7fc453fff640 1 -- 172.21.15.100:0/390143337 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1714052780 0 0) 0x7fc45c073f90 con 0x7fc45c073a50 2024-09-11T22:21:54.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.806+0000 7fc453fff640 1 -- 172.21.15.100:0/390143337 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc448003520 con 0x7fc45c073a50 2024-09-11T22:21:54.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.806+0000 7fc4613a0640 1 -- 172.21.15.100:0/390143337 >> v2:172.21.15.167:3300/0 conn(0x7fc45c067fa0 msgr2=0x7fc45c072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:21:54.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.806+0000 7fc4613a0640 1 --2- 172.21.15.100:0/390143337 >> v2:172.21.15.167:3300/0 conn(0x7fc45c067fa0 0x7fc45c072e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.806+0000 7fc4613a0640 1 -- 172.21.15.100:0/390143337 >> v1:172.21.15.100:6789/0 conn(0x7fc45c073a50 legacy=0x7fc45c0c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.806+0000 7fc4613a0640 1 -- 172.21.15.100:0/390143337 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc45c0c78f0 con 0x7fc45c067bc0 2024-09-11T22:21:54.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.806+0000 7fc460b9f640 1 --2- 172.21.15.100:0/390143337 >> v2:172.21.15.167:3300/0 conn(0x7fc45c067fa0 0x7fc45c072e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:21:54.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.807+0000 7fc4613a0640 1 --2- 172.21.15.100:0/390143337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc45c067bc0 0x7fc45c06c330 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc4580097a0 tx=0x7fc45802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a17dbfbc0779532f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:54.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.807+0000 7fc453fff640 1 -- 172.21.15.100:0/390143337 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc458037070 con 0x7fc45c067bc0 2024-09-11T22:21:54.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.807+0000 7fc453fff640 1 -- 172.21.15.100:0/390143337 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc458032440 con 0x7fc45c067bc0 2024-09-11T22:21:54.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.807+0000 7fc453fff640 1 -- 172.21.15.100:0/390143337 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4580327f0 con 0x7fc45c067bc0 2024-09-11T22:21:54.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.808+0000 7fc4623a2640 1 -- 172.21.15.100:0/390143337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc45c067bc0 msgr2=0x7fc45c06c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.808+0000 7fc4623a2640 1 --2- 172.21.15.100:0/390143337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc45c067bc0 0x7fc45c06c330 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc4580097a0 tx=0x7fc45802a180 comp rx=0 tx=0).stop 2024-09-11T22:21:54.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.808+0000 7fc4623a2640 1 -- 172.21.15.100:0/390143337 shutdown_connections 2024-09-11T22:21:54.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.808+0000 7fc4623a2640 1 --2- 172.21.15.100:0/390143337 >> v2:172.21.15.167:3300/0 conn(0x7fc45c067fa0 0x7fc45c072e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.808+0000 7fc4623a2640 1 --2- 172.21.15.100:0/390143337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc45c067bc0 0x7fc45c06c330 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.808+0000 7fc4623a2640 1 -- 172.21.15.100:0/390143337 >> 172.21.15.100:0/390143337 conn(0x7fc45c0c98a0 msgr2=0x7fc45c0c9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:54.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.808+0000 7fc4623a2640 1 -- 172.21.15.100:0/390143337 shutdown_connections 2024-09-11T22:21:54.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.808+0000 7fc4623a2640 1 -- 172.21.15.100:0/390143337 wait complete. 2024-09-11T22:21:54.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.809+0000 7fc4623a2640 1 Processor -- start 2024-09-11T22:21:54.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.810+0000 7fc4623a2640 1 -- start start 2024-09-11T22:21:54.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.810+0000 7fc4623a2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc45c067bc0 0x7fc45c1f42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.810+0000 7fc4623a2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc45c067fa0 0x7fc45c1500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.810+0000 7fc4623a2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc45c073a50 0x7fc45c1f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.810+0000 7fc460b9f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc45c067fa0 0x7fc45c1500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.810+0000 7fc460b9f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc45c067fa0 0x7fc45c1500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56150/0 (socket says 172.21.15.100:56150) 2024-09-11T22:21:54.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.810+0000 7fc460b9f640 1 -- 172.21.15.100:0/71427974 learned_addr learned my addr 172.21.15.100:0/71427974 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:21:54.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.810+0000 7fc4623a2640 1 -- 172.21.15.100:0/71427974 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc45c06c870 con 0x7fc45c067fa0 2024-09-11T22:21:54.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.810+0000 7fc4623a2640 1 -- 172.21.15.100:0/71427974 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc45c0c7eb0 con 0x7fc45c067bc0 2024-09-11T22:21:54.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.810+0000 7fc4613a0640 1 --2- 172.21.15.100:0/71427974 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc45c067bc0 0x7fc45c1f42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.810+0000 7fc4623a2640 1 -- 172.21.15.100:0/71427974 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc45c073390 con 0x7fc45c073a50 2024-09-11T22:21:54.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.811+0000 7fc461ba1640 1 --2- 172.21.15.100:0/71427974 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc45c073a50 0x7fc45c1f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.811+0000 7fc460b9f640 1 -- 172.21.15.100:0/71427974 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc45c073a50 msgr2=0x7fc45c1f0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.811+0000 7fc460b9f640 1 --2- 172.21.15.100:0/71427974 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc45c073a50 0x7fc45c1f0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.811+0000 7fc460b9f640 1 -- 172.21.15.100:0/71427974 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc45c067bc0 msgr2=0x7fc45c1f42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:54.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.811+0000 7fc460b9f640 1 --2- 172.21.15.100:0/71427974 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc45c067bc0 0x7fc45c1f42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:54.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.811+0000 7fc460b9f640 1 -- 172.21.15.100:0/71427974 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc45c0c3610 con 0x7fc45c067fa0 2024-09-11T22:21:54.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.811+0000 7fc4613a0640 1 --2- 172.21.15.100:0/71427974 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc45c067bc0 0x7fc45c1f42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:21:54.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.811+0000 7fc460b9f640 1 --2- 172.21.15.100:0/71427974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc45c067fa0 0x7fc45c1500a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc44c00ec10 tx=0x7fc44c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:54.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.811+0000 7fc451ffb640 1 -- 172.21.15.100:0/71427974 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c017070 con 0x7fc45c067fa0 2024-09-11T22:21:54.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.811+0000 7fc451ffb640 1 -- 172.21.15.100:0/71427974 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc44c00cc30 con 0x7fc45c067fa0 2024-09-11T22:21:54.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.811+0000 7fc451ffb640 1 -- 172.21.15.100:0/71427974 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c013470 con 0x7fc45c067fa0 2024-09-11T22:21:54.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.811+0000 7fc4623a2640 1 -- 172.21.15.100:0/71427974 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc45c14f9a0 con 0x7fc45c067fa0 2024-09-11T22:21:54.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.812+0000 7fc4623a2640 1 -- 172.21.15.100:0/71427974 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc45c0c3050 con 0x7fc45c067fa0 2024-09-11T22:21:54.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.813+0000 7fc4623a2640 1 -- 172.21.15.100:0/71427974 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc45c06bdd0 con 0x7fc45c067fa0 2024-09-11T22:21:54.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.813+0000 7fc451ffb640 1 -- 172.21.15.100:0/71427974 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc44c01a070 con 0x7fc45c067fa0 2024-09-11T22:21:54.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.814+0000 7fc451ffb640 1 --2- 172.21.15.100:0/71427974 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc44006be30 0x7fc44006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:21:54.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.814+0000 7fc451ffb640 1 -- 172.21.15.100:0/71427974 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fc44c08b0d0 con 0x7fc45c067fa0 2024-09-11T22:21:54.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.814+0000 7fc4613a0640 1 --2- 172.21.15.100:0/71427974 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc44006be30 0x7fc44006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:21:54.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.814+0000 7fc4613a0640 1 --2- 172.21.15.100:0/71427974 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc44006be30 0x7fc44006e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc458034000 tx=0x7fc45802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:21:54.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:54.818+0000 7fc451ffb640 1 -- 172.21.15.100:0/71427974 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc44c0590a0 con 0x7fc45c067fa0 2024-09-11T22:21:55.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:55.061+0000 7fc4623a2640 1 -- 172.21.15.100:0/71427974 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fc45c151f90 con 0x7fc45c067fa0 2024-09-11T22:21:55.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:55.061+0000 7fc451ffb640 1 -- 172.21.15.100:0/71427974 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fc44c05d3a0 con 0x7fc45c067fa0 2024-09-11T22:21:55.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:55.064+0000 7fc4623a2640 1 -- 172.21.15.100:0/71427974 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc44006be30 msgr2=0x7fc44006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:55.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:55.064+0000 7fc4623a2640 1 --2- 172.21.15.100:0/71427974 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc44006be30 0x7fc44006e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc458034000 tx=0x7fc45802e000 comp rx=0 tx=0).stop 2024-09-11T22:21:55.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:55.065+0000 7fc4623a2640 1 -- 172.21.15.100:0/71427974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc45c067fa0 msgr2=0x7fc45c1500a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:21:55.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:55.065+0000 7fc4623a2640 1 --2- 172.21.15.100:0/71427974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc45c067fa0 0x7fc45c1500a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc44c00ec10 tx=0x7fc44c00c520 comp rx=0 tx=0).stop 2024-09-11T22:21:55.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:55.065+0000 7fc4623a2640 1 -- 172.21.15.100:0/71427974 shutdown_connections 2024-09-11T22:21:55.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:55.065+0000 7fc4623a2640 1 --2- 172.21.15.100:0/71427974 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc44006be30 0x7fc44006e2f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:55.065+0000 7fc4623a2640 1 --2- 172.21.15.100:0/71427974 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc45c073a50 0x7fc45c1f0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:55.065+0000 7fc4623a2640 1 --2- 172.21.15.100:0/71427974 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc45c067fa0 0x7fc45c1500a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:55.065+0000 7fc4623a2640 1 --2- 172.21.15.100:0/71427974 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc45c067bc0 0x7fc45c1f42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:21:55.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:55.065+0000 7fc4623a2640 1 -- 172.21.15.100:0/71427974 >> 172.21.15.100:0/71427974 conn(0x7fc45c0c98a0 msgr2=0x7fc45c0cd550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:21:55.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:55.065+0000 7fc4623a2640 1 -- 172.21.15.100:0/71427974 shutdown_connections 2024-09-11T22:21:55.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:21:55.065+0000 7fc4623a2640 1 -- 172.21.15.100:0/71427974 wait complete. 2024-09-11T22:21:55.080 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-11T22:22:05.081 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:22:05.082 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:22:05.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.183+0000 7fae1eaed640 1 Processor -- start 2024-09-11T22:22:05.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.183+0000 7fae1eaed640 1 -- start start 2024-09-11T22:22:05.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.184+0000 7fae1eaed640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fae18157fd0 0x7fae180c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.184+0000 7fae1eaed640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae1815e070 0x7fae1815e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.184+0000 7fae1eaed640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae1815a950 con 0x7fae1806bc10 2024-09-11T22:22:05.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.184+0000 7fae1eaed640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fae181583b0 con 0x7fae18157fd0 2024-09-11T22:22:05.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.184+0000 7fae1eaed640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fae1815e9e0 con 0x7fae1815e070 2024-09-11T22:22:05.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.184+0000 7fae17fff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fae1806bc10 0x7fae180ccf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56468/0 (socket says 172.21.15.100:56468) 2024-09-11T22:22:05.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.184+0000 7fae17fff640 1 -- 172.21.15.100:0/2650557663 learned_addr learned my addr 172.21.15.100:0/2650557663 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:22:05.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.184+0000 7fae1d08a640 1 --2- 172.21.15.100:0/2650557663 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae1815e070 0x7fae1815e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.184+0000 7fae1c889640 1 --2- 172.21.15.100:0/2650557663 >> v2:172.21.15.167:3300/0 conn(0x7fae18157fd0 0x7fae180c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.184+0000 7fae177fe640 1 -- 172.21.15.100:0/2650557663 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 474148709 0 0) 0x7fae04001110 con 0x7fae1806bc10 2024-09-11T22:22:05.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.184+0000 7fae177fe640 1 -- 172.21.15.100:0/2650557663 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae08003520 con 0x7fae1806bc10 2024-09-11T22:22:05.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.185+0000 7fae1c889640 1 -- 172.21.15.100:0/2650557663 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae1815e070 msgr2=0x7fae1815e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:05.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.185+0000 7fae1c889640 1 --2- 172.21.15.100:0/2650557663 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae1815e070 0x7fae1815e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.185+0000 7fae1c889640 1 -- 172.21.15.100:0/2650557663 >> v1:172.21.15.100:6789/0 conn(0x7fae1806bc10 legacy=0x7fae180ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.185+0000 7fae177fe640 1 -- 172.21.15.100:0/2650557663 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1005728377 0 0) 0x7fae08003520 con 0x7fae1806bc10 2024-09-11T22:22:05.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.185+0000 7fae1c889640 1 -- 172.21.15.100:0/2650557663 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1815abd0 con 0x7fae18157fd0 2024-09-11T22:22:05.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.185+0000 7fae1d08a640 1 --2- 172.21.15.100:0/2650557663 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae1815e070 0x7fae1815e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:05.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.185+0000 7fae1c889640 1 --2- 172.21.15.100:0/2650557663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae18157fd0 0x7fae180c8ca0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fae0c0097a0 tx=0x7fae0c02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7c5950fba671052 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:05.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.186+0000 7fae177fe640 1 -- 172.21.15.100:0/2650557663 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c037070 con 0x7fae18157fd0 2024-09-11T22:22:05.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.186+0000 7fae177fe640 1 -- 172.21.15.100:0/2650557663 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae0c02ac30 con 0x7fae18157fd0 2024-09-11T22:22:05.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.186+0000 7fae177fe640 1 -- 172.21.15.100:0/2650557663 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae04001840 con 0x7fae18157fd0 2024-09-11T22:22:05.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.186+0000 7fae1eaed640 1 -- 172.21.15.100:0/2650557663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae18157fd0 msgr2=0x7fae180c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.186+0000 7fae1eaed640 1 --2- 172.21.15.100:0/2650557663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae18157fd0 0x7fae180c8ca0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fae0c0097a0 tx=0x7fae0c02a1a0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.186+0000 7fae1eaed640 1 -- 172.21.15.100:0/2650557663 shutdown_connections 2024-09-11T22:22:05.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.186+0000 7fae1eaed640 1 --2- 172.21.15.100:0/2650557663 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae1815e070 0x7fae1815e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.186+0000 7fae1eaed640 1 --2- 172.21.15.100:0/2650557663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae18157fd0 0x7fae180c8ca0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.186+0000 7fae1eaed640 1 -- 172.21.15.100:0/2650557663 >> 172.21.15.100:0/2650557663 conn(0x7fae18072960 msgr2=0x7fae18072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:05.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.186+0000 7fae1eaed640 1 -- 172.21.15.100:0/2650557663 shutdown_connections 2024-09-11T22:22:05.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.186+0000 7fae1eaed640 1 -- 172.21.15.100:0/2650557663 wait complete. 2024-09-11T22:22:05.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.187+0000 7fae1eaed640 1 Processor -- start 2024-09-11T22:22:05.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.188+0000 7fae1eaed640 1 -- start start 2024-09-11T22:22:05.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.188+0000 7fae1eaed640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae1806bc10 0x7fae1815ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.188+0000 7fae1eaed640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae18157fd0 0x7fae180c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.188+0000 7fae1eaed640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae1815e070 0x7fae180c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.188+0000 7fae1eaed640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fae1815b470 con 0x7fae1806bc10 2024-09-11T22:22:05.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.188+0000 7fae1eaed640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fae1815b190 con 0x7fae18157fd0 2024-09-11T22:22:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.188+0000 7fae1eaed640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fae18067ae0 con 0x7fae1815e070 2024-09-11T22:22:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.188+0000 7fae1c889640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae1806bc10 0x7fae1815ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.188+0000 7fae1c889640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae1806bc10 0x7fae1815ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42826/0 (socket says 172.21.15.100:42826) 2024-09-11T22:22:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.188+0000 7fae1c889640 1 -- 172.21.15.100:0/2988386875 learned_addr learned my addr 172.21.15.100:0/2988386875 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.189+0000 7fae17fff640 1 --2- 172.21.15.100:0/2988386875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae18157fd0 0x7fae180c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.189+0000 7fae1d08a640 1 --2- 172.21.15.100:0/2988386875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae1815e070 0x7fae180c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.189+0000 7fae1c889640 1 -- 172.21.15.100:0/2988386875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae1815e070 msgr2=0x7fae180c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.189+0000 7fae1c889640 1 --2- 172.21.15.100:0/2988386875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae1815e070 0x7fae180c5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.189+0000 7fae1c889640 1 -- 172.21.15.100:0/2988386875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae18157fd0 msgr2=0x7fae180c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.189+0000 7fae1c889640 1 --2- 172.21.15.100:0/2988386875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae18157fd0 0x7fae180c6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.189+0000 7fae1c889640 1 -- 172.21.15.100:0/2988386875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae180cb120 con 0x7fae1806bc10 2024-09-11T22:22:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.189+0000 7fae17fff640 1 --2- 172.21.15.100:0/2988386875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae18157fd0 0x7fae180c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:22:05.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.189+0000 7fae1c889640 1 --2- 172.21.15.100:0/2988386875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae1806bc10 0x7fae1815ca40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fae0c035040 tx=0x7fae0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:05.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.189+0000 7fae157fa640 1 -- 172.21.15.100:0/2988386875 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c037050 con 0x7fae1806bc10 2024-09-11T22:22:05.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.189+0000 7fae157fa640 1 -- 172.21.15.100:0/2988386875 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae0c043070 con 0x7fae1806bc10 2024-09-11T22:22:05.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.189+0000 7fae1eaed640 1 -- 172.21.15.100:0/2988386875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae180cc080 con 0x7fae1806bc10 2024-09-11T22:22:05.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.189+0000 7fae157fa640 1 -- 172.21.15.100:0/2988386875 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c006e10 con 0x7fae1806bc10 2024-09-11T22:22:05.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.189+0000 7fae1eaed640 1 -- 172.21.15.100:0/2988386875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae180cc620 con 0x7fae1806bc10 2024-09-11T22:22:05.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.190+0000 7fae1eaed640 1 -- 172.21.15.100:0/2988386875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae180c5120 con 0x7fae1806bc10 2024-09-11T22:22:05.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.191+0000 7fae157fa640 1 -- 172.21.15.100:0/2988386875 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae0c03ca50 con 0x7fae1806bc10 2024-09-11T22:22:05.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.191+0000 7fae157fa640 1 --2- 172.21.15.100:0/2988386875 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fadfc06be30 0x7fadfc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.191+0000 7fae157fa640 1 -- 172.21.15.100:0/2988386875 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fae0c0abe40 con 0x7fae1806bc10 2024-09-11T22:22:05.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.191+0000 7fae17fff640 1 --2- 172.21.15.100:0/2988386875 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fadfc06be30 0x7fadfc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.192+0000 7fae17fff640 1 --2- 172.21.15.100:0/2988386875 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fadfc06be30 0x7fadfc06e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fae180c4140 tx=0x7fae04009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:05.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.200+0000 7fae157fa640 1 -- 172.21.15.100:0/2988386875 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae0c07a580 con 0x7fae1806bc10 2024-09-11T22:22:05.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.440+0000 7fae1eaed640 1 -- 172.21.15.100:0/2988386875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fae18068060 con 0x7fae1806bc10 2024-09-11T22:22:05.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.440+0000 7fae157fa640 1 -- 172.21.15.100:0/2988386875 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fae0c079e80 con 0x7fae1806bc10 2024-09-11T22:22:05.441 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:22:05.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.443+0000 7fae1eaed640 1 -- 172.21.15.100:0/2988386875 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fadfc06be30 msgr2=0x7fadfc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.443+0000 7fae1eaed640 1 --2- 172.21.15.100:0/2988386875 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fadfc06be30 0x7fadfc06e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fae180c4140 tx=0x7fae04009040 comp rx=0 tx=0).stop 2024-09-11T22:22:05.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.443+0000 7fae1eaed640 1 -- 172.21.15.100:0/2988386875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae1806bc10 msgr2=0x7fae1815ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.443+0000 7fae1eaed640 1 --2- 172.21.15.100:0/2988386875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae1806bc10 0x7fae1815ca40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fae0c035040 tx=0x7fae0c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.443+0000 7fae1eaed640 1 -- 172.21.15.100:0/2988386875 shutdown_connections 2024-09-11T22:22:05.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.443+0000 7fae1eaed640 1 --2- 172.21.15.100:0/2988386875 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fadfc06be30 0x7fadfc06e2f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.443+0000 7fae1eaed640 1 --2- 172.21.15.100:0/2988386875 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae1815e070 0x7fae180c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.443+0000 7fae1eaed640 1 --2- 172.21.15.100:0/2988386875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae18157fd0 0x7fae180c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.443+0000 7fae1eaed640 1 --2- 172.21.15.100:0/2988386875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae1806bc10 0x7fae1815ca40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.443+0000 7fae1eaed640 1 -- 172.21.15.100:0/2988386875 >> 172.21.15.100:0/2988386875 conn(0x7fae18072960 msgr2=0x7fae180c98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:05.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.443+0000 7fae1eaed640 1 -- 172.21.15.100:0/2988386875 shutdown_connections 2024-09-11T22:22:05.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.443+0000 7fae1eaed640 1 -- 172.21.15.100:0/2988386875 wait complete. 2024-09-11T22:22:05.454 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:22:05.454 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-11T22:22:05.455 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:22:05.455 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:22:05.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.556+0000 7efd15b1f640 1 Processor -- start 2024-09-11T22:22:05.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.556+0000 7efd15b1f640 1 -- start start 2024-09-11T22:22:05.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.556+0000 7efd15b1f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd10152a70 0x7efd10067950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.556+0000 7efd15b1f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efd1006c420 0x7efd10067e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd15b1f640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd100730b0 con 0x7efd100c7270 2024-09-11T22:22:05.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd15b1f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7efd100739a0 con 0x7efd1006c420 2024-09-11T22:22:05.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd15b1f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7efd100c9770 con 0x7efd10152a70 2024-09-11T22:22:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd0effd640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7efd100c7270 0x7efd1006bd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56484/0 (socket says 172.21.15.100:56484) 2024-09-11T22:22:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd0effd640 1 -- 172.21.15.100:0/4271077777 learned_addr learned my addr 172.21.15.100:0/4271077777 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:22:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd0ffff640 1 --2- 172.21.15.100:0/4271077777 >> v2:172.21.15.167:3300/0 conn(0x7efd1006c420 0x7efd10067e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd0e7fc640 1 -- 172.21.15.100:0/4271077777 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1772109114 0 0) 0x7efd100730b0 con 0x7efd100c7270 2024-09-11T22:22:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd0f7fe640 1 --2- 172.21.15.100:0/4271077777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd10152a70 0x7efd10067950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd0e7fc640 1 -- 172.21.15.100:0/4271077777 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcf8003520 con 0x7efd100c7270 2024-09-11T22:22:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd0e7fc640 1 -- 172.21.15.100:0/4271077777 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1180781868 0 0) 0x7efcf8003520 con 0x7efd100c7270 2024-09-11T22:22:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd0e7fc640 1 -- 172.21.15.100:0/4271077777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd10152a70 msgr2=0x7efd10067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd0e7fc640 1 --2- 172.21.15.100:0/4271077777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd10152a70 0x7efd10067950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd0e7fc640 1 -- 172.21.15.100:0/4271077777 >> v2:172.21.15.167:3300/0 conn(0x7efd1006c420 msgr2=0x7efd10067e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd0e7fc640 1 --2- 172.21.15.100:0/4271077777 >> v2:172.21.15.167:3300/0 conn(0x7efd1006c420 0x7efd10067e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd0e7fc640 1 -- 172.21.15.100:0/4271077777 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd10072af0 con 0x7efd100c7270 2024-09-11T22:22:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd0e7fc640 1 -- 172.21.15.100:0/4271077777 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7efd04001670 con 0x7efd100c7270 2024-09-11T22:22:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd0e7fc640 1 -- 172.21.15.100:0/4271077777 >> v1:172.21.15.100:6789/0 conn(0x7efd100c7270 legacy=0x7efd1006bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd0e7fc640 1 --2- 172.21.15.100:0/4271077777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd10152a70 0x7efcf80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd0e7fc640 1 --2- 172.21.15.100:0/4271077777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcf8003f30 0x7efcf8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd0e7fc640 1 --2- 172.21.15.100:0/4271077777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcf8004d40 0x7efcf80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd0e7fc640 1 -- 172.21.15.100:0/4271077777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efd100739a0 con 0x7efcf8004d40 2024-09-11T22:22:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd0e7fc640 1 -- 172.21.15.100:0/4271077777 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efd100c9770 con 0x7efcf8003f30 2024-09-11T22:22:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd0e7fc640 1 -- 172.21.15.100:0/4271077777 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7efcf800b9c0 con 0x7efd10152a70 2024-09-11T22:22:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd0f7fe640 1 --2- 172.21.15.100:0/4271077777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd10152a70 0x7efcf80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd0ffff640 1 --2- 172.21.15.100:0/4271077777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcf8004d40 0x7efcf80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.557+0000 7efd0effd640 1 --2- 172.21.15.100:0/4271077777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcf8003f30 0x7efcf8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.558+0000 7efd0ffff640 1 -- 172.21.15.100:0/4271077777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd10152a70 msgr2=0x7efcf80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:05.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.558+0000 7efd0ffff640 1 --2- 172.21.15.100:0/4271077777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd10152a70 0x7efcf80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.558+0000 7efd0ffff640 1 -- 172.21.15.100:0/4271077777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcf8003f30 msgr2=0x7efcf8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:05.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.558+0000 7efd0ffff640 1 --2- 172.21.15.100:0/4271077777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcf8003f30 0x7efcf8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.558+0000 7efd0ffff640 1 -- 172.21.15.100:0/4271077777 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf8003520 con 0x7efcf8004d40 2024-09-11T22:22:05.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.558+0000 7efd0ffff640 1 --2- 172.21.15.100:0/4271077777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcf8004d40 0x7efcf80051c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efd08009fc0 tx=0x7efcf8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14adc466e5bbd1a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:05.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.559+0000 7efd0e7fc640 1 -- 172.21.15.100:0/4271077777 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd08009c10 con 0x7efcf8004d40 2024-09-11T22:22:05.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.559+0000 7efd0e7fc640 1 -- 172.21.15.100:0/4271077777 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd08036070 con 0x7efcf8004d40 2024-09-11T22:22:05.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.559+0000 7efd0e7fc640 1 -- 172.21.15.100:0/4271077777 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0802d070 con 0x7efcf8004d40 2024-09-11T22:22:05.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.559+0000 7efd15b1f640 1 -- 172.21.15.100:0/4271077777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcf8004d40 msgr2=0x7efcf80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.559+0000 7efd15b1f640 1 --2- 172.21.15.100:0/4271077777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcf8004d40 0x7efcf80051c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efd08009fc0 tx=0x7efcf8005830 comp rx=0 tx=0).stop 2024-09-11T22:22:05.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.559+0000 7efd0ffff640 1 -- 172.21.15.100:0/4271077777 reap_dead start 2024-09-11T22:22:05.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.559+0000 7efd15b1f640 1 -- 172.21.15.100:0/4271077777 shutdown_connections 2024-09-11T22:22:05.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.559+0000 7efd15b1f640 1 -- 172.21.15.100:0/4271077777 >> 172.21.15.100:0/4271077777 conn(0x7efd10070190 msgr2=0x7efd100705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:05.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.559+0000 7efd15b1f640 1 -- 172.21.15.100:0/4271077777 shutdown_connections 2024-09-11T22:22:05.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.559+0000 7efd15b1f640 1 -- 172.21.15.100:0/4271077777 wait complete. 2024-09-11T22:22:05.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.560+0000 7efd15b1f640 1 Processor -- start 2024-09-11T22:22:05.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.561+0000 7efd15b1f640 1 -- start start 2024-09-11T22:22:05.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.561+0000 7efd15b1f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcf8004d40 0x7efd10158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.561+0000 7efd15b1f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1015a8c0 0x7efd10067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.561+0000 7efd15b1f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd101f3740 0x7efd101f3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.561+0000 7efd15b1f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efd10073330 con 0x7efd1015a8c0 2024-09-11T22:22:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.561+0000 7efd15b1f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efd10073c40 con 0x7efcf8004d40 2024-09-11T22:22:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.561+0000 7efd15b1f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7efd100734b0 con 0x7efd101f3740 2024-09-11T22:22:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.561+0000 7efd0effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1015a8c0 0x7efd10067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.561+0000 7efd0effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1015a8c0 0x7efd10067fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42838/0 (socket says 172.21.15.100:42838) 2024-09-11T22:22:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.561+0000 7efd0effd640 1 -- 172.21.15.100:0/3266095046 learned_addr learned my addr 172.21.15.100:0/3266095046 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.562+0000 7efd0f7fe640 1 --2- 172.21.15.100:0/3266095046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcf8004d40 0x7efd10158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.562+0000 7efd0ffff640 1 --2- 172.21.15.100:0/3266095046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd101f3740 0x7efd101f3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.562+0000 7efd0effd640 1 -- 172.21.15.100:0/3266095046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd101f3740 msgr2=0x7efd101f3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.562+0000 7efd0effd640 1 --2- 172.21.15.100:0/3266095046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efd101f3740 0x7efd101f3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.562+0000 7efd0effd640 1 -- 172.21.15.100:0/3266095046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcf8004d40 msgr2=0x7efd10158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.562+0000 7efd0effd640 1 --2- 172.21.15.100:0/3266095046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcf8004d40 0x7efd10158a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.562+0000 7efd0effd640 1 -- 172.21.15.100:0/3266095046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd101f4100 con 0x7efd1015a8c0 2024-09-11T22:22:05.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.562+0000 7efd0effd640 1 --2- 172.21.15.100:0/3266095046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1015a8c0 0x7efd10067fe0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7efd04007290 tx=0x7efd04007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.562+0000 7efcf7fff640 1 -- 172.21.15.100:0/3266095046 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0400f9c0 con 0x7efd1015a8c0 2024-09-11T22:22:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.562+0000 7efcf7fff640 1 -- 172.21.15.100:0/3266095046 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd04018070 con 0x7efd1015a8c0 2024-09-11T22:22:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.562+0000 7efcf7fff640 1 -- 172.21.15.100:0/3266095046 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0400fda0 con 0x7efd1015a8c0 2024-09-11T22:22:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.562+0000 7efd15b1f640 1 -- 172.21.15.100:0/3266095046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd101e5580 con 0x7efd1015a8c0 2024-09-11T22:22:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.562+0000 7efd15b1f640 1 -- 172.21.15.100:0/3266095046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd101e5840 con 0x7efd1015a8c0 2024-09-11T22:22:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.563+0000 7efd15b1f640 1 --2- 172.21.15.100:0/3266095046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1015b2e0 0x7efd101488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.563+0000 7efd15b1f640 1 -- 172.21.15.100:0/3266095046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efd1015af70 con 0x7efd1015b2e0 2024-09-11T22:22:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.563+0000 7efd0f7fe640 1 --2- 172.21.15.100:0/3266095046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1015b2e0 0x7efd101488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.563+0000 7efd0f7fe640 1 -- 172.21.15.100:0/3266095046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd100c9330 con 0x7efd1015b2e0 2024-09-11T22:22:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.563+0000 7efd0f7fe640 1 --2- 172.21.15.100:0/3266095046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1015b2e0 0x7efd101488a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efd00013880 tx=0x7efd00013d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.563+0000 7efcf7fff640 1 -- 172.21.15.100:0/3266095046 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0001b070 con 0x7efd1015b2e0 2024-09-11T22:22:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.564+0000 7efcf7fff640 1 -- 172.21.15.100:0/3266095046 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd0401d460 con 0x7efd1015a8c0 2024-09-11T22:22:05.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.564+0000 7efcf7fff640 1 --2- 172.21.15.100:0/3266095046 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efcfc06bd60 0x7efcfc06e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.564+0000 7efcf7fff640 1 -- 172.21.15.100:0/3266095046 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7efd0408b360 con 0x7efd1015a8c0 2024-09-11T22:22:05.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.564+0000 7efd0ffff640 1 --2- 172.21.15.100:0/3266095046 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efcfc06bd60 0x7efcfc06e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.564+0000 7efcf7fff640 1 -- 172.21.15.100:0/3266095046 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7efd00004240 con 0x7efd1015b2e0 2024-09-11T22:22:05.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.564+0000 7efcf7fff640 1 -- 172.21.15.100:0/3266095046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1015b2e0 msgr2=0x7efd101488a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.564+0000 7efcf7fff640 1 --2- 172.21.15.100:0/3266095046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1015b2e0 0x7efd101488a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efd00013880 tx=0x7efd00013d40 comp rx=0 tx=0).stop 2024-09-11T22:22:05.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.564+0000 7efcf7fff640 1 -- 172.21.15.100:0/3266095046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1015b2e0 msgr2=0x7efd101488a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:22:05.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.564+0000 7efcf7fff640 1 --2- 172.21.15.100:0/3266095046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1015b2e0 0x7efd101488a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.565+0000 7efd0ffff640 1 --2- 172.21.15.100:0/3266095046 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efcfc06bd60 0x7efcfc06e220 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efd08035000 tx=0x7efd0802f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:05.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.570+0000 7efd15b1f640 1 --2- 172.21.15.100:0/3266095046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd10148de0 0x7efd100c3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.570+0000 7efd15b1f640 1 -- 172.21.15.100:0/3266095046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efd10151c60 con 0x7efd10148de0 2024-09-11T22:22:05.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.571+0000 7efd0f7fe640 1 --2- 172.21.15.100:0/3266095046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd10148de0 0x7efd100c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.571+0000 7efd0f7fe640 1 -- 172.21.15.100:0/3266095046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efd1015c0a0 con 0x7efd10148de0 2024-09-11T22:22:05.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.571+0000 7efd0f7fe640 1 --2- 172.21.15.100:0/3266095046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd10148de0 0x7efd100c3080 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efd00013880 tx=0x7efd00004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:05.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.571+0000 7efcf7fff640 1 -- 172.21.15.100:0/3266095046 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd00003df0 con 0x7efd10148de0 2024-09-11T22:22:05.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.571+0000 7efcf7fff640 1 -- 172.21.15.100:0/3266095046 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5057 (secure 0 0 0) 0x7efd00003df0 con 0x7efd10148de0 2024-09-11T22:22:05.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.571+0000 7efcf7fff640 1 -- 172.21.15.100:0/3266095046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd10148de0 msgr2=0x7efd100c3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.571+0000 7efcf7fff640 1 --2- 172.21.15.100:0/3266095046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd10148de0 0x7efd100c3080 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efd00013880 tx=0x7efd00004730 comp rx=0 tx=0).stop 2024-09-11T22:22:05.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.571+0000 7efcf7fff640 1 -- 172.21.15.100:0/3266095046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd10148de0 msgr2=0x7efd100c3080 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:22:05.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.571+0000 7efcf7fff640 1 --2- 172.21.15.100:0/3266095046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd10148de0 0x7efd100c3080 secure :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efd00013880 tx=0x7efd00004730 comp rx=0 tx=0).stop 2024-09-11T22:22:05.573 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:22:05.573 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:22:05.573 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:22:05.573 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:22:05.573 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 10, 2024-09-11T22:22:05.573 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 129590, 2024-09-11T22:22:05.574 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:22:05.574 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:22:05.574 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:22:05.574 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:22:05.574 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:05.574 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 16, 2024-09-11T22:22:05.574 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:22:05.574 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:22:05.574 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:22:05.574 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:05.574 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:05.574 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:05.574 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:05.575 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:05.575 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:05.575 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:05.575 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:05.575 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:05.575 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:05.575 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:05.575 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:05.575 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:22:05.575 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:22:05.575 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:05.575 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:05.575 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:05.575 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:05.576 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:05.576 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:05.576 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:05.576 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:05.576 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:05.576 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:05.576 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:05.576 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:05.576 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.576 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:22:05.576 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:22:05.576 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:22:05.576 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:22:05.576 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:22:05.577 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:22:05.577 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:22:05.577 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:22:05.577 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:22:05.577 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:22:05.577 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:22:05.577 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:22:05.577 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:22:05.577 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:22:05.577 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:22:05.577 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:22:05.577 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:22:05.577 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:05.577 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:05.578 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:05.578 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:05.578 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:05.578 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:05.578 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:05.578 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:05.578 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:05.578 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:05.578 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:05.578 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:05.578 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:22:05.578 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.578 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:22:05.578 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.579 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:22:05.579 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:22:05.579 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:05.579 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:05.579 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.579 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:05.579 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:22:05.579 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:05.579 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.579 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.579 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:05.579 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:22:05.579 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:05.579 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:05.580 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:05.580 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.580 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:22:05.580 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:22:05.580 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:05.580 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:05.580 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:05.580 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.580 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.580 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:22:05.580 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:22:05.580 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:05.580 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:05.581 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.581 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:05.581 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:22:05.581 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:05.581 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.581 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.581 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:05.581 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:22:05.581 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:05.581 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:05.581 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:05.581 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.581 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:22:05.581 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:22:05.582 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:05.582 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:05.582 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:05.582 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.582 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.582 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:22:05.582 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:22:05.582 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:05.582 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:05.582 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.582 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:05.582 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:22:05.582 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:05.582 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.583 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.583 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:05.583 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:22:05.583 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:05.583 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:05.583 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:05.583 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.583 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:22:05.583 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:22:05.583 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:05.583 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:05.583 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:05.583 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:05.583 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:05.584 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.584 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:22:05.584 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:22:05.584 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.584 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:05.584 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:05.584 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:22:05.584 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:05.584 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:05.584 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:22:05.584 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.584 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:05.584 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:05.585 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 6 2024-09-11T22:22:05.585 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:05.585 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:05.585 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:22:05.585 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.585 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:05.585 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:05.585 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:22:05.585 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:05.585 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:05.585 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:22:05.585 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.585 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:05.585 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:05.586 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:22:05.586 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:05.586 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:05.586 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:22:05.586 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.586 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:05.586 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:05.586 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:22:05.586 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:05.586 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:05.586 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.586 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:22:05.586 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:22:05.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.572+0000 7efd15b1f640 1 -- 172.21.15.100:0/3266095046 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efcfc06bd60 msgr2=0x7efcfc06e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.572+0000 7efd15b1f640 1 --2- 172.21.15.100:0/3266095046 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efcfc06bd60 0x7efcfc06e220 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efd08035000 tx=0x7efd0802f000 comp rx=0 tx=0).stop 2024-09-11T22:22:05.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.572+0000 7efd15b1f640 1 -- 172.21.15.100:0/3266095046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1015a8c0 msgr2=0x7efd10067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.572+0000 7efd15b1f640 1 --2- 172.21.15.100:0/3266095046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1015a8c0 0x7efd10067fe0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7efd04007290 tx=0x7efd04007750 comp rx=0 tx=0).stop 2024-09-11T22:22:05.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.572+0000 7efd0ffff640 1 -- 172.21.15.100:0/3266095046 reap_dead start 2024-09-11T22:22:05.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.572+0000 7efd0ffff640 1 -- 172.21.15.100:0/3266095046 reap_dead start 2024-09-11T22:22:05.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.572+0000 7efd15b1f640 1 -- 172.21.15.100:0/3266095046 shutdown_connections 2024-09-11T22:22:05.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.572+0000 7efd15b1f640 1 -- 172.21.15.100:0/3266095046 >> 172.21.15.100:0/3266095046 conn(0x7efd10070190 msgr2=0x7efd10150290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:05.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.572+0000 7efd15b1f640 1 -- 172.21.15.100:0/3266095046 shutdown_connections 2024-09-11T22:22:05.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.572+0000 7efd15b1f640 1 -- 172.21.15.100:0/3266095046 wait complete. 2024-09-11T22:22:05.589 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:22:05.589 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:22:05.589 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:22:05.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.689+0000 7f44111bd640 1 Processor -- start 2024-09-11T22:22:05.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.689+0000 7f44111bd640 1 -- start start 2024-09-11T22:22:05.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.690+0000 7f44111bd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f440c158210 0x7f440c0707a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.690+0000 7f44111bd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f440c0b0ca0 0x7f440c15e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.690+0000 7f44111bd640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f440c1585f0 con 0x7f440c06bc10 2024-09-11T22:22:05.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.690+0000 7f44111bd640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f440c070310 con 0x7f440c158210 2024-09-11T22:22:05.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.690+0000 7f44111bd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f440c0c9430 con 0x7f440c0b0ca0 2024-09-11T22:22:05.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.690+0000 7f440ad9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f440c158210 0x7f440c0707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.690+0000 7f440ad9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f440c158210 0x7f440c0707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42856/0 (socket says 172.21.15.100:42856) 2024-09-11T22:22:05.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.690+0000 7f440ad9d640 1 -- 172.21.15.100:0/3531753313 learned_addr learned my addr 172.21.15.100:0/3531753313 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:05.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.691+0000 7f440a59c640 1 --2- 172.21.15.100:0/3531753313 >> v2:172.21.15.167:3300/0 conn(0x7f440c0b0ca0 0x7f440c15e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.691+0000 7f440ad9d640 1 -- 172.21.15.100:0/3531753313 >> v2:172.21.15.167:3300/0 conn(0x7f440c0b0ca0 msgr2=0x7f440c15e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:05.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.691+0000 7f440ad9d640 1 --2- 172.21.15.100:0/3531753313 >> v2:172.21.15.167:3300/0 conn(0x7f440c0b0ca0 0x7f440c15e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.691+0000 7f440ad9d640 1 -- 172.21.15.100:0/3531753313 >> v1:172.21.15.100:6789/0 conn(0x7f440c06bc10 legacy=0x7f440c0ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.691+0000 7f440ad9d640 1 -- 172.21.15.100:0/3531753313 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440c0c96d0 con 0x7f440c158210 2024-09-11T22:22:05.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.691+0000 7f440ad9d640 1 --2- 172.21.15.100:0/3531753313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f440c158210 0x7f440c0707a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f440c06cd50 tx=0x7f43fc02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442b5b3ae4389aee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:05.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.691+0000 7f4409d9b640 1 -- 172.21.15.100:0/3531753313 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc036070 con 0x7f440c158210 2024-09-11T22:22:05.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.691+0000 7f4409d9b640 1 -- 172.21.15.100:0/3531753313 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43fc031600 con 0x7f440c158210 2024-09-11T22:22:05.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.691+0000 7f4409d9b640 1 -- 172.21.15.100:0/3531753313 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc0319f0 con 0x7f440c158210 2024-09-11T22:22:05.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.692+0000 7f44111bd640 1 -- 172.21.15.100:0/3531753313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f440c158210 msgr2=0x7f440c0707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.692+0000 7f44111bd640 1 --2- 172.21.15.100:0/3531753313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f440c158210 0x7f440c0707a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f440c06cd50 tx=0x7f43fc02a7c0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.692+0000 7f44111bd640 1 -- 172.21.15.100:0/3531753313 shutdown_connections 2024-09-11T22:22:05.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.692+0000 7f44111bd640 1 --2- 172.21.15.100:0/3531753313 >> v2:172.21.15.167:3300/0 conn(0x7f440c0b0ca0 0x7f440c15e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.692+0000 7f44111bd640 1 --2- 172.21.15.100:0/3531753313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f440c158210 0x7f440c0707a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.692+0000 7f44111bd640 1 -- 172.21.15.100:0/3531753313 >> 172.21.15.100:0/3531753313 conn(0x7f440c06de20 msgr2=0x7f440c06e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:05.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.692+0000 7f44111bd640 1 -- 172.21.15.100:0/3531753313 shutdown_connections 2024-09-11T22:22:05.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.692+0000 7f44111bd640 1 -- 172.21.15.100:0/3531753313 wait complete. 2024-09-11T22:22:05.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.693+0000 7f44111bd640 1 Processor -- start 2024-09-11T22:22:05.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.694+0000 7f44111bd640 1 -- start start 2024-09-11T22:22:05.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.694+0000 7f44111bd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f440c06bc10 0x7f440c0b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.694+0000 7f44111bd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f440c0b0ca0 0x7f440c0c4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.694+0000 7f44111bd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f440c158210 0x7f440c1f4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.694+0000 7f44111bd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f440c06ffa0 con 0x7f440c158210 2024-09-11T22:22:05.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.694+0000 7f44111bd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f440c0c9c90 con 0x7f440c06bc10 2024-09-11T22:22:05.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.694+0000 7f44111bd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f440c06db40 con 0x7f440c0b0ca0 2024-09-11T22:22:05.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.694+0000 7f440b59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f440c158210 0x7f440c1f4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.694+0000 7f440ad9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f440c06bc10 0x7f440c0b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.694+0000 7f440b59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f440c158210 0x7f440c1f4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42866/0 (socket says 172.21.15.100:42866) 2024-09-11T22:22:05.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.694+0000 7f440b59e640 1 -- 172.21.15.100:0/3684921029 learned_addr learned my addr 172.21.15.100:0/3684921029 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:05.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.694+0000 7f440a59c640 1 --2- 172.21.15.100:0/3684921029 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f440c0b0ca0 0x7f440c0c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.695+0000 7f440b59e640 1 -- 172.21.15.100:0/3684921029 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f440c0b0ca0 msgr2=0x7f440c0c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.695+0000 7f440b59e640 1 --2- 172.21.15.100:0/3684921029 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f440c0b0ca0 0x7f440c0c4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.695+0000 7f440b59e640 1 -- 172.21.15.100:0/3684921029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f440c06bc10 msgr2=0x7f440c0b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.695+0000 7f440b59e640 1 --2- 172.21.15.100:0/3684921029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f440c06bc10 0x7f440c0b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.695+0000 7f440b59e640 1 -- 172.21.15.100:0/3684921029 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440c0b2ac0 con 0x7f440c158210 2024-09-11T22:22:05.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.695+0000 7f440b59e640 1 --2- 172.21.15.100:0/3684921029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f440c158210 0x7f440c1f4030 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f440400c400 tx=0x7f440400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:05.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.695+0000 7f44037fe640 1 -- 172.21.15.100:0/3684921029 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4404017070 con 0x7f440c158210 2024-09-11T22:22:05.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.695+0000 7f44037fe640 1 -- 172.21.15.100:0/3684921029 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44040052d0 con 0x7f440c158210 2024-09-11T22:22:05.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.695+0000 7f44037fe640 1 -- 172.21.15.100:0/3684921029 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4404003810 con 0x7f440c158210 2024-09-11T22:22:05.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.695+0000 7f44111bd640 1 -- 172.21.15.100:0/3684921029 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f440c0b2da0 con 0x7f440c158210 2024-09-11T22:22:05.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.695+0000 7f44111bd640 1 -- 172.21.15.100:0/3684921029 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f440c0b3360 con 0x7f440c158210 2024-09-11T22:22:05.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.696+0000 7f44111bd640 1 --2- 172.21.15.100:0/3684921029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f440c1f4570 0x7f440c1e4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.696+0000 7f44111bd640 1 -- 172.21.15.100:0/3684921029 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f440c15e100 con 0x7f440c1f4570 2024-09-11T22:22:05.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.696+0000 7f440ad9d640 1 --2- 172.21.15.100:0/3684921029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f440c1f4570 0x7f440c1e4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.696+0000 7f44037fe640 1 -- 172.21.15.100:0/3684921029 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f440401a070 con 0x7f440c158210 2024-09-11T22:22:05.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.697+0000 7f440ad9d640 1 -- 172.21.15.100:0/3684921029 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f440c070da0 con 0x7f440c1f4570 2024-09-11T22:22:05.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.697+0000 7f440ad9d640 1 --2- 172.21.15.100:0/3684921029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f440c1f4570 0x7f440c1e4f50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f440c075e70 tx=0x7f43fc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:05.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.697+0000 7f44037fe640 1 --2- 172.21.15.100:0/3684921029 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f43ec06be30 0x7f43ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.697+0000 7f44037fe640 1 -- 172.21.15.100:0/3684921029 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f440408a510 con 0x7f440c158210 2024-09-11T22:22:05.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.697+0000 7f440a59c640 1 --2- 172.21.15.100:0/3684921029 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f43ec06be30 0x7f43ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.697+0000 7f44037fe640 1 -- 172.21.15.100:0/3684921029 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc040030 con 0x7f440c1f4570 2024-09-11T22:22:05.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.697+0000 7f440a59c640 1 --2- 172.21.15.100:0/3684921029 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f43ec06be30 0x7f43ec06e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f440c156700 tx=0x7f43f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:05.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.697+0000 7f44037fe640 1 -- 172.21.15.100:0/3684921029 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f43fc037040 con 0x7f440c1f4570 2024-09-11T22:22:05.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.697+0000 7f44037fe640 1 -- 172.21.15.100:0/3684921029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f440c1f4570 msgr2=0x7f440c1e4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.697+0000 7f44037fe640 1 --2- 172.21.15.100:0/3684921029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f440c1f4570 0x7f440c1e4f50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f440c075e70 tx=0x7f43fc004a40 comp rx=0 tx=0).stop 2024-09-11T22:22:05.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.697+0000 7f44037fe640 1 -- 172.21.15.100:0/3684921029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f440c1f4570 msgr2=0x7f440c1e4f50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:22:05.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.697+0000 7f44037fe640 1 --2- 172.21.15.100:0/3684921029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f440c1f4570 0x7f440c1e4f50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.703+0000 7f44111bd640 1 --2- 172.21.15.100:0/3684921029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f440c1f3ba0 0x7f440c1e5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.703+0000 7f44111bd640 1 -- 172.21.15.100:0/3684921029 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f440c156370 con 0x7f440c1f3ba0 2024-09-11T22:22:05.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.704+0000 7f440ad9d640 1 --2- 172.21.15.100:0/3684921029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f440c1f3ba0 0x7f440c1e5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.704+0000 7f440ad9d640 1 -- 172.21.15.100:0/3684921029 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f440c156090 con 0x7f440c1f3ba0 2024-09-11T22:22:05.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.704+0000 7f440ad9d640 1 --2- 172.21.15.100:0/3684921029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f440c1f3ba0 0x7f440c1e5490 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f43fc040000 tx=0x7f43fc02f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:05.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.704+0000 7f44037fe640 1 -- 172.21.15.100:0/3684921029 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc036070 con 0x7f440c1f3ba0 2024-09-11T22:22:05.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.705+0000 7f44037fe640 1 -- 172.21.15.100:0/3684921029 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4888 (secure 0 0 0) 0x7f43fc009af0 con 0x7f440c1f3ba0 2024-09-11T22:22:05.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.705+0000 7f44037fe640 1 -- 172.21.15.100:0/3684921029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f440c1f3ba0 msgr2=0x7f440c1e5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.705+0000 7f44037fe640 1 --2- 172.21.15.100:0/3684921029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f440c1f3ba0 0x7f440c1e5490 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f43fc040000 tx=0x7f43fc02f000 comp rx=0 tx=0).stop 2024-09-11T22:22:05.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.705+0000 7f44037fe640 1 -- 172.21.15.100:0/3684921029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f440c1f3ba0 msgr2=0x7f440c1e5490 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:22:05.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.705+0000 7f44037fe640 1 --2- 172.21.15.100:0/3684921029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f440c1f3ba0 0x7f440c1e5490 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f43fc040000 tx=0x7f43fc02f000 comp rx=0 tx=0).stop 2024-09-11T22:22:05.706 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:22:05.706 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:22:05.706 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:22:05.706 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:22:05.706 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 10, 2024-09-11T22:22:05.707 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 129683, 2024-09-11T22:22:05.707 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:22:05.707 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:22:05.707 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:22:05.707 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:22:05.707 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:05.707 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 16, 2024-09-11T22:22:05.707 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:22:05.707 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:22:05.707 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:22:05.707 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:05.707 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:05.707 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:05.708 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:05.708 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:05.708 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:05.708 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:05.708 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:05.708 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:05.708 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:05.708 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:05.708 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:05.708 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:22:05.708 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:22:05.708 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:05.708 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:05.708 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:05.709 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:05.709 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:05.709 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:05.709 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:05.709 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:05.709 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:05.709 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:05.709 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:05.709 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:05.709 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.709 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:22:05.709 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:22:05.709 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:22:05.710 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:22:05.710 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:22:05.710 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:22:05.710 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:22:05.710 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:22:05.710 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:22:05.710 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:22:05.710 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:22:05.710 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:22:05.710 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:22:05.710 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:22:05.710 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:22:05.710 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:22:05.710 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:22:05.711 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:05.711 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:05.711 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:05.711 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:05.711 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:05.711 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:05.711 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:05.711 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:05.711 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:05.711 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:05.711 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:05.711 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:05.711 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:22:05.711 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.712 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:22:05.712 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.712 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:22:05.712 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:22:05.712 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:05.712 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:05.712 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.712 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:05.712 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:22:05.712 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:05.712 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.712 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.712 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:05.713 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:22:05.713 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:05.713 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:05.713 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:05.713 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.713 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:22:05.713 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:22:05.713 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:05.713 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:05.713 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:05.713 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.713 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.713 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:22:05.713 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:22:05.714 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:05.714 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:05.714 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.714 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:05.714 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:22:05.714 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:05.714 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.714 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.714 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:05.714 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:22:05.714 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:05.714 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:05.714 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:05.715 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.715 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:22:05.715 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:22:05.715 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:05.715 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:05.715 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:05.715 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.715 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.715 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:22:05.715 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:22:05.715 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:05.715 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:05.715 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.716 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:05.716 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:22:05.716 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:05.716 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.716 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.716 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:05.716 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:22:05.716 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:05.716 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:05.716 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:05.716 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.716 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:22:05.716 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:22:05.716 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:05.717 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:05.717 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:05.717 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:05.717 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:05.717 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.717 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:22:05.717 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:22:05.717 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.717 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:05.717 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:05.717 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:22:05.717 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:05.717 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:05.717 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:22:05.718 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.718 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:05.718 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:05.718 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:22:05.718 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:05.718 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:05.718 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:22:05.718 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.718 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:05.718 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:05.718 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:22:05.718 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:05.718 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:05.718 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:22:05.719 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.719 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:05.719 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:05.719 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:22:05.719 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:05.719 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:05.719 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.719 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:22:05.719 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:22:05.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.705+0000 7f44111bd640 1 -- 172.21.15.100:0/3684921029 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f43ec06be30 msgr2=0x7f43ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.705+0000 7f44111bd640 1 --2- 172.21.15.100:0/3684921029 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f43ec06be30 0x7f43ec06e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f440c156700 tx=0x7f43f4008040 comp rx=0 tx=0).stop 2024-09-11T22:22:05.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.705+0000 7f44111bd640 1 -- 172.21.15.100:0/3684921029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f440c158210 msgr2=0x7f440c1f4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.705+0000 7f44111bd640 1 --2- 172.21.15.100:0/3684921029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f440c158210 0x7f440c1f4030 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f440400c400 tx=0x7f440400c8c0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.705+0000 7f440b59e640 1 -- 172.21.15.100:0/3684921029 reap_dead start 2024-09-11T22:22:05.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.705+0000 7f440b59e640 1 -- 172.21.15.100:0/3684921029 reap_dead start 2024-09-11T22:22:05.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.705+0000 7f44111bd640 1 -- 172.21.15.100:0/3684921029 shutdown_connections 2024-09-11T22:22:05.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.705+0000 7f44111bd640 1 -- 172.21.15.100:0/3684921029 >> 172.21.15.100:0/3684921029 conn(0x7f440c06de20 msgr2=0x7f440c156890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:05.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.705+0000 7f44111bd640 1 -- 172.21.15.100:0/3684921029 shutdown_connections 2024-09-11T22:22:05.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.705+0000 7f44111bd640 1 -- 172.21.15.100:0/3684921029 wait complete. 2024-09-11T22:22:05.721 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:22:05.721 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:22:05.722 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:22:05.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.820+0000 7f253ec1e640 1 Processor -- start 2024-09-11T22:22:05.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.820+0000 7f253ec1e640 1 -- start start 2024-09-11T22:22:05.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.821+0000 7f253ec1e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2538151970 0x7f25380726c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.821+0000 7f253ec1e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f25380c3c60 0x7f25381576c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.821+0000 7f253ec1e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2538157c00 0x7f2538072f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.821+0000 7f253ec1e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f25380ca3f0 con 0x7f25380c3c60 2024-09-11T22:22:05.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.821+0000 7f253ec1e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f25380c9f60 con 0x7f2538157c00 2024-09-11T22:22:05.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.821+0000 7f253ec1e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f25380741b0 con 0x7f2538151970 2024-09-11T22:22:05.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.821+0000 7f2537fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f25380c3c60 0x7f25381576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.821+0000 7f2537fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f25380c3c60 0x7f25381576c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42878/0 (socket says 172.21.15.100:42878) 2024-09-11T22:22:05.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.821+0000 7f2537fff640 1 -- 172.21.15.100:0/814631989 learned_addr learned my addr 172.21.15.100:0/814631989 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:05.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.822+0000 7f253c9ba640 1 --2- 172.21.15.100:0/814631989 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2538151970 0x7f25380726c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.822+0000 7f253d1bb640 1 --2- 172.21.15.100:0/814631989 >> v2:172.21.15.167:3300/0 conn(0x7f2538157c00 0x7f2538072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.822+0000 7f2537fff640 1 -- 172.21.15.100:0/814631989 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2538151970 msgr2=0x7f25380726c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:05.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.822+0000 7f2537fff640 1 --2- 172.21.15.100:0/814631989 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2538151970 0x7f25380726c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.822+0000 7f2537fff640 1 -- 172.21.15.100:0/814631989 >> v2:172.21.15.167:3300/0 conn(0x7f2538157c00 msgr2=0x7f2538072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:05.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.822+0000 7f2537fff640 1 --2- 172.21.15.100:0/814631989 >> v2:172.21.15.167:3300/0 conn(0x7f2538157c00 0x7f2538072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.822+0000 7f2537fff640 1 -- 172.21.15.100:0/814631989 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2538073bf0 con 0x7f25380c3c60 2024-09-11T22:22:05.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.822+0000 7f2537fff640 1 --2- 172.21.15.100:0/814631989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25380c3c60 0x7f25381576c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f25380caa80 tx=0x7f252002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdeba4317b259acf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:05.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.823+0000 7f25377fe640 1 -- 172.21.15.100:0/814631989 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2520037070 con 0x7f25380c3c60 2024-09-11T22:22:05.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.823+0000 7f25377fe640 1 -- 172.21.15.100:0/814631989 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2520032440 con 0x7f25380c3c60 2024-09-11T22:22:05.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.823+0000 7f25377fe640 1 -- 172.21.15.100:0/814631989 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2520032810 con 0x7f25380c3c60 2024-09-11T22:22:05.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.823+0000 7f253ec1e640 1 -- 172.21.15.100:0/814631989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25380c3c60 msgr2=0x7f25381576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.823+0000 7f253ec1e640 1 --2- 172.21.15.100:0/814631989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25380c3c60 0x7f25381576c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f25380caa80 tx=0x7f252002a2a0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.823+0000 7f253ec1e640 1 -- 172.21.15.100:0/814631989 shutdown_connections 2024-09-11T22:22:05.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.823+0000 7f253ec1e640 1 --2- 172.21.15.100:0/814631989 >> v2:172.21.15.167:3300/0 conn(0x7f2538157c00 0x7f2538072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.823+0000 7f253ec1e640 1 --2- 172.21.15.100:0/814631989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25380c3c60 0x7f25381576c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.823+0000 7f253ec1e640 1 --2- 172.21.15.100:0/814631989 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2538151970 0x7f25380726c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.823+0000 7f253ec1e640 1 -- 172.21.15.100:0/814631989 >> 172.21.15.100:0/814631989 conn(0x7f253806ee80 msgr2=0x7f2538070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.823+0000 7f253ec1e640 1 -- 172.21.15.100:0/814631989 shutdown_connections 2024-09-11T22:22:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.823+0000 7f253ec1e640 1 -- 172.21.15.100:0/814631989 wait complete. 2024-09-11T22:22:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.824+0000 7f253ec1e640 1 Processor -- start 2024-09-11T22:22:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.824+0000 7f253ec1e640 1 -- start start 2024-09-11T22:22:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.825+0000 7f253ec1e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25380c3c60 0x7f25380c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.825+0000 7f253ec1e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2538151970 0x7f25380c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.825+0000 7f253ec1e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2538157c00 0x7f25381ed0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.825+0000 7f253ec1e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f25380c9bf0 con 0x7f2538151970 2024-09-11T22:22:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.825+0000 7f253ec1e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f25380c9910 con 0x7f25380c3c60 2024-09-11T22:22:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.825+0000 7f253ec1e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f253806d530 con 0x7f2538157c00 2024-09-11T22:22:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.825+0000 7f2537fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2538151970 0x7f25380c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.825+0000 7f2537fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2538151970 0x7f25380c7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42882/0 (socket says 172.21.15.100:42882) 2024-09-11T22:22:05.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.825+0000 7f2537fff640 1 -- 172.21.15.100:0/2067323547 learned_addr learned my addr 172.21.15.100:0/2067323547 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:05.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.825+0000 7f253d1bb640 1 --2- 172.21.15.100:0/2067323547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2538157c00 0x7f25381ed0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.825+0000 7f253c9ba640 1 --2- 172.21.15.100:0/2067323547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25380c3c60 0x7f25380c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.825+0000 7f2537fff640 1 -- 172.21.15.100:0/2067323547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2538157c00 msgr2=0x7f25381ed0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.825+0000 7f2537fff640 1 --2- 172.21.15.100:0/2067323547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2538157c00 0x7f25381ed0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.825+0000 7f2537fff640 1 -- 172.21.15.100:0/2067323547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25380c3c60 msgr2=0x7f25380c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.825+0000 7f2537fff640 1 --2- 172.21.15.100:0/2067323547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25380c3c60 0x7f25380c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.826+0000 7f2537fff640 1 -- 172.21.15.100:0/2067323547 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25380cb670 con 0x7f2538151970 2024-09-11T22:22:05.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.826+0000 7f2537fff640 1 --2- 172.21.15.100:0/2067323547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2538151970 0x7f25380c7020 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f252002a2e0 tx=0x7f25200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:05.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.826+0000 7f25357fa640 1 -- 172.21.15.100:0/2067323547 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2520041020 con 0x7f2538151970 2024-09-11T22:22:05.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.826+0000 7f25357fa640 1 -- 172.21.15.100:0/2067323547 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25200306c0 con 0x7f2538151970 2024-09-11T22:22:05.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.826+0000 7f25357fa640 1 -- 172.21.15.100:0/2067323547 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2520037040 con 0x7f2538151970 2024-09-11T22:22:05.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.826+0000 7f253ec1e640 1 -- 172.21.15.100:0/2067323547 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25380c83a0 con 0x7f2538151970 2024-09-11T22:22:05.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.826+0000 7f253ec1e640 1 -- 172.21.15.100:0/2067323547 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f253814b400 con 0x7f2538151970 2024-09-11T22:22:05.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.827+0000 7f253ec1e640 1 --2- 172.21.15.100:0/2067323547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f25380c4f80 0x7f25381ed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.827+0000 7f253ec1e640 1 -- 172.21.15.100:0/2067323547 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f253814b260 con 0x7f25380c4f80 2024-09-11T22:22:05.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.827+0000 7f253c9ba640 1 --2- 172.21.15.100:0/2067323547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f25380c4f80 0x7f25381ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.827+0000 7f253c9ba640 1 -- 172.21.15.100:0/2067323547 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2538151d50 con 0x7f25380c4f80 2024-09-11T22:22:05.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.827+0000 7f25357fa640 1 -- 172.21.15.100:0/2067323547 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2520044020 con 0x7f2538151970 2024-09-11T22:22:05.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.827+0000 7f253c9ba640 1 --2- 172.21.15.100:0/2067323547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f25380c4f80 0x7f25381ed600 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f25280045e0 tx=0x7f2528007700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:05.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.828+0000 7f25357fa640 1 --2- 172.21.15.100:0/2067323547 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f251806be30 0x7f251806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.828+0000 7f25357fa640 1 -- 172.21.15.100:0/2067323547 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f25200ab9a0 con 0x7f2538151970 2024-09-11T22:22:05.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.828+0000 7f253d1bb640 1 --2- 172.21.15.100:0/2067323547 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f251806be30 0x7f251806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.828+0000 7f25357fa640 1 -- 172.21.15.100:0/2067323547 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2528015420 con 0x7f25380c4f80 2024-09-11T22:22:05.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.828+0000 7f25357fa640 1 -- 172.21.15.100:0/2067323547 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f252801a070 con 0x7f25380c4f80 2024-09-11T22:22:05.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.828+0000 7f25357fa640 1 -- 172.21.15.100:0/2067323547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f25380c4f80 msgr2=0x7f25381ed600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.828+0000 7f25357fa640 1 --2- 172.21.15.100:0/2067323547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f25380c4f80 0x7f25381ed600 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f25280045e0 tx=0x7f2528007700 comp rx=0 tx=0).stop 2024-09-11T22:22:05.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.828+0000 7f25357fa640 1 -- 172.21.15.100:0/2067323547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f25380c4f80 msgr2=0x7f25381ed600 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:22:05.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.828+0000 7f25357fa640 1 --2- 172.21.15.100:0/2067323547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f25380c4f80 0x7f25381ed600 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.828+0000 7f253d1bb640 1 --2- 172.21.15.100:0/2067323547 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f251806be30 0x7f251806e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2530007930 tx=0x7f2530008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:05.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.835+0000 7f253ec1e640 1 --2- 172.21.15.100:0/2067323547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f25380c6150 0x7f25381453a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:05.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.835+0000 7f253ec1e640 1 -- 172.21.15.100:0/2067323547 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2538072d10 con 0x7f25380c6150 2024-09-11T22:22:05.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.835+0000 7f253c9ba640 1 --2- 172.21.15.100:0/2067323547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f25380c6150 0x7f25381453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:05.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.835+0000 7f253c9ba640 1 -- 172.21.15.100:0/2067323547 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f253814e0f0 con 0x7f25380c6150 2024-09-11T22:22:05.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.835+0000 7f253c9ba640 1 --2- 172.21.15.100:0/2067323547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f25380c6150 0x7f25381453a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f25280045e0 tx=0x7f2528004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:05.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.835+0000 7f25357fa640 1 -- 172.21.15.100:0/2067323547 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25280156f0 con 0x7f25380c6150 2024-09-11T22:22:05.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.836+0000 7f25357fa640 1 -- 172.21.15.100:0/2067323547 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7f25280156f0 con 0x7f25380c6150 2024-09-11T22:22:05.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.836+0000 7f25357fa640 1 -- 172.21.15.100:0/2067323547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f25380c6150 msgr2=0x7f25381453a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.836+0000 7f25357fa640 1 --2- 172.21.15.100:0/2067323547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f25380c6150 0x7f25381453a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f25280045e0 tx=0x7f2528004a40 comp rx=0 tx=0).stop 2024-09-11T22:22:05.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.836+0000 7f25357fa640 1 -- 172.21.15.100:0/2067323547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f25380c6150 msgr2=0x7f25381453a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:22:05.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.836+0000 7f25357fa640 1 --2- 172.21.15.100:0/2067323547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f25380c6150 0x7f25381453a0 secure :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f25280045e0 tx=0x7f2528004a40 comp rx=0 tx=0).stop 2024-09-11T22:22:05.837 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:22:05.837 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:22:05.837 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:22:05.837 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:22:05.837 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 10, 2024-09-11T22:22:05.837 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 16556, 2024-09-11T22:22:05.838 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:22:05.838 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:22:05.838 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:22:05.838 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:22:05.838 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:05.838 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 16, 2024-09-11T22:22:05.838 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:22:05.838 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:22:05.838 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:22:05.838 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:05.838 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:05.838 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:05.838 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:05.839 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:05.839 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:05.839 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:05.839 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:05.839 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:05.839 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:05.839 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:05.839 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:05.839 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:22:05.839 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:22:05.839 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:05.839 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:05.839 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:05.839 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:05.840 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:05.840 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:05.840 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:05.840 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:05.840 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:05.840 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:05.840 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:05.840 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:05.840 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.840 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:22:05.840 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:22:05.840 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:22:05.840 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:22:05.841 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:22:05.841 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:22:05.841 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:22:05.841 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:22:05.841 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:22:05.841 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:22:05.841 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:22:05.841 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:22:05.841 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:22:05.841 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:22:05.841 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:22:05.841 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:22:05.841 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:22:05.841 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:05.842 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:05.842 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:05.842 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:05.842 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:05.842 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:05.842 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:05.842 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:05.842 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:05.842 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:05.842 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:05.842 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:05.842 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:22:05.842 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.842 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:22:05.843 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.843 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:22:05.843 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:22:05.843 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:05.843 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:05.843 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.843 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:05.843 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:22:05.843 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:05.843 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.843 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.843 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:05.843 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:22:05.843 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:05.844 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:05.844 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:05.844 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.844 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:22:05.844 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:22:05.844 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:05.844 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:05.844 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:05.844 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.844 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.844 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:22:05.844 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:22:05.844 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:05.845 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:05.845 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.845 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:05.845 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:22:05.845 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:05.845 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.845 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.845 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:05.845 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:22:05.845 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:05.845 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:05.845 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:05.845 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.845 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:22:05.846 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:22:05.846 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:05.846 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:05.846 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:05.846 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.846 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.846 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:22:05.846 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:22:05.846 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:05.846 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:05.846 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.846 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:05.846 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:22:05.846 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:05.847 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.847 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.847 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:05.847 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:22:05.847 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:05.847 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:05.847 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:05.847 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.847 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:22:05.847 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:22:05.847 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:05.847 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:05.847 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:05.848 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:05.848 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:05.848 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.848 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:22:05.848 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:22:05.848 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.848 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:05.848 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:05.848 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:22:05.848 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:05.848 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:05.848 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:22:05.848 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:05.848 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:05.849 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:05.849 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:22:05.849 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:05.849 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:05.849 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:05.849 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:22:05.849 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:22:05.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.836+0000 7f253ec1e640 1 -- 172.21.15.100:0/2067323547 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f251806be30 msgr2=0x7f251806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.836+0000 7f253ec1e640 1 --2- 172.21.15.100:0/2067323547 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f251806be30 0x7f251806e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2530007930 tx=0x7f2530008040 comp rx=0 tx=0).stop 2024-09-11T22:22:05.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.836+0000 7f253ec1e640 1 -- 172.21.15.100:0/2067323547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2538151970 msgr2=0x7f25380c7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:05.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.836+0000 7f253ec1e640 1 --2- 172.21.15.100:0/2067323547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2538151970 0x7f25380c7020 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f252002a2e0 tx=0x7f25200046c0 comp rx=0 tx=0).stop 2024-09-11T22:22:05.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.836+0000 7f253d1bb640 1 -- 172.21.15.100:0/2067323547 reap_dead start 2024-09-11T22:22:05.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.836+0000 7f253d1bb640 1 -- 172.21.15.100:0/2067323547 reap_dead start 2024-09-11T22:22:05.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.836+0000 7f253ec1e640 1 -- 172.21.15.100:0/2067323547 shutdown_connections 2024-09-11T22:22:05.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.836+0000 7f253ec1e640 1 -- 172.21.15.100:0/2067323547 >> 172.21.15.100:0/2067323547 conn(0x7f253806ee80 msgr2=0x7f25380cbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:05.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.836+0000 7f253ec1e640 1 -- 172.21.15.100:0/2067323547 shutdown_connections 2024-09-11T22:22:05.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:05.836+0000 7f253ec1e640 1 -- 172.21.15.100:0/2067323547 wait complete. 2024-09-11T22:22:05.851 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:22:05.851 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-11T22:22:05.851 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-11T22:22:05.852 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-11T22:22:05.852 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:22:05.852 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T22:22:05.852 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:22:05.866 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T22:22:05.866 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-11T22:22:05.866 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:22:06.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.007+0000 7f236d0d0640 1 Processor -- start 2024-09-11T22:22:06.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.008+0000 7f236d0d0640 1 -- start start 2024-09-11T22:22:06.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.008+0000 7f236d0d0640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2368154c20 0x7f23680cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:06.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.008+0000 7f236d0d0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f236815a7e0 0x7f23680cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:06.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.008+0000 7f236d0d0640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f236815ac90 con 0x7f23680b3190 2024-09-11T22:22:06.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.008+0000 7f236d0d0640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f236815e000 con 0x7f2368154c20 2024-09-11T22:22:06.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.008+0000 7f236d0d0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f236815af70 con 0x7f236815a7e0 2024-09-11T22:22:06.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.008+0000 7f2366d9d640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f2368154c20 msgr2=0x7f23680cb120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:22:06.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.008+0000 7f236659c640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f23680b3190 legacy=0x7f236815e490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:22:06.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.008+0000 7f2366d9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2368154c20 0x7f23680cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:22:06.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.009+0000 7f236759e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f236815a7e0 0x7f23680cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:06.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.009+0000 7f236759e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f236815a7e0 0x7f23680cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:37480/0 (socket says 172.21.15.100:37480) 2024-09-11T22:22:06.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.009+0000 7f236759e640 1 -- 172.21.15.100:0/839559560 learned_addr learned my addr 172.21.15.100:0/839559560 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:06.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.009+0000 7f236759e640 1 -- 172.21.15.100:0/839559560 >> v2:172.21.15.100:3300/0 conn(0x7f2368154c20 msgr2=0x7f23680cb120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:22:06.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.009+0000 7f236759e640 1 --2- 172.21.15.100:0/839559560 >> v2:172.21.15.100:3300/0 conn(0x7f2368154c20 0x7f23680cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:06.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.009+0000 7f236759e640 1 -- 172.21.15.100:0/839559560 >> v1:172.21.15.100:6789/0 conn(0x7f23680b3190 legacy=0x7f236815e490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:22:06.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.009+0000 7f236759e640 1 -- 172.21.15.100:0/839559560 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236815b250 con 0x7f236815a7e0 2024-09-11T22:22:06.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.010+0000 7f236759e640 1 --2- 172.21.15.100:0/839559560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f236815a7e0 0x7f23680cbd10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f23680d1360 tx=0x7f236002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11a2616b30cc8c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:06.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.010+0000 7f2365d9b640 1 -- 172.21.15.100:0/839559560 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2360036070 con 0x7f236815a7e0 2024-09-11T22:22:06.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.010+0000 7f2365d9b640 1 -- 172.21.15.100:0/839559560 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2360031600 con 0x7f236815a7e0 2024-09-11T22:22:06.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.010+0000 7f2365d9b640 1 -- 172.21.15.100:0/839559560 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23600319d0 con 0x7f236815a7e0 2024-09-11T22:22:06.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.011+0000 7f236d0d0640 1 -- 172.21.15.100:0/839559560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f236815a7e0 msgr2=0x7f23680cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:06.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.011+0000 7f236d0d0640 1 --2- 172.21.15.100:0/839559560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f236815a7e0 0x7f23680cbd10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f23680d1360 tx=0x7f236002a710 comp rx=0 tx=0).stop 2024-09-11T22:22:06.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.011+0000 7f236d0d0640 1 -- 172.21.15.100:0/839559560 shutdown_connections 2024-09-11T22:22:06.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.011+0000 7f236d0d0640 1 --2- 172.21.15.100:0/839559560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f236815a7e0 0x7f23680cbd10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:06.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.011+0000 7f236d0d0640 1 --2- 172.21.15.100:0/839559560 >> v2:172.21.15.100:3300/0 conn(0x7f2368154c20 0x7f23680cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:06.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.011+0000 7f236d0d0640 1 -- 172.21.15.100:0/839559560 >> 172.21.15.100:0/839559560 conn(0x7f2368067d40 msgr2=0x7f236806d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:06.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.011+0000 7f236d0d0640 1 -- 172.21.15.100:0/839559560 shutdown_connections 2024-09-11T22:22:06.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.011+0000 7f236d0d0640 1 -- 172.21.15.100:0/839559560 wait complete. 2024-09-11T22:22:06.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.012+0000 7f236d0d0640 1 Processor -- start 2024-09-11T22:22:06.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.012+0000 7f236d0d0640 1 -- start start 2024-09-11T22:22:06.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.013+0000 7f236d0d0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23680b3190 0x7f2368145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:06.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.013+0000 7f236d0d0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2368154c20 0x7f2368153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:06.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.013+0000 7f236d0d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f236815a7e0 0x7f23680cef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:06.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.013+0000 7f236d0d0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f236815ed20 con 0x7f236815a7e0 2024-09-11T22:22:06.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.013+0000 7f236d0d0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f236815eba0 con 0x7f23680b3190 2024-09-11T22:22:06.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.013+0000 7f236d0d0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f23680cb660 con 0x7f2368154c20 2024-09-11T22:22:06.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.013+0000 7f236759e640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f236815a7e0 msgr2=0x7f23680cef70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:22:06.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.013+0000 7f236759e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f236815a7e0 0x7f23680cef70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:22:06.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.013+0000 7f2366d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23680b3190 0x7f2368145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:06.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.013+0000 7f236659c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2368154c20 0x7f2368153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:06.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.013+0000 7f236659c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2368154c20 0x7f2368153830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:52788/0 (socket says 172.21.15.100:52788) 2024-09-11T22:22:06.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.013+0000 7f2366d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23680b3190 0x7f2368145e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:37486/0 (socket says 172.21.15.100:37486) 2024-09-11T22:22:06.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.013+0000 7f236659c640 1 -- 172.21.15.100:0/600580544 learned_addr learned my addr 172.21.15.100:0/600580544 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:06.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.014+0000 7f2366d9d640 1 -- 172.21.15.100:0/600580544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2368154c20 msgr2=0x7f2368153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:06.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.014+0000 7f2366d9d640 1 --2- 172.21.15.100:0/600580544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2368154c20 0x7f2368153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:06.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.014+0000 7f2366d9d640 1 -- 172.21.15.100:0/600580544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f236815a7e0 msgr2=0x7f23680cef70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:22:06.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.014+0000 7f2366d9d640 1 --2- 172.21.15.100:0/600580544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f236815a7e0 0x7f23680cef70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:06.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.014+0000 7f2366d9d640 1 -- 172.21.15.100:0/600580544 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23680b2ca0 con 0x7f23680b3190 2024-09-11T22:22:06.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.014+0000 7f236659c640 1 --2- 172.21.15.100:0/600580544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2368154c20 0x7f2368153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:06.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.014+0000 7f2366d9d640 1 --2- 172.21.15.100:0/600580544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23680b3190 0x7f2368145e70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f235800b400 tx=0x7f235800b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:06.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.014+0000 7f234f7fe640 1 -- 172.21.15.100:0/600580544 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2358016070 con 0x7f23680b3190 2024-09-11T22:22:06.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.014+0000 7f234f7fe640 1 -- 172.21.15.100:0/600580544 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2358003de0 con 0x7f23680b3190 2024-09-11T22:22:06.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.014+0000 7f236d0d0640 1 -- 172.21.15.100:0/600580544 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23681469b0 con 0x7f23680b3190 2024-09-11T22:22:06.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.014+0000 7f234f7fe640 1 -- 172.21.15.100:0/600580544 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23580052b0 con 0x7f23680b3190 2024-09-11T22:22:06.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.014+0000 7f236d0d0640 1 -- 172.21.15.100:0/600580544 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23680ce200 con 0x7f23680b3190 2024-09-11T22:22:06.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.015+0000 7f236d0d0640 1 -- 172.21.15.100:0/600580544 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2368145a90 con 0x7f23680b3190 2024-09-11T22:22:06.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.016+0000 7f234f7fe640 1 -- 172.21.15.100:0/600580544 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2358019070 con 0x7f23680b3190 2024-09-11T22:22:06.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.016+0000 7f234f7fe640 1 --2- 172.21.15.100:0/600580544 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f235406bde0 0x7f235406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:06.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.016+0000 7f234f7fe640 1 -- 172.21.15.100:0/600580544 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f235808a390 con 0x7f23680b3190 2024-09-11T22:22:06.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.016+0000 7f236659c640 1 --2- 172.21.15.100:0/600580544 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f235406bde0 0x7f235406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:06.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.017+0000 7f236659c640 1 --2- 172.21.15.100:0/600580544 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f235406bde0 0x7f235406e2a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2368154070 tx=0x7f235c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:06.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.021+0000 7f234f7fe640 1 -- 172.21.15.100:0/600580544 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2358058340 con 0x7f23680b3190 2024-09-11T22:22:06.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.264+0000 7f236d0d0640 1 -- 172.21.15.100:0/600580544 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f23680cc2b0 con 0x7f23680b3190 2024-09-11T22:22:06.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.265+0000 7f234f7fe640 1 -- 172.21.15.100:0/600580544 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f235805c640 con 0x7f23680b3190 2024-09-11T22:22:06.266 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:22:06.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.267+0000 7f236d0d0640 1 -- 172.21.15.100:0/600580544 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f235406bde0 msgr2=0x7f235406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:06.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.267+0000 7f236d0d0640 1 --2- 172.21.15.100:0/600580544 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f235406bde0 0x7f235406e2a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2368154070 tx=0x7f235c009190 comp rx=0 tx=0).stop 2024-09-11T22:22:06.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.267+0000 7f236d0d0640 1 -- 172.21.15.100:0/600580544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23680b3190 msgr2=0x7f2368145e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:06.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.267+0000 7f236d0d0640 1 --2- 172.21.15.100:0/600580544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23680b3190 0x7f2368145e70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f235800b400 tx=0x7f235800b8c0 comp rx=0 tx=0).stop 2024-09-11T22:22:06.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.267+0000 7f236d0d0640 1 -- 172.21.15.100:0/600580544 shutdown_connections 2024-09-11T22:22:06.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.267+0000 7f236d0d0640 1 --2- 172.21.15.100:0/600580544 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f235406bde0 0x7f235406e2a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:06.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.267+0000 7f236d0d0640 1 --2- 172.21.15.100:0/600580544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f236815a7e0 0x7f23680cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:06.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.267+0000 7f236d0d0640 1 --2- 172.21.15.100:0/600580544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2368154c20 0x7f2368153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:06.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.267+0000 7f236d0d0640 1 --2- 172.21.15.100:0/600580544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23680b3190 0x7f2368145e70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:06.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.267+0000 7f236d0d0640 1 -- 172.21.15.100:0/600580544 >> 172.21.15.100:0/600580544 conn(0x7f2368067d40 msgr2=0x7f236814aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:06.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.267+0000 7f236d0d0640 1 -- 172.21.15.100:0/600580544 shutdown_connections 2024-09-11T22:22:06.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:06.267+0000 7f236d0d0640 1 -- 172.21.15.100:0/600580544 wait complete. 2024-09-11T22:22:08.041 INFO:tasks.workunit.client.0.smithi100.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-11T22:22:08.041 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-09-11T22:22:08.041 INFO:tasks.workunit.client.0.smithi100.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-11T22:22:08.042 INFO:tasks.workunit.client.0.smithi100.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-11T22:22:08.042 INFO:tasks.workunit.client.0.smithi100.stderr:state without impacting any branches by switching back to a branch. 2024-09-11T22:22:08.042 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-09-11T22:22:08.042 INFO:tasks.workunit.client.0.smithi100.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-11T22:22:08.042 INFO:tasks.workunit.client.0.smithi100.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-11T22:22:08.042 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-09-11T22:22:08.042 INFO:tasks.workunit.client.0.smithi100.stderr: git switch -c 2024-09-11T22:22:08.042 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-09-11T22:22:08.042 INFO:tasks.workunit.client.0.smithi100.stderr:Or undo this operation with: 2024-09-11T22:22:08.042 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-09-11T22:22:08.042 INFO:tasks.workunit.client.0.smithi100.stderr: git switch - 2024-09-11T22:22:08.042 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-09-11T22:22:08.042 INFO:tasks.workunit.client.0.smithi100.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-11T22:22:08.042 INFO:tasks.workunit.client.0.smithi100.stderr: 2024-09-11T22:22:08.043 INFO:tasks.workunit.client.0.smithi100.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-11T22:22:08.045 DEBUG:teuthology.orchestra.run.smithi100:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-11T22:22:08.139 INFO:tasks.workunit.client.0.smithi100.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-11T22:22:08.141 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T22:22:08.141 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-11T22:22:08.732 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-11T22:22:08.802 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-11T22:22:08.842 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T22:22:08.844 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T22:22:08.844 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-11T22:22:08.882 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T22:22:08.885 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:22:08.885 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-11T22:22:08.902 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-09-11T22:22:08.903 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-09-11T22:22:08.904 DEBUG:teuthology.orchestra.run.smithi100:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-11T22:22:08.970 INFO:tasks.workunit.client.0.smithi100.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-11T22:22:08.971 INFO:tasks.workunit.client.0.smithi100.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-09-11T22:22:08.971 INFO:tasks.workunit.client.0.smithi100.stderr:+ trap -- retry EXIT 2024-09-11T22:22:08.971 INFO:tasks.workunit.client.0.smithi100.stderr:+ rm -rf ffsb 2024-09-11T22:22:08.971 INFO:tasks.workunit.client.0.smithi100.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-09-11T22:22:08.976 INFO:tasks.workunit.client.0.smithi100.stderr:Cloning into 'ffsb'... 2024-09-11T22:22:09.280 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:22:09.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.394+0000 7f49eb5a6640 1 Processor -- start 2024-09-11T22:22:09.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.394+0000 7f49eb5a6640 1 -- start start 2024-09-11T22:22:09.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.395+0000 7f49eb5a6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f49e4154c00 0x7f49e415b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:09.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.395+0000 7f49eb5a6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49e406f7b0 0x7f49e40c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:09.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.395+0000 7f49eb5a6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49e406fc40 con 0x7f49e4075960 2024-09-11T22:22:09.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.395+0000 7f49eb5a6640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f49e40707a0 con 0x7f49e4154c00 2024-09-11T22:22:09.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.395+0000 7f49eb5a6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f49e40c7400 con 0x7f49e406f7b0 2024-09-11T22:22:09.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.395+0000 7f49e9342640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f49e4154c00 msgr2=0x7f49e415b4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:22:09.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.395+0000 7f49e9342640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f49e4154c00 0x7f49e415b4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:22:09.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.395+0000 7f49e8b41640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49e406f7b0 0x7f49e40c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:09.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.395+0000 7f49e9b43640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f49e4075960 0x7f49e40c7890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:36256/0 (socket says 172.21.15.100:36256) 2024-09-11T22:22:09.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.395+0000 7f49e9b43640 1 -- 172.21.15.100:0/370308263 learned_addr learned my addr 172.21.15.100:0/370308263 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:22:09.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.395+0000 7f49e8b41640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49e406f7b0 0x7f49e40c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:52798/0 (socket says 172.21.15.100:52798) 2024-09-11T22:22:09.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.395+0000 7f49e8b41640 1 -- 172.21.15.100:0/370308263 >> v2:172.21.15.100:3300/0 conn(0x7f49e4154c00 msgr2=0x7f49e415b4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:22:09.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.395+0000 7f49e8b41640 1 --2- 172.21.15.100:0/370308263 >> v2:172.21.15.100:3300/0 conn(0x7f49e4154c00 0x7f49e415b4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:09.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.395+0000 7f49dbfff640 1 -- 172.21.15.100:0/370308263 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3991374533 0 0) 0x7f49e406fc40 con 0x7f49e4075960 2024-09-11T22:22:09.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.395+0000 7f49e8b41640 1 -- 172.21.15.100:0/370308263 >> v1:172.21.15.167:6789/0 conn(0x7f49e4075960 legacy=0x7f49e40c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:09.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.395+0000 7f49e8b41640 1 -- 172.21.15.100:0/370308263 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e406ff00 con 0x7f49e406f7b0 2024-09-11T22:22:09.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.396+0000 7f49e8b41640 1 --2- 172.21.15.100:0/370308263 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49e406f7b0 0x7f49e40c87c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f49e4070920 tx=0x7f49d402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d1dce024b0a4abf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:09.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.396+0000 7f49dbfff640 1 -- 172.21.15.100:0/370308263 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d4037070 con 0x7f49e406f7b0 2024-09-11T22:22:09.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.396+0000 7f49dbfff640 1 -- 172.21.15.100:0/370308263 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49d4032440 con 0x7f49e406f7b0 2024-09-11T22:22:09.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.396+0000 7f49dbfff640 1 -- 172.21.15.100:0/370308263 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d402ae60 con 0x7f49e406f7b0 2024-09-11T22:22:09.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.397+0000 7f49eb5a6640 1 -- 172.21.15.100:0/370308263 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49e406f7b0 msgr2=0x7f49e40c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:09.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.397+0000 7f49eb5a6640 1 --2- 172.21.15.100:0/370308263 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49e406f7b0 0x7f49e40c87c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f49e4070920 tx=0x7f49d402a110 comp rx=0 tx=0).stop 2024-09-11T22:22:09.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.397+0000 7f49eb5a6640 1 -- 172.21.15.100:0/370308263 shutdown_connections 2024-09-11T22:22:09.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.397+0000 7f49eb5a6640 1 --2- 172.21.15.100:0/370308263 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49e406f7b0 0x7f49e40c87c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:09.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.397+0000 7f49eb5a6640 1 --2- 172.21.15.100:0/370308263 >> v2:172.21.15.100:3300/0 conn(0x7f49e4154c00 0x7f49e415b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:09.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.397+0000 7f49eb5a6640 1 -- 172.21.15.100:0/370308263 >> 172.21.15.100:0/370308263 conn(0x7f49e40cc840 msgr2=0x7f49e40ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:09.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.397+0000 7f49eb5a6640 1 -- 172.21.15.100:0/370308263 shutdown_connections 2024-09-11T22:22:09.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.397+0000 7f49eb5a6640 1 -- 172.21.15.100:0/370308263 wait complete. 2024-09-11T22:22:09.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.398+0000 7f49eb5a6640 1 Processor -- start 2024-09-11T22:22:09.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.398+0000 7f49eb5a6640 1 -- start start 2024-09-11T22:22:09.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.399+0000 7f49eb5a6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49e4075960 0x7f49e41e5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:09.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.399+0000 7f49eb5a6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49e4154c00 0x7f49e41e4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:09.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.399+0000 7f49eb5a6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49e414b000 0x7f49e4148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:09.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.399+0000 7f49eb5a6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f49e40704c0 con 0x7f49e4154c00 2024-09-11T22:22:09.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.399+0000 7f49eb5a6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f49e415b9e0 con 0x7f49e4075960 2024-09-11T22:22:09.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.399+0000 7f49eb5a6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f49e4154fe0 con 0x7f49e414b000 2024-09-11T22:22:09.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.399+0000 7f49e8b41640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49e4154c00 msgr2=0x7f49e41e4a90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:22:09.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.399+0000 7f49e8b41640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49e4154c00 0x7f49e41e4a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:22:09.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.399+0000 7f49e9342640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49e4075960 0x7f49e41e5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:09.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.399+0000 7f49e9b43640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49e414b000 0x7f49e4148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:09.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.399+0000 7f49e9342640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49e4075960 0x7f49e41e5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:37494/0 (socket says 172.21.15.100:37494) 2024-09-11T22:22:09.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.399+0000 7f49e9342640 1 -- 172.21.15.100:0/1283275011 learned_addr learned my addr 172.21.15.100:0/1283275011 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:09.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.400+0000 7f49e9b43640 1 -- 172.21.15.100:0/1283275011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49e4075960 msgr2=0x7f49e41e5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:09.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.400+0000 7f49e9b43640 1 --2- 172.21.15.100:0/1283275011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49e4075960 0x7f49e41e5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:09.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.400+0000 7f49e9b43640 1 -- 172.21.15.100:0/1283275011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49e4154c00 msgr2=0x7f49e41e4a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:22:09.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.400+0000 7f49e9b43640 1 --2- 172.21.15.100:0/1283275011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49e4154c00 0x7f49e41e4a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:09.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.400+0000 7f49e9b43640 1 -- 172.21.15.100:0/1283275011 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e40c6d10 con 0x7f49e414b000 2024-09-11T22:22:09.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.400+0000 7f49e9342640 1 --2- 172.21.15.100:0/1283275011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49e4075960 0x7f49e41e5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:09.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.400+0000 7f49e9b43640 1 --2- 172.21.15.100:0/1283275011 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49e414b000 0x7f49e4148170 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00c750 tx=0x7f49dc00cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:09.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.400+0000 7f49d9ffb640 1 -- 172.21.15.100:0/1283275011 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc018070 con 0x7f49e414b000 2024-09-11T22:22:09.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.400+0000 7f49d9ffb640 1 -- 172.21.15.100:0/1283275011 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49dc004d70 con 0x7f49e414b000 2024-09-11T22:22:09.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.400+0000 7f49d9ffb640 1 -- 172.21.15.100:0/1283275011 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc00a880 con 0x7f49e414b000 2024-09-11T22:22:09.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.400+0000 7f49eb5a6640 1 -- 172.21.15.100:0/1283275011 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e41e6070 con 0x7f49e414b000 2024-09-11T22:22:09.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.400+0000 7f49eb5a6640 1 -- 172.21.15.100:0/1283275011 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e415aa20 con 0x7f49e414b000 2024-09-11T22:22:09.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.401+0000 7f49eb5a6640 1 -- 172.21.15.100:0/1283275011 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49e40c3f90 con 0x7f49e414b000 2024-09-11T22:22:09.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.402+0000 7f49d9ffb640 1 -- 172.21.15.100:0/1283275011 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f49dc00aa20 con 0x7f49e414b000 2024-09-11T22:22:09.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.402+0000 7f49d9ffb640 1 --2- 172.21.15.100:0/1283275011 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f49c806bde0 0x7f49c806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:09.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.403+0000 7f49d9ffb640 1 -- 172.21.15.100:0/1283275011 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f49dc08a5e0 con 0x7f49e414b000 2024-09-11T22:22:09.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.403+0000 7f49e9342640 1 --2- 172.21.15.100:0/1283275011 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f49c806bde0 0x7f49c806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:09.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.403+0000 7f49e9342640 1 --2- 172.21.15.100:0/1283275011 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f49c806bde0 0x7f49c806e2a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f49e0009810 tx=0x7f49e0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:09.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.408+0000 7f49d9ffb640 1 -- 172.21.15.100:0/1283275011 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f49e40c3f90 con 0x7f49e414b000 2024-09-11T22:22:09.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.683+0000 7f49eb5a6640 1 -- 172.21.15.100:0/1283275011 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f49e415b0c0 con 0x7f49e414b000 2024-09-11T22:22:09.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.684+0000 7f49d9ffb640 1 -- 172.21.15.100:0/1283275011 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f49e415b0c0 con 0x7f49e414b000 2024-09-11T22:22:09.685 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:22:09.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.686+0000 7f49eb5a6640 1 -- 172.21.15.100:0/1283275011 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f49c806bde0 msgr2=0x7f49c806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:09.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.686+0000 7f49eb5a6640 1 --2- 172.21.15.100:0/1283275011 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f49c806bde0 0x7f49c806e2a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f49e0009810 tx=0x7f49e0009190 comp rx=0 tx=0).stop 2024-09-11T22:22:09.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.686+0000 7f49eb5a6640 1 -- 172.21.15.100:0/1283275011 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49e414b000 msgr2=0x7f49e4148170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:09.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.686+0000 7f49eb5a6640 1 --2- 172.21.15.100:0/1283275011 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49e414b000 0x7f49e4148170 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00c750 tx=0x7f49dc00cc10 comp rx=0 tx=0).stop 2024-09-11T22:22:09.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.686+0000 7f49eb5a6640 1 -- 172.21.15.100:0/1283275011 shutdown_connections 2024-09-11T22:22:09.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.686+0000 7f49eb5a6640 1 --2- 172.21.15.100:0/1283275011 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f49c806bde0 0x7f49c806e2a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:09.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.686+0000 7f49eb5a6640 1 --2- 172.21.15.100:0/1283275011 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49e414b000 0x7f49e4148170 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:09.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.686+0000 7f49eb5a6640 1 --2- 172.21.15.100:0/1283275011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49e4154c00 0x7f49e41e4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:09.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.686+0000 7f49eb5a6640 1 --2- 172.21.15.100:0/1283275011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49e4075960 0x7f49e41e5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:09.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.686+0000 7f49eb5a6640 1 -- 172.21.15.100:0/1283275011 >> 172.21.15.100:0/1283275011 conn(0x7f49e40cc840 msgr2=0x7f49e414e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:09.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.686+0000 7f49eb5a6640 1 -- 172.21.15.100:0/1283275011 shutdown_connections 2024-09-11T22:22:09.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:09.686+0000 7f49eb5a6640 1 -- 172.21.15.100:0/1283275011 wait complete. 2024-09-11T22:22:10.547 INFO:tasks.workunit.client.0.smithi100.stderr:+ trap - EXIT 2024-09-11T22:22:10.547 INFO:tasks.workunit.client.0.smithi100.stderr:+ cd ffsb 2024-09-11T22:22:10.548 INFO:tasks.workunit.client.0.smithi100.stderr:+ ./configure 2024-09-11T22:22:10.679 INFO:tasks.workunit.client.0.smithi100.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-11T22:22:11.689 INFO:tasks.workunit.client.0.smithi100.stdout:checking whether build environment is sane... yes 2024-09-11T22:22:11.705 INFO:tasks.workunit.client.0.smithi100.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-11T22:22:11.706 INFO:tasks.workunit.client.0.smithi100.stdout:checking for gawk... gawk 2024-09-11T22:22:11.728 INFO:tasks.workunit.client.0.smithi100.stdout:checking whether make sets $(MAKE)... yes 2024-09-11T22:22:11.774 INFO:tasks.workunit.client.0.smithi100.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-11T22:22:11.774 INFO:tasks.workunit.client.0.smithi100.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-11T22:22:11.792 INFO:tasks.workunit.client.0.smithi100.stdout:checking for style of include used by make... GNU 2024-09-11T22:22:11.797 INFO:tasks.workunit.client.0.smithi100.stdout:checking for gcc... gcc 2024-09-11T22:22:11.882 INFO:tasks.workunit.client.0.smithi100.stdout:checking for C compiler default output file name... a.out 2024-09-11T22:22:11.884 INFO:tasks.workunit.client.0.smithi100.stdout:checking whether the C compiler works... yes 2024-09-11T22:22:11.887 INFO:tasks.workunit.client.0.smithi100.stdout:checking whether we are cross compiling... no 2024-09-11T22:22:11.937 INFO:tasks.workunit.client.0.smithi100.stdout:checking for suffix of executables... 2024-09-11T22:22:11.986 INFO:tasks.workunit.client.0.smithi100.stdout:checking for suffix of object files... o 2024-09-11T22:22:12.026 INFO:tasks.workunit.client.0.smithi100.stdout:checking whether we are using the GNU C compiler... yes 2024-09-11T22:22:12.067 INFO:tasks.workunit.client.0.smithi100.stdout:checking whether gcc accepts -g... yes 2024-09-11T22:22:12.128 INFO:tasks.workunit.client.0.smithi100.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-11T22:22:12.699 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:22:12.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.799+0000 7f07e8142640 1 Processor -- start 2024-09-11T22:22:12.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.799+0000 7f07e8142640 1 -- start start 2024-09-11T22:22:12.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.800+0000 7f07e8142640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f07e00d0b20 0x7f07e00ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:12.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.800+0000 7f07e8142640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f07e00d0f00 0x7f07e0165370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:12.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.800+0000 7f07e8142640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07e00c55d0 con 0x7f07e00cad20 2024-09-11T22:22:12.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.800+0000 7f07e8142640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f07e00c58b0 con 0x7f07e00d0f00 2024-09-11T22:22:12.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.800+0000 7f07e8142640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f07e015ad20 con 0x7f07e00d0b20 2024-09-11T22:22:12.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.800+0000 7f07e56dd640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f07e00cad20 legacy=0x7f07e0154830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:22:12.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.800+0000 7f07e66df640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f07e00d0f00 msgr2=0x7f07e0165370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:22:12.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.800+0000 7f07e66df640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f07e00d0f00 0x7f07e0165370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:22:12.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.800+0000 7f07e5ede640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f07e00d0b20 0x7f07e00ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:12.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.800+0000 7f07e5ede640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f07e00d0b20 0x7f07e00ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:39922/0 (socket says 172.21.15.100:39922) 2024-09-11T22:22:12.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.800+0000 7f07e5ede640 1 -- 172.21.15.100:0/4231361340 learned_addr learned my addr 172.21.15.100:0/4231361340 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:12.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.801+0000 7f07e5ede640 1 -- 172.21.15.100:0/4231361340 >> v2:172.21.15.100:3300/0 conn(0x7f07e00d0f00 msgr2=0x7f07e0165370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:22:12.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.801+0000 7f07e5ede640 1 --2- 172.21.15.100:0/4231361340 >> v2:172.21.15.100:3300/0 conn(0x7f07e00d0f00 0x7f07e0165370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:12.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.801+0000 7f07e5ede640 1 -- 172.21.15.100:0/4231361340 >> v1:172.21.15.100:6789/0 conn(0x7f07e00cad20 legacy=0x7f07e0154830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:22:12.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.801+0000 7f07e5ede640 1 -- 172.21.15.100:0/4231361340 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e015b000 con 0x7f07e00d0b20 2024-09-11T22:22:12.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.801+0000 7f07e5ede640 1 --2- 172.21.15.100:0/4231361340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07e00d0b20 0x7f07e00ccdb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f07e00d0800 tx=0x7f07dc02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4091aa783457f784 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:12.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.802+0000 7f07e4edc640 1 -- 172.21.15.100:0/4231361340 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc037070 con 0x7f07e00d0b20 2024-09-11T22:22:12.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.802+0000 7f07e4edc640 1 -- 172.21.15.100:0/4231361340 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07dc032440 con 0x7f07e00d0b20 2024-09-11T22:22:12.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.802+0000 7f07e4edc640 1 -- 172.21.15.100:0/4231361340 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc032810 con 0x7f07e00d0b20 2024-09-11T22:22:12.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.802+0000 7f07e8142640 1 -- 172.21.15.100:0/4231361340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07e00d0b20 msgr2=0x7f07e00ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:12.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.802+0000 7f07e8142640 1 --2- 172.21.15.100:0/4231361340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07e00d0b20 0x7f07e00ccdb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f07e00d0800 tx=0x7f07dc02a1c0 comp rx=0 tx=0).stop 2024-09-11T22:22:12.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.802+0000 7f07e8142640 1 -- 172.21.15.100:0/4231361340 shutdown_connections 2024-09-11T22:22:12.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.802+0000 7f07e8142640 1 --2- 172.21.15.100:0/4231361340 >> v2:172.21.15.100:3300/0 conn(0x7f07e00d0f00 0x7f07e0165370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:12.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.802+0000 7f07e8142640 1 --2- 172.21.15.100:0/4231361340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07e00d0b20 0x7f07e00ccdb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:12.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.802+0000 7f07e8142640 1 -- 172.21.15.100:0/4231361340 >> 172.21.15.100:0/4231361340 conn(0x7f07e006d160 msgr2=0x7f07e006d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:12.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.802+0000 7f07e8142640 1 -- 172.21.15.100:0/4231361340 shutdown_connections 2024-09-11T22:22:12.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.802+0000 7f07e8142640 1 -- 172.21.15.100:0/4231361340 wait complete. 2024-09-11T22:22:12.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.803+0000 7f07e8142640 1 Processor -- start 2024-09-11T22:22:12.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.803+0000 7f07e8142640 1 -- start start 2024-09-11T22:22:12.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.804+0000 7f07e8142640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07e00cad20 0x7f07e01f0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:12.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.804+0000 7f07e8142640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07e00d0b20 0x7f07e014f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:12.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.804+0000 7f07e8142640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e00d0f00 0x7f07e01501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:12.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.804+0000 7f07e8142640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f07e015b800 con 0x7f07e00d0f00 2024-09-11T22:22:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.804+0000 7f07e8142640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f07e015a9f0 con 0x7f07e00d0b20 2024-09-11T22:22:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.804+0000 7f07e8142640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f07e00b3290 con 0x7f07e00cad20 2024-09-11T22:22:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.804+0000 7f07e66df640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e00d0f00 msgr2=0x7f07e01501d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:22:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.804+0000 7f07e66df640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e00d0f00 0x7f07e01501d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:22:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.804+0000 7f07e56dd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07e00d0b20 0x7f07e014f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.804+0000 7f07e5ede640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07e00cad20 0x7f07e01f0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.804+0000 7f07e56dd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07e00d0b20 0x7f07e014f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:39932/0 (socket says 172.21.15.100:39932) 2024-09-11T22:22:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.804+0000 7f07e56dd640 1 -- 172.21.15.100:0/644734091 learned_addr learned my addr 172.21.15.100:0/644734091 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.805+0000 7f07e5ede640 1 -- 172.21.15.100:0/644734091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07e00d0b20 msgr2=0x7f07e014f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.805+0000 7f07e5ede640 1 --2- 172.21.15.100:0/644734091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07e00d0b20 0x7f07e014f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.805+0000 7f07e5ede640 1 -- 172.21.15.100:0/644734091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e00d0f00 msgr2=0x7f07e01501d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:22:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.805+0000 7f07e5ede640 1 --2- 172.21.15.100:0/644734091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e00d0f00 0x7f07e01501d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:12.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.805+0000 7f07e5ede640 1 -- 172.21.15.100:0/644734091 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e0152fe0 con 0x7f07e00cad20 2024-09-11T22:22:12.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.805+0000 7f07e56dd640 1 --2- 172.21.15.100:0/644734091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07e00d0b20 0x7f07e014f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:12.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.805+0000 7f07e5ede640 1 --2- 172.21.15.100:0/644734091 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07e00cad20 0x7f07e01f0fb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f07dc031000 tx=0x7f07dc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:12.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.805+0000 7f07d67fc640 1 -- 172.21.15.100:0/644734091 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc041070 con 0x7f07e00cad20 2024-09-11T22:22:12.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.805+0000 7f07d67fc640 1 -- 172.21.15.100:0/644734091 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07dc03c870 con 0x7f07e00cad20 2024-09-11T22:22:12.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.805+0000 7f07e8142640 1 -- 172.21.15.100:0/644734091 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07e01532c0 con 0x7f07e00cad20 2024-09-11T22:22:12.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.805+0000 7f07d67fc640 1 -- 172.21.15.100:0/644734091 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc037040 con 0x7f07e00cad20 2024-09-11T22:22:12.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.805+0000 7f07e8142640 1 -- 172.21.15.100:0/644734091 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f07e01f04d0 con 0x7f07e00cad20 2024-09-11T22:22:12.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.806+0000 7f07e8142640 1 -- 172.21.15.100:0/644734091 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07e0069290 con 0x7f07e00cad20 2024-09-11T22:22:12.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.807+0000 7f07d67fc640 1 -- 172.21.15.100:0/644734091 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f07dc044070 con 0x7f07e00cad20 2024-09-11T22:22:12.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.807+0000 7f07d67fc640 1 --2- 172.21.15.100:0/644734091 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f07c406bde0 0x7f07c406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:12.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.807+0000 7f07d67fc640 1 -- 172.21.15.100:0/644734091 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f07dc0abe70 con 0x7f07e00cad20 2024-09-11T22:22:12.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.807+0000 7f07e56dd640 1 --2- 172.21.15.100:0/644734091 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f07c406bde0 0x7f07c406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:12.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.808+0000 7f07e56dd640 1 --2- 172.21.15.100:0/644734091 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f07c406bde0 0x7f07c406e2a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f07e01597b0 tx=0x7f07d0003b90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:12.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:12.812+0000 7f07d67fc640 1 -- 172.21.15.100:0/644734091 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f07dc079ee0 con 0x7f07e00cad20 2024-09-11T22:22:13.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:13.049+0000 7f07e8142640 1 -- 172.21.15.100:0/644734091 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f07e0154b40 con 0x7f07e00cad20 2024-09-11T22:22:13.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:13.050+0000 7f07d67fc640 1 -- 172.21.15.100:0/644734091 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f07dc07e1e0 con 0x7f07e00cad20 2024-09-11T22:22:13.050 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":10,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:22:13.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:13.052+0000 7f07e8142640 1 -- 172.21.15.100:0/644734091 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f07c406bde0 msgr2=0x7f07c406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:13.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:13.052+0000 7f07e8142640 1 --2- 172.21.15.100:0/644734091 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f07c406bde0 0x7f07c406e2a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f07e01597b0 tx=0x7f07d0003b90 comp rx=0 tx=0).stop 2024-09-11T22:22:13.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:13.052+0000 7f07e8142640 1 -- 172.21.15.100:0/644734091 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07e00cad20 msgr2=0x7f07e01f0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:13.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:13.052+0000 7f07e8142640 1 --2- 172.21.15.100:0/644734091 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07e00cad20 0x7f07e01f0fb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f07dc031000 tx=0x7f07dc0046c0 comp rx=0 tx=0).stop 2024-09-11T22:22:13.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:13.052+0000 7f07e8142640 1 -- 172.21.15.100:0/644734091 shutdown_connections 2024-09-11T22:22:13.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:13.052+0000 7f07e8142640 1 --2- 172.21.15.100:0/644734091 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f07c406bde0 0x7f07c406e2a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:13.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:13.052+0000 7f07e8142640 1 --2- 172.21.15.100:0/644734091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e00d0f00 0x7f07e01501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:13.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:13.052+0000 7f07e8142640 1 --2- 172.21.15.100:0/644734091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07e00d0b20 0x7f07e014f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:13.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:13.052+0000 7f07e8142640 1 --2- 172.21.15.100:0/644734091 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f07e00cad20 0x7f07e01f0fb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:13.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:13.052+0000 7f07e8142640 1 -- 172.21.15.100:0/644734091 >> 172.21.15.100:0/644734091 conn(0x7f07e006d160 msgr2=0x7f07e0159800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:13.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:13.052+0000 7f07e8142640 1 -- 172.21.15.100:0/644734091 shutdown_connections 2024-09-11T22:22:13.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:13.052+0000 7f07e8142640 1 -- 172.21.15.100:0/644734091 wait complete. 2024-09-11T22:22:16.064 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:22:16.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.179+0000 7fb74301e640 1 Processor -- start 2024-09-11T22:22:16.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.179+0000 7fb74301e640 1 -- start start 2024-09-11T22:22:16.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.180+0000 7fb74301e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb73c154d20 0x7fb73c0cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:16.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.180+0000 7fb74301e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb73c0c5d80 con 0x7fb73c0cc770 2024-09-11T22:22:16.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.180+0000 7fb74301e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb73c15dfd0 con 0x7fb73c0cb920 2024-09-11T22:22:16.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.180+0000 7fb74301e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb73c15ebe0 con 0x7fb73c154d20 2024-09-11T22:22:16.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.180+0000 7fb733fff640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7fb73c0cc770 legacy=0x7fb73c072230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:22:16.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.180+0000 7fb740dba640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb73c154d20 0x7fb73c0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:16.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.180+0000 7fb7415bb640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb73c0cb920 0x7fb73c15aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:55648/0 (socket says 172.21.15.100:55648) 2024-09-11T22:22:16.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.180+0000 7fb7415bb640 1 -- 172.21.15.100:0/18636298 learned_addr learned my addr 172.21.15.100:0/18636298 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:22:16.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.181+0000 7fb740dba640 1 -- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb73c154d20 msgr2=0x7fb73c0cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:22:16.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.181+0000 7fb740dba640 1 -- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb73c154d20 msgr2=0x7fb73c0cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:22:16.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.181+0000 7fb740dba640 1 --2- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb73c154d20 0x7fb73c0cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:22:16.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.181+0000 7fb740dba640 1 --2- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb73c154d20 0x7fb73c0cb300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:22:16.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.381+0000 7fb733fff640 1 -- 172.21.15.100:0/18636298 >> v1:172.21.15.100:6789/0 conn(0x7fb73c0cc770 legacy=0x7fb73c072230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:22:16.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.382+0000 7fb740dba640 1 --2- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb73c154d20 0x7fb73c0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:16.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.382+0000 7fb740dba640 1 -- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb73c154d20 msgr2=0x7fb73c0cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:22:16.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.382+0000 7fb740dba640 1 -- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb73c154d20 msgr2=0x7fb73c0cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:22:16.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.382+0000 7fb740dba640 1 --2- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb73c154d20 0x7fb73c0cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:22:16.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.382+0000 7fb740dba640 1 --2- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb73c154d20 0x7fb73c0cb300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:22:16.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.782+0000 7fb733fff640 1 -- 172.21.15.100:0/18636298 >> v1:172.21.15.100:6789/0 conn(0x7fb73c0cc770 legacy=0x7fb73c072230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:22:16.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.783+0000 7fb740dba640 1 --2- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb73c154d20 0x7fb73c0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:16.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.783+0000 7fb740dba640 1 -- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb73c154d20 msgr2=0x7fb73c0cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:22:16.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.783+0000 7fb740dba640 1 -- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb73c154d20 msgr2=0x7fb73c0cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:22:16.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.783+0000 7fb740dba640 1 --2- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb73c154d20 0x7fb73c0cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:22:16.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:16.783+0000 7fb740dba640 1 --2- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb73c154d20 0x7fb73c0cb300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:22:17.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:17.583+0000 7fb733fff640 1 -- 172.21.15.100:0/18636298 >> v1:172.21.15.100:6789/0 conn(0x7fb73c0cc770 legacy=0x7fb73c072230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:22:17.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:17.584+0000 7fb740dba640 1 --2- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb73c154d20 0x7fb73c0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:17.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:17.584+0000 7fb740dba640 1 -- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb73c154d20 msgr2=0x7fb73c0cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:22:17.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:17.584+0000 7fb740dba640 1 -- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb73c154d20 msgr2=0x7fb73c0cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:22:17.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:17.584+0000 7fb740dba640 1 --2- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb73c154d20 0x7fb73c0cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:22:17.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:17.584+0000 7fb740dba640 1 --2- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb73c154d20 0x7fb73c0cb300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:22:19.091 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:22:19.095 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:22:19.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.180+0000 7fb7327fc640 1 -- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb73c154d20 msgr2=0x7fb73c0cb300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:22:19.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.180+0000 7fb7327fc640 1 --2- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb73c154d20 0x7fb73c0cb300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:19.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.180+0000 7fb7327fc640 1 -- 172.21.15.100:0/18636298 >> v1:172.21.15.167:6789/0 conn(0x7fb73c0cb920 legacy=0x7fb73c15aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:19.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.180+0000 7fb7327fc640 1 -- 172.21.15.100:0/18636298 >> v1:172.21.15.100:6789/0 conn(0x7fb73c0cc770 legacy=0x7fb73c072230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:22:19.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.180+0000 7fb7327fc640 1 --2- 172.21.15.100:0/18636298 >> v2:172.21.15.100:3300/0 conn(0x7fb7280036d0 0x7fb728005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.180+0000 7fb7327fc640 1 --2- 172.21.15.100:0/18636298 >> v2:172.21.15.167:3300/0 conn(0x7fb7280061a0 0x7fb728008640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:19.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.180+0000 7fb7327fc640 1 -- 172.21.15.100:0/18636298 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb73c15ebe0 con 0x7fb7280036d0 2024-09-11T22:22:19.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.180+0000 7fb7327fc640 1 -- 172.21.15.100:0/18636298 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fb728008cf0 con 0x7fb7280061a0 2024-09-11T22:22:19.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.180+0000 7fb740dba640 1 -- 172.21.15.100:0/18636298 >> v2:172.21.15.100:3300/0 conn(0x7fb7280036d0 msgr2=0x7fb728005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:22:19.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.180+0000 7fb740dba640 1 --2- 172.21.15.100:0/18636298 >> v2:172.21.15.100:3300/0 conn(0x7fb7280036d0 0x7fb728005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:22:19.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.180+0000 7fb733fff640 1 --2- 172.21.15.100:0/18636298 >> v2:172.21.15.167:3300/0 conn(0x7fb7280061a0 0x7fb728008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.181+0000 7fb733fff640 1 -- 172.21.15.100:0/18636298 >> v2:172.21.15.167:3300/0 conn(0x7fb7280061a0 msgr2=0x7fb728008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:22:19.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.181+0000 7fb733fff640 1 -- 172.21.15.100:0/18636298 >> v2:172.21.15.167:3300/0 conn(0x7fb7280061a0 msgr2=0x7fb728008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:22:19.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.181+0000 7fb733fff640 1 --2- 172.21.15.100:0/18636298 >> v2:172.21.15.167:3300/0 conn(0x7fb7280061a0 0x7fb728008640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:22:19.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.181+0000 7fb733fff640 1 --2- 172.21.15.100:0/18636298 >> v2:172.21.15.167:3300/0 conn(0x7fb7280061a0 0x7fb728008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:22:19.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.381+0000 7fb740dba640 1 -- 172.21.15.100:0/18636298 >> v2:172.21.15.100:3300/0 conn(0x7fb7280036d0 msgr2=0x7fb728005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:22:19.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.381+0000 7fb740dba640 1 --2- 172.21.15.100:0/18636298 >> v2:172.21.15.100:3300/0 conn(0x7fb7280036d0 0x7fb728005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:22:19.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.382+0000 7fb733fff640 1 --2- 172.21.15.100:0/18636298 >> v2:172.21.15.167:3300/0 conn(0x7fb7280061a0 0x7fb728008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.382+0000 7fb733fff640 1 -- 172.21.15.100:0/18636298 >> v2:172.21.15.167:3300/0 conn(0x7fb7280061a0 msgr2=0x7fb728008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:22:19.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.382+0000 7fb733fff640 1 -- 172.21.15.100:0/18636298 >> v2:172.21.15.167:3300/0 conn(0x7fb7280061a0 msgr2=0x7fb728008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:22:19.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.382+0000 7fb733fff640 1 --2- 172.21.15.100:0/18636298 >> v2:172.21.15.167:3300/0 conn(0x7fb7280061a0 0x7fb728008640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:22:19.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.382+0000 7fb733fff640 1 --2- 172.21.15.100:0/18636298 >> v2:172.21.15.167:3300/0 conn(0x7fb7280061a0 0x7fb728008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:22:19.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.782+0000 7fb740dba640 1 -- 172.21.15.100:0/18636298 >> v2:172.21.15.100:3300/0 conn(0x7fb7280036d0 msgr2=0x7fb728005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:22:19.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.782+0000 7fb740dba640 1 --2- 172.21.15.100:0/18636298 >> v2:172.21.15.100:3300/0 conn(0x7fb7280036d0 0x7fb728005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:22:19.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.783+0000 7fb733fff640 1 --2- 172.21.15.100:0/18636298 >> v2:172.21.15.167:3300/0 conn(0x7fb7280061a0 0x7fb728008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:19.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.783+0000 7fb733fff640 1 -- 172.21.15.100:0/18636298 >> v2:172.21.15.167:3300/0 conn(0x7fb7280061a0 msgr2=0x7fb728008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:22:19.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.783+0000 7fb733fff640 1 -- 172.21.15.100:0/18636298 >> v2:172.21.15.167:3300/0 conn(0x7fb7280061a0 msgr2=0x7fb728008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:22:19.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.783+0000 7fb733fff640 1 --2- 172.21.15.100:0/18636298 >> v2:172.21.15.167:3300/0 conn(0x7fb7280061a0 0x7fb728008640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:22:19.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:19.783+0000 7fb733fff640 1 --2- 172.21.15.100:0/18636298 >> v2:172.21.15.167:3300/0 conn(0x7fb7280061a0 0x7fb728008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:22:20.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.583+0000 7fb740dba640 1 -- 172.21.15.100:0/18636298 >> v2:172.21.15.100:3300/0 conn(0x7fb7280036d0 msgr2=0x7fb728005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:22:20.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.583+0000 7fb740dba640 1 --2- 172.21.15.100:0/18636298 >> v2:172.21.15.100:3300/0 conn(0x7fb7280036d0 0x7fb728005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:22:20.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.584+0000 7fb733fff640 1 --2- 172.21.15.100:0/18636298 >> v2:172.21.15.167:3300/0 conn(0x7fb7280061a0 0x7fb728008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:20.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.585+0000 7fb733fff640 1 -- 172.21.15.100:0/18636298 >> v2:172.21.15.100:3300/0 conn(0x7fb7280036d0 msgr2=0x7fb728005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:22:20.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.585+0000 7fb733fff640 1 --2- 172.21.15.100:0/18636298 >> v2:172.21.15.100:3300/0 conn(0x7fb7280036d0 0x7fb728005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.585+0000 7fb733fff640 1 -- 172.21.15.100:0/18636298 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb73c15e2b0 con 0x7fb7280061a0 2024-09-11T22:22:20.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.586+0000 7fb733fff640 1 --2- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7280061a0 0x7fb728008640 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb728006170 tx=0x7fb72c02b1b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dad14316d5d59a97 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:20.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.586+0000 7fb7337fe640 1 -- 172.21.15.100:0/18636298 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c031070 con 0x7fb7280061a0 2024-09-11T22:22:20.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.586+0000 7fb7337fe640 1 -- 172.21.15.100:0/18636298 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb72c035410 con 0x7fb7280061a0 2024-09-11T22:22:20.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.586+0000 7fb7337fe640 1 -- 172.21.15.100:0/18636298 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c035800 con 0x7fb7280061a0 2024-09-11T22:22:20.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.587+0000 7fb74301e640 1 -- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7280061a0 msgr2=0x7fb728008640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:20.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.587+0000 7fb74301e640 1 --2- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7280061a0 0x7fb728008640 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb728006170 tx=0x7fb72c02b1b0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.587+0000 7fb7415bb640 1 -- 172.21.15.100:0/18636298 reap_dead start 2024-09-11T22:22:20.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.587+0000 7fb74301e640 1 -- 172.21.15.100:0/18636298 shutdown_connections 2024-09-11T22:22:20.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.587+0000 7fb74301e640 1 --2- 172.21.15.100:0/18636298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7280061a0 0x7fb728008640 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.587+0000 7fb74301e640 1 -- 172.21.15.100:0/18636298 >> 172.21.15.100:0/18636298 conn(0x7fb73c0d0380 msgr2=0x7fb73c0d0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:20.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.587+0000 7fb74301e640 1 -- 172.21.15.100:0/18636298 shutdown_connections 2024-09-11T22:22:20.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.587+0000 7fb74301e640 1 -- 172.21.15.100:0/18636298 wait complete. 2024-09-11T22:22:20.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.588+0000 7fb74301e640 1 Processor -- start 2024-09-11T22:22:20.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.589+0000 7fb74301e640 1 -- start start 2024-09-11T22:22:20.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.589+0000 7fb74301e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7280061a0 0x7fb73c1f0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:20.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.590+0000 7fb74301e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb73c156a70 0x7fb73c0b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:20.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.590+0000 7fb74301e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb73c157a10 0x7fb73c157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:20.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.590+0000 7fb74301e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c15e870 con 0x7fb73c157a10 2024-09-11T22:22:20.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.590+0000 7fb74301e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c155100 con 0x7fb73c156a70 2024-09-11T22:22:20.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.590+0000 7fb74301e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb73c072940 con 0x7fb7280061a0 2024-09-11T22:22:20.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.590+0000 7fb7415bb640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb73c157a10 msgr2=0x7fb73c157e90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:22:20.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.590+0000 7fb7415bb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb73c157a10 0x7fb73c157e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:22:20.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.590+0000 7fb733fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb73c156a70 0x7fb73c0b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:20.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.590+0000 7fb733fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb73c156a70 0x7fb73c0b5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:39982/0 (socket says 172.21.15.100:39982) 2024-09-11T22:22:20.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.590+0000 7fb740dba640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7280061a0 0x7fb73c1f0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:20.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.590+0000 7fb733fff640 1 -- 172.21.15.100:0/3051962367 learned_addr learned my addr 172.21.15.100:0/3051962367 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:20.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.590+0000 7fb740dba640 1 -- 172.21.15.100:0/3051962367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb73c156a70 msgr2=0x7fb73c0b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:20.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.590+0000 7fb740dba640 1 --2- 172.21.15.100:0/3051962367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb73c156a70 0x7fb73c0b5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.590+0000 7fb740dba640 1 -- 172.21.15.100:0/3051962367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb73c157a10 msgr2=0x7fb73c157e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:22:20.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.590+0000 7fb740dba640 1 --2- 172.21.15.100:0/3051962367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb73c157a10 0x7fb73c157e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.590+0000 7fb740dba640 1 -- 172.21.15.100:0/3051962367 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb73c156fa0 con 0x7fb7280061a0 2024-09-11T22:22:20.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.590+0000 7fb733fff640 1 --2- 172.21.15.100:0/3051962367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb73c156a70 0x7fb73c0b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:20.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.590+0000 7fb740dba640 1 --2- 172.21.15.100:0/3051962367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7280061a0 0x7fb73c1f0810 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb738003fd0 tx=0x7fb738004610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:20.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.591+0000 7fb7317fa640 1 -- 172.21.15.100:0/3051962367 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73801a030 con 0x7fb7280061a0 2024-09-11T22:22:20.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.591+0000 7fb7317fa640 1 -- 172.21.15.100:0/3051962367 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb738016670 con 0x7fb7280061a0 2024-09-11T22:22:20.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.591+0000 7fb74301e640 1 -- 172.21.15.100:0/3051962367 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb73c1f1050 con 0x7fb7280061a0 2024-09-11T22:22:20.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.591+0000 7fb7317fa640 1 -- 172.21.15.100:0/3051962367 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738016a60 con 0x7fb7280061a0 2024-09-11T22:22:20.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.591+0000 7fb74301e640 1 -- 172.21.15.100:0/3051962367 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb73c1f1610 con 0x7fb7280061a0 2024-09-11T22:22:20.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.592+0000 7fb74301e640 1 -- 172.21.15.100:0/3051962367 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb73c1583d0 con 0x7fb7280061a0 2024-09-11T22:22:20.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.592+0000 7fb7317fa640 1 -- 172.21.15.100:0/3051962367 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb73801d030 con 0x7fb7280061a0 2024-09-11T22:22:20.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.593+0000 7fb7317fa640 1 --2- 172.21.15.100:0/3051962367 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb72806cb60 0x7fb72806f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:20.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.593+0000 7fb7317fa640 1 -- 172.21.15.100:0/3051962367 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fb73808b4f0 con 0x7fb7280061a0 2024-09-11T22:22:20.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.593+0000 7fb733fff640 1 --2- 172.21.15.100:0/3051962367 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb72806cb60 0x7fb72806f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:20.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.594+0000 7fb733fff640 1 --2- 172.21.15.100:0/3051962367 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb72806cb60 0x7fb72806f020 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb72c000ea0 tx=0x7fb72c031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:20.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.598+0000 7fb7317fa640 1 -- 172.21.15.100:0/3051962367 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb73c1583d0 con 0x7fb7280061a0 2024-09-11T22:22:20.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.831+0000 7fb74301e640 1 -- 172.21.15.100:0/3051962367 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb73c0cb300 con 0x7fb7280061a0 2024-09-11T22:22:20.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.832+0000 7fb7317fa640 1 -- 172.21.15.100:0/3051962367 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7fb7380593d0 con 0x7fb7280061a0 2024-09-11T22:22:20.833 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":12,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:22:20.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.834+0000 7fb74301e640 1 -- 172.21.15.100:0/3051962367 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb72806cb60 msgr2=0x7fb72806f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:20.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.834+0000 7fb74301e640 1 --2- 172.21.15.100:0/3051962367 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb72806cb60 0x7fb72806f020 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb72c000ea0 tx=0x7fb72c031000 comp rx=0 tx=0).stop 2024-09-11T22:22:20.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.834+0000 7fb74301e640 1 -- 172.21.15.100:0/3051962367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7280061a0 msgr2=0x7fb73c1f0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:20.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.834+0000 7fb74301e640 1 --2- 172.21.15.100:0/3051962367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7280061a0 0x7fb73c1f0810 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb738003fd0 tx=0x7fb738004610 comp rx=0 tx=0).stop 2024-09-11T22:22:20.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.834+0000 7fb74301e640 1 -- 172.21.15.100:0/3051962367 shutdown_connections 2024-09-11T22:22:20.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.834+0000 7fb74301e640 1 --2- 172.21.15.100:0/3051962367 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb72806cb60 0x7fb72806f020 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.834+0000 7fb74301e640 1 --2- 172.21.15.100:0/3051962367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb73c157a10 0x7fb73c157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.834+0000 7fb74301e640 1 --2- 172.21.15.100:0/3051962367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb73c156a70 0x7fb73c0b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.834+0000 7fb74301e640 1 --2- 172.21.15.100:0/3051962367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7280061a0 0x7fb73c1f0810 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.834+0000 7fb74301e640 1 -- 172.21.15.100:0/3051962367 >> 172.21.15.100:0/3051962367 conn(0x7fb73c0d0380 msgr2=0x7fb73c0ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:20.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.834+0000 7fb74301e640 1 -- 172.21.15.100:0/3051962367 shutdown_connections 2024-09-11T22:22:20.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.834+0000 7fb74301e640 1 -- 172.21.15.100:0/3051962367 wait complete. 2024-09-11T22:22:20.846 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-11T22:22:20.846 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-11T22:22:20.846 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:22:20.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.984+0000 7f093acfa640 1 Processor -- start 2024-09-11T22:22:20.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.984+0000 7f093acfa640 1 -- start start 2024-09-11T22:22:20.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.985+0000 7f093acfa640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09340ce430 0x7f09340ca700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:20.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.985+0000 7f093acfa640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f093406e970 0x7f093415c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:20.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.985+0000 7f093acfa640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09340c8dd0 con 0x7f09340ce810 2024-09-11T22:22:20.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.985+0000 7f093acfa640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f093415bd60 con 0x7f093406e970 2024-09-11T22:22:20.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.985+0000 7f093acfa640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f09341587f0 con 0x7f09340ce430 2024-09-11T22:22:20.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.985+0000 7f0939297640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f093406e970 msgr2=0x7f093415c1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:22:20.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.985+0000 7f0933fff640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f09340ce810 legacy=0x7f09341526b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:22:20.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.985+0000 7f0939297640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f093406e970 0x7f093415c1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:22:20.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.985+0000 7f0938a96640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09340ce430 0x7f09340ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:20.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.985+0000 7f0938a96640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09340ce430 0x7f09340ca700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:60680/0 (socket says 172.21.15.100:60680) 2024-09-11T22:22:20.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.985+0000 7f0938a96640 1 -- 172.21.15.100:0/902746225 learned_addr learned my addr 172.21.15.100:0/902746225 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:20.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.985+0000 7f0938a96640 1 -- 172.21.15.100:0/902746225 >> v2:172.21.15.100:3300/0 conn(0x7f093406e970 msgr2=0x7f093415c1f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:22:20.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.985+0000 7f0938a96640 1 --2- 172.21.15.100:0/902746225 >> v2:172.21.15.100:3300/0 conn(0x7f093406e970 0x7f093415c1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.986+0000 7f0938a96640 1 -- 172.21.15.100:0/902746225 >> v1:172.21.15.100:6789/0 conn(0x7f09340ce810 legacy=0x7f09341526b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:22:20.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.986+0000 7f0938a96640 1 -- 172.21.15.100:0/902746225 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0934158a90 con 0x7f09340ce430 2024-09-11T22:22:20.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.986+0000 7f0938a96640 1 --2- 172.21.15.100:0/902746225 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09340ce430 0x7f09340ca700 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0928009870 tx=0x7f092802a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1e5a9f3725d7e8e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:20.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.986+0000 7f09337fe640 1 -- 172.21.15.100:0/902746225 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0928037070 con 0x7f09340ce430 2024-09-11T22:22:20.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.986+0000 7f09337fe640 1 -- 172.21.15.100:0/902746225 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0928032440 con 0x7f09340ce430 2024-09-11T22:22:20.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.986+0000 7f09337fe640 1 -- 172.21.15.100:0/902746225 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0928032810 con 0x7f09340ce430 2024-09-11T22:22:20.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.987+0000 7f093acfa640 1 -- 172.21.15.100:0/902746225 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09340ce430 msgr2=0x7f09340ca700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:20.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.987+0000 7f093acfa640 1 --2- 172.21.15.100:0/902746225 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09340ce430 0x7f09340ca700 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0928009870 tx=0x7f092802a230 comp rx=0 tx=0).stop 2024-09-11T22:22:20.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.987+0000 7f093acfa640 1 -- 172.21.15.100:0/902746225 shutdown_connections 2024-09-11T22:22:20.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.987+0000 7f093acfa640 1 --2- 172.21.15.100:0/902746225 >> v2:172.21.15.100:3300/0 conn(0x7f093406e970 0x7f093415c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.987+0000 7f093acfa640 1 --2- 172.21.15.100:0/902746225 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09340ce430 0x7f09340ca700 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.987+0000 7f093acfa640 1 -- 172.21.15.100:0/902746225 >> 172.21.15.100:0/902746225 conn(0x7f09340714a0 msgr2=0x7f0934071880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:20.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.987+0000 7f093acfa640 1 -- 172.21.15.100:0/902746225 shutdown_connections 2024-09-11T22:22:20.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.987+0000 7f093acfa640 1 -- 172.21.15.100:0/902746225 wait complete. 2024-09-11T22:22:20.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.988+0000 7f093acfa640 1 Processor -- start 2024-09-11T22:22:20.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.988+0000 7f093acfa640 1 -- start start 2024-09-11T22:22:20.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.989+0000 7f093acfa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f093406e970 0x7f09341554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:20.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.989+0000 7f093acfa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09340ce430 0x7f09341f2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:20.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.989+0000 7f093acfa640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09340ce810 0x7f09340c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:20.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.989+0000 7f093acfa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f09341592d0 con 0x7f09340ce430 2024-09-11T22:22:20.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.989+0000 7f093acfa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0934158ff0 con 0x7f093406e970 2024-09-11T22:22:20.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.989+0000 7f093acfa640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f09341595b0 con 0x7f09340ce810 2024-09-11T22:22:20.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.989+0000 7f0933fff640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09340ce430 msgr2=0x7f09341f2750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:22:20.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.989+0000 7f0933fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09340ce430 0x7f09341f2750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:22:20.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.989+0000 7f0938a96640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f093406e970 0x7f09341554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:20.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.989+0000 7f0939297640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09340ce810 0x7f09340c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:20.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.989+0000 7f0939297640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09340ce810 0x7f09340c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:60684/0 (socket says 172.21.15.100:60684) 2024-09-11T22:22:20.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.989+0000 7f0938a96640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f093406e970 0x7f09341554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:39996/0 (socket says 172.21.15.100:39996) 2024-09-11T22:22:20.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.989+0000 7f0939297640 1 -- 172.21.15.100:0/4010200509 learned_addr learned my addr 172.21.15.100:0/4010200509 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:20.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.990+0000 7f0938a96640 1 -- 172.21.15.100:0/4010200509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09340ce810 msgr2=0x7f09340c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:20.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.990+0000 7f0938a96640 1 --2- 172.21.15.100:0/4010200509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f09340ce810 0x7f09340c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.990+0000 7f0938a96640 1 -- 172.21.15.100:0/4010200509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09340ce430 msgr2=0x7f09341f2750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:22:20.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.990+0000 7f0938a96640 1 --2- 172.21.15.100:0/4010200509 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09340ce430 0x7f09341f2750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.990+0000 7f0938a96640 1 -- 172.21.15.100:0/4010200509 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0934155150 con 0x7f093406e970 2024-09-11T22:22:20.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.990+0000 7f0938a96640 1 --2- 172.21.15.100:0/4010200509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f093406e970 0x7f09341554c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0928031000 tx=0x7f09280046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:20.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.990+0000 7f09317fa640 1 -- 172.21.15.100:0/4010200509 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0928041070 con 0x7f093406e970 2024-09-11T22:22:20.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.990+0000 7f09317fa640 1 -- 172.21.15.100:0/4010200509 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f092803c870 con 0x7f093406e970 2024-09-11T22:22:20.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.990+0000 7f09317fa640 1 -- 172.21.15.100:0/4010200509 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0928037040 con 0x7f093406e970 2024-09-11T22:22:20.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.990+0000 7f093acfa640 1 -- 172.21.15.100:0/4010200509 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09341ef2b0 con 0x7f093406e970 2024-09-11T22:22:20.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.990+0000 7f093acfa640 1 -- 172.21.15.100:0/4010200509 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09341f1f50 con 0x7f093406e970 2024-09-11T22:22:20.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.991+0000 7f093acfa640 1 --2- 172.21.15.100:0/4010200509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09341efc00 0x7f09341e57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:20.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.991+0000 7f093acfa640 1 -- 172.21.15.100:0/4010200509 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f09341f2c90 con 0x7f09341efc00 2024-09-11T22:22:20.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.991+0000 7f0933fff640 1 --2- 172.21.15.100:0/4010200509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09341efc00 0x7f09341e57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:20.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.991+0000 7f0933fff640 1 -- 172.21.15.100:0/4010200509 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f09340692a0 con 0x7f09341efc00 2024-09-11T22:22:20.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.991+0000 7f0933fff640 1 --2- 172.21.15.100:0/4010200509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09341efc00 0x7f09341e57c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0934071b60 tx=0x7f092000b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:20.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.992+0000 7f09317fa640 1 -- 172.21.15.100:0/4010200509 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0928044070 con 0x7f093406e970 2024-09-11T22:22:20.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.992+0000 7f09317fa640 1 --2- 172.21.15.100:0/4010200509 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f091806be10 0x7f091806e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:20.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.992+0000 7f09317fa640 1 -- 172.21.15.100:0/4010200509 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f09280abc90 con 0x7f093406e970 2024-09-11T22:22:20.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.992+0000 7f0939297640 1 --2- 172.21.15.100:0/4010200509 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f091806be10 0x7f091806e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:20.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.992+0000 7f09317fa640 1 -- 172.21.15.100:0/4010200509 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0920016070 con 0x7f09341efc00 2024-09-11T22:22:20.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.992+0000 7f09317fa640 1 -- 172.21.15.100:0/4010200509 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0920003d30 con 0x7f09341efc00 2024-09-11T22:22:20.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.992+0000 7f09317fa640 1 -- 172.21.15.100:0/4010200509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09341efc00 msgr2=0x7f09341e57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:20.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.992+0000 7f09317fa640 1 --2- 172.21.15.100:0/4010200509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09341efc00 0x7f09341e57c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0934071b60 tx=0x7f092000b8e0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.992+0000 7f09317fa640 1 -- 172.21.15.100:0/4010200509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09341efc00 msgr2=0x7f09341e57c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:22:20.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.992+0000 7f09317fa640 1 --2- 172.21.15.100:0/4010200509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09341efc00 0x7f09341e57c0 secure :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0934071b60 tx=0x7f092000b8e0 comp rx=0 tx=0).stop 2024-09-11T22:22:20.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.992+0000 7f0939297640 1 --2- 172.21.15.100:0/4010200509 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f091806be10 0x7f091806e2d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f092c00b450 tx=0x7f092c00d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:20.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.998+0000 7f093acfa640 1 --2- 172.21.15.100:0/4010200509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09341e42f0 0x7f09341e46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:20.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.998+0000 7f093acfa640 1 -- 172.21.15.100:0/4010200509 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f093406ee20 con 0x7f09341e42f0 2024-09-11T22:22:20.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.998+0000 7f0933fff640 1 --2- 172.21.15.100:0/4010200509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09341e42f0 0x7f09341e46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:21.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.999+0000 7f0933fff640 1 -- 172.21.15.100:0/4010200509 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0934157640 con 0x7f09341e42f0 2024-09-11T22:22:21.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.999+0000 7f0933fff640 1 --2- 172.21.15.100:0/4010200509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09341e42f0 0x7f09341e46d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0920006fd0 tx=0x7f0920005980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:21.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.999+0000 7f09317fa640 1 -- 172.21.15.100:0/4010200509 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0920016040 con 0x7f09341e42f0 2024-09-11T22:22:21.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.999+0000 7f09317fa640 1 -- 172.21.15.100:0/4010200509 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5045 (secure 0 0 0) 0x7f092001ab00 con 0x7f09341e42f0 2024-09-11T22:22:21.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.999+0000 7f09317fa640 1 -- 172.21.15.100:0/4010200509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09341e42f0 msgr2=0x7f09341e46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.999+0000 7f09317fa640 1 --2- 172.21.15.100:0/4010200509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09341e42f0 0x7f09341e46d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0920006fd0 tx=0x7f0920005980 comp rx=0 tx=0).stop 2024-09-11T22:22:21.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.999+0000 7f09317fa640 1 -- 172.21.15.100:0/4010200509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09341e42f0 msgr2=0x7f09341e46d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:22:21.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:20.999+0000 7f09317fa640 1 --2- 172.21.15.100:0/4010200509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09341e42f0 0x7f09341e46d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.001 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:22:21.001 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:22:21.001 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:22:21.001 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:22:21.001 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 12, 2024-09-11T22:22:21.001 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 144979, 2024-09-11T22:22:21.001 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:22:21.001 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:22:21.002 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:22:21.002 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:21.002 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:22:21.002 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:22:21.002 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:22:21.002 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:22:21.002 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:21.002 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:21.002 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:21.002 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:21.002 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:21.002 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:21.002 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:21.003 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:21.003 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:21.003 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:21.003 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:21.003 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:21.003 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:22:21.003 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:22:21.003 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:21.003 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:21.003 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:21.003 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:21.003 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:21.003 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:21.003 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:21.004 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:21.004 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:21.004 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:21.004 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:21.004 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:21.004 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.004 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:22:21.004 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:22:21.004 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:22:21.004 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:22:21.005 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:22:21.005 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:22:21.005 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:22:21.005 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:22:21.005 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:22:21.005 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:22:21.005 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:22:21.005 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:22:21.005 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:22:21.005 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:22:21.005 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:22:21.005 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:22:21.005 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:22:21.005 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:21.006 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:21.006 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:21.006 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:21.006 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:21.006 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:21.006 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:21.006 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:21.006 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:21.006 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:21.006 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:21.006 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:21.007 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:22:21.007 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.007 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:22:21.007 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.007 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:22:21.007 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:22:21.007 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:21.007 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:21.007 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.007 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:21.008 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:22:21.008 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:21.008 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.008 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.008 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:21.008 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:22:21.008 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:21.008 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:21.008 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:21.008 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.008 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:22:21.008 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:22:21.008 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:21.009 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:21.009 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:21.009 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.009 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.009 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:22:21.009 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:22:21.010 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:21.010 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:21.010 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.010 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:21.011 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:22:21.011 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:21.011 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.011 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.011 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:21.011 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:22:21.011 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:21.012 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:21.012 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:21.012 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.012 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:22:21.012 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:22:21.012 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:21.012 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:21.012 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:21.012 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.012 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.012 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:22:21.012 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:22:21.012 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:21.013 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:21.013 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.013 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:21.013 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:22:21.013 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:21.013 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.013 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.013 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:21.013 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:22:21.013 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:21.013 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:21.013 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:21.014 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.014 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:22:21.014 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:22:21.014 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:21.014 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:21.014 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:21.014 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:21.014 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:21.014 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.014 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:22:21.014 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:22:21.015 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.015 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:21.015 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:21.015 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:22:21.015 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:21.015 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:21.015 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:22:21.015 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.015 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:21.015 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:21.015 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:22:21.015 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:21.016 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:21.016 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:22:21.016 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.016 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:21.016 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:21.016 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:22:21.016 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:21.016 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:21.016 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:22:21.016 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.016 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:21.017 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:21.017 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:22:21.017 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:21.017 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:21.017 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:22:21.017 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.017 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:21.017 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:21.017 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:22:21.018 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:21.018 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:21.018 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.018 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:22:21.018 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:22:21.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.000+0000 7f093acfa640 1 -- 172.21.15.100:0/4010200509 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f091806be10 msgr2=0x7f091806e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.000+0000 7f093acfa640 1 --2- 172.21.15.100:0/4010200509 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f091806be10 0x7f091806e2d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f092c00b450 tx=0x7f092c00d040 comp rx=0 tx=0).stop 2024-09-11T22:22:21.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.000+0000 7f093acfa640 1 -- 172.21.15.100:0/4010200509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f093406e970 msgr2=0x7f09341554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.000+0000 7f093acfa640 1 --2- 172.21.15.100:0/4010200509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f093406e970 0x7f09341554c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0928031000 tx=0x7f09280046c0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.000+0000 7f0939297640 1 -- 172.21.15.100:0/4010200509 reap_dead start 2024-09-11T22:22:21.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.000+0000 7f0939297640 1 -- 172.21.15.100:0/4010200509 reap_dead start 2024-09-11T22:22:21.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.000+0000 7f093acfa640 1 -- 172.21.15.100:0/4010200509 shutdown_connections 2024-09-11T22:22:21.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.000+0000 7f093acfa640 1 -- 172.21.15.100:0/4010200509 >> 172.21.15.100:0/4010200509 conn(0x7f09340714a0 msgr2=0x7f0934156f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:21.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.000+0000 7f093acfa640 1 -- 172.21.15.100:0/4010200509 shutdown_connections 2024-09-11T22:22:21.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.000+0000 7f093acfa640 1 -- 172.21.15.100:0/4010200509 wait complete. 2024-09-11T22:22:21.020 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:22:21.020 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-11T22:22:21.021 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:22:21.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.120+0000 7f244e24c640 1 Processor -- start 2024-09-11T22:22:21.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.120+0000 7f244e24c640 1 -- start start 2024-09-11T22:22:21.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.121+0000 7f244e24c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244806ce60 0x7f244815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.121+0000 7f244e24c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f244815c290 0x7f24481546b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.121+0000 7f244e24c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24480c6510 con 0x7f244806d240 2024-09-11T22:22:21.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.121+0000 7f244e24c640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f244815b820 con 0x7f244815c290 2024-09-11T22:22:21.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.121+0000 7f244e24c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f24480c5470 con 0x7f244806ce60 2024-09-11T22:22:21.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.121+0000 7f243ffff640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f244815c290 msgr2=0x7f24481546b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:22:21.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.121+0000 7f243ffff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f244815c290 0x7f24481546b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:22:21.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.121+0000 7f24477fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244806ce60 0x7f244815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:21.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.121+0000 7f2447fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f244806d240 0x7f244815de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:55662/0 (socket says 172.21.15.100:55662) 2024-09-11T22:22:21.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.121+0000 7f2447fff640 1 -- 172.21.15.100:0/2927344330 learned_addr learned my addr 172.21.15.100:0/2927344330 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:22:21.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.121+0000 7f2446ffd640 1 -- 172.21.15.100:0/2927344330 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3591514764 0 0) 0x7f24480c6510 con 0x7f244806d240 2024-09-11T22:22:21.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.121+0000 7f2446ffd640 1 -- 172.21.15.100:0/2927344330 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2434003520 con 0x7f244806d240 2024-09-11T22:22:21.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.121+0000 7f24477fe640 1 -- 172.21.15.100:0/2927344330 >> v2:172.21.15.100:3300/0 conn(0x7f244815c290 msgr2=0x7f24481546b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:22:21.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.121+0000 7f24477fe640 1 --2- 172.21.15.100:0/2927344330 >> v2:172.21.15.100:3300/0 conn(0x7f244815c290 0x7f24481546b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.121+0000 7f24477fe640 1 -- 172.21.15.100:0/2927344330 >> v1:172.21.15.167:6789/0 conn(0x7f244806d240 legacy=0x7f244815de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.121+0000 7f24477fe640 1 -- 172.21.15.100:0/2927344330 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24480c5750 con 0x7f244806ce60 2024-09-11T22:22:21.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.122+0000 7f24477fe640 1 --2- 172.21.15.100:0/2927344330 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244806ce60 0x7f244815bd50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f24380097a0 tx=0x7f243802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7afcd283ecd02c8e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:21.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.122+0000 7f2446ffd640 1 -- 172.21.15.100:0/2927344330 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2438037070 con 0x7f244806ce60 2024-09-11T22:22:21.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.122+0000 7f2446ffd640 1 -- 172.21.15.100:0/2927344330 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2438032440 con 0x7f244806ce60 2024-09-11T22:22:21.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.122+0000 7f2446ffd640 1 -- 172.21.15.100:0/2927344330 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24380327f0 con 0x7f244806ce60 2024-09-11T22:22:21.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.123+0000 7f244e24c640 1 -- 172.21.15.100:0/2927344330 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244806ce60 msgr2=0x7f244815bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.123+0000 7f244e24c640 1 --2- 172.21.15.100:0/2927344330 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244806ce60 0x7f244815bd50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f24380097a0 tx=0x7f243802a1a0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.123+0000 7f244e24c640 1 -- 172.21.15.100:0/2927344330 shutdown_connections 2024-09-11T22:22:21.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.123+0000 7f244e24c640 1 --2- 172.21.15.100:0/2927344330 >> v2:172.21.15.100:3300/0 conn(0x7f244815c290 0x7f24481546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.123+0000 7f244e24c640 1 --2- 172.21.15.100:0/2927344330 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244806ce60 0x7f244815bd50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.123+0000 7f244e24c640 1 -- 172.21.15.100:0/2927344330 >> 172.21.15.100:0/2927344330 conn(0x7f244806bc10 msgr2=0x7f244806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:21.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.123+0000 7f244e24c640 1 -- 172.21.15.100:0/2927344330 shutdown_connections 2024-09-11T22:22:21.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.123+0000 7f244e24c640 1 -- 172.21.15.100:0/2927344330 wait complete. 2024-09-11T22:22:21.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.124+0000 7f244e24c640 1 Processor -- start 2024-09-11T22:22:21.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.124+0000 7f244e24c640 1 -- start start 2024-09-11T22:22:21.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.125+0000 7f244e24c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244806ce60 0x7f24480c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.125+0000 7f244e24c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f244806d240 0x7f24480c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.125+0000 7f244e24c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f244815c290 0x7f24480c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.125+0000 7f244e24c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f24480cb1b0 con 0x7f244815c290 2024-09-11T22:22:21.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.125+0000 7f244e24c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f24480c5d10 con 0x7f244806d240 2024-09-11T22:22:21.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.125+0000 7f244e24c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f24480cad20 con 0x7f244806ce60 2024-09-11T22:22:21.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.125+0000 7f2447fff640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f244815c290 msgr2=0x7f24480c9d20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:22:21.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.125+0000 7f2447fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f244815c290 0x7f24480c9d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:22:21.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.125+0000 7f243ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f244806d240 0x7f24480c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:21.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.125+0000 7f24477fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244806ce60 0x7f24480c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:21.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.125+0000 7f243ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f244806d240 0x7f24480c8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:40032/0 (socket says 172.21.15.100:40032) 2024-09-11T22:22:21.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.125+0000 7f243ffff640 1 -- 172.21.15.100:0/2912452587 learned_addr learned my addr 172.21.15.100:0/2912452587 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:21.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.126+0000 7f243ffff640 1 -- 172.21.15.100:0/2912452587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244806ce60 msgr2=0x7f24480c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.126+0000 7f243ffff640 1 --2- 172.21.15.100:0/2912452587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244806ce60 0x7f24480c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.126+0000 7f243ffff640 1 -- 172.21.15.100:0/2912452587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f244815c290 msgr2=0x7f24480c9d20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:22:21.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.126+0000 7f243ffff640 1 --2- 172.21.15.100:0/2912452587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f244815c290 0x7f24480c9d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.126+0000 7f243ffff640 1 -- 172.21.15.100:0/2912452587 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24481e4580 con 0x7f244806d240 2024-09-11T22:22:21.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.126+0000 7f243ffff640 1 --2- 172.21.15.100:0/2912452587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f244806d240 0x7f24480c8e60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f243000b4e0 tx=0x7f243000b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:21.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.126+0000 7f2444ff9640 1 -- 172.21.15.100:0/2912452587 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2430003d90 con 0x7f244806d240 2024-09-11T22:22:21.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.126+0000 7f2444ff9640 1 -- 172.21.15.100:0/2912452587 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2430015070 con 0x7f244806d240 2024-09-11T22:22:21.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.126+0000 7f244e24c640 1 -- 172.21.15.100:0/2912452587 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24481e4860 con 0x7f244806d240 2024-09-11T22:22:21.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.126+0000 7f2444ff9640 1 -- 172.21.15.100:0/2912452587 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24300052b0 con 0x7f244806d240 2024-09-11T22:22:21.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.126+0000 7f244e24c640 1 -- 172.21.15.100:0/2912452587 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24481e4e20 con 0x7f244806d240 2024-09-11T22:22:21.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.127+0000 7f244e24c640 1 --2- 172.21.15.100:0/2912452587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24481e60b0 0x7f24481e6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.127+0000 7f244e24c640 1 -- 172.21.15.100:0/2912452587 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f24481e4330 con 0x7f24481e60b0 2024-09-11T22:22:21.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.127+0000 7f24477fe640 1 --2- 172.21.15.100:0/2912452587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24481e60b0 0x7f24481e6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:21.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.127+0000 7f24477fe640 1 -- 172.21.15.100:0/2912452587 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f24481e5da0 con 0x7f24481e60b0 2024-09-11T22:22:21.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.127+0000 7f2444ff9640 1 -- 172.21.15.100:0/2912452587 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2430005450 con 0x7f244806d240 2024-09-11T22:22:21.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.128+0000 7f24477fe640 1 --2- 172.21.15.100:0/2912452587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24481e60b0 0x7f24481e6490 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f24480b5a80 tx=0x7f24380046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:21.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.128+0000 7f2444ff9640 1 --2- 172.21.15.100:0/2912452587 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f242806bde0 0x7f242806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.128+0000 7f2444ff9640 1 -- 172.21.15.100:0/2912452587 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f243008afd0 con 0x7f244806d240 2024-09-11T22:22:21.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.128+0000 7f2447fff640 1 --2- 172.21.15.100:0/2912452587 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f242806bde0 0x7f242806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:21.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.128+0000 7f2444ff9640 1 -- 172.21.15.100:0/2912452587 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2438042030 con 0x7f24481e60b0 2024-09-11T22:22:21.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.128+0000 7f2444ff9640 1 -- 172.21.15.100:0/2912452587 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f24380093c0 con 0x7f24481e60b0 2024-09-11T22:22:21.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.128+0000 7f2444ff9640 1 -- 172.21.15.100:0/2912452587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24481e60b0 msgr2=0x7f24481e6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.128+0000 7f2444ff9640 1 --2- 172.21.15.100:0/2912452587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24481e60b0 0x7f24481e6490 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f24480b5a80 tx=0x7f24380046c0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.128+0000 7f2444ff9640 1 -- 172.21.15.100:0/2912452587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24481e60b0 msgr2=0x7f24481e6490 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:22:21.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.128+0000 7f2444ff9640 1 --2- 172.21.15.100:0/2912452587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24481e60b0 0x7f24481e6490 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.128+0000 7f2447fff640 1 --2- 172.21.15.100:0/2912452587 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f242806bde0 0x7f242806e2a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f24480ce210 tx=0x7f2440001650 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:21.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.134+0000 7f244e24c640 1 --2- 172.21.15.100:0/2912452587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244814d2b0 0x7f244814d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:21.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.134+0000 7f244e24c640 1 -- 172.21.15.100:0/2912452587 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f244815b2e0 con 0x7f244814d2b0 2024-09-11T22:22:21.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.135+0000 7f24477fe640 1 --2- 172.21.15.100:0/2912452587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244814d2b0 0x7f244814d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:21.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.135+0000 7f24477fe640 1 -- 172.21.15.100:0/2912452587 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f24481525c0 con 0x7f244814d2b0 2024-09-11T22:22:21.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.135+0000 7f24477fe640 1 --2- 172.21.15.100:0/2912452587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244814d2b0 0x7f244814d6c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f24480c7250 tx=0x7f2438008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:21.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.135+0000 7f2444ff9640 1 -- 172.21.15.100:0/2912452587 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2438042070 con 0x7f244814d2b0 2024-09-11T22:22:21.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.135+0000 7f2444ff9640 1 -- 172.21.15.100:0/2912452587 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5042 (secure 0 0 0) 0x7f243803e870 con 0x7f244814d2b0 2024-09-11T22:22:21.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.135+0000 7f2444ff9640 1 -- 172.21.15.100:0/2912452587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244814d2b0 msgr2=0x7f244814d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.135+0000 7f2444ff9640 1 --2- 172.21.15.100:0/2912452587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244814d2b0 0x7f244814d6c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f24480c7250 tx=0x7f2438008030 comp rx=0 tx=0).stop 2024-09-11T22:22:21.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.135+0000 7f2444ff9640 1 -- 172.21.15.100:0/2912452587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244814d2b0 msgr2=0x7f244814d6c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:22:21.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.135+0000 7f2444ff9640 1 --2- 172.21.15.100:0/2912452587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244814d2b0 0x7f244814d6c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.137 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:22:21.137 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:22:21.138 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:22:21.138 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:22:21.138 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 12, 2024-09-11T22:22:21.138 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 31857, 2024-09-11T22:22:21.138 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:22:21.138 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:22:21.138 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:22:21.138 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:21.138 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:22:21.138 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:22:21.138 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:22:21.138 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:22:21.138 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:21.139 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:21.139 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:21.139 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:21.139 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:21.139 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:21.139 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:21.139 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:21.139 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:21.139 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:21.139 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:21.139 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:21.139 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:22:21.139 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:22:21.139 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:21.140 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:21.140 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:21.140 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:21.140 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:21.140 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:21.140 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:21.140 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:21.140 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:21.140 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:21.140 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:21.140 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:21.141 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.141 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:22:21.141 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:22:21.141 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:22:21.141 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:22:21.141 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:22:21.141 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:22:21.141 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:22:21.141 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:22:21.141 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:22:21.141 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:22:21.141 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:22:21.141 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:22:21.142 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:22:21.142 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:22:21.142 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:22:21.142 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:22:21.142 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:22:21.142 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:21.142 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:21.142 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:21.142 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:21.142 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:21.142 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:21.142 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:21.142 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:21.142 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:21.142 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:21.143 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:21.143 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:21.143 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:22:21.143 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.143 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:22:21.143 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.143 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:22:21.143 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:22:21.143 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:21.143 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:21.144 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.144 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:21.144 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:22:21.144 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:21.144 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.144 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.144 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:21.144 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:22:21.144 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:21.144 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:21.144 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:21.144 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.144 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:22:21.145 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:22:21.145 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:21.145 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:21.145 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:21.145 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.145 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.145 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:22:21.145 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:22:21.145 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:21.145 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:21.145 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.145 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:21.146 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:22:21.146 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:21.146 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.146 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.146 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:21.146 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:22:21.146 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:21.146 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:21.146 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:21.146 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.146 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:22:21.146 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:22:21.146 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:21.147 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:21.147 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:21.147 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.147 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.147 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:22:21.147 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:22:21.147 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:21.147 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:21.147 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.147 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:21.147 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:22:21.147 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:21.147 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.147 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.148 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:21.148 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:22:21.148 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:21.148 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:21.148 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:21.148 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.148 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:22:21.148 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:22:21.148 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:21.149 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:21.149 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:21.149 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:21.149 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:21.149 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.149 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:22:21.149 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:22:21.149 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.149 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:21.149 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:21.149 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:22:21.150 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:21.150 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:21.150 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:22:21.150 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.150 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:21.150 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:21.150 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:22:21.150 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:21.151 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:21.151 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:22:21.151 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.151 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:21.151 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:21.151 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:22:21.151 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:21.151 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:21.151 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:22:21.152 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.152 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:21.152 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:21.152 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:22:21.152 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:21.152 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:21.152 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:22:21.152 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:21.152 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:21.153 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:21.153 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:22:21.153 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:21.153 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:21.153 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:21.154 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:22:21.154 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:22:21.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.136+0000 7f244e24c640 1 -- 172.21.15.100:0/2912452587 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f242806bde0 msgr2=0x7f242806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.136+0000 7f244e24c640 1 --2- 172.21.15.100:0/2912452587 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f242806bde0 0x7f242806e2a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f24480ce210 tx=0x7f2440001650 comp rx=0 tx=0).stop 2024-09-11T22:22:21.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.136+0000 7f244e24c640 1 -- 172.21.15.100:0/2912452587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f244806d240 msgr2=0x7f24480c8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:21.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.136+0000 7f244e24c640 1 --2- 172.21.15.100:0/2912452587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f244806d240 0x7f24480c8e60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f243000b4e0 tx=0x7f243000b9a0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.136+0000 7f2447fff640 1 -- 172.21.15.100:0/2912452587 reap_dead start 2024-09-11T22:22:21.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.136+0000 7f244e24c640 1 -- 172.21.15.100:0/2912452587 shutdown_connections 2024-09-11T22:22:21.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.136+0000 7f244e24c640 1 --2- 172.21.15.100:0/2912452587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f244806d240 0x7f24480c8e60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:21.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.136+0000 7f244e24c640 1 -- 172.21.15.100:0/2912452587 >> 172.21.15.100:0/2912452587 conn(0x7f244806bc10 msgr2=0x7f2448159980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:21.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.136+0000 7f244e24c640 1 -- 172.21.15.100:0/2912452587 shutdown_connections 2024-09-11T22:22:21.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:21.136+0000 7f244e24c640 1 -- 172.21.15.100:0/2912452587 wait complete. 2024-09-11T22:22:21.157 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:22:21.157 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-11T22:22:24.958 INFO:tasks.workunit.client.0.smithi100.stdout:checking dependency style of gcc... gcc3 2024-09-11T22:22:25.061 INFO:tasks.workunit.client.0.smithi100.stdout:checking how to run the C preprocessor... gcc -E 2024-09-11T22:22:25.120 INFO:tasks.workunit.client.0.smithi100.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-11T22:22:25.122 INFO:tasks.workunit.client.0.smithi100.stdout:checking for egrep... /usr/bin/grep -E 2024-09-11T22:22:25.134 INFO:tasks.workunit.client.0.smithi100.stdout:checking for AIX... no 2024-09-11T22:22:25.157 INFO:tasks.workunit.client.0.smithi100.stdout:checking for gcc... (cached) gcc 2024-09-11T22:22:25.169 INFO:tasks.workunit.client.0.smithi100.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-11T22:22:25.170 INFO:tasks.workunit.client.0.smithi100.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-11T22:22:25.170 INFO:tasks.workunit.client.0.smithi100.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-11T22:22:25.171 INFO:tasks.workunit.client.0.smithi100.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-11T22:22:25.257 INFO:tasks.workunit.client.0.smithi100.stdout:checking for main in -lm... yes 2024-09-11T22:22:25.331 INFO:tasks.workunit.client.0.smithi100.stdout:checking for main in -lpthread... yes 2024-09-11T22:22:25.538 INFO:tasks.workunit.client.0.smithi100.stdout:checking for ANSI C header files... yes 2024-09-11T22:22:25.617 INFO:tasks.workunit.client.0.smithi100.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-11T22:22:25.672 INFO:tasks.workunit.client.0.smithi100.stdout:checking for sys/types.h... yes 2024-09-11T22:22:25.732 INFO:tasks.workunit.client.0.smithi100.stdout:checking for sys/stat.h... yes 2024-09-11T22:22:25.794 INFO:tasks.workunit.client.0.smithi100.stdout:checking for stdlib.h... yes 2024-09-11T22:22:25.857 INFO:tasks.workunit.client.0.smithi100.stdout:checking for string.h... yes 2024-09-11T22:22:25.919 INFO:tasks.workunit.client.0.smithi100.stdout:checking for memory.h... yes 2024-09-11T22:22:25.981 INFO:tasks.workunit.client.0.smithi100.stdout:checking for strings.h... yes 2024-09-11T22:22:26.043 INFO:tasks.workunit.client.0.smithi100.stdout:checking for inttypes.h... yes 2024-09-11T22:22:26.104 INFO:tasks.workunit.client.0.smithi100.stdout:checking for stdint.h... yes 2024-09-11T22:22:26.168 INFO:tasks.workunit.client.0.smithi100.stdout:checking for unistd.h... yes 2024-09-11T22:22:26.243 INFO:tasks.workunit.client.0.smithi100.stdout:checking pthread.h usability... yes 2024-09-11T22:22:26.272 INFO:tasks.workunit.client.0.smithi100.stdout:checking pthread.h presence... yes 2024-09-11T22:22:26.272 INFO:tasks.workunit.client.0.smithi100.stdout:checking for pthread.h... yes 2024-09-11T22:22:26.344 INFO:tasks.workunit.client.0.smithi100.stdout:checking fcntl.h usability... yes 2024-09-11T22:22:26.371 INFO:tasks.workunit.client.0.smithi100.stdout:checking fcntl.h presence... yes 2024-09-11T22:22:26.371 INFO:tasks.workunit.client.0.smithi100.stdout:checking for fcntl.h... yes 2024-09-11T22:22:26.438 INFO:tasks.workunit.client.0.smithi100.stdout:checking limits.h usability... yes 2024-09-11T22:22:26.465 INFO:tasks.workunit.client.0.smithi100.stdout:checking limits.h presence... yes 2024-09-11T22:22:26.466 INFO:tasks.workunit.client.0.smithi100.stdout:checking for limits.h... yes 2024-09-11T22:22:26.491 INFO:tasks.workunit.client.0.smithi100.stdout:checking for stdint.h... (cached) yes 2024-09-11T22:22:26.553 INFO:tasks.workunit.client.0.smithi100.stdout:checking sys/time.h usability... yes 2024-09-11T22:22:26.580 INFO:tasks.workunit.client.0.smithi100.stdout:checking sys/time.h presence... yes 2024-09-11T22:22:26.581 INFO:tasks.workunit.client.0.smithi100.stdout:checking for sys/time.h... yes 2024-09-11T22:22:26.601 INFO:tasks.workunit.client.0.smithi100.stdout:checking for unistd.h... (cached) yes 2024-09-11T22:22:26.669 INFO:tasks.workunit.client.0.smithi100.stdout:checking sys/vfs.h usability... yes 2024-09-11T22:22:26.692 INFO:tasks.workunit.client.0.smithi100.stdout:checking sys/vfs.h presence... yes 2024-09-11T22:22:26.693 INFO:tasks.workunit.client.0.smithi100.stdout:checking for sys/vfs.h... yes 2024-09-11T22:22:26.761 INFO:tasks.workunit.client.0.smithi100.stdout:checking sys/limits.h usability... no 2024-09-11T22:22:26.790 INFO:tasks.workunit.client.0.smithi100.stdout:checking sys/limits.h presence... no 2024-09-11T22:22:26.790 INFO:tasks.workunit.client.0.smithi100.stdout:checking for sys/limits.h... no 2024-09-11T22:22:26.834 INFO:tasks.workunit.client.0.smithi100.stdout:checking for an ANSI C-conforming const... yes 2024-09-11T22:22:26.878 INFO:tasks.workunit.client.0.smithi100.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-11T22:22:26.880 INFO:tasks.workunit.client.0.smithi100.stdout:checking for function prototypes... yes 2024-09-11T22:22:26.923 INFO:tasks.workunit.client.0.smithi100.stdout:checking whether setvbuf arguments are reversed... no 2024-09-11T22:22:27.012 INFO:tasks.workunit.client.0.smithi100.stdout:checking for system... yes 2024-09-11T22:22:27.092 INFO:tasks.workunit.client.0.smithi100.stdout:checking for gettimeofday... yes 2024-09-11T22:22:27.174 INFO:tasks.workunit.client.0.smithi100.stdout:checking for mkdir... yes 2024-09-11T22:22:27.255 INFO:tasks.workunit.client.0.smithi100.stdout:checking for strerror... yes 2024-09-11T22:22:27.341 INFO:tasks.workunit.client.0.smithi100.stdout:checking for open64... yes 2024-09-11T22:22:27.425 INFO:tasks.workunit.client.0.smithi100.stdout:checking for stat64... yes 2024-09-11T22:22:27.505 INFO:tasks.workunit.client.0.smithi100.stdout:checking for fseeko64... yes 2024-09-11T22:22:27.589 INFO:tasks.workunit.client.0.smithi100.stdout:checking for lrand48_r... yes 2024-09-11T22:22:27.672 INFO:tasks.workunit.client.0.smithi100.stdout:checking for srand48_r... yes 2024-09-11T22:22:27.698 INFO:tasks.workunit.client.0.smithi100.stdout:configure: creating ./config.status 2024-09-11T22:22:27.834 INFO:tasks.workunit.client.0.smithi100.stdout:config.status: creating Makefile 2024-09-11T22:22:27.852 INFO:tasks.workunit.client.0.smithi100.stdout:config.status: creating config.h 2024-09-11T22:22:27.879 INFO:tasks.workunit.client.0.smithi100.stdout:config.status: executing depfiles commands 2024-09-11T22:22:27.952 INFO:tasks.workunit.client.0.smithi100.stdout:config.status: executing default commands 2024-09-11T22:22:28.047 INFO:tasks.workunit.client.0.smithi100.stderr:+ make 2024-09-11T22:22:28.073 INFO:tasks.workunit.client.0.smithi100.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-09-11T22:22:28.078 INFO:tasks.workunit.client.0.smithi100.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-09-11T22:22:28.080 INFO:tasks.workunit.client.0.smithi100.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-09-11T22:22:28.080 INFO:tasks.workunit.client.0.smithi100.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-09-11T22:22:28.080 INFO:tasks.workunit.client.0.smithi100.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-09-11T22:22:28.080 INFO:tasks.workunit.client.0.smithi100.stderr: any GNU archive site. 2024-09-11T22:22:28.085 INFO:tasks.workunit.client.0.smithi100.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-09-11T22:22:28.089 INFO:tasks.workunit.client.0.smithi100.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-09-11T22:22:28.090 INFO:tasks.workunit.client.0.smithi100.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-09-11T22:22:28.090 INFO:tasks.workunit.client.0.smithi100.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-09-11T22:22:28.090 INFO:tasks.workunit.client.0.smithi100.stderr: You might want to install the `Automake' and `Perl' packages. 2024-09-11T22:22:28.090 INFO:tasks.workunit.client.0.smithi100.stderr: Grab them from any GNU archive site. 2024-09-11T22:22:28.258 INFO:tasks.workunit.client.0.smithi100.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-09-11T22:22:28.589 INFO:tasks.workunit.client.0.smithi100.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-09-11T22:22:28.589 INFO:tasks.workunit.client.0.smithi100.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-09-11T22:22:28.589 INFO:tasks.workunit.client.0.smithi100.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-09-11T22:22:28.589 INFO:tasks.workunit.client.0.smithi100.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-09-11T22:22:28.722 INFO:tasks.workunit.client.0.smithi100.stdout:/bin/sh ./config.status --recheck 2024-09-11T22:22:28.779 INFO:tasks.workunit.client.0.smithi100.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-09-11T22:22:28.920 INFO:tasks.workunit.client.0.smithi100.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-11T22:22:29.929 INFO:tasks.workunit.client.0.smithi100.stdout:checking whether build environment is sane... yes 2024-09-11T22:22:29.939 INFO:tasks.workunit.client.0.smithi100.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-11T22:22:29.940 INFO:tasks.workunit.client.0.smithi100.stdout:checking for gawk... gawk 2024-09-11T22:22:29.960 INFO:tasks.workunit.client.0.smithi100.stdout:checking whether make sets $(MAKE)... yes 2024-09-11T22:22:30.022 INFO:tasks.workunit.client.0.smithi100.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-11T22:22:30.022 INFO:tasks.workunit.client.0.smithi100.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-11T22:22:30.043 INFO:tasks.workunit.client.0.smithi100.stdout:checking for style of include used by make... GNU 2024-09-11T22:22:30.048 INFO:tasks.workunit.client.0.smithi100.stdout:checking for gcc... gcc 2024-09-11T22:22:30.162 INFO:tasks.workunit.client.0.smithi100.stdout:checking whether the C compiler works... yes 2024-09-11T22:22:30.162 INFO:tasks.workunit.client.0.smithi100.stdout:checking for C compiler default output file name... a.out 2024-09-11T22:22:30.212 INFO:tasks.workunit.client.0.smithi100.stdout:checking for suffix of executables... 2024-09-11T22:22:30.263 INFO:tasks.workunit.client.0.smithi100.stdout:checking whether we are cross compiling... no 2024-09-11T22:22:30.308 INFO:tasks.workunit.client.0.smithi100.stdout:checking for suffix of object files... o 2024-09-11T22:22:30.339 INFO:tasks.workunit.client.0.smithi100.stdout:checking whether we are using the GNU C compiler... yes 2024-09-11T22:22:30.371 INFO:tasks.workunit.client.0.smithi100.stdout:checking whether gcc accepts -g... yes 2024-09-11T22:22:30.421 INFO:tasks.workunit.client.0.smithi100.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-11T22:22:30.584 INFO:tasks.workunit.client.0.smithi100.stdout:checking dependency style of gcc... gcc3 2024-09-11T22:22:30.643 INFO:tasks.workunit.client.0.smithi100.stdout:checking how to run the C preprocessor... gcc -E 2024-09-11T22:22:30.705 INFO:tasks.workunit.client.0.smithi100.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-11T22:22:30.706 INFO:tasks.workunit.client.0.smithi100.stdout:checking for egrep... /usr/bin/grep -E 2024-09-11T22:22:30.866 INFO:tasks.workunit.client.0.smithi100.stdout:checking for ANSI C header files... yes 2024-09-11T22:22:30.911 INFO:tasks.workunit.client.0.smithi100.stdout:checking for sys/types.h... yes 2024-09-11T22:22:30.962 INFO:tasks.workunit.client.0.smithi100.stdout:checking for sys/stat.h... yes 2024-09-11T22:22:31.019 INFO:tasks.workunit.client.0.smithi100.stdout:checking for stdlib.h... yes 2024-09-11T22:22:31.071 INFO:tasks.workunit.client.0.smithi100.stdout:checking for string.h... yes 2024-09-11T22:22:31.122 INFO:tasks.workunit.client.0.smithi100.stdout:checking for memory.h... yes 2024-09-11T22:22:31.174 INFO:tasks.workunit.client.0.smithi100.stdout:checking for strings.h... yes 2024-09-11T22:22:31.225 INFO:tasks.workunit.client.0.smithi100.stdout:checking for inttypes.h... yes 2024-09-11T22:22:31.277 INFO:tasks.workunit.client.0.smithi100.stdout:checking for stdint.h... yes 2024-09-11T22:22:31.331 INFO:tasks.workunit.client.0.smithi100.stdout:checking for unistd.h... yes 2024-09-11T22:22:31.387 INFO:tasks.workunit.client.0.smithi100.stdout:checking minix/config.h usability... no 2024-09-11T22:22:31.423 INFO:tasks.workunit.client.0.smithi100.stdout:checking minix/config.h presence... no 2024-09-11T22:22:31.423 INFO:tasks.workunit.client.0.smithi100.stdout:checking for minix/config.h... no 2024-09-11T22:22:31.465 INFO:tasks.workunit.client.0.smithi100.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-09-11T22:22:31.475 INFO:tasks.workunit.client.0.smithi100.stdout:checking for gcc... (cached) gcc 2024-09-11T22:22:31.525 INFO:tasks.workunit.client.0.smithi100.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-11T22:22:31.525 INFO:tasks.workunit.client.0.smithi100.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-11T22:22:31.525 INFO:tasks.workunit.client.0.smithi100.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-11T22:22:31.526 INFO:tasks.workunit.client.0.smithi100.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-11T22:22:31.586 INFO:tasks.workunit.client.0.smithi100.stdout:checking for main in -lm... yes 2024-09-11T22:22:31.648 INFO:tasks.workunit.client.0.smithi100.stdout:checking for main in -lpthread... yes 2024-09-11T22:22:31.652 INFO:tasks.workunit.client.0.smithi100.stdout:checking for ANSI C header files... (cached) yes 2024-09-11T22:22:31.693 INFO:tasks.workunit.client.0.smithi100.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-11T22:22:31.750 INFO:tasks.workunit.client.0.smithi100.stdout:checking pthread.h usability... yes 2024-09-11T22:22:31.776 INFO:tasks.workunit.client.0.smithi100.stdout:checking pthread.h presence... yes 2024-09-11T22:22:31.776 INFO:tasks.workunit.client.0.smithi100.stdout:checking for pthread.h... yes 2024-09-11T22:22:31.835 INFO:tasks.workunit.client.0.smithi100.stdout:checking fcntl.h usability... yes 2024-09-11T22:22:31.857 INFO:tasks.workunit.client.0.smithi100.stdout:checking fcntl.h presence... yes 2024-09-11T22:22:31.857 INFO:tasks.workunit.client.0.smithi100.stdout:checking for fcntl.h... yes 2024-09-11T22:22:31.920 INFO:tasks.workunit.client.0.smithi100.stdout:checking limits.h usability... yes 2024-09-11T22:22:31.943 INFO:tasks.workunit.client.0.smithi100.stdout:checking limits.h presence... yes 2024-09-11T22:22:31.943 INFO:tasks.workunit.client.0.smithi100.stdout:checking for limits.h... yes 2024-09-11T22:22:31.969 INFO:tasks.workunit.client.0.smithi100.stdout:checking for stdint.h... (cached) yes 2024-09-11T22:22:32.020 INFO:tasks.workunit.client.0.smithi100.stdout:checking sys/time.h usability... yes 2024-09-11T22:22:32.043 INFO:tasks.workunit.client.0.smithi100.stdout:checking sys/time.h presence... yes 2024-09-11T22:22:32.044 INFO:tasks.workunit.client.0.smithi100.stdout:checking for sys/time.h... yes 2024-09-11T22:22:32.063 INFO:tasks.workunit.client.0.smithi100.stdout:checking for unistd.h... (cached) yes 2024-09-11T22:22:32.117 INFO:tasks.workunit.client.0.smithi100.stdout:checking sys/vfs.h usability... yes 2024-09-11T22:22:32.140 INFO:tasks.workunit.client.0.smithi100.stdout:checking sys/vfs.h presence... yes 2024-09-11T22:22:32.140 INFO:tasks.workunit.client.0.smithi100.stdout:checking for sys/vfs.h... yes 2024-09-11T22:22:32.212 INFO:tasks.workunit.client.0.smithi100.stdout:checking sys/limits.h usability... no 2024-09-11T22:22:32.253 INFO:tasks.workunit.client.0.smithi100.stdout:checking sys/limits.h presence... no 2024-09-11T22:22:32.253 INFO:tasks.workunit.client.0.smithi100.stdout:checking for sys/limits.h... no 2024-09-11T22:22:32.289 INFO:tasks.workunit.client.0.smithi100.stdout:checking for an ANSI C-conforming const... yes 2024-09-11T22:22:32.324 INFO:tasks.workunit.client.0.smithi100.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-11T22:22:32.401 INFO:tasks.workunit.client.0.smithi100.stdout:checking for system... yes 2024-09-11T22:22:32.476 INFO:tasks.workunit.client.0.smithi100.stdout:checking for gettimeofday... yes 2024-09-11T22:22:32.553 INFO:tasks.workunit.client.0.smithi100.stdout:checking for mkdir... yes 2024-09-11T22:22:32.630 INFO:tasks.workunit.client.0.smithi100.stdout:checking for strerror... yes 2024-09-11T22:22:32.705 INFO:tasks.workunit.client.0.smithi100.stdout:checking for open64... yes 2024-09-11T22:22:32.781 INFO:tasks.workunit.client.0.smithi100.stdout:checking for stat64... yes 2024-09-11T22:22:32.856 INFO:tasks.workunit.client.0.smithi100.stdout:checking for fseeko64... yes 2024-09-11T22:22:32.930 INFO:tasks.workunit.client.0.smithi100.stdout:checking for lrand48_r... yes 2024-09-11T22:22:33.031 INFO:tasks.workunit.client.0.smithi100.stdout:checking for srand48_r... yes 2024-09-11T22:22:33.060 INFO:tasks.workunit.client.0.smithi100.stdout:configure: creating ./config.status 2024-09-11T22:22:33.172 INFO:tasks.workunit.client.0.smithi100.stdout: /bin/sh ./config.status 2024-09-11T22:22:33.232 INFO:tasks.workunit.client.0.smithi100.stdout:config.status: creating Makefile 2024-09-11T22:22:33.250 INFO:tasks.workunit.client.0.smithi100.stdout:config.status: creating config.h 2024-09-11T22:22:33.277 INFO:tasks.workunit.client.0.smithi100.stdout:config.status: executing depfiles commands 2024-09-11T22:22:33.294 INFO:tasks.workunit.client.0.smithi100.stdout:config.status: executing default commands 2024-09-11T22:22:33.343 INFO:tasks.workunit.client.0.smithi100.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-09-11T22:22:33.506 INFO:tasks.workunit.client.0.smithi100.stdout:rm -f stamp-h1 2024-09-11T22:22:33.508 INFO:tasks.workunit.client.0.smithi100.stdout:touch config.h.in 2024-09-11T22:22:33.510 INFO:tasks.workunit.client.0.smithi100.stdout:cd . && /bin/sh ./config.status config.h 2024-09-11T22:22:33.565 INFO:tasks.workunit.client.0.smithi100.stdout:config.status: creating config.h 2024-09-11T22:22:33.599 INFO:tasks.workunit.client.0.smithi100.stdout:make all-am 2024-09-11T22:22:33.625 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-11T22:22:33.625 INFO:tasks.workunit.client.0.smithi100.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-09-11T22:22:33.789 INFO:tasks.workunit.client.0.smithi100.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-09-11T22:22:33.794 INFO:tasks.workunit.client.0.smithi100.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-09-11T22:22:33.896 INFO:tasks.workunit.client.0.smithi100.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-09-11T22:22:33.901 INFO:tasks.workunit.client.0.smithi100.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-09-11T22:22:34.021 INFO:tasks.workunit.client.0.smithi100.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-09-11T22:22:34.028 INFO:tasks.workunit.client.0.smithi100.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-09-11T22:22:34.132 INFO:tasks.workunit.client.0.smithi100.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-09-11T22:22:34.137 INFO:tasks.workunit.client.0.smithi100.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-09-11T22:22:34.270 INFO:tasks.workunit.client.0.smithi100.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-09-11T22:22:34.276 INFO:tasks.workunit.client.0.smithi100.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-09-11T22:22:34.345 INFO:tasks.workunit.client.0.smithi100.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-09-11T22:22:34.351 INFO:tasks.workunit.client.0.smithi100.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-09-11T22:22:34.404 INFO:tasks.workunit.client.0.smithi100.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-09-11T22:22:34.411 INFO:tasks.workunit.client.0.smithi100.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-09-11T22:22:34.472 INFO:tasks.workunit.client.0.smithi100.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-09-11T22:22:34.478 INFO:tasks.workunit.client.0.smithi100.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-09-11T22:22:34.693 INFO:tasks.workunit.client.0.smithi100.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-09-11T22:22:34.698 INFO:tasks.workunit.client.0.smithi100.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-09-11T22:22:34.843 INFO:tasks.workunit.client.0.smithi100.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-09-11T22:22:34.848 INFO:tasks.workunit.client.0.smithi100.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-09-11T22:22:35.038 INFO:tasks.workunit.client.0.smithi100.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-09-11T22:22:35.043 INFO:tasks.workunit.client.0.smithi100.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-09-11T22:22:35.127 INFO:tasks.workunit.client.0.smithi100.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-09-11T22:22:35.133 INFO:tasks.workunit.client.0.smithi100.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-09-11T22:22:35.231 INFO:tasks.workunit.client.0.smithi100.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-09-11T22:22:35.236 INFO:tasks.workunit.client.0.smithi100.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-09-11T22:22:35.359 INFO:tasks.workunit.client.0.smithi100.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-09-11T22:22:35.364 INFO:tasks.workunit.client.0.smithi100.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-09-11T22:22:35.405 INFO:tasks.workunit.client.0.smithi100.stderr:In file included from parser.h:22, 2024-09-11T22:22:35.405 INFO:tasks.workunit.client.0.smithi100.stderr: from parser.c:25: 2024-09-11T22:22:35.406 INFO:tasks.workunit.client.0.smithi100.stderr:parser.c: In function ‘init_filesys’: 2024-09-11T22:22:35.407 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T22:22:35.407 INFO:tasks.workunit.client.0.smithi100.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T22:22:35.407 INFO:tasks.workunit.client.0.smithi100.stderr: | ^ 2024-09-11T22:22:35.407 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T22:22:35.407 INFO:tasks.workunit.client.0.smithi100.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T22:22:35.408 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~ 2024-09-11T22:22:35.408 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T22:22:35.408 INFO:tasks.workunit.client.0.smithi100.stderr: 36 | container_of(ptr, type, member) 2024-09-11T22:22:35.408 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~~~ 2024-09-11T22:22:35.408 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-11T22:22:35.408 INFO:tasks.workunit.client.0.smithi100.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-11T22:22:35.408 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~ 2024-09-11T22:22:35.408 INFO:tasks.workunit.client.0.smithi100.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T22:22:35.408 INFO:tasks.workunit.client.0.smithi100.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-11T22:22:35.408 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T22:22:35.408 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T22:22:35.408 INFO:tasks.workunit.client.0.smithi100.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T22:22:35.408 INFO:tasks.workunit.client.0.smithi100.stderr: | ^ 2024-09-11T22:22:35.409 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T22:22:35.409 INFO:tasks.workunit.client.0.smithi100.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T22:22:35.409 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~ 2024-09-11T22:22:35.409 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T22:22:35.409 INFO:tasks.workunit.client.0.smithi100.stderr: 36 | container_of(ptr, type, member) 2024-09-11T22:22:35.409 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~~~ 2024-09-11T22:22:35.409 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-11T22:22:35.409 INFO:tasks.workunit.client.0.smithi100.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-11T22:22:35.409 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~ 2024-09-11T22:22:35.409 INFO:tasks.workunit.client.0.smithi100.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T22:22:35.409 INFO:tasks.workunit.client.0.smithi100.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-11T22:22:35.409 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T22:22:35.409 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T22:22:35.410 INFO:tasks.workunit.client.0.smithi100.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T22:22:35.410 INFO:tasks.workunit.client.0.smithi100.stderr: | ^ 2024-09-11T22:22:35.410 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T22:22:35.410 INFO:tasks.workunit.client.0.smithi100.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T22:22:35.410 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~ 2024-09-11T22:22:35.410 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T22:22:35.410 INFO:tasks.workunit.client.0.smithi100.stderr: 36 | container_of(ptr, type, member) 2024-09-11T22:22:35.410 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~~~ 2024-09-11T22:22:35.410 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-11T22:22:35.410 INFO:tasks.workunit.client.0.smithi100.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-11T22:22:35.410 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~ 2024-09-11T22:22:35.410 INFO:tasks.workunit.client.0.smithi100.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T22:22:35.411 INFO:tasks.workunit.client.0.smithi100.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-11T22:22:35.411 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T22:22:35.411 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T22:22:35.411 INFO:tasks.workunit.client.0.smithi100.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T22:22:35.411 INFO:tasks.workunit.client.0.smithi100.stderr: | ^ 2024-09-11T22:22:35.411 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T22:22:35.411 INFO:tasks.workunit.client.0.smithi100.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T22:22:35.411 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~ 2024-09-11T22:22:35.411 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T22:22:35.411 INFO:tasks.workunit.client.0.smithi100.stderr: 36 | container_of(ptr, type, member) 2024-09-11T22:22:35.411 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~~~ 2024-09-11T22:22:35.411 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-11T22:22:35.411 INFO:tasks.workunit.client.0.smithi100.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-11T22:22:35.412 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~ 2024-09-11T22:22:35.412 INFO:tasks.workunit.client.0.smithi100.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T22:22:35.412 INFO:tasks.workunit.client.0.smithi100.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-11T22:22:35.412 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T22:22:35.412 INFO:tasks.workunit.client.0.smithi100.stderr:parser.c: In function ‘init_tg_stats’: 2024-09-11T22:22:35.412 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T22:22:35.412 INFO:tasks.workunit.client.0.smithi100.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T22:22:35.412 INFO:tasks.workunit.client.0.smithi100.stderr: | ^ 2024-09-11T22:22:35.412 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T22:22:35.412 INFO:tasks.workunit.client.0.smithi100.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T22:22:35.412 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~ 2024-09-11T22:22:35.412 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T22:22:35.412 INFO:tasks.workunit.client.0.smithi100.stderr: 36 | container_of(ptr, type, member) 2024-09-11T22:22:35.412 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~~~ 2024-09-11T22:22:35.413 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-11T22:22:35.413 INFO:tasks.workunit.client.0.smithi100.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-11T22:22:35.413 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~ 2024-09-11T22:22:35.413 INFO:tasks.workunit.client.0.smithi100.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T22:22:35.413 INFO:tasks.workunit.client.0.smithi100.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-11T22:22:35.413 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T22:22:35.413 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T22:22:35.413 INFO:tasks.workunit.client.0.smithi100.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T22:22:35.413 INFO:tasks.workunit.client.0.smithi100.stderr: | ^ 2024-09-11T22:22:35.413 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T22:22:35.413 INFO:tasks.workunit.client.0.smithi100.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T22:22:35.413 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~ 2024-09-11T22:22:35.413 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T22:22:35.414 INFO:tasks.workunit.client.0.smithi100.stderr: 36 | container_of(ptr, type, member) 2024-09-11T22:22:35.414 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~~~ 2024-09-11T22:22:35.414 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-11T22:22:35.414 INFO:tasks.workunit.client.0.smithi100.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-11T22:22:35.414 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~ 2024-09-11T22:22:35.414 INFO:tasks.workunit.client.0.smithi100.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T22:22:35.414 INFO:tasks.workunit.client.0.smithi100.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-11T22:22:35.414 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T22:22:35.414 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T22:22:35.414 INFO:tasks.workunit.client.0.smithi100.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T22:22:35.414 INFO:tasks.workunit.client.0.smithi100.stderr: | ^ 2024-09-11T22:22:35.414 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T22:22:35.414 INFO:tasks.workunit.client.0.smithi100.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T22:22:35.415 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~ 2024-09-11T22:22:35.415 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T22:22:35.415 INFO:tasks.workunit.client.0.smithi100.stderr: 36 | container_of(ptr, type, member) 2024-09-11T22:22:35.415 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~~~ 2024-09-11T22:22:35.415 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-11T22:22:35.415 INFO:tasks.workunit.client.0.smithi100.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-11T22:22:35.415 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~ 2024-09-11T22:22:35.415 INFO:tasks.workunit.client.0.smithi100.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T22:22:35.415 INFO:tasks.workunit.client.0.smithi100.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-11T22:22:35.415 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T22:22:35.415 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T22:22:35.415 INFO:tasks.workunit.client.0.smithi100.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T22:22:35.415 INFO:tasks.workunit.client.0.smithi100.stderr: | ^ 2024-09-11T22:22:35.416 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T22:22:35.416 INFO:tasks.workunit.client.0.smithi100.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T22:22:35.416 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~ 2024-09-11T22:22:35.416 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T22:22:35.416 INFO:tasks.workunit.client.0.smithi100.stderr: 36 | container_of(ptr, type, member) 2024-09-11T22:22:35.416 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~~~ 2024-09-11T22:22:35.416 INFO:tasks.workunit.client.0.smithi100.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-11T22:22:35.416 INFO:tasks.workunit.client.0.smithi100.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-11T22:22:35.416 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~ 2024-09-11T22:22:35.416 INFO:tasks.workunit.client.0.smithi100.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T22:22:35.416 INFO:tasks.workunit.client.0.smithi100.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-11T22:22:35.416 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T22:22:35.452 INFO:tasks.workunit.client.0.smithi100.stderr:parser.c: In function ‘get_optstr’: 2024-09-11T22:22:35.452 INFO:tasks.workunit.client.0.smithi100.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-09-11T22:22:35.453 INFO:tasks.workunit.client.0.smithi100.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-09-11T22:22:35.453 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T22:22:35.453 INFO:tasks.workunit.client.0.smithi100.stderr:parser.c:200:14: note: source object declared here 2024-09-11T22:22:35.453 INFO:tasks.workunit.client.0.smithi100.stderr: 200 | char temp[BUFSIZE]; 2024-09-11T22:22:35.453 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~ 2024-09-11T22:22:35.460 INFO:tasks.workunit.client.0.smithi100.stderr:parser.c: In function ‘size64_convert’: 2024-09-11T22:22:35.460 INFO:tasks.workunit.client.0.smithi100.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-09-11T22:22:35.460 INFO:tasks.workunit.client.0.smithi100.stderr: 119 | memcpy(unit, "\0", 3); 2024-09-11T22:22:35.461 INFO:tasks.workunit.client.0.smithi100.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-09-11T22:22:35.749 INFO:tasks.workunit.client.0.smithi100.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-09-11T22:22:35.754 INFO:tasks.workunit.client.0.smithi100.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-09-11T22:22:35.828 INFO:tasks.workunit.client.0.smithi100.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-09-11T22:22:35.833 INFO:tasks.workunit.client.0.smithi100.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-09-11T22:22:35.937 INFO:tasks.workunit.client.0.smithi100.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-09-11T22:22:35.942 INFO:tasks.workunit.client.0.smithi100.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-09-11T22:22:35.981 INFO:tasks.workunit.client.0.smithi100.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-09-11T22:22:35.986 INFO:tasks.workunit.client.0.smithi100.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-09-11T22:22:36.083 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-11T22:22:36.084 INFO:tasks.workunit.client.0.smithi100.stderr:+ cd .. 2024-09-11T22:22:36.085 INFO:tasks.workunit.client.0.smithi100.stderr:+ mkdir tmp 2024-09-11T22:22:36.087 INFO:tasks.workunit.client.0.smithi100.stderr:+ cd tmp 2024-09-11T22:22:36.088 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in $mydir/*.ffsb 2024-09-11T22:22:36.088 INFO:tasks.workunit.client.0.smithi100.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-09-11T22:22:36.089 INFO:tasks.workunit.client.0.smithi100.stdout:FFSB version 6.0-RC2 started 2024-09-11T22:22:36.089 INFO:tasks.workunit.client.0.smithi100.stdout: 2024-09-11T22:22:36.092 INFO:tasks.workunit.client.0.smithi100.stdout:benchmark time = 300 2024-09-11T22:22:36.092 INFO:tasks.workunit.client.0.smithi100.stdout:ThreadGroup 0 2024-09-11T22:22:36.092 INFO:tasks.workunit.client.0.smithi100.stdout:================ 2024-09-11T22:22:36.092 INFO:tasks.workunit.client.0.smithi100.stdout: num_threads = 32 2024-09-11T22:22:36.093 INFO:tasks.workunit.client.0.smithi100.stdout: 2024-09-11T22:22:36.093 INFO:tasks.workunit.client.0.smithi100.stdout: read_random = off 2024-09-11T22:22:36.093 INFO:tasks.workunit.client.0.smithi100.stdout: read_size = 0 (0B) 2024-09-11T22:22:36.093 INFO:tasks.workunit.client.0.smithi100.stdout: read_blocksize = 0 (0B) 2024-09-11T22:22:36.093 INFO:tasks.workunit.client.0.smithi100.stdout: read_skip = off 2024-09-11T22:22:36.093 INFO:tasks.workunit.client.0.smithi100.stdout: read_skipsize = 0 (0B) 2024-09-11T22:22:36.093 INFO:tasks.workunit.client.0.smithi100.stdout: 2024-09-11T22:22:36.093 INFO:tasks.workunit.client.0.smithi100.stdout: write_random = on 2024-09-11T22:22:36.093 INFO:tasks.workunit.client.0.smithi100.stdout: write_size = 5242880 (5MB) 2024-09-11T22:22:36.093 INFO:tasks.workunit.client.0.smithi100.stdout: fsync_file = 0 2024-09-11T22:22:36.093 INFO:tasks.workunit.client.0.smithi100.stdout: write_blocksize = 4096 (4KB) 2024-09-11T22:22:36.093 INFO:tasks.workunit.client.0.smithi100.stdout: wait time = 0 2024-09-11T22:22:36.093 INFO:tasks.workunit.client.0.smithi100.stdout: 2024-09-11T22:22:36.094 INFO:tasks.workunit.client.0.smithi100.stdout: op weights 2024-09-11T22:22:36.094 INFO:tasks.workunit.client.0.smithi100.stdout: read = 0 (0.00%) 2024-09-11T22:22:36.094 INFO:tasks.workunit.client.0.smithi100.stdout: readall = 0 (0.00%) 2024-09-11T22:22:36.094 INFO:tasks.workunit.client.0.smithi100.stdout: write = 1 (100.00%) 2024-09-11T22:22:36.094 INFO:tasks.workunit.client.0.smithi100.stdout: create = 0 (0.00%) 2024-09-11T22:22:36.094 INFO:tasks.workunit.client.0.smithi100.stdout: append = 0 (0.00%) 2024-09-11T22:22:36.094 INFO:tasks.workunit.client.0.smithi100.stdout: delete = 0 (0.00%) 2024-09-11T22:22:36.094 INFO:tasks.workunit.client.0.smithi100.stdout: metaop = 0 (0.00%) 2024-09-11T22:22:36.094 INFO:tasks.workunit.client.0.smithi100.stdout: createdir = 0 (0.00%) 2024-09-11T22:22:36.094 INFO:tasks.workunit.client.0.smithi100.stdout: stat = 0 (0.00%) 2024-09-11T22:22:36.094 INFO:tasks.workunit.client.0.smithi100.stdout: writeall = 0 (0.00%) 2024-09-11T22:22:36.094 INFO:tasks.workunit.client.0.smithi100.stdout: writeall_fsync = 0 (0.00%) 2024-09-11T22:22:36.094 INFO:tasks.workunit.client.0.smithi100.stdout: open_close = 0 (0.00%) 2024-09-11T22:22:36.095 INFO:tasks.workunit.client.0.smithi100.stdout: write_fsync = 0 (0.00%) 2024-09-11T22:22:36.095 INFO:tasks.workunit.client.0.smithi100.stdout: create_fsync = 0 (0.00%) 2024-09-11T22:22:36.095 INFO:tasks.workunit.client.0.smithi100.stdout: append_fsync = 0 (0.00%) 2024-09-11T22:22:36.095 INFO:tasks.workunit.client.0.smithi100.stdout: 2024-09-11T22:22:36.095 INFO:tasks.workunit.client.0.smithi100.stdout:FileSystem . 2024-09-11T22:22:36.095 INFO:tasks.workunit.client.0.smithi100.stdout:========== 2024-09-11T22:22:36.095 INFO:tasks.workunit.client.0.smithi100.stdout: num_dirs = 0 2024-09-11T22:22:36.095 INFO:tasks.workunit.client.0.smithi100.stdout: starting files = 128 2024-09-11T22:22:36.095 INFO:tasks.workunit.client.0.smithi100.stdout: 2024-09-11T22:22:36.095 INFO:tasks.workunit.client.0.smithi100.stdout: min file size = 104857600 (100MB) 2024-09-11T22:22:36.095 INFO:tasks.workunit.client.0.smithi100.stdout: max file size = 104857600 (100MB) 2024-09-11T22:22:36.095 INFO:tasks.workunit.client.0.smithi100.stdout: directio = off 2024-09-11T22:22:36.095 INFO:tasks.workunit.client.0.smithi100.stdout: alignedio = on 2024-09-11T22:22:36.095 INFO:tasks.workunit.client.0.smithi100.stdout: bufferedio = off 2024-09-11T22:22:36.096 INFO:tasks.workunit.client.0.smithi100.stdout: 2024-09-11T22:22:36.096 INFO:tasks.workunit.client.0.smithi100.stdout: aging is off 2024-09-11T22:22:36.096 INFO:tasks.workunit.client.0.smithi100.stdout: current utilization = 0.04% 2024-09-11T22:22:36.096 INFO:tasks.workunit.client.0.smithi100.stdout: 2024-09-11T22:22:36.096 INFO:tasks.workunit.client.0.smithi100.stdout:checking existing fs: . 2024-09-11T22:22:36.096 INFO:tasks.workunit.client.0.smithi100.stdout:recreating new fileset 2024-09-11T22:22:36.096 INFO:tasks.workunit.client.0.smithi100.stderr:opendir: No such file or directory 2024-09-11T22:22:41.157 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:22:41.158 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-11T22:22:41.158 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T22:22:41.158 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T22:22:41.161 INFO:tasks.ceph.mon.a:Started 2024-09-11T22:22:41.161 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:22:41.162 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:22:41.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.267+0000 7ff97ca1e640 1 Processor -- start 2024-09-11T22:22:41.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.268+0000 7ff97ca1e640 1 -- start start 2024-09-11T22:22:41.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.269+0000 7ff97ca1e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff9780b3190 0x7ff97815e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:41.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.269+0000 7ff97ca1e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff97815a7e0 0x7ff97815e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:41.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.269+0000 7ff97ca1e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff97815ac90 con 0x7ff978154c20 2024-09-11T22:22:41.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.269+0000 7ff97ca1e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7ff97815e000 con 0x7ff9780b3190 2024-09-11T22:22:41.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.269+0000 7ff97ca1e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff97815af70 con 0x7ff97815a7e0 2024-09-11T22:22:41.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.269+0000 7ff97659c640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff978154c20 0x7ff9780cb120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:53338/0 (socket says 172.21.15.100:53338) 2024-09-11T22:22:41.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.269+0000 7ff97659c640 1 -- 172.21.15.100:0/909238221 learned_addr learned my addr 172.21.15.100:0/909238221 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:22:41.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.269+0000 7ff976d9d640 1 --2- 172.21.15.100:0/909238221 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff97815a7e0 0x7ff97815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:41.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.269+0000 7ff975d9b640 1 --2- 172.21.15.100:0/909238221 >> v2:172.21.15.167:3300/0 conn(0x7ff9780b3190 0x7ff97815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:41.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.269+0000 7ff976d9d640 1 -- 172.21.15.100:0/909238221 >> v2:172.21.15.167:3300/0 conn(0x7ff9780b3190 msgr2=0x7ff97815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:41.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.269+0000 7ff976d9d640 1 --2- 172.21.15.100:0/909238221 >> v2:172.21.15.167:3300/0 conn(0x7ff9780b3190 0x7ff97815e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:41.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.269+0000 7ff976d9d640 1 -- 172.21.15.100:0/909238221 >> v1:172.21.15.100:6789/0 conn(0x7ff978154c20 legacy=0x7ff9780cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:41.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.269+0000 7ff976d9d640 1 -- 172.21.15.100:0/909238221 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff97815b250 con 0x7ff97815a7e0 2024-09-11T22:22:41.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.270+0000 7ff976d9d640 1 --2- 172.21.15.100:0/909238221 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff97815a7e0 0x7ff97815e9d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff970009d90 tx=0x7ff97002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eab4a68e497691ee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:41.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.270+0000 7ff97559a640 1 -- 172.21.15.100:0/909238221 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff970007740 con 0x7ff97815a7e0 2024-09-11T22:22:41.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.270+0000 7ff97559a640 1 -- 172.21.15.100:0/909238221 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9700078e0 con 0x7ff97815a7e0 2024-09-11T22:22:41.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.270+0000 7ff97559a640 1 -- 172.21.15.100:0/909238221 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff970007cb0 con 0x7ff97815a7e0 2024-09-11T22:22:41.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.271+0000 7ff97ca1e640 1 -- 172.21.15.100:0/909238221 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff97815a7e0 msgr2=0x7ff97815e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:41.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.271+0000 7ff97ca1e640 1 --2- 172.21.15.100:0/909238221 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff97815a7e0 0x7ff97815e9d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff970009d90 tx=0x7ff97002a660 comp rx=0 tx=0).stop 2024-09-11T22:22:41.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.271+0000 7ff97ca1e640 1 -- 172.21.15.100:0/909238221 shutdown_connections 2024-09-11T22:22:41.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.271+0000 7ff97ca1e640 1 --2- 172.21.15.100:0/909238221 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff97815a7e0 0x7ff97815e9d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:41.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.271+0000 7ff97ca1e640 1 --2- 172.21.15.100:0/909238221 >> v2:172.21.15.167:3300/0 conn(0x7ff9780b3190 0x7ff97815e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:41.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.271+0000 7ff97ca1e640 1 -- 172.21.15.100:0/909238221 >> 172.21.15.100:0/909238221 conn(0x7ff978067d40 msgr2=0x7ff97806d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:41.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.271+0000 7ff97ca1e640 1 -- 172.21.15.100:0/909238221 shutdown_connections 2024-09-11T22:22:41.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.271+0000 7ff97ca1e640 1 -- 172.21.15.100:0/909238221 wait complete. 2024-09-11T22:22:41.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.272+0000 7ff97ca1e640 1 Processor -- start 2024-09-11T22:22:41.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.273+0000 7ff97ca1e640 1 -- start start 2024-09-11T22:22:41.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.273+0000 7ff97ca1e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9780b3190 0x7ff9781513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:41.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.273+0000 7ff97ca1e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff978154c20 0x7ff9781f0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:41.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.273+0000 7ff97ca1e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff97815a7e0 0x7ff97815cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:41.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.273+0000 7ff97ca1e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff9780cbd10 con 0x7ff978154c20 2024-09-11T22:22:41.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.273+0000 7ff97ca1e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff9780cb830 con 0x7ff9780b3190 2024-09-11T22:22:41.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.273+0000 7ff97ca1e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff9780cbe90 con 0x7ff97815a7e0 2024-09-11T22:22:41.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.273+0000 7ff975d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff978154c20 0x7ff9781f0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:41.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.274+0000 7ff975d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff978154c20 0x7ff9781f0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39608/0 (socket says 172.21.15.100:39608) 2024-09-11T22:22:41.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.274+0000 7ff975d9b640 1 -- 172.21.15.100:0/231659023 learned_addr learned my addr 172.21.15.100:0/231659023 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:41.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.274+0000 7ff975d9b640 1 -- 172.21.15.100:0/231659023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff978154c20 msgr2=0x7ff9781f0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-11T22:22:41.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.274+0000 7ff975d9b640 1 -- 172.21.15.100:0/231659023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff978154c20 msgr2=0x7ff9781f0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:22:41.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.274+0000 7ff975d9b640 1 --2- 172.21.15.100:0/231659023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff978154c20 0x7ff9781f0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:22:41.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.274+0000 7ff975d9b640 1 --2- 172.21.15.100:0/231659023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff978154c20 0x7ff9781f0e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:22:41.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.274+0000 7ff976d9d640 1 --2- 172.21.15.100:0/231659023 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff97815a7e0 0x7ff97815cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:41.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.274+0000 7ff97659c640 1 --2- 172.21.15.100:0/231659023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9780b3190 0x7ff9781513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:41.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.274+0000 7ff976d9d640 1 -- 172.21.15.100:0/231659023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9780b3190 msgr2=0x7ff9781513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:41.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.274+0000 7ff976d9d640 1 --2- 172.21.15.100:0/231659023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9780b3190 0x7ff9781513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:41.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.274+0000 7ff976d9d640 1 -- 172.21.15.100:0/231659023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff978154c20 msgr2=0x7ff9781f0e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:22:41.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.274+0000 7ff976d9d640 1 --2- 172.21.15.100:0/231659023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff978154c20 0x7ff9781f0e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:41.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.274+0000 7ff976d9d640 1 -- 172.21.15.100:0/231659023 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff97814f8d0 con 0x7ff97815a7e0 2024-09-11T22:22:41.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.275+0000 7ff976d9d640 1 --2- 172.21.15.100:0/231659023 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff97815a7e0 0x7ff97815cf00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff970031000 tx=0x7ff970004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:41.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.275+0000 7ff966ffd640 1 -- 172.21.15.100:0/231659023 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97003f070 con 0x7ff97815a7e0 2024-09-11T22:22:41.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.275+0000 7ff966ffd640 1 -- 172.21.15.100:0/231659023 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff970031c00 con 0x7ff97815a7e0 2024-09-11T22:22:41.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.275+0000 7ff966ffd640 1 -- 172.21.15.100:0/231659023 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff970009450 con 0x7ff97815a7e0 2024-09-11T22:22:41.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.275+0000 7ff97ca1e640 1 -- 172.21.15.100:0/231659023 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9781f06b0 con 0x7ff97815a7e0 2024-09-11T22:22:41.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.275+0000 7ff97ca1e640 1 -- 172.21.15.100:0/231659023 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff978156660 con 0x7ff97815a7e0 2024-09-11T22:22:41.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.276+0000 7ff97ca1e640 1 -- 172.21.15.100:0/231659023 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9780cc270 con 0x7ff97815a7e0 2024-09-11T22:22:41.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.277+0000 7ff966ffd640 1 -- 172.21.15.100:0/231659023 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff970044460 con 0x7ff97815a7e0 2024-09-11T22:22:41.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.277+0000 7ff966ffd640 1 --2- 172.21.15.100:0/231659023 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff95806be30 0x7ff95806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:41.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.277+0000 7ff966ffd640 1 -- 172.21.15.100:0/231659023 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7ff9700ad200 con 0x7ff97815a7e0 2024-09-11T22:22:41.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.277+0000 7ff97659c640 1 --2- 172.21.15.100:0/231659023 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff95806be30 0x7ff95806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:41.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.278+0000 7ff97659c640 1 --2- 172.21.15.100:0/231659023 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff95806be30 0x7ff95806e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff968000f60 tx=0x7ff968007e80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:41.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.281+0000 7ff966ffd640 1 -- 172.21.15.100:0/231659023 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff97007b7e0 con 0x7ff97815a7e0 2024-09-11T22:22:41.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:41.608+0000 7ff97ca1e640 1 -- 172.21.15.100:0/231659023 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff9780cbaf0 con 0x7ff97815a7e0 2024-09-11T22:22:47.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.474+0000 7ff966ffd640 1 -- 172.21.15.100:0/231659023 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7ff97007b0e0 con 0x7ff97815a7e0 2024-09-11T22:22:47.475 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":18,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:22:47.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.476+0000 7ff97ca1e640 1 -- 172.21.15.100:0/231659023 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff95806be30 msgr2=0x7ff95806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.476+0000 7ff97ca1e640 1 --2- 172.21.15.100:0/231659023 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff95806be30 0x7ff95806e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff968000f60 tx=0x7ff968007e80 comp rx=0 tx=0).stop 2024-09-11T22:22:47.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.476+0000 7ff97ca1e640 1 -- 172.21.15.100:0/231659023 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff97815a7e0 msgr2=0x7ff97815cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.476+0000 7ff97ca1e640 1 --2- 172.21.15.100:0/231659023 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff97815a7e0 0x7ff97815cf00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff970031000 tx=0x7ff970004a40 comp rx=0 tx=0).stop 2024-09-11T22:22:47.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.476+0000 7ff97ca1e640 1 -- 172.21.15.100:0/231659023 shutdown_connections 2024-09-11T22:22:47.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.476+0000 7ff97ca1e640 1 --2- 172.21.15.100:0/231659023 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff95806be30 0x7ff95806e2f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.477+0000 7ff97ca1e640 1 --2- 172.21.15.100:0/231659023 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff97815a7e0 0x7ff97815cf00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.477+0000 7ff97ca1e640 1 --2- 172.21.15.100:0/231659023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff978154c20 0x7ff9781f0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.477+0000 7ff97ca1e640 1 --2- 172.21.15.100:0/231659023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9780b3190 0x7ff9781513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.477+0000 7ff97ca1e640 1 -- 172.21.15.100:0/231659023 >> 172.21.15.100:0/231659023 conn(0x7ff978067d40 msgr2=0x7ff9780c6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:47.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.477+0000 7ff97ca1e640 1 -- 172.21.15.100:0/231659023 shutdown_connections 2024-09-11T22:22:47.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.477+0000 7ff97ca1e640 1 -- 172.21.15.100:0/231659023 wait complete. 2024-09-11T22:22:47.490 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:22:47.490 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:22:47.491 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:22:47.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.600+0000 7f731d59f640 1 Processor -- start 2024-09-11T22:22:47.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.600+0000 7f731d59f640 1 -- start start 2024-09-11T22:22:47.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.601+0000 7f731d59f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7318151970 0x7f73180726c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.601+0000 7f731d59f640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7318073bf0 con 0x7f7318072f30 2024-09-11T22:22:47.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.601+0000 7f731d59f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7318073ed0 con 0x7f73180c3c60 2024-09-11T22:22:47.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.601+0000 7f731d59f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f73180ca3f0 con 0x7f7318151970 2024-09-11T22:22:47.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.601+0000 7f73177fe640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7318072f30 0x7f7318161fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50588/0 (socket says 172.21.15.100:50588) 2024-09-11T22:22:47.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.601+0000 7f73177fe640 1 -- 172.21.15.100:0/1688555690 learned_addr learned my addr 172.21.15.100:0/1688555690 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:22:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.602+0000 7f7316ffd640 1 --2- 172.21.15.100:0/1688555690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7318151970 0x7f73180726c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.602+0000 7f7315ffb640 1 -- 172.21.15.100:0/1688555690 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2950530442 0 0) 0x7f7318073bf0 con 0x7f7318072f30 2024-09-11T22:22:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.602+0000 7f7315ffb640 1 -- 172.21.15.100:0/1688555690 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7300003520 con 0x7f7318072f30 2024-09-11T22:22:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.602+0000 7f7315ffb640 1 -- 172.21.15.100:0/1688555690 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 436005249 0 0) 0x7f7318073ed0 con 0x7f73180c3c60 2024-09-11T22:22:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.602+0000 7f7315ffb640 1 -- 172.21.15.100:0/1688555690 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7318073bf0 con 0x7f73180c3c60 2024-09-11T22:22:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.602+0000 7f7315ffb640 1 -- 172.21.15.100:0/1688555690 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1167180799 0 0) 0x7f7300003520 con 0x7f7318072f30 2024-09-11T22:22:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.602+0000 7f7315ffb640 1 -- 172.21.15.100:0/1688555690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7318151970 msgr2=0x7f73180726c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.602+0000 7f7315ffb640 1 --2- 172.21.15.100:0/1688555690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7318151970 0x7f73180726c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.602+0000 7f7315ffb640 1 -- 172.21.15.100:0/1688555690 >> v1:172.21.15.167:6789/0 conn(0x7f73180c3c60 legacy=0x7f73181576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.602+0000 7f7315ffb640 1 -- 172.21.15.100:0/1688555690 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73180c9910 con 0x7f7318072f30 2024-09-11T22:22:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.602+0000 7f7315ffb640 1 -- 172.21.15.100:0/1688555690 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f73100019f0 con 0x7f7318072f30 2024-09-11T22:22:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.602+0000 7f7315ffb640 1 -- 172.21.15.100:0/1688555690 >> v1:172.21.15.100:6789/0 conn(0x7f7318072f30 legacy=0x7f7318161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.602+0000 7f7315ffb640 1 --2- 172.21.15.100:0/1688555690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7300003b70 0x7f7300003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.602+0000 7f7315ffb640 1 --2- 172.21.15.100:0/1688555690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7318151970 0x7f7300004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.602+0000 7f7315ffb640 1 --2- 172.21.15.100:0/1688555690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7300004d40 0x7f73000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.602+0000 7f7315ffb640 1 -- 172.21.15.100:0/1688555690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f73180ca3f0 con 0x7f7300004d40 2024-09-11T22:22:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.602+0000 7f7315ffb640 1 -- 172.21.15.100:0/1688555690 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f730000ba70 con 0x7f7300003b70 2024-09-11T22:22:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.602+0000 7f7315ffb640 1 -- 172.21.15.100:0/1688555690 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f730000de30 con 0x7f7318151970 2024-09-11T22:22:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.602+0000 7f73177fe640 1 --2- 172.21.15.100:0/1688555690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7300004d40 0x7f73000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.602+0000 7f7316ffd640 1 --2- 172.21.15.100:0/1688555690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7300003b70 0x7f7300003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.602+0000 7f73167fc640 1 --2- 172.21.15.100:0/1688555690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7318151970 0x7f7300004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.603+0000 7f73177fe640 1 -- 172.21.15.100:0/1688555690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7318151970 msgr2=0x7f7300004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.603+0000 7f73177fe640 1 --2- 172.21.15.100:0/1688555690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7318151970 0x7f7300004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.603+0000 7f73177fe640 1 -- 172.21.15.100:0/1688555690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7300003b70 msgr2=0x7f7300003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.603+0000 7f73177fe640 1 --2- 172.21.15.100:0/1688555690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7300003b70 0x7f7300003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.603+0000 7f73177fe640 1 -- 172.21.15.100:0/1688555690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7300003520 con 0x7f7300004d40 2024-09-11T22:22:47.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.603+0000 7f7316ffd640 1 --2- 172.21.15.100:0/1688555690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7300003b70 0x7f7300003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.603+0000 7f73167fc640 1 --2- 172.21.15.100:0/1688555690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7318151970 0x7f7300004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.603+0000 7f73177fe640 1 --2- 172.21.15.100:0/1688555690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7300004d40 0x7f73000051c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f731000a7c0 tx=0x7f7300005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32439ea8a1bccd10 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.604+0000 7f7315ffb640 1 -- 172.21.15.100:0/1688555690 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731000a410 con 0x7f7300004d40 2024-09-11T22:22:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.604+0000 7f7315ffb640 1 -- 172.21.15.100:0/1688555690 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f731002f070 con 0x7f7300004d40 2024-09-11T22:22:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.604+0000 7f7315ffb640 1 -- 172.21.15.100:0/1688555690 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731002bc20 con 0x7f7300004d40 2024-09-11T22:22:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.604+0000 7f731d59f640 1 -- 172.21.15.100:0/1688555690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7300004d40 msgr2=0x7f73000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.604+0000 7f731d59f640 1 --2- 172.21.15.100:0/1688555690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7300004d40 0x7f73000051c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f731000a7c0 tx=0x7f7300005830 comp rx=0 tx=0).stop 2024-09-11T22:22:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.604+0000 7f73177fe640 1 -- 172.21.15.100:0/1688555690 reap_dead start 2024-09-11T22:22:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.604+0000 7f731d59f640 1 -- 172.21.15.100:0/1688555690 shutdown_connections 2024-09-11T22:22:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.604+0000 7f731d59f640 1 -- 172.21.15.100:0/1688555690 >> 172.21.15.100:0/1688555690 conn(0x7f731806ee80 msgr2=0x7f7318070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.604+0000 7f731d59f640 1 -- 172.21.15.100:0/1688555690 shutdown_connections 2024-09-11T22:22:47.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.604+0000 7f731d59f640 1 -- 172.21.15.100:0/1688555690 wait complete. 2024-09-11T22:22:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.606+0000 7f731d59f640 1 Processor -- start 2024-09-11T22:22:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.606+0000 7f731d59f640 1 -- start start 2024-09-11T22:22:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.606+0000 7f731d59f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f731814a590 0x7f73181df760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.606+0000 7f731d59f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f731814a970 0x7f73181dfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.606+0000 7f731d59f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73181ecbd0 0x7f73181ef6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.606+0000 7f731d59f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f73180741b0 con 0x7f73181ecbd0 2024-09-11T22:22:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.606+0000 7f731d59f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f73180c9f60 con 0x7f731814a590 2024-09-11T22:22:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.606+0000 7f731d59f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f731806d530 con 0x7f731814a970 2024-09-11T22:22:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.606+0000 7f73177fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73181ecbd0 0x7f73181ef6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.606+0000 7f73177fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73181ecbd0 0x7f73181ef6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37810/0 (socket says 172.21.15.100:37810) 2024-09-11T22:22:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.607+0000 7f73177fe640 1 -- 172.21.15.100:0/3501801577 learned_addr learned my addr 172.21.15.100:0/3501801577 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.607+0000 7f7316ffd640 1 --2- 172.21.15.100:0/3501801577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f731814a590 0x7f73181df760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.607+0000 7f73167fc640 1 --2- 172.21.15.100:0/3501801577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f731814a970 0x7f73181dfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.607+0000 7f73177fe640 1 -- 172.21.15.100:0/3501801577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f731814a970 msgr2=0x7f73181dfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.607+0000 7f73177fe640 1 --2- 172.21.15.100:0/3501801577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f731814a970 0x7f73181dfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.607+0000 7f73177fe640 1 -- 172.21.15.100:0/3501801577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f731814a590 msgr2=0x7f73181df760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.607+0000 7f73177fe640 1 --2- 172.21.15.100:0/3501801577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f731814a590 0x7f73181df760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.607+0000 7f73177fe640 1 -- 172.21.15.100:0/3501801577 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7318148790 con 0x7f73181ecbd0 2024-09-11T22:22:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.607+0000 7f7316ffd640 1 --2- 172.21.15.100:0/3501801577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f731814a590 0x7f73181df760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.607+0000 7f73177fe640 1 --2- 172.21.15.100:0/3501801577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73181ecbd0 0x7f73181ef6c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f731000a7c0 tx=0x7f73180c7a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.607+0000 7f72ff7fe640 1 -- 172.21.15.100:0/3501801577 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7308014b50 con 0x7f73181ecbd0 2024-09-11T22:22:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.607+0000 7f72ff7fe640 1 -- 172.21.15.100:0/3501801577 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f731000a3f0 con 0x7f73181ecbd0 2024-09-11T22:22:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.607+0000 7f731d59f640 1 -- 172.21.15.100:0/3501801577 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7318148a70 con 0x7f73181ecbd0 2024-09-11T22:22:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.607+0000 7f72ff7fe640 1 -- 172.21.15.100:0/3501801577 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730c0014f0 con 0x7f73181ecbd0 2024-09-11T22:22:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.607+0000 7f731d59f640 1 -- 172.21.15.100:0/3501801577 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7318148d50 con 0x7f73181ecbd0 2024-09-11T22:22:47.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.608+0000 7f731d59f640 1 --2- 172.21.15.100:0/3501801577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73181efc00 0x7f73181effe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.608+0000 7f731d59f640 1 -- 172.21.15.100:0/3501801577 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f73181f0520 con 0x7f73181efc00 2024-09-11T22:22:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.608+0000 7f7316ffd640 1 --2- 172.21.15.100:0/3501801577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73181efc00 0x7f73181effe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.609+0000 7f7316ffd640 1 -- 172.21.15.100:0/3501801577 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7318151d50 con 0x7f73181efc00 2024-09-11T22:22:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.609+0000 7f72ff7fe640 1 -- 172.21.15.100:0/3501801577 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7310034670 con 0x7f73181ecbd0 2024-09-11T22:22:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.609+0000 7f7316ffd640 1 --2- 172.21.15.100:0/3501801577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73181efc00 0x7f73181effe0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f730801bb60 tx=0x7f730801a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.609+0000 7f72ff7fe640 1 --2- 172.21.15.100:0/3501801577 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f730406be30 0x7f730406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.609+0000 7f72ff7fe640 1 -- 172.21.15.100:0/3501801577 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f73100aaee0 con 0x7f73181ecbd0 2024-09-11T22:22:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.609+0000 7f73167fc640 1 --2- 172.21.15.100:0/3501801577 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f730406be30 0x7f730406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.610+0000 7f72ff7fe640 1 -- 172.21.15.100:0/3501801577 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7308023020 con 0x7f73181efc00 2024-09-11T22:22:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.610+0000 7f72ff7fe640 1 -- 172.21.15.100:0/3501801577 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f730801be50 con 0x7f73181efc00 2024-09-11T22:22:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.610+0000 7f72ff7fe640 1 -- 172.21.15.100:0/3501801577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73181efc00 msgr2=0x7f73181effe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.610+0000 7f72ff7fe640 1 --2- 172.21.15.100:0/3501801577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73181efc00 0x7f73181effe0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f730801bb60 tx=0x7f730801a580 comp rx=0 tx=0).stop 2024-09-11T22:22:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.610+0000 7f72ff7fe640 1 -- 172.21.15.100:0/3501801577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73181efc00 msgr2=0x7f73181effe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:22:47.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.610+0000 7f72ff7fe640 1 --2- 172.21.15.100:0/3501801577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73181efc00 0x7f73181effe0 secure :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f730801bb60 tx=0x7f730801a580 comp rx=0 tx=0).stop 2024-09-11T22:22:47.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.610+0000 7f73167fc640 1 --2- 172.21.15.100:0/3501801577 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f730406be30 0x7f730406e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f731814e810 tx=0x7f730c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.616+0000 7f731d59f640 1 --2- 172.21.15.100:0/3501801577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7318147450 0x7f7318147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.616+0000 7f731d59f640 1 -- 172.21.15.100:0/3501801577 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7318072d10 con 0x7f7318147450 2024-09-11T22:22:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.616+0000 7f7316ffd640 1 --2- 172.21.15.100:0/3501801577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7318147450 0x7f7318147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.616+0000 7f7316ffd640 1 -- 172.21.15.100:0/3501801577 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f731814dbf0 con 0x7f7318147450 2024-09-11T22:22:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.616+0000 7f7316ffd640 1 --2- 172.21.15.100:0/3501801577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7318147450 0x7f7318147830 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f730801b010 tx=0x7f7308004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.617+0000 7f72ff7fe640 1 -- 172.21.15.100:0/3501801577 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7308023030 con 0x7f7318147450 2024-09-11T22:22:47.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.617+0000 7f72ff7fe640 1 -- 172.21.15.100:0/3501801577 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7f730802ad30 con 0x7f7318147450 2024-09-11T22:22:47.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.617+0000 7f72ff7fe640 1 -- 172.21.15.100:0/3501801577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7318147450 msgr2=0x7f7318147830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.617+0000 7f72ff7fe640 1 --2- 172.21.15.100:0/3501801577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7318147450 0x7f7318147830 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f730801b010 tx=0x7f7308004730 comp rx=0 tx=0).stop 2024-09-11T22:22:47.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.617+0000 7f72ff7fe640 1 -- 172.21.15.100:0/3501801577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7318147450 msgr2=0x7f7318147830 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:22:47.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.617+0000 7f72ff7fe640 1 --2- 172.21.15.100:0/3501801577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7318147450 0x7f7318147830 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.619 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:22:47.619 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:22:47.619 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:22:47.619 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:22:47.619 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 18, 2024-09-11T22:22:47.619 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 6362, 2024-09-11T22:22:47.619 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:22:47.619 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:22:47.619 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:22:47.619 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:22:47.619 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:47.619 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:22:47.620 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:22:47.620 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:22:47.620 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:22:47.620 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:47.620 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:47.620 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:47.620 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:47.620 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:47.620 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:47.620 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:47.620 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:47.620 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:47.620 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:47.620 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:47.621 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:47.621 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:22:47.621 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:22:47.621 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:47.621 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:47.621 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:47.621 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:47.621 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:47.621 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:47.621 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:47.621 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:47.621 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:47.621 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:47.621 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:47.622 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:47.622 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.622 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:22:47.622 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:22:47.622 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:22:47.622 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:22:47.622 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:22:47.622 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:22:47.622 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:22:47.622 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:22:47.622 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:22:47.622 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:22:47.622 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:22:47.622 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:22:47.623 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:22:47.623 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:22:47.623 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:22:47.623 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:22:47.623 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:22:47.623 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:47.623 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:47.623 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:47.623 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:47.623 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:47.623 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:47.623 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:47.623 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:47.623 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:47.624 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:47.624 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:47.624 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:47.624 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:22:47.624 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.624 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:22:47.624 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.624 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:22:47.624 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:22:47.624 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:47.624 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:47.624 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.624 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:47.625 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:22:47.625 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:47.625 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.625 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.625 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:47.625 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:22:47.625 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:47.625 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.625 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:47.625 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.625 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:22:47.625 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:22:47.625 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:47.625 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:47.626 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:47.626 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.626 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.626 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:22:47.626 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:22:47.626 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:47.626 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:47.626 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.626 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:47.626 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:22:47.626 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:47.626 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.626 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.626 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:47.627 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:22:47.627 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:47.627 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.627 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:47.627 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.627 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:22:47.627 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:22:47.627 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:47.627 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:47.627 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:47.627 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.627 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.627 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:22:47.627 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:22:47.627 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:47.628 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:47.628 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.628 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:47.628 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:22:47.628 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:47.628 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.628 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.628 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:47.628 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:22:47.628 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:47.628 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.628 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:47.628 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.629 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:22:47.629 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:22:47.629 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:47.629 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:47.629 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:47.629 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.629 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:47.629 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.629 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:22:47.629 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:22:47.629 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.629 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:47.629 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:47.629 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:22:47.630 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.630 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:47.630 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:22:47.630 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.630 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:47.630 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:47.630 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:22:47.630 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.630 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:47.630 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.630 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:22:47.630 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:22:47.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.617+0000 7f731d59f640 1 -- 172.21.15.100:0/3501801577 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f730406be30 msgr2=0x7f730406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.617+0000 7f731d59f640 1 --2- 172.21.15.100:0/3501801577 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f730406be30 0x7f730406e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f731814e810 tx=0x7f730c009040 comp rx=0 tx=0).stop 2024-09-11T22:22:47.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.617+0000 7f731d59f640 1 -- 172.21.15.100:0/3501801577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73181ecbd0 msgr2=0x7f73181ef6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.617+0000 7f73177fe640 1 -- 172.21.15.100:0/3501801577 reap_dead start 2024-09-11T22:22:47.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.617+0000 7f731d59f640 1 --2- 172.21.15.100:0/3501801577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73181ecbd0 0x7f73181ef6c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f731000a7c0 tx=0x7f73180c7a90 comp rx=0 tx=0).stop 2024-09-11T22:22:47.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.617+0000 7f731d59f640 1 -- 172.21.15.100:0/3501801577 shutdown_connections 2024-09-11T22:22:47.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.617+0000 7f731d59f640 1 --2- 172.21.15.100:0/3501801577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73181ecbd0 0x7f73181ef6c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.617+0000 7f731d59f640 1 -- 172.21.15.100:0/3501801577 >> 172.21.15.100:0/3501801577 conn(0x7f731806ee80 msgr2=0x7f731806c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:47.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.617+0000 7f731d59f640 1 -- 172.21.15.100:0/3501801577 shutdown_connections 2024-09-11T22:22:47.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.617+0000 7f731d59f640 1 -- 172.21.15.100:0/3501801577 wait complete. 2024-09-11T22:22:47.633 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:22:47.633 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:22:47.633 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:22:47.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.742+0000 7f2396cba640 1 Processor -- start 2024-09-11T22:22:47.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.743+0000 7f2396cba640 1 -- start start 2024-09-11T22:22:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.743+0000 7f2396cba640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f239006ce60 0x7f239015bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.743+0000 7f2396cba640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f239006d240 0x7f23901651e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.743+0000 7f2396cba640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23900c6510 con 0x7f239015c290 2024-09-11T22:22:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.743+0000 7f2396cba640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f239015b820 con 0x7f239006d240 2024-09-11T22:22:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.743+0000 7f2396cba640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f23900c5470 con 0x7f239006ce60 2024-09-11T22:22:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.744+0000 7f2394a56640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f239006ce60 0x7f239015bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.744+0000 7f2395257640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f239006d240 0x7f23901651e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.744+0000 7f2394a56640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f239006ce60 0x7f239015bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:51058/0 (socket says 172.21.15.100:51058) 2024-09-11T22:22:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.744+0000 7f2394a56640 1 -- 172.21.15.100:0/3076121938 learned_addr learned my addr 172.21.15.100:0/3076121938 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.744+0000 7f238ffff640 1 --1- 172.21.15.100:0/3076121938 >> v1:172.21.15.167:6789/0 conn(0x7f239015c290 0x7f23901546b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:42532/0 (socket says 172.21.15.100:42532) 2024-09-11T22:22:47.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.744+0000 7f2395257640 1 -- 172.21.15.100:0/3076121938 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f239006ce60 msgr2=0x7f239015bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:47.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.744+0000 7f2395257640 1 --2- 172.21.15.100:0/3076121938 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f239006ce60 0x7f239015bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.744+0000 7f2395257640 1 -- 172.21.15.100:0/3076121938 >> v1:172.21.15.167:6789/0 conn(0x7f239015c290 legacy=0x7f23901546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.744+0000 7f238f7fe640 1 -- 172.21.15.100:0/3076121938 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3625202802 0 0) 0x7f23900c6510 con 0x7f239015c290 2024-09-11T22:22:47.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.744+0000 7f2395257640 1 -- 172.21.15.100:0/3076121938 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23900c5750 con 0x7f239006d240 2024-09-11T22:22:47.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.744+0000 7f2394a56640 1 --2- 172.21.15.100:0/3076121938 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f239006ce60 0x7f239015bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.745+0000 7f2395257640 1 --2- 172.21.15.100:0/3076121938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f239006d240 0x7f23901651e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2388009d90 tx=0x7f238802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43ba081545ea6123 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.745+0000 7f238f7fe640 1 -- 172.21.15.100:0/3076121938 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388007740 con 0x7f239006d240 2024-09-11T22:22:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.745+0000 7f238f7fe640 1 -- 172.21.15.100:0/3076121938 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23880078e0 con 0x7f239006d240 2024-09-11T22:22:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.745+0000 7f238f7fe640 1 -- 172.21.15.100:0/3076121938 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388007cb0 con 0x7f239006d240 2024-09-11T22:22:47.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.745+0000 7f2396cba640 1 -- 172.21.15.100:0/3076121938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f239006d240 msgr2=0x7f23901651e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.745+0000 7f2396cba640 1 --2- 172.21.15.100:0/3076121938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f239006d240 0x7f23901651e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2388009d90 tx=0x7f238802a660 comp rx=0 tx=0).stop 2024-09-11T22:22:47.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.746+0000 7f2396cba640 1 -- 172.21.15.100:0/3076121938 shutdown_connections 2024-09-11T22:22:47.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.746+0000 7f2396cba640 1 --2- 172.21.15.100:0/3076121938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f239006d240 0x7f23901651e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.746+0000 7f2396cba640 1 --2- 172.21.15.100:0/3076121938 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f239006ce60 0x7f239015bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.746+0000 7f2396cba640 1 -- 172.21.15.100:0/3076121938 >> 172.21.15.100:0/3076121938 conn(0x7f239006bc10 msgr2=0x7f239006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:47.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.746+0000 7f2396cba640 1 -- 172.21.15.100:0/3076121938 shutdown_connections 2024-09-11T22:22:47.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.746+0000 7f2396cba640 1 -- 172.21.15.100:0/3076121938 wait complete. 2024-09-11T22:22:47.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.747+0000 7f2396cba640 1 Processor -- start 2024-09-11T22:22:47.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.747+0000 7f2396cba640 1 -- start start 2024-09-11T22:22:47.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.748+0000 7f2396cba640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f239006ce60 0x7f23901537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.748+0000 7f2396cba640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f239006d240 0x7f2390150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.748+0000 7f2396cba640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f239015c290 0x7f23900c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.748+0000 7f2396cba640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f23900cb1b0 con 0x7f239006d240 2024-09-11T22:22:47.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.748+0000 7f2396cba640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f23900c5d10 con 0x7f239006ce60 2024-09-11T22:22:47.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.748+0000 7f2396cba640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f23900cad20 con 0x7f239015c290 2024-09-11T22:22:47.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.748+0000 7f2394a56640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f239006ce60 0x7f23901537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.748+0000 7f238ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f239006d240 0x7f2390150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.748+0000 7f2394a56640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f239006ce60 0x7f23901537b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:60844/0 (socket says 172.21.15.100:60844) 2024-09-11T22:22:47.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.748+0000 7f2395257640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f239015c290 0x7f23900c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.748+0000 7f2394a56640 1 -- 172.21.15.100:0/1732770335 learned_addr learned my addr 172.21.15.100:0/1732770335 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:47.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.748+0000 7f2394a56640 1 -- 172.21.15.100:0/1732770335 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f239015c290 msgr2=0x7f23900c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.748+0000 7f2394a56640 1 --2- 172.21.15.100:0/1732770335 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f239015c290 0x7f23900c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.748+0000 7f2394a56640 1 -- 172.21.15.100:0/1732770335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f239006d240 msgr2=0x7f2390150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.748+0000 7f2394a56640 1 --2- 172.21.15.100:0/1732770335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f239006d240 0x7f2390150610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.748+0000 7f2394a56640 1 -- 172.21.15.100:0/1732770335 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23900c88d0 con 0x7f239006ce60 2024-09-11T22:22:47.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.748+0000 7f2394a56640 1 --2- 172.21.15.100:0/1732770335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f239006ce60 0x7f23901537b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f238400e9d0 tx=0x7f238400ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:47.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.748+0000 7f238d7fa640 1 -- 172.21.15.100:0/1732770335 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2384017070 con 0x7f239006ce60 2024-09-11T22:22:47.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.749+0000 7f238d7fa640 1 -- 172.21.15.100:0/1732770335 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f238400ca60 con 0x7f239006ce60 2024-09-11T22:22:47.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.749+0000 7f2396cba640 1 -- 172.21.15.100:0/1732770335 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23900c8bb0 con 0x7f239006ce60 2024-09-11T22:22:47.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.749+0000 7f238d7fa640 1 -- 172.21.15.100:0/1732770335 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238400ce10 con 0x7f239006ce60 2024-09-11T22:22:47.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.749+0000 7f2396cba640 1 -- 172.21.15.100:0/1732770335 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23900cd5f0 con 0x7f239006ce60 2024-09-11T22:22:47.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.749+0000 7f2396cba640 1 --2- 172.21.15.100:0/1732770335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23901f0220 0x7f239014d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.749+0000 7f2396cba640 1 -- 172.21.15.100:0/1732770335 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f23900c8dd0 con 0x7f23901f0220 2024-09-11T22:22:47.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.750+0000 7f238ffff640 1 --2- 172.21.15.100:0/1732770335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23901f0220 0x7f239014d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.750+0000 7f238ffff640 1 -- 172.21.15.100:0/1732770335 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f239014df60 con 0x7f23901f0220 2024-09-11T22:22:47.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.750+0000 7f238ffff640 1 --2- 172.21.15.100:0/1732770335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23901f0220 0x7f239014d3b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f23901ede50 tx=0x7f237c0018d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:47.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.750+0000 7f238d7fa640 1 -- 172.21.15.100:0/1732770335 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c011580 con 0x7f23901f0220 2024-09-11T22:22:47.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.750+0000 7f238d7fa640 1 -- 172.21.15.100:0/1732770335 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f238401a070 con 0x7f239006ce60 2024-09-11T22:22:47.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.751+0000 7f238d7fa640 1 --2- 172.21.15.100:0/1732770335 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f237406bd30 0x7f237406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.751+0000 7f238d7fa640 1 -- 172.21.15.100:0/1732770335 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f238408b480 con 0x7f239006ce60 2024-09-11T22:22:47.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.751+0000 7f2395257640 1 --2- 172.21.15.100:0/1732770335 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f237406bd30 0x7f237406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.751+0000 7f238d7fa640 1 -- 172.21.15.100:0/1732770335 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f237c018070 con 0x7f23901f0220 2024-09-11T22:22:47.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.751+0000 7f238d7fa640 1 -- 172.21.15.100:0/1732770335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23901f0220 msgr2=0x7f239014d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.751+0000 7f238d7fa640 1 --2- 172.21.15.100:0/1732770335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23901f0220 0x7f239014d3b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f23901ede50 tx=0x7f237c0018d0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.751+0000 7f238d7fa640 1 -- 172.21.15.100:0/1732770335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23901f0220 msgr2=0x7f239014d3b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:22:47.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.751+0000 7f238d7fa640 1 --2- 172.21.15.100:0/1732770335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23901f0220 0x7f239014d3b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.751+0000 7f2395257640 1 --2- 172.21.15.100:0/1732770335 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f237406bd30 0x7f237406e1f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2388034000 tx=0x7f238802f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:47.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.757+0000 7f2396cba640 1 --2- 172.21.15.100:0/1732770335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f239014d8f0 0x7f23900cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.757+0000 7f2396cba640 1 -- 172.21.15.100:0/1732770335 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f23900c98a0 con 0x7f239014d8f0 2024-09-11T22:22:47.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.757+0000 7f238ffff640 1 --2- 172.21.15.100:0/1732770335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f239014d8f0 0x7f23900cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.758+0000 7f238ffff640 1 -- 172.21.15.100:0/1732770335 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f239015b540 con 0x7f239014d8f0 2024-09-11T22:22:47.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.758+0000 7f238ffff640 1 --2- 172.21.15.100:0/1732770335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f239014d8f0 0x7f23900cc380 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f23901f0600 tx=0x7f237c001080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:47.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.758+0000 7f238d7fa640 1 -- 172.21.15.100:0/1732770335 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c01d9d0 con 0x7f239014d8f0 2024-09-11T22:22:47.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.758+0000 7f238d7fa640 1 -- 172.21.15.100:0/1732770335 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7f237c01d9d0 con 0x7f239014d8f0 2024-09-11T22:22:47.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.758+0000 7f238d7fa640 1 -- 172.21.15.100:0/1732770335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f239014d8f0 msgr2=0x7f23900cc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.758+0000 7f238d7fa640 1 --2- 172.21.15.100:0/1732770335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f239014d8f0 0x7f23900cc380 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f23901f0600 tx=0x7f237c001080 comp rx=0 tx=0).stop 2024-09-11T22:22:47.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.758+0000 7f238d7fa640 1 -- 172.21.15.100:0/1732770335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f239014d8f0 msgr2=0x7f23900cc380 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:22:47.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.758+0000 7f238d7fa640 1 --2- 172.21.15.100:0/1732770335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f239014d8f0 0x7f23900cc380 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.760 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:22:47.760 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:22:47.760 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:22:47.760 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:22:47.760 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 18, 2024-09-11T22:22:47.760 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 171737, 2024-09-11T22:22:47.760 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:22:47.760 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:22:47.760 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:22:47.760 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:22:47.760 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:47.761 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:22:47.761 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:22:47.761 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:22:47.761 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:22:47.761 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:47.761 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:47.761 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:47.761 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:47.761 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:47.761 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:47.761 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:47.761 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:47.761 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:47.761 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:47.762 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:47.762 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:47.762 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:22:47.762 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:22:47.762 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:47.762 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:47.762 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:47.762 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:47.762 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:47.762 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:47.762 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:47.762 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:47.762 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:47.763 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:47.763 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:47.763 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:47.763 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.763 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:22:47.763 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:22:47.763 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:22:47.763 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:22:47.763 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:22:47.763 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:22:47.763 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:22:47.763 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:22:47.763 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:22:47.763 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:22:47.764 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:22:47.764 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:22:47.764 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:22:47.764 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:22:47.764 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:22:47.764 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:22:47.764 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:22:47.764 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:47.764 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:47.764 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:47.764 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:47.764 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:47.764 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:47.764 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:47.765 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:47.765 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:47.765 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:47.765 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:47.765 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:47.765 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:22:47.765 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.765 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:22:47.765 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.765 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:22:47.765 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:22:47.765 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:47.765 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:47.766 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.766 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:47.766 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:22:47.766 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:47.766 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.766 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.766 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:47.766 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:22:47.766 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:47.766 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.766 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:47.766 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.766 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:22:47.766 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:22:47.767 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:47.767 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:47.767 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:47.767 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.767 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.767 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:22:47.767 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:22:47.767 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:47.767 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:47.767 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.767 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:47.767 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:22:47.767 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:47.767 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.768 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.768 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:47.768 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:22:47.768 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:47.768 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.768 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:47.768 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.768 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:22:47.768 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:22:47.768 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:47.768 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:47.768 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:47.768 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.768 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.769 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:22:47.769 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:22:47.769 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:47.769 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:47.769 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.769 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:47.769 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:22:47.769 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:47.769 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.769 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.769 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:47.769 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:22:47.769 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:47.770 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.770 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:47.770 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.770 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:22:47.770 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:22:47.770 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:47.770 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:47.770 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:47.770 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.770 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:47.770 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.770 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:22:47.770 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:22:47.770 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.771 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:47.771 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:47.771 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:22:47.771 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.771 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:47.771 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:22:47.771 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.771 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:47.771 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:47.771 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:22:47.771 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.771 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:47.771 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:22:47.771 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.772 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:47.772 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:47.772 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:22:47.772 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.772 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:47.772 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:22:47.772 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.772 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:47.772 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:47.772 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:22:47.772 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.772 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:47.772 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:22:47.773 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.773 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:47.773 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:47.773 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:22:47.773 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.773 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:47.773 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.773 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:22:47.773 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:22:47.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.759+0000 7f2396cba640 1 -- 172.21.15.100:0/1732770335 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f237406bd30 msgr2=0x7f237406e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.759+0000 7f2396cba640 1 --2- 172.21.15.100:0/1732770335 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f237406bd30 0x7f237406e1f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2388034000 tx=0x7f238802f000 comp rx=0 tx=0).stop 2024-09-11T22:22:47.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.759+0000 7f2396cba640 1 -- 172.21.15.100:0/1732770335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f239006ce60 msgr2=0x7f23901537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.759+0000 7f2396cba640 1 --2- 172.21.15.100:0/1732770335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f239006ce60 0x7f23901537b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f238400e9d0 tx=0x7f238400ee90 comp rx=0 tx=0).stop 2024-09-11T22:22:47.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.759+0000 7f2395257640 1 -- 172.21.15.100:0/1732770335 reap_dead start 2024-09-11T22:22:47.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.759+0000 7f2395257640 1 -- 172.21.15.100:0/1732770335 reap_dead start 2024-09-11T22:22:47.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.759+0000 7f2396cba640 1 -- 172.21.15.100:0/1732770335 shutdown_connections 2024-09-11T22:22:47.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.759+0000 7f2396cba640 1 -- 172.21.15.100:0/1732770335 >> 172.21.15.100:0/1732770335 conn(0x7f239006bc10 msgr2=0x7f239015c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:47.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.759+0000 7f2396cba640 1 -- 172.21.15.100:0/1732770335 shutdown_connections 2024-09-11T22:22:47.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.759+0000 7f2396cba640 1 -- 172.21.15.100:0/1732770335 wait complete. 2024-09-11T22:22:47.775 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:22:47.775 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:22:47.776 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:22:47.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.886+0000 7f1b1f50a640 1 Processor -- start 2024-09-11T22:22:47.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.886+0000 7f1b1f50a640 1 -- start start 2024-09-11T22:22:47.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.887+0000 7f1b1f50a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1b18151970 0x7f1b180726c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.887+0000 7f1b1f50a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b180c3c60 0x7f1b181576c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.887+0000 7f1b1f50a640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b18073bf0 con 0x7f1b18157c00 2024-09-11T22:22:47.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.887+0000 7f1b1f50a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f1b180ca3f0 con 0x7f1b18151970 2024-09-11T22:22:47.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.887+0000 7f1b1f50a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1b180c9f60 con 0x7f1b180c3c60 2024-09-11T22:22:47.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.887+0000 7f1b1daa7640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1b18157c00 0x7f1b18072f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50592/0 (socket says 172.21.15.100:50592) 2024-09-11T22:22:47.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.887+0000 7f1b1daa7640 1 -- 172.21.15.100:0/3062345614 learned_addr learned my addr 172.21.15.100:0/3062345614 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:22:47.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.887+0000 7f1b1caa5640 1 --2- 172.21.15.100:0/3062345614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b180c3c60 0x7f1b181576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.887+0000 7f1b1d2a6640 1 --2- 172.21.15.100:0/3062345614 >> v2:172.21.15.167:3300/0 conn(0x7f1b18151970 0x7f1b180726c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.887+0000 7f1b0ffff640 1 -- 172.21.15.100:0/3062345614 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2068881888 0 0) 0x7f1b18073bf0 con 0x7f1b18157c00 2024-09-11T22:22:47.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.887+0000 7f1b0ffff640 1 -- 172.21.15.100:0/3062345614 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b04003520 con 0x7f1b18157c00 2024-09-11T22:22:47.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.888+0000 7f1b0ffff640 1 -- 172.21.15.100:0/3062345614 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2960685537 0 0) 0x7f1b04003520 con 0x7f1b18157c00 2024-09-11T22:22:47.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.888+0000 7f1b1d2a6640 1 -- 172.21.15.100:0/3062345614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b180c3c60 msgr2=0x7f1b181576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:47.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.888+0000 7f1b1d2a6640 1 --2- 172.21.15.100:0/3062345614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b180c3c60 0x7f1b181576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.888+0000 7f1b1d2a6640 1 -- 172.21.15.100:0/3062345614 >> v1:172.21.15.100:6789/0 conn(0x7f1b18157c00 legacy=0x7f1b18072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.888+0000 7f1b1d2a6640 1 -- 172.21.15.100:0/3062345614 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b18073ed0 con 0x7f1b18151970 2024-09-11T22:22:47.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.888+0000 7f1b1caa5640 1 --2- 172.21.15.100:0/3062345614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b180c3c60 0x7f1b181576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:47.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.888+0000 7f1b1d2a6640 1 --2- 172.21.15.100:0/3062345614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b18151970 0x7f1b180726c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1b1400dbc0 tx=0x7f1b1402e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74f4853d6edebc7d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:47.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.889+0000 7f1b0ffff640 1 -- 172.21.15.100:0/3062345614 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1403a070 con 0x7f1b18151970 2024-09-11T22:22:47.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.889+0000 7f1b0ffff640 1 -- 172.21.15.100:0/3062345614 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b1400b450 con 0x7f1b18151970 2024-09-11T22:22:47.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.889+0000 7f1b0ffff640 1 -- 172.21.15.100:0/3062345614 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b100019f0 con 0x7f1b18151970 2024-09-11T22:22:47.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.889+0000 7f1b1f50a640 1 -- 172.21.15.100:0/3062345614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b18151970 msgr2=0x7f1b180726c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.889+0000 7f1b1f50a640 1 --2- 172.21.15.100:0/3062345614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b18151970 0x7f1b180726c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1b1400dbc0 tx=0x7f1b1402e4b0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.889+0000 7f1b1f50a640 1 -- 172.21.15.100:0/3062345614 shutdown_connections 2024-09-11T22:22:47.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.889+0000 7f1b1f50a640 1 --2- 172.21.15.100:0/3062345614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b180c3c60 0x7f1b181576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.889+0000 7f1b1f50a640 1 --2- 172.21.15.100:0/3062345614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b18151970 0x7f1b180726c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.889+0000 7f1b1f50a640 1 -- 172.21.15.100:0/3062345614 >> 172.21.15.100:0/3062345614 conn(0x7f1b1806ee80 msgr2=0x7f1b18070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:47.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.889+0000 7f1b1f50a640 1 -- 172.21.15.100:0/3062345614 shutdown_connections 2024-09-11T22:22:47.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.889+0000 7f1b1f50a640 1 -- 172.21.15.100:0/3062345614 wait complete. 2024-09-11T22:22:47.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.891+0000 7f1b1f50a640 1 Processor -- start 2024-09-11T22:22:47.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.891+0000 7f1b1f50a640 1 -- start start 2024-09-11T22:22:47.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.891+0000 7f1b1f50a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b180c3c60 0x7f1b180cd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.891+0000 7f1b1f50a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b18151970 0x7f1b181ef900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.891+0000 7f1b1f50a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b18157c00 0x7f1b181efe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.891+0000 7f1b1f50a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1b180c9bf0 con 0x7f1b18151970 2024-09-11T22:22:47.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.891+0000 7f1b1f50a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1b180741b0 con 0x7f1b18157c00 2024-09-11T22:22:47.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.891+0000 7f1b1f50a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1b1806d530 con 0x7f1b180c3c60 2024-09-11T22:22:47.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.892+0000 7f1b1caa5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b18151970 0x7f1b181ef900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.892+0000 7f1b1caa5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b18151970 0x7f1b181ef900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37866/0 (socket says 172.21.15.100:37866) 2024-09-11T22:22:47.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.892+0000 7f1b1caa5640 1 -- 172.21.15.100:0/155050243 learned_addr learned my addr 172.21.15.100:0/155050243 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:47.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.892+0000 7f1b1daa7640 1 --2- 172.21.15.100:0/155050243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b18157c00 0x7f1b181efe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.892+0000 7f1b1d2a6640 1 --2- 172.21.15.100:0/155050243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b180c3c60 0x7f1b180cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.892+0000 7f1b1caa5640 1 -- 172.21.15.100:0/155050243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b180c3c60 msgr2=0x7f1b180cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.892+0000 7f1b1caa5640 1 --2- 172.21.15.100:0/155050243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b180c3c60 0x7f1b180cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.892+0000 7f1b1caa5640 1 -- 172.21.15.100:0/155050243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b18157c00 msgr2=0x7f1b181efe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.892+0000 7f1b1caa5640 1 --2- 172.21.15.100:0/155050243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b18157c00 0x7f1b181efe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.892+0000 7f1b1caa5640 1 -- 172.21.15.100:0/155050243 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b181ec110 con 0x7f1b18151970 2024-09-11T22:22:47.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.892+0000 7f1b1caa5640 1 --2- 172.21.15.100:0/155050243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b18151970 0x7f1b181ef900 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1b0800fde0 tx=0x7f1b0800d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:47.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.892+0000 7f1b0dffb640 1 -- 172.21.15.100:0/155050243 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0801d070 con 0x7f1b18151970 2024-09-11T22:22:47.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.892+0000 7f1b0dffb640 1 -- 172.21.15.100:0/155050243 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b08018640 con 0x7f1b18151970 2024-09-11T22:22:47.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.892+0000 7f1b1f50a640 1 -- 172.21.15.100:0/155050243 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b181ec3f0 con 0x7f1b18151970 2024-09-11T22:22:47.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.892+0000 7f1b0dffb640 1 -- 172.21.15.100:0/155050243 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b08018a10 con 0x7f1b18151970 2024-09-11T22:22:47.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.893+0000 7f1b1f50a640 1 -- 172.21.15.100:0/155050243 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b181ec9b0 con 0x7f1b18151970 2024-09-11T22:22:47.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.893+0000 7f1b1f50a640 1 --2- 172.21.15.100:0/155050243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b18154c80 0x7f1b18142850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.893+0000 7f1b1f50a640 1 -- 172.21.15.100:0/155050243 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1b1814dc00 con 0x7f1b18154c80 2024-09-11T22:22:47.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.894+0000 7f1b1d2a6640 1 --2- 172.21.15.100:0/155050243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b18154c80 0x7f1b18142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.894+0000 7f1b1d2a6640 1 -- 172.21.15.100:0/155050243 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1b18151d50 con 0x7f1b18154c80 2024-09-11T22:22:47.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.894+0000 7f1b0dffb640 1 -- 172.21.15.100:0/155050243 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1b08020070 con 0x7f1b18151970 2024-09-11T22:22:47.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.894+0000 7f1b1d2a6640 1 --2- 172.21.15.100:0/155050243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b18154c80 0x7f1b18142850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1b180caa80 tx=0x7f1b140046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:47.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.894+0000 7f1b0dffb640 1 --2- 172.21.15.100:0/155050243 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1afc06be30 0x7f1afc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.895+0000 7f1b0dffb640 1 -- 172.21.15.100:0/155050243 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f1b0808b8b0 con 0x7f1b18151970 2024-09-11T22:22:47.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.895+0000 7f1b1daa7640 1 --2- 172.21.15.100:0/155050243 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1afc06be30 0x7f1afc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.895+0000 7f1b0dffb640 1 -- 172.21.15.100:0/155050243 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b14046070 con 0x7f1b18154c80 2024-09-11T22:22:47.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.895+0000 7f1b0dffb640 1 -- 172.21.15.100:0/155050243 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1b1403b040 con 0x7f1b18154c80 2024-09-11T22:22:47.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.895+0000 7f1b0dffb640 1 -- 172.21.15.100:0/155050243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b18154c80 msgr2=0x7f1b18142850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.895+0000 7f1b0dffb640 1 --2- 172.21.15.100:0/155050243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b18154c80 0x7f1b18142850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1b180caa80 tx=0x7f1b140046c0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.895+0000 7f1b0dffb640 1 -- 172.21.15.100:0/155050243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b18154c80 msgr2=0x7f1b18142850 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:22:47.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.895+0000 7f1b0dffb640 1 --2- 172.21.15.100:0/155050243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b18154c80 0x7f1b18142850 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:47.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.895+0000 7f1b1daa7640 1 --2- 172.21.15.100:0/155050243 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1afc06be30 0x7f1afc06e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1b10002230 tx=0x7f1b10009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:47.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.901+0000 7f1b1f50a640 1 --2- 172.21.15.100:0/155050243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b18142d90 0x7f1b181f8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:47.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.901+0000 7f1b1f50a640 1 -- 172.21.15.100:0/155050243 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1b181ef750 con 0x7f1b18142d90 2024-09-11T22:22:47.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.902+0000 7f1b1d2a6640 1 --2- 172.21.15.100:0/155050243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b18142d90 0x7f1b181f8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:47.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.902+0000 7f1b1d2a6640 1 -- 172.21.15.100:0/155050243 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1b18072d10 con 0x7f1b18142d90 2024-09-11T22:22:47.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.902+0000 7f1b1d2a6640 1 --2- 172.21.15.100:0/155050243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b18142d90 0x7f1b181f8810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1b18145890 tx=0x7f1b14033000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:47.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.902+0000 7f1b0dffb640 1 -- 172.21.15.100:0/155050243 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1403a040 con 0x7f1b18142d90 2024-09-11T22:22:47.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.903+0000 7f1b0dffb640 1 -- 172.21.15.100:0/155050243 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5053 (secure 0 0 0) 0x7f1b1404ce50 con 0x7f1b18142d90 2024-09-11T22:22:47.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.903+0000 7f1b0dffb640 1 -- 172.21.15.100:0/155050243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b18142d90 msgr2=0x7f1b181f8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.903+0000 7f1b0dffb640 1 --2- 172.21.15.100:0/155050243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b18142d90 0x7f1b181f8810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1b18145890 tx=0x7f1b14033000 comp rx=0 tx=0).stop 2024-09-11T22:22:47.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.903+0000 7f1b0dffb640 1 -- 172.21.15.100:0/155050243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b18142d90 msgr2=0x7f1b181f8810 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:22:47.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.903+0000 7f1b0dffb640 1 --2- 172.21.15.100:0/155050243 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b18142d90 0x7f1b181f8810 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1b18145890 tx=0x7f1b14033000 comp rx=0 tx=0).stop 2024-09-11T22:22:47.904 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:22:47.904 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:22:47.904 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:22:47.904 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:22:47.904 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 18, 2024-09-11T22:22:47.904 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 58623, 2024-09-11T22:22:47.905 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:22:47.905 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:22:47.905 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:22:47.905 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:22:47.905 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:47.905 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:22:47.905 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:22:47.905 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:22:47.905 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:22:47.905 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:47.905 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:47.905 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:47.905 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:47.905 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:47.906 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:47.906 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:47.906 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:47.906 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:47.906 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:47.906 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:47.906 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:47.906 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:22:47.906 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:22:47.906 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:47.906 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:47.906 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:47.906 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:47.907 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:47.907 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:47.907 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:47.907 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:47.907 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:47.907 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:47.907 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:47.907 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:47.907 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.907 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:22:47.907 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:22:47.907 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:22:47.907 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:22:47.907 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:22:47.908 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:22:47.908 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:22:47.908 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:22:47.908 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:22:47.908 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:22:47.908 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:22:47.908 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:22:47.908 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:22:47.908 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:22:47.908 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:22:47.908 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:22:47.908 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:22:47.908 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:47.908 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:47.909 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:47.909 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:47.909 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:47.909 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:47.909 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:47.909 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:47.909 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:47.909 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:47.909 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:47.909 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:47.909 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:22:47.909 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.909 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:22:47.910 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.910 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:22:47.910 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:22:47.910 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:47.910 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:47.910 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.910 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:47.910 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:22:47.910 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:47.910 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.910 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.910 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:47.910 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:22:47.910 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:47.911 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.911 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:47.911 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.911 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:22:47.911 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:22:47.911 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:47.911 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:47.911 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:47.911 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.911 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.911 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:22:47.911 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:22:47.911 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:47.911 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:47.912 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.912 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:47.912 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:22:47.912 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:47.912 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.912 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.912 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:47.912 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:22:47.912 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:47.912 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.912 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:47.912 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.912 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:22:47.912 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:22:47.913 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:47.913 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:47.913 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:47.913 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.913 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.913 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:22:47.913 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:22:47.913 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:47.913 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:47.913 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.913 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:47.913 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:22:47.913 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:47.914 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.914 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.914 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:47.914 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:22:47.914 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:47.914 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.914 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:47.914 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.914 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:22:47.914 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:22:47.914 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:47.914 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:47.914 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:47.914 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.915 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:47.915 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.915 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:22:47.915 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:22:47.915 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.915 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:47.915 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:47.915 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:22:47.915 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.915 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:47.915 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:22:47.915 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.915 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:47.915 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:47.916 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:22:47.916 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.916 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:47.916 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:22:47.916 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.916 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:47.916 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:47.916 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:22:47.916 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.916 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:47.916 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:22:47.916 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.916 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:47.916 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:47.916 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:22:47.917 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.917 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:47.917 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:22:47.917 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:47.917 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:47.917 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:47.917 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:22:47.917 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:47.917 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:47.917 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:47.917 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:22:47.917 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:22:47.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.903+0000 7f1b1f50a640 1 -- 172.21.15.100:0/155050243 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1afc06be30 msgr2=0x7f1afc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.903+0000 7f1b1f50a640 1 --2- 172.21.15.100:0/155050243 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1afc06be30 0x7f1afc06e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1b10002230 tx=0x7f1b10009040 comp rx=0 tx=0).stop 2024-09-11T22:22:47.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.903+0000 7f1b1f50a640 1 -- 172.21.15.100:0/155050243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b18151970 msgr2=0x7f1b181ef900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:47.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.903+0000 7f1b1f50a640 1 --2- 172.21.15.100:0/155050243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b18151970 0x7f1b181ef900 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1b0800fde0 tx=0x7f1b0800d720 comp rx=0 tx=0).stop 2024-09-11T22:22:47.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.903+0000 7f1b1daa7640 1 -- 172.21.15.100:0/155050243 reap_dead start 2024-09-11T22:22:47.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.903+0000 7f1b1daa7640 1 -- 172.21.15.100:0/155050243 reap_dead start 2024-09-11T22:22:47.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.903+0000 7f1b1f50a640 1 -- 172.21.15.100:0/155050243 shutdown_connections 2024-09-11T22:22:47.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.903+0000 7f1b1f50a640 1 -- 172.21.15.100:0/155050243 >> 172.21.15.100:0/155050243 conn(0x7f1b1806ee80 msgr2=0x7f1b18067950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:47.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.903+0000 7f1b1f50a640 1 -- 172.21.15.100:0/155050243 shutdown_connections 2024-09-11T22:22:47.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:47.903+0000 7f1b1f50a640 1 -- 172.21.15.100:0/155050243 wait complete. 2024-09-11T22:22:47.920 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:22:47.920 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-11T22:22:47.920 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-11T22:22:48.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.024+0000 7f83e7b03640 1 Processor -- start 2024-09-11T22:22:48.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.024+0000 7f83e7b03640 1 -- start start 2024-09-11T22:22:48.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.025+0000 7f83e7b03640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f83e0073a30 0x7f83e006c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:48.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.025+0000 7f83e7b03640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f83e00afc80 0x7f83e006c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:48.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.025+0000 7f83e7b03640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83e0151e90 con 0x7f83e0151ab0 2024-09-11T22:22:48.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.025+0000 7f83e7b03640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f83e0072f00 con 0x7f83e0073a30 2024-09-11T22:22:48.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.025+0000 7f83e7b03640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f83e006bc10 con 0x7f83e00afc80 2024-09-11T22:22:48.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.025+0000 7f83e509e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f83e0073a30 0x7f83e006c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:48.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.025+0000 7f83e509e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f83e0073a30 0x7f83e006c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37880/0 (socket says 172.21.15.100:37880) 2024-09-11T22:22:48.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.025+0000 7f83e509e640 1 -- 172.21.15.100:0/526586388 learned_addr learned my addr 172.21.15.100:0/526586388 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:48.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.025+0000 7f83e60a0640 1 --2- 172.21.15.100:0/526586388 >> v2:172.21.15.167:3300/0 conn(0x7f83e00afc80 0x7f83e006c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:48.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.026+0000 7f83e509e640 1 -- 172.21.15.100:0/526586388 >> v2:172.21.15.167:3300/0 conn(0x7f83e00afc80 msgr2=0x7f83e006c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:48.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.026+0000 7f83e509e640 1 --2- 172.21.15.100:0/526586388 >> v2:172.21.15.167:3300/0 conn(0x7f83e00afc80 0x7f83e006c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:48.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.026+0000 7f83e509e640 1 -- 172.21.15.100:0/526586388 >> v1:172.21.15.167:6789/0 conn(0x7f83e0151ab0 legacy=0x7f83e00c39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:48.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.026+0000 7f83e509e640 1 -- 172.21.15.100:0/526586388 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e01584c0 con 0x7f83e0073a30 2024-09-11T22:22:48.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.026+0000 7f83e509e640 1 --2- 172.21.15.100:0/526586388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83e0073a30 0x7f83e006c380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f83e00727d0 tx=0x7f83d002c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac9182e258439da server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:48.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.027+0000 7f83e489d640 1 -- 172.21.15.100:0/526586388 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d0033640 con 0x7f83e0073a30 2024-09-11T22:22:48.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.027+0000 7f83e489d640 1 -- 172.21.15.100:0/526586388 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83d0038070 con 0x7f83e0073a30 2024-09-11T22:22:48.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.027+0000 7f83e489d640 1 -- 172.21.15.100:0/526586388 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d0033a00 con 0x7f83e0073a30 2024-09-11T22:22:48.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.027+0000 7f83e7b03640 1 -- 172.21.15.100:0/526586388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83e0073a30 msgr2=0x7f83e006c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:48.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.027+0000 7f83e7b03640 1 --2- 172.21.15.100:0/526586388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83e0073a30 0x7f83e006c380 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f83e00727d0 tx=0x7f83d002c8b0 comp rx=0 tx=0).stop 2024-09-11T22:22:48.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.027+0000 7f83e7b03640 1 -- 172.21.15.100:0/526586388 shutdown_connections 2024-09-11T22:22:48.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.027+0000 7f83e7b03640 1 --2- 172.21.15.100:0/526586388 >> v2:172.21.15.167:3300/0 conn(0x7f83e00afc80 0x7f83e006c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:48.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.027+0000 7f83e7b03640 1 --2- 172.21.15.100:0/526586388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83e0073a30 0x7f83e006c380 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:48.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.027+0000 7f83e7b03640 1 -- 172.21.15.100:0/526586388 >> 172.21.15.100:0/526586388 conn(0x7f83e00cd200 msgr2=0x7f83e00cd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:48.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.028+0000 7f83e7b03640 1 -- 172.21.15.100:0/526586388 shutdown_connections 2024-09-11T22:22:48.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.028+0000 7f83e7b03640 1 -- 172.21.15.100:0/526586388 wait complete. 2024-09-11T22:22:48.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.029+0000 7f83e7b03640 1 Processor -- start 2024-09-11T22:22:48.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.029+0000 7f83e7b03640 1 -- start start 2024-09-11T22:22:48.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.029+0000 7f83e7b03640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83e0073a30 0x7f83e00c3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:48.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.029+0000 7f83e7b03640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83e00afc80 0x7f83e01f0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:48.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.029+0000 7f83e7b03640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83e0151ab0 0x7f83e0067bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:48.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.029+0000 7f83e7b03640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f83e0073430 con 0x7f83e00afc80 2024-09-11T22:22:48.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.029+0000 7f83e7b03640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f83e006bef0 con 0x7f83e0073a30 2024-09-11T22:22:48.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.029+0000 7f83e7b03640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f83e0158180 con 0x7f83e0151ab0 2024-09-11T22:22:48.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.030+0000 7f83e509e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83e00afc80 0x7f83e01f0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:48.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.030+0000 7f83e509e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83e00afc80 0x7f83e01f0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37886/0 (socket says 172.21.15.100:37886) 2024-09-11T22:22:48.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.030+0000 7f83e509e640 1 -- 172.21.15.100:0/3414997582 learned_addr learned my addr 172.21.15.100:0/3414997582 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:48.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.030+0000 7f83e589f640 1 --2- 172.21.15.100:0/3414997582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83e0073a30 0x7f83e00c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:48.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.030+0000 7f83e60a0640 1 --2- 172.21.15.100:0/3414997582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83e0151ab0 0x7f83e0067bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:48.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.030+0000 7f83e509e640 1 -- 172.21.15.100:0/3414997582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83e0151ab0 msgr2=0x7f83e0067bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:48.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.030+0000 7f83e509e640 1 --2- 172.21.15.100:0/3414997582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83e0151ab0 0x7f83e0067bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:48.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.030+0000 7f83e509e640 1 -- 172.21.15.100:0/3414997582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83e0073a30 msgr2=0x7f83e00c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:48.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.030+0000 7f83e509e640 1 --2- 172.21.15.100:0/3414997582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83e0073a30 0x7f83e00c3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:48.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.030+0000 7f83e509e640 1 -- 172.21.15.100:0/3414997582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e00af670 con 0x7f83e00afc80 2024-09-11T22:22:48.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.030+0000 7f83e509e640 1 --2- 172.21.15.100:0/3414997582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83e00afc80 0x7f83e01f0e80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f83d000b2c0 tx=0x7f83d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:48.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.030+0000 7f83d67fc640 1 -- 172.21.15.100:0/3414997582 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d0043070 con 0x7f83e00afc80 2024-09-11T22:22:48.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.030+0000 7f83d67fc640 1 -- 172.21.15.100:0/3414997582 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83d003c850 con 0x7f83e00afc80 2024-09-11T22:22:48.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.030+0000 7f83e7b03640 1 -- 172.21.15.100:0/3414997582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83e00af0f0 con 0x7f83e00afc80 2024-09-11T22:22:48.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.030+0000 7f83d67fc640 1 -- 172.21.15.100:0/3414997582 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d003cc40 con 0x7f83e00afc80 2024-09-11T22:22:48.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.030+0000 7f83e7b03640 1 -- 172.21.15.100:0/3414997582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83e01f3aa0 con 0x7f83e00afc80 2024-09-11T22:22:48.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.032+0000 7f83e7b03640 1 -- 172.21.15.100:0/3414997582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83e00c2220 con 0x7f83e00afc80 2024-09-11T22:22:48.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.032+0000 7f83d67fc640 1 -- 172.21.15.100:0/3414997582 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f83d0046070 con 0x7f83e00afc80 2024-09-11T22:22:48.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.032+0000 7f83d67fc640 1 --2- 172.21.15.100:0/3414997582 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f83c406be30 0x7f83c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:48.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.033+0000 7f83d67fc640 1 -- 172.21.15.100:0/3414997582 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f83d00abba0 con 0x7f83e00afc80 2024-09-11T22:22:48.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.033+0000 7f83e589f640 1 --2- 172.21.15.100:0/3414997582 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f83c406be30 0x7f83c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:48.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.033+0000 7f83e589f640 1 --2- 172.21.15.100:0/3414997582 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f83c406be30 0x7f83c406e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f83dc001780 tx=0x7f83dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:48.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.037+0000 7f83d67fc640 1 -- 172.21.15.100:0/3414997582 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f83e00af670 con 0x7f83e00afc80 2024-09-11T22:22:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.313+0000 7f83e7b03640 1 -- 172.21.15.100:0/3414997582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f83e00af850 con 0x7f83e00afc80 2024-09-11T22:22:48.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.314+0000 7f83d67fc640 1 -- 172.21.15.100:0/3414997582 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f83d0079a60 con 0x7f83e00afc80 2024-09-11T22:22:48.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.316+0000 7f83e7b03640 1 -- 172.21.15.100:0/3414997582 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f83c406be30 msgr2=0x7f83c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:48.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.316+0000 7f83e7b03640 1 --2- 172.21.15.100:0/3414997582 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f83c406be30 0x7f83c406e2f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f83dc001780 tx=0x7f83dc009040 comp rx=0 tx=0).stop 2024-09-11T22:22:48.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.316+0000 7f83e7b03640 1 -- 172.21.15.100:0/3414997582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83e00afc80 msgr2=0x7f83e01f0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:48.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.316+0000 7f83e7b03640 1 --2- 172.21.15.100:0/3414997582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83e00afc80 0x7f83e01f0e80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f83d000b2c0 tx=0x7f83d0004730 comp rx=0 tx=0).stop 2024-09-11T22:22:48.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.316+0000 7f83e7b03640 1 -- 172.21.15.100:0/3414997582 shutdown_connections 2024-09-11T22:22:48.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.316+0000 7f83e7b03640 1 --2- 172.21.15.100:0/3414997582 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f83c406be30 0x7f83c406e2f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:48.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.316+0000 7f83e7b03640 1 --2- 172.21.15.100:0/3414997582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83e0151ab0 0x7f83e0067bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:48.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.316+0000 7f83e7b03640 1 --2- 172.21.15.100:0/3414997582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83e00afc80 0x7f83e01f0e80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:48.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.316+0000 7f83e7b03640 1 --2- 172.21.15.100:0/3414997582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83e0073a30 0x7f83e00c3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:48.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.316+0000 7f83e7b03640 1 -- 172.21.15.100:0/3414997582 >> 172.21.15.100:0/3414997582 conn(0x7f83e00cd200 msgr2=0x7f83e014f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:48.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.316+0000 7f83e7b03640 1 -- 172.21.15.100:0/3414997582 shutdown_connections 2024-09-11T22:22:48.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:48.317+0000 7f83e7b03640 1 -- 172.21.15.100:0/3414997582 wait complete. 2024-09-11T22:22:48.330 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-11T22:22:49.162 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:22:49.165 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:22:58.331 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:22:58.332 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:22:58.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.438+0000 7fae0f3fd640 1 Processor -- start 2024-09-11T22:22:58.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.438+0000 7fae0f3fd640 1 -- start start 2024-09-11T22:22:58.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.439+0000 7fae0f3fd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fae08073490 0x7fae08073870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:58.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.439+0000 7fae0f3fd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae08072060 0x7fae0815ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:58.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.439+0000 7fae0f3fd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae08151b20 con 0x7fae08073db0 2024-09-11T22:22:58.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.439+0000 7fae0f3fd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fae080c3d40 con 0x7fae08073490 2024-09-11T22:22:58.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.439+0000 7fae0f3fd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fae080c5fe0 con 0x7fae08072060 2024-09-11T22:22:58.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.440+0000 7fae0c998640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae08072060 0x7fae0815ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:58.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.440+0000 7fae0d199640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fae08073490 0x7fae08073870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:58.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.440+0000 7fae0c998640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae08072060 0x7fae0815ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:43572/0 (socket says 172.21.15.100:43572) 2024-09-11T22:22:58.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.440+0000 7fae0c998640 1 -- 172.21.15.100:0/3295855262 learned_addr learned my addr 172.21.15.100:0/3295855262 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:58.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.440+0000 7fae0d199640 1 -- 172.21.15.100:0/3295855262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae08072060 msgr2=0x7fae0815ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:58.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.440+0000 7fae0d199640 1 --2- 172.21.15.100:0/3295855262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae08072060 0x7fae0815ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:58.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.440+0000 7fae0d199640 1 -- 172.21.15.100:0/3295855262 >> v1:172.21.15.167:6789/0 conn(0x7fae08073db0 legacy=0x7fae08157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:58.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.440+0000 7fae0d199640 1 -- 172.21.15.100:0/3295855262 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae080c6470 con 0x7fae08073490 2024-09-11T22:22:58.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.440+0000 7fae0c998640 1 --2- 172.21.15.100:0/3295855262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae08072060 0x7fae0815ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:58.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.441+0000 7fae0d199640 1 --2- 172.21.15.100:0/3295855262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae08073490 0x7fae08073870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fae040097a0 tx=0x7fae0402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=854db68b4ce23975 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:58.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.441+0000 7fadfffff640 1 -- 172.21.15.100:0/3295855262 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae04037070 con 0x7fae08073490 2024-09-11T22:22:58.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.441+0000 7fadfffff640 1 -- 172.21.15.100:0/3295855262 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae04032440 con 0x7fae08073490 2024-09-11T22:22:58.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.441+0000 7fadfffff640 1 -- 172.21.15.100:0/3295855262 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae04032810 con 0x7fae08073490 2024-09-11T22:22:58.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.441+0000 7fae0f3fd640 1 -- 172.21.15.100:0/3295855262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae08073490 msgr2=0x7fae08073870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:58.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.441+0000 7fae0f3fd640 1 --2- 172.21.15.100:0/3295855262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae08073490 0x7fae08073870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fae040097a0 tx=0x7fae0402a180 comp rx=0 tx=0).stop 2024-09-11T22:22:58.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.441+0000 7fae0f3fd640 1 -- 172.21.15.100:0/3295855262 shutdown_connections 2024-09-11T22:22:58.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.441+0000 7fae0f3fd640 1 --2- 172.21.15.100:0/3295855262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae08072060 0x7fae0815ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:58.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.441+0000 7fae0f3fd640 1 --2- 172.21.15.100:0/3295855262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae08073490 0x7fae08073870 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:58.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.441+0000 7fae0f3fd640 1 -- 172.21.15.100:0/3295855262 >> 172.21.15.100:0/3295855262 conn(0x7fae080cc840 msgr2=0x7fae080ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:58.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.441+0000 7fae0f3fd640 1 -- 172.21.15.100:0/3295855262 shutdown_connections 2024-09-11T22:22:58.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.441+0000 7fae0f3fd640 1 -- 172.21.15.100:0/3295855262 wait complete. 2024-09-11T22:22:58.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.443+0000 7fae0f3fd640 1 Processor -- start 2024-09-11T22:22:58.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.443+0000 7fae0f3fd640 1 -- start start 2024-09-11T22:22:58.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.444+0000 7fae0f3fd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae08073490 0x7fae080c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:58.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.444+0000 7fae0f3fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae08073db0 0x7fae08144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:58.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.444+0000 7fae0f3fd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae08144e80 0x7fae081f1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:58.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.444+0000 7fae0f3fd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fae080c5c70 con 0x7fae08144e80 2024-09-11T22:22:58.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.444+0000 7fae0f3fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fae080c5990 con 0x7fae08073db0 2024-09-11T22:22:58.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.444+0000 7fae0f3fd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fae0806efd0 con 0x7fae08073490 2024-09-11T22:22:58.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.444+0000 7fae0d99a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae08144e80 0x7fae081f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:58.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.444+0000 7fae0d99a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae08144e80 0x7fae081f1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38780/0 (socket says 172.21.15.100:38780) 2024-09-11T22:22:58.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.444+0000 7fae0d99a640 1 -- 172.21.15.100:0/3522936209 learned_addr learned my addr 172.21.15.100:0/3522936209 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:58.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.444+0000 7fae0c998640 1 --2- 172.21.15.100:0/3522936209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae08073db0 0x7fae08144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:58.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.444+0000 7fae0d199640 1 --2- 172.21.15.100:0/3522936209 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae08073490 0x7fae080c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:58.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.444+0000 7fae0c998640 1 -- 172.21.15.100:0/3522936209 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae08073490 msgr2=0x7fae080c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:58.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.444+0000 7fae0c998640 1 --2- 172.21.15.100:0/3522936209 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae08073490 0x7fae080c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:58.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.444+0000 7fae0c998640 1 -- 172.21.15.100:0/3522936209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae08144e80 msgr2=0x7fae081f1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:58.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.444+0000 7fae0c998640 1 --2- 172.21.15.100:0/3522936209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae08144e80 0x7fae081f1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:58.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.444+0000 7fae0c998640 1 -- 172.21.15.100:0/3522936209 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae080c7060 con 0x7fae08073db0 2024-09-11T22:22:58.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.444+0000 7fae0d199640 1 --2- 172.21.15.100:0/3522936209 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae08073490 0x7fae080c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:58.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.444+0000 7fae0d99a640 1 --2- 172.21.15.100:0/3522936209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae08144e80 0x7fae081f1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:58.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.444+0000 7fae0c998640 1 --2- 172.21.15.100:0/3522936209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae08073db0 0x7fae08144940 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fae080c3c10 tx=0x7fadf800d720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:58.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.445+0000 7fadfdffb640 1 -- 172.21.15.100:0/3522936209 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf8004030 con 0x7fae08073db0 2024-09-11T22:22:58.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.445+0000 7fadfdffb640 1 -- 172.21.15.100:0/3522936209 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf80041d0 con 0x7fae08073db0 2024-09-11T22:22:58.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.445+0000 7fae0f3fd640 1 -- 172.21.15.100:0/3522936209 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae080c7340 con 0x7fae08073db0 2024-09-11T22:22:58.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.445+0000 7fadfdffb640 1 -- 172.21.15.100:0/3522936209 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf8003610 con 0x7fae08073db0 2024-09-11T22:22:58.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.445+0000 7fae0f3fd640 1 -- 172.21.15.100:0/3522936209 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae080c7900 con 0x7fae08073db0 2024-09-11T22:22:58.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.446+0000 7fae0f3fd640 1 -- 172.21.15.100:0/3522936209 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae080c4d80 con 0x7fae08073db0 2024-09-11T22:22:58.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.446+0000 7fadfdffb640 1 -- 172.21.15.100:0/3522936209 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fadf80037b0 con 0x7fae08073db0 2024-09-11T22:22:58.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.447+0000 7fadfdffb640 1 --2- 172.21.15.100:0/3522936209 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fadec06be60 0x7fadec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:58.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.447+0000 7fadfdffb640 1 -- 172.21.15.100:0/3522936209 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fadf808b790 con 0x7fae08073db0 2024-09-11T22:22:58.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.447+0000 7fae0d199640 1 --2- 172.21.15.100:0/3522936209 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fadec06be60 0x7fadec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:58.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.447+0000 7fae0d199640 1 --2- 172.21.15.100:0/3522936209 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fadec06be60 0x7fadec06e320 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fae04034000 tx=0x7fae0402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:58.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.451+0000 7fadfdffb640 1 -- 172.21.15.100:0/3522936209 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae080c4d80 con 0x7fae08073db0 2024-09-11T22:22:58.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.720+0000 7fae0f3fd640 1 -- 172.21.15.100:0/3522936209 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fae08147070 con 0x7fae08073db0 2024-09-11T22:22:58.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.720+0000 7fadfdffb640 1 -- 172.21.15.100:0/3522936209 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fae08147070 con 0x7fae08073db0 2024-09-11T22:22:58.721 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":18,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:22:58.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.722+0000 7fae0f3fd640 1 -- 172.21.15.100:0/3522936209 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fadec06be60 msgr2=0x7fadec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:58.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.722+0000 7fae0f3fd640 1 --2- 172.21.15.100:0/3522936209 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fadec06be60 0x7fadec06e320 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fae04034000 tx=0x7fae0402e000 comp rx=0 tx=0).stop 2024-09-11T22:22:58.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.722+0000 7fae0f3fd640 1 -- 172.21.15.100:0/3522936209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae08073db0 msgr2=0x7fae08144940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:58.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.722+0000 7fae0f3fd640 1 --2- 172.21.15.100:0/3522936209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae08073db0 0x7fae08144940 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fae080c3c10 tx=0x7fadf800d720 comp rx=0 tx=0).stop 2024-09-11T22:22:58.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.722+0000 7fae0f3fd640 1 -- 172.21.15.100:0/3522936209 shutdown_connections 2024-09-11T22:22:58.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.722+0000 7fae0f3fd640 1 --2- 172.21.15.100:0/3522936209 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fadec06be60 0x7fadec06e320 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:58.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.722+0000 7fae0f3fd640 1 --2- 172.21.15.100:0/3522936209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae08144e80 0x7fae081f1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:58.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.722+0000 7fae0f3fd640 1 --2- 172.21.15.100:0/3522936209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae08073db0 0x7fae08144940 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:58.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.722+0000 7fae0f3fd640 1 --2- 172.21.15.100:0/3522936209 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fae08073490 0x7fae080c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:58.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.722+0000 7fae0f3fd640 1 -- 172.21.15.100:0/3522936209 >> 172.21.15.100:0/3522936209 conn(0x7fae080cc840 msgr2=0x7fae0814c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:58.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.723+0000 7fae0f3fd640 1 -- 172.21.15.100:0/3522936209 shutdown_connections 2024-09-11T22:22:58.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.723+0000 7fae0f3fd640 1 -- 172.21.15.100:0/3522936209 wait complete. 2024-09-11T22:22:58.734 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:22:58.734 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-11T22:22:58.734 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:22:58.735 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:22:58.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.861+0000 7fc783480640 1 Processor -- start 2024-09-11T22:22:58.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.862+0000 7fc783480640 1 -- start start 2024-09-11T22:22:58.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.862+0000 7fc783480640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc77c15b2e0 0x7fc77c1661f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:58.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.863+0000 7fc783480640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc77c0c6510 con 0x7fc77c06ce60 2024-09-11T22:22:58.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.863+0000 7fc783480640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc77c0c5470 con 0x7fc77c06d240 2024-09-11T22:22:58.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.863+0000 7fc783480640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fc77c15b820 con 0x7fc77c15b2e0 2024-09-11T22:22:58.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.863+0000 7fc78121c640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc77c06ce60 0x7fc77c15bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49070/0 (socket says 172.21.15.100:49070) 2024-09-11T22:22:58.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.863+0000 7fc78121c640 1 -- 172.21.15.100:0/2824847843 learned_addr learned my addr 172.21.15.100:0/2824847843 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:22:58.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.863+0000 7fc781a1d640 1 --2- 172.21.15.100:0/2824847843 >> v2:172.21.15.167:3300/0 conn(0x7fc77c15b2e0 0x7fc77c1661f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:58.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.863+0000 7fc773fff640 1 -- 172.21.15.100:0/2824847843 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1951860795 0 0) 0x7fc77c0c6510 con 0x7fc77c06ce60 2024-09-11T22:22:58.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.863+0000 7fc773fff640 1 -- 172.21.15.100:0/2824847843 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc768003520 con 0x7fc77c06ce60 2024-09-11T22:22:58.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.863+0000 7fc781a1d640 1 -- 172.21.15.100:0/2824847843 >> v1:172.21.15.167:6789/0 conn(0x7fc77c06d240 legacy=0x7fc77c1546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:58.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.863+0000 7fc773fff640 1 -- 172.21.15.100:0/2824847843 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2571838045 0 0) 0x7fc77c0c5470 con 0x7fc77c06d240 2024-09-11T22:22:58.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.863+0000 7fc781a1d640 1 -- 172.21.15.100:0/2824847843 >> v1:172.21.15.100:6789/0 conn(0x7fc77c06ce60 legacy=0x7fc77c15bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:58.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.863+0000 7fc781a1d640 1 -- 172.21.15.100:0/2824847843 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77c0c5750 con 0x7fc77c15b2e0 2024-09-11T22:22:58.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.864+0000 7fc781a1d640 1 --2- 172.21.15.100:0/2824847843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc77c15b2e0 0x7fc77c1661f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc77c15b9a0 tx=0x7fc77402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=570000e0a674c3e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:58.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.864+0000 7fc773fff640 1 -- 172.21.15.100:0/2824847843 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc774007740 con 0x7fc77c15b2e0 2024-09-11T22:22:58.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.864+0000 7fc773fff640 1 -- 172.21.15.100:0/2824847843 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7740078e0 con 0x7fc77c15b2e0 2024-09-11T22:22:58.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.864+0000 7fc773fff640 1 -- 172.21.15.100:0/2824847843 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc774007c90 con 0x7fc77c15b2e0 2024-09-11T22:22:58.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.865+0000 7fc783480640 1 -- 172.21.15.100:0/2824847843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc77c15b2e0 msgr2=0x7fc77c1661f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:58.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.865+0000 7fc783480640 1 --2- 172.21.15.100:0/2824847843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc77c15b2e0 0x7fc77c1661f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc77c15b9a0 tx=0x7fc77402a6f0 comp rx=0 tx=0).stop 2024-09-11T22:22:58.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.865+0000 7fc783480640 1 -- 172.21.15.100:0/2824847843 shutdown_connections 2024-09-11T22:22:58.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.865+0000 7fc783480640 1 --2- 172.21.15.100:0/2824847843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc77c15b2e0 0x7fc77c1661f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:58.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.865+0000 7fc783480640 1 -- 172.21.15.100:0/2824847843 >> 172.21.15.100:0/2824847843 conn(0x7fc77c06bc10 msgr2=0x7fc77c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:58.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.865+0000 7fc783480640 1 -- 172.21.15.100:0/2824847843 shutdown_connections 2024-09-11T22:22:58.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.865+0000 7fc783480640 1 -- 172.21.15.100:0/2824847843 wait complete. 2024-09-11T22:22:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.866+0000 7fc783480640 1 Processor -- start 2024-09-11T22:22:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.866+0000 7fc783480640 1 -- start start 2024-09-11T22:22:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.867+0000 7fc783480640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc77c06ce60 0x7fc77c149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.867+0000 7fc783480640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc77c06d240 0x7fc77c0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.867+0000 7fc783480640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c15b2e0 0x7fc77c0cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.867+0000 7fc783480640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc77c15c460 con 0x7fc77c15b2e0 2024-09-11T22:22:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.867+0000 7fc783480640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc77c0c5d10 con 0x7fc77c06d240 2024-09-11T22:22:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.867+0000 7fc783480640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc77c0cb1b0 con 0x7fc77c06ce60 2024-09-11T22:22:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.867+0000 7fc781a1d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c15b2e0 0x7fc77c0cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.867+0000 7fc781a1d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c15b2e0 0x7fc77c0cf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38794/0 (socket says 172.21.15.100:38794) 2024-09-11T22:22:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.867+0000 7fc781a1d640 1 -- 172.21.15.100:0/489368164 learned_addr learned my addr 172.21.15.100:0/489368164 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.867+0000 7fc78121c640 1 --2- 172.21.15.100:0/489368164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc77c06ce60 0x7fc77c149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.867+0000 7fc780a1b640 1 --2- 172.21.15.100:0/489368164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc77c06d240 0x7fc77c0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.867+0000 7fc781a1d640 1 -- 172.21.15.100:0/489368164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc77c06ce60 msgr2=0x7fc77c149570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.867+0000 7fc781a1d640 1 --2- 172.21.15.100:0/489368164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc77c06ce60 0x7fc77c149570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.867+0000 7fc781a1d640 1 -- 172.21.15.100:0/489368164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc77c06d240 msgr2=0x7fc77c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.867+0000 7fc781a1d640 1 --2- 172.21.15.100:0/489368164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc77c06d240 0x7fc77c0ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.867+0000 7fc781a1d640 1 -- 172.21.15.100:0/489368164 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77c158790 con 0x7fc77c15b2e0 2024-09-11T22:22:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.867+0000 7fc781a1d640 1 --2- 172.21.15.100:0/489368164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c15b2e0 0x7fc77c0cf3e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc77402ace0 tx=0x7fc774004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.868+0000 7fc771ffb640 1 -- 172.21.15.100:0/489368164 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77403f070 con 0x7fc77c15b2e0 2024-09-11T22:22:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.868+0000 7fc771ffb640 1 -- 172.21.15.100:0/489368164 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc774031bc0 con 0x7fc77c15b2e0 2024-09-11T22:22:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.868+0000 7fc783480640 1 -- 172.21.15.100:0/489368164 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc77c147b60 con 0x7fc77c15b2e0 2024-09-11T22:22:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.868+0000 7fc771ffb640 1 -- 172.21.15.100:0/489368164 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc774009450 con 0x7fc77c15b2e0 2024-09-11T22:22:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.868+0000 7fc783480640 1 -- 172.21.15.100:0/489368164 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc77c0cca30 con 0x7fc77c15b2e0 2024-09-11T22:22:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.869+0000 7fc783480640 1 --2- 172.21.15.100:0/489368164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c1485d0 0x7fc77c1489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.869+0000 7fc783480640 1 -- 172.21.15.100:0/489368164 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc77c147d30 con 0x7fc77c1485d0 2024-09-11T22:22:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.869+0000 7fc78121c640 1 --2- 172.21.15.100:0/489368164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c1485d0 0x7fc77c1489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.869+0000 7fc78121c640 1 -- 172.21.15.100:0/489368164 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc77c0cad20 con 0x7fc77c1485d0 2024-09-11T22:22:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.869+0000 7fc771ffb640 1 -- 172.21.15.100:0/489368164 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc774044460 con 0x7fc77c15b2e0 2024-09-11T22:22:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.869+0000 7fc78121c640 1 --2- 172.21.15.100:0/489368164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c1485d0 0x7fc77c1489b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc778000f60 tx=0x7fc77800fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.870+0000 7fc771ffb640 1 --2- 172.21.15.100:0/489368164 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc76006be30 0x7fc76006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.870+0000 7fc771ffb640 1 -- 172.21.15.100:0/489368164 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fc7740ac800 con 0x7fc77c15b2e0 2024-09-11T22:22:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.870+0000 7fc780a1b640 1 --2- 172.21.15.100:0/489368164 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc76006be30 0x7fc76006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.870+0000 7fc771ffb640 1 -- 172.21.15.100:0/489368164 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7780058b0 con 0x7fc77c1485d0 2024-09-11T22:22:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.870+0000 7fc771ffb640 1 -- 172.21.15.100:0/489368164 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc778018070 con 0x7fc77c1485d0 2024-09-11T22:22:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.870+0000 7fc771ffb640 1 -- 172.21.15.100:0/489368164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c1485d0 msgr2=0x7fc77c1489b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.870+0000 7fc771ffb640 1 --2- 172.21.15.100:0/489368164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c1485d0 0x7fc77c1489b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc778000f60 tx=0x7fc77800fc00 comp rx=0 tx=0).stop 2024-09-11T22:22:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.870+0000 7fc771ffb640 1 -- 172.21.15.100:0/489368164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c1485d0 msgr2=0x7fc77c1489b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:22:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.870+0000 7fc771ffb640 1 --2- 172.21.15.100:0/489368164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c1485d0 0x7fc77c1489b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.870+0000 7fc780a1b640 1 --2- 172.21.15.100:0/489368164 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc76006be30 0x7fc76006e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0cfda0 tx=0x7fc76c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:58.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.877+0000 7fc783480640 1 --2- 172.21.15.100:0/489368164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c148ef0 0x7fc77c0cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:58.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.877+0000 7fc783480640 1 -- 172.21.15.100:0/489368164 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc77c15d3e0 con 0x7fc77c148ef0 2024-09-11T22:22:58.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.877+0000 7fc78121c640 1 --2- 172.21.15.100:0/489368164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c148ef0 0x7fc77c0cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.878+0000 7fc78121c640 1 -- 172.21.15.100:0/489368164 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc77c15d100 con 0x7fc77c148ef0 2024-09-11T22:22:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.878+0000 7fc78121c640 1 --2- 172.21.15.100:0/489368164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c148ef0 0x7fc77c0cb420 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc778000f60 tx=0x7fc7780010a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.878+0000 7fc771ffb640 1 -- 172.21.15.100:0/489368164 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77801d7c0 con 0x7fc77c148ef0 2024-09-11T22:22:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.878+0000 7fc771ffb640 1 -- 172.21.15.100:0/489368164 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4555 (secure 0 0 0) 0x7fc77801d7c0 con 0x7fc77c148ef0 2024-09-11T22:22:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.878+0000 7fc771ffb640 1 -- 172.21.15.100:0/489368164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c148ef0 msgr2=0x7fc77c0cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.878+0000 7fc771ffb640 1 --2- 172.21.15.100:0/489368164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c148ef0 0x7fc77c0cb420 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc778000f60 tx=0x7fc7780010a0 comp rx=0 tx=0).stop 2024-09-11T22:22:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.878+0000 7fc771ffb640 1 -- 172.21.15.100:0/489368164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c148ef0 msgr2=0x7fc77c0cb420 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:22:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.878+0000 7fc771ffb640 1 --2- 172.21.15.100:0/489368164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c148ef0 0x7fc77c0cb420 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:58.880 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:22:58.880 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:22:58.880 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:22:58.880 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:22:58.880 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 18, 2024-09-11T22:22:58.880 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 17623, 2024-09-11T22:22:58.880 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:22:58.880 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:22:58.880 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:22:58.880 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:22:58.880 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:58.880 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 11, 2024-09-11T22:22:58.880 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:22:58.881 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:22:58.881 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:22:58.881 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:58.881 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:58.881 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:58.881 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:58.881 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:58.881 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:58.881 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:58.882 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:58.882 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:58.882 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:58.882 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:58.882 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:58.882 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:22:58.882 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:22:58.882 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:58.882 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:58.882 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:58.882 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:58.882 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:58.882 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:58.883 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:58.883 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:58.883 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:58.883 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:58.883 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:58.883 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:58.883 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:58.883 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:22:58.883 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:22:58.883 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:22:58.883 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:22:58.883 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:22:58.883 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:22:58.884 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:22:58.884 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:22:58.884 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:22:58.884 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:22:58.884 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:22:58.884 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:22:58.884 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:22:58.884 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:22:58.884 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:22:58.884 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:22:58.884 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:22:58.884 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:58.884 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:58.884 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:58.885 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:58.885 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:58.885 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:58.885 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:58.885 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:58.885 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:58.885 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:58.885 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:58.885 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:58.885 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:22:58.885 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:58.885 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:22:58.885 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:58.886 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:22:58.886 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:22:58.886 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:58.886 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:58.886 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:58.886 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:58.886 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:22:58.886 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:58.886 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:58.886 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:58.886 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:58.886 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:22:58.886 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:58.887 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:58.887 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:58.887 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:58.887 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:22:58.887 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:22:58.887 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:58.887 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:58.887 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:58.887 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:58.887 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:58.887 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:22:58.887 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:22:58.887 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:58.888 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:58.888 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:58.888 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:58.888 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:22:58.888 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:58.888 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:58.888 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:58.888 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:58.888 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:22:58.888 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:58.888 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:58.888 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:58.888 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:58.888 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:22:58.889 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:22:58.889 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:58.889 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:58.889 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:58.889 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:58.889 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:58.889 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:22:58.889 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:22:58.889 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:58.889 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:58.889 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:58.889 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:58.889 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:22:58.890 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:58.890 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:58.890 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:58.890 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:58.890 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:22:58.890 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:58.890 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:58.890 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:58.890 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:58.890 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:22:58.890 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:22:58.890 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:58.890 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:58.890 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:58.891 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:58.891 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:58.891 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:58.891 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:22:58.891 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:22:58.891 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:58.891 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:58.891 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:58.891 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:22:58.891 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:58.891 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:58.891 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:22:58.891 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:58.891 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:58.892 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:58.892 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:22:58.892 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:58.892 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:58.892 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:58.892 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:22:58.892 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:22:58.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.879+0000 7fc783480640 1 -- 172.21.15.100:0/489368164 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc76006be30 msgr2=0x7fc76006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:58.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.879+0000 7fc783480640 1 --2- 172.21.15.100:0/489368164 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc76006be30 0x7fc76006e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0cfda0 tx=0x7fc76c009040 comp rx=0 tx=0).stop 2024-09-11T22:22:58.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.879+0000 7fc783480640 1 -- 172.21.15.100:0/489368164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c15b2e0 msgr2=0x7fc77c0cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:58.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.879+0000 7fc783480640 1 --2- 172.21.15.100:0/489368164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c15b2e0 0x7fc77c0cf3e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc77402ace0 tx=0x7fc774004a40 comp rx=0 tx=0).stop 2024-09-11T22:22:58.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.879+0000 7fc781a1d640 1 -- 172.21.15.100:0/489368164 reap_dead start 2024-09-11T22:22:58.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.879+0000 7fc781a1d640 1 -- 172.21.15.100:0/489368164 reap_dead start 2024-09-11T22:22:58.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.879+0000 7fc783480640 1 -- 172.21.15.100:0/489368164 shutdown_connections 2024-09-11T22:22:58.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.879+0000 7fc783480640 1 -- 172.21.15.100:0/489368164 >> 172.21.15.100:0/489368164 conn(0x7fc77c06bc10 msgr2=0x7fc77c0b4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:58.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.879+0000 7fc783480640 1 -- 172.21.15.100:0/489368164 shutdown_connections 2024-09-11T22:22:58.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:58.879+0000 7fc783480640 1 -- 172.21.15.100:0/489368164 wait complete. 2024-09-11T22:22:58.894 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:22:58.895 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:22:58.895 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:22:59.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.002+0000 7f2b9cf6d640 1 Processor -- start 2024-09-11T22:22:59.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.002+0000 7f2b9cf6d640 1 -- start start 2024-09-11T22:22:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.003+0000 7f2b9cf6d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b9806ce60 0x7f2b9815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.003+0000 7f2b9cf6d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2b9806d240 0x7f2b981651e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.003+0000 7f2b9cf6d640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b980c6510 con 0x7f2b9815c290 2024-09-11T22:22:59.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.003+0000 7f2b9cf6d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f2b9815b820 con 0x7f2b9806d240 2024-09-11T22:22:59.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.003+0000 7f2b9cf6d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2b980c5470 con 0x7f2b9806ce60 2024-09-11T22:22:59.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.003+0000 7f2b8ffff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2b9815c290 0x7f2b981546b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49072/0 (socket says 172.21.15.100:49072) 2024-09-11T22:22:59.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.003+0000 7f2b8ffff640 1 -- 172.21.15.100:0/3199269179 learned_addr learned my addr 172.21.15.100:0/3199269179 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:22:59.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.003+0000 7f2b96d9d640 1 --2- 172.21.15.100:0/3199269179 >> v2:172.21.15.167:3300/0 conn(0x7f2b9806d240 0x7f2b981651e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:59.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.003+0000 7f2b9659c640 1 --2- 172.21.15.100:0/3199269179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b9806ce60 0x7f2b9815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:59.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.003+0000 7f2b95d9b640 1 -- 172.21.15.100:0/3199269179 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3553775290 0 0) 0x7f2b980c6510 con 0x7f2b9815c290 2024-09-11T22:22:59.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.003+0000 7f2b95d9b640 1 -- 172.21.15.100:0/3199269179 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b84003520 con 0x7f2b9815c290 2024-09-11T22:22:59.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.004+0000 7f2b9659c640 1 -- 172.21.15.100:0/3199269179 >> v2:172.21.15.167:3300/0 conn(0x7f2b9806d240 msgr2=0x7f2b981651e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:59.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.004+0000 7f2b9659c640 1 --2- 172.21.15.100:0/3199269179 >> v2:172.21.15.167:3300/0 conn(0x7f2b9806d240 0x7f2b981651e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.004+0000 7f2b9659c640 1 -- 172.21.15.100:0/3199269179 >> v1:172.21.15.100:6789/0 conn(0x7f2b9815c290 legacy=0x7f2b981546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:59.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.004+0000 7f2b9659c640 1 -- 172.21.15.100:0/3199269179 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b980c5750 con 0x7f2b9806ce60 2024-09-11T22:22:59.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.004+0000 7f2b9659c640 1 --2- 172.21.15.100:0/3199269179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b9806ce60 0x7f2b9815bd50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2b880097a0 tx=0x7f2b8802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb12c3f32db61290 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:59.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.005+0000 7f2b95d9b640 1 -- 172.21.15.100:0/3199269179 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b88037070 con 0x7f2b9806ce60 2024-09-11T22:22:59.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.005+0000 7f2b95d9b640 1 -- 172.21.15.100:0/3199269179 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b88032440 con 0x7f2b9806ce60 2024-09-11T22:22:59.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.005+0000 7f2b95d9b640 1 -- 172.21.15.100:0/3199269179 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b88032810 con 0x7f2b9806ce60 2024-09-11T22:22:59.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.005+0000 7f2b9cf6d640 1 -- 172.21.15.100:0/3199269179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b9806ce60 msgr2=0x7f2b9815bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:59.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.005+0000 7f2b9cf6d640 1 --2- 172.21.15.100:0/3199269179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b9806ce60 0x7f2b9815bd50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2b880097a0 tx=0x7f2b8802a180 comp rx=0 tx=0).stop 2024-09-11T22:22:59.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.005+0000 7f2b9cf6d640 1 -- 172.21.15.100:0/3199269179 shutdown_connections 2024-09-11T22:22:59.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.005+0000 7f2b9cf6d640 1 --2- 172.21.15.100:0/3199269179 >> v2:172.21.15.167:3300/0 conn(0x7f2b9806d240 0x7f2b981651e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.005+0000 7f2b9cf6d640 1 --2- 172.21.15.100:0/3199269179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b9806ce60 0x7f2b9815bd50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.005+0000 7f2b9cf6d640 1 -- 172.21.15.100:0/3199269179 >> 172.21.15.100:0/3199269179 conn(0x7f2b9806bc10 msgr2=0x7f2b9806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:59.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.005+0000 7f2b9cf6d640 1 -- 172.21.15.100:0/3199269179 shutdown_connections 2024-09-11T22:22:59.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.005+0000 7f2b9cf6d640 1 -- 172.21.15.100:0/3199269179 wait complete. 2024-09-11T22:22:59.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.007+0000 7f2b9cf6d640 1 Processor -- start 2024-09-11T22:22:59.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.007+0000 7f2b9cf6d640 1 -- start start 2024-09-11T22:22:59.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.008+0000 7f2b9cf6d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b9806ce60 0x7f2b981f02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:59.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.008+0000 7f2b9cf6d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b9806d240 0x7f2b980c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:59.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.008+0000 7f2b9cf6d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b9815c290 0x7f2b9814fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:59.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.008+0000 7f2b9cf6d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2b980cb1b0 con 0x7f2b9806ce60 2024-09-11T22:22:59.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.008+0000 7f2b9cf6d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2b980c5d10 con 0x7f2b9806d240 2024-09-11T22:22:59.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.008+0000 7f2b9cf6d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2b980cad20 con 0x7f2b9815c290 2024-09-11T22:22:59.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.008+0000 7f2b9659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b9806ce60 0x7f2b981f02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:59.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.008+0000 7f2b9659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b9806ce60 0x7f2b981f02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38818/0 (socket says 172.21.15.100:38818) 2024-09-11T22:22:59.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.008+0000 7f2b9659c640 1 -- 172.21.15.100:0/3811756383 learned_addr learned my addr 172.21.15.100:0/3811756383 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:59.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.008+0000 7f2b8ffff640 1 --2- 172.21.15.100:0/3811756383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b9806d240 0x7f2b980c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:59.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.008+0000 7f2b96d9d640 1 --2- 172.21.15.100:0/3811756383 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b9815c290 0x7f2b9814fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.008+0000 7f2b9659c640 1 -- 172.21.15.100:0/3811756383 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b9815c290 msgr2=0x7f2b9814fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.008+0000 7f2b9659c640 1 --2- 172.21.15.100:0/3811756383 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b9815c290 0x7f2b9814fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.008+0000 7f2b9659c640 1 -- 172.21.15.100:0/3811756383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b9806d240 msgr2=0x7f2b980c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.008+0000 7f2b9659c640 1 --2- 172.21.15.100:0/3811756383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b9806d240 0x7f2b980c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.008+0000 7f2b9659c640 1 -- 172.21.15.100:0/3811756383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b98150120 con 0x7f2b9806ce60 2024-09-11T22:22:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.008+0000 7f2b9659c640 1 --2- 172.21.15.100:0/3811756383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b9806ce60 0x7f2b981f02e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2b880098c0 tx=0x7f2b880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.008+0000 7f2b8effd640 1 -- 172.21.15.100:0/3811756383 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b88041020 con 0x7f2b9806ce60 2024-09-11T22:22:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.008+0000 7f2b8effd640 1 -- 172.21.15.100:0/3811756383 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8803d6e0 con 0x7f2b9806ce60 2024-09-11T22:22:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.008+0000 7f2b8effd640 1 -- 172.21.15.100:0/3811756383 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b88037040 con 0x7f2b9806ce60 2024-09-11T22:22:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.008+0000 7f2b9cf6d640 1 -- 172.21.15.100:0/3811756383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b980c9dc0 con 0x7f2b9806ce60 2024-09-11T22:22:59.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.009+0000 7f2b9cf6d640 1 -- 172.21.15.100:0/3811756383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b980ca380 con 0x7f2b9806ce60 2024-09-11T22:22:59.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.009+0000 7f2b9cf6d640 1 --2- 172.21.15.100:0/3811756383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b98159a20 0x7f2b98153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:59.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.009+0000 7f2b9cf6d640 1 -- 172.21.15.100:0/3811756383 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2b980c9b90 con 0x7f2b98159a20 2024-09-11T22:22:59.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.010+0000 7f2b8ffff640 1 --2- 172.21.15.100:0/3811756383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b98159a20 0x7f2b98153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:59.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.010+0000 7f2b8ffff640 1 -- 172.21.15.100:0/3811756383 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2b980c67d0 con 0x7f2b98159a20 2024-09-11T22:22:59.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.010+0000 7f2b8effd640 1 -- 172.21.15.100:0/3811756383 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2b88044020 con 0x7f2b9806ce60 2024-09-11T22:22:59.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.010+0000 7f2b8ffff640 1 --2- 172.21.15.100:0/3811756383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b98159a20 0x7f2b98153530 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2b980c9b40 tx=0x7f2b8000f9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:59.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.010+0000 7f2b8effd640 1 --2- 172.21.15.100:0/3811756383 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2b7806be60 0x7f2b7806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:59.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.011+0000 7f2b8effd640 1 -- 172.21.15.100:0/3811756383 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f2b880ab820 con 0x7f2b9806ce60 2024-09-11T22:22:59.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.011+0000 7f2b96d9d640 1 --2- 172.21.15.100:0/3811756383 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2b7806be60 0x7f2b7806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.011+0000 7f2b8effd640 1 -- 172.21.15.100:0/3811756383 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b80005ac0 con 0x7f2b98159a20 2024-09-11T22:22:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.011+0000 7f2b8effd640 1 -- 172.21.15.100:0/3811756383 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2b80018070 con 0x7f2b98159a20 2024-09-11T22:22:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.011+0000 7f2b8effd640 1 -- 172.21.15.100:0/3811756383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b98159a20 msgr2=0x7f2b98153530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.011+0000 7f2b8effd640 1 --2- 172.21.15.100:0/3811756383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b98159a20 0x7f2b98153530 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2b980c9b40 tx=0x7f2b8000f9d0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.011+0000 7f2b8effd640 1 -- 172.21.15.100:0/3811756383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b98159a20 msgr2=0x7f2b98153530 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:22:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.011+0000 7f2b8effd640 1 --2- 172.21.15.100:0/3811756383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b98159a20 0x7f2b98153530 secure :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2b980c9b40 tx=0x7f2b8000f9d0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.011+0000 7f2b96d9d640 1 --2- 172.21.15.100:0/3811756383 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2b7806be60 0x7f2b7806e320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2b98159780 tx=0x7f2b9000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:59.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.020+0000 7f2b9cf6d640 1 --2- 172.21.15.100:0/3811756383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b9814ebc0 0x7f2b980c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:59.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.020+0000 7f2b9cf6d640 1 -- 172.21.15.100:0/3811756383 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2b980ca5c0 con 0x7f2b9814ebc0 2024-09-11T22:22:59.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.021+0000 7f2b8ffff640 1 --2- 172.21.15.100:0/3811756383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b9814ebc0 0x7f2b980c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:59.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.021+0000 7f2b8ffff640 1 -- 172.21.15.100:0/3811756383 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2b9815cf70 con 0x7f2b9814ebc0 2024-09-11T22:22:59.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.021+0000 7f2b8ffff640 1 --2- 172.21.15.100:0/3811756383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b9814ebc0 0x7f2b980c8640 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2b98069640 tx=0x7f2b800010a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:59.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.021+0000 7f2b8effd640 1 -- 172.21.15.100:0/3811756383 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8001d9d0 con 0x7f2b9814ebc0 2024-09-11T22:22:59.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.022+0000 7f2b8effd640 1 -- 172.21.15.100:0/3811756383 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7f2b8001d9d0 con 0x7f2b9814ebc0 2024-09-11T22:22:59.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.022+0000 7f2b8effd640 1 -- 172.21.15.100:0/3811756383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b9814ebc0 msgr2=0x7f2b980c8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:59.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.022+0000 7f2b8effd640 1 --2- 172.21.15.100:0/3811756383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b9814ebc0 0x7f2b980c8640 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2b98069640 tx=0x7f2b800010a0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.022+0000 7f2b8effd640 1 -- 172.21.15.100:0/3811756383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b9814ebc0 msgr2=0x7f2b980c8640 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:22:59.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.022+0000 7f2b8effd640 1 --2- 172.21.15.100:0/3811756383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b9814ebc0 0x7f2b980c8640 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2b98069640 tx=0x7f2b800010a0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.023 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:22:59.023 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:22:59.023 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:22:59.023 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:22:59.023 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 18, 2024-09-11T22:22:59.023 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 183000, 2024-09-11T22:22:59.023 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:22:59.023 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:22:59.024 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:22:59.024 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:22:59.024 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:59.024 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 11, 2024-09-11T22:22:59.024 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:22:59.024 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:22:59.024 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:22:59.024 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:59.024 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:59.024 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:59.024 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:59.024 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:59.024 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:59.025 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:59.025 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:59.025 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:59.025 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:59.025 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:59.025 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:59.025 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:22:59.025 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:22:59.025 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:59.025 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:59.025 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:59.025 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:59.025 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:59.025 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:59.026 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:59.026 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:59.026 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:59.026 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:59.026 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:59.026 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:59.026 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.026 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:22:59.026 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:22:59.026 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:22:59.026 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:22:59.026 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:22:59.026 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:22:59.026 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:22:59.027 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:22:59.027 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:22:59.027 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:22:59.027 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:22:59.027 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:22:59.027 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:22:59.027 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:22:59.027 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:22:59.027 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:22:59.027 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:22:59.027 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:59.027 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:59.027 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:59.027 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:59.027 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:59.028 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:59.028 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:59.028 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:59.028 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:59.028 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:59.028 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:59.028 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:59.028 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:22:59.028 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.028 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:22:59.028 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.028 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:22:59.028 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:22:59.028 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:59.029 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:59.029 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.029 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:59.029 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:22:59.029 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:59.029 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.029 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.029 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:59.029 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:22:59.029 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:59.029 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:59.029 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:59.029 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.029 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:22:59.030 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:22:59.030 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:59.030 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:59.030 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:59.030 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.030 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.030 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:22:59.030 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:22:59.030 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:59.030 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:59.030 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.030 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:59.030 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:22:59.030 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:59.030 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.031 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.031 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:59.031 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:22:59.031 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:59.031 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:59.031 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:59.031 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.031 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:22:59.031 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:22:59.031 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:59.031 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:59.031 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:59.031 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.031 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.032 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:22:59.032 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:22:59.032 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:59.032 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:59.032 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.032 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:59.032 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:22:59.032 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:59.032 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.032 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.032 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:59.032 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:22:59.032 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:59.032 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:59.033 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:59.033 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.033 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:22:59.033 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:22:59.033 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:59.033 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:59.033 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:59.033 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:59.033 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:59.033 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.033 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:22:59.033 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:22:59.033 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.033 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:59.034 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:59.034 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:22:59.034 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:59.034 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:59.034 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:22:59.034 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.034 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:59.034 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:59.034 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:22:59.034 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:59.034 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:59.034 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:22:59.034 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.034 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:59.035 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:59.035 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:22:59.035 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:59.035 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:59.035 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:22:59.035 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.035 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:59.035 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:59.035 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4 2024-09-11T22:22:59.035 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:59.035 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:59.035 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:22:59.035 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.035 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:59.036 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:59.036 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:22:59.036 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:59.036 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:59.036 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.036 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:22:59.036 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:22:59.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.022+0000 7f2b9cf6d640 1 -- 172.21.15.100:0/3811756383 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2b7806be60 msgr2=0x7f2b7806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:59.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.022+0000 7f2b9cf6d640 1 --2- 172.21.15.100:0/3811756383 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2b7806be60 0x7f2b7806e320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2b98159780 tx=0x7f2b9000b040 comp rx=0 tx=0).stop 2024-09-11T22:22:59.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.022+0000 7f2b9cf6d640 1 -- 172.21.15.100:0/3811756383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b9806ce60 msgr2=0x7f2b981f02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:59.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.022+0000 7f2b9cf6d640 1 --2- 172.21.15.100:0/3811756383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b9806ce60 0x7f2b981f02e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2b880098c0 tx=0x7f2b880046c0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.022+0000 7f2b96d9d640 1 -- 172.21.15.100:0/3811756383 reap_dead start 2024-09-11T22:22:59.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.022+0000 7f2b96d9d640 1 -- 172.21.15.100:0/3811756383 reap_dead start 2024-09-11T22:22:59.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.022+0000 7f2b9cf6d640 1 -- 172.21.15.100:0/3811756383 shutdown_connections 2024-09-11T22:22:59.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.022+0000 7f2b9cf6d640 1 -- 172.21.15.100:0/3811756383 >> 172.21.15.100:0/3811756383 conn(0x7f2b9806bc10 msgr2=0x7f2b9815ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:59.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.022+0000 7f2b9cf6d640 1 -- 172.21.15.100:0/3811756383 shutdown_connections 2024-09-11T22:22:59.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.022+0000 7f2b9cf6d640 1 -- 172.21.15.100:0/3811756383 wait complete. 2024-09-11T22:22:59.038 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:22:59.038 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:22:59.038 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:22:59.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.145+0000 7f5b30250640 1 Processor -- start 2024-09-11T22:22:59.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.145+0000 7f5b30250640 1 -- start start 2024-09-11T22:22:59.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.146+0000 7f5b30250640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5b28154d60 0x7f5b280cc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:59.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.146+0000 7f5b30250640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b280c8020 0x7f5b280ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:59.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.146+0000 7f5b30250640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b2815a990 con 0x7f5b280c8590 2024-09-11T22:22:59.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.146+0000 7f5b30250640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f5b2815ac70 con 0x7f5b28154d60 2024-09-11T22:22:59.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.146+0000 7f5b30250640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5b2815af50 con 0x7f5b280c8020 2024-09-11T22:22:59.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.146+0000 7f5b2d7eb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b280c8020 0x7f5b280ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:59.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.146+0000 7f5b2dfec640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5b28154d60 0x7f5b280cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:59.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.146+0000 7f5b2d7eb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b280c8020 0x7f5b280ccc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:43602/0 (socket says 172.21.15.100:43602) 2024-09-11T22:22:59.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.146+0000 7f5b2d7eb640 1 -- 172.21.15.100:0/2325553758 learned_addr learned my addr 172.21.15.100:0/2325553758 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:59.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.147+0000 7f5b2d7eb640 1 -- 172.21.15.100:0/2325553758 >> v2:172.21.15.167:3300/0 conn(0x7f5b28154d60 msgr2=0x7f5b280cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:59.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.147+0000 7f5b2d7eb640 1 --2- 172.21.15.100:0/2325553758 >> v2:172.21.15.167:3300/0 conn(0x7f5b28154d60 0x7f5b280cc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.147+0000 7f5b2d7eb640 1 -- 172.21.15.100:0/2325553758 >> v1:172.21.15.167:6789/0 conn(0x7f5b280c8590 legacy=0x7f5b2815e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:59.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.147+0000 7f5b2d7eb640 1 -- 172.21.15.100:0/2325553758 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b2815b230 con 0x7f5b280c8020 2024-09-11T22:22:59.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.147+0000 7f5b2d7eb640 1 --2- 172.21.15.100:0/2325553758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b280c8020 0x7f5b280ccc80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5b18009870 tx=0x7f5b1802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc1623603284701c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:59.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.148+0000 7f5b2cfea640 1 -- 172.21.15.100:0/2325553758 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b18037070 con 0x7f5b280c8020 2024-09-11T22:22:59.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.148+0000 7f5b2cfea640 1 -- 172.21.15.100:0/2325553758 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b18032440 con 0x7f5b280c8020 2024-09-11T22:22:59.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.148+0000 7f5b2cfea640 1 -- 172.21.15.100:0/2325553758 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b18032810 con 0x7f5b280c8020 2024-09-11T22:22:59.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.148+0000 7f5b30250640 1 -- 172.21.15.100:0/2325553758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b280c8020 msgr2=0x7f5b280ccc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:59.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.148+0000 7f5b30250640 1 --2- 172.21.15.100:0/2325553758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b280c8020 0x7f5b280ccc80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5b18009870 tx=0x7f5b1802a270 comp rx=0 tx=0).stop 2024-09-11T22:22:59.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.148+0000 7f5b30250640 1 -- 172.21.15.100:0/2325553758 shutdown_connections 2024-09-11T22:22:59.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.148+0000 7f5b30250640 1 --2- 172.21.15.100:0/2325553758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b280c8020 0x7f5b280ccc80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.148+0000 7f5b30250640 1 --2- 172.21.15.100:0/2325553758 >> v2:172.21.15.167:3300/0 conn(0x7f5b28154d60 0x7f5b280cc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.148+0000 7f5b30250640 1 -- 172.21.15.100:0/2325553758 >> 172.21.15.100:0/2325553758 conn(0x7f5b2806fa70 msgr2=0x7f5b2806fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:59.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.148+0000 7f5b30250640 1 -- 172.21.15.100:0/2325553758 shutdown_connections 2024-09-11T22:22:59.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.148+0000 7f5b30250640 1 -- 172.21.15.100:0/2325553758 wait complete. 2024-09-11T22:22:59.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.150+0000 7f5b30250640 1 Processor -- start 2024-09-11T22:22:59.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.150+0000 7f5b30250640 1 -- start start 2024-09-11T22:22:59.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.151+0000 7f5b30250640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b280c8020 0x7f5b281e4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:59.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.151+0000 7f5b30250640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b280c8590 0x7f5b281e7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:59.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.151+0000 7f5b30250640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b28154d60 0x7f5b281e7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:59.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.151+0000 7f5b30250640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2815e9b0 con 0x7f5b28154d60 2024-09-11T22:22:59.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.151+0000 7f5b30250640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2815e830 con 0x7f5b280c8020 2024-09-11T22:22:59.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.151+0000 7f5b30250640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5b281e6f10 con 0x7f5b280c8590 2024-09-11T22:22:59.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.151+0000 7f5b2e7ed640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b28154d60 0x7f5b281e7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:59.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.151+0000 7f5b2dfec640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b280c8020 0x7f5b281e4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:59.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.151+0000 7f5b2e7ed640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b28154d60 0x7f5b281e7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38822/0 (socket says 172.21.15.100:38822) 2024-09-11T22:22:59.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.151+0000 7f5b2e7ed640 1 -- 172.21.15.100:0/2328408480 learned_addr learned my addr 172.21.15.100:0/2328408480 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:59.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.151+0000 7f5b2d7eb640 1 --2- 172.21.15.100:0/2328408480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b280c8590 0x7f5b281e7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:59.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.151+0000 7f5b2d7eb640 1 -- 172.21.15.100:0/2328408480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b280c8020 msgr2=0x7f5b281e4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:59.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.151+0000 7f5b2d7eb640 1 --2- 172.21.15.100:0/2328408480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b280c8020 0x7f5b281e4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.151+0000 7f5b2d7eb640 1 -- 172.21.15.100:0/2328408480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b28154d60 msgr2=0x7f5b281e7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:59.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.151+0000 7f5b2d7eb640 1 --2- 172.21.15.100:0/2328408480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b28154d60 0x7f5b281e7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.151+0000 7f5b2d7eb640 1 -- 172.21.15.100:0/2328408480 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b281e64e0 con 0x7f5b280c8590 2024-09-11T22:22:59.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.151+0000 7f5b2e7ed640 1 --2- 172.21.15.100:0/2328408480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b28154d60 0x7f5b281e7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:59.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.151+0000 7f5b2dfec640 1 --2- 172.21.15.100:0/2328408480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b280c8020 0x7f5b281e4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:22:59.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.151+0000 7f5b2d7eb640 1 --2- 172.21.15.100:0/2328408480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b280c8590 0x7f5b281e7640 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5b18031000 tx=0x7f5b180046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:59.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.152+0000 7f5b1e7fc640 1 -- 172.21.15.100:0/2328408480 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b18041020 con 0x7f5b280c8590 2024-09-11T22:22:59.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.152+0000 7f5b1e7fc640 1 -- 172.21.15.100:0/2328408480 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b18030660 con 0x7f5b280c8590 2024-09-11T22:22:59.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.152+0000 7f5b30250640 1 -- 172.21.15.100:0/2328408480 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b281f09b0 con 0x7f5b280c8590 2024-09-11T22:22:59.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.152+0000 7f5b1e7fc640 1 -- 172.21.15.100:0/2328408480 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b18037040 con 0x7f5b280c8590 2024-09-11T22:22:59.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.152+0000 7f5b30250640 1 -- 172.21.15.100:0/2328408480 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b281f0f70 con 0x7f5b280c8590 2024-09-11T22:22:59.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.153+0000 7f5b30250640 1 --2- 172.21.15.100:0/2328408480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b281f11b0 0x7f5b2814dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:59.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.153+0000 7f5b30250640 1 -- 172.21.15.100:0/2328408480 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5b280c8a20 con 0x7f5b281f11b0 2024-09-11T22:22:59.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.153+0000 7f5b2dfec640 1 --2- 172.21.15.100:0/2328408480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b281f11b0 0x7f5b2814dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:59.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.153+0000 7f5b2dfec640 1 -- 172.21.15.100:0/2328408480 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b28072340 con 0x7f5b281f11b0 2024-09-11T22:22:59.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.153+0000 7f5b1e7fc640 1 -- 172.21.15.100:0/2328408480 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b18044020 con 0x7f5b280c8590 2024-09-11T22:22:59.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.153+0000 7f5b2dfec640 1 --2- 172.21.15.100:0/2328408480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b281f11b0 0x7f5b2814dc10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5b24011c70 tx=0x7f5b2400f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:59.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.154+0000 7f5b1e7fc640 1 --2- 172.21.15.100:0/2328408480 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5b0c06be30 0x7f5b0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:59.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.154+0000 7f5b2e7ed640 1 --2- 172.21.15.100:0/2328408480 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5b0c06be30 0x7f5b0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:59.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.154+0000 7f5b1e7fc640 1 -- 172.21.15.100:0/2328408480 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f5b180ab780 con 0x7f5b280c8590 2024-09-11T22:22:59.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.154+0000 7f5b1e7fc640 1 -- 172.21.15.100:0/2328408480 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b24019070 con 0x7f5b281f11b0 2024-09-11T22:22:59.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.154+0000 7f5b1e7fc640 1 -- 172.21.15.100:0/2328408480 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5b24004030 con 0x7f5b281f11b0 2024-09-11T22:22:59.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.154+0000 7f5b1e7fc640 1 -- 172.21.15.100:0/2328408480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b281f11b0 msgr2=0x7f5b2814dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:59.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.154+0000 7f5b1e7fc640 1 --2- 172.21.15.100:0/2328408480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b281f11b0 0x7f5b2814dc10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5b24011c70 tx=0x7f5b2400f610 comp rx=0 tx=0).stop 2024-09-11T22:22:59.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.154+0000 7f5b1e7fc640 1 -- 172.21.15.100:0/2328408480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b281f11b0 msgr2=0x7f5b2814dc10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:22:59.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.154+0000 7f5b1e7fc640 1 --2- 172.21.15.100:0/2328408480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b281f11b0 0x7f5b2814dc10 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5b24011c70 tx=0x7f5b2400f610 comp rx=0 tx=0).stop 2024-09-11T22:22:59.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.154+0000 7f5b2e7ed640 1 --2- 172.21.15.100:0/2328408480 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5b0c06be30 0x7f5b0c06e2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5b281f08e0 tx=0x7f5b20009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:59.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.164+0000 7f5b30250640 1 --2- 172.21.15.100:0/2328408480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b2815a430 0x7f5b2814e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:59.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.164+0000 7f5b30250640 1 -- 172.21.15.100:0/2328408480 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5b280c7d90 con 0x7f5b2815a430 2024-09-11T22:22:59.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.164+0000 7f5b2dfec640 1 --2- 172.21.15.100:0/2328408480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b2815a430 0x7f5b2814e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.164+0000 7f5b2dfec640 1 -- 172.21.15.100:0/2328408480 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5b2806fff0 con 0x7f5b2815a430 2024-09-11T22:22:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.164+0000 7f5b2dfec640 1 --2- 172.21.15.100:0/2328408480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b2815a430 0x7f5b2814e150 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5b24011c70 tx=0x7f5b240046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:59.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.164+0000 7f5b1e7fc640 1 -- 172.21.15.100:0/2328408480 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b24019040 con 0x7f5b2815a430 2024-09-11T22:22:59.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.165+0000 7f5b1e7fc640 1 -- 172.21.15.100:0/2328408480 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7f5b2401e450 con 0x7f5b2815a430 2024-09-11T22:22:59.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.165+0000 7f5b1e7fc640 1 -- 172.21.15.100:0/2328408480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b2815a430 msgr2=0x7f5b2814e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:59.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.165+0000 7f5b1e7fc640 1 --2- 172.21.15.100:0/2328408480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b2815a430 0x7f5b2814e150 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5b24011c70 tx=0x7f5b240046c0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.165+0000 7f5b1e7fc640 1 -- 172.21.15.100:0/2328408480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b2815a430 msgr2=0x7f5b2814e150 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:22:59.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.165+0000 7f5b1e7fc640 1 --2- 172.21.15.100:0/2328408480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b2815a430 0x7f5b2814e150 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.166 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:22:59.166 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:22:59.166 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:22:59.166 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:22:59.167 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 18, 2024-09-11T22:22:59.167 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 69885, 2024-09-11T22:22:59.167 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:22:59.167 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:22:59.167 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:22:59.167 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:22:59.167 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:59.167 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 11, 2024-09-11T22:22:59.167 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:22:59.167 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:22:59.167 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:22:59.167 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:59.167 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:59.167 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:59.168 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:59.168 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:59.168 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:59.168 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:59.168 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:59.168 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:59.168 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:59.168 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:59.168 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:59.168 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:22:59.168 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:22:59.168 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:59.168 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:59.169 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:59.169 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:59.169 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:59.169 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:59.169 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:59.169 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:59.169 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:59.169 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:59.169 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:59.169 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:59.169 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.169 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:22:59.169 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:22:59.169 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:22:59.170 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:22:59.170 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:22:59.170 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:22:59.170 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:22:59.170 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:22:59.170 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:22:59.170 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:22:59.170 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:22:59.170 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:22:59.170 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:22:59.170 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:22:59.170 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:22:59.170 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:22:59.170 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:22:59.170 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:22:59.171 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:22:59.171 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:22:59.171 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:22:59.171 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:22:59.171 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:22:59.171 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:22:59.171 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:22:59.171 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:22:59.171 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:22:59.171 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:22:59.171 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:59.171 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:22:59.171 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.171 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:22:59.172 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.172 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:22:59.172 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:22:59.172 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:59.172 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:59.172 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.172 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:59.172 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:22:59.172 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:59.172 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.172 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.172 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:59.172 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:22:59.172 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:59.173 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:59.173 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:59.173 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.173 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:22:59.173 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:22:59.173 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:59.173 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:59.173 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:59.173 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.173 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.173 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:22:59.173 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:22:59.173 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:59.173 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:59.174 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.174 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:59.174 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:22:59.174 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:59.174 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.174 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.174 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:59.174 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:22:59.174 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:59.174 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:59.174 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:59.174 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.174 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:22:59.175 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:22:59.175 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:59.175 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:59.175 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:59.175 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.175 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.175 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:22:59.175 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:22:59.175 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:22:59.175 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:22:59.175 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.175 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:22:59.175 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:22:59.175 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:59.175 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.176 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.176 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:22:59.176 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:22:59.176 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:22:59.176 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:59.176 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:59.176 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.176 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:22:59.176 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:22:59.176 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:22:59.176 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:22:59.176 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:22:59.176 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:59.176 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:59.177 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.177 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:22:59.177 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:22:59.177 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.177 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:59.177 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:59.177 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:22:59.177 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:59.177 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:59.177 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:22:59.177 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.177 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:59.177 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:59.177 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:22:59.178 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:59.178 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:59.178 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:22:59.178 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.178 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:59.178 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:59.178 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:22:59.178 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:59.178 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:59.178 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:22:59.178 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.178 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:59.178 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:59.178 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4 2024-09-11T22:22:59.178 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:59.179 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:22:59.179 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:22:59.179 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:22:59.179 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:22:59.179 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:22:59.179 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:22:59.179 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:22:59.179 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:22:59.179 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:22:59.179 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:22:59.179 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:22:59.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.165+0000 7f5b30250640 1 -- 172.21.15.100:0/2328408480 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5b0c06be30 msgr2=0x7f5b0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:59.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.165+0000 7f5b30250640 1 --2- 172.21.15.100:0/2328408480 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5b0c06be30 0x7f5b0c06e2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5b281f08e0 tx=0x7f5b20009040 comp rx=0 tx=0).stop 2024-09-11T22:22:59.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.165+0000 7f5b30250640 1 -- 172.21.15.100:0/2328408480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b280c8590 msgr2=0x7f5b281e7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:59.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.165+0000 7f5b30250640 1 --2- 172.21.15.100:0/2328408480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b280c8590 0x7f5b281e7640 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5b18031000 tx=0x7f5b180046c0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.165+0000 7f5b2e7ed640 1 -- 172.21.15.100:0/2328408480 reap_dead start 2024-09-11T22:22:59.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.165+0000 7f5b30250640 1 -- 172.21.15.100:0/2328408480 shutdown_connections 2024-09-11T22:22:59.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.165+0000 7f5b30250640 1 --2- 172.21.15.100:0/2328408480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b280c8590 0x7f5b281e7640 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.165+0000 7f5b30250640 1 -- 172.21.15.100:0/2328408480 >> 172.21.15.100:0/2328408480 conn(0x7f5b2806fa70 msgr2=0x7f5b281538c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:59.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.165+0000 7f5b30250640 1 -- 172.21.15.100:0/2328408480 shutdown_connections 2024-09-11T22:22:59.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.165+0000 7f5b30250640 1 -- 172.21.15.100:0/2328408480 wait complete. 2024-09-11T22:22:59.182 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:22:59.182 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-09-11T22:22:59.182 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-11T22:22:59.182 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-11T22:22:59.182 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-11T22:22:59.182 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-11T22:22:59.183 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:22:59.196 INFO:tasks.ceph.mon.b:Stopped 2024-09-11T22:22:59.196 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-11T22:22:59.197 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:22:59.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.303+0000 7fcbd5a53640 1 Processor -- start 2024-09-11T22:22:59.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.303+0000 7fcbd5a53640 1 -- start start 2024-09-11T22:22:59.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.304+0000 7fcbd5a53640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcbd00c64c0 0x7fcbd015b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:59.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.304+0000 7fcbd5a53640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd00c68a0 0x7fcbd006e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:59.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.304+0000 7fcbd5a53640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbd015bb10 con 0x7fcbd00c7320 2024-09-11T22:22:59.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.304+0000 7fcbd5a53640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fcbd006d4c0 con 0x7fcbd00c64c0 2024-09-11T22:22:59.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.304+0000 7fcbd5a53640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcbd006c6e0 con 0x7fcbd00c68a0 2024-09-11T22:22:59.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.304+0000 7fcbceffd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcbd00c64c0 0x7fcbd015b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:59.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.304+0000 7fcbceffd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcbd00c64c0 0x7fcbd015b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38896/0 (socket says 172.21.15.100:38896) 2024-09-11T22:22:59.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.304+0000 7fcbceffd640 1 -- 172.21.15.100:0/2374904461 learned_addr learned my addr 172.21.15.100:0/2374904461 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:59.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.305+0000 7fcbce7fc640 1 --2- 172.21.15.100:0/2374904461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd00c68a0 0x7fcbd006e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:59.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.305+0000 7fcbceffd640 1 -- 172.21.15.100:0/2374904461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd00c68a0 msgr2=0x7fcbd006e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:22:59.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.305+0000 7fcbceffd640 1 --2- 172.21.15.100:0/2374904461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd00c68a0 0x7fcbd006e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.305+0000 7fcbceffd640 1 -- 172.21.15.100:0/2374904461 >> v1:172.21.15.100:6789/0 conn(0x7fcbd00c7320 legacy=0x7fcbd01513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:59.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.305+0000 7fcbceffd640 1 -- 172.21.15.100:0/2374904461 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd00c49e0 con 0x7fcbd00c64c0 2024-09-11T22:22:59.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.306+0000 7fcbceffd640 1 --2- 172.21.15.100:0/2374904461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd00c64c0 0x7fcbd015b5d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcbd015bce0 tx=0x7fcbc002c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0ba90c10e2c236 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:59.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.306+0000 7fcbcdffb640 1 -- 172.21.15.100:0/2374904461 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0036020 con 0x7fcbd00c64c0 2024-09-11T22:22:59.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.306+0000 7fcbcdffb640 1 -- 172.21.15.100:0/2374904461 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbc0032890 con 0x7fcbd00c64c0 2024-09-11T22:22:59.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.306+0000 7fcbcdffb640 1 -- 172.21.15.100:0/2374904461 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0032c60 con 0x7fcbd00c64c0 2024-09-11T22:22:59.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.307+0000 7fcbd5a53640 1 -- 172.21.15.100:0/2374904461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd00c64c0 msgr2=0x7fcbd015b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:59.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.307+0000 7fcbd5a53640 1 --2- 172.21.15.100:0/2374904461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd00c64c0 0x7fcbd015b5d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcbd015bce0 tx=0x7fcbc002c990 comp rx=0 tx=0).stop 2024-09-11T22:22:59.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.307+0000 7fcbd5a53640 1 -- 172.21.15.100:0/2374904461 shutdown_connections 2024-09-11T22:22:59.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.307+0000 7fcbd5a53640 1 --2- 172.21.15.100:0/2374904461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd00c68a0 0x7fcbd006e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.307+0000 7fcbd5a53640 1 --2- 172.21.15.100:0/2374904461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd00c64c0 0x7fcbd015b5d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.307+0000 7fcbd5a53640 1 -- 172.21.15.100:0/2374904461 >> 172.21.15.100:0/2374904461 conn(0x7fcbd00cd110 msgr2=0x7fcbd00cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:59.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.307+0000 7fcbd5a53640 1 -- 172.21.15.100:0/2374904461 shutdown_connections 2024-09-11T22:22:59.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.307+0000 7fcbd5a53640 1 -- 172.21.15.100:0/2374904461 wait complete. 2024-09-11T22:22:59.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.308+0000 7fcbd5a53640 1 Processor -- start 2024-09-11T22:22:59.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.308+0000 7fcbd5a53640 1 -- start start 2024-09-11T22:22:59.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.309+0000 7fcbd5a53640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd00c64c0 0x7fcbd014dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:59.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.309+0000 7fcbd5a53640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd00c68a0 0x7fcbd00680d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:59.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.309+0000 7fcbd5a53640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd00c7320 0x7fcbd01ec760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:59.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.309+0000 7fcbd5a53640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd006c370 con 0x7fcbd00c64c0 2024-09-11T22:22:59.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.309+0000 7fcbd5a53640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd006c090 con 0x7fcbd00c68a0 2024-09-11T22:22:59.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.309+0000 7fcbd5a53640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcbd006cb70 con 0x7fcbd00c7320 2024-09-11T22:22:59.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.309+0000 7fcbceffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd00c64c0 0x7fcbd014dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.309+0000 7fcbceffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd00c64c0 0x7fcbd014dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38908/0 (socket says 172.21.15.100:38908) 2024-09-11T22:22:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.309+0000 7fcbceffd640 1 -- 172.21.15.100:0/2511505231 learned_addr learned my addr 172.21.15.100:0/2511505231 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:22:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.309+0000 7fcbce7fc640 1 -- 172.21.15.100:0/2511505231 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd00c68a0 msgr2=0x7fcbd00680d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2024-09-11T22:22:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.309+0000 7fcbce7fc640 1 --2- 172.21.15.100:0/2511505231 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd00c68a0 0x7fcbd00680d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:22:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.309+0000 7fcbcf7fe640 1 --2- 172.21.15.100:0/2511505231 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd00c7320 0x7fcbd01ec760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.309+0000 7fcbceffd640 1 -- 172.21.15.100:0/2511505231 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd00c7320 msgr2=0x7fcbd01ec760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.309+0000 7fcbceffd640 1 --2- 172.21.15.100:0/2511505231 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd00c7320 0x7fcbd01ec760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.309+0000 7fcbceffd640 1 -- 172.21.15.100:0/2511505231 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd00c68a0 msgr2=0x7fcbd00680d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:22:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.309+0000 7fcbceffd640 1 --2- 172.21.15.100:0/2511505231 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd00c68a0 0x7fcbd00680d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.309+0000 7fcbceffd640 1 -- 172.21.15.100:0/2511505231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd01462b0 con 0x7fcbd00c64c0 2024-09-11T22:22:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.310+0000 7fcbceffd640 1 --2- 172.21.15.100:0/2511505231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd00c64c0 0x7fcbd014dfc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcbc002c9d0 tx=0x7fcbc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.310+0000 7fcbb7fff640 1 -- 172.21.15.100:0/2511505231 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0036040 con 0x7fcbd00c64c0 2024-09-11T22:22:59.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.310+0000 7fcbb7fff640 1 -- 172.21.15.100:0/2511505231 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbc003ccf0 con 0x7fcbd00c64c0 2024-09-11T22:22:59.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.310+0000 7fcbd5a53640 1 -- 172.21.15.100:0/2511505231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd01ebfa0 con 0x7fcbd00c64c0 2024-09-11T22:22:59.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.310+0000 7fcbb7fff640 1 -- 172.21.15.100:0/2511505231 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0046610 con 0x7fcbd00c64c0 2024-09-11T22:22:59.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.310+0000 7fcbd5a53640 1 -- 172.21.15.100:0/2511505231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd01effb0 con 0x7fcbd00c64c0 2024-09-11T22:22:59.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.311+0000 7fcbd5a53640 1 -- 172.21.15.100:0/2511505231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbd00c4610 con 0x7fcbd00c64c0 2024-09-11T22:22:59.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.311+0000 7fcbb7fff640 1 -- 172.21.15.100:0/2511505231 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcbc004d060 con 0x7fcbd00c64c0 2024-09-11T22:22:59.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.312+0000 7fcbb7fff640 1 --2- 172.21.15.100:0/2511505231 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcbbc06bde0 0x7fcbbc06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:22:59.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.312+0000 7fcbb7fff640 1 -- 172.21.15.100:0/2511505231 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fcbc00ae640 con 0x7fcbd00c64c0 2024-09-11T22:22:59.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.312+0000 7fcbce7fc640 1 --2- 172.21.15.100:0/2511505231 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcbbc06bde0 0x7fcbbc06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:22:59.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.313+0000 7fcbce7fc640 1 --2- 172.21.15.100:0/2511505231 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcbbc06bde0 0x7fcbbc06e2a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcbd01436c0 tx=0x7fcbc4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:22:59.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.319+0000 7fcbb7fff640 1 -- 172.21.15.100:0/2511505231 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcbc0041070 con 0x7fcbd00c64c0 2024-09-11T22:22:59.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.600+0000 7fcbd5a53640 1 -- 172.21.15.100:0/2511505231 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fcbd01493d0 con 0x7fcbd00c64c0 2024-09-11T22:22:59.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.601+0000 7fcbb7fff640 1 -- 172.21.15.100:0/2511505231 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fcbc002e040 con 0x7fcbd00c64c0 2024-09-11T22:22:59.602 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":18,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:22:59.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.603+0000 7fcbd5a53640 1 -- 172.21.15.100:0/2511505231 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcbbc06bde0 msgr2=0x7fcbbc06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:59.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.603+0000 7fcbd5a53640 1 --2- 172.21.15.100:0/2511505231 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcbbc06bde0 0x7fcbbc06e2a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcbd01436c0 tx=0x7fcbc4009190 comp rx=0 tx=0).stop 2024-09-11T22:22:59.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.603+0000 7fcbd5a53640 1 -- 172.21.15.100:0/2511505231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd00c64c0 msgr2=0x7fcbd014dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:22:59.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.603+0000 7fcbd5a53640 1 --2- 172.21.15.100:0/2511505231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd00c64c0 0x7fcbd014dfc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcbc002c9d0 tx=0x7fcbc00046c0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.603+0000 7fcbd5a53640 1 -- 172.21.15.100:0/2511505231 shutdown_connections 2024-09-11T22:22:59.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.603+0000 7fcbd5a53640 1 --2- 172.21.15.100:0/2511505231 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcbbc06bde0 0x7fcbbc06e2a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.603+0000 7fcbd5a53640 1 --2- 172.21.15.100:0/2511505231 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd00c7320 0x7fcbd01ec760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.603+0000 7fcbd5a53640 1 --2- 172.21.15.100:0/2511505231 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd00c68a0 0x7fcbd00680d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.603+0000 7fcbd5a53640 1 --2- 172.21.15.100:0/2511505231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd00c64c0 0x7fcbd014dfc0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:22:59.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.603+0000 7fcbd5a53640 1 -- 172.21.15.100:0/2511505231 >> 172.21.15.100:0/2511505231 conn(0x7fcbd00cd110 msgr2=0x7fcbd006eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:22:59.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.603+0000 7fcbd5a53640 1 -- 172.21.15.100:0/2511505231 shutdown_connections 2024-09-11T22:22:59.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:22:59.603+0000 7fcbd5a53640 1 -- 172.21.15.100:0/2511505231 wait complete. 2024-09-11T22:23:02.619 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:23:02.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.731+0000 7f8ac996d640 1 Processor -- start 2024-09-11T22:23:02.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.731+0000 7f8ac996d640 1 -- start start 2024-09-11T22:23:02.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.732+0000 7f8ac996d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ac415a7e0 0x7f8ac40cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:02.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.732+0000 7f8ac996d640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ac415ac90 con 0x7f8ac40b3190 2024-09-11T22:23:02.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.732+0000 7f8ac996d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ac415af70 con 0x7f8ac4154c20 2024-09-11T22:23:02.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.732+0000 7f8ac996d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac415e000 con 0x7f8ac415a7e0 2024-09-11T22:23:02.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.732+0000 7f8abbfff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f8ac40b3190 0x7f8ac415e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51886/0 (socket says 172.21.15.100:51886) 2024-09-11T22:23:02.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.732+0000 7f8abbfff640 1 -- 172.21.15.100:0/3971663936 learned_addr learned my addr 172.21.15.100:0/3971663936 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:23:02.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.732+0000 7f8ac2ffd640 1 -- 172.21.15.100:0/3971663936 >> v1:172.21.15.167:6789/0 conn(0x7f8ac4154c20 legacy=0x7f8ac40cb120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2024-09-11T22:23:02.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.732+0000 7f8ac37fe640 1 --2- 172.21.15.100:0/3971663936 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ac415a7e0 0x7f8ac40cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:02.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.732+0000 7f8ac27fc640 1 -- 172.21.15.100:0/3971663936 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4091427386 0 0) 0x7f8ac415ac90 con 0x7f8ac40b3190 2024-09-11T22:23:02.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.732+0000 7f8ac27fc640 1 -- 172.21.15.100:0/3971663936 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ab0003520 con 0x7f8ac40b3190 2024-09-11T22:23:02.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.732+0000 7f8ac37fe640 1 -- 172.21.15.100:0/3971663936 >> v1:172.21.15.167:6789/0 conn(0x7f8ac4154c20 legacy=0x7f8ac40cb120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:23:02.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.732+0000 7f8ac37fe640 1 -- 172.21.15.100:0/3971663936 >> v1:172.21.15.100:6789/0 conn(0x7f8ac40b3190 legacy=0x7f8ac415e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:02.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.732+0000 7f8ac37fe640 1 -- 172.21.15.100:0/3971663936 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac415b250 con 0x7f8ac415a7e0 2024-09-11T22:23:02.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.733+0000 7f8ac37fe640 1 --2- 172.21.15.100:0/3971663936 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ac415a7e0 0x7f8ac40cbd10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009dc0 tx=0x7f8abc02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba7cbd183cd4ff10 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:02.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.734+0000 7f8ac27fc640 1 -- 172.21.15.100:0/3971663936 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc02ae60 con 0x7f8ac415a7e0 2024-09-11T22:23:02.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.734+0000 7f8ac27fc640 1 -- 172.21.15.100:0/3971663936 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8abc007740 con 0x7f8ac415a7e0 2024-09-11T22:23:02.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.734+0000 7f8ac27fc640 1 -- 172.21.15.100:0/3971663936 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc007af0 con 0x7f8ac415a7e0 2024-09-11T22:23:02.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.734+0000 7f8ac996d640 1 -- 172.21.15.100:0/3971663936 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ac415a7e0 msgr2=0x7f8ac40cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:02.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.734+0000 7f8ac996d640 1 --2- 172.21.15.100:0/3971663936 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ac415a7e0 0x7f8ac40cbd10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009dc0 tx=0x7f8abc02a680 comp rx=0 tx=0).stop 2024-09-11T22:23:02.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.734+0000 7f8ac996d640 1 -- 172.21.15.100:0/3971663936 shutdown_connections 2024-09-11T22:23:02.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.734+0000 7f8ac996d640 1 --2- 172.21.15.100:0/3971663936 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ac415a7e0 0x7f8ac40cbd10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:02.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.734+0000 7f8ac996d640 1 -- 172.21.15.100:0/3971663936 >> 172.21.15.100:0/3971663936 conn(0x7f8ac4067d40 msgr2=0x7f8ac406d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:02.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.734+0000 7f8ac996d640 1 -- 172.21.15.100:0/3971663936 shutdown_connections 2024-09-11T22:23:02.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.734+0000 7f8ac996d640 1 -- 172.21.15.100:0/3971663936 wait complete. 2024-09-11T22:23:02.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.735+0000 7f8ac996d640 1 Processor -- start 2024-09-11T22:23:02.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.735+0000 7f8ac996d640 1 -- start start 2024-09-11T22:23:02.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.736+0000 7f8ac996d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ac40b3190 0x7f8ac41f0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:02.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.736+0000 7f8ac996d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ac4154c20 0x7f8ac4150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:02.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.736+0000 7f8ac996d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ac415a7e0 0x7f8ac40d0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:02.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.736+0000 7f8ac996d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac415eba0 con 0x7f8ac4154c20 2024-09-11T22:23:02.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.736+0000 7f8ac996d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac40cb830 con 0x7f8ac40b3190 2024-09-11T22:23:02.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.736+0000 7f8ac996d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac415ed20 con 0x7f8ac415a7e0 2024-09-11T22:23:02.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.736+0000 7f8abbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ac4154c20 0x7f8ac4150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:02.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.736+0000 7f8abbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ac4154c20 0x7f8ac4150770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48228/0 (socket says 172.21.15.100:48228) 2024-09-11T22:23:02.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.736+0000 7f8ac2ffd640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ac40b3190 msgr2=0x7f8ac41f0550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2024-09-11T22:23:02.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.736+0000 7f8abbfff640 1 -- 172.21.15.100:0/1551420733 learned_addr learned my addr 172.21.15.100:0/1551420733 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:02.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.736+0000 7f8ac2ffd640 1 --2- 172.21.15.100:0/1551420733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ac40b3190 0x7f8ac41f0550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:23:02.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.736+0000 7f8ac37fe640 1 --2- 172.21.15.100:0/1551420733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ac415a7e0 0x7f8ac40d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:02.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.737+0000 7f8abbfff640 1 -- 172.21.15.100:0/1551420733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ac415a7e0 msgr2=0x7f8ac40d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:02.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.737+0000 7f8abbfff640 1 --2- 172.21.15.100:0/1551420733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ac415a7e0 0x7f8ac40d0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:02.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.737+0000 7f8abbfff640 1 -- 172.21.15.100:0/1551420733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ac40b3190 msgr2=0x7f8ac41f0550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:23:02.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.737+0000 7f8abbfff640 1 --2- 172.21.15.100:0/1551420733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ac40b3190 0x7f8ac41f0550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:02.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.737+0000 7f8abbfff640 1 -- 172.21.15.100:0/1551420733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac4151330 con 0x7f8ac4154c20 2024-09-11T22:23:02.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.737+0000 7f8ac37fe640 1 --2- 172.21.15.100:0/1551420733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ac415a7e0 0x7f8ac40d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:02.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.737+0000 7f8abbfff640 1 --2- 172.21.15.100:0/1551420733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ac4154c20 0x7f8ac4150770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00c4d0 tx=0x7f8aac00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:02.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.737+0000 7f8ac0ff9640 1 -- 172.21.15.100:0/1551420733 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac017070 con 0x7f8ac4154c20 2024-09-11T22:23:02.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.737+0000 7f8ac0ff9640 1 -- 172.21.15.100:0/1551420733 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aac005d00 con 0x7f8ac4154c20 2024-09-11T22:23:02.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.737+0000 7f8ac0ff9640 1 -- 172.21.15.100:0/1551420733 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac0072b0 con 0x7f8ac4154c20 2024-09-11T22:23:02.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.737+0000 7f8ac996d640 1 -- 172.21.15.100:0/1551420733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac4151610 con 0x7f8ac4154c20 2024-09-11T22:23:02.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.737+0000 7f8ac996d640 1 -- 172.21.15.100:0/1551420733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac4151bd0 con 0x7f8ac4154c20 2024-09-11T22:23:02.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.738+0000 7f8ac996d640 1 -- 172.21.15.100:0/1551420733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ac415e490 con 0x7f8ac4154c20 2024-09-11T22:23:02.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.739+0000 7f8ac0ff9640 1 -- 172.21.15.100:0/1551420733 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8aac01a070 con 0x7f8ac4154c20 2024-09-11T22:23:02.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.739+0000 7f8ac0ff9640 1 --2- 172.21.15.100:0/1551420733 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8aa406be10 0x7f8aa406e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:02.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.739+0000 7f8ac0ff9640 1 -- 172.21.15.100:0/1551420733 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f8aac08a570 con 0x7f8ac4154c20 2024-09-11T22:23:02.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.739+0000 7f8ac2ffd640 1 --2- 172.21.15.100:0/1551420733 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8aa406be10 0x7f8aa406e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:02.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.740+0000 7f8ac2ffd640 1 --2- 172.21.15.100:0/1551420733 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8aa406be10 0x7f8aa406e2d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4006fd0 tx=0x7f8ab4006d80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:02.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:02.743+0000 7f8ac0ff9640 1 -- 172.21.15.100:0/1551420733 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8aac058b90 con 0x7f8ac4154c20 2024-09-11T22:23:03.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:03.040+0000 7f8ac996d640 1 -- 172.21.15.100:0/1551420733 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8ac40cbaf0 con 0x7f8ac4154c20 2024-09-11T22:23:03.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:03.040+0000 7f8ac0ff9640 1 -- 172.21.15.100:0/1551420733 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f8aac058490 con 0x7f8ac4154c20 2024-09-11T22:23:03.041 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":18,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:23:03.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:03.042+0000 7f8ac996d640 1 -- 172.21.15.100:0/1551420733 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8aa406be10 msgr2=0x7f8aa406e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:03.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:03.042+0000 7f8ac996d640 1 --2- 172.21.15.100:0/1551420733 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8aa406be10 0x7f8aa406e2d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4006fd0 tx=0x7f8ab4006d80 comp rx=0 tx=0).stop 2024-09-11T22:23:03.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:03.042+0000 7f8ac996d640 1 -- 172.21.15.100:0/1551420733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ac4154c20 msgr2=0x7f8ac4150770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:03.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:03.042+0000 7f8ac996d640 1 --2- 172.21.15.100:0/1551420733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ac4154c20 0x7f8ac4150770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00c4d0 tx=0x7f8aac00c990 comp rx=0 tx=0).stop 2024-09-11T22:23:03.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:03.042+0000 7f8ac996d640 1 -- 172.21.15.100:0/1551420733 shutdown_connections 2024-09-11T22:23:03.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:03.042+0000 7f8ac996d640 1 --2- 172.21.15.100:0/1551420733 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8aa406be10 0x7f8aa406e2d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:03.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:03.042+0000 7f8ac996d640 1 --2- 172.21.15.100:0/1551420733 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ac415a7e0 0x7f8ac40d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:03.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:03.042+0000 7f8ac996d640 1 --2- 172.21.15.100:0/1551420733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ac4154c20 0x7f8ac4150770 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:03.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:03.042+0000 7f8ac996d640 1 --2- 172.21.15.100:0/1551420733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ac40b3190 0x7f8ac41f0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:03.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:03.042+0000 7f8ac996d640 1 -- 172.21.15.100:0/1551420733 >> 172.21.15.100:0/1551420733 conn(0x7f8ac4067d40 msgr2=0x7f8ac40cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:03.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:03.042+0000 7f8ac996d640 1 -- 172.21.15.100:0/1551420733 shutdown_connections 2024-09-11T22:23:03.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:03.042+0000 7f8ac996d640 1 -- 172.21.15.100:0/1551420733 wait complete. 2024-09-11T22:23:06.056 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:23:06.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.155+0000 7f9e99077640 1 Processor -- start 2024-09-11T22:23:06.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.155+0000 7f9e99077640 1 -- start start 2024-09-11T22:23:06.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.156+0000 7f9e99077640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e940c9340 0x7f9e9415e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:06.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.156+0000 7f9e99077640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9e940c9720 0x7f9e940cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:06.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.156+0000 7f9e99077640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e940ca6b0 con 0x7f9e94075a90 2024-09-11T22:23:06.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.156+0000 7f9e99077640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f9e940ca970 con 0x7f9e940c9720 2024-09-11T22:23:06.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.156+0000 7f9e99077640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9e940cac50 con 0x7f9e940c9340 2024-09-11T22:23:06.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.156+0000 7f9e9259c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9e940c9720 0x7f9e940cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:06.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.156+0000 7f9e9359e640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7f9e94075a90 legacy=0x7f9e94154750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2024-09-11T22:23:06.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.156+0000 7f9e9259c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9e940c9720 0x7f9e940cb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48234/0 (socket says 172.21.15.100:48234) 2024-09-11T22:23:06.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.156+0000 7f9e9259c640 1 -- 172.21.15.100:0/1853058093 learned_addr learned my addr 172.21.15.100:0/1853058093 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:06.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.156+0000 7f9e92d9d640 1 --2- 172.21.15.100:0/1853058093 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e940c9340 0x7f9e9415e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:06.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.156+0000 7f9e9259c640 1 -- 172.21.15.100:0/1853058093 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e940c9340 msgr2=0x7f9e9415e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:06.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.156+0000 7f9e9259c640 1 --2- 172.21.15.100:0/1853058093 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e940c9340 0x7f9e9415e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:06.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.156+0000 7f9e9259c640 1 -- 172.21.15.100:0/1853058093 >> v1:172.21.15.167:6789/0 conn(0x7f9e94075a90 legacy=0x7f9e94154750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:23:06.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.156+0000 7f9e9259c640 1 -- 172.21.15.100:0/1853058093 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9415df10 con 0x7f9e940c9720 2024-09-11T22:23:06.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.157+0000 7f9e9259c640 1 --2- 172.21.15.100:0/1853058093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e940c9720 0x7f9e940cb0d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9e88009870 tx=0x7f9e8802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca961ee5e13800c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:06.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.157+0000 7f9e91d9b640 1 -- 172.21.15.100:0/1853058093 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e88037070 con 0x7f9e940c9720 2024-09-11T22:23:06.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.157+0000 7f9e91d9b640 1 -- 172.21.15.100:0/1853058093 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e88032440 con 0x7f9e940c9720 2024-09-11T22:23:06.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.157+0000 7f9e91d9b640 1 -- 172.21.15.100:0/1853058093 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e88032810 con 0x7f9e940c9720 2024-09-11T22:23:06.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.158+0000 7f9e99077640 1 -- 172.21.15.100:0/1853058093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e940c9720 msgr2=0x7f9e940cb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:06.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.158+0000 7f9e99077640 1 --2- 172.21.15.100:0/1853058093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e940c9720 0x7f9e940cb0d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9e88009870 tx=0x7f9e8802a2a0 comp rx=0 tx=0).stop 2024-09-11T22:23:06.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.158+0000 7f9e99077640 1 -- 172.21.15.100:0/1853058093 shutdown_connections 2024-09-11T22:23:06.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.158+0000 7f9e99077640 1 --2- 172.21.15.100:0/1853058093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e940c9720 0x7f9e940cb0d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:06.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.158+0000 7f9e99077640 1 --2- 172.21.15.100:0/1853058093 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e940c9340 0x7f9e9415e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:06.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.158+0000 7f9e99077640 1 -- 172.21.15.100:0/1853058093 >> 172.21.15.100:0/1853058093 conn(0x7f9e9406bc10 msgr2=0x7f9e9406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:06.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.158+0000 7f9e99077640 1 -- 172.21.15.100:0/1853058093 shutdown_connections 2024-09-11T22:23:06.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.158+0000 7f9e99077640 1 -- 172.21.15.100:0/1853058093 wait complete. 2024-09-11T22:23:06.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.160+0000 7f9e99077640 1 Processor -- start 2024-09-11T22:23:06.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.160+0000 7f9e99077640 1 -- start start 2024-09-11T22:23:06.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.160+0000 7f9e99077640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e94075a90 0x7f9e941e61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:06.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.160+0000 7f9e99077640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e940c9340 0x7f9e9414ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:06.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.160+0000 7f9e99077640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e940c9720 0x7f9e941521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:06.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.160+0000 7f9e99077640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9e94154e60 con 0x7f9e94075a90 2024-09-11T22:23:06.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.160+0000 7f9e99077640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9415e4d0 con 0x7f9e940c9720 2024-09-11T22:23:06.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.160+0000 7f9e99077640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9e94154fe0 con 0x7f9e940c9340 2024-09-11T22:23:06.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.160+0000 7f9e92d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e94075a90 0x7f9e941e61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:06.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.160+0000 7f9e92d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e94075a90 0x7f9e941e61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48238/0 (socket says 172.21.15.100:48238) 2024-09-11T22:23:06.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.160+0000 7f9e92d9d640 1 -- 172.21.15.100:0/2401190787 learned_addr learned my addr 172.21.15.100:0/2401190787 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:06.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.160+0000 7f9e9359e640 1 -- 172.21.15.100:0/2401190787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e940c9720 msgr2=0x7f9e941521e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2024-09-11T22:23:06.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.160+0000 7f9e9359e640 1 --2- 172.21.15.100:0/2401190787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e940c9720 0x7f9e941521e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:23:06.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.161+0000 7f9e9259c640 1 --2- 172.21.15.100:0/2401190787 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e940c9340 0x7f9e9414ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:06.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.161+0000 7f9e92d9d640 1 -- 172.21.15.100:0/2401190787 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e940c9340 msgr2=0x7f9e9414ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:06.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.161+0000 7f9e92d9d640 1 --2- 172.21.15.100:0/2401190787 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e940c9340 0x7f9e9414ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:06.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.161+0000 7f9e92d9d640 1 -- 172.21.15.100:0/2401190787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e940c9720 msgr2=0x7f9e941521e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:23:06.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.161+0000 7f9e92d9d640 1 --2- 172.21.15.100:0/2401190787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e940c9720 0x7f9e941521e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:06.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.161+0000 7f9e92d9d640 1 -- 172.21.15.100:0/2401190787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e941555b0 con 0x7f9e94075a90 2024-09-11T22:23:06.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.161+0000 7f9e92d9d640 1 --2- 172.21.15.100:0/2401190787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e94075a90 0x7f9e941e61f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400d830 tx=0x7f9e8400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:06.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.161+0000 7f9e7b7fe640 1 -- 172.21.15.100:0/2401190787 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8400b6c0 con 0x7f9e94075a90 2024-09-11T22:23:06.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.161+0000 7f9e7b7fe640 1 -- 172.21.15.100:0/2401190787 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e84019070 con 0x7f9e94075a90 2024-09-11T22:23:06.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.161+0000 7f9e7b7fe640 1 -- 172.21.15.100:0/2401190787 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8400ba80 con 0x7f9e94075a90 2024-09-11T22:23:06.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.161+0000 7f9e99077640 1 -- 172.21.15.100:0/2401190787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e94155310 con 0x7f9e94075a90 2024-09-11T22:23:06.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.161+0000 7f9e99077640 1 -- 172.21.15.100:0/2401190787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e941f1100 con 0x7f9e94075a90 2024-09-11T22:23:06.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.162+0000 7f9e99077640 1 -- 172.21.15.100:0/2401190787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e9406f090 con 0x7f9e94075a90 2024-09-11T22:23:06.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.163+0000 7f9e7b7fe640 1 -- 172.21.15.100:0/2401190787 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e8401e460 con 0x7f9e94075a90 2024-09-11T22:23:06.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.163+0000 7f9e7b7fe640 1 --2- 172.21.15.100:0/2401190787 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9e8006bde0 0x7f9e8006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:06.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.163+0000 7f9e7b7fe640 1 -- 172.21.15.100:0/2401190787 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f9e8408b940 con 0x7f9e94075a90 2024-09-11T22:23:06.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.163+0000 7f9e9259c640 1 --2- 172.21.15.100:0/2401190787 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9e8006bde0 0x7f9e8006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:06.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.164+0000 7f9e9259c640 1 --2- 172.21.15.100:0/2401190787 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9e8006bde0 0x7f9e8006e2a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9e88034000 tx=0x7f9e8802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:06.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.168+0000 7f9e7b7fe640 1 -- 172.21.15.100:0/2401190787 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9e9406f090 con 0x7f9e94075a90 2024-09-11T22:23:06.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.461+0000 7f9e99077640 1 -- 172.21.15.100:0/2401190787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9e940c6800 con 0x7f9e94075a90 2024-09-11T22:23:06.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.461+0000 7f9e7b7fe640 1 -- 172.21.15.100:0/2401190787 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f9e84059ed0 con 0x7f9e94075a90 2024-09-11T22:23:06.463 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":18,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:23:06.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.464+0000 7f9e99077640 1 -- 172.21.15.100:0/2401190787 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9e8006bde0 msgr2=0x7f9e8006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:06.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.464+0000 7f9e99077640 1 --2- 172.21.15.100:0/2401190787 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9e8006bde0 0x7f9e8006e2a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9e88034000 tx=0x7f9e8802e000 comp rx=0 tx=0).stop 2024-09-11T22:23:06.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.464+0000 7f9e99077640 1 -- 172.21.15.100:0/2401190787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e94075a90 msgr2=0x7f9e941e61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:06.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.464+0000 7f9e99077640 1 --2- 172.21.15.100:0/2401190787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e94075a90 0x7f9e941e61f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400d830 tx=0x7f9e8400dcf0 comp rx=0 tx=0).stop 2024-09-11T22:23:06.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.464+0000 7f9e99077640 1 -- 172.21.15.100:0/2401190787 shutdown_connections 2024-09-11T22:23:06.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.464+0000 7f9e99077640 1 --2- 172.21.15.100:0/2401190787 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9e8006bde0 0x7f9e8006e2a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:06.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.464+0000 7f9e99077640 1 --2- 172.21.15.100:0/2401190787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e940c9720 0x7f9e941521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:06.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.464+0000 7f9e99077640 1 --2- 172.21.15.100:0/2401190787 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e940c9340 0x7f9e9414ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:06.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.464+0000 7f9e99077640 1 --2- 172.21.15.100:0/2401190787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e94075a90 0x7f9e941e61f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:06.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.464+0000 7f9e99077640 1 -- 172.21.15.100:0/2401190787 >> 172.21.15.100:0/2401190787 conn(0x7f9e9406bc10 msgr2=0x7f9e94154520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:06.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.464+0000 7f9e99077640 1 -- 172.21.15.100:0/2401190787 shutdown_connections 2024-09-11T22:23:06.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:06.464+0000 7f9e99077640 1 -- 172.21.15.100:0/2401190787 wait complete. 2024-09-11T22:23:09.477 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:23:09.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:09.590+0000 7f4dda5fd640 1 Processor -- start 2024-09-11T22:23:09.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:09.590+0000 7f4dda5fd640 1 -- start start 2024-09-11T22:23:09.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:09.590+0000 7f4dda5fd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd40cca30 0x7f4dd4159060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:09.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:09.590+0000 7f4dda5fd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4dd406fdf0 0x7f4dd40cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:09.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:09.591+0000 7f4dda5fd640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dd415bd70 con 0x7f4dd40c69b0 2024-09-11T22:23:09.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:09.591+0000 7f4dda5fd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f4dd415c050 con 0x7f4dd406fdf0 2024-09-11T22:23:09.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:09.591+0000 7f4dda5fd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4dd415c330 con 0x7f4dd40cca30 2024-09-11T22:23:09.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:09.591+0000 7f4dd8b9a640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7f4dd406fdf0 msgr2=0x7f4dd40cce10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2024-09-11T22:23:09.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:09.591+0000 7f4dd37fe640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f4dd40c69b0 0x7f4dd406f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51898/0 (socket says 172.21.15.100:51898) 2024-09-11T22:23:09.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:09.591+0000 7f4dd37fe640 1 -- 172.21.15.100:0/2539960851 learned_addr learned my addr 172.21.15.100:0/2539960851 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:23:09.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:09.591+0000 7f4dd8b9a640 1 --2- 172.21.15.100:0/2539960851 >> v2:172.21.15.167:3300/0 conn(0x7f4dd406fdf0 0x7f4dd40cce10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:23:09.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:09.591+0000 7f4dd3fff640 1 --2- 172.21.15.100:0/2539960851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd40cca30 0x7f4dd4159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:09.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:09.591+0000 7f4dd3fff640 1 -- 172.21.15.100:0/2539960851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd40cca30 msgr2=0x7f4dd4159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:23:09.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:09.591+0000 7f4dd3fff640 1 -- 172.21.15.100:0/2539960851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd40cca30 msgr2=0x7f4dd4159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:23:09.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:09.591+0000 7f4dd3fff640 1 --2- 172.21.15.100:0/2539960851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd40cca30 0x7f4dd4159060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:23:09.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:09.591+0000 7f4dd3fff640 1 --2- 172.21.15.100:0/2539960851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd40cca30 0x7f4dd4159060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:23:09.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:09.792+0000 7f4dd8b9a640 1 -- 172.21.15.100:0/2539960851 >> v2:172.21.15.167:3300/0 conn(0x7f4dd406fdf0 msgr2=0x7f4dd40cce10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2024-09-11T22:23:09.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:09.792+0000 7f4dd8b9a640 1 --2- 172.21.15.100:0/2539960851 >> v2:172.21.15.167:3300/0 conn(0x7f4dd406fdf0 0x7f4dd40cce10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:23:09.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:09.792+0000 7f4dd3fff640 1 --2- 172.21.15.100:0/2539960851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd40cca30 0x7f4dd4159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:09.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:09.792+0000 7f4dd3fff640 1 -- 172.21.15.100:0/2539960851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd40cca30 msgr2=0x7f4dd4159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:23:09.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:09.792+0000 7f4dd3fff640 1 -- 172.21.15.100:0/2539960851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd40cca30 msgr2=0x7f4dd4159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:23:09.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:09.792+0000 7f4dd3fff640 1 --2- 172.21.15.100:0/2539960851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd40cca30 0x7f4dd4159060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:23:09.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:09.792+0000 7f4dd3fff640 1 --2- 172.21.15.100:0/2539960851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd40cca30 0x7f4dd4159060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:23:10.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:10.193+0000 7f4dd8b9a640 1 -- 172.21.15.100:0/2539960851 >> v2:172.21.15.167:3300/0 conn(0x7f4dd406fdf0 msgr2=0x7f4dd40cce10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2024-09-11T22:23:10.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:10.193+0000 7f4dd8b9a640 1 --2- 172.21.15.100:0/2539960851 >> v2:172.21.15.167:3300/0 conn(0x7f4dd406fdf0 0x7f4dd40cce10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:23:10.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:10.193+0000 7f4dd3fff640 1 --2- 172.21.15.100:0/2539960851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd40cca30 0x7f4dd4159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:10.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:10.193+0000 7f4dd3fff640 1 -- 172.21.15.100:0/2539960851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd40cca30 msgr2=0x7f4dd4159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:23:10.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:10.193+0000 7f4dd3fff640 1 -- 172.21.15.100:0/2539960851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd40cca30 msgr2=0x7f4dd4159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:23:10.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:10.193+0000 7f4dd3fff640 1 --2- 172.21.15.100:0/2539960851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd40cca30 0x7f4dd4159060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:23:10.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:10.193+0000 7f4dd3fff640 1 --2- 172.21.15.100:0/2539960851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd40cca30 0x7f4dd4159060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:23:10.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:10.994+0000 7f4dd8b9a640 1 -- 172.21.15.100:0/2539960851 >> v2:172.21.15.167:3300/0 conn(0x7f4dd406fdf0 msgr2=0x7f4dd40cce10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2024-09-11T22:23:10.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:10.994+0000 7f4dd8b9a640 1 --2- 172.21.15.100:0/2539960851 >> v2:172.21.15.167:3300/0 conn(0x7f4dd406fdf0 0x7f4dd40cce10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:23:10.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:10.994+0000 7f4dd3fff640 1 --2- 172.21.15.100:0/2539960851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd40cca30 0x7f4dd4159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:10.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:10.994+0000 7f4dd3fff640 1 -- 172.21.15.100:0/2539960851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd40cca30 msgr2=0x7f4dd4159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:23:10.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:10.994+0000 7f4dd3fff640 1 -- 172.21.15.100:0/2539960851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd40cca30 msgr2=0x7f4dd4159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:23:10.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:10.994+0000 7f4dd3fff640 1 --2- 172.21.15.100:0/2539960851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd40cca30 0x7f4dd4159060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:23:10.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:10.994+0000 7f4dd3fff640 1 --2- 172.21.15.100:0/2539960851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd40cca30 0x7f4dd4159060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:23:12.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:12.591+0000 7f4dd1ffb640 1 -- 172.21.15.100:0/2539960851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd40cca30 msgr2=0x7f4dd4159060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:23:12.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:12.591+0000 7f4dd1ffb640 1 --2- 172.21.15.100:0/2539960851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd40cca30 0x7f4dd4159060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:12.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:12.591+0000 7f4dd1ffb640 1 -- 172.21.15.100:0/2539960851 >> v2:172.21.15.167:3300/0 conn(0x7f4dd406fdf0 msgr2=0x7f4dd40cce10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:23:12.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:12.591+0000 7f4dd1ffb640 1 --2- 172.21.15.100:0/2539960851 >> v2:172.21.15.167:3300/0 conn(0x7f4dd406fdf0 0x7f4dd40cce10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:12.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:12.591+0000 7f4dd1ffb640 1 -- 172.21.15.100:0/2539960851 >> v1:172.21.15.100:6789/0 conn(0x7f4dd40c69b0 legacy=0x7f4dd406f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:12.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:12.591+0000 7f4dd1ffb640 1 --2- 172.21.15.100:0/2539960851 >> v2:172.21.15.100:3300/0 conn(0x7f4dc0007370 0x7f4dc0009830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:12.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:12.591+0000 7f4dd1ffb640 1 -- 172.21.15.100:0/2539960851 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dd415c610 con 0x7f4dc00036c0 2024-09-11T22:23:12.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:12.591+0000 7f4dd1ffb640 1 -- 172.21.15.100:0/2539960851 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f4dd415c050 con 0x7f4dc0007370 2024-09-11T22:23:12.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:12.591+0000 7f4dd3fff640 1 -- 172.21.15.100:0/2539960851 >> v1:172.21.15.167:6789/0 conn(0x7f4dc00036c0 legacy=0x7f4dc0005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2024-09-11T22:23:12.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:12.591+0000 7f4dd37fe640 1 --2- 172.21.15.100:0/2539960851 >> v2:172.21.15.100:3300/0 conn(0x7f4dc0007370 0x7f4dc0009830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:12.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:12.591+0000 7f4dd37fe640 1 -- 172.21.15.100:0/2539960851 >> v2:172.21.15.100:3300/0 conn(0x7f4dc0007370 msgr2=0x7f4dc0009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:23:12.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:12.591+0000 7f4dd37fe640 1 -- 172.21.15.100:0/2539960851 >> v2:172.21.15.100:3300/0 conn(0x7f4dc0007370 msgr2=0x7f4dc0009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:23:12.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:12.591+0000 7f4dd37fe640 1 --2- 172.21.15.100:0/2539960851 >> v2:172.21.15.100:3300/0 conn(0x7f4dc0007370 0x7f4dc0009830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:23:12.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:12.591+0000 7f4dd37fe640 1 --2- 172.21.15.100:0/2539960851 >> v2:172.21.15.100:3300/0 conn(0x7f4dc0007370 0x7f4dc0009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:23:12.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:12.792+0000 7f4dd3fff640 1 -- 172.21.15.100:0/2539960851 >> v1:172.21.15.167:6789/0 conn(0x7f4dc00036c0 legacy=0x7f4dc0005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2024-09-11T22:23:12.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:12.792+0000 7f4dd37fe640 1 --2- 172.21.15.100:0/2539960851 >> v2:172.21.15.100:3300/0 conn(0x7f4dc0007370 0x7f4dc0009830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:12.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:12.792+0000 7f4dd37fe640 1 -- 172.21.15.100:0/2539960851 >> v2:172.21.15.100:3300/0 conn(0x7f4dc0007370 msgr2=0x7f4dc0009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:23:12.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:12.792+0000 7f4dd37fe640 1 -- 172.21.15.100:0/2539960851 >> v2:172.21.15.100:3300/0 conn(0x7f4dc0007370 msgr2=0x7f4dc0009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:23:12.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:12.792+0000 7f4dd37fe640 1 --2- 172.21.15.100:0/2539960851 >> v2:172.21.15.100:3300/0 conn(0x7f4dc0007370 0x7f4dc0009830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:23:12.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:12.792+0000 7f4dd37fe640 1 --2- 172.21.15.100:0/2539960851 >> v2:172.21.15.100:3300/0 conn(0x7f4dc0007370 0x7f4dc0009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:23:13.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.193+0000 7f4dd3fff640 1 -- 172.21.15.100:0/2539960851 >> v1:172.21.15.167:6789/0 conn(0x7f4dc00036c0 legacy=0x7f4dc0005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2024-09-11T22:23:13.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.193+0000 7f4dd37fe640 1 --2- 172.21.15.100:0/2539960851 >> v2:172.21.15.100:3300/0 conn(0x7f4dc0007370 0x7f4dc0009830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:13.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.193+0000 7f4dd37fe640 1 -- 172.21.15.100:0/2539960851 >> v2:172.21.15.100:3300/0 conn(0x7f4dc0007370 msgr2=0x7f4dc0009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:23:13.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.193+0000 7f4dd37fe640 1 -- 172.21.15.100:0/2539960851 >> v2:172.21.15.100:3300/0 conn(0x7f4dc0007370 msgr2=0x7f4dc0009830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:23:13.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.193+0000 7f4dd37fe640 1 --2- 172.21.15.100:0/2539960851 >> v2:172.21.15.100:3300/0 conn(0x7f4dc0007370 0x7f4dc0009830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:23:13.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.193+0000 7f4dd37fe640 1 --2- 172.21.15.100:0/2539960851 >> v2:172.21.15.100:3300/0 conn(0x7f4dc0007370 0x7f4dc0009830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:23:13.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.994+0000 7f4dd3fff640 1 -- 172.21.15.100:0/2539960851 >> v1:172.21.15.167:6789/0 conn(0x7f4dc00036c0 legacy=0x7f4dc0005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2024-09-11T22:23:13.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.994+0000 7f4dd37fe640 1 --2- 172.21.15.100:0/2539960851 >> v2:172.21.15.100:3300/0 conn(0x7f4dc0007370 0x7f4dc0009830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:13.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.994+0000 7f4dd37fe640 1 -- 172.21.15.100:0/2539960851 >> v1:172.21.15.167:6789/0 conn(0x7f4dc00036c0 legacy=0x7f4dc0005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:23:13.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.994+0000 7f4dd37fe640 1 -- 172.21.15.100:0/2539960851 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc000af90 con 0x7f4dc0007370 2024-09-11T22:23:13.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.995+0000 7f4dd37fe640 1 --2- 172.21.15.100:0/2539960851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dc0007370 0x7f4dc0009830 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40708b0 tx=0x7f4dc802a790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6294d30ca706147a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:13.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.995+0000 7f4dd2ffd640 1 -- 172.21.15.100:0/2539960851 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8038070 con 0x7f4dc0007370 2024-09-11T22:23:13.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.995+0000 7f4dd2ffd640 1 -- 172.21.15.100:0/2539960851 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dc8033410 con 0x7f4dc0007370 2024-09-11T22:23:13.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.995+0000 7f4dd2ffd640 1 -- 172.21.15.100:0/2539960851 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc80337e0 con 0x7f4dc0007370 2024-09-11T22:23:13.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.996+0000 7f4dda5fd640 1 -- 172.21.15.100:0/2539960851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dc0007370 msgr2=0x7f4dc0009830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:13.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.996+0000 7f4dda5fd640 1 --2- 172.21.15.100:0/2539960851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dc0007370 0x7f4dc0009830 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40708b0 tx=0x7f4dc802a790 comp rx=0 tx=0).stop 2024-09-11T22:23:13.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.996+0000 7f4dd8b9a640 1 -- 172.21.15.100:0/2539960851 reap_dead start 2024-09-11T22:23:13.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.996+0000 7f4dda5fd640 1 -- 172.21.15.100:0/2539960851 shutdown_connections 2024-09-11T22:23:13.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.996+0000 7f4dda5fd640 1 --2- 172.21.15.100:0/2539960851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dc0007370 0x7f4dc0009830 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:13.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.996+0000 7f4dda5fd640 1 -- 172.21.15.100:0/2539960851 >> 172.21.15.100:0/2539960851 conn(0x7f4dd406bdf0 msgr2=0x7f4dd406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:13.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.996+0000 7f4dda5fd640 1 -- 172.21.15.100:0/2539960851 shutdown_connections 2024-09-11T22:23:13.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.996+0000 7f4dda5fd640 1 -- 172.21.15.100:0/2539960851 wait complete. 2024-09-11T22:23:13.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.998+0000 7f4dda5fd640 1 Processor -- start 2024-09-11T22:23:13.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.998+0000 7f4dda5fd640 1 -- start start 2024-09-11T22:23:14.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.999+0000 7f4dda5fd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dc0007370 0x7f4dd41e23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.999+0000 7f4dda5fd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd41e3cc0 0x7f4dd40c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.999+0000 7f4dda5fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd41e3590 0x7f4dd41ee8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.999+0000 7f4dda5fd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd4152cc0 con 0x7f4dc0007370 2024-09-11T22:23:14.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.999+0000 7f4dda5fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd4152b40 con 0x7f4dd41e3590 2024-09-11T22:23:14.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.999+0000 7f4dda5fd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4dd40c70d0 con 0x7f4dd41e3cc0 2024-09-11T22:23:14.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.999+0000 7f4dd3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dc0007370 0x7f4dd41e23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.999+0000 7f4dd3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dc0007370 0x7f4dd41e23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60270/0 (socket says 172.21.15.100:60270) 2024-09-11T22:23:14.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.999+0000 7f4dd3fff640 1 -- 172.21.15.100:0/1918537265 learned_addr learned my addr 172.21.15.100:0/1918537265 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:14.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.999+0000 7f4dd8b9a640 1 -- 172.21.15.100:0/1918537265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd41e3590 msgr2=0x7f4dd41ee8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2024-09-11T22:23:14.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.999+0000 7f4dd8b9a640 1 --2- 172.21.15.100:0/1918537265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd41e3590 0x7f4dd41ee8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:23:14.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.999+0000 7f4dd37fe640 1 --2- 172.21.15.100:0/1918537265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd41e3cc0 0x7f4dd40c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.999+0000 7f4dd3fff640 1 -- 172.21.15.100:0/1918537265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd41e3cc0 msgr2=0x7f4dd40c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.999+0000 7f4dd3fff640 1 --2- 172.21.15.100:0/1918537265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd41e3cc0 0x7f4dd40c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.999+0000 7f4dd3fff640 1 -- 172.21.15.100:0/1918537265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd41e3590 msgr2=0x7f4dd41ee8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:23:14.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.999+0000 7f4dd3fff640 1 --2- 172.21.15.100:0/1918537265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd41e3590 0x7f4dd41ee8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.999+0000 7f4dd3fff640 1 -- 172.21.15.100:0/1918537265 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd414e900 con 0x7f4dc0007370 2024-09-11T22:23:14.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:13.999+0000 7f4dd37fe640 1 --2- 172.21.15.100:0/1918537265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd41e3cc0 0x7f4dd40c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:14.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.000+0000 7f4dd3fff640 1 --2- 172.21.15.100:0/1918537265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dc0007370 0x7f4dd41e23f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4003fd0 tx=0x7f4dc4013a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:14.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.000+0000 7f4dd0ff9640 1 -- 172.21.15.100:0/1918537265 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc401a030 con 0x7f4dc0007370 2024-09-11T22:23:14.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.000+0000 7f4dd0ff9640 1 -- 172.21.15.100:0/1918537265 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dc4015690 con 0x7f4dc0007370 2024-09-11T22:23:14.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.000+0000 7f4dda5fd640 1 -- 172.21.15.100:0/1918537265 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd414eee0 con 0x7f4dc0007370 2024-09-11T22:23:14.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.000+0000 7f4dd0ff9640 1 -- 172.21.15.100:0/1918537265 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4015aa0 con 0x7f4dc0007370 2024-09-11T22:23:14.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.000+0000 7f4dda5fd640 1 -- 172.21.15.100:0/1918537265 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dd414cde0 con 0x7f4dc0007370 2024-09-11T22:23:14.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.001+0000 7f4dda5fd640 1 -- 172.21.15.100:0/1918537265 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dd40c73d0 con 0x7f4dc0007370 2024-09-11T22:23:14.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.002+0000 7f4dd0ff9640 1 -- 172.21.15.100:0/1918537265 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4dc401d030 con 0x7f4dc0007370 2024-09-11T22:23:14.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.002+0000 7f4dd0ff9640 1 --2- 172.21.15.100:0/1918537265 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4dc006cc40 0x7f4dc006f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.002+0000 7f4dd0ff9640 1 -- 172.21.15.100:0/1918537265 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f4dc408b6d0 con 0x7f4dc0007370 2024-09-11T22:23:14.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.002+0000 7f4dd37fe640 1 --2- 172.21.15.100:0/1918537265 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4dc006cc40 0x7f4dc006f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.003+0000 7f4dd37fe640 1 --2- 172.21.15.100:0/1918537265 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4dc006cc40 0x7f4dc006f100 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8035000 tx=0x7f4dc8010040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:14.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.007+0000 7f4dd0ff9640 1 -- 172.21.15.100:0/1918537265 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4dc4024030 con 0x7f4dc0007370 2024-09-11T22:23:14.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.287+0000 7f4dda5fd640 1 -- 172.21.15.100:0/1918537265 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4dd4075ce0 con 0x7f4dc0007370 2024-09-11T22:23:14.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.287+0000 7f4dd0ff9640 1 -- 172.21.15.100:0/1918537265 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7f4dc4059cf0 con 0x7f4dc0007370 2024-09-11T22:23:14.288 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":22,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:23:14.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.290+0000 7f4dda5fd640 1 -- 172.21.15.100:0/1918537265 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4dc006cc40 msgr2=0x7f4dc006f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.290+0000 7f4dda5fd640 1 --2- 172.21.15.100:0/1918537265 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4dc006cc40 0x7f4dc006f100 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8035000 tx=0x7f4dc8010040 comp rx=0 tx=0).stop 2024-09-11T22:23:14.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.290+0000 7f4dda5fd640 1 -- 172.21.15.100:0/1918537265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dc0007370 msgr2=0x7f4dd41e23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.290+0000 7f4dda5fd640 1 --2- 172.21.15.100:0/1918537265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dc0007370 0x7f4dd41e23f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4003fd0 tx=0x7f4dc4013a20 comp rx=0 tx=0).stop 2024-09-11T22:23:14.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.290+0000 7f4dda5fd640 1 -- 172.21.15.100:0/1918537265 shutdown_connections 2024-09-11T22:23:14.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.290+0000 7f4dda5fd640 1 --2- 172.21.15.100:0/1918537265 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4dc006cc40 0x7f4dc006f100 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.290+0000 7f4dda5fd640 1 --2- 172.21.15.100:0/1918537265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dd41e3590 0x7f4dd41ee8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.290+0000 7f4dda5fd640 1 --2- 172.21.15.100:0/1918537265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dd41e3cc0 0x7f4dd40c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.290+0000 7f4dda5fd640 1 --2- 172.21.15.100:0/1918537265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dc0007370 0x7f4dd41e23f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.290+0000 7f4dda5fd640 1 -- 172.21.15.100:0/1918537265 >> 172.21.15.100:0/1918537265 conn(0x7f4dd406bdf0 msgr2=0x7f4dd414c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:14.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.290+0000 7f4dda5fd640 1 -- 172.21.15.100:0/1918537265 shutdown_connections 2024-09-11T22:23:14.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.290+0000 7f4dda5fd640 1 -- 172.21.15.100:0/1918537265 wait complete. 2024-09-11T22:23:14.306 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-11T22:23:14.306 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-11T22:23:14.306 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:23:14.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.433+0000 7f968b6f1640 1 Processor -- start 2024-09-11T22:23:14.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.433+0000 7f968b6f1640 1 -- start start 2024-09-11T22:23:14.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.434+0000 7f968b6f1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f968406c3a0 0x7f9684073880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.434+0000 7f968b6f1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f968406cee0 0x7f9684073dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.434+0000 7f968b6f1640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96840687e0 con 0x7f96840b20e0 2024-09-11T22:23:14.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.434+0000 7f968b6f1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f96840c41a0 con 0x7f968406c3a0 2024-09-11T22:23:14.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.434+0000 7f968b6f1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9684072860 con 0x7f968406cee0 2024-09-11T22:23:14.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.435+0000 7f9688c8c640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7f968406c3a0 msgr2=0x7f9684073880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2024-09-11T22:23:14.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.435+0000 7f9688c8c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f968406c3a0 0x7f9684073880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:23:14.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.435+0000 7f968948d640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f96840b20e0 0x7f9684072cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56424/0 (socket says 172.21.15.100:56424) 2024-09-11T22:23:14.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.435+0000 7f968948d640 1 -- 172.21.15.100:0/388893323 learned_addr learned my addr 172.21.15.100:0/388893323 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:23:14.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.435+0000 7f9689c8e640 1 --2- 172.21.15.100:0/388893323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f968406cee0 0x7f9684073dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.435+0000 7f967bfff640 1 -- 172.21.15.100:0/388893323 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 43041293 0 0) 0x7f96840687e0 con 0x7f96840b20e0 2024-09-11T22:23:14.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.435+0000 7f967bfff640 1 -- 172.21.15.100:0/388893323 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9670003520 con 0x7f96840b20e0 2024-09-11T22:23:14.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.435+0000 7f9689c8e640 1 -- 172.21.15.100:0/388893323 >> v2:172.21.15.167:3300/0 conn(0x7f968406c3a0 msgr2=0x7f9684073880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:23:14.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.435+0000 7f9689c8e640 1 --2- 172.21.15.100:0/388893323 >> v2:172.21.15.167:3300/0 conn(0x7f968406c3a0 0x7f9684073880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.435+0000 7f9689c8e640 1 -- 172.21.15.100:0/388893323 >> v1:172.21.15.100:6789/0 conn(0x7f96840b20e0 legacy=0x7f9684072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.435+0000 7f9689c8e640 1 -- 172.21.15.100:0/388893323 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968406c890 con 0x7f968406cee0 2024-09-11T22:23:14.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.436+0000 7f9689c8e640 1 --2- 172.21.15.100:0/388893323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f968406cee0 0x7f9684073dc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f967c009d90 tx=0x7f967c02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df7243468f783d37 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:14.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.436+0000 7f967bfff640 1 -- 172.21.15.100:0/388893323 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967c007740 con 0x7f968406cee0 2024-09-11T22:23:14.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.436+0000 7f967bfff640 1 -- 172.21.15.100:0/388893323 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f967c0078e0 con 0x7f968406cee0 2024-09-11T22:23:14.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.436+0000 7f967bfff640 1 -- 172.21.15.100:0/388893323 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967c007c90 con 0x7f968406cee0 2024-09-11T22:23:14.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.437+0000 7f968b6f1640 1 -- 172.21.15.100:0/388893323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f968406cee0 msgr2=0x7f9684073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.437+0000 7f968b6f1640 1 --2- 172.21.15.100:0/388893323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f968406cee0 0x7f9684073dc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f967c009d90 tx=0x7f967c02a710 comp rx=0 tx=0).stop 2024-09-11T22:23:14.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.437+0000 7f968b6f1640 1 -- 172.21.15.100:0/388893323 shutdown_connections 2024-09-11T22:23:14.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.437+0000 7f968b6f1640 1 --2- 172.21.15.100:0/388893323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f968406cee0 0x7f9684073dc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.437+0000 7f968b6f1640 1 --2- 172.21.15.100:0/388893323 >> v2:172.21.15.167:3300/0 conn(0x7f968406c3a0 0x7f9684073880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.437+0000 7f968b6f1640 1 -- 172.21.15.100:0/388893323 >> 172.21.15.100:0/388893323 conn(0x7f968406ee80 msgr2=0x7f9684070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:14.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.437+0000 7f968b6f1640 1 -- 172.21.15.100:0/388893323 shutdown_connections 2024-09-11T22:23:14.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.437+0000 7f968b6f1640 1 -- 172.21.15.100:0/388893323 wait complete. 2024-09-11T22:23:14.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.438+0000 7f968b6f1640 1 Processor -- start 2024-09-11T22:23:14.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.438+0000 7f968b6f1640 1 -- start start 2024-09-11T22:23:14.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.439+0000 7f968b6f1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f968406c3a0 0x7f96841f4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.439+0000 7f968b6f1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f968406cee0 0x7f96841f15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.439+0000 7f968b6f1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96840b20e0 0x7f96840cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.439+0000 7f968b6f1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f96840b24c0 con 0x7f968406cee0 2024-09-11T22:23:14.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.439+0000 7f968b6f1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f96840c7e60 con 0x7f968406c3a0 2024-09-11T22:23:14.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.439+0000 7f968b6f1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f96840c8140 con 0x7f96840b20e0 2024-09-11T22:23:14.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.439+0000 7f9688c8c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f968406cee0 0x7f96841f15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.439+0000 7f968948d640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f968406c3a0 msgr2=0x7f96841f4b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2024-09-11T22:23:14.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.439+0000 7f968948d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f968406c3a0 0x7f96841f4b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:23:14.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.439+0000 7f9688c8c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f968406cee0 0x7f96841f15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60284/0 (socket says 172.21.15.100:60284) 2024-09-11T22:23:14.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.439+0000 7f9688c8c640 1 -- 172.21.15.100:0/4014305795 learned_addr learned my addr 172.21.15.100:0/4014305795 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:14.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.439+0000 7f9689c8e640 1 --2- 172.21.15.100:0/4014305795 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96840b20e0 0x7f96840cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.440+0000 7f9688c8c640 1 -- 172.21.15.100:0/4014305795 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96840b20e0 msgr2=0x7f96840cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.440+0000 7f9688c8c640 1 --2- 172.21.15.100:0/4014305795 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96840b20e0 0x7f96840cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.440+0000 7f9688c8c640 1 -- 172.21.15.100:0/4014305795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f968406c3a0 msgr2=0x7f96841f4b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:23:14.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.440+0000 7f9688c8c640 1 --2- 172.21.15.100:0/4014305795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f968406c3a0 0x7f96841f4b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.440+0000 7f9688c8c640 1 -- 172.21.15.100:0/4014305795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96840cafc0 con 0x7f968406cee0 2024-09-11T22:23:14.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.440+0000 7f9688c8c640 1 --2- 172.21.15.100:0/4014305795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f968406cee0 0x7f96841f15b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f967400b4e0 tx=0x7f967400b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:14.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.440+0000 7f9679ffb640 1 -- 172.21.15.100:0/4014305795 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9674003db0 con 0x7f968406cee0 2024-09-11T22:23:14.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.440+0000 7f9679ffb640 1 -- 172.21.15.100:0/4014305795 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9674015070 con 0x7f968406cee0 2024-09-11T22:23:14.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.440+0000 7f968b6f1640 1 -- 172.21.15.100:0/4014305795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96841f1af0 con 0x7f968406cee0 2024-09-11T22:23:14.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.440+0000 7f9679ffb640 1 -- 172.21.15.100:0/4014305795 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96740052b0 con 0x7f968406cee0 2024-09-11T22:23:14.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.440+0000 7f968b6f1640 1 -- 172.21.15.100:0/4014305795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96840cb540 con 0x7f968406cee0 2024-09-11T22:23:14.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.441+0000 7f968b6f1640 1 --2- 172.21.15.100:0/4014305795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f968414f4d0 0x7f96841f0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.441+0000 7f968b6f1640 1 -- 172.21.15.100:0/4014305795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f96840cdea0 con 0x7f968414f4d0 2024-09-11T22:23:14.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.441+0000 7f968948d640 1 --2- 172.21.15.100:0/4014305795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f968414f4d0 0x7f96841f0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.442+0000 7f968948d640 1 -- 172.21.15.100:0/4014305795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f968414b590 con 0x7f968414f4d0 2024-09-11T22:23:14.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.442+0000 7f968948d640 1 --2- 172.21.15.100:0/4014305795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f968414f4d0 0x7f96841f0ba0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f96840689b0 tx=0x7f968000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:14.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.442+0000 7f9679ffb640 1 -- 172.21.15.100:0/4014305795 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9674005450 con 0x7f968406cee0 2024-09-11T22:23:14.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.442+0000 7f9679ffb640 1 --2- 172.21.15.100:0/4014305795 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f966806bde0 0x7f966806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.443+0000 7f9689c8e640 1 --2- 172.21.15.100:0/4014305795 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f966806bde0 0x7f966806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.443+0000 7f9679ffb640 1 -- 172.21.15.100:0/4014305795 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9680017070 con 0x7f968414f4d0 2024-09-11T22:23:14.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.443+0000 7f9679ffb640 1 -- 172.21.15.100:0/4014305795 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f967408b080 con 0x7f968406cee0 2024-09-11T22:23:14.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.443+0000 7f9679ffb640 1 -- 172.21.15.100:0/4014305795 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9680005ce0 con 0x7f968414f4d0 2024-09-11T22:23:14.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.443+0000 7f9679ffb640 1 -- 172.21.15.100:0/4014305795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f968414f4d0 msgr2=0x7f96841f0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.443+0000 7f9679ffb640 1 --2- 172.21.15.100:0/4014305795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f968414f4d0 0x7f96841f0ba0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f96840689b0 tx=0x7f968000c810 comp rx=0 tx=0).stop 2024-09-11T22:23:14.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.443+0000 7f9679ffb640 1 -- 172.21.15.100:0/4014305795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f968414f4d0 msgr2=0x7f96841f0ba0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:23:14.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.443+0000 7f9679ffb640 1 --2- 172.21.15.100:0/4014305795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f968414f4d0 0x7f96841f0ba0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.443+0000 7f9689c8e640 1 --2- 172.21.15.100:0/4014305795 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f966806bde0 0x7f966806e2a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f967c034000 tx=0x7f967c02f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:14.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.450+0000 7f968b6f1640 1 --2- 172.21.15.100:0/4014305795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96840cb980 0x7f9684156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.450+0000 7f968b6f1640 1 -- 172.21.15.100:0/4014305795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f96840706f0 con 0x7f96840cb980 2024-09-11T22:23:14.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.450+0000 7f968948d640 1 --2- 172.21.15.100:0/4014305795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96840cb980 0x7f9684156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.450+0000 7f968948d640 1 -- 172.21.15.100:0/4014305795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f968406ca90 con 0x7f96840cb980 2024-09-11T22:23:14.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.450+0000 7f968948d640 1 --2- 172.21.15.100:0/4014305795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96840cb980 0x7f9684156cc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9680000c00 tx=0x7f9680000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:14.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.450+0000 7f9679ffb640 1 -- 172.21.15.100:0/4014305795 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9680017030 con 0x7f96840cb980 2024-09-11T22:23:14.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.451+0000 7f9679ffb640 1 -- 172.21.15.100:0/4014305795 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4877 (secure 0 0 0) 0x7f9680022410 con 0x7f96840cb980 2024-09-11T22:23:14.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.451+0000 7f9679ffb640 1 -- 172.21.15.100:0/4014305795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96840cb980 msgr2=0x7f9684156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.451+0000 7f9679ffb640 1 --2- 172.21.15.100:0/4014305795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96840cb980 0x7f9684156cc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9680000c00 tx=0x7f9680000ed0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.451+0000 7f9679ffb640 1 -- 172.21.15.100:0/4014305795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96840cb980 msgr2=0x7f9684156cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:23:14.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.451+0000 7f9679ffb640 1 --2- 172.21.15.100:0/4014305795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96840cb980 0x7f9684156cc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.452 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:23:14.452 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:23:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:23:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:23:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 22, 2024-09-11T22:23:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 33195, 2024-09-11T22:23:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:23:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:23:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:23:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:23:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:23:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:23:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:23:14.453 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:23:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:23:14.454 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:23:14.455 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:23:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:23:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:23:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:23:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:23:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:23:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:23:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:23:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:23:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:23:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:23:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:23:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:23:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:23:14.456 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:23:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:23:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:14.457 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:23:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:23:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:23:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:23:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:23:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.458 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:23:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:23:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:23:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:14.459 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:23:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:23:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:23:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.460 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:23:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:23:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:23:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.461 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:23:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:23:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:23:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:23:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:14.462 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:23:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:23:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:23:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:23:14.463 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:23:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:23:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:23:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:23:14.464 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:23:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:23:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:23:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.465 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:23:14.466 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:23:14.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.451+0000 7f968b6f1640 1 -- 172.21.15.100:0/4014305795 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f966806bde0 msgr2=0x7f966806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.451+0000 7f968b6f1640 1 --2- 172.21.15.100:0/4014305795 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f966806bde0 0x7f966806e2a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f967c034000 tx=0x7f967c02f000 comp rx=0 tx=0).stop 2024-09-11T22:23:14.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.451+0000 7f968b6f1640 1 -- 172.21.15.100:0/4014305795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f968406cee0 msgr2=0x7f96841f15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.451+0000 7f968b6f1640 1 --2- 172.21.15.100:0/4014305795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f968406cee0 0x7f96841f15b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f967400b4e0 tx=0x7f967400b9a0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.451+0000 7f9689c8e640 1 -- 172.21.15.100:0/4014305795 reap_dead start 2024-09-11T22:23:14.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.451+0000 7f9689c8e640 1 -- 172.21.15.100:0/4014305795 reap_dead start 2024-09-11T22:23:14.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.451+0000 7f968b6f1640 1 -- 172.21.15.100:0/4014305795 shutdown_connections 2024-09-11T22:23:14.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.451+0000 7f968b6f1640 1 -- 172.21.15.100:0/4014305795 >> 172.21.15.100:0/4014305795 conn(0x7f968406ee80 msgr2=0x7f968415bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:14.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.451+0000 7f968b6f1640 1 -- 172.21.15.100:0/4014305795 shutdown_connections 2024-09-11T22:23:14.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.451+0000 7f968b6f1640 1 -- 172.21.15.100:0/4014305795 wait complete. 2024-09-11T22:23:14.468 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:23:14.468 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-11T22:23:14.468 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:23:14.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.587+0000 7f06bed31640 1 Processor -- start 2024-09-11T22:23:14.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.587+0000 7f06bed31640 1 -- start start 2024-09-11T22:23:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06bed31640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f06b80b0c00 0x7f06b806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06bed31640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b80c98f0 con 0x7f06b8152a80 2024-09-11T22:23:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06bed31640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b80c9050 con 0x7f06b80c8b10 2024-09-11T22:23:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06bed31640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f06b8152e60 con 0x7f06b80b0c00 2024-09-11T22:23:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06bcacd640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f06b8152a80 0x7f06b8159030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56432/0 (socket says 172.21.15.100:56432) 2024-09-11T22:23:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06bcacd640 1 -- 172.21.15.100:0/1079458300 learned_addr learned my addr 172.21.15.100:0/1079458300 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:23:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06b7fff640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7f06b80c8b10 legacy=0x7f06b80cb020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2024-09-11T22:23:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06bd2ce640 1 -- 172.21.15.100:0/1079458300 >> v2:172.21.15.167:3300/0 conn(0x7f06b80b0c00 msgr2=0x7f06b806ff90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2024-09-11T22:23:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06bd2ce640 1 --2- 172.21.15.100:0/1079458300 >> v2:172.21.15.167:3300/0 conn(0x7f06b80b0c00 0x7f06b806ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:23:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06b77fe640 1 -- 172.21.15.100:0/1079458300 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3969103051 0 0) 0x7f06b80c98f0 con 0x7f06b8152a80 2024-09-11T22:23:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06b77fe640 1 -- 172.21.15.100:0/1079458300 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06a8003520 con 0x7f06b8152a80 2024-09-11T22:23:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06b77fe640 1 -- 172.21.15.100:0/1079458300 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1404054905 0 0) 0x7f06a8003520 con 0x7f06b8152a80 2024-09-11T22:23:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06b77fe640 1 -- 172.21.15.100:0/1079458300 >> v2:172.21.15.167:3300/0 conn(0x7f06b80b0c00 msgr2=0x7f06b806ff90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:23:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06b77fe640 1 --2- 172.21.15.100:0/1079458300 >> v2:172.21.15.167:3300/0 conn(0x7f06b80b0c00 0x7f06b806ff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06b77fe640 1 -- 172.21.15.100:0/1079458300 >> v1:172.21.15.167:6789/0 conn(0x7f06b80c8b10 legacy=0x7f06b80cb020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:23:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06b77fe640 1 -- 172.21.15.100:0/1079458300 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b80c9330 con 0x7f06b8152a80 2024-09-11T22:23:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06b77fe640 1 -- 172.21.15.100:0/1079458300 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f06ac001670 con 0x7f06b8152a80 2024-09-11T22:23:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06b77fe640 1 -- 172.21.15.100:0/1079458300 >> v1:172.21.15.100:6789/0 conn(0x7f06b8152a80 legacy=0x7f06b8159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06b77fe640 1 --2- 172.21.15.100:0/1079458300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06a80039b0 0x7f06a8003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06b77fe640 1 --2- 172.21.15.100:0/1079458300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06a8004800 0x7f06a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06b77fe640 1 --2- 172.21.15.100:0/1079458300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06a8005230 0x7f06a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06b77fe640 1 -- 172.21.15.100:0/1079458300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f06b8152e60 con 0x7f06a80039b0 2024-09-11T22:23:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06b77fe640 1 -- 172.21.15.100:0/1079458300 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f06a800c180 con 0x7f06a8005230 2024-09-11T22:23:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.588+0000 7f06b77fe640 1 -- 172.21.15.100:0/1079458300 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f06a800c380 con 0x7f06a8004800 2024-09-11T22:23:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.589+0000 7f06bcacd640 1 --2- 172.21.15.100:0/1079458300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06a80039b0 0x7f06a8003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.589+0000 7f06bd2ce640 1 -- 172.21.15.100:0/1079458300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06a8005230 msgr2=0x7f06a800b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2024-09-11T22:23:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.589+0000 7f06bd2ce640 1 --2- 172.21.15.100:0/1079458300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06a8005230 0x7f06a800b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:23:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.589+0000 7f06b7fff640 1 --2- 172.21.15.100:0/1079458300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06a8004800 0x7f06a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.589+0000 7f06bcacd640 1 -- 172.21.15.100:0/1079458300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06a8004800 msgr2=0x7f06a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.589+0000 7f06bcacd640 1 --2- 172.21.15.100:0/1079458300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06a8004800 0x7f06a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.589+0000 7f06bcacd640 1 -- 172.21.15.100:0/1079458300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06a8005230 msgr2=0x7f06a800b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:23:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.589+0000 7f06bcacd640 1 --2- 172.21.15.100:0/1079458300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06a8005230 0x7f06a800b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.589+0000 7f06bd2ce640 1 -- 172.21.15.100:0/1079458300 reap_dead start 2024-09-11T22:23:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.589+0000 7f06bcacd640 1 -- 172.21.15.100:0/1079458300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a8003520 con 0x7f06a80039b0 2024-09-11T22:23:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.589+0000 7f06b7fff640 1 --2- 172.21.15.100:0/1079458300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06a8004800 0x7f06a8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.590+0000 7f06bcacd640 1 --2- 172.21.15.100:0/1079458300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06a80039b0 0x7f06a8003db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f06ac00c240 tx=0x7f06a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb52105724184d21 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.590+0000 7f06b77fe640 1 -- 172.21.15.100:0/1079458300 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac007cf0 con 0x7f06a80039b0 2024-09-11T22:23:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.590+0000 7f06b77fe640 1 -- 172.21.15.100:0/1079458300 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ac005af0 con 0x7f06a80039b0 2024-09-11T22:23:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.590+0000 7f06b77fe640 1 -- 172.21.15.100:0/1079458300 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac007070 con 0x7f06a80039b0 2024-09-11T22:23:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.590+0000 7f06bed31640 1 -- 172.21.15.100:0/1079458300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06a80039b0 msgr2=0x7f06a8003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.590+0000 7f06bed31640 1 --2- 172.21.15.100:0/1079458300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06a80039b0 0x7f06a8003db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f06ac00c240 tx=0x7f06a8005830 comp rx=0 tx=0).stop 2024-09-11T22:23:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.590+0000 7f06bed31640 1 -- 172.21.15.100:0/1079458300 shutdown_connections 2024-09-11T22:23:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.590+0000 7f06bed31640 1 --2- 172.21.15.100:0/1079458300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06a80039b0 0x7f06a8003db0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.590+0000 7f06bed31640 1 -- 172.21.15.100:0/1079458300 >> 172.21.15.100:0/1079458300 conn(0x7f06b806e000 msgr2=0x7f06b806e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.590+0000 7f06bed31640 1 -- 172.21.15.100:0/1079458300 shutdown_connections 2024-09-11T22:23:14.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.591+0000 7f06bed31640 1 -- 172.21.15.100:0/1079458300 wait complete. 2024-09-11T22:23:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.592+0000 7f06bed31640 1 Processor -- start 2024-09-11T22:23:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.592+0000 7f06bed31640 1 -- start start 2024-09-11T22:23:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.592+0000 7f06bed31640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06a80039b0 0x7f06b81f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.592+0000 7f06bed31640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06b81f2570 0x7f06b8157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.593+0000 7f06bed31640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06b80b0750 0x7f06b8157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.593+0000 7f06bed31640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f06b8158b10 con 0x7f06b81f2570 2024-09-11T22:23:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.593+0000 7f06bed31640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f06b8158830 con 0x7f06b80b0750 2024-09-11T22:23:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.593+0000 7f06bed31640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f06b815bc60 con 0x7f06a80039b0 2024-09-11T22:23:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.593+0000 7f06b7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06b81f2570 0x7f06b8157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.593+0000 7f06bd2ce640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06b80b0750 msgr2=0x7f06b8157d40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2024-09-11T22:23:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.593+0000 7f06bd2ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06b80b0750 0x7f06b8157d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:23:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.593+0000 7f06b7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06b81f2570 0x7f06b8157800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60306/0 (socket says 172.21.15.100:60306) 2024-09-11T22:23:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.593+0000 7f06b7fff640 1 -- 172.21.15.100:0/2005524811 learned_addr learned my addr 172.21.15.100:0/2005524811 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.593+0000 7f06bcacd640 1 --2- 172.21.15.100:0/2005524811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06a80039b0 0x7f06b81f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.593+0000 7f06b7fff640 1 -- 172.21.15.100:0/2005524811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06a80039b0 msgr2=0x7f06b81f2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.593+0000 7f06b7fff640 1 --2- 172.21.15.100:0/2005524811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06a80039b0 0x7f06b81f2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.593+0000 7f06b7fff640 1 -- 172.21.15.100:0/2005524811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06b80b0750 msgr2=0x7f06b8157d40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:23:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.593+0000 7f06b7fff640 1 --2- 172.21.15.100:0/2005524811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06b80b0750 0x7f06b8157d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.593+0000 7f06b7fff640 1 -- 172.21.15.100:0/2005524811 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b806d5b0 con 0x7f06b81f2570 2024-09-11T22:23:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.593+0000 7f06b7fff640 1 --2- 172.21.15.100:0/2005524811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06b81f2570 0x7f06b8157800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f06a4006fd0 tx=0x7f06a400d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.593+0000 7f06b57fa640 1 -- 172.21.15.100:0/2005524811 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a4018070 con 0x7f06b81f2570 2024-09-11T22:23:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.593+0000 7f06b57fa640 1 -- 172.21.15.100:0/2005524811 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06a4003bc0 con 0x7f06b81f2570 2024-09-11T22:23:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.593+0000 7f06b57fa640 1 -- 172.21.15.100:0/2005524811 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a40050d0 con 0x7f06b81f2570 2024-09-11T22:23:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.593+0000 7f06bed31640 1 -- 172.21.15.100:0/2005524811 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06b80af7f0 con 0x7f06b81f2570 2024-09-11T22:23:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.593+0000 7f06bed31640 1 -- 172.21.15.100:0/2005524811 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06b806cad0 con 0x7f06b81f2570 2024-09-11T22:23:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.594+0000 7f06bed31640 1 --2- 172.21.15.100:0/2005524811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06b806cca0 0x7f06b814da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.594+0000 7f06bed31640 1 -- 172.21.15.100:0/2005524811 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f06b81572b0 con 0x7f06b806cca0 2024-09-11T22:23:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.595+0000 7f06bcacd640 1 --2- 172.21.15.100:0/2005524811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06b806cca0 0x7f06b814da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.595+0000 7f06b57fa640 1 -- 172.21.15.100:0/2005524811 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f06a401b070 con 0x7f06b81f2570 2024-09-11T22:23:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.595+0000 7f06bcacd640 1 -- 172.21.15.100:0/2005524811 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f06b80703d0 con 0x7f06b806cca0 2024-09-11T22:23:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.595+0000 7f06bcacd640 1 --2- 172.21.15.100:0/2005524811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06b806cca0 0x7f06b814da70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f06ac00c210 tx=0x7f06b80c9bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.595+0000 7f06b57fa640 1 --2- 172.21.15.100:0/2005524811 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f069c06be10 0x7f069c06e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.595+0000 7f06bd2ce640 1 --2- 172.21.15.100:0/2005524811 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f069c06be10 0x7f069c06e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.595+0000 7f06b57fa640 1 -- 172.21.15.100:0/2005524811 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f06a408a830 con 0x7f06b81f2570 2024-09-11T22:23:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.596+0000 7f06b57fa640 1 -- 172.21.15.100:0/2005524811 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac043020 con 0x7f06b806cca0 2024-09-11T22:23:14.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.596+0000 7f06b57fa640 1 -- 172.21.15.100:0/2005524811 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f06ac038040 con 0x7f06b806cca0 2024-09-11T22:23:14.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.596+0000 7f06b57fa640 1 -- 172.21.15.100:0/2005524811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06b806cca0 msgr2=0x7f06b814da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.596+0000 7f06b57fa640 1 --2- 172.21.15.100:0/2005524811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06b806cca0 0x7f06b814da70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f06ac00c210 tx=0x7f06b80c9bc0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.596+0000 7f06b57fa640 1 -- 172.21.15.100:0/2005524811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06b806cca0 msgr2=0x7f06b814da70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:23:14.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.596+0000 7f06b57fa640 1 --2- 172.21.15.100:0/2005524811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06b806cca0 0x7f06b814da70 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f06ac00c210 tx=0x7f06b80c9bc0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.596+0000 7f06bd2ce640 1 --2- 172.21.15.100:0/2005524811 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f069c06be10 0x7f069c06e2d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f06b806ff20 tx=0x7f06b0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:14.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.605+0000 7f06bed31640 1 --2- 172.21.15.100:0/2005524811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06b806d080 0x7f06b814dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:14.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.605+0000 7f06bed31640 1 -- 172.21.15.100:0/2005524811 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f06b814e4f0 con 0x7f06b806d080 2024-09-11T22:23:14.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.605+0000 7f06bcacd640 1 --2- 172.21.15.100:0/2005524811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06b806d080 0x7f06b814dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.606+0000 7f06bcacd640 1 -- 172.21.15.100:0/2005524811 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f06b806ff90 con 0x7f06b806d080 2024-09-11T22:23:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.606+0000 7f06bcacd640 1 --2- 172.21.15.100:0/2005524811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06b806d080 0x7f06b814dfb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f06ac001930 tx=0x7f06ac02d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.606+0000 7f06b57fa640 1 -- 172.21.15.100:0/2005524811 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ac043040 con 0x7f06b806d080 2024-09-11T22:23:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.606+0000 7f06b57fa640 1 -- 172.21.15.100:0/2005524811 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5042 (secure 0 0 0) 0x7f06ac04a220 con 0x7f06b806d080 2024-09-11T22:23:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.606+0000 7f06b57fa640 1 -- 172.21.15.100:0/2005524811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06b806d080 msgr2=0x7f06b814dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.606+0000 7f06b57fa640 1 --2- 172.21.15.100:0/2005524811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06b806d080 0x7f06b814dfb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f06ac001930 tx=0x7f06ac02d000 comp rx=0 tx=0).stop 2024-09-11T22:23:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.606+0000 7f06b57fa640 1 -- 172.21.15.100:0/2005524811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06b806d080 msgr2=0x7f06b814dfb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:23:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.606+0000 7f06b57fa640 1 --2- 172.21.15.100:0/2005524811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06b806d080 0x7f06b814dfb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.608 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:23:14.608 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:23:14.608 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:23:14.608 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:23:14.608 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 22, 2024-09-11T22:23:14.608 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 85328, 2024-09-11T22:23:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:23:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:23:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:23:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:23:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:23:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:23:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:23:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:14.609 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:14.610 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:23:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:23:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:14.611 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:23:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:23:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:23:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:23:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:23:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:23:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:23:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:23:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:23:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:23:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:23:14.612 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:23:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:23:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:23:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:23:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:23:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:23:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:14.613 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:23:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:23:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:23:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:23:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:14.614 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:23:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:23:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:23:14.615 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:23:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:23:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:23:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.616 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:23:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:23:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:23:14.617 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:23:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:23:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:23:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:23:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:14.618 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:23:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:23:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:23:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:14.619 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:23:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:23:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:23:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:23:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:23:14.620 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:23:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:23:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:23:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:14.621 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:23:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:23:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:23:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:14.622 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:23:14.622 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:23:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.607+0000 7f06bed31640 1 -- 172.21.15.100:0/2005524811 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f069c06be10 msgr2=0x7f069c06e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.607+0000 7f06bed31640 1 --2- 172.21.15.100:0/2005524811 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f069c06be10 0x7f069c06e2d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f06b806ff20 tx=0x7f06b0009190 comp rx=0 tx=0).stop 2024-09-11T22:23:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.607+0000 7f06bed31640 1 -- 172.21.15.100:0/2005524811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06b81f2570 msgr2=0x7f06b8157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.607+0000 7f06bed31640 1 --2- 172.21.15.100:0/2005524811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06b81f2570 0x7f06b8157800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f06a4006fd0 tx=0x7f06a400d8f0 comp rx=0 tx=0).stop 2024-09-11T22:23:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.607+0000 7f06bd2ce640 1 -- 172.21.15.100:0/2005524811 reap_dead start 2024-09-11T22:23:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.607+0000 7f06bd2ce640 1 -- 172.21.15.100:0/2005524811 reap_dead start 2024-09-11T22:23:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.607+0000 7f06bed31640 1 -- 172.21.15.100:0/2005524811 shutdown_connections 2024-09-11T22:23:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.607+0000 7f06bed31640 1 -- 172.21.15.100:0/2005524811 >> 172.21.15.100:0/2005524811 conn(0x7f06b806e000 msgr2=0x7f06b80c9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:14.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.607+0000 7f06bed31640 1 -- 172.21.15.100:0/2005524811 shutdown_connections 2024-09-11T22:23:14.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:14.607+0000 7f06bed31640 1 -- 172.21.15.100:0/2005524811 wait complete. 2024-09-11T22:23:14.626 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:23:14.626 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-11T22:23:19.585 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:23:19.587 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:23:34.627 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-11T22:23:34.627 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-11T22:23:34.627 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-11T22:23:34.628 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-11T22:23:34.631 INFO:tasks.ceph.mon.b:Started 2024-09-11T22:23:34.631 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:23:34.631 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:23:34.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.735+0000 7fb4faf3b640 1 Processor -- start 2024-09-11T22:23:34.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.735+0000 7fb4faf3b640 1 -- start start 2024-09-11T22:23:34.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.736+0000 7fb4faf3b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb4f4154c20 0x7fb4f40cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:34.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.736+0000 7fb4faf3b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4f415a7e0 0x7fb4f40cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:34.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.736+0000 7fb4faf3b640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4f415ac90 con 0x7fb4f40b3190 2024-09-11T22:23:34.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.736+0000 7fb4faf3b640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb4f415e000 con 0x7fb4f4154c20 2024-09-11T22:23:34.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.736+0000 7fb4faf3b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb4f415af70 con 0x7fb4f415a7e0 2024-09-11T22:23:34.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.736+0000 7fb4f8cd7640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb4f4154c20 0x7fb4f40cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:34.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.736+0000 7fb4f8cd7640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb4f4154c20 0x7fb4f40cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52648/0 (socket says 172.21.15.100:52648) 2024-09-11T22:23:34.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.736+0000 7fb4f8cd7640 1 -- 172.21.15.100:0/728870086 learned_addr learned my addr 172.21.15.100:0/728870086 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:34.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.736+0000 7fb4f94d8640 1 --2- 172.21.15.100:0/728870086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4f415a7e0 0x7fb4f40cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:34.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.737+0000 7fb4f8cd7640 1 -- 172.21.15.100:0/728870086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4f415a7e0 msgr2=0x7fb4f40cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:34.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.737+0000 7fb4f8cd7640 1 --2- 172.21.15.100:0/728870086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4f415a7e0 0x7fb4f40cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:34.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.737+0000 7fb4f8cd7640 1 -- 172.21.15.100:0/728870086 >> v1:172.21.15.100:6789/0 conn(0x7fb4f40b3190 legacy=0x7fb4f415e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:34.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.737+0000 7fb4f8cd7640 1 -- 172.21.15.100:0/728870086 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f415b250 con 0x7fb4f4154c20 2024-09-11T22:23:34.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.737+0000 7fb4f8cd7640 1 --2- 172.21.15.100:0/728870086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4f4154c20 0x7fb4f40cb120 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8009870 tx=0x7fb4e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf518b9608438d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:34.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.737+0000 7fb4f37fe640 1 -- 172.21.15.100:0/728870086 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8037070 con 0x7fb4f4154c20 2024-09-11T22:23:34.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.737+0000 7fb4f37fe640 1 -- 172.21.15.100:0/728870086 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4e8032440 con 0x7fb4f4154c20 2024-09-11T22:23:34.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.737+0000 7fb4f37fe640 1 -- 172.21.15.100:0/728870086 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8032810 con 0x7fb4f4154c20 2024-09-11T22:23:34.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.738+0000 7fb4faf3b640 1 -- 172.21.15.100:0/728870086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4f4154c20 msgr2=0x7fb4f40cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:34.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.738+0000 7fb4faf3b640 1 --2- 172.21.15.100:0/728870086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4f4154c20 0x7fb4f40cb120 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8009870 tx=0x7fb4e802a270 comp rx=0 tx=0).stop 2024-09-11T22:23:34.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.738+0000 7fb4faf3b640 1 -- 172.21.15.100:0/728870086 shutdown_connections 2024-09-11T22:23:34.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.738+0000 7fb4faf3b640 1 --2- 172.21.15.100:0/728870086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4f415a7e0 0x7fb4f40cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:34.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.738+0000 7fb4faf3b640 1 --2- 172.21.15.100:0/728870086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4f4154c20 0x7fb4f40cb120 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:34.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.738+0000 7fb4faf3b640 1 -- 172.21.15.100:0/728870086 >> 172.21.15.100:0/728870086 conn(0x7fb4f4067d40 msgr2=0x7fb4f406d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:34.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.738+0000 7fb4faf3b640 1 -- 172.21.15.100:0/728870086 shutdown_connections 2024-09-11T22:23:34.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.738+0000 7fb4faf3b640 1 -- 172.21.15.100:0/728870086 wait complete. 2024-09-11T22:23:34.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.739+0000 7fb4faf3b640 1 Processor -- start 2024-09-11T22:23:34.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.739+0000 7fb4faf3b640 1 -- start start 2024-09-11T22:23:34.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.740+0000 7fb4faf3b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4f40b3190 0x7fb4f41f3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:34.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.740+0000 7fb4faf3b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4f4154c20 0x7fb4f4151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:34.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.740+0000 7fb4faf3b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4f415a7e0 0x7fb4f41519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:34.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.740+0000 7fb4faf3b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f415ed20 con 0x7fb4f40b3190 2024-09-11T22:23:34.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.740+0000 7fb4faf3b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f415eba0 con 0x7fb4f4154c20 2024-09-11T22:23:34.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.740+0000 7fb4faf3b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb4f40cb660 con 0x7fb4f415a7e0 2024-09-11T22:23:34.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.740+0000 7fb4f8cd7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4f40b3190 0x7fb4f41f3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:34.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.740+0000 7fb4f8cd7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4f40b3190 0x7fb4f41f3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52660/0 (socket says 172.21.15.100:52660) 2024-09-11T22:23:34.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.740+0000 7fb4f8cd7640 1 -- 172.21.15.100:0/2989995099 learned_addr learned my addr 172.21.15.100:0/2989995099 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:34.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.740+0000 7fb4f3fff640 1 --2- 172.21.15.100:0/2989995099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4f4154c20 0x7fb4f4151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:34.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.740+0000 7fb4f94d8640 1 --2- 172.21.15.100:0/2989995099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4f415a7e0 0x7fb4f41519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:34.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.741+0000 7fb4f3fff640 1 -- 172.21.15.100:0/2989995099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4f4154c20 msgr2=0x7fb4f4151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-11T22:23:34.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.741+0000 7fb4f3fff640 1 -- 172.21.15.100:0/2989995099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4f4154c20 msgr2=0x7fb4f4151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:23:34.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.741+0000 7fb4f3fff640 1 --2- 172.21.15.100:0/2989995099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4f4154c20 0x7fb4f4151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:23:34.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.741+0000 7fb4f3fff640 1 --2- 172.21.15.100:0/2989995099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4f4154c20 0x7fb4f4151460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:23:34.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.741+0000 7fb4f8cd7640 1 -- 172.21.15.100:0/2989995099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4f415a7e0 msgr2=0x7fb4f41519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:34.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.741+0000 7fb4f8cd7640 1 --2- 172.21.15.100:0/2989995099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4f415a7e0 0x7fb4f41519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:34.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.741+0000 7fb4f8cd7640 1 -- 172.21.15.100:0/2989995099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4f4154c20 msgr2=0x7fb4f4151460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:23:34.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.741+0000 7fb4f8cd7640 1 --2- 172.21.15.100:0/2989995099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4f4154c20 0x7fb4f4151460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:34.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.741+0000 7fb4f8cd7640 1 -- 172.21.15.100:0/2989995099 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f41f44d0 con 0x7fb4f40b3190 2024-09-11T22:23:34.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.741+0000 7fb4f8cd7640 1 --2- 172.21.15.100:0/2989995099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4f40b3190 0x7fb4f41f3c10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb4e802a2b0 tx=0x7fb4e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:34.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.741+0000 7fb4f17fa640 1 -- 172.21.15.100:0/2989995099 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8041020 con 0x7fb4f40b3190 2024-09-11T22:23:34.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.741+0000 7fb4f17fa640 1 -- 172.21.15.100:0/2989995099 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4e80306c0 con 0x7fb4f40b3190 2024-09-11T22:23:34.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.741+0000 7fb4f17fa640 1 -- 172.21.15.100:0/2989995099 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8037040 con 0x7fb4f40b3190 2024-09-11T22:23:34.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.741+0000 7fb4faf3b640 1 -- 172.21.15.100:0/2989995099 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4f41f4740 con 0x7fb4f40b3190 2024-09-11T22:23:34.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.741+0000 7fb4faf3b640 1 -- 172.21.15.100:0/2989995099 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4f415d030 con 0x7fb4f40b3190 2024-09-11T22:23:34.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.742+0000 7fb4faf3b640 1 -- 172.21.15.100:0/2989995099 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4f4159060 con 0x7fb4f40b3190 2024-09-11T22:23:34.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.743+0000 7fb4f17fa640 1 -- 172.21.15.100:0/2989995099 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb4e8044020 con 0x7fb4f40b3190 2024-09-11T22:23:34.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.743+0000 7fb4f17fa640 1 --2- 172.21.15.100:0/2989995099 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb4d806be60 0x7fb4d806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:34.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.743+0000 7fb4f17fa640 1 -- 172.21.15.100:0/2989995099 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fb4e80ab610 con 0x7fb4f40b3190 2024-09-11T22:23:34.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.743+0000 7fb4f3fff640 1 --2- 172.21.15.100:0/2989995099 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb4d806be60 0x7fb4d806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:34.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.744+0000 7fb4f3fff640 1 --2- 172.21.15.100:0/2989995099 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb4d806be60 0x7fb4d806e320 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40ca850 tx=0x7fb4e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:34.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:34.748+0000 7fb4f17fa640 1 -- 172.21.15.100:0/2989995099 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb4e804b070 con 0x7fb4f40b3190 2024-09-11T22:23:35.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:35.045+0000 7fb4faf3b640 1 -- 172.21.15.100:0/2989995099 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb4f40cb120 con 0x7fb4f40b3190 2024-09-11T22:23:35.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:35.046+0000 7fb4f17fa640 1 -- 172.21.15.100:0/2989995099 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7fb4e8079c30 con 0x7fb4f40b3190 2024-09-11T22:23:35.047 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":22,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:23:35.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:35.048+0000 7fb4faf3b640 1 -- 172.21.15.100:0/2989995099 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb4d806be60 msgr2=0x7fb4d806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:35.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:35.048+0000 7fb4faf3b640 1 --2- 172.21.15.100:0/2989995099 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb4d806be60 0x7fb4d806e320 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb4f40ca850 tx=0x7fb4e0009040 comp rx=0 tx=0).stop 2024-09-11T22:23:35.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:35.049+0000 7fb4faf3b640 1 -- 172.21.15.100:0/2989995099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4f40b3190 msgr2=0x7fb4f41f3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:35.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:35.049+0000 7fb4faf3b640 1 --2- 172.21.15.100:0/2989995099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4f40b3190 0x7fb4f41f3c10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb4e802a2b0 tx=0x7fb4e80046c0 comp rx=0 tx=0).stop 2024-09-11T22:23:35.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:35.049+0000 7fb4faf3b640 1 -- 172.21.15.100:0/2989995099 shutdown_connections 2024-09-11T22:23:35.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:35.049+0000 7fb4faf3b640 1 --2- 172.21.15.100:0/2989995099 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb4d806be60 0x7fb4d806e320 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:35.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:35.049+0000 7fb4faf3b640 1 --2- 172.21.15.100:0/2989995099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4f415a7e0 0x7fb4f41519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:35.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:35.049+0000 7fb4faf3b640 1 --2- 172.21.15.100:0/2989995099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4f4154c20 0x7fb4f4151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:35.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:35.049+0000 7fb4faf3b640 1 --2- 172.21.15.100:0/2989995099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4f40b3190 0x7fb4f41f3c10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:35.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:35.049+0000 7fb4faf3b640 1 -- 172.21.15.100:0/2989995099 >> 172.21.15.100:0/2989995099 conn(0x7fb4f4067d40 msgr2=0x7fb4f40b50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:35.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:35.049+0000 7fb4faf3b640 1 -- 172.21.15.100:0/2989995099 shutdown_connections 2024-09-11T22:23:35.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:35.049+0000 7fb4faf3b640 1 -- 172.21.15.100:0/2989995099 wait complete. 2024-09-11T22:23:38.064 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:23:38.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.167+0000 7f8d82274640 1 Processor -- start 2024-09-11T22:23:38.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.168+0000 7f8d82274640 1 -- start start 2024-09-11T22:23:38.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.168+0000 7f8d82274640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d7c06f7b0 0x7f8d7c15b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.168+0000 7f8d82274640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8d7c075960 0x7f8d7c0c7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.168+0000 7f8d82274640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d7c06fc40 con 0x7f8d7c154c00 2024-09-11T22:23:38.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.168+0000 7f8d82274640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f8d7c0707a0 con 0x7f8d7c075960 2024-09-11T22:23:38.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.168+0000 7f8d82274640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8d7c0c7400 con 0x7f8d7c06f7b0 2024-09-11T22:23:38.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.169+0000 7f8d80811640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8d7c075960 0x7f8d7c0c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.169+0000 7f8d80811640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8d7c075960 0x7f8d7c0c7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52666/0 (socket says 172.21.15.100:52666) 2024-09-11T22:23:38.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.169+0000 7f8d80811640 1 -- 172.21.15.100:0/3352348655 learned_addr learned my addr 172.21.15.100:0/3352348655 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:38.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.169+0000 7f8d7b7fe640 1 --2- 172.21.15.100:0/3352348655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d7c06f7b0 0x7f8d7c15b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.169+0000 7f8d80811640 1 -- 172.21.15.100:0/3352348655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d7c06f7b0 msgr2=0x7f8d7c15b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:38.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.169+0000 7f8d80811640 1 --2- 172.21.15.100:0/3352348655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d7c06f7b0 0x7f8d7c15b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.169+0000 7f8d80811640 1 -- 172.21.15.100:0/3352348655 >> v1:172.21.15.167:6789/0 conn(0x7f8d7c154c00 legacy=0x7f8d7c0c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.169+0000 7f8d80811640 1 -- 172.21.15.100:0/3352348655 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7c06ff00 con 0x7f8d7c075960 2024-09-11T22:23:38.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.170+0000 7f8d80811640 1 --2- 172.21.15.100:0/3352348655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d7c075960 0x7f8d7c0c7890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c070920 tx=0x7f8d7402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0e74670bbf1cb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:38.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.170+0000 7f8d7affd640 1 -- 172.21.15.100:0/3352348655 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74036070 con 0x7f8d7c075960 2024-09-11T22:23:38.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.170+0000 7f8d7affd640 1 -- 172.21.15.100:0/3352348655 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d74031600 con 0x7f8d7c075960 2024-09-11T22:23:38.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.170+0000 7f8d7affd640 1 -- 172.21.15.100:0/3352348655 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d740319d0 con 0x7f8d7c075960 2024-09-11T22:23:38.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.171+0000 7f8d82274640 1 -- 172.21.15.100:0/3352348655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d7c075960 msgr2=0x7f8d7c0c7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.171+0000 7f8d82274640 1 --2- 172.21.15.100:0/3352348655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d7c075960 0x7f8d7c0c7890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c070920 tx=0x7f8d7402a680 comp rx=0 tx=0).stop 2024-09-11T22:23:38.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.171+0000 7f8d82274640 1 -- 172.21.15.100:0/3352348655 shutdown_connections 2024-09-11T22:23:38.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.171+0000 7f8d82274640 1 --2- 172.21.15.100:0/3352348655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d7c075960 0x7f8d7c0c7890 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.171+0000 7f8d82274640 1 --2- 172.21.15.100:0/3352348655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d7c06f7b0 0x7f8d7c15b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.171+0000 7f8d82274640 1 -- 172.21.15.100:0/3352348655 >> 172.21.15.100:0/3352348655 conn(0x7f8d7c0cc840 msgr2=0x7f8d7c0ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:38.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.171+0000 7f8d82274640 1 -- 172.21.15.100:0/3352348655 shutdown_connections 2024-09-11T22:23:38.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.171+0000 7f8d82274640 1 -- 172.21.15.100:0/3352348655 wait complete. 2024-09-11T22:23:38.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.172+0000 7f8d82274640 1 Processor -- start 2024-09-11T22:23:38.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.172+0000 7f8d82274640 1 -- start start 2024-09-11T22:23:38.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.174+0000 7f8d82274640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d7c075960 0x7f8d7c1475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.174+0000 7f8d82274640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d7c154c00 0x7f8d7c1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.174+0000 7f8d82274640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d7c157fd0 0x7f8d7c14b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.174+0000 7f8d82274640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c0704c0 con 0x7f8d7c154c00 2024-09-11T22:23:38.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.174+0000 7f8d7b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d7c154c00 0x7f8d7c1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.174+0000 7f8d82274640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c15b9e0 con 0x7f8d7c075960 2024-09-11T22:23:38.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.174+0000 7f8d82274640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8d7c0c8ed0 con 0x7f8d7c157fd0 2024-09-11T22:23:38.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.174+0000 7f8d7b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d7c154c00 0x7f8d7c1568d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52668/0 (socket says 172.21.15.100:52668) 2024-09-11T22:23:38.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.174+0000 7f8d7b7fe640 1 -- 172.21.15.100:0/2801489756 learned_addr learned my addr 172.21.15.100:0/2801489756 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:38.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.174+0000 7f8d80811640 1 --2- 172.21.15.100:0/2801489756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d7c157fd0 0x7f8d7c14b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.174+0000 7f8d7b7fe640 1 -- 172.21.15.100:0/2801489756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d7c157fd0 msgr2=0x7f8d7c14b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.174+0000 7f8d7b7fe640 1 --2- 172.21.15.100:0/2801489756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d7c157fd0 0x7f8d7c14b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.174+0000 7f8d7b7fe640 1 -- 172.21.15.100:0/2801489756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d7c075960 msgr2=0x7f8d7c1475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.174+0000 7f8d7b7fe640 1 --2- 172.21.15.100:0/2801489756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d7c075960 0x7f8d7c1475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.174+0000 7f8d7b7fe640 1 -- 172.21.15.100:0/2801489756 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7c147b00 con 0x7f8d7c154c00 2024-09-11T22:23:38.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.174+0000 7f8d80811640 1 --2- 172.21.15.100:0/2801489756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d7c157fd0 0x7f8d7c14b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:38.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.174+0000 7f8d7b7fe640 1 --2- 172.21.15.100:0/2801489756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d7c154c00 0x7f8d7c1568d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8d7000e980 tx=0x7f8d7000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:38.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.175+0000 7f8d78ff9640 1 -- 172.21.15.100:0/2801489756 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d70017070 con 0x7f8d7c154c00 2024-09-11T22:23:38.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.175+0000 7f8d78ff9640 1 -- 172.21.15.100:0/2801489756 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d7000c9a0 con 0x7f8d7c154c00 2024-09-11T22:23:38.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.175+0000 7f8d78ff9640 1 -- 172.21.15.100:0/2801489756 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7000cd70 con 0x7f8d7c154c00 2024-09-11T22:23:38.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.175+0000 7f8d82274640 1 -- 172.21.15.100:0/2801489756 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d7c1f0b70 con 0x7f8d7c154c00 2024-09-11T22:23:38.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.175+0000 7f8d82274640 1 -- 172.21.15.100:0/2801489756 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d7c151970 con 0x7f8d7c154c00 2024-09-11T22:23:38.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.176+0000 7f8d82274640 1 -- 172.21.15.100:0/2801489756 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d7c154760 con 0x7f8d7c154c00 2024-09-11T22:23:38.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.176+0000 7f8d78ff9640 1 -- 172.21.15.100:0/2801489756 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d7001a070 con 0x7f8d7c154c00 2024-09-11T22:23:38.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.177+0000 7f8d78ff9640 1 --2- 172.21.15.100:0/2801489756 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8d6806be30 0x7f8d6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:38.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.177+0000 7f8d78ff9640 1 -- 172.21.15.100:0/2801489756 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f8d7008b300 con 0x7f8d7c154c00 2024-09-11T22:23:38.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.177+0000 7f8d7bfff640 1 --2- 172.21.15.100:0/2801489756 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8d6806be30 0x7f8d6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:38.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.177+0000 7f8d7bfff640 1 --2- 172.21.15.100:0/2801489756 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8d6806be30 0x7f8d6806e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c000f60 tx=0x7f8d6c0079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:38.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.181+0000 7f8d78ff9640 1 -- 172.21.15.100:0/2801489756 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8d7c154760 con 0x7f8d7c154c00 2024-09-11T22:23:38.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.470+0000 7f8d82274640 1 -- 172.21.15.100:0/2801489756 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8d7c1f1550 con 0x7f8d7c154c00 2024-09-11T22:23:38.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.470+0000 7f8d78ff9640 1 -- 172.21.15.100:0/2801489756 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f8d7c147b00 con 0x7f8d7c154c00 2024-09-11T22:23:38.472 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":22,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":24,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:23:38.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.473+0000 7f8d82274640 1 -- 172.21.15.100:0/2801489756 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8d6806be30 msgr2=0x7f8d6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.473+0000 7f8d82274640 1 --2- 172.21.15.100:0/2801489756 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8d6806be30 0x7f8d6806e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c000f60 tx=0x7f8d6c0079d0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.473+0000 7f8d82274640 1 -- 172.21.15.100:0/2801489756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d7c154c00 msgr2=0x7f8d7c1568d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:38.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.473+0000 7f8d82274640 1 --2- 172.21.15.100:0/2801489756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d7c154c00 0x7f8d7c1568d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8d7000e980 tx=0x7f8d7000ee40 comp rx=0 tx=0).stop 2024-09-11T22:23:38.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.473+0000 7f8d82274640 1 -- 172.21.15.100:0/2801489756 shutdown_connections 2024-09-11T22:23:38.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.473+0000 7f8d82274640 1 --2- 172.21.15.100:0/2801489756 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8d6806be30 0x7f8d6806e2f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.473+0000 7f8d82274640 1 --2- 172.21.15.100:0/2801489756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d7c157fd0 0x7f8d7c14b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.473+0000 7f8d82274640 1 --2- 172.21.15.100:0/2801489756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d7c154c00 0x7f8d7c1568d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.473+0000 7f8d82274640 1 --2- 172.21.15.100:0/2801489756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d7c075960 0x7f8d7c1475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:38.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.473+0000 7f8d82274640 1 -- 172.21.15.100:0/2801489756 >> 172.21.15.100:0/2801489756 conn(0x7f8d7c0cc840 msgr2=0x7f8d7c152c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:38.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.473+0000 7f8d82274640 1 -- 172.21.15.100:0/2801489756 shutdown_connections 2024-09-11T22:23:38.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:38.473+0000 7f8d82274640 1 -- 172.21.15.100:0/2801489756 wait complete. 2024-09-11T22:23:41.486 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:23:41.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.592+0000 7f49aed33640 1 Processor -- start 2024-09-11T22:23:41.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.593+0000 7f49aed33640 1 -- start start 2024-09-11T22:23:41.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.594+0000 7f49aed33640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49a806cc90 0x7f49a806c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:41.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.594+0000 7f49aed33640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f49a806bc10 0x7f49a8154830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:41.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.594+0000 7f49aed33640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49a806c0c0 con 0x7f49a806d070 2024-09-11T22:23:41.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.594+0000 7f49aed33640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f49a80c7b10 con 0x7f49a806bc10 2024-09-11T22:23:41.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.594+0000 7f49aed33640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f49a80c8020 con 0x7f49a806cc90 2024-09-11T22:23:41.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.594+0000 7f49ad2d0640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f49a806bc10 0x7f49a8154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:41.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.594+0000 7f49ad2d0640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f49a806bc10 0x7f49a8154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52672/0 (socket says 172.21.15.100:52672) 2024-09-11T22:23:41.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.594+0000 7f49ad2d0640 1 -- 172.21.15.100:0/1859019588 learned_addr learned my addr 172.21.15.100:0/1859019588 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:41.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.594+0000 7f49acacf640 1 --2- 172.21.15.100:0/1859019588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49a806cc90 0x7f49a806c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:41.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.595+0000 7f49ad2d0640 1 -- 172.21.15.100:0/1859019588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49a806cc90 msgr2=0x7f49a806c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:41.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.595+0000 7f49ad2d0640 1 --2- 172.21.15.100:0/1859019588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49a806cc90 0x7f49a806c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:41.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.595+0000 7f49ad2d0640 1 -- 172.21.15.100:0/1859019588 >> v1:172.21.15.167:6789/0 conn(0x7f49a806d070 legacy=0x7f49a815e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:41.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.595+0000 7f49ad2d0640 1 -- 172.21.15.100:0/1859019588 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a80c7d40 con 0x7f49a806bc10 2024-09-11T22:23:41.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.595+0000 7f49ad2d0640 1 --2- 172.21.15.100:0/1859019588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a806bc10 0x7f49a8154830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f49a0009e50 tx=0x7f49a002a7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f23d30d155bae78 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:41.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.596+0000 7f49a77fe640 1 -- 172.21.15.100:0/1859019588 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a0036070 con 0x7f49a806bc10 2024-09-11T22:23:41.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.596+0000 7f49a77fe640 1 -- 172.21.15.100:0/1859019588 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49a0031600 con 0x7f49a806bc10 2024-09-11T22:23:41.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.596+0000 7f49a77fe640 1 -- 172.21.15.100:0/1859019588 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a0031a10 con 0x7f49a806bc10 2024-09-11T22:23:41.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.597+0000 7f49aed33640 1 -- 172.21.15.100:0/1859019588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a806bc10 msgr2=0x7f49a8154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:41.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.597+0000 7f49aed33640 1 --2- 172.21.15.100:0/1859019588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a806bc10 0x7f49a8154830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f49a0009e50 tx=0x7f49a002a7e0 comp rx=0 tx=0).stop 2024-09-11T22:23:41.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.597+0000 7f49aed33640 1 -- 172.21.15.100:0/1859019588 shutdown_connections 2024-09-11T22:23:41.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.597+0000 7f49aed33640 1 --2- 172.21.15.100:0/1859019588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a806bc10 0x7f49a8154830 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:41.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.597+0000 7f49aed33640 1 --2- 172.21.15.100:0/1859019588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49a806cc90 0x7f49a806c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:41.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.597+0000 7f49aed33640 1 -- 172.21.15.100:0/1859019588 >> 172.21.15.100:0/1859019588 conn(0x7f49a80cd110 msgr2=0x7f49a80cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:41.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.597+0000 7f49aed33640 1 -- 172.21.15.100:0/1859019588 shutdown_connections 2024-09-11T22:23:41.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.597+0000 7f49aed33640 1 -- 172.21.15.100:0/1859019588 wait complete. 2024-09-11T22:23:41.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.598+0000 7f49aed33640 1 Processor -- start 2024-09-11T22:23:41.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.598+0000 7f49aed33640 1 -- start start 2024-09-11T22:23:41.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.600+0000 7f49aed33640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a806bc10 0x7f49a80cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:41.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.600+0000 7f49aed33640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49a806cc90 0x7f49a815c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:41.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.600+0000 7f49aed33640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49a806d070 0x7f49a815c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:41.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.600+0000 7f49aed33640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f49a815e160 con 0x7f49a806bc10 2024-09-11T22:23:41.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.600+0000 7f49aed33640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f49a806fc20 con 0x7f49a806d070 2024-09-11T22:23:41.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.600+0000 7f49aed33640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f49a80c7510 con 0x7f49a806cc90 2024-09-11T22:23:41.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.600+0000 7f49acacf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a806bc10 0x7f49a80cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:41.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.600+0000 7f49acacf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a806bc10 0x7f49a80cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52684/0 (socket says 172.21.15.100:52684) 2024-09-11T22:23:41.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.600+0000 7f49acacf640 1 -- 172.21.15.100:0/957690485 learned_addr learned my addr 172.21.15.100:0/957690485 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:41.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.600+0000 7f49a7fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49a806cc90 0x7f49a815c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:41.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.600+0000 7f49ad2d0640 1 --2- 172.21.15.100:0/957690485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49a806d070 0x7f49a815c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:41.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.600+0000 7f49acacf640 1 -- 172.21.15.100:0/957690485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49a806cc90 msgr2=0x7f49a815c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:41.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.600+0000 7f49acacf640 1 --2- 172.21.15.100:0/957690485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49a806cc90 0x7f49a815c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:41.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.600+0000 7f49acacf640 1 -- 172.21.15.100:0/957690485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49a806d070 msgr2=0x7f49a815c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:41.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.600+0000 7f49acacf640 1 --2- 172.21.15.100:0/957690485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49a806d070 0x7f49a815c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:41.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.600+0000 7f49acacf640 1 -- 172.21.15.100:0/957690485 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a81f15a0 con 0x7f49a806bc10 2024-09-11T22:23:41.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.600+0000 7f49acacf640 1 --2- 172.21.15.100:0/957690485 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a806bc10 0x7f49a80cc3d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f499c00d830 tx=0x7f499c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:41.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.600+0000 7f49a57fa640 1 -- 172.21.15.100:0/957690485 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c00b6c0 con 0x7f49a806bc10 2024-09-11T22:23:41.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.601+0000 7f49a57fa640 1 -- 172.21.15.100:0/957690485 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f499c019070 con 0x7f49a806bc10 2024-09-11T22:23:41.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.601+0000 7f49aed33640 1 -- 172.21.15.100:0/957690485 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49a81f0a20 con 0x7f49a806bc10 2024-09-11T22:23:41.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.601+0000 7f49a57fa640 1 -- 172.21.15.100:0/957690485 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c00ba80 con 0x7f49a806bc10 2024-09-11T22:23:41.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.601+0000 7f49aed33640 1 -- 172.21.15.100:0/957690485 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49a81f0fe0 con 0x7f49a806bc10 2024-09-11T22:23:41.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.602+0000 7f49aed33640 1 -- 172.21.15.100:0/957690485 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49a806c460 con 0x7f49a806bc10 2024-09-11T22:23:41.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.602+0000 7f49a57fa640 1 -- 172.21.15.100:0/957690485 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f499c00bc20 con 0x7f49a806bc10 2024-09-11T22:23:41.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.603+0000 7f49a57fa640 1 --2- 172.21.15.100:0/957690485 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f498c06be30 0x7f498c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:41.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.603+0000 7f49a7fff640 1 --2- 172.21.15.100:0/957690485 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f498c06be30 0x7f498c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:41.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.603+0000 7f49a57fa640 1 -- 172.21.15.100:0/957690485 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f499c08b5a0 con 0x7f49a806bc10 2024-09-11T22:23:41.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.604+0000 7f49a7fff640 1 --2- 172.21.15.100:0/957690485 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f498c06be30 0x7f498c06e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f49a815dbf0 tx=0x7f4994009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:41.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.607+0000 7f49a57fa640 1 -- 172.21.15.100:0/957690485 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f499c0594e0 con 0x7f49a806bc10 2024-09-11T22:23:41.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.881+0000 7f49aed33640 1 -- 172.21.15.100:0/957690485 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f49a80cd870 con 0x7f49a806bc10 2024-09-11T22:23:41.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.881+0000 7f49a57fa640 1 -- 172.21.15.100:0/957690485 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f499c05d7e0 con 0x7f49a806bc10 2024-09-11T22:23:41.882 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":24,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:23:41.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.884+0000 7f49aed33640 1 -- 172.21.15.100:0/957690485 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f498c06be30 msgr2=0x7f498c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:41.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.884+0000 7f49aed33640 1 --2- 172.21.15.100:0/957690485 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f498c06be30 0x7f498c06e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f49a815dbf0 tx=0x7f4994009040 comp rx=0 tx=0).stop 2024-09-11T22:23:41.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.884+0000 7f49aed33640 1 -- 172.21.15.100:0/957690485 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a806bc10 msgr2=0x7f49a80cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:41.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.884+0000 7f49aed33640 1 --2- 172.21.15.100:0/957690485 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a806bc10 0x7f49a80cc3d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f499c00d830 tx=0x7f499c00dcf0 comp rx=0 tx=0).stop 2024-09-11T22:23:41.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.884+0000 7f49aed33640 1 -- 172.21.15.100:0/957690485 shutdown_connections 2024-09-11T22:23:41.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.884+0000 7f49aed33640 1 --2- 172.21.15.100:0/957690485 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f498c06be30 0x7f498c06e2f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:41.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.884+0000 7f49aed33640 1 --2- 172.21.15.100:0/957690485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49a806d070 0x7f49a815c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:41.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.884+0000 7f49aed33640 1 --2- 172.21.15.100:0/957690485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f49a806cc90 0x7f49a815c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:41.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.884+0000 7f49aed33640 1 --2- 172.21.15.100:0/957690485 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49a806bc10 0x7f49a80cc3d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:41.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.884+0000 7f49aed33640 1 -- 172.21.15.100:0/957690485 >> 172.21.15.100:0/957690485 conn(0x7f49a80cd110 msgr2=0x7f49a80c8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:41.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.884+0000 7f49aed33640 1 -- 172.21.15.100:0/957690485 shutdown_connections 2024-09-11T22:23:41.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:41.884+0000 7f49aed33640 1 -- 172.21.15.100:0/957690485 wait complete. 2024-09-11T22:23:41.896 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:23:41.896 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:23:41.896 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:23:42.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.005+0000 7f1aa6e0e640 1 Processor -- start 2024-09-11T22:23:42.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.005+0000 7f1aa6e0e640 1 -- start start 2024-09-11T22:23:42.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.006+0000 7f1aa6e0e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1aa00726c0 0x7f1aa00c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.006+0000 7f1aa6e0e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1aa0072f30 0x7f1aa0073340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.006+0000 7f1aa6e0e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aa0072ac0 con 0x7f1aa0151970 2024-09-11T22:23:42.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.006+0000 7f1aa6e0e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f1aa00ca3f0 con 0x7f1aa0072f30 2024-09-11T22:23:42.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.006+0000 7f1aa6e0e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa00c41a0 con 0x7f1aa00726c0 2024-09-11T22:23:42.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.006+0000 7f1a9ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1aa00726c0 0x7f1aa00c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.006+0000 7f1a9ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1aa00726c0 0x7f1aa00c3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:55666/0 (socket says 172.21.15.100:55666) 2024-09-11T22:23:42.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.006+0000 7f1a9ffff640 1 -- 172.21.15.100:0/3100950837 learned_addr learned my addr 172.21.15.100:0/3100950837 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:42.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.006+0000 7f1aa53ab640 1 --2- 172.21.15.100:0/3100950837 >> v2:172.21.15.167:3300/0 conn(0x7f1aa0072f30 0x7f1aa0073340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.006+0000 7f1aa53ab640 1 -- 172.21.15.100:0/3100950837 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1aa00726c0 msgr2=0x7f1aa00c3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:42.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.006+0000 7f1aa53ab640 1 --2- 172.21.15.100:0/3100950837 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1aa00726c0 0x7f1aa00c3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.006+0000 7f1aa53ab640 1 -- 172.21.15.100:0/3100950837 >> v1:172.21.15.167:6789/0 conn(0x7f1aa0151970 legacy=0x7f1aa01576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.006+0000 7f1aa53ab640 1 -- 172.21.15.100:0/3100950837 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa0073bf0 con 0x7f1aa0072f30 2024-09-11T22:23:42.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.006+0000 7f1a9ffff640 1 --2- 172.21.15.100:0/3100950837 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1aa00726c0 0x7f1aa00c3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:23:42.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.007+0000 7f1aa53ab640 1 --2- 172.21.15.100:0/3100950837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1aa0072f30 0x7f1aa0073340 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009d90 tx=0x7f1a9802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9bcf9ea4486bd88 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:42.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.007+0000 7f1a9f7fe640 1 -- 172.21.15.100:0/3100950837 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98007740 con 0x7f1aa0072f30 2024-09-11T22:23:42.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.007+0000 7f1a9f7fe640 1 -- 172.21.15.100:0/3100950837 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a980078e0 con 0x7f1aa0072f30 2024-09-11T22:23:42.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.007+0000 7f1a9f7fe640 1 -- 172.21.15.100:0/3100950837 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98007cb0 con 0x7f1aa0072f30 2024-09-11T22:23:42.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.008+0000 7f1aa6e0e640 1 -- 172.21.15.100:0/3100950837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1aa0072f30 msgr2=0x7f1aa0073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.008+0000 7f1aa6e0e640 1 --2- 172.21.15.100:0/3100950837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1aa0072f30 0x7f1aa0073340 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009d90 tx=0x7f1a9802a6f0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.008+0000 7f1aa6e0e640 1 -- 172.21.15.100:0/3100950837 shutdown_connections 2024-09-11T22:23:42.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.008+0000 7f1aa6e0e640 1 --2- 172.21.15.100:0/3100950837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1aa0072f30 0x7f1aa0073340 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.008+0000 7f1aa6e0e640 1 --2- 172.21.15.100:0/3100950837 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1aa00726c0 0x7f1aa00c3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.008+0000 7f1aa6e0e640 1 -- 172.21.15.100:0/3100950837 >> 172.21.15.100:0/3100950837 conn(0x7f1aa006ee80 msgr2=0x7f1aa0070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:42.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.008+0000 7f1aa6e0e640 1 -- 172.21.15.100:0/3100950837 shutdown_connections 2024-09-11T22:23:42.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.008+0000 7f1aa6e0e640 1 -- 172.21.15.100:0/3100950837 wait complete. 2024-09-11T22:23:42.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.009+0000 7f1aa6e0e640 1 Processor -- start 2024-09-11T22:23:42.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.009+0000 7f1aa6e0e640 1 -- start start 2024-09-11T22:23:42.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.010+0000 7f1aa6e0e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1aa00726c0 0x7f1aa00c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.010+0000 7f1aa6e0e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa0072f30 0x7f1aa00c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.010+0000 7f1aa6e0e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1aa0151970 0x7f1aa0146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.010+0000 7f1aa6e0e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa00741b0 con 0x7f1aa0072f30 2024-09-11T22:23:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.010+0000 7f1aa6e0e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa00c9f60 con 0x7f1aa0151970 2024-09-11T22:23:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.010+0000 7f1aa6e0e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa00c9910 con 0x7f1aa00726c0 2024-09-11T22:23:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.010+0000 7f1a9ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa0072f30 0x7f1aa00c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.010+0000 7f1a9ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa0072f30 0x7f1aa00c5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52698/0 (socket says 172.21.15.100:52698) 2024-09-11T22:23:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.010+0000 7f1a9ffff640 1 -- 172.21.15.100:0/1602645017 learned_addr learned my addr 172.21.15.100:0/1602645017 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.010+0000 7f1aa53ab640 1 --2- 172.21.15.100:0/1602645017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1aa0151970 0x7f1aa0146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.011+0000 7f1aa4baa640 1 --2- 172.21.15.100:0/1602645017 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1aa00726c0 0x7f1aa00c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.011+0000 7f1a9ffff640 1 -- 172.21.15.100:0/1602645017 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1aa00726c0 msgr2=0x7f1aa00c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.011+0000 7f1a9ffff640 1 --2- 172.21.15.100:0/1602645017 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1aa00726c0 0x7f1aa00c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.011+0000 7f1a9ffff640 1 -- 172.21.15.100:0/1602645017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1aa0151970 msgr2=0x7f1aa0146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.011+0000 7f1a9ffff640 1 --2- 172.21.15.100:0/1602645017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1aa0151970 0x7f1aa0146bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.011+0000 7f1a9ffff640 1 -- 172.21.15.100:0/1602645017 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa01549c0 con 0x7f1aa0072f30 2024-09-11T22:23:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.011+0000 7f1aa53ab640 1 --2- 172.21.15.100:0/1602645017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1aa0151970 0x7f1aa0146bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.011+0000 7f1a9ffff640 1 --2- 172.21.15.100:0/1602645017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa0072f30 0x7f1aa00c5750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c010f10 tx=0x7f1a8c00e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.011+0000 7f1a9d7fa640 1 -- 172.21.15.100:0/1602645017 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c01e070 con 0x7f1aa0072f30 2024-09-11T22:23:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.011+0000 7f1a9d7fa640 1 -- 172.21.15.100:0/1602645017 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a8c011860 con 0x7f1aa0072f30 2024-09-11T22:23:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.011+0000 7f1a9d7fa640 1 -- 172.21.15.100:0/1602645017 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c011c10 con 0x7f1aa0072f30 2024-09-11T22:23:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.011+0000 7f1aa6e0e640 1 -- 172.21.15.100:0/1602645017 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa00c63b0 con 0x7f1aa0072f30 2024-09-11T22:23:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.011+0000 7f1aa6e0e640 1 -- 172.21.15.100:0/1602645017 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa00c6aa0 con 0x7f1aa0072f30 2024-09-11T22:23:42.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.012+0000 7f1aa6e0e640 1 --2- 172.21.15.100:0/1602645017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa01478a0 0x7f1aa00c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.012+0000 7f1aa6e0e640 1 -- 172.21.15.100:0/1602645017 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa00c71e0 con 0x7f1aa01478a0 2024-09-11T22:23:42.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.012+0000 7f1aa4baa640 1 --2- 172.21.15.100:0/1602645017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa01478a0 0x7f1aa00c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.013+0000 7f1aa4baa640 1 -- 172.21.15.100:0/1602645017 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1aa00c9bf0 con 0x7f1aa01478a0 2024-09-11T22:23:42.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.013+0000 7f1aa4baa640 1 --2- 172.21.15.100:0/1602645017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa01478a0 0x7f1aa00c6ca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0072c90 tx=0x7f1a9400e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:42.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.013+0000 7f1a9d7fa640 1 -- 172.21.15.100:0/1602645017 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a8c021070 con 0x7f1aa0072f30 2024-09-11T22:23:42.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.013+0000 7f1a9d7fa640 1 --2- 172.21.15.100:0/1602645017 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1a8406be30 0x7f1a8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.013+0000 7f1a9d7fa640 1 -- 172.21.15.100:0/1602645017 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a940052e0 con 0x7f1aa01478a0 2024-09-11T22:23:42.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.013+0000 7f1a9d7fa640 1 -- 172.21.15.100:0/1602645017 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f1a8c08deb0 con 0x7f1aa0072f30 2024-09-11T22:23:42.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.013+0000 7f1aa53ab640 1 --2- 172.21.15.100:0/1602645017 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1a8406be30 0x7f1a8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.014+0000 7f1a9d7fa640 1 -- 172.21.15.100:0/1602645017 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1a94005480 con 0x7f1aa01478a0 2024-09-11T22:23:42.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.014+0000 7f1a9d7fa640 1 -- 172.21.15.100:0/1602645017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa01478a0 msgr2=0x7f1aa00c6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.014+0000 7f1a9d7fa640 1 --2- 172.21.15.100:0/1602645017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa01478a0 0x7f1aa00c6ca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0072c90 tx=0x7f1a9400e820 comp rx=0 tx=0).stop 2024-09-11T22:23:42.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.014+0000 7f1a9d7fa640 1 -- 172.21.15.100:0/1602645017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa01478a0 msgr2=0x7f1aa00c6ca0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:23:42.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.014+0000 7f1a9d7fa640 1 --2- 172.21.15.100:0/1602645017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa01478a0 0x7f1aa00c6ca0 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0072c90 tx=0x7f1a9400e820 comp rx=0 tx=0).stop 2024-09-11T22:23:42.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.014+0000 7f1aa53ab640 1 --2- 172.21.15.100:0/1602645017 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1a8406be30 0x7f1a8406e2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1a98034000 tx=0x7f1a9802f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:42.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.020+0000 7f1aa6e0e640 1 --2- 172.21.15.100:0/1602645017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa0147100 0x7f1aa01ef960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.020+0000 7f1aa6e0e640 1 -- 172.21.15.100:0/1602645017 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa0072d10 con 0x7f1aa0147100 2024-09-11T22:23:42.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.020+0000 7f1aa4baa640 1 --2- 172.21.15.100:0/1602645017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa0147100 0x7f1aa01ef960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.021+0000 7f1aa4baa640 1 -- 172.21.15.100:0/1602645017 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1aa00cd8d0 con 0x7f1aa0147100 2024-09-11T22:23:42.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.021+0000 7f1aa4baa640 1 --2- 172.21.15.100:0/1602645017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa0147100 0x7f1aa01ef960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0072c90 tx=0x7f1a94000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:42.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.021+0000 7f1a9d7fa640 1 -- 172.21.15.100:0/1602645017 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a94007660 con 0x7f1aa0147100 2024-09-11T22:23:42.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.021+0000 7f1a9d7fa640 1 -- 172.21.15.100:0/1602645017 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4888 (secure 0 0 0) 0x7f1a94007660 con 0x7f1aa0147100 2024-09-11T22:23:42.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.021+0000 7f1a9d7fa640 1 -- 172.21.15.100:0/1602645017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa0147100 msgr2=0x7f1aa01ef960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.021+0000 7f1a9d7fa640 1 --2- 172.21.15.100:0/1602645017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa0147100 0x7f1aa01ef960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0072c90 tx=0x7f1a94000ed0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.021+0000 7f1a9d7fa640 1 -- 172.21.15.100:0/1602645017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa0147100 msgr2=0x7f1aa01ef960 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:23:42.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.021+0000 7f1a9d7fa640 1 --2- 172.21.15.100:0/1602645017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa0147100 0x7f1aa01ef960 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.023 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:23:42.023 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:23:42.023 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:23:42.023 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:23:42.023 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 24, 2024-09-11T22:23:42.023 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 60766, 2024-09-11T22:23:42.023 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:23:42.023 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:23:42.023 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:23:42.024 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:23:42.024 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:42.024 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 2, 2024-09-11T22:23:42.024 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:23:42.024 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:23:42.024 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:23:42.024 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:42.024 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:42.024 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:42.024 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:42.024 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:42.024 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:42.024 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:42.024 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:42.025 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:42.025 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:42.025 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:42.025 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:42.025 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:23:42.025 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:23:42.025 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:42.025 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:42.025 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:42.025 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:42.025 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:42.025 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:42.025 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:42.026 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:42.026 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:42.026 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:42.026 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:42.026 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:42.026 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.026 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:23:42.026 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:23:42.026 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:23:42.026 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:23:42.026 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:23:42.026 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:23:42.026 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:23:42.026 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:23:42.027 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:23:42.027 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:23:42.027 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:23:42.027 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:23:42.027 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:23:42.027 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:23:42.027 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:23:42.027 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:23:42.027 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:23:42.027 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:42.027 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:42.027 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:42.027 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:42.027 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:42.028 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:42.028 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:42.028 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:42.028 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:42.028 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:42.028 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:42.028 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:42.028 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:23:42.028 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.028 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:23:42.028 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.028 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:23:42.028 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:23:42.029 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:42.029 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:42.029 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.029 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:42.029 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:23:42.029 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:42.029 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.029 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.029 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:42.029 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:23:42.029 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:42.029 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:42.029 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:42.029 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.030 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:23:42.030 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:23:42.030 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:42.030 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:42.030 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:42.030 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.030 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.030 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:23:42.030 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:23:42.030 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:42.030 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:42.030 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.030 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:42.030 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:23:42.031 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:42.031 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.031 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.031 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:42.031 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:23:42.031 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:42.031 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:42.031 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:42.031 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.031 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:23:42.031 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:23:42.031 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:42.031 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:42.031 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:42.032 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.032 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.032 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:23:42.032 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:23:42.032 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:42.032 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:42.032 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.032 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:42.032 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:23:42.032 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:42.032 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.032 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.032 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:42.033 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:23:42.033 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:42.033 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:42.033 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:42.033 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.033 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:23:42.033 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:23:42.033 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:42.033 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:42.033 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:42.033 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:42.033 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:42.033 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.033 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:23:42.034 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:23:42.034 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.034 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:42.034 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:42.034 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:23:42.034 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:42.034 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:42.034 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:23:42.034 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.034 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:42.034 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:42.034 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:23:42.034 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:42.034 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:42.035 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:23:42.035 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.035 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:42.035 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:42.035 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:23:42.035 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:42.035 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:42.035 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:23:42.035 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.035 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:42.035 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:42.035 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:23:42.035 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:42.035 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:42.036 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.036 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:23:42.036 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:23:42.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.021+0000 7f1aa6e0e640 1 -- 172.21.15.100:0/1602645017 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1a8406be30 msgr2=0x7f1a8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.022+0000 7f1aa6e0e640 1 --2- 172.21.15.100:0/1602645017 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1a8406be30 0x7f1a8406e2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1a98034000 tx=0x7f1a9802f000 comp rx=0 tx=0).stop 2024-09-11T22:23:42.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.022+0000 7f1aa6e0e640 1 -- 172.21.15.100:0/1602645017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa0072f30 msgr2=0x7f1aa00c5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.022+0000 7f1aa6e0e640 1 --2- 172.21.15.100:0/1602645017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1aa0072f30 0x7f1aa00c5750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c010f10 tx=0x7f1a8c00e730 comp rx=0 tx=0).stop 2024-09-11T22:23:42.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.022+0000 7f1aa53ab640 1 -- 172.21.15.100:0/1602645017 reap_dead start 2024-09-11T22:23:42.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.022+0000 7f1aa53ab640 1 -- 172.21.15.100:0/1602645017 reap_dead start 2024-09-11T22:23:42.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.022+0000 7f1aa6e0e640 1 -- 172.21.15.100:0/1602645017 shutdown_connections 2024-09-11T22:23:42.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.022+0000 7f1aa6e0e640 1 -- 172.21.15.100:0/1602645017 >> 172.21.15.100:0/1602645017 conn(0x7f1aa006ee80 msgr2=0x7f1aa00c39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:42.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.022+0000 7f1aa6e0e640 1 -- 172.21.15.100:0/1602645017 shutdown_connections 2024-09-11T22:23:42.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.022+0000 7f1aa6e0e640 1 -- 172.21.15.100:0/1602645017 wait complete. 2024-09-11T22:23:42.038 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:23:42.038 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:23:42.038 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:23:42.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.153+0000 7fe7dad3b640 1 Processor -- start 2024-09-11T22:23:42.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.153+0000 7fe7dad3b640 1 -- start start 2024-09-11T22:23:42.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.154+0000 7fe7dad3b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7d41518e0 0x7fe7d40c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.154+0000 7fe7dad3b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe7d40c3bb0 0x7fe7d40c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.154+0000 7fe7dad3b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7d4072020 con 0x7fe7d4073280 2024-09-11T22:23:42.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.154+0000 7fe7dad3b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fe7d4151cc0 con 0x7fe7d40c3bb0 2024-09-11T22:23:42.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.154+0000 7fe7dad3b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe7d4072300 con 0x7fe7d41518e0 2024-09-11T22:23:42.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.154+0000 7fe7d8ad7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7d41518e0 0x7fe7d40c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.154+0000 7fe7d92d8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe7d40c3bb0 0x7fe7d40c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.154+0000 7fe7d92d8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe7d40c3bb0 0x7fe7d40c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:36024/0 (socket says 172.21.15.100:36024) 2024-09-11T22:23:42.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.154+0000 7fe7d8ad7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7d41518e0 0x7fe7d40c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:55696/0 (socket says 172.21.15.100:55696) 2024-09-11T22:23:42.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.154+0000 7fe7d92d8640 1 -- 172.21.15.100:0/818989512 learned_addr learned my addr 172.21.15.100:0/818989512 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:42.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.154+0000 7fe7d8ad7640 1 -- 172.21.15.100:0/818989512 >> v2:172.21.15.167:3300/0 conn(0x7fe7d40c3bb0 msgr2=0x7fe7d40c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:42.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.154+0000 7fe7d8ad7640 1 --2- 172.21.15.100:0/818989512 >> v2:172.21.15.167:3300/0 conn(0x7fe7d40c3bb0 0x7fe7d40c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.154+0000 7fe7d8ad7640 1 -- 172.21.15.100:0/818989512 >> v1:172.21.15.167:6789/0 conn(0x7fe7d4073280 legacy=0x7fe7d4157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.154+0000 7fe7d8ad7640 1 -- 172.21.15.100:0/818989512 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d4072a80 con 0x7fe7d41518e0 2024-09-11T22:23:42.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.155+0000 7fe7d92d8640 1 --2- 172.21.15.100:0/818989512 >> v2:172.21.15.167:3300/0 conn(0x7fe7d40c3bb0 0x7fe7d40c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:23:42.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.155+0000 7fe7d8ad7640 1 --2- 172.21.15.100:0/818989512 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7d41518e0 0x7fe7d40c82d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80097a0 tx=0x7fe7c802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=259db58a137cc1c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:42.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.155+0000 7fe7d37fe640 1 -- 172.21.15.100:0/818989512 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8037070 con 0x7fe7d41518e0 2024-09-11T22:23:42.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.155+0000 7fe7d37fe640 1 -- 172.21.15.100:0/818989512 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7c8032440 con 0x7fe7d41518e0 2024-09-11T22:23:42.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.155+0000 7fe7d37fe640 1 -- 172.21.15.100:0/818989512 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8032810 con 0x7fe7d41518e0 2024-09-11T22:23:42.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.156+0000 7fe7dad3b640 1 -- 172.21.15.100:0/818989512 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7d41518e0 msgr2=0x7fe7d40c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.156+0000 7fe7dad3b640 1 --2- 172.21.15.100:0/818989512 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7d41518e0 0x7fe7d40c82d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80097a0 tx=0x7fe7c802a210 comp rx=0 tx=0).stop 2024-09-11T22:23:42.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.156+0000 7fe7dad3b640 1 -- 172.21.15.100:0/818989512 shutdown_connections 2024-09-11T22:23:42.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.156+0000 7fe7dad3b640 1 --2- 172.21.15.100:0/818989512 >> v2:172.21.15.167:3300/0 conn(0x7fe7d40c3bb0 0x7fe7d40c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.156+0000 7fe7dad3b640 1 --2- 172.21.15.100:0/818989512 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7d41518e0 0x7fe7d40c82d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.156+0000 7fe7dad3b640 1 -- 172.21.15.100:0/818989512 >> 172.21.15.100:0/818989512 conn(0x7fe7d406fa70 msgr2=0x7fe7d406fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:42.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.156+0000 7fe7dad3b640 1 -- 172.21.15.100:0/818989512 shutdown_connections 2024-09-11T22:23:42.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.156+0000 7fe7dad3b640 1 -- 172.21.15.100:0/818989512 wait complete. 2024-09-11T22:23:42.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.157+0000 7fe7dad3b640 1 Processor -- start 2024-09-11T22:23:42.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.157+0000 7fe7dad3b640 1 -- start start 2024-09-11T22:23:42.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.158+0000 7fe7dad3b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d4073280 0x7fe7d414f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.158+0000 7fe7dad3b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7d40c3bb0 0x7fe7d40cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.158+0000 7fe7dad3b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7d41518e0 0x7fe7d40cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.158+0000 7fe7dad3b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d4072730 con 0x7fe7d40c3bb0 2024-09-11T22:23:42.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.158+0000 7fe7dad3b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d40c8b70 con 0x7fe7d4073280 2024-09-11T22:23:42.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.158+0000 7fe7dad3b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe7d4074110 con 0x7fe7d41518e0 2024-09-11T22:23:42.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.158+0000 7fe7d3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7d40c3bb0 0x7fe7d40cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.158+0000 7fe7d3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7d40c3bb0 0x7fe7d40cae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52728/0 (socket says 172.21.15.100:52728) 2024-09-11T22:23:42.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.158+0000 7fe7d3fff640 1 -- 172.21.15.100:0/1241035937 learned_addr learned my addr 172.21.15.100:0/1241035937 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:42.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.158+0000 7fe7d92d8640 1 --2- 172.21.15.100:0/1241035937 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7d41518e0 0x7fe7d40cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.158+0000 7fe7d8ad7640 1 --2- 172.21.15.100:0/1241035937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d4073280 0x7fe7d414f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.159+0000 7fe7d3fff640 1 -- 172.21.15.100:0/1241035937 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7d41518e0 msgr2=0x7fe7d40cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.159+0000 7fe7d3fff640 1 --2- 172.21.15.100:0/1241035937 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7d41518e0 0x7fe7d40cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.159+0000 7fe7d3fff640 1 -- 172.21.15.100:0/1241035937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d4073280 msgr2=0x7fe7d414f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.159+0000 7fe7d3fff640 1 --2- 172.21.15.100:0/1241035937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d4073280 0x7fe7d414f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.159+0000 7fe7d3fff640 1 -- 172.21.15.100:0/1241035937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d4150250 con 0x7fe7d40c3bb0 2024-09-11T22:23:42.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.159+0000 7fe7d3fff640 1 --2- 172.21.15.100:0/1241035937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7d40c3bb0 0x7fe7d40cae30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe7c000c400 tx=0x7fe7c000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:42.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.159+0000 7fe7d17fa640 1 -- 172.21.15.100:0/1241035937 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0017070 con 0x7fe7d40c3bb0 2024-09-11T22:23:42.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.159+0000 7fe7d17fa640 1 -- 172.21.15.100:0/1241035937 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7c00052d0 con 0x7fe7d40c3bb0 2024-09-11T22:23:42.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.159+0000 7fe7d17fa640 1 -- 172.21.15.100:0/1241035937 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0003830 con 0x7fe7d40c3bb0 2024-09-11T22:23:42.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.159+0000 7fe7dad3b640 1 -- 172.21.15.100:0/1241035937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d41ef100 con 0x7fe7d40c3bb0 2024-09-11T22:23:42.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.159+0000 7fe7dad3b640 1 -- 172.21.15.100:0/1241035937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d40ca630 con 0x7fe7d40c3bb0 2024-09-11T22:23:42.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.160+0000 7fe7dad3b640 1 --2- 172.21.15.100:0/1241035937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d4150f20 0x7fe7d41f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.160+0000 7fe7dad3b640 1 -- 172.21.15.100:0/1241035937 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d4150510 con 0x7fe7d4150f20 2024-09-11T22:23:42.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.160+0000 7fe7d8ad7640 1 --2- 172.21.15.100:0/1241035937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d4150f20 0x7fe7d41f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.161+0000 7fe7d8ad7640 1 -- 172.21.15.100:0/1241035937 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe7d40c82d0 con 0x7fe7d4150f20 2024-09-11T22:23:42.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.161+0000 7fe7d17fa640 1 -- 172.21.15.100:0/1241035937 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe7c001a070 con 0x7fe7d40c3bb0 2024-09-11T22:23:42.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.161+0000 7fe7d8ad7640 1 --2- 172.21.15.100:0/1241035937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d4150f20 0x7fe7d41f1ac0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40ca010 tx=0x7fe7c80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:42.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.161+0000 7fe7d17fa640 1 --2- 172.21.15.100:0/1241035937 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe7b806be60 0x7fe7b806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.161+0000 7fe7d17fa640 1 -- 172.21.15.100:0/1241035937 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fe7c008a5b0 con 0x7fe7d40c3bb0 2024-09-11T22:23:42.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.161+0000 7fe7d92d8640 1 --2- 172.21.15.100:0/1241035937 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe7b806be60 0x7fe7b806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.162+0000 7fe7d17fa640 1 -- 172.21.15.100:0/1241035937 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8037040 con 0x7fe7d4150f20 2024-09-11T22:23:42.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.162+0000 7fe7d17fa640 1 -- 172.21.15.100:0/1241035937 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe7c803c640 con 0x7fe7d4150f20 2024-09-11T22:23:42.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.162+0000 7fe7d17fa640 1 -- 172.21.15.100:0/1241035937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d4150f20 msgr2=0x7fe7d41f1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.162+0000 7fe7d17fa640 1 --2- 172.21.15.100:0/1241035937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d4150f20 0x7fe7d41f1ac0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40ca010 tx=0x7fe7c80046c0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.162+0000 7fe7d17fa640 1 -- 172.21.15.100:0/1241035937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d4150f20 msgr2=0x7fe7d41f1ac0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:23:42.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.162+0000 7fe7d17fa640 1 --2- 172.21.15.100:0/1241035937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d4150f20 0x7fe7d41f1ac0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.162+0000 7fe7d92d8640 1 --2- 172.21.15.100:0/1241035937 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe7b806be60 0x7fe7b806e320 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc009c90 tx=0x7fe7cc00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:42.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.169+0000 7fe7dad3b640 1 --2- 172.21.15.100:0/1241035937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d41f2000 0x7fe7d41f23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.169+0000 7fe7dad3b640 1 -- 172.21.15.100:0/1241035937 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d41f2920 con 0x7fe7d41f2000 2024-09-11T22:23:42.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.169+0000 7fe7d8ad7640 1 --2- 172.21.15.100:0/1241035937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d41f2000 0x7fe7d41f23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.169+0000 7fe7d8ad7640 1 -- 172.21.15.100:0/1241035937 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe7d40c9aa0 con 0x7fe7d41f2000 2024-09-11T22:23:42.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.170+0000 7fe7d8ad7640 1 --2- 172.21.15.100:0/1241035937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d41f2000 0x7fe7d41f23e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80097a0 tx=0x7fe7c8008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:42.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.170+0000 7fe7d17fa640 1 -- 172.21.15.100:0/1241035937 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8037040 con 0x7fe7d41f2000 2024-09-11T22:23:42.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.170+0000 7fe7d17fa640 1 -- 172.21.15.100:0/1241035937 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4551 (secure 0 0 0) 0x7fe7c8003ca0 con 0x7fe7d41f2000 2024-09-11T22:23:42.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.170+0000 7fe7d17fa640 1 -- 172.21.15.100:0/1241035937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d41f2000 msgr2=0x7fe7d41f23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.170+0000 7fe7d17fa640 1 --2- 172.21.15.100:0/1241035937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d41f2000 0x7fe7d41f23e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80097a0 tx=0x7fe7c8008030 comp rx=0 tx=0).stop 2024-09-11T22:23:42.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.170+0000 7fe7d17fa640 1 -- 172.21.15.100:0/1241035937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d41f2000 msgr2=0x7fe7d41f23e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:23:42.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.170+0000 7fe7d17fa640 1 --2- 172.21.15.100:0/1241035937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7d41f2000 0x7fe7d41f23e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.172 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:23:42.172 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:23:42.172 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:23:42.172 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:23:42.172 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 24, 2024-09-11T22:23:42.172 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 7448, 2024-09-11T22:23:42.172 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:23:42.172 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:23:42.172 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:23:42.172 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:23:42.173 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:42.173 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 2, 2024-09-11T22:23:42.173 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:23:42.173 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:23:42.173 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:23:42.173 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:42.173 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:42.173 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:42.173 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:42.173 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:42.173 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:42.173 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:42.173 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:23:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:23:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:23:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:23:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:23:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:23:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:23:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:23:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:23:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:23:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:23:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:23:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:23:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:23:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:23:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:23:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:23:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:23:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:23:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:23:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:23:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:23:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:23:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:23:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:23:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:23:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:23:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:23:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:23:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:23:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:23:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:23:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:23:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:23:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:23:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:23:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:23:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:23:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:23:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:23:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:23:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:23:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:23:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:23:42.184 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:42.184 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:42.184 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.184 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:23:42.184 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:23:42.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.170+0000 7fe7dad3b640 1 -- 172.21.15.100:0/1241035937 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe7b806be60 msgr2=0x7fe7b806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.170+0000 7fe7dad3b640 1 --2- 172.21.15.100:0/1241035937 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe7b806be60 0x7fe7b806e320 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc009c90 tx=0x7fe7cc00b040 comp rx=0 tx=0).stop 2024-09-11T22:23:42.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.170+0000 7fe7dad3b640 1 -- 172.21.15.100:0/1241035937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7d40c3bb0 msgr2=0x7fe7d40cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.170+0000 7fe7dad3b640 1 --2- 172.21.15.100:0/1241035937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7d40c3bb0 0x7fe7d40cae30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe7c000c400 tx=0x7fe7c000c8c0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.170+0000 7fe7d92d8640 1 -- 172.21.15.100:0/1241035937 reap_dead start 2024-09-11T22:23:42.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.171+0000 7fe7d92d8640 1 -- 172.21.15.100:0/1241035937 reap_dead start 2024-09-11T22:23:42.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.171+0000 7fe7dad3b640 1 -- 172.21.15.100:0/1241035937 shutdown_connections 2024-09-11T22:23:42.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.171+0000 7fe7dad3b640 1 -- 172.21.15.100:0/1241035937 >> 172.21.15.100:0/1241035937 conn(0x7fe7d406fa70 msgr2=0x7fe7d406fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:42.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.171+0000 7fe7dad3b640 1 -- 172.21.15.100:0/1241035937 shutdown_connections 2024-09-11T22:23:42.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.171+0000 7fe7dad3b640 1 -- 172.21.15.100:0/1241035937 wait complete. 2024-09-11T22:23:42.186 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:23:42.186 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:23:42.186 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:23:42.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.308+0000 7f7e30280640 1 Processor -- start 2024-09-11T22:23:42.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.308+0000 7f7e30280640 1 -- start start 2024-09-11T22:23:42.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.309+0000 7f7e30280640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e28151970 0x7f7e280726c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.309+0000 7f7e30280640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7e280c3c60 0x7f7e281576c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.309+0000 7f7e30280640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e28073bf0 con 0x7f7e28157c00 2024-09-11T22:23:42.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.309+0000 7f7e30280640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f7e280ca3f0 con 0x7f7e280c3c60 2024-09-11T22:23:42.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.309+0000 7f7e30280640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7e280c9f60 con 0x7f7e28151970 2024-09-11T22:23:42.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.309+0000 7f7e2d81b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7e280c3c60 0x7f7e281576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.309+0000 7f7e2d81b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7e280c3c60 0x7f7e281576c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49694/0 (socket says 172.21.15.100:49694) 2024-09-11T22:23:42.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.309+0000 7f7e2d81b640 1 -- 172.21.15.100:0/3913555362 learned_addr learned my addr 172.21.15.100:0/3913555362 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:42.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.310+0000 7f7e2e01c640 1 --2- 172.21.15.100:0/3913555362 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e28151970 0x7f7e280726c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.310+0000 7f7e2d81b640 1 -- 172.21.15.100:0/3913555362 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e28151970 msgr2=0x7f7e280726c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:42.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.310+0000 7f7e2d81b640 1 --2- 172.21.15.100:0/3913555362 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e28151970 0x7f7e280726c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.310+0000 7f7e2d81b640 1 -- 172.21.15.100:0/3913555362 >> v1:172.21.15.167:6789/0 conn(0x7f7e28157c00 legacy=0x7f7e28072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:42.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.310+0000 7f7e2d81b640 1 -- 172.21.15.100:0/3913555362 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e28073ed0 con 0x7f7e280c3c60 2024-09-11T22:23:42.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.310+0000 7f7e2e01c640 1 --2- 172.21.15.100:0/3913555362 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e28151970 0x7f7e280726c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:23:42.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.311+0000 7f7e2d81b640 1 --2- 172.21.15.100:0/3913555362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e280c3c60 0x7f7e281576c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7e18009870 tx=0x7f7e1802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff78bd16a1ad45d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:42.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.311+0000 7f7e2d01a640 1 -- 172.21.15.100:0/3913555362 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e18037070 con 0x7f7e280c3c60 2024-09-11T22:23:42.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.311+0000 7f7e2d01a640 1 -- 172.21.15.100:0/3913555362 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e18032440 con 0x7f7e280c3c60 2024-09-11T22:23:42.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.311+0000 7f7e2d01a640 1 -- 172.21.15.100:0/3913555362 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e18032810 con 0x7f7e280c3c60 2024-09-11T22:23:42.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.311+0000 7f7e30280640 1 -- 172.21.15.100:0/3913555362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e280c3c60 msgr2=0x7f7e281576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.311+0000 7f7e30280640 1 --2- 172.21.15.100:0/3913555362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e280c3c60 0x7f7e281576c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7e18009870 tx=0x7f7e1802a2a0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.312+0000 7f7e30280640 1 -- 172.21.15.100:0/3913555362 shutdown_connections 2024-09-11T22:23:42.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.312+0000 7f7e30280640 1 --2- 172.21.15.100:0/3913555362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e280c3c60 0x7f7e281576c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.312+0000 7f7e30280640 1 --2- 172.21.15.100:0/3913555362 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e28151970 0x7f7e280726c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.312+0000 7f7e30280640 1 -- 172.21.15.100:0/3913555362 >> 172.21.15.100:0/3913555362 conn(0x7f7e2806ee80 msgr2=0x7f7e28070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:42.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.312+0000 7f7e30280640 1 -- 172.21.15.100:0/3913555362 shutdown_connections 2024-09-11T22:23:42.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.312+0000 7f7e30280640 1 -- 172.21.15.100:0/3913555362 wait complete. 2024-09-11T22:23:42.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.313+0000 7f7e30280640 1 Processor -- start 2024-09-11T22:23:42.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.313+0000 7f7e30280640 1 -- start start 2024-09-11T22:23:42.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.314+0000 7f7e30280640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e280c3c60 0x7f7e281ee3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.314+0000 7f7e30280640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e28151970 0x7f7e2813e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.314+0000 7f7e30280640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e28157c00 0x7f7e2813ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.314+0000 7f7e30280640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7e280c9bf0 con 0x7f7e280c3c60 2024-09-11T22:23:42.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.314+0000 7f7e30280640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7e280741b0 con 0x7f7e28151970 2024-09-11T22:23:42.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.314+0000 7f7e30280640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7e2806d530 con 0x7f7e28157c00 2024-09-11T22:23:42.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.314+0000 7f7e2e01c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e280c3c60 0x7f7e281ee3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.314+0000 7f7e2e01c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e280c3c60 0x7f7e281ee3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49710/0 (socket says 172.21.15.100:49710) 2024-09-11T22:23:42.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.314+0000 7f7e2e01c640 1 -- 172.21.15.100:0/4172287235 learned_addr learned my addr 172.21.15.100:0/4172287235 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:42.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.314+0000 7f7e2e81d640 1 --2- 172.21.15.100:0/4172287235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e28157c00 0x7f7e2813ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.314+0000 7f7e2d81b640 1 --2- 172.21.15.100:0/4172287235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e28151970 0x7f7e2813e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.314+0000 7f7e2e01c640 1 -- 172.21.15.100:0/4172287235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e28157c00 msgr2=0x7f7e2813ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.314+0000 7f7e2e01c640 1 --2- 172.21.15.100:0/4172287235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e28157c00 0x7f7e2813ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.314+0000 7f7e2e01c640 1 -- 172.21.15.100:0/4172287235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e28151970 msgr2=0x7f7e2813e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.314+0000 7f7e2e01c640 1 --2- 172.21.15.100:0/4172287235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e28151970 0x7f7e2813e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.314+0000 7f7e2e01c640 1 -- 172.21.15.100:0/4172287235 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e281f19f0 con 0x7f7e280c3c60 2024-09-11T22:23:42.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.314+0000 7f7e2d81b640 1 --2- 172.21.15.100:0/4172287235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e28151970 0x7f7e2813e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:23:42.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.314+0000 7f7e2e81d640 1 --2- 172.21.15.100:0/4172287235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e28157c00 0x7f7e2813ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:23:42.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.314+0000 7f7e2e01c640 1 --2- 172.21.15.100:0/4172287235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e280c3c60 0x7f7e281ee3e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400c7f0 tx=0x7f7e2400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:42.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.315+0000 7f7e1effd640 1 -- 172.21.15.100:0/4172287235 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e24015070 con 0x7f7e280c3c60 2024-09-11T22:23:42.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.315+0000 7f7e1effd640 1 -- 172.21.15.100:0/4172287235 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e240079d0 con 0x7f7e280c3c60 2024-09-11T22:23:42.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.315+0000 7f7e1effd640 1 -- 172.21.15.100:0/4172287235 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e24007da0 con 0x7f7e280c3c60 2024-09-11T22:23:42.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.315+0000 7f7e30280640 1 -- 172.21.15.100:0/4172287235 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e281f1cd0 con 0x7f7e280c3c60 2024-09-11T22:23:42.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.315+0000 7f7e30280640 1 -- 172.21.15.100:0/4172287235 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e281f2290 con 0x7f7e280c3c60 2024-09-11T22:23:42.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.316+0000 7f7e30280640 1 --2- 172.21.15.100:0/4172287235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e281f24d0 0x7f7e28152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.316+0000 7f7e30280640 1 -- 172.21.15.100:0/4172287235 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7e28151d50 con 0x7f7e281f24d0 2024-09-11T22:23:42.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.316+0000 7f7e2d81b640 1 --2- 172.21.15.100:0/4172287235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e281f24d0 0x7f7e28152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.316+0000 7f7e2d81b640 1 -- 172.21.15.100:0/4172287235 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e28072d10 con 0x7f7e281f24d0 2024-09-11T22:23:42.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.316+0000 7f7e1effd640 1 -- 172.21.15.100:0/4172287235 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e24018070 con 0x7f7e280c3c60 2024-09-11T22:23:42.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.317+0000 7f7e2d81b640 1 --2- 172.21.15.100:0/4172287235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e281f24d0 0x7f7e28152640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7e280caa80 tx=0x7f7e180046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:42.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.317+0000 7f7e1effd640 1 --2- 172.21.15.100:0/4172287235 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7e0c06be30 0x7f7e0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.317+0000 7f7e2e81d640 1 --2- 172.21.15.100:0/4172287235 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7e0c06be30 0x7f7e0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.317+0000 7f7e1effd640 1 -- 172.21.15.100:0/4172287235 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f7e2408b200 con 0x7f7e280c3c60 2024-09-11T22:23:42.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.317+0000 7f7e1effd640 1 -- 172.21.15.100:0/4172287235 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e18041070 con 0x7f7e281f24d0 2024-09-11T22:23:42.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.317+0000 7f7e1effd640 1 -- 172.21.15.100:0/4172287235 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7e1803c660 con 0x7f7e281f24d0 2024-09-11T22:23:42.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.317+0000 7f7e1effd640 1 -- 172.21.15.100:0/4172287235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e281f24d0 msgr2=0x7f7e28152640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.317+0000 7f7e1effd640 1 --2- 172.21.15.100:0/4172287235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e281f24d0 0x7f7e28152640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7e280caa80 tx=0x7f7e180046c0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.317+0000 7f7e1effd640 1 -- 172.21.15.100:0/4172287235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e281f24d0 msgr2=0x7f7e28152640 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:23:42.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.317+0000 7f7e1effd640 1 --2- 172.21.15.100:0/4172287235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e281f24d0 0x7f7e28152640 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7e280caa80 tx=0x7f7e180046c0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.317+0000 7f7e2e81d640 1 --2- 172.21.15.100:0/4172287235 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7e0c06be30 0x7f7e0c06e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7e20007e10 tx=0x7f7e20007320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:42.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.325+0000 7f7e30280640 1 --2- 172.21.15.100:0/4172287235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e28152b80 0x7f7e281535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.325+0000 7f7e30280640 1 -- 172.21.15.100:0/4172287235 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7e280cc180 con 0x7f7e28152b80 2024-09-11T22:23:42.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.325+0000 7f7e2d81b640 1 --2- 172.21.15.100:0/4172287235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e28152b80 0x7f7e281535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.325+0000 7f7e2d81b640 1 -- 172.21.15.100:0/4172287235 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7e280cbea0 con 0x7f7e28152b80 2024-09-11T22:23:42.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.325+0000 7f7e2d81b640 1 --2- 172.21.15.100:0/4172287235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e28152b80 0x7f7e281535f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7e18000c00 tx=0x7f7e18009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:42.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.326+0000 7f7e1effd640 1 -- 172.21.15.100:0/4172287235 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e18037040 con 0x7f7e28152b80 2024-09-11T22:23:42.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.326+0000 7f7e1effd640 1 -- 172.21.15.100:0/4172287235 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7f7e18003820 con 0x7f7e28152b80 2024-09-11T22:23:42.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.326+0000 7f7e1effd640 1 -- 172.21.15.100:0/4172287235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e28152b80 msgr2=0x7f7e281535f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.326+0000 7f7e1effd640 1 --2- 172.21.15.100:0/4172287235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e28152b80 0x7f7e281535f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7e18000c00 tx=0x7f7e18009240 comp rx=0 tx=0).stop 2024-09-11T22:23:42.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.326+0000 7f7e1effd640 1 -- 172.21.15.100:0/4172287235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e28152b80 msgr2=0x7f7e281535f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:23:42.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.326+0000 7f7e1effd640 1 --2- 172.21.15.100:0/4172287235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e28152b80 0x7f7e281535f0 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7e18000c00 tx=0x7f7e18009240 comp rx=0 tx=0).stop 2024-09-11T22:23:42.327 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:23:42.328 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:23:42.328 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:23:42.328 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:23:42.328 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 24, 2024-09-11T22:23:42.328 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 113047, 2024-09-11T22:23:42.328 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:23:42.328 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:23:42.328 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:23:42.328 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:23:42.328 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:42.328 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 2, 2024-09-11T22:23:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:23:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:23:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:23:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:23:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:23:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:23:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:23:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:23:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:23:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:23:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:23:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:23:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:23:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:23:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:23:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:23:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:23:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:23:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:23:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:23:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:23:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:23:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:23:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:23:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:23:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:23:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:23:42.334 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:42.334 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.334 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.334 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:42.334 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:23:42.334 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:42.334 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:42.334 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:42.334 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.334 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:23:42.334 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:23:42.334 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:42.334 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:42.334 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:23:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:23:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:23:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:23:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:23:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:23:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:23:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:23:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:23:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:23:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:23:42.338 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:23:42.338 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:42.338 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:42.338 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:42.338 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:42.338 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:42.338 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.338 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:23:42.338 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:23:42.338 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.338 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:42.338 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:42.338 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:23:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:23:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:23:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:23:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:23:42.340 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:42.340 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:42.340 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:23:42.340 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.340 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:42.340 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:42.340 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:23:42.340 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:42.340 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:42.340 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:23:42.340 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:42.340 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:42.340 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:42.340 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:23:42.341 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:42.341 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:42.341 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:42.341 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:23:42.341 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:23:42.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.326+0000 7f7e30280640 1 -- 172.21.15.100:0/4172287235 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7e0c06be30 msgr2=0x7f7e0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.326+0000 7f7e30280640 1 --2- 172.21.15.100:0/4172287235 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7e0c06be30 0x7f7e0c06e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7e20007e10 tx=0x7f7e20007320 comp rx=0 tx=0).stop 2024-09-11T22:23:42.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.326+0000 7f7e30280640 1 -- 172.21.15.100:0/4172287235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e280c3c60 msgr2=0x7f7e281ee3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.326+0000 7f7e30280640 1 --2- 172.21.15.100:0/4172287235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e280c3c60 0x7f7e281ee3e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400c7f0 tx=0x7f7e2400cbf0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.326+0000 7f7e2e81d640 1 -- 172.21.15.100:0/4172287235 reap_dead start 2024-09-11T22:23:42.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.326+0000 7f7e2e81d640 1 -- 172.21.15.100:0/4172287235 reap_dead start 2024-09-11T22:23:42.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.326+0000 7f7e30280640 1 -- 172.21.15.100:0/4172287235 shutdown_connections 2024-09-11T22:23:42.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.326+0000 7f7e30280640 1 -- 172.21.15.100:0/4172287235 >> 172.21.15.100:0/4172287235 conn(0x7f7e2806ee80 msgr2=0x7f7e280c80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:42.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.326+0000 7f7e30280640 1 -- 172.21.15.100:0/4172287235 shutdown_connections 2024-09-11T22:23:42.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.326+0000 7f7e30280640 1 -- 172.21.15.100:0/4172287235 wait complete. 2024-09-11T22:23:42.343 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:23:42.343 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-11T22:23:42.343 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-11T22:23:42.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.455+0000 7f69e51d6640 1 Processor -- start 2024-09-11T22:23:42.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.455+0000 7f69e51d6640 1 -- start start 2024-09-11T22:23:42.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.456+0000 7f69e51d6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69e00ccaa0 0x7f69e00ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.456+0000 7f69e51d6640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69e00c3820 con 0x7f69e0150d20 2024-09-11T22:23:42.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.456+0000 7f69e51d6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69e01573c0 con 0x7f69e0151100 2024-09-11T22:23:42.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.456+0000 7f69e51d6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f69e006f5e0 con 0x7f69e00ccaa0 2024-09-11T22:23:42.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.456+0000 7f69ded9d640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f69e0150d20 0x7f69e0156bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:35476/0 (socket says 172.21.15.100:35476) 2024-09-11T22:23:42.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.456+0000 7f69ded9d640 1 -- 172.21.15.100:0/1280189205 learned_addr learned my addr 172.21.15.100:0/1280189205 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:23:42.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.456+0000 7f69df59e640 1 --2- 172.21.15.100:0/1280189205 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69e00ccaa0 0x7f69e00ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.456+0000 7f69ddd9b640 1 -- 172.21.15.100:0/1280189205 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1750921923 0 0) 0x7f69e00c3820 con 0x7f69e0150d20 2024-09-11T22:23:42.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.456+0000 7f69ddd9b640 1 -- 172.21.15.100:0/1280189205 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69c8004630 con 0x7f69e0150d20 2024-09-11T22:23:42.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.456+0000 7f69ddd9b640 1 -- 172.21.15.100:0/1280189205 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2087147094 0 0) 0x7f69e01573c0 con 0x7f69e0151100 2024-09-11T22:23:42.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.456+0000 7f69ddd9b640 1 -- 172.21.15.100:0/1280189205 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69e00c3820 con 0x7f69e0151100 2024-09-11T22:23:42.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.457+0000 7f69df59e640 1 -- 172.21.15.100:0/1280189205 >> v1:172.21.15.167:6789/0 conn(0x7f69e0151100 legacy=0x7f69e00c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.456+0000 7f69ddd9b640 1 -- 172.21.15.100:0/1280189205 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3134553568 0 0) 0x7f69c8004630 con 0x7f69e0150d20 2024-09-11T22:23:42.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.457+0000 7f69df59e640 1 -- 172.21.15.100:0/1280189205 >> v1:172.21.15.100:6789/0 conn(0x7f69e0150d20 legacy=0x7f69e0156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.457+0000 7f69df59e640 1 -- 172.21.15.100:0/1280189205 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e01576a0 con 0x7f69e00ccaa0 2024-09-11T22:23:42.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.457+0000 7f69df59e640 1 --2- 172.21.15.100:0/1280189205 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69e00ccaa0 0x7f69e00ccf50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009dc0 tx=0x7f69d802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7acaa15baf267ecb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:42.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.457+0000 7f69ddd9b640 1 -- 172.21.15.100:0/1280189205 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d0001670 con 0x7f69e00ccaa0 2024-09-11T22:23:42.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.458+0000 7f69ddd9b640 1 -- 172.21.15.100:0/1280189205 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d802ae50 con 0x7f69e00ccaa0 2024-09-11T22:23:42.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.458+0000 7f69ddd9b640 1 -- 172.21.15.100:0/1280189205 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8007740 con 0x7f69e00ccaa0 2024-09-11T22:23:42.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.458+0000 7f69e51d6640 1 -- 172.21.15.100:0/1280189205 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69e00ccaa0 msgr2=0x7f69e00ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.458+0000 7f69e51d6640 1 --2- 172.21.15.100:0/1280189205 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69e00ccaa0 0x7f69e00ccf50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009dc0 tx=0x7f69d802a6f0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.458+0000 7f69e51d6640 1 -- 172.21.15.100:0/1280189205 shutdown_connections 2024-09-11T22:23:42.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.458+0000 7f69e51d6640 1 --2- 172.21.15.100:0/1280189205 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69e00ccaa0 0x7f69e00ccf50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.458+0000 7f69e51d6640 1 -- 172.21.15.100:0/1280189205 >> 172.21.15.100:0/1280189205 conn(0x7f69e006bdf0 msgr2=0x7f69e006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:42.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.458+0000 7f69e51d6640 1 -- 172.21.15.100:0/1280189205 shutdown_connections 2024-09-11T22:23:42.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.458+0000 7f69e51d6640 1 -- 172.21.15.100:0/1280189205 wait complete. 2024-09-11T22:23:42.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.460+0000 7f69e51d6640 1 Processor -- start 2024-09-11T22:23:42.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.460+0000 7f69e51d6640 1 -- start start 2024-09-11T22:23:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.461+0000 7f69e51d6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69e00ccaa0 0x7f69e0153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.461+0000 7f69e51d6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69e0150d20 0x7f69e014bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.461+0000 7f69e51d6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69e0151100 0x7f69e01f1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.461+0000 7f69e51d6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f69e006fb10 con 0x7f69e0150d20 2024-09-11T22:23:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.461+0000 7f69e51d6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f69e006f830 con 0x7f69e0151100 2024-09-11T22:23:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.461+0000 7f69e51d6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f69e0075670 con 0x7f69e00ccaa0 2024-09-11T22:23:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.461+0000 7f69de59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69e0150d20 0x7f69e014bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.461+0000 7f69de59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69e0150d20 0x7f69e014bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49718/0 (socket says 172.21.15.100:49718) 2024-09-11T22:23:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.461+0000 7f69de59c640 1 -- 172.21.15.100:0/913520623 learned_addr learned my addr 172.21.15.100:0/913520623 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.461+0000 7f69df59e640 1 --2- 172.21.15.100:0/913520623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69e0151100 0x7f69e01f1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.461+0000 7f69ded9d640 1 --2- 172.21.15.100:0/913520623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69e00ccaa0 0x7f69e0153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.461+0000 7f69de59c640 1 -- 172.21.15.100:0/913520623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69e00ccaa0 msgr2=0x7f69e0153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.461+0000 7f69de59c640 1 --2- 172.21.15.100:0/913520623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69e00ccaa0 0x7f69e0153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.461+0000 7f69de59c640 1 -- 172.21.15.100:0/913520623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69e0151100 msgr2=0x7f69e01f1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.461+0000 7f69de59c640 1 --2- 172.21.15.100:0/913520623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69e0151100 0x7f69e01f1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.461+0000 7f69de59c640 1 -- 172.21.15.100:0/913520623 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e01ee0b0 con 0x7f69e0150d20 2024-09-11T22:23:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.461+0000 7f69df59e640 1 --2- 172.21.15.100:0/913520623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69e0151100 0x7f69e01f1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.462+0000 7f69de59c640 1 --2- 172.21.15.100:0/913520623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69e0150d20 0x7f69e014bc20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f69d400c430 tx=0x7f69d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.462+0000 7f69c77fe640 1 -- 172.21.15.100:0/913520623 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d4017070 con 0x7f69e0150d20 2024-09-11T22:23:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.462+0000 7f69c77fe640 1 -- 172.21.15.100:0/913520623 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d40052f0 con 0x7f69e0150d20 2024-09-11T22:23:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.462+0000 7f69c77fe640 1 -- 172.21.15.100:0/913520623 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d4003830 con 0x7f69e0150d20 2024-09-11T22:23:42.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.462+0000 7f69e51d6640 1 -- 172.21.15.100:0/913520623 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69e0151b30 con 0x7f69e0150d20 2024-09-11T22:23:42.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.462+0000 7f69e51d6640 1 -- 172.21.15.100:0/913520623 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69e01ee610 con 0x7f69e0150d20 2024-09-11T22:23:42.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.463+0000 7f69e51d6640 1 -- 172.21.15.100:0/913520623 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69e0075aa0 con 0x7f69e0150d20 2024-09-11T22:23:42.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.464+0000 7f69c77fe640 1 -- 172.21.15.100:0/913520623 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f69d401a070 con 0x7f69e0150d20 2024-09-11T22:23:42.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.464+0000 7f69c77fe640 1 --2- 172.21.15.100:0/913520623 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f69cc06be30 0x7f69cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:42.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.464+0000 7f69c77fe640 1 -- 172.21.15.100:0/913520623 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f69d408a700 con 0x7f69e0150d20 2024-09-11T22:23:42.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.464+0000 7f69ded9d640 1 --2- 172.21.15.100:0/913520623 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f69cc06be30 0x7f69cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:42.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.465+0000 7f69ded9d640 1 --2- 172.21.15.100:0/913520623 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f69cc06be30 0x7f69cc06e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f69d00011e0 tx=0x7f69d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:42.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.469+0000 7f69c77fe640 1 -- 172.21.15.100:0/913520623 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f69e01ee0b0 con 0x7f69e0150d20 2024-09-11T22:23:42.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.779+0000 7f69e51d6640 1 -- 172.21.15.100:0/913520623 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f69e00701d0 con 0x7f69e0150d20 2024-09-11T22:23:42.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.780+0000 7f69c77fe640 1 -- 172.21.15.100:0/913520623 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f69d4058c90 con 0x7f69e0150d20 2024-09-11T22:23:42.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.783+0000 7f69e51d6640 1 -- 172.21.15.100:0/913520623 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f69cc06be30 msgr2=0x7f69cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.783+0000 7f69e51d6640 1 --2- 172.21.15.100:0/913520623 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f69cc06be30 0x7f69cc06e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f69d00011e0 tx=0x7f69d0009040 comp rx=0 tx=0).stop 2024-09-11T22:23:42.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.783+0000 7f69e51d6640 1 -- 172.21.15.100:0/913520623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69e0150d20 msgr2=0x7f69e014bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:42.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.783+0000 7f69e51d6640 1 --2- 172.21.15.100:0/913520623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69e0150d20 0x7f69e014bc20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f69d400c430 tx=0x7f69d400c8f0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.784+0000 7f69e51d6640 1 -- 172.21.15.100:0/913520623 shutdown_connections 2024-09-11T22:23:42.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.784+0000 7f69e51d6640 1 --2- 172.21.15.100:0/913520623 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f69cc06be30 0x7f69cc06e2f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.784+0000 7f69e51d6640 1 --2- 172.21.15.100:0/913520623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f69e0151100 0x7f69e01f1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.784+0000 7f69e51d6640 1 --2- 172.21.15.100:0/913520623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69e0150d20 0x7f69e014bc20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.784+0000 7f69e51d6640 1 --2- 172.21.15.100:0/913520623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69e00ccaa0 0x7f69e0153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:42.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.784+0000 7f69e51d6640 1 -- 172.21.15.100:0/913520623 >> 172.21.15.100:0/913520623 conn(0x7f69e006bdf0 msgr2=0x7f69e00c80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:42.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.784+0000 7f69e51d6640 1 -- 172.21.15.100:0/913520623 shutdown_connections 2024-09-11T22:23:42.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:42.784+0000 7f69e51d6640 1 -- 172.21.15.100:0/913520623 wait complete. 2024-09-11T22:23:42.797 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-11T22:23:49.643 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:23:49.645 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:23:52.800 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:23:52.801 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:23:52.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.910+0000 7fb10c853640 1 Processor -- start 2024-09-11T22:23:52.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.910+0000 7fb10c853640 1 -- start start 2024-09-11T22:23:52.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.911+0000 7fb10c853640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb108154c20 0x7fb1080cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:52.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.911+0000 7fb10c853640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb10815ac90 con 0x7fb10815a7e0 2024-09-11T22:23:52.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.911+0000 7fb10c853640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb10815af70 con 0x7fb1080b3190 2024-09-11T22:23:52.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.911+0000 7fb10c853640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fb10815e000 con 0x7fb108154c20 2024-09-11T22:23:52.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.911+0000 7fb106d9d640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb10815a7e0 0x7fb1080cbd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33658/0 (socket says 172.21.15.100:33658) 2024-09-11T22:23:52.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.911+0000 7fb106d9d640 1 -- 172.21.15.100:0/3841643486 learned_addr learned my addr 172.21.15.100:0/3841643486 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:23:52.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.911+0000 7fb10659c640 1 --2- 172.21.15.100:0/3841643486 >> v2:172.21.15.167:3300/0 conn(0x7fb108154c20 0x7fb1080cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:52.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.911+0000 7fb10559a640 1 -- 172.21.15.100:0/3841643486 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1787255607 0 0) 0x7fb10815ac90 con 0x7fb10815a7e0 2024-09-11T22:23:52.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.911+0000 7fb10559a640 1 -- 172.21.15.100:0/3841643486 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0f0003520 con 0x7fb10815a7e0 2024-09-11T22:23:52.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.911+0000 7fb10659c640 1 -- 172.21.15.100:0/3841643486 >> v1:172.21.15.167:6789/0 conn(0x7fb1080b3190 legacy=0x7fb10815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:52.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.912+0000 7fb10659c640 1 -- 172.21.15.100:0/3841643486 >> v1:172.21.15.100:6789/0 conn(0x7fb10815a7e0 legacy=0x7fb1080cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:52.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.912+0000 7fb10659c640 1 -- 172.21.15.100:0/3841643486 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb10815b250 con 0x7fb108154c20 2024-09-11T22:23:52.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.913+0000 7fb10659c640 1 --2- 172.21.15.100:0/3841643486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb108154c20 0x7fb1080cb120 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb10815e180 tx=0x7fb0f802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf82d86550914f79 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:52.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.914+0000 7fb10559a640 1 -- 172.21.15.100:0/3841643486 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8037070 con 0x7fb108154c20 2024-09-11T22:23:52.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.914+0000 7fb10559a640 1 -- 172.21.15.100:0/3841643486 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f8032440 con 0x7fb108154c20 2024-09-11T22:23:52.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.914+0000 7fb10559a640 1 -- 172.21.15.100:0/3841643486 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8032810 con 0x7fb108154c20 2024-09-11T22:23:52.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.915+0000 7fb10c853640 1 -- 172.21.15.100:0/3841643486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb108154c20 msgr2=0x7fb1080cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:52.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.915+0000 7fb10c853640 1 --2- 172.21.15.100:0/3841643486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb108154c20 0x7fb1080cb120 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb10815e180 tx=0x7fb0f802a230 comp rx=0 tx=0).stop 2024-09-11T22:23:52.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.915+0000 7fb10c853640 1 -- 172.21.15.100:0/3841643486 shutdown_connections 2024-09-11T22:23:52.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.915+0000 7fb10c853640 1 --2- 172.21.15.100:0/3841643486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb108154c20 0x7fb1080cb120 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:52.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.915+0000 7fb10c853640 1 -- 172.21.15.100:0/3841643486 >> 172.21.15.100:0/3841643486 conn(0x7fb108067d40 msgr2=0x7fb10806d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:52.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.915+0000 7fb10c853640 1 -- 172.21.15.100:0/3841643486 shutdown_connections 2024-09-11T22:23:52.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.915+0000 7fb10c853640 1 -- 172.21.15.100:0/3841643486 wait complete. 2024-09-11T22:23:52.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.916+0000 7fb10c853640 1 Processor -- start 2024-09-11T22:23:52.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.916+0000 7fb10c853640 1 -- start start 2024-09-11T22:23:52.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.917+0000 7fb10c853640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1080b3190 0x7fb10815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:52.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.917+0000 7fb10c853640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb108154c20 0x7fb108156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:52.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.917+0000 7fb10c853640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb10815a7e0 0x7fb1081572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:52.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.917+0000 7fb10c853640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb10815ed20 con 0x7fb1080b3190 2024-09-11T22:23:52.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.917+0000 7fb10c853640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb10815eba0 con 0x7fb108154c20 2024-09-11T22:23:52.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.917+0000 7fb10c853640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb1080cc420 con 0x7fb10815a7e0 2024-09-11T22:23:52.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.917+0000 7fb10659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1080b3190 0x7fb10815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:52.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.917+0000 7fb10659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1080b3190 0x7fb10815cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36912/0 (socket says 172.21.15.100:36912) 2024-09-11T22:23:52.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.917+0000 7fb10659c640 1 -- 172.21.15.100:0/1503096954 learned_addr learned my addr 172.21.15.100:0/1503096954 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:52.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.917+0000 7fb105d9b640 1 --2- 172.21.15.100:0/1503096954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb108154c20 0x7fb108156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:52.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.917+0000 7fb106d9d640 1 --2- 172.21.15.100:0/1503096954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb10815a7e0 0x7fb1081572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:52.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.917+0000 7fb10659c640 1 -- 172.21.15.100:0/1503096954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb10815a7e0 msgr2=0x7fb1081572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:52.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.917+0000 7fb10659c640 1 --2- 172.21.15.100:0/1503096954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb10815a7e0 0x7fb1081572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:52.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.917+0000 7fb10659c640 1 -- 172.21.15.100:0/1503096954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb108154c20 msgr2=0x7fb108156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:52.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.917+0000 7fb10659c640 1 --2- 172.21.15.100:0/1503096954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb108154c20 0x7fb108156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:52.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.917+0000 7fb10659c640 1 -- 172.21.15.100:0/1503096954 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1081f1420 con 0x7fb1080b3190 2024-09-11T22:23:52.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.918+0000 7fb10659c640 1 --2- 172.21.15.100:0/1503096954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1080b3190 0x7fb10815cc60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8009890 tx=0x7fb0f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:52.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.918+0000 7fb0f6ffd640 1 -- 172.21.15.100:0/1503096954 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8037040 con 0x7fb1080b3190 2024-09-11T22:23:52.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.918+0000 7fb0f6ffd640 1 -- 172.21.15.100:0/1503096954 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f8042070 con 0x7fb1080b3190 2024-09-11T22:23:52.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.918+0000 7fb10c853640 1 -- 172.21.15.100:0/1503096954 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1081f3e80 con 0x7fb1080b3190 2024-09-11T22:23:52.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.918+0000 7fb0f6ffd640 1 -- 172.21.15.100:0/1503096954 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8030960 con 0x7fb1080b3190 2024-09-11T22:23:52.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.918+0000 7fb10c853640 1 -- 172.21.15.100:0/1503096954 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1081f4440 con 0x7fb1080b3190 2024-09-11T22:23:52.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.919+0000 7fb10c853640 1 -- 172.21.15.100:0/1503096954 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb10815e490 con 0x7fb1080b3190 2024-09-11T22:23:52.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.919+0000 7fb0f6ffd640 1 -- 172.21.15.100:0/1503096954 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb0f8030b00 con 0x7fb1080b3190 2024-09-11T22:23:52.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.920+0000 7fb0f6ffd640 1 --2- 172.21.15.100:0/1503096954 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb0e806be30 0x7fb0e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:52.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.920+0000 7fb0f6ffd640 1 -- 172.21.15.100:0/1503096954 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fb0f80aba80 con 0x7fb1080b3190 2024-09-11T22:23:52.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.920+0000 7fb105d9b640 1 --2- 172.21.15.100:0/1503096954 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb0e806be30 0x7fb0e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:52.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.920+0000 7fb105d9b640 1 --2- 172.21.15.100:0/1503096954 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb0e806be30 0x7fb0e806e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb1080c6580 tx=0x7fb0fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:52.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:52.925+0000 7fb0f6ffd640 1 -- 172.21.15.100:0/1503096954 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb0f80799c0 con 0x7fb1080b3190 2024-09-11T22:23:53.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.208+0000 7fb10c853640 1 -- 172.21.15.100:0/1503096954 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb1080b5070 con 0x7fb1080b3190 2024-09-11T22:23:53.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.208+0000 7fb0f6ffd640 1 -- 172.21.15.100:0/1503096954 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fb0f807dcc0 con 0x7fb1080b3190 2024-09-11T22:23:53.210 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":24,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:23:53.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.210+0000 7fb10c853640 1 -- 172.21.15.100:0/1503096954 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb0e806be30 msgr2=0x7fb0e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.211+0000 7fb10c853640 1 --2- 172.21.15.100:0/1503096954 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb0e806be30 0x7fb0e806e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb1080c6580 tx=0x7fb0fc009040 comp rx=0 tx=0).stop 2024-09-11T22:23:53.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.211+0000 7fb10c853640 1 -- 172.21.15.100:0/1503096954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1080b3190 msgr2=0x7fb10815cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.211+0000 7fb10c853640 1 --2- 172.21.15.100:0/1503096954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1080b3190 0x7fb10815cc60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8009890 tx=0x7fb0f80046c0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.211+0000 7fb10c853640 1 -- 172.21.15.100:0/1503096954 shutdown_connections 2024-09-11T22:23:53.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.211+0000 7fb10c853640 1 --2- 172.21.15.100:0/1503096954 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb0e806be30 0x7fb0e806e2f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.211+0000 7fb10c853640 1 --2- 172.21.15.100:0/1503096954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb10815a7e0 0x7fb1081572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.211+0000 7fb10c853640 1 --2- 172.21.15.100:0/1503096954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb108154c20 0x7fb108156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.211+0000 7fb10c853640 1 --2- 172.21.15.100:0/1503096954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1080b3190 0x7fb10815cc60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.211+0000 7fb10c853640 1 -- 172.21.15.100:0/1503096954 >> 172.21.15.100:0/1503096954 conn(0x7fb108067d40 msgr2=0x7fb1080caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:53.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.211+0000 7fb10c853640 1 -- 172.21.15.100:0/1503096954 shutdown_connections 2024-09-11T22:23:53.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.211+0000 7fb10c853640 1 -- 172.21.15.100:0/1503096954 wait complete. 2024-09-11T22:23:53.223 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:23:53.223 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-11T22:23:53.223 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:23:53.223 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:23:53.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.329+0000 7f22daf13640 1 Processor -- start 2024-09-11T22:23:53.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.329+0000 7f22daf13640 1 -- start start 2024-09-11T22:23:53.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.329+0000 7f22daf13640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f22d4154c60 0x7f22d40d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:53.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.330+0000 7f22daf13640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22d4155040 0x7f22d40d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:53.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.330+0000 7f22daf13640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d415ac20 con 0x7f22d415e3e0 2024-09-11T22:23:53.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.330+0000 7f22daf13640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f22d415bad0 con 0x7f22d4154c60 2024-09-11T22:23:53.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.330+0000 7f22daf13640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f22d415aec0 con 0x7f22d4155040 2024-09-11T22:23:53.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.330+0000 7f22d3fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22d4155040 0x7f22d40d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:53.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.330+0000 7f22d8caf640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f22d4154c60 0x7f22d40d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:53.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.330+0000 7f22d3fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22d4155040 0x7f22d40d08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:46300/0 (socket says 172.21.15.100:46300) 2024-09-11T22:23:53.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.330+0000 7f22d3fff640 1 -- 172.21.15.100:0/4122326085 learned_addr learned my addr 172.21.15.100:0/4122326085 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:53.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.330+0000 7f22d8caf640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f22d4154c60 0x7f22d40d0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:60934/0 (socket says 172.21.15.100:60934) 2024-09-11T22:23:53.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.330+0000 7f22d8caf640 1 -- 172.21.15.100:0/4122326085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22d4155040 msgr2=0x7f22d40d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:23:53.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.330+0000 7f22d8caf640 1 --2- 172.21.15.100:0/4122326085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22d4155040 0x7f22d40d08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.330+0000 7f22d8caf640 1 -- 172.21.15.100:0/4122326085 >> v1:172.21.15.167:6789/0 conn(0x7f22d415e3e0 legacy=0x7f22d415e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.330+0000 7f22d8caf640 1 -- 172.21.15.100:0/4122326085 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d415b1a0 con 0x7f22d4154c60 2024-09-11T22:23:53.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.330+0000 7f22d3fff640 1 --2- 172.21.15.100:0/4122326085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22d4155040 0x7f22d40d08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:23:53.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.331+0000 7f22d8caf640 1 --2- 172.21.15.100:0/4122326085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22d4154c60 0x7f22d40d0370 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f22c80097a0 tx=0x7f22c802a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9a8f9350261ea22 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:53.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.331+0000 7f22d37fe640 1 -- 172.21.15.100:0/4122326085 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c8037070 con 0x7f22d4154c60 2024-09-11T22:23:53.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.331+0000 7f22d37fe640 1 -- 172.21.15.100:0/4122326085 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c8032440 con 0x7f22d4154c60 2024-09-11T22:23:53.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.331+0000 7f22d37fe640 1 -- 172.21.15.100:0/4122326085 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c8032810 con 0x7f22d4154c60 2024-09-11T22:23:53.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.332+0000 7f22daf13640 1 -- 172.21.15.100:0/4122326085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22d4154c60 msgr2=0x7f22d40d0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.332+0000 7f22daf13640 1 --2- 172.21.15.100:0/4122326085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22d4154c60 0x7f22d40d0370 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f22c80097a0 tx=0x7f22c802a210 comp rx=0 tx=0).stop 2024-09-11T22:23:53.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.332+0000 7f22daf13640 1 -- 172.21.15.100:0/4122326085 shutdown_connections 2024-09-11T22:23:53.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.332+0000 7f22daf13640 1 --2- 172.21.15.100:0/4122326085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22d4155040 0x7f22d40d08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.332+0000 7f22daf13640 1 --2- 172.21.15.100:0/4122326085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22d4154c60 0x7f22d40d0370 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.332+0000 7f22daf13640 1 -- 172.21.15.100:0/4122326085 >> 172.21.15.100:0/4122326085 conn(0x7f22d406d060 msgr2=0x7f22d406d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:53.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.332+0000 7f22daf13640 1 -- 172.21.15.100:0/4122326085 shutdown_connections 2024-09-11T22:23:53.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.332+0000 7f22daf13640 1 -- 172.21.15.100:0/4122326085 wait complete. 2024-09-11T22:23:53.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.333+0000 7f22daf13640 1 Processor -- start 2024-09-11T22:23:53.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.333+0000 7f22daf13640 1 -- start start 2024-09-11T22:23:53.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.334+0000 7f22daf13640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22d4154c60 0x7f22d41509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:53.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.335+0000 7f22daf13640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22d4155040 0x7f22d4149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:53.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.335+0000 7f22daf13640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22d415e3e0 0x7f22d41f11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:53.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.335+0000 7f22daf13640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f22d40c5e10 con 0x7f22d4154c60 2024-09-11T22:23:53.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.335+0000 7f22daf13640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f22d415b760 con 0x7f22d4155040 2024-09-11T22:23:53.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.335+0000 7f22daf13640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f22d40c5f90 con 0x7f22d415e3e0 2024-09-11T22:23:53.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.335+0000 7f22d8caf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22d4154c60 0x7f22d41509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:53.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.335+0000 7f22d8caf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22d4154c60 0x7f22d41509e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36922/0 (socket says 172.21.15.100:36922) 2024-09-11T22:23:53.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.335+0000 7f22d8caf640 1 -- 172.21.15.100:0/3769768342 learned_addr learned my addr 172.21.15.100:0/3769768342 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:53.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.335+0000 7f22d3fff640 1 --2- 172.21.15.100:0/3769768342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22d4155040 0x7f22d4149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:53.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.335+0000 7f22d94b0640 1 --2- 172.21.15.100:0/3769768342 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22d415e3e0 0x7f22d41f11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:53.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.335+0000 7f22d8caf640 1 -- 172.21.15.100:0/3769768342 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22d415e3e0 msgr2=0x7f22d41f11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.335+0000 7f22d8caf640 1 --2- 172.21.15.100:0/3769768342 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22d415e3e0 0x7f22d41f11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.335+0000 7f22d8caf640 1 -- 172.21.15.100:0/3769768342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22d4155040 msgr2=0x7f22d4149110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.335+0000 7f22d8caf640 1 --2- 172.21.15.100:0/3769768342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22d4155040 0x7f22d4149110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.335+0000 7f22d8caf640 1 -- 172.21.15.100:0/3769768342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d41f09f0 con 0x7f22d4154c60 2024-09-11T22:23:53.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.335+0000 7f22d8caf640 1 --2- 172.21.15.100:0/3769768342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22d4154c60 0x7f22d41509e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f22c8035040 tx=0x7f22c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:53.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.335+0000 7f22d17fa640 1 -- 172.21.15.100:0/3769768342 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c8037040 con 0x7f22d4154c60 2024-09-11T22:23:53.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.335+0000 7f22d17fa640 1 -- 172.21.15.100:0/3769768342 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c8030500 con 0x7f22d4154c60 2024-09-11T22:23:53.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.335+0000 7f22daf13640 1 -- 172.21.15.100:0/3769768342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22d4158880 con 0x7f22d4154c60 2024-09-11T22:23:53.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.335+0000 7f22d17fa640 1 -- 172.21.15.100:0/3769768342 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c8030910 con 0x7f22d4154c60 2024-09-11T22:23:53.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.336+0000 7f22daf13640 1 -- 172.21.15.100:0/3769768342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22d40cc100 con 0x7f22d4154c60 2024-09-11T22:23:53.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.336+0000 7f22daf13640 1 --2- 172.21.15.100:0/3769768342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22d4159e50 0x7f22d415d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:53.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.337+0000 7f22daf13640 1 -- 172.21.15.100:0/3769768342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f22d4074290 con 0x7f22d4159e50 2024-09-11T22:23:53.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.337+0000 7f22d3fff640 1 --2- 172.21.15.100:0/3769768342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22d4159e50 0x7f22d415d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:53.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.337+0000 7f22d3fff640 1 -- 172.21.15.100:0/3769768342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f22d4151090 con 0x7f22d4159e50 2024-09-11T22:23:53.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.337+0000 7f22d3fff640 1 --2- 172.21.15.100:0/3769768342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22d4159e50 0x7f22d415d2b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f22d415ec10 tx=0x7f22c0011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:53.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.337+0000 7f22d17fa640 1 -- 172.21.15.100:0/3769768342 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f22c8044020 con 0x7f22d4154c60 2024-09-11T22:23:53.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.338+0000 7f22d17fa640 1 --2- 172.21.15.100:0/3769768342 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f22b806be30 0x7f22b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:53.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.338+0000 7f22d94b0640 1 --2- 172.21.15.100:0/3769768342 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f22b806be30 0x7f22b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:53.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.338+0000 7f22d17fa640 1 -- 172.21.15.100:0/3769768342 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f22c80ab360 con 0x7f22d4154c60 2024-09-11T22:23:53.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.338+0000 7f22d17fa640 1 -- 172.21.15.100:0/3769768342 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c000fa70 con 0x7f22d4159e50 2024-09-11T22:23:53.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.338+0000 7f22d17fa640 1 -- 172.21.15.100:0/3769768342 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f22c000fc10 con 0x7f22d4159e50 2024-09-11T22:23:53.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.338+0000 7f22d17fa640 1 -- 172.21.15.100:0/3769768342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22d4159e50 msgr2=0x7f22d415d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.338+0000 7f22d17fa640 1 --2- 172.21.15.100:0/3769768342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22d4159e50 0x7f22d415d2b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f22d415ec10 tx=0x7f22c0011d80 comp rx=0 tx=0).stop 2024-09-11T22:23:53.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.338+0000 7f22d17fa640 1 -- 172.21.15.100:0/3769768342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22d4159e50 msgr2=0x7f22d415d2b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:23:53.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.338+0000 7f22d17fa640 1 --2- 172.21.15.100:0/3769768342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22d4159e50 0x7f22d415d2b0 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f22d415ec10 tx=0x7f22c0011d80 comp rx=0 tx=0).stop 2024-09-11T22:23:53.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.338+0000 7f22d94b0640 1 --2- 172.21.15.100:0/3769768342 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f22b806be30 0x7f22b806e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f22cc0012e0 tx=0x7f22cc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:53.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.345+0000 7f22daf13640 1 --2- 172.21.15.100:0/3769768342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22d415a4a0 0x7f22d415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:53.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.345+0000 7f22daf13640 1 -- 172.21.15.100:0/3769768342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f22d415e830 con 0x7f22d415a4a0 2024-09-11T22:23:53.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.345+0000 7f22d3fff640 1 --2- 172.21.15.100:0/3769768342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22d415a4a0 0x7f22d415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:53.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.345+0000 7f22d3fff640 1 -- 172.21.15.100:0/3769768342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f22d40ca7a0 con 0x7f22d415a4a0 2024-09-11T22:23:53.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.346+0000 7f22d3fff640 1 --2- 172.21.15.100:0/3769768342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22d415a4a0 0x7f22d415d7f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f22d4075f60 tx=0x7f22c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:53.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.346+0000 7f22d17fa640 1 -- 172.21.15.100:0/3769768342 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c0014640 con 0x7f22d415a4a0 2024-09-11T22:23:53.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.346+0000 7f22d17fa640 1 -- 172.21.15.100:0/3769768342 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4889 (secure 0 0 0) 0x7f22c002c420 con 0x7f22d415a4a0 2024-09-11T22:23:53.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.346+0000 7f22d17fa640 1 -- 172.21.15.100:0/3769768342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22d415a4a0 msgr2=0x7f22d415d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.346+0000 7f22d17fa640 1 --2- 172.21.15.100:0/3769768342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22d415a4a0 0x7f22d415d7f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f22d4075f60 tx=0x7f22c00046c0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.346+0000 7f22d17fa640 1 -- 172.21.15.100:0/3769768342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22d415a4a0 msgr2=0x7f22d415d7f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:23:53.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.346+0000 7f22d17fa640 1 --2- 172.21.15.100:0/3769768342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22d415a4a0 0x7f22d415d7f0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f22d4075f60 tx=0x7f22c00046c0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.348 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:23:53.348 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:23:53.348 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:23:53.348 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:23:53.348 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 24, 2024-09-11T22:23:53.348 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 72091, 2024-09-11T22:23:53.349 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:23:53.349 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:23:53.349 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:23:53.349 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:23:53.349 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:53.349 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 13, 2024-09-11T22:23:53.349 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:23:53.349 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:23:53.349 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:23:53.349 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:53.349 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:53.349 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:53.349 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:53.350 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:53.350 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:53.350 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:53.350 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:53.350 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:53.350 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:53.350 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:53.350 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:53.350 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:23:53.351 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:23:53.351 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:53.351 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:53.351 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:53.351 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:53.351 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:53.351 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:53.351 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:53.351 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:53.351 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:53.351 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:53.351 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:53.351 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:53.352 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.352 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:23:53.352 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:23:53.352 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:23:53.352 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:23:53.352 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:23:53.352 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:23:53.352 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:23:53.352 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:23:53.352 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:23:53.352 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:23:53.353 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:23:53.353 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:23:53.353 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:23:53.353 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:23:53.353 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:23:53.353 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:23:53.353 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:23:53.353 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:53.353 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:53.353 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:53.353 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:53.353 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:53.353 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:53.353 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:53.354 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:53.354 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:53.354 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:53.354 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:53.354 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:53.354 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:23:53.354 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.354 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:23:53.354 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.354 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:23:53.354 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:23:53.354 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:53.354 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:53.354 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.355 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:53.355 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:23:53.355 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:53.355 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.355 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.355 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:53.355 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:23:53.355 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:53.355 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:53.356 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:53.356 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.356 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:23:53.356 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:23:53.356 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:53.356 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:53.356 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:53.356 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.356 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.356 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:23:53.356 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:23:53.356 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:53.356 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:53.357 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.357 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:53.357 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:23:53.357 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:53.357 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.357 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.357 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:53.357 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:23:53.357 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:53.357 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:53.357 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:53.357 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.357 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:23:53.357 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:23:53.358 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:53.358 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:53.358 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:53.358 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.358 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.358 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:23:53.358 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:23:53.358 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:53.358 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:53.358 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.358 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:53.358 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:23:53.358 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:53.359 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.359 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.359 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:53.359 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:23:53.359 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:53.359 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:53.359 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:53.359 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.359 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:23:53.359 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:23:53.359 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:53.359 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:53.360 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:53.360 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:53.360 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:53.360 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.360 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:23:53.360 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:23:53.360 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.360 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:53.360 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:53.360 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:23:53.361 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:53.361 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:53.361 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:23:53.361 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.361 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:53.361 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:53.361 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:23:53.362 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:53.362 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:53.362 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:23:53.362 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.362 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:53.362 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:53.362 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:23:53.363 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:53.363 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:53.363 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:23:53.363 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.363 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:53.364 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:53.364 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:23:53.364 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:53.364 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:53.364 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.364 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:23:53.364 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:23:53.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.346+0000 7f22daf13640 1 -- 172.21.15.100:0/3769768342 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f22b806be30 msgr2=0x7f22b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.346+0000 7f22daf13640 1 --2- 172.21.15.100:0/3769768342 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f22b806be30 0x7f22b806e2f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f22cc0012e0 tx=0x7f22cc009040 comp rx=0 tx=0).stop 2024-09-11T22:23:53.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.346+0000 7f22daf13640 1 -- 172.21.15.100:0/3769768342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22d4154c60 msgr2=0x7f22d41509e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.346+0000 7f22daf13640 1 --2- 172.21.15.100:0/3769768342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22d4154c60 0x7f22d41509e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f22c8035040 tx=0x7f22c80046c0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.346+0000 7f22d94b0640 1 -- 172.21.15.100:0/3769768342 reap_dead start 2024-09-11T22:23:53.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.346+0000 7f22daf13640 1 -- 172.21.15.100:0/3769768342 shutdown_connections 2024-09-11T22:23:53.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.346+0000 7f22daf13640 1 --2- 172.21.15.100:0/3769768342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22d4154c60 0x7f22d41509e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.346+0000 7f22daf13640 1 -- 172.21.15.100:0/3769768342 >> 172.21.15.100:0/3769768342 conn(0x7f22d406d060 msgr2=0x7f22d4151520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:53.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.347+0000 7f22daf13640 1 -- 172.21.15.100:0/3769768342 shutdown_connections 2024-09-11T22:23:53.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.347+0000 7f22daf13640 1 -- 172.21.15.100:0/3769768342 wait complete. 2024-09-11T22:23:53.367 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:23:53.367 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:23:53.367 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:23:53.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.474+0000 7f290df8d640 1 Processor -- start 2024-09-11T22:23:53.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.475+0000 7f290df8d640 1 -- start start 2024-09-11T22:23:53.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.475+0000 7f290df8d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f290815b2e0 0x7f29081661f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:53.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.475+0000 7f290df8d640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29080c6510 con 0x7f290806ce60 2024-09-11T22:23:53.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.475+0000 7f290df8d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29080c5470 con 0x7f290806d240 2024-09-11T22:23:53.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.475+0000 7f290df8d640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f290815b820 con 0x7f290815b2e0 2024-09-11T22:23:53.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.476+0000 7f2907fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f290815b2e0 0x7f29081661f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:53.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.476+0000 7f2907fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f290815b2e0 0x7f29081661f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36962/0 (socket says 172.21.15.100:36962) 2024-09-11T22:23:53.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.476+0000 7f2907fff640 1 -- 172.21.15.100:0/2987758061 learned_addr learned my addr 172.21.15.100:0/2987758061 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:53.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.476+0000 7f2907fff640 1 -- 172.21.15.100:0/2987758061 >> v1:172.21.15.167:6789/0 conn(0x7f290806d240 legacy=0x7f29081546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.476+0000 7f2907fff640 1 -- 172.21.15.100:0/2987758061 >> v1:172.21.15.100:6789/0 conn(0x7f290806ce60 legacy=0x7f290815bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.476+0000 7f2907fff640 1 -- 172.21.15.100:0/2987758061 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29080c5750 con 0x7f290815b2e0 2024-09-11T22:23:53.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.477+0000 7f2907fff640 1 --2- 172.21.15.100:0/2987758061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f290815b2e0 0x7f29081661f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f290815b9a0 tx=0x7f290002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982ea5c45c51dff2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:53.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.477+0000 7f29067fc640 1 -- 172.21.15.100:0/2987758061 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900036070 con 0x7f290815b2e0 2024-09-11T22:23:53.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.477+0000 7f29067fc640 1 -- 172.21.15.100:0/2987758061 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2900031600 con 0x7f290815b2e0 2024-09-11T22:23:53.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.477+0000 7f29067fc640 1 -- 172.21.15.100:0/2987758061 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29000319d0 con 0x7f290815b2e0 2024-09-11T22:23:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.477+0000 7f290df8d640 1 -- 172.21.15.100:0/2987758061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f290815b2e0 msgr2=0x7f29081661f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.477+0000 7f290df8d640 1 --2- 172.21.15.100:0/2987758061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f290815b2e0 0x7f29081661f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f290815b9a0 tx=0x7f290002a7a0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.477+0000 7f290df8d640 1 -- 172.21.15.100:0/2987758061 shutdown_connections 2024-09-11T22:23:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.477+0000 7f290df8d640 1 --2- 172.21.15.100:0/2987758061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f290815b2e0 0x7f29081661f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.477+0000 7f290df8d640 1 -- 172.21.15.100:0/2987758061 >> 172.21.15.100:0/2987758061 conn(0x7f290806bc10 msgr2=0x7f290806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.478+0000 7f290df8d640 1 -- 172.21.15.100:0/2987758061 shutdown_connections 2024-09-11T22:23:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.478+0000 7f290df8d640 1 -- 172.21.15.100:0/2987758061 wait complete. 2024-09-11T22:23:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.479+0000 7f290df8d640 1 Processor -- start 2024-09-11T22:23:53.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.479+0000 7f290df8d640 1 -- start start 2024-09-11T22:23:53.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.480+0000 7f290df8d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f290806ce60 0x7f29080c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.480+0000 7f290df8d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f290806d240 0x7f29081f33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.480+0000 7f290df8d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f290815b2e0 0x7f29080c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.480+0000 7f290df8d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f290815c460 con 0x7f290806ce60 2024-09-11T22:23:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.480+0000 7f290df8d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f29080c5d10 con 0x7f290815b2e0 2024-09-11T22:23:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.480+0000 7f290df8d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f29080cb1b0 con 0x7f290806d240 2024-09-11T22:23:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.480+0000 7f29077fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f290806ce60 0x7f29080c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.480+0000 7f29077fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f290806ce60 0x7f29080c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36976/0 (socket says 172.21.15.100:36976) 2024-09-11T22:23:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.480+0000 7f29077fe640 1 -- 172.21.15.100:0/1042686438 learned_addr learned my addr 172.21.15.100:0/1042686438 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.480+0000 7f2907fff640 1 --2- 172.21.15.100:0/1042686438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f290815b2e0 0x7f29080c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.480+0000 7f2906ffd640 1 --2- 172.21.15.100:0/1042686438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f290806d240 0x7f29081f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.480+0000 7f29077fe640 1 -- 172.21.15.100:0/1042686438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f290806d240 msgr2=0x7f29081f33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.480+0000 7f29077fe640 1 --2- 172.21.15.100:0/1042686438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f290806d240 0x7f29081f33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.480+0000 7f29077fe640 1 -- 172.21.15.100:0/1042686438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f290815b2e0 msgr2=0x7f29080c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.480+0000 7f29077fe640 1 --2- 172.21.15.100:0/1042686438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f290815b2e0 0x7f29080c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.480+0000 7f29077fe640 1 -- 172.21.15.100:0/1042686438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2908151de0 con 0x7f290806ce60 2024-09-11T22:23:53.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.480+0000 7f29077fe640 1 --2- 172.21.15.100:0/1042686438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f290806ce60 0x7f29080c9e80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f28f800c450 tx=0x7f28f800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:53.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.481+0000 7f28effff640 1 -- 172.21.15.100:0/1042686438 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f80052d0 con 0x7f290806ce60 2024-09-11T22:23:53.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.481+0000 7f28effff640 1 -- 172.21.15.100:0/1042686438 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f8005470 con 0x7f290806ce60 2024-09-11T22:23:53.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.481+0000 7f290df8d640 1 -- 172.21.15.100:0/1042686438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29080cd350 con 0x7f290806ce60 2024-09-11T22:23:53.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.481+0000 7f28effff640 1 -- 172.21.15.100:0/1042686438 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f8012870 con 0x7f290806ce60 2024-09-11T22:23:53.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.481+0000 7f290df8d640 1 -- 172.21.15.100:0/1042686438 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29080c7970 con 0x7f290806ce60 2024-09-11T22:23:53.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.482+0000 7f290df8d640 1 --2- 172.21.15.100:0/1042686438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29081524f0 0x7f290814dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:53.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.482+0000 7f290df8d640 1 -- 172.21.15.100:0/1042686438 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f29080cad20 con 0x7f29081524f0 2024-09-11T22:23:53.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.482+0000 7f2906ffd640 1 --2- 172.21.15.100:0/1042686438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29081524f0 0x7f290814dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:53.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.482+0000 7f2906ffd640 1 -- 172.21.15.100:0/1042686438 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29080c76a0 con 0x7f29081524f0 2024-09-11T22:23:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.482+0000 7f2906ffd640 1 --2- 172.21.15.100:0/1042686438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29081524f0 0x7f290814dc20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f29080d1330 tx=0x7f28fc00fc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.482+0000 7f28effff640 1 -- 172.21.15.100:0/1042686438 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f28f8012a10 con 0x7f290806ce60 2024-09-11T22:23:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.483+0000 7f28effff640 1 --2- 172.21.15.100:0/1042686438 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f28f406beb0 0x7f28f406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.483+0000 7f28effff640 1 -- 172.21.15.100:0/1042686438 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f28f808acb0 con 0x7f290806ce60 2024-09-11T22:23:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.483+0000 7f2907fff640 1 --2- 172.21.15.100:0/1042686438 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f28f406beb0 0x7f28f406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.483+0000 7f28effff640 1 -- 172.21.15.100:0/1042686438 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc0050d0 con 0x7f29081524f0 2024-09-11T22:23:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.483+0000 7f28effff640 1 -- 172.21.15.100:0/1042686438 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f28fc005270 con 0x7f29081524f0 2024-09-11T22:23:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.483+0000 7f28effff640 1 -- 172.21.15.100:0/1042686438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29081524f0 msgr2=0x7f290814dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.483+0000 7f28effff640 1 --2- 172.21.15.100:0/1042686438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29081524f0 0x7f290814dc20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f29080d1330 tx=0x7f28fc00fc00 comp rx=0 tx=0).stop 2024-09-11T22:23:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.483+0000 7f28effff640 1 -- 172.21.15.100:0/1042686438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29081524f0 msgr2=0x7f290814dc20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:23:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.483+0000 7f28effff640 1 --2- 172.21.15.100:0/1042686438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29081524f0 0x7f290814dc20 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f29080d1330 tx=0x7f28fc00fc00 comp rx=0 tx=0).stop 2024-09-11T22:23:53.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.483+0000 7f2907fff640 1 --2- 172.21.15.100:0/1042686438 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f28f406beb0 0x7f28f406e370 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2900033000 tx=0x7f2900009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:53.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.489+0000 7f290df8d640 1 --2- 172.21.15.100:0/1042686438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29080c98c0 0x7f290814e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:53.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.489+0000 7f290df8d640 1 -- 172.21.15.100:0/1042686438 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f290814e6a0 con 0x7f29080c98c0 2024-09-11T22:23:53.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.489+0000 7f2906ffd640 1 --2- 172.21.15.100:0/1042686438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29080c98c0 0x7f290814e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:53.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.490+0000 7f2906ffd640 1 -- 172.21.15.100:0/1042686438 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f29080cf5c0 con 0x7f29080c98c0 2024-09-11T22:23:53.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.490+0000 7f2906ffd640 1 --2- 172.21.15.100:0/1042686438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29080c98c0 0x7f290814e160 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f29080ca620 tx=0x7f28fc001120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:53.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.490+0000 7f28effff640 1 -- 172.21.15.100:0/1042686438 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc0050d0 con 0x7f29080c98c0 2024-09-11T22:23:53.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.490+0000 7f28effff640 1 -- 172.21.15.100:0/1042686438 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7f28fc006c60 con 0x7f29080c98c0 2024-09-11T22:23:53.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.490+0000 7f28effff640 1 -- 172.21.15.100:0/1042686438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29080c98c0 msgr2=0x7f290814e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.490+0000 7f28effff640 1 --2- 172.21.15.100:0/1042686438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29080c98c0 0x7f290814e160 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f29080ca620 tx=0x7f28fc001120 comp rx=0 tx=0).stop 2024-09-11T22:23:53.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.490+0000 7f28effff640 1 -- 172.21.15.100:0/1042686438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29080c98c0 msgr2=0x7f290814e160 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:23:53.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.490+0000 7f28effff640 1 --2- 172.21.15.100:0/1042686438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29080c98c0 0x7f290814e160 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f29080ca620 tx=0x7f28fc001120 comp rx=0 tx=0).stop 2024-09-11T22:23:53.492 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:23:53.493 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:23:53.493 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:23:53.493 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:23:53.493 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 24, 2024-09-11T22:23:53.493 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 18768, 2024-09-11T22:23:53.493 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:23:53.493 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:23:53.494 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:23:53.494 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:23:53.494 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:53.494 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 13, 2024-09-11T22:23:53.494 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:23:53.495 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:23:53.495 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:23:53.495 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:53.495 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:53.495 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:53.495 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:53.495 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:53.495 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:53.495 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:53.495 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:53.495 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:53.495 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:53.495 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:53.496 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:53.496 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:23:53.496 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:23:53.496 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:53.496 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:53.496 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:53.496 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:53.496 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:53.496 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:53.496 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:53.496 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:53.496 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:53.497 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:53.497 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:53.497 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:53.497 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.497 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:23:53.497 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:23:53.497 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:23:53.497 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:23:53.497 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:23:53.497 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:23:53.497 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:23:53.497 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:23:53.497 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:23:53.498 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:23:53.498 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:23:53.498 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:23:53.498 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:23:53.498 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:23:53.498 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:23:53.498 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:23:53.498 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:23:53.498 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:53.498 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:53.498 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:53.498 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:53.498 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:53.498 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:53.499 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:53.499 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:53.499 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:53.499 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:53.499 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:53.499 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:53.499 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:23:53.499 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.499 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:23:53.499 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.499 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:23:53.499 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:23:53.500 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:53.500 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:53.500 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.500 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:53.500 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:23:53.500 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:53.500 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.500 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.500 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:53.500 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:23:53.500 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:53.500 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:53.501 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:53.501 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.501 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:23:53.501 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:23:53.501 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:53.501 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:53.501 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:53.501 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.501 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.501 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:23:53.501 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:23:53.501 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:53.501 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:53.501 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.502 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:53.502 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:23:53.502 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:53.502 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.502 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.502 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:53.502 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:23:53.502 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:53.502 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:53.502 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:53.502 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.502 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:23:53.502 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:23:53.503 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:53.503 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:53.503 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:53.503 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.503 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.503 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:23:53.504 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:23:53.504 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:53.504 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:53.504 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.504 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:53.505 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:23:53.505 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:53.505 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.505 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.505 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:53.505 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:23:53.506 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:53.506 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:53.506 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:53.506 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.506 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:23:53.506 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:23:53.506 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:53.507 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:53.507 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:53.507 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:53.507 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:53.507 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.507 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:23:53.507 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:23:53.507 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.507 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:53.507 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:53.507 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:23:53.507 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:53.507 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:53.507 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:23:53.508 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.508 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:53.508 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:53.508 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:23:53.508 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:53.508 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:53.508 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.508 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:23:53.508 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:23:53.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.491+0000 7f290df8d640 1 -- 172.21.15.100:0/1042686438 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f28f406beb0 msgr2=0x7f28f406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.491+0000 7f290df8d640 1 --2- 172.21.15.100:0/1042686438 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f28f406beb0 0x7f28f406e370 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2900033000 tx=0x7f2900009000 comp rx=0 tx=0).stop 2024-09-11T22:23:53.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.491+0000 7f290df8d640 1 -- 172.21.15.100:0/1042686438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f290806ce60 msgr2=0x7f29080c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.491+0000 7f290df8d640 1 --2- 172.21.15.100:0/1042686438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f290806ce60 0x7f29080c9e80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f28f800c450 tx=0x7f28f800c910 comp rx=0 tx=0).stop 2024-09-11T22:23:53.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.491+0000 7f2907fff640 1 -- 172.21.15.100:0/1042686438 reap_dead start 2024-09-11T22:23:53.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.491+0000 7f2907fff640 1 -- 172.21.15.100:0/1042686438 reap_dead start 2024-09-11T22:23:53.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.491+0000 7f290df8d640 1 -- 172.21.15.100:0/1042686438 shutdown_connections 2024-09-11T22:23:53.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.491+0000 7f290df8d640 1 -- 172.21.15.100:0/1042686438 >> 172.21.15.100:0/1042686438 conn(0x7f290806bc10 msgr2=0x7f29080cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:53.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.491+0000 7f290df8d640 1 -- 172.21.15.100:0/1042686438 shutdown_connections 2024-09-11T22:23:53.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.491+0000 7f290df8d640 1 -- 172.21.15.100:0/1042686438 wait complete. 2024-09-11T22:23:53.511 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:23:53.511 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:23:53.511 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:23:53.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.623+0000 7fd555fa6640 1 Processor -- start 2024-09-11T22:23:53.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.623+0000 7fd555fa6640 1 -- start start 2024-09-11T22:23:53.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.624+0000 7fd555fa6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd5500ccd90 0x7fd550152580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:53.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.624+0000 7fd555fa6640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5500c6bb0 con 0x7fd5500cc9b0 2024-09-11T22:23:53.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.624+0000 7fd555fa6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5500c7fa0 con 0x7fd5500c7710 2024-09-11T22:23:53.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.624+0000 7fd555fa6640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fd550075d50 con 0x7fd5500ccd90 2024-09-11T22:23:53.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.624+0000 7fd54effd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd5500ccd90 0x7fd550152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:53.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.624+0000 7fd54effd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd5500ccd90 0x7fd550152580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36990/0 (socket says 172.21.15.100:36990) 2024-09-11T22:23:53.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.624+0000 7fd54effd640 1 -- 172.21.15.100:0/222910734 learned_addr learned my addr 172.21.15.100:0/222910734 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:53.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.625+0000 7fd54effd640 1 -- 172.21.15.100:0/222910734 >> v1:172.21.15.167:6789/0 conn(0x7fd5500c7710 legacy=0x7fd550163020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.625+0000 7fd54effd640 1 -- 172.21.15.100:0/222910734 >> v1:172.21.15.100:6789/0 conn(0x7fd5500cc9b0 legacy=0x7fd55015bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.625+0000 7fd54effd640 1 -- 172.21.15.100:0/222910734 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5500c8280 con 0x7fd5500ccd90 2024-09-11T22:23:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.625+0000 7fd54effd640 1 --2- 172.21.15.100:0/222910734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5500ccd90 0x7fd550152580 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd544009870 tx=0x7fd54402a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c375091d6738b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.626+0000 7fd54e7fc640 1 -- 172.21.15.100:0/222910734 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544037070 con 0x7fd5500ccd90 2024-09-11T22:23:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.626+0000 7fd54e7fc640 1 -- 172.21.15.100:0/222910734 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd544032640 con 0x7fd5500ccd90 2024-09-11T22:23:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.626+0000 7fd54e7fc640 1 -- 172.21.15.100:0/222910734 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544032a10 con 0x7fd5500ccd90 2024-09-11T22:23:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.626+0000 7fd555fa6640 1 -- 172.21.15.100:0/222910734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5500ccd90 msgr2=0x7fd550152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.626+0000 7fd555fa6640 1 --2- 172.21.15.100:0/222910734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5500ccd90 0x7fd550152580 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd544009870 tx=0x7fd54402a3c0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.626+0000 7fd555fa6640 1 -- 172.21.15.100:0/222910734 shutdown_connections 2024-09-11T22:23:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.626+0000 7fd555fa6640 1 --2- 172.21.15.100:0/222910734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5500ccd90 0x7fd550152580 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.626+0000 7fd555fa6640 1 -- 172.21.15.100:0/222910734 >> 172.21.15.100:0/222910734 conn(0x7fd55006fa70 msgr2=0x7fd55006fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.626+0000 7fd555fa6640 1 -- 172.21.15.100:0/222910734 shutdown_connections 2024-09-11T22:23:53.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.626+0000 7fd555fa6640 1 -- 172.21.15.100:0/222910734 wait complete. 2024-09-11T22:23:53.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.627+0000 7fd555fa6640 1 Processor -- start 2024-09-11T22:23:53.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.628+0000 7fd555fa6640 1 -- start start 2024-09-11T22:23:53.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.628+0000 7fd555fa6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5500c7710 0x7fd5501f0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:53.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.628+0000 7fd555fa6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5500cc9b0 0x7fd55014b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:53.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.628+0000 7fd555fa6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5500ccd90 0x7fd5501f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:53.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.628+0000 7fd555fa6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd5500c49f0 con 0x7fd5500ccd90 2024-09-11T22:23:53.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.628+0000 7fd555fa6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd5500c4710 con 0x7fd5500cc9b0 2024-09-11T22:23:53.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.628+0000 7fd555fa6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd5500c3bb0 con 0x7fd5500c7710 2024-09-11T22:23:53.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.629+0000 7fd54ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5500ccd90 0x7fd5501f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:53.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.629+0000 7fd54ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5500ccd90 0x7fd5501f3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37000/0 (socket says 172.21.15.100:37000) 2024-09-11T22:23:53.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.629+0000 7fd54ffff640 1 -- 172.21.15.100:0/347746673 learned_addr learned my addr 172.21.15.100:0/347746673 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:23:53.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.629+0000 7fd54effd640 1 --2- 172.21.15.100:0/347746673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5500cc9b0 0x7fd55014b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:53.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.629+0000 7fd54f7fe640 1 --2- 172.21.15.100:0/347746673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5500c7710 0x7fd5501f0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:53.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.629+0000 7fd54ffff640 1 -- 172.21.15.100:0/347746673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5500c7710 msgr2=0x7fd5501f0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.629+0000 7fd54ffff640 1 --2- 172.21.15.100:0/347746673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5500c7710 0x7fd5501f0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.629+0000 7fd54ffff640 1 -- 172.21.15.100:0/347746673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5500cc9b0 msgr2=0x7fd55014b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.629+0000 7fd54ffff640 1 --2- 172.21.15.100:0/347746673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5500cc9b0 0x7fd55014b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.629+0000 7fd54ffff640 1 -- 172.21.15.100:0/347746673 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5501f04c0 con 0x7fd5500ccd90 2024-09-11T22:23:53.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.629+0000 7fd54f7fe640 1 --2- 172.21.15.100:0/347746673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5500c7710 0x7fd5501f0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:23:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.629+0000 7fd54ffff640 1 --2- 172.21.15.100:0/347746673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5500ccd90 0x7fd5501f3a30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd54800c730 tx=0x7fd54800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.629+0000 7fd537fff640 1 -- 172.21.15.100:0/347746673 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd548003b70 con 0x7fd5500ccd90 2024-09-11T22:23:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.629+0000 7fd537fff640 1 -- 172.21.15.100:0/347746673 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd548003d10 con 0x7fd5500ccd90 2024-09-11T22:23:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.629+0000 7fd537fff640 1 -- 172.21.15.100:0/347746673 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54800aa90 con 0x7fd5500ccd90 2024-09-11T22:23:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.629+0000 7fd555fa6640 1 -- 172.21.15.100:0/347746673 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd55015cb70 con 0x7fd5500ccd90 2024-09-11T22:23:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.629+0000 7fd555fa6640 1 -- 172.21.15.100:0/347746673 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5500723b0 con 0x7fd5500ccd90 2024-09-11T22:23:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.630+0000 7fd555fa6640 1 --2- 172.21.15.100:0/347746673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd550072ec0 0x7fd5501f06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.630+0000 7fd555fa6640 1 -- 172.21.15.100:0/347746673 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd5501f1480 con 0x7fd550072ec0 2024-09-11T22:23:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.630+0000 7fd54f7fe640 1 --2- 172.21.15.100:0/347746673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd550072ec0 0x7fd5501f06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.631+0000 7fd54f7fe640 1 -- 172.21.15.100:0/347746673 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5500c7300 con 0x7fd550072ec0 2024-09-11T22:23:53.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.631+0000 7fd537fff640 1 -- 172.21.15.100:0/347746673 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd54800ac30 con 0x7fd5500ccd90 2024-09-11T22:23:53.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.631+0000 7fd54f7fe640 1 --2- 172.21.15.100:0/347746673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd550072ec0 0x7fd5501f06a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd540000f60 tx=0x7fd54000eb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:53.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.631+0000 7fd537fff640 1 --2- 172.21.15.100:0/347746673 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd53c06be60 0x7fd53c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:53.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.631+0000 7fd537fff640 1 -- 172.21.15.100:0/347746673 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fd54808b160 con 0x7fd5500ccd90 2024-09-11T22:23:53.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.631+0000 7fd54effd640 1 --2- 172.21.15.100:0/347746673 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd53c06be60 0x7fd53c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:53.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.632+0000 7fd537fff640 1 -- 172.21.15.100:0/347746673 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5400050d0 con 0x7fd550072ec0 2024-09-11T22:23:53.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.632+0000 7fd537fff640 1 -- 172.21.15.100:0/347746673 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd540005270 con 0x7fd550072ec0 2024-09-11T22:23:53.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.632+0000 7fd537fff640 1 -- 172.21.15.100:0/347746673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd550072ec0 msgr2=0x7fd5501f06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.632+0000 7fd537fff640 1 --2- 172.21.15.100:0/347746673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd550072ec0 0x7fd5501f06a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd540000f60 tx=0x7fd54000eb90 comp rx=0 tx=0).stop 2024-09-11T22:23:53.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.632+0000 7fd537fff640 1 -- 172.21.15.100:0/347746673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd550072ec0 msgr2=0x7fd5501f06a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:23:53.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.632+0000 7fd537fff640 1 --2- 172.21.15.100:0/347746673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd550072ec0 0x7fd5501f06a0 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd540000f60 tx=0x7fd54000eb90 comp rx=0 tx=0).stop 2024-09-11T22:23:53.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.632+0000 7fd54effd640 1 --2- 172.21.15.100:0/347746673 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd53c06be60 0x7fd53c06e320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd544034000 tx=0x7fd54402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:53.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.638+0000 7fd555fa6640 1 --2- 172.21.15.100:0/347746673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5501f3f70 0x7fd5501f4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:23:53.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.638+0000 7fd555fa6640 1 -- 172.21.15.100:0/347746673 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd5501f4890 con 0x7fd5501f3f70 2024-09-11T22:23:53.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.638+0000 7fd54f7fe640 1 --2- 172.21.15.100:0/347746673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5501f3f70 0x7fd5501f4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:23:53.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.638+0000 7fd54f7fe640 1 -- 172.21.15.100:0/347746673 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd5500c5430 con 0x7fd5501f3f70 2024-09-11T22:23:53.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.639+0000 7fd54f7fe640 1 --2- 172.21.15.100:0/347746673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5501f3f70 0x7fd5501f4350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd540000f60 tx=0x7fd540001120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:23:53.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.639+0000 7fd537fff640 1 -- 172.21.15.100:0/347746673 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd540007580 con 0x7fd5501f3f70 2024-09-11T22:23:53.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.639+0000 7fd537fff640 1 -- 172.21.15.100:0/347746673 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7fd540007580 con 0x7fd5501f3f70 2024-09-11T22:23:53.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.639+0000 7fd537fff640 1 -- 172.21.15.100:0/347746673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5501f3f70 msgr2=0x7fd5501f4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.639+0000 7fd537fff640 1 --2- 172.21.15.100:0/347746673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5501f3f70 0x7fd5501f4350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd540000f60 tx=0x7fd540001120 comp rx=0 tx=0).stop 2024-09-11T22:23:53.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.639+0000 7fd537fff640 1 -- 172.21.15.100:0/347746673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5501f3f70 msgr2=0x7fd5501f4350 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:23:53.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.639+0000 7fd537fff640 1 --2- 172.21.15.100:0/347746673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5501f3f70 0x7fd5501f4350 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.641 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:23:53.641 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:23:53.641 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:23:53.641 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:23:53.641 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 24, 2024-09-11T22:23:53.641 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 124360, 2024-09-11T22:23:53.642 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:23:53.642 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:23:53.642 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:23:53.642 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:23:53.642 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:53.642 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 13, 2024-09-11T22:23:53.642 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:23:53.642 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:23:53.642 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:23:53.642 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:53.642 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:53.642 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:53.642 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:53.643 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:53.643 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:53.643 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:53.643 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:53.643 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:53.643 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:53.643 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:53.643 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:53.643 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:23:53.643 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:23:53.643 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:53.643 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:53.643 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:53.644 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:53.644 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:53.644 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:53.644 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:53.644 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:53.644 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:53.644 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:53.644 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:53.644 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:53.644 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.644 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:23:53.644 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:23:53.644 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:23:53.644 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:23:53.645 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:23:53.645 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:23:53.645 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:23:53.645 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:23:53.645 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:23:53.645 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:23:53.645 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:23:53.645 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:23:53.645 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:23:53.645 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:23:53.645 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:23:53.645 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:23:53.646 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:23:53.646 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:23:53.646 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:23:53.646 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:23:53.646 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:23:53.646 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:23:53.646 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:23:53.646 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:23:53.646 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:23:53.646 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:23:53.646 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:23:53.646 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:23:53.646 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:53.647 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:23:53.647 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.647 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:23:53.647 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.647 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:23:53.647 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:23:53.647 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:53.647 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:53.647 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.648 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:53.648 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:23:53.648 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:53.648 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.648 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.648 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:53.648 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:23:53.648 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:53.648 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:53.649 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:53.649 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.649 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:23:53.649 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:23:53.649 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:53.649 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:53.649 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:53.650 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.650 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.650 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:23:53.650 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:23:53.650 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:53.650 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:53.650 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.650 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:53.651 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:23:53.651 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:53.651 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.651 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.651 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:53.651 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:23:53.651 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:53.651 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:53.651 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:53.652 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.652 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:23:53.652 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:23:53.652 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:53.652 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:53.652 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:53.652 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.653 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.653 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:23:53.653 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:23:53.653 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:23:53.653 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:23:53.653 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.653 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:23:53.653 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:23:53.654 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:53.654 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.654 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.654 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:23:53.654 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:23:53.654 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:23:53.654 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:53.654 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:53.654 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.655 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:23:53.655 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:23:53.655 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:23:53.655 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:23:53.655 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:23:53.655 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:53.655 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:53.656 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.656 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:23:53.656 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:23:53.656 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.656 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:53.656 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:53.656 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:23:53.656 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:53.657 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:53.657 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:23:53.657 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.657 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:53.657 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:53.657 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:23:53.657 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:53.657 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:53.658 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:23:53.658 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.658 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:53.658 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:53.658 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:23:53.658 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:53.658 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:53.658 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:23:53.659 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.659 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:53.659 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:53.659 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:23:53.659 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:53.659 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:23:53.659 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:23:53.659 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:23:53.660 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:23:53.660 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:23:53.660 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:23:53.660 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:23:53.660 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:23:53.660 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:23:53.660 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:23:53.660 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:23:53.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.639+0000 7fd555fa6640 1 -- 172.21.15.100:0/347746673 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd53c06be60 msgr2=0x7fd53c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.639+0000 7fd555fa6640 1 --2- 172.21.15.100:0/347746673 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd53c06be60 0x7fd53c06e320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd544034000 tx=0x7fd54402e000 comp rx=0 tx=0).stop 2024-09-11T22:23:53.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.639+0000 7fd555fa6640 1 -- 172.21.15.100:0/347746673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5500ccd90 msgr2=0x7fd5501f3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:23:53.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.639+0000 7fd555fa6640 1 --2- 172.21.15.100:0/347746673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5500ccd90 0x7fd5501f3a30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd54800c730 tx=0x7fd54800cbf0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.639+0000 7fd54ffff640 1 -- 172.21.15.100:0/347746673 reap_dead start 2024-09-11T22:23:53.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.639+0000 7fd555fa6640 1 -- 172.21.15.100:0/347746673 shutdown_connections 2024-09-11T22:23:53.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.639+0000 7fd555fa6640 1 --2- 172.21.15.100:0/347746673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5500ccd90 0x7fd5501f3a30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:23:53.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.639+0000 7fd555fa6640 1 -- 172.21.15.100:0/347746673 >> 172.21.15.100:0/347746673 conn(0x7fd55006fa70 msgr2=0x7fd5501506d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:23:53.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.640+0000 7fd555fa6640 1 -- 172.21.15.100:0/347746673 shutdown_connections 2024-09-11T22:23:53.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:23:53.640+0000 7fd555fa6640 1 -- 172.21.15.100:0/347746673 wait complete. 2024-09-11T22:23:53.663 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:23:53.663 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-11T22:23:53.663 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2024-09-11T22:23:53.663 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-11T22:23:53.663 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:23:53.664 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T22:23:53.664 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:23:53.677 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T22:23:53.677 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-09-11T22:23:53.677 INFO:tasks.ceph.mon.b:Sent signal 19 2024-09-11T22:23:53.677 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-11T22:24:08.678 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-09-11T22:24:08.679 INFO:tasks.ceph.mon.b:Sent signal 18 2024-09-11T22:24:08.679 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-11T22:24:08.680 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:24:08.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.792+0000 7f654039f640 1 Processor -- start 2024-09-11T22:24:08.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.792+0000 7f654039f640 1 -- start start 2024-09-11T22:24:08.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.793+0000 7f654039f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6538154c20 0x7f65380cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:08.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.793+0000 7f654039f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 0x7f653815e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:08.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.793+0000 7f654039f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f653815ac90 con 0x7f653815a7e0 2024-09-11T22:24:08.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.793+0000 7f654039f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f653815e000 con 0x7f65380b3190 2024-09-11T22:24:08.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.793+0000 7f654039f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f653815af70 con 0x7f6538154c20 2024-09-11T22:24:08.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.793+0000 7f653d93a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 0x7f653815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:08.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.793+0000 7f653e13b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6538154c20 0x7f65380cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:08.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.793+0000 7f653d93a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 0x7f653815e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:38026/0 (socket says 172.21.15.100:38026) 2024-09-11T22:24:08.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.793+0000 7f653d93a640 1 -- 172.21.15.100:0/628389538 learned_addr learned my addr 172.21.15.100:0/628389538 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:24:08.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.793+0000 7f653e93c640 1 --1- 172.21.15.100:0/628389538 >> v1:172.21.15.167:6789/0 conn(0x7f653815a7e0 0x7f65380cbd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:42828/0 (socket says 172.21.15.100:42828) 2024-09-11T22:24:08.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.793+0000 7f653e13b640 1 -- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6538154c20 msgr2=0x7f65380cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:24:08.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.793+0000 7f653e13b640 1 -- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6538154c20 msgr2=0x7f65380cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:24:08.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.793+0000 7f653e13b640 1 --2- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6538154c20 0x7f65380cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:24:08.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.793+0000 7f653e13b640 1 --2- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6538154c20 0x7f65380cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:24:08.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.793+0000 7f653d93a640 1 -- 172.21.15.100:0/628389538 >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 msgr2=0x7f653815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:24:08.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.793+0000 7f653d93a640 1 -- 172.21.15.100:0/628389538 >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 msgr2=0x7f653815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:24:08.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.793+0000 7f653d93a640 1 --2- 172.21.15.100:0/628389538 >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 0x7f653815e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:24:08.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.793+0000 7f653d93a640 1 --2- 172.21.15.100:0/628389538 >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 0x7f653815e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:24:08.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.994+0000 7f653d93a640 1 --2- 172.21.15.100:0/628389538 >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 0x7f653815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:08.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.994+0000 7f653d93a640 1 -- 172.21.15.100:0/628389538 >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 msgr2=0x7f653815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:24:08.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.994+0000 7f653d93a640 1 -- 172.21.15.100:0/628389538 >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 msgr2=0x7f653815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:24:08.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.994+0000 7f653d93a640 1 --2- 172.21.15.100:0/628389538 >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 0x7f653815e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:24:08.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.994+0000 7f653d93a640 1 --2- 172.21.15.100:0/628389538 >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 0x7f653815e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:24:08.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.994+0000 7f653e13b640 1 --2- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6538154c20 0x7f65380cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:08.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.995+0000 7f653e13b640 1 -- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6538154c20 msgr2=0x7f65380cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:24:08.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.995+0000 7f653e13b640 1 -- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6538154c20 msgr2=0x7f65380cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:24:08.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.995+0000 7f653e13b640 1 --2- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6538154c20 0x7f65380cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:24:08.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:08.995+0000 7f653e13b640 1 --2- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6538154c20 0x7f65380cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:24:09.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:09.395+0000 7f653d93a640 1 --2- 172.21.15.100:0/628389538 >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 0x7f653815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:09.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:09.395+0000 7f653d93a640 1 -- 172.21.15.100:0/628389538 >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 msgr2=0x7f653815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:24:09.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:09.395+0000 7f653d93a640 1 -- 172.21.15.100:0/628389538 >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 msgr2=0x7f653815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:24:09.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:09.395+0000 7f653d93a640 1 --2- 172.21.15.100:0/628389538 >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 0x7f653815e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:24:09.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:09.395+0000 7f653d93a640 1 --2- 172.21.15.100:0/628389538 >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 0x7f653815e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:24:09.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:09.396+0000 7f653e13b640 1 --2- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6538154c20 0x7f65380cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:09.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:09.396+0000 7f653e13b640 1 -- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6538154c20 msgr2=0x7f65380cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:24:09.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:09.396+0000 7f653e13b640 1 -- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6538154c20 msgr2=0x7f65380cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:24:09.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:09.396+0000 7f653e13b640 1 --2- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6538154c20 0x7f65380cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:24:09.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:09.396+0000 7f653e13b640 1 --2- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6538154c20 0x7f65380cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:24:10.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:10.196+0000 7f653d93a640 1 --2- 172.21.15.100:0/628389538 >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 0x7f653815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:10.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:10.197+0000 7f653d93a640 1 -- 172.21.15.100:0/628389538 >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 msgr2=0x7f653815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:24:10.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:10.197+0000 7f653d93a640 1 -- 172.21.15.100:0/628389538 >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 msgr2=0x7f653815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:24:10.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:10.197+0000 7f653d93a640 1 --2- 172.21.15.100:0/628389538 >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 0x7f653815e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:24:10.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:10.197+0000 7f653d93a640 1 --2- 172.21.15.100:0/628389538 >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 0x7f653815e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:24:10.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:10.197+0000 7f653e13b640 1 --2- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6538154c20 0x7f65380cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:10.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:10.197+0000 7f653e13b640 1 -- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6538154c20 msgr2=0x7f65380cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:24:10.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:10.197+0000 7f653e13b640 1 -- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6538154c20 msgr2=0x7f65380cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:24:10.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:10.197+0000 7f653e13b640 1 --2- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6538154c20 0x7f65380cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:24:10.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:10.197+0000 7f653e13b640 1 --2- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6538154c20 0x7f65380cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:24:11.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:11.793+0000 7f652ffff640 1 -- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6538154c20 msgr2=0x7f65380cb120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:24:11.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:11.793+0000 7f652ffff640 1 --2- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6538154c20 0x7f65380cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:11.793+0000 7f652ffff640 1 -- 172.21.15.100:0/628389538 >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 msgr2=0x7f653815e490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:24:11.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:11.793+0000 7f652ffff640 1 --2- 172.21.15.100:0/628389538 >> v2:172.21.15.167:3300/0 conn(0x7f65380b3190 0x7f653815e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:11.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:11.793+0000 7f652ffff640 1 -- 172.21.15.100:0/628389538 >> v1:172.21.15.167:6789/0 conn(0x7f653815a7e0 legacy=0x7f65380cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:11.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:11.793+0000 7f652ffff640 1 --2- 172.21.15.100:0/628389538 >> v2:172.21.15.100:3300/0 conn(0x7f651c0036e0 0x7f651c005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:11.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:11.793+0000 7f652ffff640 1 -- 172.21.15.100:0/628389538 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f653815b250 con 0x7f651c006170 2024-09-11T22:24:11.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:11.793+0000 7f652ffff640 1 -- 172.21.15.100:0/628389538 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f653815e000 con 0x7f651c0036e0 2024-09-11T22:24:11.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:11.793+0000 7f653e13b640 1 -- 172.21.15.100:0/628389538 >> v2:172.21.15.100:3300/0 conn(0x7f651c0036e0 msgr2=0x7f651c005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:24:11.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:11.793+0000 7f653d93a640 1 -- 172.21.15.100:0/628389538 >> v1:172.21.15.100:6789/0 conn(0x7f651c006170 legacy=0x7f651c008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:24:11.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:11.793+0000 7f653e13b640 1 --2- 172.21.15.100:0/628389538 >> v2:172.21.15.100:3300/0 conn(0x7f651c0036e0 0x7f651c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:24:11.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:11.994+0000 7f653d93a640 1 -- 172.21.15.100:0/628389538 >> v1:172.21.15.100:6789/0 conn(0x7f651c006170 legacy=0x7f651c008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:24:11.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:11.994+0000 7f653e13b640 1 -- 172.21.15.100:0/628389538 >> v2:172.21.15.100:3300/0 conn(0x7f651c0036e0 msgr2=0x7f651c005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:24:11.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:11.994+0000 7f653e13b640 1 --2- 172.21.15.100:0/628389538 >> v2:172.21.15.100:3300/0 conn(0x7f651c0036e0 0x7f651c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:24:12.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:12.395+0000 7f653d93a640 1 -- 172.21.15.100:0/628389538 >> v1:172.21.15.100:6789/0 conn(0x7f651c006170 legacy=0x7f651c008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:24:12.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:12.395+0000 7f653e13b640 1 -- 172.21.15.100:0/628389538 >> v2:172.21.15.100:3300/0 conn(0x7f651c0036e0 msgr2=0x7f651c005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:24:12.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:12.395+0000 7f653e13b640 1 --2- 172.21.15.100:0/628389538 >> v2:172.21.15.100:3300/0 conn(0x7f651c0036e0 0x7f651c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:24:13.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:13.196+0000 7f653d93a640 1 -- 172.21.15.100:0/628389538 >> v1:172.21.15.100:6789/0 conn(0x7f651c006170 legacy=0x7f651c008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:24:13.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:13.196+0000 7f653e13b640 1 -- 172.21.15.100:0/628389538 >> v2:172.21.15.100:3300/0 conn(0x7f651c0036e0 msgr2=0x7f651c005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:24:13.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:13.196+0000 7f653e13b640 1 --2- 172.21.15.100:0/628389538 >> v2:172.21.15.100:3300/0 conn(0x7f651c0036e0 0x7f651c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:24:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.794+0000 7f652ffff640 1 -- 172.21.15.100:0/628389538 >> v2:172.21.15.100:3300/0 conn(0x7f651c0036e0 msgr2=0x7f651c005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:24:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.794+0000 7f652ffff640 1 --2- 172.21.15.100:0/628389538 >> v2:172.21.15.100:3300/0 conn(0x7f651c0036e0 0x7f651c005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.794+0000 7f652ffff640 1 -- 172.21.15.100:0/628389538 >> v1:172.21.15.100:6789/0 conn(0x7f651c006170 legacy=0x7f651c008610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:24:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.794+0000 7f653e93c640 1 -- 172.21.15.100:0/628389538 reap_dead start 2024-09-11T22:24:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.794+0000 7f652ffff640 1 --2- 172.21.15.100:0/628389538 >> v2:172.21.15.167:3300/0 conn(0x7f651c005b20 0x7f651c00e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.794+0000 7f652ffff640 1 -- 172.21.15.100:0/628389538 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f651c00afb0 con 0x7f651c006170 2024-09-11T22:24:14.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.794+0000 7f652ffff640 1 -- 172.21.15.100:0/628389538 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f653815b250 con 0x7f651c009eb0 2024-09-11T22:24:14.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.794+0000 7f653e13b640 1 -- 172.21.15.100:0/628389538 >> v1:172.21.15.100:6789/0 conn(0x7f651c006170 legacy=0x7f651c008610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:24:14.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.794+0000 7f652ffff640 1 -- 172.21.15.100:0/628389538 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f653815e000 con 0x7f651c005b20 2024-09-11T22:24:14.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.794+0000 7f653e93c640 1 --2- 172.21.15.100:0/628389538 >> v2:172.21.15.167:3300/0 conn(0x7f651c005b20 0x7f651c00e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:14.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.794+0000 7f653e93c640 1 -- 172.21.15.100:0/628389538 >> v1:172.21.15.167:6789/0 conn(0x7f651c009eb0 legacy=0x7f651c00a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:14.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.794+0000 7f653e93c640 1 -- 172.21.15.100:0/628389538 >> v1:172.21.15.100:6789/0 conn(0x7f651c006170 legacy=0x7f651c008610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:24:14.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.794+0000 7f653e93c640 1 -- 172.21.15.100:0/628389538 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f651c00ac10 con 0x7f651c005b20 2024-09-11T22:24:14.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.795+0000 7f653e93c640 1 --2- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f651c005b20 0x7f651c00e400 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f653806d920 tx=0x7f653002a260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f85812445ad2262d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:14.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.795+0000 7f653d139640 1 -- 172.21.15.100:0/628389538 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653002ab60 con 0x7f651c005b20 2024-09-11T22:24:14.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.795+0000 7f653d139640 1 -- 172.21.15.100:0/628389538 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f653002e070 con 0x7f651c005b20 2024-09-11T22:24:14.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.795+0000 7f653d139640 1 -- 172.21.15.100:0/628389538 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6530007070 con 0x7f651c005b20 2024-09-11T22:24:14.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.796+0000 7f654039f640 1 -- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f651c005b20 msgr2=0x7f651c00e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:14.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.796+0000 7f654039f640 1 --2- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f651c005b20 0x7f651c00e400 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f653806d920 tx=0x7f653002a260 comp rx=0 tx=0).stop 2024-09-11T22:24:14.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.796+0000 7f654039f640 1 -- 172.21.15.100:0/628389538 shutdown_connections 2024-09-11T22:24:14.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.796+0000 7f654039f640 1 --2- 172.21.15.100:0/628389538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f651c005b20 0x7f651c00e400 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.796+0000 7f654039f640 1 -- 172.21.15.100:0/628389538 >> 172.21.15.100:0/628389538 conn(0x7f6538067d40 msgr2=0x7f653806d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:14.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.796+0000 7f654039f640 1 -- 172.21.15.100:0/628389538 shutdown_connections 2024-09-11T22:24:14.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.796+0000 7f654039f640 1 -- 172.21.15.100:0/628389538 wait complete. 2024-09-11T22:24:14.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.798+0000 7f654039f640 1 Processor -- start 2024-09-11T22:24:14.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.798+0000 7f654039f640 1 -- start start 2024-09-11T22:24:14.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.799+0000 7f654039f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f651c005b20 0x7f65381f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.799+0000 7f654039f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f651c006170 0x7f65380c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.799+0000 7f654039f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f651c009eb0 0x7f65380cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.799+0000 7f654039f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f65380cb2a0 con 0x7f651c009eb0 2024-09-11T22:24:14.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.799+0000 7f654039f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f65380cb120 con 0x7f651c006170 2024-09-11T22:24:14.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.799+0000 7f654039f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f65380cb420 con 0x7f651c005b20 2024-09-11T22:24:14.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.799+0000 7f653e93c640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f651c009eb0 msgr2=0x7f65380cf8c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:24:14.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.799+0000 7f653e93c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f651c009eb0 0x7f65380cf8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:24:14.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.799+0000 7f653e13b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f651c005b20 0x7f65381f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:14.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.799+0000 7f653d93a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f651c006170 0x7f65380c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:14.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.799+0000 7f653e13b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f651c005b20 0x7f65381f4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:35038/0 (socket says 172.21.15.100:35038) 2024-09-11T22:24:14.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.799+0000 7f653e13b640 1 -- 172.21.15.100:0/3797663461 learned_addr learned my addr 172.21.15.100:0/3797663461 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:24:14.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.799+0000 7f653d93a640 1 -- 172.21.15.100:0/3797663461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f651c005b20 msgr2=0x7f65381f4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:14.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.799+0000 7f653d93a640 1 --2- 172.21.15.100:0/3797663461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f651c005b20 0x7f65381f4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.799+0000 7f653d93a640 1 -- 172.21.15.100:0/3797663461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f651c009eb0 msgr2=0x7f65380cf8c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:24:14.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.799+0000 7f653d93a640 1 --2- 172.21.15.100:0/3797663461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f651c009eb0 0x7f65380cf8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:14.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.799+0000 7f653d93a640 1 -- 172.21.15.100:0/3797663461 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65380c9cd0 con 0x7f651c006170 2024-09-11T22:24:14.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.799+0000 7f653e13b640 1 --2- 172.21.15.100:0/3797663461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f651c005b20 0x7f65381f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:24:14.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.800+0000 7f653d93a640 1 --2- 172.21.15.100:0/3797663461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f651c006170 0x7f65380c8ee0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f653806d770 tx=0x7f6528010890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:14.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.800+0000 7f652effd640 1 -- 172.21.15.100:0/3797663461 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652801b070 con 0x7f651c006170 2024-09-11T22:24:14.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.800+0000 7f652effd640 1 -- 172.21.15.100:0/3797663461 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65280168c0 con 0x7f651c006170 2024-09-11T22:24:14.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.800+0000 7f654039f640 1 -- 172.21.15.100:0/3797663461 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65380c9fb0 con 0x7f651c006170 2024-09-11T22:24:14.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.800+0000 7f652effd640 1 -- 172.21.15.100:0/3797663461 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652800f040 con 0x7f651c006170 2024-09-11T22:24:14.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.800+0000 7f654039f640 1 -- 172.21.15.100:0/3797663461 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65381f0a60 con 0x7f651c006170 2024-09-11T22:24:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.801+0000 7f654039f640 1 -- 172.21.15.100:0/3797663461 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f653815af70 con 0x7f651c006170 2024-09-11T22:24:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.802+0000 7f652effd640 1 -- 172.21.15.100:0/3797663461 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6528016cb0 con 0x7f651c006170 2024-09-11T22:24:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.802+0000 7f652effd640 1 --2- 172.21.15.100:0/3797663461 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f651c06d3c0 0x7f651c06f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.802+0000 7f652effd640 1 -- 172.21.15.100:0/3797663461 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f652808be20 con 0x7f651c006170 2024-09-11T22:24:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.802+0000 7f653e13b640 1 --2- 172.21.15.100:0/3797663461 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f651c06d3c0 0x7f651c06f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.803+0000 7f653e13b640 1 --2- 172.21.15.100:0/3797663461 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f651c06d3c0 0x7f651c06f880 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6534008010 tx=0x7f6534008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:14.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:14.807+0000 7f652effd640 1 -- 172.21.15.100:0/3797663461 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6528059bb0 con 0x7f651c006170 2024-09-11T22:24:15.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.085+0000 7f654039f640 1 -- 172.21.15.100:0/3797663461 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f65380cc2b0 con 0x7f651c006170 2024-09-11T22:24:15.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.086+0000 7f652effd640 1 -- 172.21.15.100:0/3797663461 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7f652805deb0 con 0x7f651c006170 2024-09-11T22:24:15.087 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":26,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:24:15.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.089+0000 7f654039f640 1 -- 172.21.15.100:0/3797663461 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f651c06d3c0 msgr2=0x7f651c06f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:15.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.089+0000 7f654039f640 1 --2- 172.21.15.100:0/3797663461 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f651c06d3c0 0x7f651c06f880 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6534008010 tx=0x7f6534008040 comp rx=0 tx=0).stop 2024-09-11T22:24:15.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.089+0000 7f654039f640 1 -- 172.21.15.100:0/3797663461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f651c006170 msgr2=0x7f65380c8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:15.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.089+0000 7f654039f640 1 --2- 172.21.15.100:0/3797663461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f651c006170 0x7f65380c8ee0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f653806d770 tx=0x7f6528010890 comp rx=0 tx=0).stop 2024-09-11T22:24:15.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.089+0000 7f654039f640 1 -- 172.21.15.100:0/3797663461 shutdown_connections 2024-09-11T22:24:15.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.089+0000 7f654039f640 1 --2- 172.21.15.100:0/3797663461 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f651c06d3c0 0x7f651c06f880 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.089+0000 7f654039f640 1 --2- 172.21.15.100:0/3797663461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f651c009eb0 0x7f65380cf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.089+0000 7f654039f640 1 --2- 172.21.15.100:0/3797663461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f651c006170 0x7f65380c8ee0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.089+0000 7f654039f640 1 --2- 172.21.15.100:0/3797663461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f651c005b20 0x7f65381f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.089+0000 7f654039f640 1 -- 172.21.15.100:0/3797663461 >> 172.21.15.100:0/3797663461 conn(0x7f6538067d40 msgr2=0x7f6538159130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:15.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.089+0000 7f654039f640 1 -- 172.21.15.100:0/3797663461 shutdown_connections 2024-09-11T22:24:15.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.089+0000 7f654039f640 1 -- 172.21.15.100:0/3797663461 wait complete. 2024-09-11T22:24:15.100 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-11T22:24:15.100 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-11T22:24:15.101 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:24:15.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.209+0000 7f1c7d2d0640 1 Processor -- start 2024-09-11T22:24:15.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.209+0000 7f1c7d2d0640 1 -- start start 2024-09-11T22:24:15.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.210+0000 7f1c7d2d0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c7806d240 0x7f1c781546b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:15.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.210+0000 7f1c7d2d0640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1c7815b2e0 0x7f1c78154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:15.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.210+0000 7f1c7d2d0640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c780c6510 con 0x7f1c7806ce60 2024-09-11T22:24:15.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.210+0000 7f1c7d2d0640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f1c7815b820 con 0x7f1c7815b2e0 2024-09-11T22:24:15.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.210+0000 7f1c7d2d0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1c780c5470 con 0x7f1c7806d240 2024-09-11T22:24:15.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.210+0000 7f1c76ffd640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f1c7806ce60 legacy=0x7f1c7815bd50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:24:15.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.210+0000 7f1c777fe640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f1c7815b2e0 msgr2=0x7f1c78154bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:24:15.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.211+0000 7f1c777fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1c7815b2e0 0x7f1c78154bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:24:15.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.211+0000 7f1c767fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c7806d240 0x7f1c781546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:15.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.211+0000 7f1c767fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c7806d240 0x7f1c781546b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:35050/0 (socket says 172.21.15.100:35050) 2024-09-11T22:24:15.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.211+0000 7f1c767fc640 1 -- 172.21.15.100:0/2578526474 learned_addr learned my addr 172.21.15.100:0/2578526474 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:24:15.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.211+0000 7f1c767fc640 1 -- 172.21.15.100:0/2578526474 >> v2:172.21.15.100:3300/0 conn(0x7f1c7815b2e0 msgr2=0x7f1c78154bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:24:15.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.211+0000 7f1c767fc640 1 --2- 172.21.15.100:0/2578526474 >> v2:172.21.15.100:3300/0 conn(0x7f1c7815b2e0 0x7f1c78154bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.211+0000 7f1c767fc640 1 -- 172.21.15.100:0/2578526474 >> v1:172.21.15.100:6789/0 conn(0x7f1c7806ce60 legacy=0x7f1c7815bd50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:24:15.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.211+0000 7f1c767fc640 1 -- 172.21.15.100:0/2578526474 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c780c5750 con 0x7f1c7806d240 2024-09-11T22:24:15.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.212+0000 7f1c767fc640 1 --2- 172.21.15.100:0/2578526474 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c7806d240 0x7f1c781546b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c009870 tx=0x7f1c6c02a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82bc701db7d9d2ac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:15.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.212+0000 7f1c75ffb640 1 -- 172.21.15.100:0/2578526474 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c037070 con 0x7f1c7806d240 2024-09-11T22:24:15.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.212+0000 7f1c75ffb640 1 -- 172.21.15.100:0/2578526474 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c6c032440 con 0x7f1c7806d240 2024-09-11T22:24:15.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.212+0000 7f1c75ffb640 1 -- 172.21.15.100:0/2578526474 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c032810 con 0x7f1c7806d240 2024-09-11T22:24:15.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.213+0000 7f1c7d2d0640 1 -- 172.21.15.100:0/2578526474 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c7806d240 msgr2=0x7f1c781546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:15.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.213+0000 7f1c7d2d0640 1 --2- 172.21.15.100:0/2578526474 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c7806d240 0x7f1c781546b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c009870 tx=0x7f1c6c02a230 comp rx=0 tx=0).stop 2024-09-11T22:24:15.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.213+0000 7f1c7d2d0640 1 -- 172.21.15.100:0/2578526474 shutdown_connections 2024-09-11T22:24:15.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.213+0000 7f1c7d2d0640 1 --2- 172.21.15.100:0/2578526474 >> v2:172.21.15.100:3300/0 conn(0x7f1c7815b2e0 0x7f1c78154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.213+0000 7f1c7d2d0640 1 --2- 172.21.15.100:0/2578526474 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c7806d240 0x7f1c781546b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.213+0000 7f1c7d2d0640 1 -- 172.21.15.100:0/2578526474 >> 172.21.15.100:0/2578526474 conn(0x7f1c7806bc10 msgr2=0x7f1c7806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:15.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.213+0000 7f1c7d2d0640 1 -- 172.21.15.100:0/2578526474 shutdown_connections 2024-09-11T22:24:15.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.213+0000 7f1c7d2d0640 1 -- 172.21.15.100:0/2578526474 wait complete. 2024-09-11T22:24:15.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.214+0000 7f1c7d2d0640 1 Processor -- start 2024-09-11T22:24:15.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.214+0000 7f1c7d2d0640 1 -- start start 2024-09-11T22:24:15.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.215+0000 7f1c7d2d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c7806ce60 0x7f1c78157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:15.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.215+0000 7f1c7d2d0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c7806d240 0x7f1c781f3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:15.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.215+0000 7f1c7d2d0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c7815b2e0 0x7f1c78156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:15.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.215+0000 7f1c7d2d0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7815c460 con 0x7f1c7806ce60 2024-09-11T22:24:15.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.215+0000 7f1c7d2d0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1c780c5d10 con 0x7f1c7815b2e0 2024-09-11T22:24:15.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.215+0000 7f1c7d2d0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1c780cb1b0 con 0x7f1c7806d240 2024-09-11T22:24:15.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.215+0000 7f1c76ffd640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c7806ce60 msgr2=0x7f1c78157d60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:24:15.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.215+0000 7f1c76ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c7806ce60 0x7f1c78157d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:24:15.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.216+0000 7f1c767fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c7806d240 0x7f1c781f3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:15.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.216+0000 7f1c777fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c7815b2e0 0x7f1c78156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:15.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.216+0000 7f1c767fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c7806d240 0x7f1c781f3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:35052/0 (socket says 172.21.15.100:35052) 2024-09-11T22:24:15.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.216+0000 7f1c767fc640 1 -- 172.21.15.100:0/2331110286 learned_addr learned my addr 172.21.15.100:0/2331110286 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:24:15.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.216+0000 7f1c777fe640 1 -- 172.21.15.100:0/2331110286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c7806d240 msgr2=0x7f1c781f3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:15.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.216+0000 7f1c777fe640 1 --2- 172.21.15.100:0/2331110286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c7806d240 0x7f1c781f3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.216+0000 7f1c777fe640 1 -- 172.21.15.100:0/2331110286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c7806ce60 msgr2=0x7f1c78157d60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:24:15.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.216+0000 7f1c777fe640 1 --2- 172.21.15.100:0/2331110286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c7806ce60 0x7f1c78157d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.216+0000 7f1c777fe640 1 -- 172.21.15.100:0/2331110286 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c78153280 con 0x7f1c7815b2e0 2024-09-11T22:24:15.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.216+0000 7f1c767fc640 1 --2- 172.21.15.100:0/2331110286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c7806d240 0x7f1c781f3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:24:15.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.216+0000 7f1c777fe640 1 --2- 172.21.15.100:0/2331110286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c7815b2e0 0x7f1c78156530 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1c70003d00 tx=0x7f1c70009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:15.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.216+0000 7f1c5f7fe640 1 -- 172.21.15.100:0/2331110286 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7000cdf0 con 0x7f1c7815b2e0 2024-09-11T22:24:15.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.216+0000 7f1c5f7fe640 1 -- 172.21.15.100:0/2331110286 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c70010030 con 0x7f1c7815b2e0 2024-09-11T22:24:15.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.216+0000 7f1c7d2d0640 1 -- 172.21.15.100:0/2331110286 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c78155450 con 0x7f1c7815b2e0 2024-09-11T22:24:15.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.216+0000 7f1c5f7fe640 1 -- 172.21.15.100:0/2331110286 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70016670 con 0x7f1c7815b2e0 2024-09-11T22:24:15.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.217+0000 7f1c7d2d0640 1 -- 172.21.15.100:0/2331110286 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c78155170 con 0x7f1c7815b2e0 2024-09-11T22:24:15.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.217+0000 7f1c7d2d0640 1 --2- 172.21.15.100:0/2331110286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c780c76a0 0x7f1c780c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:15.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.217+0000 7f1c7d2d0640 1 -- 172.21.15.100:0/2331110286 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1c78153030 con 0x7f1c780c76a0 2024-09-11T22:24:15.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.218+0000 7f1c76ffd640 1 --2- 172.21.15.100:0/2331110286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c780c76a0 0x7f1c780c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:15.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.218+0000 7f1c76ffd640 1 -- 172.21.15.100:0/2331110286 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c780cad20 con 0x7f1c780c76a0 2024-09-11T22:24:15.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.218+0000 7f1c5f7fe640 1 -- 172.21.15.100:0/2331110286 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1c700153e0 con 0x7f1c7815b2e0 2024-09-11T22:24:15.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.218+0000 7f1c76ffd640 1 --2- 172.21.15.100:0/2331110286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c780c76a0 0x7f1c780c81f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1c68003980 tx=0x7f1c6800b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:15.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.219+0000 7f1c5f7fe640 1 --2- 172.21.15.100:0/2331110286 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1c6406bde0 0x7f1c6406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:15.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.219+0000 7f1c5f7fe640 1 -- 172.21.15.100:0/2331110286 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f1c7008b5d0 con 0x7f1c7815b2e0 2024-09-11T22:24:15.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.219+0000 7f1c767fc640 1 --2- 172.21.15.100:0/2331110286 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1c6406bde0 0x7f1c6406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:15.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.219+0000 7f1c5f7fe640 1 -- 172.21.15.100:0/2331110286 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c68003e10 con 0x7f1c780c76a0 2024-09-11T22:24:15.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.219+0000 7f1c5f7fe640 1 -- 172.21.15.100:0/2331110286 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1c68015070 con 0x7f1c780c76a0 2024-09-11T22:24:15.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.219+0000 7f1c5f7fe640 1 -- 172.21.15.100:0/2331110286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c780c76a0 msgr2=0x7f1c780c81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:15.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.219+0000 7f1c5f7fe640 1 --2- 172.21.15.100:0/2331110286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c780c76a0 0x7f1c780c81f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1c68003980 tx=0x7f1c6800b8c0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.219+0000 7f1c5f7fe640 1 -- 172.21.15.100:0/2331110286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c780c76a0 msgr2=0x7f1c780c81f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:24:15.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.219+0000 7f1c5f7fe640 1 --2- 172.21.15.100:0/2331110286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c780c76a0 0x7f1c780c81f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.219+0000 7f1c767fc640 1 --2- 172.21.15.100:0/2331110286 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1c6406bde0 0x7f1c6406e2a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c035040 tx=0x7f1c6c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:15.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.226+0000 7f1c7d2d0640 1 --2- 172.21.15.100:0/2331110286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c780c8730 0x7f1c7814de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:15.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.226+0000 7f1c7d2d0640 1 -- 172.21.15.100:0/2331110286 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1c780c8b10 con 0x7f1c780c8730 2024-09-11T22:24:15.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.226+0000 7f1c76ffd640 1 --2- 172.21.15.100:0/2331110286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c780c8730 0x7f1c7814de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:15.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.227+0000 7f1c76ffd640 1 -- 172.21.15.100:0/2331110286 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1c780b4050 con 0x7f1c780c8730 2024-09-11T22:24:15.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.227+0000 7f1c76ffd640 1 --2- 172.21.15.100:0/2331110286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c780c8730 0x7f1c7814de50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1c68003980 tx=0x7f1c68005a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:15.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.227+0000 7f1c5f7fe640 1 -- 172.21.15.100:0/2331110286 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c68005820 con 0x7f1c780c8730 2024-09-11T22:24:15.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.228+0000 7f1c5f7fe640 1 -- 172.21.15.100:0/2331110286 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4877 (secure 0 0 0) 0x7f1c68005820 con 0x7f1c780c8730 2024-09-11T22:24:15.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.228+0000 7f1c5f7fe640 1 -- 172.21.15.100:0/2331110286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c780c8730 msgr2=0x7f1c7814de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:15.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.228+0000 7f1c5f7fe640 1 --2- 172.21.15.100:0/2331110286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c780c8730 0x7f1c7814de50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1c68003980 tx=0x7f1c68005a20 comp rx=0 tx=0).stop 2024-09-11T22:24:15.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.228+0000 7f1c5f7fe640 1 -- 172.21.15.100:0/2331110286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c780c8730 msgr2=0x7f1c7814de50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:24:15.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.228+0000 7f1c5f7fe640 1 --2- 172.21.15.100:0/2331110286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c780c8730 0x7f1c7814de50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.229 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:24:15.229 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:24:15.229 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:24:15.229 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:24:15.229 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 26, 2024-09-11T22:24:15.229 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 40506, 2024-09-11T22:24:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:24:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:24:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:24:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:24:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:24:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:24:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:24:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:24:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:24:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:24:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:24:15.230 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:24:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:24:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:24:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:24:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:24:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:24:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:24:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:24:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:24:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:24:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:24:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:24:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:24:15.231 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:24:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:24:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:24:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:24:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:24:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:24:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:24:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:24:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:24:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:24:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:24:15.232 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:24:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:24:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:24:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:24:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:24:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:24:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:24:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:24:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:24:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:24:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:24:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:24:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:24:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:24:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:24:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:24:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:24:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:24:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:24:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:24:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:24:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:24:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:24:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:24:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:24:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.234 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:24:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:24:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:24:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:24:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:24:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:24:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:24:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:24:15.235 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:24:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:24:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:24:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:24:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:24:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:24:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:24:15.236 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:24:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:24:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:24:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:24:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:24:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:24:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:24:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:15.237 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:24:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:24:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:24:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:24:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:24:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:24:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:24:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:24:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:24:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.238 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:24:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:24:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:24:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:24:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:24:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:24:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:24:15.239 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:24:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:24:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:24:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:24:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:24:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:24:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:24:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:24:15.240 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:24:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:24:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:24:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:24:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:24:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:24:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:24:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:15.241 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:24:15.242 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.242 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:24:15.242 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:24:15.242 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:24:15.242 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:15.242 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:15.242 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.242 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:24:15.242 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:24:15.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.228+0000 7f1c7d2d0640 1 -- 172.21.15.100:0/2331110286 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1c6406bde0 msgr2=0x7f1c6406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:15.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.228+0000 7f1c7d2d0640 1 --2- 172.21.15.100:0/2331110286 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1c6406bde0 0x7f1c6406e2a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c035040 tx=0x7f1c6c02e000 comp rx=0 tx=0).stop 2024-09-11T22:24:15.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.228+0000 7f1c7d2d0640 1 -- 172.21.15.100:0/2331110286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c7815b2e0 msgr2=0x7f1c78156530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:15.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.228+0000 7f1c7d2d0640 1 --2- 172.21.15.100:0/2331110286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c7815b2e0 0x7f1c78156530 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1c70003d00 tx=0x7f1c70009ed0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.228+0000 7f1c777fe640 1 -- 172.21.15.100:0/2331110286 reap_dead start 2024-09-11T22:24:15.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.228+0000 7f1c777fe640 1 -- 172.21.15.100:0/2331110286 reap_dead start 2024-09-11T22:24:15.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.228+0000 7f1c7d2d0640 1 -- 172.21.15.100:0/2331110286 shutdown_connections 2024-09-11T22:24:15.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.228+0000 7f1c7d2d0640 1 -- 172.21.15.100:0/2331110286 >> 172.21.15.100:0/2331110286 conn(0x7f1c7806bc10 msgr2=0x7f1c78153760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:15.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.228+0000 7f1c7d2d0640 1 -- 172.21.15.100:0/2331110286 shutdown_connections 2024-09-11T22:24:15.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.228+0000 7f1c7d2d0640 1 -- 172.21.15.100:0/2331110286 wait complete. 2024-09-11T22:24:15.245 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:24:15.245 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-11T22:24:15.245 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:24:15.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.350+0000 7f79dc40a640 1 Processor -- start 2024-09-11T22:24:15.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.350+0000 7f79dc40a640 1 -- start start 2024-09-11T22:24:15.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.351+0000 7f79dc40a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d415b2e0 0x7f79d41661f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:15.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.351+0000 7f79dc40a640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79d40c6510 con 0x7f79d406ce60 2024-09-11T22:24:15.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.351+0000 7f79dc40a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79d40c5470 con 0x7f79d406d240 2024-09-11T22:24:15.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.351+0000 7f79dc40a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f79d415b820 con 0x7f79d415b2e0 2024-09-11T22:24:15.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.351+0000 7f79da1a6640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f79d406ce60 legacy=0x7f79d415bd50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:24:15.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.351+0000 7f79da9a7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d415b2e0 0x7f79d41661f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:15.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.351+0000 7f79d99a5640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f79d406d240 0x7f79d41546b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:48626/0 (socket says 172.21.15.100:48626) 2024-09-11T22:24:15.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.351+0000 7f79d99a5640 1 -- 172.21.15.100:0/1848913249 learned_addr learned my addr 172.21.15.100:0/1848913249 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:24:15.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.352+0000 7f79d91a4640 1 -- 172.21.15.100:0/1848913249 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 445576102 0 0) 0x7f79d40c5470 con 0x7f79d406d240 2024-09-11T22:24:15.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.352+0000 7f79d91a4640 1 -- 172.21.15.100:0/1848913249 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79c0003520 con 0x7f79d406d240 2024-09-11T22:24:15.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.352+0000 7f79da9a7640 1 -- 172.21.15.100:0/1848913249 >> v1:172.21.15.167:6789/0 conn(0x7f79d406d240 legacy=0x7f79d41546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:15.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.352+0000 7f79da9a7640 1 -- 172.21.15.100:0/1848913249 >> v1:172.21.15.100:6789/0 conn(0x7f79d406ce60 legacy=0x7f79d415bd50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:24:15.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.352+0000 7f79da9a7640 1 -- 172.21.15.100:0/1848913249 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d40c5750 con 0x7f79d415b2e0 2024-09-11T22:24:15.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.353+0000 7f79da9a7640 1 --2- 172.21.15.100:0/1848913249 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d415b2e0 0x7f79d41661f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009dc0 tx=0x7f79cc02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4c1fdc704f3fdb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:15.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.353+0000 7f79d91a4640 1 -- 172.21.15.100:0/1848913249 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc02ae60 con 0x7f79d415b2e0 2024-09-11T22:24:15.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.353+0000 7f79d91a4640 1 -- 172.21.15.100:0/1848913249 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79cc007740 con 0x7f79d415b2e0 2024-09-11T22:24:15.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.353+0000 7f79d91a4640 1 -- 172.21.15.100:0/1848913249 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc007b10 con 0x7f79d415b2e0 2024-09-11T22:24:15.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.353+0000 7f79dc40a640 1 -- 172.21.15.100:0/1848913249 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d415b2e0 msgr2=0x7f79d41661f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:15.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.353+0000 7f79dc40a640 1 --2- 172.21.15.100:0/1848913249 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d415b2e0 0x7f79d41661f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009dc0 tx=0x7f79cc02a680 comp rx=0 tx=0).stop 2024-09-11T22:24:15.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.353+0000 7f79dc40a640 1 -- 172.21.15.100:0/1848913249 shutdown_connections 2024-09-11T22:24:15.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.353+0000 7f79dc40a640 1 --2- 172.21.15.100:0/1848913249 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d415b2e0 0x7f79d41661f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.353+0000 7f79dc40a640 1 -- 172.21.15.100:0/1848913249 >> 172.21.15.100:0/1848913249 conn(0x7f79d406bc10 msgr2=0x7f79d406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:15.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.353+0000 7f79dc40a640 1 -- 172.21.15.100:0/1848913249 shutdown_connections 2024-09-11T22:24:15.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.353+0000 7f79dc40a640 1 -- 172.21.15.100:0/1848913249 wait complete. 2024-09-11T22:24:15.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.355+0000 7f79dc40a640 1 Processor -- start 2024-09-11T22:24:15.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.355+0000 7f79dc40a640 1 -- start start 2024-09-11T22:24:15.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.355+0000 7f79dc40a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79d406ce60 0x7f79d4155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:15.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.355+0000 7f79dc40a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d406d240 0x7f79d415d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:15.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.355+0000 7f79dc40a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79d415b2e0 0x7f79d4156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:15.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.355+0000 7f79dc40a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f79d415c460 con 0x7f79d406ce60 2024-09-11T22:24:15.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.355+0000 7f79dc40a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f79d40c5d10 con 0x7f79d415b2e0 2024-09-11T22:24:15.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.355+0000 7f79dc40a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f79d40cb1b0 con 0x7f79d406d240 2024-09-11T22:24:15.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.355+0000 7f79da1a6640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79d406ce60 msgr2=0x7f79d4155170 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:24:15.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.355+0000 7f79da1a6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79d406ce60 0x7f79d4155170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:24:15.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.356+0000 7f79d99a5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d406d240 0x7f79d415d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:15.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.356+0000 7f79da9a7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79d415b2e0 0x7f79d4156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:15.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.356+0000 7f79d99a5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d406d240 0x7f79d415d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:35074/0 (socket says 172.21.15.100:35074) 2024-09-11T22:24:15.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.356+0000 7f79d99a5640 1 -- 172.21.15.100:0/2001612486 learned_addr learned my addr 172.21.15.100:0/2001612486 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:24:15.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.356+0000 7f79d99a5640 1 -- 172.21.15.100:0/2001612486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79d415b2e0 msgr2=0x7f79d4156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:15.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.356+0000 7f79d99a5640 1 --2- 172.21.15.100:0/2001612486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79d415b2e0 0x7f79d4156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.356+0000 7f79d99a5640 1 -- 172.21.15.100:0/2001612486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79d406ce60 msgr2=0x7f79d4155170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:24:15.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.356+0000 7f79d99a5640 1 --2- 172.21.15.100:0/2001612486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79d406ce60 0x7f79d4155170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.356+0000 7f79d99a5640 1 -- 172.21.15.100:0/2001612486 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d40c95a0 con 0x7f79d406d240 2024-09-11T22:24:15.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.356+0000 7f79d99a5640 1 --2- 172.21.15.100:0/2001612486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d406d240 0x7f79d415d1d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f79c800c430 tx=0x7f79c800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:15.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.356+0000 7f79c6ffd640 1 -- 172.21.15.100:0/2001612486 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c8017070 con 0x7f79d406d240 2024-09-11T22:24:15.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.356+0000 7f79c6ffd640 1 -- 172.21.15.100:0/2001612486 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c8005d00 con 0x7f79d406d240 2024-09-11T22:24:15.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.356+0000 7f79dc40a640 1 -- 172.21.15.100:0/2001612486 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d40c90e0 con 0x7f79d406d240 2024-09-11T22:24:15.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.356+0000 7f79c6ffd640 1 -- 172.21.15.100:0/2001612486 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c8007310 con 0x7f79d406d240 2024-09-11T22:24:15.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.357+0000 7f79dc40a640 1 -- 172.21.15.100:0/2001612486 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d4157e80 con 0x7f79d406d240 2024-09-11T22:24:15.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.357+0000 7f79dc40a640 1 --2- 172.21.15.100:0/2001612486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d415a670 0x7f79d4157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:15.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.357+0000 7f79dc40a640 1 -- 172.21.15.100:0/2001612486 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f79d4157a20 con 0x7f79d415a670 2024-09-11T22:24:15.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.357+0000 7f79da1a6640 1 --2- 172.21.15.100:0/2001612486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d415a670 0x7f79d4157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:15.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.358+0000 7f79da1a6640 1 -- 172.21.15.100:0/2001612486 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f79d40c9860 con 0x7f79d415a670 2024-09-11T22:24:15.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.358+0000 7f79da1a6640 1 --2- 172.21.15.100:0/2001612486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d415a670 0x7f79d4157070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f79d0003980 tx=0x7f79d000b8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:15.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.358+0000 7f79c6ffd640 1 -- 172.21.15.100:0/2001612486 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d0003e10 con 0x7f79d415a670 2024-09-11T22:24:15.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.358+0000 7f79c6ffd640 1 -- 172.21.15.100:0/2001612486 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f79c801a070 con 0x7f79d406d240 2024-09-11T22:24:15.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.359+0000 7f79c6ffd640 1 --2- 172.21.15.100:0/2001612486 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f79b806bd60 0x7f79b806e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:15.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.359+0000 7f79da9a7640 1 --2- 172.21.15.100:0/2001612486 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f79b806bd60 0x7f79b806e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:15.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.359+0000 7f79c6ffd640 1 -- 172.21.15.100:0/2001612486 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f79c808a5e0 con 0x7f79d406d240 2024-09-11T22:24:15.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.359+0000 7f79c6ffd640 1 -- 172.21.15.100:0/2001612486 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f79d0015070 con 0x7f79d415a670 2024-09-11T22:24:15.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.359+0000 7f79c6ffd640 1 -- 172.21.15.100:0/2001612486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d415a670 msgr2=0x7f79d4157070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:15.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.359+0000 7f79c6ffd640 1 --2- 172.21.15.100:0/2001612486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d415a670 0x7f79d4157070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f79d0003980 tx=0x7f79d000b8c0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.359+0000 7f79c6ffd640 1 -- 172.21.15.100:0/2001612486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d415a670 msgr2=0x7f79d4157070 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:24:15.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.359+0000 7f79c6ffd640 1 --2- 172.21.15.100:0/2001612486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d415a670 0x7f79d4157070 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f79d0003980 tx=0x7f79d000b8c0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.359+0000 7f79da9a7640 1 --2- 172.21.15.100:0/2001612486 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f79b806bd60 0x7f79b806e220 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f79cc034000 tx=0x7f79cc02f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:15.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.367+0000 7f79dc40a640 1 --2- 172.21.15.100:0/2001612486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d40c8b00 0x7f79d414dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:15.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.367+0000 7f79dc40a640 1 -- 172.21.15.100:0/2001612486 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f79d40b4550 con 0x7f79d40c8b00 2024-09-11T22:24:15.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.367+0000 7f79da1a6640 1 --2- 172.21.15.100:0/2001612486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d40c8b00 0x7f79d414dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:15.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.367+0000 7f79da1a6640 1 -- 172.21.15.100:0/2001612486 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f79d40cad20 con 0x7f79d40c8b00 2024-09-11T22:24:15.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.367+0000 7f79da1a6640 1 --2- 172.21.15.100:0/2001612486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d40c8b00 0x7f79d414dbb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f79d0003980 tx=0x7f79d0005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:15.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.368+0000 7f79c6ffd640 1 -- 172.21.15.100:0/2001612486 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d0005710 con 0x7f79d40c8b00 2024-09-11T22:24:15.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.368+0000 7f79c6ffd640 1 -- 172.21.15.100:0/2001612486 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5043 (secure 0 0 0) 0x7f79d0005710 con 0x7f79d40c8b00 2024-09-11T22:24:15.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.368+0000 7f79c6ffd640 1 -- 172.21.15.100:0/2001612486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d40c8b00 msgr2=0x7f79d414dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:15.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.368+0000 7f79c6ffd640 1 --2- 172.21.15.100:0/2001612486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d40c8b00 0x7f79d414dbb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f79d0003980 tx=0x7f79d0005a20 comp rx=0 tx=0).stop 2024-09-11T22:24:15.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.368+0000 7f79c6ffd640 1 -- 172.21.15.100:0/2001612486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d40c8b00 msgr2=0x7f79d414dbb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:24:15.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.368+0000 7f79c6ffd640 1 --2- 172.21.15.100:0/2001612486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d40c8b00 0x7f79d414dbb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.369 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:24:15.369 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:24:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:24:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:24:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 26, 2024-09-11T22:24:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 146090, 2024-09-11T22:24:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:24:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:24:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:24:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:24:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:24:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:24:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:24:15.370 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:24:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:24:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:24:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:24:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:24:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:24:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:24:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:24:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:24:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:24:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:24:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:24:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:24:15.371 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:24:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:24:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:24:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:24:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:24:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:24:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:24:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:24:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:24:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:24:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:24:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:24:15.372 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:24:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:24:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:24:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:24:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:24:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:24:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:24:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:24:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:24:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:24:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:24:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:24:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:24:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:24:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:24:15.373 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:24:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:24:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:24:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:24:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:24:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:24:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:24:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:24:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:24:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:24:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:24:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:24:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:15.374 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:24:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:24:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:24:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:24:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:24:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:24:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:24:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:24:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:24:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:24:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:24:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:24:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:24:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:24:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:24:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.376 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:24:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:24:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:24:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:24:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:24:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:24:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:24:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:24:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:15.377 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:24:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:24:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:24:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:24:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:24:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:24:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:24:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:24:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:24:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.378 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:24:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:24:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:24:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:24:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:24:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:24:15.379 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:24:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:24:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:24:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:24:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:24:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:24:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:24:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:24:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:15.380 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:24:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:24:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:24:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:24:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:24:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:24:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:24:15.381 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:24:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:24:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:24:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:24:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 6 2024-09-11T22:24:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:24:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:24:15.382 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:24:15.383 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:24:15.383 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:15.383 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:15.383 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:15.383 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:24:15.383 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:24:15.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.368+0000 7f79dc40a640 1 -- 172.21.15.100:0/2001612486 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f79b806bd60 msgr2=0x7f79b806e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:15.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.368+0000 7f79dc40a640 1 --2- 172.21.15.100:0/2001612486 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f79b806bd60 0x7f79b806e220 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f79cc034000 tx=0x7f79cc02f000 comp rx=0 tx=0).stop 2024-09-11T22:24:15.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.368+0000 7f79dc40a640 1 -- 172.21.15.100:0/2001612486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d406d240 msgr2=0x7f79d415d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:15.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.368+0000 7f79dc40a640 1 --2- 172.21.15.100:0/2001612486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d406d240 0x7f79d415d1d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f79c800c430 tx=0x7f79c800c8f0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.368+0000 7f79da9a7640 1 -- 172.21.15.100:0/2001612486 reap_dead start 2024-09-11T22:24:15.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.368+0000 7f79dc40a640 1 -- 172.21.15.100:0/2001612486 shutdown_connections 2024-09-11T22:24:15.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.368+0000 7f79dc40a640 1 --2- 172.21.15.100:0/2001612486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79d406d240 0x7f79d415d1d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:15.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.368+0000 7f79dc40a640 1 -- 172.21.15.100:0/2001612486 >> 172.21.15.100:0/2001612486 conn(0x7f79d406bc10 msgr2=0x7f79d4154480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:15.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.368+0000 7f79dc40a640 1 -- 172.21.15.100:0/2001612486 shutdown_connections 2024-09-11T22:24:15.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:15.368+0000 7f79dc40a640 1 -- 172.21.15.100:0/2001612486 wait complete. 2024-09-11T22:24:15.385 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:24:15.385 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-11T22:24:19.724 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:24:19.726 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:24:35.388 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:24:35.388 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-11T22:24:35.388 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T22:24:35.388 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T22:24:35.391 INFO:tasks.ceph.mon.a:Started 2024-09-11T22:24:35.391 INFO:tasks.mon_thrash:Sending STOP to mon b 2024-09-11T22:24:35.391 INFO:tasks.ceph.mon.b:Sent signal 19 2024-09-11T22:24:35.391 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-11T22:24:49.863 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:24:49.866 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:24:50.391 INFO:tasks.mon_thrash:Sending CONT to mon b 2024-09-11T22:24:50.392 INFO:tasks.ceph.mon.b:Sent signal 18 2024-09-11T22:24:50.392 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:24:50.392 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:24:50.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.499+0000 7f662f40e640 1 Processor -- start 2024-09-11T22:24:50.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.499+0000 7f662f40e640 1 -- start start 2024-09-11T22:24:50.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.500+0000 7f662f40e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f662815e780 0x7f66280c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:50.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.500+0000 7f662f40e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f662815a950 con 0x7f662806bc10 2024-09-11T22:24:50.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.500+0000 7f662f40e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66281583b0 con 0x7f6628157fd0 2024-09-11T22:24:50.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.500+0000 7f662f40e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f662815abd0 con 0x7f662815e780 2024-09-11T22:24:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.500+0000 7f662d9ab640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f662815e780 0x7f66280c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.500+0000 7f662d9ab640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f662815e780 0x7f66280c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55826/0 (socket says 172.21.15.100:55826) 2024-09-11T22:24:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.500+0000 7f662d9ab640 1 -- 172.21.15.100:0/4061538991 learned_addr learned my addr 172.21.15.100:0/4061538991 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:24:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.500+0000 7f662c9a9640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f662806bc10 0x7f662815e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47082/0 (socket says 172.21.15.100:47082) 2024-09-11T22:24:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.500+0000 7f662d9ab640 1 -- 172.21.15.100:0/4061538991 >> v2:172.21.15.100:3300/0 conn(0x7f662815e780 msgr2=0x7f66280c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:24:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.500+0000 7f662d9ab640 1 -- 172.21.15.100:0/4061538991 >> v2:172.21.15.100:3300/0 conn(0x7f662815e780 msgr2=0x7f66280c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:24:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.500+0000 7f662d9ab640 1 --2- 172.21.15.100:0/4061538991 >> v2:172.21.15.100:3300/0 conn(0x7f662815e780 0x7f66280c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:24:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.501+0000 7f662d9ab640 1 --2- 172.21.15.100:0/4061538991 >> v2:172.21.15.100:3300/0 conn(0x7f662815e780 0x7f66280c8ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:24:50.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.702+0000 7f662d9ab640 1 --2- 172.21.15.100:0/4061538991 >> v2:172.21.15.100:3300/0 conn(0x7f662815e780 0x7f66280c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:50.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.702+0000 7f662d9ab640 1 -- 172.21.15.100:0/4061538991 >> v2:172.21.15.100:3300/0 conn(0x7f662815e780 msgr2=0x7f66280c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:24:50.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.702+0000 7f662d9ab640 1 -- 172.21.15.100:0/4061538991 >> v2:172.21.15.100:3300/0 conn(0x7f662815e780 msgr2=0x7f66280c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:24:50.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.702+0000 7f662d9ab640 1 --2- 172.21.15.100:0/4061538991 >> v2:172.21.15.100:3300/0 conn(0x7f662815e780 0x7f66280c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:24:50.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.702+0000 7f662d9ab640 1 --2- 172.21.15.100:0/4061538991 >> v2:172.21.15.100:3300/0 conn(0x7f662815e780 0x7f66280c8ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:24:50.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.804+0000 7f661ffff640 1 -- 172.21.15.100:0/4061538991 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1025696832 0 0) 0x7f6618001110 con 0x7f662806bc10 2024-09-11T22:24:50.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.804+0000 7f661ffff640 1 -- 172.21.15.100:0/4061538991 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6614003520 con 0x7f662806bc10 2024-09-11T22:24:50.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.805+0000 7f661ffff640 1 -- 172.21.15.100:0/4061538991 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 892865769 0 0) 0x7f66281583b0 con 0x7f6628157fd0 2024-09-11T22:24:50.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.805+0000 7f661ffff640 1 -- 172.21.15.100:0/4061538991 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6618001110 con 0x7f6628157fd0 2024-09-11T22:24:50.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.806+0000 7f661ffff640 1 -- 172.21.15.100:0/4061538991 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2073535096 0 0) 0x7f6614003520 con 0x7f662806bc10 2024-09-11T22:24:50.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.806+0000 7f661ffff640 1 -- 172.21.15.100:0/4061538991 >> v2:172.21.15.100:3300/0 conn(0x7f662815e780 msgr2=0x7f66280c8ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:24:50.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.806+0000 7f661ffff640 1 --2- 172.21.15.100:0/4061538991 >> v2:172.21.15.100:3300/0 conn(0x7f662815e780 0x7f66280c8ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:50.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.806+0000 7f661ffff640 1 -- 172.21.15.100:0/4061538991 >> v1:172.21.15.167:6789/0 conn(0x7f6628157fd0 legacy=0x7f66280ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:50.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.806+0000 7f661ffff640 1 -- 172.21.15.100:0/4061538991 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f662815aeb0 con 0x7f662806bc10 2024-09-11T22:24:50.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.806+0000 7f661ffff640 1 -- 172.21.15.100:0/4061538991 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f6618001840 con 0x7f662806bc10 2024-09-11T22:24:50.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.806+0000 7f661ffff640 1 -- 172.21.15.100:0/4061538991 >> v1:172.21.15.100:6789/0 conn(0x7f662806bc10 legacy=0x7f662815e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:50.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.806+0000 7f661ffff640 1 --2- 172.21.15.100:0/4061538991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6614003b40 0x7f6614003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:50.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.806+0000 7f661ffff640 1 --2- 172.21.15.100:0/4061538991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6614004800 0x7f6614004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:50.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.806+0000 7f661ffff640 1 --2- 172.21.15.100:0/4061538991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66140051c0 0x7f661400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:50.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.806+0000 7f661ffff640 1 -- 172.21.15.100:0/4061538991 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f662815abd0 con 0x7f6614004800 2024-09-11T22:24:50.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.806+0000 7f661ffff640 1 -- 172.21.15.100:0/4061538991 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f661400c040 con 0x7f6614003b40 2024-09-11T22:24:50.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.806+0000 7f661ffff640 1 -- 172.21.15.100:0/4061538991 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f661400c240 con 0x7f66140051c0 2024-09-11T22:24:50.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.806+0000 7f662c9a9640 1 --2- 172.21.15.100:0/4061538991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6614004800 0x7f6614004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:50.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.806+0000 7f662d9ab640 1 --2- 172.21.15.100:0/4061538991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66140051c0 0x7f661400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:50.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.806+0000 7f662d1aa640 1 --2- 172.21.15.100:0/4061538991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6614003b40 0x7f6614003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:50.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.806+0000 7f662c9a9640 1 -- 172.21.15.100:0/4061538991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66140051c0 msgr2=0x7f661400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:50.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.806+0000 7f662c9a9640 1 --2- 172.21.15.100:0/4061538991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66140051c0 0x7f661400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:50.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.806+0000 7f662c9a9640 1 -- 172.21.15.100:0/4061538991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6614003b40 msgr2=0x7f6614003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:50.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.806+0000 7f662c9a9640 1 --2- 172.21.15.100:0/4061538991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6614003b40 0x7f6614003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:50.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.807+0000 7f662d9ab640 1 -- 172.21.15.100:0/4061538991 reap_dead start 2024-09-11T22:24:50.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.807+0000 7f662c9a9640 1 -- 172.21.15.100:0/4061538991 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6614003520 con 0x7f6614004800 2024-09-11T22:24:50.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.807+0000 7f662c9a9640 1 --2- 172.21.15.100:0/4061538991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6614004800 0x7f6614004c80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f661800c320 tx=0x7f6614005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31229d7a6a97ea9c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:50.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.808+0000 7f661ffff640 1 -- 172.21.15.100:0/4061538991 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6618007da0 con 0x7f6614004800 2024-09-11T22:24:50.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.808+0000 7f661ffff640 1 -- 172.21.15.100:0/4061538991 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6618007270 con 0x7f6614004800 2024-09-11T22:24:50.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.808+0000 7f661ffff640 1 -- 172.21.15.100:0/4061538991 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6618005810 con 0x7f6614004800 2024-09-11T22:24:50.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.809+0000 7f662f40e640 1 -- 172.21.15.100:0/4061538991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6614004800 msgr2=0x7f6614004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:50.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.809+0000 7f662f40e640 1 --2- 172.21.15.100:0/4061538991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6614004800 0x7f6614004c80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f661800c320 tx=0x7f6614005830 comp rx=0 tx=0).stop 2024-09-11T22:24:50.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.809+0000 7f662f40e640 1 -- 172.21.15.100:0/4061538991 shutdown_connections 2024-09-11T22:24:50.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.809+0000 7f662f40e640 1 --2- 172.21.15.100:0/4061538991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6614004800 0x7f6614004c80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:50.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.809+0000 7f662f40e640 1 -- 172.21.15.100:0/4061538991 >> 172.21.15.100:0/4061538991 conn(0x7f6628072960 msgr2=0x7f6628072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:50.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.809+0000 7f662f40e640 1 -- 172.21.15.100:0/4061538991 shutdown_connections 2024-09-11T22:24:50.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.809+0000 7f662f40e640 1 -- 172.21.15.100:0/4061538991 wait complete. 2024-09-11T22:24:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.810+0000 7f662f40e640 1 Processor -- start 2024-09-11T22:24:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.811+0000 7f662f40e640 1 -- start start 2024-09-11T22:24:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.811+0000 7f662f40e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6614004800 0x7f66280be340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.811+0000 7f662f40e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6628154fc0 0x7f6628154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.811+0000 7f662f40e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66281549d0 0x7f66280c3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.811+0000 7f662f40e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6628067ae0 con 0x7f6614004800 2024-09-11T22:24:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.811+0000 7f662f40e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f662815b470 con 0x7f66281549d0 2024-09-11T22:24:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.811+0000 7f662f40e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f66280c1f00 con 0x7f6628154fc0 2024-09-11T22:24:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.812+0000 7f662d1aa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6614004800 0x7f66280be340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.812+0000 7f662d1aa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6614004800 0x7f66280be340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55864/0 (socket says 172.21.15.100:55864) 2024-09-11T22:24:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.812+0000 7f662d1aa640 1 -- 172.21.15.100:0/757210112 learned_addr learned my addr 172.21.15.100:0/757210112 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:24:50.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.812+0000 7f662c9a9640 1 --2- 172.21.15.100:0/757210112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6628154fc0 0x7f6628154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:50.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.812+0000 7f662d9ab640 1 --2- 172.21.15.100:0/757210112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66281549d0 0x7f66280c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:50.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.812+0000 7f662d1aa640 1 -- 172.21.15.100:0/757210112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6628154fc0 msgr2=0x7f6628154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:50.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.812+0000 7f662d1aa640 1 --2- 172.21.15.100:0/757210112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6628154fc0 0x7f6628154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:50.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.812+0000 7f662d1aa640 1 -- 172.21.15.100:0/757210112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66281549d0 msgr2=0x7f66280c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:50.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.812+0000 7f662d1aa640 1 --2- 172.21.15.100:0/757210112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66281549d0 0x7f66280c3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:50.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.812+0000 7f662d1aa640 1 -- 172.21.15.100:0/757210112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66280c08e0 con 0x7f6614004800 2024-09-11T22:24:50.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.812+0000 7f662d1aa640 1 --2- 172.21.15.100:0/757210112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6614004800 0x7f66280be340 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f662400f7d0 tx=0x7f662400fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:50.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.812+0000 7f661dffb640 1 -- 172.21.15.100:0/757210112 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662401a070 con 0x7f6614004800 2024-09-11T22:24:50.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.812+0000 7f661dffb640 1 -- 172.21.15.100:0/757210112 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6624005110 con 0x7f6614004800 2024-09-11T22:24:50.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.812+0000 7f662f40e640 1 -- 172.21.15.100:0/757210112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66280c2c70 con 0x7f6614004800 2024-09-11T22:24:50.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.812+0000 7f661dffb640 1 -- 172.21.15.100:0/757210112 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6624007050 con 0x7f6614004800 2024-09-11T22:24:50.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.813+0000 7f662f40e640 1 -- 172.21.15.100:0/757210112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66280c1940 con 0x7f6614004800 2024-09-11T22:24:50.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.813+0000 7f662f40e640 1 -- 172.21.15.100:0/757210112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6628068060 con 0x7f6614004800 2024-09-11T22:24:50.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.814+0000 7f661dffb640 1 -- 172.21.15.100:0/757210112 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f662401d070 con 0x7f6614004800 2024-09-11T22:24:50.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.814+0000 7f661dffb640 1 --2- 172.21.15.100:0/757210112 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f660c06be30 0x7f660c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:50.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.815+0000 7f661dffb640 1 -- 172.21.15.100:0/757210112 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f662408a8c0 con 0x7f6614004800 2024-09-11T22:24:50.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.815+0000 7f662c9a9640 1 --2- 172.21.15.100:0/757210112 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f660c06be30 0x7f660c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:50.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.815+0000 7f662c9a9640 1 --2- 172.21.15.100:0/757210112 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f660c06be30 0x7f660c06e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6618033000 tx=0x7f6618009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:50.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:50.821+0000 7f661dffb640 1 -- 172.21.15.100:0/757210112 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6624058890 con 0x7f6614004800 2024-09-11T22:24:51.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.118+0000 7f662f40e640 1 -- 172.21.15.100:0/757210112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f66280c2e40 con 0x7f6614004800 2024-09-11T22:24:51.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.118+0000 7f661dffb640 1 -- 172.21.15.100:0/757210112 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f662408a6e0 con 0x7f6614004800 2024-09-11T22:24:51.120 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":34,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:24:51.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.121+0000 7f662f40e640 1 -- 172.21.15.100:0/757210112 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f660c06be30 msgr2=0x7f660c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.121+0000 7f662f40e640 1 --2- 172.21.15.100:0/757210112 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f660c06be30 0x7f660c06e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6618033000 tx=0x7f6618009030 comp rx=0 tx=0).stop 2024-09-11T22:24:51.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.121+0000 7f662f40e640 1 -- 172.21.15.100:0/757210112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6614004800 msgr2=0x7f66280be340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.121+0000 7f662f40e640 1 --2- 172.21.15.100:0/757210112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6614004800 0x7f66280be340 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f662400f7d0 tx=0x7f662400fc90 comp rx=0 tx=0).stop 2024-09-11T22:24:51.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.121+0000 7f662f40e640 1 -- 172.21.15.100:0/757210112 shutdown_connections 2024-09-11T22:24:51.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.121+0000 7f662f40e640 1 --2- 172.21.15.100:0/757210112 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f660c06be30 0x7f660c06e2f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.121+0000 7f662f40e640 1 --2- 172.21.15.100:0/757210112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66281549d0 0x7f66280c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.121+0000 7f662f40e640 1 --2- 172.21.15.100:0/757210112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6628154fc0 0x7f6628154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.121+0000 7f662f40e640 1 --2- 172.21.15.100:0/757210112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6614004800 0x7f66280be340 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.121+0000 7f662f40e640 1 -- 172.21.15.100:0/757210112 >> 172.21.15.100:0/757210112 conn(0x7f6628072960 msgr2=0x7f66280ca000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:51.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.121+0000 7f662f40e640 1 -- 172.21.15.100:0/757210112 shutdown_connections 2024-09-11T22:24:51.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.121+0000 7f662f40e640 1 -- 172.21.15.100:0/757210112 wait complete. 2024-09-11T22:24:51.133 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:24:51.133 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:24:51.133 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:24:51.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.245+0000 7f269209b640 1 Processor -- start 2024-09-11T22:24:51.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.245+0000 7f269209b640 1 -- start start 2024-09-11T22:24:51.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.246+0000 7f269209b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f268c0726c0 0x7f268c0c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.246+0000 7f269209b640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f268c072af0 con 0x7f268c151970 2024-09-11T22:24:51.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.246+0000 7f269209b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f268c073bf0 con 0x7f268c072f30 2024-09-11T22:24:51.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.246+0000 7f269209b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f268c0ca3f0 con 0x7f268c0726c0 2024-09-11T22:24:51.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.246+0000 7f268b7fe640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f268c151970 0x7f268c1576c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47094/0 (socket says 172.21.15.100:47094) 2024-09-11T22:24:51.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.246+0000 7f268b7fe640 1 -- 172.21.15.100:0/3514161475 learned_addr learned my addr 172.21.15.100:0/3514161475 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:24:51.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.247+0000 7f268affd640 1 --2- 172.21.15.100:0/3514161475 >> v2:172.21.15.167:3300/0 conn(0x7f268c0726c0 0x7f268c0c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.247+0000 7f268a7fc640 1 -- 172.21.15.100:0/3514161475 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3174950323 0 0) 0x7f268c072af0 con 0x7f268c151970 2024-09-11T22:24:51.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.247+0000 7f268a7fc640 1 -- 172.21.15.100:0/3514161475 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2674005730 con 0x7f268c151970 2024-09-11T22:24:51.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.247+0000 7f268a7fc640 1 -- 172.21.15.100:0/3514161475 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1762940833 0 0) 0x7f268c073bf0 con 0x7f268c072f30 2024-09-11T22:24:51.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.247+0000 7f268a7fc640 1 -- 172.21.15.100:0/3514161475 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f268c072af0 con 0x7f268c072f30 2024-09-11T22:24:51.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.247+0000 7f268a7fc640 1 -- 172.21.15.100:0/3514161475 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2972525338 0 0) 0x7f2674005730 con 0x7f268c151970 2024-09-11T22:24:51.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.247+0000 7f268affd640 1 -- 172.21.15.100:0/3514161475 >> v1:172.21.15.167:6789/0 conn(0x7f268c072f30 legacy=0x7f268c161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.247+0000 7f268affd640 1 -- 172.21.15.100:0/3514161475 >> v1:172.21.15.100:6789/0 conn(0x7f268c151970 legacy=0x7f268c1576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.247+0000 7f268affd640 1 -- 172.21.15.100:0/3514161475 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268c073ed0 con 0x7f268c0726c0 2024-09-11T22:24:51.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.248+0000 7f268affd640 1 --2- 172.21.15.100:0/3514161475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f268c0726c0 0x7f268c0c3c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f26800097a0 tx=0x7f268002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=652507a8afa12033 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:51.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.248+0000 7f268a7fc640 1 -- 172.21.15.100:0/3514161475 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2680037070 con 0x7f268c0726c0 2024-09-11T22:24:51.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.248+0000 7f268a7fc640 1 -- 172.21.15.100:0/3514161475 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f268002ace0 con 0x7f268c0726c0 2024-09-11T22:24:51.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.248+0000 7f268a7fc640 1 -- 172.21.15.100:0/3514161475 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c001670 con 0x7f268c0726c0 2024-09-11T22:24:51.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.249+0000 7f269209b640 1 -- 172.21.15.100:0/3514161475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f268c0726c0 msgr2=0x7f268c0c3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.249+0000 7f269209b640 1 --2- 172.21.15.100:0/3514161475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f268c0726c0 0x7f268c0c3c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f26800097a0 tx=0x7f268002a250 comp rx=0 tx=0).stop 2024-09-11T22:24:51.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.249+0000 7f269209b640 1 -- 172.21.15.100:0/3514161475 shutdown_connections 2024-09-11T22:24:51.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.249+0000 7f269209b640 1 --2- 172.21.15.100:0/3514161475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f268c0726c0 0x7f268c0c3c60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.249+0000 7f269209b640 1 -- 172.21.15.100:0/3514161475 >> 172.21.15.100:0/3514161475 conn(0x7f268c06ee80 msgr2=0x7f268c070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:51.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.249+0000 7f269209b640 1 -- 172.21.15.100:0/3514161475 shutdown_connections 2024-09-11T22:24:51.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.249+0000 7f269209b640 1 -- 172.21.15.100:0/3514161475 wait complete. 2024-09-11T22:24:51.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.250+0000 7f269209b640 1 Processor -- start 2024-09-11T22:24:51.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.250+0000 7f269209b640 1 -- start start 2024-09-11T22:24:51.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.251+0000 7f269209b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f268c0726c0 0x7f268c0c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.251+0000 7f269209b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f268c072f30 0x7f268c149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.251+0000 7f269209b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f268c151970 0x7f268c1487d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.251+0000 7f269209b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f268c0c9f60 con 0x7f268c072f30 2024-09-11T22:24:51.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.251+0000 7f269209b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f268c0c41a0 con 0x7f268c151970 2024-09-11T22:24:51.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.251+0000 7f269209b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f268c0741b0 con 0x7f268c0726c0 2024-09-11T22:24:51.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.251+0000 7f268affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f268c072f30 0x7f268c149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.251+0000 7f268b7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f268c0726c0 0x7f268c0c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.251+0000 7f268affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f268c072f30 0x7f268c149cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55868/0 (socket says 172.21.15.100:55868) 2024-09-11T22:24:51.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.251+0000 7f268affd640 1 -- 172.21.15.100:0/587360303 learned_addr learned my addr 172.21.15.100:0/587360303 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:24:51.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.251+0000 7f268bfff640 1 --2- 172.21.15.100:0/587360303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f268c151970 0x7f268c1487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.251+0000 7f268affd640 1 -- 172.21.15.100:0/587360303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f268c0726c0 msgr2=0x7f268c0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.251+0000 7f268affd640 1 --2- 172.21.15.100:0/587360303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f268c0726c0 0x7f268c0c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.251+0000 7f268affd640 1 -- 172.21.15.100:0/587360303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f268c151970 msgr2=0x7f268c1487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.251+0000 7f268affd640 1 --2- 172.21.15.100:0/587360303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f268c151970 0x7f268c1487d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.251+0000 7f268affd640 1 -- 172.21.15.100:0/587360303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268c0c6ee0 con 0x7f268c072f30 2024-09-11T22:24:51.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.252+0000 7f268affd640 1 --2- 172.21.15.100:0/587360303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f268c072f30 0x7f268c149cf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2680000c00 tx=0x7f26800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:51.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.252+0000 7f2673fff640 1 -- 172.21.15.100:0/587360303 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2680041020 con 0x7f268c072f30 2024-09-11T22:24:51.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.252+0000 7f2673fff640 1 -- 172.21.15.100:0/587360303 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f268003d620 con 0x7f268c072f30 2024-09-11T22:24:51.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.252+0000 7f2673fff640 1 -- 172.21.15.100:0/587360303 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2680037040 con 0x7f268c072f30 2024-09-11T22:24:51.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.252+0000 7f269209b640 1 -- 172.21.15.100:0/587360303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f268c0c71c0 con 0x7f268c072f30 2024-09-11T22:24:51.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.252+0000 7f269209b640 1 -- 172.21.15.100:0/587360303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f268c1ec480 con 0x7f268c072f30 2024-09-11T22:24:51.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.253+0000 7f269209b640 1 --2- 172.21.15.100:0/587360303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f268c1ec7f0 0x7f268c0c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.253+0000 7f269209b640 1 -- 172.21.15.100:0/587360303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f268c0cccd0 con 0x7f268c1ec7f0 2024-09-11T22:24:51.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.253+0000 7f268b7fe640 1 --2- 172.21.15.100:0/587360303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f268c1ec7f0 0x7f268c0c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.253+0000 7f268b7fe640 1 -- 172.21.15.100:0/587360303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f268c1ebf90 con 0x7f268c1ec7f0 2024-09-11T22:24:51.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.253+0000 7f2673fff640 1 -- 172.21.15.100:0/587360303 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2680044020 con 0x7f268c072f30 2024-09-11T22:24:51.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.253+0000 7f268b7fe640 1 --2- 172.21.15.100:0/587360303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f268c1ec7f0 0x7f268c0c5680 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f267c005880 tx=0x7f267c00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:51.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.254+0000 7f2673fff640 1 --2- 172.21.15.100:0/587360303 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f267806be30 0x7f267806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.254+0000 7f2673fff640 1 -- 172.21.15.100:0/587360303 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f26800ab6c0 con 0x7f268c072f30 2024-09-11T22:24:51.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.254+0000 7f268bfff640 1 --2- 172.21.15.100:0/587360303 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f267806be30 0x7f267806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.254+0000 7f2673fff640 1 -- 172.21.15.100:0/587360303 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c017020 con 0x7f268c1ec7f0 2024-09-11T22:24:51.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.254+0000 7f2673fff640 1 -- 172.21.15.100:0/587360303 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f267c00d900 con 0x7f268c1ec7f0 2024-09-11T22:24:51.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.254+0000 7f2673fff640 1 -- 172.21.15.100:0/587360303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f268c1ec7f0 msgr2=0x7f268c0c5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.254+0000 7f2673fff640 1 --2- 172.21.15.100:0/587360303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f268c1ec7f0 0x7f268c0c5680 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f267c005880 tx=0x7f267c00ff70 comp rx=0 tx=0).stop 2024-09-11T22:24:51.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.254+0000 7f2673fff640 1 -- 172.21.15.100:0/587360303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f268c1ec7f0 msgr2=0x7f268c0c5680 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:24:51.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.254+0000 7f2673fff640 1 --2- 172.21.15.100:0/587360303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f268c1ec7f0 0x7f268c0c5680 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f267c005880 tx=0x7f267c00ff70 comp rx=0 tx=0).stop 2024-09-11T22:24:51.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.254+0000 7f268bfff640 1 --2- 172.21.15.100:0/587360303 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f267806be30 0x7f267806e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2684001560 tx=0x7f2684009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:51.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.264+0000 7f269209b640 1 --2- 172.21.15.100:0/587360303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f268c1ecc60 0x7f268c0c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.264+0000 7f269209b640 1 -- 172.21.15.100:0/587360303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f268c1ec650 con 0x7f268c1ecc60 2024-09-11T22:24:51.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.264+0000 7f268b7fe640 1 --2- 172.21.15.100:0/587360303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f268c1ecc60 0x7f268c0c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.264+0000 7f268b7fe640 1 -- 172.21.15.100:0/587360303 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f268c0c6100 con 0x7f268c1ecc60 2024-09-11T22:24:51.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.264+0000 7f268b7fe640 1 --2- 172.21.15.100:0/587360303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f268c1ecc60 0x7f268c0c5bc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f267c018000 tx=0x7f267c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:51.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.264+0000 7f2673fff640 1 -- 172.21.15.100:0/587360303 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267c017040 con 0x7f268c1ecc60 2024-09-11T22:24:51.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.265+0000 7f2673fff640 1 -- 172.21.15.100:0/587360303 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4554 (secure 0 0 0) 0x7f267c01e220 con 0x7f268c1ecc60 2024-09-11T22:24:51.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.265+0000 7f2673fff640 1 -- 172.21.15.100:0/587360303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f268c1ecc60 msgr2=0x7f268c0c5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.265+0000 7f2673fff640 1 --2- 172.21.15.100:0/587360303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f268c1ecc60 0x7f268c0c5bc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f267c018000 tx=0x7f267c0057f0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.265+0000 7f2673fff640 1 -- 172.21.15.100:0/587360303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f268c1ecc60 msgr2=0x7f268c0c5bc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:24:51.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.265+0000 7f2673fff640 1 --2- 172.21.15.100:0/587360303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f268c1ecc60 0x7f268c0c5bc0 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f267c018000 tx=0x7f267c0057f0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.268 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:24:51.268 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:24:51.268 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:24:51.268 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:24:51.268 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 34, 2024-09-11T22:24:51.268 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 15788, 2024-09-11T22:24:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:24:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:24:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:24:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:24:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:24:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:24:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:24:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:24:51.269 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:24:51.270 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:24:51.270 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:24:51.270 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:24:51.270 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:24:51.270 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:24:51.270 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:24:51.270 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:24:51.270 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:24:51.270 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:24:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:24:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:24:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:24:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:24:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:24:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:24:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:24:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:24:51.271 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:24:51.272 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:24:51.272 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:24:51.272 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:24:51.272 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:24:51.272 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:24:51.272 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:51.272 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.272 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:24:51.272 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:24:51.273 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:24:51.273 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:24:51.273 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:24:51.273 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:24:51.273 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:24:51.273 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:24:51.273 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:24:51.273 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:24:51.273 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:24:51.274 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:24:51.274 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:24:51.274 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:24:51.274 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:24:51.274 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:24:51.274 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:24:51.274 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:24:51.275 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:24:51.275 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:24:51.275 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:24:51.275 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:24:51.275 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:24:51.275 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:24:51.275 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:24:51.275 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:24:51.276 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:24:51.276 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:24:51.276 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:51.276 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:24:51.276 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.276 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:24:51.276 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.276 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:24:51.276 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:24:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:24:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:24:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:24:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:24:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:24:51.277 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:24:51.278 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:51.278 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:51.278 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:51.278 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.278 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:24:51.278 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:24:51.278 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:24:51.278 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:24:51.278 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:24:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:24:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:24:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:24:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:24:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:24:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:24:51.279 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:51.280 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.280 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.280 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:24:51.280 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:24:51.280 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:51.280 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:51.280 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:51.280 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.281 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:24:51.281 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:24:51.281 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:24:51.281 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:24:51.281 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:24:51.281 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.281 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.281 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:24:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:24:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:24:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:24:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:24:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:24:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.282 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:24:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:24:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:24:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:24:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:24:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:24:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:24:51.283 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:51.284 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:51.284 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.284 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:24:51.284 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:24:51.284 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.284 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:24:51.284 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:24:51.284 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:24:51.284 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:51.284 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:51.284 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:24:51.285 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.285 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:24:51.285 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:24:51.285 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:24:51.285 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:51.285 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:51.285 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.285 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:24:51.285 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:24:51.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.265+0000 7f269209b640 1 -- 172.21.15.100:0/587360303 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f267806be30 msgr2=0x7f267806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.265+0000 7f269209b640 1 --2- 172.21.15.100:0/587360303 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f267806be30 0x7f267806e2f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2684001560 tx=0x7f2684009040 comp rx=0 tx=0).stop 2024-09-11T22:24:51.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.265+0000 7f269209b640 1 -- 172.21.15.100:0/587360303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f268c072f30 msgr2=0x7f268c149cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.265+0000 7f269209b640 1 --2- 172.21.15.100:0/587360303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f268c072f30 0x7f268c149cf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2680000c00 tx=0x7f26800046c0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.265+0000 7f268bfff640 1 -- 172.21.15.100:0/587360303 reap_dead start 2024-09-11T22:24:51.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.265+0000 7f268bfff640 1 -- 172.21.15.100:0/587360303 reap_dead start 2024-09-11T22:24:51.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.265+0000 7f269209b640 1 -- 172.21.15.100:0/587360303 shutdown_connections 2024-09-11T22:24:51.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.265+0000 7f269209b640 1 -- 172.21.15.100:0/587360303 >> 172.21.15.100:0/587360303 conn(0x7f268c06ee80 msgr2=0x7f268c0c7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:51.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.265+0000 7f269209b640 1 -- 172.21.15.100:0/587360303 shutdown_connections 2024-09-11T22:24:51.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.265+0000 7f269209b640 1 -- 172.21.15.100:0/587360303 wait complete. 2024-09-11T22:24:51.288 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:24:51.289 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:24:51.289 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:24:51.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.401+0000 7fcded9c4640 1 Processor -- start 2024-09-11T22:24:51.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.401+0000 7fcded9c4640 1 -- start start 2024-09-11T22:24:51.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.402+0000 7fcded9c4640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcde815eaf0 0x7fcde80cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.402+0000 7fcded9c4640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcde815ac20 con 0x7fcde8155040 2024-09-11T22:24:51.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.402+0000 7fcded9c4640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcde815aec0 con 0x7fcde8154c60 2024-09-11T22:24:51.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.402+0000 7fcded9c4640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fcde815bad0 con 0x7fcde815eaf0 2024-09-11T22:24:51.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.402+0000 7fcde77fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcde815eaf0 0x7fcde80cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.402+0000 7fcddffff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fcde8155040 0x7fcde815e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47106/0 (socket says 172.21.15.100:47106) 2024-09-11T22:24:51.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.402+0000 7fcde77fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcde815eaf0 0x7fcde80cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55900/0 (socket says 172.21.15.100:55900) 2024-09-11T22:24:51.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.402+0000 7fcddffff640 1 -- 172.21.15.100:0/3869563591 learned_addr learned my addr 172.21.15.100:0/3869563591 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:24:51.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.402+0000 7fcde77fe640 1 -- 172.21.15.100:0/3869563591 >> v1:172.21.15.167:6789/0 conn(0x7fcde8154c60 legacy=0x7fcde80d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.402+0000 7fcde77fe640 1 -- 172.21.15.100:0/3869563591 >> v1:172.21.15.100:6789/0 conn(0x7fcde8155040 legacy=0x7fcde815e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.402+0000 7fcde67fc640 1 -- 172.21.15.100:0/3869563591 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 962471135 0 0) 0x7fcde815ac20 con 0x7fcde8155040 2024-09-11T22:24:51.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.403+0000 7fcde77fe640 1 -- 172.21.15.100:0/3869563591 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde815b1a0 con 0x7fcde815eaf0 2024-09-11T22:24:51.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.403+0000 7fcde77fe640 1 --2- 172.21.15.100:0/3869563591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcde815eaf0 0x7fcde80cb560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcde0009d90 tx=0x7fcde002a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ccf4d92689fc9a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:51.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.404+0000 7fcde67fc640 1 -- 172.21.15.100:0/3869563591 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde0037070 con 0x7fcde815eaf0 2024-09-11T22:24:51.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.404+0000 7fcde67fc640 1 -- 172.21.15.100:0/3869563591 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcde0007740 con 0x7fcde815eaf0 2024-09-11T22:24:51.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.404+0000 7fcde67fc640 1 -- 172.21.15.100:0/3869563591 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde0007b10 con 0x7fcde815eaf0 2024-09-11T22:24:51.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.404+0000 7fcded9c4640 1 -- 172.21.15.100:0/3869563591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcde815eaf0 msgr2=0x7fcde80cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.404+0000 7fcded9c4640 1 --2- 172.21.15.100:0/3869563591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcde815eaf0 0x7fcde80cb560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcde0009d90 tx=0x7fcde002a780 comp rx=0 tx=0).stop 2024-09-11T22:24:51.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.404+0000 7fcded9c4640 1 -- 172.21.15.100:0/3869563591 shutdown_connections 2024-09-11T22:24:51.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.404+0000 7fcded9c4640 1 --2- 172.21.15.100:0/3869563591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcde815eaf0 0x7fcde80cb560 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.404+0000 7fcded9c4640 1 -- 172.21.15.100:0/3869563591 >> 172.21.15.100:0/3869563591 conn(0x7fcde806d060 msgr2=0x7fcde806d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:51.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.404+0000 7fcded9c4640 1 -- 172.21.15.100:0/3869563591 shutdown_connections 2024-09-11T22:24:51.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.404+0000 7fcded9c4640 1 -- 172.21.15.100:0/3869563591 wait complete. 2024-09-11T22:24:51.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.406+0000 7fcded9c4640 1 Processor -- start 2024-09-11T22:24:51.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.406+0000 7fcded9c4640 1 -- start start 2024-09-11T22:24:51.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.407+0000 7fcded9c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcde8154c60 0x7fcde8150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.407+0000 7fcded9c4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde8155040 0x7fcde8159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.407+0000 7fcded9c4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcde815eaf0 0x7fcde814ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.407+0000 7fcded9c4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcde80c5e10 con 0x7fcde8154c60 2024-09-11T22:24:51.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.407+0000 7fcded9c4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcde815b760 con 0x7fcde8155040 2024-09-11T22:24:51.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.407+0000 7fcded9c4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcde80c5f90 con 0x7fcde815eaf0 2024-09-11T22:24:51.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.407+0000 7fcde6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcde8154c60 0x7fcde8150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.407+0000 7fcde6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcde8154c60 0x7fcde8150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55916/0 (socket says 172.21.15.100:55916) 2024-09-11T22:24:51.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.407+0000 7fcde6ffd640 1 -- 172.21.15.100:0/1811418087 learned_addr learned my addr 172.21.15.100:0/1811418087 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:24:51.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.407+0000 7fcde77fe640 1 --2- 172.21.15.100:0/1811418087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcde815eaf0 0x7fcde814ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.407+0000 7fcddffff640 1 --2- 172.21.15.100:0/1811418087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde8155040 0x7fcde8159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.407+0000 7fcde6ffd640 1 -- 172.21.15.100:0/1811418087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcde815eaf0 msgr2=0x7fcde814ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.407+0000 7fcde6ffd640 1 --2- 172.21.15.100:0/1811418087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcde815eaf0 0x7fcde814ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.407+0000 7fcde6ffd640 1 -- 172.21.15.100:0/1811418087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde8155040 msgr2=0x7fcde8159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.407+0000 7fcde6ffd640 1 --2- 172.21.15.100:0/1811418087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde8155040 0x7fcde8159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.407+0000 7fcde6ffd640 1 -- 172.21.15.100:0/1811418087 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde8150450 con 0x7fcde8154c60 2024-09-11T22:24:51.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.407+0000 7fcde6ffd640 1 --2- 172.21.15.100:0/1811418087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcde8154c60 0x7fcde8150b80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800c480 tx=0x7fcdd800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:51.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.407+0000 7fcde4ff9640 1 -- 172.21.15.100:0/1811418087 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd80052d0 con 0x7fcde8154c60 2024-09-11T22:24:51.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.408+0000 7fcde4ff9640 1 -- 172.21.15.100:0/1811418087 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd8005470 con 0x7fcde8154c60 2024-09-11T22:24:51.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.408+0000 7fcded9c4640 1 -- 172.21.15.100:0/1811418087 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde81510c0 con 0x7fcde8154c60 2024-09-11T22:24:51.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.408+0000 7fcde4ff9640 1 -- 172.21.15.100:0/1811418087 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd8012870 con 0x7fcde8154c60 2024-09-11T22:24:51.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.408+0000 7fcded9c4640 1 -- 172.21.15.100:0/1811418087 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde8150180 con 0x7fcde8154c60 2024-09-11T22:24:51.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.409+0000 7fcded9c4640 1 --2- 172.21.15.100:0/1811418087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde80c89c0 0x7fcde814b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.409+0000 7fcded9c4640 1 -- 172.21.15.100:0/1811418087 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcde8074290 con 0x7fcde80c89c0 2024-09-11T22:24:51.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.409+0000 7fcddffff640 1 --2- 172.21.15.100:0/1811418087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde80c89c0 0x7fcde814b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.409+0000 7fcddffff640 1 -- 172.21.15.100:0/1811418087 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcde814b6a0 con 0x7fcde80c89c0 2024-09-11T22:24:51.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.409+0000 7fcde4ff9640 1 -- 172.21.15.100:0/1811418087 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcdd8012a10 con 0x7fcde8154c60 2024-09-11T22:24:51.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.409+0000 7fcddffff640 1 --2- 172.21.15.100:0/1811418087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde80c89c0 0x7fcde814b160 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcde80753e0 tx=0x7fcdd0001970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:51.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.409+0000 7fcde4ff9640 1 --2- 172.21.15.100:0/1811418087 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcdc806be30 0x7fcdc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.410+0000 7fcde4ff9640 1 -- 172.21.15.100:0/1811418087 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fcdd808adf0 con 0x7fcde8154c60 2024-09-11T22:24:51.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.410+0000 7fcde77fe640 1 --2- 172.21.15.100:0/1811418087 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcdc806be30 0x7fcdc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.410+0000 7fcde4ff9640 1 -- 172.21.15.100:0/1811418087 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0005a60 con 0x7fcde80c89c0 2024-09-11T22:24:51.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.410+0000 7fcde4ff9640 1 -- 172.21.15.100:0/1811418087 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fcdd0018070 con 0x7fcde80c89c0 2024-09-11T22:24:51.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.410+0000 7fcde4ff9640 1 -- 172.21.15.100:0/1811418087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde80c89c0 msgr2=0x7fcde814b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.410+0000 7fcde4ff9640 1 --2- 172.21.15.100:0/1811418087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde80c89c0 0x7fcde814b160 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcde80753e0 tx=0x7fcdd0001970 comp rx=0 tx=0).stop 2024-09-11T22:24:51.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.410+0000 7fcde4ff9640 1 -- 172.21.15.100:0/1811418087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde80c89c0 msgr2=0x7fcde814b160 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:24:51.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.410+0000 7fcde4ff9640 1 --2- 172.21.15.100:0/1811418087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde80c89c0 0x7fcde814b160 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.410+0000 7fcde77fe640 1 --2- 172.21.15.100:0/1811418087 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcdc806be30 0x7fcdc806e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcde0034000 tx=0x7fcde002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:51.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.419+0000 7fcded9c4640 1 --2- 172.21.15.100:0/1811418087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde81f06c0 0x7fcde815bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.419+0000 7fcded9c4640 1 -- 172.21.15.100:0/1811418087 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcde8152c70 con 0x7fcde81f06c0 2024-09-11T22:24:51.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.420+0000 7fcddffff640 1 --2- 172.21.15.100:0/1811418087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde81f06c0 0x7fcde815bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.420+0000 7fcddffff640 1 -- 172.21.15.100:0/1811418087 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcde80d0b10 con 0x7fcde81f06c0 2024-09-11T22:24:51.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.420+0000 7fcddffff640 1 --2- 172.21.15.100:0/1811418087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde81f06c0 0x7fcde815bcd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcde80cc310 tx=0x7fcdd0000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:51.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.420+0000 7fcde4ff9640 1 -- 172.21.15.100:0/1811418087 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd00064e0 con 0x7fcde81f06c0 2024-09-11T22:24:51.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.421+0000 7fcde4ff9640 1 -- 172.21.15.100:0/1811418087 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4886 (secure 0 0 0) 0x7fcdd00064e0 con 0x7fcde81f06c0 2024-09-11T22:24:51.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.421+0000 7fcde4ff9640 1 -- 172.21.15.100:0/1811418087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde81f06c0 msgr2=0x7fcde815bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.421+0000 7fcde4ff9640 1 --2- 172.21.15.100:0/1811418087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde81f06c0 0x7fcde815bcd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcde80cc310 tx=0x7fcdd0000ed0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.421+0000 7fcde4ff9640 1 -- 172.21.15.100:0/1811418087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde81f06c0 msgr2=0x7fcde815bcd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:24:51.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.421+0000 7fcde4ff9640 1 --2- 172.21.15.100:0/1811418087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde81f06c0 0x7fcde815bcd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.422 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:24:51.423 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:24:51.423 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:24:51.423 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:24:51.423 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 34, 2024-09-11T22:24:51.423 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 76698, 2024-09-11T22:24:51.423 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:24:51.423 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:24:51.423 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:24:51.423 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:24:51.423 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:51.423 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:24:51.423 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:24:51.423 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:24:51.424 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:24:51.424 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:24:51.424 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:24:51.424 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:24:51.424 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:24:51.424 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:24:51.424 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:24:51.424 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:24:51.424 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:24:51.424 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:24:51.424 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:24:51.424 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:24:51.424 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:51.425 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:24:51.425 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:24:51.425 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:24:51.425 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:24:51.425 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:24:51.425 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:24:51.425 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:24:51.425 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:24:51.425 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:24:51.425 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:24:51.425 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:24:51.425 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:24:51.425 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:24:51.426 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:51.426 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.426 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:24:51.426 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:24:51.426 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:24:51.426 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:24:51.426 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:24:51.426 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:24:51.426 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:24:51.426 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:24:51.427 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:24:51.427 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:24:51.427 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:24:51.427 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:24:51.427 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:24:51.427 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:24:51.427 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:24:51.427 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:24:51.427 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:24:51.427 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:24:51.427 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:24:51.427 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:24:51.427 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:24:51.428 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:24:51.428 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:24:51.428 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:24:51.428 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:24:51.428 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:24:51.428 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:24:51.428 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:24:51.428 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:51.428 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:24:51.428 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.428 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:24:51.429 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.429 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:24:51.429 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:24:51.429 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:24:51.429 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:24:51.429 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.429 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:24:51.429 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:24:51.429 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:51.429 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.429 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.430 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:24:51.430 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:24:51.430 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:51.430 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:51.430 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:51.430 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.430 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:24:51.430 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:24:51.430 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:24:51.430 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:24:51.430 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:24:51.430 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.431 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.431 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:24:51.431 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:24:51.431 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:24:51.431 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:24:51.431 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.431 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:24:51.431 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:24:51.431 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:51.431 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.432 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.432 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:24:51.432 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:24:51.432 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:51.432 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:51.432 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:51.432 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.432 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:24:51.432 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:24:51.432 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:24:51.432 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:24:51.432 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:24:51.433 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.433 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.433 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:24:51.433 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:24:51.433 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:24:51.433 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:24:51.433 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.433 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:24:51.433 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:24:51.433 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:51.434 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.434 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.434 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:24:51.434 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:24:51.434 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:51.434 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:51.434 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:51.434 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.434 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:24:51.434 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:24:51.435 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:24:51.435 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:24:51.435 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:24:51.435 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:51.435 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:51.435 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.435 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:24:51.435 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:24:51.435 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.435 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:24:51.435 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:24:51.435 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:24:51.436 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:51.436 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:51.436 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:24:51.436 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.436 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:24:51.436 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:24:51.436 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:24:51.436 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:51.437 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:51.437 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:24:51.437 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.437 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:24:51.437 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:24:51.437 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:24:51.437 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:51.437 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:51.437 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:24:51.437 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.438 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:24:51.438 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:24:51.438 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:24:51.438 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:51.438 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:51.438 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.438 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:24:51.438 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:24:51.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.421+0000 7fcded9c4640 1 -- 172.21.15.100:0/1811418087 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcdc806be30 msgr2=0x7fcdc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.421+0000 7fcded9c4640 1 --2- 172.21.15.100:0/1811418087 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcdc806be30 0x7fcdc806e2f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcde0034000 tx=0x7fcde002e000 comp rx=0 tx=0).stop 2024-09-11T22:24:51.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.421+0000 7fcded9c4640 1 -- 172.21.15.100:0/1811418087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcde8154c60 msgr2=0x7fcde8150b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.421+0000 7fcded9c4640 1 --2- 172.21.15.100:0/1811418087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcde8154c60 0x7fcde8150b80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcdd800c480 tx=0x7fcdd800c940 comp rx=0 tx=0).stop 2024-09-11T22:24:51.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.421+0000 7fcde77fe640 1 -- 172.21.15.100:0/1811418087 reap_dead start 2024-09-11T22:24:51.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.421+0000 7fcde77fe640 1 -- 172.21.15.100:0/1811418087 reap_dead start 2024-09-11T22:24:51.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.421+0000 7fcded9c4640 1 -- 172.21.15.100:0/1811418087 shutdown_connections 2024-09-11T22:24:51.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.421+0000 7fcded9c4640 1 -- 172.21.15.100:0/1811418087 >> 172.21.15.100:0/1811418087 conn(0x7fcde806d060 msgr2=0x7fcde8153e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:51.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.421+0000 7fcded9c4640 1 -- 172.21.15.100:0/1811418087 shutdown_connections 2024-09-11T22:24:51.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.421+0000 7fcded9c4640 1 -- 172.21.15.100:0/1811418087 wait complete. 2024-09-11T22:24:51.441 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:24:51.441 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:24:51.441 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:24:51.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.549+0000 7f244b60e640 1 Processor -- start 2024-09-11T22:24:51.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.549+0000 7f244b60e640 1 -- start start 2024-09-11T22:24:51.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.550+0000 7f244b60e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2444154d30 0x7f244415e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.550+0000 7f244b60e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24440c9b40 0x7f244415b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.550+0000 7f244b60e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f244415b6b0 0x7f24440caf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.550+0000 7f244b60e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f244415ace0 con 0x7f244415b6b0 2024-09-11T22:24:51.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.550+0000 7f244b60e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f244406bc10 con 0x7f2444154d30 2024-09-11T22:24:51.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.550+0000 7f244b60e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2444155110 con 0x7f24440c9b40 2024-09-11T22:24:51.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.550+0000 7f2449bab640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f244415b6b0 0x7f24440caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.550+0000 7f2449bab640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f244415b6b0 0x7f24440caf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55920/0 (socket says 172.21.15.100:55920) 2024-09-11T22:24:51.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.550+0000 7f2449bab640 1 -- 172.21.15.100:0/1523995062 learned_addr learned my addr 172.21.15.100:0/1523995062 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:24:51.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.550+0000 7f2448ba9640 1 --2- 172.21.15.100:0/1523995062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24440c9b40 0x7f244415b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.550+0000 7f24493aa640 1 --2- 172.21.15.100:0/1523995062 >> v2:172.21.15.167:3300/0 conn(0x7f2444154d30 0x7f244415e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.550+0000 7f2449bab640 1 -- 172.21.15.100:0/1523995062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24440c9b40 msgr2=0x7f244415b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:51.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.550+0000 7f2449bab640 1 --2- 172.21.15.100:0/1523995062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24440c9b40 0x7f244415b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.550+0000 7f2449bab640 1 -- 172.21.15.100:0/1523995062 >> v2:172.21.15.167:3300/0 conn(0x7f2444154d30 msgr2=0x7f244415e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:51.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.550+0000 7f2449bab640 1 --2- 172.21.15.100:0/1523995062 >> v2:172.21.15.167:3300/0 conn(0x7f2444154d30 0x7f244415e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.550+0000 7f2449bab640 1 -- 172.21.15.100:0/1523995062 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24440ca010 con 0x7f244415b6b0 2024-09-11T22:24:51.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.551+0000 7f2449bab640 1 --2- 172.21.15.100:0/1523995062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f244415b6b0 0x7f24440caf90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f24440cf1c0 tx=0x7f243c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7921d23755f0fd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:51.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.552+0000 7f243bfff640 1 -- 172.21.15.100:0/1523995062 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c036070 con 0x7f244415b6b0 2024-09-11T22:24:51.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.552+0000 7f243bfff640 1 -- 172.21.15.100:0/1523995062 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f243c031600 con 0x7f244415b6b0 2024-09-11T22:24:51.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.552+0000 7f243bfff640 1 -- 172.21.15.100:0/1523995062 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c0319d0 con 0x7f244415b6b0 2024-09-11T22:24:51.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.552+0000 7f244b60e640 1 -- 172.21.15.100:0/1523995062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f244415b6b0 msgr2=0x7f24440caf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.552+0000 7f244b60e640 1 --2- 172.21.15.100:0/1523995062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f244415b6b0 0x7f24440caf90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f24440cf1c0 tx=0x7f243c02a6a0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.552+0000 7f244b60e640 1 -- 172.21.15.100:0/1523995062 shutdown_connections 2024-09-11T22:24:51.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.552+0000 7f244b60e640 1 --2- 172.21.15.100:0/1523995062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f244415b6b0 0x7f24440caf90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.552+0000 7f244b60e640 1 --2- 172.21.15.100:0/1523995062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24440c9b40 0x7f244415b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.552+0000 7f244b60e640 1 --2- 172.21.15.100:0/1523995062 >> v2:172.21.15.167:3300/0 conn(0x7f2444154d30 0x7f244415e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.552+0000 7f244b60e640 1 -- 172.21.15.100:0/1523995062 >> 172.21.15.100:0/1523995062 conn(0x7f244406e000 msgr2=0x7f244406e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:51.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.552+0000 7f244b60e640 1 -- 172.21.15.100:0/1523995062 shutdown_connections 2024-09-11T22:24:51.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.552+0000 7f244b60e640 1 -- 172.21.15.100:0/1523995062 wait complete. 2024-09-11T22:24:51.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.553+0000 7f244b60e640 1 Processor -- start 2024-09-11T22:24:51.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.554+0000 7f244b60e640 1 -- start start 2024-09-11T22:24:51.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.554+0000 7f244b60e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24440c9b40 0x7f24440c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.554+0000 7f244b60e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2444154d30 0x7f2444150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.554+0000 7f244b60e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f244415b6b0 0x7f2444150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.554+0000 7f244b60e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f24440ca5b0 con 0x7f2444154d30 2024-09-11T22:24:51.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.554+0000 7f244b60e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f24440ca2d0 con 0x7f244415b6b0 2024-09-11T22:24:51.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.554+0000 7f244b60e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f24440ca890 con 0x7f24440c9b40 2024-09-11T22:24:51.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.554+0000 7f2448ba9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2444154d30 0x7f2444150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.554+0000 7f24493aa640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24440c9b40 0x7f24440c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.554+0000 7f2448ba9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2444154d30 0x7f2444150a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55928/0 (socket says 172.21.15.100:55928) 2024-09-11T22:24:51.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.554+0000 7f2448ba9640 1 -- 172.21.15.100:0/3334583042 learned_addr learned my addr 172.21.15.100:0/3334583042 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:24:51.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.554+0000 7f2449bab640 1 --2- 172.21.15.100:0/3334583042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f244415b6b0 0x7f2444150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.555+0000 7f2448ba9640 1 -- 172.21.15.100:0/3334583042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24440c9b40 msgr2=0x7f24440c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.555+0000 7f2448ba9640 1 --2- 172.21.15.100:0/3334583042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24440c9b40 0x7f24440c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.555+0000 7f2448ba9640 1 -- 172.21.15.100:0/3334583042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f244415b6b0 msgr2=0x7f2444150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.555+0000 7f2448ba9640 1 --2- 172.21.15.100:0/3334583042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f244415b6b0 0x7f2444150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.555+0000 7f2448ba9640 1 -- 172.21.15.100:0/3334583042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24441517a0 con 0x7f2444154d30 2024-09-11T22:24:51.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.555+0000 7f2448ba9640 1 --2- 172.21.15.100:0/3334583042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2444154d30 0x7f2444150a40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f243400d620 tx=0x7f243400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:51.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.555+0000 7f2439ffb640 1 -- 172.21.15.100:0/3334583042 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2434004240 con 0x7f2444154d30 2024-09-11T22:24:51.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.555+0000 7f2439ffb640 1 -- 172.21.15.100:0/3334583042 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24340043e0 con 0x7f2444154d30 2024-09-11T22:24:51.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.555+0000 7f244b60e640 1 -- 172.21.15.100:0/3334583042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24441f12b0 con 0x7f2444154d30 2024-09-11T22:24:51.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.555+0000 7f2439ffb640 1 -- 172.21.15.100:0/3334583042 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2434003610 con 0x7f2444154d30 2024-09-11T22:24:51.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.555+0000 7f244b60e640 1 -- 172.21.15.100:0/3334583042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24440ce910 con 0x7f2444154d30 2024-09-11T22:24:51.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.556+0000 7f244b60e640 1 --2- 172.21.15.100:0/3334583042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2444158a90 0x7f24440ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.556+0000 7f244b60e640 1 -- 172.21.15.100:0/3334583042 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2444151a40 con 0x7f2444158a90 2024-09-11T22:24:51.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.557+0000 7f24493aa640 1 --2- 172.21.15.100:0/3334583042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2444158a90 0x7f24440ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.557+0000 7f2439ffb640 1 -- 172.21.15.100:0/3334583042 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f243401b020 con 0x7f2444154d30 2024-09-11T22:24:51.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.557+0000 7f24493aa640 1 -- 172.21.15.100:0/3334583042 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2444159620 con 0x7f2444158a90 2024-09-11T22:24:51.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.557+0000 7f24493aa640 1 --2- 172.21.15.100:0/3334583042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2444158a90 0x7f24440ceb50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2440010820 tx=0x7f2440010ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:51.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.557+0000 7f2439ffb640 1 --2- 172.21.15.100:0/3334583042 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f242806be30 0x7f242806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.557+0000 7f2439ffb640 1 -- 172.21.15.100:0/3334583042 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f243408aea0 con 0x7f2444154d30 2024-09-11T22:24:51.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.557+0000 7f2449bab640 1 --2- 172.21.15.100:0/3334583042 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f242806be30 0x7f242806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.557+0000 7f2439ffb640 1 -- 172.21.15.100:0/3334583042 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244000ea30 con 0x7f2444158a90 2024-09-11T22:24:51.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.558+0000 7f2439ffb640 1 -- 172.21.15.100:0/3334583042 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f244000ea30 con 0x7f2444158a90 2024-09-11T22:24:51.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.558+0000 7f2439ffb640 1 -- 172.21.15.100:0/3334583042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2444158a90 msgr2=0x7f24440ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.558+0000 7f2439ffb640 1 --2- 172.21.15.100:0/3334583042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2444158a90 0x7f24440ceb50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2440010820 tx=0x7f2440010ce0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.558+0000 7f2439ffb640 1 -- 172.21.15.100:0/3334583042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2444158a90 msgr2=0x7f24440ceb50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:24:51.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.558+0000 7f2439ffb640 1 --2- 172.21.15.100:0/3334583042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2444158a90 0x7f24440ceb50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.558+0000 7f2449bab640 1 --2- 172.21.15.100:0/3334583042 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f242806be30 0x7f242806e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f243c033000 tx=0x7f243c009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:51.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.565+0000 7f244b60e640 1 --2- 172.21.15.100:0/3334583042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244414efb0 0x7f244414dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.565+0000 7f244b60e640 1 -- 172.21.15.100:0/3334583042 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f24440c8b10 con 0x7f244414efb0 2024-09-11T22:24:51.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.566+0000 7f24493aa640 1 --2- 172.21.15.100:0/3334583042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244414efb0 0x7f244414dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.566+0000 7f24493aa640 1 -- 172.21.15.100:0/3334583042 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f24440c9710 con 0x7f244414efb0 2024-09-11T22:24:51.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.566+0000 7f24493aa640 1 --2- 172.21.15.100:0/3334583042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244414efb0 0x7f244414dac0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2440019000 tx=0x7f24400046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:51.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.566+0000 7f2439ffb640 1 -- 172.21.15.100:0/3334583042 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2440003df0 con 0x7f244414efb0 2024-09-11T22:24:51.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.567+0000 7f2439ffb640 1 -- 172.21.15.100:0/3334583042 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7f2440003df0 con 0x7f244414efb0 2024-09-11T22:24:51.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.567+0000 7f2439ffb640 1 -- 172.21.15.100:0/3334583042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244414efb0 msgr2=0x7f244414dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.567+0000 7f2439ffb640 1 --2- 172.21.15.100:0/3334583042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244414efb0 0x7f244414dac0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2440019000 tx=0x7f24400046c0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.567+0000 7f2439ffb640 1 -- 172.21.15.100:0/3334583042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244414efb0 msgr2=0x7f244414dac0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:24:51.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.567+0000 7f2439ffb640 1 --2- 172.21.15.100:0/3334583042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f244414efb0 0x7f244414dac0 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2440019000 tx=0x7f24400046c0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.568 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:24:51.569 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:24:51.569 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:24:51.569 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:24:51.569 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 34, 2024-09-11T22:24:51.569 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 182288, 2024-09-11T22:24:51.569 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:24:51.569 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:24:51.569 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:24:51.569 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:24:51.569 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:51.569 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:24:51.569 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:24:51.570 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:24:51.570 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:24:51.570 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:24:51.570 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:24:51.570 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:24:51.570 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:24:51.570 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:24:51.570 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:24:51.570 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:24:51.570 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:24:51.570 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:24:51.570 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:24:51.570 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:24:51.570 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:51.571 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:24:51.571 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:24:51.571 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:24:51.571 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:24:51.571 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:24:51.571 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:24:51.571 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:24:51.571 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:24:51.571 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:24:51.571 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:24:51.571 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:24:51.571 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:24:51.571 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:24:51.571 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:51.572 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.572 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:24:51.572 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:24:51.572 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:24:51.572 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:24:51.572 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:24:51.572 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:24:51.572 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:24:51.572 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:24:51.572 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:24:51.572 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:24:51.572 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:24:51.572 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:24:51.573 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:24:51.573 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:24:51.573 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:24:51.573 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:24:51.573 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:24:51.573 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:24:51.573 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:24:51.573 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:24:51.573 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:24:51.573 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:24:51.573 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:24:51.573 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:24:51.573 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:24:51.573 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:24:51.574 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:24:51.574 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:24:51.574 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:51.574 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:24:51.574 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.574 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:24:51.574 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.574 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:24:51.574 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:24:51.574 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:24:51.574 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:24:51.574 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.574 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:24:51.575 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:24:51.575 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:51.575 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.575 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.575 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:24:51.575 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:24:51.575 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:51.575 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:51.575 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:51.575 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.575 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:24:51.575 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:24:51.575 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:24:51.575 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:24:51.576 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:24:51.576 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.576 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.576 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:24:51.576 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:24:51.576 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:24:51.576 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:24:51.576 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.576 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:24:51.576 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:24:51.576 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:51.576 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.576 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.577 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:24:51.577 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:24:51.577 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:51.577 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:51.577 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:51.577 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.577 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:24:51.577 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:24:51.577 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:24:51.577 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:24:51.577 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:24:51.577 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.577 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.578 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:24:51.578 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:24:51.578 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:24:51.578 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:24:51.578 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.578 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:24:51.578 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:24:51.578 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:51.578 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.578 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.578 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:24:51.578 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:24:51.578 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:24:51.578 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:51.579 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:51.579 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.579 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:24:51.579 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:24:51.579 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:24:51.579 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:24:51.579 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:24:51.579 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:51.579 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:51.579 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.579 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:24:51.579 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:24:51.579 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.580 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:24:51.580 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:24:51.580 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:24:51.580 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:51.580 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:51.580 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:24:51.580 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.580 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:24:51.580 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:24:51.580 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:24:51.580 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:51.580 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:51.580 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:24:51.580 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.581 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:24:51.581 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:24:51.581 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:24:51.581 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:51.581 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:51.581 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:24:51.581 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.581 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:24:51.581 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:24:51.581 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:24:51.581 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:51.581 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:24:51.581 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:24:51.582 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:24:51.582 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:24:51.582 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:24:51.582 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:24:51.582 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:24:51.582 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:24:51.582 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:24:51.582 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:24:51.582 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:24:51.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.567+0000 7f244b60e640 1 -- 172.21.15.100:0/3334583042 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f242806be30 msgr2=0x7f242806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.567+0000 7f244b60e640 1 --2- 172.21.15.100:0/3334583042 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f242806be30 0x7f242806e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f243c033000 tx=0x7f243c009000 comp rx=0 tx=0).stop 2024-09-11T22:24:51.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.567+0000 7f2449bab640 1 -- 172.21.15.100:0/3334583042 reap_dead start 2024-09-11T22:24:51.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.567+0000 7f244b60e640 1 -- 172.21.15.100:0/3334583042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2444154d30 msgr2=0x7f2444150a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.567+0000 7f244b60e640 1 --2- 172.21.15.100:0/3334583042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2444154d30 0x7f2444150a40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f243400d620 tx=0x7f243400dae0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.567+0000 7f244b60e640 1 -- 172.21.15.100:0/3334583042 shutdown_connections 2024-09-11T22:24:51.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.567+0000 7f244b60e640 1 --2- 172.21.15.100:0/3334583042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2444154d30 0x7f2444150a40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.567+0000 7f244b60e640 1 -- 172.21.15.100:0/3334583042 >> 172.21.15.100:0/3334583042 conn(0x7f244406e000 msgr2=0x7f2444159a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:51.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.567+0000 7f244b60e640 1 -- 172.21.15.100:0/3334583042 shutdown_connections 2024-09-11T22:24:51.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.567+0000 7f244b60e640 1 -- 172.21.15.100:0/3334583042 wait complete. 2024-09-11T22:24:51.585 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:24:51.585 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-11T22:24:51.585 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-11T22:24:51.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.692+0000 7f2500f86640 1 Processor -- start 2024-09-11T22:24:51.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.692+0000 7f2500f86640 1 -- start start 2024-09-11T22:24:51.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.693+0000 7f2500f86640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24fc154c20 0x7f24fc0cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.693+0000 7f2500f86640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f24fc15a7e0 0x7f24fc0cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.693+0000 7f2500f86640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24fc15ac90 con 0x7f24fc0b3190 2024-09-11T22:24:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.693+0000 7f2500f86640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f24fc15e000 con 0x7f24fc15a7e0 2024-09-11T22:24:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.693+0000 7f2500f86640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f24fc15af70 con 0x7f24fc154c20 2024-09-11T22:24:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.693+0000 7f24fad9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f24fc15a7e0 0x7f24fc0cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.693+0000 7f24f9d9b640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f24fc0b3190 0x7f24fc15e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47114/0 (socket says 172.21.15.100:47114) 2024-09-11T22:24:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.693+0000 7f24f9d9b640 1 -- 172.21.15.100:0/711736737 learned_addr learned my addr 172.21.15.100:0/711736737 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:24:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.693+0000 7f24fa59c640 1 --2- 172.21.15.100:0/711736737 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24fc154c20 0x7f24fc0cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.693+0000 7f24fad9d640 1 -- 172.21.15.100:0/711736737 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24fc154c20 msgr2=0x7f24fc0cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:24:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.693+0000 7f24fad9d640 1 --2- 172.21.15.100:0/711736737 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24fc154c20 0x7f24fc0cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.693+0000 7f24fad9d640 1 -- 172.21.15.100:0/711736737 >> v1:172.21.15.100:6789/0 conn(0x7f24fc0b3190 legacy=0x7f24fc15e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.693+0000 7f24f959a640 1 -- 172.21.15.100:0/711736737 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 10818943 0 0) 0x7f24fc15ac90 con 0x7f24fc0b3190 2024-09-11T22:24:51.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.693+0000 7f24fad9d640 1 -- 172.21.15.100:0/711736737 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24fc15b250 con 0x7f24fc15a7e0 2024-09-11T22:24:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.694+0000 7f24fad9d640 1 --2- 172.21.15.100:0/711736737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24fc15a7e0 0x7f24fc0cbd10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009d90 tx=0x7f24f402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0715aae822f4ab6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.694+0000 7f24f959a640 1 -- 172.21.15.100:0/711736737 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4007740 con 0x7f24fc15a7e0 2024-09-11T22:24:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.694+0000 7f24f959a640 1 -- 172.21.15.100:0/711736737 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f40078e0 con 0x7f24fc15a7e0 2024-09-11T22:24:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.694+0000 7f24f959a640 1 -- 172.21.15.100:0/711736737 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4007cb0 con 0x7f24fc15a7e0 2024-09-11T22:24:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.695+0000 7f2500f86640 1 -- 172.21.15.100:0/711736737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24fc15a7e0 msgr2=0x7f24fc0cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.695+0000 7f2500f86640 1 --2- 172.21.15.100:0/711736737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24fc15a7e0 0x7f24fc0cbd10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009d90 tx=0x7f24f402a660 comp rx=0 tx=0).stop 2024-09-11T22:24:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.695+0000 7f2500f86640 1 -- 172.21.15.100:0/711736737 shutdown_connections 2024-09-11T22:24:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.695+0000 7f2500f86640 1 --2- 172.21.15.100:0/711736737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24fc15a7e0 0x7f24fc0cbd10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.695+0000 7f2500f86640 1 --2- 172.21.15.100:0/711736737 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24fc154c20 0x7f24fc0cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.695+0000 7f2500f86640 1 -- 172.21.15.100:0/711736737 >> 172.21.15.100:0/711736737 conn(0x7f24fc067d40 msgr2=0x7f24fc06d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.695+0000 7f2500f86640 1 -- 172.21.15.100:0/711736737 shutdown_connections 2024-09-11T22:24:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.695+0000 7f2500f86640 1 -- 172.21.15.100:0/711736737 wait complete. 2024-09-11T22:24:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.696+0000 7f2500f86640 1 Processor -- start 2024-09-11T22:24:51.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.696+0000 7f2500f86640 1 -- start start 2024-09-11T22:24:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.697+0000 7f2500f86640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24fc0b3190 0x7f24fc15ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.697+0000 7f2500f86640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24fc154c20 0x7f24fc1f3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.697+0000 7f2500f86640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24fc15a7e0 0x7f24fc150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.697+0000 7f2500f86640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f24fc15ed20 con 0x7f24fc15a7e0 2024-09-11T22:24:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.697+0000 7f2500f86640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f24fc15eba0 con 0x7f24fc154c20 2024-09-11T22:24:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.697+0000 7f2500f86640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f24fc0cb660 con 0x7f24fc0b3190 2024-09-11T22:24:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.697+0000 7f24fad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24fc15a7e0 0x7f24fc150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.697+0000 7f24fad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24fc15a7e0 0x7f24fc150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55956/0 (socket says 172.21.15.100:55956) 2024-09-11T22:24:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.697+0000 7f24fad9d640 1 -- 172.21.15.100:0/1736389290 learned_addr learned my addr 172.21.15.100:0/1736389290 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:24:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.697+0000 7f24fa59c640 1 --2- 172.21.15.100:0/1736389290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24fc0b3190 0x7f24fc15ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.697+0000 7f24f9d9b640 1 --2- 172.21.15.100:0/1736389290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24fc154c20 0x7f24fc1f3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.697+0000 7f24fad9d640 1 -- 172.21.15.100:0/1736389290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24fc0b3190 msgr2=0x7f24fc15ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.697+0000 7f24fad9d640 1 --2- 172.21.15.100:0/1736389290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24fc0b3190 0x7f24fc15ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.697+0000 7f24fad9d640 1 -- 172.21.15.100:0/1736389290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24fc154c20 msgr2=0x7f24fc1f3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.697+0000 7f24fad9d640 1 --2- 172.21.15.100:0/1736389290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24fc154c20 0x7f24fc1f3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.697+0000 7f24fad9d640 1 -- 172.21.15.100:0/1736389290 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24fc153ca0 con 0x7f24fc15a7e0 2024-09-11T22:24:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.698+0000 7f24fad9d640 1 --2- 172.21.15.100:0/1736389290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24fc15a7e0 0x7f24fc150180 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009eb0 tx=0x7f24f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.698+0000 7f24eaffd640 1 -- 172.21.15.100:0/1736389290 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f403f070 con 0x7f24fc15a7e0 2024-09-11T22:24:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.698+0000 7f24eaffd640 1 -- 172.21.15.100:0/1736389290 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24f4031bc0 con 0x7f24fc15a7e0 2024-09-11T22:24:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.698+0000 7f2500f86640 1 -- 172.21.15.100:0/1736389290 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24fc15d8d0 con 0x7f24fc15a7e0 2024-09-11T22:24:51.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.698+0000 7f24eaffd640 1 -- 172.21.15.100:0/1736389290 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24f4009450 con 0x7f24fc15a7e0 2024-09-11T22:24:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.698+0000 7f2500f86640 1 -- 172.21.15.100:0/1736389290 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24fc14eb30 con 0x7f24fc15a7e0 2024-09-11T22:24:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.699+0000 7f2500f86640 1 -- 172.21.15.100:0/1736389290 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24fc0cb120 con 0x7f24fc15a7e0 2024-09-11T22:24:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.699+0000 7f24eaffd640 1 -- 172.21.15.100:0/1736389290 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f24f403b410 con 0x7f24fc15a7e0 2024-09-11T22:24:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.700+0000 7f24eaffd640 1 --2- 172.21.15.100:0/1736389290 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f24dc06be60 0x7f24dc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:24:51.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.700+0000 7f24eaffd640 1 -- 172.21.15.100:0/1736389290 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f24f40ac4f0 con 0x7f24fc15a7e0 2024-09-11T22:24:51.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.700+0000 7f24fa59c640 1 --2- 172.21.15.100:0/1736389290 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f24dc06be60 0x7f24dc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:24:51.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.700+0000 7f24fa59c640 1 --2- 172.21.15.100:0/1736389290 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f24dc06be60 0x7f24dc06e320 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009b40 tx=0x7f24ec009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:24:51.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.705+0000 7f24eaffd640 1 -- 172.21.15.100:0/1736389290 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f24f407a4c0 con 0x7f24fc15a7e0 2024-09-11T22:24:51.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.993+0000 7f2500f86640 1 -- 172.21.15.100:0/1736389290 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f24fc1f3600 con 0x7f24fc15a7e0 2024-09-11T22:24:51.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.993+0000 7f24eaffd640 1 -- 172.21.15.100:0/1736389290 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f24f407e7c0 con 0x7f24fc15a7e0 2024-09-11T22:24:51.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.996+0000 7f2500f86640 1 -- 172.21.15.100:0/1736389290 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f24dc06be60 msgr2=0x7f24dc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.996+0000 7f2500f86640 1 --2- 172.21.15.100:0/1736389290 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f24dc06be60 0x7f24dc06e320 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009b40 tx=0x7f24ec009190 comp rx=0 tx=0).stop 2024-09-11T22:24:51.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.996+0000 7f2500f86640 1 -- 172.21.15.100:0/1736389290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24fc15a7e0 msgr2=0x7f24fc150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:24:51.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.996+0000 7f2500f86640 1 --2- 172.21.15.100:0/1736389290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24fc15a7e0 0x7f24fc150180 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f24f4009eb0 tx=0x7f24f4004a40 comp rx=0 tx=0).stop 2024-09-11T22:24:51.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.996+0000 7f2500f86640 1 -- 172.21.15.100:0/1736389290 shutdown_connections 2024-09-11T22:24:51.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.996+0000 7f2500f86640 1 --2- 172.21.15.100:0/1736389290 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f24dc06be60 0x7f24dc06e320 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.996+0000 7f2500f86640 1 --2- 172.21.15.100:0/1736389290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24fc15a7e0 0x7f24fc150180 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.996+0000 7f2500f86640 1 --2- 172.21.15.100:0/1736389290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24fc154c20 0x7f24fc1f3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.996+0000 7f2500f86640 1 --2- 172.21.15.100:0/1736389290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24fc0b3190 0x7f24fc15ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:24:51.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.996+0000 7f2500f86640 1 -- 172.21.15.100:0/1736389290 >> 172.21.15.100:0/1736389290 conn(0x7f24fc067d40 msgr2=0x7f24fc0b5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:24:51.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.996+0000 7f2500f86640 1 -- 172.21.15.100:0/1736389290 shutdown_connections 2024-09-11T22:24:51.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:24:51.996+0000 7f2500f86640 1 -- 172.21.15.100:0/1736389290 wait complete. 2024-09-11T22:24:52.010 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-11T22:25:02.011 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:25:02.011 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:25:02.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.121+0000 7fd9058af640 1 Processor -- start 2024-09-11T22:25:02.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.121+0000 7fd9058af640 1 -- start start 2024-09-11T22:25:02.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.122+0000 7fd9058af640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd900154c00 0x7fd90015b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.122+0000 7fd9058af640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd900075960 0x7fd9000c7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.122+0000 7fd9058af640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd90006fc40 con 0x7fd90006f7b0 2024-09-11T22:25:02.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.122+0000 7fd9058af640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fd9000707a0 con 0x7fd900075960 2024-09-11T22:25:02.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.122+0000 7fd9058af640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd9000c7400 con 0x7fd900154c00 2024-09-11T22:25:02.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.122+0000 7fd8ff7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd900075960 0x7fd9000c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.122+0000 7fd8fe7fc640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd90006f7b0 0x7fd9000c87c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54190/0 (socket says 172.21.15.100:54190) 2024-09-11T22:25:02.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.122+0000 7fd8ff7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd900075960 0x7fd9000c7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38950/0 (socket says 172.21.15.100:38950) 2024-09-11T22:25:02.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.122+0000 7fd8fe7fc640 1 -- 172.21.15.100:0/4285230290 learned_addr learned my addr 172.21.15.100:0/4285230290 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:25:02.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.122+0000 7fd8feffd640 1 --2- 172.21.15.100:0/4285230290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd900154c00 0x7fd90015b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.122+0000 7fd8ff7fe640 1 -- 172.21.15.100:0/4285230290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd900154c00 msgr2=0x7fd90015b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:25:02.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.122+0000 7fd8ff7fe640 1 --2- 172.21.15.100:0/4285230290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd900154c00 0x7fd90015b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.122+0000 7fd8ff7fe640 1 -- 172.21.15.100:0/4285230290 >> v1:172.21.15.100:6789/0 conn(0x7fd90006f7b0 legacy=0x7fd9000c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.122+0000 7fd8fdffb640 1 -- 172.21.15.100:0/4285230290 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2824709679 0 0) 0x7fd90006fc40 con 0x7fd90006f7b0 2024-09-11T22:25:02.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.122+0000 7fd8ff7fe640 1 -- 172.21.15.100:0/4285230290 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90006ff00 con 0x7fd900075960 2024-09-11T22:25:02.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.123+0000 7fd8ff7fe640 1 --2- 172.21.15.100:0/4285230290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd900075960 0x7fd9000c7890 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd900070920 tx=0x7fd8f802a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a225cbe9b6482182 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:02.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.123+0000 7fd8fdffb640 1 -- 172.21.15.100:0/4285230290 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8007740 con 0x7fd900075960 2024-09-11T22:25:02.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.123+0000 7fd8fdffb640 1 -- 172.21.15.100:0/4285230290 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f80078e0 con 0x7fd900075960 2024-09-11T22:25:02.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.123+0000 7fd8fdffb640 1 -- 172.21.15.100:0/4285230290 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8007cb0 con 0x7fd900075960 2024-09-11T22:25:02.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.124+0000 7fd9058af640 1 -- 172.21.15.100:0/4285230290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd900075960 msgr2=0x7fd9000c7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.124+0000 7fd9058af640 1 --2- 172.21.15.100:0/4285230290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd900075960 0x7fd9000c7890 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd900070920 tx=0x7fd8f802a5b0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.124+0000 7fd9058af640 1 -- 172.21.15.100:0/4285230290 shutdown_connections 2024-09-11T22:25:02.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.124+0000 7fd9058af640 1 --2- 172.21.15.100:0/4285230290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd900075960 0x7fd9000c7890 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.124+0000 7fd9058af640 1 --2- 172.21.15.100:0/4285230290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd900154c00 0x7fd90015b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.124+0000 7fd9058af640 1 -- 172.21.15.100:0/4285230290 >> 172.21.15.100:0/4285230290 conn(0x7fd9000cc840 msgr2=0x7fd9000ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:02.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.124+0000 7fd9058af640 1 -- 172.21.15.100:0/4285230290 shutdown_connections 2024-09-11T22:25:02.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.124+0000 7fd9058af640 1 -- 172.21.15.100:0/4285230290 wait complete. 2024-09-11T22:25:02.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.125+0000 7fd9058af640 1 Processor -- start 2024-09-11T22:25:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.126+0000 7fd9058af640 1 -- start start 2024-09-11T22:25:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.126+0000 7fd9058af640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd900075960 0x7fd9000ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.126+0000 7fd9058af640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd900154c00 0x7fd900147430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.126+0000 7fd9058af640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9000c60e0 0x7fd900148820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.126+0000 7fd9058af640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd9000704c0 con 0x7fd9000c60e0 2024-09-11T22:25:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.126+0000 7fd9058af640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd90015b9e0 con 0x7fd900154c00 2024-09-11T22:25:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.126+0000 7fd9058af640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd9000c8ed0 con 0x7fd900075960 2024-09-11T22:25:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.127+0000 7fd8ff7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9000c60e0 0x7fd900148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.127+0000 7fd8ff7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9000c60e0 0x7fd900148820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38966/0 (socket says 172.21.15.100:38966) 2024-09-11T22:25:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.127+0000 7fd8ff7fe640 1 -- 172.21.15.100:0/1430499889 learned_addr learned my addr 172.21.15.100:0/1430499889 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.127+0000 7fd8feffd640 1 --2- 172.21.15.100:0/1430499889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd900075960 0x7fd9000ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.127+0000 7fd8fe7fc640 1 --2- 172.21.15.100:0/1430499889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd900154c00 0x7fd900147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.127+0000 7fd8ff7fe640 1 -- 172.21.15.100:0/1430499889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd900075960 msgr2=0x7fd9000ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.127+0000 7fd8ff7fe640 1 --2- 172.21.15.100:0/1430499889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd900075960 0x7fd9000ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.127+0000 7fd8ff7fe640 1 -- 172.21.15.100:0/1430499889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd900154c00 msgr2=0x7fd900147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.127+0000 7fd8ff7fe640 1 --2- 172.21.15.100:0/1430499889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd900154c00 0x7fd900147430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.127+0000 7fd8ff7fe640 1 -- 172.21.15.100:0/1430499889 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90014a740 con 0x7fd9000c60e0 2024-09-11T22:25:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.127+0000 7fd8fe7fc640 1 --2- 172.21.15.100:0/1430499889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd900154c00 0x7fd900147430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:25:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.127+0000 7fd8ff7fe640 1 --2- 172.21.15.100:0/1430499889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9000c60e0 0x7fd900148820 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009e50 tx=0x7fd8f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.127+0000 7fd8e7fff640 1 -- 172.21.15.100:0/1430499889 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8040070 con 0x7fd9000c60e0 2024-09-11T22:25:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.127+0000 7fd8e7fff640 1 -- 172.21.15.100:0/1430499889 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f8031bf0 con 0x7fd9000c60e0 2024-09-11T22:25:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.127+0000 7fd8e7fff640 1 -- 172.21.15.100:0/1430499889 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8009450 con 0x7fd9000c60e0 2024-09-11T22:25:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.127+0000 7fd9058af640 1 -- 172.21.15.100:0/1430499889 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd90014a340 con 0x7fd9000c60e0 2024-09-11T22:25:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.127+0000 7fd9058af640 1 -- 172.21.15.100:0/1430499889 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd90014ab00 con 0x7fd9000c60e0 2024-09-11T22:25:02.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.128+0000 7fd9058af640 1 -- 172.21.15.100:0/1430499889 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd900154fe0 con 0x7fd9000c60e0 2024-09-11T22:25:02.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.129+0000 7fd8e7fff640 1 -- 172.21.15.100:0/1430499889 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8f8039040 con 0x7fd9000c60e0 2024-09-11T22:25:02.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.129+0000 7fd8e7fff640 1 --2- 172.21.15.100:0/1430499889 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd8ec06be30 0x7fd8ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.130+0000 7fd8e7fff640 1 -- 172.21.15.100:0/1430499889 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fd8f80acaa0 con 0x7fd9000c60e0 2024-09-11T22:25:02.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.130+0000 7fd8feffd640 1 --2- 172.21.15.100:0/1430499889 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd8ec06be30 0x7fd8ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.130+0000 7fd8feffd640 1 --2- 172.21.15.100:0/1430499889 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd8ec06be30 0x7fd8ec06e2f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00079a0 tx=0x7fd8f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:02.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.134+0000 7fd8e7fff640 1 -- 172.21.15.100:0/1430499889 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd90014a740 con 0x7fd9000c60e0 2024-09-11T22:25:02.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.416+0000 7fd9058af640 1 -- 172.21.15.100:0/1430499889 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd9000c36e0 con 0x7fd9000c60e0 2024-09-11T22:25:02.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.417+0000 7fd8e7fff640 1 -- 172.21.15.100:0/1430499889 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fd8f807b030 con 0x7fd9000c60e0 2024-09-11T22:25:02.418 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":34,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:25:02.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.419+0000 7fd9058af640 1 -- 172.21.15.100:0/1430499889 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd8ec06be30 msgr2=0x7fd8ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.419+0000 7fd9058af640 1 --2- 172.21.15.100:0/1430499889 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd8ec06be30 0x7fd8ec06e2f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00079a0 tx=0x7fd8f0008040 comp rx=0 tx=0).stop 2024-09-11T22:25:02.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.419+0000 7fd9058af640 1 -- 172.21.15.100:0/1430499889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9000c60e0 msgr2=0x7fd900148820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.419+0000 7fd9058af640 1 --2- 172.21.15.100:0/1430499889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9000c60e0 0x7fd900148820 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009e50 tx=0x7fd8f8004a40 comp rx=0 tx=0).stop 2024-09-11T22:25:02.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.419+0000 7fd9058af640 1 -- 172.21.15.100:0/1430499889 shutdown_connections 2024-09-11T22:25:02.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.419+0000 7fd9058af640 1 --2- 172.21.15.100:0/1430499889 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd8ec06be30 0x7fd8ec06e2f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.419+0000 7fd9058af640 1 --2- 172.21.15.100:0/1430499889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9000c60e0 0x7fd900148820 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.419+0000 7fd9058af640 1 --2- 172.21.15.100:0/1430499889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd900154c00 0x7fd900147430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.419+0000 7fd9058af640 1 --2- 172.21.15.100:0/1430499889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd900075960 0x7fd9000ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.419+0000 7fd9058af640 1 -- 172.21.15.100:0/1430499889 >> 172.21.15.100:0/1430499889 conn(0x7fd9000cc840 msgr2=0x7fd900072420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:02.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.419+0000 7fd9058af640 1 -- 172.21.15.100:0/1430499889 shutdown_connections 2024-09-11T22:25:02.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.419+0000 7fd9058af640 1 -- 172.21.15.100:0/1430499889 wait complete. 2024-09-11T22:25:02.433 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:25:02.433 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-11T22:25:02.433 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:25:02.433 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:25:02.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.548+0000 7fa08fde8640 1 Processor -- start 2024-09-11T22:25:02.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.549+0000 7fa08fde8640 1 -- start start 2024-09-11T22:25:02.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.550+0000 7fa08fde8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa088151740 0x7fa088073d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.550+0000 7fa08fde8640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa0880c8e80 0x7fa08806c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.550+0000 7fa08fde8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0880c3f20 con 0x7fa088157520 2024-09-11T22:25:02.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.550+0000 7fa08fde8640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fa0880c89f0 con 0x7fa0880c8e80 2024-09-11T22:25:02.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.550+0000 7fa08fde8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa08806c490 con 0x7fa088151740 2024-09-11T22:25:02.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.550+0000 7fa08d383640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa0880c8e80 0x7fa08806c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.550+0000 7fa08d383640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa0880c8e80 0x7fa08806c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33926/0 (socket says 172.21.15.100:33926) 2024-09-11T22:25:02.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.550+0000 7fa08d383640 1 -- 172.21.15.100:0/3531498214 learned_addr learned my addr 172.21.15.100:0/3531498214 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:02.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.550+0000 7fa08db84640 1 --2- 172.21.15.100:0/3531498214 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa088151740 0x7fa088073d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.550+0000 7fa08d383640 1 -- 172.21.15.100:0/3531498214 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa088151740 msgr2=0x7fa088073d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:25:02.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.550+0000 7fa08d383640 1 --2- 172.21.15.100:0/3531498214 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa088151740 0x7fa088073d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.550+0000 7fa08d383640 1 -- 172.21.15.100:0/3531498214 >> v1:172.21.15.167:6789/0 conn(0x7fa088157520 legacy=0x7fa08806e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.550+0000 7fa08d383640 1 -- 172.21.15.100:0/3531498214 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0880c83e0 con 0x7fa0880c8e80 2024-09-11T22:25:02.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.551+0000 7fa08d383640 1 --2- 172.21.15.100:0/3531498214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0880c8e80 0x7fa08806c890 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa078009870 tx=0x7fa07802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5eb526b4141486 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:02.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.551+0000 7fa08cb82640 1 -- 172.21.15.100:0/3531498214 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa078037070 con 0x7fa0880c8e80 2024-09-11T22:25:02.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.551+0000 7fa08cb82640 1 -- 172.21.15.100:0/3531498214 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa078032440 con 0x7fa0880c8e80 2024-09-11T22:25:02.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.551+0000 7fa08cb82640 1 -- 172.21.15.100:0/3531498214 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa078032810 con 0x7fa0880c8e80 2024-09-11T22:25:02.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.551+0000 7fa08fde8640 1 -- 172.21.15.100:0/3531498214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0880c8e80 msgr2=0x7fa08806c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.551+0000 7fa08fde8640 1 --2- 172.21.15.100:0/3531498214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0880c8e80 0x7fa08806c890 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa078009870 tx=0x7fa07802a270 comp rx=0 tx=0).stop 2024-09-11T22:25:02.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.552+0000 7fa08fde8640 1 -- 172.21.15.100:0/3531498214 shutdown_connections 2024-09-11T22:25:02.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.552+0000 7fa08fde8640 1 --2- 172.21.15.100:0/3531498214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0880c8e80 0x7fa08806c890 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.552+0000 7fa08fde8640 1 --2- 172.21.15.100:0/3531498214 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa088151740 0x7fa088073d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.552+0000 7fa08fde8640 1 -- 172.21.15.100:0/3531498214 >> 172.21.15.100:0/3531498214 conn(0x7fa088070190 msgr2=0x7fa0880705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:02.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.552+0000 7fa08fde8640 1 -- 172.21.15.100:0/3531498214 shutdown_connections 2024-09-11T22:25:02.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.552+0000 7fa08fde8640 1 -- 172.21.15.100:0/3531498214 wait complete. 2024-09-11T22:25:02.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.553+0000 7fa08fde8640 1 Processor -- start 2024-09-11T22:25:02.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.553+0000 7fa08fde8640 1 -- start start 2024-09-11T22:25:02.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.554+0000 7fa08fde8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0880c8e80 0x7fa088144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.554+0000 7fa08fde8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa088151740 0x7fa08814ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.554+0000 7fa08fde8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa088157520 0x7fa08814f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.554+0000 7fa08fde8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa08806c1b0 con 0x7fa088157520 2024-09-11T22:25:02.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.554+0000 7fa08fde8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa08806bed0 con 0x7fa0880c8e80 2024-09-11T22:25:02.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.554+0000 7fa08fde8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa0880c8680 con 0x7fa088151740 2024-09-11T22:25:02.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.554+0000 7fa08e385640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa088157520 0x7fa08814f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.554+0000 7fa08e385640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa088157520 0x7fa08814f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33936/0 (socket says 172.21.15.100:33936) 2024-09-11T22:25:02.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.554+0000 7fa08e385640 1 -- 172.21.15.100:0/520077361 learned_addr learned my addr 172.21.15.100:0/520077361 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:02.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.554+0000 7fa08d383640 1 --2- 172.21.15.100:0/520077361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa088151740 0x7fa08814ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.554+0000 7fa08db84640 1 --2- 172.21.15.100:0/520077361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0880c8e80 0x7fa088144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.554+0000 7fa08e385640 1 -- 172.21.15.100:0/520077361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa088151740 msgr2=0x7fa08814ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.554+0000 7fa08e385640 1 --2- 172.21.15.100:0/520077361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa088151740 0x7fa08814ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.554+0000 7fa08e385640 1 -- 172.21.15.100:0/520077361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0880c8e80 msgr2=0x7fa088144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.554+0000 7fa08e385640 1 --2- 172.21.15.100:0/520077361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0880c8e80 0x7fa088144940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.554+0000 7fa08e385640 1 -- 172.21.15.100:0/520077361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0881589c0 con 0x7fa088157520 2024-09-11T22:25:02.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.554+0000 7fa08e385640 1 --2- 172.21.15.100:0/520077361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa088157520 0x7fa08814f4a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa08000c6b0 tx=0x7fa08000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:02.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.554+0000 7fa07e7fc640 1 -- 172.21.15.100:0/520077361 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa080003b70 con 0x7fa088157520 2024-09-11T22:25:02.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.554+0000 7fa07e7fc640 1 -- 172.21.15.100:0/520077361 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa080003d30 con 0x7fa088157520 2024-09-11T22:25:02.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.554+0000 7fa08fde8640 1 -- 172.21.15.100:0/520077361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa088158ca0 con 0x7fa088157520 2024-09-11T22:25:02.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.554+0000 7fa07e7fc640 1 -- 172.21.15.100:0/520077361 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa080005310 con 0x7fa088157520 2024-09-11T22:25:02.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.554+0000 7fa08fde8640 1 -- 172.21.15.100:0/520077361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa088159260 con 0x7fa088157520 2024-09-11T22:25:02.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.555+0000 7fa08fde8640 1 --2- 172.21.15.100:0/520077361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0881594a0 0x7fa08814fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.555+0000 7fa08fde8640 1 -- 172.21.15.100:0/520077361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa08814e450 con 0x7fa0881594a0 2024-09-11T22:25:02.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.555+0000 7fa08db84640 1 --2- 172.21.15.100:0/520077361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0881594a0 0x7fa08814fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.556+0000 7fa08db84640 1 -- 172.21.15.100:0/520077361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa088069100 con 0x7fa0881594a0 2024-09-11T22:25:02.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.556+0000 7fa08db84640 1 --2- 172.21.15.100:0/520077361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0881594a0 0x7fa08814fc90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa0840118e0 tx=0x7fa084011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:02.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.556+0000 7fa07e7fc640 1 -- 172.21.15.100:0/520077361 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa084019070 con 0x7fa0881594a0 2024-09-11T22:25:02.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.556+0000 7fa07e7fc640 1 -- 172.21.15.100:0/520077361 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa0800054b0 con 0x7fa088157520 2024-09-11T22:25:02.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.557+0000 7fa07e7fc640 1 --2- 172.21.15.100:0/520077361 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa06c06bd30 0x7fa06c06e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.557+0000 7fa07e7fc640 1 -- 172.21.15.100:0/520077361 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fa08008b0b0 con 0x7fa088157520 2024-09-11T22:25:02.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.557+0000 7fa08d383640 1 --2- 172.21.15.100:0/520077361 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa06c06bd30 0x7fa06c06e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.557+0000 7fa07e7fc640 1 -- 172.21.15.100:0/520077361 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa084004300 con 0x7fa0881594a0 2024-09-11T22:25:02.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.557+0000 7fa07e7fc640 1 -- 172.21.15.100:0/520077361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0881594a0 msgr2=0x7fa08814fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.557+0000 7fa07e7fc640 1 --2- 172.21.15.100:0/520077361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0881594a0 0x7fa08814fc90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa0840118e0 tx=0x7fa084011da0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.557+0000 7fa07e7fc640 1 -- 172.21.15.100:0/520077361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0881594a0 msgr2=0x7fa08814fc90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:25:02.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.557+0000 7fa07e7fc640 1 --2- 172.21.15.100:0/520077361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0881594a0 0x7fa08814fc90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.557+0000 7fa08d383640 1 --2- 172.21.15.100:0/520077361 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa06c06bd30 0x7fa06c06e1f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa078034000 tx=0x7fa07802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:02.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.564+0000 7fa08fde8640 1 --2- 172.21.15.100:0/520077361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa088150c10 0x7fa0881501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.564+0000 7fa08fde8640 1 -- 172.21.15.100:0/520077361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa088142e00 con 0x7fa088150c10 2024-09-11T22:25:02.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.564+0000 7fa08db84640 1 --2- 172.21.15.100:0/520077361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa088150c10 0x7fa0881501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.564+0000 7fa08db84640 1 -- 172.21.15.100:0/520077361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa088145510 con 0x7fa088150c10 2024-09-11T22:25:02.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.564+0000 7fa08db84640 1 --2- 172.21.15.100:0/520077361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa088150c10 0x7fa0881501d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa08401b000 tx=0x7fa0840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:02.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.564+0000 7fa07e7fc640 1 -- 172.21.15.100:0/520077361 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08400fe40 con 0x7fa088150c10 2024-09-11T22:25:02.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.565+0000 7fa07e7fc640 1 -- 172.21.15.100:0/520077361 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4555 (secure 0 0 0) 0x7fa08400fe40 con 0x7fa088150c10 2024-09-11T22:25:02.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.565+0000 7fa07e7fc640 1 -- 172.21.15.100:0/520077361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa088150c10 msgr2=0x7fa0881501d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.565+0000 7fa07e7fc640 1 --2- 172.21.15.100:0/520077361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa088150c10 0x7fa0881501d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa08401b000 tx=0x7fa0840046c0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.565+0000 7fa07e7fc640 1 -- 172.21.15.100:0/520077361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa088150c10 msgr2=0x7fa0881501d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:25:02.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.565+0000 7fa07e7fc640 1 --2- 172.21.15.100:0/520077361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa088150c10 0x7fa0881501d0 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa08401b000 tx=0x7fa0840046c0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.567 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:25:02.567 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:25:02.567 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:25:02.567 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:25:02.567 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 34, 2024-09-11T22:25:02.567 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 27088, 2024-09-11T22:25:02.567 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:25:02.567 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:25:02.567 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:25:02.567 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:25:02.568 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:02.568 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 11, 2024-09-11T22:25:02.568 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:25:02.568 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:25:02.568 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:25:02.568 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:02.568 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:02.568 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:02.568 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:02.568 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:02.568 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:02.568 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:02.569 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:02.569 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:02.569 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:02.569 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:02.569 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:02.569 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:25:02.569 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:25:02.569 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:02.569 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:02.569 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:02.570 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:02.570 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:02.570 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:02.570 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:02.570 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:02.570 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:02.570 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:02.570 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:02.570 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:02.570 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.571 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:25:02.571 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:25:02.571 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:25:02.571 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:25:02.571 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:25:02.571 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:25:02.571 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:25:02.571 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:25:02.571 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:25:02.571 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:25:02.572 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:25:02.572 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:25:02.572 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:25:02.572 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:25:02.572 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:25:02.572 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:25:02.572 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:25:02.572 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:02.572 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:02.572 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:02.572 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:02.573 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:02.573 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:02.573 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:02.573 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:02.573 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:02.573 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:02.573 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:02.573 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:02.573 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:25:02.574 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.574 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:25:02.574 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.574 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:25:02.574 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:25:02.574 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:02.574 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:02.574 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.574 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:02.574 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:25:02.574 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:02.574 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.574 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.574 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:02.574 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:25:02.575 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:02.575 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:02.575 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:02.575 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.575 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:25:02.575 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:25:02.575 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:02.575 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:02.575 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:02.575 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.575 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.575 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:25:02.576 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:25:02.576 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:02.576 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:02.576 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.576 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:02.576 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:25:02.576 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:02.576 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.576 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.576 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:02.576 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:25:02.576 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:02.576 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:02.576 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:25:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:25:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:25:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:25:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.578 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:02.578 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:25:02.578 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:02.578 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.578 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.578 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:02.578 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:25:02.578 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:02.578 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:02.578 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:02.578 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.578 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:25:02.578 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:25:02.578 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:02.579 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:02.579 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:02.579 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:02.579 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:02.579 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.579 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:25:02.579 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:25:02.579 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.579 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:02.579 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:02.579 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:25:02.579 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:02.579 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:02.579 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:25:02.580 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.580 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:02.580 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:02.580 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:25:02.580 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:02.580 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:02.580 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.580 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:25:02.580 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:25:02.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.565+0000 7fa08fde8640 1 -- 172.21.15.100:0/520077361 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa06c06bd30 msgr2=0x7fa06c06e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.565+0000 7fa08fde8640 1 --2- 172.21.15.100:0/520077361 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa06c06bd30 0x7fa06c06e1f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa078034000 tx=0x7fa07802e000 comp rx=0 tx=0).stop 2024-09-11T22:25:02.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.565+0000 7fa08fde8640 1 -- 172.21.15.100:0/520077361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa088157520 msgr2=0x7fa08814f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.565+0000 7fa08fde8640 1 --2- 172.21.15.100:0/520077361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa088157520 0x7fa08814f4a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa08000c6b0 tx=0x7fa08000cb70 comp rx=0 tx=0).stop 2024-09-11T22:25:02.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.565+0000 7fa08e385640 1 -- 172.21.15.100:0/520077361 reap_dead start 2024-09-11T22:25:02.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.565+0000 7fa08e385640 1 -- 172.21.15.100:0/520077361 reap_dead start 2024-09-11T22:25:02.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.565+0000 7fa08fde8640 1 -- 172.21.15.100:0/520077361 shutdown_connections 2024-09-11T22:25:02.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.565+0000 7fa08fde8640 1 -- 172.21.15.100:0/520077361 >> 172.21.15.100:0/520077361 conn(0x7fa088070190 msgr2=0x7fa08806cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:02.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.565+0000 7fa08fde8640 1 -- 172.21.15.100:0/520077361 shutdown_connections 2024-09-11T22:25:02.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.565+0000 7fa08fde8640 1 -- 172.21.15.100:0/520077361 wait complete. 2024-09-11T22:25:02.582 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:25:02.583 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:25:02.583 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:25:02.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.692+0000 7f75f3331640 1 Processor -- start 2024-09-11T22:25:02.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.692+0000 7f75f3331640 1 -- start start 2024-09-11T22:25:02.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.693+0000 7f75f3331640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75ec154cd0 0x7f75ec15bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.693+0000 7f75f3331640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f75ec15e7c0 0x7f75ec0cc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.693+0000 7f75f3331640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75ec0738d0 con 0x7f75ec0c71e0 2024-09-11T22:25:02.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.693+0000 7f75f3331640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f75ec15ecb0 con 0x7f75ec15e7c0 2024-09-11T22:25:02.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.693+0000 7f75f3331640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f75ec072830 con 0x7f75ec154cd0 2024-09-11T22:25:02.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.693+0000 7f75f18ce640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f75ec0c71e0 0x7f75ec15a7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44064/0 (socket says 172.21.15.100:44064) 2024-09-11T22:25:02.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.693+0000 7f75f18ce640 1 -- 172.21.15.100:0/3407771707 learned_addr learned my addr 172.21.15.100:0/3407771707 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:25:02.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.694+0000 7f75f10cd640 1 --2- 172.21.15.100:0/3407771707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75ec154cd0 0x7f75ec15bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.694+0000 7f75f08cc640 1 --2- 172.21.15.100:0/3407771707 >> v2:172.21.15.167:3300/0 conn(0x7f75ec15e7c0 0x7f75ec0cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.694+0000 7f75e3fff640 1 -- 172.21.15.100:0/3407771707 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 654175733 0 0) 0x7f75ec0738d0 con 0x7f75ec0c71e0 2024-09-11T22:25:02.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.694+0000 7f75e3fff640 1 -- 172.21.15.100:0/3407771707 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75d8003520 con 0x7f75ec0c71e0 2024-09-11T22:25:02.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.694+0000 7f75f10cd640 1 -- 172.21.15.100:0/3407771707 >> v2:172.21.15.167:3300/0 conn(0x7f75ec15e7c0 msgr2=0x7f75ec0cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:25:02.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.694+0000 7f75f10cd640 1 --2- 172.21.15.100:0/3407771707 >> v2:172.21.15.167:3300/0 conn(0x7f75ec15e7c0 0x7f75ec0cc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.694+0000 7f75e3fff640 1 -- 172.21.15.100:0/3407771707 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2480825714 0 0) 0x7f75d8003520 con 0x7f75ec0c71e0 2024-09-11T22:25:02.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.694+0000 7f75f10cd640 1 -- 172.21.15.100:0/3407771707 >> v1:172.21.15.100:6789/0 conn(0x7f75ec0c71e0 legacy=0x7f75ec15a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.694+0000 7f75f10cd640 1 -- 172.21.15.100:0/3407771707 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec072b10 con 0x7f75ec154cd0 2024-09-11T22:25:02.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.694+0000 7f75f08cc640 1 --2- 172.21.15.100:0/3407771707 >> v2:172.21.15.167:3300/0 conn(0x7f75ec15e7c0 0x7f75ec0cc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:25:02.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.695+0000 7f75f10cd640 1 --2- 172.21.15.100:0/3407771707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75ec154cd0 0x7f75ec15bcb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f75e80097a0 tx=0x7f75e802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c7bfe5a4f008697 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:02.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.695+0000 7f75e3fff640 1 -- 172.21.15.100:0/3407771707 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e8037070 con 0x7f75ec154cd0 2024-09-11T22:25:02.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.695+0000 7f75e3fff640 1 -- 172.21.15.100:0/3407771707 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e802aba0 con 0x7f75ec154cd0 2024-09-11T22:25:02.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.695+0000 7f75e3fff640 1 -- 172.21.15.100:0/3407771707 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e40019f0 con 0x7f75ec154cd0 2024-09-11T22:25:02.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.696+0000 7f75f3331640 1 -- 172.21.15.100:0/3407771707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75ec154cd0 msgr2=0x7f75ec15bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.696+0000 7f75f3331640 1 --2- 172.21.15.100:0/3407771707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75ec154cd0 0x7f75ec15bcb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f75e80097a0 tx=0x7f75e802a110 comp rx=0 tx=0).stop 2024-09-11T22:25:02.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.696+0000 7f75f3331640 1 -- 172.21.15.100:0/3407771707 shutdown_connections 2024-09-11T22:25:02.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.696+0000 7f75f3331640 1 --2- 172.21.15.100:0/3407771707 >> v2:172.21.15.167:3300/0 conn(0x7f75ec15e7c0 0x7f75ec0cc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.696+0000 7f75f3331640 1 --2- 172.21.15.100:0/3407771707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75ec154cd0 0x7f75ec15bcb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.696+0000 7f75f3331640 1 -- 172.21.15.100:0/3407771707 >> 172.21.15.100:0/3407771707 conn(0x7f75ec06fa70 msgr2=0x7f75ec06fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:02.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.696+0000 7f75f3331640 1 -- 172.21.15.100:0/3407771707 shutdown_connections 2024-09-11T22:25:02.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.696+0000 7f75f3331640 1 -- 172.21.15.100:0/3407771707 wait complete. 2024-09-11T22:25:02.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.697+0000 7f75f3331640 1 Processor -- start 2024-09-11T22:25:02.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.697+0000 7f75f3331640 1 -- start start 2024-09-11T22:25:02.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.697+0000 7f75f3331640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75ec0c71e0 0x7f75ec157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.698+0000 7f75f3331640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75ec154cd0 0x7f75ec0ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.698+0000 7f75f3331640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75ec15e7c0 0x7f75ec1f0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.698+0000 7f75f3331640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec075770 con 0x7f75ec154cd0 2024-09-11T22:25:02.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.698+0000 7f75f3331640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec0730d0 con 0x7f75ec15e7c0 2024-09-11T22:25:02.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.698+0000 7f75f3331640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f75ec0c7800 con 0x7f75ec0c71e0 2024-09-11T22:25:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.698+0000 7f75f08cc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75ec154cd0 0x7f75ec0ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.698+0000 7f75f08cc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75ec154cd0 0x7f75ec0ca800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33968/0 (socket says 172.21.15.100:33968) 2024-09-11T22:25:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.698+0000 7f75f08cc640 1 -- 172.21.15.100:0/2841539248 learned_addr learned my addr 172.21.15.100:0/2841539248 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.698+0000 7f75f10cd640 1 --2- 172.21.15.100:0/2841539248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75ec0c71e0 0x7f75ec157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.698+0000 7f75f18ce640 1 --2- 172.21.15.100:0/2841539248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75ec15e7c0 0x7f75ec1f0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.698+0000 7f75f08cc640 1 -- 172.21.15.100:0/2841539248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75ec0c71e0 msgr2=0x7f75ec157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.698+0000 7f75f08cc640 1 --2- 172.21.15.100:0/2841539248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75ec0c71e0 0x7f75ec157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.698+0000 7f75f08cc640 1 -- 172.21.15.100:0/2841539248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75ec15e7c0 msgr2=0x7f75ec1f0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.698+0000 7f75f08cc640 1 --2- 172.21.15.100:0/2841539248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75ec15e7c0 0x7f75ec1f0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.698+0000 7f75f08cc640 1 -- 172.21.15.100:0/2841539248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec157e90 con 0x7f75ec154cd0 2024-09-11T22:25:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.698+0000 7f75f10cd640 1 --2- 172.21.15.100:0/2841539248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75ec0c71e0 0x7f75ec157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:25:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.698+0000 7f75f08cc640 1 --2- 172.21.15.100:0/2841539248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75ec154cd0 0x7f75ec0ca800 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f75dc00e910 tx=0x7f75dc00edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:02.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.698+0000 7f75e1ffb640 1 -- 172.21.15.100:0/2841539248 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75dc017070 con 0x7f75ec154cd0 2024-09-11T22:25:02.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.698+0000 7f75e1ffb640 1 -- 172.21.15.100:0/2841539248 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75dc00ca00 con 0x7f75ec154cd0 2024-09-11T22:25:02.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.698+0000 7f75f3331640 1 -- 172.21.15.100:0/2841539248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ec1f3af0 con 0x7f75ec154cd0 2024-09-11T22:25:02.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.698+0000 7f75e1ffb640 1 -- 172.21.15.100:0/2841539248 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75dc00cdb0 con 0x7f75ec154cd0 2024-09-11T22:25:02.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.699+0000 7f75f3331640 1 -- 172.21.15.100:0/2841539248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ec1f40b0 con 0x7f75ec154cd0 2024-09-11T22:25:02.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.700+0000 7f75f3331640 1 --2- 172.21.15.100:0/2841539248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75ec1f4280 0x7f75ec1f0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.700+0000 7f75f3331640 1 -- 172.21.15.100:0/2841539248 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec1f48b0 con 0x7f75ec1f4280 2024-09-11T22:25:02.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.700+0000 7f75f10cd640 1 --2- 172.21.15.100:0/2841539248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75ec1f4280 0x7f75ec1f0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.700+0000 7f75e1ffb640 1 -- 172.21.15.100:0/2841539248 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f75dc01a070 con 0x7f75ec154cd0 2024-09-11T22:25:02.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.700+0000 7f75f10cd640 1 -- 172.21.15.100:0/2841539248 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f75ec0cd610 con 0x7f75ec1f4280 2024-09-11T22:25:02.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.700+0000 7f75f10cd640 1 --2- 172.21.15.100:0/2841539248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75ec1f4280 0x7f75ec1f0940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0c6b50 tx=0x7f75e80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:02.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.700+0000 7f75e1ffb640 1 --2- 172.21.15.100:0/2841539248 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f75d006be30 0x7f75d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.701+0000 7f75e1ffb640 1 -- 172.21.15.100:0/2841539248 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f75dc08b500 con 0x7f75ec154cd0 2024-09-11T22:25:02.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.701+0000 7f75f18ce640 1 --2- 172.21.15.100:0/2841539248 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f75d006be30 0x7f75d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.701+0000 7f75e1ffb640 1 -- 172.21.15.100:0/2841539248 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e8041070 con 0x7f75ec1f4280 2024-09-11T22:25:02.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.701+0000 7f75e1ffb640 1 -- 172.21.15.100:0/2841539248 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f75e8003810 con 0x7f75ec1f4280 2024-09-11T22:25:02.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.701+0000 7f75e1ffb640 1 -- 172.21.15.100:0/2841539248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75ec1f4280 msgr2=0x7f75ec1f0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.701+0000 7f75e1ffb640 1 --2- 172.21.15.100:0/2841539248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75ec1f4280 0x7f75ec1f0940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0c6b50 tx=0x7f75e80046c0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.701+0000 7f75e1ffb640 1 -- 172.21.15.100:0/2841539248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75ec1f4280 msgr2=0x7f75ec1f0940 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:25:02.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.701+0000 7f75e1ffb640 1 --2- 172.21.15.100:0/2841539248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75ec1f4280 0x7f75ec1f0940 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0c6b50 tx=0x7f75e80046c0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.701+0000 7f75f18ce640 1 --2- 172.21.15.100:0/2841539248 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f75d006be30 0x7f75d006e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f75e4005c00 tx=0x7f75e4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:02.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.710+0000 7f75f3331640 1 --2- 172.21.15.100:0/2841539248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75ec15b710 0x7f75ec14dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.710+0000 7f75f3331640 1 -- 172.21.15.100:0/2841539248 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec15bcb0 con 0x7f75ec15b710 2024-09-11T22:25:02.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.711+0000 7f75f10cd640 1 --2- 172.21.15.100:0/2841539248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75ec15b710 0x7f75ec14dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.711+0000 7f75f10cd640 1 -- 172.21.15.100:0/2841539248 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f75ec0722d0 con 0x7f75ec15b710 2024-09-11T22:25:02.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.711+0000 7f75f10cd640 1 --2- 172.21.15.100:0/2841539248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75ec15b710 0x7f75ec14dfd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f75e80097a0 tx=0x7f75e8008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:02.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.711+0000 7f75e1ffb640 1 -- 172.21.15.100:0/2841539248 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e8037040 con 0x7f75ec15b710 2024-09-11T22:25:02.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.712+0000 7f75e1ffb640 1 -- 172.21.15.100:0/2841539248 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4887 (secure 0 0 0) 0x7f75e8032440 con 0x7f75ec15b710 2024-09-11T22:25:02.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.712+0000 7f75e1ffb640 1 -- 172.21.15.100:0/2841539248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75ec15b710 msgr2=0x7f75ec14dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.712+0000 7f75e1ffb640 1 --2- 172.21.15.100:0/2841539248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75ec15b710 0x7f75ec14dfd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f75e80097a0 tx=0x7f75e8008030 comp rx=0 tx=0).stop 2024-09-11T22:25:02.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.712+0000 7f75e1ffb640 1 -- 172.21.15.100:0/2841539248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75ec15b710 msgr2=0x7f75ec14dfd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:25:02.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.712+0000 7f75e1ffb640 1 --2- 172.21.15.100:0/2841539248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75ec15b710 0x7f75ec14dfd0 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f75e80097a0 tx=0x7f75e8008030 comp rx=0 tx=0).stop 2024-09-11T22:25:02.714 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:25:02.714 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:25:02.714 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:25:02.714 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:25:02.714 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 34, 2024-09-11T22:25:02.714 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 87990, 2024-09-11T22:25:02.714 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:25:02.714 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:25:02.714 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:25:02.714 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:25:02.714 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:02.715 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 11, 2024-09-11T22:25:02.715 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:25:02.715 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:25:02.715 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:25:02.715 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:02.715 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:02.715 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:02.715 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:02.715 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:02.715 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:02.716 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:02.716 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:02.716 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:02.716 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:02.716 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:02.716 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:02.716 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:25:02.716 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:25:02.716 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:02.716 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:02.717 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:02.717 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:02.717 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:02.717 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:02.717 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:02.717 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:02.717 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:02.717 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:02.717 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:02.717 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:02.718 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.718 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:25:02.718 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:25:02.718 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:25:02.718 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:25:02.718 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:25:02.718 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:25:02.718 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:25:02.718 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:25:02.718 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:25:02.719 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:25:02.719 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:25:02.719 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:25:02.719 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:25:02.719 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:25:02.719 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:25:02.719 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:25:02.719 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:25:02.719 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:02.719 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:02.720 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:02.720 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:02.720 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:02.720 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:02.720 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:02.720 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:02.720 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:02.720 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:02.720 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:02.721 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:02.721 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:25:02.721 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.721 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:25:02.721 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.721 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:25:02.721 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:25:02.721 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:02.721 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:02.721 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.721 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:02.721 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:25:02.721 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:02.722 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.722 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.722 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:02.722 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:25:02.722 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:02.722 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:02.722 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:02.722 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.722 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:25:02.722 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:25:02.722 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:02.722 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:02.722 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:02.723 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.723 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.723 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:25:02.723 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:25:02.723 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:02.723 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:02.723 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.723 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:02.723 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:25:02.723 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:02.724 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.724 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.724 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:02.724 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:25:02.724 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:02.724 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:02.724 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:02.724 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.724 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:25:02.724 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:25:02.724 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:02.724 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:02.725 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:02.725 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.725 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.725 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:25:02.725 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:25:02.725 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:02.725 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:02.725 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.725 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:02.725 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:25:02.725 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:02.725 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.725 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.726 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:02.726 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:25:02.726 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:02.726 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:02.726 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:02.726 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.726 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:25:02.726 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:25:02.726 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:02.726 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:02.726 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:02.726 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:02.726 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:02.727 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.727 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:25:02.727 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:25:02.727 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.727 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:02.727 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:02.727 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:25:02.727 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:02.727 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:02.727 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:25:02.727 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.727 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:02.727 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:02.728 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:25:02.728 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:02.728 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:02.728 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:25:02.728 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.728 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:02.728 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:02.728 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:25:02.728 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:02.728 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:02.728 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:25:02.728 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.728 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:02.729 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:02.729 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:25:02.729 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:02.729 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:02.729 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.729 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:25:02.729 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:25:02.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.712+0000 7f75f3331640 1 -- 172.21.15.100:0/2841539248 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f75d006be30 msgr2=0x7f75d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.712+0000 7f75f3331640 1 --2- 172.21.15.100:0/2841539248 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f75d006be30 0x7f75d006e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f75e4005c00 tx=0x7f75e4009040 comp rx=0 tx=0).stop 2024-09-11T22:25:02.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.712+0000 7f75f3331640 1 -- 172.21.15.100:0/2841539248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75ec154cd0 msgr2=0x7f75ec0ca800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.712+0000 7f75f3331640 1 --2- 172.21.15.100:0/2841539248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75ec154cd0 0x7f75ec0ca800 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f75dc00e910 tx=0x7f75dc00edd0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.712+0000 7f75f18ce640 1 -- 172.21.15.100:0/2841539248 reap_dead start 2024-09-11T22:25:02.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.712+0000 7f75f18ce640 1 -- 172.21.15.100:0/2841539248 reap_dead start 2024-09-11T22:25:02.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.712+0000 7f75f3331640 1 -- 172.21.15.100:0/2841539248 shutdown_connections 2024-09-11T22:25:02.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.712+0000 7f75f3331640 1 -- 172.21.15.100:0/2841539248 >> 172.21.15.100:0/2841539248 conn(0x7f75ec06fa70 msgr2=0x7f75ec15d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:02.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.712+0000 7f75f3331640 1 -- 172.21.15.100:0/2841539248 shutdown_connections 2024-09-11T22:25:02.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.712+0000 7f75f3331640 1 -- 172.21.15.100:0/2841539248 wait complete. 2024-09-11T22:25:02.731 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:25:02.731 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:25:02.732 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:25:02.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.842+0000 7f39cd152640 1 Processor -- start 2024-09-11T22:25:02.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.842+0000 7f39cd152640 1 -- start start 2024-09-11T22:25:02.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.843+0000 7f39cd152640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f39c806ce60 0x7f39c815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.843+0000 7f39cd152640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f39c815c290 0x7f39c81546b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.843+0000 7f39cd152640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c806d240 0x7f39c8154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.843+0000 7f39cd152640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f39c815b820 con 0x7f39c806ce60 2024-09-11T22:25:02.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.843+0000 7f39cd152640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f39c80c6510 con 0x7f39c815c290 2024-09-11T22:25:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.843+0000 7f39cd152640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f39c80c5470 con 0x7f39c806d240 2024-09-11T22:25:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.843+0000 7f39c6d9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f39c806ce60 0x7f39c815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.843+0000 7f39c6d9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f39c806ce60 0x7f39c815bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33982/0 (socket says 172.21.15.100:33982) 2024-09-11T22:25:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.843+0000 7f39c6d9d640 1 -- 172.21.15.100:0/1611597140 learned_addr learned my addr 172.21.15.100:0/1611597140 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.844+0000 7f39c659c640 1 --2- 172.21.15.100:0/1611597140 >> v2:172.21.15.167:3300/0 conn(0x7f39c815c290 0x7f39c81546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.844+0000 7f39c759e640 1 --2- 172.21.15.100:0/1611597140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c806d240 0x7f39c8154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.844+0000 7f39c6d9d640 1 -- 172.21.15.100:0/1611597140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c806d240 msgr2=0x7f39c8154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:25:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.844+0000 7f39c6d9d640 1 --2- 172.21.15.100:0/1611597140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c806d240 0x7f39c8154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.844+0000 7f39c6d9d640 1 -- 172.21.15.100:0/1611597140 >> v2:172.21.15.167:3300/0 conn(0x7f39c815c290 msgr2=0x7f39c81546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:25:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.844+0000 7f39c6d9d640 1 --2- 172.21.15.100:0/1611597140 >> v2:172.21.15.167:3300/0 conn(0x7f39c815c290 0x7f39c81546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.844+0000 7f39c6d9d640 1 -- 172.21.15.100:0/1611597140 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c80c5750 con 0x7f39c806ce60 2024-09-11T22:25:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.844+0000 7f39c659c640 1 --2- 172.21.15.100:0/1611597140 >> v2:172.21.15.167:3300/0 conn(0x7f39c815c290 0x7f39c81546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:25:02.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.844+0000 7f39c759e640 1 --2- 172.21.15.100:0/1611597140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c806d240 0x7f39c8154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:25:02.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.844+0000 7f39c6d9d640 1 --2- 172.21.15.100:0/1611597140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c806ce60 0x7f39c815bd50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f39c80ca9e0 tx=0x7f39b802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3439560cef9c3fa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:02.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.844+0000 7f39c5d9b640 1 -- 172.21.15.100:0/1611597140 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8037070 con 0x7f39c806ce60 2024-09-11T22:25:02.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.845+0000 7f39c5d9b640 1 -- 172.21.15.100:0/1611597140 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b8032440 con 0x7f39c806ce60 2024-09-11T22:25:02.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.845+0000 7f39c5d9b640 1 -- 172.21.15.100:0/1611597140 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8032810 con 0x7f39c806ce60 2024-09-11T22:25:02.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.845+0000 7f39cd152640 1 -- 172.21.15.100:0/1611597140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c806ce60 msgr2=0x7f39c815bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.845+0000 7f39cd152640 1 --2- 172.21.15.100:0/1611597140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c806ce60 0x7f39c815bd50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f39c80ca9e0 tx=0x7f39b802a1e0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.845+0000 7f39cd152640 1 -- 172.21.15.100:0/1611597140 shutdown_connections 2024-09-11T22:25:02.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.845+0000 7f39cd152640 1 --2- 172.21.15.100:0/1611597140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c806d240 0x7f39c8154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.845+0000 7f39cd152640 1 --2- 172.21.15.100:0/1611597140 >> v2:172.21.15.167:3300/0 conn(0x7f39c815c290 0x7f39c81546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.845+0000 7f39cd152640 1 --2- 172.21.15.100:0/1611597140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c806ce60 0x7f39c815bd50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.845+0000 7f39cd152640 1 -- 172.21.15.100:0/1611597140 >> 172.21.15.100:0/1611597140 conn(0x7f39c806bc10 msgr2=0x7f39c806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:02.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.845+0000 7f39cd152640 1 -- 172.21.15.100:0/1611597140 shutdown_connections 2024-09-11T22:25:02.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.845+0000 7f39cd152640 1 -- 172.21.15.100:0/1611597140 wait complete. 2024-09-11T22:25:02.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.847+0000 7f39cd152640 1 Processor -- start 2024-09-11T22:25:02.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.847+0000 7f39cd152640 1 -- start start 2024-09-11T22:25:02.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.847+0000 7f39cd152640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c806ce60 0x7f39c80cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.847+0000 7f39cd152640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c806d240 0x7f39c80cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.847+0000 7f39cd152640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39c815c290 0x7f39c8150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.847+0000 7f39cd152640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f39c80cb1b0 con 0x7f39c806d240 2024-09-11T22:25:02.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.847+0000 7f39cd152640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f39c80c5d10 con 0x7f39c815c290 2024-09-11T22:25:02.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.847+0000 7f39cd152640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f39c80cad20 con 0x7f39c806ce60 2024-09-11T22:25:02.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.848+0000 7f39c659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c806d240 0x7f39c80cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.848+0000 7f39c659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c806d240 0x7f39c80cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33990/0 (socket says 172.21.15.100:33990) 2024-09-11T22:25:02.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.848+0000 7f39c659c640 1 -- 172.21.15.100:0/1374002053 learned_addr learned my addr 172.21.15.100:0/1374002053 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:02.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.848+0000 7f39c759e640 1 --2- 172.21.15.100:0/1374002053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39c815c290 0x7f39c8150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.848+0000 7f39c6d9d640 1 --2- 172.21.15.100:0/1374002053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c806ce60 0x7f39c80cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.848+0000 7f39c659c640 1 -- 172.21.15.100:0/1374002053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c806ce60 msgr2=0x7f39c80cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.848+0000 7f39c659c640 1 --2- 172.21.15.100:0/1374002053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c806ce60 0x7f39c80cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.848+0000 7f39c659c640 1 -- 172.21.15.100:0/1374002053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39c815c290 msgr2=0x7f39c8150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.848+0000 7f39c659c640 1 --2- 172.21.15.100:0/1374002053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39c815c290 0x7f39c8150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.848+0000 7f39c659c640 1 -- 172.21.15.100:0/1374002053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c80d0010 con 0x7f39c806d240 2024-09-11T22:25:02.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.848+0000 7f39c659c640 1 --2- 172.21.15.100:0/1374002053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c806d240 0x7f39c80cf6c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f39bc00c820 tx=0x7f39bc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:02.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.848+0000 7f39af7fe640 1 -- 172.21.15.100:0/1374002053 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc015070 con 0x7f39c806d240 2024-09-11T22:25:02.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.848+0000 7f39af7fe640 1 -- 172.21.15.100:0/1374002053 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39bc007a30 con 0x7f39c806d240 2024-09-11T22:25:02.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.848+0000 7f39cd152640 1 -- 172.21.15.100:0/1374002053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c80d02f0 con 0x7f39c806d240 2024-09-11T22:25:02.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.848+0000 7f39af7fe640 1 -- 172.21.15.100:0/1374002053 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc007de0 con 0x7f39c806d240 2024-09-11T22:25:02.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.848+0000 7f39cd152640 1 -- 172.21.15.100:0/1374002053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c80cef30 con 0x7f39c806d240 2024-09-11T22:25:02.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.849+0000 7f39cd152640 1 --2- 172.21.15.100:0/1374002053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c814fc70 0x7f39c8150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.849+0000 7f39cd152640 1 -- 172.21.15.100:0/1374002053 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f39c815b2e0 con 0x7f39c814fc70 2024-09-11T22:25:02.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.849+0000 7f39c6d9d640 1 --2- 172.21.15.100:0/1374002053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c814fc70 0x7f39c8150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.850+0000 7f39af7fe640 1 -- 172.21.15.100:0/1374002053 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39bc018070 con 0x7f39c806d240 2024-09-11T22:25:02.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.850+0000 7f39c6d9d640 1 -- 172.21.15.100:0/1374002053 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f39c80b5000 con 0x7f39c814fc70 2024-09-11T22:25:02.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.850+0000 7f39c6d9d640 1 --2- 172.21.15.100:0/1374002053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c814fc70 0x7f39c8150640 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f39c808d7a0 tx=0x7f39b80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:02.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.850+0000 7f39af7fe640 1 --2- 172.21.15.100:0/1374002053 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f39b406be30 0x7f39b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.850+0000 7f39af7fe640 1 -- 172.21.15.100:0/1374002053 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f39bc08b110 con 0x7f39c806d240 2024-09-11T22:25:02.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.850+0000 7f39c759e640 1 --2- 172.21.15.100:0/1374002053 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f39b406be30 0x7f39b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.850+0000 7f39af7fe640 1 -- 172.21.15.100:0/1374002053 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8043070 con 0x7f39c814fc70 2024-09-11T22:25:02.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.851+0000 7f39af7fe640 1 -- 172.21.15.100:0/1374002053 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f39b803c640 con 0x7f39c814fc70 2024-09-11T22:25:02.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.851+0000 7f39af7fe640 1 -- 172.21.15.100:0/1374002053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c814fc70 msgr2=0x7f39c8150640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.851+0000 7f39af7fe640 1 --2- 172.21.15.100:0/1374002053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c814fc70 0x7f39c8150640 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f39c808d7a0 tx=0x7f39b80046c0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.851+0000 7f39af7fe640 1 -- 172.21.15.100:0/1374002053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c814fc70 msgr2=0x7f39c8150640 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:25:02.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.851+0000 7f39af7fe640 1 --2- 172.21.15.100:0/1374002053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c814fc70 0x7f39c8150640 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f39c808d7a0 tx=0x7f39b80046c0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.851+0000 7f39c759e640 1 --2- 172.21.15.100:0/1374002053 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f39b406be30 0x7f39b406e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f39c0007130 tx=0x7f39c0007710 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:02.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.860+0000 7f39cd152640 1 --2- 172.21.15.100:0/1374002053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c80ca470 0x7f39c8147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:02.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.860+0000 7f39cd152640 1 -- 172.21.15.100:0/1374002053 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f39c814fa90 con 0x7f39c80ca470 2024-09-11T22:25:02.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.861+0000 7f39c6d9d640 1 --2- 172.21.15.100:0/1374002053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c80ca470 0x7f39c8147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:02.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.861+0000 7f39c6d9d640 1 -- 172.21.15.100:0/1374002053 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f39c80cf170 con 0x7f39c80ca470 2024-09-11T22:25:02.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.861+0000 7f39c6d9d640 1 --2- 172.21.15.100:0/1374002053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c80ca470 0x7f39c8147020 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f39b802a220 tx=0x7f39b8008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:02.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.861+0000 7f39af7fe640 1 -- 172.21.15.100:0/1374002053 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8037040 con 0x7f39c80ca470 2024-09-11T22:25:02.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.862+0000 7f39af7fe640 1 -- 172.21.15.100:0/1374002053 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7f39b8003890 con 0x7f39c80ca470 2024-09-11T22:25:02.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.862+0000 7f39af7fe640 1 -- 172.21.15.100:0/1374002053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c80ca470 msgr2=0x7f39c8147020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.862+0000 7f39af7fe640 1 --2- 172.21.15.100:0/1374002053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c80ca470 0x7f39c8147020 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f39b802a220 tx=0x7f39b8008030 comp rx=0 tx=0).stop 2024-09-11T22:25:02.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.862+0000 7f39af7fe640 1 -- 172.21.15.100:0/1374002053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c80ca470 msgr2=0x7f39c8147020 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:25:02.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.862+0000 7f39af7fe640 1 --2- 172.21.15.100:0/1374002053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c80ca470 0x7f39c8147020 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.863 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:25:02.864 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:25:02.864 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:25:02.864 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:25:02.864 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 34, 2024-09-11T22:25:02.864 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 193583, 2024-09-11T22:25:02.864 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:25:02.864 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:25:02.864 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:25:02.864 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:25:02.864 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:02.865 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 12, 2024-09-11T22:25:02.865 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:25:02.865 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:25:02.865 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:25:02.865 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:02.865 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:02.865 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:02.865 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:02.865 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:02.866 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:02.866 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:02.866 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:02.866 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:02.866 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:02.866 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:02.866 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:02.866 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:25:02.866 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:25:02.867 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:02.867 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:02.867 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:02.867 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:02.867 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:02.867 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:02.867 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:02.867 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:02.867 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:02.867 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:02.868 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:02.868 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:02.868 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.868 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:25:02.868 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:25:02.868 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:25:02.868 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:25:02.869 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:25:02.869 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:25:02.869 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:25:02.869 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:25:02.869 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:25:02.869 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:25:02.869 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:25:02.869 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:25:02.870 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:25:02.870 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:25:02.870 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:25:02.870 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:25:02.870 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:25:02.870 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:02.870 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:02.870 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:02.870 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:02.870 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:02.870 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:02.870 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:02.870 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:02.871 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:02.871 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:02.871 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:02.871 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:02.871 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:25:02.871 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.871 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:25:02.871 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.871 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:25:02.871 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:25:02.871 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:02.871 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:02.871 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.872 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:02.872 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:25:02.872 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:02.872 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.872 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.872 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:02.872 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:25:02.872 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:02.872 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:02.872 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:02.872 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.872 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:25:02.872 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:25:02.873 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:02.873 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:02.873 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:02.873 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.873 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.873 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:25:02.873 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:25:02.873 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:02.873 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:02.873 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.873 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:02.873 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:25:02.874 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:02.874 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.874 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.874 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:02.874 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:25:02.874 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:02.874 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:02.874 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:02.874 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.874 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:25:02.874 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:25:02.874 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:02.874 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:02.875 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:02.875 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.875 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.875 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:25:02.875 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:25:02.875 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:02.875 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:02.875 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.875 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:02.875 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:25:02.875 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:02.875 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.875 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.876 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:02.876 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:25:02.876 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:02.876 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:02.876 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:02.876 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.876 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:25:02.876 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:25:02.876 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:02.876 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:02.876 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:02.876 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:02.876 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:02.877 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.877 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:25:02.877 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:25:02.877 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.877 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:02.877 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:02.877 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:25:02.877 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:02.877 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:02.877 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:25:02.877 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.877 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:02.877 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:02.878 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:25:02.878 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:02.878 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:02.878 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:25:02.878 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.878 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:02.878 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:02.878 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:25:02.878 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:02.878 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:02.878 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:25:02.878 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.878 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:02.878 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:02.879 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:25:02.879 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:02.879 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:02.879 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:25:02.879 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:02.879 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:02.879 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:02.879 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:25:02.879 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:02.879 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:02.879 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:02.879 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:25:02.879 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:25:02.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.862+0000 7f39cd152640 1 -- 172.21.15.100:0/1374002053 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f39b406be30 msgr2=0x7f39b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.862+0000 7f39cd152640 1 --2- 172.21.15.100:0/1374002053 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f39b406be30 0x7f39b406e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f39c0007130 tx=0x7f39c0007710 comp rx=0 tx=0).stop 2024-09-11T22:25:02.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.862+0000 7f39cd152640 1 -- 172.21.15.100:0/1374002053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c806d240 msgr2=0x7f39c80cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:02.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.862+0000 7f39cd152640 1 --2- 172.21.15.100:0/1374002053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c806d240 0x7f39c80cf6c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f39bc00c820 tx=0x7f39bc00cce0 comp rx=0 tx=0).stop 2024-09-11T22:25:02.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.862+0000 7f39c759e640 1 -- 172.21.15.100:0/1374002053 reap_dead start 2024-09-11T22:25:02.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.862+0000 7f39c759e640 1 -- 172.21.15.100:0/1374002053 reap_dead start 2024-09-11T22:25:02.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.862+0000 7f39cd152640 1 -- 172.21.15.100:0/1374002053 shutdown_connections 2024-09-11T22:25:02.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.862+0000 7f39cd152640 1 -- 172.21.15.100:0/1374002053 >> 172.21.15.100:0/1374002053 conn(0x7f39c806bc10 msgr2=0x7f39c80b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:02.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.862+0000 7f39cd152640 1 -- 172.21.15.100:0/1374002053 shutdown_connections 2024-09-11T22:25:02.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:02.862+0000 7f39cd152640 1 -- 172.21.15.100:0/1374002053 wait complete. 2024-09-11T22:25:02.881 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:25:02.882 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-11T22:25:02.882 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-11T22:25:02.882 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-11T22:25:02.882 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:25:02.882 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T22:25:02.882 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:25:02.892 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T22:25:02.893 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-11T22:25:02.893 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:25:03.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.040+0000 7f511dcd0640 1 Processor -- start 2024-09-11T22:25:03.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.040+0000 7f511dcd0640 1 -- start start 2024-09-11T22:25:03.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.041+0000 7f511dcd0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5118154c20 0x7f51180cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:03.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.041+0000 7f511dcd0640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f511815a7e0 0x7f51180cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:03.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.041+0000 7f511dcd0640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f511815ac90 con 0x7f51180b3190 2024-09-11T22:25:03.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.041+0000 7f511dcd0640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f511815e000 con 0x7f511815a7e0 2024-09-11T22:25:03.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.041+0000 7f511dcd0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f511815af70 con 0x7f5118154c20 2024-09-11T22:25:03.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.041+0000 7f5117fff640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f511815a7e0 msgr2=0x7f51180cbd10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:25:03.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.041+0000 7f5116ffd640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f51180b3190 legacy=0x7f511815e490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:25:03.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.041+0000 7f5117fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f511815a7e0 0x7f51180cbd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:25:03.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.041+0000 7f51177fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5118154c20 0x7f51180cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:03.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.042+0000 7f51177fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5118154c20 0x7f51180cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:48328/0 (socket says 172.21.15.100:48328) 2024-09-11T22:25:03.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.042+0000 7f51177fe640 1 -- 172.21.15.100:0/31759290 learned_addr learned my addr 172.21.15.100:0/31759290 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:03.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.042+0000 7f51177fe640 1 -- 172.21.15.100:0/31759290 >> v2:172.21.15.100:3300/0 conn(0x7f511815a7e0 msgr2=0x7f51180cbd10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:25:03.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.042+0000 7f51177fe640 1 --2- 172.21.15.100:0/31759290 >> v2:172.21.15.100:3300/0 conn(0x7f511815a7e0 0x7f51180cbd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:03.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.042+0000 7f51177fe640 1 -- 172.21.15.100:0/31759290 >> v1:172.21.15.100:6789/0 conn(0x7f51180b3190 legacy=0x7f511815e490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:25:03.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.042+0000 7f51177fe640 1 -- 172.21.15.100:0/31759290 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511815b250 con 0x7f5118154c20 2024-09-11T22:25:03.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.043+0000 7f51177fe640 1 --2- 172.21.15.100:0/31759290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5118154c20 0x7f51180cb120 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5108009870 tx=0x7f510802a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=465d4abd9437e20d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:03.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.043+0000 7f51167fc640 1 -- 172.21.15.100:0/31759290 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5108037070 con 0x7f5118154c20 2024-09-11T22:25:03.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.043+0000 7f51167fc640 1 -- 172.21.15.100:0/31759290 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5108032440 con 0x7f5118154c20 2024-09-11T22:25:03.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.043+0000 7f51167fc640 1 -- 172.21.15.100:0/31759290 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5108032810 con 0x7f5118154c20 2024-09-11T22:25:03.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.044+0000 7f511dcd0640 1 -- 172.21.15.100:0/31759290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5118154c20 msgr2=0x7f51180cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:03.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.044+0000 7f511dcd0640 1 --2- 172.21.15.100:0/31759290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5118154c20 0x7f51180cb120 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5108009870 tx=0x7f510802a230 comp rx=0 tx=0).stop 2024-09-11T22:25:03.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.044+0000 7f511dcd0640 1 -- 172.21.15.100:0/31759290 shutdown_connections 2024-09-11T22:25:03.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.044+0000 7f511dcd0640 1 --2- 172.21.15.100:0/31759290 >> v2:172.21.15.100:3300/0 conn(0x7f511815a7e0 0x7f51180cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:03.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.044+0000 7f511dcd0640 1 --2- 172.21.15.100:0/31759290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5118154c20 0x7f51180cb120 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:03.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.044+0000 7f511dcd0640 1 -- 172.21.15.100:0/31759290 >> 172.21.15.100:0/31759290 conn(0x7f5118067d40 msgr2=0x7f511806d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:03.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.044+0000 7f511dcd0640 1 -- 172.21.15.100:0/31759290 shutdown_connections 2024-09-11T22:25:03.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.044+0000 7f511dcd0640 1 -- 172.21.15.100:0/31759290 wait complete. 2024-09-11T22:25:03.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.045+0000 7f511dcd0640 1 Processor -- start 2024-09-11T22:25:03.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.045+0000 7f511dcd0640 1 -- start start 2024-09-11T22:25:03.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.046+0000 7f511dcd0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51180b3190 0x7f511815da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:03.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.046+0000 7f511dcd0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5118154c20 0x7f5118149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:03.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.046+0000 7f511dcd0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f511815a7e0 0x7f51181f3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:03.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.046+0000 7f511dcd0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f511815ed20 con 0x7f511815a7e0 2024-09-11T22:25:03.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.046+0000 7f511dcd0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f511815eba0 con 0x7f51180b3190 2024-09-11T22:25:03.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.046+0000 7f511dcd0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f51180cb660 con 0x7f5118154c20 2024-09-11T22:25:03.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.046+0000 7f5117fff640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f511815a7e0 msgr2=0x7f51181f3aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:25:03.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.046+0000 7f5117fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f511815a7e0 0x7f51181f3aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:25:03.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.046+0000 7f5116ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5118154c20 0x7f5118149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:03.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.046+0000 7f5116ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5118154c20 0x7f5118149170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:48332/0 (socket says 172.21.15.100:48332) 2024-09-11T22:25:03.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.046+0000 7f51177fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51180b3190 0x7f511815da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:03.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.046+0000 7f5116ffd640 1 -- 172.21.15.100:0/1616384321 learned_addr learned my addr 172.21.15.100:0/1616384321 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:03.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.047+0000 7f5116ffd640 1 -- 172.21.15.100:0/1616384321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51180b3190 msgr2=0x7f511815da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:03.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.047+0000 7f5116ffd640 1 --2- 172.21.15.100:0/1616384321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51180b3190 0x7f511815da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:03.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.047+0000 7f5116ffd640 1 -- 172.21.15.100:0/1616384321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f511815a7e0 msgr2=0x7f51181f3aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:25:03.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.047+0000 7f5116ffd640 1 --2- 172.21.15.100:0/1616384321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f511815a7e0 0x7f51181f3aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:03.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.047+0000 7f5116ffd640 1 -- 172.21.15.100:0/1616384321 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51181482a0 con 0x7f5118154c20 2024-09-11T22:25:03.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.047+0000 7f5116ffd640 1 --2- 172.21.15.100:0/1616384321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5118154c20 0x7f5118149170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f510c00b580 tx=0x7f510c00ba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:03.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.047+0000 7f50fffff640 1 -- 172.21.15.100:0/1616384321 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510c003cf0 con 0x7f5118154c20 2024-09-11T22:25:03.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.047+0000 7f50fffff640 1 -- 172.21.15.100:0/1616384321 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f510c015070 con 0x7f5118154c20 2024-09-11T22:25:03.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.047+0000 7f511dcd0640 1 -- 172.21.15.100:0/1616384321 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5118155150 con 0x7f5118154c20 2024-09-11T22:25:03.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.047+0000 7f50fffff640 1 -- 172.21.15.100:0/1616384321 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510c005310 con 0x7f5118154c20 2024-09-11T22:25:03.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.047+0000 7f511dcd0640 1 -- 172.21.15.100:0/1616384321 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5118148540 con 0x7f5118154c20 2024-09-11T22:25:03.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.048+0000 7f511dcd0640 1 -- 172.21.15.100:0/1616384321 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51180cb120 con 0x7f5118154c20 2024-09-11T22:25:03.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.049+0000 7f50fffff640 1 -- 172.21.15.100:0/1616384321 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f510c0054b0 con 0x7f5118154c20 2024-09-11T22:25:03.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.049+0000 7f50fffff640 1 --2- 172.21.15.100:0/1616384321 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f510406bde0 0x7f510406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:03.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.049+0000 7f50fffff640 1 -- 172.21.15.100:0/1616384321 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f510c08af50 con 0x7f5118154c20 2024-09-11T22:25:03.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.049+0000 7f51177fe640 1 --2- 172.21.15.100:0/1616384321 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f510406bde0 0x7f510406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:03.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.050+0000 7f51177fe640 1 --2- 172.21.15.100:0/1616384321 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f510406bde0 0x7f510406e2a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5108034000 tx=0x7f510802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:03.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.054+0000 7f50fffff640 1 -- 172.21.15.100:0/1616384321 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f510c059570 con 0x7f5118154c20 2024-09-11T22:25:03.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.332+0000 7f511dcd0640 1 -- 172.21.15.100:0/1616384321 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f51180cd2c0 con 0x7f5118154c20 2024-09-11T22:25:03.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.333+0000 7f50fffff640 1 -- 172.21.15.100:0/1616384321 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f510c058e70 con 0x7f5118154c20 2024-09-11T22:25:03.334 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":34,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:25:03.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.335+0000 7f511dcd0640 1 -- 172.21.15.100:0/1616384321 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f510406bde0 msgr2=0x7f510406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:03.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.335+0000 7f511dcd0640 1 --2- 172.21.15.100:0/1616384321 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f510406bde0 0x7f510406e2a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5108034000 tx=0x7f510802e000 comp rx=0 tx=0).stop 2024-09-11T22:25:03.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.335+0000 7f511dcd0640 1 -- 172.21.15.100:0/1616384321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5118154c20 msgr2=0x7f5118149170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:03.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.335+0000 7f511dcd0640 1 --2- 172.21.15.100:0/1616384321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5118154c20 0x7f5118149170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f510c00b580 tx=0x7f510c00ba40 comp rx=0 tx=0).stop 2024-09-11T22:25:03.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.335+0000 7f511dcd0640 1 -- 172.21.15.100:0/1616384321 shutdown_connections 2024-09-11T22:25:03.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.335+0000 7f511dcd0640 1 --2- 172.21.15.100:0/1616384321 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f510406bde0 0x7f510406e2a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:03.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.335+0000 7f511dcd0640 1 --2- 172.21.15.100:0/1616384321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f511815a7e0 0x7f51181f3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:03.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.335+0000 7f511dcd0640 1 --2- 172.21.15.100:0/1616384321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5118154c20 0x7f5118149170 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:03.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.335+0000 7f511dcd0640 1 --2- 172.21.15.100:0/1616384321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51180b3190 0x7f511815da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:03.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.335+0000 7f511dcd0640 1 -- 172.21.15.100:0/1616384321 >> 172.21.15.100:0/1616384321 conn(0x7f5118067d40 msgr2=0x7f511815e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:03.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.335+0000 7f511dcd0640 1 -- 172.21.15.100:0/1616384321 shutdown_connections 2024-09-11T22:25:03.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:03.335+0000 7f511dcd0640 1 -- 172.21.15.100:0/1616384321 wait complete. 2024-09-11T22:25:06.350 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:25:06.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.455+0000 7f3b66e1e640 1 Processor -- start 2024-09-11T22:25:06.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.455+0000 7f3b66e1e640 1 -- start start 2024-09-11T22:25:06.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.457+0000 7f3b66e1e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3b60073a30 0x7f3b6006c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:06.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.457+0000 7f3b66e1e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b600afc80 0x7f3b6006c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:06.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.457+0000 7f3b66e1e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b60151e90 con 0x7f3b60151ab0 2024-09-11T22:25:06.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.457+0000 7f3b66e1e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f3b60072f00 con 0x7f3b60073a30 2024-09-11T22:25:06.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.457+0000 7f3b66e1e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3b6006bc10 con 0x7f3b600afc80 2024-09-11T22:25:06.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.457+0000 7f3b64bba640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f3b60151ab0 legacy=0x7f3b600c39a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:25:06.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.457+0000 7f3b653bb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b600afc80 0x7f3b6006c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:06.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.457+0000 7f3b653bb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b600afc80 0x7f3b6006c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:48348/0 (socket says 172.21.15.100:48348) 2024-09-11T22:25:06.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.457+0000 7f3b5ffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3b60073a30 0x7f3b6006c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:06.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.457+0000 7f3b653bb640 1 -- 172.21.15.100:0/4252712738 learned_addr learned my addr 172.21.15.100:0/4252712738 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:06.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.457+0000 7f3b653bb640 1 -- 172.21.15.100:0/4252712738 >> v2:172.21.15.167:3300/0 conn(0x7f3b60073a30 msgr2=0x7f3b6006c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:25:06.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.457+0000 7f3b653bb640 1 --2- 172.21.15.100:0/4252712738 >> v2:172.21.15.167:3300/0 conn(0x7f3b60073a30 0x7f3b6006c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:06.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.457+0000 7f3b653bb640 1 -- 172.21.15.100:0/4252712738 >> v1:172.21.15.100:6789/0 conn(0x7f3b60151ab0 legacy=0x7f3b600c39a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:25:06.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.457+0000 7f3b653bb640 1 -- 172.21.15.100:0/4252712738 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b601584c0 con 0x7f3b600afc80 2024-09-11T22:25:06.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.458+0000 7f3b653bb640 1 --2- 172.21.15.100:0/4252712738 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b600afc80 0x7f3b6006c8c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3b58009e50 tx=0x7f3b5802a630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18861a22b623d1ed server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:06.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.458+0000 7f3b5f7fe640 1 -- 172.21.15.100:0/4252712738 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b58036070 con 0x7f3b600afc80 2024-09-11T22:25:06.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.458+0000 7f3b5f7fe640 1 -- 172.21.15.100:0/4252712738 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b58031600 con 0x7f3b600afc80 2024-09-11T22:25:06.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.458+0000 7f3b5f7fe640 1 -- 172.21.15.100:0/4252712738 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b580319d0 con 0x7f3b600afc80 2024-09-11T22:25:06.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.459+0000 7f3b66e1e640 1 -- 172.21.15.100:0/4252712738 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b600afc80 msgr2=0x7f3b6006c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:06.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.459+0000 7f3b66e1e640 1 --2- 172.21.15.100:0/4252712738 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b600afc80 0x7f3b6006c8c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3b58009e50 tx=0x7f3b5802a630 comp rx=0 tx=0).stop 2024-09-11T22:25:06.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.459+0000 7f3b66e1e640 1 -- 172.21.15.100:0/4252712738 shutdown_connections 2024-09-11T22:25:06.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.459+0000 7f3b66e1e640 1 --2- 172.21.15.100:0/4252712738 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b600afc80 0x7f3b6006c8c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:06.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.459+0000 7f3b66e1e640 1 --2- 172.21.15.100:0/4252712738 >> v2:172.21.15.167:3300/0 conn(0x7f3b60073a30 0x7f3b6006c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:06.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.459+0000 7f3b66e1e640 1 -- 172.21.15.100:0/4252712738 >> 172.21.15.100:0/4252712738 conn(0x7f3b600cd200 msgr2=0x7f3b600cd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:06.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.459+0000 7f3b66e1e640 1 -- 172.21.15.100:0/4252712738 shutdown_connections 2024-09-11T22:25:06.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.459+0000 7f3b66e1e640 1 -- 172.21.15.100:0/4252712738 wait complete. 2024-09-11T22:25:06.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.460+0000 7f3b66e1e640 1 Processor -- start 2024-09-11T22:25:06.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.460+0000 7f3b66e1e640 1 -- start start 2024-09-11T22:25:06.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.462+0000 7f3b66e1e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b60073a30 0x7f3b601f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:06.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.462+0000 7f3b66e1e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b600afc80 0x7f3b601e4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:06.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.462+0000 7f3b66e1e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b60151ab0 0x7f3b60147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:06.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.462+0000 7f3b66e1e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3b60073430 con 0x7f3b600afc80 2024-09-11T22:25:06.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.462+0000 7f3b66e1e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6006bef0 con 0x7f3b60073a30 2024-09-11T22:25:06.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.462+0000 7f3b66e1e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3b60158180 con 0x7f3b60151ab0 2024-09-11T22:25:06.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.462+0000 7f3b5ffff640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b600afc80 msgr2=0x7f3b601e4100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:25:06.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.462+0000 7f3b5ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b600afc80 0x7f3b601e4100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:25:06.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.462+0000 7f3b653bb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b60151ab0 0x7f3b60147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:06.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.462+0000 7f3b64bba640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b60073a30 0x7f3b601f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:06.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.462+0000 7f3b653bb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b60151ab0 0x7f3b60147590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:48362/0 (socket says 172.21.15.100:48362) 2024-09-11T22:25:06.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.462+0000 7f3b653bb640 1 -- 172.21.15.100:0/1142779265 learned_addr learned my addr 172.21.15.100:0/1142779265 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:06.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.462+0000 7f3b653bb640 1 -- 172.21.15.100:0/1142779265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b60073a30 msgr2=0x7f3b601f15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:06.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.462+0000 7f3b653bb640 1 --2- 172.21.15.100:0/1142779265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b60073a30 0x7f3b601f15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:06.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.462+0000 7f3b653bb640 1 -- 172.21.15.100:0/1142779265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b600afc80 msgr2=0x7f3b601e4100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:25:06.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.462+0000 7f3b653bb640 1 --2- 172.21.15.100:0/1142779265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b600afc80 0x7f3b601e4100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:06.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.462+0000 7f3b653bb640 1 -- 172.21.15.100:0/1142779265 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b601f1b30 con 0x7f3b60151ab0 2024-09-11T22:25:06.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.463+0000 7f3b653bb640 1 --2- 172.21.15.100:0/1142779265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b60151ab0 0x7f3b60147590 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3b58034040 tx=0x7f3b58004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:06.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.463+0000 7f3b5d7fa640 1 -- 172.21.15.100:0/1142779265 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b58041020 con 0x7f3b60151ab0 2024-09-11T22:25:06.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.463+0000 7f3b5d7fa640 1 -- 172.21.15.100:0/1142779265 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b580077a0 con 0x7f3b60151ab0 2024-09-11T22:25:06.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.463+0000 7f3b5d7fa640 1 -- 172.21.15.100:0/1142779265 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b58036040 con 0x7f3b60151ab0 2024-09-11T22:25:06.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.463+0000 7f3b66e1e640 1 -- 172.21.15.100:0/1142779265 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b6015ac90 con 0x7f3b60151ab0 2024-09-11T22:25:06.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.463+0000 7f3b66e1e640 1 -- 172.21.15.100:0/1142779265 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b6015b230 con 0x7f3b60151ab0 2024-09-11T22:25:06.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.464+0000 7f3b66e1e640 1 -- 172.21.15.100:0/1142779265 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b6014bb30 con 0x7f3b60151ab0 2024-09-11T22:25:06.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.464+0000 7f3b5d7fa640 1 -- 172.21.15.100:0/1142779265 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b58044020 con 0x7f3b60151ab0 2024-09-11T22:25:06.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.465+0000 7f3b5d7fa640 1 --2- 172.21.15.100:0/1142779265 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3b4406be10 0x7f3b4406e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:06.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.465+0000 7f3b5d7fa640 1 -- 172.21.15.100:0/1142779265 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f3b580aba90 con 0x7f3b60151ab0 2024-09-11T22:25:06.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.465+0000 7f3b64bba640 1 --2- 172.21.15.100:0/1142779265 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3b4406be10 0x7f3b4406e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:06.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.465+0000 7f3b64bba640 1 --2- 172.21.15.100:0/1142779265 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3b4406be10 0x7f3b4406e2d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3b54003980 tx=0x7f3b5400b320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:06.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.470+0000 7f3b5d7fa640 1 -- 172.21.15.100:0/1142779265 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3b6014bb30 con 0x7f3b60151ab0 2024-09-11T22:25:06.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.764+0000 7f3b66e1e640 1 -- 172.21.15.100:0/1142779265 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3b600c2220 con 0x7f3b60151ab0 2024-09-11T22:25:06.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.764+0000 7f3b5d7fa640 1 -- 172.21.15.100:0/1142779265 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f3b5804b070 con 0x7f3b60151ab0 2024-09-11T22:25:06.765 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":34,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:25:06.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.766+0000 7f3b66e1e640 1 -- 172.21.15.100:0/1142779265 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3b4406be10 msgr2=0x7f3b4406e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:06.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.766+0000 7f3b66e1e640 1 --2- 172.21.15.100:0/1142779265 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3b4406be10 0x7f3b4406e2d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3b54003980 tx=0x7f3b5400b320 comp rx=0 tx=0).stop 2024-09-11T22:25:06.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.766+0000 7f3b66e1e640 1 -- 172.21.15.100:0/1142779265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b60151ab0 msgr2=0x7f3b60147590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:06.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.766+0000 7f3b66e1e640 1 --2- 172.21.15.100:0/1142779265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b60151ab0 0x7f3b60147590 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3b58034040 tx=0x7f3b58004a40 comp rx=0 tx=0).stop 2024-09-11T22:25:06.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.766+0000 7f3b66e1e640 1 -- 172.21.15.100:0/1142779265 shutdown_connections 2024-09-11T22:25:06.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.766+0000 7f3b66e1e640 1 --2- 172.21.15.100:0/1142779265 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3b4406be10 0x7f3b4406e2d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:06.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.766+0000 7f3b66e1e640 1 --2- 172.21.15.100:0/1142779265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b60151ab0 0x7f3b60147590 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:06.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.766+0000 7f3b66e1e640 1 --2- 172.21.15.100:0/1142779265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b600afc80 0x7f3b601e4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:06.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.766+0000 7f3b66e1e640 1 --2- 172.21.15.100:0/1142779265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b60073a30 0x7f3b601f15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:06.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.766+0000 7f3b66e1e640 1 -- 172.21.15.100:0/1142779265 >> 172.21.15.100:0/1142779265 conn(0x7f3b600cd200 msgr2=0x7f3b6014e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:06.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.766+0000 7f3b66e1e640 1 -- 172.21.15.100:0/1142779265 shutdown_connections 2024-09-11T22:25:06.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:06.766+0000 7f3b66e1e640 1 -- 172.21.15.100:0/1142779265 wait complete. 2024-09-11T22:25:09.781 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:25:09.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.892+0000 7f38c62a5640 1 Processor -- start 2024-09-11T22:25:09.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.892+0000 7f38c62a5640 1 -- start start 2024-09-11T22:25:09.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.893+0000 7f38c62a5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f38c00d0b20 0x7f38c00ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:09.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.893+0000 7f38c62a5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38c00d0f00 0x7f38c0165370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:09.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.893+0000 7f38c62a5640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38c00c55d0 con 0x7f38c00cad20 2024-09-11T22:25:09.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.893+0000 7f38c62a5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f38c00c58b0 con 0x7f38c00d0b20 2024-09-11T22:25:09.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.893+0000 7f38c62a5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f38c015ad20 con 0x7f38c00d0f00 2024-09-11T22:25:09.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.893+0000 7f38bf7fe640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f38c00cad20 legacy=0x7f38c0154830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:25:09.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.893+0000 7f38bffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f38c00d0b20 0x7f38c00ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:09.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.893+0000 7f38c4842640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38c00d0f00 0x7f38c0165370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:09.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.893+0000 7f38bffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f38c00d0b20 0x7f38c00ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:33646/0 (socket says 172.21.15.100:33646) 2024-09-11T22:25:09.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.893+0000 7f38c4842640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38c00d0f00 0x7f38c0165370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:48366/0 (socket says 172.21.15.100:48366) 2024-09-11T22:25:09.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.893+0000 7f38bffff640 1 -- 172.21.15.100:0/2167590359 learned_addr learned my addr 172.21.15.100:0/2167590359 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:09.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.894+0000 7f38bffff640 1 -- 172.21.15.100:0/2167590359 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38c00d0f00 msgr2=0x7f38c0165370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:25:09.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.894+0000 7f38bffff640 1 --2- 172.21.15.100:0/2167590359 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38c00d0f00 0x7f38c0165370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:09.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.894+0000 7f38bffff640 1 -- 172.21.15.100:0/2167590359 >> v1:172.21.15.100:6789/0 conn(0x7f38c00cad20 legacy=0x7f38c0154830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:25:09.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.894+0000 7f38bffff640 1 -- 172.21.15.100:0/2167590359 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c015b000 con 0x7f38c00d0b20 2024-09-11T22:25:09.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.894+0000 7f38c4842640 1 --2- 172.21.15.100:0/2167590359 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38c00d0f00 0x7f38c0165370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:25:09.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.895+0000 7f38bffff640 1 --2- 172.21.15.100:0/2167590359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38c00d0b20 0x7f38c00ccdb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009870 tx=0x7f38b002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b902a6cbd64759f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:09.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.895+0000 7f38beffd640 1 -- 172.21.15.100:0/2167590359 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0037070 con 0x7f38c00d0b20 2024-09-11T22:25:09.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.895+0000 7f38beffd640 1 -- 172.21.15.100:0/2167590359 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b0032440 con 0x7f38c00d0b20 2024-09-11T22:25:09.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.895+0000 7f38beffd640 1 -- 172.21.15.100:0/2167590359 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0032810 con 0x7f38c00d0b20 2024-09-11T22:25:09.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.895+0000 7f38c62a5640 1 -- 172.21.15.100:0/2167590359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38c00d0b20 msgr2=0x7f38c00ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:09.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.895+0000 7f38c62a5640 1 --2- 172.21.15.100:0/2167590359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38c00d0b20 0x7f38c00ccdb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009870 tx=0x7f38b002a210 comp rx=0 tx=0).stop 2024-09-11T22:25:09.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.895+0000 7f38c62a5640 1 -- 172.21.15.100:0/2167590359 shutdown_connections 2024-09-11T22:25:09.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.895+0000 7f38c62a5640 1 --2- 172.21.15.100:0/2167590359 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38c00d0f00 0x7f38c0165370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:09.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.895+0000 7f38c62a5640 1 --2- 172.21.15.100:0/2167590359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38c00d0b20 0x7f38c00ccdb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:09.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.895+0000 7f38c62a5640 1 -- 172.21.15.100:0/2167590359 >> 172.21.15.100:0/2167590359 conn(0x7f38c006d160 msgr2=0x7f38c006d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:09.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.895+0000 7f38c62a5640 1 -- 172.21.15.100:0/2167590359 shutdown_connections 2024-09-11T22:25:09.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.895+0000 7f38c62a5640 1 -- 172.21.15.100:0/2167590359 wait complete. 2024-09-11T22:25:09.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.896+0000 7f38c62a5640 1 Processor -- start 2024-09-11T22:25:09.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.897+0000 7f38c62a5640 1 -- start start 2024-09-11T22:25:09.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.897+0000 7f38c62a5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38c00cad20 0x7f38c01f4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:09.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.897+0000 7f38c62a5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38c00d0b20 0x7f38c014e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:09.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.897+0000 7f38c62a5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38c00d0f00 0x7f38c014f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:09.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.897+0000 7f38c62a5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f38c015b800 con 0x7f38c00d0b20 2024-09-11T22:25:09.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.897+0000 7f38c62a5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f38c015a9f0 con 0x7f38c00d0f00 2024-09-11T22:25:09.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.897+0000 7f38c62a5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f38c00b3290 con 0x7f38c00cad20 2024-09-11T22:25:09.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.897+0000 7f38bf7fe640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38c00d0b20 msgr2=0x7f38c014e4d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:25:09.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.897+0000 7f38bf7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38c00d0b20 0x7f38c014e4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:25:09.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.898+0000 7f38bffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38c00cad20 0x7f38c01f4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:09.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.898+0000 7f38bffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38c00cad20 0x7f38c01f4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:48374/0 (socket says 172.21.15.100:48374) 2024-09-11T22:25:09.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.898+0000 7f38c4842640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38c00d0f00 0x7f38c014f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:09.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.898+0000 7f38bffff640 1 -- 172.21.15.100:0/1452367780 learned_addr learned my addr 172.21.15.100:0/1452367780 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:09.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.898+0000 7f38bffff640 1 -- 172.21.15.100:0/1452367780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38c00d0f00 msgr2=0x7f38c014f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:09.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.898+0000 7f38bffff640 1 --2- 172.21.15.100:0/1452367780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38c00d0f00 0x7f38c014f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:09.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.898+0000 7f38bffff640 1 -- 172.21.15.100:0/1452367780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38c00d0b20 msgr2=0x7f38c014e4d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:25:09.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.898+0000 7f38bffff640 1 --2- 172.21.15.100:0/1452367780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38c00d0b20 0x7f38c014e4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:09.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.898+0000 7f38bffff640 1 -- 172.21.15.100:0/1452367780 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c01f06a0 con 0x7f38c00cad20 2024-09-11T22:25:09.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.898+0000 7f38c4842640 1 --2- 172.21.15.100:0/1452367780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38c00d0f00 0x7f38c014f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:25:09.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.898+0000 7f38bffff640 1 --2- 172.21.15.100:0/1452367780 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38c00cad20 0x7f38c01f4480 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009870 tx=0x7f38b00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:09.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.898+0000 7f38bcff9640 1 -- 172.21.15.100:0/1452367780 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0041070 con 0x7f38c00cad20 2024-09-11T22:25:09.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.898+0000 7f38bcff9640 1 -- 172.21.15.100:0/1452367780 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b003c890 con 0x7f38c00cad20 2024-09-11T22:25:09.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.898+0000 7f38bcff9640 1 -- 172.21.15.100:0/1452367780 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0037040 con 0x7f38c00cad20 2024-09-11T22:25:09.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.898+0000 7f38c62a5640 1 -- 172.21.15.100:0/1452367780 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c01f0940 con 0x7f38c00cad20 2024-09-11T22:25:09.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.899+0000 7f38c62a5640 1 -- 172.21.15.100:0/1452367780 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c01f0f00 con 0x7f38c00cad20 2024-09-11T22:25:09.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.900+0000 7f38c62a5640 1 -- 172.21.15.100:0/1452367780 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38c0069290 con 0x7f38c00cad20 2024-09-11T22:25:09.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.900+0000 7f38bcff9640 1 -- 172.21.15.100:0/1452367780 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f38b0044070 con 0x7f38c00cad20 2024-09-11T22:25:09.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.901+0000 7f38bcff9640 1 --2- 172.21.15.100:0/1452367780 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f38ac06be10 0x7f38ac06e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:09.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.901+0000 7f38bcff9640 1 -- 172.21.15.100:0/1452367780 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f38b00abb30 con 0x7f38c00cad20 2024-09-11T22:25:09.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.901+0000 7f38bf7fe640 1 --2- 172.21.15.100:0/1452367780 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f38ac06be10 0x7f38ac06e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:09.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.901+0000 7f38bf7fe640 1 --2- 172.21.15.100:0/1452367780 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f38ac06be10 0x7f38ac06e2d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f38c01584e0 tx=0x7f38b4006d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:09.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:09.905+0000 7f38bcff9640 1 -- 172.21.15.100:0/1452367780 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f38b007a0c0 con 0x7f38c00cad20 2024-09-11T22:25:10.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:10.190+0000 7f38c62a5640 1 -- 172.21.15.100:0/1452367780 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f38c00c6c60 con 0x7f38c00cad20 2024-09-11T22:25:10.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:10.191+0000 7f38bcff9640 1 -- 172.21.15.100:0/1452367780 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f38c00c6c60 con 0x7f38c00cad20 2024-09-11T22:25:10.192 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":34,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:25:10.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:10.193+0000 7f38c62a5640 1 -- 172.21.15.100:0/1452367780 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f38ac06be10 msgr2=0x7f38ac06e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:10.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:10.193+0000 7f38c62a5640 1 --2- 172.21.15.100:0/1452367780 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f38ac06be10 0x7f38ac06e2d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f38c01584e0 tx=0x7f38b4006d30 comp rx=0 tx=0).stop 2024-09-11T22:25:10.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:10.193+0000 7f38c62a5640 1 -- 172.21.15.100:0/1452367780 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38c00cad20 msgr2=0x7f38c01f4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:10.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:10.193+0000 7f38c62a5640 1 --2- 172.21.15.100:0/1452367780 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38c00cad20 0x7f38c01f4480 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f38b0009870 tx=0x7f38b00046c0 comp rx=0 tx=0).stop 2024-09-11T22:25:10.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:10.193+0000 7f38c62a5640 1 -- 172.21.15.100:0/1452367780 shutdown_connections 2024-09-11T22:25:10.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:10.193+0000 7f38c62a5640 1 --2- 172.21.15.100:0/1452367780 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f38ac06be10 0x7f38ac06e2d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:10.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:10.193+0000 7f38c62a5640 1 --2- 172.21.15.100:0/1452367780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38c00d0f00 0x7f38c014f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:10.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:10.193+0000 7f38c62a5640 1 --2- 172.21.15.100:0/1452367780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38c00d0b20 0x7f38c014e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:10.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:10.193+0000 7f38c62a5640 1 --2- 172.21.15.100:0/1452367780 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38c00cad20 0x7f38c01f4480 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:10.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:10.193+0000 7f38c62a5640 1 -- 172.21.15.100:0/1452367780 >> 172.21.15.100:0/1452367780 conn(0x7f38c006d160 msgr2=0x7f38c00cb120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:10.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:10.193+0000 7f38c62a5640 1 -- 172.21.15.100:0/1452367780 shutdown_connections 2024-09-11T22:25:10.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:10.193+0000 7f38c62a5640 1 -- 172.21.15.100:0/1452367780 wait complete. 2024-09-11T22:25:13.209 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:25:13.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.314+0000 7f0bc585e640 1 Processor -- start 2024-09-11T22:25:13.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.314+0000 7f0bc585e640 1 -- start start 2024-09-11T22:25:13.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.315+0000 7f0bc585e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 0x7f0bc00cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:13.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.315+0000 7f0bc585e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0bc00b3190 0x7f0bc015e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:13.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.315+0000 7f0bc585e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bc015ac90 con 0x7f0bc015a7e0 2024-09-11T22:25:13.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.315+0000 7f0bc585e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f0bc015e000 con 0x7f0bc00b3190 2024-09-11T22:25:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.315+0000 7f0bc585e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f0bc015af70 con 0x7f0bc0154c20 2024-09-11T22:25:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.315+0000 7f0bb7fff640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f0bc00b3190 msgr2=0x7f0bc015e490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:25:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.315+0000 7f0bb7fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0bc00b3190 0x7f0bc015e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:25:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.315+0000 7f0bbeffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 0x7f0bc00cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.315+0000 7f0bbf7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f0bc015a7e0 0x7f0bc00cbd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:51376/0 (socket says 172.21.15.100:51376) 2024-09-11T22:25:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.315+0000 7f0bbf7fe640 1 -- 172.21.15.100:0/2679738316 learned_addr learned my addr 172.21.15.100:0/2679738316 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:25:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.315+0000 7f0bbeffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 0x7f0bc00cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:46392/0 (socket says 172.21.15.100:46392) 2024-09-11T22:25:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.315+0000 7f0bbeffd640 1 -- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 msgr2=0x7f0bc00cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:25:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.315+0000 7f0bbeffd640 1 -- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 msgr2=0x7f0bc00cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:25:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.315+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 0x7f0bc00cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:25:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.315+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 0x7f0bc00cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:25:13.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.516+0000 7f0bb7fff640 1 -- 172.21.15.100:0/2679738316 >> v2:172.21.15.100:3300/0 conn(0x7f0bc00b3190 msgr2=0x7f0bc015e490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:25:13.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.516+0000 7f0bb7fff640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.100:3300/0 conn(0x7f0bc00b3190 0x7f0bc015e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:25:13.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.516+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 0x7f0bc00cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:13.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.516+0000 7f0bbeffd640 1 -- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 msgr2=0x7f0bc00cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:25:13.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.516+0000 7f0bbeffd640 1 -- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 msgr2=0x7f0bc00cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:25:13.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.516+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 0x7f0bc00cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:25:13.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.516+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 0x7f0bc00cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:25:13.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.917+0000 7f0bb7fff640 1 -- 172.21.15.100:0/2679738316 >> v2:172.21.15.100:3300/0 conn(0x7f0bc00b3190 msgr2=0x7f0bc015e490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:25:13.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.917+0000 7f0bb7fff640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.100:3300/0 conn(0x7f0bc00b3190 0x7f0bc015e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:25:13.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.917+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 0x7f0bc00cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:13.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.917+0000 7f0bbeffd640 1 -- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 msgr2=0x7f0bc00cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:25:13.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.917+0000 7f0bbeffd640 1 -- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 msgr2=0x7f0bc00cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:25:13.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.917+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 0x7f0bc00cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:25:13.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:13.917+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 0x7f0bc00cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:25:14.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:14.718+0000 7f0bb7fff640 1 -- 172.21.15.100:0/2679738316 >> v2:172.21.15.100:3300/0 conn(0x7f0bc00b3190 msgr2=0x7f0bc015e490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:25:14.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:14.718+0000 7f0bb7fff640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.100:3300/0 conn(0x7f0bc00b3190 0x7f0bc015e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:25:14.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:14.718+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 0x7f0bc00cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:14.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:14.718+0000 7f0bbeffd640 1 -- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 msgr2=0x7f0bc00cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:25:14.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:14.718+0000 7f0bbeffd640 1 -- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 msgr2=0x7f0bc00cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:25:14.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:14.718+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 0x7f0bc00cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:25:14.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:14.718+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 0x7f0bc00cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:25:16.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.315+0000 7f0bbd7fa640 1 -- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 msgr2=0x7f0bc00cb120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:25:16.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.315+0000 7f0bbd7fa640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0bc0154c20 0x7f0bc00cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:16.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.315+0000 7f0bbd7fa640 1 -- 172.21.15.100:0/2679738316 >> v2:172.21.15.100:3300/0 conn(0x7f0bc00b3190 msgr2=0x7f0bc015e490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:25:16.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.315+0000 7f0bbd7fa640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.100:3300/0 conn(0x7f0bc00b3190 0x7f0bc015e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:16.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.315+0000 7f0bbd7fa640 1 -- 172.21.15.100:0/2679738316 >> v1:172.21.15.167:6789/0 conn(0x7f0bc015a7e0 legacy=0x7f0bc00cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:16.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.315+0000 7f0bbd7fa640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba00072e0 0x7f0ba0009780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:16.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.315+0000 7f0bbd7fa640 1 -- 172.21.15.100:0/2679738316 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bc015b250 con 0x7f0ba0003690 2024-09-11T22:25:16.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.315+0000 7f0bbd7fa640 1 -- 172.21.15.100:0/2679738316 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0bc015e000 con 0x7f0ba00072e0 2024-09-11T22:25:16.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.315+0000 7f0bbeffd640 1 -- 172.21.15.100:0/2679738316 >> v1:172.21.15.100:6789/0 conn(0x7f0ba0003690 legacy=0x7f0ba0005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:25:16.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.315+0000 7f0bb7fff640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba00072e0 0x7f0ba0009780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:16.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.315+0000 7f0bb7fff640 1 -- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba00072e0 msgr2=0x7f0ba0009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:25:16.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.315+0000 7f0bb7fff640 1 -- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba00072e0 msgr2=0x7f0ba0009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:25:16.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.315+0000 7f0bb7fff640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba00072e0 0x7f0ba0009780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:25:16.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.315+0000 7f0bb7fff640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba00072e0 0x7f0ba0009780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:25:16.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.516+0000 7f0bbeffd640 1 -- 172.21.15.100:0/2679738316 >> v1:172.21.15.100:6789/0 conn(0x7f0ba0003690 legacy=0x7f0ba0005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:25:16.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.516+0000 7f0bb7fff640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba00072e0 0x7f0ba0009780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:16.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.516+0000 7f0bb7fff640 1 -- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba00072e0 msgr2=0x7f0ba0009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:25:16.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.516+0000 7f0bb7fff640 1 -- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba00072e0 msgr2=0x7f0ba0009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:25:16.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.516+0000 7f0bb7fff640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba00072e0 0x7f0ba0009780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:25:16.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.516+0000 7f0bb7fff640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba00072e0 0x7f0ba0009780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:25:16.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.917+0000 7f0bbeffd640 1 -- 172.21.15.100:0/2679738316 >> v1:172.21.15.100:6789/0 conn(0x7f0ba0003690 legacy=0x7f0ba0005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:25:16.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.917+0000 7f0bb7fff640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba00072e0 0x7f0ba0009780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:16.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.917+0000 7f0bb7fff640 1 -- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba00072e0 msgr2=0x7f0ba0009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:25:16.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.917+0000 7f0bb7fff640 1 -- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba00072e0 msgr2=0x7f0ba0009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:25:16.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.917+0000 7f0bb7fff640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba00072e0 0x7f0ba0009780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:25:16.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:16.917+0000 7f0bb7fff640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba00072e0 0x7f0ba0009780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:25:17.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:17.718+0000 7f0bbeffd640 1 -- 172.21.15.100:0/2679738316 >> v1:172.21.15.100:6789/0 conn(0x7f0ba0003690 legacy=0x7f0ba0005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:25:17.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:17.718+0000 7f0bb7fff640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba00072e0 0x7f0ba0009780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:17.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:17.718+0000 7f0bb7fff640 1 -- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba00072e0 msgr2=0x7f0ba0009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:25:17.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:17.718+0000 7f0bb7fff640 1 -- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba00072e0 msgr2=0x7f0ba0009780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:25:17.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:17.718+0000 7f0bb7fff640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba00072e0 0x7f0ba0009780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:25:17.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:17.718+0000 7f0bb7fff640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba00072e0 0x7f0ba0009780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:25:19.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.315+0000 7f0bbd7fa640 1 -- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba00072e0 msgr2=0x7f0ba0009780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:25:19.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.315+0000 7f0bbd7fa640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba00072e0 0x7f0ba0009780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:19.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.315+0000 7f0bbd7fa640 1 -- 172.21.15.100:0/2679738316 >> v1:172.21.15.100:6789/0 conn(0x7f0ba0003690 legacy=0x7f0ba0005b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:25:19.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.315+0000 7f0bbd7fa640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.100:3300/0 conn(0x7f0bc00b3190 0x7f0ba0009ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:19.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.315+0000 7f0bbf7fe640 1 -- 172.21.15.100:0/2679738316 reap_dead start 2024-09-11T22:25:19.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.315+0000 7f0bbd7fa640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba0009840 0x7f0ba000a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:19.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.315+0000 7f0bbd7fa640 1 -- 172.21.15.100:0/2679738316 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ba000b000 con 0x7f0ba000a3e0 2024-09-11T22:25:19.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.315+0000 7f0bbd7fa640 1 -- 172.21.15.100:0/2679738316 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f0bc015e000 con 0x7f0bc00b3190 2024-09-11T22:25:19.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.315+0000 7f0bbd7fa640 1 -- 172.21.15.100:0/2679738316 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0bc015af70 con 0x7f0ba0009840 2024-09-11T22:25:19.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.315+0000 7f0bb7fff640 1 -- 172.21.15.100:0/2679738316 >> v1:172.21.15.100:6789/0 conn(0x7f0ba000a3e0 legacy=0x7f0ba0003b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:25:19.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.315+0000 7f0bbeffd640 1 -- 172.21.15.100:0/2679738316 >> v2:172.21.15.100:3300/0 conn(0x7f0bc00b3190 msgr2=0x7f0ba0009ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:25:19.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.315+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.100:3300/0 conn(0x7f0bc00b3190 0x7f0ba0009ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:25:19.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.315+0000 7f0bbf7fe640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba0009840 0x7f0ba000a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:19.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.316+0000 7f0bbf7fe640 1 -- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba0009840 msgr2=0x7f0ba000a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:25:19.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.316+0000 7f0bbf7fe640 1 -- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba0009840 msgr2=0x7f0ba000a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:25:19.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.316+0000 7f0bbf7fe640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba0009840 0x7f0ba000a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:25:19.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.316+0000 7f0bbf7fe640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba0009840 0x7f0ba000a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:25:19.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.516+0000 7f0bb7fff640 1 -- 172.21.15.100:0/2679738316 >> v1:172.21.15.100:6789/0 conn(0x7f0ba000a3e0 legacy=0x7f0ba0003b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:25:19.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.516+0000 7f0bbeffd640 1 -- 172.21.15.100:0/2679738316 >> v2:172.21.15.100:3300/0 conn(0x7f0bc00b3190 msgr2=0x7f0ba0009ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:25:19.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.516+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.100:3300/0 conn(0x7f0bc00b3190 0x7f0ba0009ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:25:19.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.517+0000 7f0bbf7fe640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba0009840 0x7f0ba000a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:19.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.517+0000 7f0bbf7fe640 1 -- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba0009840 msgr2=0x7f0ba000a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:25:19.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.517+0000 7f0bbf7fe640 1 -- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba0009840 msgr2=0x7f0ba000a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:25:19.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.517+0000 7f0bbf7fe640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba0009840 0x7f0ba000a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:25:19.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.517+0000 7f0bbf7fe640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba0009840 0x7f0ba000a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:25:19.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.917+0000 7f0bb7fff640 1 -- 172.21.15.100:0/2679738316 >> v1:172.21.15.100:6789/0 conn(0x7f0ba000a3e0 legacy=0x7f0ba0003b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:25:19.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.917+0000 7f0bbeffd640 1 -- 172.21.15.100:0/2679738316 >> v2:172.21.15.100:3300/0 conn(0x7f0bc00b3190 msgr2=0x7f0ba0009ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:25:19.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.917+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.100:3300/0 conn(0x7f0bc00b3190 0x7f0ba0009ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:25:19.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.918+0000 7f0bbf7fe640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba0009840 0x7f0ba000a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:19.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.918+0000 7f0bbf7fe640 1 -- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba0009840 msgr2=0x7f0ba000a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:25:19.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.918+0000 7f0bbf7fe640 1 -- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba0009840 msgr2=0x7f0ba000a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:25:19.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.918+0000 7f0bbf7fe640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba0009840 0x7f0ba000a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:25:19.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:19.918+0000 7f0bbf7fe640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba0009840 0x7f0ba000a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:25:20.184 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:25:20.188 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:25:20.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:20.718+0000 7f0bb7fff640 1 -- 172.21.15.100:0/2679738316 >> v1:172.21.15.100:6789/0 conn(0x7f0ba000a3e0 legacy=0x7f0ba0003b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:25:20.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:20.718+0000 7f0bbeffd640 1 -- 172.21.15.100:0/2679738316 >> v2:172.21.15.100:3300/0 conn(0x7f0bc00b3190 msgr2=0x7f0ba0009ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:25:20.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:20.718+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.100:3300/0 conn(0x7f0bc00b3190 0x7f0ba0009ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:25:20.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:20.719+0000 7f0bbf7fe640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba0009840 0x7f0ba000a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:20.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:20.720+0000 7f0bbf7fe640 1 -- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba0009840 msgr2=0x7f0ba000a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:25:20.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:20.720+0000 7f0bbf7fe640 1 -- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba0009840 msgr2=0x7f0ba000a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:25:20.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:20.720+0000 7f0bbf7fe640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba0009840 0x7f0ba000a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:25:20.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:20.720+0000 7f0bbf7fe640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba0009840 0x7f0ba000a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:25:22.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.316+0000 7f0bbd7fa640 1 -- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba0009840 msgr2=0x7f0ba000a7c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:25:22.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.316+0000 7f0bbd7fa640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ba0009840 0x7f0ba000a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:22.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.316+0000 7f0bbd7fa640 1 -- 172.21.15.100:0/2679738316 >> v2:172.21.15.100:3300/0 conn(0x7f0bc00b3190 msgr2=0x7f0ba0009ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:25:22.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.316+0000 7f0bbd7fa640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.100:3300/0 conn(0x7f0bc00b3190 0x7f0ba0009ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:22.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.316+0000 7f0bbd7fa640 1 -- 172.21.15.100:0/2679738316 >> v1:172.21.15.100:6789/0 conn(0x7f0ba000a3e0 legacy=0x7f0ba0003b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:25:22.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.316+0000 7f0bbd7fa640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0ba000d520 0x7f0ba000d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:22.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.316+0000 7f0bbd7fa640 1 -- 172.21.15.100:0/2679738316 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bc015b250 con 0x7f0ba000e000 2024-09-11T22:25:22.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.316+0000 7f0bbd7fa640 1 -- 172.21.15.100:0/2679738316 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f0bc015e000 con 0x7f0ba000d520 2024-09-11T22:25:22.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.316+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0ba000d520 0x7f0ba000d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:22.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.316+0000 7f0bbeffd640 1 -- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0ba000d520 msgr2=0x7f0ba000d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:25:22.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.316+0000 7f0bbeffd640 1 -- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0ba000d520 msgr2=0x7f0ba000d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:25:22.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.316+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0ba000d520 0x7f0ba000d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:25:22.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.316+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0ba000d520 0x7f0ba000d930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:25:22.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.517+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0ba000d520 0x7f0ba000d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:22.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.517+0000 7f0bbeffd640 1 -- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0ba000d520 msgr2=0x7f0ba000d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:25:22.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.517+0000 7f0bbeffd640 1 -- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0ba000d520 msgr2=0x7f0ba000d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:25:22.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.517+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0ba000d520 0x7f0ba000d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:25:22.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.517+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0ba000d520 0x7f0ba000d930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:25:22.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.888+0000 7f0bbe7fc640 1 -- 172.21.15.100:0/2679738316 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 613871962 0 0) 0x7f0bc015b250 con 0x7f0ba000e000 2024-09-11T22:25:22.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.888+0000 7f0bbe7fc640 1 -- 172.21.15.100:0/2679738316 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bac003520 con 0x7f0ba000e000 2024-09-11T22:25:22.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.892+0000 7f0bbe7fc640 1 -- 172.21.15.100:0/2679738316 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1603472373 0 0) 0x7f0bac003520 con 0x7f0ba000e000 2024-09-11T22:25:22.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.892+0000 7f0bbe7fc640 1 -- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0ba000d520 msgr2=0x7f0ba000d930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:25:22.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.892+0000 7f0bbe7fc640 1 --2- 172.21.15.100:0/2679738316 >> v2:172.21.15.167:3300/0 conn(0x7f0ba000d520 0x7f0ba000d930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:22.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.892+0000 7f0bbe7fc640 1 -- 172.21.15.100:0/2679738316 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba000b000 con 0x7f0ba000e000 2024-09-11T22:25:22.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.892+0000 7f0bbe7fc640 1 -- 172.21.15.100:0/2679738316 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f0ba8009860 con 0x7f0ba000e000 2024-09-11T22:25:22.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.892+0000 7f0bbe7fc640 1 -- 172.21.15.100:0/2679738316 >> v1:172.21.15.167:6789/0 conn(0x7f0ba000e000 legacy=0x7f0ba0012610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:22.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.892+0000 7f0bbf7fe640 1 -- 172.21.15.100:0/2679738316 reap_dead start 2024-09-11T22:25:22.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.892+0000 7f0bbe7fc640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bac0039b0 0x7f0bac003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:22.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.892+0000 7f0bbe7fc640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac004800 0x7f0bac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:22.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.892+0000 7f0bbe7fc640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac005210 0x7f0bac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:22.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.892+0000 7f0bbe7fc640 1 -- 172.21.15.100:0/2679738316 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc015e000 con 0x7f0bac0039b0 2024-09-11T22:25:22.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.892+0000 7f0bbe7fc640 1 -- 172.21.15.100:0/2679738316 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0bac00c140 con 0x7f0bac004800 2024-09-11T22:25:22.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.892+0000 7f0bbe7fc640 1 -- 172.21.15.100:0/2679738316 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0bac00c340 con 0x7f0bac005210 2024-09-11T22:25:22.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.892+0000 7f0bbeffd640 1 -- 172.21.15.100:0/2679738316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bac0039b0 msgr2=0x7f0bac003db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:25:22.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.892+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bac0039b0 0x7f0bac003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:25:22.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.892+0000 7f0bb7fff640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac004800 0x7f0bac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:22.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.892+0000 7f0bbf7fe640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac005210 0x7f0bac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:22.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.892+0000 7f0bb7fff640 1 -- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac005210 msgr2=0x7f0bac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:25:22.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.892+0000 7f0bb7fff640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac005210 0x7f0bac00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:22.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.892+0000 7f0bb7fff640 1 -- 172.21.15.100:0/2679738316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bac0039b0 msgr2=0x7f0bac003db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:25:22.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.892+0000 7f0bb7fff640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bac0039b0 0x7f0bac003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:22.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.892+0000 7f0bb7fff640 1 -- 172.21.15.100:0/2679738316 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bac003520 con 0x7f0bac004800 2024-09-11T22:25:22.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.893+0000 7f0bb7fff640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac004800 0x7f0bac004c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8007090 tx=0x7f0bac005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b1726ebad9e6ed9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:22.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.896+0000 7f0bbe7fc640 1 -- 172.21.15.100:0/2679738316 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8031070 con 0x7f0bac004800 2024-09-11T22:25:22.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.897+0000 7f0bbe7fc640 1 -- 172.21.15.100:0/2679738316 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba802f070 con 0x7f0bac004800 2024-09-11T22:25:22.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.897+0000 7f0bbe7fc640 1 -- 172.21.15.100:0/2679738316 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba800b490 con 0x7f0bac004800 2024-09-11T22:25:22.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.897+0000 7f0bc585e640 1 -- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac004800 msgr2=0x7f0bac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:22.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.897+0000 7f0bc585e640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac004800 0x7f0bac004c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8007090 tx=0x7f0bac005830 comp rx=0 tx=0).stop 2024-09-11T22:25:22.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.897+0000 7f0bc585e640 1 -- 172.21.15.100:0/2679738316 shutdown_connections 2024-09-11T22:25:22.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.897+0000 7f0bc585e640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac005210 0x7f0bac00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:22.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.897+0000 7f0bc585e640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac004800 0x7f0bac004c80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:22.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.897+0000 7f0bc585e640 1 --2- 172.21.15.100:0/2679738316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bac0039b0 0x7f0bac003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:22.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.897+0000 7f0bc585e640 1 -- 172.21.15.100:0/2679738316 >> 172.21.15.100:0/2679738316 conn(0x7f0bc0067d40 msgr2=0x7f0bc006d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:22.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.898+0000 7f0bc585e640 1 -- 172.21.15.100:0/2679738316 shutdown_connections 2024-09-11T22:25:22.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.898+0000 7f0bc585e640 1 -- 172.21.15.100:0/2679738316 wait complete. 2024-09-11T22:25:22.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.899+0000 7f0bc585e640 1 Processor -- start 2024-09-11T22:25:22.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.899+0000 7f0bc585e640 1 -- start start 2024-09-11T22:25:22.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.900+0000 7f0bc585e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bac0039b0 0x7f0bc01539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:22.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.900+0000 7f0bc585e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac004800 0x7f0bc00b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:22.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.900+0000 7f0bc585e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac005210 0x7f0bc01f3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:22.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.900+0000 7f0bc585e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc00cb2a0 con 0x7f0bac0039b0 2024-09-11T22:25:22.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.900+0000 7f0bc585e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc00cb120 con 0x7f0bac005210 2024-09-11T22:25:22.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.900+0000 7f0bc585e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0bc00cb420 con 0x7f0bac004800 2024-09-11T22:25:22.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.900+0000 7f0bbeffd640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bac0039b0 msgr2=0x7f0bc01539d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:25:22.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.900+0000 7f0bbeffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bac0039b0 0x7f0bc01539d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:25:22.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.900+0000 7f0bbf7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac005210 0x7f0bc01f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:22.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.900+0000 7f0bb7fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac004800 0x7f0bc00b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:22.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.900+0000 7f0bb7fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac004800 0x7f0bc00b5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:50344/0 (socket says 172.21.15.100:50344) 2024-09-11T22:25:22.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.900+0000 7f0bbf7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac005210 0x7f0bc01f3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:58686/0 (socket says 172.21.15.100:58686) 2024-09-11T22:25:22.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.900+0000 7f0bb7fff640 1 -- 172.21.15.100:0/795252952 learned_addr learned my addr 172.21.15.100:0/795252952 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:22.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.901+0000 7f0bb7fff640 1 -- 172.21.15.100:0/795252952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac005210 msgr2=0x7f0bc01f3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:22.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.901+0000 7f0bb7fff640 1 --2- 172.21.15.100:0/795252952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac005210 0x7f0bc01f3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:22.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.901+0000 7f0bb7fff640 1 -- 172.21.15.100:0/795252952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bac0039b0 msgr2=0x7f0bc01539d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:25:22.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.901+0000 7f0bb7fff640 1 --2- 172.21.15.100:0/795252952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bac0039b0 0x7f0bc01539d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:22.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.901+0000 7f0bb7fff640 1 -- 172.21.15.100:0/795252952 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc0153f10 con 0x7f0bac004800 2024-09-11T22:25:22.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.901+0000 7f0bb7fff640 1 --2- 172.21.15.100:0/795252952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac004800 0x7f0bc00b5e20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8000ea0 tx=0x7f0ba8005d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:22.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.901+0000 7f0bbcff9640 1 -- 172.21.15.100:0/795252952 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8045020 con 0x7f0bac004800 2024-09-11T22:25:22.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.901+0000 7f0bbcff9640 1 -- 172.21.15.100:0/795252952 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba8036660 con 0x7f0bac004800 2024-09-11T22:25:22.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.901+0000 7f0bc585e640 1 -- 172.21.15.100:0/795252952 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bc01533b0 con 0x7f0bac004800 2024-09-11T22:25:22.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.901+0000 7f0bbcff9640 1 -- 172.21.15.100:0/795252952 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba803b040 con 0x7f0bac004800 2024-09-11T22:25:22.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.901+0000 7f0bc585e640 1 -- 172.21.15.100:0/795252952 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bc0149cf0 con 0x7f0bac004800 2024-09-11T22:25:22.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.902+0000 7f0bc585e640 1 -- 172.21.15.100:0/795252952 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bc015af70 con 0x7f0bac004800 2024-09-11T22:25:22.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.903+0000 7f0bbcff9640 1 -- 172.21.15.100:0/795252952 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ba8036a10 con 0x7f0bac004800 2024-09-11T22:25:22.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.903+0000 7f0bbcff9640 1 --2- 172.21.15.100:0/795252952 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0ba006d1d0 0x7f0ba006f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:22.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.903+0000 7f0bbcff9640 1 -- 172.21.15.100:0/795252952 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f0ba80abf80 con 0x7f0bac004800 2024-09-11T22:25:22.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.903+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/795252952 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0ba006d1d0 0x7f0ba006f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:22.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.904+0000 7f0bbeffd640 1 --2- 172.21.15.100:0/795252952 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0ba006d1d0 0x7f0ba006f690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0006fd0 tx=0x7f0bb0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:22.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:22.908+0000 7f0bbcff9640 1 -- 172.21.15.100:0/795252952 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0ba804f020 con 0x7f0bac004800 2024-09-11T22:25:23.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.166+0000 7f0bc585e640 1 -- 172.21.15.100:0/795252952 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0bc00cbaf0 con 0x7f0bac004800 2024-09-11T22:25:23.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.166+0000 7f0bbcff9640 1 -- 172.21.15.100:0/795252952 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7f0ba8005e20 con 0x7f0bac004800 2024-09-11T22:25:23.167 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":38,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:25:23.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.169+0000 7f0bc585e640 1 -- 172.21.15.100:0/795252952 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0ba006d1d0 msgr2=0x7f0ba006f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:23.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.169+0000 7f0bc585e640 1 --2- 172.21.15.100:0/795252952 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0ba006d1d0 0x7f0ba006f690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0006fd0 tx=0x7f0bb0008040 comp rx=0 tx=0).stop 2024-09-11T22:25:23.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.169+0000 7f0bc585e640 1 -- 172.21.15.100:0/795252952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac004800 msgr2=0x7f0bc00b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:23.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.169+0000 7f0bc585e640 1 --2- 172.21.15.100:0/795252952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac004800 0x7f0bc00b5e20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8000ea0 tx=0x7f0ba8005d40 comp rx=0 tx=0).stop 2024-09-11T22:25:23.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.169+0000 7f0bc585e640 1 -- 172.21.15.100:0/795252952 shutdown_connections 2024-09-11T22:25:23.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.169+0000 7f0bc585e640 1 --2- 172.21.15.100:0/795252952 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0ba006d1d0 0x7f0ba006f690 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:23.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.169+0000 7f0bc585e640 1 --2- 172.21.15.100:0/795252952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bac005210 0x7f0bc01f3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:23.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.169+0000 7f0bc585e640 1 --2- 172.21.15.100:0/795252952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0bac004800 0x7f0bc00b5e20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:23.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.169+0000 7f0bc585e640 1 --2- 172.21.15.100:0/795252952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bac0039b0 0x7f0bc01539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:23.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.169+0000 7f0bc585e640 1 -- 172.21.15.100:0/795252952 >> 172.21.15.100:0/795252952 conn(0x7f0bc0067d40 msgr2=0x7f0bc0159be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:23.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.169+0000 7f0bc585e640 1 -- 172.21.15.100:0/795252952 shutdown_connections 2024-09-11T22:25:23.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.169+0000 7f0bc585e640 1 -- 172.21.15.100:0/795252952 wait complete. 2024-09-11T22:25:23.181 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-11T22:25:23.181 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-11T22:25:23.182 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:25:23.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.292+0000 7fba269b9640 1 Processor -- start 2024-09-11T22:25:23.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.292+0000 7fba269b9640 1 -- start start 2024-09-11T22:25:23.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.292+0000 7fba269b9640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fba2006d240 0x7fba201546b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:23.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.292+0000 7fba269b9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fba2015b2e0 0x7fba20154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:23.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.292+0000 7fba269b9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba200c6510 con 0x7fba2006ce60 2024-09-11T22:25:23.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.292+0000 7fba269b9640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fba2015b820 con 0x7fba2006d240 2024-09-11T22:25:23.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.292+0000 7fba269b9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fba200c5470 con 0x7fba2015b2e0 2024-09-11T22:25:23.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.293+0000 7fba17fff640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7fba2006d240 msgr2=0x7fba201546b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:25:23.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.293+0000 7fba17fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fba2006d240 0x7fba201546b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:25:23.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.293+0000 7fba1ffff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fba2006ce60 0x7fba2015bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:48054/0 (socket says 172.21.15.100:48054) 2024-09-11T22:25:23.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.293+0000 7fba24f56640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fba2015b2e0 0x7fba20154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:23.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.293+0000 7fba1ffff640 1 -- 172.21.15.100:0/1142083092 learned_addr learned my addr 172.21.15.100:0/1142083092 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:25:23.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.293+0000 7fba1f7fe640 1 -- 172.21.15.100:0/1142083092 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 21037144 0 0) 0x7fba200c6510 con 0x7fba2006ce60 2024-09-11T22:25:23.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.293+0000 7fba1f7fe640 1 -- 172.21.15.100:0/1142083092 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba0c003520 con 0x7fba2006ce60 2024-09-11T22:25:23.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.293+0000 7fba24f56640 1 -- 172.21.15.100:0/1142083092 >> v2:172.21.15.100:3300/0 conn(0x7fba2006d240 msgr2=0x7fba201546b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:25:23.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.293+0000 7fba24f56640 1 --2- 172.21.15.100:0/1142083092 >> v2:172.21.15.100:3300/0 conn(0x7fba2006d240 0x7fba201546b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:23.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.293+0000 7fba24f56640 1 -- 172.21.15.100:0/1142083092 >> v1:172.21.15.167:6789/0 conn(0x7fba2006ce60 legacy=0x7fba2015bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:23.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.293+0000 7fba24f56640 1 -- 172.21.15.100:0/1142083092 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba200c5750 con 0x7fba2015b2e0 2024-09-11T22:25:23.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.294+0000 7fba24f56640 1 --2- 172.21.15.100:0/1142083092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba2015b2e0 0x7fba20154bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fba2006d780 tx=0x7fba1802a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79d17dfd6a08e8fa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:23.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.294+0000 7fba1f7fe640 1 -- 172.21.15.100:0/1142083092 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba18007740 con 0x7fba2015b2e0 2024-09-11T22:25:23.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.294+0000 7fba1f7fe640 1 -- 172.21.15.100:0/1142083092 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba180078e0 con 0x7fba2015b2e0 2024-09-11T22:25:23.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.294+0000 7fba1f7fe640 1 -- 172.21.15.100:0/1142083092 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba18007c90 con 0x7fba2015b2e0 2024-09-11T22:25:23.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.295+0000 7fba269b9640 1 -- 172.21.15.100:0/1142083092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba2015b2e0 msgr2=0x7fba20154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:23.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.295+0000 7fba269b9640 1 --2- 172.21.15.100:0/1142083092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba2015b2e0 0x7fba20154bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fba2006d780 tx=0x7fba1802a6a0 comp rx=0 tx=0).stop 2024-09-11T22:25:23.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.295+0000 7fba269b9640 1 -- 172.21.15.100:0/1142083092 shutdown_connections 2024-09-11T22:25:23.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.295+0000 7fba269b9640 1 --2- 172.21.15.100:0/1142083092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba2015b2e0 0x7fba20154bf0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:23.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.295+0000 7fba269b9640 1 --2- 172.21.15.100:0/1142083092 >> v2:172.21.15.100:3300/0 conn(0x7fba2006d240 0x7fba201546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:23.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.295+0000 7fba269b9640 1 -- 172.21.15.100:0/1142083092 >> 172.21.15.100:0/1142083092 conn(0x7fba2006bc10 msgr2=0x7fba2006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:23.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.295+0000 7fba269b9640 1 -- 172.21.15.100:0/1142083092 shutdown_connections 2024-09-11T22:25:23.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.295+0000 7fba269b9640 1 -- 172.21.15.100:0/1142083092 wait complete. 2024-09-11T22:25:23.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.296+0000 7fba269b9640 1 Processor -- start 2024-09-11T22:25:23.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.296+0000 7fba269b9640 1 -- start start 2024-09-11T22:25:23.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.297+0000 7fba269b9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba2006ce60 0x7fba201f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:23.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.297+0000 7fba269b9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba2006d240 0x7fba201f4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:23.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.297+0000 7fba269b9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba2015b2e0 0x7fba201f0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:23.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.297+0000 7fba269b9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fba2015c460 con 0x7fba2006ce60 2024-09-11T22:25:23.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.297+0000 7fba269b9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fba200c5d10 con 0x7fba2015b2e0 2024-09-11T22:25:23.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.297+0000 7fba269b9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fba200cb1b0 con 0x7fba2006d240 2024-09-11T22:25:23.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.297+0000 7fba1ffff640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba2006ce60 msgr2=0x7fba201f3d10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:25:23.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.297+0000 7fba1ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba2006ce60 0x7fba201f3d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:25:23.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.297+0000 7fba24f56640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba2015b2e0 0x7fba201f0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:23.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.297+0000 7fba17fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba2006d240 0x7fba201f4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:23.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.297+0000 7fba24f56640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba2015b2e0 0x7fba201f0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:58698/0 (socket says 172.21.15.100:58698) 2024-09-11T22:25:23.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.297+0000 7fba17fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba2006d240 0x7fba201f4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:50358/0 (socket says 172.21.15.100:50358) 2024-09-11T22:25:23.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.297+0000 7fba24f56640 1 -- 172.21.15.100:0/1940706480 learned_addr learned my addr 172.21.15.100:0/1940706480 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:23.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.298+0000 7fba24f56640 1 -- 172.21.15.100:0/1940706480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba2006d240 msgr2=0x7fba201f4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:23.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.298+0000 7fba24f56640 1 --2- 172.21.15.100:0/1940706480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba2006d240 0x7fba201f4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:23.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.298+0000 7fba24f56640 1 -- 172.21.15.100:0/1940706480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba2006ce60 msgr2=0x7fba201f3d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:25:23.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.298+0000 7fba24f56640 1 --2- 172.21.15.100:0/1940706480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba2006ce60 0x7fba201f3d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:23.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.298+0000 7fba24f56640 1 -- 172.21.15.100:0/1940706480 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba200cd5c0 con 0x7fba2015b2e0 2024-09-11T22:25:23.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.298+0000 7fba17fff640 1 --2- 172.21.15.100:0/1940706480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba2006d240 0x7fba201f4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:25:23.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.298+0000 7fba24f56640 1 --2- 172.21.15.100:0/1940706480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba2015b2e0 0x7fba201f0530 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fba18009e50 tx=0x7fba18004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:23.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.298+0000 7fba1d7fa640 1 -- 172.21.15.100:0/1940706480 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1803f070 con 0x7fba2015b2e0 2024-09-11T22:25:23.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.298+0000 7fba1d7fa640 1 -- 172.21.15.100:0/1940706480 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba18031c70 con 0x7fba2015b2e0 2024-09-11T22:25:23.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.298+0000 7fba269b9640 1 -- 172.21.15.100:0/1940706480 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba201f4950 con 0x7fba2015b2e0 2024-09-11T22:25:23.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.298+0000 7fba1d7fa640 1 -- 172.21.15.100:0/1940706480 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba18009450 con 0x7fba2015b2e0 2024-09-11T22:25:23.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.298+0000 7fba269b9640 1 -- 172.21.15.100:0/1940706480 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba200cc800 con 0x7fba2015b2e0 2024-09-11T22:25:23.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.299+0000 7fba269b9640 1 --2- 172.21.15.100:0/1940706480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba2014a820 0x7fba200cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:23.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.299+0000 7fba269b9640 1 -- 172.21.15.100:0/1940706480 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fba200ccf10 con 0x7fba2014a820 2024-09-11T22:25:23.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.299+0000 7fba1ffff640 1 --2- 172.21.15.100:0/1940706480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba2014a820 0x7fba200cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:23.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.299+0000 7fba1ffff640 1 -- 172.21.15.100:0/1940706480 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba2015b100 con 0x7fba2014a820 2024-09-11T22:25:23.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.300+0000 7fba1ffff640 1 --2- 172.21.15.100:0/1940706480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba2014a820 0x7fba200cc9d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fba10004810 tx=0x7fba1000c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:23.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.300+0000 7fba1d7fa640 1 -- 172.21.15.100:0/1940706480 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba10017070 con 0x7fba2014a820 2024-09-11T22:25:23.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.300+0000 7fba1d7fa640 1 -- 172.21.15.100:0/1940706480 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba18003bb0 con 0x7fba2015b2e0 2024-09-11T22:25:23.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.300+0000 7fba1d7fa640 1 --2- 172.21.15.100:0/1940706480 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fba0006bd30 0x7fba0006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:23.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.300+0000 7fba1d7fa640 1 -- 172.21.15.100:0/1940706480 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fba180abeb0 con 0x7fba2015b2e0 2024-09-11T22:25:23.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.300+0000 7fba17fff640 1 --2- 172.21.15.100:0/1940706480 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fba0006bd30 0x7fba0006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:23.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.300+0000 7fba1d7fa640 1 -- 172.21.15.100:0/1940706480 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fba10005ce0 con 0x7fba2014a820 2024-09-11T22:25:23.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.300+0000 7fba1d7fa640 1 -- 172.21.15.100:0/1940706480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba2014a820 msgr2=0x7fba200cc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:23.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.300+0000 7fba1d7fa640 1 --2- 172.21.15.100:0/1940706480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba2014a820 0x7fba200cc9d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fba10004810 tx=0x7fba1000c8e0 comp rx=0 tx=0).stop 2024-09-11T22:25:23.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.301+0000 7fba1d7fa640 1 -- 172.21.15.100:0/1940706480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba2014a820 msgr2=0x7fba200cc9d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:25:23.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.301+0000 7fba1d7fa640 1 --2- 172.21.15.100:0/1940706480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba2014a820 0x7fba200cc9d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:23.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.301+0000 7fba17fff640 1 --2- 172.21.15.100:0/1940706480 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fba0006bd30 0x7fba0006e1f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fba080093f0 tx=0x7fba08009380 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:23.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.308+0000 7fba269b9640 1 --2- 172.21.15.100:0/1940706480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba200cb420 0x7fba201f0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:23.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.308+0000 7fba269b9640 1 -- 172.21.15.100:0/1940706480 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fba200cad20 con 0x7fba200cb420 2024-09-11T22:25:23.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.308+0000 7fba1ffff640 1 --2- 172.21.15.100:0/1940706480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba200cb420 0x7fba201f0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:23.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.308+0000 7fba1ffff640 1 -- 172.21.15.100:0/1940706480 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fba2014ac80 con 0x7fba200cb420 2024-09-11T22:25:23.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.309+0000 7fba1ffff640 1 --2- 172.21.15.100:0/1940706480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba200cb420 0x7fba201f0a70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fba20050090 tx=0x7fba10000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:23.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.309+0000 7fba1d7fa640 1 -- 172.21.15.100:0/1940706480 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1001a2a0 con 0x7fba200cb420 2024-09-11T22:25:23.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.309+0000 7fba1d7fa640 1 -- 172.21.15.100:0/1940706480 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4878 (secure 0 0 0) 0x7fba1001a2a0 con 0x7fba200cb420 2024-09-11T22:25:23.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.309+0000 7fba1d7fa640 1 -- 172.21.15.100:0/1940706480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba200cb420 msgr2=0x7fba201f0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:23.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.309+0000 7fba1d7fa640 1 --2- 172.21.15.100:0/1940706480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba200cb420 0x7fba201f0a70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fba20050090 tx=0x7fba10000ed0 comp rx=0 tx=0).stop 2024-09-11T22:25:23.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.309+0000 7fba1d7fa640 1 -- 172.21.15.100:0/1940706480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba200cb420 msgr2=0x7fba201f0a70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:25:23.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.309+0000 7fba1d7fa640 1 --2- 172.21.15.100:0/1940706480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba200cb420 0x7fba201f0a70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:23.311 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:25:23.311 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:25:23.311 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:25:23.311 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:25:23.311 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 38, 2024-09-11T22:25:23.311 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 108588, 2024-09-11T22:25:23.311 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:25:23.311 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:25:23.311 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:25:23.311 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:23.311 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:25:23.311 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:25:23.311 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:25:23.312 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:25:23.312 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:23.312 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:23.312 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:23.312 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:23.312 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:23.312 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:23.312 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:23.312 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:23.312 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:23.312 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:23.312 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:23.312 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:23.313 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:25:23.313 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:25:23.313 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:23.313 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:23.313 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:23.313 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:23.313 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:23.313 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:23.313 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:23.313 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:23.313 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:23.313 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:23.313 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:23.313 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:23.314 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.314 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:25:23.314 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:25:23.314 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:25:23.314 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:25:23.314 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:25:23.314 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:25:23.314 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:25:23.314 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:25:23.314 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:25:23.315 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:25:23.315 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:25:23.315 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:25:23.315 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:25:23.315 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:25:23.315 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:25:23.315 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:25:23.315 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:25:23.315 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:23.315 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:23.315 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:23.315 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:23.316 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:23.316 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:23.316 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:23.316 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:23.316 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:23.316 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:23.316 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:23.316 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:23.316 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:25:23.316 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.316 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:25:23.316 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.316 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:25:23.316 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:25:23.317 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:23.317 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:23.317 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.317 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:23.317 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:25:23.317 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:23.317 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.317 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.317 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:23.317 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:25:23.317 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:23.317 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:23.317 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:23.317 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.318 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:25:23.318 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:25:23.318 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:23.318 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:23.318 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:23.318 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.318 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.318 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:25:23.318 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:25:23.318 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:23.318 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:23.318 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.318 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:23.318 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:25:23.319 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:23.319 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.319 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.319 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:23.319 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:25:23.319 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:23.319 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:23.319 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:23.319 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.319 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:25:23.319 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:25:23.319 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:23.319 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:23.319 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:23.319 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.320 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.320 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:25:23.320 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:25:23.320 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:23.320 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:23.320 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.320 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:23.320 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:25:23.320 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:23.320 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.320 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.320 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:23.320 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:25:23.320 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:23.321 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:23.321 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:23.321 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.321 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:25:23.321 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:25:23.321 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:23.321 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:23.321 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:23.321 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:23.321 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:23.321 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.321 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:25:23.321 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:25:23.321 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.322 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:23.322 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:23.322 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:25:23.322 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:23.322 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:23.322 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:25:23.322 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.322 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:23.322 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:23.322 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:25:23.322 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:23.322 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:23.322 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:25:23.323 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.323 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:23.323 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:23.323 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:25:23.323 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:23.323 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:23.323 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:25:23.323 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.323 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:23.323 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:23.323 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:25:23.323 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:23.323 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:23.323 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.324 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:25:23.324 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:25:23.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.309+0000 7fba269b9640 1 -- 172.21.15.100:0/1940706480 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fba0006bd30 msgr2=0x7fba0006e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:23.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.309+0000 7fba269b9640 1 --2- 172.21.15.100:0/1940706480 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fba0006bd30 0x7fba0006e1f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fba080093f0 tx=0x7fba08009380 comp rx=0 tx=0).stop 2024-09-11T22:25:23.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.309+0000 7fba269b9640 1 -- 172.21.15.100:0/1940706480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba2015b2e0 msgr2=0x7fba201f0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:23.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.309+0000 7fba269b9640 1 --2- 172.21.15.100:0/1940706480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba2015b2e0 0x7fba201f0530 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fba18009e50 tx=0x7fba18004a40 comp rx=0 tx=0).stop 2024-09-11T22:25:23.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.309+0000 7fba24f56640 1 -- 172.21.15.100:0/1940706480 reap_dead start 2024-09-11T22:25:23.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.309+0000 7fba24f56640 1 -- 172.21.15.100:0/1940706480 reap_dead start 2024-09-11T22:25:23.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.309+0000 7fba269b9640 1 -- 172.21.15.100:0/1940706480 shutdown_connections 2024-09-11T22:25:23.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.309+0000 7fba269b9640 1 -- 172.21.15.100:0/1940706480 >> 172.21.15.100:0/1940706480 conn(0x7fba2006bc10 msgr2=0x7fba2015d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:23.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.310+0000 7fba269b9640 1 -- 172.21.15.100:0/1940706480 shutdown_connections 2024-09-11T22:25:23.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.310+0000 7fba269b9640 1 -- 172.21.15.100:0/1940706480 wait complete. 2024-09-11T22:25:23.326 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:25:23.326 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-11T22:25:23.326 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:25:23.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.435+0000 7fba15903640 1 Processor -- start 2024-09-11T22:25:23.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.435+0000 7fba15903640 1 -- start start 2024-09-11T22:25:23.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.436+0000 7fba15903640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fba10152c70 0x7fba100c9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:23.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.436+0000 7fba15903640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fba100c4f80 0x7fba1006ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.436+0000 7fba15903640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba100b0f00 con 0x7fba100c9dd0 2024-09-11T22:25:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.436+0000 7fba15903640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fba10153050 con 0x7fba100c4f80 2024-09-11T22:25:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.436+0000 7fba15903640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fba100ca440 con 0x7fba10152c70 2024-09-11T22:25:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.436+0000 7fba0e7fc640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7fba100c9dd0 legacy=0x7fba100ce160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:25:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.436+0000 7fba0f7fe640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7fba100c4f80 msgr2=0x7fba1006ff00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:25:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.436+0000 7fba0f7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fba100c4f80 0x7fba1006ff00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:25:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.437+0000 7fba0effd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fba10152c70 0x7fba100c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.437+0000 7fba0effd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fba10152c70 0x7fba100c9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:58726/0 (socket says 172.21.15.100:58726) 2024-09-11T22:25:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.437+0000 7fba0effd640 1 -- 172.21.15.100:0/4024168442 learned_addr learned my addr 172.21.15.100:0/4024168442 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.437+0000 7fba0effd640 1 -- 172.21.15.100:0/4024168442 >> v2:172.21.15.100:3300/0 conn(0x7fba100c4f80 msgr2=0x7fba1006ff00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:25:23.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.437+0000 7fba0effd640 1 --2- 172.21.15.100:0/4024168442 >> v2:172.21.15.100:3300/0 conn(0x7fba100c4f80 0x7fba1006ff00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:23.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.437+0000 7fba0effd640 1 -- 172.21.15.100:0/4024168442 >> v1:172.21.15.100:6789/0 conn(0x7fba100c9dd0 legacy=0x7fba100ce160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:25:23.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.437+0000 7fba0effd640 1 -- 172.21.15.100:0/4024168442 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba100c33d0 con 0x7fba10152c70 2024-09-11T22:25:23.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.438+0000 7fba0effd640 1 --2- 172.21.15.100:0/4024168442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba10152c70 0x7fba100c9820 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fba100cbdb0 tx=0x7fba0002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94714b5fe2544d8f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:23.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.438+0000 7fba0dffb640 1 -- 172.21.15.100:0/4024168442 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba00037070 con 0x7fba10152c70 2024-09-11T22:25:23.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.438+0000 7fba0dffb640 1 -- 172.21.15.100:0/4024168442 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba00032440 con 0x7fba10152c70 2024-09-11T22:25:23.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.438+0000 7fba0dffb640 1 -- 172.21.15.100:0/4024168442 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba00032810 con 0x7fba10152c70 2024-09-11T22:25:23.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.439+0000 7fba15903640 1 -- 172.21.15.100:0/4024168442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba10152c70 msgr2=0x7fba100c9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:23.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.439+0000 7fba15903640 1 --2- 172.21.15.100:0/4024168442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba10152c70 0x7fba100c9820 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fba100cbdb0 tx=0x7fba0002a1c0 comp rx=0 tx=0).stop 2024-09-11T22:25:23.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.439+0000 7fba15903640 1 -- 172.21.15.100:0/4024168442 shutdown_connections 2024-09-11T22:25:23.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.439+0000 7fba15903640 1 --2- 172.21.15.100:0/4024168442 >> v2:172.21.15.100:3300/0 conn(0x7fba100c4f80 0x7fba1006ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:23.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.439+0000 7fba15903640 1 --2- 172.21.15.100:0/4024168442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba10152c70 0x7fba100c9820 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:23.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.439+0000 7fba15903640 1 -- 172.21.15.100:0/4024168442 >> 172.21.15.100:0/4024168442 conn(0x7fba1006de20 msgr2=0x7fba1006e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:23.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.439+0000 7fba15903640 1 -- 172.21.15.100:0/4024168442 shutdown_connections 2024-09-11T22:25:23.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.439+0000 7fba15903640 1 -- 172.21.15.100:0/4024168442 wait complete. 2024-09-11T22:25:23.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.440+0000 7fba15903640 1 Processor -- start 2024-09-11T22:25:23.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.440+0000 7fba15903640 1 -- start start 2024-09-11T22:25:23.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.441+0000 7fba15903640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba100c4f80 0x7fba100b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:23.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.441+0000 7fba15903640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba100c9dd0 0x7fba100cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:23.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.441+0000 7fba15903640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba10152c70 0x7fba1006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:23.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.441+0000 7fba15903640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fba100c3990 con 0x7fba100c4f80 2024-09-11T22:25:23.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.441+0000 7fba15903640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fba100ca6e0 con 0x7fba100c9dd0 2024-09-11T22:25:23.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.441+0000 7fba15903640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fba100ce870 con 0x7fba10152c70 2024-09-11T22:25:23.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.441+0000 7fba0effd640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba100c4f80 msgr2=0x7fba100b23c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:25:23.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.441+0000 7fba0effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba100c4f80 0x7fba100b23c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:25:23.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.441+0000 7fba0f7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba10152c70 0x7fba1006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:23.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.441+0000 7fba0f7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba10152c70 0x7fba1006ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:50374/0 (socket says 172.21.15.100:50374) 2024-09-11T22:25:23.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.441+0000 7fba0f7fe640 1 -- 172.21.15.100:0/1276688004 learned_addr learned my addr 172.21.15.100:0/1276688004 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:23.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.441+0000 7fba0e7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba100c9dd0 0x7fba100cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:23.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.442+0000 7fba0f7fe640 1 -- 172.21.15.100:0/1276688004 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba100c9dd0 msgr2=0x7fba100cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:23.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.442+0000 7fba0f7fe640 1 --2- 172.21.15.100:0/1276688004 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba100c9dd0 0x7fba100cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:23.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.442+0000 7fba0f7fe640 1 -- 172.21.15.100:0/1276688004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba100c4f80 msgr2=0x7fba100b23c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:25:23.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.442+0000 7fba0f7fe640 1 --2- 172.21.15.100:0/1276688004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba100c4f80 0x7fba100b23c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:23.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.442+0000 7fba0f7fe640 1 -- 172.21.15.100:0/1276688004 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1006bdc0 con 0x7fba10152c70 2024-09-11T22:25:23.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.442+0000 7fba0f7fe640 1 --2- 172.21.15.100:0/1276688004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba10152c70 0x7fba1006ca40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fba0800be90 tx=0x7fba08009f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:23.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.442+0000 7fb9f7fff640 1 -- 172.21.15.100:0/1276688004 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba08015470 con 0x7fba10152c70 2024-09-11T22:25:23.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.442+0000 7fb9f7fff640 1 -- 172.21.15.100:0/1276688004 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba08010070 con 0x7fba10152c70 2024-09-11T22:25:23.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.442+0000 7fb9f7fff640 1 -- 172.21.15.100:0/1276688004 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba08015890 con 0x7fba10152c70 2024-09-11T22:25:23.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.442+0000 7fba15903640 1 -- 172.21.15.100:0/1276688004 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba101f0fe0 con 0x7fba10152c70 2024-09-11T22:25:23.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.442+0000 7fba15903640 1 -- 172.21.15.100:0/1276688004 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fba101e5920 con 0x7fba10152c70 2024-09-11T22:25:23.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.443+0000 7fba15903640 1 --2- 172.21.15.100:0/1276688004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba100b30c0 0x7fba1006cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:23.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.443+0000 7fba15903640 1 -- 172.21.15.100:0/1276688004 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fba101e5780 con 0x7fba100b30c0 2024-09-11T22:25:23.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.443+0000 7fba0effd640 1 --2- 172.21.15.100:0/1276688004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba100b30c0 0x7fba1006cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:23.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.444+0000 7fba0effd640 1 -- 172.21.15.100:0/1276688004 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba100c9820 con 0x7fba100b30c0 2024-09-11T22:25:23.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.444+0000 7fba0effd640 1 --2- 172.21.15.100:0/1276688004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba100b30c0 0x7fba1006cf80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fba100c4930 tx=0x7fba000046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:23.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.444+0000 7fb9f7fff640 1 -- 172.21.15.100:0/1276688004 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba08005070 con 0x7fba10152c70 2024-09-11T22:25:23.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.444+0000 7fb9f7fff640 1 --2- 172.21.15.100:0/1276688004 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb9fc06bde0 0x7fb9fc06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:23.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.444+0000 7fb9f7fff640 1 -- 172.21.15.100:0/1276688004 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fba0808b840 con 0x7fba10152c70 2024-09-11T22:25:23.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.444+0000 7fba0e7fc640 1 --2- 172.21.15.100:0/1276688004 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb9fc06bde0 0x7fb9fc06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:23.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.445+0000 7fb9f7fff640 1 -- 172.21.15.100:0/1276688004 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba00037040 con 0x7fba100b30c0 2024-09-11T22:25:23.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.445+0000 7fb9f7fff640 1 -- 172.21.15.100:0/1276688004 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fba00004020 con 0x7fba100b30c0 2024-09-11T22:25:23.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.445+0000 7fb9f7fff640 1 -- 172.21.15.100:0/1276688004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba100b30c0 msgr2=0x7fba1006cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:23.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.445+0000 7fb9f7fff640 1 --2- 172.21.15.100:0/1276688004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba100b30c0 0x7fba1006cf80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fba100c4930 tx=0x7fba000046c0 comp rx=0 tx=0).stop 2024-09-11T22:25:23.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.445+0000 7fb9f7fff640 1 -- 172.21.15.100:0/1276688004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba100b30c0 msgr2=0x7fba1006cf80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:25:23.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.445+0000 7fb9f7fff640 1 --2- 172.21.15.100:0/1276688004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba100b30c0 0x7fba1006cf80 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fba100c4930 tx=0x7fba000046c0 comp rx=0 tx=0).stop 2024-09-11T22:25:23.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.445+0000 7fba0e7fc640 1 --2- 172.21.15.100:0/1276688004 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb9fc06bde0 0x7fb9fc06e2a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fba10150b20 tx=0x7fba04009110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:23.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.452+0000 7fba15903640 1 --2- 172.21.15.100:0/1276688004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba101e5b60 0x7fba10148980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:23.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.452+0000 7fba15903640 1 -- 172.21.15.100:0/1276688004 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fba101514d0 con 0x7fba101e5b60 2024-09-11T22:25:23.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.452+0000 7fba0effd640 1 --2- 172.21.15.100:0/1276688004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba101e5b60 0x7fba10148980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:23.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.452+0000 7fba0effd640 1 -- 172.21.15.100:0/1276688004 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fba10070d80 con 0x7fba101e5b60 2024-09-11T22:25:23.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.453+0000 7fba0effd640 1 --2- 172.21.15.100:0/1276688004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba101e5b60 0x7fba10148980 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fba00000c00 tx=0x7fba00009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:23.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.453+0000 7fb9f7fff640 1 -- 172.21.15.100:0/1276688004 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0004d070 con 0x7fba101e5b60 2024-09-11T22:25:23.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.453+0000 7fb9f7fff640 1 -- 172.21.15.100:0/1276688004 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5043 (secure 0 0 0) 0x7fba0004b070 con 0x7fba101e5b60 2024-09-11T22:25:23.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.453+0000 7fb9f7fff640 1 -- 172.21.15.100:0/1276688004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba101e5b60 msgr2=0x7fba10148980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:23.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.453+0000 7fb9f7fff640 1 --2- 172.21.15.100:0/1276688004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba101e5b60 0x7fba10148980 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fba00000c00 tx=0x7fba00009240 comp rx=0 tx=0).stop 2024-09-11T22:25:23.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.453+0000 7fb9f7fff640 1 -- 172.21.15.100:0/1276688004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba101e5b60 msgr2=0x7fba10148980 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:25:23.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.453+0000 7fb9f7fff640 1 --2- 172.21.15.100:0/1276688004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba101e5b60 0x7fba10148980 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fba00000c00 tx=0x7fba00009240 comp rx=0 tx=0).stop 2024-09-11T22:25:23.455 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:25:23.455 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:25:23.455 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:25:23.455 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:25:23.455 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 38, 2024-09-11T22:25:23.455 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 214175, 2024-09-11T22:25:23.455 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:25:23.455 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:25:23.455 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:25:23.455 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:23.456 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:25:23.456 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:25:23.456 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:25:23.456 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:25:23.456 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:23.456 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:23.456 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:23.456 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:23.456 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:23.456 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:23.456 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:23.456 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:23.456 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:23.457 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:23.457 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:23.457 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:23.457 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:25:23.457 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:25:23.457 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:23.457 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:23.457 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:23.457 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:23.457 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:23.457 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:23.457 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:23.457 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:23.457 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:23.458 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:23.458 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:23.458 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:23.458 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.458 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:25:23.458 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:25:23.458 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:25:23.458 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:25:23.458 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:25:23.458 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:25:23.458 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:25:23.458 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:25:23.458 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:25:23.458 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:25:23.459 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:25:23.459 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:25:23.459 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:25:23.459 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:25:23.459 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:25:23.459 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:25:23.459 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:25:23.459 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:23.459 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:23.459 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:23.459 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:23.459 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:23.459 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:23.459 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:23.460 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:23.460 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:23.460 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:23.460 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:23.460 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:23.460 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:25:23.460 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.460 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:25:23.460 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.460 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:25:23.460 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:25:23.460 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:23.460 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:23.461 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.461 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:23.461 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:25:23.461 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:23.461 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.461 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.461 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:23.461 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:25:23.461 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:23.461 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:23.461 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:23.462 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.462 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:25:23.462 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:25:23.462 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:23.462 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:23.462 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:23.462 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.462 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.462 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:25:23.462 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:25:23.462 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:23.462 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:23.462 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.463 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:23.463 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:25:23.463 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:23.463 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.463 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.463 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:23.463 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:25:23.463 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:23.463 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:23.463 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:23.463 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.463 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:25:23.463 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:25:23.464 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:23.464 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:23.464 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:23.464 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.464 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.464 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:25:23.464 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:25:23.464 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:23.464 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:23.464 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.464 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:23.464 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:25:23.464 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:23.465 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.465 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.465 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:23.465 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:25:23.465 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:23.465 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:23.465 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:23.465 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.465 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:25:23.465 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:25:23.465 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:23.465 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:23.466 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:23.466 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:23.466 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:23.466 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.466 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:25:23.466 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:25:23.466 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.466 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:23.466 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:23.466 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:25:23.466 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:23.466 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:23.467 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:25:23.467 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.467 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:23.467 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:23.467 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:25:23.467 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:23.468 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:23.468 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:25:23.468 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.468 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:23.468 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:23.469 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:25:23.469 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:23.469 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:23.469 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:25:23.469 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.469 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:23.469 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:23.469 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 6 2024-09-11T22:25:23.469 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:23.469 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:23.470 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:25:23.470 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:23.470 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:23.470 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:23.470 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:25:23.470 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:23.470 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:23.470 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:23.470 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:25:23.471 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:25:23.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.453+0000 7fba15903640 1 -- 172.21.15.100:0/1276688004 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb9fc06bde0 msgr2=0x7fb9fc06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:23.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.453+0000 7fba15903640 1 --2- 172.21.15.100:0/1276688004 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb9fc06bde0 0x7fb9fc06e2a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fba10150b20 tx=0x7fba04009110 comp rx=0 tx=0).stop 2024-09-11T22:25:23.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.453+0000 7fba15903640 1 -- 172.21.15.100:0/1276688004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba10152c70 msgr2=0x7fba1006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:23.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.453+0000 7fba15903640 1 --2- 172.21.15.100:0/1276688004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba10152c70 0x7fba1006ca40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fba0800be90 tx=0x7fba08009f30 comp rx=0 tx=0).stop 2024-09-11T22:25:23.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.453+0000 7fba0f7fe640 1 -- 172.21.15.100:0/1276688004 reap_dead start 2024-09-11T22:25:23.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.453+0000 7fba0f7fe640 1 -- 172.21.15.100:0/1276688004 reap_dead start 2024-09-11T22:25:23.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.454+0000 7fba15903640 1 -- 172.21.15.100:0/1276688004 shutdown_connections 2024-09-11T22:25:23.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.454+0000 7fba15903640 1 -- 172.21.15.100:0/1276688004 >> 172.21.15.100:0/1276688004 conn(0x7fba1006de20 msgr2=0x7fba1014d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:23.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.454+0000 7fba15903640 1 -- 172.21.15.100:0/1276688004 shutdown_connections 2024-09-11T22:25:23.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:23.454+0000 7fba15903640 1 -- 172.21.15.100:0/1276688004 wait complete. 2024-09-11T22:25:23.473 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:25:23.473 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-11T22:25:43.474 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:25:43.475 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-11T22:25:43.475 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T22:25:43.475 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T22:25:43.478 INFO:tasks.ceph.mon.a:Started 2024-09-11T22:25:43.478 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:25:43.478 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:25:43.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.589+0000 7f1bdb235640 1 Processor -- start 2024-09-11T22:25:43.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.589+0000 7f1bdb235640 1 -- start start 2024-09-11T22:25:43.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.590+0000 7f1bdb235640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1bd4154c20 0x7f1bd40cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:43.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.590+0000 7f1bdb235640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bd40b3190 0x7f1bd415e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:43.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.590+0000 7f1bdb235640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bd415ac90 con 0x7f1bd415a7e0 2024-09-11T22:25:43.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.590+0000 7f1bdb235640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f1bd415e000 con 0x7f1bd4154c20 2024-09-11T22:25:43.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.590+0000 7f1bdb235640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd415af70 con 0x7f1bd40b3190 2024-09-11T22:25:43.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.591+0000 7f1bd97d2640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1bd415a7e0 0x7f1bd40cbd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39130/0 (socket says 172.21.15.100:39130) 2024-09-11T22:25:43.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.591+0000 7f1bd97d2640 1 -- 172.21.15.100:0/2601123118 learned_addr learned my addr 172.21.15.100:0/2601123118 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:25:43.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.591+0000 7f1bd8fd1640 1 --2- 172.21.15.100:0/2601123118 >> v2:172.21.15.167:3300/0 conn(0x7f1bd4154c20 0x7f1bd40cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:43.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.591+0000 7f1bd3fff640 1 --2- 172.21.15.100:0/2601123118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bd40b3190 0x7f1bd415e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:43.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.591+0000 7f1bd8fd1640 1 -- 172.21.15.100:0/2601123118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bd40b3190 msgr2=0x7f1bd415e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:25:43.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.591+0000 7f1bd8fd1640 1 --2- 172.21.15.100:0/2601123118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bd40b3190 0x7f1bd415e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:43.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.591+0000 7f1bd8fd1640 1 -- 172.21.15.100:0/2601123118 >> v1:172.21.15.100:6789/0 conn(0x7f1bd415a7e0 legacy=0x7f1bd40cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:43.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.591+0000 7f1bd8fd1640 1 -- 172.21.15.100:0/2601123118 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd415b250 con 0x7f1bd4154c20 2024-09-11T22:25:43.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.591+0000 7f1bd3fff640 1 --2- 172.21.15.100:0/2601123118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bd40b3190 0x7f1bd415e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:25:43.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.592+0000 7f1bd8fd1640 1 --2- 172.21.15.100:0/2601123118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bd4154c20 0x7f1bd40cb120 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80097a0 tx=0x7f1bc802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7115728729cfec43 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:43.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.592+0000 7f1bd37fe640 1 -- 172.21.15.100:0/2601123118 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8037070 con 0x7f1bd4154c20 2024-09-11T22:25:43.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.592+0000 7f1bd37fe640 1 -- 172.21.15.100:0/2601123118 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc8032440 con 0x7f1bd4154c20 2024-09-11T22:25:43.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.592+0000 7f1bd37fe640 1 -- 172.21.15.100:0/2601123118 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8032810 con 0x7f1bd4154c20 2024-09-11T22:25:43.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.593+0000 7f1bdb235640 1 -- 172.21.15.100:0/2601123118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bd4154c20 msgr2=0x7f1bd40cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:43.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.593+0000 7f1bdb235640 1 --2- 172.21.15.100:0/2601123118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bd4154c20 0x7f1bd40cb120 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80097a0 tx=0x7f1bc802a180 comp rx=0 tx=0).stop 2024-09-11T22:25:43.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.593+0000 7f1bdb235640 1 -- 172.21.15.100:0/2601123118 shutdown_connections 2024-09-11T22:25:43.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.593+0000 7f1bdb235640 1 --2- 172.21.15.100:0/2601123118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bd40b3190 0x7f1bd415e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:43.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.593+0000 7f1bdb235640 1 --2- 172.21.15.100:0/2601123118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bd4154c20 0x7f1bd40cb120 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:43.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.593+0000 7f1bdb235640 1 -- 172.21.15.100:0/2601123118 >> 172.21.15.100:0/2601123118 conn(0x7f1bd4067d40 msgr2=0x7f1bd406d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:43.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.593+0000 7f1bdb235640 1 -- 172.21.15.100:0/2601123118 shutdown_connections 2024-09-11T22:25:43.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.593+0000 7f1bdb235640 1 -- 172.21.15.100:0/2601123118 wait complete. 2024-09-11T22:25:43.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.594+0000 7f1bdb235640 1 Processor -- start 2024-09-11T22:25:43.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.594+0000 7f1bdb235640 1 -- start start 2024-09-11T22:25:43.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.596+0000 7f1bdb235640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bd40b3190 0x7f1bd40d0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:43.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.596+0000 7f1bdb235640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bd4154c20 0x7f1bd415c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:43.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.596+0000 7f1bdb235640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bd415a7e0 0x7f1bd40ce740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:43.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.596+0000 7f1bd3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bd4154c20 0x7f1bd415c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:43.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.596+0000 7f1bd3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bd4154c20 0x7f1bd415c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43028/0 (socket says 172.21.15.100:43028) 2024-09-11T22:25:43.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.596+0000 7f1bd3fff640 1 -- 172.21.15.100:0/1179364597 learned_addr learned my addr 172.21.15.100:0/1179364597 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:43.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.596+0000 7f1bdb235640 1 -- 172.21.15.100:0/1179364597 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd40cc5a0 con 0x7f1bd4154c20 2024-09-11T22:25:43.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.596+0000 7f1bdb235640 1 -- 172.21.15.100:0/1179364597 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd40cc420 con 0x7f1bd40b3190 2024-09-11T22:25:43.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.596+0000 7f1bdb235640 1 -- 172.21.15.100:0/1179364597 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd40cb660 con 0x7f1bd415a7e0 2024-09-11T22:25:43.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.596+0000 7f1bd3fff640 1 -- 172.21.15.100:0/1179364597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bd4154c20 msgr2=0x7f1bd415c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-11T22:25:43.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.596+0000 7f1bd3fff640 1 -- 172.21.15.100:0/1179364597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bd4154c20 msgr2=0x7f1bd415c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:25:43.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.596+0000 7f1bd8fd1640 1 --2- 172.21.15.100:0/1179364597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bd40b3190 0x7f1bd40d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:43.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.596+0000 7f1bd3fff640 1 --2- 172.21.15.100:0/1179364597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bd4154c20 0x7f1bd415c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:25:43.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.596+0000 7f1bd3fff640 1 --2- 172.21.15.100:0/1179364597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bd4154c20 0x7f1bd415c280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:25:43.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.596+0000 7f1bd97d2640 1 --2- 172.21.15.100:0/1179364597 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bd415a7e0 0x7f1bd40ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:43.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.597+0000 7f1bd8fd1640 1 -- 172.21.15.100:0/1179364597 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bd415a7e0 msgr2=0x7f1bd40ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:43.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.597+0000 7f1bd8fd1640 1 --2- 172.21.15.100:0/1179364597 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bd415a7e0 0x7f1bd40ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:43.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.597+0000 7f1bd8fd1640 1 -- 172.21.15.100:0/1179364597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bd4154c20 msgr2=0x7f1bd415c280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:25:43.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.597+0000 7f1bd8fd1640 1 --2- 172.21.15.100:0/1179364597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bd4154c20 0x7f1bd415c280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:43.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.597+0000 7f1bd8fd1640 1 -- 172.21.15.100:0/1179364597 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd415cc40 con 0x7f1bd40b3190 2024-09-11T22:25:43.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.597+0000 7f1bd8fd1640 1 --2- 172.21.15.100:0/1179364597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bd40b3190 0x7f1bd40d0360 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1bd406d860 tx=0x7f1bc80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:43.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.597+0000 7f1bd17fa640 1 -- 172.21.15.100:0/1179364597 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8041030 con 0x7f1bd40b3190 2024-09-11T22:25:43.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.597+0000 7f1bd17fa640 1 -- 172.21.15.100:0/1179364597 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc8030500 con 0x7f1bd40b3190 2024-09-11T22:25:43.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.597+0000 7f1bdb235640 1 -- 172.21.15.100:0/1179364597 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd41f1110 con 0x7f1bd40b3190 2024-09-11T22:25:43.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.597+0000 7f1bd17fa640 1 -- 172.21.15.100:0/1179364597 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8037040 con 0x7f1bd40b3190 2024-09-11T22:25:43.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.597+0000 7f1bdb235640 1 -- 172.21.15.100:0/1179364597 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd40ce220 con 0x7f1bd40b3190 2024-09-11T22:25:43.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.598+0000 7f1bdb235640 1 -- 172.21.15.100:0/1179364597 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bd40cb120 con 0x7f1bd40b3190 2024-09-11T22:25:43.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.599+0000 7f1bd17fa640 1 -- 172.21.15.100:0/1179364597 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1bc8044070 con 0x7f1bd40b3190 2024-09-11T22:25:43.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.599+0000 7f1bd17fa640 1 --2- 172.21.15.100:0/1179364597 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1bb806be60 0x7f1bb806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:43.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.599+0000 7f1bd17fa640 1 -- 172.21.15.100:0/1179364597 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f1bc80ab8b0 con 0x7f1bd40b3190 2024-09-11T22:25:43.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.599+0000 7f1bd3fff640 1 --2- 172.21.15.100:0/1179364597 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1bb806be60 0x7f1bb806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:43.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.600+0000 7f1bd3fff640 1 --2- 172.21.15.100:0/1179364597 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1bb806be60 0x7f1bb806e320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4154630 tx=0x7f1bc0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:43.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.604+0000 7f1bd17fa640 1 -- 172.21.15.100:0/1179364597 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1bc8079dc0 con 0x7f1bd40b3190 2024-09-11T22:25:43.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.871+0000 7f1bdb235640 1 -- 172.21.15.100:0/1179364597 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1bd40cbaf0 con 0x7f1bd40b3190 2024-09-11T22:25:43.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.872+0000 7f1bd17fa640 1 -- 172.21.15.100:0/1179364597 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f1bc80796c0 con 0x7f1bd40b3190 2024-09-11T22:25:43.873 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":38,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:25:43.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.874+0000 7f1bdb235640 1 -- 172.21.15.100:0/1179364597 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1bb806be60 msgr2=0x7f1bb806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:43.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.874+0000 7f1bdb235640 1 --2- 172.21.15.100:0/1179364597 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1bb806be60 0x7f1bb806e320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4154630 tx=0x7f1bc0008040 comp rx=0 tx=0).stop 2024-09-11T22:25:43.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.874+0000 7f1bdb235640 1 -- 172.21.15.100:0/1179364597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bd40b3190 msgr2=0x7f1bd40d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:43.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.874+0000 7f1bdb235640 1 --2- 172.21.15.100:0/1179364597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bd40b3190 0x7f1bd40d0360 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1bd406d860 tx=0x7f1bc80046c0 comp rx=0 tx=0).stop 2024-09-11T22:25:43.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.874+0000 7f1bdb235640 1 -- 172.21.15.100:0/1179364597 shutdown_connections 2024-09-11T22:25:43.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.874+0000 7f1bdb235640 1 --2- 172.21.15.100:0/1179364597 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1bb806be60 0x7f1bb806e320 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:43.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.874+0000 7f1bdb235640 1 --2- 172.21.15.100:0/1179364597 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bd415a7e0 0x7f1bd40ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:43.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.874+0000 7f1bdb235640 1 --2- 172.21.15.100:0/1179364597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1bd4154c20 0x7f1bd415c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:43.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.874+0000 7f1bdb235640 1 --2- 172.21.15.100:0/1179364597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bd40b3190 0x7f1bd40d0360 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:43.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.874+0000 7f1bdb235640 1 -- 172.21.15.100:0/1179364597 >> 172.21.15.100:0/1179364597 conn(0x7f1bd4067d40 msgr2=0x7f1bd40b5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:43.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.874+0000 7f1bdb235640 1 -- 172.21.15.100:0/1179364597 shutdown_connections 2024-09-11T22:25:43.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:43.874+0000 7f1bdb235640 1 -- 172.21.15.100:0/1179364597 wait complete. 2024-09-11T22:25:46.887 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:25:46.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:46.998+0000 7f2fa9998640 1 Processor -- start 2024-09-11T22:25:46.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:46.998+0000 7f2fa9998640 1 -- start start 2024-09-11T22:25:47.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.000+0000 7f2fa9998640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2fa415ea70 0x7f2fa40ce070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.000+0000 7f2fa9998640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fa40ce5b0 0x7f2fa40c4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.000+0000 7f2fa9998640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fa40ca840 con 0x7f2fa4157fe0 2024-09-11T22:25:47.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.000+0000 7f2fa9998640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f2fa415b170 con 0x7f2fa415ea70 2024-09-11T22:25:47.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.000+0000 7f2fa9998640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2fa415eec0 con 0x7f2fa40ce5b0 2024-09-11T22:25:47.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.000+0000 7f2fa37fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fa40ce5b0 0x7f2fa40c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.000+0000 7f2fa37fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fa40ce5b0 0x7f2fa40c4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:59728/0 (socket says 172.21.15.100:59728) 2024-09-11T22:25:47.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.000+0000 7f2f9bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2fa415ea70 0x7f2fa40ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.000+0000 7f2fa37fe640 1 -- 172.21.15.100:0/2059751653 learned_addr learned my addr 172.21.15.100:0/2059751653 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:47.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.000+0000 7f2fa37fe640 1 -- 172.21.15.100:0/2059751653 >> v2:172.21.15.167:3300/0 conn(0x7f2fa415ea70 msgr2=0x7f2fa40ce070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:25:47.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.000+0000 7f2fa37fe640 1 --2- 172.21.15.100:0/2059751653 >> v2:172.21.15.167:3300/0 conn(0x7f2fa415ea70 0x7f2fa40ce070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.000+0000 7f2fa37fe640 1 -- 172.21.15.100:0/2059751653 >> v1:172.21.15.167:6789/0 conn(0x7f2fa4157fe0 legacy=0x7f2fa415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.000+0000 7f2fa37fe640 1 -- 172.21.15.100:0/2059751653 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa415b9b0 con 0x7f2fa40ce5b0 2024-09-11T22:25:47.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.001+0000 7f2fa37fe640 1 --2- 172.21.15.100:0/2059751653 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fa40ce5b0 0x7f2fa40c4240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009e50 tx=0x7f2f9c02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=276a8ca6eac6c901 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:47.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.001+0000 7f2fa27fc640 1 -- 172.21.15.100:0/2059751653 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c036070 con 0x7f2fa40ce5b0 2024-09-11T22:25:47.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.001+0000 7f2fa27fc640 1 -- 172.21.15.100:0/2059751653 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f9c031600 con 0x7f2fa40ce5b0 2024-09-11T22:25:47.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.001+0000 7f2fa27fc640 1 -- 172.21.15.100:0/2059751653 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9c0319d0 con 0x7f2fa40ce5b0 2024-09-11T22:25:47.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.002+0000 7f2fa9998640 1 -- 172.21.15.100:0/2059751653 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fa40ce5b0 msgr2=0x7f2fa40c4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.002+0000 7f2fa9998640 1 --2- 172.21.15.100:0/2059751653 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fa40ce5b0 0x7f2fa40c4240 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009e50 tx=0x7f2f9c02a680 comp rx=0 tx=0).stop 2024-09-11T22:25:47.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.002+0000 7f2fa9998640 1 -- 172.21.15.100:0/2059751653 shutdown_connections 2024-09-11T22:25:47.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.002+0000 7f2fa9998640 1 --2- 172.21.15.100:0/2059751653 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fa40ce5b0 0x7f2fa40c4240 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.002+0000 7f2fa9998640 1 --2- 172.21.15.100:0/2059751653 >> v2:172.21.15.167:3300/0 conn(0x7f2fa415ea70 0x7f2fa40ce070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.002+0000 7f2fa9998640 1 -- 172.21.15.100:0/2059751653 >> 172.21.15.100:0/2059751653 conn(0x7f2fa4073920 msgr2=0x7f2fa4073d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:47.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.002+0000 7f2fa9998640 1 -- 172.21.15.100:0/2059751653 shutdown_connections 2024-09-11T22:25:47.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.002+0000 7f2fa9998640 1 -- 172.21.15.100:0/2059751653 wait complete. 2024-09-11T22:25:47.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.003+0000 7f2fa9998640 1 Processor -- start 2024-09-11T22:25:47.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.003+0000 7f2fa9998640 1 -- start start 2024-09-11T22:25:47.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.004+0000 7f2fa9998640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fa40ce5b0 0x7f2fa415d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.004+0000 7f2fa9998640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fa4157fe0 0x7f2fa4158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.004+0000 7f2fa9998640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fa415ea70 0x7f2fa41595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.004+0000 7f2fa9998640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa40c3760 con 0x7f2fa40ce5b0 2024-09-11T22:25:47.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.004+0000 7f2fa9998640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa415b6d0 con 0x7f2fa415ea70 2024-09-11T22:25:47.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.004+0000 7f2fa9998640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2fa40c3a40 con 0x7f2fa4157fe0 2024-09-11T22:25:47.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.004+0000 7f2fa2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fa40ce5b0 0x7f2fa415d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.004+0000 7f2fa2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fa40ce5b0 0x7f2fa415d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43034/0 (socket says 172.21.15.100:43034) 2024-09-11T22:25:47.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.004+0000 7f2fa2ffd640 1 -- 172.21.15.100:0/1063106683 learned_addr learned my addr 172.21.15.100:0/1063106683 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:47.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.004+0000 7f2fa37fe640 1 --2- 172.21.15.100:0/1063106683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fa415ea70 0x7f2fa41595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.004+0000 7f2f9bfff640 1 --2- 172.21.15.100:0/1063106683 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fa4157fe0 0x7f2fa4158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.005+0000 7f2fa2ffd640 1 -- 172.21.15.100:0/1063106683 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fa4157fe0 msgr2=0x7f2fa4158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.005+0000 7f2fa2ffd640 1 --2- 172.21.15.100:0/1063106683 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fa4157fe0 0x7f2fa4158930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.005+0000 7f2fa2ffd640 1 -- 172.21.15.100:0/1063106683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fa415ea70 msgr2=0x7f2fa41595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.005+0000 7f2fa2ffd640 1 --2- 172.21.15.100:0/1063106683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fa415ea70 0x7f2fa41595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.005+0000 7f2fa2ffd640 1 -- 172.21.15.100:0/1063106683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa40b30b0 con 0x7f2fa40ce5b0 2024-09-11T22:25:47.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.005+0000 7f2fa37fe640 1 --2- 172.21.15.100:0/1063106683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fa415ea70 0x7f2fa41595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:25:47.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.005+0000 7f2fa2ffd640 1 --2- 172.21.15.100:0/1063106683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fa40ce5b0 0x7f2fa415d900 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400c400 tx=0x7f2f9400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:47.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.005+0000 7f2fa0ff9640 1 -- 172.21.15.100:0/1063106683 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f940052d0 con 0x7f2fa40ce5b0 2024-09-11T22:25:47.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.005+0000 7f2fa0ff9640 1 -- 172.21.15.100:0/1063106683 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f94005490 con 0x7f2fa40ce5b0 2024-09-11T22:25:47.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.005+0000 7f2fa0ff9640 1 -- 172.21.15.100:0/1063106683 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f94007260 con 0x7f2fa40ce5b0 2024-09-11T22:25:47.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.005+0000 7f2fa9998640 1 -- 172.21.15.100:0/1063106683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa415bc60 con 0x7f2fa40ce5b0 2024-09-11T22:25:47.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.005+0000 7f2fa9998640 1 -- 172.21.15.100:0/1063106683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa415d100 con 0x7f2fa40ce5b0 2024-09-11T22:25:47.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.006+0000 7f2fa9998640 1 -- 172.21.15.100:0/1063106683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa41583c0 con 0x7f2fa40ce5b0 2024-09-11T22:25:47.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.007+0000 7f2fa0ff9640 1 -- 172.21.15.100:0/1063106683 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2f94007400 con 0x7f2fa40ce5b0 2024-09-11T22:25:47.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.007+0000 7f2fa0ff9640 1 --2- 172.21.15.100:0/1063106683 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2f8406be30 0x7f2f8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.007+0000 7f2fa0ff9640 1 -- 172.21.15.100:0/1063106683 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f2f9408a6f0 con 0x7f2fa40ce5b0 2024-09-11T22:25:47.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.007+0000 7f2f9bfff640 1 --2- 172.21.15.100:0/1063106683 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2f8406be30 0x7f2f8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.008+0000 7f2f9bfff640 1 --2- 172.21.15.100:0/1063106683 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2f8406be30 0x7f2f8406e2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40cc540 tx=0x7f2f8c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:47.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.012+0000 7f2fa0ff9640 1 -- 172.21.15.100:0/1063106683 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2fa40ca840 con 0x7f2fa40ce5b0 2024-09-11T22:25:47.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.297+0000 7f2fa9998640 1 -- 172.21.15.100:0/1063106683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2fa4067d30 con 0x7f2fa40ce5b0 2024-09-11T22:25:47.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.297+0000 7f2fa0ff9640 1 -- 172.21.15.100:0/1063106683 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f2f94058630 con 0x7f2fa40ce5b0 2024-09-11T22:25:47.298 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":42,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:25:47.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.299+0000 7f2fa9998640 1 -- 172.21.15.100:0/1063106683 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2f8406be30 msgr2=0x7f2f8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.299+0000 7f2fa9998640 1 --2- 172.21.15.100:0/1063106683 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2f8406be30 0x7f2f8406e2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40cc540 tx=0x7f2f8c009190 comp rx=0 tx=0).stop 2024-09-11T22:25:47.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.299+0000 7f2fa9998640 1 -- 172.21.15.100:0/1063106683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fa40ce5b0 msgr2=0x7f2fa415d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.299+0000 7f2fa9998640 1 --2- 172.21.15.100:0/1063106683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fa40ce5b0 0x7f2fa415d900 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400c400 tx=0x7f2f9400c8c0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.299+0000 7f2fa9998640 1 -- 172.21.15.100:0/1063106683 shutdown_connections 2024-09-11T22:25:47.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.299+0000 7f2fa9998640 1 --2- 172.21.15.100:0/1063106683 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2f8406be30 0x7f2f8406e2f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.299+0000 7f2fa9998640 1 --2- 172.21.15.100:0/1063106683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fa415ea70 0x7f2fa41595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.299+0000 7f2fa9998640 1 --2- 172.21.15.100:0/1063106683 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fa4157fe0 0x7f2fa4158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.299+0000 7f2fa9998640 1 --2- 172.21.15.100:0/1063106683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fa40ce5b0 0x7f2fa415d900 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.299+0000 7f2fa9998640 1 -- 172.21.15.100:0/1063106683 >> 172.21.15.100:0/1063106683 conn(0x7f2fa4073920 msgr2=0x7f2fa40cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:47.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.299+0000 7f2fa9998640 1 -- 172.21.15.100:0/1063106683 shutdown_connections 2024-09-11T22:25:47.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.299+0000 7f2fa9998640 1 -- 172.21.15.100:0/1063106683 wait complete. 2024-09-11T22:25:47.311 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:25:47.311 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:25:47.312 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:25:47.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.429+0000 7f3fda6dd640 1 Processor -- start 2024-09-11T22:25:47.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.429+0000 7f3fda6dd640 1 -- start start 2024-09-11T22:25:47.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.430+0000 7f3fda6dd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fd4158210 0x7f3fd40707a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.430+0000 7f3fda6dd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3fd40b0ca0 0x7f3fd415e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.430+0000 7f3fda6dd640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd41585f0 con 0x7f3fd406bc10 2024-09-11T22:25:47.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.430+0000 7f3fda6dd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f3fd4070310 con 0x7f3fd40b0ca0 2024-09-11T22:25:47.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.430+0000 7f3fda6dd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3fd40c9430 con 0x7f3fd4158210 2024-09-11T22:25:47.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.430+0000 7f3fd8c7a640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3fd406bc10 0x7f3fd40ce160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39144/0 (socket says 172.21.15.100:39144) 2024-09-11T22:25:47.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.430+0000 7f3fd8c7a640 1 -- 172.21.15.100:0/600440725 learned_addr learned my addr 172.21.15.100:0/600440725 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:25:47.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.430+0000 7f3fd37fe640 1 --2- 172.21.15.100:0/600440725 >> v2:172.21.15.167:3300/0 conn(0x7f3fd40b0ca0 0x7f3fd415e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.430+0000 7f3fd3fff640 1 --2- 172.21.15.100:0/600440725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fd4158210 0x7f3fd40707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.430+0000 7f3fd2ffd640 1 -- 172.21.15.100:0/600440725 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3105066033 0 0) 0x7f3fd41585f0 con 0x7f3fd406bc10 2024-09-11T22:25:47.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.430+0000 7f3fd2ffd640 1 -- 172.21.15.100:0/600440725 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fbc003520 con 0x7f3fd406bc10 2024-09-11T22:25:47.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.430+0000 7f3fd37fe640 1 -- 172.21.15.100:0/600440725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fd4158210 msgr2=0x7f3fd40707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:25:47.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.430+0000 7f3fd37fe640 1 --2- 172.21.15.100:0/600440725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fd4158210 0x7f3fd40707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.430+0000 7f3fd2ffd640 1 -- 172.21.15.100:0/600440725 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 885896182 0 0) 0x7f3fbc003520 con 0x7f3fd406bc10 2024-09-11T22:25:47.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.430+0000 7f3fd37fe640 1 -- 172.21.15.100:0/600440725 >> v1:172.21.15.100:6789/0 conn(0x7f3fd406bc10 legacy=0x7f3fd40ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.430+0000 7f3fd37fe640 1 -- 172.21.15.100:0/600440725 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd40c96d0 con 0x7f3fd40b0ca0 2024-09-11T22:25:47.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.430+0000 7f3fd3fff640 1 --2- 172.21.15.100:0/600440725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fd4158210 0x7f3fd40707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:25:47.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.431+0000 7f3fd37fe640 1 --2- 172.21.15.100:0/600440725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fd40b0ca0 0x7f3fd415e100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3fc80097a0 tx=0x7f3fc802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1079d9921d8eecc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:47.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.432+0000 7f3fd2ffd640 1 -- 172.21.15.100:0/600440725 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8037070 con 0x7f3fd40b0ca0 2024-09-11T22:25:47.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.432+0000 7f3fd2ffd640 1 -- 172.21.15.100:0/600440725 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc802ac30 con 0x7f3fd40b0ca0 2024-09-11T22:25:47.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.432+0000 7f3fd2ffd640 1 -- 172.21.15.100:0/600440725 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc0019f0 con 0x7f3fd40b0ca0 2024-09-11T22:25:47.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.432+0000 7f3fda6dd640 1 -- 172.21.15.100:0/600440725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fd40b0ca0 msgr2=0x7f3fd415e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.432+0000 7f3fda6dd640 1 --2- 172.21.15.100:0/600440725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fd40b0ca0 0x7f3fd415e100 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3fc80097a0 tx=0x7f3fc802a1a0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.432+0000 7f3fda6dd640 1 -- 172.21.15.100:0/600440725 shutdown_connections 2024-09-11T22:25:47.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.432+0000 7f3fda6dd640 1 --2- 172.21.15.100:0/600440725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fd40b0ca0 0x7f3fd415e100 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.432+0000 7f3fda6dd640 1 --2- 172.21.15.100:0/600440725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fd4158210 0x7f3fd40707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.432+0000 7f3fda6dd640 1 -- 172.21.15.100:0/600440725 >> 172.21.15.100:0/600440725 conn(0x7f3fd406de20 msgr2=0x7f3fd406e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:47.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.432+0000 7f3fda6dd640 1 -- 172.21.15.100:0/600440725 shutdown_connections 2024-09-11T22:25:47.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.432+0000 7f3fda6dd640 1 -- 172.21.15.100:0/600440725 wait complete. 2024-09-11T22:25:47.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.434+0000 7f3fda6dd640 1 Processor -- start 2024-09-11T22:25:47.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.434+0000 7f3fda6dd640 1 -- start start 2024-09-11T22:25:47.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.434+0000 7f3fda6dd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd406bc10 0x7f3fd415d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.434+0000 7f3fda6dd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fd40b0ca0 0x7f3fd41f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.434+0000 7f3fda6dd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fd4158210 0x7f3fd4157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.434+0000 7f3fda6dd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd406ffa0 con 0x7f3fd406bc10 2024-09-11T22:25:47.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.435+0000 7f3fda6dd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd40c9c90 con 0x7f3fd40b0ca0 2024-09-11T22:25:47.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.435+0000 7f3fda6dd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3fd406db40 con 0x7f3fd4158210 2024-09-11T22:25:47.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.435+0000 7f3fd3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd406bc10 0x7f3fd415d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.435+0000 7f3fd3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd406bc10 0x7f3fd415d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43050/0 (socket says 172.21.15.100:43050) 2024-09-11T22:25:47.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.435+0000 7f3fd3fff640 1 -- 172.21.15.100:0/3473480911 learned_addr learned my addr 172.21.15.100:0/3473480911 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:47.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.435+0000 7f3fd8c7a640 1 --2- 172.21.15.100:0/3473480911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fd4158210 0x7f3fd4157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.435+0000 7f3fd37fe640 1 --2- 172.21.15.100:0/3473480911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fd40b0ca0 0x7f3fd41f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.435+0000 7f3fd3fff640 1 -- 172.21.15.100:0/3473480911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fd4158210 msgr2=0x7f3fd4157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.435+0000 7f3fd3fff640 1 --2- 172.21.15.100:0/3473480911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fd4158210 0x7f3fd4157090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.435+0000 7f3fd3fff640 1 -- 172.21.15.100:0/3473480911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fd40b0ca0 msgr2=0x7f3fd41f40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.435+0000 7f3fd3fff640 1 --2- 172.21.15.100:0/3473480911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fd40b0ca0 0x7f3fd41f40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.435+0000 7f3fd3fff640 1 -- 172.21.15.100:0/3473480911 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd415dad0 con 0x7f3fd406bc10 2024-09-11T22:25:47.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.435+0000 7f3fd8c7a640 1 --2- 172.21.15.100:0/3473480911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fd4158210 0x7f3fd4157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:25:47.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.435+0000 7f3fd37fe640 1 --2- 172.21.15.100:0/3473480911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fd40b0ca0 0x7f3fd41f40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:25:47.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.435+0000 7f3fd3fff640 1 --2- 172.21.15.100:0/3473480911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd406bc10 0x7f3fd415d3a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400e990 tx=0x7f3fc400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:47.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.435+0000 7f3fd0ff9640 1 -- 172.21.15.100:0/3473480911 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4017070 con 0x7f3fd406bc10 2024-09-11T22:25:47.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.435+0000 7f3fd0ff9640 1 -- 172.21.15.100:0/3473480911 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc400c9e0 con 0x7f3fd406bc10 2024-09-11T22:25:47.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.435+0000 7f3fda6dd640 1 -- 172.21.15.100:0/3473480911 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fd415ddb0 con 0x7f3fd406bc10 2024-09-11T22:25:47.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.435+0000 7f3fd0ff9640 1 -- 172.21.15.100:0/3473480911 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc400cdb0 con 0x7f3fd406bc10 2024-09-11T22:25:47.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.436+0000 7f3fda6dd640 1 -- 172.21.15.100:0/3473480911 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fd415bf00 con 0x7f3fd406bc10 2024-09-11T22:25:47.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.436+0000 7f3fda6dd640 1 --2- 172.21.15.100:0/3473480911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd415c700 0x7f3fd415cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.436+0000 7f3fda6dd640 1 -- 172.21.15.100:0/3473480911 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd41f15c0 con 0x7f3fd415c700 2024-09-11T22:25:47.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.437+0000 7f3fd37fe640 1 --2- 172.21.15.100:0/3473480911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd415c700 0x7f3fd415cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.437+0000 7f3fd0ff9640 1 -- 172.21.15.100:0/3473480911 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3fc401a070 con 0x7f3fd406bc10 2024-09-11T22:25:47.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.437+0000 7f3fd37fe640 1 -- 172.21.15.100:0/3473480911 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3fd415bcf0 con 0x7f3fd415c700 2024-09-11T22:25:47.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.437+0000 7f3fd37fe640 1 --2- 172.21.15.100:0/3473480911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd415c700 0x7f3fd415cae0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4071050 tx=0x7f3fc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:47.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.437+0000 7f3fd0ff9640 1 --2- 172.21.15.100:0/3473480911 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3fc006be30 0x7f3fc006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.438+0000 7f3fd0ff9640 1 -- 172.21.15.100:0/3473480911 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f3fc408b420 con 0x7f3fd406bc10 2024-09-11T22:25:47.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.438+0000 7f3fd8c7a640 1 --2- 172.21.15.100:0/3473480911 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3fc006be30 0x7f3fc006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.438+0000 7f3fd0ff9640 1 -- 172.21.15.100:0/3473480911 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8043070 con 0x7f3fd415c700 2024-09-11T22:25:47.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.438+0000 7f3fd0ff9640 1 -- 172.21.15.100:0/3473480911 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3fc802ac30 con 0x7f3fd415c700 2024-09-11T22:25:47.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.438+0000 7f3fd0ff9640 1 -- 172.21.15.100:0/3473480911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd415c700 msgr2=0x7f3fd415cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.438+0000 7f3fd0ff9640 1 --2- 172.21.15.100:0/3473480911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd415c700 0x7f3fd415cae0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4071050 tx=0x7f3fc80046c0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.438+0000 7f3fd0ff9640 1 -- 172.21.15.100:0/3473480911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd415c700 msgr2=0x7f3fd415cae0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:25:47.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.438+0000 7f3fd0ff9640 1 --2- 172.21.15.100:0/3473480911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd415c700 0x7f3fd415cae0 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4071050 tx=0x7f3fc80046c0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.438+0000 7f3fd8c7a640 1 --2- 172.21.15.100:0/3473480911 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3fc006be30 0x7f3fc006e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40c5690 tx=0x7f3fcc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:47.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.445+0000 7f3fda6dd640 1 --2- 172.21.15.100:0/3473480911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd4154e70 0x7f3fd4155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.445+0000 7f3fda6dd640 1 -- 172.21.15.100:0/3473480911 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd415c550 con 0x7f3fd4154e70 2024-09-11T22:25:47.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.445+0000 7f3fd37fe640 1 --2- 172.21.15.100:0/3473480911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd4154e70 0x7f3fd4155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.445+0000 7f3fd37fe640 1 -- 172.21.15.100:0/3473480911 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3fd40707a0 con 0x7f3fd4154e70 2024-09-11T22:25:47.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.445+0000 7f3fd37fe640 1 --2- 172.21.15.100:0/3473480911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd4154e70 0x7f3fd4155250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3fc802a1e0 tx=0x7f3fc8008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:47.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.446+0000 7f3fd0ff9640 1 -- 172.21.15.100:0/3473480911 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8037040 con 0x7f3fd4154e70 2024-09-11T22:25:47.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.446+0000 7f3fd0ff9640 1 -- 172.21.15.100:0/3473480911 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7f3fc803cdd0 con 0x7f3fd4154e70 2024-09-11T22:25:47.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.446+0000 7f3fd0ff9640 1 -- 172.21.15.100:0/3473480911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd4154e70 msgr2=0x7f3fd4155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.446+0000 7f3fd0ff9640 1 --2- 172.21.15.100:0/3473480911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd4154e70 0x7f3fd4155250 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3fc802a1e0 tx=0x7f3fc8008030 comp rx=0 tx=0).stop 2024-09-11T22:25:47.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.446+0000 7f3fd0ff9640 1 -- 172.21.15.100:0/3473480911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd4154e70 msgr2=0x7f3fd4155250 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:25:47.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.446+0000 7f3fd0ff9640 1 --2- 172.21.15.100:0/3473480911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd4154e70 0x7f3fd4155250 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3fc802a1e0 tx=0x7f3fc8008030 comp rx=0 tx=0).stop 2024-09-11T22:25:47.448 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:25:47.448 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:25:47.448 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:25:47.448 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:25:47.448 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 42, 2024-09-11T22:25:47.448 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 3871, 2024-09-11T22:25:47.448 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:25:47.448 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:25:47.448 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:25:47.448 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:25:47.449 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:47.449 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:25:47.449 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:25:47.449 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:25:47.449 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:25:47.449 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:47.449 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:47.449 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:47.449 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:47.449 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:47.449 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:47.449 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:47.449 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:47.449 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:47.450 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:47.450 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:47.450 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:47.450 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:25:47.450 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:25:47.450 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:47.450 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:47.450 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:47.450 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:47.450 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:47.450 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:47.450 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:47.450 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:47.451 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:47.451 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:47.451 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:47.451 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:47.451 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.451 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:25:47.451 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:25:47.451 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:25:47.451 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:25:47.451 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:25:47.451 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:25:47.451 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:25:47.451 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:25:47.452 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:25:47.452 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:25:47.452 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:25:47.452 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:25:47.452 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:25:47.452 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:25:47.452 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:25:47.452 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:25:47.452 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:25:47.452 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:47.452 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:47.452 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:47.453 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:47.453 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:47.453 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:47.453 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:47.453 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:47.453 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:47.453 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:47.453 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:47.453 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:47.453 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:25:47.453 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.453 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:25:47.453 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.453 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:25:47.454 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:25:47.454 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:47.454 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:47.454 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.454 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:47.454 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:25:47.454 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:47.454 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.454 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.454 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:47.454 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:25:47.454 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:47.454 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:47.455 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:47.455 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.455 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:25:47.455 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:25:47.455 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:47.455 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:47.455 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:47.455 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.455 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.455 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:25:47.455 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:25:47.455 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:47.456 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:47.456 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.456 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:47.456 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:25:47.456 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:47.456 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.456 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.456 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:47.456 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:25:47.456 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:47.456 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:47.456 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:47.456 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.457 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:25:47.457 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:25:47.457 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:47.457 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:47.457 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:47.457 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.457 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.457 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:25:47.458 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:25:47.458 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:47.458 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:47.458 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.458 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:47.458 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:25:47.458 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:47.458 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.458 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.459 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:47.459 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:25:47.459 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:47.459 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:47.459 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:47.459 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.459 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:25:47.459 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:25:47.459 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:47.459 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:47.460 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:47.460 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:47.460 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:47.460 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.460 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:25:47.460 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:25:47.460 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.460 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:47.460 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:47.460 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:25:47.460 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:47.460 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:47.460 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:25:47.461 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.461 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:47.461 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:47.461 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:25:47.461 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:47.461 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:47.461 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.461 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:25:47.461 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:25:47.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.446+0000 7f3fda6dd640 1 -- 172.21.15.100:0/3473480911 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3fc006be30 msgr2=0x7f3fc006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.446+0000 7f3fda6dd640 1 --2- 172.21.15.100:0/3473480911 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3fc006be30 0x7f3fc006e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40c5690 tx=0x7f3fcc009040 comp rx=0 tx=0).stop 2024-09-11T22:25:47.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.446+0000 7f3fda6dd640 1 -- 172.21.15.100:0/3473480911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd406bc10 msgr2=0x7f3fd415d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.446+0000 7f3fda6dd640 1 --2- 172.21.15.100:0/3473480911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fd406bc10 0x7f3fd415d3a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400e990 tx=0x7f3fc400ee50 comp rx=0 tx=0).stop 2024-09-11T22:25:47.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.446+0000 7f3fd8c7a640 1 -- 172.21.15.100:0/3473480911 reap_dead start 2024-09-11T22:25:47.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.446+0000 7f3fd8c7a640 1 -- 172.21.15.100:0/3473480911 reap_dead start 2024-09-11T22:25:47.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.446+0000 7f3fda6dd640 1 -- 172.21.15.100:0/3473480911 shutdown_connections 2024-09-11T22:25:47.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.446+0000 7f3fda6dd640 1 -- 172.21.15.100:0/3473480911 >> 172.21.15.100:0/3473480911 conn(0x7f3fd406de20 msgr2=0x7f3fd40c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:47.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.446+0000 7f3fda6dd640 1 -- 172.21.15.100:0/3473480911 shutdown_connections 2024-09-11T22:25:47.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.446+0000 7f3fda6dd640 1 -- 172.21.15.100:0/3473480911 wait complete. 2024-09-11T22:25:47.464 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:25:47.464 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:25:47.464 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:25:47.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.577+0000 7f1b83477640 1 Processor -- start 2024-09-11T22:25:47.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.578+0000 7f1b83477640 1 -- start start 2024-09-11T22:25:47.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.578+0000 7f1b83477640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1b7c0726c0 0x7f1b7c0c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.578+0000 7f1b83477640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7c072af0 con 0x7f1b7c151970 2024-09-11T22:25:47.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.578+0000 7f1b83477640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7c073bf0 con 0x7f1b7c072f30 2024-09-11T22:25:47.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.578+0000 7f1b83477640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7c0ca3f0 con 0x7f1b7c0726c0 2024-09-11T22:25:47.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.578+0000 7f1b81213640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1b7c151970 0x7f1b7c1576c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39160/0 (socket says 172.21.15.100:39160) 2024-09-11T22:25:47.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.578+0000 7f1b81213640 1 -- 172.21.15.100:0/118626729 learned_addr learned my addr 172.21.15.100:0/118626729 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:25:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.579+0000 7f1b80a12640 1 --2- 172.21.15.100:0/118626729 >> v2:172.21.15.167:3300/0 conn(0x7f1b7c0726c0 0x7f1b7c0c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.579+0000 7f1b73fff640 1 -- 172.21.15.100:0/118626729 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2990049098 0 0) 0x7f1b7c072af0 con 0x7f1b7c151970 2024-09-11T22:25:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.579+0000 7f1b73fff640 1 -- 172.21.15.100:0/118626729 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b68005730 con 0x7f1b7c151970 2024-09-11T22:25:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.579+0000 7f1b80a12640 1 -- 172.21.15.100:0/118626729 >> v1:172.21.15.167:6789/0 conn(0x7f1b7c072f30 legacy=0x7f1b7c161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.579+0000 7f1b73fff640 1 -- 172.21.15.100:0/118626729 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 299636660 0 0) 0x7f1b68005730 con 0x7f1b7c151970 2024-09-11T22:25:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.579+0000 7f1b80a12640 1 -- 172.21.15.100:0/118626729 >> v1:172.21.15.100:6789/0 conn(0x7f1b7c151970 legacy=0x7f1b7c1576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.579+0000 7f1b80a12640 1 -- 172.21.15.100:0/118626729 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7c073ed0 con 0x7f1b7c0726c0 2024-09-11T22:25:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.580+0000 7f1b80a12640 1 --2- 172.21.15.100:0/118626729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b7c0726c0 0x7f1b7c0c3c60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0097a0 tx=0x7f1b6c02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c518ee773b3f2e0f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.580+0000 7f1b73fff640 1 -- 172.21.15.100:0/118626729 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c037070 con 0x7f1b7c0726c0 2024-09-11T22:25:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.580+0000 7f1b73fff640 1 -- 172.21.15.100:0/118626729 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b6c02ace0 con 0x7f1b7c0726c0 2024-09-11T22:25:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.580+0000 7f1b73fff640 1 -- 172.21.15.100:0/118626729 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78001670 con 0x7f1b7c0726c0 2024-09-11T22:25:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.581+0000 7f1b83477640 1 -- 172.21.15.100:0/118626729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b7c0726c0 msgr2=0x7f1b7c0c3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.581+0000 7f1b83477640 1 --2- 172.21.15.100:0/118626729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b7c0726c0 0x7f1b7c0c3c60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0097a0 tx=0x7f1b6c02a250 comp rx=0 tx=0).stop 2024-09-11T22:25:47.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.581+0000 7f1b83477640 1 -- 172.21.15.100:0/118626729 shutdown_connections 2024-09-11T22:25:47.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.581+0000 7f1b83477640 1 --2- 172.21.15.100:0/118626729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b7c0726c0 0x7f1b7c0c3c60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.581+0000 7f1b83477640 1 -- 172.21.15.100:0/118626729 >> 172.21.15.100:0/118626729 conn(0x7f1b7c06ee80 msgr2=0x7f1b7c070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:47.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.581+0000 7f1b83477640 1 -- 172.21.15.100:0/118626729 shutdown_connections 2024-09-11T22:25:47.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.581+0000 7f1b83477640 1 -- 172.21.15.100:0/118626729 wait complete. 2024-09-11T22:25:47.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.582+0000 7f1b83477640 1 Processor -- start 2024-09-11T22:25:47.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.582+0000 7f1b83477640 1 -- start start 2024-09-11T22:25:47.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.583+0000 7f1b83477640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b7c0726c0 0x7f1b7c1f1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.583+0000 7f1b83477640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b7c072f30 0x7f1b7c14cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.583+0000 7f1b83477640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b7c151970 0x7f1b7c157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.583+0000 7f1b83477640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7c0c9f60 con 0x7f1b7c072f30 2024-09-11T22:25:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.583+0000 7f1b83477640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7c0c41a0 con 0x7f1b7c151970 2024-09-11T22:25:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.583+0000 7f1b83477640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7c0741b0 con 0x7f1b7c0726c0 2024-09-11T22:25:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.583+0000 7f1b80a12640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b7c072f30 0x7f1b7c14cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.583+0000 7f1b80a12640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b7c072f30 0x7f1b7c14cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43062/0 (socket says 172.21.15.100:43062) 2024-09-11T22:25:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.583+0000 7f1b80a12640 1 -- 172.21.15.100:0/4266062154 learned_addr learned my addr 172.21.15.100:0/4266062154 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.583+0000 7f1b81a14640 1 --2- 172.21.15.100:0/4266062154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b7c151970 0x7f1b7c157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.583+0000 7f1b81213640 1 --2- 172.21.15.100:0/4266062154 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b7c0726c0 0x7f1b7c1f1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.583+0000 7f1b80a12640 1 -- 172.21.15.100:0/4266062154 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b7c0726c0 msgr2=0x7f1b7c1f1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.583+0000 7f1b80a12640 1 --2- 172.21.15.100:0/4266062154 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1b7c0726c0 0x7f1b7c1f1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.583+0000 7f1b80a12640 1 -- 172.21.15.100:0/4266062154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b7c151970 msgr2=0x7f1b7c157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.583+0000 7f1b80a12640 1 --2- 172.21.15.100:0/4266062154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b7c151970 0x7f1b7c157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.583+0000 7f1b80a12640 1 -- 172.21.15.100:0/4266062154 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7c1debb0 con 0x7f1b7c072f30 2024-09-11T22:25:47.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.583+0000 7f1b81a14640 1 --2- 172.21.15.100:0/4266062154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b7c151970 0x7f1b7c157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:25:47.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.583+0000 7f1b80a12640 1 --2- 172.21.15.100:0/4266062154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b7c072f30 0x7f1b7c14cc50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c035040 tx=0x7f1b6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:47.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.584+0000 7f1b71ffb640 1 -- 172.21.15.100:0/4266062154 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c041020 con 0x7f1b7c072f30 2024-09-11T22:25:47.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.584+0000 7f1b71ffb640 1 -- 172.21.15.100:0/4266062154 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b6c003d40 con 0x7f1b7c072f30 2024-09-11T22:25:47.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.584+0000 7f1b83477640 1 -- 172.21.15.100:0/4266062154 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b7c1dee90 con 0x7f1b7c072f30 2024-09-11T22:25:47.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.584+0000 7f1b71ffb640 1 -- 172.21.15.100:0/4266062154 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c037040 con 0x7f1b7c072f30 2024-09-11T22:25:47.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.584+0000 7f1b83477640 1 -- 172.21.15.100:0/4266062154 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b7c1df450 con 0x7f1b7c072f30 2024-09-11T22:25:47.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.585+0000 7f1b83477640 1 --2- 172.21.15.100:0/4266062154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b7c158360 0x7f1b7c1df690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.585+0000 7f1b83477640 1 -- 172.21.15.100:0/4266062154 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7c0c9500 con 0x7f1b7c158360 2024-09-11T22:25:47.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.585+0000 7f1b81213640 1 --2- 172.21.15.100:0/4266062154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b7c158360 0x7f1b7c1df690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.585+0000 7f1b81213640 1 -- 172.21.15.100:0/4266062154 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1b7c0c9bf0 con 0x7f1b7c158360 2024-09-11T22:25:47.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.585+0000 7f1b71ffb640 1 -- 172.21.15.100:0/4266062154 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1b6c044020 con 0x7f1b7c072f30 2024-09-11T22:25:47.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.586+0000 7f1b81213640 1 --2- 172.21.15.100:0/4266062154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b7c158360 0x7f1b7c1df690 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800e4f0 tx=0x7f1b7800e9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:47.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.586+0000 7f1b71ffb640 1 --2- 172.21.15.100:0/4266062154 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1b6006be30 0x7f1b6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.586+0000 7f1b71ffb640 1 -- 172.21.15.100:0/4266062154 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f1b6c0ab940 con 0x7f1b7c072f30 2024-09-11T22:25:47.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.586+0000 7f1b81a14640 1 --2- 172.21.15.100:0/4266062154 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1b6006be30 0x7f1b6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.586+0000 7f1b71ffb640 1 -- 172.21.15.100:0/4266062154 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78005ae0 con 0x7f1b7c158360 2024-09-11T22:25:47.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.586+0000 7f1b71ffb640 1 -- 172.21.15.100:0/4266062154 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1b78018070 con 0x7f1b7c158360 2024-09-11T22:25:47.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.586+0000 7f1b71ffb640 1 -- 172.21.15.100:0/4266062154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b7c158360 msgr2=0x7f1b7c1df690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.586+0000 7f1b71ffb640 1 --2- 172.21.15.100:0/4266062154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b7c158360 0x7f1b7c1df690 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800e4f0 tx=0x7f1b7800e9b0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.586+0000 7f1b71ffb640 1 -- 172.21.15.100:0/4266062154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b7c158360 msgr2=0x7f1b7c1df690 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:25:47.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.586+0000 7f1b71ffb640 1 --2- 172.21.15.100:0/4266062154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b7c158360 0x7f1b7c1df690 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.586+0000 7f1b81a14640 1 --2- 172.21.15.100:0/4266062154 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1b6006be30 0x7f1b6006e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1b740012e0 tx=0x7f1b74009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:47.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.594+0000 7f1b83477640 1 --2- 172.21.15.100:0/4266062154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b7c1479a0 0x7f1b7c147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.594+0000 7f1b83477640 1 -- 172.21.15.100:0/4266062154 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7c1dd740 con 0x7f1b7c1479a0 2024-09-11T22:25:47.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.595+0000 7f1b81213640 1 --2- 172.21.15.100:0/4266062154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b7c1479a0 0x7f1b7c147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.595+0000 7f1b81213640 1 -- 172.21.15.100:0/4266062154 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1b7c1482c0 con 0x7f1b7c1479a0 2024-09-11T22:25:47.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.595+0000 7f1b81213640 1 --2- 172.21.15.100:0/4266062154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b7c1479a0 0x7f1b7c147d80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1b78017000 tx=0x7f1b780011a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:47.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.595+0000 7f1b71ffb640 1 -- 172.21.15.100:0/4266062154 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7801dbd0 con 0x7f1b7c1479a0 2024-09-11T22:25:47.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.596+0000 7f1b71ffb640 1 -- 172.21.15.100:0/4266062154 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4887 (secure 0 0 0) 0x7f1b78007710 con 0x7f1b7c1479a0 2024-09-11T22:25:47.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.596+0000 7f1b71ffb640 1 -- 172.21.15.100:0/4266062154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b7c1479a0 msgr2=0x7f1b7c147d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.596+0000 7f1b71ffb640 1 --2- 172.21.15.100:0/4266062154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b7c1479a0 0x7f1b7c147d80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1b78017000 tx=0x7f1b780011a0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.596+0000 7f1b71ffb640 1 -- 172.21.15.100:0/4266062154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b7c1479a0 msgr2=0x7f1b7c147d80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:25:47.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.596+0000 7f1b71ffb640 1 --2- 172.21.15.100:0/4266062154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b7c1479a0 0x7f1b7c147d80 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1b78017000 tx=0x7f1b780011a0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.597 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:25:47.598 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:25:47.598 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:25:47.598 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:25:47.598 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 42, 2024-09-11T22:25:47.598 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 132873, 2024-09-11T22:25:47.598 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:25:47.598 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:25:47.598 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:25:47.598 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:25:47.598 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:47.598 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:25:47.598 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:25:47.598 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:25:47.598 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:25:47.599 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:47.599 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:47.599 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:47.599 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:47.599 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:47.599 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:47.599 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:47.599 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:47.599 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:47.599 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:47.599 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:47.599 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:47.599 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:25:47.600 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:25:47.600 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:47.600 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:47.600 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:47.600 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:47.600 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:47.600 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:47.600 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:47.600 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:47.600 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:47.600 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:47.601 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:47.601 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:47.601 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.601 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:25:47.601 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:25:47.601 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:25:47.601 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:25:47.601 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:25:47.601 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:25:47.601 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:25:47.601 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:25:47.601 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:25:47.601 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:25:47.601 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:25:47.602 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:25:47.602 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:25:47.602 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:25:47.602 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:25:47.602 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:25:47.602 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:25:47.602 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:47.602 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:47.602 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:47.602 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:47.602 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:47.602 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:47.602 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:47.602 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:47.603 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:47.603 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:47.603 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:47.603 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:47.603 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:25:47.603 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.603 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:25:47.603 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.603 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:25:47.603 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:25:47.603 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:47.603 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:47.603 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.604 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:47.604 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:25:47.604 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:47.604 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.604 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.604 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:47.604 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:25:47.604 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:47.604 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:47.604 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:47.604 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.604 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:25:47.604 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:25:47.605 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:47.605 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:47.605 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:47.605 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.605 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.605 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:25:47.605 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:25:47.605 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:47.605 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:47.605 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.605 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:47.605 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:25:47.605 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:47.606 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.606 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.606 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:47.606 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:25:47.606 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:47.606 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:47.606 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:47.606 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.606 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:25:47.606 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:25:47.606 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:47.606 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:47.606 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:47.606 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.607 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.607 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:25:47.607 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:25:47.607 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:47.607 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:47.607 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.607 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:47.607 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:25:47.607 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:47.607 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.607 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.607 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:47.607 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:25:47.608 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:47.608 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:47.608 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:47.608 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.608 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:25:47.608 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:25:47.608 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:47.608 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:47.608 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:47.608 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:47.608 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:47.608 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.608 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:25:47.608 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:25:47.608 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.609 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:47.609 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:47.609 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:25:47.609 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:47.609 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:47.609 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:25:47.609 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.609 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:47.609 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:47.609 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:25:47.609 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:47.609 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:47.609 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:25:47.609 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.610 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:47.610 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:47.610 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:25:47.610 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:47.610 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:47.610 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:25:47.610 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.610 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:47.610 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:47.610 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:25:47.610 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:47.610 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:47.610 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.610 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:25:47.611 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:25:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.596+0000 7f1b83477640 1 -- 172.21.15.100:0/4266062154 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1b6006be30 msgr2=0x7f1b6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.596+0000 7f1b83477640 1 --2- 172.21.15.100:0/4266062154 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1b6006be30 0x7f1b6006e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1b740012e0 tx=0x7f1b74009040 comp rx=0 tx=0).stop 2024-09-11T22:25:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.596+0000 7f1b83477640 1 -- 172.21.15.100:0/4266062154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b7c072f30 msgr2=0x7f1b7c14cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.596+0000 7f1b83477640 1 --2- 172.21.15.100:0/4266062154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b7c072f30 0x7f1b7c14cc50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c035040 tx=0x7f1b6c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.596+0000 7f1b81a14640 1 -- 172.21.15.100:0/4266062154 reap_dead start 2024-09-11T22:25:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.596+0000 7f1b81a14640 1 -- 172.21.15.100:0/4266062154 reap_dead start 2024-09-11T22:25:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.596+0000 7f1b83477640 1 -- 172.21.15.100:0/4266062154 shutdown_connections 2024-09-11T22:25:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.596+0000 7f1b83477640 1 -- 172.21.15.100:0/4266062154 >> 172.21.15.100:0/4266062154 conn(0x7f1b7c06ee80 msgr2=0x7f1b7c0c8050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.596+0000 7f1b83477640 1 -- 172.21.15.100:0/4266062154 shutdown_connections 2024-09-11T22:25:47.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.597+0000 7f1b83477640 1 -- 172.21.15.100:0/4266062154 wait complete. 2024-09-11T22:25:47.613 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:25:47.613 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:25:47.613 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:25:47.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.718+0000 7f32a5404640 1 Processor -- start 2024-09-11T22:25:47.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.718+0000 7f32a5404640 1 -- start start 2024-09-11T22:25:47.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.719+0000 7f32a5404640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f32a00c99e0 0x7f32a006f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.719+0000 7f32a5404640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32a00c6340 con 0x7f32a00c9600 2024-09-11T22:25:47.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.719+0000 7f32a5404640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32a00c6600 con 0x7f32a0075920 2024-09-11T22:25:47.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.719+0000 7f32a5404640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f32a015bcb0 con 0x7f32a00c99e0 2024-09-11T22:25:47.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.719+0000 7f329effd640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f32a00c9600 0x7f32a00c8960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39164/0 (socket says 172.21.15.100:39164) 2024-09-11T22:25:47.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.719+0000 7f329effd640 1 -- 172.21.15.100:0/1077433036 learned_addr learned my addr 172.21.15.100:0/1077433036 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:25:47.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.719+0000 7f329e7fc640 1 --2- 172.21.15.100:0/1077433036 >> v2:172.21.15.167:3300/0 conn(0x7f32a00c99e0 0x7f32a006f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.719+0000 7f329dffb640 1 -- 172.21.15.100:0/1077433036 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2471384148 0 0) 0x7f32a00c6340 con 0x7f32a00c9600 2024-09-11T22:25:47.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.719+0000 7f329dffb640 1 -- 172.21.15.100:0/1077433036 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3288003520 con 0x7f32a00c9600 2024-09-11T22:25:47.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.720+0000 7f329e7fc640 1 -- 172.21.15.100:0/1077433036 >> v1:172.21.15.167:6789/0 conn(0x7f32a0075920 legacy=0x7f32a0152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.720+0000 7f329e7fc640 1 -- 172.21.15.100:0/1077433036 >> v1:172.21.15.100:6789/0 conn(0x7f32a00c9600 legacy=0x7f32a00c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.720+0000 7f329e7fc640 1 -- 172.21.15.100:0/1077433036 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a00c68e0 con 0x7f32a00c99e0 2024-09-11T22:25:47.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.720+0000 7f329e7fc640 1 --2- 172.21.15.100:0/1077433036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32a00c99e0 0x7f32a006f1d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f32940097a0 tx=0x7f329402a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c08f986d248e67e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:47.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.721+0000 7f329dffb640 1 -- 172.21.15.100:0/1077433036 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294037070 con 0x7f32a00c99e0 2024-09-11T22:25:47.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.721+0000 7f329dffb640 1 -- 172.21.15.100:0/1077433036 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3294032640 con 0x7f32a00c99e0 2024-09-11T22:25:47.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.721+0000 7f329dffb640 1 -- 172.21.15.100:0/1077433036 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32940329f0 con 0x7f32a00c99e0 2024-09-11T22:25:47.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.721+0000 7f32a5404640 1 -- 172.21.15.100:0/1077433036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32a00c99e0 msgr2=0x7f32a006f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.721+0000 7f32a5404640 1 --2- 172.21.15.100:0/1077433036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32a00c99e0 0x7f32a006f1d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f32940097a0 tx=0x7f329402a2c0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.721+0000 7f32a5404640 1 -- 172.21.15.100:0/1077433036 shutdown_connections 2024-09-11T22:25:47.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.721+0000 7f32a5404640 1 --2- 172.21.15.100:0/1077433036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32a00c99e0 0x7f32a006f1d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.721+0000 7f32a5404640 1 -- 172.21.15.100:0/1077433036 >> 172.21.15.100:0/1077433036 conn(0x7f32a006bdf0 msgr2=0x7f32a006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:47.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.721+0000 7f32a5404640 1 -- 172.21.15.100:0/1077433036 shutdown_connections 2024-09-11T22:25:47.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.721+0000 7f32a5404640 1 -- 172.21.15.100:0/1077433036 wait complete. 2024-09-11T22:25:47.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.722+0000 7f32a5404640 1 Processor -- start 2024-09-11T22:25:47.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.722+0000 7f32a5404640 1 -- start start 2024-09-11T22:25:47.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.723+0000 7f32a5404640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32a0075920 0x7f32a0155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.723+0000 7f32a5404640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32a00c9600 0x7f32a01573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.723+0000 7f32a5404640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32a00c99e0 0x7f32a01ee130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.723+0000 7f32a5404640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f32a015c4c0 con 0x7f32a00c99e0 2024-09-11T22:25:47.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.723+0000 7f32a5404640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f32a015c1e0 con 0x7f32a00c9600 2024-09-11T22:25:47.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.723+0000 7f32a5404640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f32a015c9e0 con 0x7f32a0075920 2024-09-11T22:25:47.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.723+0000 7f329f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32a00c99e0 0x7f32a01ee130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.723+0000 7f329f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32a00c99e0 0x7f32a01ee130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43076/0 (socket says 172.21.15.100:43076) 2024-09-11T22:25:47.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.723+0000 7f329f7fe640 1 -- 172.21.15.100:0/2096530308 learned_addr learned my addr 172.21.15.100:0/2096530308 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:47.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.723+0000 7f329e7fc640 1 --2- 172.21.15.100:0/2096530308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32a00c9600 0x7f32a01573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.723+0000 7f329effd640 1 --2- 172.21.15.100:0/2096530308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32a0075920 0x7f32a0155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.724+0000 7f329f7fe640 1 -- 172.21.15.100:0/2096530308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32a0075920 msgr2=0x7f32a0155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.724+0000 7f329f7fe640 1 --2- 172.21.15.100:0/2096530308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32a0075920 0x7f32a0155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.724+0000 7f329f7fe640 1 -- 172.21.15.100:0/2096530308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32a00c9600 msgr2=0x7f32a01573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.724+0000 7f329f7fe640 1 --2- 172.21.15.100:0/2096530308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32a00c9600 0x7f32a01573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.724+0000 7f329f7fe640 1 -- 172.21.15.100:0/2096530308 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a01563e0 con 0x7f32a00c99e0 2024-09-11T22:25:47.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.724+0000 7f329e7fc640 1 --2- 172.21.15.100:0/2096530308 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32a00c9600 0x7f32a01573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:25:47.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.724+0000 7f329f7fe640 1 --2- 172.21.15.100:0/2096530308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32a00c99e0 0x7f32a01ee130 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f329800c6e0 tx=0x7f329800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:47.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.724+0000 7f32877fe640 1 -- 172.21.15.100:0/2096530308 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3298003b70 con 0x7f32a00c99e0 2024-09-11T22:25:47.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.724+0000 7f32877fe640 1 -- 172.21.15.100:0/2096530308 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3298003d30 con 0x7f32a00c99e0 2024-09-11T22:25:47.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.724+0000 7f32a5404640 1 -- 172.21.15.100:0/2096530308 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a0154610 con 0x7f32a00c99e0 2024-09-11T22:25:47.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.724+0000 7f32877fe640 1 -- 172.21.15.100:0/2096530308 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3298005310 con 0x7f32a00c99e0 2024-09-11T22:25:47.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.724+0000 7f32a5404640 1 -- 172.21.15.100:0/2096530308 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a00cd380 con 0x7f32a00c99e0 2024-09-11T22:25:47.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.725+0000 7f32a5404640 1 --2- 172.21.15.100:0/2096530308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32a00c3ee0 0x7f32a0154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.725+0000 7f32a5404640 1 -- 172.21.15.100:0/2096530308 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f32a006fc40 con 0x7f32a00c3ee0 2024-09-11T22:25:47.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.725+0000 7f329effd640 1 --2- 172.21.15.100:0/2096530308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32a00c3ee0 0x7f32a0154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.725+0000 7f329effd640 1 -- 172.21.15.100:0/2096530308 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f32a0150ac0 con 0x7f32a00c3ee0 2024-09-11T22:25:47.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.726+0000 7f329effd640 1 --2- 172.21.15.100:0/2096530308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32a00c3ee0 0x7f32a0154c60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3290000f60 tx=0x7f32900018d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:47.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.726+0000 7f32877fe640 1 -- 172.21.15.100:0/2096530308 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32980054b0 con 0x7f32a00c99e0 2024-09-11T22:25:47.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.726+0000 7f32877fe640 1 --2- 172.21.15.100:0/2096530308 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f328c06be30 0x7f328c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.726+0000 7f329e7fc640 1 --2- 172.21.15.100:0/2096530308 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f328c06be30 0x7f328c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.726+0000 7f32877fe640 1 -- 172.21.15.100:0/2096530308 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f329808aef0 con 0x7f32a00c99e0 2024-09-11T22:25:47.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.726+0000 7f32877fe640 1 -- 172.21.15.100:0/2096530308 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3290017020 con 0x7f32a00c3ee0 2024-09-11T22:25:47.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.726+0000 7f32877fe640 1 -- 172.21.15.100:0/2096530308 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3290013600 con 0x7f32a00c3ee0 2024-09-11T22:25:47.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.726+0000 7f32877fe640 1 -- 172.21.15.100:0/2096530308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32a00c3ee0 msgr2=0x7f32a0154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.726+0000 7f32877fe640 1 --2- 172.21.15.100:0/2096530308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32a00c3ee0 0x7f32a0154c60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3290000f60 tx=0x7f32900018d0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.726+0000 7f32877fe640 1 -- 172.21.15.100:0/2096530308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32a00c3ee0 msgr2=0x7f32a0154c60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:25:47.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.726+0000 7f32877fe640 1 --2- 172.21.15.100:0/2096530308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32a00c3ee0 0x7f32a0154c60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.727+0000 7f329e7fc640 1 --2- 172.21.15.100:0/2096530308 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f328c06be30 0x7f328c06e2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3294034000 tx=0x7f329402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:47.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.733+0000 7f32a5404640 1 --2- 172.21.15.100:0/2096530308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32a01ee670 0x7f32a01f1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.733+0000 7f32a5404640 1 -- 172.21.15.100:0/2096530308 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f32a01eea50 con 0x7f32a01ee670 2024-09-11T22:25:47.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.733+0000 7f329effd640 1 --2- 172.21.15.100:0/2096530308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32a01ee670 0x7f32a01f1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.733+0000 7f329effd640 1 -- 172.21.15.100:0/2096530308 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f32a00c88e0 con 0x7f32a01ee670 2024-09-11T22:25:47.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.734+0000 7f329effd640 1 --2- 172.21.15.100:0/2096530308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32a01ee670 0x7f32a01f1480 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f32900078c0 tx=0x7f3290001150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:47.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.734+0000 7f32877fe640 1 -- 172.21.15.100:0/2096530308 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3290017050 con 0x7f32a01ee670 2024-09-11T22:25:47.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.734+0000 7f32877fe640 1 -- 172.21.15.100:0/2096530308 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7f3290006450 con 0x7f32a01ee670 2024-09-11T22:25:47.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.734+0000 7f32877fe640 1 -- 172.21.15.100:0/2096530308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32a01ee670 msgr2=0x7f32a01f1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.734+0000 7f32877fe640 1 --2- 172.21.15.100:0/2096530308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32a01ee670 0x7f32a01f1480 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f32900078c0 tx=0x7f3290001150 comp rx=0 tx=0).stop 2024-09-11T22:25:47.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.734+0000 7f32877fe640 1 -- 172.21.15.100:0/2096530308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32a01ee670 msgr2=0x7f32a01f1480 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:25:47.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.734+0000 7f32877fe640 1 --2- 172.21.15.100:0/2096530308 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32a01ee670 0x7f32a01f1480 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.736 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:25:47.736 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:25:47.736 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:25:47.736 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:25:47.736 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 42, 2024-09-11T22:25:47.736 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 238455, 2024-09-11T22:25:47.736 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:25:47.737 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:25:47.737 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:25:47.737 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:25:47.737 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:47.737 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:25:47.737 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:25:47.737 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:25:47.737 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:25:47.737 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:47.737 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:47.737 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:47.737 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:47.737 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:47.738 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:47.738 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:47.738 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:47.738 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:47.738 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:47.738 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:47.738 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:47.738 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:25:47.738 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:25:47.738 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:47.738 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:47.738 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:47.738 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:47.738 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:47.739 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:47.739 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:47.739 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:47.739 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:47.739 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:47.739 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:47.739 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:47.739 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.739 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:25:47.739 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:25:47.739 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:25:47.739 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:25:47.739 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:25:47.739 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:25:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:25:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:25:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:25:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:25:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:25:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:25:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:25:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:25:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:25:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:25:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:25:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:47.740 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:25:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.741 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:25:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:25:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:25:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:25:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:25:47.742 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:25:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:25:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:25:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:25:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:47.743 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:25:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:25:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.744 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:25:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:25:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:25:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:25:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:25:47.745 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:25:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:25:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:25:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:47.746 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:25:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:25:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:25:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:47.747 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:25:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:25:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:25:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:47.748 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:47.749 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:25:47.749 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:47.750 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:47.750 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:25:47.750 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.750 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:47.750 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:47.750 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:25:47.750 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:47.750 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:47.750 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:25:47.750 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:47.750 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:47.750 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:47.750 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:25:47.751 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:47.751 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:47.751 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:47.751 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:25:47.751 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:25:47.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.734+0000 7f32a5404640 1 -- 172.21.15.100:0/2096530308 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f328c06be30 msgr2=0x7f328c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.734+0000 7f32a5404640 1 --2- 172.21.15.100:0/2096530308 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f328c06be30 0x7f328c06e2f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3294034000 tx=0x7f329402e000 comp rx=0 tx=0).stop 2024-09-11T22:25:47.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.734+0000 7f32a5404640 1 -- 172.21.15.100:0/2096530308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32a00c99e0 msgr2=0x7f32a01ee130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.734+0000 7f32a5404640 1 --2- 172.21.15.100:0/2096530308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32a00c99e0 0x7f32a01ee130 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f329800c6e0 tx=0x7f329800cba0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.734+0000 7f329f7fe640 1 -- 172.21.15.100:0/2096530308 reap_dead start 2024-09-11T22:25:47.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.734+0000 7f329f7fe640 1 -- 172.21.15.100:0/2096530308 reap_dead start 2024-09-11T22:25:47.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.734+0000 7f32a5404640 1 -- 172.21.15.100:0/2096530308 shutdown_connections 2024-09-11T22:25:47.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.734+0000 7f32a5404640 1 -- 172.21.15.100:0/2096530308 >> 172.21.15.100:0/2096530308 conn(0x7f32a006bdf0 msgr2=0x7f32a014ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:47.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.734+0000 7f32a5404640 1 -- 172.21.15.100:0/2096530308 shutdown_connections 2024-09-11T22:25:47.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.734+0000 7f32a5404640 1 -- 172.21.15.100:0/2096530308 wait complete. 2024-09-11T22:25:47.753 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:25:47.753 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-11T22:25:47.755 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-11T22:25:47.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.876+0000 7f94947b7640 1 Processor -- start 2024-09-11T22:25:47.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.876+0000 7f94947b7640 1 -- start start 2024-09-11T22:25:47.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.878+0000 7f94947b7640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f948c1527d0 0x7f948c06e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.878+0000 7f94947b7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f948c0c8a70 0x7f948c0c9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.878+0000 7f94947b7640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f948c0c5080 con 0x7f948c0c8250 2024-09-11T22:25:47.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.878+0000 7f94947b7640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f948c0ca3b0 con 0x7f948c1527d0 2024-09-11T22:25:47.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.878+0000 7f94947b7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f948c0ca690 con 0x7f948c0c8a70 2024-09-11T22:25:47.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.878+0000 7f9492553640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f948c1527d0 0x7f948c06e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.878+0000 7f9492553640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f948c1527d0 0x7f948c06e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43084/0 (socket says 172.21.15.100:43084) 2024-09-11T22:25:47.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.878+0000 7f9492553640 1 -- 172.21.15.100:0/1682991647 learned_addr learned my addr 172.21.15.100:0/1682991647 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:47.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.878+0000 7f9492d54640 1 --1- 172.21.15.100:0/1682991647 >> v1:172.21.15.100:6789/0 conn(0x7f948c0c8250 0x7f948c0cab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39174/0 (socket says 172.21.15.100:39174) 2024-09-11T22:25:47.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.878+0000 7f9491d52640 1 --2- 172.21.15.100:0/1682991647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f948c0c8a70 0x7f948c0c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.878+0000 7f9492553640 1 -- 172.21.15.100:0/1682991647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f948c0c8a70 msgr2=0x7f948c0c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:25:47.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.878+0000 7f9492553640 1 --2- 172.21.15.100:0/1682991647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f948c0c8a70 0x7f948c0c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.878+0000 7f9492553640 1 -- 172.21.15.100:0/1682991647 >> v1:172.21.15.100:6789/0 conn(0x7f948c0c8250 legacy=0x7f948c0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.878+0000 7f9492553640 1 -- 172.21.15.100:0/1682991647 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948c06edc0 con 0x7f948c1527d0 2024-09-11T22:25:47.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.879+0000 7f9492553640 1 --2- 172.21.15.100:0/1682991647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f948c1527d0 0x7f948c06e120 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9488009870 tx=0x7f948802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db44401b4ec122 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:47.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.879+0000 7f9491551640 1 -- 172.21.15.100:0/1682991647 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9488037070 con 0x7f948c1527d0 2024-09-11T22:25:47.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.879+0000 7f9491551640 1 -- 172.21.15.100:0/1682991647 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f948802ae50 con 0x7f948c1527d0 2024-09-11T22:25:47.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.879+0000 7f9491551640 1 -- 172.21.15.100:0/1682991647 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9488032860 con 0x7f948c1527d0 2024-09-11T22:25:47.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.880+0000 7f94947b7640 1 -- 172.21.15.100:0/1682991647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f948c1527d0 msgr2=0x7f948c06e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.880+0000 7f94947b7640 1 --2- 172.21.15.100:0/1682991647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f948c1527d0 0x7f948c06e120 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9488009870 tx=0x7f948802a300 comp rx=0 tx=0).stop 2024-09-11T22:25:47.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.880+0000 7f94947b7640 1 -- 172.21.15.100:0/1682991647 shutdown_connections 2024-09-11T22:25:47.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.880+0000 7f94947b7640 1 --2- 172.21.15.100:0/1682991647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f948c0c8a70 0x7f948c0c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.880+0000 7f94947b7640 1 --2- 172.21.15.100:0/1682991647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f948c1527d0 0x7f948c06e120 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.880+0000 7f94947b7640 1 -- 172.21.15.100:0/1682991647 >> 172.21.15.100:0/1682991647 conn(0x7f948c073900 msgr2=0x7f948c073ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:47.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.880+0000 7f94947b7640 1 -- 172.21.15.100:0/1682991647 shutdown_connections 2024-09-11T22:25:47.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.880+0000 7f94947b7640 1 -- 172.21.15.100:0/1682991647 wait complete. 2024-09-11T22:25:47.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.881+0000 7f94947b7640 1 Processor -- start 2024-09-11T22:25:47.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.881+0000 7f94947b7640 1 -- start start 2024-09-11T22:25:47.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.882+0000 7f94947b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f948c0c8250 0x7f948c1e5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.882+0000 7f94947b7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f948c0c8a70 0x7f948c14ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.882+0000 7f94947b7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f948c1527d0 0x7f948c1f14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.882+0000 7f94947b7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f948c0cb390 con 0x7f948c0c8250 2024-09-11T22:25:47.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.882+0000 7f94947b7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f948c0cb210 con 0x7f948c1527d0 2024-09-11T22:25:47.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.882+0000 7f94947b7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f948c0c9840 con 0x7f948c0c8a70 2024-09-11T22:25:47.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.882+0000 7f9492553640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f948c0c8250 0x7f948c1e5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.882+0000 7f9492553640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f948c0c8250 0x7f948c1e5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43086/0 (socket says 172.21.15.100:43086) 2024-09-11T22:25:47.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.882+0000 7f9492553640 1 -- 172.21.15.100:0/1935323807 learned_addr learned my addr 172.21.15.100:0/1935323807 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:47.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.882+0000 7f9491d52640 1 --2- 172.21.15.100:0/1935323807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f948c0c8a70 0x7f948c14ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.882+0000 7f9492d54640 1 --2- 172.21.15.100:0/1935323807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f948c1527d0 0x7f948c1f14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.882+0000 7f9492553640 1 -- 172.21.15.100:0/1935323807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f948c0c8a70 msgr2=0x7f948c14ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.882+0000 7f9492553640 1 --2- 172.21.15.100:0/1935323807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f948c0c8a70 0x7f948c14ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.882+0000 7f9492553640 1 -- 172.21.15.100:0/1935323807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f948c1527d0 msgr2=0x7f948c1f14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:47.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.882+0000 7f9492553640 1 --2- 172.21.15.100:0/1935323807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f948c1527d0 0x7f948c1f14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:47.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.882+0000 7f9492553640 1 -- 172.21.15.100:0/1935323807 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948c15c560 con 0x7f948c0c8250 2024-09-11T22:25:47.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.882+0000 7f9492553640 1 --2- 172.21.15.100:0/1935323807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f948c0c8250 0x7f948c1e5670 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9488009870 tx=0x7f94880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:47.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.882+0000 7f9482ffd640 1 -- 172.21.15.100:0/1935323807 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9488042070 con 0x7f948c0c8250 2024-09-11T22:25:47.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.883+0000 7f9482ffd640 1 -- 172.21.15.100:0/1935323807 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f948803e670 con 0x7f948c0c8250 2024-09-11T22:25:47.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.883+0000 7f94947b7640 1 -- 172.21.15.100:0/1935323807 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f948c15c820 con 0x7f948c0c8250 2024-09-11T22:25:47.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.883+0000 7f9482ffd640 1 -- 172.21.15.100:0/1935323807 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9488037040 con 0x7f948c0c8250 2024-09-11T22:25:47.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.883+0000 7f94947b7640 1 -- 172.21.15.100:0/1935323807 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f948c1e4e70 con 0x7f948c0c8250 2024-09-11T22:25:47.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.884+0000 7f94947b7640 1 -- 172.21.15.100:0/1935323807 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f948c0c9300 con 0x7f948c0c8250 2024-09-11T22:25:47.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.884+0000 7f9482ffd640 1 -- 172.21.15.100:0/1935323807 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9488045070 con 0x7f948c0c8250 2024-09-11T22:25:47.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.884+0000 7f9482ffd640 1 --2- 172.21.15.100:0/1935323807 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f947006be60 0x7f947006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:47.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.885+0000 7f9482ffd640 1 -- 172.21.15.100:0/1935323807 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f94880abaa0 con 0x7f948c0c8250 2024-09-11T22:25:47.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.885+0000 7f9491d52640 1 --2- 172.21.15.100:0/1935323807 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f947006be60 0x7f947006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:47.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.885+0000 7f9491d52640 1 --2- 172.21.15.100:0/1935323807 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f947006be60 0x7f947006e320 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f948c151230 tx=0x7f947c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:47.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:47.889+0000 7f9482ffd640 1 -- 172.21.15.100:0/1935323807 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f94880799e0 con 0x7f948c0c8250 2024-09-11T22:25:48.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:48.158+0000 7f94947b7640 1 -- 172.21.15.100:0/1935323807 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f948c0caca0 con 0x7f948c0c8250 2024-09-11T22:25:48.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:48.159+0000 7f9482ffd640 1 -- 172.21.15.100:0/1935323807 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f948807dce0 con 0x7f948c0c8250 2024-09-11T22:25:48.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:48.162+0000 7f94947b7640 1 -- 172.21.15.100:0/1935323807 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f947006be60 msgr2=0x7f947006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:48.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:48.162+0000 7f94947b7640 1 --2- 172.21.15.100:0/1935323807 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f947006be60 0x7f947006e320 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f948c151230 tx=0x7f947c008040 comp rx=0 tx=0).stop 2024-09-11T22:25:48.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:48.162+0000 7f94947b7640 1 -- 172.21.15.100:0/1935323807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f948c0c8250 msgr2=0x7f948c1e5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:48.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:48.162+0000 7f94947b7640 1 --2- 172.21.15.100:0/1935323807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f948c0c8250 0x7f948c1e5670 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9488009870 tx=0x7f94880046c0 comp rx=0 tx=0).stop 2024-09-11T22:25:48.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:48.162+0000 7f94947b7640 1 -- 172.21.15.100:0/1935323807 shutdown_connections 2024-09-11T22:25:48.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:48.162+0000 7f94947b7640 1 --2- 172.21.15.100:0/1935323807 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f947006be60 0x7f947006e320 secure :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f948c151230 tx=0x7f947c008040 comp rx=0 tx=0).stop 2024-09-11T22:25:48.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:48.162+0000 7f94947b7640 1 --2- 172.21.15.100:0/1935323807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f948c1527d0 0x7f948c1f14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:48.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:48.162+0000 7f94947b7640 1 --2- 172.21.15.100:0/1935323807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f948c0c8a70 0x7f948c14ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:48.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:48.162+0000 7f94947b7640 1 --2- 172.21.15.100:0/1935323807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f948c0c8250 0x7f948c1e5670 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:48.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:48.162+0000 7f94947b7640 1 -- 172.21.15.100:0/1935323807 >> 172.21.15.100:0/1935323807 conn(0x7f948c073900 msgr2=0x7f948c0c40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:48.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:48.162+0000 7f94947b7640 1 -- 172.21.15.100:0/1935323807 shutdown_connections 2024-09-11T22:25:48.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:48.162+0000 7f94947b7640 1 -- 172.21.15.100:0/1935323807 wait complete. 2024-09-11T22:25:48.175 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-11T22:25:50.333 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:25:50.335 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:25:58.177 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:25:58.177 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:25:58.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.281+0000 7fd71f4b7640 1 Processor -- start 2024-09-11T22:25:58.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.282+0000 7fd71f4b7640 1 -- start start 2024-09-11T22:25:58.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.283+0000 7fd71f4b7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd718154c20 0x7fd7180cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.283+0000 7fd71f4b7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7180b3190 0x7fd71815e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.283+0000 7fd71f4b7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd71815ac90 con 0x7fd71815a7e0 2024-09-11T22:25:58.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.283+0000 7fd71f4b7640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fd71815e000 con 0x7fd718154c20 2024-09-11T22:25:58.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.283+0000 7fd71f4b7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd71815af70 con 0x7fd7180b3190 2024-09-11T22:25:58.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.283+0000 7fd71d253640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd718154c20 0x7fd7180cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.283+0000 7fd71ca52640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7180b3190 0x7fd71815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.283+0000 7fd71d253640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd718154c20 0x7fd7180cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:41390/0 (socket says 172.21.15.100:41390) 2024-09-11T22:25:58.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.283+0000 7fd71ca52640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7180b3190 0x7fd71815e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:60056/0 (socket says 172.21.15.100:60056) 2024-09-11T22:25:58.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.283+0000 7fd71d253640 1 -- 172.21.15.100:0/1859197022 learned_addr learned my addr 172.21.15.100:0/1859197022 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:58.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.284+0000 7fd71ca52640 1 -- 172.21.15.100:0/1859197022 >> v2:172.21.15.167:3300/0 conn(0x7fd718154c20 msgr2=0x7fd7180cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:25:58.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.284+0000 7fd71ca52640 1 --2- 172.21.15.100:0/1859197022 >> v2:172.21.15.167:3300/0 conn(0x7fd718154c20 0x7fd7180cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.284+0000 7fd71ca52640 1 -- 172.21.15.100:0/1859197022 >> v1:172.21.15.167:6789/0 conn(0x7fd71815a7e0 legacy=0x7fd7180cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.284+0000 7fd71ca52640 1 -- 172.21.15.100:0/1859197022 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd71815b250 con 0x7fd7180b3190 2024-09-11T22:25:58.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.285+0000 7fd71ca52640 1 --2- 172.21.15.100:0/1859197022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7180b3190 0x7fd71815e490 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd7080097a0 tx=0x7fd70802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c44026248e130dd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:58.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.286+0000 7fd70ffff640 1 -- 172.21.15.100:0/1859197022 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd708037070 con 0x7fd7180b3190 2024-09-11T22:25:58.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.286+0000 7fd70ffff640 1 -- 172.21.15.100:0/1859197022 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd708032440 con 0x7fd7180b3190 2024-09-11T22:25:58.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.286+0000 7fd70ffff640 1 -- 172.21.15.100:0/1859197022 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd708032810 con 0x7fd7180b3190 2024-09-11T22:25:58.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.287+0000 7fd71f4b7640 1 -- 172.21.15.100:0/1859197022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7180b3190 msgr2=0x7fd71815e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.287+0000 7fd71f4b7640 1 --2- 172.21.15.100:0/1859197022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7180b3190 0x7fd71815e490 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd7080097a0 tx=0x7fd70802a180 comp rx=0 tx=0).stop 2024-09-11T22:25:58.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.287+0000 7fd71f4b7640 1 -- 172.21.15.100:0/1859197022 shutdown_connections 2024-09-11T22:25:58.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.287+0000 7fd71f4b7640 1 --2- 172.21.15.100:0/1859197022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7180b3190 0x7fd71815e490 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.287+0000 7fd71f4b7640 1 --2- 172.21.15.100:0/1859197022 >> v2:172.21.15.167:3300/0 conn(0x7fd718154c20 0x7fd7180cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.287+0000 7fd71f4b7640 1 -- 172.21.15.100:0/1859197022 >> 172.21.15.100:0/1859197022 conn(0x7fd718067d40 msgr2=0x7fd71806d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:58.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.287+0000 7fd71f4b7640 1 -- 172.21.15.100:0/1859197022 shutdown_connections 2024-09-11T22:25:58.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.287+0000 7fd71f4b7640 1 -- 172.21.15.100:0/1859197022 wait complete. 2024-09-11T22:25:58.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.288+0000 7fd71f4b7640 1 Processor -- start 2024-09-11T22:25:58.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.288+0000 7fd71f4b7640 1 -- start start 2024-09-11T22:25:58.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.289+0000 7fd71f4b7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7180b3190 0x7fd71815d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.289+0000 7fd71f4b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd718154c20 0x7fd7181f1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.289+0000 7fd71f4b7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd71815a7e0 0x7fd71814a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.289+0000 7fd71f4b7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd7180cc5a0 con 0x7fd718154c20 2024-09-11T22:25:58.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.289+0000 7fd71f4b7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd7180cc420 con 0x7fd71815a7e0 2024-09-11T22:25:58.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.289+0000 7fd71f4b7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd7180cb660 con 0x7fd7180b3190 2024-09-11T22:25:58.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.289+0000 7fd71ca52640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd718154c20 0x7fd7181f1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.289+0000 7fd71ca52640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd718154c20 0x7fd7181f1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39386/0 (socket says 172.21.15.100:39386) 2024-09-11T22:25:58.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.289+0000 7fd71ca52640 1 -- 172.21.15.100:0/593356302 learned_addr learned my addr 172.21.15.100:0/593356302 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:58.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.289+0000 7fd71d253640 1 --2- 172.21.15.100:0/593356302 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7180b3190 0x7fd71815d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.289+0000 7fd71da54640 1 --2- 172.21.15.100:0/593356302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd71815a7e0 0x7fd71814a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.290+0000 7fd71ca52640 1 -- 172.21.15.100:0/593356302 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7180b3190 msgr2=0x7fd71815d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.290+0000 7fd71ca52640 1 --2- 172.21.15.100:0/593356302 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7180b3190 0x7fd71815d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.290+0000 7fd71ca52640 1 -- 172.21.15.100:0/593356302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd71815a7e0 msgr2=0x7fd71814a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.290+0000 7fd71ca52640 1 --2- 172.21.15.100:0/593356302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd71815a7e0 0x7fd71814a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.290+0000 7fd71ca52640 1 -- 172.21.15.100:0/593356302 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7181f0c60 con 0x7fd718154c20 2024-09-11T22:25:58.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.290+0000 7fd71ca52640 1 --2- 172.21.15.100:0/593356302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd718154c20 0x7fd7181f1420 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd7080098c0 tx=0x7fd7080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:58.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.290+0000 7fd70dffb640 1 -- 172.21.15.100:0/593356302 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd708037040 con 0x7fd718154c20 2024-09-11T22:25:58.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.290+0000 7fd70dffb640 1 -- 172.21.15.100:0/593356302 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd708030500 con 0x7fd718154c20 2024-09-11T22:25:58.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.290+0000 7fd70dffb640 1 -- 172.21.15.100:0/593356302 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7080308d0 con 0x7fd718154c20 2024-09-11T22:25:58.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.290+0000 7fd71f4b7640 1 -- 172.21.15.100:0/593356302 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd718158710 con 0x7fd718154c20 2024-09-11T22:25:58.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.290+0000 7fd71f4b7640 1 -- 172.21.15.100:0/593356302 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd718158440 con 0x7fd718154c20 2024-09-11T22:25:58.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.292+0000 7fd71f4b7640 1 -- 172.21.15.100:0/593356302 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7180cb120 con 0x7fd718154c20 2024-09-11T22:25:58.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.292+0000 7fd70dffb640 1 -- 172.21.15.100:0/593356302 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd708044020 con 0x7fd718154c20 2024-09-11T22:25:58.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.293+0000 7fd70dffb640 1 --2- 172.21.15.100:0/593356302 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd6fc06be30 0x7fd6fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.293+0000 7fd70dffb640 1 -- 172.21.15.100:0/593356302 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fd7080ab3d0 con 0x7fd718154c20 2024-09-11T22:25:58.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.293+0000 7fd71d253640 1 --2- 172.21.15.100:0/593356302 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd6fc06be30 0x7fd6fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.293+0000 7fd71d253640 1 --2- 172.21.15.100:0/593356302 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd6fc06be30 0x7fd6fc06e2f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd714009bd0 tx=0x7fd714009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:58.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.298+0000 7fd70dffb640 1 -- 172.21.15.100:0/593356302 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd708079310 con 0x7fd718154c20 2024-09-11T22:25:58.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.576+0000 7fd71f4b7640 1 -- 172.21.15.100:0/593356302 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd7180c5720 con 0x7fd718154c20 2024-09-11T22:25:58.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.577+0000 7fd70dffb640 1 -- 172.21.15.100:0/593356302 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fd70807d610 con 0x7fd718154c20 2024-09-11T22:25:58.578 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":42,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:25:58.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.579+0000 7fd71f4b7640 1 -- 172.21.15.100:0/593356302 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd6fc06be30 msgr2=0x7fd6fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.579+0000 7fd71f4b7640 1 --2- 172.21.15.100:0/593356302 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd6fc06be30 0x7fd6fc06e2f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd714009bd0 tx=0x7fd714009240 comp rx=0 tx=0).stop 2024-09-11T22:25:58.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.579+0000 7fd71f4b7640 1 -- 172.21.15.100:0/593356302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd718154c20 msgr2=0x7fd7181f1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.579+0000 7fd71f4b7640 1 --2- 172.21.15.100:0/593356302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd718154c20 0x7fd7181f1420 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd7080098c0 tx=0x7fd7080046c0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.579+0000 7fd71f4b7640 1 -- 172.21.15.100:0/593356302 shutdown_connections 2024-09-11T22:25:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.579+0000 7fd71f4b7640 1 --2- 172.21.15.100:0/593356302 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd6fc06be30 0x7fd6fc06e2f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.579+0000 7fd71f4b7640 1 --2- 172.21.15.100:0/593356302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd71815a7e0 0x7fd71814a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.579+0000 7fd71f4b7640 1 --2- 172.21.15.100:0/593356302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd718154c20 0x7fd7181f1420 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.579+0000 7fd71f4b7640 1 --2- 172.21.15.100:0/593356302 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd7180b3190 0x7fd71815d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.579+0000 7fd71f4b7640 1 -- 172.21.15.100:0/593356302 >> 172.21.15.100:0/593356302 conn(0x7fd718067d40 msgr2=0x7fd7180cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.579+0000 7fd71f4b7640 1 -- 172.21.15.100:0/593356302 shutdown_connections 2024-09-11T22:25:58.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.579+0000 7fd71f4b7640 1 -- 172.21.15.100:0/593356302 wait complete. 2024-09-11T22:25:58.591 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:25:58.592 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-11T22:25:58.592 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:25:58.592 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:25:58.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.696+0000 7f8b08131640 1 Processor -- start 2024-09-11T22:25:58.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.696+0000 7f8b08131640 1 -- start start 2024-09-11T22:25:58.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.697+0000 7f8b08131640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b000cc9b0 0x7f8b0015bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.697+0000 7f8b08131640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8b000ccd90 0x7f8b00152580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.697+0000 7f8b08131640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b000c6bb0 con 0x7f8b000c7710 2024-09-11T22:25:58.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.697+0000 7f8b08131640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f8b00075d50 con 0x7f8b000ccd90 2024-09-11T22:25:58.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.697+0000 7f8b08131640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8b000c7fa0 con 0x7f8b000cc9b0 2024-09-11T22:25:58.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.698+0000 7f8b056cc640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8b000ccd90 0x7f8b00152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.698+0000 7f8b066ce640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f8b000c7710 0x7f8b000c91c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33490/0 (socket says 172.21.15.100:33490) 2024-09-11T22:25:58.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.698+0000 7f8b066ce640 1 -- 172.21.15.100:0/860832529 learned_addr learned my addr 172.21.15.100:0/860832529 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:25:58.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.698+0000 7f8b05ecd640 1 --2- 172.21.15.100:0/860832529 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b000cc9b0 0x7f8b0015bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.698+0000 7f8b056cc640 1 -- 172.21.15.100:0/860832529 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b000cc9b0 msgr2=0x7f8b0015bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:25:58.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.698+0000 7f8b056cc640 1 --2- 172.21.15.100:0/860832529 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b000cc9b0 0x7f8b0015bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.698+0000 7f8b056cc640 1 -- 172.21.15.100:0/860832529 >> v1:172.21.15.100:6789/0 conn(0x7f8b000c7710 legacy=0x7f8b000c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.698+0000 7f8b056cc640 1 -- 172.21.15.100:0/860832529 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b000c8280 con 0x7f8b000ccd90 2024-09-11T22:25:58.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.698+0000 7f8b04ecb640 1 -- 172.21.15.100:0/860832529 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 168078733 0 0) 0x7f8b000c6bb0 con 0x7f8b000c7710 2024-09-11T22:25:58.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.699+0000 7f8b056cc640 1 --2- 172.21.15.100:0/860832529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b000ccd90 0x7f8b00152580 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8b00075ed0 tx=0x7f8af002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cdba3a0bc390ecb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:58.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.699+0000 7f8b04ecb640 1 -- 172.21.15.100:0/860832529 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0037070 con 0x7f8b000ccd90 2024-09-11T22:25:58.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.699+0000 7f8b04ecb640 1 -- 172.21.15.100:0/860832529 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af0032440 con 0x7f8b000ccd90 2024-09-11T22:25:58.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.699+0000 7f8b04ecb640 1 -- 172.21.15.100:0/860832529 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0032810 con 0x7f8b000ccd90 2024-09-11T22:25:58.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.700+0000 7f8b08131640 1 -- 172.21.15.100:0/860832529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b000ccd90 msgr2=0x7f8b00152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.700+0000 7f8b08131640 1 --2- 172.21.15.100:0/860832529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b000ccd90 0x7f8b00152580 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8b00075ed0 tx=0x7f8af002a210 comp rx=0 tx=0).stop 2024-09-11T22:25:58.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.700+0000 7f8b08131640 1 -- 172.21.15.100:0/860832529 shutdown_connections 2024-09-11T22:25:58.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.700+0000 7f8b08131640 1 --2- 172.21.15.100:0/860832529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b000ccd90 0x7f8b00152580 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.700+0000 7f8b08131640 1 --2- 172.21.15.100:0/860832529 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b000cc9b0 0x7f8b0015bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.700+0000 7f8b08131640 1 -- 172.21.15.100:0/860832529 >> 172.21.15.100:0/860832529 conn(0x7f8b0006fa70 msgr2=0x7f8b0006fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:58.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.700+0000 7f8b08131640 1 -- 172.21.15.100:0/860832529 shutdown_connections 2024-09-11T22:25:58.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.700+0000 7f8b08131640 1 -- 172.21.15.100:0/860832529 wait complete. 2024-09-11T22:25:58.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.701+0000 7f8b08131640 1 Processor -- start 2024-09-11T22:25:58.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.701+0000 7f8b08131640 1 -- start start 2024-09-11T22:25:58.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.702+0000 7f8b08131640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b000c7710 0x7f8b0015a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.702+0000 7f8b08131640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b000cc9b0 0x7f8b000c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.702+0000 7f8b08131640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b000ccd90 0x7f8b0014e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.702+0000 7f8b08131640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8b000c49f0 con 0x7f8b000cc9b0 2024-09-11T22:25:58.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.702+0000 7f8b08131640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8b000c4710 con 0x7f8b000ccd90 2024-09-11T22:25:58.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.702+0000 7f8b08131640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8b0015c1f0 con 0x7f8b000c7710 2024-09-11T22:25:58.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.702+0000 7f8b056cc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b000cc9b0 0x7f8b000c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.702+0000 7f8b056cc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b000cc9b0 0x7f8b000c2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39404/0 (socket says 172.21.15.100:39404) 2024-09-11T22:25:58.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.702+0000 7f8b056cc640 1 -- 172.21.15.100:0/1927105348 learned_addr learned my addr 172.21.15.100:0/1927105348 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:58.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.702+0000 7f8b05ecd640 1 --2- 172.21.15.100:0/1927105348 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b000c7710 0x7f8b0015a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.702+0000 7f8b066ce640 1 --2- 172.21.15.100:0/1927105348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b000ccd90 0x7f8b0014e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.702+0000 7f8b056cc640 1 -- 172.21.15.100:0/1927105348 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b000c7710 msgr2=0x7f8b0015a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.702+0000 7f8b056cc640 1 --2- 172.21.15.100:0/1927105348 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b000c7710 0x7f8b0015a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.702+0000 7f8b056cc640 1 -- 172.21.15.100:0/1927105348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b000ccd90 msgr2=0x7f8b0014e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.702+0000 7f8b056cc640 1 --2- 172.21.15.100:0/1927105348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b000ccd90 0x7f8b0014e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.702+0000 7f8b056cc640 1 -- 172.21.15.100:0/1927105348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b000b9210 con 0x7f8b000cc9b0 2024-09-11T22:25:58.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.702+0000 7f8b056cc640 1 --2- 172.21.15.100:0/1927105348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b000cc9b0 0x7f8b000c2df0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8af0035040 tx=0x7f8af00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:58.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.703+0000 7f8af67fc640 1 -- 172.21.15.100:0/1927105348 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0037050 con 0x7f8b000cc9b0 2024-09-11T22:25:58.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.703+0000 7f8af67fc640 1 -- 172.21.15.100:0/1927105348 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af0038040 con 0x7f8b000cc9b0 2024-09-11T22:25:58.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.703+0000 7f8b08131640 1 -- 172.21.15.100:0/1927105348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b000b94f0 con 0x7f8b000cc9b0 2024-09-11T22:25:58.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.703+0000 7f8af67fc640 1 -- 172.21.15.100:0/1927105348 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0004470 con 0x7f8b000cc9b0 2024-09-11T22:25:58.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.703+0000 7f8b08131640 1 -- 172.21.15.100:0/1927105348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b00073790 con 0x7f8b000cc9b0 2024-09-11T22:25:58.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.704+0000 7f8b08131640 1 --2- 172.21.15.100:0/1927105348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b00071e80 0x7f8b0014ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.704+0000 7f8b08131640 1 -- 172.21.15.100:0/1927105348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8b000c3bb0 con 0x7f8b00071e80 2024-09-11T22:25:58.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.704+0000 7f8b05ecd640 1 --2- 172.21.15.100:0/1927105348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b00071e80 0x7f8b0014ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.704+0000 7f8b05ecd640 1 -- 172.21.15.100:0/1927105348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b000c5430 con 0x7f8b00071e80 2024-09-11T22:25:58.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.704+0000 7f8b05ecd640 1 --2- 172.21.15.100:0/1927105348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b00071e80 0x7f8b0014ebf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0118e0 tx=0x7f8afc011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:58.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.704+0000 7f8af67fc640 1 -- 172.21.15.100:0/1927105348 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8af0003610 con 0x7f8b000cc9b0 2024-09-11T22:25:58.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.705+0000 7f8af67fc640 1 --2- 172.21.15.100:0/1927105348 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8ae406be60 0x7f8ae406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.705+0000 7f8af67fc640 1 -- 172.21.15.100:0/1927105348 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc019070 con 0x7f8b00071e80 2024-09-11T22:25:58.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.705+0000 7f8b066ce640 1 --2- 172.21.15.100:0/1927105348 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8ae406be60 0x7f8ae406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.705+0000 7f8af67fc640 1 -- 172.21.15.100:0/1927105348 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f8af00abb30 con 0x7f8b000cc9b0 2024-09-11T22:25:58.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.705+0000 7f8af67fc640 1 -- 172.21.15.100:0/1927105348 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8afc004300 con 0x7f8b00071e80 2024-09-11T22:25:58.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.705+0000 7f8af67fc640 1 -- 172.21.15.100:0/1927105348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b00071e80 msgr2=0x7f8b0014ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.705+0000 7f8af67fc640 1 --2- 172.21.15.100:0/1927105348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b00071e80 0x7f8b0014ebf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0118e0 tx=0x7f8afc011da0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.705+0000 7f8af67fc640 1 -- 172.21.15.100:0/1927105348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b00071e80 msgr2=0x7f8b0014ebf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:25:58.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.705+0000 7f8af67fc640 1 --2- 172.21.15.100:0/1927105348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b00071e80 0x7f8b0014ebf0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.706+0000 7f8b066ce640 1 --2- 172.21.15.100:0/1927105348 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8ae406be60 0x7f8ae406e320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8af80018a0 tx=0x7f8af8001830 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:58.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.714+0000 7f8b08131640 1 --2- 172.21.15.100:0/1927105348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b00073960 0x7f8b0014b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.714+0000 7f8b08131640 1 -- 172.21.15.100:0/1927105348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0006ff80 con 0x7f8b00073960 2024-09-11T22:25:58.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.715+0000 7f8b05ecd640 1 --2- 172.21.15.100:0/1927105348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b00073960 0x7f8b0014b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.715+0000 7f8b05ecd640 1 -- 172.21.15.100:0/1927105348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8b000c8560 con 0x7f8b00073960 2024-09-11T22:25:58.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.715+0000 7f8b05ecd640 1 --2- 172.21.15.100:0/1927105348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b00073960 0x7f8b0014b1d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0118e0 tx=0x7f8afc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:58.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.716+0000 7f8af67fc640 1 -- 172.21.15.100:0/1927105348 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc019040 con 0x7f8b00073960 2024-09-11T22:25:58.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.716+0000 7f8af67fc640 1 -- 172.21.15.100:0/1927105348 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4555 (secure 0 0 0) 0x7f8afc00fe40 con 0x7f8b00073960 2024-09-11T22:25:58.717 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:25:58.717 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:25:58.717 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:25:58.717 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:25:58.717 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 42, 2024-09-11T22:25:58.717 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 15141, 2024-09-11T22:25:58.718 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:25:58.718 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:25:58.718 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:25:58.718 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:25:58.718 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:58.718 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 12, 2024-09-11T22:25:58.718 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:25:58.718 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:25:58.718 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:25:58.718 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:58.718 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:58.718 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:58.718 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:58.718 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:58.719 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:58.719 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:58.719 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:58.719 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:58.719 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:58.719 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:58.719 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:58.719 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:25:58.719 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:25:58.719 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:58.719 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:58.719 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:58.719 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:58.720 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:58.720 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:58.720 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:58.720 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:58.720 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:58.720 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:58.720 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:58.720 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:58.720 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.720 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:25:58.720 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:25:58.720 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:25:58.720 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:25:58.721 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:25:58.721 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:25:58.721 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:25:58.721 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:25:58.721 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:25:58.721 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:25:58.721 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:25:58.721 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:25:58.721 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:25:58.721 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:25:58.721 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:25:58.721 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:25:58.721 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:25:58.721 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:58.722 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:58.722 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:58.722 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:58.722 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:58.722 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:58.722 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:58.722 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:58.722 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:58.722 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:58.722 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:58.722 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:58.722 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:25:58.722 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.723 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:25:58.723 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.723 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:25:58.723 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:25:58.723 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:58.723 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:58.723 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.723 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:58.723 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:25:58.723 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:58.723 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.723 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.723 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:58.723 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:25:58.724 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:58.724 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:58.724 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:58.724 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.724 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:25:58.724 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:25:58.724 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:58.724 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:58.724 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:58.724 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.724 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.724 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:25:58.724 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:25:58.724 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:58.725 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:58.725 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.725 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:58.725 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:25:58.725 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:58.725 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.725 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.725 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:58.725 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:25:58.725 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:58.725 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:58.725 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:58.725 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.726 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:25:58.726 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:25:58.726 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:58.726 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:58.726 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:58.726 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.726 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.726 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:25:58.726 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:25:58.726 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:58.726 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:58.726 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.726 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:58.726 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:25:58.727 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:58.727 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.727 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.727 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:58.727 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:25:58.727 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:58.727 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:58.727 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:58.727 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.727 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:25:58.727 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:25:58.727 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:58.727 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:58.727 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:58.728 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:58.728 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:58.728 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.728 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:25:58.728 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:25:58.728 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.728 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:58.728 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:58.728 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:25:58.728 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:58.728 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:58.728 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:25:58.728 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.729 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:58.729 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:58.729 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:25:58.729 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:58.729 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:58.729 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.729 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:25:58.729 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:25:58.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.716+0000 7f8af67fc640 1 -- 172.21.15.100:0/1927105348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b00073960 msgr2=0x7f8b0014b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.716+0000 7f8af67fc640 1 --2- 172.21.15.100:0/1927105348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b00073960 0x7f8b0014b1d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0118e0 tx=0x7f8afc0046c0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.716+0000 7f8af67fc640 1 -- 172.21.15.100:0/1927105348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b00073960 msgr2=0x7f8b0014b1d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:25:58.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.716+0000 7f8af67fc640 1 --2- 172.21.15.100:0/1927105348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b00073960 0x7f8b0014b1d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.716+0000 7f8b08131640 1 -- 172.21.15.100:0/1927105348 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8ae406be60 msgr2=0x7f8ae406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.716+0000 7f8b08131640 1 --2- 172.21.15.100:0/1927105348 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8ae406be60 0x7f8ae406e320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8af80018a0 tx=0x7f8af8001830 comp rx=0 tx=0).stop 2024-09-11T22:25:58.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.716+0000 7f8b08131640 1 -- 172.21.15.100:0/1927105348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b000cc9b0 msgr2=0x7f8b000c2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.716+0000 7f8b08131640 1 --2- 172.21.15.100:0/1927105348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b000cc9b0 0x7f8b000c2df0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8af0035040 tx=0x7f8af00046c0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.716+0000 7f8b066ce640 1 -- 172.21.15.100:0/1927105348 reap_dead start 2024-09-11T22:25:58.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.716+0000 7f8b066ce640 1 -- 172.21.15.100:0/1927105348 reap_dead start 2024-09-11T22:25:58.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.716+0000 7f8b08131640 1 -- 172.21.15.100:0/1927105348 shutdown_connections 2024-09-11T22:25:58.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.716+0000 7f8b08131640 1 -- 172.21.15.100:0/1927105348 >> 172.21.15.100:0/1927105348 conn(0x7f8b0006fa70 msgr2=0x7f8b00151a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:58.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.716+0000 7f8b08131640 1 -- 172.21.15.100:0/1927105348 shutdown_connections 2024-09-11T22:25:58.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.716+0000 7f8b08131640 1 -- 172.21.15.100:0/1927105348 wait complete. 2024-09-11T22:25:58.732 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:25:58.732 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:25:58.732 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:25:58.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.842+0000 7fb7f7d78640 1 Processor -- start 2024-09-11T22:25:58.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.842+0000 7fb7f7d78640 1 -- start start 2024-09-11T22:25:58.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.843+0000 7fb7f7d78640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7f00b0ca0 0x7fb7f00707a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.843+0000 7fb7f7d78640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7f01585f0 con 0x7fb7f0158210 2024-09-11T22:25:58.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.843+0000 7fb7f7d78640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7f00c9430 con 0x7fb7f015e100 2024-09-11T22:25:58.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.843+0000 7fb7f7d78640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb7f0070310 con 0x7fb7f00b0ca0 2024-09-11T22:25:58.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.843+0000 7fb7f5b14640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb7f0158210 0x7fb7f006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33500/0 (socket says 172.21.15.100:33500) 2024-09-11T22:25:58.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.843+0000 7fb7f5b14640 1 -- 172.21.15.100:0/768596885 learned_addr learned my addr 172.21.15.100:0/768596885 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:25:58.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.843+0000 7fb7f5313640 1 --2- 172.21.15.100:0/768596885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7f00b0ca0 0x7fb7f00707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.843+0000 7fb7f4b12640 1 -- 172.21.15.100:0/768596885 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 297231306 0 0) 0x7fb7f01585f0 con 0x7fb7f0158210 2024-09-11T22:25:58.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.843+0000 7fb7f4b12640 1 -- 172.21.15.100:0/768596885 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7dc003520 con 0x7fb7f0158210 2024-09-11T22:25:58.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.843+0000 7fb7f4b12640 1 -- 172.21.15.100:0/768596885 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1826300962 0 0) 0x7fb7f00c9430 con 0x7fb7f015e100 2024-09-11T22:25:58.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.843+0000 7fb7f4b12640 1 -- 172.21.15.100:0/768596885 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7f01585f0 con 0x7fb7f015e100 2024-09-11T22:25:58.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.843+0000 7fb7f4b12640 1 -- 172.21.15.100:0/768596885 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3603713565 0 0) 0x7fb7dc003520 con 0x7fb7f0158210 2024-09-11T22:25:58.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.843+0000 7fb7f4b12640 1 -- 172.21.15.100:0/768596885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7f00b0ca0 msgr2=0x7fb7f00707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:25:58.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.843+0000 7fb7f4b12640 1 --2- 172.21.15.100:0/768596885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7f00b0ca0 0x7fb7f00707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.843+0000 7fb7f4b12640 1 -- 172.21.15.100:0/768596885 >> v1:172.21.15.167:6789/0 conn(0x7fb7f015e100 legacy=0x7fb7f00ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.844+0000 7fb7f4b12640 1 -- 172.21.15.100:0/768596885 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f00c96d0 con 0x7fb7f0158210 2024-09-11T22:25:58.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.844+0000 7fb7f4b12640 1 -- 172.21.15.100:0/768596885 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fb7ec001670 con 0x7fb7f0158210 2024-09-11T22:25:58.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.844+0000 7fb7f4b12640 1 -- 172.21.15.100:0/768596885 >> v1:172.21.15.100:6789/0 conn(0x7fb7f0158210 legacy=0x7fb7f006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.844+0000 7fb7f4b12640 1 --2- 172.21.15.100:0/768596885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7dc003b70 0x7fb7dc003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.844+0000 7fb7f4b12640 1 --2- 172.21.15.100:0/768596885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7dc004800 0x7fb7dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.844+0000 7fb7f4b12640 1 --2- 172.21.15.100:0/768596885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7f00b0ca0 0x7fb7dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.844+0000 7fb7f4b12640 1 -- 172.21.15.100:0/768596885 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f0070310 con 0x7fb7dc004800 2024-09-11T22:25:58.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.844+0000 7fb7f4b12640 1 -- 172.21.15.100:0/768596885 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc00ba70 con 0x7fb7dc003b70 2024-09-11T22:25:58.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.844+0000 7fb7f4b12640 1 -- 172.21.15.100:0/768596885 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb7dc00bc40 con 0x7fb7f00b0ca0 2024-09-11T22:25:58.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.844+0000 7fb7f5b14640 1 --2- 172.21.15.100:0/768596885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7dc003b70 0x7fb7dc003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.844+0000 7fb7f5313640 1 --2- 172.21.15.100:0/768596885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7dc004800 0x7fb7dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.844+0000 7fb7f6315640 1 --2- 172.21.15.100:0/768596885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7f00b0ca0 0x7fb7dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.844+0000 7fb7f5313640 1 -- 172.21.15.100:0/768596885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7f00b0ca0 msgr2=0x7fb7dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:25:58.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.844+0000 7fb7f5313640 1 --2- 172.21.15.100:0/768596885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7f00b0ca0 0x7fb7dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.844+0000 7fb7f5313640 1 -- 172.21.15.100:0/768596885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7dc003b70 msgr2=0x7fb7dc003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:25:58.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.844+0000 7fb7f5313640 1 --2- 172.21.15.100:0/768596885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7dc003b70 0x7fb7dc003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.844+0000 7fb7f5313640 1 -- 172.21.15.100:0/768596885 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7dc003520 con 0x7fb7dc004800 2024-09-11T22:25:58.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.845+0000 7fb7f5313640 1 --2- 172.21.15.100:0/768596885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7dc004800 0x7fb7dc004c80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0009a90 tx=0x7fb7dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1238c14e51db25 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:58.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.845+0000 7fb7f4b12640 1 -- 172.21.15.100:0/768596885 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0036070 con 0x7fb7dc004800 2024-09-11T22:25:58.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.845+0000 7fb7f4b12640 1 -- 172.21.15.100:0/768596885 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e0031400 con 0x7fb7dc004800 2024-09-11T22:25:58.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.845+0000 7fb7f4b12640 1 -- 172.21.15.100:0/768596885 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0009690 con 0x7fb7dc004800 2024-09-11T22:25:58.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.846+0000 7fb7f7d78640 1 -- 172.21.15.100:0/768596885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7dc004800 msgr2=0x7fb7dc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.846+0000 7fb7f7d78640 1 --2- 172.21.15.100:0/768596885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7dc004800 0x7fb7dc004c80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0009a90 tx=0x7fb7dc005830 comp rx=0 tx=0).stop 2024-09-11T22:25:58.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.846+0000 7fb7f6315640 1 -- 172.21.15.100:0/768596885 reap_dead start 2024-09-11T22:25:58.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.846+0000 7fb7f7d78640 1 -- 172.21.15.100:0/768596885 shutdown_connections 2024-09-11T22:25:58.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.846+0000 7fb7f7d78640 1 -- 172.21.15.100:0/768596885 >> 172.21.15.100:0/768596885 conn(0x7fb7f006de20 msgr2=0x7fb7f006e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:58.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.846+0000 7fb7f7d78640 1 -- 172.21.15.100:0/768596885 shutdown_connections 2024-09-11T22:25:58.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.846+0000 7fb7f7d78640 1 -- 172.21.15.100:0/768596885 wait complete. 2024-09-11T22:25:58.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.847+0000 7fb7f7d78640 1 Processor -- start 2024-09-11T22:25:58.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.847+0000 7fb7f7d78640 1 -- start start 2024-09-11T22:25:58.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.848+0000 7fb7f7d78640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7dc004800 0x7fb7f00b1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.848+0000 7fb7f7d78640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7f0157510 0x7fb7f01564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.848+0000 7fb7f7d78640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7f01569e0 0x7fb7f015cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.848+0000 7fb7f7d78640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f006ffa0 con 0x7fb7f01569e0 2024-09-11T22:25:58.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.848+0000 7fb7f7d78640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f00c9c90 con 0x7fb7dc004800 2024-09-11T22:25:58.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.848+0000 7fb7f7d78640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb7f006db40 con 0x7fb7f0157510 2024-09-11T22:25:58.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.848+0000 7fb7f6315640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7f01569e0 0x7fb7f015cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.848+0000 7fb7f6315640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7f01569e0 0x7fb7f015cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39436/0 (socket says 172.21.15.100:39436) 2024-09-11T22:25:58.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.848+0000 7fb7f6315640 1 -- 172.21.15.100:0/275041119 learned_addr learned my addr 172.21.15.100:0/275041119 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:58.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.848+0000 7fb7f5313640 1 --2- 172.21.15.100:0/275041119 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7f0157510 0x7fb7f01564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.848+0000 7fb7f5b14640 1 --2- 172.21.15.100:0/275041119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7dc004800 0x7fb7f00b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.848+0000 7fb7f6315640 1 -- 172.21.15.100:0/275041119 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7f0157510 msgr2=0x7fb7f01564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.848+0000 7fb7f6315640 1 --2- 172.21.15.100:0/275041119 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7f0157510 0x7fb7f01564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.848+0000 7fb7f6315640 1 -- 172.21.15.100:0/275041119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7dc004800 msgr2=0x7fb7f00b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.848+0000 7fb7f6315640 1 --2- 172.21.15.100:0/275041119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7dc004800 0x7fb7f00b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.848+0000 7fb7f6315640 1 -- 172.21.15.100:0/275041119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f01f1a50 con 0x7fb7f01569e0 2024-09-11T22:25:58.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.848+0000 7fb7f6315640 1 --2- 172.21.15.100:0/275041119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7f01569e0 0x7fb7f015cdd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00cc0c0 tx=0x7fb7e800feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:58.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.848+0000 7fb7e67fc640 1 -- 172.21.15.100:0/275041119 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8019070 con 0x7fb7f01569e0 2024-09-11T22:25:58.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.849+0000 7fb7e67fc640 1 -- 172.21.15.100:0/275041119 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e8006d60 con 0x7fb7f01569e0 2024-09-11T22:25:58.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.849+0000 7fb7f7d78640 1 -- 172.21.15.100:0/275041119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7f00b1a90 con 0x7fb7f01569e0 2024-09-11T22:25:58.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.849+0000 7fb7e67fc640 1 -- 172.21.15.100:0/275041119 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8003bb0 con 0x7fb7f01569e0 2024-09-11T22:25:58.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.849+0000 7fb7f7d78640 1 -- 172.21.15.100:0/275041119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7f01f0ed0 con 0x7fb7f01569e0 2024-09-11T22:25:58.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.850+0000 7fb7f7d78640 1 --2- 172.21.15.100:0/275041119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7f015d310 0x7fb7f01f11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.850+0000 7fb7f7d78640 1 -- 172.21.15.100:0/275041119 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f00c9060 con 0x7fb7f015d310 2024-09-11T22:25:58.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.850+0000 7fb7f5b14640 1 --2- 172.21.15.100:0/275041119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7f015d310 0x7fb7f01f11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.850+0000 7fb7e67fc640 1 -- 172.21.15.100:0/275041119 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7e801c070 con 0x7fb7f01569e0 2024-09-11T22:25:58.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.851+0000 7fb7f5b14640 1 -- 172.21.15.100:0/275041119 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb7f00707a0 con 0x7fb7f015d310 2024-09-11T22:25:58.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.851+0000 7fb7e67fc640 1 --2- 172.21.15.100:0/275041119 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb7d406be30 0x7fb7d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.851+0000 7fb7f5313640 1 --2- 172.21.15.100:0/275041119 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb7d406be30 0x7fb7d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.851+0000 7fb7e67fc640 1 -- 172.21.15.100:0/275041119 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fb7e808a3c0 con 0x7fb7f01569e0 2024-09-11T22:25:58.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.852+0000 7fb7f5b14640 1 --2- 172.21.15.100:0/275041119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7f015d310 0x7fb7f01f11b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec007320 tx=0x7fb7ec0077e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:58.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.852+0000 7fb7f5313640 1 --2- 172.21.15.100:0/275041119 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb7d406be30 0x7fb7d406e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0033000 tx=0x7fb7e0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:58.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.852+0000 7fb7e67fc640 1 -- 172.21.15.100:0/275041119 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec012a90 con 0x7fb7f015d310 2024-09-11T22:25:58.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.852+0000 7fb7e67fc640 1 -- 172.21.15.100:0/275041119 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb7ec01a070 con 0x7fb7f015d310 2024-09-11T22:25:58.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.852+0000 7fb7e67fc640 1 -- 172.21.15.100:0/275041119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7f015d310 msgr2=0x7fb7f01f11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.852+0000 7fb7e67fc640 1 --2- 172.21.15.100:0/275041119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7f015d310 0x7fb7f01f11b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec007320 tx=0x7fb7ec0077e0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.852+0000 7fb7e67fc640 1 -- 172.21.15.100:0/275041119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7f015d310 msgr2=0x7fb7f01f11b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:25:58.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.852+0000 7fb7e67fc640 1 --2- 172.21.15.100:0/275041119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7f015d310 0x7fb7f01f11b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.860+0000 7fb7f7d78640 1 --2- 172.21.15.100:0/275041119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7f0153b10 0x7fb7f0153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.860+0000 7fb7f7d78640 1 -- 172.21.15.100:0/275041119 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f015cb30 con 0x7fb7f0153b10 2024-09-11T22:25:58.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.861+0000 7fb7f5b14640 1 --2- 172.21.15.100:0/275041119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7f0153b10 0x7fb7f0153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.861+0000 7fb7f5b14640 1 -- 172.21.15.100:0/275041119 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb7f0070da0 con 0x7fb7f0153b10 2024-09-11T22:25:58.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.862+0000 7fb7f5b14640 1 --2- 172.21.15.100:0/275041119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7f0153b10 0x7fb7f0153ef0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec019000 tx=0x7fb7f006d880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:58.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.862+0000 7fb7e67fc640 1 -- 172.21.15.100:0/275041119 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec015790 con 0x7fb7f0153b10 2024-09-11T22:25:58.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.862+0000 7fb7e67fc640 1 -- 172.21.15.100:0/275041119 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4888 (secure 0 0 0) 0x7fb7ec015790 con 0x7fb7f0153b10 2024-09-11T22:25:58.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.862+0000 7fb7e67fc640 1 -- 172.21.15.100:0/275041119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7f0153b10 msgr2=0x7fb7f0153ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.862+0000 7fb7e67fc640 1 --2- 172.21.15.100:0/275041119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7f0153b10 0x7fb7f0153ef0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec019000 tx=0x7fb7f006d880 comp rx=0 tx=0).stop 2024-09-11T22:25:58.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.862+0000 7fb7e67fc640 1 -- 172.21.15.100:0/275041119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7f0153b10 msgr2=0x7fb7f0153ef0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:25:58.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.862+0000 7fb7e67fc640 1 --2- 172.21.15.100:0/275041119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb7f0153b10 0x7fb7f0153ef0 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec019000 tx=0x7fb7f006d880 comp rx=0 tx=0).stop 2024-09-11T22:25:58.863 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:25:58.864 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:25:58.864 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:25:58.864 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:25:58.864 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 42, 2024-09-11T22:25:58.864 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 144141, 2024-09-11T22:25:58.864 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:25:58.864 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:25:58.864 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:25:58.864 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:25:58.864 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:58.864 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 12, 2024-09-11T22:25:58.864 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:25:58.865 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:25:58.865 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:25:58.865 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:58.865 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:58.865 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:58.865 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:58.865 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:58.865 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:58.865 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:58.865 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:58.865 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:58.865 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:58.865 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:58.865 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:58.866 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:25:58.866 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:25:58.866 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:58.866 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:58.866 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:58.866 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:58.866 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:58.866 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:58.866 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:58.866 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:58.866 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:58.866 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:58.866 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:58.867 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:58.867 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.867 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:25:58.867 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:25:58.867 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:25:58.867 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:25:58.867 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:25:58.867 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:25:58.867 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:25:58.867 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:25:58.867 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:25:58.867 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:25:58.867 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:25:58.867 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:25:58.868 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:25:58.868 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:25:58.868 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:25:58.868 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:25:58.868 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:25:58.868 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:58.868 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:58.868 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:58.868 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:58.868 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:58.868 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:58.868 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:58.869 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:58.869 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:58.869 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:58.869 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:58.869 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:58.869 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:25:58.869 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.869 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:25:58.869 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.869 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:25:58.869 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:25:58.869 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:58.869 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:58.870 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.870 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:58.870 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:25:58.870 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:58.870 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.870 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.870 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:58.870 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:25:58.870 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:58.870 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:58.870 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:58.870 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.870 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:25:58.870 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:25:58.871 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:58.871 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:58.871 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:58.871 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.871 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.871 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:25:58.871 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:25:58.871 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:58.871 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:58.871 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.871 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:58.871 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:25:58.871 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:58.871 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.872 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.872 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:58.872 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:25:58.872 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:58.872 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:58.872 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:58.872 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.872 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:25:58.872 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:25:58.872 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:58.872 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:58.872 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:58.872 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.873 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.873 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:25:58.873 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:25:58.873 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:58.873 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:58.873 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.873 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:58.873 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:25:58.873 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:58.873 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.873 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.873 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:58.873 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:25:58.874 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:58.874 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:58.874 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:58.874 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.874 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:25:58.874 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:25:58.874 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:58.874 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:58.874 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:58.874 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:58.874 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:58.874 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.874 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:25:58.874 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:25:58.875 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.875 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:58.875 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:58.875 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:25:58.875 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:58.875 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:58.875 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:25:58.875 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.875 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:58.875 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:58.875 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:25:58.875 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:58.875 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:58.875 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:25:58.876 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.876 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:58.876 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:58.876 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:25:58.876 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:58.876 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:58.876 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:25:58.876 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:58.876 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:58.876 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:58.876 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:25:58.876 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:58.876 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:58.877 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:58.877 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:25:58.877 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:25:58.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.863+0000 7fb7f7d78640 1 -- 172.21.15.100:0/275041119 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb7d406be30 msgr2=0x7fb7d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.863+0000 7fb7f7d78640 1 --2- 172.21.15.100:0/275041119 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb7d406be30 0x7fb7d406e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0033000 tx=0x7fb7e0008030 comp rx=0 tx=0).stop 2024-09-11T22:25:58.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.863+0000 7fb7f7d78640 1 -- 172.21.15.100:0/275041119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7f01569e0 msgr2=0x7fb7f015cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.863+0000 7fb7f7d78640 1 --2- 172.21.15.100:0/275041119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7f01569e0 0x7fb7f015cdd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00cc0c0 tx=0x7fb7e800feb0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.863+0000 7fb7f6315640 1 -- 172.21.15.100:0/275041119 reap_dead start 2024-09-11T22:25:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.863+0000 7fb7f6315640 1 -- 172.21.15.100:0/275041119 reap_dead start 2024-09-11T22:25:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.863+0000 7fb7f7d78640 1 -- 172.21.15.100:0/275041119 shutdown_connections 2024-09-11T22:25:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.863+0000 7fb7f7d78640 1 -- 172.21.15.100:0/275041119 >> 172.21.15.100:0/275041119 conn(0x7fb7f006de20 msgr2=0x7fb7f00cc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.863+0000 7fb7f7d78640 1 -- 172.21.15.100:0/275041119 shutdown_connections 2024-09-11T22:25:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.863+0000 7fb7f7d78640 1 -- 172.21.15.100:0/275041119 wait complete. 2024-09-11T22:25:58.879 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:25:58.879 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:25:58.880 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:25:58.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.985+0000 7f1a280e6640 1 Processor -- start 2024-09-11T22:25:58.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.985+0000 7f1a280e6640 1 -- start start 2024-09-11T22:25:58.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.986+0000 7f1a280e6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1a200c8ca0 0x7f1a2015e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.986+0000 7f1a280e6640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a2015a990 con 0x7f1a200c8020 2024-09-11T22:25:58.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.986+0000 7f1a280e6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a2015ac70 con 0x7f1a20154d60 2024-09-11T22:25:58.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.986+0000 7f1a280e6640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f1a2015af50 con 0x7f1a200c8ca0 2024-09-11T22:25:58.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.986+0000 7f1a26683640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1a200c8ca0 0x7f1a2015e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.986+0000 7f1a25681640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1a200c8020 0x7f1a200c8590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:33508/0 (socket says 172.21.15.100:33508) 2024-09-11T22:25:58.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.986+0000 7f1a25681640 1 -- 172.21.15.100:0/851245266 learned_addr learned my addr 172.21.15.100:0/851245266 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:25:58.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.986+0000 7f1a26683640 1 -- 172.21.15.100:0/851245266 >> v1:172.21.15.167:6789/0 conn(0x7f1a20154d60 legacy=0x7f1a200cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:25:58.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.986+0000 7f1a26683640 1 -- 172.21.15.100:0/851245266 >> v1:172.21.15.100:6789/0 conn(0x7f1a200c8020 legacy=0x7f1a200c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.986+0000 7f1a26683640 1 -- 172.21.15.100:0/851245266 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2015b230 con 0x7f1a200c8ca0 2024-09-11T22:25:58.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.987+0000 7f1a26683640 1 --2- 172.21.15.100:0/851245266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a200c8ca0 0x7f1a2015e120 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1a18009d90 tx=0x7f1a1802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c48e82ebbe4f251 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:58.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.987+0000 7f1a24e80640 1 -- 172.21.15.100:0/851245266 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18007740 con 0x7f1a200c8ca0 2024-09-11T22:25:58.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.987+0000 7f1a24e80640 1 -- 172.21.15.100:0/851245266 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a180078e0 con 0x7f1a200c8ca0 2024-09-11T22:25:58.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.987+0000 7f1a24e80640 1 -- 172.21.15.100:0/851245266 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18007cb0 con 0x7f1a200c8ca0 2024-09-11T22:25:58.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.988+0000 7f1a280e6640 1 -- 172.21.15.100:0/851245266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a200c8ca0 msgr2=0x7f1a2015e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.988+0000 7f1a280e6640 1 --2- 172.21.15.100:0/851245266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a200c8ca0 0x7f1a2015e120 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1a18009d90 tx=0x7f1a1802a6f0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.988+0000 7f1a280e6640 1 -- 172.21.15.100:0/851245266 shutdown_connections 2024-09-11T22:25:58.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.988+0000 7f1a280e6640 1 --2- 172.21.15.100:0/851245266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a200c8ca0 0x7f1a2015e120 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.988+0000 7f1a280e6640 1 -- 172.21.15.100:0/851245266 >> 172.21.15.100:0/851245266 conn(0x7f1a2006fa70 msgr2=0x7f1a2006fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:58.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.988+0000 7f1a280e6640 1 -- 172.21.15.100:0/851245266 shutdown_connections 2024-09-11T22:25:58.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.988+0000 7f1a280e6640 1 -- 172.21.15.100:0/851245266 wait complete. 2024-09-11T22:25:58.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.989+0000 7f1a280e6640 1 Processor -- start 2024-09-11T22:25:58.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.989+0000 7f1a280e6640 1 -- start start 2024-09-11T22:25:58.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.990+0000 7f1a280e6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a200c8020 0x7f1a201f0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.990+0000 7f1a280e6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a200c8ca0 0x7f1a200c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.990+0000 7f1a280e6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a20154d60 0x7f1a200c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.990+0000 7f1a280e6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1a200ccfd0 con 0x7f1a20154d60 2024-09-11T22:25:58.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.990+0000 7f1a280e6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1a200cce50 con 0x7f1a200c8020 2024-09-11T22:25:58.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.990+0000 7f1a280e6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1a2015e660 con 0x7f1a200c8ca0 2024-09-11T22:25:58.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.990+0000 7f1a26683640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a20154d60 0x7f1a200c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.990+0000 7f1a25e82640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a200c8020 0x7f1a201f0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.990+0000 7f1a26683640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a20154d60 0x7f1a200c6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39452/0 (socket says 172.21.15.100:39452) 2024-09-11T22:25:58.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.990+0000 7f1a26683640 1 -- 172.21.15.100:0/3726954828 learned_addr learned my addr 172.21.15.100:0/3726954828 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:58.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.990+0000 7f1a25681640 1 --2- 172.21.15.100:0/3726954828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a200c8ca0 0x7f1a200c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.990+0000 7f1a26683640 1 -- 172.21.15.100:0/3726954828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a200c8ca0 msgr2=0x7f1a200c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.990+0000 7f1a26683640 1 --2- 172.21.15.100:0/3726954828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a200c8ca0 0x7f1a200c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.990+0000 7f1a26683640 1 -- 172.21.15.100:0/3726954828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a200c8020 msgr2=0x7f1a201f0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.990+0000 7f1a26683640 1 --2- 172.21.15.100:0/3726954828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a200c8020 0x7f1a201f0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.990+0000 7f1a26683640 1 -- 172.21.15.100:0/3726954828 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a20157ba0 con 0x7f1a20154d60 2024-09-11T22:25:58.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.991+0000 7f1a26683640 1 --2- 172.21.15.100:0/3726954828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a20154d60 0x7f1a200c6780 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1a1802ace0 tx=0x7f1a18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:58.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.991+0000 7f1a167fc640 1 -- 172.21.15.100:0/3726954828 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18040070 con 0x7f1a20154d60 2024-09-11T22:25:58.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.991+0000 7f1a167fc640 1 -- 172.21.15.100:0/3726954828 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a18031c40 con 0x7f1a20154d60 2024-09-11T22:25:58.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.991+0000 7f1a280e6640 1 -- 172.21.15.100:0/3726954828 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a20155890 con 0x7f1a20154d60 2024-09-11T22:25:58.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.991+0000 7f1a167fc640 1 -- 172.21.15.100:0/3726954828 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1803c420 con 0x7f1a20154d60 2024-09-11T22:25:58.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.991+0000 7f1a280e6640 1 -- 172.21.15.100:0/3726954828 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a201581b0 con 0x7f1a20154d60 2024-09-11T22:25:58.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.992+0000 7f1a280e6640 1 --2- 172.21.15.100:0/3726954828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a201f0cb0 0x7f1a2014e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.992+0000 7f1a280e6640 1 -- 172.21.15.100:0/3726954828 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1a201551f0 con 0x7f1a201f0cb0 2024-09-11T22:25:58.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.992+0000 7f1a25e82640 1 --2- 172.21.15.100:0/3726954828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a201f0cb0 0x7f1a2014e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.992+0000 7f1a25e82640 1 -- 172.21.15.100:0/3726954828 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a2015ea90 con 0x7f1a201f0cb0 2024-09-11T22:25:58.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.992+0000 7f1a25e82640 1 --2- 172.21.15.100:0/3726954828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a201f0cb0 0x7f1a2014e160 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00f470 tx=0x7f1a1c00f930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:58.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.993+0000 7f1a167fc640 1 -- 172.21.15.100:0/3726954828 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c019070 con 0x7f1a201f0cb0 2024-09-11T22:25:58.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.993+0000 7f1a167fc640 1 -- 172.21.15.100:0/3726954828 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a18039040 con 0x7f1a20154d60 2024-09-11T22:25:58.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.993+0000 7f1a167fc640 1 --2- 172.21.15.100:0/3726954828 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1a0406bd30 0x7f1a0406e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:58.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.993+0000 7f1a167fc640 1 -- 172.21.15.100:0/3726954828 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f1a180ac820 con 0x7f1a20154d60 2024-09-11T22:25:58.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.993+0000 7f1a25681640 1 --2- 172.21.15.100:0/3726954828 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1a0406bd30 0x7f1a0406e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:58.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.994+0000 7f1a167fc640 1 -- 172.21.15.100:0/3726954828 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1a1c005320 con 0x7f1a201f0cb0 2024-09-11T22:25:58.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.994+0000 7f1a167fc640 1 -- 172.21.15.100:0/3726954828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a201f0cb0 msgr2=0x7f1a2014e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:58.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.994+0000 7f1a167fc640 1 --2- 172.21.15.100:0/3726954828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a201f0cb0 0x7f1a2014e160 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00f470 tx=0x7f1a1c00f930 comp rx=0 tx=0).stop 2024-09-11T22:25:58.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.994+0000 7f1a167fc640 1 -- 172.21.15.100:0/3726954828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a201f0cb0 msgr2=0x7f1a2014e160 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:25:58.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.994+0000 7f1a167fc640 1 --2- 172.21.15.100:0/3726954828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a201f0cb0 0x7f1a2014e160 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:58.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:58.994+0000 7f1a25681640 1 --2- 172.21.15.100:0/3726954828 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1a0406bd30 0x7f1a0406e1f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1a20070350 tx=0x7f1a10009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.003+0000 7f1a280e6640 1 --2- 172.21.15.100:0/3726954828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a2015d6b0 0x7f1a2014e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.003+0000 7f1a280e6640 1 -- 172.21.15.100:0/3726954828 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1a20151bc0 con 0x7f1a2015d6b0 2024-09-11T22:25:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.003+0000 7f1a25e82640 1 --2- 172.21.15.100:0/3726954828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a2015d6b0 0x7f1a2014e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:59.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.004+0000 7f1a25e82640 1 -- 172.21.15.100:0/3726954828 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1a20072340 con 0x7f1a2015d6b0 2024-09-11T22:25:59.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.004+0000 7f1a25e82640 1 --2- 172.21.15.100:0/3726954828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a2015d6b0 0x7f1a2014e6a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00f470 tx=0x7f1a1c000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:59.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.004+0000 7f1a167fc640 1 -- 172.21.15.100:0/3726954828 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c01c2a0 con 0x7f1a2015d6b0 2024-09-11T22:25:59.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.004+0000 7f1a167fc640 1 -- 172.21.15.100:0/3726954828 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7f1a1c01c2a0 con 0x7f1a2015d6b0 2024-09-11T22:25:59.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.004+0000 7f1a167fc640 1 -- 172.21.15.100:0/3726954828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a2015d6b0 msgr2=0x7f1a2014e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:59.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.004+0000 7f1a167fc640 1 --2- 172.21.15.100:0/3726954828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a2015d6b0 0x7f1a2014e6a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00f470 tx=0x7f1a1c000ed0 comp rx=0 tx=0).stop 2024-09-11T22:25:59.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.004+0000 7f1a167fc640 1 -- 172.21.15.100:0/3726954828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a2015d6b0 msgr2=0x7f1a2014e6a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:25:59.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.004+0000 7f1a167fc640 1 --2- 172.21.15.100:0/3726954828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a2015d6b0 0x7f1a2014e6a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:59.006 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:25:59.006 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:25:59.006 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:25:59.006 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:25:59.006 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 42, 2024-09-11T22:25:59.006 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 249726, 2024-09-11T22:25:59.006 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:25:59.007 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:25:59.007 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:25:59.007 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:25:59.007 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:59.007 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 12, 2024-09-11T22:25:59.007 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:25:59.007 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:25:59.007 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:25:59.007 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:59.007 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:59.007 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:59.008 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:59.008 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:59.008 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:59.008 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:59.008 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:59.008 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:59.008 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:59.008 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:59.008 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:59.008 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:25:59.008 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:25:59.008 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:59.008 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:59.009 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:59.009 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:59.009 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:59.009 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:59.009 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:59.009 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:59.009 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:59.009 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:59.009 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:59.009 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:59.009 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:59.009 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:25:59.009 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:25:59.009 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:25:59.010 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:25:59.010 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:25:59.010 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:25:59.010 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:25:59.010 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:25:59.010 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:25:59.010 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:25:59.010 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:25:59.010 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:25:59.010 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:25:59.010 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:25:59.010 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:25:59.010 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:25:59.010 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:25:59.011 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:25:59.011 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:25:59.011 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:25:59.011 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:25:59.011 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:25:59.011 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:25:59.011 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:25:59.011 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:25:59.012 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:25:59.012 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:25:59.012 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:25:59.012 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:59.012 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:25:59.012 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:59.012 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:25:59.012 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:59.012 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:25:59.012 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:25:59.012 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:59.012 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:59.013 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:59.013 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:59.013 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:25:59.013 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:59.013 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:59.013 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:59.013 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:59.013 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:25:59.013 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:59.013 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:59.013 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:59.013 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:59.013 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:25:59.014 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:25:59.014 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:59.014 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:59.014 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:59.014 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:59.014 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:59.014 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:25:59.014 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:25:59.014 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:59.014 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:59.014 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:59.014 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:59.014 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:25:59.015 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:59.015 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:59.015 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:59.015 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:59.015 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:25:59.015 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:59.015 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:59.015 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:59.015 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:59.015 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:25:59.015 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:25:59.015 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:59.016 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:59.016 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:59.016 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:59.016 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:59.016 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:25:59.016 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:25:59.016 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:25:59.016 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:25:59.016 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:59.016 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:25:59.016 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:25:59.016 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:59.016 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:59.017 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:59.017 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:25:59.017 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:25:59.017 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:25:59.017 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:59.017 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:59.017 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:59.017 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:25:59.017 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:25:59.017 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:25:59.017 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:25:59.017 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:25:59.018 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:59.018 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:59.018 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:59.018 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:25:59.018 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:25:59.018 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:59.018 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:59.018 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:59.018 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:25:59.018 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:59.018 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:59.018 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:25:59.018 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:59.019 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:59.019 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:59.019 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:25:59.019 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:59.019 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:59.019 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:25:59.019 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:59.019 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:59.019 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:59.019 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:25:59.019 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:59.019 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:59.019 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:25:59.019 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:59.020 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:59.020 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:59.020 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:25:59.020 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:59.020 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:25:59.020 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:25:59.020 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:25:59.020 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:25:59.020 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:25:59.020 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:25:59.020 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:25:59.020 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:25:59.020 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:25:59.021 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:25:59.021 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:25:59.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.005+0000 7f1a280e6640 1 -- 172.21.15.100:0/3726954828 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1a0406bd30 msgr2=0x7f1a0406e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:59.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.005+0000 7f1a280e6640 1 --2- 172.21.15.100:0/3726954828 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1a0406bd30 0x7f1a0406e1f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1a20070350 tx=0x7f1a10009040 comp rx=0 tx=0).stop 2024-09-11T22:25:59.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.005+0000 7f1a280e6640 1 -- 172.21.15.100:0/3726954828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a20154d60 msgr2=0x7f1a200c6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:59.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.005+0000 7f1a280e6640 1 --2- 172.21.15.100:0/3726954828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a20154d60 0x7f1a200c6780 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1a1802ace0 tx=0x7f1a18004a40 comp rx=0 tx=0).stop 2024-09-11T22:25:59.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.005+0000 7f1a26683640 1 -- 172.21.15.100:0/3726954828 reap_dead start 2024-09-11T22:25:59.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.005+0000 7f1a26683640 1 -- 172.21.15.100:0/3726954828 reap_dead start 2024-09-11T22:25:59.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.005+0000 7f1a280e6640 1 -- 172.21.15.100:0/3726954828 shutdown_connections 2024-09-11T22:25:59.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.005+0000 7f1a280e6640 1 -- 172.21.15.100:0/3726954828 >> 172.21.15.100:0/3726954828 conn(0x7f1a2006fa70 msgr2=0x7f1a2014f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:59.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.005+0000 7f1a280e6640 1 -- 172.21.15.100:0/3726954828 shutdown_connections 2024-09-11T22:25:59.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.005+0000 7f1a280e6640 1 -- 172.21.15.100:0/3726954828 wait complete. 2024-09-11T22:25:59.023 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:25:59.023 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-11T22:25:59.023 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-11T22:25:59.024 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-11T22:25:59.024 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:25:59.024 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T22:25:59.024 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:25:59.034 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T22:25:59.034 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-11T22:25:59.034 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:25:59.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.178+0000 7f0d1893b640 1 Processor -- start 2024-09-11T22:25:59.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.178+0000 7f0d1893b640 1 -- start start 2024-09-11T22:25:59.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.179+0000 7f0d1893b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0d1415a7e0 0x7f0d140cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:59.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.179+0000 7f0d1893b640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d1415ac90 con 0x7f0d14154c20 2024-09-11T22:25:59.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.179+0000 7f0d1893b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d1415af70 con 0x7f0d140b3190 2024-09-11T22:25:59.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.179+0000 7f0d1893b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f0d1415e000 con 0x7f0d1415a7e0 2024-09-11T22:25:59.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.179+0000 7f0d1259c640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f0d14154c20 legacy=0x7f0d140cb120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:25:59.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.179+0000 7f0d12d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0d1415a7e0 0x7f0d140cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:59.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.179+0000 7f0d12d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0d1415a7e0 0x7f0d140cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:41482/0 (socket says 172.21.15.100:41482) 2024-09-11T22:25:59.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.179+0000 7f0d12d9d640 1 -- 172.21.15.100:0/916484319 learned_addr learned my addr 172.21.15.100:0/916484319 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:59.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.179+0000 7f0d12d9d640 1 -- 172.21.15.100:0/916484319 >> v1:172.21.15.167:6789/0 conn(0x7f0d140b3190 legacy=0x7f0d1415e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:59.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.179+0000 7f0d12d9d640 1 -- 172.21.15.100:0/916484319 >> v1:172.21.15.100:6789/0 conn(0x7f0d14154c20 legacy=0x7f0d140cb120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:25:59.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.179+0000 7f0d12d9d640 1 -- 172.21.15.100:0/916484319 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d1415b250 con 0x7f0d1415a7e0 2024-09-11T22:25:59.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.180+0000 7f0d12d9d640 1 --2- 172.21.15.100:0/916484319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d1415a7e0 0x7f0d140cbd10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0d1415e180 tx=0x7f0d0c02a750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3437dc5a2de878e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:59.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.180+0000 7f0d1159a640 1 -- 172.21.15.100:0/916484319 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c036070 con 0x7f0d1415a7e0 2024-09-11T22:25:59.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.181+0000 7f0d1159a640 1 -- 172.21.15.100:0/916484319 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d0c031600 con 0x7f0d1415a7e0 2024-09-11T22:25:59.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.181+0000 7f0d1159a640 1 -- 172.21.15.100:0/916484319 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c0319d0 con 0x7f0d1415a7e0 2024-09-11T22:25:59.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.181+0000 7f0d1893b640 1 -- 172.21.15.100:0/916484319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d1415a7e0 msgr2=0x7f0d140cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:59.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.181+0000 7f0d1893b640 1 --2- 172.21.15.100:0/916484319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d1415a7e0 0x7f0d140cbd10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0d1415e180 tx=0x7f0d0c02a750 comp rx=0 tx=0).stop 2024-09-11T22:25:59.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.181+0000 7f0d1893b640 1 -- 172.21.15.100:0/916484319 shutdown_connections 2024-09-11T22:25:59.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.181+0000 7f0d1893b640 1 --2- 172.21.15.100:0/916484319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d1415a7e0 0x7f0d140cbd10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:59.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.181+0000 7f0d1893b640 1 -- 172.21.15.100:0/916484319 >> 172.21.15.100:0/916484319 conn(0x7f0d14067d40 msgr2=0x7f0d1406d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:59.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.181+0000 7f0d1893b640 1 -- 172.21.15.100:0/916484319 shutdown_connections 2024-09-11T22:25:59.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.181+0000 7f0d1893b640 1 -- 172.21.15.100:0/916484319 wait complete. 2024-09-11T22:25:59.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.182+0000 7f0d1893b640 1 Processor -- start 2024-09-11T22:25:59.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.183+0000 7f0d1893b640 1 -- start start 2024-09-11T22:25:59.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.183+0000 7f0d1893b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d140b3190 0x7f0d14147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:59.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.183+0000 7f0d1893b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d14154c20 0x7f0d14145c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:59.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.183+0000 7f0d1893b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d1415a7e0 0x7f0d1415c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:59.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.183+0000 7f0d1893b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1415eba0 con 0x7f0d1415a7e0 2024-09-11T22:25:59.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.183+0000 7f0d1893b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0d140cb830 con 0x7f0d14154c20 2024-09-11T22:25:59.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.183+0000 7f0d1893b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0d1415ed20 con 0x7f0d140b3190 2024-09-11T22:25:59.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.183+0000 7f0d12d9d640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d1415a7e0 msgr2=0x7f0d1415c510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:25:59.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.184+0000 7f0d12d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d1415a7e0 0x7f0d1415c510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:25:59.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.184+0000 7f0d11d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d14154c20 0x7f0d14145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:59.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.184+0000 7f0d11d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d14154c20 0x7f0d14145c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:41486/0 (socket says 172.21.15.100:41486) 2024-09-11T22:25:59.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.184+0000 7f0d11d9b640 1 -- 172.21.15.100:0/691106247 learned_addr learned my addr 172.21.15.100:0/691106247 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:25:59.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.184+0000 7f0d1259c640 1 --2- 172.21.15.100:0/691106247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d140b3190 0x7f0d14147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:59.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.184+0000 7f0d11d9b640 1 -- 172.21.15.100:0/691106247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d140b3190 msgr2=0x7f0d14147990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:59.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.184+0000 7f0d11d9b640 1 --2- 172.21.15.100:0/691106247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d140b3190 0x7f0d14147990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:59.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.184+0000 7f0d11d9b640 1 -- 172.21.15.100:0/691106247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d1415a7e0 msgr2=0x7f0d1415c510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:25:59.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.184+0000 7f0d11d9b640 1 --2- 172.21.15.100:0/691106247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d1415a7e0 0x7f0d1415c510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:59.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.184+0000 7f0d11d9b640 1 -- 172.21.15.100:0/691106247 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d14147ed0 con 0x7f0d14154c20 2024-09-11T22:25:59.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.184+0000 7f0d11d9b640 1 --2- 172.21.15.100:0/691106247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d14154c20 0x7f0d14145c50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0d0800c450 tx=0x7f0d0800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:59.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.184+0000 7f0d02ffd640 1 -- 172.21.15.100:0/691106247 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d080052d0 con 0x7f0d14154c20 2024-09-11T22:25:59.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.184+0000 7f0d02ffd640 1 -- 172.21.15.100:0/691106247 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d08005470 con 0x7f0d14154c20 2024-09-11T22:25:59.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.184+0000 7f0d02ffd640 1 -- 172.21.15.100:0/691106247 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d08012870 con 0x7f0d14154c20 2024-09-11T22:25:59.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.184+0000 7f0d1893b640 1 -- 172.21.15.100:0/691106247 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d141f0830 con 0x7f0d14154c20 2024-09-11T22:25:59.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.184+0000 7f0d1893b640 1 -- 172.21.15.100:0/691106247 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d141f0af0 con 0x7f0d14154c20 2024-09-11T22:25:59.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.186+0000 7f0d1893b640 1 -- 172.21.15.100:0/691106247 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d140cbaf0 con 0x7f0d14154c20 2024-09-11T22:25:59.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.186+0000 7f0d02ffd640 1 -- 172.21.15.100:0/691106247 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0d08012a10 con 0x7f0d14154c20 2024-09-11T22:25:59.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.186+0000 7f0d02ffd640 1 --2- 172.21.15.100:0/691106247 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0cf406be10 0x7f0cf406e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:25:59.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.186+0000 7f0d02ffd640 1 -- 172.21.15.100:0/691106247 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f0d0808ad40 con 0x7f0d14154c20 2024-09-11T22:25:59.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.186+0000 7f0d1259c640 1 --2- 172.21.15.100:0/691106247 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0cf406be10 0x7f0cf406e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:25:59.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.187+0000 7f0d1259c640 1 --2- 172.21.15.100:0/691106247 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0cf406be10 0x7f0cf406e2d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0d040093d0 tx=0x7f0d04009360 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:25:59.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.191+0000 7f0d02ffd640 1 -- 172.21.15.100:0/691106247 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0d08059360 con 0x7f0d14154c20 2024-09-11T22:25:59.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.472+0000 7f0d1893b640 1 -- 172.21.15.100:0/691106247 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0d1415e470 con 0x7f0d14154c20 2024-09-11T22:25:59.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.472+0000 7f0d02ffd640 1 -- 172.21.15.100:0/691106247 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f0d08058c60 con 0x7f0d14154c20 2024-09-11T22:25:59.473 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":42,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:25:59.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.474+0000 7f0d1893b640 1 -- 172.21.15.100:0/691106247 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0cf406be10 msgr2=0x7f0cf406e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:59.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.474+0000 7f0d1893b640 1 --2- 172.21.15.100:0/691106247 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0cf406be10 0x7f0cf406e2d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0d040093d0 tx=0x7f0d04009360 comp rx=0 tx=0).stop 2024-09-11T22:25:59.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.474+0000 7f0d1893b640 1 -- 172.21.15.100:0/691106247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d14154c20 msgr2=0x7f0d14145c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:25:59.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.474+0000 7f0d1893b640 1 --2- 172.21.15.100:0/691106247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d14154c20 0x7f0d14145c50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0d0800c450 tx=0x7f0d0800c910 comp rx=0 tx=0).stop 2024-09-11T22:25:59.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.474+0000 7f0d1893b640 1 -- 172.21.15.100:0/691106247 shutdown_connections 2024-09-11T22:25:59.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.474+0000 7f0d1893b640 1 --2- 172.21.15.100:0/691106247 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0cf406be10 0x7f0cf406e2d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:59.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.474+0000 7f0d1893b640 1 --2- 172.21.15.100:0/691106247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d1415a7e0 0x7f0d1415c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:59.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.474+0000 7f0d1893b640 1 --2- 172.21.15.100:0/691106247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d14154c20 0x7f0d14145c50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:59.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.474+0000 7f0d1893b640 1 --2- 172.21.15.100:0/691106247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0d140b3190 0x7f0d14147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:25:59.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.474+0000 7f0d1893b640 1 -- 172.21.15.100:0/691106247 >> 172.21.15.100:0/691106247 conn(0x7f0d14067d40 msgr2=0x7f0d140ccc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:25:59.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.474+0000 7f0d1893b640 1 -- 172.21.15.100:0/691106247 shutdown_connections 2024-09-11T22:25:59.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:25:59.474+0000 7f0d1893b640 1 -- 172.21.15.100:0/691106247 wait complete. 2024-09-11T22:26:02.489 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:26:02.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.596+0000 7f840b52c640 1 Processor -- start 2024-09-11T22:26:02.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.596+0000 7f840b52c640 1 -- start start 2024-09-11T22:26:02.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.597+0000 7f840b52c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f84040d09a0 0x7f8404154850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:02.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.597+0000 7f840b52c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f84040d0d80 0x7f8404154d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:02.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.597+0000 7f840b52c640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f840415abc0 con 0x7f840415e9b0 2024-09-11T22:26:02.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.597+0000 7f840b52c640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f840415b7d0 con 0x7f84040d0d80 2024-09-11T22:26:02.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.597+0000 7f840b52c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f840415aea0 con 0x7f84040d09a0 2024-09-11T22:26:02.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.597+0000 7f8408ac7640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f84040d0d80 msgr2=0x7f8404154d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:26:02.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.597+0000 7f8408ac7640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f84040d0d80 0x7f8404154d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:26:02.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.597+0000 7f8409ac9640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f840415e9b0 legacy=0x7f84040cbb20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:26:02.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.597+0000 7f84092c8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f84040d09a0 0x7f8404154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:02.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.597+0000 7f84092c8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f84040d09a0 0x7f8404154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:33188/0 (socket says 172.21.15.100:33188) 2024-09-11T22:26:02.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.597+0000 7f84092c8640 1 -- 172.21.15.100:0/2541581768 learned_addr learned my addr 172.21.15.100:0/2541581768 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:02.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.597+0000 7f84092c8640 1 -- 172.21.15.100:0/2541581768 >> v2:172.21.15.100:3300/0 conn(0x7f84040d0d80 msgr2=0x7f8404154d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:26:02.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.597+0000 7f84092c8640 1 --2- 172.21.15.100:0/2541581768 >> v2:172.21.15.100:3300/0 conn(0x7f84040d0d80 0x7f8404154d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:02.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.597+0000 7f84092c8640 1 -- 172.21.15.100:0/2541581768 >> v1:172.21.15.100:6789/0 conn(0x7f840415e9b0 legacy=0x7f84040cbb20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:26:02.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.597+0000 7f84092c8640 1 -- 172.21.15.100:0/2541581768 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f840415b180 con 0x7f84040d09a0 2024-09-11T22:26:02.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.598+0000 7f84092c8640 1 --2- 172.21.15.100:0/2541581768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84040d09a0 0x7f8404154850 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f840406dda0 tx=0x7f840002a2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bbd699b31cda5a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:02.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.598+0000 7f83fbfff640 1 -- 172.21.15.100:0/2541581768 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8400037070 con 0x7f84040d09a0 2024-09-11T22:26:02.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.598+0000 7f83fbfff640 1 -- 172.21.15.100:0/2541581768 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8400032440 con 0x7f84040d09a0 2024-09-11T22:26:02.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.598+0000 7f83fbfff640 1 -- 172.21.15.100:0/2541581768 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8400032810 con 0x7f84040d09a0 2024-09-11T22:26:02.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.599+0000 7f840b52c640 1 -- 172.21.15.100:0/2541581768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84040d09a0 msgr2=0x7f8404154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:02.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.599+0000 7f840b52c640 1 --2- 172.21.15.100:0/2541581768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84040d09a0 0x7f8404154850 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f840406dda0 tx=0x7f840002a2e0 comp rx=0 tx=0).stop 2024-09-11T22:26:02.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.599+0000 7f840b52c640 1 -- 172.21.15.100:0/2541581768 shutdown_connections 2024-09-11T22:26:02.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.599+0000 7f840b52c640 1 --2- 172.21.15.100:0/2541581768 >> v2:172.21.15.100:3300/0 conn(0x7f84040d0d80 0x7f8404154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:02.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.599+0000 7f840b52c640 1 --2- 172.21.15.100:0/2541581768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84040d09a0 0x7f8404154850 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:02.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.599+0000 7f840b52c640 1 -- 172.21.15.100:0/2541581768 >> 172.21.15.100:0/2541581768 conn(0x7f840406d0a0 msgr2=0x7f840406d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:02.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.599+0000 7f840b52c640 1 -- 172.21.15.100:0/2541581768 shutdown_connections 2024-09-11T22:26:02.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.599+0000 7f840b52c640 1 -- 172.21.15.100:0/2541581768 wait complete. 2024-09-11T22:26:02.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.600+0000 7f840b52c640 1 Processor -- start 2024-09-11T22:26:02.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.601+0000 7f840b52c640 1 -- start start 2024-09-11T22:26:02.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.601+0000 7f840b52c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84040d09a0 0x7f840415d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:02.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.601+0000 7f840b52c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84040d0d80 0x7f8404155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:02.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.601+0000 7f840b52c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f840415e9b0 0x7f8404158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:02.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.601+0000 7f840b52c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f84040cc230 con 0x7f840415e9b0 2024-09-11T22:26:02.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.601+0000 7f840b52c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f84040b3590 con 0x7f84040d09a0 2024-09-11T22:26:02.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.601+0000 7f840b52c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f84040cc3b0 con 0x7f84040d0d80 2024-09-11T22:26:02.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.601+0000 7f8409ac9640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f840415e9b0 msgr2=0x7f8404158b30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:26:02.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.601+0000 7f8409ac9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f840415e9b0 0x7f8404158b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:26:02.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.602+0000 7f84092c8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84040d09a0 0x7f840415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:02.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.602+0000 7f84092c8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84040d09a0 0x7f840415d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:33198/0 (socket says 172.21.15.100:33198) 2024-09-11T22:26:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.602+0000 7f8408ac7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84040d0d80 0x7f8404155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.602+0000 7f84092c8640 1 -- 172.21.15.100:0/2969977726 learned_addr learned my addr 172.21.15.100:0/2969977726 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.602+0000 7f84092c8640 1 -- 172.21.15.100:0/2969977726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84040d0d80 msgr2=0x7f8404155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.602+0000 7f84092c8640 1 --2- 172.21.15.100:0/2969977726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84040d0d80 0x7f8404155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.602+0000 7f84092c8640 1 -- 172.21.15.100:0/2969977726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f840415e9b0 msgr2=0x7f8404158b30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:26:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.602+0000 7f84092c8640 1 --2- 172.21.15.100:0/2969977726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f840415e9b0 0x7f8404158b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.602+0000 7f84092c8640 1 -- 172.21.15.100:0/2969977726 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84041f0d00 con 0x7f84040d09a0 2024-09-11T22:26:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.602+0000 7f84092c8640 1 --2- 172.21.15.100:0/2969977726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84040d09a0 0x7f840415d560 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8400000c00 tx=0x7f84000046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.602+0000 7f83f9ffb640 1 -- 172.21.15.100:0/2969977726 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8400041070 con 0x7f84040d09a0 2024-09-11T22:26:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.602+0000 7f83f9ffb640 1 -- 172.21.15.100:0/2969977726 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840003c660 con 0x7f84040d09a0 2024-09-11T22:26:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.602+0000 7f83f9ffb640 1 -- 172.21.15.100:0/2969977726 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8400037040 con 0x7f84040d09a0 2024-09-11T22:26:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.602+0000 7f840b52c640 1 -- 172.21.15.100:0/2969977726 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84041f0fa0 con 0x7f84040d09a0 2024-09-11T22:26:02.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.603+0000 7f840b52c640 1 -- 172.21.15.100:0/2969977726 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f840415a5a0 con 0x7f84040d09a0 2024-09-11T22:26:02.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.604+0000 7f840b52c640 1 -- 172.21.15.100:0/2969977726 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84040cad60 con 0x7f84040d09a0 2024-09-11T22:26:02.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.604+0000 7f83f9ffb640 1 -- 172.21.15.100:0/2969977726 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8400044070 con 0x7f84040d09a0 2024-09-11T22:26:02.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.605+0000 7f83f9ffb640 1 --2- 172.21.15.100:0/2969977726 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f83e806bde0 0x7f83e806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:02.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.605+0000 7f83f9ffb640 1 -- 172.21.15.100:0/2969977726 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f84000abb50 con 0x7f84040d09a0 2024-09-11T22:26:02.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.605+0000 7f8408ac7640 1 --2- 172.21.15.100:0/2969977726 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f83e806bde0 0x7f83e806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:02.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.605+0000 7f8408ac7640 1 --2- 172.21.15.100:0/2969977726 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f83e806bde0 0x7f83e806e2a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f83f4006b20 tx=0x7f83f4006ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:02.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.609+0000 7f83f9ffb640 1 -- 172.21.15.100:0/2969977726 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8400079a00 con 0x7f84040d09a0 2024-09-11T22:26:02.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.900+0000 7f840b52c640 1 -- 172.21.15.100:0/2969977726 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f84040b3010 con 0x7f84040d09a0 2024-09-11T22:26:02.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.900+0000 7f83f9ffb640 1 -- 172.21.15.100:0/2969977726 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f840007dd00 con 0x7f84040d09a0 2024-09-11T22:26:02.902 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":42,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:26:02.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.903+0000 7f840b52c640 1 -- 172.21.15.100:0/2969977726 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f83e806bde0 msgr2=0x7f83e806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:02.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.903+0000 7f840b52c640 1 --2- 172.21.15.100:0/2969977726 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f83e806bde0 0x7f83e806e2a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f83f4006b20 tx=0x7f83f4006ab0 comp rx=0 tx=0).stop 2024-09-11T22:26:02.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.903+0000 7f840b52c640 1 -- 172.21.15.100:0/2969977726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84040d09a0 msgr2=0x7f840415d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:02.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.903+0000 7f840b52c640 1 --2- 172.21.15.100:0/2969977726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84040d09a0 0x7f840415d560 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8400000c00 tx=0x7f84000046c0 comp rx=0 tx=0).stop 2024-09-11T22:26:02.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.903+0000 7f840b52c640 1 -- 172.21.15.100:0/2969977726 shutdown_connections 2024-09-11T22:26:02.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.903+0000 7f840b52c640 1 --2- 172.21.15.100:0/2969977726 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f83e806bde0 0x7f83e806e2a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:02.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.903+0000 7f840b52c640 1 --2- 172.21.15.100:0/2969977726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f840415e9b0 0x7f8404158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:02.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.903+0000 7f840b52c640 1 --2- 172.21.15.100:0/2969977726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84040d0d80 0x7f8404155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:02.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.903+0000 7f840b52c640 1 --2- 172.21.15.100:0/2969977726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84040d09a0 0x7f840415d560 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:02.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.903+0000 7f840b52c640 1 -- 172.21.15.100:0/2969977726 >> 172.21.15.100:0/2969977726 conn(0x7f840406d0a0 msgr2=0x7f84041534e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:02.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.903+0000 7f840b52c640 1 -- 172.21.15.100:0/2969977726 shutdown_connections 2024-09-11T22:26:02.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:02.903+0000 7f840b52c640 1 -- 172.21.15.100:0/2969977726 wait complete. 2024-09-11T22:26:05.918 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:26:06.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.021+0000 7f0041931640 1 Processor -- start 2024-09-11T22:26:06.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.021+0000 7f0041931640 1 -- start start 2024-09-11T22:26:06.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.022+0000 7f0041931640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f003c151710 0x7f003c157e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:06.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.022+0000 7f0041931640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f003c073a10 0x7f003c161db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:06.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.022+0000 7f0041931640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f003c072d50 con 0x7f003c0c87a0 2024-09-11T22:26:06.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.022+0000 7f0041931640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f003c1579d0 con 0x7f003c073a10 2024-09-11T22:26:06.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.022+0000 7f0041931640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f003c072ff0 con 0x7f003c151710 2024-09-11T22:26:06.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.022+0000 7f003a7fc640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f003c0c87a0 legacy=0x7f003c0c38f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:26:06.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.022+0000 7f003b7fe640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f003c073a10 msgr2=0x7f003c161db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:26:06.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.022+0000 7f003b7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f003c073a10 0x7f003c161db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:26:06.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.023+0000 7f003affd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f003c151710 0x7f003c157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:06.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.023+0000 7f003affd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f003c151710 0x7f003c157e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:56330/0 (socket says 172.21.15.100:56330) 2024-09-11T22:26:06.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.023+0000 7f003affd640 1 -- 172.21.15.100:0/250886924 learned_addr learned my addr 172.21.15.100:0/250886924 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:06.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.023+0000 7f003affd640 1 -- 172.21.15.100:0/250886924 >> v2:172.21.15.100:3300/0 conn(0x7f003c073a10 msgr2=0x7f003c161db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:26:06.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.023+0000 7f003affd640 1 --2- 172.21.15.100:0/250886924 >> v2:172.21.15.100:3300/0 conn(0x7f003c073a10 0x7f003c161db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:06.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.023+0000 7f003affd640 1 -- 172.21.15.100:0/250886924 >> v1:172.21.15.100:6789/0 conn(0x7f003c0c87a0 legacy=0x7f003c0c38f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:26:06.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.023+0000 7f003affd640 1 -- 172.21.15.100:0/250886924 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003c157660 con 0x7f003c151710 2024-09-11T22:26:06.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.024+0000 7f003affd640 1 --2- 172.21.15.100:0/250886924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f003c151710 0x7f003c157e60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f002c009870 tx=0x7f002c02a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6b528f88457c9ef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:06.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.024+0000 7f0039ffb640 1 -- 172.21.15.100:0/250886924 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c037070 con 0x7f003c151710 2024-09-11T22:26:06.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.024+0000 7f0039ffb640 1 -- 172.21.15.100:0/250886924 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f002c032440 con 0x7f003c151710 2024-09-11T22:26:06.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.024+0000 7f0039ffb640 1 -- 172.21.15.100:0/250886924 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c032810 con 0x7f003c151710 2024-09-11T22:26:06.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.025+0000 7f0041931640 1 -- 172.21.15.100:0/250886924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f003c151710 msgr2=0x7f003c157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:06.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.025+0000 7f0041931640 1 --2- 172.21.15.100:0/250886924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f003c151710 0x7f003c157e60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f002c009870 tx=0x7f002c02a230 comp rx=0 tx=0).stop 2024-09-11T22:26:06.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.025+0000 7f0041931640 1 -- 172.21.15.100:0/250886924 shutdown_connections 2024-09-11T22:26:06.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.025+0000 7f0041931640 1 --2- 172.21.15.100:0/250886924 >> v2:172.21.15.100:3300/0 conn(0x7f003c073a10 0x7f003c161db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:06.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.025+0000 7f0041931640 1 --2- 172.21.15.100:0/250886924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f003c151710 0x7f003c157e60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:06.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.025+0000 7f0041931640 1 -- 172.21.15.100:0/250886924 >> 172.21.15.100:0/250886924 conn(0x7f003c0c9d00 msgr2=0x7f003c0ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:06.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.025+0000 7f0041931640 1 -- 172.21.15.100:0/250886924 shutdown_connections 2024-09-11T22:26:06.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.025+0000 7f0041931640 1 -- 172.21.15.100:0/250886924 wait complete. 2024-09-11T22:26:06.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.026+0000 7f0041931640 1 Processor -- start 2024-09-11T22:26:06.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.026+0000 7f0041931640 1 -- start start 2024-09-11T22:26:06.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.027+0000 7f0041931640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f003c073a10 0x7f003c1f0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:06.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.027+0000 7f0041931640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f003c0c87a0 0x7f003c1f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:06.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.027+0000 7f0041931640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f003c151710 0x7f003c14b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:06.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.027+0000 7f0041931640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f003c151af0 con 0x7f003c151710 2024-09-11T22:26:06.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.027+0000 7f0041931640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f003c0afe00 con 0x7f003c073a10 2024-09-11T22:26:06.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.027+0000 7f0041931640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f003c0c2220 con 0x7f003c0c87a0 2024-09-11T22:26:06.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.027+0000 7f003b7fe640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f003c151710 msgr2=0x7f003c14b140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:26:06.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.027+0000 7f003b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f003c151710 0x7f003c14b140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:26:06.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.027+0000 7f003a7fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f003c0c87a0 0x7f003c1f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:06.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.027+0000 7f003a7fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f003c0c87a0 0x7f003c1f46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:56342/0 (socket says 172.21.15.100:56342) 2024-09-11T22:26:06.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.027+0000 7f003a7fc640 1 -- 172.21.15.100:0/1571705222 learned_addr learned my addr 172.21.15.100:0/1571705222 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:06.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.027+0000 7f003affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f003c073a10 0x7f003c1f0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:06.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.028+0000 7f003a7fc640 1 -- 172.21.15.100:0/1571705222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f003c073a10 msgr2=0x7f003c1f0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:06.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.028+0000 7f003a7fc640 1 --2- 172.21.15.100:0/1571705222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f003c073a10 0x7f003c1f0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:06.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.028+0000 7f003a7fc640 1 -- 172.21.15.100:0/1571705222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f003c151710 msgr2=0x7f003c14b140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:26:06.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.028+0000 7f003a7fc640 1 --2- 172.21.15.100:0/1571705222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f003c151710 0x7f003c14b140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:06.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.028+0000 7f003a7fc640 1 -- 172.21.15.100:0/1571705222 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003c068140 con 0x7f003c0c87a0 2024-09-11T22:26:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.028+0000 7f003affd640 1 --2- 172.21.15.100:0/1571705222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f003c073a10 0x7f003c1f0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:26:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.028+0000 7f003a7fc640 1 --2- 172.21.15.100:0/1571705222 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f003c0c87a0 0x7f003c1f46e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f003000b450 tx=0x7f003000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.028+0000 7f0023fff640 1 -- 172.21.15.100:0/1571705222 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0030003d70 con 0x7f003c0c87a0 2024-09-11T22:26:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.028+0000 7f0023fff640 1 -- 172.21.15.100:0/1571705222 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0030015070 con 0x7f003c0c87a0 2024-09-11T22:26:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.028+0000 7f0041931640 1 -- 172.21.15.100:0/1571705222 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f003c14b680 con 0x7f003c0c87a0 2024-09-11T22:26:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.028+0000 7f0023fff640 1 -- 172.21.15.100:0/1571705222 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0030005270 con 0x7f003c0c87a0 2024-09-11T22:26:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.028+0000 7f0041931640 1 -- 172.21.15.100:0/1571705222 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f003c1deb00 con 0x7f003c0c87a0 2024-09-11T22:26:06.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.030+0000 7f0041931640 1 -- 172.21.15.100:0/1571705222 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f003c0af590 con 0x7f003c0c87a0 2024-09-11T22:26:06.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.030+0000 7f0023fff640 1 -- 172.21.15.100:0/1571705222 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f003000f070 con 0x7f003c0c87a0 2024-09-11T22:26:06.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.030+0000 7f0023fff640 1 --2- 172.21.15.100:0/1571705222 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f002806bde0 0x7f002806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:06.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.031+0000 7f0023fff640 1 -- 172.21.15.100:0/1571705222 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f003008a9a0 con 0x7f003c0c87a0 2024-09-11T22:26:06.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.031+0000 7f003affd640 1 --2- 172.21.15.100:0/1571705222 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f002806bde0 0x7f002806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:06.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.031+0000 7f003affd640 1 --2- 172.21.15.100:0/1571705222 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f002806bde0 0x7f002806e2a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f002c034000 tx=0x7f002c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:06.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.035+0000 7f0023fff640 1 -- 172.21.15.100:0/1571705222 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f003000d040 con 0x7f003c0c87a0 2024-09-11T22:26:06.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.307+0000 7f0041931640 1 -- 172.21.15.100:0/1571705222 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f003c06e920 con 0x7f003c0c87a0 2024-09-11T22:26:06.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.308+0000 7f0023fff640 1 -- 172.21.15.100:0/1571705222 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f0030058fc0 con 0x7f003c0c87a0 2024-09-11T22:26:06.309 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":42,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:26:06.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.310+0000 7f0041931640 1 -- 172.21.15.100:0/1571705222 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f002806bde0 msgr2=0x7f002806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:06.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.310+0000 7f0041931640 1 --2- 172.21.15.100:0/1571705222 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f002806bde0 0x7f002806e2a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f002c034000 tx=0x7f002c02e000 comp rx=0 tx=0).stop 2024-09-11T22:26:06.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.310+0000 7f0041931640 1 -- 172.21.15.100:0/1571705222 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f003c0c87a0 msgr2=0x7f003c1f46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:06.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.310+0000 7f0041931640 1 --2- 172.21.15.100:0/1571705222 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f003c0c87a0 0x7f003c1f46e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f003000b450 tx=0x7f003000b910 comp rx=0 tx=0).stop 2024-09-11T22:26:06.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.310+0000 7f0041931640 1 -- 172.21.15.100:0/1571705222 shutdown_connections 2024-09-11T22:26:06.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.310+0000 7f0041931640 1 --2- 172.21.15.100:0/1571705222 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f002806bde0 0x7f002806e2a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:06.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.310+0000 7f0041931640 1 --2- 172.21.15.100:0/1571705222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f003c151710 0x7f003c14b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:06.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.310+0000 7f0041931640 1 --2- 172.21.15.100:0/1571705222 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f003c0c87a0 0x7f003c1f46e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:06.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.310+0000 7f0041931640 1 --2- 172.21.15.100:0/1571705222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f003c073a10 0x7f003c1f0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:06.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.310+0000 7f0041931640 1 -- 172.21.15.100:0/1571705222 >> 172.21.15.100:0/1571705222 conn(0x7f003c0c9d00 msgr2=0x7f003c0c3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:06.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.310+0000 7f0041931640 1 -- 172.21.15.100:0/1571705222 shutdown_connections 2024-09-11T22:26:06.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:06.310+0000 7f0041931640 1 -- 172.21.15.100:0/1571705222 wait complete. 2024-09-11T22:26:09.323 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:26:09.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.434+0000 7fdc5a277640 1 Processor -- start 2024-09-11T22:26:09.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.434+0000 7fdc5a277640 1 -- start start 2024-09-11T22:26:09.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.435+0000 7fdc5a277640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 0x7fdc5406d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:09.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.435+0000 7fdc5a277640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdc54072840 0x7fdc5415e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:09.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.435+0000 7fdc5a277640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdc540c89a0 0x7fdc54067950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:09.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.435+0000 7fdc5a277640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fdc540739d0 con 0x7fdc540c89a0 2024-09-11T22:26:09.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.435+0000 7fdc5a277640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fdc5415ed80 con 0x7fdc54072840 2024-09-11T22:26:09.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.435+0000 7fdc5a277640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fdc540c9190 con 0x7fdc54154b00 2024-09-11T22:26:09.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.435+0000 7fdc58814640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7fdc540c89a0 msgr2=0x7fdc54067950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:26:09.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.435+0000 7fdc58814640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdc540c89a0 0x7fdc54067950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:26:09.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.436+0000 7fdc53fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 0x7fdc5406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:09.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.436+0000 7fdc4bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdc54072840 0x7fdc5415e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:09.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.436+0000 7fdc53fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 0x7fdc5406d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:56350/0 (socket says 172.21.15.100:56350) 2024-09-11T22:26:09.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.436+0000 7fdc53fff640 1 -- 172.21.15.100:0/2993310279 learned_addr learned my addr 172.21.15.100:0/2993310279 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:09.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.436+0000 7fdc4bfff640 1 -- 172.21.15.100:0/2993310279 >> v2:172.21.15.167:3300/0 conn(0x7fdc54072840 msgr2=0x7fdc5415e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:26:09.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.436+0000 7fdc4bfff640 1 -- 172.21.15.100:0/2993310279 >> v2:172.21.15.167:3300/0 conn(0x7fdc54072840 msgr2=0x7fdc5415e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:26:09.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.436+0000 7fdc4bfff640 1 --2- 172.21.15.100:0/2993310279 >> v2:172.21.15.167:3300/0 conn(0x7fdc54072840 0x7fdc5415e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:26:09.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.436+0000 7fdc53fff640 1 -- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 msgr2=0x7fdc5406d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:26:09.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.436+0000 7fdc53fff640 1 -- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 msgr2=0x7fdc5406d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:26:09.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.436+0000 7fdc53fff640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 0x7fdc5406d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:26:09.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.436+0000 7fdc4bfff640 1 --2- 172.21.15.100:0/2993310279 >> v2:172.21.15.167:3300/0 conn(0x7fdc54072840 0x7fdc5415e840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:26:09.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.436+0000 7fdc53fff640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 0x7fdc5406d150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:26:09.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.636+0000 7fdc58814640 1 -- 172.21.15.100:0/2993310279 >> v2:172.21.15.100:3300/0 conn(0x7fdc540c89a0 msgr2=0x7fdc54067950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:26:09.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.636+0000 7fdc58814640 1 --2- 172.21.15.100:0/2993310279 >> v2:172.21.15.100:3300/0 conn(0x7fdc540c89a0 0x7fdc54067950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:26:09.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.637+0000 7fdc4bfff640 1 --2- 172.21.15.100:0/2993310279 >> v2:172.21.15.167:3300/0 conn(0x7fdc54072840 0x7fdc5415e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:09.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.637+0000 7fdc53fff640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 0x7fdc5406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:09.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.637+0000 7fdc4bfff640 1 -- 172.21.15.100:0/2993310279 >> v2:172.21.15.167:3300/0 conn(0x7fdc54072840 msgr2=0x7fdc5415e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:26:09.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.637+0000 7fdc4bfff640 1 -- 172.21.15.100:0/2993310279 >> v2:172.21.15.167:3300/0 conn(0x7fdc54072840 msgr2=0x7fdc5415e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:26:09.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.637+0000 7fdc4bfff640 1 --2- 172.21.15.100:0/2993310279 >> v2:172.21.15.167:3300/0 conn(0x7fdc54072840 0x7fdc5415e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:26:09.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.637+0000 7fdc53fff640 1 -- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 msgr2=0x7fdc5406d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:26:09.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.637+0000 7fdc53fff640 1 -- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 msgr2=0x7fdc5406d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:26:09.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.637+0000 7fdc53fff640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 0x7fdc5406d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:26:09.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.637+0000 7fdc4bfff640 1 --2- 172.21.15.100:0/2993310279 >> v2:172.21.15.167:3300/0 conn(0x7fdc54072840 0x7fdc5415e840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:26:09.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:09.637+0000 7fdc53fff640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 0x7fdc5406d150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:26:10.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.037+0000 7fdc58814640 1 -- 172.21.15.100:0/2993310279 >> v2:172.21.15.100:3300/0 conn(0x7fdc540c89a0 msgr2=0x7fdc54067950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:26:10.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.037+0000 7fdc58814640 1 --2- 172.21.15.100:0/2993310279 >> v2:172.21.15.100:3300/0 conn(0x7fdc540c89a0 0x7fdc54067950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:26:10.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.038+0000 7fdc4bfff640 1 --2- 172.21.15.100:0/2993310279 >> v2:172.21.15.167:3300/0 conn(0x7fdc54072840 0x7fdc5415e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:10.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.038+0000 7fdc53fff640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 0x7fdc5406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:10.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.038+0000 7fdc4bfff640 1 -- 172.21.15.100:0/2993310279 >> v2:172.21.15.167:3300/0 conn(0x7fdc54072840 msgr2=0x7fdc5415e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:26:10.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.038+0000 7fdc4bfff640 1 -- 172.21.15.100:0/2993310279 >> v2:172.21.15.167:3300/0 conn(0x7fdc54072840 msgr2=0x7fdc5415e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:26:10.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.038+0000 7fdc4bfff640 1 --2- 172.21.15.100:0/2993310279 >> v2:172.21.15.167:3300/0 conn(0x7fdc54072840 0x7fdc5415e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:26:10.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.038+0000 7fdc53fff640 1 -- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 msgr2=0x7fdc5406d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:26:10.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.038+0000 7fdc4bfff640 1 --2- 172.21.15.100:0/2993310279 >> v2:172.21.15.167:3300/0 conn(0x7fdc54072840 0x7fdc5415e840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:26:10.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.038+0000 7fdc53fff640 1 -- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 msgr2=0x7fdc5406d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:26:10.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.038+0000 7fdc53fff640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 0x7fdc5406d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:26:10.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.038+0000 7fdc53fff640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 0x7fdc5406d150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:26:10.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.838+0000 7fdc58814640 1 -- 172.21.15.100:0/2993310279 >> v2:172.21.15.100:3300/0 conn(0x7fdc540c89a0 msgr2=0x7fdc54067950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:26:10.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.838+0000 7fdc58814640 1 --2- 172.21.15.100:0/2993310279 >> v2:172.21.15.100:3300/0 conn(0x7fdc540c89a0 0x7fdc54067950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:26:10.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.839+0000 7fdc4bfff640 1 --2- 172.21.15.100:0/2993310279 >> v2:172.21.15.167:3300/0 conn(0x7fdc54072840 0x7fdc5415e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:10.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.839+0000 7fdc53fff640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 0x7fdc5406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:10.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.839+0000 7fdc4bfff640 1 -- 172.21.15.100:0/2993310279 >> v2:172.21.15.167:3300/0 conn(0x7fdc54072840 msgr2=0x7fdc5415e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:26:10.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.839+0000 7fdc53fff640 1 -- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 msgr2=0x7fdc5406d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:26:10.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.839+0000 7fdc4bfff640 1 -- 172.21.15.100:0/2993310279 >> v2:172.21.15.167:3300/0 conn(0x7fdc54072840 msgr2=0x7fdc5415e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:26:10.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.839+0000 7fdc53fff640 1 -- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 msgr2=0x7fdc5406d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:26:10.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.839+0000 7fdc4bfff640 1 --2- 172.21.15.100:0/2993310279 >> v2:172.21.15.167:3300/0 conn(0x7fdc54072840 0x7fdc5415e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:26:10.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.839+0000 7fdc53fff640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 0x7fdc5406d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:26:10.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.839+0000 7fdc4bfff640 1 --2- 172.21.15.100:0/2993310279 >> v2:172.21.15.167:3300/0 conn(0x7fdc54072840 0x7fdc5415e840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:26:10.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:10.839+0000 7fdc53fff640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 0x7fdc5406d150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:26:12.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:12.435+0000 7fdc527fc640 1 -- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 msgr2=0x7fdc5406d150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:26:12.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:12.435+0000 7fdc527fc640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc54154b00 0x7fdc5406d150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:12.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:12.435+0000 7fdc527fc640 1 -- 172.21.15.100:0/2993310279 >> v2:172.21.15.167:3300/0 conn(0x7fdc54072840 msgr2=0x7fdc5415e840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:26:12.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:12.435+0000 7fdc527fc640 1 --2- 172.21.15.100:0/2993310279 >> v2:172.21.15.167:3300/0 conn(0x7fdc54072840 0x7fdc5415e840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:12.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:12.436+0000 7fdc527fc640 1 -- 172.21.15.100:0/2993310279 >> v2:172.21.15.100:3300/0 conn(0x7fdc540c89a0 msgr2=0x7fdc54067950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:26:12.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:12.436+0000 7fdc527fc640 1 --2- 172.21.15.100:0/2993310279 >> v2:172.21.15.100:3300/0 conn(0x7fdc540c89a0 0x7fdc54067950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:12.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:12.436+0000 7fdc527fc640 1 -- 172.21.15.100:0/2993310279 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc540c9470 con 0x7fdc340073b0 2024-09-11T22:26:12.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:12.436+0000 7fdc527fc640 1 -- 172.21.15.100:0/2993310279 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc3400c120 con 0x7fdc34003670 2024-09-11T22:26:12.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:12.436+0000 7fdc4bfff640 1 -- 172.21.15.100:0/2993310279 >> v1:172.21.15.100:6789/0 conn(0x7fdc340073b0 legacy=0x7fdc34009870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:26:12.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:12.637+0000 7fdc4bfff640 1 -- 172.21.15.100:0/2993310279 >> v1:172.21.15.100:6789/0 conn(0x7fdc340073b0 legacy=0x7fdc34009870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:26:13.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.038+0000 7fdc4bfff640 1 -- 172.21.15.100:0/2993310279 >> v1:172.21.15.100:6789/0 conn(0x7fdc340073b0 legacy=0x7fdc34009870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:26:13.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.683+0000 7fdc537fe640 1 -- 172.21.15.100:0/2993310279 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1744243105 0 0) 0x7fdc3400c120 con 0x7fdc34003670 2024-09-11T22:26:13.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.683+0000 7fdc537fe640 1 -- 172.21.15.100:0/2993310279 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc40003520 con 0x7fdc34003670 2024-09-11T22:26:13.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.689+0000 7fdc537fe640 1 -- 172.21.15.100:0/2993310279 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 367457684 0 0) 0x7fdc40003520 con 0x7fdc34003670 2024-09-11T22:26:13.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.689+0000 7fdc537fe640 1 -- 172.21.15.100:0/2993310279 >> v1:172.21.15.100:6789/0 conn(0x7fdc340073b0 legacy=0x7fdc34009870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:26:13.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.690+0000 7fdc537fe640 1 -- 172.21.15.100:0/2993310279 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc3400d3c0 con 0x7fdc34003670 2024-09-11T22:26:13.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.690+0000 7fdc537fe640 1 -- 172.21.15.100:0/2993310279 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fdc4400f040 con 0x7fdc34003670 2024-09-11T22:26:13.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.690+0000 7fdc537fe640 1 -- 172.21.15.100:0/2993310279 >> v1:172.21.15.167:6789/0 conn(0x7fdc34003670 legacy=0x7fdc34005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:13.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.690+0000 7fdc58814640 1 -- 172.21.15.100:0/2993310279 reap_dead start 2024-09-11T22:26:13.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.690+0000 7fdc537fe640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc400039b0 0x7fdc40003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:13.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.690+0000 7fdc537fe640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc40004800 0x7fdc40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:13.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.690+0000 7fdc537fe640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc400052e0 0x7fdc4000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:13.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.690+0000 7fdc537fe640 1 -- 172.21.15.100:0/2993310279 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4000c1d0 con 0x7fdc40004800 2024-09-11T22:26:13.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.690+0000 7fdc537fe640 1 -- 172.21.15.100:0/2993310279 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4000c380 con 0x7fdc400039b0 2024-09-11T22:26:13.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.690+0000 7fdc537fe640 1 -- 172.21.15.100:0/2993310279 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fdc4000c580 con 0x7fdc400052e0 2024-09-11T22:26:13.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.690+0000 7fdc4bfff640 1 -- 172.21.15.100:0/2993310279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc40004800 msgr2=0x7fdc40004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:26:13.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.690+0000 7fdc4bfff640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc40004800 0x7fdc40004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:26:13.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.690+0000 7fdc53fff640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc400039b0 0x7fdc40003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:13.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.690+0000 7fdc58814640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc400052e0 0x7fdc4000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:13.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.690+0000 7fdc53fff640 1 -- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc400052e0 msgr2=0x7fdc4000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:26:13.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.690+0000 7fdc53fff640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc400052e0 0x7fdc4000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:13.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.690+0000 7fdc53fff640 1 -- 172.21.15.100:0/2993310279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc40004800 msgr2=0x7fdc40004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:26:13.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.690+0000 7fdc53fff640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc40004800 0x7fdc40004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:13.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.690+0000 7fdc53fff640 1 -- 172.21.15.100:0/2993310279 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc40003520 con 0x7fdc400039b0 2024-09-11T22:26:13.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.690+0000 7fdc58814640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc400052e0 0x7fdc4000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:26:13.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.691+0000 7fdc53fff640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc400039b0 0x7fdc40003d90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdc44006f40 tx=0x7fdc40005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f749ba1435b104a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:13.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.691+0000 7fdc537fe640 1 -- 172.21.15.100:0/2993310279 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc44031070 con 0x7fdc400039b0 2024-09-11T22:26:13.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.691+0000 7fdc537fe640 1 -- 172.21.15.100:0/2993310279 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4402f070 con 0x7fdc400039b0 2024-09-11T22:26:13.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.691+0000 7fdc537fe640 1 -- 172.21.15.100:0/2993310279 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4400ca80 con 0x7fdc400039b0 2024-09-11T22:26:13.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.692+0000 7fdc5a277640 1 -- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc400039b0 msgr2=0x7fdc40003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:13.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.692+0000 7fdc5a277640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc400039b0 0x7fdc40003d90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdc44006f40 tx=0x7fdc40005830 comp rx=0 tx=0).stop 2024-09-11T22:26:13.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.692+0000 7fdc5a277640 1 -- 172.21.15.100:0/2993310279 shutdown_connections 2024-09-11T22:26:13.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.692+0000 7fdc5a277640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc400052e0 0x7fdc4000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:13.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.692+0000 7fdc5a277640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc40004800 0x7fdc40004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:13.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.692+0000 7fdc5a277640 1 --2- 172.21.15.100:0/2993310279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc400039b0 0x7fdc40003d90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:13.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.692+0000 7fdc5a277640 1 -- 172.21.15.100:0/2993310279 >> 172.21.15.100:0/2993310279 conn(0x7fdc540cd200 msgr2=0x7fdc540cd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:13.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.692+0000 7fdc5a277640 1 -- 172.21.15.100:0/2993310279 shutdown_connections 2024-09-11T22:26:13.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.692+0000 7fdc5a277640 1 -- 172.21.15.100:0/2993310279 wait complete. 2024-09-11T22:26:13.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.693+0000 7fdc5a277640 1 Processor -- start 2024-09-11T22:26:13.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.694+0000 7fdc5a277640 1 -- start start 2024-09-11T22:26:13.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.694+0000 7fdc5a277640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc400039b0 0x7fdc540c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:13.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.694+0000 7fdc5a277640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc40004800 0x7fdc5414caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:13.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.694+0000 7fdc5a277640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc400052e0 0x7fdc5414cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:13.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.694+0000 7fdc5a277640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5406cc30 con 0x7fdc40004800 2024-09-11T22:26:13.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.694+0000 7fdc5a277640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5406c950 con 0x7fdc400039b0 2024-09-11T22:26:13.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.694+0000 7fdc5a277640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fdc54072c60 con 0x7fdc400052e0 2024-09-11T22:26:13.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.694+0000 7fdc4bfff640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc40004800 msgr2=0x7fdc5414caa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:26:13.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.694+0000 7fdc4bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc40004800 0x7fdc5414caa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:26:13.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.694+0000 7fdc53fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc400039b0 0x7fdc540c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:13.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.695+0000 7fdc53fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc400039b0 0x7fdc540c6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:41568/0 (socket says 172.21.15.100:41568) 2024-09-11T22:26:13.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.695+0000 7fdc53fff640 1 -- 172.21.15.100:0/1034746224 learned_addr learned my addr 172.21.15.100:0/1034746224 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:13.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.695+0000 7fdc58814640 1 --2- 172.21.15.100:0/1034746224 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc400052e0 0x7fdc5414cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:13.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.695+0000 7fdc53fff640 1 -- 172.21.15.100:0/1034746224 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc400052e0 msgr2=0x7fdc5414cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:13.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.695+0000 7fdc53fff640 1 --2- 172.21.15.100:0/1034746224 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc400052e0 0x7fdc5414cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:13.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.695+0000 7fdc53fff640 1 -- 172.21.15.100:0/1034746224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc40004800 msgr2=0x7fdc5414caa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:26:13.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.695+0000 7fdc53fff640 1 --2- 172.21.15.100:0/1034746224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc40004800 0x7fdc5414caa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:13.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.695+0000 7fdc53fff640 1 -- 172.21.15.100:0/1034746224 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc540b0240 con 0x7fdc400039b0 2024-09-11T22:26:13.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.695+0000 7fdc53fff640 1 --2- 172.21.15.100:0/1034746224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc400039b0 0x7fdc540c6d20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdc44006ab0 tx=0x7fdc440046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:13.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.695+0000 7fdc517fa640 1 -- 172.21.15.100:0/1034746224 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc44046070 con 0x7fdc400039b0 2024-09-11T22:26:13.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.695+0000 7fdc517fa640 1 -- 172.21.15.100:0/1034746224 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4400ca60 con 0x7fdc400039b0 2024-09-11T22:26:13.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.695+0000 7fdc5a277640 1 -- 172.21.15.100:0/1034746224 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc540c4980 con 0x7fdc400039b0 2024-09-11T22:26:13.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.695+0000 7fdc517fa640 1 -- 172.21.15.100:0/1034746224 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4400f040 con 0x7fdc400039b0 2024-09-11T22:26:13.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.695+0000 7fdc5a277640 1 -- 172.21.15.100:0/1034746224 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc540c4db0 con 0x7fdc400039b0 2024-09-11T22:26:13.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.697+0000 7fdc5a277640 1 -- 172.21.15.100:0/1034746224 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc540c8510 con 0x7fdc400039b0 2024-09-11T22:26:13.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.697+0000 7fdc517fa640 1 -- 172.21.15.100:0/1034746224 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc44049070 con 0x7fdc400039b0 2024-09-11T22:26:13.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.697+0000 7fdc517fa640 1 --2- 172.21.15.100:0/1034746224 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fdc3406c650 0x7fdc3406eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:13.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.697+0000 7fdc517fa640 1 -- 172.21.15.100:0/1034746224 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fdc440ab4a0 con 0x7fdc400039b0 2024-09-11T22:26:13.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.697+0000 7fdc4bfff640 1 --2- 172.21.15.100:0/1034746224 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fdc3406c650 0x7fdc3406eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:13.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.698+0000 7fdc4bfff640 1 --2- 172.21.15.100:0/1034746224 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fdc3406c650 0x7fdc3406eb10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdc540ce160 tx=0x7fdc3c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:13.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.702+0000 7fdc517fa640 1 -- 172.21.15.100:0/1034746224 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc440793d0 con 0x7fdc400039b0 2024-09-11T22:26:13.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.930+0000 7fdc5a277640 1 -- 172.21.15.100:0/1034746224 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdc540c9ab0 con 0x7fdc400039b0 2024-09-11T22:26:13.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.931+0000 7fdc517fa640 1 -- 172.21.15.100:0/1034746224 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7fdc4407d6d0 con 0x7fdc400039b0 2024-09-11T22:26:13.932 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":44,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:26:13.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.933+0000 7fdc5a277640 1 -- 172.21.15.100:0/1034746224 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fdc3406c650 msgr2=0x7fdc3406eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:13.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.933+0000 7fdc5a277640 1 --2- 172.21.15.100:0/1034746224 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fdc3406c650 0x7fdc3406eb10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdc540ce160 tx=0x7fdc3c008040 comp rx=0 tx=0).stop 2024-09-11T22:26:13.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.933+0000 7fdc5a277640 1 -- 172.21.15.100:0/1034746224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc400039b0 msgr2=0x7fdc540c6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:13.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.933+0000 7fdc5a277640 1 --2- 172.21.15.100:0/1034746224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc400039b0 0x7fdc540c6d20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdc44006ab0 tx=0x7fdc440046c0 comp rx=0 tx=0).stop 2024-09-11T22:26:13.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.933+0000 7fdc5a277640 1 -- 172.21.15.100:0/1034746224 shutdown_connections 2024-09-11T22:26:13.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.933+0000 7fdc5a277640 1 --2- 172.21.15.100:0/1034746224 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fdc3406c650 0x7fdc3406eb10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:13.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.933+0000 7fdc5a277640 1 --2- 172.21.15.100:0/1034746224 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc400052e0 0x7fdc5414cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:13.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.933+0000 7fdc5a277640 1 --2- 172.21.15.100:0/1034746224 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc40004800 0x7fdc5414caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:13.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.933+0000 7fdc5a277640 1 --2- 172.21.15.100:0/1034746224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc400039b0 0x7fdc540c6d20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:13.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.933+0000 7fdc5a277640 1 -- 172.21.15.100:0/1034746224 >> 172.21.15.100:0/1034746224 conn(0x7fdc540cd200 msgr2=0x7fdc540cc190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:13.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.933+0000 7fdc5a277640 1 -- 172.21.15.100:0/1034746224 shutdown_connections 2024-09-11T22:26:13.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:13.933+0000 7fdc5a277640 1 -- 172.21.15.100:0/1034746224 wait complete. 2024-09-11T22:26:13.945 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-11T22:26:13.945 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-11T22:26:13.945 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:26:14.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.044+0000 7fca2988b640 1 Processor -- start 2024-09-11T22:26:14.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.044+0000 7fca2988b640 1 -- start start 2024-09-11T22:26:14.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.044+0000 7fca2988b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca2415b2e0 0x7fca241661f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:14.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.044+0000 7fca2988b640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca240c6510 con 0x7fca2406d240 2024-09-11T22:26:14.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.044+0000 7fca2988b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca240c5470 con 0x7fca2406ce60 2024-09-11T22:26:14.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.044+0000 7fca2988b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fca2415b820 con 0x7fca2415b2e0 2024-09-11T22:26:14.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.044+0000 7fca227fc640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7fca2406d240 legacy=0x7fca241546b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:26:14.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.045+0000 7fca22ffd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fca2406ce60 0x7fca2415bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:50334/0 (socket says 172.21.15.100:50334) 2024-09-11T22:26:14.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.045+0000 7fca22ffd640 1 -- 172.21.15.100:0/1970266877 learned_addr learned my addr 172.21.15.100:0/1970266877 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:26:14.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.045+0000 7fca237fe640 1 --2- 172.21.15.100:0/1970266877 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca2415b2e0 0x7fca241661f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:14.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.045+0000 7fca21ffb640 1 -- 172.21.15.100:0/1970266877 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3614497258 0 0) 0x7fca240c5470 con 0x7fca2406ce60 2024-09-11T22:26:14.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.045+0000 7fca237fe640 1 -- 172.21.15.100:0/1970266877 >> v1:172.21.15.167:6789/0 conn(0x7fca2406ce60 legacy=0x7fca2415bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:14.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.045+0000 7fca237fe640 1 -- 172.21.15.100:0/1970266877 >> v1:172.21.15.100:6789/0 conn(0x7fca2406d240 legacy=0x7fca241546b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:26:14.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.045+0000 7fca237fe640 1 -- 172.21.15.100:0/1970266877 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca240c5750 con 0x7fca2415b2e0 2024-09-11T22:26:14.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.046+0000 7fca237fe640 1 --2- 172.21.15.100:0/1970266877 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca2415b2e0 0x7fca241661f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fca1c009dc0 tx=0x7fca1c02a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6aa12b564bc53e7a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:14.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.046+0000 7fca21ffb640 1 -- 172.21.15.100:0/1970266877 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c02ae60 con 0x7fca2415b2e0 2024-09-11T22:26:14.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.046+0000 7fca21ffb640 1 -- 172.21.15.100:0/1970266877 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca1c007740 con 0x7fca2415b2e0 2024-09-11T22:26:14.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.046+0000 7fca21ffb640 1 -- 172.21.15.100:0/1970266877 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c007b10 con 0x7fca2415b2e0 2024-09-11T22:26:14.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.046+0000 7fca2988b640 1 -- 172.21.15.100:0/1970266877 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca2415b2e0 msgr2=0x7fca241661f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:14.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.046+0000 7fca2988b640 1 --2- 172.21.15.100:0/1970266877 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca2415b2e0 0x7fca241661f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fca1c009dc0 tx=0x7fca1c02a680 comp rx=0 tx=0).stop 2024-09-11T22:26:14.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.046+0000 7fca2988b640 1 -- 172.21.15.100:0/1970266877 shutdown_connections 2024-09-11T22:26:14.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.046+0000 7fca2988b640 1 --2- 172.21.15.100:0/1970266877 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca2415b2e0 0x7fca241661f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:14.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.046+0000 7fca2988b640 1 -- 172.21.15.100:0/1970266877 >> 172.21.15.100:0/1970266877 conn(0x7fca2406bc10 msgr2=0x7fca2406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:14.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.047+0000 7fca2988b640 1 -- 172.21.15.100:0/1970266877 shutdown_connections 2024-09-11T22:26:14.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.047+0000 7fca2988b640 1 -- 172.21.15.100:0/1970266877 wait complete. 2024-09-11T22:26:14.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.048+0000 7fca2988b640 1 Processor -- start 2024-09-11T22:26:14.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.048+0000 7fca2988b640 1 -- start start 2024-09-11T22:26:14.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.048+0000 7fca2988b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca2406ce60 0x7fca240cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:14.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.048+0000 7fca2988b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca2406d240 0x7fca240cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:14.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.048+0000 7fca2988b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca2415b2e0 0x7fca24156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:14.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.048+0000 7fca2988b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fca2415c460 con 0x7fca2406d240 2024-09-11T22:26:14.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.048+0000 7fca2988b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fca240c5d10 con 0x7fca2415b2e0 2024-09-11T22:26:14.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.048+0000 7fca2988b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fca240cb1b0 con 0x7fca2406ce60 2024-09-11T22:26:14.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.049+0000 7fca227fc640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca2406d240 msgr2=0x7fca240cbe20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:26:14.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.049+0000 7fca227fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca2406d240 0x7fca240cbe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:26:14.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.049+0000 7fca22ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca2406ce60 0x7fca240cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:14.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.049+0000 7fca22ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca2406ce60 0x7fca240cb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:54148/0 (socket says 172.21.15.100:54148) 2024-09-11T22:26:14.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.049+0000 7fca22ffd640 1 -- 172.21.15.100:0/1824789196 learned_addr learned my addr 172.21.15.100:0/1824789196 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:14.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.049+0000 7fca237fe640 1 --2- 172.21.15.100:0/1824789196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca2415b2e0 0x7fca24156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:14.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.049+0000 7fca22ffd640 1 -- 172.21.15.100:0/1824789196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca2415b2e0 msgr2=0x7fca24156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:14.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.049+0000 7fca22ffd640 1 --2- 172.21.15.100:0/1824789196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca2415b2e0 0x7fca24156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:14.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.049+0000 7fca22ffd640 1 -- 172.21.15.100:0/1824789196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca2406d240 msgr2=0x7fca240cbe20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:26:14.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.049+0000 7fca22ffd640 1 --2- 172.21.15.100:0/1824789196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca2406d240 0x7fca240cbe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:14.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.049+0000 7fca22ffd640 1 -- 172.21.15.100:0/1824789196 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca240cd920 con 0x7fca2406ce60 2024-09-11T22:26:14.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.049+0000 7fca22ffd640 1 --2- 172.21.15.100:0/1824789196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca2406ce60 0x7fca240cb8e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fca1400c4d0 tx=0x7fca1400c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:14.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.049+0000 7fca0bfff640 1 -- 172.21.15.100:0/1824789196 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca14018070 con 0x7fca2406ce60 2024-09-11T22:26:14.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.049+0000 7fca0bfff640 1 -- 172.21.15.100:0/1824789196 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca140074e0 con 0x7fca2406ce60 2024-09-11T22:26:14.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.049+0000 7fca0bfff640 1 -- 172.21.15.100:0/1824789196 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca14004a20 con 0x7fca2406ce60 2024-09-11T22:26:14.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.049+0000 7fca2988b640 1 -- 172.21.15.100:0/1824789196 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca24158e50 con 0x7fca2406ce60 2024-09-11T22:26:14.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.049+0000 7fca2988b640 1 -- 172.21.15.100:0/1824789196 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fca2415a150 con 0x7fca2406ce60 2024-09-11T22:26:14.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.050+0000 7fca2988b640 1 --2- 172.21.15.100:0/1824789196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca241577c0 0x7fca24157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:14.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.050+0000 7fca2988b640 1 -- 172.21.15.100:0/1824789196 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fca24159130 con 0x7fca241577c0 2024-09-11T22:26:14.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.050+0000 7fca227fc640 1 --2- 172.21.15.100:0/1824789196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca241577c0 0x7fca24157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:14.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.051+0000 7fca227fc640 1 -- 172.21.15.100:0/1824789196 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca2415a4c0 con 0x7fca241577c0 2024-09-11T22:26:14.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.051+0000 7fca0bfff640 1 -- 172.21.15.100:0/1824789196 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca14004bc0 con 0x7fca2406ce60 2024-09-11T22:26:14.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.051+0000 7fca227fc640 1 --2- 172.21.15.100:0/1824789196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca241577c0 0x7fca24157140 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fca2415d280 tx=0x7fca1800b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:14.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.051+0000 7fca0bfff640 1 --2- 172.21.15.100:0/1824789196 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fca1006be10 0x7fca1006e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:14.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.051+0000 7fca0bfff640 1 -- 172.21.15.100:0/1824789196 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fca1408a490 con 0x7fca2406ce60 2024-09-11T22:26:14.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.051+0000 7fca237fe640 1 --2- 172.21.15.100:0/1824789196 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fca1006be10 0x7fca1006e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:14.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.051+0000 7fca0bfff640 1 -- 172.21.15.100:0/1824789196 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca18016070 con 0x7fca241577c0 2024-09-11T22:26:14.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.051+0000 7fca0bfff640 1 -- 172.21.15.100:0/1824789196 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fca18003dc0 con 0x7fca241577c0 2024-09-11T22:26:14.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.051+0000 7fca0bfff640 1 -- 172.21.15.100:0/1824789196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca241577c0 msgr2=0x7fca24157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:14.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.052+0000 7fca0bfff640 1 --2- 172.21.15.100:0/1824789196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca241577c0 0x7fca24157140 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fca2415d280 tx=0x7fca1800b8e0 comp rx=0 tx=0).stop 2024-09-11T22:26:14.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.052+0000 7fca0bfff640 1 -- 172.21.15.100:0/1824789196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca241577c0 msgr2=0x7fca24157140 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:26:14.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.052+0000 7fca0bfff640 1 --2- 172.21.15.100:0/1824789196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca241577c0 0x7fca24157140 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fca2415d280 tx=0x7fca1800b8e0 comp rx=0 tx=0).stop 2024-09-11T22:26:14.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.052+0000 7fca237fe640 1 --2- 172.21.15.100:0/1824789196 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fca1006be10 0x7fca1006e2d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fca1c034000 tx=0x7fca1c02f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:14.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.057+0000 7fca2988b640 1 --2- 172.21.15.100:0/1824789196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca241f3d10 0x7fca241f4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:14.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.058+0000 7fca2988b640 1 -- 172.21.15.100:0/1824789196 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fca240cad20 con 0x7fca241f3d10 2024-09-11T22:26:14.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.058+0000 7fca227fc640 1 --2- 172.21.15.100:0/1824789196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca241f3d10 0x7fca241f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:14.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.058+0000 7fca227fc640 1 -- 172.21.15.100:0/1824789196 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fca2415cfd0 con 0x7fca241f3d10 2024-09-11T22:26:14.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.058+0000 7fca227fc640 1 --2- 172.21.15.100:0/1824789196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca241f3d10 0x7fca241f4120 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fca24157f10 tx=0x7fca180059d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:14.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.058+0000 7fca0bfff640 1 -- 172.21.15.100:0/1824789196 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca18016040 con 0x7fca241f3d10 2024-09-11T22:26:14.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.059+0000 7fca0bfff640 1 -- 172.21.15.100:0/1824789196 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4878 (secure 0 0 0) 0x7fca18011400 con 0x7fca241f3d10 2024-09-11T22:26:14.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.059+0000 7fca0bfff640 1 -- 172.21.15.100:0/1824789196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca241f3d10 msgr2=0x7fca241f4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:14.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.059+0000 7fca0bfff640 1 --2- 172.21.15.100:0/1824789196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca241f3d10 0x7fca241f4120 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fca24157f10 tx=0x7fca180059d0 comp rx=0 tx=0).stop 2024-09-11T22:26:14.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.059+0000 7fca0bfff640 1 -- 172.21.15.100:0/1824789196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca241f3d10 msgr2=0x7fca241f4120 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:26:14.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.059+0000 7fca0bfff640 1 --2- 172.21.15.100:0/1824789196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca241f3d10 0x7fca241f4120 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:14.060 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:26:14.060 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:26:14.061 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:26:14.061 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:26:14.061 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 44, 2024-09-11T22:26:14.061 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 159337, 2024-09-11T22:26:14.061 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:26:14.061 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:26:14.061 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:26:14.061 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:14.061 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:26:14.061 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:26:14.061 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:26:14.061 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:26:14.061 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:14.062 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:14.062 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:14.062 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:14.062 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:14.062 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:14.062 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:14.062 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:14.062 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:14.062 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:14.062 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:14.062 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:14.062 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:26:14.062 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:26:14.062 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:14.063 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:14.063 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:14.063 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:14.063 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:14.063 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:14.063 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:14.063 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:14.063 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:14.063 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:14.063 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:14.063 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:14.063 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.063 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:26:14.064 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:26:14.064 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:26:14.064 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:26:14.064 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:26:14.064 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:26:14.064 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:26:14.064 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:26:14.064 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:26:14.064 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:26:14.064 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:26:14.064 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:26:14.064 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:26:14.064 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:26:14.065 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:26:14.065 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:26:14.065 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:26:14.065 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:14.065 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:14.065 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:14.065 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:14.065 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:14.065 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:14.065 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:14.065 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:14.065 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:14.066 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:14.066 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:14.066 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:14.066 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:26:14.066 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.066 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:26:14.066 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.066 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:26:14.066 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:26:14.066 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:14.066 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:14.066 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.066 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:14.067 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:26:14.067 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:14.067 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.067 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.067 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:14.067 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:26:14.067 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:14.067 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:14.067 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:14.067 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.067 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:26:14.067 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:26:14.067 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:14.067 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:14.068 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:14.068 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.068 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.068 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:26:14.068 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:26:14.068 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:14.068 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:14.068 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.068 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:14.068 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:26:14.068 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:14.068 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.068 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.069 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:14.069 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:26:14.069 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:14.069 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:14.069 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:14.069 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.069 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:26:14.069 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:26:14.069 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:14.069 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:14.069 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:14.069 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.069 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.069 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:26:14.070 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:26:14.070 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:14.070 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:14.070 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.070 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:14.070 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:26:14.070 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:14.070 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.070 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.070 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:14.070 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:26:14.070 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:14.070 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:14.070 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:14.071 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.071 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:26:14.071 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:26:14.071 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:14.071 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:14.071 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:14.071 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:14.071 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:14.071 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.071 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:26:14.071 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:26:14.071 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.071 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:14.072 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:14.072 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:26:14.072 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:14.072 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:14.072 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:26:14.072 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.072 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:14.072 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:14.072 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:26:14.072 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:14.072 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:14.072 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:26:14.072 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.072 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:14.073 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:14.073 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:26:14.073 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:14.073 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:14.073 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:26:14.073 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.073 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:14.073 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:14.073 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:26:14.073 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:14.073 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:14.073 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.073 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:26:14.073 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:26:14.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.059+0000 7fca2988b640 1 -- 172.21.15.100:0/1824789196 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fca1006be10 msgr2=0x7fca1006e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:14.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.059+0000 7fca2988b640 1 --2- 172.21.15.100:0/1824789196 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fca1006be10 0x7fca1006e2d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fca1c034000 tx=0x7fca1c02f000 comp rx=0 tx=0).stop 2024-09-11T22:26:14.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.059+0000 7fca2988b640 1 -- 172.21.15.100:0/1824789196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca2406ce60 msgr2=0x7fca240cb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:14.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.059+0000 7fca2988b640 1 --2- 172.21.15.100:0/1824789196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca2406ce60 0x7fca240cb8e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fca1400c4d0 tx=0x7fca1400c990 comp rx=0 tx=0).stop 2024-09-11T22:26:14.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.059+0000 7fca237fe640 1 -- 172.21.15.100:0/1824789196 reap_dead start 2024-09-11T22:26:14.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.059+0000 7fca237fe640 1 -- 172.21.15.100:0/1824789196 reap_dead start 2024-09-11T22:26:14.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.059+0000 7fca2988b640 1 -- 172.21.15.100:0/1824789196 shutdown_connections 2024-09-11T22:26:14.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.059+0000 7fca2988b640 1 -- 172.21.15.100:0/1824789196 >> 172.21.15.100:0/1824789196 conn(0x7fca2406bc10 msgr2=0x7fca240b39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:14.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.059+0000 7fca2988b640 1 -- 172.21.15.100:0/1824789196 shutdown_connections 2024-09-11T22:26:14.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.059+0000 7fca2988b640 1 -- 172.21.15.100:0/1824789196 wait complete. 2024-09-11T22:26:14.076 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:26:14.076 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-11T22:26:14.076 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:26:14.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.174+0000 7f1a692c9640 1 Processor -- start 2024-09-11T22:26:14.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.174+0000 7f1a692c9640 1 -- start start 2024-09-11T22:26:14.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.175+0000 7f1a692c9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a6406ce60 0x7f1a6415bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:14.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.175+0000 7f1a692c9640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a640c6510 con 0x7f1a6406d240 2024-09-11T22:26:14.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.175+0000 7f1a692c9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a640c5470 con 0x7f1a6415c290 2024-09-11T22:26:14.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.175+0000 7f1a692c9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1a6415b820 con 0x7f1a6406ce60 2024-09-11T22:26:14.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.175+0000 7f1a637fe640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f1a6406d240 legacy=0x7f1a641651e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:26:14.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.175+0000 7f1a62ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a6406ce60 0x7f1a6415bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:14.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.175+0000 7f1a5bfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f1a6415c290 0x7f1a641546b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:50342/0 (socket says 172.21.15.100:50342) 2024-09-11T22:26:14.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.175+0000 7f1a5bfff640 1 -- 172.21.15.100:0/917775293 learned_addr learned my addr 172.21.15.100:0/917775293 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:26:14.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.175+0000 7f1a62ffd640 1 -- 172.21.15.100:0/917775293 >> v1:172.21.15.167:6789/0 conn(0x7f1a6415c290 legacy=0x7f1a641546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:14.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.175+0000 7f1a62ffd640 1 -- 172.21.15.100:0/917775293 >> v1:172.21.15.100:6789/0 conn(0x7f1a6406d240 legacy=0x7f1a641651e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:26:14.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.175+0000 7f1a627fc640 1 -- 172.21.15.100:0/917775293 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 520646319 0 0) 0x7f1a640c5470 con 0x7f1a6415c290 2024-09-11T22:26:14.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.175+0000 7f1a62ffd640 1 -- 172.21.15.100:0/917775293 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a640c5750 con 0x7f1a6406ce60 2024-09-11T22:26:14.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.176+0000 7f1a62ffd640 1 --2- 172.21.15.100:0/917775293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a6406ce60 0x7f1a6415bd50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1a540097d0 tx=0x7f1a5402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1af97e4d77f2cb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:14.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.176+0000 7f1a627fc640 1 -- 172.21.15.100:0/917775293 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54037070 con 0x7f1a6406ce60 2024-09-11T22:26:14.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.176+0000 7f1a627fc640 1 -- 172.21.15.100:0/917775293 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a54032440 con 0x7f1a6406ce60 2024-09-11T22:26:14.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.176+0000 7f1a627fc640 1 -- 172.21.15.100:0/917775293 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54032810 con 0x7f1a6406ce60 2024-09-11T22:26:14.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.177+0000 7f1a692c9640 1 -- 172.21.15.100:0/917775293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a6406ce60 msgr2=0x7f1a6415bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:14.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.177+0000 7f1a692c9640 1 --2- 172.21.15.100:0/917775293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a6406ce60 0x7f1a6415bd50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1a540097d0 tx=0x7f1a5402a1c0 comp rx=0 tx=0).stop 2024-09-11T22:26:14.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.177+0000 7f1a692c9640 1 -- 172.21.15.100:0/917775293 shutdown_connections 2024-09-11T22:26:14.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.177+0000 7f1a692c9640 1 --2- 172.21.15.100:0/917775293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a6406ce60 0x7f1a6415bd50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:14.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.177+0000 7f1a692c9640 1 -- 172.21.15.100:0/917775293 >> 172.21.15.100:0/917775293 conn(0x7f1a6406bc10 msgr2=0x7f1a6406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:14.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.177+0000 7f1a692c9640 1 -- 172.21.15.100:0/917775293 shutdown_connections 2024-09-11T22:26:14.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.177+0000 7f1a692c9640 1 -- 172.21.15.100:0/917775293 wait complete. 2024-09-11T22:26:14.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.178+0000 7f1a692c9640 1 Processor -- start 2024-09-11T22:26:14.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.178+0000 7f1a692c9640 1 -- start start 2024-09-11T22:26:14.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.179+0000 7f1a692c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a6406ce60 0x7f1a641e6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:14.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.179+0000 7f1a692c9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a6406d240 0x7f1a641f0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:14.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.179+0000 7f1a692c9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a6415c290 0x7f1a641f0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:14.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.179+0000 7f1a692c9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1a640cb1b0 con 0x7f1a6415c290 2024-09-11T22:26:14.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.179+0000 7f1a692c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1a640c5d10 con 0x7f1a6406ce60 2024-09-11T22:26:14.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.179+0000 7f1a692c9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1a640cad20 con 0x7f1a6406d240 2024-09-11T22:26:14.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.179+0000 7f1a637fe640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a6415c290 msgr2=0x7f1a641f0f40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:26:14.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.179+0000 7f1a637fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a6415c290 0x7f1a641f0f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:26:14.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.179+0000 7f1a62ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a6406ce60 0x7f1a641e6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:14.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.179+0000 7f1a5bfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a6406d240 0x7f1a641f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:14.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.179+0000 7f1a62ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a6406ce60 0x7f1a641e6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:41598/0 (socket says 172.21.15.100:41598) 2024-09-11T22:26:14.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.179+0000 7f1a62ffd640 1 -- 172.21.15.100:0/1365426355 learned_addr learned my addr 172.21.15.100:0/1365426355 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:14.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.179+0000 7f1a62ffd640 1 -- 172.21.15.100:0/1365426355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a6406d240 msgr2=0x7f1a641f0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:14.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.179+0000 7f1a62ffd640 1 --2- 172.21.15.100:0/1365426355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a6406d240 0x7f1a641f0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:14.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.179+0000 7f1a62ffd640 1 -- 172.21.15.100:0/1365426355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a6415c290 msgr2=0x7f1a641f0f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:26:14.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.179+0000 7f1a62ffd640 1 --2- 172.21.15.100:0/1365426355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a6415c290 0x7f1a641f0f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:14.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.179+0000 7f1a62ffd640 1 -- 172.21.15.100:0/1365426355 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a641e3d30 con 0x7f1a6406ce60 2024-09-11T22:26:14.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.179+0000 7f1a5bfff640 1 --2- 172.21.15.100:0/1365426355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a6406d240 0x7f1a641f0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:26:14.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.179+0000 7f1a62ffd640 1 --2- 172.21.15.100:0/1365426355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a6406ce60 0x7f1a641e6ed0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1a540097d0 tx=0x7f1a540046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:14.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.180+0000 7f1a5b7fe640 1 -- 172.21.15.100:0/1365426355 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54037040 con 0x7f1a6406ce60 2024-09-11T22:26:14.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.180+0000 7f1a5b7fe640 1 -- 172.21.15.100:0/1365426355 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a54004230 con 0x7f1a6406ce60 2024-09-11T22:26:14.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.180+0000 7f1a692c9640 1 -- 172.21.15.100:0/1365426355 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a641f40a0 con 0x7f1a6406ce60 2024-09-11T22:26:14.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.180+0000 7f1a5b7fe640 1 -- 172.21.15.100:0/1365426355 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54032e40 con 0x7f1a6406ce60 2024-09-11T22:26:14.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.180+0000 7f1a692c9640 1 -- 172.21.15.100:0/1365426355 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a641f4660 con 0x7f1a6406ce60 2024-09-11T22:26:14.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.181+0000 7f1a692c9640 1 --2- 172.21.15.100:0/1365426355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a6414ebc0 0x7f1a64151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:14.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.181+0000 7f1a692c9640 1 -- 172.21.15.100:0/1365426355 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1a641f4e40 con 0x7f1a6414ebc0 2024-09-11T22:26:14.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.181+0000 7f1a5bfff640 1 --2- 172.21.15.100:0/1365426355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a6414ebc0 0x7f1a64151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:14.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.181+0000 7f1a5bfff640 1 -- 172.21.15.100:0/1365426355 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a641e3fa0 con 0x7f1a6414ebc0 2024-09-11T22:26:14.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.181+0000 7f1a5b7fe640 1 -- 172.21.15.100:0/1365426355 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a540306f0 con 0x7f1a6406ce60 2024-09-11T22:26:14.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.181+0000 7f1a5bfff640 1 --2- 172.21.15.100:0/1365426355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a6414ebc0 0x7f1a64151870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1a640ca930 tx=0x7f1a4c001c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:14.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.182+0000 7f1a5b7fe640 1 --2- 172.21.15.100:0/1365426355 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1a4406bde0 0x7f1a4406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:14.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.182+0000 7f1a5b7fe640 1 -- 172.21.15.100:0/1365426355 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f1a540ac450 con 0x7f1a6406ce60 2024-09-11T22:26:14.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.182+0000 7f1a637fe640 1 --2- 172.21.15.100:0/1365426355 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1a4406bde0 0x7f1a4406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:14.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.182+0000 7f1a5b7fe640 1 -- 172.21.15.100:0/1365426355 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c00fa00 con 0x7f1a6414ebc0 2024-09-11T22:26:14.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.182+0000 7f1a5b7fe640 1 -- 172.21.15.100:0/1365426355 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1a4c018070 con 0x7f1a6414ebc0 2024-09-11T22:26:14.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.182+0000 7f1a5b7fe640 1 -- 172.21.15.100:0/1365426355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a6414ebc0 msgr2=0x7f1a64151870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:14.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.182+0000 7f1a5b7fe640 1 --2- 172.21.15.100:0/1365426355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a6414ebc0 0x7f1a64151870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1a640ca930 tx=0x7f1a4c001c80 comp rx=0 tx=0).stop 2024-09-11T22:26:14.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.182+0000 7f1a5b7fe640 1 -- 172.21.15.100:0/1365426355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a6414ebc0 msgr2=0x7f1a64151870 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:26:14.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.182+0000 7f1a5b7fe640 1 --2- 172.21.15.100:0/1365426355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a6414ebc0 0x7f1a64151870 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1a640ca930 tx=0x7f1a4c001c80 comp rx=0 tx=0).stop 2024-09-11T22:26:14.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.182+0000 7f1a637fe640 1 --2- 172.21.15.100:0/1365426355 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1a4406bde0 0x7f1a4406e2a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c003cb0 tx=0x7f1a5c0091f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:14.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.188+0000 7f1a692c9640 1 --2- 172.21.15.100:0/1365426355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a641e49c0 0x7f1a641e4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:14.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.188+0000 7f1a692c9640 1 -- 172.21.15.100:0/1365426355 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1a641e52e0 con 0x7f1a641e49c0 2024-09-11T22:26:14.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.188+0000 7f1a5bfff640 1 --2- 172.21.15.100:0/1365426355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a641e49c0 0x7f1a641e4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:14.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.189+0000 7f1a5bfff640 1 -- 172.21.15.100:0/1365426355 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1a6415b2e0 con 0x7f1a641e49c0 2024-09-11T22:26:14.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.189+0000 7f1a5bfff640 1 --2- 172.21.15.100:0/1365426355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a641e49c0 0x7f1a641e4da0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c014000 tx=0x7f1a4c001080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:14.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.189+0000 7f1a5b7fe640 1 -- 172.21.15.100:0/1365426355 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c013600 con 0x7f1a641e49c0 2024-09-11T22:26:14.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.189+0000 7f1a5b7fe640 1 -- 172.21.15.100:0/1365426355 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5043 (secure 0 0 0) 0x7f1a4c013600 con 0x7f1a641e49c0 2024-09-11T22:26:14.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.189+0000 7f1a5b7fe640 1 -- 172.21.15.100:0/1365426355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a641e49c0 msgr2=0x7f1a641e4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:14.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.189+0000 7f1a5b7fe640 1 --2- 172.21.15.100:0/1365426355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a641e49c0 0x7f1a641e4da0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c014000 tx=0x7f1a4c001080 comp rx=0 tx=0).stop 2024-09-11T22:26:14.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.189+0000 7f1a5b7fe640 1 -- 172.21.15.100:0/1365426355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a641e49c0 msgr2=0x7f1a641e4da0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:26:14.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.189+0000 7f1a5b7fe640 1 --2- 172.21.15.100:0/1365426355 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a641e49c0 0x7f1a641e4da0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:14.191 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:26:14.191 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:26:14.191 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:26:14.191 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:26:14.191 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 44, 2024-09-11T22:26:14.191 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 264911, 2024-09-11T22:26:14.191 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:26:14.191 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:26:14.192 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:26:14.192 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:14.192 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:26:14.192 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:26:14.192 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:26:14.192 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:26:14.192 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:14.192 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:14.192 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:14.192 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:14.192 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:14.192 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:14.192 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:14.193 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:14.193 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:14.193 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:14.193 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:14.193 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:14.193 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:26:14.193 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:26:14.193 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:14.193 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:14.193 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:14.193 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:14.193 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:14.193 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:14.193 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:14.194 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:14.194 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:14.194 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:14.194 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:14.194 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:14.194 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.194 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:26:14.194 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:26:14.194 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:26:14.194 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:26:14.194 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:26:14.194 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:26:14.194 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:26:14.194 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:26:14.195 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:26:14.195 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:26:14.195 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:26:14.195 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:26:14.195 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:26:14.195 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:26:14.195 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:26:14.195 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:26:14.195 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:26:14.195 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:14.195 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:14.195 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:14.195 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:14.195 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:14.196 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:14.196 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:14.196 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:14.196 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:14.196 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:14.196 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:14.196 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:14.196 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:26:14.196 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.196 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:26:14.196 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.196 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:26:14.196 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:26:14.197 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:14.197 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:14.197 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.197 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:14.197 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:26:14.197 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:14.197 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.197 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.197 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:14.197 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:26:14.197 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:14.197 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:14.197 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:14.198 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.198 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:26:14.198 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:26:14.198 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:14.198 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:14.198 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:14.198 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.198 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.198 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:26:14.198 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:26:14.198 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:14.198 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:14.198 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.198 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:14.199 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:26:14.199 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:14.199 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.199 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.199 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:14.199 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:26:14.199 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:14.199 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:14.199 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:14.199 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.199 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:26:14.199 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:26:14.199 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:14.200 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:14.200 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:14.200 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.200 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.200 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:26:14.200 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:26:14.200 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:14.200 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:14.200 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.200 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:14.200 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:26:14.200 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:14.200 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.201 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.201 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:14.201 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:26:14.201 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:14.201 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:14.201 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:14.201 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.201 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:26:14.201 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:26:14.201 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:14.201 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:14.201 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:14.201 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:14.201 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:14.202 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.202 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:26:14.202 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:26:14.202 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.202 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:14.202 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:14.202 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:26:14.202 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:14.202 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:14.202 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:26:14.202 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.202 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:14.202 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:14.203 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:26:14.203 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:14.203 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:14.203 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:26:14.203 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.203 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:14.203 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:14.203 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:26:14.203 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:14.203 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:14.203 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:26:14.203 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.203 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:14.203 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:14.204 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:26:14.204 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:14.204 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:14.204 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:26:14.204 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:14.204 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:14.204 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:14.204 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:26:14.204 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:14.204 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:14.204 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:14.204 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:26:14.204 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:26:14.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.190+0000 7f1a692c9640 1 -- 172.21.15.100:0/1365426355 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1a4406bde0 msgr2=0x7f1a4406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:14.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.190+0000 7f1a692c9640 1 --2- 172.21.15.100:0/1365426355 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1a4406bde0 0x7f1a4406e2a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c003cb0 tx=0x7f1a5c0091f0 comp rx=0 tx=0).stop 2024-09-11T22:26:14.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.190+0000 7f1a692c9640 1 -- 172.21.15.100:0/1365426355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a6406ce60 msgr2=0x7f1a641e6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:14.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.190+0000 7f1a692c9640 1 --2- 172.21.15.100:0/1365426355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a6406ce60 0x7f1a641e6ed0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1a540097d0 tx=0x7f1a540046c0 comp rx=0 tx=0).stop 2024-09-11T22:26:14.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.190+0000 7f1a637fe640 1 -- 172.21.15.100:0/1365426355 reap_dead start 2024-09-11T22:26:14.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.190+0000 7f1a637fe640 1 -- 172.21.15.100:0/1365426355 reap_dead start 2024-09-11T22:26:14.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.190+0000 7f1a692c9640 1 -- 172.21.15.100:0/1365426355 shutdown_connections 2024-09-11T22:26:14.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.190+0000 7f1a692c9640 1 -- 172.21.15.100:0/1365426355 >> 172.21.15.100:0/1365426355 conn(0x7f1a6406bc10 msgr2=0x7f1a640cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:14.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.190+0000 7f1a692c9640 1 -- 172.21.15.100:0/1365426355 shutdown_connections 2024-09-11T22:26:14.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:14.190+0000 7f1a692c9640 1 -- 172.21.15.100:0/1365426355 wait complete. 2024-09-11T22:26:14.207 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:26:14.207 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-11T22:26:20.456 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:26:20.459 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:26:34.208 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:26:34.208 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-11T22:26:34.209 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T22:26:34.209 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T22:26:34.212 INFO:tasks.ceph.mon.a:Started 2024-09-11T22:26:34.212 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:26:34.212 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:26:34.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.330+0000 7f7883a17640 1 Processor -- start 2024-09-11T22:26:34.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.330+0000 7f7883a17640 1 -- start start 2024-09-11T22:26:34.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.331+0000 7f7883a17640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f787c0cabc0 0x7f787c0c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:34.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.331+0000 7f7883a17640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f787c071fc0 0x7f787c0cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:34.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.331+0000 7f7883a17640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f787c159060 0x7f787c06de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:34.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.331+0000 7f7883a17640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f787c15cc50 con 0x7f787c071fc0 2024-09-11T22:26:34.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.331+0000 7f7883a17640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f787c0b1160 con 0x7f787c0cabc0 2024-09-11T22:26:34.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.331+0000 7f7883a17640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f787c158bd0 con 0x7f787c159060 2024-09-11T22:26:34.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.331+0000 7f7880fb2640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f787c071fc0 0x7f787c0cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:34.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.332+0000 7f7880fb2640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f787c071fc0 0x7f787c0cafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34354/0 (socket says 172.21.15.100:34354) 2024-09-11T22:26:34.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.332+0000 7f7880fb2640 1 -- 172.21.15.100:0/2032705685 learned_addr learned my addr 172.21.15.100:0/2032705685 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:34.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.332+0000 7f78817b3640 1 --2- 172.21.15.100:0/2032705685 >> v2:172.21.15.167:3300/0 conn(0x7f787c0cabc0 0x7f787c0c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:34.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.332+0000 7f7881fb4640 1 --2- 172.21.15.100:0/2032705685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f787c159060 0x7f787c06de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:34.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.332+0000 7f7880fb2640 1 -- 172.21.15.100:0/2032705685 >> v2:172.21.15.100:3300/0 conn(0x7f787c071fc0 msgr2=0x7f787c0cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:26:34.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.332+0000 7f7880fb2640 1 -- 172.21.15.100:0/2032705685 >> v2:172.21.15.100:3300/0 conn(0x7f787c071fc0 msgr2=0x7f787c0cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:26:34.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.332+0000 7f7880fb2640 1 --2- 172.21.15.100:0/2032705685 >> v2:172.21.15.100:3300/0 conn(0x7f787c071fc0 0x7f787c0cafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:26:34.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.332+0000 7f7880fb2640 1 --2- 172.21.15.100:0/2032705685 >> v2:172.21.15.100:3300/0 conn(0x7f787c071fc0 0x7f787c0cafa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:26:34.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.332+0000 7f78817b3640 1 -- 172.21.15.100:0/2032705685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f787c159060 msgr2=0x7f787c06de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:26:34.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.332+0000 7f78817b3640 1 --2- 172.21.15.100:0/2032705685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f787c159060 0x7f787c06de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:34.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.332+0000 7f78817b3640 1 -- 172.21.15.100:0/2032705685 >> v2:172.21.15.100:3300/0 conn(0x7f787c071fc0 msgr2=0x7f787c0cafa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:26:34.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.332+0000 7f78817b3640 1 --2- 172.21.15.100:0/2032705685 >> v2:172.21.15.100:3300/0 conn(0x7f787c071fc0 0x7f787c0cafa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:34.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.332+0000 7f78817b3640 1 -- 172.21.15.100:0/2032705685 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787c0ca9c0 con 0x7f787c0cabc0 2024-09-11T22:26:34.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.332+0000 7f7881fb4640 1 --2- 172.21.15.100:0/2032705685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f787c159060 0x7f787c06de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:26:34.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.333+0000 7f78817b3640 1 --2- 172.21.15.100:0/2032705685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f787c0cabc0 0x7f787c0c8d60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f787c06eec0 tx=0x7f787802a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=218d425b7bcaa6aa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:34.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.333+0000 7f7873fff640 1 -- 172.21.15.100:0/2032705685 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7878037070 con 0x7f787c0cabc0 2024-09-11T22:26:34.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.333+0000 7f7873fff640 1 -- 172.21.15.100:0/2032705685 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f787802add0 con 0x7f787c0cabc0 2024-09-11T22:26:34.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.333+0000 7f7873fff640 1 -- 172.21.15.100:0/2032705685 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7878032660 con 0x7f787c0cabc0 2024-09-11T22:26:34.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.333+0000 7f7883a17640 1 -- 172.21.15.100:0/2032705685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f787c0cabc0 msgr2=0x7f787c0c8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:34.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.333+0000 7f7883a17640 1 --2- 172.21.15.100:0/2032705685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f787c0cabc0 0x7f787c0c8d60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f787c06eec0 tx=0x7f787802a080 comp rx=0 tx=0).stop 2024-09-11T22:26:34.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.334+0000 7f7883a17640 1 -- 172.21.15.100:0/2032705685 shutdown_connections 2024-09-11T22:26:34.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.334+0000 7f7883a17640 1 --2- 172.21.15.100:0/2032705685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f787c159060 0x7f787c06de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:34.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.334+0000 7f7883a17640 1 --2- 172.21.15.100:0/2032705685 >> v2:172.21.15.100:3300/0 conn(0x7f787c071fc0 0x7f787c0cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:34.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.334+0000 7f7883a17640 1 --2- 172.21.15.100:0/2032705685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f787c0cabc0 0x7f787c0c8d60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:34.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.334+0000 7f7883a17640 1 -- 172.21.15.100:0/2032705685 >> 172.21.15.100:0/2032705685 conn(0x7f787c06fb70 msgr2=0x7f787c071590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:34.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.334+0000 7f7883a17640 1 -- 172.21.15.100:0/2032705685 shutdown_connections 2024-09-11T22:26:34.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.334+0000 7f7883a17640 1 -- 172.21.15.100:0/2032705685 wait complete. 2024-09-11T22:26:34.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.335+0000 7f7883a17640 1 Processor -- start 2024-09-11T22:26:34.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.335+0000 7f7883a17640 1 -- start start 2024-09-11T22:26:34.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.336+0000 7f7883a17640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f787c071fc0 0x7f787c150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:34.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.336+0000 7f7883a17640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f787c0cabc0 0x7f787c0c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:34.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.336+0000 7f7883a17640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f787c159060 0x7f787c0c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:34.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.336+0000 7f7883a17640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f787c15c690 con 0x7f787c159060 2024-09-11T22:26:34.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.336+0000 7f7883a17640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f787c1588a0 con 0x7f787c0cabc0 2024-09-11T22:26:34.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.336+0000 7f7883a17640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f787c15c970 con 0x7f787c071fc0 2024-09-11T22:26:34.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.336+0000 7f7881fb4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f787c159060 0x7f787c0c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:34.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.336+0000 7f78817b3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f787c071fc0 0x7f787c150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:34.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.336+0000 7f7881fb4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f787c159060 0x7f787c0c6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34368/0 (socket says 172.21.15.100:34368) 2024-09-11T22:26:34.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.336+0000 7f7881fb4640 1 -- 172.21.15.100:0/2585412666 learned_addr learned my addr 172.21.15.100:0/2585412666 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:34.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.336+0000 7f78817b3640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f787c071fc0 0x7f787c150770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45754/0 (socket says 172.21.15.100:45754) 2024-09-11T22:26:34.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.336+0000 7f7880fb2640 1 --2- 172.21.15.100:0/2585412666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f787c0cabc0 0x7f787c0c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:34.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.336+0000 7f7881fb4640 1 -- 172.21.15.100:0/2585412666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f787c159060 msgr2=0x7f787c0c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-11T22:26:34.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.336+0000 7f7881fb4640 1 -- 172.21.15.100:0/2585412666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f787c159060 msgr2=0x7f787c0c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:26:34.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.336+0000 7f7881fb4640 1 --2- 172.21.15.100:0/2585412666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f787c159060 0x7f787c0c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:26:34.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.336+0000 7f7881fb4640 1 --2- 172.21.15.100:0/2585412666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f787c159060 0x7f787c0c6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:26:34.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.337+0000 7f78817b3640 1 -- 172.21.15.100:0/2585412666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f787c0cabc0 msgr2=0x7f787c0c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:34.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.337+0000 7f78817b3640 1 --2- 172.21.15.100:0/2585412666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f787c0cabc0 0x7f787c0c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:34.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.337+0000 7f78817b3640 1 -- 172.21.15.100:0/2585412666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f787c159060 msgr2=0x7f787c0c6260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:26:34.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.337+0000 7f78817b3640 1 --2- 172.21.15.100:0/2585412666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f787c159060 0x7f787c0c6260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:34.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.337+0000 7f78817b3640 1 -- 172.21.15.100:0/2585412666 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787c151810 con 0x7f787c071fc0 2024-09-11T22:26:34.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.337+0000 7f78817b3640 1 --2- 172.21.15.100:0/2585412666 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f787c071fc0 0x7f787c150770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7878031000 tx=0x7f78780046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:34.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.337+0000 7f7871ffb640 1 -- 172.21.15.100:0/2585412666 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7878037040 con 0x7f787c071fc0 2024-09-11T22:26:34.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.337+0000 7f7871ffb640 1 -- 172.21.15.100:0/2585412666 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f787802abd0 con 0x7f787c071fc0 2024-09-11T22:26:34.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.337+0000 7f7883a17640 1 -- 172.21.15.100:0/2585412666 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787c151af0 con 0x7f787c071fc0 2024-09-11T22:26:34.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.337+0000 7f7871ffb640 1 -- 172.21.15.100:0/2585412666 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7878006e10 con 0x7f787c071fc0 2024-09-11T22:26:34.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.337+0000 7f7883a17640 1 -- 172.21.15.100:0/2585412666 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f787c1520b0 con 0x7f787c071fc0 2024-09-11T22:26:34.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.338+0000 7f7883a17640 1 -- 172.21.15.100:0/2585412666 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f787c0cf450 con 0x7f787c071fc0 2024-09-11T22:26:34.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.339+0000 7f7871ffb640 1 -- 172.21.15.100:0/2585412666 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7878044020 con 0x7f787c071fc0 2024-09-11T22:26:34.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.339+0000 7f7871ffb640 1 --2- 172.21.15.100:0/2585412666 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f786006be60 0x7f786006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:34.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.340+0000 7f7871ffb640 1 -- 172.21.15.100:0/2585412666 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f78780ab400 con 0x7f787c071fc0 2024-09-11T22:26:34.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.340+0000 7f7880fb2640 1 --2- 172.21.15.100:0/2585412666 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f786006be60 0x7f786006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:34.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.340+0000 7f7880fb2640 1 --2- 172.21.15.100:0/2585412666 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f786006be60 0x7f786006e320 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f787c157a00 tx=0x7f786c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:34.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.344+0000 7f7871ffb640 1 -- 172.21.15.100:0/2585412666 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f787c0ca9c0 con 0x7f787c071fc0 2024-09-11T22:26:34.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.638+0000 7f7883a17640 1 -- 172.21.15.100:0/2585412666 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f787c0c9340 con 0x7f787c071fc0 2024-09-11T22:26:34.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.639+0000 7f7871ffb640 1 -- 172.21.15.100:0/2585412666 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f7878079990 con 0x7f787c071fc0 2024-09-11T22:26:34.640 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":44,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:26:34.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.641+0000 7f7883a17640 1 -- 172.21.15.100:0/2585412666 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f786006be60 msgr2=0x7f786006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:34.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.641+0000 7f7883a17640 1 --2- 172.21.15.100:0/2585412666 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f786006be60 0x7f786006e320 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f787c157a00 tx=0x7f786c008040 comp rx=0 tx=0).stop 2024-09-11T22:26:34.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.641+0000 7f7883a17640 1 -- 172.21.15.100:0/2585412666 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f787c071fc0 msgr2=0x7f787c150770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:34.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.641+0000 7f7883a17640 1 --2- 172.21.15.100:0/2585412666 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f787c071fc0 0x7f787c150770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7878031000 tx=0x7f78780046c0 comp rx=0 tx=0).stop 2024-09-11T22:26:34.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.641+0000 7f7883a17640 1 -- 172.21.15.100:0/2585412666 shutdown_connections 2024-09-11T22:26:34.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.641+0000 7f7883a17640 1 --2- 172.21.15.100:0/2585412666 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f786006be60 0x7f786006e320 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:34.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.641+0000 7f7883a17640 1 --2- 172.21.15.100:0/2585412666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f787c159060 0x7f787c0c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:34.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.641+0000 7f7883a17640 1 --2- 172.21.15.100:0/2585412666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f787c0cabc0 0x7f787c0c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:34.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.641+0000 7f7883a17640 1 --2- 172.21.15.100:0/2585412666 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f787c071fc0 0x7f787c150770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:34.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.641+0000 7f7883a17640 1 -- 172.21.15.100:0/2585412666 >> 172.21.15.100:0/2585412666 conn(0x7f787c06fb70 msgr2=0x7f787c1569c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:34.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.641+0000 7f7883a17640 1 -- 172.21.15.100:0/2585412666 shutdown_connections 2024-09-11T22:26:34.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:34.641+0000 7f7883a17640 1 -- 172.21.15.100:0/2585412666 wait complete. 2024-09-11T22:26:37.655 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:26:37.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.775+0000 7fbccd55f640 1 Processor -- start 2024-09-11T22:26:37.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.775+0000 7fbccd55f640 1 -- start start 2024-09-11T22:26:37.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.776+0000 7fbccd55f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 0x7fbcc80c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:37.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.776+0000 7fbccd55f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbcc80cafa0 0x7fbcc8163010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:37.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.776+0000 7fbccd55f640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc80ca9c0 con 0x7fbcc80cabc0 2024-09-11T22:26:37.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.776+0000 7fbccd55f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fbcc815cc50 con 0x7fbcc80cafa0 2024-09-11T22:26:37.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.776+0000 7fbccd55f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbcc80b1160 con 0x7fbcc8071fc0 2024-09-11T22:26:37.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.777+0000 7fbcc6ffd640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fbcc80cabc0 0x7fbcc8159060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40580/0 (socket says 172.21.15.100:40580) 2024-09-11T22:26:37.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.777+0000 7fbcc6ffd640 1 -- 172.21.15.100:0/989207096 learned_addr learned my addr 172.21.15.100:0/989207096 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:26:37.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.777+0000 7fbcc77fe640 1 --2- 172.21.15.100:0/989207096 >> v2:172.21.15.167:3300/0 conn(0x7fbcc80cafa0 0x7fbcc8163010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:37.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.777+0000 7fbcc67fc640 1 --2- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 0x7fbcc80c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:37.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.777+0000 7fbcc77fe640 1 -- 172.21.15.100:0/989207096 >> v2:172.21.15.167:3300/0 conn(0x7fbcc80cafa0 msgr2=0x7fbcc8163010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:26:37.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.777+0000 7fbcc77fe640 1 -- 172.21.15.100:0/989207096 >> v2:172.21.15.167:3300/0 conn(0x7fbcc80cafa0 msgr2=0x7fbcc8163010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:26:37.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.777+0000 7fbcc77fe640 1 --2- 172.21.15.100:0/989207096 >> v2:172.21.15.167:3300/0 conn(0x7fbcc80cafa0 0x7fbcc8163010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:26:37.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.777+0000 7fbcc67fc640 1 -- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 msgr2=0x7fbcc80c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:26:37.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.777+0000 7fbcc67fc640 1 -- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 msgr2=0x7fbcc80c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:26:37.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.777+0000 7fbcc67fc640 1 --2- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 0x7fbcc80c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:26:37.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.777+0000 7fbcc77fe640 1 --2- 172.21.15.100:0/989207096 >> v2:172.21.15.167:3300/0 conn(0x7fbcc80cafa0 0x7fbcc8163010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:26:37.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.777+0000 7fbcc67fc640 1 --2- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 0x7fbcc80c8d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:26:37.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.978+0000 7fbcc77fe640 1 --2- 172.21.15.100:0/989207096 >> v2:172.21.15.167:3300/0 conn(0x7fbcc80cafa0 0x7fbcc8163010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:37.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.978+0000 7fbcc67fc640 1 --2- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 0x7fbcc80c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:37.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.978+0000 7fbcc77fe640 1 -- 172.21.15.100:0/989207096 >> v2:172.21.15.167:3300/0 conn(0x7fbcc80cafa0 msgr2=0x7fbcc8163010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:26:37.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.978+0000 7fbcc77fe640 1 -- 172.21.15.100:0/989207096 >> v2:172.21.15.167:3300/0 conn(0x7fbcc80cafa0 msgr2=0x7fbcc8163010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:26:37.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.978+0000 7fbcc77fe640 1 --2- 172.21.15.100:0/989207096 >> v2:172.21.15.167:3300/0 conn(0x7fbcc80cafa0 0x7fbcc8163010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:26:37.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.978+0000 7fbcc67fc640 1 -- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 msgr2=0x7fbcc80c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:26:37.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.978+0000 7fbcc67fc640 1 -- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 msgr2=0x7fbcc80c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:26:37.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.978+0000 7fbcc67fc640 1 --2- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 0x7fbcc80c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:26:37.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.978+0000 7fbcc77fe640 1 --2- 172.21.15.100:0/989207096 >> v2:172.21.15.167:3300/0 conn(0x7fbcc80cafa0 0x7fbcc8163010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:26:37.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:37.978+0000 7fbcc67fc640 1 --2- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 0x7fbcc80c8d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:26:38.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:38.379+0000 7fbcc77fe640 1 --2- 172.21.15.100:0/989207096 >> v2:172.21.15.167:3300/0 conn(0x7fbcc80cafa0 0x7fbcc8163010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:38.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:38.379+0000 7fbcc67fc640 1 --2- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 0x7fbcc80c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:38.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:38.379+0000 7fbcc77fe640 1 -- 172.21.15.100:0/989207096 >> v2:172.21.15.167:3300/0 conn(0x7fbcc80cafa0 msgr2=0x7fbcc8163010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:26:38.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:38.379+0000 7fbcc77fe640 1 -- 172.21.15.100:0/989207096 >> v2:172.21.15.167:3300/0 conn(0x7fbcc80cafa0 msgr2=0x7fbcc8163010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:26:38.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:38.379+0000 7fbcc67fc640 1 -- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 msgr2=0x7fbcc80c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:26:38.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:38.379+0000 7fbcc77fe640 1 --2- 172.21.15.100:0/989207096 >> v2:172.21.15.167:3300/0 conn(0x7fbcc80cafa0 0x7fbcc8163010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:26:38.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:38.379+0000 7fbcc67fc640 1 -- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 msgr2=0x7fbcc80c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:26:38.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:38.379+0000 7fbcc67fc640 1 --2- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 0x7fbcc80c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:26:38.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:38.379+0000 7fbcc67fc640 1 --2- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 0x7fbcc80c8d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:26:38.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:38.379+0000 7fbcc77fe640 1 --2- 172.21.15.100:0/989207096 >> v2:172.21.15.167:3300/0 conn(0x7fbcc80cafa0 0x7fbcc8163010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:26:39.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:39.180+0000 7fbcc77fe640 1 --2- 172.21.15.100:0/989207096 >> v2:172.21.15.167:3300/0 conn(0x7fbcc80cafa0 0x7fbcc8163010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:39.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:39.180+0000 7fbcc67fc640 1 --2- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 0x7fbcc80c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:39.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:39.180+0000 7fbcc77fe640 1 -- 172.21.15.100:0/989207096 >> v2:172.21.15.167:3300/0 conn(0x7fbcc80cafa0 msgr2=0x7fbcc8163010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:26:39.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:39.180+0000 7fbcc67fc640 1 -- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 msgr2=0x7fbcc80c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:26:39.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:39.180+0000 7fbcc77fe640 1 -- 172.21.15.100:0/989207096 >> v2:172.21.15.167:3300/0 conn(0x7fbcc80cafa0 msgr2=0x7fbcc8163010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:26:39.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:39.180+0000 7fbcc67fc640 1 -- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 msgr2=0x7fbcc80c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:26:39.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:39.180+0000 7fbcc77fe640 1 --2- 172.21.15.100:0/989207096 >> v2:172.21.15.167:3300/0 conn(0x7fbcc80cafa0 0x7fbcc8163010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:26:39.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:39.180+0000 7fbcc67fc640 1 --2- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 0x7fbcc80c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:26:39.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:39.180+0000 7fbcc77fe640 1 --2- 172.21.15.100:0/989207096 >> v2:172.21.15.167:3300/0 conn(0x7fbcc80cafa0 0x7fbcc8163010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:26:39.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:39.180+0000 7fbcc67fc640 1 --2- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 0x7fbcc80c8d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:26:40.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.529+0000 7fbcc5ffb640 1 -- 172.21.15.100:0/989207096 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1065947676 0 0) 0x7fbcb8001110 con 0x7fbcc80cabc0 2024-09-11T22:26:40.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.529+0000 7fbcc5ffb640 1 -- 172.21.15.100:0/989207096 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcb0003520 con 0x7fbcc80cabc0 2024-09-11T22:26:40.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.530+0000 7fbcc5ffb640 1 -- 172.21.15.100:0/989207096 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1822168259 0 0) 0x7fbcb0003520 con 0x7fbcc80cabc0 2024-09-11T22:26:40.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.530+0000 7fbcc5ffb640 1 -- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 msgr2=0x7fbcc80c8d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:26:40.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.530+0000 7fbcc5ffb640 1 --2- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 0x7fbcc80c8d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.530+0000 7fbcc5ffb640 1 -- 172.21.15.100:0/989207096 >> v2:172.21.15.167:3300/0 conn(0x7fbcc80cafa0 msgr2=0x7fbcc8163010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:26:40.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.530+0000 7fbcc5ffb640 1 --2- 172.21.15.100:0/989207096 >> v2:172.21.15.167:3300/0 conn(0x7fbcc80cafa0 0x7fbcc8163010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.530+0000 7fbcc5ffb640 1 -- 172.21.15.100:0/989207096 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc81588a0 con 0x7fbcc80cabc0 2024-09-11T22:26:40.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.530+0000 7fbcc5ffb640 1 -- 172.21.15.100:0/989207096 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fbcb8001840 con 0x7fbcc80cabc0 2024-09-11T22:26:40.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.530+0000 7fbcc5ffb640 1 -- 172.21.15.100:0/989207096 >> v1:172.21.15.100:6789/0 conn(0x7fbcc80cabc0 legacy=0x7fbcc8159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:40.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.530+0000 7fbcc5ffb640 1 --2- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 0x7fbcb00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:40.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.530+0000 7fbcc5ffb640 1 --2- 172.21.15.100:0/989207096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcb0003fe0 0x7fbcb0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:40.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.530+0000 7fbcc5ffb640 1 --2- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcb0004d40 0x7fbcb00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:40.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.530+0000 7fbcc5ffb640 1 -- 172.21.15.100:0/989207096 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc815cc50 con 0x7fbcb0003fe0 2024-09-11T22:26:40.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.530+0000 7fbcc5ffb640 1 -- 172.21.15.100:0/989207096 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc80b1160 con 0x7fbcb0004d40 2024-09-11T22:26:40.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.530+0000 7fbcc5ffb640 1 -- 172.21.15.100:0/989207096 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbcb000bb80 con 0x7fbcc8071fc0 2024-09-11T22:26:40.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.530+0000 7fbcc67fc640 1 --2- 172.21.15.100:0/989207096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcb0003fe0 0x7fbcb0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:40.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.530+0000 7fbcc77fe640 1 --2- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcb0004d40 0x7fbcb00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:40.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.530+0000 7fbcc6ffd640 1 --2- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 0x7fbcb00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:40.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.531+0000 7fbcc67fc640 1 -- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 msgr2=0x7fbcb00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:26:40.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.531+0000 7fbcc67fc640 1 --2- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc8071fc0 0x7fbcb00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.531+0000 7fbcc67fc640 1 -- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcb0004d40 msgr2=0x7fbcb00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:26:40.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.531+0000 7fbcc67fc640 1 --2- 172.21.15.100:0/989207096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcb0004d40 0x7fbcb00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.531+0000 7fbcc67fc640 1 -- 172.21.15.100:0/989207096 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb0003520 con 0x7fbcb0003fe0 2024-09-11T22:26:40.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.531+0000 7fbcc67fc640 1 --2- 172.21.15.100:0/989207096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcb0003fe0 0x7fbcb0004800 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8071f50 tx=0x7fbcb0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dbe3d5f32676555 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:40.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.532+0000 7fbcc5ffb640 1 -- 172.21.15.100:0/989207096 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc031070 con 0x7fbcb0003fe0 2024-09-11T22:26:40.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.532+0000 7fbcc5ffb640 1 -- 172.21.15.100:0/989207096 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcbc02b760 con 0x7fbcb0003fe0 2024-09-11T22:26:40.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.532+0000 7fbcc5ffb640 1 -- 172.21.15.100:0/989207096 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc011790 con 0x7fbcb0003fe0 2024-09-11T22:26:40.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.533+0000 7fbccd55f640 1 -- 172.21.15.100:0/989207096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcb0003fe0 msgr2=0x7fbcb0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:40.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.533+0000 7fbccd55f640 1 --2- 172.21.15.100:0/989207096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcb0003fe0 0x7fbcb0004800 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8071f50 tx=0x7fbcb0005830 comp rx=0 tx=0).stop 2024-09-11T22:26:40.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.533+0000 7fbcc77fe640 1 -- 172.21.15.100:0/989207096 reap_dead start 2024-09-11T22:26:40.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.533+0000 7fbccd55f640 1 -- 172.21.15.100:0/989207096 shutdown_connections 2024-09-11T22:26:40.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.533+0000 7fbccd55f640 1 -- 172.21.15.100:0/989207096 >> 172.21.15.100:0/989207096 conn(0x7fbcc806fb70 msgr2=0x7fbcc8071590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:40.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.533+0000 7fbccd55f640 1 -- 172.21.15.100:0/989207096 shutdown_connections 2024-09-11T22:26:40.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.533+0000 7fbccd55f640 1 -- 172.21.15.100:0/989207096 wait complete. 2024-09-11T22:26:40.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.535+0000 7fbccd55f640 1 Processor -- start 2024-09-11T22:26:40.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.535+0000 7fbccd55f640 1 -- start start 2024-09-11T22:26:40.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.536+0000 7fbccd55f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcb0003fe0 0x7fbcc806d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:40.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.536+0000 7fbccd55f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc815a460 0x7fbcc815b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:40.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.536+0000 7fbccd55f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc81f0660 0x7fbcc806c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:40.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.536+0000 7fbccd55f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc80cb450 con 0x7fbcc81f0660 2024-09-11T22:26:40.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.536+0000 7fbccd55f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc8158bd0 con 0x7fbcb0003fe0 2024-09-11T22:26:40.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.536+0000 7fbccd55f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbcc815c690 con 0x7fbcc815a460 2024-09-11T22:26:40.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.536+0000 7fbcc77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc81f0660 0x7fbcc806c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:40.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.536+0000 7fbcc67fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc815a460 0x7fbcc815b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:40.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.536+0000 7fbcc77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc81f0660 0x7fbcc806c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34384/0 (socket says 172.21.15.100:34384) 2024-09-11T22:26:40.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.536+0000 7fbcc77fe640 1 -- 172.21.15.100:0/336324570 learned_addr learned my addr 172.21.15.100:0/336324570 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:40.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.536+0000 7fbcc6ffd640 1 --2- 172.21.15.100:0/336324570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcb0003fe0 0x7fbcc806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:40.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.536+0000 7fbcc77fe640 1 -- 172.21.15.100:0/336324570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc815a460 msgr2=0x7fbcc815b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:40.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.536+0000 7fbcc77fe640 1 --2- 172.21.15.100:0/336324570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc815a460 0x7fbcc815b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.536+0000 7fbcc77fe640 1 -- 172.21.15.100:0/336324570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcb0003fe0 msgr2=0x7fbcc806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:40.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.536+0000 7fbcc77fe640 1 --2- 172.21.15.100:0/336324570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcb0003fe0 0x7fbcc806d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.536+0000 7fbcc77fe640 1 -- 172.21.15.100:0/336324570 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc815a9f0 con 0x7fbcc81f0660 2024-09-11T22:26:40.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.536+0000 7fbcc67fc640 1 --2- 172.21.15.100:0/336324570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc815a460 0x7fbcc815b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:26:40.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.536+0000 7fbcc6ffd640 1 --2- 172.21.15.100:0/336324570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcb0003fe0 0x7fbcc806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:26:40.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.537+0000 7fbcc77fe640 1 --2- 172.21.15.100:0/336324570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc81f0660 0x7fbcc806c770 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0009610 tx=0x7fbcc0015700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:40.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.537+0000 7fbcaf7fe640 1 -- 172.21.15.100:0/336324570 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc001c030 con 0x7fbcc81f0660 2024-09-11T22:26:40.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.537+0000 7fbcaf7fe640 1 -- 172.21.15.100:0/336324570 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc0009ca0 con 0x7fbcc81f0660 2024-09-11T22:26:40.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.537+0000 7fbccd55f640 1 -- 172.21.15.100:0/336324570 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc815acd0 con 0x7fbcc81f0660 2024-09-11T22:26:40.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.537+0000 7fbcaf7fe640 1 -- 172.21.15.100:0/336324570 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0021630 con 0x7fbcc81f0660 2024-09-11T22:26:40.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.537+0000 7fbccd55f640 1 -- 172.21.15.100:0/336324570 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc8159c60 con 0x7fbcc81f0660 2024-09-11T22:26:40.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.538+0000 7fbccd55f640 1 -- 172.21.15.100:0/336324570 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcc815c970 con 0x7fbcc81f0660 2024-09-11T22:26:40.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.539+0000 7fbcaf7fe640 1 -- 172.21.15.100:0/336324570 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbcc0005d10 con 0x7fbcc81f0660 2024-09-11T22:26:40.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.539+0000 7fbcaf7fe640 1 --2- 172.21.15.100:0/336324570 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbcb406be60 0x7fbcb406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:40.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.539+0000 7fbcaf7fe640 1 -- 172.21.15.100:0/336324570 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fbcc008c210 con 0x7fbcc81f0660 2024-09-11T22:26:40.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.539+0000 7fbcc6ffd640 1 --2- 172.21.15.100:0/336324570 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbcb406be60 0x7fbcb406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:40.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.540+0000 7fbcc6ffd640 1 --2- 172.21.15.100:0/336324570 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbcb406be60 0x7fbcb406e320 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbcb80012f0 tx=0x7fbcb8007b00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:40.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.546+0000 7fbcaf7fe640 1 -- 172.21.15.100:0/336324570 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbcc0026030 con 0x7fbcc81f0660 2024-09-11T22:26:40.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.835+0000 7fbccd55f640 1 -- 172.21.15.100:0/336324570 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbcc80c9340 con 0x7fbcc81f0660 2024-09-11T22:26:40.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.836+0000 7fbcaf7fe640 1 -- 172.21.15.100:0/336324570 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7fbcc0010050 con 0x7fbcc81f0660 2024-09-11T22:26:40.837 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":48,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:26:40.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.838+0000 7fbccd55f640 1 -- 172.21.15.100:0/336324570 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbcb406be60 msgr2=0x7fbcb406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:40.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.838+0000 7fbccd55f640 1 --2- 172.21.15.100:0/336324570 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbcb406be60 0x7fbcb406e320 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbcb80012f0 tx=0x7fbcb8007b00 comp rx=0 tx=0).stop 2024-09-11T22:26:40.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.838+0000 7fbccd55f640 1 -- 172.21.15.100:0/336324570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc81f0660 msgr2=0x7fbcc806c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:40.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.838+0000 7fbccd55f640 1 --2- 172.21.15.100:0/336324570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc81f0660 0x7fbcc806c770 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0009610 tx=0x7fbcc0015700 comp rx=0 tx=0).stop 2024-09-11T22:26:40.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.838+0000 7fbccd55f640 1 -- 172.21.15.100:0/336324570 shutdown_connections 2024-09-11T22:26:40.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.838+0000 7fbccd55f640 1 --2- 172.21.15.100:0/336324570 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbcb406be60 0x7fbcb406e320 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.838+0000 7fbccd55f640 1 --2- 172.21.15.100:0/336324570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc81f0660 0x7fbcc806c770 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.838+0000 7fbccd55f640 1 --2- 172.21.15.100:0/336324570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbcc815a460 0x7fbcc815b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.838+0000 7fbccd55f640 1 --2- 172.21.15.100:0/336324570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcb0003fe0 0x7fbcc806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.838+0000 7fbccd55f640 1 -- 172.21.15.100:0/336324570 >> 172.21.15.100:0/336324570 conn(0x7fbcc806fb70 msgr2=0x7fbcc80c42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:40.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.838+0000 7fbccd55f640 1 -- 172.21.15.100:0/336324570 shutdown_connections 2024-09-11T22:26:40.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.838+0000 7fbccd55f640 1 -- 172.21.15.100:0/336324570 wait complete. 2024-09-11T22:26:40.850 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:26:40.850 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:26:40.850 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:26:40.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.953+0000 7f2766882640 1 Processor -- start 2024-09-11T22:26:40.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.953+0000 7f2766882640 1 -- start start 2024-09-11T22:26:40.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.954+0000 7f2766882640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f276006ce60 0x7f276015bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:40.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.954+0000 7f2766882640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f276015c290 0x7f27601546b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:40.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.954+0000 7f2766882640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f276006d240 0x7f2760154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:40.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.954+0000 7f2766882640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f276015b820 con 0x7f276006ce60 2024-09-11T22:26:40.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.954+0000 7f2766882640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f27600c6510 con 0x7f276006d240 2024-09-11T22:26:40.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.954+0000 7f2766882640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f27600c5470 con 0x7f276015c290 2024-09-11T22:26:40.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.954+0000 7f275ffff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f276006ce60 0x7f276015bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:40.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.954+0000 7f275ffff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f276006ce60 0x7f276015bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34394/0 (socket says 172.21.15.100:34394) 2024-09-11T22:26:40.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.954+0000 7f275ffff640 1 -- 172.21.15.100:0/3196158704 learned_addr learned my addr 172.21.15.100:0/3196158704 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:40.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.955+0000 7f275ffff640 1 -- 172.21.15.100:0/3196158704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f276015c290 msgr2=0x7f27601546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:26:40.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.955+0000 7f2764e1f640 1 --2- 172.21.15.100:0/3196158704 >> v2:172.21.15.167:3300/0 conn(0x7f276006d240 0x7f2760154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:40.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.955+0000 7f275ffff640 1 --2- 172.21.15.100:0/3196158704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f276015c290 0x7f27601546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.955+0000 7f275ffff640 1 -- 172.21.15.100:0/3196158704 >> v2:172.21.15.167:3300/0 conn(0x7f276006d240 msgr2=0x7f2760154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:26:40.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.955+0000 7f275ffff640 1 --2- 172.21.15.100:0/3196158704 >> v2:172.21.15.167:3300/0 conn(0x7f276006d240 0x7f2760154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.955+0000 7f275ffff640 1 -- 172.21.15.100:0/3196158704 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27600c5750 con 0x7f276006ce60 2024-09-11T22:26:40.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.955+0000 7f2764e1f640 1 --2- 172.21.15.100:0/3196158704 >> v2:172.21.15.167:3300/0 conn(0x7f276006d240 0x7f2760154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:26:40.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.955+0000 7f275ffff640 1 --2- 172.21.15.100:0/3196158704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276006ce60 0x7f276015bd50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f27600b5a80 tx=0x7f275002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb5f7db506f0c2b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:40.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.956+0000 7f275effd640 1 -- 172.21.15.100:0/3196158704 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2750037070 con 0x7f276006ce60 2024-09-11T22:26:40.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.956+0000 7f275effd640 1 -- 172.21.15.100:0/3196158704 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2750032440 con 0x7f276006ce60 2024-09-11T22:26:40.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.956+0000 7f275effd640 1 -- 172.21.15.100:0/3196158704 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2750032810 con 0x7f276006ce60 2024-09-11T22:26:40.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.956+0000 7f2766882640 1 -- 172.21.15.100:0/3196158704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276006ce60 msgr2=0x7f276015bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:40.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.956+0000 7f2766882640 1 --2- 172.21.15.100:0/3196158704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276006ce60 0x7f276015bd50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f27600b5a80 tx=0x7f275002a200 comp rx=0 tx=0).stop 2024-09-11T22:26:40.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.956+0000 7f2766882640 1 -- 172.21.15.100:0/3196158704 shutdown_connections 2024-09-11T22:26:40.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.956+0000 7f2766882640 1 --2- 172.21.15.100:0/3196158704 >> v2:172.21.15.167:3300/0 conn(0x7f276006d240 0x7f2760154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.956+0000 7f2766882640 1 --2- 172.21.15.100:0/3196158704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f276015c290 0x7f27601546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.956+0000 7f2766882640 1 --2- 172.21.15.100:0/3196158704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276006ce60 0x7f276015bd50 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.956+0000 7f2766882640 1 -- 172.21.15.100:0/3196158704 >> 172.21.15.100:0/3196158704 conn(0x7f276006bc10 msgr2=0x7f276006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:40.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.956+0000 7f2766882640 1 -- 172.21.15.100:0/3196158704 shutdown_connections 2024-09-11T22:26:40.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.956+0000 7f2766882640 1 -- 172.21.15.100:0/3196158704 wait complete. 2024-09-11T22:26:40.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.957+0000 7f2766882640 1 Processor -- start 2024-09-11T22:26:40.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.958+0000 7f2766882640 1 -- start start 2024-09-11T22:26:40.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.958+0000 7f2766882640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276006ce60 0x7f27600c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:40.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.958+0000 7f2766882640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f276006d240 0x7f27601f0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:40.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.958+0000 7f2766882640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f276015c290 0x7f27600b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:40.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.958+0000 7f2766882640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f27600cb1b0 con 0x7f276006ce60 2024-09-11T22:26:40.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.958+0000 7f2766882640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f27600c5d10 con 0x7f276006d240 2024-09-11T22:26:40.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.958+0000 7f2766882640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f27600cad20 con 0x7f276015c290 2024-09-11T22:26:40.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.959+0000 7f275ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276006ce60 0x7f27600c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:40.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.959+0000 7f275ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276006ce60 0x7f27600c7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34408/0 (socket says 172.21.15.100:34408) 2024-09-11T22:26:40.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.959+0000 7f275ffff640 1 -- 172.21.15.100:0/23023802 learned_addr learned my addr 172.21.15.100:0/23023802 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:40.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.959+0000 7f275f7fe640 1 --2- 172.21.15.100:0/23023802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f276006d240 0x7f27601f0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:40.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.959+0000 7f2764e1f640 1 --2- 172.21.15.100:0/23023802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f276015c290 0x7f27600b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:40.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.959+0000 7f275ffff640 1 -- 172.21.15.100:0/23023802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f276015c290 msgr2=0x7f27600b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:40.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.959+0000 7f275ffff640 1 --2- 172.21.15.100:0/23023802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f276015c290 0x7f27600b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.959+0000 7f275ffff640 1 -- 172.21.15.100:0/23023802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f276006d240 msgr2=0x7f27601f0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:40.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.959+0000 7f275ffff640 1 --2- 172.21.15.100:0/23023802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f276006d240 0x7f27601f0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.959+0000 7f275ffff640 1 -- 172.21.15.100:0/23023802 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27600cf160 con 0x7f276006ce60 2024-09-11T22:26:40.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.959+0000 7f275ffff640 1 --2- 172.21.15.100:0/23023802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276006ce60 0x7f27600c7840 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2750000c00 tx=0x7f27500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:40.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.959+0000 7f275cff9640 1 -- 172.21.15.100:0/23023802 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2750041070 con 0x7f276006ce60 2024-09-11T22:26:40.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.959+0000 7f275cff9640 1 -- 172.21.15.100:0/23023802 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f275003c870 con 0x7f276006ce60 2024-09-11T22:26:40.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.959+0000 7f275cff9640 1 -- 172.21.15.100:0/23023802 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2750037040 con 0x7f276006ce60 2024-09-11T22:26:40.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.959+0000 7f2766882640 1 -- 172.21.15.100:0/23023802 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27601f45f0 con 0x7f276006ce60 2024-09-11T22:26:40.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.960+0000 7f2766882640 1 -- 172.21.15.100:0/23023802 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27600cee80 con 0x7f276006ce60 2024-09-11T22:26:40.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.961+0000 7f2766882640 1 --2- 172.21.15.100:0/23023802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27600cb330 0x7f27600cff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:40.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.961+0000 7f2766882640 1 -- 172.21.15.100:0/23023802 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f276015b2e0 con 0x7f27600cb330 2024-09-11T22:26:40.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.961+0000 7f275f7fe640 1 --2- 172.21.15.100:0/23023802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27600cb330 0x7f27600cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:40.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.961+0000 7f275f7fe640 1 -- 172.21.15.100:0/23023802 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2760158fc0 con 0x7f27600cb330 2024-09-11T22:26:40.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.961+0000 7f275f7fe640 1 --2- 172.21.15.100:0/23023802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27600cb330 0x7f27600cff60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2760154290 tx=0x7f275400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:40.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.961+0000 7f275cff9640 1 -- 172.21.15.100:0/23023802 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2750044070 con 0x7f276006ce60 2024-09-11T22:26:40.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.962+0000 7f275cff9640 1 --2- 172.21.15.100:0/23023802 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f274c06be60 0x7f274c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:40.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.962+0000 7f275cff9640 1 -- 172.21.15.100:0/23023802 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2754017070 con 0x7f27600cb330 2024-09-11T22:26:40.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.962+0000 7f275cff9640 1 -- 172.21.15.100:0/23023802 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f27500abda0 con 0x7f276006ce60 2024-09-11T22:26:40.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.962+0000 7f2764e1f640 1 --2- 172.21.15.100:0/23023802 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f274c06be60 0x7f274c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:40.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.962+0000 7f275cff9640 1 -- 172.21.15.100:0/23023802 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f275400c770 con 0x7f27600cb330 2024-09-11T22:26:40.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.962+0000 7f275cff9640 1 -- 172.21.15.100:0/23023802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27600cb330 msgr2=0x7f27600cff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:40.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.962+0000 7f275cff9640 1 --2- 172.21.15.100:0/23023802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27600cb330 0x7f27600cff60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2760154290 tx=0x7f275400ec00 comp rx=0 tx=0).stop 2024-09-11T22:26:40.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.962+0000 7f275cff9640 1 -- 172.21.15.100:0/23023802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27600cb330 msgr2=0x7f27600cff60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:26:40.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.962+0000 7f275cff9640 1 --2- 172.21.15.100:0/23023802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27600cb330 0x7f27600cff60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.962+0000 7f2764e1f640 1 --2- 172.21.15.100:0/23023802 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f274c06be60 0x7f274c06e320 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f27600c8020 tx=0x7f2758007780 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:40.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.969+0000 7f2766882640 1 --2- 172.21.15.100:0/23023802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276014dbb0 0x7f276014df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:40.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.969+0000 7f2766882640 1 -- 172.21.15.100:0/23023802 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f27601f0a80 con 0x7f276014dbb0 2024-09-11T22:26:40.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.969+0000 7f275f7fe640 1 --2- 172.21.15.100:0/23023802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276014dbb0 0x7f276014df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:40.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.969+0000 7f275f7fe640 1 -- 172.21.15.100:0/23023802 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2760151ee0 con 0x7f276014dbb0 2024-09-11T22:26:40.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.969+0000 7f275f7fe640 1 --2- 172.21.15.100:0/23023802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276014dbb0 0x7f276014df90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2760154290 tx=0x7f27540047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:40.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.969+0000 7f275cff9640 1 -- 172.21.15.100:0/23023802 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2754017070 con 0x7f276014dbb0 2024-09-11T22:26:40.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.969+0000 7f275cff9640 1 -- 172.21.15.100:0/23023802 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7f27540064d0 con 0x7f276014dbb0 2024-09-11T22:26:40.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.970+0000 7f275cff9640 1 -- 172.21.15.100:0/23023802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276014dbb0 msgr2=0x7f276014df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:40.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.970+0000 7f275cff9640 1 --2- 172.21.15.100:0/23023802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276014dbb0 0x7f276014df90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2760154290 tx=0x7f27540047d0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.970+0000 7f275cff9640 1 -- 172.21.15.100:0/23023802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276014dbb0 msgr2=0x7f276014df90 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:26:40.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.970+0000 7f275cff9640 1 --2- 172.21.15.100:0/23023802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276014dbb0 0x7f276014df90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.971 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:26:40.971 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:26:40.972 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:26:40.972 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:26:40.972 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 48, 2024-09-11T22:26:40.972 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 6668, 2024-09-11T22:26:40.972 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:26:40.972 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:26:40.972 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:26:40.972 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:26:40.972 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:40.972 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:26:40.972 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:26:40.972 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:26:40.972 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:26:40.973 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:40.973 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:40.973 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:40.973 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:40.973 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:40.973 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:40.973 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:40.973 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:40.973 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:40.973 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:40.973 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:40.973 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:40.973 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:26:40.973 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:26:40.974 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:40.974 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:40.974 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:40.974 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:40.974 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:40.974 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:40.974 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:40.974 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:40.974 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:40.974 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:40.974 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:40.974 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:40.974 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:40.974 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:26:40.975 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:26:40.975 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:26:40.975 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:26:40.975 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:26:40.975 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:26:40.975 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:26:40.975 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:26:40.975 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:26:40.975 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:26:40.975 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:26:40.975 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:26:40.975 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:26:40.975 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:26:40.975 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:26:40.975 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:26:40.976 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:26:40.976 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:40.976 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:40.976 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:40.976 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:40.976 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:40.976 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:40.976 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:40.976 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:40.976 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:40.976 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:40.976 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:40.976 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:40.977 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:26:40.977 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:40.977 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:26:40.977 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:40.977 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:26:40.977 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:26:40.977 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:40.977 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:40.977 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:40.977 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:40.977 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:26:40.977 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:40.977 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:40.977 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:40.977 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:40.978 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:26:40.978 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:40.978 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:40.978 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:40.978 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:40.978 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:26:40.978 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:26:40.978 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:40.978 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:40.978 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:40.978 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:40.978 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:40.978 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:26:40.978 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:26:40.979 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:40.979 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:40.979 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:40.979 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:40.979 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:26:40.979 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:40.979 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:40.979 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:40.979 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:40.979 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:26:40.979 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:40.979 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:40.979 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:40.979 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:40.980 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:26:40.980 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:26:40.980 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:40.980 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:40.980 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:40.980 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:40.980 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:40.980 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:26:40.980 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:26:40.980 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:40.980 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:40.980 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:40.980 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:40.980 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:26:40.981 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:40.981 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:40.981 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:40.981 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:40.981 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:26:40.981 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:40.981 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:40.981 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:40.981 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:40.981 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:26:40.981 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:26:40.981 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:40.981 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:40.981 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:40.982 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:40.982 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:40.982 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:40.982 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:26:40.982 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:26:40.982 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:40.982 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:40.982 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:40.982 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:26:40.982 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:40.982 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:40.982 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:26:40.982 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:40.982 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:40.983 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:40.983 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:26:40.983 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:40.983 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:40.983 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:40.983 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:26:40.983 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:26:40.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.970+0000 7f2766882640 1 -- 172.21.15.100:0/23023802 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f274c06be60 msgr2=0x7f274c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:40.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.970+0000 7f2766882640 1 --2- 172.21.15.100:0/23023802 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f274c06be60 0x7f274c06e320 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f27600c8020 tx=0x7f2758007780 comp rx=0 tx=0).stop 2024-09-11T22:26:40.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.970+0000 7f2766882640 1 -- 172.21.15.100:0/23023802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276006ce60 msgr2=0x7f27600c7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:40.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.970+0000 7f2766882640 1 --2- 172.21.15.100:0/23023802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276006ce60 0x7f27600c7840 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2750000c00 tx=0x7f27500046c0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.970+0000 7f2764e1f640 1 -- 172.21.15.100:0/23023802 reap_dead start 2024-09-11T22:26:40.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.970+0000 7f2766882640 1 -- 172.21.15.100:0/23023802 shutdown_connections 2024-09-11T22:26:40.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.970+0000 7f2766882640 1 --2- 172.21.15.100:0/23023802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f276006ce60 0x7f27600c7840 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:40.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.970+0000 7f2766882640 1 -- 172.21.15.100:0/23023802 >> 172.21.15.100:0/23023802 conn(0x7f276006bc10 msgr2=0x7f2760154480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:40.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.970+0000 7f2766882640 1 -- 172.21.15.100:0/23023802 shutdown_connections 2024-09-11T22:26:40.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:40.970+0000 7f2766882640 1 -- 172.21.15.100:0/23023802 wait complete. 2024-09-11T22:26:40.985 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:26:40.985 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:26:40.985 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:26:41.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.094+0000 7fa9147fd640 1 Processor -- start 2024-09-11T22:26:41.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.094+0000 7fa9147fd640 1 -- start start 2024-09-11T22:26:41.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.095+0000 7fa9147fd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa90c154d30 0x7fa90c15e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.095+0000 7fa9147fd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa90c0c8b10 0x7fa90c0caf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.095+0000 7fa9147fd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa90c06bc10 con 0x7fa90c0c9b40 2024-09-11T22:26:41.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.095+0000 7fa9147fd640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fa90c15ace0 con 0x7fa90c154d30 2024-09-11T22:26:41.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.095+0000 7fa9147fd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fa90c155110 con 0x7fa90c0c8b10 2024-09-11T22:26:41.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.095+0000 7fa912599640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa90c154d30 0x7fa90c15e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.095+0000 7fa912599640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa90c154d30 0x7fa90c15e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34452/0 (socket says 172.21.15.100:34452) 2024-09-11T22:26:41.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.095+0000 7fa912599640 1 -- 172.21.15.100:0/2828494197 learned_addr learned my addr 172.21.15.100:0/2828494197 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:41.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.095+0000 7fa912d9a640 1 --2- 172.21.15.100:0/2828494197 >> v2:172.21.15.167:3300/0 conn(0x7fa90c0c8b10 0x7fa90c0caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.095+0000 7fa912599640 1 -- 172.21.15.100:0/2828494197 >> v2:172.21.15.167:3300/0 conn(0x7fa90c0c8b10 msgr2=0x7fa90c0caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:26:41.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.095+0000 7fa912599640 1 --2- 172.21.15.100:0/2828494197 >> v2:172.21.15.167:3300/0 conn(0x7fa90c0c8b10 0x7fa90c0caf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.095+0000 7fa912599640 1 -- 172.21.15.100:0/2828494197 >> v1:172.21.15.167:6789/0 conn(0x7fa90c0c9b40 legacy=0x7fa90c15b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:41.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.095+0000 7fa912599640 1 -- 172.21.15.100:0/2828494197 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa90c0ca010 con 0x7fa90c154d30 2024-09-11T22:26:41.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.096+0000 7fa912599640 1 --2- 172.21.15.100:0/2828494197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa90c154d30 0x7fa90c15e990 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0cc000 tx=0x7fa90802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d53c797395c5328 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:41.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.096+0000 7fa911597640 1 -- 172.21.15.100:0/2828494197 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa908037070 con 0x7fa90c154d30 2024-09-11T22:26:41.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.096+0000 7fa911597640 1 -- 172.21.15.100:0/2828494197 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa908032440 con 0x7fa90c154d30 2024-09-11T22:26:41.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.096+0000 7fa911597640 1 -- 172.21.15.100:0/2828494197 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa908032810 con 0x7fa90c154d30 2024-09-11T22:26:41.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.097+0000 7fa9147fd640 1 -- 172.21.15.100:0/2828494197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa90c154d30 msgr2=0x7fa90c15e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:41.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.097+0000 7fa9147fd640 1 --2- 172.21.15.100:0/2828494197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa90c154d30 0x7fa90c15e990 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0cc000 tx=0x7fa90802a1e0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.097+0000 7fa9147fd640 1 -- 172.21.15.100:0/2828494197 shutdown_connections 2024-09-11T22:26:41.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.097+0000 7fa9147fd640 1 --2- 172.21.15.100:0/2828494197 >> v2:172.21.15.167:3300/0 conn(0x7fa90c0c8b10 0x7fa90c0caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.097+0000 7fa9147fd640 1 --2- 172.21.15.100:0/2828494197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa90c154d30 0x7fa90c15e990 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.097+0000 7fa9147fd640 1 -- 172.21.15.100:0/2828494197 >> 172.21.15.100:0/2828494197 conn(0x7fa90c06e000 msgr2=0x7fa90c06e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:41.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.097+0000 7fa9147fd640 1 -- 172.21.15.100:0/2828494197 shutdown_connections 2024-09-11T22:26:41.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.097+0000 7fa9147fd640 1 -- 172.21.15.100:0/2828494197 wait complete. 2024-09-11T22:26:41.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.098+0000 7fa9147fd640 1 Processor -- start 2024-09-11T22:26:41.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.099+0000 7fa9147fd640 1 -- start start 2024-09-11T22:26:41.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.099+0000 7fa9147fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa90c0c8b10 0x7fa90c0cd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.099+0000 7fa9147fd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa90c0c9b40 0x7fa90c14fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.099+0000 7fa9147fd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa90c154d30 0x7fa90c14ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.099+0000 7fa9147fd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa90c0ca5b0 con 0x7fa90c0c9b40 2024-09-11T22:26:41.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.099+0000 7fa9147fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa90c0ca2d0 con 0x7fa90c0c8b10 2024-09-11T22:26:41.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.099+0000 7fa9147fd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa90c0ca890 con 0x7fa90c154d30 2024-09-11T22:26:41.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.099+0000 7fa911d98640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa90c0c9b40 0x7fa90c14fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.099+0000 7fa911d98640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa90c0c9b40 0x7fa90c14fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34464/0 (socket says 172.21.15.100:34464) 2024-09-11T22:26:41.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.099+0000 7fa911d98640 1 -- 172.21.15.100:0/1635801716 learned_addr learned my addr 172.21.15.100:0/1635801716 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:41.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.099+0000 7fa912599640 1 --2- 172.21.15.100:0/1635801716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa90c0c8b10 0x7fa90c0cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.099+0000 7fa912d9a640 1 --2- 172.21.15.100:0/1635801716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa90c154d30 0x7fa90c14ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.100+0000 7fa911d98640 1 -- 172.21.15.100:0/1635801716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa90c154d30 msgr2=0x7fa90c14ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:41.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.100+0000 7fa911d98640 1 --2- 172.21.15.100:0/1635801716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa90c154d30 0x7fa90c14ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.100+0000 7fa911d98640 1 -- 172.21.15.100:0/1635801716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa90c0c8b10 msgr2=0x7fa90c0cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:41.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.100+0000 7fa911d98640 1 --2- 172.21.15.100:0/1635801716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa90c0c8b10 0x7fa90c0cd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.100+0000 7fa911d98640 1 -- 172.21.15.100:0/1635801716 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa90c0ce970 con 0x7fa90c0c9b40 2024-09-11T22:26:41.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.100+0000 7fa911d98640 1 --2- 172.21.15.100:0/1635801716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa90c0c9b40 0x7fa90c14fa00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00c400 tx=0x7fa8fc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:41.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.100+0000 7fa902ffd640 1 -- 172.21.15.100:0/1635801716 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0052d0 con 0x7fa90c0c9b40 2024-09-11T22:26:41.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.100+0000 7fa902ffd640 1 -- 172.21.15.100:0/1635801716 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8fc005490 con 0x7fa90c0c9b40 2024-09-11T22:26:41.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.100+0000 7fa902ffd640 1 -- 172.21.15.100:0/1635801716 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc007260 con 0x7fa90c0c9b40 2024-09-11T22:26:41.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.100+0000 7fa9147fd640 1 -- 172.21.15.100:0/1635801716 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa90c155a10 con 0x7fa90c0c9b40 2024-09-11T22:26:41.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.100+0000 7fa9147fd640 1 -- 172.21.15.100:0/1635801716 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa90c157d60 con 0x7fa90c0c9b40 2024-09-11T22:26:41.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.101+0000 7fa9147fd640 1 --2- 172.21.15.100:0/1635801716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa90c0cdb50 0x7fa90c157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.101+0000 7fa9147fd640 1 -- 172.21.15.100:0/1635801716 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa90c150980 con 0x7fa90c0cdb50 2024-09-11T22:26:41.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.101+0000 7fa912599640 1 --2- 172.21.15.100:0/1635801716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa90c0cdb50 0x7fa90c157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.102+0000 7fa902ffd640 1 -- 172.21.15.100:0/1635801716 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa8fc007400 con 0x7fa90c0c9b40 2024-09-11T22:26:41.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.102+0000 7fa912599640 1 -- 172.21.15.100:0/1635801716 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa90c157b10 con 0x7fa90c0cdb50 2024-09-11T22:26:41.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.102+0000 7fa912599640 1 --2- 172.21.15.100:0/1635801716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa90c0cdb50 0x7fa90c157f30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa90c06d590 tx=0x7fa9080046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:41.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.102+0000 7fa902ffd640 1 --2- 172.21.15.100:0/1635801716 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa8f006be30 0x7fa8f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.102+0000 7fa902ffd640 1 -- 172.21.15.100:0/1635801716 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fa8fc08a710 con 0x7fa90c0c9b40 2024-09-11T22:26:41.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.102+0000 7fa912d9a640 1 --2- 172.21.15.100:0/1635801716 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa8f006be30 0x7fa8f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.102+0000 7fa902ffd640 1 -- 172.21.15.100:0/1635801716 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa908043070 con 0x7fa90c0cdb50 2024-09-11T22:26:41.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.103+0000 7fa902ffd640 1 -- 172.21.15.100:0/1635801716 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa908032e40 con 0x7fa90c0cdb50 2024-09-11T22:26:41.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.103+0000 7fa902ffd640 1 -- 172.21.15.100:0/1635801716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa90c0cdb50 msgr2=0x7fa90c157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:41.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.103+0000 7fa902ffd640 1 --2- 172.21.15.100:0/1635801716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa90c0cdb50 0x7fa90c157f30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa90c06d590 tx=0x7fa9080046c0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.103+0000 7fa902ffd640 1 -- 172.21.15.100:0/1635801716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa90c0cdb50 msgr2=0x7fa90c157f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:26:41.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.103+0000 7fa902ffd640 1 --2- 172.21.15.100:0/1635801716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa90c0cdb50 0x7fa90c157f30 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa90c06d590 tx=0x7fa9080046c0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.103+0000 7fa912d9a640 1 --2- 172.21.15.100:0/1635801716 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa8f006be30 0x7fa8f006e2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa904003aa0 tx=0x7fa904009780 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:41.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.109+0000 7fa9147fd640 1 --2- 172.21.15.100:0/1635801716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa90c0ae850 0x7fa90c1f42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.109+0000 7fa9147fd640 1 -- 172.21.15.100:0/1635801716 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa90c150480 con 0x7fa90c0ae850 2024-09-11T22:26:41.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.110+0000 7fa912599640 1 --2- 172.21.15.100:0/1635801716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa90c0ae850 0x7fa90c1f42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.110+0000 7fa912599640 1 -- 172.21.15.100:0/1635801716 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa90c15e990 con 0x7fa90c0ae850 2024-09-11T22:26:41.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.110+0000 7fa912599640 1 --2- 172.21.15.100:0/1635801716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa90c0ae850 0x7fa90c1f42c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa90802a220 tx=0x7fa908008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:41.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.110+0000 7fa902ffd640 1 -- 172.21.15.100:0/1635801716 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa908054020 con 0x7fa90c0ae850 2024-09-11T22:26:41.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.110+0000 7fa902ffd640 1 -- 172.21.15.100:0/1635801716 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4887 (secure 0 0 0) 0x7fa908003820 con 0x7fa90c0ae850 2024-09-11T22:26:41.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.110+0000 7fa902ffd640 1 -- 172.21.15.100:0/1635801716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa90c0ae850 msgr2=0x7fa90c1f42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:41.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.110+0000 7fa902ffd640 1 --2- 172.21.15.100:0/1635801716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa90c0ae850 0x7fa90c1f42c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa90802a220 tx=0x7fa908008030 comp rx=0 tx=0).stop 2024-09-11T22:26:41.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.111+0000 7fa902ffd640 1 -- 172.21.15.100:0/1635801716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa90c0ae850 msgr2=0x7fa90c1f42c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:26:41.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.111+0000 7fa902ffd640 1 --2- 172.21.15.100:0/1635801716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa90c0ae850 0x7fa90c1f42c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.112 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:26:41.112 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:26:41.112 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:26:41.112 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 48, 2024-09-11T22:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 186388, 2024-09-11T22:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:41.113 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:41.114 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:26:41.115 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:41.116 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:41.117 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:41.117 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:41.117 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:41.117 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:41.117 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:41.117 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:41.117 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:41.117 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:41.117 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:41.117 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:41.117 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:26:41.117 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.117 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:26:41.117 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.118 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:26:41.118 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:26:41.118 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:41.118 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:41.118 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.118 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:41.118 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:26:41.118 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:41.118 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.118 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.118 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:41.118 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:26:41.118 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:41.118 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:41.118 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:41.119 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.119 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:26:41.119 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:26:41.119 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:41.119 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:41.119 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:41.119 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.119 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.119 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:26:41.119 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:26:41.119 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:41.119 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:41.119 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.119 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:41.120 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:26:41.120 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:41.120 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.120 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.120 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:41.120 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:26:41.120 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:41.120 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:41.120 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:41.120 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.120 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:26:41.120 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:26:41.120 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:41.120 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:41.121 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:41.121 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.121 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.121 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:26:41.121 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:26:41.121 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:41.121 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:41.121 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.121 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:41.121 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:26:41.121 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:41.121 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.121 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.121 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:41.122 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:26:41.122 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:41.122 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:41.122 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:41.122 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.122 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:26:41.122 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:26:41.122 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:41.122 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:41.122 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:41.122 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:41.122 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:41.122 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.122 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:26:41.122 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:26:41.123 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.123 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:41.123 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:41.123 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:26:41.123 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:41.123 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:41.123 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:26:41.123 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.123 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:41.123 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:41.123 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:26:41.123 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:41.123 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:41.123 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:26:41.123 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.124 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:41.124 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:41.124 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:26:41.124 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:41.124 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:41.124 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:26:41.124 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.124 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:41.124 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:41.124 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:26:41.124 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:41.124 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:41.124 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.125 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:26:41.125 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:26:41.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.111+0000 7fa9147fd640 1 -- 172.21.15.100:0/1635801716 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa8f006be30 msgr2=0x7fa8f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:41.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.111+0000 7fa9147fd640 1 --2- 172.21.15.100:0/1635801716 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa8f006be30 0x7fa8f006e2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa904003aa0 tx=0x7fa904009780 comp rx=0 tx=0).stop 2024-09-11T22:26:41.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.111+0000 7fa9147fd640 1 -- 172.21.15.100:0/1635801716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa90c0c9b40 msgr2=0x7fa90c14fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:41.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.111+0000 7fa9147fd640 1 --2- 172.21.15.100:0/1635801716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa90c0c9b40 0x7fa90c14fa00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00c400 tx=0x7fa8fc00c8c0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.111+0000 7fa912d9a640 1 -- 172.21.15.100:0/1635801716 reap_dead start 2024-09-11T22:26:41.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.111+0000 7fa912d9a640 1 -- 172.21.15.100:0/1635801716 reap_dead start 2024-09-11T22:26:41.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.111+0000 7fa9147fd640 1 -- 172.21.15.100:0/1635801716 shutdown_connections 2024-09-11T22:26:41.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.111+0000 7fa9147fd640 1 -- 172.21.15.100:0/1635801716 >> 172.21.15.100:0/1635801716 conn(0x7fa90c06e000 msgr2=0x7fa90c154060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:41.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.111+0000 7fa9147fd640 1 -- 172.21.15.100:0/1635801716 shutdown_connections 2024-09-11T22:26:41.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.111+0000 7fa9147fd640 1 -- 172.21.15.100:0/1635801716 wait complete. 2024-09-11T22:26:41.127 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:26:41.127 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:26:41.127 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:26:41.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.242+0000 7f1711230640 1 Processor -- start 2024-09-11T22:26:41.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.242+0000 7f1711230640 1 -- start start 2024-09-11T22:26:41.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.243+0000 7f1711230640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f170c0c3230 0x7f170c0c9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.243+0000 7f1711230640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f170c0c9da0 0x7f170c15ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.243+0000 7f1711230640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f170c0ca5c0 con 0x7f170c154d70 2024-09-11T22:26:41.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.243+0000 7f1711230640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f170c0c43b0 con 0x7f170c0c3230 2024-09-11T22:26:41.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.243+0000 7f1711230640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f170c0ae930 con 0x7f170c0c9da0 2024-09-11T22:26:41.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.243+0000 7f170a59c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f170c0c3230 0x7f170c0c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.243+0000 7f170a59c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f170c0c3230 0x7f170c0c9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34472/0 (socket says 172.21.15.100:34472) 2024-09-11T22:26:41.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.243+0000 7f170a59c640 1 -- 172.21.15.100:0/2596453945 learned_addr learned my addr 172.21.15.100:0/2596453945 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:41.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.243+0000 7f170b59e640 1 --2- 172.21.15.100:0/2596453945 >> v2:172.21.15.167:3300/0 conn(0x7f170c0c9da0 0x7f170c15ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.243+0000 7f170a59c640 1 -- 172.21.15.100:0/2596453945 >> v2:172.21.15.167:3300/0 conn(0x7f170c0c9da0 msgr2=0x7f170c15ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:26:41.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.243+0000 7f170a59c640 1 --2- 172.21.15.100:0/2596453945 >> v2:172.21.15.167:3300/0 conn(0x7f170c0c9da0 0x7f170c15ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.243+0000 7f170a59c640 1 -- 172.21.15.100:0/2596453945 >> v1:172.21.15.100:6789/0 conn(0x7f170c154d70 legacy=0x7f170c0714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:41.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.244+0000 7f1709d9b640 1 -- 172.21.15.100:0/2596453945 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3996897029 0 0) 0x7f170c0ca5c0 con 0x7f170c154d70 2024-09-11T22:26:41.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.244+0000 7f170a59c640 1 -- 172.21.15.100:0/2596453945 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f170c0c3830 con 0x7f170c0c3230 2024-09-11T22:26:41.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.244+0000 7f170a59c640 1 --2- 172.21.15.100:0/2596453945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f170c0c3230 0x7f170c0c9860 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f170c0af550 tx=0x7f170002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c030d8aa8d06991 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:41.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.244+0000 7f1709d9b640 1 -- 172.21.15.100:0/2596453945 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1700037070 con 0x7f170c0c3230 2024-09-11T22:26:41.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.245+0000 7f1709d9b640 1 -- 172.21.15.100:0/2596453945 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f170002ae50 con 0x7f170c0c3230 2024-09-11T22:26:41.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.245+0000 7f1709d9b640 1 -- 172.21.15.100:0/2596453945 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1700032860 con 0x7f170c0c3230 2024-09-11T22:26:41.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.245+0000 7f1711230640 1 -- 172.21.15.100:0/2596453945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f170c0c3230 msgr2=0x7f170c0c9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:41.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.245+0000 7f1711230640 1 --2- 172.21.15.100:0/2596453945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f170c0c3230 0x7f170c0c9860 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f170c0af550 tx=0x7f170002a300 comp rx=0 tx=0).stop 2024-09-11T22:26:41.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.245+0000 7f1711230640 1 -- 172.21.15.100:0/2596453945 shutdown_connections 2024-09-11T22:26:41.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.245+0000 7f1711230640 1 --2- 172.21.15.100:0/2596453945 >> v2:172.21.15.167:3300/0 conn(0x7f170c0c9da0 0x7f170c15ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.245+0000 7f1711230640 1 --2- 172.21.15.100:0/2596453945 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f170c0c3230 0x7f170c0c9860 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.245+0000 7f1711230640 1 -- 172.21.15.100:0/2596453945 >> 172.21.15.100:0/2596453945 conn(0x7f170c06f4c0 msgr2=0x7f170c06f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:41.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.245+0000 7f1711230640 1 -- 172.21.15.100:0/2596453945 shutdown_connections 2024-09-11T22:26:41.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.245+0000 7f1711230640 1 -- 172.21.15.100:0/2596453945 wait complete. 2024-09-11T22:26:41.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.247+0000 7f1711230640 1 Processor -- start 2024-09-11T22:26:41.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.247+0000 7f1711230640 1 -- start start 2024-09-11T22:26:41.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.247+0000 7f1711230640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f170c0c3230 0x7f170c1e2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.247+0000 7f1711230640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c0c9da0 0x7f170c159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.247+0000 7f1711230640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f170c154d70 0x7f170c1e4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.248+0000 7f1711230640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f170c0c40d0 con 0x7f170c154d70 2024-09-11T22:26:41.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.248+0000 7f1711230640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f170c0c3df0 con 0x7f170c0c9da0 2024-09-11T22:26:41.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.248+0000 7f1711230640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f170c071bd0 con 0x7f170c0c3230 2024-09-11T22:26:41.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.248+0000 7f170b59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f170c154d70 0x7f170c1e4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.248+0000 7f170b59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f170c154d70 0x7f170c1e4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34488/0 (socket says 172.21.15.100:34488) 2024-09-11T22:26:41.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.248+0000 7f170b59e640 1 -- 172.21.15.100:0/2453839703 learned_addr learned my addr 172.21.15.100:0/2453839703 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:41.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.248+0000 7f170a59c640 1 --2- 172.21.15.100:0/2453839703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c0c9da0 0x7f170c159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.248+0000 7f170ad9d640 1 --2- 172.21.15.100:0/2453839703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f170c0c3230 0x7f170c1e2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.248+0000 7f170b59e640 1 -- 172.21.15.100:0/2453839703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f170c0c3230 msgr2=0x7f170c1e2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:41.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.248+0000 7f170b59e640 1 --2- 172.21.15.100:0/2453839703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f170c0c3230 0x7f170c1e2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.248+0000 7f170b59e640 1 -- 172.21.15.100:0/2453839703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c0c9da0 msgr2=0x7f170c159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:41.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.248+0000 7f170b59e640 1 --2- 172.21.15.100:0/2453839703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f170c0c9da0 0x7f170c159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.248+0000 7f170b59e640 1 -- 172.21.15.100:0/2453839703 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f170c1e5fe0 con 0x7f170c154d70 2024-09-11T22:26:41.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.248+0000 7f170b59e640 1 --2- 172.21.15.100:0/2453839703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f170c154d70 0x7f170c1e4a40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1704007e70 tx=0x7f170400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:41.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.248+0000 7f16f37fe640 1 -- 172.21.15.100:0/2453839703 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704014620 con 0x7f170c154d70 2024-09-11T22:26:41.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.248+0000 7f16f37fe640 1 -- 172.21.15.100:0/2453839703 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1704019070 con 0x7f170c154d70 2024-09-11T22:26:41.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.248+0000 7f1711230640 1 -- 172.21.15.100:0/2453839703 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f170c1e5a20 con 0x7f170c154d70 2024-09-11T22:26:41.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.248+0000 7f16f37fe640 1 -- 172.21.15.100:0/2453839703 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704014a20 con 0x7f170c154d70 2024-09-11T22:26:41.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.248+0000 7f1711230640 1 -- 172.21.15.100:0/2453839703 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f170c1e4240 con 0x7f170c154d70 2024-09-11T22:26:41.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.249+0000 7f1711230640 1 --2- 172.21.15.100:0/2453839703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f170c1e4480 0x7f170c1e4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.249+0000 7f1711230640 1 -- 172.21.15.100:0/2453839703 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f170c0c9860 con 0x7f170c1e4480 2024-09-11T22:26:41.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.250+0000 7f170ad9d640 1 --2- 172.21.15.100:0/2453839703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f170c1e4480 0x7f170c1e4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.250+0000 7f170ad9d640 1 -- 172.21.15.100:0/2453839703 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f170c0ca3a0 con 0x7f170c1e4480 2024-09-11T22:26:41.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.250+0000 7f170ad9d640 1 --2- 172.21.15.100:0/2453839703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f170c1e4480 0x7f170c1e4f80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f16fc000f60 tx=0x7f16fc00e8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:41.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.250+0000 7f16f37fe640 1 -- 172.21.15.100:0/2453839703 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc0052e0 con 0x7f170c1e4480 2024-09-11T22:26:41.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.250+0000 7f16f37fe640 1 -- 172.21.15.100:0/2453839703 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1704014bc0 con 0x7f170c154d70 2024-09-11T22:26:41.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.251+0000 7f16f37fe640 1 --2- 172.21.15.100:0/2453839703 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f16f806bd30 0x7f16f806e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.251+0000 7f16f37fe640 1 -- 172.21.15.100:0/2453839703 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f170408bab0 con 0x7f170c154d70 2024-09-11T22:26:41.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.251+0000 7f170a59c640 1 --2- 172.21.15.100:0/2453839703 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f16f806bd30 0x7f16f806e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.251+0000 7f16f37fe640 1 -- 172.21.15.100:0/2453839703 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f16fc018070 con 0x7f170c1e4480 2024-09-11T22:26:41.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.251+0000 7f16f37fe640 1 -- 172.21.15.100:0/2453839703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f170c1e4480 msgr2=0x7f170c1e4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:41.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.251+0000 7f16f37fe640 1 --2- 172.21.15.100:0/2453839703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f170c1e4480 0x7f170c1e4f80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f16fc000f60 tx=0x7f16fc00e8b0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.251+0000 7f16f37fe640 1 -- 172.21.15.100:0/2453839703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f170c1e4480 msgr2=0x7f170c1e4f80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:26:41.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.251+0000 7f16f37fe640 1 --2- 172.21.15.100:0/2453839703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f170c1e4480 0x7f170c1e4f80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.251+0000 7f170a59c640 1 --2- 172.21.15.100:0/2453839703 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f16f806bd30 0x7f16f806e1f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1700034000 tx=0x7f170002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:41.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.260+0000 7f1711230640 1 --2- 172.21.15.100:0/2453839703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f170c1f0b00 0x7f170c1f35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.260+0000 7f1711230640 1 -- 172.21.15.100:0/2453839703 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f170c0cb730 con 0x7f170c1f0b00 2024-09-11T22:26:41.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.260+0000 7f170ad9d640 1 --2- 172.21.15.100:0/2453839703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f170c1f0b00 0x7f170c1f35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.261+0000 7f170ad9d640 1 -- 172.21.15.100:0/2453839703 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f170c1e32b0 con 0x7f170c1f0b00 2024-09-11T22:26:41.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.261+0000 7f170ad9d640 1 --2- 172.21.15.100:0/2453839703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f170c1f0b00 0x7f170c1f35f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f16fc000f60 tx=0x7f16fc001080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:41.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.261+0000 7f16f37fe640 1 -- 172.21.15.100:0/2453839703 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16fc003b90 con 0x7f170c1f0b00 2024-09-11T22:26:41.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.262+0000 7f16f37fe640 1 -- 172.21.15.100:0/2453839703 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7f16fc003b90 con 0x7f170c1f0b00 2024-09-11T22:26:41.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.262+0000 7f16f37fe640 1 -- 172.21.15.100:0/2453839703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f170c1f0b00 msgr2=0x7f170c1f35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:41.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.262+0000 7f16f37fe640 1 --2- 172.21.15.100:0/2453839703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f170c1f0b00 0x7f170c1f35f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f16fc000f60 tx=0x7f16fc001080 comp rx=0 tx=0).stop 2024-09-11T22:26:41.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.262+0000 7f16f37fe640 1 -- 172.21.15.100:0/2453839703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f170c1f0b00 msgr2=0x7f170c1f35f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:26:41.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.262+0000 7f16f37fe640 1 --2- 172.21.15.100:0/2453839703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f170c1f0b00 0x7f170c1f35f0 secure :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f16fc000f60 tx=0x7f16fc001080 comp rx=0 tx=0).stop 2024-09-11T22:26:41.263 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:26:41.263 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:26:41.263 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:26:41.263 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:26:41.263 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 48, 2024-09-11T22:26:41.264 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 291982, 2024-09-11T22:26:41.264 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:26:41.264 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:26:41.264 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:26:41.264 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:26:41.264 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:41.264 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:26:41.264 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:26:41.264 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:26:41.264 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:26:41.264 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:41.264 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:41.264 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:41.265 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:41.265 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:41.265 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:41.265 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:41.265 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:41.265 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:41.265 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:41.265 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:41.265 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:41.266 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:26:41.266 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:26:41.266 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:41.266 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:41.266 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:41.266 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:41.266 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:41.266 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:41.266 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:41.266 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:41.266 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:41.266 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:41.266 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:41.266 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:41.267 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.267 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:26:41.267 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:26:41.267 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:26:41.267 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:26:41.267 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:26:41.267 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:26:41.267 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:26:41.267 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:26:41.267 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:26:41.267 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:26:41.267 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:26:41.267 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:26:41.268 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:26:41.268 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:26:41.268 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:26:41.268 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:26:41.268 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:26:41.268 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:41.268 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:41.268 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:41.268 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:41.268 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:41.268 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:41.268 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:41.268 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:41.269 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:41.269 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:41.269 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:41.269 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:41.269 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:26:41.269 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.269 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:26:41.269 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.269 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:26:41.269 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:26:41.269 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:41.269 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:41.269 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.269 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:41.270 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:26:41.270 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:41.270 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.270 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.270 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:41.270 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:26:41.270 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:41.270 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:41.270 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:41.270 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.270 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:26:41.270 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:26:41.270 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:41.270 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:41.271 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:41.271 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.271 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.271 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:26:41.271 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:26:41.271 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:41.271 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:41.271 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.271 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:41.271 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:26:41.271 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:41.271 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.271 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.271 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:41.272 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:26:41.272 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:41.272 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:41.272 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:41.272 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.272 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:26:41.272 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:26:41.272 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:41.272 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:41.272 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:41.272 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.272 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.272 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:26:41.273 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:26:41.273 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:41.273 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:41.273 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.273 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:41.273 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:26:41.273 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:41.273 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.273 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.273 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:41.273 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:26:41.273 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:41.273 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:41.273 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:41.274 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.274 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:26:41.274 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:26:41.274 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:41.274 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:41.274 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:41.274 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:41.274 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:41.274 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.274 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:26:41.274 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:26:41.274 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.274 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:41.274 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:41.275 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:26:41.275 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:41.275 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:41.275 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:26:41.275 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.275 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:41.275 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:41.275 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:26:41.275 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:41.275 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:41.275 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:26:41.275 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.275 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:41.275 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:41.276 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:26:41.276 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:41.276 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:41.276 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:26:41.276 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.276 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:41.276 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:41.276 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:26:41.276 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:41.276 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:41.276 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:26:41.276 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:41.276 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:41.277 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:41.277 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:26:41.277 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:41.277 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:41.277 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:41.277 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:26:41.277 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:26:41.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.262+0000 7f1711230640 1 -- 172.21.15.100:0/2453839703 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f16f806bd30 msgr2=0x7f16f806e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:41.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.262+0000 7f1711230640 1 --2- 172.21.15.100:0/2453839703 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f16f806bd30 0x7f16f806e1f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1700034000 tx=0x7f170002e000 comp rx=0 tx=0).stop 2024-09-11T22:26:41.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.262+0000 7f170b59e640 1 -- 172.21.15.100:0/2453839703 reap_dead start 2024-09-11T22:26:41.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.263+0000 7f1711230640 1 -- 172.21.15.100:0/2453839703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f170c154d70 msgr2=0x7f170c1e4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:41.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.263+0000 7f1711230640 1 --2- 172.21.15.100:0/2453839703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f170c154d70 0x7f170c1e4a40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1704007e70 tx=0x7f170400e4b0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.263+0000 7f1711230640 1 -- 172.21.15.100:0/2453839703 shutdown_connections 2024-09-11T22:26:41.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.263+0000 7f1711230640 1 --2- 172.21.15.100:0/2453839703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f170c154d70 0x7f170c1e4a40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.263+0000 7f1711230640 1 -- 172.21.15.100:0/2453839703 >> 172.21.15.100:0/2453839703 conn(0x7f170c06f4c0 msgr2=0x7f170c152d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:41.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.263+0000 7f1711230640 1 -- 172.21.15.100:0/2453839703 shutdown_connections 2024-09-11T22:26:41.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.263+0000 7f1711230640 1 -- 172.21.15.100:0/2453839703 wait complete. 2024-09-11T22:26:41.280 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:26:41.280 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-11T22:26:41.280 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-11T22:26:41.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.396+0000 7f40f1627640 1 Processor -- start 2024-09-11T22:26:41.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.396+0000 7f40f1627640 1 -- start start 2024-09-11T22:26:41.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.397+0000 7f40f1627640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f40ec152700 0x7f40ec06ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.397+0000 7f40f1627640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40ec15bb70 con 0x7f40ec0c7040 2024-09-11T22:26:41.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.397+0000 7f40f1627640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40ec0c8aa0 con 0x7f40ec0caea0 2024-09-11T22:26:41.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.397+0000 7f40f1627640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f40ec070500 con 0x7f40ec152700 2024-09-11T22:26:41.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.397+0000 7f40eb7fe640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f40ec0c7040 0x7f40ec0c5d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40598/0 (socket says 172.21.15.100:40598) 2024-09-11T22:26:41.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.397+0000 7f40eb7fe640 1 -- 172.21.15.100:0/3391180306 learned_addr learned my addr 172.21.15.100:0/3391180306 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:26:41.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.397+0000 7f40eaffd640 1 --2- 172.21.15.100:0/3391180306 >> v2:172.21.15.167:3300/0 conn(0x7f40ec152700 0x7f40ec06ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.397+0000 7f40ea7fc640 1 -- 172.21.15.100:0/3391180306 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 667989458 0 0) 0x7f40ec15bb70 con 0x7f40ec0c7040 2024-09-11T22:26:41.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.397+0000 7f40ea7fc640 1 -- 172.21.15.100:0/3391180306 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40d8003520 con 0x7f40ec0c7040 2024-09-11T22:26:41.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.397+0000 7f40ea7fc640 1 -- 172.21.15.100:0/3391180306 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1467610656 0 0) 0x7f40d8003520 con 0x7f40ec0c7040 2024-09-11T22:26:41.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.397+0000 7f40ea7fc640 1 -- 172.21.15.100:0/3391180306 >> v2:172.21.15.167:3300/0 conn(0x7f40ec152700 msgr2=0x7f40ec06ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:26:41.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.397+0000 7f40ea7fc640 1 --2- 172.21.15.100:0/3391180306 >> v2:172.21.15.167:3300/0 conn(0x7f40ec152700 0x7f40ec06ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.397+0000 7f40ea7fc640 1 -- 172.21.15.100:0/3391180306 >> v1:172.21.15.167:6789/0 conn(0x7f40ec0caea0 legacy=0x7f40ec158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:41.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.397+0000 7f40ea7fc640 1 -- 172.21.15.100:0/3391180306 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40ec0c8d80 con 0x7f40ec0c7040 2024-09-11T22:26:41.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.397+0000 7f40ea7fc640 1 -- 172.21.15.100:0/3391180306 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f40e40019f0 con 0x7f40ec0c7040 2024-09-11T22:26:41.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.397+0000 7f40ea7fc640 1 -- 172.21.15.100:0/3391180306 >> v1:172.21.15.100:6789/0 conn(0x7f40ec0c7040 legacy=0x7f40ec0c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:41.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.397+0000 7f40ea7fc640 1 --2- 172.21.15.100:0/3391180306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40d80039b0 0x7f40d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.397+0000 7f40ea7fc640 1 --2- 172.21.15.100:0/3391180306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40d8004800 0x7f40d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.397+0000 7f40ea7fc640 1 --2- 172.21.15.100:0/3391180306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d80051c0 0x7f40d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.397+0000 7f40ea7fc640 1 -- 172.21.15.100:0/3391180306 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec070500 con 0x7f40d8004800 2024-09-11T22:26:41.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.397+0000 7f40ea7fc640 1 -- 172.21.15.100:0/3391180306 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f40d800c070 con 0x7f40d80051c0 2024-09-11T22:26:41.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.397+0000 7f40ea7fc640 1 -- 172.21.15.100:0/3391180306 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f40d800c270 con 0x7f40d80039b0 2024-09-11T22:26:41.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.398+0000 7f40e3fff640 1 --2- 172.21.15.100:0/3391180306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40d8004800 0x7f40d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.398+0000 7f40eb7fe640 1 --2- 172.21.15.100:0/3391180306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d80051c0 0x7f40d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.398+0000 7f40eaffd640 1 --2- 172.21.15.100:0/3391180306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40d80039b0 0x7f40d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.398+0000 7f40e3fff640 1 -- 172.21.15.100:0/3391180306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40d80039b0 msgr2=0x7f40d8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:26:41.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.398+0000 7f40e3fff640 1 --2- 172.21.15.100:0/3391180306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40d80039b0 0x7f40d8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.398+0000 7f40e3fff640 1 -- 172.21.15.100:0/3391180306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d80051c0 msgr2=0x7f40d800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:26:41.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.398+0000 7f40e3fff640 1 --2- 172.21.15.100:0/3391180306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d80051c0 0x7f40d800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.398+0000 7f40e3fff640 1 -- 172.21.15.100:0/3391180306 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d8003520 con 0x7f40d8004800 2024-09-11T22:26:41.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.398+0000 7f40eb7fe640 1 -- 172.21.15.100:0/3391180306 reap_dead start 2024-09-11T22:26:41.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.399+0000 7f40e3fff640 1 --2- 172.21.15.100:0/3391180306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40d8004800 0x7f40d8004c80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f40d4001750 tx=0x7f40d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454c476d109aba30 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:41.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.399+0000 7f40ea7fc640 1 -- 172.21.15.100:0/3391180306 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d4001370 con 0x7f40d8004800 2024-09-11T22:26:41.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.399+0000 7f40ea7fc640 1 -- 172.21.15.100:0/3391180306 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d40052d0 con 0x7f40d8004800 2024-09-11T22:26:41.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.399+0000 7f40ea7fc640 1 -- 172.21.15.100:0/3391180306 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d402abc0 con 0x7f40d8004800 2024-09-11T22:26:41.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.399+0000 7f40f1627640 1 -- 172.21.15.100:0/3391180306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40d8004800 msgr2=0x7f40d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:41.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.399+0000 7f40f1627640 1 --2- 172.21.15.100:0/3391180306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40d8004800 0x7f40d8004c80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f40d4001750 tx=0x7f40d8005830 comp rx=0 tx=0).stop 2024-09-11T22:26:41.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.399+0000 7f40f1627640 1 -- 172.21.15.100:0/3391180306 shutdown_connections 2024-09-11T22:26:41.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.399+0000 7f40f1627640 1 --2- 172.21.15.100:0/3391180306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40d8004800 0x7f40d8004c80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.399+0000 7f40f1627640 1 -- 172.21.15.100:0/3391180306 >> 172.21.15.100:0/3391180306 conn(0x7f40ec06bc10 msgr2=0x7f40ec06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:41.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.399+0000 7f40f1627640 1 -- 172.21.15.100:0/3391180306 shutdown_connections 2024-09-11T22:26:41.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.399+0000 7f40f1627640 1 -- 172.21.15.100:0/3391180306 wait complete. 2024-09-11T22:26:41.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.401+0000 7f40f1627640 1 Processor -- start 2024-09-11T22:26:41.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.401+0000 7f40f1627640 1 -- start start 2024-09-11T22:26:41.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.402+0000 7f40f1627640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40d8004800 0x7f40ec0c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.402+0000 7f40f1627640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40ec15a860 0x7f40ec0c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.402+0000 7f40f1627640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40ec1f40e0 0x7f40ec1f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.402+0000 7f40f1627640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec15c3d0 con 0x7f40d8004800 2024-09-11T22:26:41.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.402+0000 7f40f1627640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec15c0f0 con 0x7f40ec1f40e0 2024-09-11T22:26:41.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.402+0000 7f40f1627640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f40ec152ae0 con 0x7f40ec15a860 2024-09-11T22:26:41.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.402+0000 7f40eaffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40d8004800 0x7f40ec0c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.402+0000 7f40eaffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40d8004800 0x7f40ec0c56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34504/0 (socket says 172.21.15.100:34504) 2024-09-11T22:26:41.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.402+0000 7f40eaffd640 1 -- 172.21.15.100:0/276252716 learned_addr learned my addr 172.21.15.100:0/276252716 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:41.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.402+0000 7f40e3fff640 1 --2- 172.21.15.100:0/276252716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40ec15a860 0x7f40ec0c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.402+0000 7f40eb7fe640 1 --2- 172.21.15.100:0/276252716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40ec1f40e0 0x7f40ec1f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.402+0000 7f40eaffd640 1 -- 172.21.15.100:0/276252716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40ec15a860 msgr2=0x7f40ec0c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:41.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.402+0000 7f40eaffd640 1 --2- 172.21.15.100:0/276252716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40ec15a860 0x7f40ec0c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.402+0000 7f40eaffd640 1 -- 172.21.15.100:0/276252716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40ec1f40e0 msgr2=0x7f40ec1f4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:41.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.402+0000 7f40eaffd640 1 --2- 172.21.15.100:0/276252716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40ec1f40e0 0x7f40ec1f4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.402+0000 7f40eaffd640 1 -- 172.21.15.100:0/276252716 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40ec1f4aa0 con 0x7f40d8004800 2024-09-11T22:26:41.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.402+0000 7f40e3fff640 1 --2- 172.21.15.100:0/276252716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40ec15a860 0x7f40ec0c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:26:41.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.402+0000 7f40eb7fe640 1 --2- 172.21.15.100:0/276252716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40ec1f40e0 0x7f40ec1f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:26:41.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.402+0000 7f40eaffd640 1 --2- 172.21.15.100:0/276252716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40d8004800 0x7f40ec0c56d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f40dc011990 tx=0x7f40dc011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:41.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.402+0000 7f40e37fe640 1 -- 172.21.15.100:0/276252716 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc00fad0 con 0x7f40d8004800 2024-09-11T22:26:41.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.402+0000 7f40e37fe640 1 -- 172.21.15.100:0/276252716 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40dc00fc70 con 0x7f40d8004800 2024-09-11T22:26:41.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.403+0000 7f40f1627640 1 -- 172.21.15.100:0/276252716 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40ec1487c0 con 0x7f40d8004800 2024-09-11T22:26:41.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.403+0000 7f40e37fe640 1 -- 172.21.15.100:0/276252716 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc014440 con 0x7f40d8004800 2024-09-11T22:26:41.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.403+0000 7f40f1627640 1 -- 172.21.15.100:0/276252716 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40ec148d80 con 0x7f40d8004800 2024-09-11T22:26:41.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.404+0000 7f40f1627640 1 -- 172.21.15.100:0/276252716 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40ec15c8f0 con 0x7f40d8004800 2024-09-11T22:26:41.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.404+0000 7f40e37fe640 1 -- 172.21.15.100:0/276252716 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f40dc012040 con 0x7f40d8004800 2024-09-11T22:26:41.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.405+0000 7f40e37fe640 1 --2- 172.21.15.100:0/276252716 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f40cc06be30 0x7f40cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:41.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.405+0000 7f40e37fe640 1 -- 172.21.15.100:0/276252716 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f40dc08b940 con 0x7f40d8004800 2024-09-11T22:26:41.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.405+0000 7f40e3fff640 1 --2- 172.21.15.100:0/276252716 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f40cc06be30 0x7f40cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:41.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.406+0000 7f40e3fff640 1 --2- 172.21.15.100:0/276252716 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f40cc06be30 0x7f40cc06e2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f40d4032000 tx=0x7f40d402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:41.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.411+0000 7f40e37fe640 1 -- 172.21.15.100:0/276252716 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f40ec1f4aa0 con 0x7f40d8004800 2024-09-11T22:26:41.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.662+0000 7f40f1627640 1 -- 172.21.15.100:0/276252716 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f40ec0cd2c0 con 0x7f40d8004800 2024-09-11T22:26:41.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.663+0000 7f40e37fe640 1 -- 172.21.15.100:0/276252716 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f40dc019030 con 0x7f40d8004800 2024-09-11T22:26:41.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.666+0000 7f40f1627640 1 -- 172.21.15.100:0/276252716 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f40cc06be30 msgr2=0x7f40cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:41.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.666+0000 7f40f1627640 1 --2- 172.21.15.100:0/276252716 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f40cc06be30 0x7f40cc06e2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f40d4032000 tx=0x7f40d402e000 comp rx=0 tx=0).stop 2024-09-11T22:26:41.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.666+0000 7f40f1627640 1 -- 172.21.15.100:0/276252716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40d8004800 msgr2=0x7f40ec0c56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:41.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.666+0000 7f40f1627640 1 --2- 172.21.15.100:0/276252716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40d8004800 0x7f40ec0c56d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f40dc011990 tx=0x7f40dc011e50 comp rx=0 tx=0).stop 2024-09-11T22:26:41.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.666+0000 7f40f1627640 1 -- 172.21.15.100:0/276252716 shutdown_connections 2024-09-11T22:26:41.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.666+0000 7f40f1627640 1 --2- 172.21.15.100:0/276252716 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f40cc06be30 0x7f40cc06e2f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.666+0000 7f40f1627640 1 --2- 172.21.15.100:0/276252716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40ec1f40e0 0x7f40ec1f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.666+0000 7f40f1627640 1 --2- 172.21.15.100:0/276252716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40ec15a860 0x7f40ec0c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.666+0000 7f40f1627640 1 --2- 172.21.15.100:0/276252716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40d8004800 0x7f40ec0c56d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:41.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.666+0000 7f40f1627640 1 -- 172.21.15.100:0/276252716 >> 172.21.15.100:0/276252716 conn(0x7f40ec06bc10 msgr2=0x7f40ec1471a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:41.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.667+0000 7f40f1627640 1 -- 172.21.15.100:0/276252716 shutdown_connections 2024-09-11T22:26:41.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:41.667+0000 7f40f1627640 1 -- 172.21.15.100:0/276252716 wait complete. 2024-09-11T22:26:41.681 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-11T22:26:50.579 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:26:50.582 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:26:51.682 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:26:51.683 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:26:51.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.792+0000 7fd60525c640 1 Processor -- start 2024-09-11T22:26:51.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.792+0000 7fd60525c640 1 -- start start 2024-09-11T22:26:51.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.793+0000 7fd60525c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd6001527d0 0x7fd60006e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:51.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.793+0000 7fd60525c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd6000c8a70 0x7fd6000c9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:51.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.793+0000 7fd60525c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6000c5080 con 0x7fd6000c8250 2024-09-11T22:26:51.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.793+0000 7fd60525c640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fd6000ca3b0 con 0x7fd6001527d0 2024-09-11T22:26:51.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.793+0000 7fd60525c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fd6000ca690 con 0x7fd6000c8a70 2024-09-11T22:26:51.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.793+0000 7fd5fed9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd6001527d0 0x7fd60006e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:51.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.793+0000 7fd5fed9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd6001527d0 0x7fd60006e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52762/0 (socket says 172.21.15.100:52762) 2024-09-11T22:26:51.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.793+0000 7fd5fed9d640 1 -- 172.21.15.100:0/3338814141 learned_addr learned my addr 172.21.15.100:0/3338814141 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:51.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.793+0000 7fd5fe59c640 1 --2- 172.21.15.100:0/3338814141 >> v2:172.21.15.167:3300/0 conn(0x7fd6000c8a70 0x7fd6000c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:51.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.793+0000 7fd5fed9d640 1 -- 172.21.15.100:0/3338814141 >> v2:172.21.15.167:3300/0 conn(0x7fd6000c8a70 msgr2=0x7fd6000c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:26:51.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.793+0000 7fd5fed9d640 1 --2- 172.21.15.100:0/3338814141 >> v2:172.21.15.167:3300/0 conn(0x7fd6000c8a70 0x7fd6000c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:51.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.793+0000 7fd5fed9d640 1 -- 172.21.15.100:0/3338814141 >> v1:172.21.15.167:6789/0 conn(0x7fd6000c8250 legacy=0x7fd6000cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:51.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.793+0000 7fd5fed9d640 1 -- 172.21.15.100:0/3338814141 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60006edc0 con 0x7fd6001527d0 2024-09-11T22:26:51.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.794+0000 7fd5fed9d640 1 --2- 172.21.15.100:0/3338814141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6001527d0 0x7fd60006e120 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0009870 tx=0x7fd5f002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb9160863c913d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:51.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.794+0000 7fd5fdd9b640 1 -- 172.21.15.100:0/3338814141 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0037070 con 0x7fd6001527d0 2024-09-11T22:26:51.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.794+0000 7fd5fdd9b640 1 -- 172.21.15.100:0/3338814141 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f0032440 con 0x7fd6001527d0 2024-09-11T22:26:51.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.794+0000 7fd5fdd9b640 1 -- 172.21.15.100:0/3338814141 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0032810 con 0x7fd6001527d0 2024-09-11T22:26:51.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.795+0000 7fd60525c640 1 -- 172.21.15.100:0/3338814141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6001527d0 msgr2=0x7fd60006e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:51.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.795+0000 7fd60525c640 1 --2- 172.21.15.100:0/3338814141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6001527d0 0x7fd60006e120 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0009870 tx=0x7fd5f002a2a0 comp rx=0 tx=0).stop 2024-09-11T22:26:51.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.795+0000 7fd60525c640 1 -- 172.21.15.100:0/3338814141 shutdown_connections 2024-09-11T22:26:51.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.795+0000 7fd60525c640 1 --2- 172.21.15.100:0/3338814141 >> v2:172.21.15.167:3300/0 conn(0x7fd6000c8a70 0x7fd6000c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:51.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.795+0000 7fd60525c640 1 --2- 172.21.15.100:0/3338814141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6001527d0 0x7fd60006e120 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:51.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.795+0000 7fd60525c640 1 -- 172.21.15.100:0/3338814141 >> 172.21.15.100:0/3338814141 conn(0x7fd600073900 msgr2=0x7fd600073ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:51.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.795+0000 7fd60525c640 1 -- 172.21.15.100:0/3338814141 shutdown_connections 2024-09-11T22:26:51.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.795+0000 7fd60525c640 1 -- 172.21.15.100:0/3338814141 wait complete. 2024-09-11T22:26:51.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.796+0000 7fd60525c640 1 Processor -- start 2024-09-11T22:26:51.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.796+0000 7fd60525c640 1 -- start start 2024-09-11T22:26:51.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.797+0000 7fd60525c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6000c8250 0x7fd60006d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:51.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.797+0000 7fd60525c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6000c8a70 0x7fd600155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:51.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.797+0000 7fd60525c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6001527d0 0x7fd6000c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:51.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.797+0000 7fd60525c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd6000cb390 con 0x7fd6000c8250 2024-09-11T22:26:51.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.797+0000 7fd60525c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd6000cb210 con 0x7fd6001527d0 2024-09-11T22:26:51.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.797+0000 7fd60525c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd6000c9840 con 0x7fd6000c8a70 2024-09-11T22:26:51.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.797+0000 7fd5fed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6000c8250 0x7fd60006d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:51.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.797+0000 7fd5fed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6000c8250 0x7fd60006d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52774/0 (socket says 172.21.15.100:52774) 2024-09-11T22:26:51.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.797+0000 7fd5fed9d640 1 -- 172.21.15.100:0/1438712997 learned_addr learned my addr 172.21.15.100:0/1438712997 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:51.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.797+0000 7fd5ff59e640 1 --2- 172.21.15.100:0/1438712997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6001527d0 0x7fd6000c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:51.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.797+0000 7fd5fe59c640 1 --2- 172.21.15.100:0/1438712997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6000c8a70 0x7fd600155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:51.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.797+0000 7fd5fed9d640 1 -- 172.21.15.100:0/1438712997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6000c8a70 msgr2=0x7fd600155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:51.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.797+0000 7fd5fed9d640 1 --2- 172.21.15.100:0/1438712997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6000c8a70 0x7fd600155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:51.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.797+0000 7fd5fed9d640 1 -- 172.21.15.100:0/1438712997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6001527d0 msgr2=0x7fd6000c60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:51.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.797+0000 7fd5fed9d640 1 --2- 172.21.15.100:0/1438712997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6001527d0 0x7fd6000c60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:51.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.797+0000 7fd5fed9d640 1 -- 172.21.15.100:0/1438712997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60014c2c0 con 0x7fd6000c8250 2024-09-11T22:26:51.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.798+0000 7fd5fed9d640 1 --2- 172.21.15.100:0/1438712997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6000c8250 0x7fd60006d5a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0000c00 tx=0x7fd5f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:51.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.798+0000 7fd5e77fe640 1 -- 172.21.15.100:0/1438712997 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0037040 con 0x7fd6000c8250 2024-09-11T22:26:51.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.798+0000 7fd5e77fe640 1 -- 172.21.15.100:0/1438712997 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f0042070 con 0x7fd6000c8250 2024-09-11T22:26:51.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.798+0000 7fd60525c640 1 -- 172.21.15.100:0/1438712997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd60014c560 con 0x7fd6000c8250 2024-09-11T22:26:51.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.798+0000 7fd5e77fe640 1 -- 172.21.15.100:0/1438712997 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0030880 con 0x7fd6000c8250 2024-09-11T22:26:51.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.798+0000 7fd60525c640 1 -- 172.21.15.100:0/1438712997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6000c5890 con 0x7fd6000c8250 2024-09-11T22:26:51.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.799+0000 7fd60525c640 1 -- 172.21.15.100:0/1438712997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6000c9300 con 0x7fd6000c8250 2024-09-11T22:26:51.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.800+0000 7fd5e77fe640 1 -- 172.21.15.100:0/1438712997 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd5f0030a20 con 0x7fd6000c8250 2024-09-11T22:26:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.800+0000 7fd5e77fe640 1 --2- 172.21.15.100:0/1438712997 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd5ec06be30 0x7fd5ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.800+0000 7fd5e77fe640 1 -- 172.21.15.100:0/1438712997 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fd5f00ab9f0 con 0x7fd6000c8250 2024-09-11T22:26:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.800+0000 7fd5fe59c640 1 --2- 172.21.15.100:0/1438712997 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd5ec06be30 0x7fd5ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.801+0000 7fd5fe59c640 1 --2- 172.21.15.100:0/1438712997 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd5ec06be30 0x7fd5ec06e2f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd6000c78a0 tx=0x7fd5f4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:51.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:51.805+0000 7fd5e77fe640 1 -- 172.21.15.100:0/1438712997 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd5f00798a0 con 0x7fd6000c8250 2024-09-11T22:26:52.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.096+0000 7fd60525c640 1 -- 172.21.15.100:0/1438712997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd6000c5d00 con 0x7fd6000c8250 2024-09-11T22:26:52.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.096+0000 7fd5e77fe640 1 -- 172.21.15.100:0/1438712997 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fd5f007dba0 con 0x7fd6000c8250 2024-09-11T22:26:52.098 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":48,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:26:52.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.098+0000 7fd60525c640 1 -- 172.21.15.100:0/1438712997 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd5ec06be30 msgr2=0x7fd5ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.098+0000 7fd60525c640 1 --2- 172.21.15.100:0/1438712997 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd5ec06be30 0x7fd5ec06e2f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd6000c78a0 tx=0x7fd5f4009190 comp rx=0 tx=0).stop 2024-09-11T22:26:52.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.099+0000 7fd60525c640 1 -- 172.21.15.100:0/1438712997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6000c8250 msgr2=0x7fd60006d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.099+0000 7fd60525c640 1 --2- 172.21.15.100:0/1438712997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6000c8250 0x7fd60006d5a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd5f0000c00 tx=0x7fd5f00046c0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.099+0000 7fd60525c640 1 -- 172.21.15.100:0/1438712997 shutdown_connections 2024-09-11T22:26:52.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.099+0000 7fd60525c640 1 --2- 172.21.15.100:0/1438712997 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd5ec06be30 0x7fd5ec06e2f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.099+0000 7fd60525c640 1 --2- 172.21.15.100:0/1438712997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6001527d0 0x7fd6000c60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.099+0000 7fd60525c640 1 --2- 172.21.15.100:0/1438712997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6000c8a70 0x7fd600155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.099+0000 7fd60525c640 1 --2- 172.21.15.100:0/1438712997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6000c8250 0x7fd60006d5a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.099+0000 7fd60525c640 1 -- 172.21.15.100:0/1438712997 >> 172.21.15.100:0/1438712997 conn(0x7fd600073900 msgr2=0x7fd6000cab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:52.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.099+0000 7fd60525c640 1 -- 172.21.15.100:0/1438712997 shutdown_connections 2024-09-11T22:26:52.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.099+0000 7fd60525c640 1 -- 172.21.15.100:0/1438712997 wait complete. 2024-09-11T22:26:52.111 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:26:52.111 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-11T22:26:52.111 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:26:52.111 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:26:52.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.224+0000 7fb6c85d6640 1 Processor -- start 2024-09-11T22:26:52.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.224+0000 7fb6c85d6640 1 -- start start 2024-09-11T22:26:52.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.226+0000 7fb6c85d6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb6c0154cd0 0x7fb6c015bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.226+0000 7fb6c85d6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb6c015e7c0 0x7fb6c00cc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.226+0000 7fb6c85d6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6c00c71e0 0x7fb6c00ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.226+0000 7fb6c85d6640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb6c015ecb0 con 0x7fb6c0154cd0 2024-09-11T22:26:52.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.226+0000 7fb6c85d6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fb6c00738d0 con 0x7fb6c015e7c0 2024-09-11T22:26:52.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.226+0000 7fb6c85d6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c0072830 con 0x7fb6c00c71e0 2024-09-11T22:26:52.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.226+0000 7fb6c6372640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb6c0154cd0 0x7fb6c015bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.226+0000 7fb6c6372640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb6c0154cd0 0x7fb6c015bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47532/0 (socket says 172.21.15.100:47532) 2024-09-11T22:26:52.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.226+0000 7fb6c6372640 1 -- 172.21.15.100:0/766676085 learned_addr learned my addr 172.21.15.100:0/766676085 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:52.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.226+0000 7fb6c6372640 1 -- 172.21.15.100:0/766676085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6c00c71e0 msgr2=0x7fb6c00ccc80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:26:52.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.226+0000 7fb6c6372640 1 --2- 172.21.15.100:0/766676085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6c00c71e0 0x7fb6c00ccc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.226+0000 7fb6c6372640 1 -- 172.21.15.100:0/766676085 >> v2:172.21.15.167:3300/0 conn(0x7fb6c015e7c0 msgr2=0x7fb6c00cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:26:52.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.226+0000 7fb6c6372640 1 --2- 172.21.15.100:0/766676085 >> v2:172.21.15.167:3300/0 conn(0x7fb6c015e7c0 0x7fb6c00cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.226+0000 7fb6c6372640 1 -- 172.21.15.100:0/766676085 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c0072b10 con 0x7fb6c0154cd0 2024-09-11T22:26:52.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.227+0000 7fb6c6372640 1 --2- 172.21.15.100:0/766676085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c0154cd0 0x7fb6c015bcb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb6c015dd10 tx=0x7fb6bc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02da826ca4258c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:52.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.227+0000 7fb6c5370640 1 -- 172.21.15.100:0/766676085 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc037070 con 0x7fb6c0154cd0 2024-09-11T22:26:52.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.228+0000 7fb6c5370640 1 -- 172.21.15.100:0/766676085 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6bc032440 con 0x7fb6c0154cd0 2024-09-11T22:26:52.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.228+0000 7fb6c5370640 1 -- 172.21.15.100:0/766676085 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc032810 con 0x7fb6c0154cd0 2024-09-11T22:26:52.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.228+0000 7fb6c85d6640 1 -- 172.21.15.100:0/766676085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c0154cd0 msgr2=0x7fb6c015bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.228+0000 7fb6c85d6640 1 --2- 172.21.15.100:0/766676085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c0154cd0 0x7fb6c015bcb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb6c015dd10 tx=0x7fb6bc02a230 comp rx=0 tx=0).stop 2024-09-11T22:26:52.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.228+0000 7fb6c85d6640 1 -- 172.21.15.100:0/766676085 shutdown_connections 2024-09-11T22:26:52.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.228+0000 7fb6c85d6640 1 --2- 172.21.15.100:0/766676085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6c00c71e0 0x7fb6c00ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.228+0000 7fb6c85d6640 1 --2- 172.21.15.100:0/766676085 >> v2:172.21.15.167:3300/0 conn(0x7fb6c015e7c0 0x7fb6c00cc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.228+0000 7fb6c85d6640 1 --2- 172.21.15.100:0/766676085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c0154cd0 0x7fb6c015bcb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.228+0000 7fb6c85d6640 1 -- 172.21.15.100:0/766676085 >> 172.21.15.100:0/766676085 conn(0x7fb6c006fa70 msgr2=0x7fb6c006fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:52.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.229+0000 7fb6c85d6640 1 -- 172.21.15.100:0/766676085 shutdown_connections 2024-09-11T22:26:52.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.229+0000 7fb6c85d6640 1 -- 172.21.15.100:0/766676085 wait complete. 2024-09-11T22:26:52.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.230+0000 7fb6c85d6640 1 Processor -- start 2024-09-11T22:26:52.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.230+0000 7fb6c85d6640 1 -- start start 2024-09-11T22:26:52.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.231+0000 7fb6c85d6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6c00c71e0 0x7fb6c01f1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.231+0000 7fb6c85d6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c015e7c0 0x7fb6c00c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.231+0000 7fb6c85d6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6c01519a0 0x7fb6c01f45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.231+0000 7fb6c85d6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c0075770 con 0x7fb6c015e7c0 2024-09-11T22:26:52.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.231+0000 7fb6c85d6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c00730d0 con 0x7fb6c00c71e0 2024-09-11T22:26:52.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.231+0000 7fb6c85d6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c00c7800 con 0x7fb6c01519a0 2024-09-11T22:26:52.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.231+0000 7fb6c5b71640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c015e7c0 0x7fb6c00c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.231+0000 7fb6c6372640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6c00c71e0 0x7fb6c01f1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.231+0000 7fb6c5b71640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c015e7c0 0x7fb6c00c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47538/0 (socket says 172.21.15.100:47538) 2024-09-11T22:26:52.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.231+0000 7fb6c6372640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6c00c71e0 0x7fb6c01f1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:59530/0 (socket says 172.21.15.100:59530) 2024-09-11T22:26:52.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.231+0000 7fb6c5b71640 1 -- 172.21.15.100:0/1389802396 learned_addr learned my addr 172.21.15.100:0/1389802396 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:52.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.231+0000 7fb6c6b73640 1 --2- 172.21.15.100:0/1389802396 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6c01519a0 0x7fb6c01f45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.232+0000 7fb6c5b71640 1 -- 172.21.15.100:0/1389802396 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6c01519a0 msgr2=0x7fb6c01f45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.232+0000 7fb6c5b71640 1 --2- 172.21.15.100:0/1389802396 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6c01519a0 0x7fb6c01f45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.232+0000 7fb6c5b71640 1 -- 172.21.15.100:0/1389802396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6c00c71e0 msgr2=0x7fb6c01f1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.232+0000 7fb6c5b71640 1 --2- 172.21.15.100:0/1389802396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6c00c71e0 0x7fb6c01f1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.232+0000 7fb6c5b71640 1 -- 172.21.15.100:0/1389802396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c0150980 con 0x7fb6c015e7c0 2024-09-11T22:26:52.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.232+0000 7fb6c5b71640 1 --2- 172.21.15.100:0/1389802396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c015e7c0 0x7fb6c00c8190 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000b410 tx=0x7fb6b000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:52.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.232+0000 7fb6b6ffd640 1 -- 172.21.15.100:0/1389802396 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0015020 con 0x7fb6c015e7c0 2024-09-11T22:26:52.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.232+0000 7fb6c85d6640 1 -- 172.21.15.100:0/1389802396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c0150c40 con 0x7fb6c015e7c0 2024-09-11T22:26:52.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.232+0000 7fb6b6ffd640 1 -- 172.21.15.100:0/1389802396 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6b0011850 con 0x7fb6c015e7c0 2024-09-11T22:26:52.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.232+0000 7fb6b6ffd640 1 -- 172.21.15.100:0/1389802396 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0011c40 con 0x7fb6c015e7c0 2024-09-11T22:26:52.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.232+0000 7fb6c85d6640 1 -- 172.21.15.100:0/1389802396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c0151200 con 0x7fb6c015e7c0 2024-09-11T22:26:52.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.233+0000 7fb6c85d6640 1 --2- 172.21.15.100:0/1389802396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c01f4b00 0x7fb6c00c4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.233+0000 7fb6c85d6640 1 -- 172.21.15.100:0/1389802396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c015bcb0 con 0x7fb6c01f4b00 2024-09-11T22:26:52.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.233+0000 7fb6c6372640 1 --2- 172.21.15.100:0/1389802396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c01f4b00 0x7fb6c00c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.234+0000 7fb6c6372640 1 -- 172.21.15.100:0/1389802396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb6c00c9c30 con 0x7fb6c01f4b00 2024-09-11T22:26:52.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.234+0000 7fb6c6372640 1 --2- 172.21.15.100:0/1389802396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c01f4b00 0x7fb6c00c4550 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0071820 tx=0x7fb6bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:52.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.234+0000 7fb6b6ffd640 1 -- 172.21.15.100:0/1389802396 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb6b0018020 con 0x7fb6c015e7c0 2024-09-11T22:26:52.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.235+0000 7fb6b6ffd640 1 --2- 172.21.15.100:0/1389802396 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb6a406be60 0x7fb6a406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.235+0000 7fb6b6ffd640 1 -- 172.21.15.100:0/1389802396 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fb6b008b0a0 con 0x7fb6c015e7c0 2024-09-11T22:26:52.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.235+0000 7fb6c6b73640 1 --2- 172.21.15.100:0/1389802396 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb6a406be60 0x7fb6a406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.235+0000 7fb6b6ffd640 1 -- 172.21.15.100:0/1389802396 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc037040 con 0x7fb6c01f4b00 2024-09-11T22:26:52.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.235+0000 7fb6b6ffd640 1 -- 172.21.15.100:0/1389802396 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb6bc032440 con 0x7fb6c01f4b00 2024-09-11T22:26:52.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.235+0000 7fb6b6ffd640 1 -- 172.21.15.100:0/1389802396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c01f4b00 msgr2=0x7fb6c00c4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.235+0000 7fb6b6ffd640 1 --2- 172.21.15.100:0/1389802396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c01f4b00 0x7fb6c00c4550 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0071820 tx=0x7fb6bc0046c0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.235+0000 7fb6b6ffd640 1 -- 172.21.15.100:0/1389802396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c01f4b00 msgr2=0x7fb6c00c4550 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:26:52.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.235+0000 7fb6b6ffd640 1 --2- 172.21.15.100:0/1389802396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c01f4b00 0x7fb6c00c4550 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0071820 tx=0x7fb6bc0046c0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.238 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.235+0000 7fb6c6b73640 1 --2- 172.21.15.100:0/1389802396 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb6a406be60 0x7fb6a406e320 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0151e10 tx=0x7fb6b800d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:52.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.244+0000 7fb6c85d6640 1 --2- 172.21.15.100:0/1389802396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c00c4a90 0x7fb6c00c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.244+0000 7fb6c85d6640 1 -- 172.21.15.100:0/1389802396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c00c53e0 con 0x7fb6c00c4a90 2024-09-11T22:26:52.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.245+0000 7fb6c6372640 1 --2- 172.21.15.100:0/1389802396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c00c4a90 0x7fb6c00c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.245+0000 7fb6c6372640 1 -- 172.21.15.100:0/1389802396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb6c00722d0 con 0x7fb6c00c4a90 2024-09-11T22:26:52.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.245+0000 7fb6c6372640 1 --2- 172.21.15.100:0/1389802396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c00c4a90 0x7fb6c00c4ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc02a270 tx=0x7fb6bc008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:52.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.245+0000 7fb6b6ffd640 1 -- 172.21.15.100:0/1389802396 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc037040 con 0x7fb6c00c4a90 2024-09-11T22:26:52.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.246+0000 7fb6b6ffd640 1 -- 172.21.15.100:0/1389802396 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4555 (secure 0 0 0) 0x7fb6bc003610 con 0x7fb6c00c4a90 2024-09-11T22:26:52.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.246+0000 7fb6b6ffd640 1 -- 172.21.15.100:0/1389802396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c00c4a90 msgr2=0x7fb6c00c4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.246+0000 7fb6b6ffd640 1 --2- 172.21.15.100:0/1389802396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c00c4a90 0x7fb6c00c4ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc02a270 tx=0x7fb6bc008030 comp rx=0 tx=0).stop 2024-09-11T22:26:52.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.246+0000 7fb6b6ffd640 1 -- 172.21.15.100:0/1389802396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c00c4a90 msgr2=0x7fb6c00c4ea0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:26:52.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.246+0000 7fb6b6ffd640 1 --2- 172.21.15.100:0/1389802396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c00c4a90 0x7fb6c00c4ea0 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc02a270 tx=0x7fb6bc008030 comp rx=0 tx=0).stop 2024-09-11T22:26:52.247 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:26:52.247 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:26:52.247 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:26:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:26:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 48, 2024-09-11T22:26:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 17944, 2024-09-11T22:26:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:26:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:26:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:26:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:26:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 11, 2024-09-11T22:26:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:26:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:26:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:26:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:52.248 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:26:52.249 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:26:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:52.250 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:26:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:26:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:26:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:26:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:26:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:26:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:26:52.251 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:26:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:26:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:26:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:26:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:26:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:26:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:26:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:26:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:26:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:26:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:52.252 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:26:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.253 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:26:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:26:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:26:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:26:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:52.254 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:26:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:26:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:26:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.255 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:26:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:26:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:26:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:26:52.256 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:26:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:26:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:26:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:26:52.257 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:26:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:26:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.258 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:26:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:26:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:26:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:26:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:26:52.259 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:26:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:26:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.260 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:26:52.260 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:26:52.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.246+0000 7fb6c85d6640 1 -- 172.21.15.100:0/1389802396 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb6a406be60 msgr2=0x7fb6a406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.246+0000 7fb6c85d6640 1 --2- 172.21.15.100:0/1389802396 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb6a406be60 0x7fb6a406e320 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0151e10 tx=0x7fb6b800d040 comp rx=0 tx=0).stop 2024-09-11T22:26:52.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.246+0000 7fb6c85d6640 1 -- 172.21.15.100:0/1389802396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c015e7c0 msgr2=0x7fb6c00c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.246+0000 7fb6c85d6640 1 --2- 172.21.15.100:0/1389802396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6c015e7c0 0x7fb6c00c8190 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000b410 tx=0x7fb6b000b8d0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.246+0000 7fb6c6b73640 1 -- 172.21.15.100:0/1389802396 reap_dead start 2024-09-11T22:26:52.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.246+0000 7fb6c6b73640 1 -- 172.21.15.100:0/1389802396 reap_dead start 2024-09-11T22:26:52.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.246+0000 7fb6c85d6640 1 -- 172.21.15.100:0/1389802396 shutdown_connections 2024-09-11T22:26:52.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.246+0000 7fb6c85d6640 1 -- 172.21.15.100:0/1389802396 >> 172.21.15.100:0/1389802396 conn(0x7fb6c006fa70 msgr2=0x7fb6c006c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:52.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.246+0000 7fb6c85d6640 1 -- 172.21.15.100:0/1389802396 shutdown_connections 2024-09-11T22:26:52.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.246+0000 7fb6c85d6640 1 -- 172.21.15.100:0/1389802396 wait complete. 2024-09-11T22:26:52.263 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:26:52.263 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:26:52.263 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:26:52.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.376+0000 7fcfb55fd640 1 Processor -- start 2024-09-11T22:26:52.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.376+0000 7fcfb55fd640 1 -- start start 2024-09-11T22:26:52.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.377+0000 7fcfb55fd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcfb0151970 0x7fcfb00726c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.377+0000 7fcfb55fd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfb0072f30 0x7fcfb0073380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.377+0000 7fcfb55fd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfb0073bf0 con 0x7fcfb00c3c60 2024-09-11T22:26:52.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.377+0000 7fcfb55fd640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fcfb00ca3f0 con 0x7fcfb0151970 2024-09-11T22:26:52.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.377+0000 7fcfb55fd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcfb00c9f60 con 0x7fcfb0072f30 2024-09-11T22:26:52.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.377+0000 7fcfaeffd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcfb0151970 0x7fcfb00726c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.377+0000 7fcfaeffd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcfb0151970 0x7fcfb00726c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47562/0 (socket says 172.21.15.100:47562) 2024-09-11T22:26:52.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.377+0000 7fcfaeffd640 1 -- 172.21.15.100:0/2445846594 learned_addr learned my addr 172.21.15.100:0/2445846594 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:52.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.378+0000 7fcfaeffd640 1 -- 172.21.15.100:0/2445846594 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfb0072f30 msgr2=0x7fcfb0073380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:26:52.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.378+0000 7fcfaf7fe640 1 --2- 172.21.15.100:0/2445846594 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfb0072f30 0x7fcfb0073380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.378+0000 7fcfaeffd640 1 --2- 172.21.15.100:0/2445846594 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfb0072f30 0x7fcfb0073380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.378+0000 7fcfaeffd640 1 -- 172.21.15.100:0/2445846594 >> v1:172.21.15.167:6789/0 conn(0x7fcfb00c3c60 legacy=0x7fcfb01576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.378+0000 7fcfaeffd640 1 -- 172.21.15.100:0/2445846594 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb0073ed0 con 0x7fcfb0151970 2024-09-11T22:26:52.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.378+0000 7fcfaf7fe640 1 --2- 172.21.15.100:0/2445846594 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfb0072f30 0x7fcfb0073380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:26:52.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.379+0000 7fcfaeffd640 1 --2- 172.21.15.100:0/2445846594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfb0151970 0x7fcfb00726c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009870 tx=0x7fcfa002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc073e200f090a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:52.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.379+0000 7fcfadffb640 1 -- 172.21.15.100:0/2445846594 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0037070 con 0x7fcfb0151970 2024-09-11T22:26:52.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.379+0000 7fcfadffb640 1 -- 172.21.15.100:0/2445846594 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa002ae50 con 0x7fcfb0151970 2024-09-11T22:26:52.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.379+0000 7fcfadffb640 1 -- 172.21.15.100:0/2445846594 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0032860 con 0x7fcfb0151970 2024-09-11T22:26:52.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.380+0000 7fcfb55fd640 1 -- 172.21.15.100:0/2445846594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfb0151970 msgr2=0x7fcfb00726c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.380+0000 7fcfb55fd640 1 --2- 172.21.15.100:0/2445846594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfb0151970 0x7fcfb00726c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009870 tx=0x7fcfa002a300 comp rx=0 tx=0).stop 2024-09-11T22:26:52.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.380+0000 7fcfb55fd640 1 -- 172.21.15.100:0/2445846594 shutdown_connections 2024-09-11T22:26:52.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.380+0000 7fcfb55fd640 1 --2- 172.21.15.100:0/2445846594 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfb0072f30 0x7fcfb0073380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.380+0000 7fcfb55fd640 1 --2- 172.21.15.100:0/2445846594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfb0151970 0x7fcfb00726c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.380+0000 7fcfb55fd640 1 -- 172.21.15.100:0/2445846594 >> 172.21.15.100:0/2445846594 conn(0x7fcfb006ee80 msgr2=0x7fcfb0070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:52.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.381+0000 7fcfb55fd640 1 -- 172.21.15.100:0/2445846594 shutdown_connections 2024-09-11T22:26:52.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.381+0000 7fcfb55fd640 1 -- 172.21.15.100:0/2445846594 wait complete. 2024-09-11T22:26:52.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.382+0000 7fcfb55fd640 1 Processor -- start 2024-09-11T22:26:52.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.382+0000 7fcfb55fd640 1 -- start start 2024-09-11T22:26:52.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.383+0000 7fcfb55fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfb0072f30 0x7fcfb0157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.383+0000 7fcfb55fd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfb00c3c60 0x7fcfb0157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.383+0000 7fcfb55fd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfb0151970 0x7fcfb013a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.383+0000 7fcfb55fd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb00c9bf0 con 0x7fcfb00c3c60 2024-09-11T22:26:52.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.383+0000 7fcfb55fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb00741b0 con 0x7fcfb0072f30 2024-09-11T22:26:52.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.383+0000 7fcfb55fd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcfb006d530 con 0x7fcfb0151970 2024-09-11T22:26:52.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.383+0000 7fcfae7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfb00c3c60 0x7fcfb0157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.383+0000 7fcfaeffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfb0072f30 0x7fcfb0157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.383+0000 7fcfae7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfb00c3c60 0x7fcfb0157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47564/0 (socket says 172.21.15.100:47564) 2024-09-11T22:26:52.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.383+0000 7fcfaf7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfb0151970 0x7fcfb013a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.383+0000 7fcfae7fc640 1 -- 172.21.15.100:0/2979281545 learned_addr learned my addr 172.21.15.100:0/2979281545 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:52.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.383+0000 7fcfae7fc640 1 -- 172.21.15.100:0/2979281545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfb0151970 msgr2=0x7fcfb013a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.383+0000 7fcfae7fc640 1 --2- 172.21.15.100:0/2979281545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfb0151970 0x7fcfb013a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.383+0000 7fcfae7fc640 1 -- 172.21.15.100:0/2979281545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfb0072f30 msgr2=0x7fcfb0157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.383+0000 7fcfae7fc640 1 --2- 172.21.15.100:0/2979281545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfb0072f30 0x7fcfb0157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.383+0000 7fcfae7fc640 1 -- 172.21.15.100:0/2979281545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb01510a0 con 0x7fcfb00c3c60 2024-09-11T22:26:52.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.384+0000 7fcfae7fc640 1 --2- 172.21.15.100:0/2979281545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfb00c3c60 0x7fcfb0157d40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400c400 tx=0x7fcfa400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:52.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.384+0000 7fcf977fe640 1 -- 172.21.15.100:0/2979281545 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa40052d0 con 0x7fcfb00c3c60 2024-09-11T22:26:52.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.384+0000 7fcfb55fd640 1 -- 172.21.15.100:0/2979281545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfb01f1890 con 0x7fcfb00c3c60 2024-09-11T22:26:52.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.384+0000 7fcf977fe640 1 -- 172.21.15.100:0/2979281545 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa4005470 con 0x7fcfb00c3c60 2024-09-11T22:26:52.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.384+0000 7fcf977fe640 1 -- 172.21.15.100:0/2979281545 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa40052d0 con 0x7fcfb00c3c60 2024-09-11T22:26:52.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.384+0000 7fcfb55fd640 1 -- 172.21.15.100:0/2979281545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfb01f1e50 con 0x7fcfb00c3c60 2024-09-11T22:26:52.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.385+0000 7fcfb55fd640 1 --2- 172.21.15.100:0/2979281545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfb00c6d00 0x7fcfb013a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.385+0000 7fcfb55fd640 1 -- 172.21.15.100:0/2979281545 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb00c4090 con 0x7fcfb00c6d00 2024-09-11T22:26:52.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.385+0000 7fcfaeffd640 1 --2- 172.21.15.100:0/2979281545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfb00c6d00 0x7fcfb013a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.385+0000 7fcf977fe640 1 -- 172.21.15.100:0/2979281545 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcfa4007020 con 0x7fcfb00c3c60 2024-09-11T22:26:52.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.385+0000 7fcfaeffd640 1 -- 172.21.15.100:0/2979281545 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcfb0072d10 con 0x7fcfb00c6d00 2024-09-11T22:26:52.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.386+0000 7fcfaeffd640 1 --2- 172.21.15.100:0/2979281545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfb00c6d00 0x7fcfb013a8e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcfb00caa80 tx=0x7fcfa00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:52.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.386+0000 7fcf977fe640 1 --2- 172.21.15.100:0/2979281545 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcf9c06c030 0x7fcf9c06e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.386+0000 7fcfaf7fe640 1 --2- 172.21.15.100:0/2979281545 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcf9c06c030 0x7fcf9c06e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.386+0000 7fcf977fe640 1 -- 172.21.15.100:0/2979281545 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fcfa408a320 con 0x7fcfb00c3c60 2024-09-11T22:26:52.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.386+0000 7fcf977fe640 1 -- 172.21.15.100:0/2979281545 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0037040 con 0x7fcfb00c6d00 2024-09-11T22:26:52.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.386+0000 7fcf977fe640 1 -- 172.21.15.100:0/2979281545 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fcfa002ae50 con 0x7fcfb00c6d00 2024-09-11T22:26:52.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.386+0000 7fcf977fe640 1 -- 172.21.15.100:0/2979281545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfb00c6d00 msgr2=0x7fcfb013a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.386+0000 7fcf977fe640 1 --2- 172.21.15.100:0/2979281545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfb00c6d00 0x7fcfb013a8e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcfb00caa80 tx=0x7fcfa00046c0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.386+0000 7fcf977fe640 1 -- 172.21.15.100:0/2979281545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfb00c6d00 msgr2=0x7fcfb013a8e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:26:52.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.386+0000 7fcf977fe640 1 --2- 172.21.15.100:0/2979281545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfb00c6d00 0x7fcfb013a8e0 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcfb00caa80 tx=0x7fcfa00046c0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.386+0000 7fcfaf7fe640 1 --2- 172.21.15.100:0/2979281545 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcf9c06c030 0x7fcf9c06e4f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800d540 tx=0x7fcfa8007780 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:52.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.393+0000 7fcfb55fd640 1 --2- 172.21.15.100:0/2979281545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfb01f2050 0x7fcfb01ee5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.393+0000 7fcfb55fd640 1 -- 172.21.15.100:0/2979281545 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb00704c0 con 0x7fcfb01f2050 2024-09-11T22:26:52.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.393+0000 7fcfaeffd640 1 --2- 172.21.15.100:0/2979281545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfb01f2050 0x7fcfb01ee5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.393+0000 7fcfaeffd640 1 -- 172.21.15.100:0/2979281545 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcfb00701e0 con 0x7fcfb01f2050 2024-09-11T22:26:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.394+0000 7fcfaeffd640 1 --2- 172.21.15.100:0/2979281545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfb01f2050 0x7fcfb01ee5e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0000c00 tx=0x7fcfa0008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.394+0000 7fcf977fe640 1 -- 172.21.15.100:0/2979281545 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0037030 con 0x7fcfb01f2050 2024-09-11T22:26:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.394+0000 7fcf977fe640 1 -- 172.21.15.100:0/2979281545 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4888 (secure 0 0 0) 0x7fcfa003ca50 con 0x7fcfb01f2050 2024-09-11T22:26:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.394+0000 7fcf977fe640 1 -- 172.21.15.100:0/2979281545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfb01f2050 msgr2=0x7fcfb01ee5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.394+0000 7fcf977fe640 1 --2- 172.21.15.100:0/2979281545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfb01f2050 0x7fcfb01ee5e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0000c00 tx=0x7fcfa0008030 comp rx=0 tx=0).stop 2024-09-11T22:26:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.394+0000 7fcf977fe640 1 -- 172.21.15.100:0/2979281545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfb01f2050 msgr2=0x7fcfb01ee5e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:26:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.394+0000 7fcf977fe640 1 --2- 172.21.15.100:0/2979281545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfb01f2050 0x7fcfb01ee5e0 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0000c00 tx=0x7fcfa0008030 comp rx=0 tx=0).stop 2024-09-11T22:26:52.396 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:26:52.396 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:26:52.396 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:26:52.396 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:26:52.396 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 48, 2024-09-11T22:26:52.396 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 197673, 2024-09-11T22:26:52.396 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:26:52.396 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:26:52.396 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:26:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:26:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 11, 2024-09-11T22:26:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:26:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:26:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:26:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:52.397 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:52.398 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:52.398 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:52.398 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:52.398 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:52.398 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:52.398 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:26:52.398 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:26:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:52.399 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:26:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:26:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:26:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:26:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:26:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:26:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:26:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:26:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:26:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:26:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:26:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:26:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:26:52.400 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:26:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:26:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:26:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:26:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:52.401 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:26:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:26:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:26:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:26:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:52.402 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:26:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:26:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:26:52.403 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:26:52.404 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:52.404 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:52.404 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:52.404 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.404 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.404 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:26:52.404 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:26:52.404 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:52.404 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:52.404 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.404 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:52.404 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:26:52.404 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:52.405 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.405 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.405 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:52.405 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:26:52.405 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:52.405 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:52.405 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:52.405 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.405 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:26:52.405 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:26:52.405 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:52.405 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:52.405 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:52.405 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:26:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:26:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:26:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:52.406 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:26:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:26:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:26:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.407 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:26:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:26:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:26:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:26:52.408 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:26:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:26:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:26:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:52.409 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:26:52.410 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.410 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:52.410 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:52.410 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:26:52.410 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:52.410 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:52.410 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.410 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:26:52.410 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:26:52.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.394+0000 7fcfb55fd640 1 -- 172.21.15.100:0/2979281545 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcf9c06c030 msgr2=0x7fcf9c06e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.394+0000 7fcfb55fd640 1 --2- 172.21.15.100:0/2979281545 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcf9c06c030 0x7fcf9c06e4f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800d540 tx=0x7fcfa8007780 comp rx=0 tx=0).stop 2024-09-11T22:26:52.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.394+0000 7fcfb55fd640 1 -- 172.21.15.100:0/2979281545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfb00c3c60 msgr2=0x7fcfb0157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.394+0000 7fcfb55fd640 1 --2- 172.21.15.100:0/2979281545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfb00c3c60 0x7fcfb0157d40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400c400 tx=0x7fcfa400c8c0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.394+0000 7fcfaf7fe640 1 -- 172.21.15.100:0/2979281545 reap_dead start 2024-09-11T22:26:52.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.394+0000 7fcfaf7fe640 1 -- 172.21.15.100:0/2979281545 reap_dead start 2024-09-11T22:26:52.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.394+0000 7fcfb55fd640 1 -- 172.21.15.100:0/2979281545 shutdown_connections 2024-09-11T22:26:52.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.395+0000 7fcfb55fd640 1 -- 172.21.15.100:0/2979281545 >> 172.21.15.100:0/2979281545 conn(0x7fcfb006ee80 msgr2=0x7fcfb00c7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:52.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.395+0000 7fcfb55fd640 1 -- 172.21.15.100:0/2979281545 shutdown_connections 2024-09-11T22:26:52.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.395+0000 7fcfb55fd640 1 -- 172.21.15.100:0/2979281545 wait complete. 2024-09-11T22:26:52.413 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:26:52.413 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:26:52.413 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:26:52.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.522+0000 7f9e33db0640 1 Processor -- start 2024-09-11T22:26:52.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.522+0000 7f9e33db0640 1 -- start start 2024-09-11T22:26:52.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.523+0000 7f9e33db0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c152c70 0x7f9e2c0c9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.523+0000 7f9e33db0640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9e2c0c4f80 0x7f9e2c06ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.524+0000 7f9e33db0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e2c0b0f00 con 0x7f9e2c0c9dd0 2024-09-11T22:26:52.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.524+0000 7f9e33db0640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f9e2c153050 con 0x7f9e2c0c4f80 2024-09-11T22:26:52.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.524+0000 7f9e33db0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9e2c0ca440 con 0x7f9e2c152c70 2024-09-11T22:26:52.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.524+0000 7f9e3234d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9e2c0c4f80 0x7f9e2c06ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.524+0000 7f9e3234d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9e2c0c4f80 0x7f9e2c06ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47580/0 (socket says 172.21.15.100:47580) 2024-09-11T22:26:52.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.524+0000 7f9e3234d640 1 -- 172.21.15.100:0/880710293 learned_addr learned my addr 172.21.15.100:0/880710293 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:52.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.524+0000 7f9e31b4c640 1 --2- 172.21.15.100:0/880710293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c152c70 0x7f9e2c0c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.524+0000 7f9e3234d640 1 -- 172.21.15.100:0/880710293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c152c70 msgr2=0x7f9e2c0c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:26:52.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.524+0000 7f9e3234d640 1 --2- 172.21.15.100:0/880710293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c152c70 0x7f9e2c0c9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.524+0000 7f9e3234d640 1 -- 172.21.15.100:0/880710293 >> v1:172.21.15.167:6789/0 conn(0x7f9e2c0c9dd0 legacy=0x7f9e2c0ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.524+0000 7f9e3234d640 1 -- 172.21.15.100:0/880710293 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e2c0c33d0 con 0x7f9e2c0c4f80 2024-09-11T22:26:52.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.525+0000 7f9e3234d640 1 --2- 172.21.15.100:0/880710293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2c0c4f80 0x7f9e2c06ff00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9e24009e50 tx=0x7f9e2402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403f9bce1f1ebc0c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:52.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.525+0000 7f9e30b4a640 1 -- 172.21.15.100:0/880710293 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e24036070 con 0x7f9e2c0c4f80 2024-09-11T22:26:52.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.525+0000 7f9e30b4a640 1 -- 172.21.15.100:0/880710293 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e24031600 con 0x7f9e2c0c4f80 2024-09-11T22:26:52.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.525+0000 7f9e30b4a640 1 -- 172.21.15.100:0/880710293 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e240319d0 con 0x7f9e2c0c4f80 2024-09-11T22:26:52.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.525+0000 7f9e33db0640 1 -- 172.21.15.100:0/880710293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2c0c4f80 msgr2=0x7f9e2c06ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.526+0000 7f9e33db0640 1 --2- 172.21.15.100:0/880710293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2c0c4f80 0x7f9e2c06ff00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9e24009e50 tx=0x7f9e2402a680 comp rx=0 tx=0).stop 2024-09-11T22:26:52.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.526+0000 7f9e33db0640 1 -- 172.21.15.100:0/880710293 shutdown_connections 2024-09-11T22:26:52.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.526+0000 7f9e33db0640 1 --2- 172.21.15.100:0/880710293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2c0c4f80 0x7f9e2c06ff00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.526+0000 7f9e33db0640 1 --2- 172.21.15.100:0/880710293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c152c70 0x7f9e2c0c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.526+0000 7f9e33db0640 1 -- 172.21.15.100:0/880710293 >> 172.21.15.100:0/880710293 conn(0x7f9e2c06de20 msgr2=0x7f9e2c06e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.526+0000 7f9e33db0640 1 -- 172.21.15.100:0/880710293 shutdown_connections 2024-09-11T22:26:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.526+0000 7f9e33db0640 1 -- 172.21.15.100:0/880710293 wait complete. 2024-09-11T22:26:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.527+0000 7f9e33db0640 1 Processor -- start 2024-09-11T22:26:52.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.527+0000 7f9e33db0640 1 -- start start 2024-09-11T22:26:52.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.528+0000 7f9e33db0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c0c4f80 0x7f9e2c1f2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.528+0000 7f9e33db0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e2c0c9dd0 0x7f9e2c1e5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.528+0000 7f9e33db0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2c152c70 0x7f9e2c1eeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.528+0000 7f9e33db0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2c0c3990 con 0x7f9e2c152c70 2024-09-11T22:26:52.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.528+0000 7f9e33db0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2c0ca6e0 con 0x7f9e2c0c9dd0 2024-09-11T22:26:52.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.528+0000 7f9e33db0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9e2c0ce870 con 0x7f9e2c0c4f80 2024-09-11T22:26:52.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.528+0000 7f9e3234d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2c152c70 0x7f9e2c1eeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.528+0000 7f9e3234d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2c152c70 0x7f9e2c1eeb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47592/0 (socket says 172.21.15.100:47592) 2024-09-11T22:26:52.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.528+0000 7f9e3234d640 1 -- 172.21.15.100:0/411321444 learned_addr learned my addr 172.21.15.100:0/411321444 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:52.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.528+0000 7f9e31b4c640 1 --2- 172.21.15.100:0/411321444 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c0c4f80 0x7f9e2c1f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.528+0000 7f9e3134b640 1 --2- 172.21.15.100:0/411321444 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e2c0c9dd0 0x7f9e2c1e5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.528+0000 7f9e3234d640 1 -- 172.21.15.100:0/411321444 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c0c4f80 msgr2=0x7f9e2c1f2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.528+0000 7f9e3234d640 1 --2- 172.21.15.100:0/411321444 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c0c4f80 0x7f9e2c1f2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.528+0000 7f9e3234d640 1 -- 172.21.15.100:0/411321444 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e2c0c9dd0 msgr2=0x7f9e2c1e5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.528+0000 7f9e3234d640 1 --2- 172.21.15.100:0/411321444 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e2c0c9dd0 0x7f9e2c1e5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.528+0000 7f9e3234d640 1 -- 172.21.15.100:0/411321444 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e2c156220 con 0x7f9e2c152c70 2024-09-11T22:26:52.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.529+0000 7f9e3234d640 1 --2- 172.21.15.100:0/411321444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2c152c70 0x7f9e2c1eeb50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9e24034040 tx=0x7f9e24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:52.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.529+0000 7f9e227fc640 1 -- 172.21.15.100:0/411321444 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e24041020 con 0x7f9e2c152c70 2024-09-11T22:26:52.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.529+0000 7f9e227fc640 1 -- 172.21.15.100:0/411321444 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e240077a0 con 0x7f9e2c152c70 2024-09-11T22:26:52.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.529+0000 7f9e227fc640 1 -- 172.21.15.100:0/411321444 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e24036040 con 0x7f9e2c152c70 2024-09-11T22:26:52.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.529+0000 7f9e33db0640 1 -- 172.21.15.100:0/411321444 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e2c0ce4e0 con 0x7f9e2c152c70 2024-09-11T22:26:52.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.529+0000 7f9e33db0640 1 -- 172.21.15.100:0/411321444 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e2c155f40 con 0x7f9e2c152c70 2024-09-11T22:26:52.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.530+0000 7f9e33db0640 1 --2- 172.21.15.100:0/411321444 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c0ce030 0x7f9e2c1ef090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.530+0000 7f9e33db0640 1 -- 172.21.15.100:0/411321444 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9e2c155a30 con 0x7f9e2c0ce030 2024-09-11T22:26:52.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.530+0000 7f9e31b4c640 1 --2- 172.21.15.100:0/411321444 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c0ce030 0x7f9e2c1ef090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.530+0000 7f9e31b4c640 1 -- 172.21.15.100:0/411321444 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e2c0b3110 con 0x7f9e2c0ce030 2024-09-11T22:26:52.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.531+0000 7f9e227fc640 1 -- 172.21.15.100:0/411321444 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e24044020 con 0x7f9e2c152c70 2024-09-11T22:26:52.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.531+0000 7f9e31b4c640 1 --2- 172.21.15.100:0/411321444 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c0ce030 0x7f9e2c1ef090 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9e280118e0 tx=0x7f9e28011da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:52.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.531+0000 7f9e227fc640 1 --2- 172.21.15.100:0/411321444 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9e1006be30 0x7f9e1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.531+0000 7f9e227fc640 1 -- 172.21.15.100:0/411321444 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f9e240abdf0 con 0x7f9e2c152c70 2024-09-11T22:26:52.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.531+0000 7f9e3134b640 1 --2- 172.21.15.100:0/411321444 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9e1006be30 0x7f9e1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.531+0000 7f9e227fc640 1 -- 172.21.15.100:0/411321444 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e28019070 con 0x7f9e2c0ce030 2024-09-11T22:26:52.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.531+0000 7f9e227fc640 1 -- 172.21.15.100:0/411321444 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9e28004300 con 0x7f9e2c0ce030 2024-09-11T22:26:52.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.531+0000 7f9e227fc640 1 -- 172.21.15.100:0/411321444 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c0ce030 msgr2=0x7f9e2c1ef090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.531+0000 7f9e227fc640 1 --2- 172.21.15.100:0/411321444 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c0ce030 0x7f9e2c1ef090 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9e280118e0 tx=0x7f9e28011da0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.531+0000 7f9e227fc640 1 -- 172.21.15.100:0/411321444 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c0ce030 msgr2=0x7f9e2c1ef090 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:26:52.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.531+0000 7f9e227fc640 1 --2- 172.21.15.100:0/411321444 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c0ce030 0x7f9e2c1ef090 secure :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9e280118e0 tx=0x7f9e28011da0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.532+0000 7f9e3134b640 1 --2- 172.21.15.100:0/411321444 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9e1006be30 0x7f9e1006e2f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0b37d0 tx=0x7f9e1c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:52.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.538+0000 7f9e33db0640 1 --2- 172.21.15.100:0/411321444 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c14f730 0x7f9e2c1485a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.538+0000 7f9e33db0640 1 -- 172.21.15.100:0/411321444 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9e2c0c9820 con 0x7f9e2c14f730 2024-09-11T22:26:52.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.539+0000 7f9e31b4c640 1 --2- 172.21.15.100:0/411321444 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c14f730 0x7f9e2c1485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.539+0000 7f9e31b4c640 1 -- 172.21.15.100:0/411321444 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9e2c1ee490 con 0x7f9e2c14f730 2024-09-11T22:26:52.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.539+0000 7f9e31b4c640 1 --2- 172.21.15.100:0/411321444 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c14f730 0x7f9e2c1485a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9e280118e0 tx=0x7f9e280046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:52.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.539+0000 7f9e227fc640 1 -- 172.21.15.100:0/411321444 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e28019040 con 0x7f9e2c14f730 2024-09-11T22:26:52.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.540+0000 7f9e227fc640 1 -- 172.21.15.100:0/411321444 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7f9e28003da0 con 0x7f9e2c14f730 2024-09-11T22:26:52.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.540+0000 7f9e227fc640 1 -- 172.21.15.100:0/411321444 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c14f730 msgr2=0x7f9e2c1485a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.540+0000 7f9e227fc640 1 --2- 172.21.15.100:0/411321444 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c14f730 0x7f9e2c1485a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9e280118e0 tx=0x7f9e280046c0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.540+0000 7f9e227fc640 1 -- 172.21.15.100:0/411321444 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c14f730 msgr2=0x7f9e2c1485a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:26:52.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.540+0000 7f9e227fc640 1 --2- 172.21.15.100:0/411321444 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e2c14f730 0x7f9e2c1485a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.541 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:26:52.541 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:26:52.541 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:26:52.541 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:26:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 48, 2024-09-11T22:26:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 303261, 2024-09-11T22:26:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:26:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:26:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:26:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:26:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 12, 2024-09-11T22:26:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:26:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:26:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:26:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:52.542 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:26:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:26:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:52.543 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:26:52.544 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:26:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:26:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:26:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:26:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:26:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:26:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:26:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:26:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:26:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:26:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:26:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:26:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:26:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:26:52.545 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:26:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:26:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:26:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:26:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:26:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:26:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:26:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:26:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:26:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:26:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:26:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:26:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:26:52.546 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:26:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:26:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:26:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:26:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:26:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:52.547 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:26:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:26:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:26:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:52.548 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:26:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:26:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:26:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:52.549 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:26:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:26:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:26:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:26:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:26:52.550 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:26:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:26:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:26:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:26:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:26:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:26:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:26:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:52.551 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:26:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:26:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:26:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:26:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:26:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:26:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:26:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:52.552 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:26:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:26:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:26:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:26:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.553 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:26:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:26:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:26:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:26:52.554 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:26:52.555 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:26:52.555 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:26:52.555 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:26:52.555 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:26:52.555 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:26:52.555 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:26:52.555 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:26:52.555 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:26:52.555 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:26:52.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.540+0000 7f9e33db0640 1 -- 172.21.15.100:0/411321444 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9e1006be30 msgr2=0x7f9e1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.540+0000 7f9e33db0640 1 --2- 172.21.15.100:0/411321444 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9e1006be30 0x7f9e1006e2f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0b37d0 tx=0x7f9e1c009040 comp rx=0 tx=0).stop 2024-09-11T22:26:52.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.540+0000 7f9e33db0640 1 -- 172.21.15.100:0/411321444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2c152c70 msgr2=0x7f9e2c1eeb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.540+0000 7f9e33db0640 1 --2- 172.21.15.100:0/411321444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2c152c70 0x7f9e2c1eeb50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9e24034040 tx=0x7f9e24004a40 comp rx=0 tx=0).stop 2024-09-11T22:26:52.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.540+0000 7f9e3234d640 1 -- 172.21.15.100:0/411321444 reap_dead start 2024-09-11T22:26:52.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.540+0000 7f9e33db0640 1 -- 172.21.15.100:0/411321444 shutdown_connections 2024-09-11T22:26:52.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.540+0000 7f9e33db0640 1 --2- 172.21.15.100:0/411321444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2c152c70 0x7f9e2c1eeb50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.540+0000 7f9e33db0640 1 -- 172.21.15.100:0/411321444 >> 172.21.15.100:0/411321444 conn(0x7f9e2c06de20 msgr2=0x7f9e2c14cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:52.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.540+0000 7f9e33db0640 1 -- 172.21.15.100:0/411321444 shutdown_connections 2024-09-11T22:26:52.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.540+0000 7f9e33db0640 1 -- 172.21.15.100:0/411321444 wait complete. 2024-09-11T22:26:52.558 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:26:52.558 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-11T22:26:52.558 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-11T22:26:52.558 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-11T22:26:52.558 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:26:52.558 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T22:26:52.559 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:26:52.568 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T22:26:52.568 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-11T22:26:52.568 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:26:52.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.716+0000 7f2f06cf1640 1 Processor -- start 2024-09-11T22:26:52.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.716+0000 7f2f06cf1640 1 -- start start 2024-09-11T22:26:52.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.717+0000 7f2f06cf1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f00154c20 0x7f2f000cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.717+0000 7f2f06cf1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2f0015a7e0 0x7f2f000cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.717+0000 7f2f06cf1640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f0015ac90 con 0x7f2f000b3190 2024-09-11T22:26:52.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.717+0000 7f2f06cf1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f2f0015e000 con 0x7f2f0015a7e0 2024-09-11T22:26:52.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.717+0000 7f2f06cf1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2f0015af70 con 0x7f2f00154c20 2024-09-11T22:26:52.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.717+0000 7f2efffff640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f2f000b3190 legacy=0x7f2f0015e490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:26:52.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.717+0000 7f2f04a8d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f00154c20 0x7f2f000cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.718+0000 7f2f0528e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2f0015a7e0 0x7f2f000cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.718+0000 7f2f04a8d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f00154c20 0x7f2f000cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:51782/0 (socket says 172.21.15.100:51782) 2024-09-11T22:26:52.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.718+0000 7f2f04a8d640 1 -- 172.21.15.100:0/2579815305 learned_addr learned my addr 172.21.15.100:0/2579815305 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:52.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.718+0000 7f2f04a8d640 1 -- 172.21.15.100:0/2579815305 >> v2:172.21.15.167:3300/0 conn(0x7f2f0015a7e0 msgr2=0x7f2f000cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:26:52.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.718+0000 7f2f04a8d640 1 --2- 172.21.15.100:0/2579815305 >> v2:172.21.15.167:3300/0 conn(0x7f2f0015a7e0 0x7f2f000cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.718+0000 7f2f04a8d640 1 -- 172.21.15.100:0/2579815305 >> v1:172.21.15.100:6789/0 conn(0x7f2f000b3190 legacy=0x7f2f0015e490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:26:52.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.718+0000 7f2f04a8d640 1 -- 172.21.15.100:0/2579815305 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f0015b250 con 0x7f2f00154c20 2024-09-11T22:26:52.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.718+0000 7f2f0528e640 1 --2- 172.21.15.100:0/2579815305 >> v2:172.21.15.167:3300/0 conn(0x7f2f0015a7e0 0x7f2f000cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:26:52.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.719+0000 7f2f04a8d640 1 --2- 172.21.15.100:0/2579815305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f00154c20 0x7f2f000cb120 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4009870 tx=0x7f2ef402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7163291e84b9d20 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:52.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.719+0000 7f2eff7fe640 1 -- 172.21.15.100:0/2579815305 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4037070 con 0x7f2f00154c20 2024-09-11T22:26:52.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.719+0000 7f2eff7fe640 1 -- 172.21.15.100:0/2579815305 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef4032440 con 0x7f2f00154c20 2024-09-11T22:26:52.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.719+0000 7f2eff7fe640 1 -- 172.21.15.100:0/2579815305 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4032810 con 0x7f2f00154c20 2024-09-11T22:26:52.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.720+0000 7f2f06cf1640 1 -- 172.21.15.100:0/2579815305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f00154c20 msgr2=0x7f2f000cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.720+0000 7f2f06cf1640 1 --2- 172.21.15.100:0/2579815305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f00154c20 0x7f2f000cb120 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4009870 tx=0x7f2ef402a210 comp rx=0 tx=0).stop 2024-09-11T22:26:52.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.720+0000 7f2f06cf1640 1 -- 172.21.15.100:0/2579815305 shutdown_connections 2024-09-11T22:26:52.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.720+0000 7f2f06cf1640 1 --2- 172.21.15.100:0/2579815305 >> v2:172.21.15.167:3300/0 conn(0x7f2f0015a7e0 0x7f2f000cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.720+0000 7f2f06cf1640 1 --2- 172.21.15.100:0/2579815305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f00154c20 0x7f2f000cb120 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.720+0000 7f2f06cf1640 1 -- 172.21.15.100:0/2579815305 >> 172.21.15.100:0/2579815305 conn(0x7f2f00067d40 msgr2=0x7f2f0006d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:52.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.720+0000 7f2f06cf1640 1 -- 172.21.15.100:0/2579815305 shutdown_connections 2024-09-11T22:26:52.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.720+0000 7f2f06cf1640 1 -- 172.21.15.100:0/2579815305 wait complete. 2024-09-11T22:26:52.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.721+0000 7f2f06cf1640 1 Processor -- start 2024-09-11T22:26:52.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.721+0000 7f2f06cf1640 1 -- start start 2024-09-11T22:26:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.722+0000 7f2f06cf1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f000b3190 0x7f2f0015d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.722+0000 7f2f06cf1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f00154c20 0x7f2f00158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.722+0000 7f2f06cf1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f0015a7e0 0x7f2f001f45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.722+0000 7f2f06cf1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0015ed20 con 0x7f2f0015a7e0 2024-09-11T22:26:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.722+0000 7f2f06cf1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0015eba0 con 0x7f2f000b3190 2024-09-11T22:26:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.722+0000 7f2f06cf1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2f000cb660 con 0x7f2f00154c20 2024-09-11T22:26:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.723+0000 7f2f0528e640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f0015a7e0 msgr2=0x7f2f001f45d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:26:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.723+0000 7f2f0528e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f0015a7e0 0x7f2f001f45d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:26:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.723+0000 7f2f04a8d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f000b3190 0x7f2f0015d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.723+0000 7f2efffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f00154c20 0x7f2f00158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.723+0000 7f2f04a8d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f000b3190 0x7f2f0015d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:59594/0 (socket says 172.21.15.100:59594) 2024-09-11T22:26:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.723+0000 7f2f04a8d640 1 -- 172.21.15.100:0/391163491 learned_addr learned my addr 172.21.15.100:0/391163491 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.723+0000 7f2f04a8d640 1 -- 172.21.15.100:0/391163491 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f00154c20 msgr2=0x7f2f00158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.723+0000 7f2f04a8d640 1 --2- 172.21.15.100:0/391163491 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f00154c20 0x7f2f00158440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.723+0000 7f2f04a8d640 1 -- 172.21.15.100:0/391163491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f0015a7e0 msgr2=0x7f2f001f45d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:26:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.723+0000 7f2f04a8d640 1 --2- 172.21.15.100:0/391163491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f0015a7e0 0x7f2f001f45d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.723+0000 7f2f04a8d640 1 -- 172.21.15.100:0/391163491 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f0015bb20 con 0x7f2f000b3190 2024-09-11T22:26:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.723+0000 7f2efffff640 1 --2- 172.21.15.100:0/391163491 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f00154c20 0x7f2f00158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:26:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.723+0000 7f2f04a8d640 1 --2- 172.21.15.100:0/391163491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f000b3190 0x7f2f0015d980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4009870 tx=0x7f2ef40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.723+0000 7f2efd7fa640 1 -- 172.21.15.100:0/391163491 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4041020 con 0x7f2f000b3190 2024-09-11T22:26:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.724+0000 7f2efd7fa640 1 -- 172.21.15.100:0/391163491 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef4030640 con 0x7f2f000b3190 2024-09-11T22:26:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.724+0000 7f2f06cf1640 1 -- 172.21.15.100:0/391163491 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f0015bde0 con 0x7f2f000b3190 2024-09-11T22:26:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.724+0000 7f2efd7fa640 1 -- 172.21.15.100:0/391163491 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4037040 con 0x7f2f000b3190 2024-09-11T22:26:52.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.724+0000 7f2f06cf1640 1 -- 172.21.15.100:0/391163491 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f0015c3a0 con 0x7f2f000b3190 2024-09-11T22:26:52.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.725+0000 7f2f06cf1640 1 -- 172.21.15.100:0/391163491 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f000b4c40 con 0x7f2f000b3190 2024-09-11T22:26:52.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.725+0000 7f2efd7fa640 1 -- 172.21.15.100:0/391163491 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2ef4044020 con 0x7f2f000b3190 2024-09-11T22:26:52.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.726+0000 7f2efd7fa640 1 --2- 172.21.15.100:0/391163491 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2ee406bde0 0x7f2ee406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:52.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.726+0000 7f2efd7fa640 1 -- 172.21.15.100:0/391163491 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f2ef40ab620 con 0x7f2f000b3190 2024-09-11T22:26:52.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.726+0000 7f2efffff640 1 --2- 172.21.15.100:0/391163491 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2ee406bde0 0x7f2ee406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:52.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.726+0000 7f2efffff640 1 --2- 172.21.15.100:0/391163491 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2ee406bde0 0x7f2ee406e2a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2f00157aa0 tx=0x7f2eec006f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:52.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:52.729+0000 7f2efd7fa640 1 -- 172.21.15.100:0/391163491 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f000b4c40 con 0x7f2f000b3190 2024-09-11T22:26:53.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:53.016+0000 7f2f06cf1640 1 -- 172.21.15.100:0/391163491 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2f000cbaf0 con 0x7f2f000b3190 2024-09-11T22:26:53.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:53.017+0000 7f2efd7fa640 1 -- 172.21.15.100:0/391163491 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f2ef404b070 con 0x7f2f000b3190 2024-09-11T22:26:53.018 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":48,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:26:53.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:53.019+0000 7f2f06cf1640 1 -- 172.21.15.100:0/391163491 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2ee406bde0 msgr2=0x7f2ee406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:53.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:53.019+0000 7f2f06cf1640 1 --2- 172.21.15.100:0/391163491 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2ee406bde0 0x7f2ee406e2a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2f00157aa0 tx=0x7f2eec006f90 comp rx=0 tx=0).stop 2024-09-11T22:26:53.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:53.019+0000 7f2f06cf1640 1 -- 172.21.15.100:0/391163491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f000b3190 msgr2=0x7f2f0015d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:53.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:53.019+0000 7f2f06cf1640 1 --2- 172.21.15.100:0/391163491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f000b3190 0x7f2f0015d980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4009870 tx=0x7f2ef40046c0 comp rx=0 tx=0).stop 2024-09-11T22:26:53.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:53.019+0000 7f2f06cf1640 1 -- 172.21.15.100:0/391163491 shutdown_connections 2024-09-11T22:26:53.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:53.019+0000 7f2f06cf1640 1 --2- 172.21.15.100:0/391163491 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2ee406bde0 0x7f2ee406e2a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:53.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:53.019+0000 7f2f06cf1640 1 --2- 172.21.15.100:0/391163491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2f0015a7e0 0x7f2f001f45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:53.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:53.019+0000 7f2f06cf1640 1 --2- 172.21.15.100:0/391163491 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f00154c20 0x7f2f00158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:53.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:53.019+0000 7f2f06cf1640 1 --2- 172.21.15.100:0/391163491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f000b3190 0x7f2f0015d980 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:53.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:53.019+0000 7f2f06cf1640 1 -- 172.21.15.100:0/391163491 >> 172.21.15.100:0/391163491 conn(0x7f2f00067d40 msgr2=0x7f2f000b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:53.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:53.019+0000 7f2f06cf1640 1 -- 172.21.15.100:0/391163491 shutdown_connections 2024-09-11T22:26:53.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:53.019+0000 7f2f06cf1640 1 -- 172.21.15.100:0/391163491 wait complete. 2024-09-11T22:26:56.033 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:26:56.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.141+0000 7f9002ce4640 1 Processor -- start 2024-09-11T22:26:56.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.141+0000 7f9002ce4640 1 -- start start 2024-09-11T22:26:56.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.142+0000 7f9002ce4640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8ffc152a70 0x7f8ffc0c3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:56.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.142+0000 7f9002ce4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8ffc0c7e80 0x7f8ffc158930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:56.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.142+0000 7f9002ce4640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ffc0c6930 con 0x7f8ffc152690 2024-09-11T22:26:56.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.142+0000 7f9002ce4640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f8ffc0c4430 con 0x7f8ffc152a70 2024-09-11T22:26:56.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.142+0000 7f9002ce4640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f8ffc0c5000 con 0x7f8ffc0c7e80 2024-09-11T22:26:56.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.142+0000 7f8ffbfff640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f8ffc152a70 msgr2=0x7f8ffc0c3910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:26:56.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.142+0000 7f8ffbfff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8ffc152a70 0x7f8ffc0c3910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:26:56.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.143+0000 7f9001281640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8ffc0c7e80 0x7f8ffc158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:56.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.143+0000 7f9001281640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8ffc0c7e80 0x7f8ffc158930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:59606/0 (socket says 172.21.15.100:59606) 2024-09-11T22:26:56.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.143+0000 7f9001281640 1 -- 172.21.15.100:0/2262945811 learned_addr learned my addr 172.21.15.100:0/2262945811 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:56.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.143+0000 7f9000a80640 1 --1- 172.21.15.100:0/2262945811 >> v1:172.21.15.167:6789/0 conn(0x7f8ffc152690 0x7f8ffc0c6e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:59142/0 (socket says 172.21.15.100:59142) 2024-09-11T22:26:56.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.143+0000 7f9001281640 1 -- 172.21.15.100:0/2262945811 >> v2:172.21.15.100:3300/0 conn(0x7f8ffc152a70 msgr2=0x7f8ffc0c3910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:26:56.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.143+0000 7f9001281640 1 --2- 172.21.15.100:0/2262945811 >> v2:172.21.15.100:3300/0 conn(0x7f8ffc152a70 0x7f8ffc0c3910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:56.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.143+0000 7f9001281640 1 -- 172.21.15.100:0/2262945811 >> v1:172.21.15.167:6789/0 conn(0x7f8ffc152690 legacy=0x7f8ffc0c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:56.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.143+0000 7f9001281640 1 -- 172.21.15.100:0/2262945811 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ffc0c46d0 con 0x7f8ffc0c7e80 2024-09-11T22:26:56.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.144+0000 7f9001281640 1 --2- 172.21.15.100:0/2262945811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ffc0c7e80 0x7f8ffc158930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0742c0 tx=0x7f8ff402a7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7197033d1c88892 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:56.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.144+0000 7f8ffb7fe640 1 -- 172.21.15.100:0/2262945811 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4036070 con 0x7f8ffc0c7e80 2024-09-11T22:26:56.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.144+0000 7f8ffb7fe640 1 -- 172.21.15.100:0/2262945811 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff4031600 con 0x7f8ffc0c7e80 2024-09-11T22:26:56.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.144+0000 7f8ffb7fe640 1 -- 172.21.15.100:0/2262945811 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff40319d0 con 0x7f8ffc0c7e80 2024-09-11T22:26:56.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.145+0000 7f9002ce4640 1 -- 172.21.15.100:0/2262945811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ffc0c7e80 msgr2=0x7f8ffc158930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:56.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.145+0000 7f9002ce4640 1 --2- 172.21.15.100:0/2262945811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ffc0c7e80 0x7f8ffc158930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0742c0 tx=0x7f8ff402a7e0 comp rx=0 tx=0).stop 2024-09-11T22:26:56.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.145+0000 7f9002ce4640 1 -- 172.21.15.100:0/2262945811 shutdown_connections 2024-09-11T22:26:56.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.145+0000 7f9002ce4640 1 --2- 172.21.15.100:0/2262945811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ffc0c7e80 0x7f8ffc158930 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:56.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.145+0000 7f9002ce4640 1 --2- 172.21.15.100:0/2262945811 >> v2:172.21.15.100:3300/0 conn(0x7f8ffc152a70 0x7f8ffc0c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:56.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.145+0000 7f9002ce4640 1 -- 172.21.15.100:0/2262945811 >> 172.21.15.100:0/2262945811 conn(0x7f8ffc06e290 msgr2=0x7f8ffc06f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:56.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.145+0000 7f9002ce4640 1 -- 172.21.15.100:0/2262945811 shutdown_connections 2024-09-11T22:26:56.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.145+0000 7f9002ce4640 1 -- 172.21.15.100:0/2262945811 wait complete. 2024-09-11T22:26:56.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.147+0000 7f9002ce4640 1 Processor -- start 2024-09-11T22:26:56.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.147+0000 7f9002ce4640 1 -- start start 2024-09-11T22:26:56.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.148+0000 7f9002ce4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ffc0c7e80 0x7f8ffc15a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:56.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.148+0000 7f9002ce4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ffc152690 0x7f8ffc1530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:56.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.148+0000 7f9002ce4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ffc152a70 0x7f8ffc153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:56.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.148+0000 7f9002ce4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc0705a0 con 0x7f8ffc152a70 2024-09-11T22:26:56.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.148+0000 7f9002ce4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc0c4c90 con 0x7f8ffc0c7e80 2024-09-11T22:26:56.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.148+0000 7f9002ce4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8ffc0c6560 con 0x7f8ffc152690 2024-09-11T22:26:56.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.148+0000 7f9001281640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ffc152a70 msgr2=0x7f8ffc153630 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:26:56.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.148+0000 7f9001281640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ffc152a70 0x7f8ffc153630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:26:56.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.148+0000 7f8ffbfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ffc152690 0x7f8ffc1530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:56.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.148+0000 7f8ffbfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ffc152690 0x7f8ffc1530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:51794/0 (socket says 172.21.15.100:51794) 2024-09-11T22:26:56.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.148+0000 7f8ffbfff640 1 -- 172.21.15.100:0/1305958860 learned_addr learned my addr 172.21.15.100:0/1305958860 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:56.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.148+0000 7f9000a80640 1 --2- 172.21.15.100:0/1305958860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ffc0c7e80 0x7f8ffc15a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:56.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.149+0000 7f8ffbfff640 1 -- 172.21.15.100:0/1305958860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ffc0c7e80 msgr2=0x7f8ffc15a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:56.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.149+0000 7f8ffbfff640 1 --2- 172.21.15.100:0/1305958860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ffc0c7e80 0x7f8ffc15a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:56.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.149+0000 7f8ffbfff640 1 -- 172.21.15.100:0/1305958860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ffc152a70 msgr2=0x7f8ffc153630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:26:56.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.149+0000 7f8ffbfff640 1 --2- 172.21.15.100:0/1305958860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ffc152a70 0x7f8ffc153630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:56.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.149+0000 7f8ffbfff640 1 -- 172.21.15.100:0/1305958860 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ffc1598f0 con 0x7f8ffc152690 2024-09-11T22:26:56.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.149+0000 7f8ffbfff640 1 --2- 172.21.15.100:0/1305958860 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ffc152690 0x7f8ffc1530f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800b510 tx=0x7f8fe800b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:56.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.149+0000 7f8ff97fa640 1 -- 172.21.15.100:0/1305958860 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8003d90 con 0x7f8ffc152690 2024-09-11T22:26:56.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.149+0000 7f8ff97fa640 1 -- 172.21.15.100:0/1305958860 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe8015070 con 0x7f8ffc152690 2024-09-11T22:26:56.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.149+0000 7f8ff97fa640 1 -- 172.21.15.100:0/1305958860 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe80052b0 con 0x7f8ffc152690 2024-09-11T22:26:56.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.150+0000 7f9002ce4640 1 -- 172.21.15.100:0/1305958860 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ffc159bd0 con 0x7f8ffc152690 2024-09-11T22:26:56.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.150+0000 7f9002ce4640 1 -- 172.21.15.100:0/1305958860 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ffc072140 con 0x7f8ffc152690 2024-09-11T22:26:56.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.152+0000 7f9002ce4640 1 -- 172.21.15.100:0/1305958860 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ffc0c3910 con 0x7f8ffc152690 2024-09-11T22:26:56.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.153+0000 7f8ff97fa640 1 -- 172.21.15.100:0/1305958860 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8fe8005450 con 0x7f8ffc152690 2024-09-11T22:26:56.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.153+0000 7f8ff97fa640 1 --2- 172.21.15.100:0/1305958860 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8fe006be60 0x7f8fe006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:56.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.153+0000 7f8ff97fa640 1 -- 172.21.15.100:0/1305958860 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f8fe808b160 con 0x7f8ffc152690 2024-09-11T22:26:56.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.153+0000 7f9000a80640 1 --2- 172.21.15.100:0/1305958860 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8fe006be60 0x7f8fe006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:56.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.154+0000 7f9000a80640 1 --2- 172.21.15.100:0/1305958860 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8fe006be60 0x7f8fe006e320 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0007fd0 tx=0x7f8ff0007e80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:56.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.157+0000 7f8ff97fa640 1 -- 172.21.15.100:0/1305958860 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8fe8059760 con 0x7f8ffc152690 2024-09-11T22:26:56.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.418+0000 7f9002ce4640 1 -- 172.21.15.100:0/1305958860 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8ffc155fb0 con 0x7f8ffc152690 2024-09-11T22:26:56.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.419+0000 7f8ff97fa640 1 -- 172.21.15.100:0/1305958860 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f8fe8059060 con 0x7f8ffc152690 2024-09-11T22:26:56.420 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":48,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:26:56.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.423+0000 7f9002ce4640 1 -- 172.21.15.100:0/1305958860 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8fe006be60 msgr2=0x7f8fe006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:56.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.423+0000 7f9002ce4640 1 --2- 172.21.15.100:0/1305958860 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8fe006be60 0x7f8fe006e320 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0007fd0 tx=0x7f8ff0007e80 comp rx=0 tx=0).stop 2024-09-11T22:26:56.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.423+0000 7f9002ce4640 1 -- 172.21.15.100:0/1305958860 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ffc152690 msgr2=0x7f8ffc1530f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:56.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.423+0000 7f9002ce4640 1 --2- 172.21.15.100:0/1305958860 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ffc152690 0x7f8ffc1530f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800b510 tx=0x7f8fe800b9d0 comp rx=0 tx=0).stop 2024-09-11T22:26:56.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.423+0000 7f9002ce4640 1 -- 172.21.15.100:0/1305958860 shutdown_connections 2024-09-11T22:26:56.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.423+0000 7f9002ce4640 1 --2- 172.21.15.100:0/1305958860 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8fe006be60 0x7f8fe006e320 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:56.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.423+0000 7f9002ce4640 1 --2- 172.21.15.100:0/1305958860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ffc152a70 0x7f8ffc153630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:56.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.423+0000 7f9002ce4640 1 --2- 172.21.15.100:0/1305958860 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ffc152690 0x7f8ffc1530f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:56.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.423+0000 7f9002ce4640 1 --2- 172.21.15.100:0/1305958860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ffc0c7e80 0x7f8ffc15a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:56.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.423+0000 7f9002ce4640 1 -- 172.21.15.100:0/1305958860 >> 172.21.15.100:0/1305958860 conn(0x7f8ffc06e290 msgr2=0x7f8ffc0cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:56.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.423+0000 7f9002ce4640 1 -- 172.21.15.100:0/1305958860 shutdown_connections 2024-09-11T22:26:56.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:56.423+0000 7f9002ce4640 1 -- 172.21.15.100:0/1305958860 wait complete. 2024-09-11T22:26:59.437 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:26:59.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.544+0000 7ff1007bd640 1 Processor -- start 2024-09-11T22:26:59.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.544+0000 7ff1007bd640 1 -- start start 2024-09-11T22:26:59.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.545+0000 7ff1007bd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff0f8154c20 0x7ff0f80cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:59.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.545+0000 7ff1007bd640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0f815ac90 con 0x7ff0f815a7e0 2024-09-11T22:26:59.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.545+0000 7ff1007bd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0f815af70 con 0x7ff0f80b3190 2024-09-11T22:26:59.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.545+0000 7ff1007bd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7ff0f815e000 con 0x7ff0f8154c20 2024-09-11T22:26:59.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.545+0000 7ff0fed5a640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7ff0f815a7e0 legacy=0x7ff0f80cbd10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:26:59.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.545+0000 7ff0fe559640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff0f8154c20 0x7ff0f80cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:59.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.545+0000 7ff0fdd58640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ff0f80b3190 0x7ff0f815e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:59154/0 (socket says 172.21.15.100:59154) 2024-09-11T22:26:59.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.545+0000 7ff0fdd58640 1 -- 172.21.15.100:0/2219678860 learned_addr learned my addr 172.21.15.100:0/2219678860 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:26:59.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.545+0000 7ff0fe559640 1 -- 172.21.15.100:0/2219678860 >> v1:172.21.15.167:6789/0 conn(0x7ff0f80b3190 legacy=0x7ff0f815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:59.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.545+0000 7ff0fe559640 1 -- 172.21.15.100:0/2219678860 >> v1:172.21.15.100:6789/0 conn(0x7ff0f815a7e0 legacy=0x7ff0f80cbd10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:26:59.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.545+0000 7ff0fe559640 1 -- 172.21.15.100:0/2219678860 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f815b250 con 0x7ff0f8154c20 2024-09-11T22:26:59.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.546+0000 7ff0fe559640 1 --2- 172.21.15.100:0/2219678860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0f8154c20 0x7ff0f80cb120 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff0f815e180 tx=0x7ff0f402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eecfa566c9ad4bdf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:59.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.546+0000 7ff0fd557640 1 -- 172.21.15.100:0/2219678860 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4037070 con 0x7ff0f8154c20 2024-09-11T22:26:59.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.546+0000 7ff0fd557640 1 -- 172.21.15.100:0/2219678860 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f4032440 con 0x7ff0f8154c20 2024-09-11T22:26:59.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.546+0000 7ff0fd557640 1 -- 172.21.15.100:0/2219678860 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4032810 con 0x7ff0f8154c20 2024-09-11T22:26:59.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.547+0000 7ff1007bd640 1 -- 172.21.15.100:0/2219678860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0f8154c20 msgr2=0x7ff0f80cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:59.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.547+0000 7ff1007bd640 1 --2- 172.21.15.100:0/2219678860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0f8154c20 0x7ff0f80cb120 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff0f815e180 tx=0x7ff0f402a1c0 comp rx=0 tx=0).stop 2024-09-11T22:26:59.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.547+0000 7ff1007bd640 1 -- 172.21.15.100:0/2219678860 shutdown_connections 2024-09-11T22:26:59.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.547+0000 7ff1007bd640 1 --2- 172.21.15.100:0/2219678860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0f8154c20 0x7ff0f80cb120 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:59.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.547+0000 7ff1007bd640 1 -- 172.21.15.100:0/2219678860 >> 172.21.15.100:0/2219678860 conn(0x7ff0f8067d40 msgr2=0x7ff0f806d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:59.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.547+0000 7ff1007bd640 1 -- 172.21.15.100:0/2219678860 shutdown_connections 2024-09-11T22:26:59.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.547+0000 7ff1007bd640 1 -- 172.21.15.100:0/2219678860 wait complete. 2024-09-11T22:26:59.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.548+0000 7ff1007bd640 1 Processor -- start 2024-09-11T22:26:59.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.548+0000 7ff1007bd640 1 -- start start 2024-09-11T22:26:59.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.549+0000 7ff1007bd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0f80b3190 0x7ff0f80b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:59.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.549+0000 7ff1007bd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0f8154c20 0x7ff0f8149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:59.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.549+0000 7ff1007bd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0f815a7e0 0x7ff0f8149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:59.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.549+0000 7ff1007bd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f815ed20 con 0x7ff0f815a7e0 2024-09-11T22:26:59.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.549+0000 7ff1007bd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f815eba0 con 0x7ff0f8154c20 2024-09-11T22:26:59.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.549+0000 7ff1007bd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f80cc420 con 0x7ff0f80b3190 2024-09-11T22:26:59.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.549+0000 7ff0fed5a640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0f815a7e0 msgr2=0x7ff0f8149cc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:26:59.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.549+0000 7ff0fed5a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0f815a7e0 0x7ff0f8149cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:26:59.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.550+0000 7ff0fdd58640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0f8154c20 0x7ff0f8149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:59.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.550+0000 7ff0fdd58640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0f8154c20 0x7ff0f8149780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:59640/0 (socket says 172.21.15.100:59640) 2024-09-11T22:26:59.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.550+0000 7ff0fdd58640 1 -- 172.21.15.100:0/3583277058 learned_addr learned my addr 172.21.15.100:0/3583277058 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:26:59.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.550+0000 7ff0fe559640 1 --2- 172.21.15.100:0/3583277058 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0f80b3190 0x7ff0f80b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:59.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.550+0000 7ff0fdd58640 1 -- 172.21.15.100:0/3583277058 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0f80b3190 msgr2=0x7ff0f80b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:59.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.550+0000 7ff0fdd58640 1 --2- 172.21.15.100:0/3583277058 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0f80b3190 0x7ff0f80b5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:59.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.550+0000 7ff0fdd58640 1 -- 172.21.15.100:0/3583277058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0f815a7e0 msgr2=0x7ff0f8149cc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:26:59.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.550+0000 7ff0fdd58640 1 --2- 172.21.15.100:0/3583277058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0f815a7e0 0x7ff0f8149cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:59.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.550+0000 7ff0fdd58640 1 -- 172.21.15.100:0/3583277058 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f81e3e50 con 0x7ff0f8154c20 2024-09-11T22:26:59.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.550+0000 7ff0fdd58640 1 --2- 172.21.15.100:0/3583277058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0f8154c20 0x7ff0f8149780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff0e800c400 tx=0x7ff0e800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:59.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.550+0000 7ff0eeffd640 1 -- 172.21.15.100:0/3583277058 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8017070 con 0x7ff0f8154c20 2024-09-11T22:26:59.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.550+0000 7ff0eeffd640 1 -- 172.21.15.100:0/3583277058 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e8005ce0 con 0x7ff0f8154c20 2024-09-11T22:26:59.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.550+0000 7ff0eeffd640 1 -- 172.21.15.100:0/3583277058 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e80072f0 con 0x7ff0f8154c20 2024-09-11T22:26:59.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.550+0000 7ff1007bd640 1 -- 172.21.15.100:0/3583277058 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f81e40f0 con 0x7ff0f8154c20 2024-09-11T22:26:59.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.550+0000 7ff1007bd640 1 -- 172.21.15.100:0/3583277058 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f81e4690 con 0x7ff0f8154c20 2024-09-11T22:26:59.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.551+0000 7ff1007bd640 1 -- 172.21.15.100:0/3583277058 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0f814eca0 con 0x7ff0f8154c20 2024-09-11T22:26:59.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.552+0000 7ff0eeffd640 1 -- 172.21.15.100:0/3583277058 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0e801a070 con 0x7ff0f8154c20 2024-09-11T22:26:59.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.552+0000 7ff0eeffd640 1 --2- 172.21.15.100:0/3583277058 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff0dc06bde0 0x7ff0dc06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:26:59.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.553+0000 7ff0fe559640 1 --2- 172.21.15.100:0/3583277058 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff0dc06bde0 0x7ff0dc06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:26:59.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.553+0000 7ff0eeffd640 1 -- 172.21.15.100:0/3583277058 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7ff0e808a580 con 0x7ff0f8154c20 2024-09-11T22:26:59.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.553+0000 7ff0fe559640 1 --2- 172.21.15.100:0/3583277058 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff0dc06bde0 0x7ff0dc06e2a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4034000 tx=0x7ff0f402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:26:59.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.557+0000 7ff0eeffd640 1 -- 172.21.15.100:0/3583277058 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff0e80584b0 con 0x7ff0f8154c20 2024-09-11T22:26:59.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.842+0000 7ff1007bd640 1 -- 172.21.15.100:0/3583277058 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff0f80cbaf0 con 0x7ff0f8154c20 2024-09-11T22:26:59.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.843+0000 7ff0eeffd640 1 -- 172.21.15.100:0/3583277058 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7ff0e805c7b0 con 0x7ff0f8154c20 2024-09-11T22:26:59.844 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":48,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:26:59.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.845+0000 7ff1007bd640 1 -- 172.21.15.100:0/3583277058 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff0dc06bde0 msgr2=0x7ff0dc06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:59.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.845+0000 7ff1007bd640 1 --2- 172.21.15.100:0/3583277058 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff0dc06bde0 0x7ff0dc06e2a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4034000 tx=0x7ff0f402e000 comp rx=0 tx=0).stop 2024-09-11T22:26:59.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.845+0000 7ff1007bd640 1 -- 172.21.15.100:0/3583277058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0f8154c20 msgr2=0x7ff0f8149780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:26:59.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.845+0000 7ff1007bd640 1 --2- 172.21.15.100:0/3583277058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0f8154c20 0x7ff0f8149780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff0e800c400 tx=0x7ff0e800c8c0 comp rx=0 tx=0).stop 2024-09-11T22:26:59.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.845+0000 7ff1007bd640 1 -- 172.21.15.100:0/3583277058 shutdown_connections 2024-09-11T22:26:59.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.845+0000 7ff1007bd640 1 --2- 172.21.15.100:0/3583277058 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff0dc06bde0 0x7ff0dc06e2a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:59.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.845+0000 7ff1007bd640 1 --2- 172.21.15.100:0/3583277058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0f815a7e0 0x7ff0f8149cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:59.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.845+0000 7ff1007bd640 1 --2- 172.21.15.100:0/3583277058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0f8154c20 0x7ff0f8149780 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:59.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.845+0000 7ff1007bd640 1 --2- 172.21.15.100:0/3583277058 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0f80b3190 0x7ff0f80b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:26:59.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.845+0000 7ff1007bd640 1 -- 172.21.15.100:0/3583277058 >> 172.21.15.100:0/3583277058 conn(0x7ff0f8067d40 msgr2=0x7ff0f81e6030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:26:59.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.845+0000 7ff1007bd640 1 -- 172.21.15.100:0/3583277058 shutdown_connections 2024-09-11T22:26:59.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:26:59.845+0000 7ff1007bd640 1 -- 172.21.15.100:0/3583277058 wait complete. 2024-09-11T22:27:02.858 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:27:02.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:02.962+0000 7f22ddd6d640 1 Processor -- start 2024-09-11T22:27:02.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:02.962+0000 7f22ddd6d640 1 -- start start 2024-09-11T22:27:02.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:02.963+0000 7f22ddd6d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f22d80c8570 0x7f22d80c0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:02.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:02.963+0000 7f22ddd6d640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d80c1ec0 con 0x7f22d80c2de0 2024-09-11T22:27:02.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:02.963+0000 7f22ddd6d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d8071f50 con 0x7f22d8151ae0 2024-09-11T22:27:02.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:02.963+0000 7f22ddd6d640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f22d8072230 con 0x7f22d80c8570 2024-09-11T22:27:02.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:02.963+0000 7f22d6ffd640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f22d80c8570 msgr2=0x7f22d80c0f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:27:02.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:02.963+0000 7f22d7fff640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f22d80c2de0 legacy=0x7f22d806bc10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:27:02.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:02.963+0000 7f22d6ffd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f22d80c8570 0x7f22d80c0f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:27:02.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:02.963+0000 7f22d77fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f22d8151ae0 0x7f22d8071780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:54216/0 (socket says 172.21.15.100:54216) 2024-09-11T22:27:02.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:02.963+0000 7f22d77fe640 1 -- 172.21.15.100:0/1668861281 learned_addr learned my addr 172.21.15.100:0/1668861281 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:27:03.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:03.164+0000 7f22d6ffd640 1 -- 172.21.15.100:0/1668861281 >> v2:172.21.15.100:3300/0 conn(0x7f22d80c8570 msgr2=0x7f22d80c0f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:27:03.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:03.164+0000 7f22d7fff640 1 -- 172.21.15.100:0/1668861281 >> v1:172.21.15.100:6789/0 conn(0x7f22d80c2de0 legacy=0x7f22d806bc10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:27:03.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:03.164+0000 7f22d6ffd640 1 --2- 172.21.15.100:0/1668861281 >> v2:172.21.15.100:3300/0 conn(0x7f22d80c8570 0x7f22d80c0f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:27:03.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:03.565+0000 7f22d7fff640 1 -- 172.21.15.100:0/1668861281 >> v1:172.21.15.100:6789/0 conn(0x7f22d80c2de0 legacy=0x7f22d806bc10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:27:03.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:03.565+0000 7f22d6ffd640 1 -- 172.21.15.100:0/1668861281 >> v2:172.21.15.100:3300/0 conn(0x7f22d80c8570 msgr2=0x7f22d80c0f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:27:03.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:03.565+0000 7f22d6ffd640 1 --2- 172.21.15.100:0/1668861281 >> v2:172.21.15.100:3300/0 conn(0x7f22d80c8570 0x7f22d80c0f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:27:04.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:04.365+0000 7f22d7fff640 1 -- 172.21.15.100:0/1668861281 >> v1:172.21.15.100:6789/0 conn(0x7f22d80c2de0 legacy=0x7f22d806bc10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:27:04.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:04.365+0000 7f22d6ffd640 1 -- 172.21.15.100:0/1668861281 >> v2:172.21.15.100:3300/0 conn(0x7f22d80c8570 msgr2=0x7f22d80c0f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:27:04.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:04.365+0000 7f22d6ffd640 1 --2- 172.21.15.100:0/1668861281 >> v2:172.21.15.100:3300/0 conn(0x7f22d80c8570 0x7f22d80c0f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:27:05.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:05.963+0000 7f22d57fa640 1 -- 172.21.15.100:0/1668861281 >> v2:172.21.15.100:3300/0 conn(0x7f22d80c8570 msgr2=0x7f22d80c0f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:27:05.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:05.963+0000 7f22d57fa640 1 --2- 172.21.15.100:0/1668861281 >> v2:172.21.15.100:3300/0 conn(0x7f22d80c8570 0x7f22d80c0f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:05.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:05.963+0000 7f22d57fa640 1 -- 172.21.15.100:0/1668861281 >> v1:172.21.15.167:6789/0 conn(0x7f22d8151ae0 legacy=0x7f22d8071780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:05.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:05.963+0000 7f22d57fa640 1 -- 172.21.15.100:0/1668861281 >> v1:172.21.15.100:6789/0 conn(0x7f22d80c2de0 legacy=0x7f22d806bc10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:27:05.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:05.963+0000 7f22d57fa640 1 --2- 172.21.15.100:0/1668861281 >> v2:172.21.15.167:3300/0 conn(0x7f22c40036c0 0x7f22c4005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:05.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:05.963+0000 7f22d57fa640 1 --2- 172.21.15.100:0/1668861281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22c4006110 0x7f22c40085d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:05.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:05.963+0000 7f22d57fa640 1 -- 172.21.15.100:0/1668861281 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f22d8072230 con 0x7f22c40036c0 2024-09-11T22:27:05.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:05.963+0000 7f22d57fa640 1 -- 172.21.15.100:0/1668861281 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f22c4008cf0 con 0x7f22c4006110 2024-09-11T22:27:05.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:05.964+0000 7f22d77fe640 1 --2- 172.21.15.100:0/1668861281 >> v2:172.21.15.167:3300/0 conn(0x7f22c40036c0 0x7f22c4005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:05.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:05.964+0000 7f22d77fe640 1 -- 172.21.15.100:0/1668861281 >> v2:172.21.15.167:3300/0 conn(0x7f22c40036c0 msgr2=0x7f22c4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:27:05.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:05.964+0000 7f22d77fe640 1 -- 172.21.15.100:0/1668861281 >> v2:172.21.15.167:3300/0 conn(0x7f22c40036c0 msgr2=0x7f22c4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:27:05.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:05.964+0000 7f22d77fe640 1 --2- 172.21.15.100:0/1668861281 >> v2:172.21.15.167:3300/0 conn(0x7f22c40036c0 0x7f22c4005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:05.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:05.964+0000 7f22d77fe640 1 --2- 172.21.15.100:0/1668861281 >> v2:172.21.15.167:3300/0 conn(0x7f22c40036c0 0x7f22c4005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:27:05.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:05.964+0000 7f22d6ffd640 1 --2- 172.21.15.100:0/1668861281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22c4006110 0x7f22c40085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:05.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:05.964+0000 7f22d6ffd640 1 -- 172.21.15.100:0/1668861281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22c4006110 msgr2=0x7f22c40085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:27:05.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:05.964+0000 7f22d6ffd640 1 -- 172.21.15.100:0/1668861281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22c4006110 msgr2=0x7f22c40085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:27:05.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:05.964+0000 7f22d6ffd640 1 --2- 172.21.15.100:0/1668861281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22c4006110 0x7f22c40085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:05.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:05.964+0000 7f22d6ffd640 1 --2- 172.21.15.100:0/1668861281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22c4006110 0x7f22c40085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:27:06.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:06.165+0000 7f22d6ffd640 1 --2- 172.21.15.100:0/1668861281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22c4006110 0x7f22c40085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:06.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:06.165+0000 7f22d77fe640 1 --2- 172.21.15.100:0/1668861281 >> v2:172.21.15.167:3300/0 conn(0x7f22c40036c0 0x7f22c4005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:06.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:06.166+0000 7f22d6ffd640 1 -- 172.21.15.100:0/1668861281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22c4006110 msgr2=0x7f22c40085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:27:06.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:06.166+0000 7f22d6ffd640 1 -- 172.21.15.100:0/1668861281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22c4006110 msgr2=0x7f22c40085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:27:06.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:06.166+0000 7f22d6ffd640 1 --2- 172.21.15.100:0/1668861281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22c4006110 0x7f22c40085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:06.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:06.166+0000 7f22d6ffd640 1 --2- 172.21.15.100:0/1668861281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22c4006110 0x7f22c40085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:27:06.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:06.166+0000 7f22d77fe640 1 -- 172.21.15.100:0/1668861281 >> v2:172.21.15.167:3300/0 conn(0x7f22c40036c0 msgr2=0x7f22c4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:27:06.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:06.166+0000 7f22d77fe640 1 -- 172.21.15.100:0/1668861281 >> v2:172.21.15.167:3300/0 conn(0x7f22c40036c0 msgr2=0x7f22c4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:27:06.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:06.166+0000 7f22d77fe640 1 --2- 172.21.15.100:0/1668861281 >> v2:172.21.15.167:3300/0 conn(0x7f22c40036c0 0x7f22c4005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:06.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:06.166+0000 7f22d77fe640 1 --2- 172.21.15.100:0/1668861281 >> v2:172.21.15.167:3300/0 conn(0x7f22c40036c0 0x7f22c4005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:27:06.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:06.567+0000 7f22d6ffd640 1 --2- 172.21.15.100:0/1668861281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22c4006110 0x7f22c40085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:06.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:06.567+0000 7f22d77fe640 1 --2- 172.21.15.100:0/1668861281 >> v2:172.21.15.167:3300/0 conn(0x7f22c40036c0 0x7f22c4005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:06.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:06.567+0000 7f22d77fe640 1 -- 172.21.15.100:0/1668861281 >> v2:172.21.15.167:3300/0 conn(0x7f22c40036c0 msgr2=0x7f22c4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:27:06.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:06.567+0000 7f22d77fe640 1 -- 172.21.15.100:0/1668861281 >> v2:172.21.15.167:3300/0 conn(0x7f22c40036c0 msgr2=0x7f22c4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:27:06.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:06.567+0000 7f22d77fe640 1 --2- 172.21.15.100:0/1668861281 >> v2:172.21.15.167:3300/0 conn(0x7f22c40036c0 0x7f22c4005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:06.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:06.567+0000 7f22d6ffd640 1 -- 172.21.15.100:0/1668861281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22c4006110 msgr2=0x7f22c40085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:27:06.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:06.567+0000 7f22d77fe640 1 --2- 172.21.15.100:0/1668861281 >> v2:172.21.15.167:3300/0 conn(0x7f22c40036c0 0x7f22c4005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:27:06.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:06.567+0000 7f22d6ffd640 1 -- 172.21.15.100:0/1668861281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22c4006110 msgr2=0x7f22c40085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:27:06.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:06.567+0000 7f22d6ffd640 1 --2- 172.21.15.100:0/1668861281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22c4006110 0x7f22c40085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:06.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:06.567+0000 7f22d6ffd640 1 --2- 172.21.15.100:0/1668861281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22c4006110 0x7f22c40085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:27:07.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.368+0000 7f22d6ffd640 1 --2- 172.21.15.100:0/1668861281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22c4006110 0x7f22c40085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:07.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.368+0000 7f22d77fe640 1 --2- 172.21.15.100:0/1668861281 >> v2:172.21.15.167:3300/0 conn(0x7f22c40036c0 0x7f22c4005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:07.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.368+0000 7f22d6ffd640 1 -- 172.21.15.100:0/1668861281 >> v2:172.21.15.167:3300/0 conn(0x7f22c40036c0 msgr2=0x7f22c4005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:27:07.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.368+0000 7f22d6ffd640 1 --2- 172.21.15.100:0/1668861281 >> v2:172.21.15.167:3300/0 conn(0x7f22c40036c0 0x7f22c4005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.368+0000 7f22d6ffd640 1 -- 172.21.15.100:0/1668861281 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d80c2160 con 0x7f22c4006110 2024-09-11T22:27:07.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.368+0000 7f22d77fe640 1 --2- 172.21.15.100:0/1668861281 >> v2:172.21.15.167:3300/0 conn(0x7f22c40036c0 0x7f22c4005b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:27:07.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.369+0000 7f22d6ffd640 1 --2- 172.21.15.100:0/1668861281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22c4006110 0x7f22c40085d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f22cc003fd0 tx=0x7f22cc02add0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca85478cbe262f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:07.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.370+0000 7f22d67fc640 1 -- 172.21.15.100:0/1668861281 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc02bba0 con 0x7f22c4006110 2024-09-11T22:27:07.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.370+0000 7f22d67fc640 1 -- 172.21.15.100:0/1668861281 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22cc02f070 con 0x7f22c4006110 2024-09-11T22:27:07.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.370+0000 7f22d67fc640 1 -- 172.21.15.100:0/1668861281 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc033410 con 0x7f22c4006110 2024-09-11T22:27:07.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.370+0000 7f22ddd6d640 1 -- 172.21.15.100:0/1668861281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22c4006110 msgr2=0x7f22c40085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:07.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.370+0000 7f22ddd6d640 1 --2- 172.21.15.100:0/1668861281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22c4006110 0x7f22c40085d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f22cc003fd0 tx=0x7f22cc02add0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.370+0000 7f22d7fff640 1 -- 172.21.15.100:0/1668861281 reap_dead start 2024-09-11T22:27:07.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.370+0000 7f22ddd6d640 1 -- 172.21.15.100:0/1668861281 shutdown_connections 2024-09-11T22:27:07.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.370+0000 7f22ddd6d640 1 -- 172.21.15.100:0/1668861281 >> 172.21.15.100:0/1668861281 conn(0x7f22d80cbf70 msgr2=0x7f22d80cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:07.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.370+0000 7f22ddd6d640 1 -- 172.21.15.100:0/1668861281 shutdown_connections 2024-09-11T22:27:07.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.370+0000 7f22ddd6d640 1 -- 172.21.15.100:0/1668861281 wait complete. 2024-09-11T22:27:07.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.372+0000 7f22ddd6d640 1 Processor -- start 2024-09-11T22:27:07.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.372+0000 7f22ddd6d640 1 -- start start 2024-09-11T22:27:07.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.372+0000 7f22ddd6d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c4006110 0x7f22d81534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:07.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.373+0000 7f22ddd6d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22d8153a00 0x7f22d8152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.373+0000 7f22ddd6d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22d8152760 0x7f22d8144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.373+0000 7f22ddd6d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f22d806c320 con 0x7f22c4006110 2024-09-11T22:27:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.373+0000 7f22ddd6d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f22d80c2720 con 0x7f22d8153a00 2024-09-11T22:27:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.373+0000 7f22ddd6d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f22d806c4a0 con 0x7f22d8152760 2024-09-11T22:27:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.373+0000 7f22d77fe640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c4006110 msgr2=0x7f22d81534c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:27:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.373+0000 7f22d77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c4006110 0x7f22d81534c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:27:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.373+0000 7f22d6ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22d8153a00 0x7f22d8152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.373+0000 7f22d7fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22d8152760 0x7f22d8144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.373+0000 7f22d6ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22d8153a00 0x7f22d8152220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:39696/0 (socket says 172.21.15.100:39696) 2024-09-11T22:27:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.373+0000 7f22d6ffd640 1 -- 172.21.15.100:0/2519461235 learned_addr learned my addr 172.21.15.100:0/2519461235 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.373+0000 7f22d6ffd640 1 -- 172.21.15.100:0/2519461235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22d8152760 msgr2=0x7f22d8144ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.373+0000 7f22d6ffd640 1 --2- 172.21.15.100:0/2519461235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22d8152760 0x7f22d8144ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.373+0000 7f22d6ffd640 1 -- 172.21.15.100:0/2519461235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c4006110 msgr2=0x7f22d81534c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:27:07.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.373+0000 7f22d6ffd640 1 --2- 172.21.15.100:0/2519461235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c4006110 0x7f22d81534c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.373+0000 7f22d6ffd640 1 -- 172.21.15.100:0/2519461235 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d81ed060 con 0x7f22d8153a00 2024-09-11T22:27:07.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.373+0000 7f22d6ffd640 1 --2- 172.21.15.100:0/2519461235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22d8153a00 0x7f22d8152220 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f22cc02ae10 tx=0x7f22cc005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:07.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.373+0000 7f22bffff640 1 -- 172.21.15.100:0/2519461235 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc043020 con 0x7f22d8153a00 2024-09-11T22:27:07.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.373+0000 7f22bffff640 1 -- 172.21.15.100:0/2519461235 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22cc03f470 con 0x7f22d8153a00 2024-09-11T22:27:07.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.373+0000 7f22bffff640 1 -- 172.21.15.100:0/2519461235 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc003b40 con 0x7f22d8153a00 2024-09-11T22:27:07.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.373+0000 7f22ddd6d640 1 -- 172.21.15.100:0/2519461235 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22d8154cc0 con 0x7f22d8153a00 2024-09-11T22:27:07.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.374+0000 7f22ddd6d640 1 -- 172.21.15.100:0/2519461235 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22d8154420 con 0x7f22d8153a00 2024-09-11T22:27:07.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.375+0000 7f22ddd6d640 1 -- 172.21.15.100:0/2519461235 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22d8068db0 con 0x7f22d8153a00 2024-09-11T22:27:07.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.375+0000 7f22bffff640 1 -- 172.21.15.100:0/2519461235 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f22cc046020 con 0x7f22d8153a00 2024-09-11T22:27:07.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.376+0000 7f22bffff640 1 --2- 172.21.15.100:0/2519461235 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f22c406cc20 0x7f22c406f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:07.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.376+0000 7f22bffff640 1 -- 172.21.15.100:0/2519461235 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f22cc0ac0d0 con 0x7f22d8153a00 2024-09-11T22:27:07.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.376+0000 7f22d77fe640 1 --2- 172.21.15.100:0/2519461235 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f22c406cc20 0x7f22c406f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:07.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.376+0000 7f22d77fe640 1 --2- 172.21.15.100:0/2519461235 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f22c406cc20 0x7f22c406f0e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f22c8000c00 tx=0x7f22c8001190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:07.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.380+0000 7f22bffff640 1 -- 172.21.15.100:0/2519461235 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f22d8068db0 con 0x7f22d8153a00 2024-09-11T22:27:07.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.643+0000 7f22ddd6d640 1 -- 172.21.15.100:0/2519461235 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f22d806bc10 con 0x7f22d8153a00 2024-09-11T22:27:07.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.644+0000 7f22bffff640 1 -- 172.21.15.100:0/2519461235 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7f22cc04d070 con 0x7f22d8153a00 2024-09-11T22:27:07.645 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":50,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:27:07.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.646+0000 7f22ddd6d640 1 -- 172.21.15.100:0/2519461235 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f22c406cc20 msgr2=0x7f22c406f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:07.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.646+0000 7f22ddd6d640 1 --2- 172.21.15.100:0/2519461235 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f22c406cc20 0x7f22c406f0e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f22c8000c00 tx=0x7f22c8001190 comp rx=0 tx=0).stop 2024-09-11T22:27:07.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.646+0000 7f22ddd6d640 1 -- 172.21.15.100:0/2519461235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22d8153a00 msgr2=0x7f22d8152220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:07.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.646+0000 7f22ddd6d640 1 --2- 172.21.15.100:0/2519461235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22d8153a00 0x7f22d8152220 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f22cc02ae10 tx=0x7f22cc005bd0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.646+0000 7f22ddd6d640 1 -- 172.21.15.100:0/2519461235 shutdown_connections 2024-09-11T22:27:07.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.646+0000 7f22ddd6d640 1 --2- 172.21.15.100:0/2519461235 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f22c406cc20 0x7f22c406f0e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.646+0000 7f22ddd6d640 1 --2- 172.21.15.100:0/2519461235 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22d8152760 0x7f22d8144ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.646+0000 7f22ddd6d640 1 --2- 172.21.15.100:0/2519461235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22d8153a00 0x7f22d8152220 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.646+0000 7f22ddd6d640 1 --2- 172.21.15.100:0/2519461235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c4006110 0x7f22d81534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.646+0000 7f22ddd6d640 1 -- 172.21.15.100:0/2519461235 >> 172.21.15.100:0/2519461235 conn(0x7f22d80cbf70 msgr2=0x7f22d814e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:07.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.647+0000 7f22ddd6d640 1 -- 172.21.15.100:0/2519461235 shutdown_connections 2024-09-11T22:27:07.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.647+0000 7f22ddd6d640 1 -- 172.21.15.100:0/2519461235 wait complete. 2024-09-11T22:27:07.658 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-11T22:27:07.658 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-11T22:27:07.659 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:27:07.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.768+0000 7f17cfc5e640 1 Processor -- start 2024-09-11T22:27:07.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.768+0000 7f17cfc5e640 1 -- start start 2024-09-11T22:27:07.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.769+0000 7f17cfc5e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f17c806ce60 0x7f17c815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:07.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.769+0000 7f17cfc5e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17c815c290 0x7f17c81546b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:07.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.769+0000 7f17cfc5e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17c80c6510 con 0x7f17c806d240 2024-09-11T22:27:07.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.769+0000 7f17cfc5e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f17c815b820 con 0x7f17c806ce60 2024-09-11T22:27:07.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.769+0000 7f17cfc5e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f17c80c5470 con 0x7f17c815c290 2024-09-11T22:27:07.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.769+0000 7f17ce1fb640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f17c806d240 legacy=0x7f17c815de50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:27:07.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.770+0000 7f17cd1f9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17c815c290 0x7f17c81546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:07.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.770+0000 7f17cd9fa640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f17c806ce60 0x7f17c815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:07.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.770+0000 7f17cd9fa640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f17c806ce60 0x7f17c815bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:39710/0 (socket says 172.21.15.100:39710) 2024-09-11T22:27:07.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.770+0000 7f17cd1f9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17c815c290 0x7f17c81546b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:42894/0 (socket says 172.21.15.100:42894) 2024-09-11T22:27:07.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.770+0000 7f17cd9fa640 1 -- 172.21.15.100:0/1027655617 learned_addr learned my addr 172.21.15.100:0/1027655617 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:07.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.770+0000 7f17cd1f9640 1 -- 172.21.15.100:0/1027655617 >> v2:172.21.15.167:3300/0 conn(0x7f17c806ce60 msgr2=0x7f17c815bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:27:07.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.770+0000 7f17cd1f9640 1 --2- 172.21.15.100:0/1027655617 >> v2:172.21.15.167:3300/0 conn(0x7f17c806ce60 0x7f17c815bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.770+0000 7f17cd1f9640 1 -- 172.21.15.100:0/1027655617 >> v1:172.21.15.100:6789/0 conn(0x7f17c806d240 legacy=0x7f17c815de50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:27:07.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.770+0000 7f17cd1f9640 1 -- 172.21.15.100:0/1027655617 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c80c5750 con 0x7f17c815c290 2024-09-11T22:27:07.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.770+0000 7f17cd9fa640 1 --2- 172.21.15.100:0/1027655617 >> v2:172.21.15.167:3300/0 conn(0x7f17c806ce60 0x7f17c815bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:27:07.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.771+0000 7f17cd1f9640 1 --2- 172.21.15.100:0/1027655617 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17c815c290 0x7f17c81546b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f17b80097a0 tx=0x7f17b802a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f8869a12b7cf1a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:07.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.771+0000 7f17cc9f8640 1 -- 172.21.15.100:0/1027655617 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b8037070 con 0x7f17c815c290 2024-09-11T22:27:07.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.771+0000 7f17cc9f8640 1 -- 172.21.15.100:0/1027655617 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b802ae40 con 0x7f17c815c290 2024-09-11T22:27:07.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.771+0000 7f17cc9f8640 1 -- 172.21.15.100:0/1027655617 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b8032660 con 0x7f17c815c290 2024-09-11T22:27:07.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.772+0000 7f17cfc5e640 1 -- 172.21.15.100:0/1027655617 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17c815c290 msgr2=0x7f17c81546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:07.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.772+0000 7f17cfc5e640 1 --2- 172.21.15.100:0/1027655617 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17c815c290 0x7f17c81546b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f17b80097a0 tx=0x7f17b802a130 comp rx=0 tx=0).stop 2024-09-11T22:27:07.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.772+0000 7f17cfc5e640 1 -- 172.21.15.100:0/1027655617 shutdown_connections 2024-09-11T22:27:07.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.772+0000 7f17cfc5e640 1 --2- 172.21.15.100:0/1027655617 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17c815c290 0x7f17c81546b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.772+0000 7f17cfc5e640 1 --2- 172.21.15.100:0/1027655617 >> v2:172.21.15.167:3300/0 conn(0x7f17c806ce60 0x7f17c815bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.772+0000 7f17cfc5e640 1 -- 172.21.15.100:0/1027655617 >> 172.21.15.100:0/1027655617 conn(0x7f17c806bc10 msgr2=0x7f17c806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:07.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.772+0000 7f17cfc5e640 1 -- 172.21.15.100:0/1027655617 shutdown_connections 2024-09-11T22:27:07.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.772+0000 7f17cfc5e640 1 -- 172.21.15.100:0/1027655617 wait complete. 2024-09-11T22:27:07.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.773+0000 7f17cfc5e640 1 Processor -- start 2024-09-11T22:27:07.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.773+0000 7f17cfc5e640 1 -- start start 2024-09-11T22:27:07.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.774+0000 7f17cfc5e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17c806ce60 0x7f17c8158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:07.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.774+0000 7f17cfc5e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17c806d240 0x7f17c81f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:07.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.774+0000 7f17cfc5e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17c815c290 0x7f17c8151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:07.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.774+0000 7f17cfc5e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f17c80cb1b0 con 0x7f17c806ce60 2024-09-11T22:27:07.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.774+0000 7f17cfc5e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f17c80c5d10 con 0x7f17c806d240 2024-09-11T22:27:07.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.774+0000 7f17cfc5e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f17c80cad20 con 0x7f17c815c290 2024-09-11T22:27:07.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.774+0000 7f17cd9fa640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17c806ce60 msgr2=0x7f17c8158940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:27:07.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.774+0000 7f17cd9fa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17c806ce60 0x7f17c8158940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:27:07.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.775+0000 7f17cd1f9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17c806d240 0x7f17c81f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:07.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.775+0000 7f17ce1fb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17c815c290 0x7f17c8151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:07.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.775+0000 7f17cd1f9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17c806d240 0x7f17c81f3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:39720/0 (socket says 172.21.15.100:39720) 2024-09-11T22:27:07.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.775+0000 7f17cd1f9640 1 -- 172.21.15.100:0/2217851207 learned_addr learned my addr 172.21.15.100:0/2217851207 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:07.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.775+0000 7f17ce1fb640 1 -- 172.21.15.100:0/2217851207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17c806d240 msgr2=0x7f17c81f3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:07.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.775+0000 7f17ce1fb640 1 --2- 172.21.15.100:0/2217851207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17c806d240 0x7f17c81f3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.775+0000 7f17ce1fb640 1 -- 172.21.15.100:0/2217851207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17c806ce60 msgr2=0x7f17c8158940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:27:07.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.775+0000 7f17ce1fb640 1 --2- 172.21.15.100:0/2217851207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17c806ce60 0x7f17c8158940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.775+0000 7f17ce1fb640 1 -- 172.21.15.100:0/2217851207 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c81f0eb0 con 0x7f17c815c290 2024-09-11T22:27:07.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.775+0000 7f17cd1f9640 1 --2- 172.21.15.100:0/2217851207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17c806d240 0x7f17c81f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:27:07.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.775+0000 7f17ce1fb640 1 --2- 172.21.15.100:0/2217851207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17c815c290 0x7f17c8151130 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f17c80ce210 tx=0x7f17c0009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:07.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.775+0000 7f17be7fc640 1 -- 172.21.15.100:0/2217851207 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c000cd90 con 0x7f17c815c290 2024-09-11T22:27:07.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.775+0000 7f17be7fc640 1 -- 172.21.15.100:0/2217851207 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17c0010030 con 0x7f17c815c290 2024-09-11T22:27:07.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.775+0000 7f17be7fc640 1 -- 172.21.15.100:0/2217851207 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c0016670 con 0x7f17c815c290 2024-09-11T22:27:07.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.775+0000 7f17cfc5e640 1 -- 172.21.15.100:0/2217851207 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c80c8c20 con 0x7f17c815c290 2024-09-11T22:27:07.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.776+0000 7f17cfc5e640 1 -- 172.21.15.100:0/2217851207 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c8159ec0 con 0x7f17c815c290 2024-09-11T22:27:07.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.777+0000 7f17cfc5e640 1 --2- 172.21.15.100:0/2217851207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17c81f41e0 0x7f17c80c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:07.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.777+0000 7f17cfc5e640 1 -- 172.21.15.100:0/2217851207 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f17c815b2e0 con 0x7f17c81f41e0 2024-09-11T22:27:07.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.777+0000 7f17cd9fa640 1 --2- 172.21.15.100:0/2217851207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17c81f41e0 0x7f17c80c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:07.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.777+0000 7f17cd9fa640 1 -- 172.21.15.100:0/2217851207 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f17c815d3c0 con 0x7f17c81f41e0 2024-09-11T22:27:07.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.777+0000 7f17be7fc640 1 -- 172.21.15.100:0/2217851207 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f17c00153e0 con 0x7f17c815c290 2024-09-11T22:27:07.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.777+0000 7f17cd9fa640 1 --2- 172.21.15.100:0/2217851207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17c81f41e0 0x7f17c80c8500 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f17c4006c80 tx=0x7f17c400ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:07.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.777+0000 7f17be7fc640 1 --2- 172.21.15.100:0/2217851207 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f17ac06bde0 0x7f17ac06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:07.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.778+0000 7f17cd1f9640 1 --2- 172.21.15.100:0/2217851207 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f17ac06bde0 0x7f17ac06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:07.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.778+0000 7f17be7fc640 1 -- 172.21.15.100:0/2217851207 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f17c008b4a0 con 0x7f17c815c290 2024-09-11T22:27:07.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.778+0000 7f17be7fc640 1 -- 172.21.15.100:0/2217851207 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c4017070 con 0x7f17c81f41e0 2024-09-11T22:27:07.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.778+0000 7f17be7fc640 1 -- 172.21.15.100:0/2217851207 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f17c400ee50 con 0x7f17c81f41e0 2024-09-11T22:27:07.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.778+0000 7f17be7fc640 1 -- 172.21.15.100:0/2217851207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17c81f41e0 msgr2=0x7f17c80c8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:07.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.778+0000 7f17be7fc640 1 --2- 172.21.15.100:0/2217851207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17c81f41e0 0x7f17c80c8500 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f17c4006c80 tx=0x7f17c400ec00 comp rx=0 tx=0).stop 2024-09-11T22:27:07.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.778+0000 7f17be7fc640 1 -- 172.21.15.100:0/2217851207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17c81f41e0 msgr2=0x7f17c80c8500 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:27:07.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.778+0000 7f17be7fc640 1 --2- 172.21.15.100:0/2217851207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17c81f41e0 0x7f17c80c8500 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f17c4006c80 tx=0x7f17c400ec00 comp rx=0 tx=0).stop 2024-09-11T22:27:07.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.778+0000 7f17cd1f9640 1 --2- 172.21.15.100:0/2217851207 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f17ac06bde0 0x7f17ac06e2a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f17b802a170 tx=0x7f17b802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:07.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.784+0000 7f17cfc5e640 1 --2- 172.21.15.100:0/2217851207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17c80c76a0 0x7f17c8151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:07.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.785+0000 7f17cfc5e640 1 -- 172.21.15.100:0/2217851207 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f17c8151bb0 con 0x7f17c80c76a0 2024-09-11T22:27:07.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.785+0000 7f17cd9fa640 1 --2- 172.21.15.100:0/2217851207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17c80c76a0 0x7f17c8151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:07.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.785+0000 7f17cd9fa640 1 -- 172.21.15.100:0/2217851207 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f17c80d0f60 con 0x7f17c80c76a0 2024-09-11T22:27:07.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.785+0000 7f17cd9fa640 1 --2- 172.21.15.100:0/2217851207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17c80c76a0 0x7f17c8151670 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f17c4019000 tx=0x7f17c4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:07.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.785+0000 7f17be7fc640 1 -- 172.21.15.100:0/2217851207 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c4017070 con 0x7f17c80c76a0 2024-09-11T22:27:07.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.786+0000 7f17be7fc640 1 -- 172.21.15.100:0/2217851207 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4878 (secure 0 0 0) 0x7f17c4006370 con 0x7f17c80c76a0 2024-09-11T22:27:07.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.786+0000 7f17be7fc640 1 -- 172.21.15.100:0/2217851207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17c80c76a0 msgr2=0x7f17c8151670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:07.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.786+0000 7f17be7fc640 1 --2- 172.21.15.100:0/2217851207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17c80c76a0 0x7f17c8151670 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f17c4019000 tx=0x7f17c4004730 comp rx=0 tx=0).stop 2024-09-11T22:27:07.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.786+0000 7f17be7fc640 1 -- 172.21.15.100:0/2217851207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17c80c76a0 msgr2=0x7f17c8151670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:27:07.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.786+0000 7f17be7fc640 1 --2- 172.21.15.100:0/2217851207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17c80c76a0 0x7f17c8151670 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.788 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:27:07.788 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:27:07.788 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:27:07.788 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:27:07.788 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 50, 2024-09-11T22:27:07.788 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 213064, 2024-09-11T22:27:07.788 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:27:07.788 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:27:07.789 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:27:07.789 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:07.789 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:27:07.789 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:27:07.789 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:27:07.789 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:27:07.789 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:07.789 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:07.789 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:07.789 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:07.789 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:07.789 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:07.789 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:07.790 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:07.790 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:07.790 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:07.790 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:07.790 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:07.790 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:27:07.790 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:27:07.790 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:07.790 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:07.790 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:07.790 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:07.790 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:07.790 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:07.790 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:07.791 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:07.791 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:07.791 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:07.791 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:07.791 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:07.791 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.791 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:27:07.791 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:27:07.791 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:27:07.791 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:27:07.791 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:27:07.791 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:27:07.791 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:27:07.791 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:27:07.792 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:27:07.792 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:27:07.792 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:27:07.792 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:27:07.792 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:27:07.792 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:27:07.792 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:27:07.792 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:27:07.792 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:27:07.792 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:07.792 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:07.792 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:07.792 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:07.793 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:07.793 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:07.793 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:07.793 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:07.793 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:07.793 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:07.793 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:07.793 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:07.793 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:27:07.793 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.793 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:27:07.793 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.793 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:27:07.793 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:27:07.794 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:07.794 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:07.794 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.794 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:07.794 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:27:07.794 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:07.794 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.794 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.794 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:07.794 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:27:07.794 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:07.794 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:07.794 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:07.794 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.795 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:27:07.795 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:27:07.795 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:07.795 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:07.795 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:07.795 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.795 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.795 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:27:07.795 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:27:07.795 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:07.795 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:07.795 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.795 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:07.795 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:27:07.795 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:07.796 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.796 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.796 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:07.796 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:27:07.796 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:07.796 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:07.796 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:07.796 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.796 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:27:07.796 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:27:07.796 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:07.796 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:07.796 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:07.797 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.797 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.797 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:27:07.797 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:27:07.797 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:07.797 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:07.797 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.797 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:07.797 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:27:07.797 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:07.797 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.797 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.797 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:07.798 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:27:07.798 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:07.798 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:07.798 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:07.798 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.798 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:27:07.798 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:27:07.798 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:07.798 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:07.798 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:07.798 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:07.798 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:07.799 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.799 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:27:07.799 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:27:07.799 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.799 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:07.799 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:07.799 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:27:07.799 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:07.799 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:07.799 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:27:07.799 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.799 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:07.800 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:07.800 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:27:07.800 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:07.800 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:07.800 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:27:07.800 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.800 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:07.800 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:07.800 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:27:07.801 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:07.801 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:07.801 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:27:07.801 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.801 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:07.801 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:07.801 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:27:07.801 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:07.801 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:07.802 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.802 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:27:07.802 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:27:07.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.786+0000 7f17cfc5e640 1 -- 172.21.15.100:0/2217851207 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f17ac06bde0 msgr2=0x7f17ac06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:07.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.786+0000 7f17cfc5e640 1 --2- 172.21.15.100:0/2217851207 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f17ac06bde0 0x7f17ac06e2a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f17b802a170 tx=0x7f17b802e000 comp rx=0 tx=0).stop 2024-09-11T22:27:07.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.786+0000 7f17cfc5e640 1 -- 172.21.15.100:0/2217851207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17c815c290 msgr2=0x7f17c8151130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:07.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.786+0000 7f17cfc5e640 1 --2- 172.21.15.100:0/2217851207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17c815c290 0x7f17c8151130 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f17c80ce210 tx=0x7f17c0009ed0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.786+0000 7f17ce1fb640 1 -- 172.21.15.100:0/2217851207 reap_dead start 2024-09-11T22:27:07.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.786+0000 7f17ce1fb640 1 -- 172.21.15.100:0/2217851207 reap_dead start 2024-09-11T22:27:07.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.786+0000 7f17cfc5e640 1 -- 172.21.15.100:0/2217851207 shutdown_connections 2024-09-11T22:27:07.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.786+0000 7f17cfc5e640 1 -- 172.21.15.100:0/2217851207 >> 172.21.15.100:0/2217851207 conn(0x7f17c806bc10 msgr2=0x7f17c8157b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:07.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.786+0000 7f17cfc5e640 1 -- 172.21.15.100:0/2217851207 shutdown_connections 2024-09-11T22:27:07.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.786+0000 7f17cfc5e640 1 -- 172.21.15.100:0/2217851207 wait complete. 2024-09-11T22:27:07.804 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:27:07.804 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-11T22:27:07.804 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:27:07.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.920+0000 7fb3e1c77640 1 Processor -- start 2024-09-11T22:27:07.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.920+0000 7fb3e1c77640 1 -- start start 2024-09-11T22:27:07.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.920+0000 7fb3e1c77640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb3dc06d240 0x7fb3dc1546b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:07.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.920+0000 7fb3e1c77640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc15b2e0 0x7fb3dc154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:07.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.920+0000 7fb3e1c77640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3dc0c6510 con 0x7fb3dc06ce60 2024-09-11T22:27:07.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.920+0000 7fb3e1c77640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb3dc15b820 con 0x7fb3dc06d240 2024-09-11T22:27:07.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.920+0000 7fb3e1c77640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb3dc0c5470 con 0x7fb3dc15b2e0 2024-09-11T22:27:07.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.920+0000 7fb3daffd640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7fb3dc06d240 msgr2=0x7fb3dc1546b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:27:07.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.921+0000 7fb3daffd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb3dc06d240 0x7fb3dc1546b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:27:07.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.921+0000 7fb3dbfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc15b2e0 0x7fb3dc154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:07.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.921+0000 7fb3db7fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb3dc06ce60 0x7fb3dc15bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:54220/0 (socket says 172.21.15.100:54220) 2024-09-11T22:27:07.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.921+0000 7fb3db7fe640 1 -- 172.21.15.100:0/2474914801 learned_addr learned my addr 172.21.15.100:0/2474914801 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:27:07.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.922+0000 7fb3dbfff640 1 -- 172.21.15.100:0/2474914801 >> v2:172.21.15.100:3300/0 conn(0x7fb3dc06d240 msgr2=0x7fb3dc1546b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:27:07.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.922+0000 7fb3dbfff640 1 --2- 172.21.15.100:0/2474914801 >> v2:172.21.15.100:3300/0 conn(0x7fb3dc06d240 0x7fb3dc1546b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.922+0000 7fb3dbfff640 1 -- 172.21.15.100:0/2474914801 >> v1:172.21.15.167:6789/0 conn(0x7fb3dc06ce60 legacy=0x7fb3dc15bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:07.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.922+0000 7fb3da7fc640 1 -- 172.21.15.100:0/2474914801 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2709021320 0 0) 0x7fb3dc0c6510 con 0x7fb3dc06ce60 2024-09-11T22:27:07.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.922+0000 7fb3dbfff640 1 -- 172.21.15.100:0/2474914801 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3dc0c5750 con 0x7fb3dc15b2e0 2024-09-11T22:27:07.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.923+0000 7fb3dbfff640 1 --2- 172.21.15.100:0/2474914801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc15b2e0 0x7fb3dc154bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4009d90 tx=0x7fb3d402a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44f66cde88f2a127 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:07.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.923+0000 7fb3da7fc640 1 -- 172.21.15.100:0/2474914801 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4007740 con 0x7fb3dc15b2e0 2024-09-11T22:27:07.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.923+0000 7fb3da7fc640 1 -- 172.21.15.100:0/2474914801 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3d40078e0 con 0x7fb3dc15b2e0 2024-09-11T22:27:07.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.923+0000 7fb3da7fc640 1 -- 172.21.15.100:0/2474914801 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4007cb0 con 0x7fb3dc15b2e0 2024-09-11T22:27:07.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.924+0000 7fb3e1c77640 1 -- 172.21.15.100:0/2474914801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc15b2e0 msgr2=0x7fb3dc154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:07.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.924+0000 7fb3e1c77640 1 --2- 172.21.15.100:0/2474914801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc15b2e0 0x7fb3dc154bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4009d90 tx=0x7fb3d402a680 comp rx=0 tx=0).stop 2024-09-11T22:27:07.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.924+0000 7fb3e1c77640 1 -- 172.21.15.100:0/2474914801 shutdown_connections 2024-09-11T22:27:07.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.924+0000 7fb3e1c77640 1 --2- 172.21.15.100:0/2474914801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc15b2e0 0x7fb3dc154bf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.924+0000 7fb3e1c77640 1 --2- 172.21.15.100:0/2474914801 >> v2:172.21.15.100:3300/0 conn(0x7fb3dc06d240 0x7fb3dc1546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.924+0000 7fb3e1c77640 1 -- 172.21.15.100:0/2474914801 >> 172.21.15.100:0/2474914801 conn(0x7fb3dc06bc10 msgr2=0x7fb3dc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:07.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.924+0000 7fb3e1c77640 1 -- 172.21.15.100:0/2474914801 shutdown_connections 2024-09-11T22:27:07.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.924+0000 7fb3e1c77640 1 -- 172.21.15.100:0/2474914801 wait complete. 2024-09-11T22:27:07.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.925+0000 7fb3e1c77640 1 Processor -- start 2024-09-11T22:27:07.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.925+0000 7fb3e1c77640 1 -- start start 2024-09-11T22:27:07.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.926+0000 7fb3e1c77640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc06ce60 0x7fb3dc1f0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:07.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.926+0000 7fb3e1c77640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3dc06d240 0x7fb3dc156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:07.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.926+0000 7fb3e1c77640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3dc15b2e0 0x7fb3dc14dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:07.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.926+0000 7fb3e1c77640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb3dc15c460 con 0x7fb3dc15b2e0 2024-09-11T22:27:07.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.926+0000 7fb3e1c77640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb3dc0c5d10 con 0x7fb3dc06d240 2024-09-11T22:27:07.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.926+0000 7fb3e1c77640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb3dc0cb1b0 con 0x7fb3dc06ce60 2024-09-11T22:27:07.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.926+0000 7fb3dbfff640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3dc15b2e0 msgr2=0x7fb3dc14dc00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:27:07.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.926+0000 7fb3dbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3dc15b2e0 0x7fb3dc14dc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:27:07.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.927+0000 7fb3db7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc06ce60 0x7fb3dc1f0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:07.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.927+0000 7fb3db7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc06ce60 0x7fb3dc1f0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:42916/0 (socket says 172.21.15.100:42916) 2024-09-11T22:27:07.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.927+0000 7fb3db7fe640 1 -- 172.21.15.100:0/2321922912 learned_addr learned my addr 172.21.15.100:0/2321922912 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:07.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.927+0000 7fb3db7fe640 1 -- 172.21.15.100:0/2321922912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3dc06d240 msgr2=0x7fb3dc156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:07.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.927+0000 7fb3db7fe640 1 --2- 172.21.15.100:0/2321922912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3dc06d240 0x7fb3dc156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.927+0000 7fb3db7fe640 1 -- 172.21.15.100:0/2321922912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3dc15b2e0 msgr2=0x7fb3dc14dc00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:27:07.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.927+0000 7fb3db7fe640 1 --2- 172.21.15.100:0/2321922912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3dc15b2e0 0x7fb3dc14dc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.927+0000 7fb3db7fe640 1 -- 172.21.15.100:0/2321922912 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3dc155bf0 con 0x7fb3dc06ce60 2024-09-11T22:27:07.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.927+0000 7fb3db7fe640 1 --2- 172.21.15.100:0/2321922912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc06ce60 0x7fb3dc1f0d10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00c500 tx=0x7fb3cc00c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:07.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.927+0000 7fb3c3fff640 1 -- 172.21.15.100:0/2321922912 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc018070 con 0x7fb3dc06ce60 2024-09-11T22:27:07.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.927+0000 7fb3c3fff640 1 -- 172.21.15.100:0/2321922912 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3cc007580 con 0x7fb3dc06ce60 2024-09-11T22:27:07.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.927+0000 7fb3c3fff640 1 -- 172.21.15.100:0/2321922912 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc004a20 con 0x7fb3dc06ce60 2024-09-11T22:27:07.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.927+0000 7fb3e1c77640 1 -- 172.21.15.100:0/2321922912 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3dc157470 con 0x7fb3dc06ce60 2024-09-11T22:27:07.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.927+0000 7fb3e1c77640 1 -- 172.21.15.100:0/2321922912 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3dc156170 con 0x7fb3dc06ce60 2024-09-11T22:27:07.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.928+0000 7fb3e1c77640 1 --2- 172.21.15.100:0/2321922912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc14fe50 0x7fb3dc1563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:07.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.928+0000 7fb3e1c77640 1 -- 172.21.15.100:0/2321922912 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb3dc1f1250 con 0x7fb3dc14fe50 2024-09-11T22:27:07.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.929+0000 7fb3daffd640 1 --2- 172.21.15.100:0/2321922912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc14fe50 0x7fb3dc1563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:07.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.929+0000 7fb3c3fff640 1 -- 172.21.15.100:0/2321922912 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3cc01b070 con 0x7fb3dc06ce60 2024-09-11T22:27:07.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.929+0000 7fb3daffd640 1 -- 172.21.15.100:0/2321922912 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3dc0cad20 con 0x7fb3dc14fe50 2024-09-11T22:27:07.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.930+0000 7fb3c3fff640 1 --2- 172.21.15.100:0/2321922912 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb3c806bde0 0x7fb3c806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:07.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.930+0000 7fb3c3fff640 1 -- 172.21.15.100:0/2321922912 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fb3cc08a590 con 0x7fb3dc06ce60 2024-09-11T22:27:07.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.930+0000 7fb3daffd640 1 --2- 172.21.15.100:0/2321922912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc14fe50 0x7fb3dc1563b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0cfd30 tx=0x7fb3d000b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:07.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.930+0000 7fb3dbfff640 1 --2- 172.21.15.100:0/2321922912 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb3c806bde0 0x7fb3c806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:07.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.930+0000 7fb3c3fff640 1 -- 172.21.15.100:0/2321922912 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0016070 con 0x7fb3dc14fe50 2024-09-11T22:27:07.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.930+0000 7fb3dbfff640 1 --2- 172.21.15.100:0/2321922912 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb3c806bde0 0x7fb3c806e2a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4034000 tx=0x7fb3d402f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:07.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.930+0000 7fb3c3fff640 1 -- 172.21.15.100:0/2321922912 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb3d0003dc0 con 0x7fb3dc14fe50 2024-09-11T22:27:07.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.930+0000 7fb3c3fff640 1 -- 172.21.15.100:0/2321922912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc14fe50 msgr2=0x7fb3dc1563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:07.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.930+0000 7fb3c3fff640 1 --2- 172.21.15.100:0/2321922912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc14fe50 0x7fb3dc1563b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0cfd30 tx=0x7fb3d000b7a0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.930+0000 7fb3c3fff640 1 -- 172.21.15.100:0/2321922912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc14fe50 msgr2=0x7fb3dc1563b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:27:07.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.930+0000 7fb3c3fff640 1 --2- 172.21.15.100:0/2321922912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc14fe50 0x7fb3dc1563b0 secure :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0cfd30 tx=0x7fb3d000b7a0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.936+0000 7fb3e1c77640 1 --2- 172.21.15.100:0/2321922912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc1568f0 0x7fb3dc14ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:07.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.936+0000 7fb3e1c77640 1 -- 172.21.15.100:0/2321922912 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb3dc153590 con 0x7fb3dc1568f0 2024-09-11T22:27:07.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.937+0000 7fb3daffd640 1 --2- 172.21.15.100:0/2321922912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc1568f0 0x7fb3dc14ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:07.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.937+0000 7fb3daffd640 1 -- 172.21.15.100:0/2321922912 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb3dc1532b0 con 0x7fb3dc1568f0 2024-09-11T22:27:07.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.937+0000 7fb3daffd640 1 --2- 172.21.15.100:0/2321922912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc1568f0 0x7fb3dc14ebc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0013000 tx=0x7fb3d00059d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:07.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.937+0000 7fb3c3fff640 1 -- 172.21.15.100:0/2321922912 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d0016040 con 0x7fb3dc1568f0 2024-09-11T22:27:07.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.938+0000 7fb3c3fff640 1 -- 172.21.15.100:0/2321922912 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5043 (secure 0 0 0) 0x7fb3d0011400 con 0x7fb3dc1568f0 2024-09-11T22:27:07.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.938+0000 7fb3c3fff640 1 -- 172.21.15.100:0/2321922912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc1568f0 msgr2=0x7fb3dc14ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:07.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.938+0000 7fb3c3fff640 1 --2- 172.21.15.100:0/2321922912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc1568f0 0x7fb3dc14ebc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0013000 tx=0x7fb3d00059d0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.938+0000 7fb3c3fff640 1 -- 172.21.15.100:0/2321922912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc1568f0 msgr2=0x7fb3dc14ebc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:27:07.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.938+0000 7fb3c3fff640 1 --2- 172.21.15.100:0/2321922912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc1568f0 0x7fb3dc14ebc0 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0013000 tx=0x7fb3d00059d0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.939 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:27:07.939 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:27:07.940 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:27:07.940 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:27:07.940 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 50, 2024-09-11T22:27:07.940 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 318659, 2024-09-11T22:27:07.940 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:27:07.940 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:27:07.940 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:27:07.940 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:07.941 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:27:07.941 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:27:07.941 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:27:07.941 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:27:07.941 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:07.941 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:07.941 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:07.941 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:07.941 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:07.941 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:07.941 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:07.941 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:07.941 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:07.942 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:07.942 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:07.942 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:07.942 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:27:07.942 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:27:07.942 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:07.942 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:07.942 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:07.942 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:07.942 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:07.942 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:07.943 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:07.943 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:07.943 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:07.943 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:07.943 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:07.943 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:07.943 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.943 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:27:07.943 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:27:07.943 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:27:07.943 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:27:07.943 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:27:07.944 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:27:07.944 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:27:07.944 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:27:07.944 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:27:07.944 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:27:07.944 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:27:07.944 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:27:07.944 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:27:07.944 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:27:07.945 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:27:07.945 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:27:07.945 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:27:07.945 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:07.945 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:07.945 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:07.945 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:07.945 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:07.945 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:07.946 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:07.946 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:07.946 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:07.946 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:07.946 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:07.946 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:07.946 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:27:07.946 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.946 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:27:07.946 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.947 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:27:07.947 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:27:07.947 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:07.947 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:07.947 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.947 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:07.947 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:27:07.947 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:07.947 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.947 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.947 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:07.947 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:27:07.947 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:07.948 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:07.948 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:07.948 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.948 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:27:07.948 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:27:07.948 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:07.948 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:07.948 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:07.948 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.948 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.948 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:27:07.948 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:27:07.948 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:07.948 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:07.949 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.949 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:07.949 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:27:07.949 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:07.949 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.949 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.949 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:07.949 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:27:07.949 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:07.949 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:07.949 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:07.950 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.950 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:27:07.950 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:27:07.950 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:07.950 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:07.950 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:07.950 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.950 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.950 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:27:07.950 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:27:07.950 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:07.950 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:07.950 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.951 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:07.951 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:27:07.951 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:07.951 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.951 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.951 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:07.951 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:27:07.951 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:07.951 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:07.951 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:07.951 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.951 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:27:07.951 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:27:07.951 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:07.952 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:07.952 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:07.952 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:07.952 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:07.952 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.952 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:27:07.952 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:27:07.952 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.952 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:07.952 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:07.952 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:27:07.952 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:07.952 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:07.953 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:27:07.953 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.953 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:07.953 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:07.953 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:27:07.953 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:07.953 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:07.953 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:27:07.953 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.953 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:07.953 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:07.953 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:27:07.953 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:07.954 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:07.954 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:27:07.954 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.954 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:07.954 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:07.954 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 6 2024-09-11T22:27:07.954 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:07.954 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:07.954 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:27:07.954 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:07.954 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:07.955 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:07.955 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:27:07.955 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:07.955 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:07.955 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:07.955 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:27:07.955 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:27:07.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.938+0000 7fb3e1c77640 1 -- 172.21.15.100:0/2321922912 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb3c806bde0 msgr2=0x7fb3c806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:07.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.938+0000 7fb3e1c77640 1 --2- 172.21.15.100:0/2321922912 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb3c806bde0 0x7fb3c806e2a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4034000 tx=0x7fb3d402f000 comp rx=0 tx=0).stop 2024-09-11T22:27:07.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.938+0000 7fb3e1c77640 1 -- 172.21.15.100:0/2321922912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc06ce60 msgr2=0x7fb3dc1f0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:07.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.938+0000 7fb3e1c77640 1 --2- 172.21.15.100:0/2321922912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc06ce60 0x7fb3dc1f0d10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc00c500 tx=0x7fb3cc00c9c0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.938+0000 7fb3dbfff640 1 -- 172.21.15.100:0/2321922912 reap_dead start 2024-09-11T22:27:07.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.938+0000 7fb3e1c77640 1 -- 172.21.15.100:0/2321922912 shutdown_connections 2024-09-11T22:27:07.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.938+0000 7fb3e1c77640 1 --2- 172.21.15.100:0/2321922912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3dc06ce60 0x7fb3dc1f0d10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:07.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.938+0000 7fb3e1c77640 1 -- 172.21.15.100:0/2321922912 >> 172.21.15.100:0/2321922912 conn(0x7fb3dc06bc10 msgr2=0x7fb3dc1578d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:07.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.938+0000 7fb3e1c77640 1 -- 172.21.15.100:0/2321922912 shutdown_connections 2024-09-11T22:27:07.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:07.938+0000 7fb3e1c77640 1 -- 172.21.15.100:0/2321922912 wait complete. 2024-09-11T22:27:07.957 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:27:07.958 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-11T22:27:20.643 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:27:20.646 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:27:27.959 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:27:27.959 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-11T22:27:27.959 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T22:27:27.959 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T22:27:27.962 INFO:tasks.ceph.mon.a:Started 2024-09-11T22:27:27.962 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:27:27.962 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:27:28.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.082+0000 7efc9079f640 1 Processor -- start 2024-09-11T22:27:28.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.082+0000 7efc9079f640 1 -- start start 2024-09-11T22:27:28.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.083+0000 7efc9079f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc88154c20 0x7efc880cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:28.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.083+0000 7efc9079f640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efc880b3190 0x7efc8815e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:28.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.083+0000 7efc9079f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc8815ac90 con 0x7efc8815a7e0 2024-09-11T22:27:28.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.083+0000 7efc9079f640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7efc8815e000 con 0x7efc880b3190 2024-09-11T22:27:28.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.083+0000 7efc9079f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7efc8815af70 con 0x7efc88154c20 2024-09-11T22:27:28.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.083+0000 7efc8dd3a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efc880b3190 0x7efc8815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:28.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.083+0000 7efc8dd3a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efc880b3190 0x7efc8815e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33314/0 (socket says 172.21.15.100:33314) 2024-09-11T22:27:28.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.083+0000 7efc8dd3a640 1 -- 172.21.15.100:0/2054337438 learned_addr learned my addr 172.21.15.100:0/2054337438 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:28.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.083+0000 7efc8e53b640 1 --2- 172.21.15.100:0/2054337438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc88154c20 0x7efc880cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:28.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.083+0000 7efc8dd3a640 1 -- 172.21.15.100:0/2054337438 >> v2:172.21.15.100:3300/0 conn(0x7efc880b3190 msgr2=0x7efc8815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:27:28.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.083+0000 7efc8dd3a640 1 -- 172.21.15.100:0/2054337438 >> v2:172.21.15.100:3300/0 conn(0x7efc880b3190 msgr2=0x7efc8815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:27:28.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.083+0000 7efc8dd3a640 1 --2- 172.21.15.100:0/2054337438 >> v2:172.21.15.100:3300/0 conn(0x7efc880b3190 0x7efc8815e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:28.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.083+0000 7efc8dd3a640 1 --2- 172.21.15.100:0/2054337438 >> v2:172.21.15.100:3300/0 conn(0x7efc880b3190 0x7efc8815e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:27:28.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.083+0000 7efc8e53b640 1 -- 172.21.15.100:0/2054337438 >> v2:172.21.15.100:3300/0 conn(0x7efc880b3190 msgr2=0x7efc8815e490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:27:28.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.083+0000 7efc8e53b640 1 --2- 172.21.15.100:0/2054337438 >> v2:172.21.15.100:3300/0 conn(0x7efc880b3190 0x7efc8815e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.083+0000 7efc8e53b640 1 -- 172.21.15.100:0/2054337438 >> v1:172.21.15.167:6789/0 conn(0x7efc8815a7e0 legacy=0x7efc880cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:28.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.083+0000 7efc8e53b640 1 -- 172.21.15.100:0/2054337438 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc8815b250 con 0x7efc88154c20 2024-09-11T22:27:28.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.083+0000 7efc8d539640 1 -- 172.21.15.100:0/2054337438 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3768135540 0 0) 0x7efc8815ac90 con 0x7efc8815a7e0 2024-09-11T22:27:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.084+0000 7efc8e53b640 1 --2- 172.21.15.100:0/2054337438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc88154c20 0x7efc880cb120 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efc840097a0 tx=0x7efc8402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6abe6f7c4e57ad9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.085+0000 7efc8d539640 1 -- 172.21.15.100:0/2054337438 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc84037070 con 0x7efc88154c20 2024-09-11T22:27:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.085+0000 7efc8d539640 1 -- 172.21.15.100:0/2054337438 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc84032440 con 0x7efc88154c20 2024-09-11T22:27:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.085+0000 7efc8d539640 1 -- 172.21.15.100:0/2054337438 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc84032810 con 0x7efc88154c20 2024-09-11T22:27:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.085+0000 7efc9079f640 1 -- 172.21.15.100:0/2054337438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc88154c20 msgr2=0x7efc880cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.085+0000 7efc9079f640 1 --2- 172.21.15.100:0/2054337438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc88154c20 0x7efc880cb120 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efc840097a0 tx=0x7efc8402a180 comp rx=0 tx=0).stop 2024-09-11T22:27:28.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.085+0000 7efc9079f640 1 -- 172.21.15.100:0/2054337438 shutdown_connections 2024-09-11T22:27:28.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.085+0000 7efc9079f640 1 --2- 172.21.15.100:0/2054337438 >> v2:172.21.15.100:3300/0 conn(0x7efc880b3190 0x7efc8815e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.085+0000 7efc9079f640 1 --2- 172.21.15.100:0/2054337438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc88154c20 0x7efc880cb120 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.085+0000 7efc9079f640 1 -- 172.21.15.100:0/2054337438 >> 172.21.15.100:0/2054337438 conn(0x7efc88067d40 msgr2=0x7efc8806d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:28.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.086+0000 7efc9079f640 1 -- 172.21.15.100:0/2054337438 shutdown_connections 2024-09-11T22:27:28.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.086+0000 7efc9079f640 1 -- 172.21.15.100:0/2054337438 wait complete. 2024-09-11T22:27:28.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.087+0000 7efc9079f640 1 Processor -- start 2024-09-11T22:27:28.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.087+0000 7efc9079f640 1 -- start start 2024-09-11T22:27:28.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.088+0000 7efc9079f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc880b3190 0x7efc880b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:28.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.088+0000 7efc9079f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc88154c20 0x7efc880c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:28.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.088+0000 7efc9079f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc8815a7e0 0x7efc881f7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:28.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.088+0000 7efc9079f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efc880cc5a0 con 0x7efc880b3190 2024-09-11T22:27:28.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.088+0000 7efc9079f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efc880cc420 con 0x7efc8815a7e0 2024-09-11T22:27:28.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.088+0000 7efc9079f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7efc880cb660 con 0x7efc88154c20 2024-09-11T22:27:28.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.088+0000 7efc8e53b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc880b3190 0x7efc880b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:28.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.088+0000 7efc8ed3c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc8815a7e0 0x7efc881f7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:28.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.088+0000 7efc8e53b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc880b3190 0x7efc880b5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33320/0 (socket says 172.21.15.100:33320) 2024-09-11T22:27:28.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.088+0000 7efc8dd3a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc88154c20 0x7efc880c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:28.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.088+0000 7efc8e53b640 1 -- 172.21.15.100:0/1879723633 learned_addr learned my addr 172.21.15.100:0/1879723633 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:28.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.088+0000 7efc8e53b640 1 -- 172.21.15.100:0/1879723633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc880b3190 msgr2=0x7efc880b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-11T22:27:28.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.088+0000 7efc8e53b640 1 -- 172.21.15.100:0/1879723633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc880b3190 msgr2=0x7efc880b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:27:28.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.088+0000 7efc8e53b640 1 --2- 172.21.15.100:0/1879723633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc880b3190 0x7efc880b5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:28.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.088+0000 7efc8e53b640 1 --2- 172.21.15.100:0/1879723633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc880b3190 0x7efc880b5670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:27:28.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.089+0000 7efc8dd3a640 1 -- 172.21.15.100:0/1879723633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc8815a7e0 msgr2=0x7efc881f7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:28.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.089+0000 7efc8dd3a640 1 --2- 172.21.15.100:0/1879723633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc8815a7e0 0x7efc881f7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.089+0000 7efc8dd3a640 1 -- 172.21.15.100:0/1879723633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc880b3190 msgr2=0x7efc880b5670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:27:28.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.089+0000 7efc8dd3a640 1 --2- 172.21.15.100:0/1879723633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc880b3190 0x7efc880b5670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.089+0000 7efc8dd3a640 1 -- 172.21.15.100:0/1879723633 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc880c9b10 con 0x7efc88154c20 2024-09-11T22:27:28.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.089+0000 7efc8dd3a640 1 --2- 172.21.15.100:0/1879723633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc88154c20 0x7efc880c7580 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efc7800e7e0 tx=0x7efc7800eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:28.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.089+0000 7efc7effd640 1 -- 172.21.15.100:0/1879723633 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc78017070 con 0x7efc88154c20 2024-09-11T22:27:28.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.089+0000 7efc7effd640 1 -- 172.21.15.100:0/1879723633 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc78004020 con 0x7efc88154c20 2024-09-11T22:27:28.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.089+0000 7efc9079f640 1 -- 172.21.15.100:0/1879723633 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc880c9fc0 con 0x7efc88154c20 2024-09-11T22:27:28.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.089+0000 7efc9079f640 1 -- 172.21.15.100:0/1879723633 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efc880ca580 con 0x7efc88154c20 2024-09-11T22:27:28.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.089+0000 7efc7effd640 1 -- 172.21.15.100:0/1879723633 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7800f040 con 0x7efc88154c20 2024-09-11T22:27:28.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.090+0000 7efc9079f640 1 -- 172.21.15.100:0/1879723633 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc880cb120 con 0x7efc88154c20 2024-09-11T22:27:28.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.091+0000 7efc7effd640 1 -- 172.21.15.100:0/1879723633 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc7800c6d0 con 0x7efc88154c20 2024-09-11T22:27:28.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.091+0000 7efc7effd640 1 --2- 172.21.15.100:0/1879723633 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efc6c06be30 0x7efc6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:28.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.092+0000 7efc7effd640 1 -- 172.21.15.100:0/1879723633 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7efc7808acd0 con 0x7efc88154c20 2024-09-11T22:27:28.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.092+0000 7efc8e53b640 1 --2- 172.21.15.100:0/1879723633 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efc6c06be30 0x7efc6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:28.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.092+0000 7efc8e53b640 1 --2- 172.21.15.100:0/1879723633 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efc6c06be30 0x7efc6c06e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efc84000c00 tx=0x7efc8402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:28.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.096+0000 7efc7effd640 1 -- 172.21.15.100:0/1879723633 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc78058b80 con 0x7efc88154c20 2024-09-11T22:27:28.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.374+0000 7efc9079f640 1 -- 172.21.15.100:0/1879723633 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7efc880cbaf0 con 0x7efc88154c20 2024-09-11T22:27:28.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.375+0000 7efc7effd640 1 -- 172.21.15.100:0/1879723633 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7efc7805ce80 con 0x7efc88154c20 2024-09-11T22:27:28.376 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":50,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:27:28.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.377+0000 7efc9079f640 1 -- 172.21.15.100:0/1879723633 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efc6c06be30 msgr2=0x7efc6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:28.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.377+0000 7efc9079f640 1 --2- 172.21.15.100:0/1879723633 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efc6c06be30 0x7efc6c06e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efc84000c00 tx=0x7efc8402e000 comp rx=0 tx=0).stop 2024-09-11T22:27:28.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.377+0000 7efc9079f640 1 -- 172.21.15.100:0/1879723633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc88154c20 msgr2=0x7efc880c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:28.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.377+0000 7efc9079f640 1 --2- 172.21.15.100:0/1879723633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc88154c20 0x7efc880c7580 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efc7800e7e0 tx=0x7efc7800eca0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.377+0000 7efc9079f640 1 -- 172.21.15.100:0/1879723633 shutdown_connections 2024-09-11T22:27:28.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.377+0000 7efc9079f640 1 --2- 172.21.15.100:0/1879723633 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efc6c06be30 0x7efc6c06e2f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.377+0000 7efc9079f640 1 --2- 172.21.15.100:0/1879723633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc8815a7e0 0x7efc881f7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.377+0000 7efc9079f640 1 --2- 172.21.15.100:0/1879723633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc88154c20 0x7efc880c7580 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.377+0000 7efc9079f640 1 --2- 172.21.15.100:0/1879723633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc880b3190 0x7efc880b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:28.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.377+0000 7efc9079f640 1 -- 172.21.15.100:0/1879723633 >> 172.21.15.100:0/1879723633 conn(0x7efc88067d40 msgr2=0x7efc880cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:28.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.377+0000 7efc9079f640 1 -- 172.21.15.100:0/1879723633 shutdown_connections 2024-09-11T22:27:28.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:28.377+0000 7efc9079f640 1 -- 172.21.15.100:0/1879723633 wait complete. 2024-09-11T22:27:31.389 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:27:31.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.496+0000 7fcfe98e4640 1 Processor -- start 2024-09-11T22:27:31.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.497+0000 7fcfe98e4640 1 -- start start 2024-09-11T22:27:31.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.497+0000 7fcfe98e4640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 0x7fcfe40cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:31.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.498+0000 7fcfe98e4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 0x7fcfe40cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:31.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.498+0000 7fcfe98e4640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfe415ac90 con 0x7fcfe40b3190 2024-09-11T22:27:31.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.498+0000 7fcfe98e4640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fcfe415e000 con 0x7fcfe4154c20 2024-09-11T22:27:31.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.498+0000 7fcfe98e4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcfe415af70 con 0x7fcfe415a7e0 2024-09-11T22:27:31.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.498+0000 7fcfe2ffd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 0x7fcfe40cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:31.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.498+0000 7fcfe2ffd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 0x7fcfe40cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33336/0 (socket says 172.21.15.100:33336) 2024-09-11T22:27:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.498+0000 7fcfe2ffd640 1 -- 172.21.15.100:0/1580166020 learned_addr learned my addr 172.21.15.100:0/1580166020 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.498+0000 7fcfe2ffd640 1 -- 172.21.15.100:0/1580166020 >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 msgr2=0x7fcfe40cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:27:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.498+0000 7fcfe2ffd640 1 -- 172.21.15.100:0/1580166020 >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 msgr2=0x7fcfe40cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:27:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.498+0000 7fcfe37fe640 1 --2- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 0x7fcfe40cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.498+0000 7fcfe2ffd640 1 --2- 172.21.15.100:0/1580166020 >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 0x7fcfe40cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.498+0000 7fcfe2ffd640 1 --2- 172.21.15.100:0/1580166020 >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 0x7fcfe40cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:27:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.498+0000 7fcfe37fe640 1 -- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 msgr2=0x7fcfe40cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:27:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.498+0000 7fcfe37fe640 1 -- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 msgr2=0x7fcfe40cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:27:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.498+0000 7fcfe37fe640 1 --2- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 0x7fcfe40cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:31.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.498+0000 7fcfe37fe640 1 --2- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 0x7fcfe40cbd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:27:31.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.699+0000 7fcfe2ffd640 1 --2- 172.21.15.100:0/1580166020 >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 0x7fcfe40cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:31.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.699+0000 7fcfe2ffd640 1 -- 172.21.15.100:0/1580166020 >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 msgr2=0x7fcfe40cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:27:31.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.699+0000 7fcfe2ffd640 1 -- 172.21.15.100:0/1580166020 >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 msgr2=0x7fcfe40cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:27:31.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.699+0000 7fcfe2ffd640 1 --2- 172.21.15.100:0/1580166020 >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 0x7fcfe40cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:31.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.699+0000 7fcfe2ffd640 1 --2- 172.21.15.100:0/1580166020 >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 0x7fcfe40cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:27:31.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.699+0000 7fcfe37fe640 1 --2- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 0x7fcfe40cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:31.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.699+0000 7fcfe37fe640 1 -- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 msgr2=0x7fcfe40cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:27:31.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.699+0000 7fcfe37fe640 1 -- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 msgr2=0x7fcfe40cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:27:31.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.699+0000 7fcfe37fe640 1 --2- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 0x7fcfe40cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:31.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:31.699+0000 7fcfe37fe640 1 --2- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 0x7fcfe40cbd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:27:32.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:32.100+0000 7fcfe2ffd640 1 --2- 172.21.15.100:0/1580166020 >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 0x7fcfe40cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:32.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:32.100+0000 7fcfe2ffd640 1 -- 172.21.15.100:0/1580166020 >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 msgr2=0x7fcfe40cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:27:32.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:32.100+0000 7fcfe2ffd640 1 -- 172.21.15.100:0/1580166020 >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 msgr2=0x7fcfe40cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:27:32.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:32.100+0000 7fcfe2ffd640 1 --2- 172.21.15.100:0/1580166020 >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 0x7fcfe40cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:32.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:32.100+0000 7fcfe2ffd640 1 --2- 172.21.15.100:0/1580166020 >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 0x7fcfe40cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:27:32.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:32.100+0000 7fcfe37fe640 1 --2- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 0x7fcfe40cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:32.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:32.100+0000 7fcfe37fe640 1 -- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 msgr2=0x7fcfe40cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:27:32.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:32.100+0000 7fcfe37fe640 1 -- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 msgr2=0x7fcfe40cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:27:32.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:32.100+0000 7fcfe37fe640 1 --2- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 0x7fcfe40cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:32.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:32.100+0000 7fcfe37fe640 1 --2- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 0x7fcfe40cbd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:27:32.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:32.901+0000 7fcfe2ffd640 1 --2- 172.21.15.100:0/1580166020 >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 0x7fcfe40cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:32.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:32.901+0000 7fcfe2ffd640 1 -- 172.21.15.100:0/1580166020 >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 msgr2=0x7fcfe40cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:27:32.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:32.901+0000 7fcfe2ffd640 1 -- 172.21.15.100:0/1580166020 >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 msgr2=0x7fcfe40cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:27:32.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:32.901+0000 7fcfe2ffd640 1 --2- 172.21.15.100:0/1580166020 >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 0x7fcfe40cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:32.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:32.901+0000 7fcfe2ffd640 1 --2- 172.21.15.100:0/1580166020 >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 0x7fcfe40cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:27:32.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:32.901+0000 7fcfe37fe640 1 --2- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 0x7fcfe40cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:32.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:32.901+0000 7fcfe37fe640 1 -- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 msgr2=0x7fcfe40cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:27:32.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:32.901+0000 7fcfe37fe640 1 -- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 msgr2=0x7fcfe40cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:27:32.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:32.901+0000 7fcfe37fe640 1 --2- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 0x7fcfe40cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:32.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:32.901+0000 7fcfe37fe640 1 --2- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 0x7fcfe40cbd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:27:34.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.269+0000 7fcfe1ffb640 1 -- 172.21.15.100:0/1580166020 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3336159228 0 0) 0x7fcfe415ac90 con 0x7fcfe40b3190 2024-09-11T22:27:34.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.269+0000 7fcfe1ffb640 1 -- 172.21.15.100:0/1580166020 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfcc003520 con 0x7fcfe40b3190 2024-09-11T22:27:34.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.270+0000 7fcfe1ffb640 1 -- 172.21.15.100:0/1580166020 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1926589909 0 0) 0x7fcfcc003520 con 0x7fcfe40b3190 2024-09-11T22:27:34.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.270+0000 7fcfe1ffb640 1 -- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 msgr2=0x7fcfe40cbd10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:27:34.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.270+0000 7fcfe1ffb640 1 --2- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 0x7fcfe40cbd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.270+0000 7fcfe1ffb640 1 -- 172.21.15.100:0/1580166020 >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 msgr2=0x7fcfe40cb120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:27:34.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.270+0000 7fcfe1ffb640 1 --2- 172.21.15.100:0/1580166020 >> v2:172.21.15.100:3300/0 conn(0x7fcfe4154c20 0x7fcfe40cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.270+0000 7fcfe1ffb640 1 -- 172.21.15.100:0/1580166020 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe415b250 con 0x7fcfe40b3190 2024-09-11T22:27:34.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.270+0000 7fcfe1ffb640 1 -- 172.21.15.100:0/1580166020 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fcfd8001690 con 0x7fcfe40b3190 2024-09-11T22:27:34.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.270+0000 7fcfe1ffb640 1 -- 172.21.15.100:0/1580166020 >> v1:172.21.15.167:6789/0 conn(0x7fcfe40b3190 legacy=0x7fcfe415e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.270+0000 7fcfe1ffb640 1 --2- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 0x7fcfcc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.270+0000 7fcfe1ffb640 1 --2- 172.21.15.100:0/1580166020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfcc004030 0x7fcfcc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.270+0000 7fcfe1ffb640 1 --2- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfcc004d40 0x7fcfcc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.270+0000 7fcfe1ffb640 1 -- 172.21.15.100:0/1580166020 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe415e000 con 0x7fcfcc004030 2024-09-11T22:27:34.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.270+0000 7fcfe1ffb640 1 -- 172.21.15.100:0/1580166020 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe415af70 con 0x7fcfcc004d40 2024-09-11T22:27:34.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.270+0000 7fcfe1ffb640 1 -- 172.21.15.100:0/1580166020 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcfcc00bb20 con 0x7fcfe415a7e0 2024-09-11T22:27:34.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.270+0000 7fcfe2ffd640 1 --2- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 0x7fcfcc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.270+0000 7fcfe37fe640 1 --2- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfcc004d40 0x7fcfcc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.270+0000 7fcfe27fc640 1 --2- 172.21.15.100:0/1580166020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfcc004030 0x7fcfcc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.270+0000 7fcfe37fe640 1 -- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 msgr2=0x7fcfcc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:27:34.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.270+0000 7fcfe37fe640 1 --2- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe415a7e0 0x7fcfcc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.270+0000 7fcfe37fe640 1 -- 172.21.15.100:0/1580166020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfcc004030 msgr2=0x7fcfcc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:27:34.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.270+0000 7fcfe37fe640 1 --2- 172.21.15.100:0/1580166020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfcc004030 0x7fcfcc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.270+0000 7fcfe37fe640 1 -- 172.21.15.100:0/1580166020 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfcc003520 con 0x7fcfcc004d40 2024-09-11T22:27:34.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.271+0000 7fcfe37fe640 1 --2- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfcc004d40 0x7fcfcc0051c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc009610 tx=0x7fcfcc005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af143cef770aec82 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:34.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.272+0000 7fcfe1ffb640 1 -- 172.21.15.100:0/1580166020 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc031070 con 0x7fcfcc004d40 2024-09-11T22:27:34.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.272+0000 7fcfe1ffb640 1 -- 172.21.15.100:0/1580166020 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfdc02ba90 con 0x7fcfcc004d40 2024-09-11T22:27:34.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.272+0000 7fcfe1ffb640 1 -- 172.21.15.100:0/1580166020 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc004040 con 0x7fcfcc004d40 2024-09-11T22:27:34.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.272+0000 7fcfe98e4640 1 -- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfcc004d40 msgr2=0x7fcfcc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.272+0000 7fcfe98e4640 1 --2- 172.21.15.100:0/1580166020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfcc004d40 0x7fcfcc0051c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc009610 tx=0x7fcfcc005830 comp rx=0 tx=0).stop 2024-09-11T22:27:34.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.272+0000 7fcfe37fe640 1 -- 172.21.15.100:0/1580166020 reap_dead start 2024-09-11T22:27:34.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.272+0000 7fcfe98e4640 1 -- 172.21.15.100:0/1580166020 shutdown_connections 2024-09-11T22:27:34.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.272+0000 7fcfe98e4640 1 -- 172.21.15.100:0/1580166020 >> 172.21.15.100:0/1580166020 conn(0x7fcfe4067d40 msgr2=0x7fcfe406d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:34.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.272+0000 7fcfe98e4640 1 -- 172.21.15.100:0/1580166020 shutdown_connections 2024-09-11T22:27:34.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.272+0000 7fcfe98e4640 1 -- 172.21.15.100:0/1580166020 wait complete. 2024-09-11T22:27:34.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.274+0000 7fcfe98e4640 1 Processor -- start 2024-09-11T22:27:34.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.274+0000 7fcfe98e4640 1 -- start start 2024-09-11T22:27:34.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.275+0000 7fcfe98e4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfcc004d40 0x7fcfe4147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.275+0000 7fcfe98e4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfe41492b0 0x7fcfe4152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.275+0000 7fcfe98e4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe4152cd0 0x7fcfe41f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.275+0000 7fcfe98e4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe415ed20 con 0x7fcfcc004d40 2024-09-11T22:27:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.275+0000 7fcfe98e4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe415eba0 con 0x7fcfe41492b0 2024-09-11T22:27:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.275+0000 7fcfe98e4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcfe40cb660 con 0x7fcfe4152cd0 2024-09-11T22:27:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.275+0000 7fcfe2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfcc004d40 0x7fcfe4147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.275+0000 7fcfe2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfcc004d40 0x7fcfe4147330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53714/0 (socket says 172.21.15.100:53714) 2024-09-11T22:27:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.275+0000 7fcfe2ffd640 1 -- 172.21.15.100:0/2475045077 learned_addr learned my addr 172.21.15.100:0/2475045077 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.275+0000 7fcfe27fc640 1 --2- 172.21.15.100:0/2475045077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfe41492b0 0x7fcfe4152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.275+0000 7fcfe37fe640 1 --2- 172.21.15.100:0/2475045077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe4152cd0 0x7fcfe41f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.275+0000 7fcfe2ffd640 1 -- 172.21.15.100:0/2475045077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe4152cd0 msgr2=0x7fcfe41f39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.275+0000 7fcfe2ffd640 1 --2- 172.21.15.100:0/2475045077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe4152cd0 0x7fcfe41f39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.275+0000 7fcfe2ffd640 1 -- 172.21.15.100:0/2475045077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfe41492b0 msgr2=0x7fcfe4152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.275+0000 7fcfe2ffd640 1 --2- 172.21.15.100:0/2475045077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfe41492b0 0x7fcfe4152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.275+0000 7fcfe2ffd640 1 -- 172.21.15.100:0/2475045077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe41467f0 con 0x7fcfcc004d40 2024-09-11T22:27:34.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.276+0000 7fcfe2ffd640 1 --2- 172.21.15.100:0/2475045077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfcc004d40 0x7fcfe4147330 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4012f70 tx=0x7fcfd4003aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:34.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.276+0000 7fcfcbfff640 1 -- 172.21.15.100:0/2475045077 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd400f040 con 0x7fcfcc004d40 2024-09-11T22:27:34.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.276+0000 7fcfe98e4640 1 -- 172.21.15.100:0/2475045077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe4146140 con 0x7fcfcc004d40 2024-09-11T22:27:34.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.276+0000 7fcfe98e4640 1 -- 172.21.15.100:0/2475045077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfe414b220 con 0x7fcfcc004d40 2024-09-11T22:27:34.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.277+0000 7fcfcbfff640 1 -- 172.21.15.100:0/2475045077 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfd4017820 con 0x7fcfcc004d40 2024-09-11T22:27:34.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.277+0000 7fcfcbfff640 1 -- 172.21.15.100:0/2475045077 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4017bd0 con 0x7fcfcc004d40 2024-09-11T22:27:34.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.278+0000 7fcfe98e4640 1 -- 172.21.15.100:0/2475045077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfc4005290 con 0x7fcfcc004d40 2024-09-11T22:27:34.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.278+0000 7fcfcbfff640 1 -- 172.21.15.100:0/2475045077 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcfd4018450 con 0x7fcfcc004d40 2024-09-11T22:27:34.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.279+0000 7fcfcbfff640 1 --2- 172.21.15.100:0/2475045077 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcfd006be30 0x7fcfd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.279+0000 7fcfcbfff640 1 -- 172.21.15.100:0/2475045077 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fcfd408c290 con 0x7fcfcc004d40 2024-09-11T22:27:34.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.279+0000 7fcfe27fc640 1 --2- 172.21.15.100:0/2475045077 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcfd006be30 0x7fcfd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.279+0000 7fcfe27fc640 1 --2- 172.21.15.100:0/2475045077 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcfd006be30 0x7fcfd006e2f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcfe406d220 tx=0x7fcfd8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:34.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.285+0000 7fcfcbfff640 1 -- 172.21.15.100:0/2475045077 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcfd405a0c0 con 0x7fcfcc004d40 2024-09-11T22:27:34.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.562+0000 7fcfe98e4640 1 -- 172.21.15.100:0/2475045077 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fcfc4005850 con 0x7fcfcc004d40 2024-09-11T22:27:34.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.562+0000 7fcfcbfff640 1 -- 172.21.15.100:0/2475045077 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7fcfd405e3c0 con 0x7fcfcc004d40 2024-09-11T22:27:34.563 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:27:34.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.564+0000 7fcfe98e4640 1 -- 172.21.15.100:0/2475045077 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcfd006be30 msgr2=0x7fcfd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.564+0000 7fcfe98e4640 1 --2- 172.21.15.100:0/2475045077 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcfd006be30 0x7fcfd006e2f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcfe406d220 tx=0x7fcfd8009040 comp rx=0 tx=0).stop 2024-09-11T22:27:34.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.564+0000 7fcfe98e4640 1 -- 172.21.15.100:0/2475045077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfcc004d40 msgr2=0x7fcfe4147330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.564+0000 7fcfe98e4640 1 --2- 172.21.15.100:0/2475045077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfcc004d40 0x7fcfe4147330 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4012f70 tx=0x7fcfd4003aa0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.564+0000 7fcfe98e4640 1 -- 172.21.15.100:0/2475045077 shutdown_connections 2024-09-11T22:27:34.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.564+0000 7fcfe98e4640 1 --2- 172.21.15.100:0/2475045077 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcfd006be30 0x7fcfd006e2f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.564+0000 7fcfe98e4640 1 --2- 172.21.15.100:0/2475045077 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcfe4152cd0 0x7fcfe41f39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.564+0000 7fcfe98e4640 1 --2- 172.21.15.100:0/2475045077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcfe41492b0 0x7fcfe4152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.564+0000 7fcfe98e4640 1 --2- 172.21.15.100:0/2475045077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfcc004d40 0x7fcfe4147330 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.564+0000 7fcfe98e4640 1 -- 172.21.15.100:0/2475045077 >> 172.21.15.100:0/2475045077 conn(0x7fcfe4067d40 msgr2=0x7fcfe40cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:34.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.564+0000 7fcfe98e4640 1 -- 172.21.15.100:0/2475045077 shutdown_connections 2024-09-11T22:27:34.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.564+0000 7fcfe98e4640 1 -- 172.21.15.100:0/2475045077 wait complete. 2024-09-11T22:27:34.577 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:27:34.577 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:27:34.577 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:27:34.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.693+0000 7faac97b7640 1 Processor -- start 2024-09-11T22:27:34.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.693+0000 7faac97b7640 1 -- start start 2024-09-11T22:27:34.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.694+0000 7faac97b7640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7faac40c8b10 0x7faac406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.694+0000 7faac97b7640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faac40c98f0 con 0x7faac40b0c00 2024-09-11T22:27:34.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.694+0000 7faac97b7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faac40c9050 con 0x7faac4152a80 2024-09-11T22:27:34.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.694+0000 7faac97b7640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7faac4152e60 con 0x7faac40c8b10 2024-09-11T22:27:34.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.694+0000 7faac27fc640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7faac40c8b10 0x7faac406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.694+0000 7faac37fe640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7faac40b0c00 0x7faac40cb020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37086/0 (socket says 172.21.15.100:37086) 2024-09-11T22:27:34.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.694+0000 7faac37fe640 1 -- 172.21.15.100:0/38502321 learned_addr learned my addr 172.21.15.100:0/38502321 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:27:34.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.694+0000 7faac27fc640 1 -- 172.21.15.100:0/38502321 >> v1:172.21.15.167:6789/0 conn(0x7faac4152a80 legacy=0x7faac4159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:27:34.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.694+0000 7faac27fc640 1 -- 172.21.15.100:0/38502321 >> v1:172.21.15.100:6789/0 conn(0x7faac40b0c00 legacy=0x7faac40cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.694+0000 7faac1ffb640 1 -- 172.21.15.100:0/38502321 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2395952146 0 0) 0x7faac40c98f0 con 0x7faac40b0c00 2024-09-11T22:27:34.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.694+0000 7faac27fc640 1 -- 172.21.15.100:0/38502321 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac40c9330 con 0x7faac40c8b10 2024-09-11T22:27:34.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.695+0000 7faac27fc640 1 --2- 172.21.15.100:0/38502321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac40c8b10 0x7faac406ff90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faab80097a0 tx=0x7faab802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=944d9dd49635c097 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:34.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.695+0000 7faac1ffb640 1 -- 172.21.15.100:0/38502321 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8037070 con 0x7faac40c8b10 2024-09-11T22:27:34.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.695+0000 7faac1ffb640 1 -- 172.21.15.100:0/38502321 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab8032440 con 0x7faac40c8b10 2024-09-11T22:27:34.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.695+0000 7faac1ffb640 1 -- 172.21.15.100:0/38502321 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8032810 con 0x7faac40c8b10 2024-09-11T22:27:34.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.696+0000 7faac97b7640 1 -- 172.21.15.100:0/38502321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac40c8b10 msgr2=0x7faac406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.696+0000 7faac97b7640 1 --2- 172.21.15.100:0/38502321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac40c8b10 0x7faac406ff90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faab80097a0 tx=0x7faab802a270 comp rx=0 tx=0).stop 2024-09-11T22:27:34.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.696+0000 7faac97b7640 1 -- 172.21.15.100:0/38502321 shutdown_connections 2024-09-11T22:27:34.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.696+0000 7faac97b7640 1 --2- 172.21.15.100:0/38502321 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac40c8b10 0x7faac406ff90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.696+0000 7faac97b7640 1 -- 172.21.15.100:0/38502321 >> 172.21.15.100:0/38502321 conn(0x7faac406e000 msgr2=0x7faac406e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:34.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.696+0000 7faac97b7640 1 -- 172.21.15.100:0/38502321 shutdown_connections 2024-09-11T22:27:34.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.696+0000 7faac97b7640 1 -- 172.21.15.100:0/38502321 wait complete. 2024-09-11T22:27:34.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.697+0000 7faac97b7640 1 Processor -- start 2024-09-11T22:27:34.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.697+0000 7faac97b7640 1 -- start start 2024-09-11T22:27:34.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.698+0000 7faac97b7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faac40b0c00 0x7faac414a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.698+0000 7faac97b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac40c8b10 0x7faac406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.698+0000 7faac97b7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faac4152a80 0x7faac415a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.698+0000 7faac97b7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faac4158b10 con 0x7faac40c8b10 2024-09-11T22:27:34.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.698+0000 7faac97b7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faac4158830 con 0x7faac4152a80 2024-09-11T22:27:34.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.698+0000 7faac97b7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7faac40cb730 con 0x7faac40b0c00 2024-09-11T22:27:34.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.698+0000 7faac27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac40c8b10 0x7faac406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.698+0000 7faac27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac40c8b10 0x7faac406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53730/0 (socket says 172.21.15.100:53730) 2024-09-11T22:27:34.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.698+0000 7faac27fc640 1 -- 172.21.15.100:0/3565594484 learned_addr learned my addr 172.21.15.100:0/3565594484 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:34.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.698+0000 7faac37fe640 1 --2- 172.21.15.100:0/3565594484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faac4152a80 0x7faac415a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.698+0000 7faac2ffd640 1 --2- 172.21.15.100:0/3565594484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faac40b0c00 0x7faac414a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.699+0000 7faac27fc640 1 -- 172.21.15.100:0/3565594484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faac40b0c00 msgr2=0x7faac414a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.699+0000 7faac27fc640 1 --2- 172.21.15.100:0/3565594484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faac40b0c00 0x7faac414a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.699+0000 7faac27fc640 1 -- 172.21.15.100:0/3565594484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faac4152a80 msgr2=0x7faac415a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.699+0000 7faac27fc640 1 --2- 172.21.15.100:0/3565594484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faac4152a80 0x7faac415a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.699+0000 7faac27fc640 1 -- 172.21.15.100:0/3565594484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac406da00 con 0x7faac40c8b10 2024-09-11T22:27:34.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.699+0000 7faac27fc640 1 --2- 172.21.15.100:0/3565594484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac40c8b10 0x7faac406bc10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faab80098c0 tx=0x7faab80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:34.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.699+0000 7faaab7fe640 1 -- 172.21.15.100:0/3565594484 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8041070 con 0x7faac40c8b10 2024-09-11T22:27:34.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.699+0000 7faaab7fe640 1 -- 172.21.15.100:0/3565594484 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab803c870 con 0x7faac40c8b10 2024-09-11T22:27:34.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.699+0000 7faac97b7640 1 -- 172.21.15.100:0/3565594484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac40b0200 con 0x7faac40c8b10 2024-09-11T22:27:34.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.699+0000 7faaab7fe640 1 -- 172.21.15.100:0/3565594484 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8037040 con 0x7faac40c8b10 2024-09-11T22:27:34.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.699+0000 7faac97b7640 1 -- 172.21.15.100:0/3565594484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac40b3050 con 0x7faac40c8b10 2024-09-11T22:27:34.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.700+0000 7faac97b7640 1 --2- 172.21.15.100:0/3565594484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac414ade0 0x7faac415b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.700+0000 7faac97b7640 1 -- 172.21.15.100:0/3565594484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faac4156860 con 0x7faac414ade0 2024-09-11T22:27:34.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.700+0000 7faac2ffd640 1 --2- 172.21.15.100:0/3565594484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac414ade0 0x7faac415b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.700+0000 7faac2ffd640 1 -- 172.21.15.100:0/3565594484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faac415b650 con 0x7faac414ade0 2024-09-11T22:27:34.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.701+0000 7faac2ffd640 1 --2- 172.21.15.100:0/3565594484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac414ade0 0x7faac415b930 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faab400e770 tx=0x7faab400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:34.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.701+0000 7faaab7fe640 1 -- 172.21.15.100:0/3565594484 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faab8044070 con 0x7faac40c8b10 2024-09-11T22:27:34.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.701+0000 7faaab7fe640 1 --2- 172.21.15.100:0/3565594484 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7faab006be60 0x7faab006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.701+0000 7faaab7fe640 1 -- 172.21.15.100:0/3565594484 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7faab80abc80 con 0x7faac40c8b10 2024-09-11T22:27:34.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.701+0000 7faac37fe640 1 --2- 172.21.15.100:0/3565594484 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7faab006be60 0x7faab006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.701+0000 7faaab7fe640 1 -- 172.21.15.100:0/3565594484 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4017070 con 0x7faac414ade0 2024-09-11T22:27:34.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.702+0000 7faaab7fe640 1 -- 172.21.15.100:0/3565594484 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7faab400c7a0 con 0x7faac414ade0 2024-09-11T22:27:34.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.702+0000 7faaab7fe640 1 -- 172.21.15.100:0/3565594484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac414ade0 msgr2=0x7faac415b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.702+0000 7faaab7fe640 1 --2- 172.21.15.100:0/3565594484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac414ade0 0x7faac415b930 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faab400e770 tx=0x7faab400ec30 comp rx=0 tx=0).stop 2024-09-11T22:27:34.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.702+0000 7faaab7fe640 1 -- 172.21.15.100:0/3565594484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac414ade0 msgr2=0x7faac415b930 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:27:34.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.702+0000 7faaab7fe640 1 --2- 172.21.15.100:0/3565594484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac414ade0 0x7faac415b930 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faab400e770 tx=0x7faab400ec30 comp rx=0 tx=0).stop 2024-09-11T22:27:34.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.702+0000 7faac37fe640 1 --2- 172.21.15.100:0/3565594484 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7faab006be60 0x7faab006e320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faabc0018a0 tx=0x7faabc001830 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:34.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.709+0000 7faac97b7640 1 --2- 172.21.15.100:0/3565594484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac415adc0 0x7faac40ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.709+0000 7faac97b7640 1 -- 172.21.15.100:0/3565594484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faac40b04e0 con 0x7faac415adc0 2024-09-11T22:27:34.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.709+0000 7faac2ffd640 1 --2- 172.21.15.100:0/3565594484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac415adc0 0x7faac40ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.709+0000 7faac2ffd640 1 -- 172.21.15.100:0/3565594484 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faac406e3e0 con 0x7faac415adc0 2024-09-11T22:27:34.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.709+0000 7faac2ffd640 1 --2- 172.21.15.100:0/3565594484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac415adc0 0x7faac40ae850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faab400e770 tx=0x7faab40046f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:34.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.709+0000 7faaab7fe640 1 -- 172.21.15.100:0/3565594484 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4017070 con 0x7faac415adc0 2024-09-11T22:27:34.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.710+0000 7faaab7fe640 1 -- 172.21.15.100:0/3565594484 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7faab4004020 con 0x7faac415adc0 2024-09-11T22:27:34.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.710+0000 7faaab7fe640 1 -- 172.21.15.100:0/3565594484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac415adc0 msgr2=0x7faac40ae850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.710+0000 7faaab7fe640 1 --2- 172.21.15.100:0/3565594484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac415adc0 0x7faac40ae850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7faab400e770 tx=0x7faab40046f0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.710+0000 7faaab7fe640 1 -- 172.21.15.100:0/3565594484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac415adc0 msgr2=0x7faac40ae850 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:27:34.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.710+0000 7faaab7fe640 1 --2- 172.21.15.100:0/3565594484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac415adc0 0x7faac40ae850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.711 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:27:34.712 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:27:34.712 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:27:34.712 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:27:34.712 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 54, 2024-09-11T22:27:34.712 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 6657, 2024-09-11T22:27:34.712 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:27:34.712 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:27:34.712 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:27:34.712 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:27:34.712 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:34.712 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:27:34.712 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:27:34.713 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:27:34.713 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:27:34.713 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:34.713 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:34.713 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:34.713 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:34.713 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:34.713 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:34.713 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:34.713 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:34.713 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:34.713 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:34.713 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:34.714 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:34.714 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:27:34.714 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:27:34.714 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:34.714 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:34.714 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:34.714 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:34.714 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:34.714 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:34.714 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:34.714 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:34.714 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:34.714 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:34.714 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:34.715 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:34.715 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.715 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:27:34.715 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:27:34.715 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:27:34.715 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:27:34.715 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:27:34.715 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:27:34.715 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:27:34.715 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:27:34.715 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:27:34.715 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:27:34.715 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:27:34.715 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:27:34.716 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:27:34.716 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:27:34.716 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:27:34.716 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:27:34.716 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:27:34.716 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:34.716 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:34.716 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:34.716 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:34.716 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:34.716 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:34.716 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:34.716 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:34.717 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:34.717 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:34.717 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:34.717 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:34.717 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:27:34.717 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.717 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:27:34.717 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.717 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:27:34.717 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:27:34.717 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:34.717 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:34.717 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.717 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:34.718 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:27:34.718 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:34.718 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.718 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.718 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:34.718 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:27:34.718 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:34.718 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:34.718 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:34.718 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.718 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:27:34.718 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:27:34.718 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:34.718 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:34.719 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:34.719 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.719 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.719 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:27:34.719 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:27:34.719 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:34.719 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:34.719 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.719 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:34.719 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:27:34.719 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:34.719 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.719 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.720 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:34.720 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:27:34.720 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:34.720 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:34.720 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:34.720 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.720 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:27:34.720 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:27:34.720 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:34.720 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:34.720 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:34.720 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.720 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.720 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:27:34.721 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:27:34.721 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:34.721 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:34.721 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.721 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:34.721 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:27:34.721 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:34.721 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.721 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.721 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:34.721 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:27:34.721 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:34.721 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:34.721 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:34.722 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.722 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:27:34.722 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:27:34.722 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:34.722 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:34.722 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:34.722 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:34.722 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:34.722 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.722 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:27:34.722 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:27:34.722 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.722 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:34.723 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:34.723 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:27:34.723 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:34.723 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:34.723 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:27:34.723 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.723 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:34.723 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:34.723 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:27:34.723 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:34.723 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:34.723 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.723 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:27:34.723 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:27:34.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.710+0000 7faac97b7640 1 -- 172.21.15.100:0/3565594484 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7faab006be60 msgr2=0x7faab006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.710+0000 7faac97b7640 1 --2- 172.21.15.100:0/3565594484 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7faab006be60 0x7faab006e320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faabc0018a0 tx=0x7faabc001830 comp rx=0 tx=0).stop 2024-09-11T22:27:34.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.710+0000 7faac97b7640 1 -- 172.21.15.100:0/3565594484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac40c8b10 msgr2=0x7faac406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.710+0000 7faac97b7640 1 --2- 172.21.15.100:0/3565594484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac40c8b10 0x7faac406bc10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faab80098c0 tx=0x7faab80046c0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.710+0000 7faac37fe640 1 -- 172.21.15.100:0/3565594484 reap_dead start 2024-09-11T22:27:34.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.710+0000 7faac37fe640 1 -- 172.21.15.100:0/3565594484 reap_dead start 2024-09-11T22:27:34.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.710+0000 7faac97b7640 1 -- 172.21.15.100:0/3565594484 shutdown_connections 2024-09-11T22:27:34.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.710+0000 7faac97b7640 1 -- 172.21.15.100:0/3565594484 >> 172.21.15.100:0/3565594484 conn(0x7faac406e000 msgr2=0x7faac40c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:34.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.710+0000 7faac97b7640 1 -- 172.21.15.100:0/3565594484 shutdown_connections 2024-09-11T22:27:34.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.710+0000 7faac97b7640 1 -- 172.21.15.100:0/3565594484 wait complete. 2024-09-11T22:27:34.726 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:27:34.726 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:27:34.726 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:27:34.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.836+0000 7fe9fe923640 1 Processor -- start 2024-09-11T22:27:34.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.836+0000 7fe9fe923640 1 -- start start 2024-09-11T22:27:34.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.837+0000 7fe9fe923640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9f8154c60 0x7fe9f80d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.837+0000 7fe9fe923640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe9f8155040 0x7fe9f80d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.837+0000 7fe9fe923640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe9f815e3e0 0x7fe9f815e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.837+0000 7fe9fe923640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fe9f815bad0 con 0x7fe9f815e3e0 2024-09-11T22:27:34.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.837+0000 7fe9fe923640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fe9f815ac20 con 0x7fe9f8155040 2024-09-11T22:27:34.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.837+0000 7fe9fe923640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe9f815ed70 con 0x7fe9f8154c60 2024-09-11T22:27:34.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.837+0000 7fe9fcec0640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe9f815e3e0 0x7fe9f815e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.837+0000 7fe9fcec0640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe9f815e3e0 0x7fe9f815e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53756/0 (socket says 172.21.15.100:53756) 2024-09-11T22:27:34.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.837+0000 7fe9fcec0640 1 -- 172.21.15.100:0/2848382603 learned_addr learned my addr 172.21.15.100:0/2848382603 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:34.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.837+0000 7fe9f7fff640 1 --2- 172.21.15.100:0/2848382603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9f8154c60 0x7fe9f80d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.837+0000 7fe9f77fe640 1 --2- 172.21.15.100:0/2848382603 >> v2:172.21.15.167:3300/0 conn(0x7fe9f8155040 0x7fe9f80d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.838+0000 7fe9fcec0640 1 -- 172.21.15.100:0/2848382603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9f8154c60 msgr2=0x7fe9f80d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:27:34.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.838+0000 7fe9fcec0640 1 --2- 172.21.15.100:0/2848382603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9f8154c60 0x7fe9f80d0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.838+0000 7fe9fcec0640 1 -- 172.21.15.100:0/2848382603 >> v2:172.21.15.167:3300/0 conn(0x7fe9f8155040 msgr2=0x7fe9f80d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:27:34.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.838+0000 7fe9fcec0640 1 --2- 172.21.15.100:0/2848382603 >> v2:172.21.15.167:3300/0 conn(0x7fe9f8155040 0x7fe9f80d08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.838+0000 7fe9fcec0640 1 -- 172.21.15.100:0/2848382603 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f815aec0 con 0x7fe9f815e3e0 2024-09-11T22:27:34.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.838+0000 7fe9f7fff640 1 --2- 172.21.15.100:0/2848382603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9f8154c60 0x7fe9f80d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:27:34.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.838+0000 7fe9fcec0640 1 --2- 172.21.15.100:0/2848382603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9f815e3e0 0x7fe9f815e830 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe9f806cdb0 tx=0x7fe9f002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609a8526fecf1d9c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:34.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.839+0000 7fe9f6ffd640 1 -- 172.21.15.100:0/2848382603 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0036070 con 0x7fe9f815e3e0 2024-09-11T22:27:34.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.839+0000 7fe9f6ffd640 1 -- 172.21.15.100:0/2848382603 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f0031600 con 0x7fe9f815e3e0 2024-09-11T22:27:34.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.839+0000 7fe9f6ffd640 1 -- 172.21.15.100:0/2848382603 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f00319d0 con 0x7fe9f815e3e0 2024-09-11T22:27:34.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.839+0000 7fe9fe923640 1 -- 172.21.15.100:0/2848382603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9f815e3e0 msgr2=0x7fe9f815e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.839+0000 7fe9fe923640 1 --2- 172.21.15.100:0/2848382603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9f815e3e0 0x7fe9f815e830 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe9f806cdb0 tx=0x7fe9f002a730 comp rx=0 tx=0).stop 2024-09-11T22:27:34.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.839+0000 7fe9fe923640 1 -- 172.21.15.100:0/2848382603 shutdown_connections 2024-09-11T22:27:34.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.839+0000 7fe9fe923640 1 --2- 172.21.15.100:0/2848382603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9f815e3e0 0x7fe9f815e830 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.839+0000 7fe9fe923640 1 --2- 172.21.15.100:0/2848382603 >> v2:172.21.15.167:3300/0 conn(0x7fe9f8155040 0x7fe9f80d08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.839+0000 7fe9fe923640 1 --2- 172.21.15.100:0/2848382603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9f8154c60 0x7fe9f80d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.839+0000 7fe9fe923640 1 -- 172.21.15.100:0/2848382603 >> 172.21.15.100:0/2848382603 conn(0x7fe9f806d060 msgr2=0x7fe9f806d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:34.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.839+0000 7fe9fe923640 1 -- 172.21.15.100:0/2848382603 shutdown_connections 2024-09-11T22:27:34.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.839+0000 7fe9fe923640 1 -- 172.21.15.100:0/2848382603 wait complete. 2024-09-11T22:27:34.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.840+0000 7fe9fe923640 1 Processor -- start 2024-09-11T22:27:34.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.841+0000 7fe9fe923640 1 -- start start 2024-09-11T22:27:34.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.841+0000 7fe9fe923640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9f8154c60 0x7fe9f8153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.841+0000 7fe9fe923640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9f8155040 0x7fe9f8151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.841+0000 7fe9fe923640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9f815e3e0 0x7fe9f80c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.841+0000 7fe9fe923640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f815b760 con 0x7fe9f815e3e0 2024-09-11T22:27:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.841+0000 7fe9fe923640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f815b480 con 0x7fe9f8154c60 2024-09-11T22:27:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.841+0000 7fe9fe923640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe9f80c5e10 con 0x7fe9f8155040 2024-09-11T22:27:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.841+0000 7fe9fcec0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9f815e3e0 0x7fe9f80c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.841+0000 7fe9fcec0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9f815e3e0 0x7fe9f80c7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53772/0 (socket says 172.21.15.100:53772) 2024-09-11T22:27:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.841+0000 7fe9fcec0640 1 -- 172.21.15.100:0/970922743 learned_addr learned my addr 172.21.15.100:0/970922743 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.842+0000 7fe9f77fe640 1 --2- 172.21.15.100:0/970922743 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9f8155040 0x7fe9f8151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.842+0000 7fe9f7fff640 1 --2- 172.21.15.100:0/970922743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9f8154c60 0x7fe9f8153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.842+0000 7fe9fcec0640 1 -- 172.21.15.100:0/970922743 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9f8155040 msgr2=0x7fe9f8151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.842+0000 7fe9fcec0640 1 --2- 172.21.15.100:0/970922743 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9f8155040 0x7fe9f8151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.842+0000 7fe9fcec0640 1 -- 172.21.15.100:0/970922743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9f8154c60 msgr2=0x7fe9f8153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.842+0000 7fe9fcec0640 1 --2- 172.21.15.100:0/970922743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9f8154c60 0x7fe9f8153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.842+0000 7fe9fcec0640 1 -- 172.21.15.100:0/970922743 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f81f0e20 con 0x7fe9f815e3e0 2024-09-11T22:27:34.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.842+0000 7fe9f7fff640 1 --2- 172.21.15.100:0/970922743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9f8154c60 0x7fe9f8153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:27:34.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.842+0000 7fe9fcec0640 1 --2- 172.21.15.100:0/970922743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9f815e3e0 0x7fe9f80c7df0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0009f40 tx=0x7fe9f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:34.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.842+0000 7fe9f4ff9640 1 -- 172.21.15.100:0/970922743 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f003f020 con 0x7fe9f815e3e0 2024-09-11T22:27:34.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.842+0000 7fe9f4ff9640 1 -- 172.21.15.100:0/970922743 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f0037040 con 0x7fe9f815e3e0 2024-09-11T22:27:34.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.842+0000 7fe9fe923640 1 -- 172.21.15.100:0/970922743 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9f81f10c0 con 0x7fe9f815e3e0 2024-09-11T22:27:34.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.842+0000 7fe9f4ff9640 1 -- 172.21.15.100:0/970922743 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0036070 con 0x7fe9f815e3e0 2024-09-11T22:27:34.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.842+0000 7fe9fe923640 1 -- 172.21.15.100:0/970922743 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9f8150980 con 0x7fe9f815e3e0 2024-09-11T22:27:34.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.843+0000 7fe9fe923640 1 --2- 172.21.15.100:0/970922743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9f815dc80 0x7fe9f81f3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.843+0000 7fe9fe923640 1 -- 172.21.15.100:0/970922743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f8074290 con 0x7fe9f815dc80 2024-09-11T22:27:34.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.843+0000 7fe9f7fff640 1 --2- 172.21.15.100:0/970922743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9f815dc80 0x7fe9f81f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.844+0000 7fe9f7fff640 1 -- 172.21.15.100:0/970922743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe9f815e830 con 0x7fe9f815dc80 2024-09-11T22:27:34.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.844+0000 7fe9f4ff9640 1 -- 172.21.15.100:0/970922743 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe9f0042020 con 0x7fe9f815e3e0 2024-09-11T22:27:34.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.844+0000 7fe9f7fff640 1 --2- 172.21.15.100:0/970922743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9f815dc80 0x7fe9f81f3910 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800f580 tx=0x7fe9e800fa40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:34.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.844+0000 7fe9f4ff9640 1 --2- 172.21.15.100:0/970922743 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe9e406be60 0x7fe9e406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.844+0000 7fe9f4ff9640 1 -- 172.21.15.100:0/970922743 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fe9f00ab530 con 0x7fe9f815e3e0 2024-09-11T22:27:34.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.844+0000 7fe9f77fe640 1 --2- 172.21.15.100:0/970922743 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe9e406be60 0x7fe9e406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.845+0000 7fe9f4ff9640 1 -- 172.21.15.100:0/970922743 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8019020 con 0x7fe9f815dc80 2024-09-11T22:27:34.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.845+0000 7fe9f4ff9640 1 -- 172.21.15.100:0/970922743 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe9e8014870 con 0x7fe9f815dc80 2024-09-11T22:27:34.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.845+0000 7fe9f4ff9640 1 -- 172.21.15.100:0/970922743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9f815dc80 msgr2=0x7fe9f81f3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.845+0000 7fe9f4ff9640 1 --2- 172.21.15.100:0/970922743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9f815dc80 0x7fe9f81f3910 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800f580 tx=0x7fe9e800fa40 comp rx=0 tx=0).stop 2024-09-11T22:27:34.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.845+0000 7fe9f4ff9640 1 -- 172.21.15.100:0/970922743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9f815dc80 msgr2=0x7fe9f81f3910 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:27:34.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.845+0000 7fe9f4ff9640 1 --2- 172.21.15.100:0/970922743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9f815dc80 0x7fe9f81f3910 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.845+0000 7fe9f77fe640 1 --2- 172.21.15.100:0/970922743 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe9e406be60 0x7fe9e406e320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80c5b10 tx=0x7fe9ec009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:34.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.851+0000 7fe9fe923640 1 --2- 172.21.15.100:0/970922743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9f80c8330 0x7fe9f81f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.851+0000 7fe9fe923640 1 -- 172.21.15.100:0/970922743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f8159ad0 con 0x7fe9f80c8330 2024-09-11T22:27:34.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.852+0000 7fe9f7fff640 1 --2- 172.21.15.100:0/970922743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9f80c8330 0x7fe9f81f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.853+0000 7fe9f7fff640 1 -- 172.21.15.100:0/970922743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe9f814f6f0 con 0x7fe9f80c8330 2024-09-11T22:27:34.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.854+0000 7fe9f7fff640 1 --2- 172.21.15.100:0/970922743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9f80c8330 0x7fe9f81f3e50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800f580 tx=0x7fe9e8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:34.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.854+0000 7fe9f4ff9640 1 -- 172.21.15.100:0/970922743 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8019070 con 0x7fe9f80c8330 2024-09-11T22:27:34.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.854+0000 7fe9f4ff9640 1 -- 172.21.15.100:0/970922743 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4887 (secure 0 0 0) 0x7fe9e8015410 con 0x7fe9f80c8330 2024-09-11T22:27:34.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.854+0000 7fe9f4ff9640 1 -- 172.21.15.100:0/970922743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9f80c8330 msgr2=0x7fe9f81f3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.854+0000 7fe9f4ff9640 1 --2- 172.21.15.100:0/970922743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9f80c8330 0x7fe9f81f3e50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800f580 tx=0x7fe9e8004730 comp rx=0 tx=0).stop 2024-09-11T22:27:34.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.854+0000 7fe9f4ff9640 1 -- 172.21.15.100:0/970922743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9f80c8330 msgr2=0x7fe9f81f3e50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:27:34.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.854+0000 7fe9f4ff9640 1 --2- 172.21.15.100:0/970922743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9f80c8330 0x7fe9f81f3e50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.856 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:27:34.856 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:27:34.856 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:27:34.856 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:27:34.856 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 54, 2024-09-11T22:27:34.856 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 240132, 2024-09-11T22:27:34.856 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:27:34.856 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:27:34.857 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:27:34.857 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:27:34.857 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:34.857 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:27:34.857 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:27:34.857 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:27:34.857 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:27:34.857 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:34.857 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:34.857 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:34.857 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:34.857 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:34.857 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:34.858 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:34.858 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:34.858 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:34.858 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:34.858 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:34.858 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:34.858 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:27:34.858 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:27:34.858 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:34.858 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:34.858 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:34.858 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:34.858 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:34.858 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:34.859 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:34.859 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:34.859 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:34.859 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:34.859 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:34.859 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:34.859 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.859 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:27:34.859 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:27:34.859 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:27:34.859 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:27:34.859 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:27:34.859 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:27:34.859 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:27:34.860 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:27:34.860 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:27:34.860 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:27:34.860 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:27:34.860 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:27:34.860 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:27:34.860 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:27:34.860 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:27:34.860 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:27:34.860 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:27:34.860 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:34.860 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:34.860 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:34.860 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:34.861 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:34.861 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:34.861 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:34.861 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:34.861 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:34.861 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:34.861 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:34.861 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:34.861 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:27:34.861 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.861 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:27:34.861 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.862 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:27:34.862 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:27:34.862 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:34.862 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:34.862 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.862 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:34.862 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:27:34.862 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:34.862 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.862 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.862 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:34.862 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:27:34.862 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:34.863 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:34.863 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:34.863 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.863 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:27:34.863 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:27:34.863 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:34.863 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:34.863 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:34.863 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.863 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.863 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:27:34.863 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:27:34.863 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:34.863 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:34.864 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.864 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:34.864 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:27:34.864 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:34.864 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.864 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.864 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:34.864 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:27:34.864 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:34.864 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:34.864 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:34.864 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.864 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:27:34.865 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:27:34.865 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:34.865 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:34.865 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:34.865 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.865 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.865 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:27:34.865 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:27:34.865 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:34.865 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:34.865 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.865 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:34.865 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:27:34.865 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:34.865 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.866 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.866 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:34.866 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:27:34.866 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:34.866 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:34.866 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:34.866 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.866 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:27:34.866 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:27:34.866 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:34.866 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:34.866 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:34.867 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:34.867 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:34.867 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.867 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:27:34.867 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:27:34.867 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.867 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:34.868 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:34.868 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:27:34.868 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:34.868 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:34.868 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:27:34.868 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.868 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:34.868 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:34.868 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:27:34.868 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:34.868 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:34.868 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:27:34.868 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.869 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:34.869 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:34.869 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:27:34.869 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:34.869 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:34.869 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:27:34.869 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:34.869 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:34.869 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:34.869 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:27:34.869 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:34.869 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:34.869 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:34.869 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:27:34.869 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:27:34.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.855+0000 7fe9fe923640 1 -- 172.21.15.100:0/970922743 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe9e406be60 msgr2=0x7fe9e406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.855+0000 7fe9fe923640 1 --2- 172.21.15.100:0/970922743 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe9e406be60 0x7fe9e406e320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80c5b10 tx=0x7fe9ec009190 comp rx=0 tx=0).stop 2024-09-11T22:27:34.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.855+0000 7fe9fe923640 1 -- 172.21.15.100:0/970922743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9f815e3e0 msgr2=0x7fe9f80c7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.855+0000 7fe9fe923640 1 --2- 172.21.15.100:0/970922743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9f815e3e0 0x7fe9f80c7df0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0009f40 tx=0x7fe9f0004a40 comp rx=0 tx=0).stop 2024-09-11T22:27:34.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.855+0000 7fe9fcec0640 1 -- 172.21.15.100:0/970922743 reap_dead start 2024-09-11T22:27:34.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.855+0000 7fe9fcec0640 1 -- 172.21.15.100:0/970922743 reap_dead start 2024-09-11T22:27:34.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.855+0000 7fe9fe923640 1 -- 172.21.15.100:0/970922743 shutdown_connections 2024-09-11T22:27:34.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.855+0000 7fe9fe923640 1 -- 172.21.15.100:0/970922743 >> 172.21.15.100:0/970922743 conn(0x7fe9f806d060 msgr2=0x7fe9f8151ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:34.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.855+0000 7fe9fe923640 1 -- 172.21.15.100:0/970922743 shutdown_connections 2024-09-11T22:27:34.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.855+0000 7fe9fe923640 1 -- 172.21.15.100:0/970922743 wait complete. 2024-09-11T22:27:34.872 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:27:34.872 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:27:34.873 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:27:34.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.979+0000 7fad7fa4c640 1 Processor -- start 2024-09-11T22:27:34.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.979+0000 7fad7fa4c640 1 -- start start 2024-09-11T22:27:34.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.980+0000 7fad7fa4c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fad78154d30 0x7fad7815e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.980+0000 7fad7fa4c640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad7806bc10 con 0x7fad780c8b10 2024-09-11T22:27:34.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.980+0000 7fad7fa4c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad78155110 con 0x7fad780c9b40 2024-09-11T22:27:34.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.980+0000 7fad7fa4c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fad7815ace0 con 0x7fad78154d30 2024-09-11T22:27:34.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.980+0000 7fad7dfe9640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fad780c8b10 0x7fad780caf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37088/0 (socket says 172.21.15.100:37088) 2024-09-11T22:27:34.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.980+0000 7fad7dfe9640 1 -- 172.21.15.100:0/3587868313 learned_addr learned my addr 172.21.15.100:0/3587868313 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:27:34.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.980+0000 7fad7d7e8640 1 --2- 172.21.15.100:0/3587868313 >> v2:172.21.15.167:3300/0 conn(0x7fad78154d30 0x7fad7815e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.980+0000 7fad6ffff640 1 -- 172.21.15.100:0/3587868313 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1625681017 0 0) 0x7fad70001490 con 0x7fad780c8b10 2024-09-11T22:27:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.981+0000 7fad6ffff640 1 -- 172.21.15.100:0/3587868313 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad64003520 con 0x7fad780c8b10 2024-09-11T22:27:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.981+0000 7fad6ffff640 1 -- 172.21.15.100:0/3587868313 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2488395875 0 0) 0x7fad64003520 con 0x7fad780c8b10 2024-09-11T22:27:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.981+0000 7fad6ffff640 1 -- 172.21.15.100:0/3587868313 >> v2:172.21.15.167:3300/0 conn(0x7fad78154d30 msgr2=0x7fad7815e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:27:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.981+0000 7fad6ffff640 1 --2- 172.21.15.100:0/3587868313 >> v2:172.21.15.167:3300/0 conn(0x7fad78154d30 0x7fad7815e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.981+0000 7fad6ffff640 1 -- 172.21.15.100:0/3587868313 >> v1:172.21.15.167:6789/0 conn(0x7fad780c9b40 legacy=0x7fad7815b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.981+0000 7fad6ffff640 1 -- 172.21.15.100:0/3587868313 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad780ca010 con 0x7fad780c8b10 2024-09-11T22:27:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.981+0000 7fad6ffff640 1 -- 172.21.15.100:0/3587868313 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fad70001bc0 con 0x7fad780c8b10 2024-09-11T22:27:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.981+0000 7fad6ffff640 1 -- 172.21.15.100:0/3587868313 >> v1:172.21.15.100:6789/0 conn(0x7fad780c8b10 legacy=0x7fad780caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.981+0000 7fad6ffff640 1 --2- 172.21.15.100:0/3587868313 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad640039b0 0x7fad64003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.981+0000 7fad6ffff640 1 --2- 172.21.15.100:0/3587868313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad640043b0 0x7fad64004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.981+0000 7fad6ffff640 1 --2- 172.21.15.100:0/3587868313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad64005120 0x7fad6400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.981+0000 7fad6ffff640 1 -- 172.21.15.100:0/3587868313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fad7815ace0 con 0x7fad64005120 2024-09-11T22:27:34.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.981+0000 7fad6ffff640 1 -- 172.21.15.100:0/3587868313 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fad6400c060 con 0x7fad640043b0 2024-09-11T22:27:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.981+0000 7fad6ffff640 1 -- 172.21.15.100:0/3587868313 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fad6400c260 con 0x7fad640039b0 2024-09-11T22:27:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.981+0000 7fad7dfe9640 1 --2- 172.21.15.100:0/3587868313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad64005120 0x7fad6400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.981+0000 7fad7d7e8640 1 --2- 172.21.15.100:0/3587868313 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad640039b0 0x7fad64003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.981+0000 7fad7cfe7640 1 --2- 172.21.15.100:0/3587868313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad640043b0 0x7fad64004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.981+0000 7fad7dfe9640 1 -- 172.21.15.100:0/3587868313 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad640039b0 msgr2=0x7fad64003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:27:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.981+0000 7fad7dfe9640 1 --2- 172.21.15.100:0/3587868313 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad640039b0 0x7fad64003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.981+0000 7fad7dfe9640 1 -- 172.21.15.100:0/3587868313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad640043b0 msgr2=0x7fad64004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:27:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.981+0000 7fad7dfe9640 1 --2- 172.21.15.100:0/3587868313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad640043b0 0x7fad64004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.981+0000 7fad7dfe9640 1 -- 172.21.15.100:0/3587868313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad64003520 con 0x7fad64005120 2024-09-11T22:27:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.982+0000 7fad7dfe9640 1 -- 172.21.15.100:0/3587868313 reap_dead start 2024-09-11T22:27:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.982+0000 7fad7dfe9640 1 --2- 172.21.15.100:0/3587868313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad64005120 0x7fad6400b9c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fad7000a9e0 tx=0x7fad64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5716a330c20e9f18 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.982+0000 7fad6ffff640 1 -- 172.21.15.100:0/3587868313 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7000a600 con 0x7fad64005120 2024-09-11T22:27:34.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.982+0000 7fad6ffff640 1 -- 172.21.15.100:0/3587868313 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad7002f070 con 0x7fad64005120 2024-09-11T22:27:34.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.982+0000 7fad6ffff640 1 -- 172.21.15.100:0/3587868313 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7002be30 con 0x7fad64005120 2024-09-11T22:27:34.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.983+0000 7fad7fa4c640 1 -- 172.21.15.100:0/3587868313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad64005120 msgr2=0x7fad6400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.983+0000 7fad7fa4c640 1 --2- 172.21.15.100:0/3587868313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad64005120 0x7fad6400b9c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fad7000a9e0 tx=0x7fad64005830 comp rx=0 tx=0).stop 2024-09-11T22:27:34.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.983+0000 7fad7fa4c640 1 -- 172.21.15.100:0/3587868313 shutdown_connections 2024-09-11T22:27:34.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.983+0000 7fad7fa4c640 1 --2- 172.21.15.100:0/3587868313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad64005120 0x7fad6400b9c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.983+0000 7fad7fa4c640 1 -- 172.21.15.100:0/3587868313 >> 172.21.15.100:0/3587868313 conn(0x7fad7806e000 msgr2=0x7fad7806e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:34.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.983+0000 7fad7fa4c640 1 -- 172.21.15.100:0/3587868313 shutdown_connections 2024-09-11T22:27:34.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.983+0000 7fad7fa4c640 1 -- 172.21.15.100:0/3587868313 wait complete. 2024-09-11T22:27:34.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.984+0000 7fad7fa4c640 1 Processor -- start 2024-09-11T22:27:34.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.984+0000 7fad7fa4c640 1 -- start start 2024-09-11T22:27:34.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.985+0000 7fad7fa4c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad64005120 0x7fad7815cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.985+0000 7fad7fa4c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad78072010 0x7fad780cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.985+0000 7fad7fa4c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad78152890 0x7fad781f3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.985+0000 7fad7fa4c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fad780ca5b0 con 0x7fad64005120 2024-09-11T22:27:34.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.985+0000 7fad7fa4c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fad780ca2d0 con 0x7fad78152890 2024-09-11T22:27:34.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.985+0000 7fad7fa4c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fad780ca890 con 0x7fad78072010 2024-09-11T22:27:34.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.985+0000 7fad7d7e8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad64005120 0x7fad7815cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.985+0000 7fad7d7e8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad64005120 0x7fad7815cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53786/0 (socket says 172.21.15.100:53786) 2024-09-11T22:27:34.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.985+0000 7fad7d7e8640 1 -- 172.21.15.100:0/696131535 learned_addr learned my addr 172.21.15.100:0/696131535 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:34.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.985+0000 7fad7cfe7640 1 --2- 172.21.15.100:0/696131535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad78072010 0x7fad780cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.985+0000 7fad7dfe9640 1 --2- 172.21.15.100:0/696131535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad78152890 0x7fad781f3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.985+0000 7fad7d7e8640 1 -- 172.21.15.100:0/696131535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad78072010 msgr2=0x7fad780cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.985+0000 7fad7d7e8640 1 --2- 172.21.15.100:0/696131535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad78072010 0x7fad780cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.985+0000 7fad7d7e8640 1 -- 172.21.15.100:0/696131535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad78152890 msgr2=0x7fad781f3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.985+0000 7fad7d7e8640 1 --2- 172.21.15.100:0/696131535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad78152890 0x7fad781f3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.985+0000 7fad7d7e8640 1 -- 172.21.15.100:0/696131535 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad781f4730 con 0x7fad64005120 2024-09-11T22:27:34.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.986+0000 7fad7d7e8640 1 --2- 172.21.15.100:0/696131535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad64005120 0x7fad7815cfb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fad74011910 tx=0x7fad74011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:34.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.986+0000 7fad6dffb640 1 -- 172.21.15.100:0/696131535 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7400faf0 con 0x7fad64005120 2024-09-11T22:27:34.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.986+0000 7fad6dffb640 1 -- 172.21.15.100:0/696131535 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad7400fc90 con 0x7fad64005120 2024-09-11T22:27:34.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.986+0000 7fad7fa4c640 1 -- 172.21.15.100:0/696131535 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad78152f30 con 0x7fad64005120 2024-09-11T22:27:34.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.986+0000 7fad6dffb640 1 -- 172.21.15.100:0/696131535 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad74014440 con 0x7fad64005120 2024-09-11T22:27:34.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.986+0000 7fad7fa4c640 1 -- 172.21.15.100:0/696131535 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad7815c7b0 con 0x7fad64005120 2024-09-11T22:27:34.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.987+0000 7fad7fa4c640 1 --2- 172.21.15.100:0/696131535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad7815c9f0 0x7fad781f4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.987+0000 7fad7fa4c640 1 -- 172.21.15.100:0/696131535 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fad7815e990 con 0x7fad7815c9f0 2024-09-11T22:27:34.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.987+0000 7fad7cfe7640 1 --2- 172.21.15.100:0/696131535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad7815c9f0 0x7fad781f4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.988+0000 7fad6dffb640 1 -- 172.21.15.100:0/696131535 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad74012040 con 0x7fad64005120 2024-09-11T22:27:34.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.988+0000 7fad7cfe7640 1 -- 172.21.15.100:0/696131535 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad780c9710 con 0x7fad7815c9f0 2024-09-11T22:27:34.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.988+0000 7fad7cfe7640 1 --2- 172.21.15.100:0/696131535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad7815c9f0 0x7fad781f4010 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fad7815a370 tx=0x7fad68012cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:34.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.988+0000 7fad6dffb640 1 --2- 172.21.15.100:0/696131535 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fad5c06be60 0x7fad5c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.988+0000 7fad6dffb640 1 -- 172.21.15.100:0/696131535 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fad7408b850 con 0x7fad64005120 2024-09-11T22:27:34.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.988+0000 7fad7dfe9640 1 --2- 172.21.15.100:0/696131535 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fad5c06be60 0x7fad5c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.988+0000 7fad6dffb640 1 -- 172.21.15.100:0/696131535 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad68005320 con 0x7fad7815c9f0 2024-09-11T22:27:34.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.988+0000 7fad6dffb640 1 -- 172.21.15.100:0/696131535 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fad6801a070 con 0x7fad7815c9f0 2024-09-11T22:27:34.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.988+0000 7fad6dffb640 1 -- 172.21.15.100:0/696131535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad7815c9f0 msgr2=0x7fad781f4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.988+0000 7fad6dffb640 1 --2- 172.21.15.100:0/696131535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad7815c9f0 0x7fad781f4010 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fad7815a370 tx=0x7fad68012cf0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.988+0000 7fad6dffb640 1 -- 172.21.15.100:0/696131535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad7815c9f0 msgr2=0x7fad781f4010 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:27:34.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.988+0000 7fad6dffb640 1 --2- 172.21.15.100:0/696131535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad7815c9f0 0x7fad781f4010 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.989+0000 7fad7dfe9640 1 --2- 172.21.15.100:0/696131535 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fad5c06be60 0x7fad5c06e320 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fad6400c030 tx=0x7fad70009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:34.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.996+0000 7fad7fa4c640 1 --2- 172.21.15.100:0/696131535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad7814ee40 0x7fad7814f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:34.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.996+0000 7fad7fa4c640 1 -- 172.21.15.100:0/696131535 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fad780c9080 con 0x7fad7814ee40 2024-09-11T22:27:34.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.997+0000 7fad7cfe7640 1 --2- 172.21.15.100:0/696131535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad7814ee40 0x7fad7814f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:34.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.997+0000 7fad7cfe7640 1 -- 172.21.15.100:0/696131535 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fad78154240 con 0x7fad7814ee40 2024-09-11T22:27:34.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.997+0000 7fad7cfe7640 1 --2- 172.21.15.100:0/696131535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad7814ee40 0x7fad7814f260 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fad781544f0 tx=0x7fad680012b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:34.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.997+0000 7fad6dffb640 1 -- 172.21.15.100:0/696131535 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad680074c0 con 0x7fad7814ee40 2024-09-11T22:27:34.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.998+0000 7fad6dffb640 1 -- 172.21.15.100:0/696131535 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7fad680074c0 con 0x7fad7814ee40 2024-09-11T22:27:34.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.998+0000 7fad6dffb640 1 -- 172.21.15.100:0/696131535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad7814ee40 msgr2=0x7fad7814f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:34.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.998+0000 7fad6dffb640 1 --2- 172.21.15.100:0/696131535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad7814ee40 0x7fad7814f260 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fad781544f0 tx=0x7fad680012b0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.998+0000 7fad6dffb640 1 -- 172.21.15.100:0/696131535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad7814ee40 msgr2=0x7fad7814f260 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:27:34.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.998+0000 7fad6dffb640 1 --2- 172.21.15.100:0/696131535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad7814ee40 0x7fad7814f260 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:34.999 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:27:34.999 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:27:35.000 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:27:35.000 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:27:35.000 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 54, 2024-09-11T22:27:35.000 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 345719, 2024-09-11T22:27:35.000 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:27:35.000 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:27:35.000 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:27:35.000 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:27:35.000 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:35.000 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:27:35.000 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:27:35.000 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:27:35.001 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:27:35.001 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:35.001 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:35.001 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:35.001 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:35.001 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:35.001 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:35.001 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:35.001 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:35.001 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:35.001 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:35.001 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:35.001 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:35.001 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:27:35.002 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:27:35.002 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:35.002 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:35.002 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:35.002 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:35.002 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:35.002 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:35.002 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:35.002 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:35.002 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:35.002 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:35.002 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:35.002 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:35.002 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:35.003 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:27:35.003 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:27:35.003 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:27:35.003 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:27:35.003 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:27:35.003 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:27:35.003 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:27:35.003 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:27:35.003 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:27:35.003 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:27:35.003 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:27:35.003 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:27:35.003 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:27:35.003 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:27:35.004 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:27:35.004 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:27:35.004 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:27:35.004 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:35.004 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:35.004 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:35.004 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:35.004 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:35.004 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:35.004 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:35.004 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:35.004 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:35.004 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:35.005 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:35.005 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:35.005 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:27:35.005 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:35.005 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:27:35.005 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:35.005 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:27:35.005 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:27:35.005 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:35.005 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:35.005 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:35.005 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:35.005 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:27:35.005 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:35.006 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:35.006 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:35.006 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:35.006 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:27:35.006 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:35.006 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:35.006 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:35.006 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:35.006 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:27:35.006 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:27:35.006 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:35.006 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:35.006 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:35.006 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:35.007 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:35.007 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:27:35.007 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:27:35.007 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:35.007 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:35.007 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:35.007 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:35.007 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:27:35.007 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:35.007 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:35.007 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:35.007 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:35.007 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:27:35.008 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:35.008 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:35.008 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:35.008 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:35.008 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:27:35.008 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:27:35.008 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:35.008 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:35.008 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:35.008 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:35.008 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:35.008 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:27:35.008 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:27:35.008 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:35.009 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:35.009 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:35.009 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:35.009 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:27:35.009 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:35.009 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:35.009 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:35.009 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:35.009 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:27:35.009 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:35.009 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:35.009 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:35.009 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:35.010 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:27:35.010 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:27:35.010 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:35.010 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:35.010 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:35.010 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:35.010 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:35.010 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:35.010 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:27:35.010 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:27:35.010 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:35.010 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:35.010 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:35.010 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:27:35.011 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:35.011 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:35.011 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:27:35.011 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:35.011 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:35.011 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:35.011 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:27:35.011 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:35.011 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:35.011 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:27:35.011 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:35.011 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:35.011 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:35.011 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:27:35.012 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:35.012 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:35.012 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:27:35.012 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:35.012 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:35.012 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:35.012 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:27:35.012 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:35.012 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:35.012 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:27:35.012 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:35.012 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:35.012 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:35.012 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:27:35.013 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:35.013 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:35.013 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:35.013 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:27:35.013 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:27:35.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.998+0000 7fad7fa4c640 1 -- 172.21.15.100:0/696131535 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fad5c06be60 msgr2=0x7fad5c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:35.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.998+0000 7fad7fa4c640 1 --2- 172.21.15.100:0/696131535 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fad5c06be60 0x7fad5c06e320 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fad6400c030 tx=0x7fad70009030 comp rx=0 tx=0).stop 2024-09-11T22:27:35.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.998+0000 7fad7fa4c640 1 -- 172.21.15.100:0/696131535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad64005120 msgr2=0x7fad7815cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:35.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.998+0000 7fad7fa4c640 1 --2- 172.21.15.100:0/696131535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad64005120 0x7fad7815cfb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fad74011910 tx=0x7fad74011dd0 comp rx=0 tx=0).stop 2024-09-11T22:27:35.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.998+0000 7fad7dfe9640 1 -- 172.21.15.100:0/696131535 reap_dead start 2024-09-11T22:27:35.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.998+0000 7fad7fa4c640 1 -- 172.21.15.100:0/696131535 shutdown_connections 2024-09-11T22:27:35.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.998+0000 7fad7fa4c640 1 --2- 172.21.15.100:0/696131535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad64005120 0x7fad7815cfb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:35.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.998+0000 7fad7fa4c640 1 -- 172.21.15.100:0/696131535 >> 172.21.15.100:0/696131535 conn(0x7fad7806e000 msgr2=0x7fad780cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:35.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.998+0000 7fad7fa4c640 1 -- 172.21.15.100:0/696131535 shutdown_connections 2024-09-11T22:27:35.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:34.998+0000 7fad7fa4c640 1 -- 172.21.15.100:0/696131535 wait complete. 2024-09-11T22:27:35.015 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:27:35.015 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-11T22:27:35.015 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-11T22:27:35.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.127+0000 7f4beabcd640 1 Processor -- start 2024-09-11T22:27:35.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.127+0000 7f4beabcd640 1 -- start start 2024-09-11T22:27:35.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.128+0000 7f4beabcd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4be4154c20 0x7f4be40cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:35.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.128+0000 7f4beabcd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4be415a7e0 0x7f4be40cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:35.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.128+0000 7f4beabcd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4be415ac90 con 0x7f4be40b3190 2024-09-11T22:27:35.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.128+0000 7f4beabcd640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f4be415e000 con 0x7f4be4154c20 2024-09-11T22:27:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.128+0000 7f4beabcd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4be415af70 con 0x7f4be415a7e0 2024-09-11T22:27:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.128+0000 7f4be8969640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4be4154c20 0x7f4be40cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.128+0000 7f4be8969640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4be4154c20 0x7f4be40cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53792/0 (socket says 172.21.15.100:53792) 2024-09-11T22:27:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.128+0000 7f4be8969640 1 -- 172.21.15.100:0/576629525 learned_addr learned my addr 172.21.15.100:0/576629525 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.129+0000 7f4be916a640 1 --2- 172.21.15.100:0/576629525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4be415a7e0 0x7f4be40cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.129+0000 7f4be8969640 1 -- 172.21.15.100:0/576629525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4be415a7e0 msgr2=0x7f4be40cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:27:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.129+0000 7f4be8969640 1 --2- 172.21.15.100:0/576629525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4be415a7e0 0x7f4be40cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.129+0000 7f4be8969640 1 -- 172.21.15.100:0/576629525 >> v1:172.21.15.167:6789/0 conn(0x7f4be40b3190 legacy=0x7f4be415e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:27:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.129+0000 7f4be8969640 1 -- 172.21.15.100:0/576629525 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be415b250 con 0x7f4be4154c20 2024-09-11T22:27:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.129+0000 7f4be8969640 1 --2- 172.21.15.100:0/576629525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4be4154c20 0x7f4be40cb120 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4be40732d0 tx=0x7f4bd802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95de95d8b907c100 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.129+0000 7f4be37fe640 1 -- 172.21.15.100:0/576629525 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8037070 con 0x7f4be4154c20 2024-09-11T22:27:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.130+0000 7f4be37fe640 1 -- 172.21.15.100:0/576629525 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd8032440 con 0x7f4be4154c20 2024-09-11T22:27:35.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.130+0000 7f4be37fe640 1 -- 172.21.15.100:0/576629525 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8032810 con 0x7f4be4154c20 2024-09-11T22:27:35.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.130+0000 7f4beabcd640 1 -- 172.21.15.100:0/576629525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4be4154c20 msgr2=0x7f4be40cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.130+0000 7f4beabcd640 1 --2- 172.21.15.100:0/576629525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4be4154c20 0x7f4be40cb120 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4be40732d0 tx=0x7f4bd802a1e0 comp rx=0 tx=0).stop 2024-09-11T22:27:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.130+0000 7f4beabcd640 1 -- 172.21.15.100:0/576629525 shutdown_connections 2024-09-11T22:27:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.130+0000 7f4beabcd640 1 --2- 172.21.15.100:0/576629525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4be415a7e0 0x7f4be40cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.130+0000 7f4beabcd640 1 --2- 172.21.15.100:0/576629525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4be4154c20 0x7f4be40cb120 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.130+0000 7f4beabcd640 1 -- 172.21.15.100:0/576629525 >> 172.21.15.100:0/576629525 conn(0x7f4be4067d40 msgr2=0x7f4be406d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.130+0000 7f4beabcd640 1 -- 172.21.15.100:0/576629525 shutdown_connections 2024-09-11T22:27:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.130+0000 7f4beabcd640 1 -- 172.21.15.100:0/576629525 wait complete. 2024-09-11T22:27:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.131+0000 7f4beabcd640 1 Processor -- start 2024-09-11T22:27:35.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.132+0000 7f4beabcd640 1 -- start start 2024-09-11T22:27:35.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.132+0000 7f4beabcd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4be40b3190 0x7f4be41f4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:35.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.132+0000 7f4beabcd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4be4154c20 0x7f4be415b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:35.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.132+0000 7f4beabcd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4be415a7e0 0x7f4be4149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:35.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.132+0000 7f4beabcd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4be415ed20 con 0x7f4be415a7e0 2024-09-11T22:27:35.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.132+0000 7f4beabcd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4be415eba0 con 0x7f4be40b3190 2024-09-11T22:27:35.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.132+0000 7f4beabcd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4be40cb660 con 0x7f4be4154c20 2024-09-11T22:27:35.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.133+0000 7f4be916a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4be415a7e0 0x7f4be4149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:35.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.133+0000 7f4be8969640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4be40b3190 0x7f4be41f4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:35.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.133+0000 7f4be916a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4be415a7e0 0x7f4be4149e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53798/0 (socket says 172.21.15.100:53798) 2024-09-11T22:27:35.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.133+0000 7f4be916a640 1 -- 172.21.15.100:0/2683573375 learned_addr learned my addr 172.21.15.100:0/2683573375 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:35.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.133+0000 7f4be3fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4be4154c20 0x7f4be415b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:35.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.133+0000 7f4be916a640 1 -- 172.21.15.100:0/2683573375 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4be4154c20 msgr2=0x7f4be415b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:35.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.133+0000 7f4be916a640 1 --2- 172.21.15.100:0/2683573375 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4be4154c20 0x7f4be415b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:35.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.133+0000 7f4be916a640 1 -- 172.21.15.100:0/2683573375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4be40b3190 msgr2=0x7f4be41f4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:35.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.133+0000 7f4be916a640 1 --2- 172.21.15.100:0/2683573375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4be40b3190 0x7f4be41f4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:35.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.133+0000 7f4be916a640 1 -- 172.21.15.100:0/2683573375 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be41f5060 con 0x7f4be415a7e0 2024-09-11T22:27:35.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.133+0000 7f4be916a640 1 --2- 172.21.15.100:0/2683573375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4be415a7e0 0x7f4be4149e30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc007e30 tx=0x7f4bdc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:35.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.133+0000 7f4be17fa640 1 -- 172.21.15.100:0/2683573375 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc014620 con 0x7f4be415a7e0 2024-09-11T22:27:35.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.133+0000 7f4be17fa640 1 -- 172.21.15.100:0/2683573375 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bdc019070 con 0x7f4be415a7e0 2024-09-11T22:27:35.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.133+0000 7f4beabcd640 1 -- 172.21.15.100:0/2683573375 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be41507a0 con 0x7f4be415a7e0 2024-09-11T22:27:35.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.133+0000 7f4be17fa640 1 -- 172.21.15.100:0/2683573375 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc014a00 con 0x7f4be415a7e0 2024-09-11T22:27:35.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.133+0000 7f4beabcd640 1 -- 172.21.15.100:0/2683573375 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be41f0e00 con 0x7f4be415a7e0 2024-09-11T22:27:35.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.134+0000 7f4beabcd640 1 -- 172.21.15.100:0/2683573375 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4be40b44d0 con 0x7f4be415a7e0 2024-09-11T22:27:35.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.135+0000 7f4be17fa640 1 -- 172.21.15.100:0/2683573375 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4bdc014ba0 con 0x7f4be415a7e0 2024-09-11T22:27:35.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.135+0000 7f4be17fa640 1 --2- 172.21.15.100:0/2683573375 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4bc806be60 0x7f4bc806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:35.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.135+0000 7f4be17fa640 1 -- 172.21.15.100:0/2683573375 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f4bdc08b990 con 0x7f4be415a7e0 2024-09-11T22:27:35.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.136+0000 7f4be8969640 1 --2- 172.21.15.100:0/2683573375 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4bc806be60 0x7f4bc806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:35.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.136+0000 7f4be8969640 1 --2- 172.21.15.100:0/2683573375 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4bc806be60 0x7f4bc806e320 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8034000 tx=0x7f4bd802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:35.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.140+0000 7f4be17fa640 1 -- 172.21.15.100:0/2683573375 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4be40b44d0 con 0x7f4be415a7e0 2024-09-11T22:27:35.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.435+0000 7f4beabcd640 1 -- 172.21.15.100:0/2683573375 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f4be41f0bf0 con 0x7f4be415a7e0 2024-09-11T22:27:35.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.436+0000 7f4be17fa640 1 -- 172.21.15.100:0/2683573375 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f4bdc059960 con 0x7f4be415a7e0 2024-09-11T22:27:35.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.438+0000 7f4beabcd640 1 -- 172.21.15.100:0/2683573375 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4bc806be60 msgr2=0x7f4bc806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:35.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.438+0000 7f4beabcd640 1 --2- 172.21.15.100:0/2683573375 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4bc806be60 0x7f4bc806e320 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8034000 tx=0x7f4bd802e000 comp rx=0 tx=0).stop 2024-09-11T22:27:35.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.438+0000 7f4beabcd640 1 -- 172.21.15.100:0/2683573375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4be415a7e0 msgr2=0x7f4be4149e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:35.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.438+0000 7f4beabcd640 1 --2- 172.21.15.100:0/2683573375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4be415a7e0 0x7f4be4149e30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc007e30 tx=0x7f4bdc00e4b0 comp rx=0 tx=0).stop 2024-09-11T22:27:35.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.438+0000 7f4beabcd640 1 -- 172.21.15.100:0/2683573375 shutdown_connections 2024-09-11T22:27:35.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.438+0000 7f4beabcd640 1 --2- 172.21.15.100:0/2683573375 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4bc806be60 0x7f4bc806e320 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:35.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.438+0000 7f4beabcd640 1 --2- 172.21.15.100:0/2683573375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4be415a7e0 0x7f4be4149e30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:35.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.438+0000 7f4beabcd640 1 --2- 172.21.15.100:0/2683573375 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4be4154c20 0x7f4be415b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:35.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.438+0000 7f4beabcd640 1 --2- 172.21.15.100:0/2683573375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4be40b3190 0x7f4be41f4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:35.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.438+0000 7f4beabcd640 1 -- 172.21.15.100:0/2683573375 >> 172.21.15.100:0/2683573375 conn(0x7f4be4067d40 msgr2=0x7f4be415e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:35.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.438+0000 7f4beabcd640 1 -- 172.21.15.100:0/2683573375 shutdown_connections 2024-09-11T22:27:35.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:35.438+0000 7f4beabcd640 1 -- 172.21.15.100:0/2683573375 wait complete. 2024-09-11T22:27:35.514 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-11T22:27:45.515 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:27:45.515 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:27:45.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.625+0000 7f80c8db9640 1 Processor -- start 2024-09-11T22:27:45.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.625+0000 7f80c8db9640 1 -- start start 2024-09-11T22:27:45.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.626+0000 7f80c8db9640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f80c40c64c0 0x7f80c415b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:45.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.626+0000 7f80c8db9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f80c40c68a0 0x7f80c406e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:45.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.626+0000 7f80c8db9640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80c415bb10 con 0x7f80c40c7320 2024-09-11T22:27:45.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.626+0000 7f80c8db9640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f80c406d4c0 con 0x7f80c40c64c0 2024-09-11T22:27:45.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.626+0000 7f80c8db9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f80c406c6e0 con 0x7f80c40c68a0 2024-09-11T22:27:45.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.626+0000 7f80c259c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f80c40c64c0 0x7f80c415b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:45.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.626+0000 7f80c259c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f80c40c64c0 0x7f80c415b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56744/0 (socket says 172.21.15.100:56744) 2024-09-11T22:27:45.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.626+0000 7f80c259c640 1 -- 172.21.15.100:0/32430138 learned_addr learned my addr 172.21.15.100:0/32430138 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:45.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.626+0000 7f80c2d9d640 1 --1- 172.21.15.100:0/32430138 >> v1:172.21.15.100:6789/0 conn(0x7f80c40c7320 0x7f80c41513b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41660/0 (socket says 172.21.15.100:41660) 2024-09-11T22:27:45.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.626+0000 7f80bbfff640 1 --2- 172.21.15.100:0/32430138 >> v2:172.21.15.167:3300/0 conn(0x7f80c40c68a0 0x7f80c406e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:45.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.626+0000 7f80c259c640 1 -- 172.21.15.100:0/32430138 >> v2:172.21.15.167:3300/0 conn(0x7f80c40c68a0 msgr2=0x7f80c406e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:27:45.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.626+0000 7f80c259c640 1 --2- 172.21.15.100:0/32430138 >> v2:172.21.15.167:3300/0 conn(0x7f80c40c68a0 0x7f80c406e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.626+0000 7f80c259c640 1 -- 172.21.15.100:0/32430138 >> v1:172.21.15.100:6789/0 conn(0x7f80c40c7320 legacy=0x7f80c41513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:45.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.626+0000 7f80c259c640 1 -- 172.21.15.100:0/32430138 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c40c49e0 con 0x7f80c40c64c0 2024-09-11T22:27:45.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.627+0000 7f80c259c640 1 --2- 172.21.15.100:0/32430138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c40c64c0 0x7f80c415b5d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f80c4155240 tx=0x7f80b402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809dfddf0696ceef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:45.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.627+0000 7f80c1d9b640 1 -- 172.21.15.100:0/32430138 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b4037070 con 0x7f80c40c64c0 2024-09-11T22:27:45.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.627+0000 7f80c1d9b640 1 -- 172.21.15.100:0/32430138 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80b402ae50 con 0x7f80c40c64c0 2024-09-11T22:27:45.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.627+0000 7f80c1d9b640 1 -- 172.21.15.100:0/32430138 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b4032860 con 0x7f80c40c64c0 2024-09-11T22:27:45.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.628+0000 7f80c8db9640 1 -- 172.21.15.100:0/32430138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c40c64c0 msgr2=0x7f80c415b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:45.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.628+0000 7f80c8db9640 1 --2- 172.21.15.100:0/32430138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c40c64c0 0x7f80c415b5d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f80c4155240 tx=0x7f80b402a300 comp rx=0 tx=0).stop 2024-09-11T22:27:45.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.628+0000 7f80c8db9640 1 -- 172.21.15.100:0/32430138 shutdown_connections 2024-09-11T22:27:45.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.628+0000 7f80c8db9640 1 --2- 172.21.15.100:0/32430138 >> v2:172.21.15.167:3300/0 conn(0x7f80c40c68a0 0x7f80c406e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.628+0000 7f80c8db9640 1 --2- 172.21.15.100:0/32430138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c40c64c0 0x7f80c415b5d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.628+0000 7f80c8db9640 1 -- 172.21.15.100:0/32430138 >> 172.21.15.100:0/32430138 conn(0x7f80c40cd110 msgr2=0x7f80c40cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:45.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.628+0000 7f80c8db9640 1 -- 172.21.15.100:0/32430138 shutdown_connections 2024-09-11T22:27:45.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.628+0000 7f80c8db9640 1 -- 172.21.15.100:0/32430138 wait complete. 2024-09-11T22:27:45.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.629+0000 7f80c8db9640 1 Processor -- start 2024-09-11T22:27:45.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.629+0000 7f80c8db9640 1 -- start start 2024-09-11T22:27:45.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.630+0000 7f80c8db9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80c40c64c0 0x7f80c41446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:45.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.630+0000 7f80c8db9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80c40c68a0 0x7f80c4067bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:45.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.630+0000 7f80c8db9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c40c7320 0x7f80c4141e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:45.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.630+0000 7f80c8db9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f80c406c370 con 0x7f80c40c7320 2024-09-11T22:27:45.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.630+0000 7f80c8db9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f80c406c090 con 0x7f80c40c64c0 2024-09-11T22:27:45.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.630+0000 7f80c8db9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f80c406cb70 con 0x7f80c40c68a0 2024-09-11T22:27:45.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.630+0000 7f80c2d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c40c7320 0x7f80c4141e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:45.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.630+0000 7f80c2d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c40c7320 0x7f80c4141e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56756/0 (socket says 172.21.15.100:56756) 2024-09-11T22:27:45.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.630+0000 7f80c2d9d640 1 -- 172.21.15.100:0/202492203 learned_addr learned my addr 172.21.15.100:0/202492203 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:45.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.630+0000 7f80bbfff640 1 --2- 172.21.15.100:0/202492203 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80c40c68a0 0x7f80c4067bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:45.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.630+0000 7f80c259c640 1 --2- 172.21.15.100:0/202492203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80c40c64c0 0x7f80c41446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:45.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.630+0000 7f80c2d9d640 1 -- 172.21.15.100:0/202492203 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80c40c68a0 msgr2=0x7f80c4067bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:45.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.630+0000 7f80c2d9d640 1 --2- 172.21.15.100:0/202492203 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80c40c68a0 0x7f80c4067bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.630+0000 7f80c2d9d640 1 -- 172.21.15.100:0/202492203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80c40c64c0 msgr2=0x7f80c41446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:45.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.630+0000 7f80c2d9d640 1 --2- 172.21.15.100:0/202492203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80c40c64c0 0x7f80c41446e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.630+0000 7f80c2d9d640 1 -- 172.21.15.100:0/202492203 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c41f4c80 con 0x7f80c40c7320 2024-09-11T22:27:45.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.630+0000 7f80bbfff640 1 --2- 172.21.15.100:0/202492203 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80c40c68a0 0x7f80c4067bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:27:45.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.630+0000 7f80c259c640 1 --2- 172.21.15.100:0/202492203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80c40c64c0 0x7f80c41446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:27:45.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.631+0000 7f80c2d9d640 1 --2- 172.21.15.100:0/202492203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c40c7320 0x7f80c4141e50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f80bc00c730 tx=0x7f80bc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:45.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.631+0000 7f80baffd640 1 -- 172.21.15.100:0/202492203 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc018070 con 0x7f80c40c7320 2024-09-11T22:27:45.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.631+0000 7f80baffd640 1 -- 172.21.15.100:0/202492203 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80bc004d60 con 0x7f80c40c7320 2024-09-11T22:27:45.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.631+0000 7f80c8db9640 1 -- 172.21.15.100:0/202492203 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c4143c40 con 0x7f80c40c7320 2024-09-11T22:27:45.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.631+0000 7f80baffd640 1 -- 172.21.15.100:0/202492203 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc00a880 con 0x7f80c40c7320 2024-09-11T22:27:45.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.631+0000 7f80c8db9640 1 -- 172.21.15.100:0/202492203 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c4143ee0 con 0x7f80c40c7320 2024-09-11T22:27:45.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.632+0000 7f80c8db9640 1 -- 172.21.15.100:0/202492203 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80c40c4610 con 0x7f80c40c7320 2024-09-11T22:27:45.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.633+0000 7f80baffd640 1 -- 172.21.15.100:0/202492203 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f80bc01b070 con 0x7f80c40c7320 2024-09-11T22:27:45.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.633+0000 7f80baffd640 1 --2- 172.21.15.100:0/202492203 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f80a406be30 0x7f80a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:45.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.633+0000 7f80baffd640 1 -- 172.21.15.100:0/202492203 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f80bc08a7c0 con 0x7f80c40c7320 2024-09-11T22:27:45.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.633+0000 7f80c259c640 1 --2- 172.21.15.100:0/202492203 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f80a406be30 0x7f80a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:45.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.634+0000 7f80c259c640 1 --2- 172.21.15.100:0/202492203 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f80a406be30 0x7f80a406e2f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f80b4034000 tx=0x7f80b402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:45.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.638+0000 7f80baffd640 1 -- 172.21.15.100:0/202492203 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f80bc058cc0 con 0x7f80c40c7320 2024-09-11T22:27:45.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.960+0000 7f80c8db9640 1 -- 172.21.15.100:0/202492203 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f80c40c4220 con 0x7f80c40c7320 2024-09-11T22:27:45.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.960+0000 7f80baffd640 1 -- 172.21.15.100:0/202492203 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f80bc0585c0 con 0x7f80c40c7320 2024-09-11T22:27:45.962 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:27:45.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.963+0000 7f80c8db9640 1 -- 172.21.15.100:0/202492203 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f80a406be30 msgr2=0x7f80a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:45.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.963+0000 7f80c8db9640 1 --2- 172.21.15.100:0/202492203 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f80a406be30 0x7f80a406e2f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f80b4034000 tx=0x7f80b402e000 comp rx=0 tx=0).stop 2024-09-11T22:27:45.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.963+0000 7f80c8db9640 1 -- 172.21.15.100:0/202492203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c40c7320 msgr2=0x7f80c4141e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:45.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.963+0000 7f80c8db9640 1 --2- 172.21.15.100:0/202492203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c40c7320 0x7f80c4141e50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f80bc00c730 tx=0x7f80bc00cbf0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.963+0000 7f80c8db9640 1 -- 172.21.15.100:0/202492203 shutdown_connections 2024-09-11T22:27:45.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.963+0000 7f80c8db9640 1 --2- 172.21.15.100:0/202492203 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f80a406be30 0x7f80a406e2f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.963+0000 7f80c8db9640 1 --2- 172.21.15.100:0/202492203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c40c7320 0x7f80c4141e50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.963+0000 7f80c8db9640 1 --2- 172.21.15.100:0/202492203 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80c40c68a0 0x7f80c4067bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.963+0000 7f80c8db9640 1 --2- 172.21.15.100:0/202492203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80c40c64c0 0x7f80c41446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:45.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.963+0000 7f80c8db9640 1 -- 172.21.15.100:0/202492203 >> 172.21.15.100:0/202492203 conn(0x7f80c40cd110 msgr2=0x7f80c406e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:45.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.963+0000 7f80c8db9640 1 -- 172.21.15.100:0/202492203 shutdown_connections 2024-09-11T22:27:45.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:45.963+0000 7f80c8db9640 1 -- 172.21.15.100:0/202492203 wait complete. 2024-09-11T22:27:45.975 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:27:45.976 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-11T22:27:45.976 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:27:45.976 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:27:46.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.089+0000 7f8a0e94b640 1 Processor -- start 2024-09-11T22:27:46.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.089+0000 7f8a0e94b640 1 -- start start 2024-09-11T22:27:46.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.089+0000 7f8a0e94b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a080c9b40 0x7f8a0815e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.089+0000 7f8a0e94b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8a080c8b10 0x7f8a080caf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.089+0000 7f8a0e94b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a0806bc10 con 0x7f8a08154d30 2024-09-11T22:27:46.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.089+0000 7f8a0e94b640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f8a0815ace0 con 0x7f8a080c8b10 2024-09-11T22:27:46.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.089+0000 7f8a0e94b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8a08155110 con 0x7f8a080c9b40 2024-09-11T22:27:46.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.090+0000 7f8a0cee8640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8a080c8b10 0x7f8a080caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.090+0000 7f8a0cee8640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8a080c8b10 0x7f8a080caf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56766/0 (socket says 172.21.15.100:56766) 2024-09-11T22:27:46.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.090+0000 7f8a0cee8640 1 -- 172.21.15.100:0/1575569052 learned_addr learned my addr 172.21.15.100:0/1575569052 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:46.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.090+0000 7f8a077fe640 1 --2- 172.21.15.100:0/1575569052 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a080c9b40 0x7f8a0815e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.090+0000 7f8a0cee8640 1 -- 172.21.15.100:0/1575569052 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a080c9b40 msgr2=0x7f8a0815e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:27:46.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.090+0000 7f8a0cee8640 1 --2- 172.21.15.100:0/1575569052 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a080c9b40 0x7f8a0815e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.090+0000 7f8a0cee8640 1 -- 172.21.15.100:0/1575569052 >> v1:172.21.15.167:6789/0 conn(0x7f8a08154d30 legacy=0x7f8a0815b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.090+0000 7f8a0cee8640 1 -- 172.21.15.100:0/1575569052 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a080ca010 con 0x7f8a080c8b10 2024-09-11T22:27:46.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.091+0000 7f8a0cee8640 1 --2- 172.21.15.100:0/1575569052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a080c8b10 0x7f8a080caf90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009e50 tx=0x7f8a0002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e8a41e2d40730 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:46.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.091+0000 7f8a06ffd640 1 -- 172.21.15.100:0/1575569052 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a00036070 con 0x7f8a080c8b10 2024-09-11T22:27:46.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.091+0000 7f8a06ffd640 1 -- 172.21.15.100:0/1575569052 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a00031600 con 0x7f8a080c8b10 2024-09-11T22:27:46.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.091+0000 7f8a06ffd640 1 -- 172.21.15.100:0/1575569052 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a000319d0 con 0x7f8a080c8b10 2024-09-11T22:27:46.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.092+0000 7f8a0e94b640 1 -- 172.21.15.100:0/1575569052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a080c8b10 msgr2=0x7f8a080caf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.092+0000 7f8a0e94b640 1 --2- 172.21.15.100:0/1575569052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a080c8b10 0x7f8a080caf90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009e50 tx=0x7f8a0002a710 comp rx=0 tx=0).stop 2024-09-11T22:27:46.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.092+0000 7f8a0e94b640 1 -- 172.21.15.100:0/1575569052 shutdown_connections 2024-09-11T22:27:46.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.092+0000 7f8a0e94b640 1 --2- 172.21.15.100:0/1575569052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a080c8b10 0x7f8a080caf90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.092+0000 7f8a0e94b640 1 --2- 172.21.15.100:0/1575569052 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a080c9b40 0x7f8a0815e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.092+0000 7f8a0e94b640 1 -- 172.21.15.100:0/1575569052 >> 172.21.15.100:0/1575569052 conn(0x7f8a0806e000 msgr2=0x7f8a0806e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:46.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.092+0000 7f8a0e94b640 1 -- 172.21.15.100:0/1575569052 shutdown_connections 2024-09-11T22:27:46.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.092+0000 7f8a0e94b640 1 -- 172.21.15.100:0/1575569052 wait complete. 2024-09-11T22:27:46.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.093+0000 7f8a0e94b640 1 Processor -- start 2024-09-11T22:27:46.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.093+0000 7f8a0e94b640 1 -- start start 2024-09-11T22:27:46.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.094+0000 7f8a0e94b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a080c8b10 0x7f8a080c5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.094+0000 7f8a0e94b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a080c9b40 0x7f8a080aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.094+0000 7f8a0e94b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a08154d30 0x7f8a08152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.094+0000 7f8a0e94b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8a080ca5b0 con 0x7f8a08154d30 2024-09-11T22:27:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.094+0000 7f8a0e94b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a080ca2d0 con 0x7f8a080c8b10 2024-09-11T22:27:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.094+0000 7f8a0e94b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8a080ca890 con 0x7f8a080c9b40 2024-09-11T22:27:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.094+0000 7f8a0cee8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a08154d30 0x7f8a08152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.094+0000 7f8a0cee8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a08154d30 0x7f8a08152640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56780/0 (socket says 172.21.15.100:56780) 2024-09-11T22:27:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.094+0000 7f8a0cee8640 1 -- 172.21.15.100:0/1381586033 learned_addr learned my addr 172.21.15.100:0/1381586033 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.094+0000 7f8a077fe640 1 --2- 172.21.15.100:0/1381586033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a080c9b40 0x7f8a080aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.094+0000 7f8a07fff640 1 --2- 172.21.15.100:0/1381586033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a080c8b10 0x7f8a080c5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.094+0000 7f8a0cee8640 1 -- 172.21.15.100:0/1381586033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a080c9b40 msgr2=0x7f8a080aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.094+0000 7f8a0cee8640 1 --2- 172.21.15.100:0/1381586033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a080c9b40 0x7f8a080aeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.094+0000 7f8a0cee8640 1 -- 172.21.15.100:0/1381586033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a080c8b10 msgr2=0x7f8a080c5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.094+0000 7f8a0cee8640 1 --2- 172.21.15.100:0/1381586033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a080c8b10 0x7f8a080c5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.094+0000 7f8a0cee8640 1 -- 172.21.15.100:0/1381586033 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a081518c0 con 0x7f8a08154d30 2024-09-11T22:27:46.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.094+0000 7f8a077fe640 1 --2- 172.21.15.100:0/1381586033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a080c9b40 0x7f8a080aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:27:46.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.095+0000 7f8a0cee8640 1 --2- 172.21.15.100:0/1381586033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a08154d30 0x7f8a08152640 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009e50 tx=0x7f8a00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:46.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.095+0000 7f8a04ff9640 1 -- 172.21.15.100:0/1381586033 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a00036050 con 0x7f8a08154d30 2024-09-11T22:27:46.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.095+0000 7f8a04ff9640 1 -- 172.21.15.100:0/1381586033 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a00042070 con 0x7f8a08154d30 2024-09-11T22:27:46.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.095+0000 7f8a04ff9640 1 -- 172.21.15.100:0/1381586033 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a00009510 con 0x7f8a08154d30 2024-09-11T22:27:46.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.095+0000 7f8a0e94b640 1 -- 172.21.15.100:0/1381586033 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a080b02e0 con 0x7f8a08154d30 2024-09-11T22:27:46.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.095+0000 7f8a0e94b640 1 -- 172.21.15.100:0/1381586033 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a08151e40 con 0x7f8a08154d30 2024-09-11T22:27:46.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.096+0000 7f8a0e94b640 1 --2- 172.21.15.100:0/1381586033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a08152b80 0x7f8a081f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.096+0000 7f8a0e94b640 1 -- 172.21.15.100:0/1381586033 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8a080b0650 con 0x7f8a08152b80 2024-09-11T22:27:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.096+0000 7f8a07fff640 1 --2- 172.21.15.100:0/1381586033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a08152b80 0x7f8a081f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.096+0000 7f8a07fff640 1 -- 172.21.15.100:0/1381586033 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a0815e990 con 0x7f8a08152b80 2024-09-11T22:27:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.096+0000 7f8a04ff9640 1 -- 172.21.15.100:0/1381586033 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a00007bf0 con 0x7f8a08154d30 2024-09-11T22:27:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.096+0000 7f8a07fff640 1 --2- 172.21.15.100:0/1381586033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a08152b80 0x7f8a081f3ee0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f89f800f570 tx=0x7f89f800fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.097+0000 7f8a04ff9640 1 --2- 172.21.15.100:0/1381586033 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f89f406be30 0x7f89f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.097+0000 7f8a077fe640 1 --2- 172.21.15.100:0/1381586033 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f89f406be30 0x7f89f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.097+0000 7f8a04ff9640 1 -- 172.21.15.100:0/1381586033 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f8a000abec0 con 0x7f8a08154d30 2024-09-11T22:27:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.097+0000 7f8a04ff9640 1 -- 172.21.15.100:0/1381586033 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f8019070 con 0x7f8a08152b80 2024-09-11T22:27:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.097+0000 7f8a04ff9640 1 -- 172.21.15.100:0/1381586033 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f89f8005320 con 0x7f8a08152b80 2024-09-11T22:27:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.097+0000 7f8a04ff9640 1 -- 172.21.15.100:0/1381586033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a08152b80 msgr2=0x7f8a081f3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.097+0000 7f8a04ff9640 1 --2- 172.21.15.100:0/1381586033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a08152b80 0x7f8a081f3ee0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f89f800f570 tx=0x7f89f800fa30 comp rx=0 tx=0).stop 2024-09-11T22:27:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.097+0000 7f8a04ff9640 1 -- 172.21.15.100:0/1381586033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a08152b80 msgr2=0x7f8a081f3ee0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:27:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.097+0000 7f8a04ff9640 1 --2- 172.21.15.100:0/1381586033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a08152b80 0x7f8a081f3ee0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.097+0000 7f8a077fe640 1 --2- 172.21.15.100:0/1381586033 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f89f406be30 0x7f89f406e2f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8a08151720 tx=0x7f89fc009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:46.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.103+0000 7f8a0e94b640 1 --2- 172.21.15.100:0/1381586033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a08158660 0x7f8a081f4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.103+0000 7f8a0e94b640 1 -- 172.21.15.100:0/1381586033 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8a080c9710 con 0x7f8a08158660 2024-09-11T22:27:46.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.103+0000 7f8a07fff640 1 --2- 172.21.15.100:0/1381586033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a08158660 0x7f8a081f4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.104+0000 7f8a07fff640 1 -- 172.21.15.100:0/1381586033 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8a080c9080 con 0x7f8a08158660 2024-09-11T22:27:46.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.104+0000 7f8a07fff640 1 --2- 172.21.15.100:0/1381586033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a08158660 0x7f8a081f4420 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f89f800f570 tx=0x7f89f8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:46.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.104+0000 7f8a04ff9640 1 -- 172.21.15.100:0/1381586033 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f8019030 con 0x7f8a08158660 2024-09-11T22:27:46.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.104+0000 7f8a04ff9640 1 -- 172.21.15.100:0/1381586033 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4555 (secure 0 0 0) 0x7f89f8006cd0 con 0x7f8a08158660 2024-09-11T22:27:46.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.104+0000 7f8a04ff9640 1 -- 172.21.15.100:0/1381586033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a08158660 msgr2=0x7f8a081f4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.104+0000 7f8a04ff9640 1 --2- 172.21.15.100:0/1381586033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a08158660 0x7f8a081f4420 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f89f800f570 tx=0x7f89f8000ed0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.104+0000 7f8a04ff9640 1 -- 172.21.15.100:0/1381586033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a08158660 msgr2=0x7f8a081f4420 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:27:46.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.104+0000 7f8a04ff9640 1 --2- 172.21.15.100:0/1381586033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a08158660 0x7f8a081f4420 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.107 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:27:46.107 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:27:46.108 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:27:46.108 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:27:46.108 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 54, 2024-09-11T22:27:46.108 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 18053, 2024-09-11T22:27:46.108 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:27:46.108 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:27:46.108 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:27:46.108 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:27:46.108 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:46.108 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 11, 2024-09-11T22:27:46.108 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:27:46.108 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:27:46.109 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:27:46.109 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:46.109 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:46.109 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:46.109 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:46.109 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:46.109 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:46.109 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:46.109 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:46.109 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:46.109 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:46.109 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:46.109 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:46.109 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:27:46.110 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:27:46.110 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:46.110 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:46.110 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:46.110 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:46.110 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:46.110 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:46.110 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:46.110 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:46.110 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:46.110 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:46.110 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:46.110 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:46.110 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.111 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:27:46.111 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:27:46.111 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:27:46.111 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:27:46.111 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:27:46.111 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:27:46.111 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:27:46.111 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:27:46.111 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:27:46.111 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:27:46.111 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:27:46.111 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:27:46.111 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:27:46.111 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:27:46.112 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:27:46.112 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:27:46.112 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:27:46.112 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:46.112 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:46.112 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:46.112 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:46.112 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:46.112 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:46.112 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:46.113 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:46.113 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:46.113 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:46.113 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:46.113 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:46.113 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:27:46.113 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.113 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:27:46.113 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.113 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:27:46.113 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:27:46.113 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:46.113 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:46.114 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.114 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:46.114 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:27:46.114 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:46.114 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.114 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.114 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:46.114 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:27:46.114 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:46.114 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:46.114 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:46.114 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.114 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:27:46.115 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:27:46.115 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:46.115 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:46.115 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:46.115 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.115 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.115 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:27:46.115 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:27:46.115 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:46.115 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:46.115 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.115 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:46.115 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:27:46.116 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:46.116 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.116 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.116 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:46.116 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:27:46.116 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:46.116 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:46.116 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:46.116 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.116 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:27:46.116 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:27:46.116 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:46.116 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:46.117 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:46.117 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.117 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.117 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:27:46.117 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:27:46.117 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:46.117 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:46.117 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.117 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:46.117 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:27:46.117 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:46.117 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.117 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.118 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:46.118 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:27:46.118 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:46.118 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:46.118 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:46.118 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.118 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:27:46.118 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:27:46.118 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:46.118 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:46.118 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:46.118 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:46.118 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:46.118 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.119 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:27:46.119 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:27:46.119 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.119 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:46.119 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:46.119 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:27:46.119 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:46.119 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:46.119 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:27:46.119 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.119 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:46.119 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:46.119 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:27:46.119 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:46.120 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:46.120 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.120 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:27:46.120 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:27:46.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.105+0000 7f8a0e94b640 1 -- 172.21.15.100:0/1381586033 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f89f406be30 msgr2=0x7f89f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.105+0000 7f8a0e94b640 1 --2- 172.21.15.100:0/1381586033 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f89f406be30 0x7f89f406e2f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8a08151720 tx=0x7f89fc009190 comp rx=0 tx=0).stop 2024-09-11T22:27:46.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.105+0000 7f8a0e94b640 1 -- 172.21.15.100:0/1381586033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a08154d30 msgr2=0x7f8a08152640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.105+0000 7f8a0e94b640 1 --2- 172.21.15.100:0/1381586033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a08154d30 0x7f8a08152640 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8a00009e50 tx=0x7f8a00004a40 comp rx=0 tx=0).stop 2024-09-11T22:27:46.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.105+0000 7f8a0cee8640 1 -- 172.21.15.100:0/1381586033 reap_dead start 2024-09-11T22:27:46.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.105+0000 7f8a0e94b640 1 -- 172.21.15.100:0/1381586033 shutdown_connections 2024-09-11T22:27:46.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.105+0000 7f8a0e94b640 1 --2- 172.21.15.100:0/1381586033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a08154d30 0x7f8a08152640 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.105+0000 7f8a0e94b640 1 -- 172.21.15.100:0/1381586033 >> 172.21.15.100:0/1381586033 conn(0x7f8a0806e000 msgr2=0x7f8a080cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:46.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.105+0000 7f8a0e94b640 1 -- 172.21.15.100:0/1381586033 shutdown_connections 2024-09-11T22:27:46.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.105+0000 7f8a0e94b640 1 -- 172.21.15.100:0/1381586033 wait complete. 2024-09-11T22:27:46.122 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:27:46.122 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:27:46.122 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:27:46.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.231+0000 7fa85a78d640 1 Processor -- start 2024-09-11T22:27:46.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.231+0000 7fa85a78d640 1 -- start start 2024-09-11T22:27:46.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.232+0000 7fa85a78d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa8540ccd90 0x7fa854152580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.232+0000 7fa85a78d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa8540c7710 0x7fa854152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.232+0000 7fa85a78d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8540c6bb0 con 0x7fa8540cc9b0 2024-09-11T22:27:46.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.232+0000 7fa85a78d640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fa854075d50 con 0x7fa8540c7710 2024-09-11T22:27:46.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.232+0000 7fa85a78d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fa8540c7fa0 con 0x7fa8540ccd90 2024-09-11T22:27:46.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.232+0000 7fa858d2a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa8540c7710 0x7fa854152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.233+0000 7fa858d2a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa8540c7710 0x7fa854152ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56818/0 (socket says 172.21.15.100:56818) 2024-09-11T22:27:46.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.233+0000 7fa858d2a640 1 -- 172.21.15.100:0/2413947335 learned_addr learned my addr 172.21.15.100:0/2413947335 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:46.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.233+0000 7fa8537fe640 1 --2- 172.21.15.100:0/2413947335 >> v2:172.21.15.167:3300/0 conn(0x7fa8540ccd90 0x7fa854152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.233+0000 7fa858d2a640 1 -- 172.21.15.100:0/2413947335 >> v2:172.21.15.167:3300/0 conn(0x7fa8540ccd90 msgr2=0x7fa854152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:27:46.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.233+0000 7fa858d2a640 1 --2- 172.21.15.100:0/2413947335 >> v2:172.21.15.167:3300/0 conn(0x7fa8540ccd90 0x7fa854152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.233+0000 7fa858d2a640 1 -- 172.21.15.100:0/2413947335 >> v1:172.21.15.167:6789/0 conn(0x7fa8540cc9b0 legacy=0x7fa85415bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.233+0000 7fa858d2a640 1 -- 172.21.15.100:0/2413947335 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8540c8280 con 0x7fa8540c7710 2024-09-11T22:27:46.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.234+0000 7fa858d2a640 1 --2- 172.21.15.100:0/2413947335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8540c7710 0x7fa854152ac0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa8540c9160 tx=0x7fa84c02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bca5e5516fd092 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:46.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.234+0000 7fa852ffd640 1 -- 172.21.15.100:0/2413947335 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c036070 con 0x7fa8540c7710 2024-09-11T22:27:46.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.234+0000 7fa852ffd640 1 -- 172.21.15.100:0/2413947335 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa84c031600 con 0x7fa8540c7710 2024-09-11T22:27:46.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.234+0000 7fa852ffd640 1 -- 172.21.15.100:0/2413947335 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c0319f0 con 0x7fa8540c7710 2024-09-11T22:27:46.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.234+0000 7fa85a78d640 1 -- 172.21.15.100:0/2413947335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8540c7710 msgr2=0x7fa854152ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.234+0000 7fa85a78d640 1 --2- 172.21.15.100:0/2413947335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8540c7710 0x7fa854152ac0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa8540c9160 tx=0x7fa84c02a7c0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.234+0000 7fa85a78d640 1 -- 172.21.15.100:0/2413947335 shutdown_connections 2024-09-11T22:27:46.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.234+0000 7fa85a78d640 1 --2- 172.21.15.100:0/2413947335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8540c7710 0x7fa854152ac0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.234+0000 7fa85a78d640 1 --2- 172.21.15.100:0/2413947335 >> v2:172.21.15.167:3300/0 conn(0x7fa8540ccd90 0x7fa854152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.234+0000 7fa85a78d640 1 -- 172.21.15.100:0/2413947335 >> 172.21.15.100:0/2413947335 conn(0x7fa85406fa70 msgr2=0x7fa85406fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:46.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.234+0000 7fa85a78d640 1 -- 172.21.15.100:0/2413947335 shutdown_connections 2024-09-11T22:27:46.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.234+0000 7fa85a78d640 1 -- 172.21.15.100:0/2413947335 wait complete. 2024-09-11T22:27:46.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.236+0000 7fa85a78d640 1 Processor -- start 2024-09-11T22:27:46.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.236+0000 7fa85a78d640 1 -- start start 2024-09-11T22:27:46.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.237+0000 7fa85a78d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8540c7710 0x7fa854154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.237+0000 7fa85a78d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8540cc9b0 0x7fa8541e4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.237+0000 7fa85a78d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8540ccd90 0x7fa854148e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.237+0000 7fa85a78d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8540c49f0 con 0x7fa8540cc9b0 2024-09-11T22:27:46.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.237+0000 7fa85a78d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa8540c4710 con 0x7fa8540c7710 2024-09-11T22:27:46.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.237+0000 7fa85a78d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa8540c3bb0 con 0x7fa8540ccd90 2024-09-11T22:27:46.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.237+0000 7fa8537fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8540cc9b0 0x7fa8541e4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.237+0000 7fa8537fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8540cc9b0 0x7fa8541e4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56832/0 (socket says 172.21.15.100:56832) 2024-09-11T22:27:46.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.237+0000 7fa8537fe640 1 -- 172.21.15.100:0/528371814 learned_addr learned my addr 172.21.15.100:0/528371814 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:46.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.237+0000 7fa853fff640 1 --2- 172.21.15.100:0/528371814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8540c7710 0x7fa854154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.237+0000 7fa858d2a640 1 --2- 172.21.15.100:0/528371814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8540ccd90 0x7fa854148e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.237+0000 7fa8537fe640 1 -- 172.21.15.100:0/528371814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8540ccd90 msgr2=0x7fa854148e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.237+0000 7fa8537fe640 1 --2- 172.21.15.100:0/528371814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8540ccd90 0x7fa854148e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.237+0000 7fa8537fe640 1 -- 172.21.15.100:0/528371814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8540c7710 msgr2=0x7fa854154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.237+0000 7fa8537fe640 1 --2- 172.21.15.100:0/528371814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8540c7710 0x7fa854154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.237+0000 7fa8537fe640 1 -- 172.21.15.100:0/528371814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa854149350 con 0x7fa8540cc9b0 2024-09-11T22:27:46.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.237+0000 7fa853fff640 1 --2- 172.21.15.100:0/528371814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8540c7710 0x7fa854154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:27:46.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.237+0000 7fa8537fe640 1 --2- 172.21.15.100:0/528371814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8540cc9b0 0x7fa8541e4bd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa84800e8a0 tx=0x7fa84800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:46.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.237+0000 7fa850ff9640 1 -- 172.21.15.100:0/528371814 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa848017070 con 0x7fa8540cc9b0 2024-09-11T22:27:46.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.237+0000 7fa850ff9640 1 -- 172.21.15.100:0/528371814 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa84800c940 con 0x7fa8540cc9b0 2024-09-11T22:27:46.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.237+0000 7fa850ff9640 1 -- 172.21.15.100:0/528371814 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84800cd30 con 0x7fa8540cc9b0 2024-09-11T22:27:46.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.237+0000 7fa85a78d640 1 -- 172.21.15.100:0/528371814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8541e5bd0 con 0x7fa8540cc9b0 2024-09-11T22:27:46.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.238+0000 7fa85a78d640 1 -- 172.21.15.100:0/528371814 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8541eee50 con 0x7fa8540cc9b0 2024-09-11T22:27:46.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.238+0000 7fa85a78d640 1 --2- 172.21.15.100:0/528371814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8541e2470 0x7fa8541e2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.238+0000 7fa85a78d640 1 -- 172.21.15.100:0/528371814 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa8541e5110 con 0x7fa8541e2470 2024-09-11T22:27:46.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.239+0000 7fa853fff640 1 --2- 172.21.15.100:0/528371814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8541e2470 0x7fa8541e2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.239+0000 7fa853fff640 1 -- 172.21.15.100:0/528371814 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa8540694c0 con 0x7fa8541e2470 2024-09-11T22:27:46.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.239+0000 7fa850ff9640 1 -- 172.21.15.100:0/528371814 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa84801a070 con 0x7fa8540cc9b0 2024-09-11T22:27:46.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.239+0000 7fa853fff640 1 --2- 172.21.15.100:0/528371814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8541e2470 0x7fa8541e2850 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa84400fb10 tx=0x7fa844001cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:46.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.239+0000 7fa850ff9640 1 --2- 172.21.15.100:0/528371814 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa84006be60 0x7fa84006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.240+0000 7fa850ff9640 1 -- 172.21.15.100:0/528371814 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fa84808b020 con 0x7fa8540cc9b0 2024-09-11T22:27:46.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.240+0000 7fa858d2a640 1 --2- 172.21.15.100:0/528371814 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa84006be60 0x7fa84006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.240+0000 7fa850ff9640 1 -- 172.21.15.100:0/528371814 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8440052e0 con 0x7fa8541e2470 2024-09-11T22:27:46.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.240+0000 7fa850ff9640 1 -- 172.21.15.100:0/528371814 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa844005480 con 0x7fa8541e2470 2024-09-11T22:27:46.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.240+0000 7fa850ff9640 1 -- 172.21.15.100:0/528371814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8541e2470 msgr2=0x7fa8541e2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.240+0000 7fa850ff9640 1 --2- 172.21.15.100:0/528371814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8541e2470 0x7fa8541e2850 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa84400fb10 tx=0x7fa844001cf0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.240+0000 7fa850ff9640 1 -- 172.21.15.100:0/528371814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8541e2470 msgr2=0x7fa8541e2850 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:27:46.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.240+0000 7fa850ff9640 1 --2- 172.21.15.100:0/528371814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8541e2470 0x7fa8541e2850 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.240+0000 7fa858d2a640 1 --2- 172.21.15.100:0/528371814 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa84006be60 0x7fa84006e320 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa84c033000 tx=0x7fa84c009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:46.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.247+0000 7fa85a78d640 1 --2- 172.21.15.100:0/528371814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8541ef090 0x7fa8541e30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.247+0000 7fa85a78d640 1 -- 172.21.15.100:0/528371814 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa8540c7300 con 0x7fa8541ef090 2024-09-11T22:27:46.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.247+0000 7fa853fff640 1 --2- 172.21.15.100:0/528371814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8541ef090 0x7fa8541e30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.248+0000 7fa853fff640 1 -- 172.21.15.100:0/528371814 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa8540c5430 con 0x7fa8541ef090 2024-09-11T22:27:46.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.248+0000 7fa853fff640 1 --2- 172.21.15.100:0/528371814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8541ef090 0x7fa8541e30c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa844016000 tx=0x7fa844000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:46.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.248+0000 7fa850ff9640 1 -- 172.21.15.100:0/528371814 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8440052e0 con 0x7fa8541ef090 2024-09-11T22:27:46.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.248+0000 7fa850ff9640 1 -- 172.21.15.100:0/528371814 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4888 (secure 0 0 0) 0x7fa84400d7e0 con 0x7fa8541ef090 2024-09-11T22:27:46.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.248+0000 7fa850ff9640 1 -- 172.21.15.100:0/528371814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8541ef090 msgr2=0x7fa8541e30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.248+0000 7fa850ff9640 1 --2- 172.21.15.100:0/528371814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8541ef090 0x7fa8541e30c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa844016000 tx=0x7fa844000ed0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.248+0000 7fa850ff9640 1 -- 172.21.15.100:0/528371814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8541ef090 msgr2=0x7fa8541e30c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:27:46.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.248+0000 7fa850ff9640 1 --2- 172.21.15.100:0/528371814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8541ef090 0x7fa8541e30c0 secure :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa844016000 tx=0x7fa844000ed0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.251 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:27:46.251 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:27:46.251 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:27:46.251 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:27:46.251 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 54, 2024-09-11T22:27:46.251 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 251527, 2024-09-11T22:27:46.252 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:27:46.252 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:27:46.252 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:27:46.252 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:27:46.252 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:46.252 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 11, 2024-09-11T22:27:46.252 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:27:46.252 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:27:46.252 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:27:46.252 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:46.252 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:46.252 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:46.252 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:46.252 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:46.253 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:46.253 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:46.253 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:46.253 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:46.253 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:46.253 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:46.253 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:46.253 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:27:46.253 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:27:46.253 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:46.253 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:46.253 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:46.253 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:46.253 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:46.253 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:46.254 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:46.254 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:46.254 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:46.254 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:46.254 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:46.254 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:46.254 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.254 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:27:46.254 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:27:46.254 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:27:46.254 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:27:46.254 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:27:46.254 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:27:46.254 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:27:46.255 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:27:46.255 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:27:46.255 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:27:46.255 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:27:46.255 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:27:46.255 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:27:46.255 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:27:46.255 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:27:46.255 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:27:46.255 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:27:46.255 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:46.255 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:46.255 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:46.255 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:46.256 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:46.256 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:46.256 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:46.256 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:46.256 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:46.256 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:46.256 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:46.256 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:46.256 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:27:46.256 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.256 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:27:46.256 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.256 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:27:46.256 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:27:46.257 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:46.257 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:46.257 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.257 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:46.257 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:27:46.257 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:46.257 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.257 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.257 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:46.257 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:27:46.257 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:46.257 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:46.257 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:46.257 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.258 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:27:46.258 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:27:46.258 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:46.258 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:46.258 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:46.258 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.258 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.258 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:27:46.258 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:27:46.258 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:46.258 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:46.258 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.258 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:46.259 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:27:46.259 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:46.259 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.259 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.259 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:46.259 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:27:46.259 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:46.259 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:46.259 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:46.259 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.259 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:27:46.259 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:27:46.259 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:46.259 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:46.260 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:46.260 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.260 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.260 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:27:46.260 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:27:46.260 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:46.260 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:46.260 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.260 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:46.260 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:27:46.260 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:46.260 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.260 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.260 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:46.261 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:27:46.261 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:46.261 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:46.261 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:46.261 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.261 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:27:46.261 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:27:46.261 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:46.261 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:46.261 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:46.261 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:46.261 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:46.261 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.261 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:27:46.262 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:27:46.262 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.262 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:46.262 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:46.262 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:27:46.262 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:46.262 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:46.262 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:27:46.262 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.262 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:46.262 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:46.262 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:27:46.262 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:46.262 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:46.263 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:27:46.263 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.263 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:46.263 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:46.263 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:27:46.263 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:46.263 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:46.263 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:27:46.263 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.263 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:46.263 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:46.263 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:27:46.263 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:46.263 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:46.263 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.264 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:27:46.264 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:27:46.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.249+0000 7fa85a78d640 1 -- 172.21.15.100:0/528371814 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa84006be60 msgr2=0x7fa84006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.249+0000 7fa85a78d640 1 --2- 172.21.15.100:0/528371814 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa84006be60 0x7fa84006e320 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa84c033000 tx=0x7fa84c009000 comp rx=0 tx=0).stop 2024-09-11T22:27:46.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.249+0000 7fa85a78d640 1 -- 172.21.15.100:0/528371814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8540cc9b0 msgr2=0x7fa8541e4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.249+0000 7fa85a78d640 1 --2- 172.21.15.100:0/528371814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8540cc9b0 0x7fa8541e4bd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa84800e8a0 tx=0x7fa84800ed60 comp rx=0 tx=0).stop 2024-09-11T22:27:46.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.249+0000 7fa858d2a640 1 -- 172.21.15.100:0/528371814 reap_dead start 2024-09-11T22:27:46.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.249+0000 7fa85a78d640 1 -- 172.21.15.100:0/528371814 shutdown_connections 2024-09-11T22:27:46.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.249+0000 7fa85a78d640 1 --2- 172.21.15.100:0/528371814 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8540cc9b0 0x7fa8541e4bd0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.249+0000 7fa85a78d640 1 -- 172.21.15.100:0/528371814 >> 172.21.15.100:0/528371814 conn(0x7fa85406fa70 msgr2=0x7fa8540ca690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:46.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.249+0000 7fa85a78d640 1 -- 172.21.15.100:0/528371814 shutdown_connections 2024-09-11T22:27:46.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.249+0000 7fa85a78d640 1 -- 172.21.15.100:0/528371814 wait complete. 2024-09-11T22:27:46.266 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:27:46.266 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:27:46.266 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:27:46.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.375+0000 7eff6bf31640 1 Processor -- start 2024-09-11T22:27:46.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.376+0000 7eff6bf31640 1 -- start start 2024-09-11T22:27:46.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.376+0000 7eff6bf31640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff64151740 0x7eff64073d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.376+0000 7eff6bf31640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7eff640c8e80 0x7eff6406c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.376+0000 7eff6bf31640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7eff64157520 0x7eff6406e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.376+0000 7eff6bf31640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7eff640c89f0 con 0x7eff640c8e80 2024-09-11T22:27:46.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.376+0000 7eff6bf31640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7eff640c3f20 con 0x7eff64157520 2024-09-11T22:27:46.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.376+0000 7eff6bf31640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7eff6406c490 con 0x7eff64151740 2024-09-11T22:27:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.377+0000 7eff694cc640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7eff640c8e80 0x7eff6406c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.377+0000 7eff694cc640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7eff640c8e80 0x7eff6406c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56836/0 (socket says 172.21.15.100:56836) 2024-09-11T22:27:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.377+0000 7eff694cc640 1 -- 172.21.15.100:0/1338598337 learned_addr learned my addr 172.21.15.100:0/1338598337 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.377+0000 7eff69ccd640 1 --2- 172.21.15.100:0/1338598337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff64151740 0x7eff64073d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.377+0000 7eff6a4ce640 1 --2- 172.21.15.100:0/1338598337 >> v2:172.21.15.167:3300/0 conn(0x7eff64157520 0x7eff6406e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.377+0000 7eff694cc640 1 -- 172.21.15.100:0/1338598337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff64151740 msgr2=0x7eff64073d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:27:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.377+0000 7eff694cc640 1 --2- 172.21.15.100:0/1338598337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff64151740 0x7eff64073d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.377+0000 7eff694cc640 1 -- 172.21.15.100:0/1338598337 >> v2:172.21.15.167:3300/0 conn(0x7eff64157520 msgr2=0x7eff6406e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:27:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.377+0000 7eff694cc640 1 --2- 172.21.15.100:0/1338598337 >> v2:172.21.15.167:3300/0 conn(0x7eff64157520 0x7eff6406e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.377+0000 7eff694cc640 1 -- 172.21.15.100:0/1338598337 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff640c83e0 con 0x7eff640c8e80 2024-09-11T22:27:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.377+0000 7eff69ccd640 1 --2- 172.21.15.100:0/1338598337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff64151740 0x7eff64073d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:27:46.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.377+0000 7eff6a4ce640 1 --2- 172.21.15.100:0/1338598337 >> v2:172.21.15.167:3300/0 conn(0x7eff64157520 0x7eff6406e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:27:46.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.378+0000 7eff694cc640 1 --2- 172.21.15.100:0/1338598337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff640c8e80 0x7eff6406c890 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7eff640c2030 tx=0x7eff5402c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b895defa0c70337 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:46.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.378+0000 7eff68ccb640 1 -- 172.21.15.100:0/1338598337 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff54032790 con 0x7eff640c8e80 2024-09-11T22:27:46.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.378+0000 7eff68ccb640 1 -- 172.21.15.100:0/1338598337 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff54038070 con 0x7eff640c8e80 2024-09-11T22:27:46.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.378+0000 7eff68ccb640 1 -- 172.21.15.100:0/1338598337 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff54032b50 con 0x7eff640c8e80 2024-09-11T22:27:46.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.379+0000 7eff6bf31640 1 -- 172.21.15.100:0/1338598337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff640c8e80 msgr2=0x7eff6406c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.379+0000 7eff6bf31640 1 --2- 172.21.15.100:0/1338598337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff640c8e80 0x7eff6406c890 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7eff640c2030 tx=0x7eff5402c890 comp rx=0 tx=0).stop 2024-09-11T22:27:46.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.379+0000 7eff6bf31640 1 -- 172.21.15.100:0/1338598337 shutdown_connections 2024-09-11T22:27:46.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.379+0000 7eff6bf31640 1 --2- 172.21.15.100:0/1338598337 >> v2:172.21.15.167:3300/0 conn(0x7eff64157520 0x7eff6406e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.379+0000 7eff6bf31640 1 --2- 172.21.15.100:0/1338598337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff640c8e80 0x7eff6406c890 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.379+0000 7eff6bf31640 1 --2- 172.21.15.100:0/1338598337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff64151740 0x7eff64073d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.379+0000 7eff6bf31640 1 -- 172.21.15.100:0/1338598337 >> 172.21.15.100:0/1338598337 conn(0x7eff64070190 msgr2=0x7eff640705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:46.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.379+0000 7eff6bf31640 1 -- 172.21.15.100:0/1338598337 shutdown_connections 2024-09-11T22:27:46.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.379+0000 7eff6bf31640 1 -- 172.21.15.100:0/1338598337 wait complete. 2024-09-11T22:27:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.380+0000 7eff6bf31640 1 Processor -- start 2024-09-11T22:27:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.380+0000 7eff6bf31640 1 -- start start 2024-09-11T22:27:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.381+0000 7eff6bf31640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff640c8e80 0x7eff6414cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.381+0000 7eff6bf31640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff64151740 0x7eff64142be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.381+0000 7eff6bf31640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff64157520 0x7eff641563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.381+0000 7eff6bf31640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7eff6406c1b0 con 0x7eff640c8e80 2024-09-11T22:27:46.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.381+0000 7eff6bf31640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7eff6406bed0 con 0x7eff64157520 2024-09-11T22:27:46.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.381+0000 7eff6bf31640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7eff640c8680 con 0x7eff64151740 2024-09-11T22:27:46.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.381+0000 7eff69ccd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff640c8e80 0x7eff6414cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.381+0000 7eff69ccd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff640c8e80 0x7eff6414cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56844/0 (socket says 172.21.15.100:56844) 2024-09-11T22:27:46.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.381+0000 7eff69ccd640 1 -- 172.21.15.100:0/922093866 learned_addr learned my addr 172.21.15.100:0/922093866 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:46.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.382+0000 7eff694cc640 1 --2- 172.21.15.100:0/922093866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff64151740 0x7eff64142be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.382+0000 7eff6a4ce640 1 --2- 172.21.15.100:0/922093866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff64157520 0x7eff641563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.382+0000 7eff69ccd640 1 -- 172.21.15.100:0/922093866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff64151740 msgr2=0x7eff64142be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.382+0000 7eff69ccd640 1 --2- 172.21.15.100:0/922093866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff64151740 0x7eff64142be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.382+0000 7eff69ccd640 1 -- 172.21.15.100:0/922093866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff64157520 msgr2=0x7eff641563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.382+0000 7eff69ccd640 1 --2- 172.21.15.100:0/922093866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff64157520 0x7eff641563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.382+0000 7eff69ccd640 1 -- 172.21.15.100:0/922093866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff641ef720 con 0x7eff640c8e80 2024-09-11T22:27:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.382+0000 7eff6a4ce640 1 --2- 172.21.15.100:0/922093866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff64157520 0x7eff641563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:27:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.382+0000 7eff69ccd640 1 --2- 172.21.15.100:0/922093866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff640c8e80 0x7eff6414cec0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7eff6000e840 tx=0x7eff6000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.382+0000 7eff5a7fc640 1 -- 172.21.15.100:0/922093866 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6000f040 con 0x7eff640c8e80 2024-09-11T22:27:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.382+0000 7eff5a7fc640 1 -- 172.21.15.100:0/922093866 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff60004030 con 0x7eff640c8e80 2024-09-11T22:27:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.382+0000 7eff6bf31640 1 -- 172.21.15.100:0/922093866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff6414d620 con 0x7eff640c8e80 2024-09-11T22:27:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.382+0000 7eff5a7fc640 1 -- 172.21.15.100:0/922093866 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff60004400 con 0x7eff640c8e80 2024-09-11T22:27:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.382+0000 7eff6bf31640 1 -- 172.21.15.100:0/922093866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff641efca0 con 0x7eff640c8e80 2024-09-11T22:27:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.383+0000 7eff6bf31640 1 --2- 172.21.15.100:0/922093866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff641efee0 0x7eff640c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.383+0000 7eff6bf31640 1 -- 172.21.15.100:0/922093866 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7eff6414d400 con 0x7eff641efee0 2024-09-11T22:27:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.383+0000 7eff694cc640 1 --2- 172.21.15.100:0/922093866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff641efee0 0x7eff640c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.384+0000 7eff694cc640 1 -- 172.21.15.100:0/922093866 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff6406cb90 con 0x7eff641efee0 2024-09-11T22:27:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.384+0000 7eff5a7fc640 1 -- 172.21.15.100:0/922093866 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff6000c6d0 con 0x7eff640c8e80 2024-09-11T22:27:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.384+0000 7eff694cc640 1 --2- 172.21.15.100:0/922093866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff641efee0 0x7eff640c9f90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7eff640ce030 tx=0x7eff54004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.384+0000 7eff5a7fc640 1 --2- 172.21.15.100:0/922093866 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7eff4806be60 0x7eff4806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.384+0000 7eff5a7fc640 1 -- 172.21.15.100:0/922093866 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7eff6008ae30 con 0x7eff640c8e80 2024-09-11T22:27:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.384+0000 7eff6a4ce640 1 --2- 172.21.15.100:0/922093866 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7eff4806be60 0x7eff4806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.385+0000 7eff5a7fc640 1 -- 172.21.15.100:0/922093866 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5404b070 con 0x7eff641efee0 2024-09-11T22:27:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.385+0000 7eff5a7fc640 1 -- 172.21.15.100:0/922093866 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7eff54038040 con 0x7eff641efee0 2024-09-11T22:27:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.385+0000 7eff5a7fc640 1 -- 172.21.15.100:0/922093866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff641efee0 msgr2=0x7eff640c9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.385+0000 7eff5a7fc640 1 --2- 172.21.15.100:0/922093866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff641efee0 0x7eff640c9f90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7eff640ce030 tx=0x7eff54004730 comp rx=0 tx=0).stop 2024-09-11T22:27:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.385+0000 7eff5a7fc640 1 -- 172.21.15.100:0/922093866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff641efee0 msgr2=0x7eff640c9f90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:27:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.385+0000 7eff5a7fc640 1 --2- 172.21.15.100:0/922093866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff641efee0 0x7eff640c9f90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.385+0000 7eff6a4ce640 1 --2- 172.21.15.100:0/922093866 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7eff4806be60 0x7eff4806e320 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7eff5c009540 tx=0x7eff5c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.392+0000 7eff6bf31640 1 --2- 172.21.15.100:0/922093866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff640cb9d0 0x7eff640ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.392+0000 7eff6bf31640 1 -- 172.21.15.100:0/922093866 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7eff6414cc00 con 0x7eff640cb9d0 2024-09-11T22:27:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.393+0000 7eff694cc640 1 --2- 172.21.15.100:0/922093866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff640cb9d0 0x7eff640ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.393+0000 7eff694cc640 1 -- 172.21.15.100:0/922093866 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7eff64068880 con 0x7eff640cb9d0 2024-09-11T22:27:46.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.393+0000 7eff694cc640 1 --2- 172.21.15.100:0/922093866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff640cb9d0 0x7eff640ca4d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7eff54000c00 tx=0x7eff540046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:46.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.393+0000 7eff5a7fc640 1 -- 172.21.15.100:0/922093866 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5404b040 con 0x7eff640cb9d0 2024-09-11T22:27:46.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.393+0000 7eff5a7fc640 1 -- 172.21.15.100:0/922093866 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7eff54033d60 con 0x7eff640cb9d0 2024-09-11T22:27:46.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.393+0000 7eff5a7fc640 1 -- 172.21.15.100:0/922093866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff640cb9d0 msgr2=0x7eff640ca4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.393+0000 7eff5a7fc640 1 --2- 172.21.15.100:0/922093866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff640cb9d0 0x7eff640ca4d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7eff54000c00 tx=0x7eff540046c0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.394+0000 7eff5a7fc640 1 -- 172.21.15.100:0/922093866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff640cb9d0 msgr2=0x7eff640ca4d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:27:46.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.394+0000 7eff5a7fc640 1 --2- 172.21.15.100:0/922093866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7eff640cb9d0 0x7eff640ca4d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.395 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:27:46.395 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:27:46.396 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:27:46.396 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:27:46.396 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 54, 2024-09-11T22:27:46.396 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 357115, 2024-09-11T22:27:46.396 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:27:46.396 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:27:46.396 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:27:46.396 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:27:46.396 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:46.396 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 12, 2024-09-11T22:27:46.396 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:27:46.397 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:27:46.397 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:27:46.397 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:46.397 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:46.397 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:46.397 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:46.397 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:46.397 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:46.397 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:46.397 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:46.397 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:46.397 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:46.398 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:46.398 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:46.398 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:27:46.398 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:27:46.398 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:46.398 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:46.398 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:46.398 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:46.398 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:46.398 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:46.398 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:46.399 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:46.399 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:46.399 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:46.399 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:46.399 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:46.399 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.399 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:27:46.399 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:27:46.399 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:27:46.399 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:27:46.399 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:27:46.400 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:27:46.400 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:27:46.400 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:27:46.400 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:27:46.400 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:27:46.400 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:27:46.400 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:27:46.400 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:27:46.400 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:27:46.400 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:27:46.400 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:27:46.400 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:27:46.401 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:27:46.401 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:27:46.401 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:27:46.401 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:27:46.401 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:27:46.401 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:27:46.401 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:27:46.401 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:27:46.401 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:27:46.401 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:27:46.402 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:27:46.402 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:46.402 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:27:46.402 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.402 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:27:46.402 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.402 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:27:46.402 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:27:46.402 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:46.402 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:46.402 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.402 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:46.403 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:27:46.403 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:46.403 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.403 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.403 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:46.403 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:27:46.403 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:46.403 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:46.403 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:46.403 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.403 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:27:46.404 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:27:46.404 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:46.404 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:46.404 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:46.404 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.404 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.404 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:27:46.404 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:27:46.404 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:46.404 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:46.405 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.405 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:46.405 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:27:46.405 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:46.405 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.405 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.405 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:46.405 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:27:46.405 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:46.406 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:46.406 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:46.406 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.406 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:27:46.406 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:27:46.406 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:46.406 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:46.406 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:46.406 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.407 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.407 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:27:46.407 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:27:46.407 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:27:46.407 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:27:46.407 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.407 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:27:46.407 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:27:46.407 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:46.407 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.407 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.408 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:27:46.408 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:27:46.408 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:27:46.408 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:46.408 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:46.408 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.408 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:27:46.408 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:27:46.408 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:27:46.408 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:27:46.408 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:27:46.409 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:46.409 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:46.409 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.409 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:27:46.409 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:27:46.409 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.409 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:46.409 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:46.409 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:27:46.409 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:46.409 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:46.410 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:27:46.410 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.410 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:46.410 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:46.410 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:27:46.410 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:46.410 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:46.410 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:27:46.410 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.410 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:46.411 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:46.411 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:27:46.411 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:46.411 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:46.411 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:27:46.411 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.411 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:46.411 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:46.411 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:27:46.412 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:46.412 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:27:46.412 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:27:46.412 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:27:46.412 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:27:46.412 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:27:46.412 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:27:46.412 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:27:46.412 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:27:46.412 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:27:46.412 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:27:46.412 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:27:46.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.394+0000 7eff6bf31640 1 -- 172.21.15.100:0/922093866 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7eff4806be60 msgr2=0x7eff4806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.394+0000 7eff6bf31640 1 --2- 172.21.15.100:0/922093866 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7eff4806be60 0x7eff4806e320 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7eff5c009540 tx=0x7eff5c00b040 comp rx=0 tx=0).stop 2024-09-11T22:27:46.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.394+0000 7eff6bf31640 1 -- 172.21.15.100:0/922093866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff640c8e80 msgr2=0x7eff6414cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.394+0000 7eff6bf31640 1 --2- 172.21.15.100:0/922093866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff640c8e80 0x7eff6414cec0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7eff6000e840 tx=0x7eff6000ed00 comp rx=0 tx=0).stop 2024-09-11T22:27:46.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.394+0000 7eff6a4ce640 1 -- 172.21.15.100:0/922093866 reap_dead start 2024-09-11T22:27:46.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.394+0000 7eff6bf31640 1 -- 172.21.15.100:0/922093866 shutdown_connections 2024-09-11T22:27:46.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.394+0000 7eff6bf31640 1 --2- 172.21.15.100:0/922093866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff640c8e80 0x7eff6414cec0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.394+0000 7eff6bf31640 1 -- 172.21.15.100:0/922093866 >> 172.21.15.100:0/922093866 conn(0x7eff64070190 msgr2=0x7eff6414ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:46.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.394+0000 7eff6bf31640 1 -- 172.21.15.100:0/922093866 shutdown_connections 2024-09-11T22:27:46.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.394+0000 7eff6bf31640 1 -- 172.21.15.100:0/922093866 wait complete. 2024-09-11T22:27:46.415 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:27:46.415 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-11T22:27:46.415 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-11T22:27:46.415 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-11T22:27:46.415 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:27:46.416 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T22:27:46.416 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:27:46.426 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T22:27:46.426 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-11T22:27:46.426 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:27:46.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.577+0000 7f28b364c640 1 Processor -- start 2024-09-11T22:27:46.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.578+0000 7f28b364c640 1 -- start start 2024-09-11T22:27:46.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.578+0000 7f28b364c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f28ac0cc0f0 0x7f28ac0cb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.578+0000 7f28b364c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f28ac0cb560 0x7f28ac15e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.578+0000 7f28b364c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28ac15ab50 con 0x7f28ac154d40 2024-09-11T22:27:46.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.578+0000 7f28b364c640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f28ac15ae30 con 0x7f28ac0cb560 2024-09-11T22:27:46.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.578+0000 7f28b364c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f28ac15b110 con 0x7f28ac0cc0f0 2024-09-11T22:27:46.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.578+0000 7f28b1be9640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f28ac0cb560 msgr2=0x7f28ac15e020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:27:46.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.578+0000 7f28b1be9640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f28ac0cb560 0x7f28ac15e020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:27:46.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.579+0000 7f28b0be7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f28ac0cc0f0 0x7f28ac0cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.579+0000 7f28b13e8640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f28ac154d40 0x7f28ac0c5140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:46690/0 (socket says 172.21.15.100:46690) 2024-09-11T22:27:46.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.579+0000 7f28b13e8640 1 -- 172.21.15.100:0/3844617826 learned_addr learned my addr 172.21.15.100:0/3844617826 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:27:46.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.579+0000 7f28b0be7640 1 -- 172.21.15.100:0/3844617826 >> v2:172.21.15.100:3300/0 conn(0x7f28ac0cb560 msgr2=0x7f28ac15e020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:27:46.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.579+0000 7f28b0be7640 1 --2- 172.21.15.100:0/3844617826 >> v2:172.21.15.100:3300/0 conn(0x7f28ac0cb560 0x7f28ac15e020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.579+0000 7f28b0be7640 1 -- 172.21.15.100:0/3844617826 >> v1:172.21.15.167:6789/0 conn(0x7f28ac154d40 legacy=0x7f28ac0c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.579+0000 7f28a3fff640 1 -- 172.21.15.100:0/3844617826 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2332574008 0 0) 0x7f28ac15ab50 con 0x7f28ac154d40 2024-09-11T22:27:46.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.579+0000 7f28b0be7640 1 -- 172.21.15.100:0/3844617826 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28ac15b3f0 con 0x7f28ac0cc0f0 2024-09-11T22:27:46.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.580+0000 7f28b0be7640 1 --2- 172.21.15.100:0/3844617826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28ac0cc0f0 0x7f28ac0cb020 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f28ac0b6670 tx=0x7f289c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=493c21a37099b57b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:46.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.580+0000 7f28a3fff640 1 -- 172.21.15.100:0/3844617826 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c037070 con 0x7f28ac0cc0f0 2024-09-11T22:27:46.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.580+0000 7f28a3fff640 1 -- 172.21.15.100:0/3844617826 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f289c032440 con 0x7f28ac0cc0f0 2024-09-11T22:27:46.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.580+0000 7f28a3fff640 1 -- 172.21.15.100:0/3844617826 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c032810 con 0x7f28ac0cc0f0 2024-09-11T22:27:46.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.581+0000 7f28b364c640 1 -- 172.21.15.100:0/3844617826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28ac0cc0f0 msgr2=0x7f28ac0cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.581+0000 7f28b364c640 1 --2- 172.21.15.100:0/3844617826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28ac0cc0f0 0x7f28ac0cb020 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f28ac0b6670 tx=0x7f289c02a270 comp rx=0 tx=0).stop 2024-09-11T22:27:46.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.581+0000 7f28b364c640 1 -- 172.21.15.100:0/3844617826 shutdown_connections 2024-09-11T22:27:46.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.581+0000 7f28b364c640 1 --2- 172.21.15.100:0/3844617826 >> v2:172.21.15.100:3300/0 conn(0x7f28ac0cb560 0x7f28ac15e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.581+0000 7f28b364c640 1 --2- 172.21.15.100:0/3844617826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28ac0cc0f0 0x7f28ac0cb020 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.581+0000 7f28b364c640 1 -- 172.21.15.100:0/3844617826 >> 172.21.15.100:0/3844617826 conn(0x7f28ac067d40 msgr2=0x7f28ac06d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:46.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.581+0000 7f28b364c640 1 -- 172.21.15.100:0/3844617826 shutdown_connections 2024-09-11T22:27:46.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.581+0000 7f28b364c640 1 -- 172.21.15.100:0/3844617826 wait complete. 2024-09-11T22:27:46.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.582+0000 7f28b364c640 1 Processor -- start 2024-09-11T22:27:46.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.582+0000 7f28b364c640 1 -- start start 2024-09-11T22:27:46.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.583+0000 7f28b364c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28ac0cb560 0x7f28ac0b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.583+0000 7f28b364c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28ac0cc0f0 0x7f28ac14efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.583+0000 7f28b364c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28ac154d40 0x7f28ac144980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.583+0000 7f28b364c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac0b32e0 con 0x7f28ac0cc0f0 2024-09-11T22:27:46.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.583+0000 7f28b364c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac15a800 con 0x7f28ac154d40 2024-09-11T22:27:46.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.583+0000 7f28b364c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f28ac0b3460 con 0x7f28ac0cb560 2024-09-11T22:27:46.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.583+0000 7f28b0be7640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28ac0cc0f0 msgr2=0x7f28ac14efe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:27:46.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.583+0000 7f28b0be7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28ac0cc0f0 0x7f28ac14efe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:27:46.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.583+0000 7f28b13e8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28ac0cb560 0x7f28ac0b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.583+0000 7f28b1be9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28ac154d40 0x7f28ac144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.583+0000 7f28b13e8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28ac0cb560 0x7f28ac0b5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:60258/0 (socket says 172.21.15.100:60258) 2024-09-11T22:27:46.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.583+0000 7f28b13e8640 1 -- 172.21.15.100:0/1760592252 learned_addr learned my addr 172.21.15.100:0/1760592252 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:46.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.584+0000 7f28b13e8640 1 -- 172.21.15.100:0/1760592252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28ac154d40 msgr2=0x7f28ac144980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.584+0000 7f28b13e8640 1 --2- 172.21.15.100:0/1760592252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28ac154d40 0x7f28ac144980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.584+0000 7f28b13e8640 1 -- 172.21.15.100:0/1760592252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28ac0cc0f0 msgr2=0x7f28ac14efe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:27:46.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.584+0000 7f28b13e8640 1 --2- 172.21.15.100:0/1760592252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28ac0cc0f0 0x7f28ac14efe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.584+0000 7f28b13e8640 1 -- 172.21.15.100:0/1760592252 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28ac145e40 con 0x7f28ac0cb560 2024-09-11T22:27:46.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.584+0000 7f28b1be9640 1 --2- 172.21.15.100:0/1760592252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28ac154d40 0x7f28ac144980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:27:46.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.584+0000 7f28b13e8640 1 --2- 172.21.15.100:0/1760592252 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28ac0cb560 0x7f28ac0b5b20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f28a800c430 tx=0x7f28a800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:46.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.584+0000 7f28a1ffb640 1 -- 172.21.15.100:0/1760592252 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a80074e0 con 0x7f28ac0cb560 2024-09-11T22:27:46.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.584+0000 7f28a1ffb640 1 -- 172.21.15.100:0/1760592252 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28a80047e0 con 0x7f28ac0cb560 2024-09-11T22:27:46.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.584+0000 7f28b364c640 1 -- 172.21.15.100:0/1760592252 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28ac146120 con 0x7f28ac0cb560 2024-09-11T22:27:46.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.584+0000 7f28a1ffb640 1 -- 172.21.15.100:0/1760592252 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a8004bd0 con 0x7f28ac0cb560 2024-09-11T22:27:46.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.584+0000 7f28b364c640 1 -- 172.21.15.100:0/1760592252 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f28ac1f0b60 con 0x7f28ac0cb560 2024-09-11T22:27:46.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.585+0000 7f28b364c640 1 -- 172.21.15.100:0/1760592252 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28ac06d670 con 0x7f28ac0cb560 2024-09-11T22:27:46.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.586+0000 7f28a1ffb640 1 -- 172.21.15.100:0/1760592252 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f28a8011070 con 0x7f28ac0cb560 2024-09-11T22:27:46.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.586+0000 7f28a1ffb640 1 --2- 172.21.15.100:0/1760592252 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f289006bde0 0x7f289006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:46.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.586+0000 7f28a1ffb640 1 -- 172.21.15.100:0/1760592252 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f28a808aef0 con 0x7f28ac0cb560 2024-09-11T22:27:46.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.586+0000 7f28b0be7640 1 --2- 172.21.15.100:0/1760592252 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f289006bde0 0x7f289006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:46.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.587+0000 7f28b0be7640 1 --2- 172.21.15.100:0/1760592252 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f289006bde0 0x7f289006e2a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f289c034000 tx=0x7f289c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:46.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.590+0000 7f28a1ffb640 1 -- 172.21.15.100:0/1760592252 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f28a80593e0 con 0x7f28ac0cb560 2024-09-11T22:27:46.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.882+0000 7f28b364c640 1 -- 172.21.15.100:0/1760592252 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f28ac1587a0 con 0x7f28ac0cb560 2024-09-11T22:27:46.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.882+0000 7f28a1ffb640 1 -- 172.21.15.100:0/1760592252 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f28a8058ce0 con 0x7f28ac0cb560 2024-09-11T22:27:46.884 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:27:46.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.885+0000 7f28b364c640 1 -- 172.21.15.100:0/1760592252 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f289006bde0 msgr2=0x7f289006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.885+0000 7f28b364c640 1 --2- 172.21.15.100:0/1760592252 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f289006bde0 0x7f289006e2a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f289c034000 tx=0x7f289c02e000 comp rx=0 tx=0).stop 2024-09-11T22:27:46.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.885+0000 7f28b364c640 1 -- 172.21.15.100:0/1760592252 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28ac0cb560 msgr2=0x7f28ac0b5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:46.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.885+0000 7f28b364c640 1 --2- 172.21.15.100:0/1760592252 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28ac0cb560 0x7f28ac0b5b20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f28a800c430 tx=0x7f28a800c8f0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.885+0000 7f28b364c640 1 -- 172.21.15.100:0/1760592252 shutdown_connections 2024-09-11T22:27:46.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.885+0000 7f28b364c640 1 --2- 172.21.15.100:0/1760592252 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f289006bde0 0x7f289006e2a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.885+0000 7f28b364c640 1 --2- 172.21.15.100:0/1760592252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28ac154d40 0x7f28ac144980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.885+0000 7f28b364c640 1 --2- 172.21.15.100:0/1760592252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28ac0cc0f0 0x7f28ac14efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.885+0000 7f28b364c640 1 --2- 172.21.15.100:0/1760592252 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28ac0cb560 0x7f28ac0b5b20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:46.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.885+0000 7f28b364c640 1 -- 172.21.15.100:0/1760592252 >> 172.21.15.100:0/1760592252 conn(0x7f28ac067d40 msgr2=0x7f28ac158cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:46.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.885+0000 7f28b364c640 1 -- 172.21.15.100:0/1760592252 shutdown_connections 2024-09-11T22:27:46.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:46.885+0000 7f28b364c640 1 -- 172.21.15.100:0/1760592252 wait complete. 2024-09-11T22:27:49.898 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:27:50.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.009+0000 7f16c2c5e640 1 Processor -- start 2024-09-11T22:27:50.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.009+0000 7f16c2c5e640 1 -- start start 2024-09-11T22:27:50.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.010+0000 7f16c2c5e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f16bc154c20 0x7f16bc0cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.010+0000 7f16c2c5e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16bc0b3190 0x7f16bc15e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.010+0000 7f16c2c5e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16bc15ac90 con 0x7f16bc15a7e0 2024-09-11T22:27:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.010+0000 7f16c2c5e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f16bc15e000 con 0x7f16bc154c20 2024-09-11T22:27:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.010+0000 7f16c2c5e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f16bc15af70 con 0x7f16bc0b3190 2024-09-11T22:27:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.010+0000 7f16c11fb640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f16bc15a7e0 legacy=0x7f16bc0cbd10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:27:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.010+0000 7f16c09fa640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f16bc154c20 0x7f16bc0cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.010+0000 7f16bbfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16bc0b3190 0x7f16bc15e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.010+0000 7f16c09fa640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f16bc154c20 0x7f16bc0cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:36114/0 (socket says 172.21.15.100:36114) 2024-09-11T22:27:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.010+0000 7f16c09fa640 1 -- 172.21.15.100:0/1624405923 learned_addr learned my addr 172.21.15.100:0/1624405923 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.010+0000 7f16c09fa640 1 -- 172.21.15.100:0/1624405923 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16bc0b3190 msgr2=0x7f16bc15e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:27:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.010+0000 7f16c09fa640 1 --2- 172.21.15.100:0/1624405923 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16bc0b3190 0x7f16bc15e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.010+0000 7f16c09fa640 1 -- 172.21.15.100:0/1624405923 >> v1:172.21.15.100:6789/0 conn(0x7f16bc15a7e0 legacy=0x7f16bc0cbd10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:27:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.010+0000 7f16c09fa640 1 -- 172.21.15.100:0/1624405923 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16bc15b250 con 0x7f16bc154c20 2024-09-11T22:27:50.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.010+0000 7f16bbfff640 1 --2- 172.21.15.100:0/1624405923 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16bc0b3190 0x7f16bc15e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:27:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.011+0000 7f16c09fa640 1 --2- 172.21.15.100:0/1624405923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16bc154c20 0x7f16bc0cb120 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f16b0009870 tx=0x7f16b002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=484250705255e117 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.011+0000 7f16bb7fe640 1 -- 172.21.15.100:0/1624405923 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b0037070 con 0x7f16bc154c20 2024-09-11T22:27:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.011+0000 7f16bb7fe640 1 -- 172.21.15.100:0/1624405923 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b0032440 con 0x7f16bc154c20 2024-09-11T22:27:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.011+0000 7f16bb7fe640 1 -- 172.21.15.100:0/1624405923 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b0032810 con 0x7f16bc154c20 2024-09-11T22:27:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.012+0000 7f16c2c5e640 1 -- 172.21.15.100:0/1624405923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16bc154c20 msgr2=0x7f16bc0cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.012+0000 7f16c2c5e640 1 --2- 172.21.15.100:0/1624405923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16bc154c20 0x7f16bc0cb120 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f16b0009870 tx=0x7f16b002a210 comp rx=0 tx=0).stop 2024-09-11T22:27:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.012+0000 7f16c2c5e640 1 -- 172.21.15.100:0/1624405923 shutdown_connections 2024-09-11T22:27:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.012+0000 7f16c2c5e640 1 --2- 172.21.15.100:0/1624405923 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16bc0b3190 0x7f16bc15e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.012+0000 7f16c2c5e640 1 --2- 172.21.15.100:0/1624405923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16bc154c20 0x7f16bc0cb120 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.012+0000 7f16c2c5e640 1 -- 172.21.15.100:0/1624405923 >> 172.21.15.100:0/1624405923 conn(0x7f16bc067d40 msgr2=0x7f16bc06d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.012+0000 7f16c2c5e640 1 -- 172.21.15.100:0/1624405923 shutdown_connections 2024-09-11T22:27:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.012+0000 7f16c2c5e640 1 -- 172.21.15.100:0/1624405923 wait complete. 2024-09-11T22:27:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.013+0000 7f16c2c5e640 1 Processor -- start 2024-09-11T22:27:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.014+0000 7f16c2c5e640 1 -- start start 2024-09-11T22:27:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.014+0000 7f16c2c5e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16bc0b3190 0x7f16bc145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.014+0000 7f16c2c5e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16bc154c20 0x7f16bc14a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.014+0000 7f16c2c5e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16bc15a7e0 0x7f16bc144a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.014+0000 7f16c2c5e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f16bc0cc5a0 con 0x7f16bc0b3190 2024-09-11T22:27:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.014+0000 7f16c2c5e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f16bc0cc420 con 0x7f16bc15a7e0 2024-09-11T22:27:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.014+0000 7f16c2c5e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f16bc0cb660 con 0x7f16bc154c20 2024-09-11T22:27:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.014+0000 7f16c09fa640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16bc0b3190 msgr2=0x7f16bc145e10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:27:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.014+0000 7f16c09fa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16bc0b3190 0x7f16bc145e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:27:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.015+0000 7f16c11fb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16bc15a7e0 0x7f16bc144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.015+0000 7f16bbfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16bc154c20 0x7f16bc14a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.015+0000 7f16c11fb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16bc15a7e0 0x7f16bc144a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:36126/0 (socket says 172.21.15.100:36126) 2024-09-11T22:27:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.015+0000 7f16c11fb640 1 -- 172.21.15.100:0/527123114 learned_addr learned my addr 172.21.15.100:0/527123114 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.015+0000 7f16c11fb640 1 -- 172.21.15.100:0/527123114 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16bc154c20 msgr2=0x7f16bc14a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.015+0000 7f16c11fb640 1 --2- 172.21.15.100:0/527123114 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16bc154c20 0x7f16bc14a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.015+0000 7f16c11fb640 1 -- 172.21.15.100:0/527123114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16bc0b3190 msgr2=0x7f16bc145e10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:27:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.015+0000 7f16c11fb640 1 --2- 172.21.15.100:0/527123114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16bc0b3190 0x7f16bc145e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.015+0000 7f16c11fb640 1 -- 172.21.15.100:0/527123114 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16bc1f0c60 con 0x7f16bc15a7e0 2024-09-11T22:27:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.015+0000 7f16bbfff640 1 --2- 172.21.15.100:0/527123114 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16bc154c20 0x7f16bc14a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:27:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.015+0000 7f16c11fb640 1 --2- 172.21.15.100:0/527123114 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16bc15a7e0 0x7f16bc144a60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f16b400be60 tx=0x7f16b400bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.015+0000 7f16b97fa640 1 -- 172.21.15.100:0/527123114 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b4016430 con 0x7f16bc15a7e0 2024-09-11T22:27:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.015+0000 7f16b97fa640 1 -- 172.21.15.100:0/527123114 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b4010030 con 0x7f16bc15a7e0 2024-09-11T22:27:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.016+0000 7f16c2c5e640 1 -- 172.21.15.100:0/527123114 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16bc147b70 con 0x7f16bc15a7e0 2024-09-11T22:27:50.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.016+0000 7f16b97fa640 1 -- 172.21.15.100:0/527123114 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b4016810 con 0x7f16bc15a7e0 2024-09-11T22:27:50.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.016+0000 7f16c2c5e640 1 -- 172.21.15.100:0/527123114 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16bc1f1200 con 0x7f16bc15a7e0 2024-09-11T22:27:50.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.016+0000 7f16c2c5e640 1 -- 172.21.15.100:0/527123114 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16bc0cb120 con 0x7f16bc15a7e0 2024-09-11T22:27:50.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.017+0000 7f16b97fa640 1 -- 172.21.15.100:0/527123114 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f16b40153e0 con 0x7f16bc15a7e0 2024-09-11T22:27:50.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.017+0000 7f16b97fa640 1 --2- 172.21.15.100:0/527123114 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f16a006bde0 0x7f16a006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:50.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.018+0000 7f16b97fa640 1 -- 172.21.15.100:0/527123114 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f16b408b620 con 0x7f16bc15a7e0 2024-09-11T22:27:50.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.018+0000 7f16c09fa640 1 --2- 172.21.15.100:0/527123114 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f16a006bde0 0x7f16a006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:50.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.018+0000 7f16c09fa640 1 --2- 172.21.15.100:0/527123114 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f16a006bde0 0x7f16a006e2a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f16b0034000 tx=0x7f16b002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:50.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.022+0000 7f16b97fa640 1 -- 172.21.15.100:0/527123114 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f16b40595f0 con 0x7f16bc15a7e0 2024-09-11T22:27:50.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.316+0000 7f16c2c5e640 1 -- 172.21.15.100:0/527123114 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f16bc14eca0 con 0x7f16bc15a7e0 2024-09-11T22:27:50.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.316+0000 7f16b97fa640 1 -- 172.21.15.100:0/527123114 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f16b405d8f0 con 0x7f16bc15a7e0 2024-09-11T22:27:50.317 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:27:50.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.319+0000 7f16c2c5e640 1 -- 172.21.15.100:0/527123114 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f16a006bde0 msgr2=0x7f16a006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:50.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.319+0000 7f16c2c5e640 1 --2- 172.21.15.100:0/527123114 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f16a006bde0 0x7f16a006e2a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f16b0034000 tx=0x7f16b002e000 comp rx=0 tx=0).stop 2024-09-11T22:27:50.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.319+0000 7f16c2c5e640 1 -- 172.21.15.100:0/527123114 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16bc15a7e0 msgr2=0x7f16bc144a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:50.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.319+0000 7f16c2c5e640 1 --2- 172.21.15.100:0/527123114 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16bc15a7e0 0x7f16bc144a60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f16b400be60 tx=0x7f16b400bf50 comp rx=0 tx=0).stop 2024-09-11T22:27:50.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.319+0000 7f16c2c5e640 1 -- 172.21.15.100:0/527123114 shutdown_connections 2024-09-11T22:27:50.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.319+0000 7f16c2c5e640 1 --2- 172.21.15.100:0/527123114 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f16a006bde0 0x7f16a006e2a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:50.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.319+0000 7f16c2c5e640 1 --2- 172.21.15.100:0/527123114 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16bc15a7e0 0x7f16bc144a60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:50.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.319+0000 7f16c2c5e640 1 --2- 172.21.15.100:0/527123114 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16bc154c20 0x7f16bc14a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:50.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.319+0000 7f16c2c5e640 1 --2- 172.21.15.100:0/527123114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16bc0b3190 0x7f16bc145e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:50.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.319+0000 7f16c2c5e640 1 -- 172.21.15.100:0/527123114 >> 172.21.15.100:0/527123114 conn(0x7f16bc067d40 msgr2=0x7f16bc0cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:50.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.319+0000 7f16c2c5e640 1 -- 172.21.15.100:0/527123114 shutdown_connections 2024-09-11T22:27:50.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:50.319+0000 7f16c2c5e640 1 -- 172.21.15.100:0/527123114 wait complete. 2024-09-11T22:27:50.765 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:27:50.768 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:27:53.332 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:27:53.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.441+0000 7ff7c5d5f640 1 Processor -- start 2024-09-11T22:27:53.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.441+0000 7ff7c5d5f640 1 -- start start 2024-09-11T22:27:53.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.442+0000 7ff7c5d5f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7c0151ab0 0x7ff7c00c39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.442+0000 7ff7c5d5f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff7c0073a30 0x7ff7c00c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.442+0000 7ff7c5d5f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7c0151e90 con 0x7ff7c00afc80 2024-09-11T22:27:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.442+0000 7ff7c5d5f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7ff7c0072f00 con 0x7ff7c0073a30 2024-09-11T22:27:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.442+0000 7ff7c5d5f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff7c006bc10 con 0x7ff7c0151ab0 2024-09-11T22:27:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.442+0000 7ff7bf7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7c0151ab0 0x7ff7c00c39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.442+0000 7ff7beffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff7c0073a30 0x7ff7c00c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.442+0000 7ff7bf7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7c0151ab0 0x7ff7c00c39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:55618/0 (socket says 172.21.15.100:55618) 2024-09-11T22:27:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.442+0000 7ff7bf7fe640 1 -- 172.21.15.100:0/3965995405 learned_addr learned my addr 172.21.15.100:0/3965995405 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.442+0000 7ff7bffff640 1 --1- 172.21.15.100:0/3965995405 >> v1:172.21.15.167:6789/0 conn(0x7ff7c00afc80 0x7ff7c006c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:54704/0 (socket says 172.21.15.100:54704) 2024-09-11T22:27:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.443+0000 7ff7bf7fe640 1 -- 172.21.15.100:0/3965995405 >> v2:172.21.15.167:3300/0 conn(0x7ff7c0073a30 msgr2=0x7ff7c00c3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:27:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.443+0000 7ff7bf7fe640 1 --2- 172.21.15.100:0/3965995405 >> v2:172.21.15.167:3300/0 conn(0x7ff7c0073a30 0x7ff7c00c3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:53.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.443+0000 7ff7bf7fe640 1 -- 172.21.15.100:0/3965995405 >> v1:172.21.15.167:6789/0 conn(0x7ff7c00afc80 legacy=0x7ff7c006c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.443+0000 7ff7bf7fe640 1 -- 172.21.15.100:0/3965995405 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c01584c0 con 0x7ff7c0151ab0 2024-09-11T22:27:53.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.443+0000 7ff7beffd640 1 --2- 172.21.15.100:0/3965995405 >> v2:172.21.15.167:3300/0 conn(0x7ff7c0073a30 0x7ff7c00c3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:27:53.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.444+0000 7ff7bf7fe640 1 --2- 172.21.15.100:0/3965995405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7c0151ab0 0x7ff7c00c39a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0009870 tx=0x7ff7b002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe1fe7a348c57691 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:53.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.444+0000 7ff7be7fc640 1 -- 172.21.15.100:0/3965995405 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0037070 con 0x7ff7c0151ab0 2024-09-11T22:27:53.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.444+0000 7ff7be7fc640 1 -- 172.21.15.100:0/3965995405 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b0032440 con 0x7ff7c0151ab0 2024-09-11T22:27:53.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.444+0000 7ff7be7fc640 1 -- 172.21.15.100:0/3965995405 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0032810 con 0x7ff7c0151ab0 2024-09-11T22:27:53.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.444+0000 7ff7c5d5f640 1 -- 172.21.15.100:0/3965995405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7c0151ab0 msgr2=0x7ff7c00c39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:53.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.444+0000 7ff7c5d5f640 1 --2- 172.21.15.100:0/3965995405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7c0151ab0 0x7ff7c00c39a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0009870 tx=0x7ff7b002a1c0 comp rx=0 tx=0).stop 2024-09-11T22:27:53.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.444+0000 7ff7c5d5f640 1 -- 172.21.15.100:0/3965995405 shutdown_connections 2024-09-11T22:27:53.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.444+0000 7ff7c5d5f640 1 --2- 172.21.15.100:0/3965995405 >> v2:172.21.15.167:3300/0 conn(0x7ff7c0073a30 0x7ff7c00c3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:53.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.444+0000 7ff7c5d5f640 1 --2- 172.21.15.100:0/3965995405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7c0151ab0 0x7ff7c00c39a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:53.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.444+0000 7ff7c5d5f640 1 -- 172.21.15.100:0/3965995405 >> 172.21.15.100:0/3965995405 conn(0x7ff7c00cd200 msgr2=0x7ff7c00cd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:53.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.444+0000 7ff7c5d5f640 1 -- 172.21.15.100:0/3965995405 shutdown_connections 2024-09-11T22:27:53.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.444+0000 7ff7c5d5f640 1 -- 172.21.15.100:0/3965995405 wait complete. 2024-09-11T22:27:53.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.446+0000 7ff7c5d5f640 1 Processor -- start 2024-09-11T22:27:53.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.446+0000 7ff7c5d5f640 1 -- start start 2024-09-11T22:27:53.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.447+0000 7ff7c5d5f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7c0073a30 0x7ff7c0153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:53.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.447+0000 7ff7c5d5f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7c00afc80 0x7ff7c01531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:53.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.447+0000 7ff7c5d5f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7c0151ab0 0x7ff7c0147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:53.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.447+0000 7ff7c5d5f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c0073430 con 0x7ff7c0073a30 2024-09-11T22:27:53.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.447+0000 7ff7c5d5f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c006bef0 con 0x7ff7c00afc80 2024-09-11T22:27:53.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.447+0000 7ff7c5d5f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff7c0158180 con 0x7ff7c0151ab0 2024-09-11T22:27:53.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.447+0000 7ff7bf7fe640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7c0073a30 msgr2=0x7ff7c0153fc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:27:53.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.447+0000 7ff7bf7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7c0073a30 0x7ff7c0153fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:27:53.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.447+0000 7ff7beffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7c00afc80 0x7ff7c01531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:53.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.447+0000 7ff7bffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7c0151ab0 0x7ff7c0147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:53.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.447+0000 7ff7beffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7c00afc80 0x7ff7c01531a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:52316/0 (socket says 172.21.15.100:52316) 2024-09-11T22:27:53.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.447+0000 7ff7bffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7c0151ab0 0x7ff7c0147e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:55630/0 (socket says 172.21.15.100:55630) 2024-09-11T22:27:53.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.447+0000 7ff7beffd640 1 -- 172.21.15.100:0/1116044372 learned_addr learned my addr 172.21.15.100:0/1116044372 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:27:53.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.447+0000 7ff7beffd640 1 -- 172.21.15.100:0/1116044372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7c0151ab0 msgr2=0x7ff7c0147e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:53.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.447+0000 7ff7beffd640 1 --2- 172.21.15.100:0/1116044372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7c0151ab0 0x7ff7c0147e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:53.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.447+0000 7ff7beffd640 1 -- 172.21.15.100:0/1116044372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7c0073a30 msgr2=0x7ff7c0153fc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:27:53.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.447+0000 7ff7beffd640 1 --2- 172.21.15.100:0/1116044372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7c0073a30 0x7ff7c0153fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:53.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.447+0000 7ff7beffd640 1 -- 172.21.15.100:0/1116044372 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c00c6b70 con 0x7ff7c00afc80 2024-09-11T22:27:53.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.447+0000 7ff7bffff640 1 --2- 172.21.15.100:0/1116044372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7c0151ab0 0x7ff7c0147e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:27:53.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.447+0000 7ff7beffd640 1 --2- 172.21.15.100:0/1116044372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7c00afc80 0x7ff7c01531a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400e910 tx=0x7ff7b400edd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:53.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.448+0000 7ff7a7fff640 1 -- 172.21.15.100:0/1116044372 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4017070 con 0x7ff7c00afc80 2024-09-11T22:27:53.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.448+0000 7ff7a7fff640 1 -- 172.21.15.100:0/1116044372 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b400ca00 con 0x7ff7c00afc80 2024-09-11T22:27:53.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.448+0000 7ff7a7fff640 1 -- 172.21.15.100:0/1116044372 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b400cdb0 con 0x7ff7c00afc80 2024-09-11T22:27:53.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.448+0000 7ff7c5d5f640 1 -- 172.21.15.100:0/1116044372 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c0152a60 con 0x7ff7c00afc80 2024-09-11T22:27:53.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.448+0000 7ff7c5d5f640 1 -- 172.21.15.100:0/1116044372 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c00c6de0 con 0x7ff7c00afc80 2024-09-11T22:27:53.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.449+0000 7ff7c5d5f640 1 -- 172.21.15.100:0/1116044372 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c00c2220 con 0x7ff7c00afc80 2024-09-11T22:27:53.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.449+0000 7ff7a7fff640 1 -- 172.21.15.100:0/1116044372 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff7b401a070 con 0x7ff7c00afc80 2024-09-11T22:27:53.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.450+0000 7ff7a7fff640 1 --2- 172.21.15.100:0/1116044372 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff7ac06bde0 0x7ff7ac06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:53.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.450+0000 7ff7a7fff640 1 -- 172.21.15.100:0/1116044372 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7ff7b408b070 con 0x7ff7c00afc80 2024-09-11T22:27:53.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.450+0000 7ff7bf7fe640 1 --2- 172.21.15.100:0/1116044372 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff7ac06bde0 0x7ff7ac06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:53.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.450+0000 7ff7bf7fe640 1 --2- 172.21.15.100:0/1116044372 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff7ac06bde0 0x7ff7ac06e2a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0034000 tx=0x7ff7b002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:27:53.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.454+0000 7ff7a7fff640 1 -- 172.21.15.100:0/1116044372 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff7b4058fb0 con 0x7ff7c00afc80 2024-09-11T22:27:53.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.743+0000 7ff7c5d5f640 1 -- 172.21.15.100:0/1116044372 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff7c0073810 con 0x7ff7c00afc80 2024-09-11T22:27:53.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.744+0000 7ff7a7fff640 1 -- 172.21.15.100:0/1116044372 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7ff7b405d2b0 con 0x7ff7c00afc80 2024-09-11T22:27:53.745 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:27:53.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.746+0000 7ff7c5d5f640 1 -- 172.21.15.100:0/1116044372 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff7ac06bde0 msgr2=0x7ff7ac06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:53.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.746+0000 7ff7c5d5f640 1 --2- 172.21.15.100:0/1116044372 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff7ac06bde0 0x7ff7ac06e2a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0034000 tx=0x7ff7b002e000 comp rx=0 tx=0).stop 2024-09-11T22:27:53.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.746+0000 7ff7c5d5f640 1 -- 172.21.15.100:0/1116044372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7c00afc80 msgr2=0x7ff7c01531a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:53.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.746+0000 7ff7c5d5f640 1 --2- 172.21.15.100:0/1116044372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7c00afc80 0x7ff7c01531a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400e910 tx=0x7ff7b400edd0 comp rx=0 tx=0).stop 2024-09-11T22:27:53.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.746+0000 7ff7c5d5f640 1 -- 172.21.15.100:0/1116044372 shutdown_connections 2024-09-11T22:27:53.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.746+0000 7ff7c5d5f640 1 --2- 172.21.15.100:0/1116044372 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff7ac06bde0 0x7ff7ac06e2a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:53.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.746+0000 7ff7c5d5f640 1 --2- 172.21.15.100:0/1116044372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7c0151ab0 0x7ff7c0147e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:53.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.746+0000 7ff7c5d5f640 1 --2- 172.21.15.100:0/1116044372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7c00afc80 0x7ff7c01531a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:53.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.746+0000 7ff7c5d5f640 1 --2- 172.21.15.100:0/1116044372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7c0073a30 0x7ff7c0153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:53.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.746+0000 7ff7c5d5f640 1 -- 172.21.15.100:0/1116044372 >> 172.21.15.100:0/1116044372 conn(0x7ff7c00cd200 msgr2=0x7ff7c0156f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:27:53.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.746+0000 7ff7c5d5f640 1 -- 172.21.15.100:0/1116044372 shutdown_connections 2024-09-11T22:27:53.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:53.746+0000 7ff7c5d5f640 1 -- 172.21.15.100:0/1116044372 wait complete. 2024-09-11T22:27:56.759 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:27:56.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:56.873+0000 7fda1dd86640 1 Processor -- start 2024-09-11T22:27:56.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:56.873+0000 7fda1dd86640 1 -- start start 2024-09-11T22:27:56.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:56.874+0000 7fda1dd86640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fda180b3190 0x7fda1815e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:56.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:56.874+0000 7fda1dd86640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1815a7e0 0x7fda1815e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:56.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:56.874+0000 7fda1dd86640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda1815ac90 con 0x7fda18154c20 2024-09-11T22:27:56.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:56.874+0000 7fda1dd86640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fda1815e000 con 0x7fda180b3190 2024-09-11T22:27:56.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:56.874+0000 7fda1dd86640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fda1815af70 con 0x7fda1815a7e0 2024-09-11T22:27:56.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:56.874+0000 7fda17fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1815a7e0 0x7fda1815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:56.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:56.874+0000 7fda177fe640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fda18154c20 0x7fda180cb120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:54712/0 (socket says 172.21.15.100:54712) 2024-09-11T22:27:56.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:56.874+0000 7fda177fe640 1 -- 172.21.15.100:0/433996707 learned_addr learned my addr 172.21.15.100:0/433996707 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:27:56.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:56.874+0000 7fda16ffd640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda180b3190 0x7fda1815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:56.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:56.874+0000 7fda17fff640 1 -- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1815a7e0 msgr2=0x7fda1815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:27:56.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:56.874+0000 7fda17fff640 1 -- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1815a7e0 msgr2=0x7fda1815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:27:56.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:56.874+0000 7fda16ffd640 1 -- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda180b3190 msgr2=0x7fda1815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:27:56.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:56.874+0000 7fda17fff640 1 --2- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1815a7e0 0x7fda1815e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:56.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:56.874+0000 7fda16ffd640 1 -- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda180b3190 msgr2=0x7fda1815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:27:56.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:56.874+0000 7fda16ffd640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda180b3190 0x7fda1815e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:56.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:56.874+0000 7fda16ffd640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda180b3190 0x7fda1815e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:27:56.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:56.874+0000 7fda17fff640 1 --2- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1815a7e0 0x7fda1815e9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:27:57.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:57.075+0000 7fda17fff640 1 --2- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1815a7e0 0x7fda1815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:57.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:57.075+0000 7fda16ffd640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda180b3190 0x7fda1815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:57.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:57.075+0000 7fda17fff640 1 -- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1815a7e0 msgr2=0x7fda1815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:27:57.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:57.075+0000 7fda17fff640 1 -- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1815a7e0 msgr2=0x7fda1815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:27:57.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:57.075+0000 7fda16ffd640 1 -- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda180b3190 msgr2=0x7fda1815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:27:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:57.075+0000 7fda17fff640 1 --2- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1815a7e0 0x7fda1815e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:57.075+0000 7fda16ffd640 1 -- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda180b3190 msgr2=0x7fda1815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:27:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:57.075+0000 7fda16ffd640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda180b3190 0x7fda1815e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:57.075+0000 7fda16ffd640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda180b3190 0x7fda1815e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:27:57.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:57.075+0000 7fda17fff640 1 --2- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1815a7e0 0x7fda1815e9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:27:57.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:57.476+0000 7fda17fff640 1 --2- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1815a7e0 0x7fda1815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:57.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:57.476+0000 7fda16ffd640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda180b3190 0x7fda1815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:57.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:57.476+0000 7fda17fff640 1 -- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1815a7e0 msgr2=0x7fda1815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:27:57.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:57.476+0000 7fda17fff640 1 -- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1815a7e0 msgr2=0x7fda1815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:27:57.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:57.476+0000 7fda16ffd640 1 -- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda180b3190 msgr2=0x7fda1815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:27:57.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:57.476+0000 7fda17fff640 1 --2- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1815a7e0 0x7fda1815e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:57.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:57.476+0000 7fda16ffd640 1 -- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda180b3190 msgr2=0x7fda1815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:27:57.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:57.476+0000 7fda16ffd640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda180b3190 0x7fda1815e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:57.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:57.476+0000 7fda17fff640 1 --2- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1815a7e0 0x7fda1815e9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:27:57.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:57.476+0000 7fda16ffd640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda180b3190 0x7fda1815e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:27:58.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:58.277+0000 7fda17fff640 1 --2- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1815a7e0 0x7fda1815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:58.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:58.277+0000 7fda16ffd640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda180b3190 0x7fda1815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:27:58.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:58.277+0000 7fda17fff640 1 -- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1815a7e0 msgr2=0x7fda1815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:27:58.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:58.277+0000 7fda17fff640 1 -- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1815a7e0 msgr2=0x7fda1815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:27:58.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:58.277+0000 7fda17fff640 1 --2- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1815a7e0 0x7fda1815e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:58.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:58.277+0000 7fda16ffd640 1 -- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda180b3190 msgr2=0x7fda1815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:27:58.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:58.277+0000 7fda16ffd640 1 -- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda180b3190 msgr2=0x7fda1815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:27:58.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:58.277+0000 7fda16ffd640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda180b3190 0x7fda1815e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:27:58.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:58.277+0000 7fda17fff640 1 --2- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1815a7e0 0x7fda1815e9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:27:58.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:58.277+0000 7fda16ffd640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda180b3190 0x7fda1815e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:27:59.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:59.874+0000 7fda157fa640 1 -- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1815a7e0 msgr2=0x7fda1815e9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:27:59.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:59.874+0000 7fda157fa640 1 --2- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1815a7e0 0x7fda1815e9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:59.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:59.874+0000 7fda157fa640 1 -- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda180b3190 msgr2=0x7fda1815e490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:27:59.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:59.874+0000 7fda157fa640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda180b3190 0x7fda1815e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:27:59.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:59.874+0000 7fda157fa640 1 -- 172.21.15.100:0/433996707 >> v1:172.21.15.167:6789/0 conn(0x7fda18154c20 legacy=0x7fda180cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:27:59.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:59.874+0000 7fda157fa640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.100:3300/0 conn(0x7fda04007350 0x7fda040097f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:27:59.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:59.874+0000 7fda157fa640 1 -- 172.21.15.100:0/433996707 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda1815b250 con 0x7fda040036a0 2024-09-11T22:27:59.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:59.874+0000 7fda157fa640 1 -- 172.21.15.100:0/433996707 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fda1815e000 con 0x7fda04007350 2024-09-11T22:27:59.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:59.874+0000 7fda177fe640 1 -- 172.21.15.100:0/433996707 >> v1:172.21.15.100:6789/0 conn(0x7fda040036a0 legacy=0x7fda04005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:27:59.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:59.874+0000 7fda16ffd640 1 -- 172.21.15.100:0/433996707 >> v2:172.21.15.100:3300/0 conn(0x7fda04007350 msgr2=0x7fda040097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:27:59.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:27:59.874+0000 7fda16ffd640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.100:3300/0 conn(0x7fda04007350 0x7fda040097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:28:00.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:00.075+0000 7fda177fe640 1 -- 172.21.15.100:0/433996707 >> v1:172.21.15.100:6789/0 conn(0x7fda040036a0 legacy=0x7fda04005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:28:00.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:00.075+0000 7fda16ffd640 1 -- 172.21.15.100:0/433996707 >> v2:172.21.15.100:3300/0 conn(0x7fda04007350 msgr2=0x7fda040097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:28:00.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:00.075+0000 7fda16ffd640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.100:3300/0 conn(0x7fda04007350 0x7fda040097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:28:00.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:00.476+0000 7fda16ffd640 1 -- 172.21.15.100:0/433996707 >> v2:172.21.15.100:3300/0 conn(0x7fda04007350 msgr2=0x7fda040097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:28:00.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:00.476+0000 7fda177fe640 1 -- 172.21.15.100:0/433996707 >> v1:172.21.15.100:6789/0 conn(0x7fda040036a0 legacy=0x7fda04005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:28:00.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:00.476+0000 7fda16ffd640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.100:3300/0 conn(0x7fda04007350 0x7fda040097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:28:01.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:01.277+0000 7fda16ffd640 1 -- 172.21.15.100:0/433996707 >> v2:172.21.15.100:3300/0 conn(0x7fda04007350 msgr2=0x7fda040097f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:28:01.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:01.277+0000 7fda177fe640 1 -- 172.21.15.100:0/433996707 >> v1:172.21.15.100:6789/0 conn(0x7fda040036a0 legacy=0x7fda04005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:28:01.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:01.277+0000 7fda16ffd640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.100:3300/0 conn(0x7fda04007350 0x7fda040097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:28:02.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.874+0000 7fda157fa640 1 -- 172.21.15.100:0/433996707 >> v2:172.21.15.100:3300/0 conn(0x7fda04007350 msgr2=0x7fda040097f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:28:02.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.874+0000 7fda157fa640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.100:3300/0 conn(0x7fda04007350 0x7fda040097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.874+0000 7fda157fa640 1 -- 172.21.15.100:0/433996707 >> v1:172.21.15.100:6789/0 conn(0x7fda040036a0 legacy=0x7fda04005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:28:02.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.874+0000 7fda17fff640 1 -- 172.21.15.100:0/433996707 reap_dead start 2024-09-11T22:28:02.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.874+0000 7fda157fa640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda04006250 0x7fda040097f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:02.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.874+0000 7fda157fa640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.100:3300/0 conn(0x7fda040066d0 0x7fda04005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:02.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.874+0000 7fda157fa640 1 --2- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda04006ad0 0x7fda04009e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:02.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.874+0000 7fda157fa640 1 -- 172.21.15.100:0/433996707 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fda1815e000 con 0x7fda040066d0 2024-09-11T22:28:02.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.874+0000 7fda157fa640 1 -- 172.21.15.100:0/433996707 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fda1815af70 con 0x7fda04006250 2024-09-11T22:28:02.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.874+0000 7fda157fa640 1 -- 172.21.15.100:0/433996707 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fda0400a3b0 con 0x7fda04006ad0 2024-09-11T22:28:02.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.874+0000 7fda16ffd640 1 -- 172.21.15.100:0/433996707 >> v2:172.21.15.100:3300/0 conn(0x7fda040066d0 msgr2=0x7fda04005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:28:02.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.874+0000 7fda16ffd640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.100:3300/0 conn(0x7fda040066d0 0x7fda04005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:28:02.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.875+0000 7fda177fe640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda04006250 0x7fda040097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:02.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.875+0000 7fda17fff640 1 --2- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda04006ad0 0x7fda04009e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:02.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.875+0000 7fda17fff640 1 -- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda04006250 msgr2=0x7fda040097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:02.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.875+0000 7fda17fff640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda04006250 0x7fda040097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.875+0000 7fda17fff640 1 -- 172.21.15.100:0/433996707 >> v2:172.21.15.100:3300/0 conn(0x7fda040066d0 msgr2=0x7fda04005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:28:02.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.875+0000 7fda17fff640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.100:3300/0 conn(0x7fda040066d0 0x7fda04005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.875+0000 7fda17fff640 1 -- 172.21.15.100:0/433996707 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda0400afb0 con 0x7fda04006ad0 2024-09-11T22:28:02.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.875+0000 7fda177fe640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda04006250 0x7fda040097f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:02.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.876+0000 7fda17fff640 1 --2- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda04006ad0 0x7fda04009e70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fda180cdd80 tx=0x7fda1002ae90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b61243bc79f3d1f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:02.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.876+0000 7fda167fc640 1 -- 172.21.15.100:0/433996707 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda10031070 con 0x7fda04006ad0 2024-09-11T22:28:02.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.876+0000 7fda167fc640 1 -- 172.21.15.100:0/433996707 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda1002bba0 con 0x7fda04006ad0 2024-09-11T22:28:02.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.876+0000 7fda167fc640 1 -- 172.21.15.100:0/433996707 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda10035400 con 0x7fda04006ad0 2024-09-11T22:28:02.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.877+0000 7fda1dd86640 1 -- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda04006ad0 msgr2=0x7fda04009e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:02.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.877+0000 7fda1dd86640 1 --2- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda04006ad0 0x7fda04009e70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fda180cdd80 tx=0x7fda1002ae90 comp rx=0 tx=0).stop 2024-09-11T22:28:02.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.877+0000 7fda1dd86640 1 -- 172.21.15.100:0/433996707 shutdown_connections 2024-09-11T22:28:02.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.877+0000 7fda1dd86640 1 --2- 172.21.15.100:0/433996707 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda04006ad0 0x7fda04009e70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.877+0000 7fda1dd86640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.100:3300/0 conn(0x7fda040066d0 0x7fda04005b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.877+0000 7fda1dd86640 1 --2- 172.21.15.100:0/433996707 >> v2:172.21.15.167:3300/0 conn(0x7fda04006250 0x7fda040097f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.877+0000 7fda1dd86640 1 -- 172.21.15.100:0/433996707 >> 172.21.15.100:0/433996707 conn(0x7fda18067d40 msgr2=0x7fda1806d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:02.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.877+0000 7fda1dd86640 1 -- 172.21.15.100:0/433996707 shutdown_connections 2024-09-11T22:28:02.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.877+0000 7fda1dd86640 1 -- 172.21.15.100:0/433996707 wait complete. 2024-09-11T22:28:02.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.878+0000 7fda1dd86640 1 Processor -- start 2024-09-11T22:28:02.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.878+0000 7fda1dd86640 1 -- start start 2024-09-11T22:28:02.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.879+0000 7fda1dd86640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda04006250 0x7fda180ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:02.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.879+0000 7fda1dd86640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda040066d0 0x7fda1815bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:02.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.879+0000 7fda1dd86640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda04006ad0 0x7fda181f3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:02.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.879+0000 7fda1dd86640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fda180cb2a0 con 0x7fda040066d0 2024-09-11T22:28:02.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.879+0000 7fda1dd86640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fda180cb120 con 0x7fda04006ad0 2024-09-11T22:28:02.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.879+0000 7fda1dd86640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fda180cb420 con 0x7fda04006250 2024-09-11T22:28:02.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.879+0000 7fda16ffd640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda040066d0 msgr2=0x7fda1815bc10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:28:02.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.879+0000 7fda16ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda040066d0 0x7fda1815bc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:28:02.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.879+0000 7fda177fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda04006250 0x7fda180ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:02.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.879+0000 7fda177fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda04006250 0x7fda180ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45220/0 (socket says 172.21.15.100:45220) 2024-09-11T22:28:02.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.879+0000 7fda177fe640 1 -- 172.21.15.100:0/2342231431 learned_addr learned my addr 172.21.15.100:0/2342231431 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:02.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.879+0000 7fda17fff640 1 --2- 172.21.15.100:0/2342231431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda04006ad0 0x7fda181f3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:02.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.879+0000 7fda177fe640 1 -- 172.21.15.100:0/2342231431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda04006ad0 msgr2=0x7fda181f3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:02.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.879+0000 7fda177fe640 1 --2- 172.21.15.100:0/2342231431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda04006ad0 0x7fda181f3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.879+0000 7fda177fe640 1 -- 172.21.15.100:0/2342231431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda040066d0 msgr2=0x7fda1815bc10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:28:02.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.879+0000 7fda177fe640 1 --2- 172.21.15.100:0/2342231431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda040066d0 0x7fda1815bc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:02.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.879+0000 7fda177fe640 1 -- 172.21.15.100:0/2342231431 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda180cecf0 con 0x7fda04006250 2024-09-11T22:28:02.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.880+0000 7fda177fe640 1 --2- 172.21.15.100:0/2342231431 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda04006250 0x7fda180ce7b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fda08007360 tx=0x7fda08007820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:02.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.880+0000 7fd9fffff640 1 -- 172.21.15.100:0/2342231431 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0801a070 con 0x7fda04006250 2024-09-11T22:28:02.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.880+0000 7fd9fffff640 1 -- 172.21.15.100:0/2342231431 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda0800f9a0 con 0x7fda04006250 2024-09-11T22:28:02.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.880+0000 7fda1dd86640 1 -- 172.21.15.100:0/2342231431 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda18152440 con 0x7fda04006250 2024-09-11T22:28:02.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.880+0000 7fd9fffff640 1 -- 172.21.15.100:0/2342231431 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0800fd50 con 0x7fda04006250 2024-09-11T22:28:02.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.880+0000 7fda1dd86640 1 -- 172.21.15.100:0/2342231431 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fda181529a0 con 0x7fda04006250 2024-09-11T22:28:02.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.881+0000 7fda1dd86640 1 -- 172.21.15.100:0/2342231431 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda18159410 con 0x7fda04006250 2024-09-11T22:28:02.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.882+0000 7fd9fffff640 1 -- 172.21.15.100:0/2342231431 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fda0801d070 con 0x7fda04006250 2024-09-11T22:28:02.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.882+0000 7fd9fffff640 1 --2- 172.21.15.100:0/2342231431 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fda0406da00 0x7fda0406fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:02.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.882+0000 7fd9fffff640 1 -- 172.21.15.100:0/2342231431 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fda0808ab10 con 0x7fda04006250 2024-09-11T22:28:02.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.882+0000 7fda16ffd640 1 --2- 172.21.15.100:0/2342231431 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fda0406da00 0x7fda0406fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:02.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.882+0000 7fda16ffd640 1 --2- 172.21.15.100:0/2342231431 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fda0406da00 0x7fda0406fec0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fda180c5900 tx=0x7fda0c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:02.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:02.886+0000 7fd9fffff640 1 -- 172.21.15.100:0/2342231431 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fda18159410 con 0x7fda04006250 2024-09-11T22:28:03.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.161+0000 7fda1dd86640 1 -- 172.21.15.100:0/2342231431 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fda180cb850 con 0x7fda04006250 2024-09-11T22:28:03.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.161+0000 7fd9fffff640 1 -- 172.21.15.100:0/2342231431 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7fda080589a0 con 0x7fda04006250 2024-09-11T22:28:03.162 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":56,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:28:03.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.163+0000 7fda1dd86640 1 -- 172.21.15.100:0/2342231431 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fda0406da00 msgr2=0x7fda0406fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:03.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.163+0000 7fda1dd86640 1 --2- 172.21.15.100:0/2342231431 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fda0406da00 0x7fda0406fec0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fda180c5900 tx=0x7fda0c008040 comp rx=0 tx=0).stop 2024-09-11T22:28:03.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.163+0000 7fda1dd86640 1 -- 172.21.15.100:0/2342231431 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda04006250 msgr2=0x7fda180ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:03.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.163+0000 7fda1dd86640 1 --2- 172.21.15.100:0/2342231431 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda04006250 0x7fda180ce7b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fda08007360 tx=0x7fda08007820 comp rx=0 tx=0).stop 2024-09-11T22:28:03.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.163+0000 7fda1dd86640 1 -- 172.21.15.100:0/2342231431 shutdown_connections 2024-09-11T22:28:03.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.163+0000 7fda1dd86640 1 --2- 172.21.15.100:0/2342231431 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fda0406da00 0x7fda0406fec0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.163+0000 7fda1dd86640 1 --2- 172.21.15.100:0/2342231431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda04006ad0 0x7fda181f3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.163+0000 7fda1dd86640 1 --2- 172.21.15.100:0/2342231431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda040066d0 0x7fda1815bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.163+0000 7fda1dd86640 1 --2- 172.21.15.100:0/2342231431 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda04006250 0x7fda180ce7b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.163+0000 7fda1dd86640 1 -- 172.21.15.100:0/2342231431 >> 172.21.15.100:0/2342231431 conn(0x7fda18067d40 msgr2=0x7fda1815a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:03.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.164+0000 7fda1dd86640 1 -- 172.21.15.100:0/2342231431 shutdown_connections 2024-09-11T22:28:03.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.164+0000 7fda1dd86640 1 -- 172.21.15.100:0/2342231431 wait complete. 2024-09-11T22:28:03.177 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-11T22:28:03.177 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-11T22:28:03.178 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:28:03.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.289+0000 7fe93b0ac640 1 Processor -- start 2024-09-11T22:28:03.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.290+0000 7fe93b0ac640 1 -- start start 2024-09-11T22:28:03.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.290+0000 7fe93b0ac640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe93406c3a0 0x7fe934073880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:03.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.290+0000 7fe93b0ac640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93406cee0 0x7fe934073dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:03.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.290+0000 7fe93b0ac640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9340687e0 con 0x7fe9340b20e0 2024-09-11T22:28:03.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.290+0000 7fe93b0ac640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fe9340c41a0 con 0x7fe93406c3a0 2024-09-11T22:28:03.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.290+0000 7fe93b0ac640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe934072860 con 0x7fe93406cee0 2024-09-11T22:28:03.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.290+0000 7fe933fff640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7fe93406c3a0 msgr2=0x7fe934073880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:28:03.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.290+0000 7fe938e48640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7fe9340b20e0 legacy=0x7fe934072cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:28:03.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.290+0000 7fe933fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe93406c3a0 0x7fe934073880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:28:03.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.291+0000 7fe939649640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93406cee0 0x7fe934073dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:03.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.291+0000 7fe939649640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93406cee0 0x7fe934073dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45230/0 (socket says 172.21.15.100:45230) 2024-09-11T22:28:03.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.291+0000 7fe939649640 1 -- 172.21.15.100:0/380410629 learned_addr learned my addr 172.21.15.100:0/380410629 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:03.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.291+0000 7fe939649640 1 -- 172.21.15.100:0/380410629 >> v2:172.21.15.100:3300/0 conn(0x7fe93406c3a0 msgr2=0x7fe934073880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:28:03.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.291+0000 7fe939649640 1 --2- 172.21.15.100:0/380410629 >> v2:172.21.15.100:3300/0 conn(0x7fe93406c3a0 0x7fe934073880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.291+0000 7fe939649640 1 -- 172.21.15.100:0/380410629 >> v1:172.21.15.100:6789/0 conn(0x7fe9340b20e0 legacy=0x7fe934072cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:28:03.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.291+0000 7fe939649640 1 -- 172.21.15.100:0/380410629 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe93406c890 con 0x7fe93406cee0 2024-09-11T22:28:03.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.292+0000 7fe939649640 1 --2- 172.21.15.100:0/380410629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93406cee0 0x7fe934073dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe934073720 tx=0x7fe92c02a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10f0a5c58a644e9e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:03.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.292+0000 7fe9337fe640 1 -- 172.21.15.100:0/380410629 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92c036070 con 0x7fe93406cee0 2024-09-11T22:28:03.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.292+0000 7fe9337fe640 1 -- 172.21.15.100:0/380410629 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe92c031600 con 0x7fe93406cee0 2024-09-11T22:28:03.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.292+0000 7fe9337fe640 1 -- 172.21.15.100:0/380410629 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92c0319d0 con 0x7fe93406cee0 2024-09-11T22:28:03.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.292+0000 7fe93b0ac640 1 -- 172.21.15.100:0/380410629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93406cee0 msgr2=0x7fe934073dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.292+0000 7fe93b0ac640 1 --2- 172.21.15.100:0/380410629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93406cee0 0x7fe934073dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe934073720 tx=0x7fe92c02a760 comp rx=0 tx=0).stop 2024-09-11T22:28:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.293+0000 7fe93b0ac640 1 -- 172.21.15.100:0/380410629 shutdown_connections 2024-09-11T22:28:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.293+0000 7fe93b0ac640 1 --2- 172.21.15.100:0/380410629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93406cee0 0x7fe934073dc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.293+0000 7fe93b0ac640 1 --2- 172.21.15.100:0/380410629 >> v2:172.21.15.100:3300/0 conn(0x7fe93406c3a0 0x7fe934073880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.293+0000 7fe93b0ac640 1 -- 172.21.15.100:0/380410629 >> 172.21.15.100:0/380410629 conn(0x7fe93406ee80 msgr2=0x7fe934070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.293+0000 7fe93b0ac640 1 -- 172.21.15.100:0/380410629 shutdown_connections 2024-09-11T22:28:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.293+0000 7fe93b0ac640 1 -- 172.21.15.100:0/380410629 wait complete. 2024-09-11T22:28:03.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.294+0000 7fe93b0ac640 1 Processor -- start 2024-09-11T22:28:03.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.294+0000 7fe93b0ac640 1 -- start start 2024-09-11T22:28:03.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.295+0000 7fe93b0ac640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93406c3a0 0x7fe9340c5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:03.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.295+0000 7fe93b0ac640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe93406cee0 0x7fe934154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:03.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.295+0000 7fe93b0ac640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9340b20e0 0x7fe934154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:03.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.295+0000 7fe93b0ac640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe9340b24c0 con 0x7fe9340b20e0 2024-09-11T22:28:03.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.295+0000 7fe939649640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9340b20e0 msgr2=0x7fe934154760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:28:03.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.295+0000 7fe93b0ac640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe9340c7e60 con 0x7fe93406cee0 2024-09-11T22:28:03.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.295+0000 7fe939649640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9340b20e0 0x7fe934154760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:28:03.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.295+0000 7fe93b0ac640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe9340c8140 con 0x7fe93406c3a0 2024-09-11T22:28:03.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.295+0000 7fe938e48640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93406c3a0 0x7fe9340c5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:03.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.295+0000 7fe938e48640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93406c3a0 0x7fe9340c5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45238/0 (socket says 172.21.15.100:45238) 2024-09-11T22:28:03.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.295+0000 7fe938e48640 1 -- 172.21.15.100:0/1342487132 learned_addr learned my addr 172.21.15.100:0/1342487132 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:03.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.295+0000 7fe933fff640 1 --2- 172.21.15.100:0/1342487132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe93406cee0 0x7fe934154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:03.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.296+0000 7fe938e48640 1 -- 172.21.15.100:0/1342487132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe93406cee0 msgr2=0x7fe934154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:03.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.296+0000 7fe938e48640 1 --2- 172.21.15.100:0/1342487132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe93406cee0 0x7fe934154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.296+0000 7fe938e48640 1 -- 172.21.15.100:0/1342487132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9340b20e0 msgr2=0x7fe934154760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:28:03.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.296+0000 7fe938e48640 1 --2- 172.21.15.100:0/1342487132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9340b20e0 0x7fe934154760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.296+0000 7fe938e48640 1 -- 172.21.15.100:0/1342487132 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9340c4670 con 0x7fe93406c3a0 2024-09-11T22:28:03.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.296+0000 7fe938e48640 1 --2- 172.21.15.100:0/1342487132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93406c3a0 0x7fe9340c5320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe92800b580 tx=0x7fe92800ba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:03.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.296+0000 7fe9317fa640 1 -- 172.21.15.100:0/1342487132 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe928003cf0 con 0x7fe93406c3a0 2024-09-11T22:28:03.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.296+0000 7fe9317fa640 1 -- 172.21.15.100:0/1342487132 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe928015070 con 0x7fe93406c3a0 2024-09-11T22:28:03.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.296+0000 7fe93b0ac640 1 -- 172.21.15.100:0/1342487132 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe934152f70 con 0x7fe93406c3a0 2024-09-11T22:28:03.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.296+0000 7fe9317fa640 1 -- 172.21.15.100:0/1342487132 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe928005330 con 0x7fe93406c3a0 2024-09-11T22:28:03.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.296+0000 7fe93b0ac640 1 -- 172.21.15.100:0/1342487132 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe934153530 con 0x7fe93406c3a0 2024-09-11T22:28:03.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.297+0000 7fe93b0ac640 1 --2- 172.21.15.100:0/1342487132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe934153770 0x7fe9341f0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:03.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.297+0000 7fe93b0ac640 1 -- 172.21.15.100:0/1342487132 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe9340c9710 con 0x7fe934153770 2024-09-11T22:28:03.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.297+0000 7fe933fff640 1 --2- 172.21.15.100:0/1342487132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe934153770 0x7fe9341f0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:03.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.298+0000 7fe933fff640 1 -- 172.21.15.100:0/1342487132 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe93406ccc0 con 0x7fe934153770 2024-09-11T22:28:03.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.298+0000 7fe9317fa640 1 -- 172.21.15.100:0/1342487132 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe9280054d0 con 0x7fe93406c3a0 2024-09-11T22:28:03.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.298+0000 7fe933fff640 1 --2- 172.21.15.100:0/1342487132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe934153770 0x7fe9341f0450 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe9340b0ed0 tx=0x7fe9200099b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:03.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.298+0000 7fe9317fa640 1 --2- 172.21.15.100:0/1342487132 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe91806be10 0x7fe91806e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:03.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.298+0000 7fe9317fa640 1 -- 172.21.15.100:0/1342487132 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fe92808af60 con 0x7fe93406c3a0 2024-09-11T22:28:03.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.298+0000 7fe939649640 1 --2- 172.21.15.100:0/1342487132 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe91806be10 0x7fe91806e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:03.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.298+0000 7fe9317fa640 1 -- 172.21.15.100:0/1342487132 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe920016070 con 0x7fe934153770 2024-09-11T22:28:03.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.299+0000 7fe9317fa640 1 -- 172.21.15.100:0/1342487132 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe920005a10 con 0x7fe934153770 2024-09-11T22:28:03.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.299+0000 7fe9317fa640 1 -- 172.21.15.100:0/1342487132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe934153770 msgr2=0x7fe9341f0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:03.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.299+0000 7fe9317fa640 1 --2- 172.21.15.100:0/1342487132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe934153770 0x7fe9341f0450 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe9340b0ed0 tx=0x7fe9200099b0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.299+0000 7fe9317fa640 1 -- 172.21.15.100:0/1342487132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe934153770 msgr2=0x7fe9341f0450 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:28:03.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.299+0000 7fe9317fa640 1 --2- 172.21.15.100:0/1342487132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe934153770 0x7fe9341f0450 secure :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe9340b0ed0 tx=0x7fe9200099b0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.299+0000 7fe939649640 1 --2- 172.21.15.100:0/1342487132 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe91806be10 0x7fe91806e2d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe92c033000 tx=0x7fe92c009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:03.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.306+0000 7fe93b0ac640 1 --2- 172.21.15.100:0/1342487132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9341f0990 0x7fe9341508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:03.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.306+0000 7fe93b0ac640 1 -- 172.21.15.100:0/1342487132 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe934068040 con 0x7fe9341f0990 2024-09-11T22:28:03.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.306+0000 7fe933fff640 1 --2- 172.21.15.100:0/1342487132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9341f0990 0x7fe9341508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:03.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.306+0000 7fe933fff640 1 -- 172.21.15.100:0/1342487132 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe9340c4910 con 0x7fe9341f0990 2024-09-11T22:28:03.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.306+0000 7fe933fff640 1 --2- 172.21.15.100:0/1342487132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9341f0990 0x7fe9341508a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe9340b0ed0 tx=0x7fe9200059a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:03.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.306+0000 7fe9317fa640 1 -- 172.21.15.100:0/1342487132 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe920016050 con 0x7fe9341f0990 2024-09-11T22:28:03.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.307+0000 7fe9317fa640 1 -- 172.21.15.100:0/1342487132 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4878 (secure 0 0 0) 0x7fe92001ab50 con 0x7fe9341f0990 2024-09-11T22:28:03.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.307+0000 7fe9317fa640 1 -- 172.21.15.100:0/1342487132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9341f0990 msgr2=0x7fe9341508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:03.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.307+0000 7fe9317fa640 1 --2- 172.21.15.100:0/1342487132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9341f0990 0x7fe9341508a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe9340b0ed0 tx=0x7fe9200059a0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.307+0000 7fe9317fa640 1 -- 172.21.15.100:0/1342487132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9341f0990 msgr2=0x7fe9341508a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:28:03.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.307+0000 7fe9317fa640 1 --2- 172.21.15.100:0/1342487132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe9341f0990 0x7fe9341508a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.308 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:28:03.308 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:28:03.309 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:28:03.309 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:28:03.309 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 56, 2024-09-11T22:28:03.309 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 268585, 2024-09-11T22:28:03.309 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:28:03.309 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:28:03.309 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:28:03.309 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:03.309 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 2, 2024-09-11T22:28:03.309 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:28:03.309 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:28:03.309 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:28:03.309 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:03.310 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:03.310 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:03.310 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:03.310 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:03.310 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:03.310 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:03.310 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:03.310 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:03.310 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:03.310 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:03.310 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:03.310 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:28:03.310 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:28:03.311 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:03.311 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:03.311 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:03.311 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:03.311 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:03.311 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:03.311 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:03.311 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:03.311 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:03.311 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:03.311 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:03.311 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:03.311 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.311 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:28:03.312 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:28:03.312 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:28:03.312 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:28:03.312 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:28:03.312 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:28:03.312 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:28:03.312 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:28:03.312 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:28:03.312 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:28:03.312 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:28:03.312 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:28:03.312 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:28:03.312 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:28:03.313 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:28:03.313 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:28:03.313 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:28:03.313 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:03.313 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:03.313 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:03.313 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:03.313 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:03.313 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:03.313 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:03.313 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:03.313 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:03.313 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:03.314 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:03.314 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:03.314 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:28:03.314 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.314 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:28:03.314 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.314 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:28:03.314 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:28:03.314 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:03.314 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:03.314 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.314 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:03.314 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:28:03.315 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:03.315 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.315 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.315 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:03.315 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:28:03.315 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:03.315 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:03.315 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:03.315 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.315 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:28:03.315 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:28:03.315 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:03.315 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:03.316 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:03.316 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.316 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.316 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:28:03.316 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:28:03.316 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:03.316 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:03.316 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.316 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:03.316 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:28:03.316 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:03.316 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.316 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.316 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:03.317 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:28:03.317 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:03.317 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:03.317 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:03.317 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.317 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:28:03.317 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:28:03.317 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:03.317 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:03.317 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:03.317 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.317 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.317 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:28:03.318 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:28:03.318 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:03.318 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:03.318 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.318 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:03.318 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:28:03.318 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:03.318 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.318 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.318 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:03.318 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:28:03.318 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:03.318 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:03.318 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:03.319 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.319 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:28:03.319 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:28:03.319 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:03.319 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:03.319 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:03.319 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:03.319 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:03.319 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.319 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:28:03.319 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:28:03.319 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.319 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:03.320 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:03.320 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:28:03.320 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:03.320 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:03.320 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:28:03.320 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.320 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:03.320 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:03.320 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:28:03.320 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:03.320 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:03.320 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:28:03.320 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.321 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:03.321 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:03.321 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:28:03.321 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:03.321 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:03.321 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:28:03.321 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.321 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:03.321 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:03.321 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:28:03.321 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:03.321 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:03.321 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.321 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:28:03.322 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:28:03.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.307+0000 7fe93b0ac640 1 -- 172.21.15.100:0/1342487132 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe91806be10 msgr2=0x7fe91806e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:03.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.307+0000 7fe93b0ac640 1 --2- 172.21.15.100:0/1342487132 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe91806be10 0x7fe91806e2d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe92c033000 tx=0x7fe92c009000 comp rx=0 tx=0).stop 2024-09-11T22:28:03.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.307+0000 7fe93b0ac640 1 -- 172.21.15.100:0/1342487132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93406c3a0 msgr2=0x7fe9340c5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:03.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.307+0000 7fe93b0ac640 1 --2- 172.21.15.100:0/1342487132 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe93406c3a0 0x7fe9340c5320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe92800b580 tx=0x7fe92800ba40 comp rx=0 tx=0).stop 2024-09-11T22:28:03.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.307+0000 7fe939649640 1 -- 172.21.15.100:0/1342487132 reap_dead start 2024-09-11T22:28:03.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.307+0000 7fe939649640 1 -- 172.21.15.100:0/1342487132 reap_dead start 2024-09-11T22:28:03.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.307+0000 7fe93b0ac640 1 -- 172.21.15.100:0/1342487132 shutdown_connections 2024-09-11T22:28:03.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.307+0000 7fe93b0ac640 1 -- 172.21.15.100:0/1342487132 >> 172.21.15.100:0/1342487132 conn(0x7fe93406ee80 msgr2=0x7fe93415e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:03.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.307+0000 7fe93b0ac640 1 -- 172.21.15.100:0/1342487132 shutdown_connections 2024-09-11T22:28:03.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.307+0000 7fe93b0ac640 1 -- 172.21.15.100:0/1342487132 wait complete. 2024-09-11T22:28:03.324 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:28:03.324 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-11T22:28:03.324 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:28:03.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.436+0000 7f57971b0640 1 Processor -- start 2024-09-11T22:28:03.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.436+0000 7f57971b0640 1 -- start start 2024-09-11T22:28:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.437+0000 7f57971b0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5790154c60 0x7f57900d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.437+0000 7f57971b0640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f579015eaf0 0x7f57900d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.437+0000 7f57971b0640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f579015ac20 con 0x7f5790155040 2024-09-11T22:28:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.437+0000 7f57971b0640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f579015bad0 con 0x7f579015eaf0 2024-09-11T22:28:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.437+0000 7f57971b0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f579015aec0 con 0x7f5790154c60 2024-09-11T22:28:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.437+0000 7f578ffff640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f5790155040 legacy=0x7f579015e3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:28:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.437+0000 7f579574d640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f579015eaf0 msgr2=0x7f57900d08b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:28:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.437+0000 7f579574d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f579015eaf0 0x7f57900d08b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:28:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.437+0000 7f5794f4c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5790154c60 0x7f57900d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.437+0000 7f5794f4c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5790154c60 0x7f57900d0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:60720/0 (socket says 172.21.15.100:60720) 2024-09-11T22:28:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.437+0000 7f5794f4c640 1 -- 172.21.15.100:0/251874623 learned_addr learned my addr 172.21.15.100:0/251874623 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:03.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.437+0000 7f5794f4c640 1 -- 172.21.15.100:0/251874623 >> v2:172.21.15.100:3300/0 conn(0x7f579015eaf0 msgr2=0x7f57900d08b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:28:03.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.437+0000 7f5794f4c640 1 --2- 172.21.15.100:0/251874623 >> v2:172.21.15.100:3300/0 conn(0x7f579015eaf0 0x7f57900d08b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.437+0000 7f5794f4c640 1 -- 172.21.15.100:0/251874623 >> v1:172.21.15.100:6789/0 conn(0x7f5790155040 legacy=0x7f579015e3e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:28:03.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.437+0000 7f5794f4c640 1 -- 172.21.15.100:0/251874623 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579015b1a0 con 0x7f5790154c60 2024-09-11T22:28:03.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.438+0000 7f5794f4c640 1 --2- 172.21.15.100:0/251874623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5790154c60 0x7f57900d0370 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f57901586e0 tx=0x7f578402a2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43140a64a51db9f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:03.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.438+0000 7f578f7fe640 1 -- 172.21.15.100:0/251874623 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784037070 con 0x7f5790154c60 2024-09-11T22:28:03.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.438+0000 7f578f7fe640 1 -- 172.21.15.100:0/251874623 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5784032440 con 0x7f5790154c60 2024-09-11T22:28:03.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.438+0000 7f578f7fe640 1 -- 172.21.15.100:0/251874623 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784032810 con 0x7f5790154c60 2024-09-11T22:28:03.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.439+0000 7f57971b0640 1 -- 172.21.15.100:0/251874623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5790154c60 msgr2=0x7f57900d0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:03.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.439+0000 7f57971b0640 1 --2- 172.21.15.100:0/251874623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5790154c60 0x7f57900d0370 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f57901586e0 tx=0x7f578402a2e0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.439+0000 7f57971b0640 1 -- 172.21.15.100:0/251874623 shutdown_connections 2024-09-11T22:28:03.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.439+0000 7f57971b0640 1 --2- 172.21.15.100:0/251874623 >> v2:172.21.15.100:3300/0 conn(0x7f579015eaf0 0x7f57900d08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.439+0000 7f57971b0640 1 --2- 172.21.15.100:0/251874623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5790154c60 0x7f57900d0370 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.439+0000 7f57971b0640 1 -- 172.21.15.100:0/251874623 >> 172.21.15.100:0/251874623 conn(0x7f579006d060 msgr2=0x7f579006d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:03.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.439+0000 7f57971b0640 1 -- 172.21.15.100:0/251874623 shutdown_connections 2024-09-11T22:28:03.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.439+0000 7f57971b0640 1 -- 172.21.15.100:0/251874623 wait complete. 2024-09-11T22:28:03.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.440+0000 7f57971b0640 1 Processor -- start 2024-09-11T22:28:03.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.440+0000 7f57971b0640 1 -- start start 2024-09-11T22:28:03.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.441+0000 7f57971b0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5790154c60 0x7f57901f0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:03.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.441+0000 7f57971b0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5790155040 0x7f57901e6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:03.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.441+0000 7f57971b0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f579015eaf0 0x7f57900cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:03.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.441+0000 7f5794f4c640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5790154c60 msgr2=0x7f57901f0590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:28:03.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.441+0000 7f5794f4c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5790154c60 0x7f57901f0590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:28:03.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.441+0000 7f57971b0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f57900c5e10 con 0x7f5790154c60 2024-09-11T22:28:03.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.441+0000 7f57971b0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f579015b760 con 0x7f5790155040 2024-09-11T22:28:03.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.441+0000 7f57971b0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f57900c5f90 con 0x7f579015eaf0 2024-09-11T22:28:03.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.441+0000 7f578ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5790155040 0x7f57901e6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:03.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.441+0000 7f579574d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f579015eaf0 0x7f57900cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:03.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.441+0000 7f578ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5790155040 0x7f57901e6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:60736/0 (socket says 172.21.15.100:60736) 2024-09-11T22:28:03.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.441+0000 7f579574d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f579015eaf0 0x7f57900cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45244/0 (socket says 172.21.15.100:45244) 2024-09-11T22:28:03.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.441+0000 7f578ffff640 1 -- 172.21.15.100:0/4099679869 learned_addr learned my addr 172.21.15.100:0/4099679869 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:03.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.441+0000 7f578ffff640 1 -- 172.21.15.100:0/4099679869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f579015eaf0 msgr2=0x7f57900cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:03.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.441+0000 7f578ffff640 1 --2- 172.21.15.100:0/4099679869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f579015eaf0 0x7f57900cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.441+0000 7f578ffff640 1 -- 172.21.15.100:0/4099679869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5790154c60 msgr2=0x7f57901f0590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:28:03.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.441+0000 7f578ffff640 1 --2- 172.21.15.100:0/4099679869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5790154c60 0x7f57901f0590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.441+0000 7f578ffff640 1 -- 172.21.15.100:0/4099679869 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579015c880 con 0x7f5790155040 2024-09-11T22:28:03.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.442+0000 7f578ffff640 1 --2- 172.21.15.100:0/4099679869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5790155040 0x7f57901e6110 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f577c00b550 tx=0x7f577c00ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:03.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.442+0000 7f578d7fa640 1 -- 172.21.15.100:0/4099679869 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577c003dc0 con 0x7f5790155040 2024-09-11T22:28:03.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.442+0000 7f578d7fa640 1 -- 172.21.15.100:0/4099679869 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f577c015070 con 0x7f5790155040 2024-09-11T22:28:03.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.442+0000 7f57971b0640 1 -- 172.21.15.100:0/4099679869 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57901f3d50 con 0x7f5790155040 2024-09-11T22:28:03.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.442+0000 7f578d7fa640 1 -- 172.21.15.100:0/4099679869 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577c0052b0 con 0x7f5790155040 2024-09-11T22:28:03.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.442+0000 7f57971b0640 1 -- 172.21.15.100:0/4099679869 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57900cc310 con 0x7f5790155040 2024-09-11T22:28:03.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.443+0000 7f57971b0640 1 --2- 172.21.15.100:0/4099679869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57901f4810 0x7f57900cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:03.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.443+0000 7f57971b0640 1 -- 172.21.15.100:0/4099679869 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5790074290 con 0x7f57901f4810 2024-09-11T22:28:03.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.443+0000 7f5794f4c640 1 --2- 172.21.15.100:0/4099679869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57901f4810 0x7f57900cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:03.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.443+0000 7f578d7fa640 1 -- 172.21.15.100:0/4099679869 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f577c005450 con 0x7f5790155040 2024-09-11T22:28:03.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.444+0000 7f5794f4c640 1 -- 172.21.15.100:0/4099679869 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f579015e3c0 con 0x7f57901f4810 2024-09-11T22:28:03.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.444+0000 7f5794f4c640 1 --2- 172.21.15.100:0/4099679869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57901f4810 0x7f57900cfc60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f579015f220 tx=0x7f57840046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:03.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.444+0000 7f578d7fa640 1 --2- 172.21.15.100:0/4099679869 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f577406be10 0x7f577406e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:03.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.444+0000 7f578d7fa640 1 -- 172.21.15.100:0/4099679869 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f577c08af30 con 0x7f5790155040 2024-09-11T22:28:03.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.444+0000 7f579574d640 1 --2- 172.21.15.100:0/4099679869 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f577406be10 0x7f577406e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:03.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.444+0000 7f578d7fa640 1 -- 172.21.15.100:0/4099679869 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784037040 con 0x7f57901f4810 2024-09-11T22:28:03.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.444+0000 7f578d7fa640 1 -- 172.21.15.100:0/4099679869 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5784004030 con 0x7f57901f4810 2024-09-11T22:28:03.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.444+0000 7f578d7fa640 1 -- 172.21.15.100:0/4099679869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57901f4810 msgr2=0x7f57900cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:03.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.444+0000 7f578d7fa640 1 --2- 172.21.15.100:0/4099679869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57901f4810 0x7f57900cfc60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f579015f220 tx=0x7f57840046c0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.444+0000 7f578d7fa640 1 -- 172.21.15.100:0/4099679869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57901f4810 msgr2=0x7f57900cfc60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:28:03.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.444+0000 7f578d7fa640 1 --2- 172.21.15.100:0/4099679869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57901f4810 0x7f57900cfc60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.445+0000 7f579574d640 1 --2- 172.21.15.100:0/4099679869 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f577406be10 0x7f577406e2d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f579015dfa0 tx=0x7f578800d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:03.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.451+0000 7f57971b0640 1 --2- 172.21.15.100:0/4099679869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57901e6650 0x7f579015d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:03.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.451+0000 7f57971b0640 1 -- 172.21.15.100:0/4099679869 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f57900c6470 con 0x7f57901e6650 2024-09-11T22:28:03.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.452+0000 7f5794f4c640 1 --2- 172.21.15.100:0/4099679869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57901e6650 0x7f579015d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:03.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.452+0000 7f5794f4c640 1 -- 172.21.15.100:0/4099679869 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f57901f3b00 con 0x7f57901e6650 2024-09-11T22:28:03.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.452+0000 7f5794f4c640 1 --2- 172.21.15.100:0/4099679869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57901e6650 0x7f579015d0a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5784000c00 tx=0x7f5784009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:03.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.452+0000 7f578d7fa640 1 -- 172.21.15.100:0/4099679869 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784037040 con 0x7f57901e6650 2024-09-11T22:28:03.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.452+0000 7f578d7fa640 1 -- 172.21.15.100:0/4099679869 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5043 (secure 0 0 0) 0x7f578404c070 con 0x7f57901e6650 2024-09-11T22:28:03.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.452+0000 7f578d7fa640 1 -- 172.21.15.100:0/4099679869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57901e6650 msgr2=0x7f579015d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:03.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.452+0000 7f578d7fa640 1 --2- 172.21.15.100:0/4099679869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57901e6650 0x7f579015d0a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5784000c00 tx=0x7f5784009240 comp rx=0 tx=0).stop 2024-09-11T22:28:03.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.452+0000 7f578d7fa640 1 -- 172.21.15.100:0/4099679869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57901e6650 msgr2=0x7f579015d0a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:28:03.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.453+0000 7f578d7fa640 1 --2- 172.21.15.100:0/4099679869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57901e6650 0x7f579015d0a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:03.455 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:28:03.455 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:28:03.455 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:28:03.455 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:28:03.455 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 56, 2024-09-11T22:28:03.455 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 374174, 2024-09-11T22:28:03.455 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:28:03.456 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:28:03.456 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:28:03.456 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:03.456 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 2, 2024-09-11T22:28:03.456 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:28:03.456 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:28:03.456 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:28:03.456 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:03.456 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:03.456 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:03.456 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:03.456 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:03.457 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:03.457 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:03.457 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:03.457 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:03.457 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:03.457 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:03.457 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:03.457 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:28:03.457 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:28:03.457 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:03.457 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:03.458 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:03.458 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:03.458 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:03.458 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:03.458 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:03.458 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:03.458 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:03.458 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:03.458 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:03.458 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:03.458 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.458 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:28:03.459 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:28:03.459 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:28:03.459 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:28:03.459 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:28:03.459 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:28:03.459 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:28:03.459 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:28:03.459 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:28:03.459 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:28:03.459 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:28:03.459 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:28:03.459 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:28:03.460 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:28:03.460 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:28:03.460 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:28:03.460 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:28:03.460 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:03.460 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:03.460 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:03.460 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:03.460 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:03.460 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:03.460 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:03.460 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:03.461 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:03.461 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:03.461 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:03.461 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:03.461 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:28:03.461 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.461 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:28:03.461 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.461 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:28:03.461 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:28:03.461 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:03.462 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:03.462 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.462 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:03.462 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:28:03.462 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:03.462 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.462 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.462 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:03.462 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:28:03.462 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:03.462 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:03.462 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:03.463 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.463 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:28:03.463 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:28:03.463 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:03.463 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:03.463 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:03.463 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.463 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.463 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:28:03.463 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:28:03.464 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:03.464 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:03.464 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.464 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:03.464 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:28:03.464 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:03.464 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.464 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.464 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:03.464 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:28:03.464 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:03.465 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:03.465 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:03.465 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.465 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:28:03.465 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:28:03.465 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:03.465 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:03.465 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:03.465 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.465 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.465 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:28:03.466 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:28:03.466 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:03.466 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:03.466 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.466 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:03.466 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:28:03.466 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:03.466 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.466 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.466 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:03.466 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:28:03.466 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:03.467 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:03.467 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:03.467 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.467 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:28:03.467 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:28:03.467 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:03.467 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:03.467 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:03.467 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:03.467 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:03.467 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.468 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:28:03.468 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:28:03.468 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.468 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:03.468 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:03.468 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:28:03.468 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:03.468 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:03.468 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:28:03.468 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.468 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:03.469 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:03.469 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:28:03.469 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:03.469 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:03.469 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:28:03.469 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.469 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:03.469 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:03.469 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:28:03.469 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:03.469 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:03.470 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:28:03.470 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.470 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:03.470 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:03.470 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:28:03.470 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:03.470 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:03.470 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:28:03.470 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:03.470 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:03.470 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:03.470 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:28:03.471 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:03.471 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:03.471 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:03.471 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:28:03.471 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:28:03.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.453+0000 7f57971b0640 1 -- 172.21.15.100:0/4099679869 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f577406be10 msgr2=0x7f577406e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:03.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.453+0000 7f57971b0640 1 --2- 172.21.15.100:0/4099679869 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f577406be10 0x7f577406e2d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f579015dfa0 tx=0x7f578800d040 comp rx=0 tx=0).stop 2024-09-11T22:28:03.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.453+0000 7f57971b0640 1 -- 172.21.15.100:0/4099679869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5790155040 msgr2=0x7f57901e6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:03.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.453+0000 7f57971b0640 1 --2- 172.21.15.100:0/4099679869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5790155040 0x7f57901e6110 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f577c00b550 tx=0x7f577c00ba10 comp rx=0 tx=0).stop 2024-09-11T22:28:03.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.453+0000 7f579574d640 1 -- 172.21.15.100:0/4099679869 reap_dead start 2024-09-11T22:28:03.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.453+0000 7f579574d640 1 -- 172.21.15.100:0/4099679869 reap_dead start 2024-09-11T22:28:03.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.453+0000 7f57971b0640 1 -- 172.21.15.100:0/4099679869 shutdown_connections 2024-09-11T22:28:03.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.453+0000 7f57971b0640 1 -- 172.21.15.100:0/4099679869 >> 172.21.15.100:0/4099679869 conn(0x7f579006d060 msgr2=0x7f57900cb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:03.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.453+0000 7f57971b0640 1 -- 172.21.15.100:0/4099679869 shutdown_connections 2024-09-11T22:28:03.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:03.453+0000 7f57971b0640 1 -- 172.21.15.100:0/4099679869 wait complete. 2024-09-11T22:28:03.473 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:28:03.473 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-11T22:28:20.864 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:28:20.867 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:28:23.474 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:28:23.475 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-11T22:28:23.475 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T22:28:23.475 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T22:28:23.477 INFO:tasks.ceph.mon.a:Started 2024-09-11T22:28:23.477 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:28:23.478 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:28:23.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.590+0000 7f47c253b640 1 Processor -- start 2024-09-11T22:28:23.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.590+0000 7f47c253b640 1 -- start start 2024-09-11T22:28:23.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.591+0000 7f47c253b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f47bc0c2d00 0x7f47bc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:23.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.591+0000 7f47c253b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f47bc06c1f0 0x7f47bc15aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:23.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.591+0000 7f47c253b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47bc06c860 con 0x7f47bc151640 2024-09-11T22:28:23.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.591+0000 7f47c253b640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f47bc06ce70 con 0x7f47bc06c1f0 2024-09-11T22:28:23.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.591+0000 7f47c253b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f47bc0ca390 con 0x7f47bc0c2d00 2024-09-11T22:28:23.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.591+0000 7f47c0ad8640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f47bc06c1f0 0x7f47bc15aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:23.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.591+0000 7f47c0ad8640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f47bc06c1f0 0x7f47bc15aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43768/0 (socket says 172.21.15.100:43768) 2024-09-11T22:28:23.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.591+0000 7f47c0ad8640 1 -- 172.21.15.100:0/2568609584 learned_addr learned my addr 172.21.15.100:0/2568609584 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:23.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.591+0000 7f47bb7fe640 1 --2- 172.21.15.100:0/2568609584 >> v2:172.21.15.167:3300/0 conn(0x7f47bc0c2d00 0x7f47bc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:23.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.591+0000 7f47c0ad8640 1 -- 172.21.15.100:0/2568609584 >> v2:172.21.15.100:3300/0 conn(0x7f47bc06c1f0 msgr2=0x7f47bc15aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:28:23.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.591+0000 7f47c0ad8640 1 -- 172.21.15.100:0/2568609584 >> v2:172.21.15.100:3300/0 conn(0x7f47bc06c1f0 msgr2=0x7f47bc15aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:28:23.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.591+0000 7f47c0ad8640 1 --2- 172.21.15.100:0/2568609584 >> v2:172.21.15.100:3300/0 conn(0x7f47bc06c1f0 0x7f47bc15aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:28:23.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.591+0000 7f47c0ad8640 1 --2- 172.21.15.100:0/2568609584 >> v2:172.21.15.100:3300/0 conn(0x7f47bc06c1f0 0x7f47bc15aa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:28:23.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.591+0000 7f47baffd640 1 -- 172.21.15.100:0/2568609584 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 558208069 0 0) 0x7f47bc06c860 con 0x7f47bc151640 2024-09-11T22:28:23.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.591+0000 7f47baffd640 1 -- 172.21.15.100:0/2568609584 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47a4003520 con 0x7f47bc151640 2024-09-11T22:28:23.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.592+0000 7f47bb7fe640 1 -- 172.21.15.100:0/2568609584 >> v2:172.21.15.100:3300/0 conn(0x7f47bc06c1f0 msgr2=0x7f47bc15aa30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:28:23.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.592+0000 7f47bb7fe640 1 --2- 172.21.15.100:0/2568609584 >> v2:172.21.15.100:3300/0 conn(0x7f47bc06c1f0 0x7f47bc15aa30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.592+0000 7f47bb7fe640 1 -- 172.21.15.100:0/2568609584 >> v1:172.21.15.167:6789/0 conn(0x7f47bc151640 legacy=0x7f47bc06d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:23.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.592+0000 7f47bb7fe640 1 -- 172.21.15.100:0/2568609584 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47bc0c8d90 con 0x7f47bc0c2d00 2024-09-11T22:28:23.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.592+0000 7f47bb7fe640 1 --2- 172.21.15.100:0/2568609584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47bc0c2d00 0x7f47bc06bc10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f47bc06ca30 tx=0x7f47b002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=879f7a354fa4c8fa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:23.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.593+0000 7f47baffd640 1 -- 172.21.15.100:0/2568609584 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0037070 con 0x7f47bc0c2d00 2024-09-11T22:28:23.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.593+0000 7f47baffd640 1 -- 172.21.15.100:0/2568609584 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b0032440 con 0x7f47bc0c2d00 2024-09-11T22:28:23.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.593+0000 7f47baffd640 1 -- 172.21.15.100:0/2568609584 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b002ae60 con 0x7f47bc0c2d00 2024-09-11T22:28:23.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.593+0000 7f47c253b640 1 -- 172.21.15.100:0/2568609584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47bc0c2d00 msgr2=0x7f47bc06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:23.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.593+0000 7f47c253b640 1 --2- 172.21.15.100:0/2568609584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47bc0c2d00 0x7f47bc06bc10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f47bc06ca30 tx=0x7f47b002a110 comp rx=0 tx=0).stop 2024-09-11T22:28:23.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.593+0000 7f47c253b640 1 -- 172.21.15.100:0/2568609584 shutdown_connections 2024-09-11T22:28:23.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.593+0000 7f47c253b640 1 --2- 172.21.15.100:0/2568609584 >> v2:172.21.15.100:3300/0 conn(0x7f47bc06c1f0 0x7f47bc15aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.593+0000 7f47c253b640 1 --2- 172.21.15.100:0/2568609584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47bc0c2d00 0x7f47bc06bc10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.593+0000 7f47c253b640 1 -- 172.21.15.100:0/2568609584 >> 172.21.15.100:0/2568609584 conn(0x7f47bc0cd620 msgr2=0x7f47bc0c9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:23.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.593+0000 7f47c253b640 1 -- 172.21.15.100:0/2568609584 shutdown_connections 2024-09-11T22:28:23.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.593+0000 7f47c253b640 1 -- 172.21.15.100:0/2568609584 wait complete. 2024-09-11T22:28:23.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.595+0000 7f47c253b640 1 Processor -- start 2024-09-11T22:28:23.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.595+0000 7f47c253b640 1 -- start start 2024-09-11T22:28:23.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.596+0000 7f47c253b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47bc06c1f0 0x7f47bc14b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:23.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.596+0000 7f47c253b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47bc0c2d00 0x7f47bc0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:23.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.596+0000 7f47c253b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc151640 0x7f47bc14d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:23.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.596+0000 7f47c253b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc151a20 con 0x7f47bc151640 2024-09-11T22:28:23.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.596+0000 7f47c253b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f47bc06cb00 con 0x7f47bc0c2d00 2024-09-11T22:28:23.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.596+0000 7f47c253b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f47bc151ba0 con 0x7f47bc06c1f0 2024-09-11T22:28:23.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.597+0000 7f47bbfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47bc06c1f0 0x7f47bc14b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:23.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.597+0000 7f47bb7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47bc0c2d00 0x7f47bc0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:23.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.597+0000 7f47bbfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47bc06c1f0 0x7f47bc14b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:33888/0 (socket says 172.21.15.100:33888) 2024-09-11T22:28:23.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.597+0000 7f47bbfff640 1 -- 172.21.15.100:0/47959773 learned_addr learned my addr 172.21.15.100:0/47959773 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:23.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.597+0000 7f47c0ad8640 1 --2- 172.21.15.100:0/47959773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc151640 0x7f47bc14d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:23.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.597+0000 7f47c0ad8640 1 -- 172.21.15.100:0/47959773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc151640 msgr2=0x7f47bc14d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-11T22:28:23.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.597+0000 7f47c0ad8640 1 -- 172.21.15.100:0/47959773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc151640 msgr2=0x7f47bc14d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:28:23.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.597+0000 7f47c0ad8640 1 --2- 172.21.15.100:0/47959773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc151640 0x7f47bc14d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:28:23.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.597+0000 7f47c0ad8640 1 --2- 172.21.15.100:0/47959773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc151640 0x7f47bc14d740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:28:23.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.597+0000 7f47bb7fe640 1 -- 172.21.15.100:0/47959773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47bc06c1f0 msgr2=0x7f47bc14b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:23.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.597+0000 7f47bb7fe640 1 --2- 172.21.15.100:0/47959773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47bc06c1f0 0x7f47bc14b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.597+0000 7f47bb7fe640 1 -- 172.21.15.100:0/47959773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc151640 msgr2=0x7f47bc14d740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:28:23.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.597+0000 7f47bb7fe640 1 --2- 172.21.15.100:0/47959773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc151640 0x7f47bc14d740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.597+0000 7f47bb7fe640 1 -- 172.21.15.100:0/47959773 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47bc14e7d0 con 0x7f47bc0c2d00 2024-09-11T22:28:23.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.597+0000 7f47bbfff640 1 --2- 172.21.15.100:0/47959773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47bc06c1f0 0x7f47bc14b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:23.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.597+0000 7f47bb7fe640 1 --2- 172.21.15.100:0/47959773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47bc0c2d00 0x7f47bc0c8110 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f47b0031000 tx=0x7f47b00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:23.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.597+0000 7f47b8ff9640 1 -- 172.21.15.100:0/47959773 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0041030 con 0x7f47bc0c2d00 2024-09-11T22:28:23.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.597+0000 7f47b8ff9640 1 -- 172.21.15.100:0/47959773 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b003d420 con 0x7f47bc0c2d00 2024-09-11T22:28:23.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.597+0000 7f47b8ff9640 1 -- 172.21.15.100:0/47959773 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0037040 con 0x7f47bc0c2d00 2024-09-11T22:28:23.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.597+0000 7f47c253b640 1 -- 172.21.15.100:0/47959773 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47bc14be20 con 0x7f47bc0c2d00 2024-09-11T22:28:23.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.598+0000 7f47c253b640 1 -- 172.21.15.100:0/47959773 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47bc1418d0 con 0x7f47bc0c2d00 2024-09-11T22:28:23.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.599+0000 7f47c253b640 1 -- 172.21.15.100:0/47959773 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47bc06bc10 con 0x7f47bc0c2d00 2024-09-11T22:28:23.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.599+0000 7f47b8ff9640 1 -- 172.21.15.100:0/47959773 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47b0044070 con 0x7f47bc0c2d00 2024-09-11T22:28:23.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.600+0000 7f47b8ff9640 1 --2- 172.21.15.100:0/47959773 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f47a806be60 0x7f47a806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:23.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.600+0000 7f47b8ff9640 1 -- 172.21.15.100:0/47959773 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f47b00ab800 con 0x7f47bc0c2d00 2024-09-11T22:28:23.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.600+0000 7f47bbfff640 1 --2- 172.21.15.100:0/47959773 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f47a806be60 0x7f47a806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:23.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.600+0000 7f47bbfff640 1 --2- 172.21.15.100:0/47959773 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f47a806be60 0x7f47a806e320 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f47ac007fd0 tx=0x7f47ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:23.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.604+0000 7f47b8ff9640 1 -- 172.21.15.100:0/47959773 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f47b0079da0 con 0x7f47bc0c2d00 2024-09-11T22:28:23.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.879+0000 7f47c253b640 1 -- 172.21.15.100:0/47959773 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f47bc068650 con 0x7f47bc0c2d00 2024-09-11T22:28:23.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.880+0000 7f47b8ff9640 1 -- 172.21.15.100:0/47959773 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f47b00796a0 con 0x7f47bc0c2d00 2024-09-11T22:28:23.881 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":56,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:28:23.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.882+0000 7f47c253b640 1 -- 172.21.15.100:0/47959773 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f47a806be60 msgr2=0x7f47a806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:23.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.882+0000 7f47c253b640 1 --2- 172.21.15.100:0/47959773 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f47a806be60 0x7f47a806e320 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f47ac007fd0 tx=0x7f47ac009040 comp rx=0 tx=0).stop 2024-09-11T22:28:23.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.882+0000 7f47c253b640 1 -- 172.21.15.100:0/47959773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47bc0c2d00 msgr2=0x7f47bc0c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:23.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.882+0000 7f47c253b640 1 --2- 172.21.15.100:0/47959773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47bc0c2d00 0x7f47bc0c8110 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f47b0031000 tx=0x7f47b00046c0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.882+0000 7f47c253b640 1 -- 172.21.15.100:0/47959773 shutdown_connections 2024-09-11T22:28:23.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.882+0000 7f47c253b640 1 --2- 172.21.15.100:0/47959773 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f47a806be60 0x7f47a806e320 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.882+0000 7f47c253b640 1 --2- 172.21.15.100:0/47959773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47bc151640 0x7f47bc14d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.882+0000 7f47c253b640 1 --2- 172.21.15.100:0/47959773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47bc0c2d00 0x7f47bc0c8110 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.882+0000 7f47c253b640 1 --2- 172.21.15.100:0/47959773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47bc06c1f0 0x7f47bc14b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:23.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.882+0000 7f47c253b640 1 -- 172.21.15.100:0/47959773 >> 172.21.15.100:0/47959773 conn(0x7f47bc0cd620 msgr2=0x7f47bc06d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:23.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.882+0000 7f47c253b640 1 -- 172.21.15.100:0/47959773 shutdown_connections 2024-09-11T22:28:23.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:23.882+0000 7f47c253b640 1 -- 172.21.15.100:0/47959773 wait complete. 2024-09-11T22:28:26.897 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:28:27.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.008+0000 7ff1bef66640 1 Processor -- start 2024-09-11T22:28:27.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.008+0000 7ff1bef66640 1 -- start start 2024-09-11T22:28:27.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.009+0000 7ff1bef66640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1b8154c20 0x7ff1b80cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:27.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.009+0000 7ff1bef66640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff1b815a7e0 0x7ff1b80cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:27.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.009+0000 7ff1bef66640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1b815ac90 con 0x7ff1b80b3190 2024-09-11T22:28:27.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.009+0000 7ff1bef66640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7ff1b815e000 con 0x7ff1b815a7e0 2024-09-11T22:28:27.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.009+0000 7ff1bef66640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b815af70 con 0x7ff1b8154c20 2024-09-11T22:28:27.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.009+0000 7ff1bd503640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff1b815a7e0 0x7ff1b80cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:27.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.009+0000 7ff1bd503640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff1b815a7e0 0x7ff1b80cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43792/0 (socket says 172.21.15.100:43792) 2024-09-11T22:28:27.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.009+0000 7ff1bd503640 1 -- 172.21.15.100:0/426230533 learned_addr learned my addr 172.21.15.100:0/426230533 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:27.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.009+0000 7ff1bcd02640 1 --2- 172.21.15.100:0/426230533 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1b8154c20 0x7ff1b80cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:27.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.009+0000 7ff1bd503640 1 -- 172.21.15.100:0/426230533 >> v2:172.21.15.100:3300/0 conn(0x7ff1b815a7e0 msgr2=0x7ff1b80cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:28:27.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.009+0000 7ff1bd503640 1 -- 172.21.15.100:0/426230533 >> v2:172.21.15.100:3300/0 conn(0x7ff1b815a7e0 msgr2=0x7ff1b80cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:28:27.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.009+0000 7ff1bd503640 1 --2- 172.21.15.100:0/426230533 >> v2:172.21.15.100:3300/0 conn(0x7ff1b815a7e0 0x7ff1b80cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:28:27.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.009+0000 7ff1bd503640 1 --2- 172.21.15.100:0/426230533 >> v2:172.21.15.100:3300/0 conn(0x7ff1b815a7e0 0x7ff1b80cbd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:28:27.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.010+0000 7ff1bcd02640 1 -- 172.21.15.100:0/426230533 >> v2:172.21.15.100:3300/0 conn(0x7ff1b815a7e0 msgr2=0x7ff1b80cbd10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:28:27.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.010+0000 7ff1bcd02640 1 --2- 172.21.15.100:0/426230533 >> v2:172.21.15.100:3300/0 conn(0x7ff1b815a7e0 0x7ff1b80cbd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:27.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.010+0000 7ff1bcd02640 1 -- 172.21.15.100:0/426230533 >> v1:172.21.15.167:6789/0 conn(0x7ff1b80b3190 legacy=0x7ff1b815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:27.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.010+0000 7ff1b77fe640 1 -- 172.21.15.100:0/426230533 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1298998893 0 0) 0x7ff1b815ac90 con 0x7ff1b80b3190 2024-09-11T22:28:27.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.010+0000 7ff1bcd02640 1 -- 172.21.15.100:0/426230533 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b815b250 con 0x7ff1b8154c20 2024-09-11T22:28:27.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.010+0000 7ff1bcd02640 1 --2- 172.21.15.100:0/426230533 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1b8154c20 0x7ff1b80cb120 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0097a0 tx=0x7ff1ac02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1447011ab2177942 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:27.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.011+0000 7ff1b77fe640 1 -- 172.21.15.100:0/426230533 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac037070 con 0x7ff1b8154c20 2024-09-11T22:28:27.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.011+0000 7ff1b77fe640 1 -- 172.21.15.100:0/426230533 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1ac032440 con 0x7ff1b8154c20 2024-09-11T22:28:27.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.011+0000 7ff1b77fe640 1 -- 172.21.15.100:0/426230533 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac032810 con 0x7ff1b8154c20 2024-09-11T22:28:27.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.011+0000 7ff1bef66640 1 -- 172.21.15.100:0/426230533 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1b8154c20 msgr2=0x7ff1b80cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:27.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.011+0000 7ff1bef66640 1 --2- 172.21.15.100:0/426230533 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1b8154c20 0x7ff1b80cb120 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac0097a0 tx=0x7ff1ac02a180 comp rx=0 tx=0).stop 2024-09-11T22:28:27.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.011+0000 7ff1bef66640 1 -- 172.21.15.100:0/426230533 shutdown_connections 2024-09-11T22:28:27.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.011+0000 7ff1bef66640 1 --2- 172.21.15.100:0/426230533 >> v2:172.21.15.100:3300/0 conn(0x7ff1b815a7e0 0x7ff1b80cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:27.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.011+0000 7ff1bef66640 1 --2- 172.21.15.100:0/426230533 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1b8154c20 0x7ff1b80cb120 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:27.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.011+0000 7ff1bef66640 1 -- 172.21.15.100:0/426230533 >> 172.21.15.100:0/426230533 conn(0x7ff1b8067d40 msgr2=0x7ff1b806d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:27.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.011+0000 7ff1bef66640 1 -- 172.21.15.100:0/426230533 shutdown_connections 2024-09-11T22:28:27.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.011+0000 7ff1bef66640 1 -- 172.21.15.100:0/426230533 wait complete. 2024-09-11T22:28:27.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.012+0000 7ff1bef66640 1 Processor -- start 2024-09-11T22:28:27.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.013+0000 7ff1bef66640 1 -- start start 2024-09-11T22:28:27.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.014+0000 7ff1bef66640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1b80b3190 0x7ff1b81556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:27.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.014+0000 7ff1bef66640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1b8154c20 0x7ff1b81564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:27.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.014+0000 7ff1bef66640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1b815a7e0 0x7ff1b814aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:27.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.014+0000 7ff1bef66640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b815ed20 con 0x7ff1b815a7e0 2024-09-11T22:28:27.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.014+0000 7ff1bef66640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b815eba0 con 0x7ff1b8154c20 2024-09-11T22:28:27.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.014+0000 7ff1bef66640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b80cb660 con 0x7ff1b80b3190 2024-09-11T22:28:27.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.014+0000 7ff1bd503640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1b815a7e0 0x7ff1b814aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:27.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.014+0000 7ff1bd503640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1b815a7e0 0x7ff1b814aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43806/0 (socket says 172.21.15.100:43806) 2024-09-11T22:28:27.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.014+0000 7ff1bd503640 1 -- 172.21.15.100:0/3805816256 learned_addr learned my addr 172.21.15.100:0/3805816256 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:27.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.014+0000 7ff1bcd02640 1 --2- 172.21.15.100:0/3805816256 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1b80b3190 0x7ff1b81556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:27.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.014+0000 7ff1b7fff640 1 --2- 172.21.15.100:0/3805816256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1b8154c20 0x7ff1b81564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:27.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.014+0000 7ff1bd503640 1 -- 172.21.15.100:0/3805816256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1b815a7e0 msgr2=0x7ff1b814aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-11T22:28:27.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.014+0000 7ff1bd503640 1 -- 172.21.15.100:0/3805816256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1b815a7e0 msgr2=0x7ff1b814aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:28:27.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.014+0000 7ff1bd503640 1 --2- 172.21.15.100:0/3805816256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1b815a7e0 0x7ff1b814aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:28:27.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.014+0000 7ff1bd503640 1 --2- 172.21.15.100:0/3805816256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1b815a7e0 0x7ff1b814aa10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:28:27.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.014+0000 7ff1bcd02640 1 -- 172.21.15.100:0/3805816256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1b8154c20 msgr2=0x7ff1b81564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:27.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.014+0000 7ff1bcd02640 1 --2- 172.21.15.100:0/3805816256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1b8154c20 0x7ff1b81564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:27.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.014+0000 7ff1bcd02640 1 -- 172.21.15.100:0/3805816256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1b815a7e0 msgr2=0x7ff1b814aa10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:28:27.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.014+0000 7ff1bcd02640 1 --2- 172.21.15.100:0/3805816256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1b815a7e0 0x7ff1b814aa10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:27.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.014+0000 7ff1bcd02640 1 -- 172.21.15.100:0/3805816256 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b814f500 con 0x7ff1b80b3190 2024-09-11T22:28:27.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.014+0000 7ff1bcd02640 1 --2- 172.21.15.100:0/3805816256 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1b80b3190 0x7ff1b81556f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff1b815e180 tx=0x7ff1ac0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:27.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.015+0000 7ff1b57fa640 1 -- 172.21.15.100:0/3805816256 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac037050 con 0x7ff1b80b3190 2024-09-11T22:28:27.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.015+0000 7ff1b57fa640 1 -- 172.21.15.100:0/3805816256 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1ac038040 con 0x7ff1b80b3190 2024-09-11T22:28:27.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.015+0000 7ff1bef66640 1 -- 172.21.15.100:0/3805816256 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1b81f3ad0 con 0x7ff1b80b3190 2024-09-11T22:28:27.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.015+0000 7ff1b57fa640 1 -- 172.21.15.100:0/3805816256 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac006e10 con 0x7ff1b80b3190 2024-09-11T22:28:27.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.015+0000 7ff1bef66640 1 -- 172.21.15.100:0/3805816256 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1b815dae0 con 0x7ff1b80b3190 2024-09-11T22:28:27.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.016+0000 7ff1bef66640 1 -- 172.21.15.100:0/3805816256 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1b815ac90 con 0x7ff1b80b3190 2024-09-11T22:28:27.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.016+0000 7ff1b57fa640 1 -- 172.21.15.100:0/3805816256 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1ac030980 con 0x7ff1b80b3190 2024-09-11T22:28:27.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.017+0000 7ff1b57fa640 1 --2- 172.21.15.100:0/3805816256 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff19c06be80 0x7ff19c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:27.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.017+0000 7ff1b57fa640 1 -- 172.21.15.100:0/3805816256 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7ff1ac0abbe0 con 0x7ff1b80b3190 2024-09-11T22:28:27.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.017+0000 7ff1b7fff640 1 --2- 172.21.15.100:0/3805816256 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff19c06be80 0x7ff19c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:27.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.017+0000 7ff1b7fff640 1 --2- 172.21.15.100:0/3805816256 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff19c06be80 0x7ff19c06e340 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8154510 tx=0x7ff1a4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:27.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.021+0000 7ff1b57fa640 1 -- 172.21.15.100:0/3805816256 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff1b815ac90 con 0x7ff1b80b3190 2024-09-11T22:28:27.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.301+0000 7ff1bef66640 1 -- 172.21.15.100:0/3805816256 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff1b80cb120 con 0x7ff1b80b3190 2024-09-11T22:28:27.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.301+0000 7ff1b57fa640 1 -- 172.21.15.100:0/3805816256 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7ff1ac080030 con 0x7ff1b80b3190 2024-09-11T22:28:27.302 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":56,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":26,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:28:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.304+0000 7ff1bef66640 1 -- 172.21.15.100:0/3805816256 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff19c06be80 msgr2=0x7ff19c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.304+0000 7ff1bef66640 1 --2- 172.21.15.100:0/3805816256 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff19c06be80 0x7ff19c06e340 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8154510 tx=0x7ff1a4009040 comp rx=0 tx=0).stop 2024-09-11T22:28:27.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.304+0000 7ff1bef66640 1 -- 172.21.15.100:0/3805816256 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1b80b3190 msgr2=0x7ff1b81556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.304+0000 7ff1bef66640 1 --2- 172.21.15.100:0/3805816256 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1b80b3190 0x7ff1b81556f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff1b815e180 tx=0x7ff1ac0046c0 comp rx=0 tx=0).stop 2024-09-11T22:28:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.304+0000 7ff1bef66640 1 -- 172.21.15.100:0/3805816256 shutdown_connections 2024-09-11T22:28:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.304+0000 7ff1bef66640 1 --2- 172.21.15.100:0/3805816256 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff19c06be80 0x7ff19c06e340 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.304+0000 7ff1bef66640 1 --2- 172.21.15.100:0/3805816256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1b815a7e0 0x7ff1b814aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.304+0000 7ff1bef66640 1 --2- 172.21.15.100:0/3805816256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1b8154c20 0x7ff1b81564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.304+0000 7ff1bef66640 1 --2- 172.21.15.100:0/3805816256 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1b80b3190 0x7ff1b81556f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.304+0000 7ff1bef66640 1 -- 172.21.15.100:0/3805816256 >> 172.21.15.100:0/3805816256 conn(0x7ff1b8067d40 msgr2=0x7ff1b80b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.304+0000 7ff1bef66640 1 -- 172.21.15.100:0/3805816256 shutdown_connections 2024-09-11T22:28:27.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:27.304+0000 7ff1bef66640 1 -- 172.21.15.100:0/3805816256 wait complete. 2024-09-11T22:28:30.318 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:28:30.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.427+0000 7f2a650af640 1 Processor -- start 2024-09-11T22:28:30.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.427+0000 7f2a650af640 1 -- start start 2024-09-11T22:28:30.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.428+0000 7f2a650af640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a600c7320 0x7f2a60163080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:30.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.428+0000 7f2a650af640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a6006d490 con 0x7f2a6006bc10 2024-09-11T22:28:30.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.428+0000 7f2a650af640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a6006c530 con 0x7f2a600cd1b0 2024-09-11T22:28:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.428+0000 7f2a650af640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2a6006c810 con 0x7f2a600c7320 2024-09-11T22:28:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.429+0000 7f2a5e59c640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2a6006bc10 0x7f2a60157d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57194/0 (socket says 172.21.15.100:57194) 2024-09-11T22:28:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.429+0000 7f2a5e59c640 1 -- 172.21.15.100:0/2794843703 learned_addr learned my addr 172.21.15.100:0/2794843703 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:28:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.429+0000 7f2a5f59e640 1 --2- 172.21.15.100:0/2794843703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a600c7320 0x7f2a60163080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.429+0000 7f2a5dd9b640 1 -- 172.21.15.100:0/2794843703 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 115410178 0 0) 0x7f2a6006d490 con 0x7f2a6006bc10 2024-09-11T22:28:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.429+0000 7f2a5dd9b640 1 -- 172.21.15.100:0/2794843703 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a48003520 con 0x7f2a6006bc10 2024-09-11T22:28:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.429+0000 7f2a5dd9b640 1 -- 172.21.15.100:0/2794843703 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3312212667 0 0) 0x7f2a48003520 con 0x7f2a6006bc10 2024-09-11T22:28:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.429+0000 7f2a5dd9b640 1 -- 172.21.15.100:0/2794843703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a600c7320 msgr2=0x7f2a60163080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.429+0000 7f2a5dd9b640 1 --2- 172.21.15.100:0/2794843703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a600c7320 0x7f2a60163080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.429+0000 7f2a5dd9b640 1 -- 172.21.15.100:0/2794843703 >> v1:172.21.15.167:6789/0 conn(0x7f2a600cd1b0 legacy=0x7f2a601512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.429+0000 7f2a5dd9b640 1 -- 172.21.15.100:0/2794843703 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a6006ced0 con 0x7f2a6006bc10 2024-09-11T22:28:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.429+0000 7f2a5dd9b640 1 -- 172.21.15.100:0/2794843703 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f2a54001670 con 0x7f2a6006bc10 2024-09-11T22:28:30.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.429+0000 7f2a5dd9b640 1 -- 172.21.15.100:0/2794843703 >> v1:172.21.15.100:6789/0 conn(0x7f2a6006bc10 legacy=0x7f2a60157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:30.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.429+0000 7f2a5dd9b640 1 --2- 172.21.15.100:0/2794843703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a480039e0 0x7f2a48003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:30.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.429+0000 7f2a5dd9b640 1 --2- 172.21.15.100:0/2794843703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a600c7320 0x7f2a48004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:30.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.429+0000 7f2a5dd9b640 1 --2- 172.21.15.100:0/2794843703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a48004d40 0x7f2a480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:30.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.429+0000 7f2a5dd9b640 1 -- 172.21.15.100:0/2794843703 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6006c810 con 0x7f2a480039e0 2024-09-11T22:28:30.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.429+0000 7f2a5dd9b640 1 -- 172.21.15.100:0/2794843703 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4800b9f0 con 0x7f2a48004d40 2024-09-11T22:28:30.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.429+0000 7f2a5dd9b640 1 -- 172.21.15.100:0/2794843703 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2a4800bbf0 con 0x7f2a600c7320 2024-09-11T22:28:30.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.429+0000 7f2a5ed9d640 1 --2- 172.21.15.100:0/2794843703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a480039e0 0x7f2a48003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:30.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.429+0000 7f2a5f59e640 1 --2- 172.21.15.100:0/2794843703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a48004d40 0x7f2a480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:30.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.429+0000 7f2a5e59c640 1 --2- 172.21.15.100:0/2794843703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a600c7320 0x7f2a48004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:30.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.430+0000 7f2a5ed9d640 1 -- 172.21.15.100:0/2794843703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a600c7320 msgr2=0x7f2a48004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:30.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.430+0000 7f2a5ed9d640 1 --2- 172.21.15.100:0/2794843703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a600c7320 0x7f2a48004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.430+0000 7f2a5ed9d640 1 -- 172.21.15.100:0/2794843703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a48004d40 msgr2=0x7f2a480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:30.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.430+0000 7f2a5ed9d640 1 --2- 172.21.15.100:0/2794843703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a48004d40 0x7f2a480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.430+0000 7f2a5ed9d640 1 -- 172.21.15.100:0/2794843703 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a48003520 con 0x7f2a480039e0 2024-09-11T22:28:30.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.430+0000 7f2a5e59c640 1 --2- 172.21.15.100:0/2794843703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a600c7320 0x7f2a48004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:28:30.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.430+0000 7f2a5ed9d640 1 --2- 172.21.15.100:0/2794843703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a480039e0 0x7f2a48003dc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2a50001910 tx=0x7f2a48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b46f87e53c34d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:30.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.431+0000 7f2a5dd9b640 1 -- 172.21.15.100:0/2794843703 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a50037070 con 0x7f2a480039e0 2024-09-11T22:28:30.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.431+0000 7f2a5dd9b640 1 -- 172.21.15.100:0/2794843703 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a5002aba0 con 0x7f2a480039e0 2024-09-11T22:28:30.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.431+0000 7f2a5dd9b640 1 -- 172.21.15.100:0/2794843703 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a500014e0 con 0x7f2a480039e0 2024-09-11T22:28:30.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.431+0000 7f2a650af640 1 -- 172.21.15.100:0/2794843703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a480039e0 msgr2=0x7f2a48003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:30.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.431+0000 7f2a650af640 1 --2- 172.21.15.100:0/2794843703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a480039e0 0x7f2a48003dc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2a50001910 tx=0x7f2a48005830 comp rx=0 tx=0).stop 2024-09-11T22:28:30.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.431+0000 7f2a5f59e640 1 -- 172.21.15.100:0/2794843703 reap_dead start 2024-09-11T22:28:30.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.431+0000 7f2a650af640 1 -- 172.21.15.100:0/2794843703 shutdown_connections 2024-09-11T22:28:30.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.431+0000 7f2a650af640 1 -- 172.21.15.100:0/2794843703 >> 172.21.15.100:0/2794843703 conn(0x7f2a60072960 msgr2=0x7f2a60072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:30.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.431+0000 7f2a650af640 1 -- 172.21.15.100:0/2794843703 shutdown_connections 2024-09-11T22:28:30.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.431+0000 7f2a650af640 1 -- 172.21.15.100:0/2794843703 wait complete. 2024-09-11T22:28:30.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.433+0000 7f2a650af640 1 Processor -- start 2024-09-11T22:28:30.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.433+0000 7f2a650af640 1 -- start start 2024-09-11T22:28:30.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.434+0000 7f2a650af640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a480039e0 0x7f2a6014d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:30.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.434+0000 7f2a650af640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a601561b0 0x7f2a60155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:30.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.434+0000 7f2a650af640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a60155a50 0x7f2a6014a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:30.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.434+0000 7f2a650af640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6006cc50 con 0x7f2a480039e0 2024-09-11T22:28:30.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.434+0000 7f2a650af640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2a60157800 con 0x7f2a601561b0 2024-09-11T22:28:30.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.434+0000 7f2a650af640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2a601519e0 con 0x7f2a60155a50 2024-09-11T22:28:30.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.434+0000 7f2a5ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a480039e0 0x7f2a6014d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:30.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.434+0000 7f2a5ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a480039e0 0x7f2a6014d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43824/0 (socket says 172.21.15.100:43824) 2024-09-11T22:28:30.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.434+0000 7f2a5ed9d640 1 -- 172.21.15.100:0/287809051 learned_addr learned my addr 172.21.15.100:0/287809051 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.434+0000 7f2a5e59c640 1 --2- 172.21.15.100:0/287809051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a601561b0 0x7f2a60155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.434+0000 7f2a5f59e640 1 --2- 172.21.15.100:0/287809051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a60155a50 0x7f2a6014a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.434+0000 7f2a5ed9d640 1 -- 172.21.15.100:0/287809051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a60155a50 msgr2=0x7f2a6014a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.434+0000 7f2a5ed9d640 1 --2- 172.21.15.100:0/287809051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a60155a50 0x7f2a6014a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.434+0000 7f2a5ed9d640 1 -- 172.21.15.100:0/287809051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a601561b0 msgr2=0x7f2a60155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.434+0000 7f2a5ed9d640 1 --2- 172.21.15.100:0/287809051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a601561b0 0x7f2a60155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.434+0000 7f2a5ed9d640 1 -- 172.21.15.100:0/287809051 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a601f0160 con 0x7f2a480039e0 2024-09-11T22:28:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.434+0000 7f2a5e59c640 1 --2- 172.21.15.100:0/287809051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a601561b0 0x7f2a60155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.434+0000 7f2a5ed9d640 1 --2- 172.21.15.100:0/287809051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a480039e0 0x7f2a6014d680 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2a50001970 tx=0x7f2a500012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.435+0000 7f2a477fe640 1 -- 172.21.15.100:0/287809051 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a50037040 con 0x7f2a480039e0 2024-09-11T22:28:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.435+0000 7f2a477fe640 1 -- 172.21.15.100:0/287809051 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a500052e0 con 0x7f2a480039e0 2024-09-11T22:28:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.435+0000 7f2a477fe640 1 -- 172.21.15.100:0/287809051 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a50007240 con 0x7f2a480039e0 2024-09-11T22:28:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.435+0000 7f2a650af640 1 -- 172.21.15.100:0/287809051 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a601f0400 con 0x7f2a480039e0 2024-09-11T22:28:30.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.435+0000 7f2a650af640 1 -- 172.21.15.100:0/287809051 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a601f0960 con 0x7f2a480039e0 2024-09-11T22:28:30.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.436+0000 7f2a650af640 1 -- 172.21.15.100:0/287809051 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a6014f570 con 0x7f2a480039e0 2024-09-11T22:28:30.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.436+0000 7f2a477fe640 1 -- 172.21.15.100:0/287809051 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a5003a070 con 0x7f2a480039e0 2024-09-11T22:28:30.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.437+0000 7f2a477fe640 1 --2- 172.21.15.100:0/287809051 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2a4c06be30 0x7f2a4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:30.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.437+0000 7f2a477fe640 1 -- 172.21.15.100:0/287809051 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f2a500ab150 con 0x7f2a480039e0 2024-09-11T22:28:30.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.437+0000 7f2a5e59c640 1 --2- 172.21.15.100:0/287809051 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2a4c06be30 0x7f2a4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:30.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.438+0000 7f2a5e59c640 1 --2- 172.21.15.100:0/287809051 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2a4c06be30 0x7f2a4c06e2f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2a60157350 tx=0x7f2a54007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:30.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.443+0000 7f2a477fe640 1 -- 172.21.15.100:0/287809051 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2a50079090 con 0x7f2a480039e0 2024-09-11T22:28:30.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.720+0000 7f2a650af640 1 -- 172.21.15.100:0/287809051 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2a6014f290 con 0x7f2a480039e0 2024-09-11T22:28:30.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.720+0000 7f2a477fe640 1 -- 172.21.15.100:0/287809051 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f2a5007d390 con 0x7f2a480039e0 2024-09-11T22:28:30.721 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":60,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:28:30.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.723+0000 7f2a650af640 1 -- 172.21.15.100:0/287809051 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2a4c06be30 msgr2=0x7f2a4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:30.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.723+0000 7f2a650af640 1 --2- 172.21.15.100:0/287809051 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2a4c06be30 0x7f2a4c06e2f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2a60157350 tx=0x7f2a54007040 comp rx=0 tx=0).stop 2024-09-11T22:28:30.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.723+0000 7f2a650af640 1 -- 172.21.15.100:0/287809051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a480039e0 msgr2=0x7f2a6014d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:30.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.723+0000 7f2a650af640 1 --2- 172.21.15.100:0/287809051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a480039e0 0x7f2a6014d680 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2a50001970 tx=0x7f2a500012b0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.723+0000 7f2a650af640 1 -- 172.21.15.100:0/287809051 shutdown_connections 2024-09-11T22:28:30.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.723+0000 7f2a650af640 1 --2- 172.21.15.100:0/287809051 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2a4c06be30 0x7f2a4c06e2f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.723+0000 7f2a650af640 1 --2- 172.21.15.100:0/287809051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2a60155a50 0x7f2a6014a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.723+0000 7f2a650af640 1 --2- 172.21.15.100:0/287809051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a601561b0 0x7f2a60155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.723+0000 7f2a650af640 1 --2- 172.21.15.100:0/287809051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a480039e0 0x7f2a6014d680 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.723+0000 7f2a650af640 1 -- 172.21.15.100:0/287809051 >> 172.21.15.100:0/287809051 conn(0x7f2a60072960 msgr2=0x7f2a600c7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:30.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.723+0000 7f2a650af640 1 -- 172.21.15.100:0/287809051 shutdown_connections 2024-09-11T22:28:30.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.723+0000 7f2a650af640 1 -- 172.21.15.100:0/287809051 wait complete. 2024-09-11T22:28:30.737 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:28:30.737 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:28:30.737 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:28:30.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.849+0000 7fdd971be640 1 Processor -- start 2024-09-11T22:28:30.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.850+0000 7fdd971be640 1 -- start start 2024-09-11T22:28:30.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.850+0000 7fdd971be640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd90158210 0x7fdd900707a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:30.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.850+0000 7fdd971be640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdd9015e100 0x7fdd900ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:30.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.851+0000 7fdd971be640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd901585f0 con 0x7fdd900b0ca0 2024-09-11T22:28:30.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.851+0000 7fdd971be640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fdd90070310 con 0x7fdd9015e100 2024-09-11T22:28:30.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.851+0000 7fdd971be640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fdd900c9430 con 0x7fdd90158210 2024-09-11T22:28:30.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.851+0000 7fdd9575b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdd9015e100 0x7fdd900ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.851+0000 7fdd9575b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdd9015e100 0x7fdd900ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43836/0 (socket says 172.21.15.100:43836) 2024-09-11T22:28:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.851+0000 7fdd8ffff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fdd900b0ca0 0x7fdd9006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57200/0 (socket says 172.21.15.100:57200) 2024-09-11T22:28:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.851+0000 7fdd9575b640 1 -- 172.21.15.100:0/3545408838 learned_addr learned my addr 172.21.15.100:0/3545408838 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.851+0000 7fdd94f5a640 1 --2- 172.21.15.100:0/3545408838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd90158210 0x7fdd900707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.851+0000 7fdd9575b640 1 -- 172.21.15.100:0/3545408838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd90158210 msgr2=0x7fdd900707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.851+0000 7fdd9575b640 1 --2- 172.21.15.100:0/3545408838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd90158210 0x7fdd900707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.851+0000 7fdd9575b640 1 -- 172.21.15.100:0/3545408838 >> v1:172.21.15.100:6789/0 conn(0x7fdd900b0ca0 legacy=0x7fdd9006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.851+0000 7fdd9575b640 1 -- 172.21.15.100:0/3545408838 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd900c96d0 con 0x7fdd9015e100 2024-09-11T22:28:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.851+0000 7fdd8f7fe640 1 -- 172.21.15.100:0/3545408838 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1127577411 0 0) 0x7fdd901585f0 con 0x7fdd900b0ca0 2024-09-11T22:28:30.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.852+0000 7fdd9575b640 1 --2- 172.21.15.100:0/3545408838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd9015e100 0x7fdd900ce160 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdd88009e50 tx=0x7fdd8802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f073395477c23d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:30.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.852+0000 7fdd8f7fe640 1 -- 172.21.15.100:0/3545408838 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd88036070 con 0x7fdd9015e100 2024-09-11T22:28:30.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.852+0000 7fdd8f7fe640 1 -- 172.21.15.100:0/3545408838 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd88031600 con 0x7fdd9015e100 2024-09-11T22:28:30.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.852+0000 7fdd8f7fe640 1 -- 172.21.15.100:0/3545408838 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd880319d0 con 0x7fdd9015e100 2024-09-11T22:28:30.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.853+0000 7fdd971be640 1 -- 172.21.15.100:0/3545408838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd9015e100 msgr2=0x7fdd900ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:30.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.853+0000 7fdd971be640 1 --2- 172.21.15.100:0/3545408838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd9015e100 0x7fdd900ce160 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdd88009e50 tx=0x7fdd8802a7a0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.853+0000 7fdd971be640 1 -- 172.21.15.100:0/3545408838 shutdown_connections 2024-09-11T22:28:30.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.853+0000 7fdd971be640 1 --2- 172.21.15.100:0/3545408838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd9015e100 0x7fdd900ce160 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.853+0000 7fdd971be640 1 --2- 172.21.15.100:0/3545408838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd90158210 0x7fdd900707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.853+0000 7fdd971be640 1 -- 172.21.15.100:0/3545408838 >> 172.21.15.100:0/3545408838 conn(0x7fdd9006de20 msgr2=0x7fdd9006e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:30.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.853+0000 7fdd971be640 1 -- 172.21.15.100:0/3545408838 shutdown_connections 2024-09-11T22:28:30.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.853+0000 7fdd971be640 1 -- 172.21.15.100:0/3545408838 wait complete. 2024-09-11T22:28:30.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.854+0000 7fdd971be640 1 Processor -- start 2024-09-11T22:28:30.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.854+0000 7fdd971be640 1 -- start start 2024-09-11T22:28:30.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.855+0000 7fdd971be640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd900b0ca0 0x7fdd900b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:30.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.855+0000 7fdd971be640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd90158210 0x7fdd900b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:30.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.855+0000 7fdd971be640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd9015e100 0x7fdd901f0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:30.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.855+0000 7fdd971be640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9006ffa0 con 0x7fdd90158210 2024-09-11T22:28:30.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.855+0000 7fdd971be640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdd900c9c90 con 0x7fdd900b0ca0 2024-09-11T22:28:30.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.855+0000 7fdd971be640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fdd9006db40 con 0x7fdd9015e100 2024-09-11T22:28:30.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.855+0000 7fdd8ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd90158210 0x7fdd900b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:30.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.855+0000 7fdd8ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd90158210 0x7fdd900b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43842/0 (socket says 172.21.15.100:43842) 2024-09-11T22:28:30.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.855+0000 7fdd8ffff640 1 -- 172.21.15.100:0/2981949293 learned_addr learned my addr 172.21.15.100:0/2981949293 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:30.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.855+0000 7fdd94f5a640 1 --2- 172.21.15.100:0/2981949293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd900b0ca0 0x7fdd900b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:30.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.855+0000 7fdd9575b640 1 --2- 172.21.15.100:0/2981949293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd9015e100 0x7fdd901f0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:30.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.855+0000 7fdd8ffff640 1 -- 172.21.15.100:0/2981949293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd9015e100 msgr2=0x7fdd901f0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:30.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.855+0000 7fdd8ffff640 1 --2- 172.21.15.100:0/2981949293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdd9015e100 0x7fdd901f0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.855+0000 7fdd8ffff640 1 -- 172.21.15.100:0/2981949293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd900b0ca0 msgr2=0x7fdd900b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:30.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.855+0000 7fdd8ffff640 1 --2- 172.21.15.100:0/2981949293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdd900b0ca0 0x7fdd900b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.855+0000 7fdd8ffff640 1 -- 172.21.15.100:0/2981949293 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd901f4490 con 0x7fdd90158210 2024-09-11T22:28:30.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.855+0000 7fdd8ffff640 1 --2- 172.21.15.100:0/2981949293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd90158210 0x7fdd900b1e10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c00c4e0 tx=0x7fdd7c00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:30.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.856+0000 7fdd8d7fa640 1 -- 172.21.15.100:0/2981949293 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c018070 con 0x7fdd90158210 2024-09-11T22:28:30.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.856+0000 7fdd8d7fa640 1 -- 172.21.15.100:0/2981949293 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd7c007500 con 0x7fdd90158210 2024-09-11T22:28:30.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.856+0000 7fdd8d7fa640 1 -- 172.21.15.100:0/2981949293 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c004a20 con 0x7fdd90158210 2024-09-11T22:28:30.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.856+0000 7fdd971be640 1 -- 172.21.15.100:0/2981949293 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd900b16f0 con 0x7fdd90158210 2024-09-11T22:28:30.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.856+0000 7fdd971be640 1 -- 172.21.15.100:0/2981949293 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd901f39d0 con 0x7fdd90158210 2024-09-11T22:28:30.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.857+0000 7fdd971be640 1 --2- 172.21.15.100:0/2981949293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd901f0590 0x7fdd901f3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:30.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.857+0000 7fdd971be640 1 -- 172.21.15.100:0/2981949293 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdd901f4150 con 0x7fdd901f0590 2024-09-11T22:28:30.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.857+0000 7fdd94f5a640 1 --2- 172.21.15.100:0/2981949293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd901f0590 0x7fdd901f3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:30.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.857+0000 7fdd8d7fa640 1 -- 172.21.15.100:0/2981949293 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd7c004bc0 con 0x7fdd90158210 2024-09-11T22:28:30.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.857+0000 7fdd94f5a640 1 -- 172.21.15.100:0/2981949293 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd900b19d0 con 0x7fdd901f0590 2024-09-11T22:28:30.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.857+0000 7fdd94f5a640 1 --2- 172.21.15.100:0/2981949293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd901f0590 0x7fdd901f3c10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdd840118e0 tx=0x7fdd84011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:30.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.858+0000 7fdd8d7fa640 1 --2- 172.21.15.100:0/2981949293 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fdd7406be30 0x7fdd7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:30.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.858+0000 7fdd8d7fa640 1 -- 172.21.15.100:0/2981949293 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fdd7c08a640 con 0x7fdd90158210 2024-09-11T22:28:30.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.858+0000 7fdd9575b640 1 --2- 172.21.15.100:0/2981949293 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fdd7406be30 0x7fdd7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:30.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.858+0000 7fdd8d7fa640 1 -- 172.21.15.100:0/2981949293 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd84019070 con 0x7fdd901f0590 2024-09-11T22:28:30.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.858+0000 7fdd8d7fa640 1 -- 172.21.15.100:0/2981949293 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fdd84004300 con 0x7fdd901f0590 2024-09-11T22:28:30.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.858+0000 7fdd8d7fa640 1 -- 172.21.15.100:0/2981949293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd901f0590 msgr2=0x7fdd901f3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:30.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.858+0000 7fdd8d7fa640 1 --2- 172.21.15.100:0/2981949293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd901f0590 0x7fdd901f3c10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdd840118e0 tx=0x7fdd84011da0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.858+0000 7fdd8d7fa640 1 -- 172.21.15.100:0/2981949293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd901f0590 msgr2=0x7fdd901f3c10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:28:30.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.858+0000 7fdd8d7fa640 1 --2- 172.21.15.100:0/2981949293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd901f0590 0x7fdd901f3c10 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdd840118e0 tx=0x7fdd84011da0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.858+0000 7fdd9575b640 1 --2- 172.21.15.100:0/2981949293 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fdd7406be30 0x7fdd7406e2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdd88033000 tx=0x7fdd88009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:30.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.866+0000 7fdd971be640 1 --2- 172.21.15.100:0/2981949293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd900b11b0 0x7fdd901e4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:30.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.866+0000 7fdd971be640 1 -- 172.21.15.100:0/2981949293 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdd90070da0 con 0x7fdd900b11b0 2024-09-11T22:28:30.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.866+0000 7fdd94f5a640 1 --2- 172.21.15.100:0/2981949293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd900b11b0 0x7fdd901e4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:30.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.867+0000 7fdd94f5a640 1 -- 172.21.15.100:0/2981949293 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdd90157750 con 0x7fdd900b11b0 2024-09-11T22:28:30.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.867+0000 7fdd94f5a640 1 --2- 172.21.15.100:0/2981949293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd900b11b0 0x7fdd901e4f50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdd840118e0 tx=0x7fdd840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:30.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.867+0000 7fdd8d7fa640 1 -- 172.21.15.100:0/2981949293 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd84019040 con 0x7fdd900b11b0 2024-09-11T22:28:30.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.867+0000 7fdd8d7fa640 1 -- 172.21.15.100:0/2981949293 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7fdd8401e450 con 0x7fdd900b11b0 2024-09-11T22:28:30.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.867+0000 7fdd8d7fa640 1 -- 172.21.15.100:0/2981949293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd900b11b0 msgr2=0x7fdd901e4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:30.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.867+0000 7fdd8d7fa640 1 --2- 172.21.15.100:0/2981949293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd900b11b0 0x7fdd901e4f50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdd840118e0 tx=0x7fdd840046c0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.867+0000 7fdd8d7fa640 1 -- 172.21.15.100:0/2981949293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd900b11b0 msgr2=0x7fdd901e4f50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:28:30.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.867+0000 7fdd8d7fa640 1 --2- 172.21.15.100:0/2981949293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd900b11b0 0x7fdd901e4f50 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdd840118e0 tx=0x7fdd840046c0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.870 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:28:30.870 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:28:30.870 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:28:30.870 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:28:30.870 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 60, 2024-09-11T22:28:30.870 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 7297, 2024-09-11T22:28:30.870 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:28:30.870 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:28:30.870 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:28:30.870 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:28:30.871 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:30.871 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:28:30.871 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:28:30.871 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:28:30.871 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:28:30.871 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:30.871 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:30.871 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:30.871 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:30.871 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:30.871 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:30.871 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:30.872 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:30.872 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:30.872 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:30.872 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:30.872 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:30.872 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:28:30.872 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:28:30.872 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:30.872 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:30.873 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:30.873 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:30.873 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:30.873 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:30.873 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:30.873 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:30.873 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:30.873 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:30.873 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:30.874 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:30.874 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:30.874 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:28:30.874 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:28:30.874 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:28:30.874 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:28:30.874 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:28:30.874 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:28:30.874 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:28:30.875 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:28:30.875 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:28:30.875 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:28:30.875 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:28:30.875 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:28:30.875 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:28:30.875 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:28:30.875 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:28:30.875 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:28:30.875 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:28:30.876 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:30.876 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:30.876 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:30.876 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:30.876 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:30.876 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:30.876 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:30.876 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:30.876 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:30.877 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:30.877 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:30.877 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:30.877 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:28:30.877 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:30.877 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:28:30.877 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:30.877 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:28:30.877 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:28:30.877 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:30.877 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:30.878 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:30.878 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:30.878 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:28:30.878 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:30.878 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:30.878 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:30.878 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:30.878 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:28:30.879 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:30.879 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:30.879 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:30.879 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:30.879 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:28:30.879 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:28:30.879 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:30.879 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:30.879 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:30.879 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:30.879 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:30.880 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:28:30.880 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:28:30.880 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:30.880 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:30.880 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:30.880 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:30.880 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:28:30.880 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:30.881 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:30.881 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:30.881 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:30.881 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:28:30.881 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:30.881 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:30.881 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:30.881 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:30.882 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:28:30.882 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:28:30.882 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:30.882 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:30.882 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:30.882 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:30.882 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:30.882 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:28:30.882 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:28:30.882 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:30.882 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:30.883 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:30.883 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:30.883 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:28:30.883 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:30.883 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:30.883 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:30.883 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:30.883 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:28:30.883 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:30.883 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:30.883 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:30.883 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:30.883 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:28:30.883 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:28:30.884 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:30.884 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:30.884 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:30.884 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:30.884 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:30.884 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:30.884 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:28:30.884 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:28:30.884 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:30.884 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:30.884 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:30.884 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:28:30.884 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:30.884 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:30.885 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:28:30.885 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:30.885 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:30.885 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:30.885 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:28:30.885 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:30.885 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:30.885 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:30.885 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:28:30.885 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:28:30.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.868+0000 7fdd971be640 1 -- 172.21.15.100:0/2981949293 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fdd7406be30 msgr2=0x7fdd7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:30.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.868+0000 7fdd971be640 1 --2- 172.21.15.100:0/2981949293 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fdd7406be30 0x7fdd7406e2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdd88033000 tx=0x7fdd88009000 comp rx=0 tx=0).stop 2024-09-11T22:28:30.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.868+0000 7fdd971be640 1 -- 172.21.15.100:0/2981949293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd90158210 msgr2=0x7fdd900b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:30.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.868+0000 7fdd971be640 1 --2- 172.21.15.100:0/2981949293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd90158210 0x7fdd900b1e10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c00c4e0 tx=0x7fdd7c00c9a0 comp rx=0 tx=0).stop 2024-09-11T22:28:30.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.868+0000 7fdd9575b640 1 -- 172.21.15.100:0/2981949293 reap_dead start 2024-09-11T22:28:30.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.868+0000 7fdd9575b640 1 -- 172.21.15.100:0/2981949293 reap_dead start 2024-09-11T22:28:30.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.868+0000 7fdd971be640 1 -- 172.21.15.100:0/2981949293 shutdown_connections 2024-09-11T22:28:30.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.868+0000 7fdd971be640 1 -- 172.21.15.100:0/2981949293 >> 172.21.15.100:0/2981949293 conn(0x7fdd9006de20 msgr2=0x7fdd9006e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:30.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.868+0000 7fdd971be640 1 -- 172.21.15.100:0/2981949293 shutdown_connections 2024-09-11T22:28:30.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.868+0000 7fdd971be640 1 -- 172.21.15.100:0/2981949293 wait complete. 2024-09-11T22:28:30.887 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:28:30.888 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:28:30.888 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:28:30.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.997+0000 7f46bc7cf640 1 Processor -- start 2024-09-11T22:28:30.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.997+0000 7f46bc7cf640 1 -- start start 2024-09-11T22:28:30.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.998+0000 7f46bc7cf640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f46b4158210 0x7f46b40707a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:30.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.998+0000 7f46bc7cf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46b415e100 0x7f46b40ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:30.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.998+0000 7f46bc7cf640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46b41585f0 con 0x7f46b40b0ca0 2024-09-11T22:28:30.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.998+0000 7f46bc7cf640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f46b4070310 con 0x7f46b4158210 2024-09-11T22:28:30.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.998+0000 7f46bc7cf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f46b40c9430 con 0x7f46b415e100 2024-09-11T22:28:30.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.998+0000 7f46bad6c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46b415e100 0x7f46b40ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:30.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.998+0000 7f46ba56b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f46b4158210 0x7f46b40707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:30.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.998+0000 7f46bad6c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46b415e100 0x7f46b40ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:33998/0 (socket says 172.21.15.100:33998) 2024-09-11T22:28:30.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.998+0000 7f46ba56b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f46b4158210 0x7f46b40707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:36312/0 (socket says 172.21.15.100:36312) 2024-09-11T22:28:30.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.998+0000 7f46bad6c640 1 -- 172.21.15.100:0/89934229 learned_addr learned my addr 172.21.15.100:0/89934229 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:31.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.998+0000 7f46bad6c640 1 -- 172.21.15.100:0/89934229 >> v2:172.21.15.167:3300/0 conn(0x7f46b4158210 msgr2=0x7f46b40707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:31.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.998+0000 7f46bad6c640 1 --2- 172.21.15.100:0/89934229 >> v2:172.21.15.167:3300/0 conn(0x7f46b4158210 0x7f46b40707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.998+0000 7f46bad6c640 1 -- 172.21.15.100:0/89934229 >> v1:172.21.15.167:6789/0 conn(0x7f46b40b0ca0 legacy=0x7f46b406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.998+0000 7f46bad6c640 1 -- 172.21.15.100:0/89934229 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b40c96d0 con 0x7f46b415e100 2024-09-11T22:28:31.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.998+0000 7f46ba56b640 1 --2- 172.21.15.100:0/89934229 >> v2:172.21.15.167:3300/0 conn(0x7f46b4158210 0x7f46b40707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:31.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.999+0000 7f46bad6c640 1 --2- 172.21.15.100:0/89934229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46b415e100 0x7f46b40ce160 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f46ac009e50 tx=0x7f46ac02a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=891383549bda8c13 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:31.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.999+0000 7f46b9569640 1 -- 172.21.15.100:0/89934229 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ac036070 con 0x7f46b415e100 2024-09-11T22:28:31.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.999+0000 7f46b9569640 1 -- 172.21.15.100:0/89934229 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46ac031600 con 0x7f46b415e100 2024-09-11T22:28:31.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:30.999+0000 7f46b9569640 1 -- 172.21.15.100:0/89934229 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ac0319d0 con 0x7f46b415e100 2024-09-11T22:28:31.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.000+0000 7f46bc7cf640 1 -- 172.21.15.100:0/89934229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46b415e100 msgr2=0x7f46b40ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.000+0000 7f46bc7cf640 1 --2- 172.21.15.100:0/89934229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46b415e100 0x7f46b40ce160 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f46ac009e50 tx=0x7f46ac02a7a0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.000+0000 7f46bc7cf640 1 -- 172.21.15.100:0/89934229 shutdown_connections 2024-09-11T22:28:31.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.000+0000 7f46bc7cf640 1 --2- 172.21.15.100:0/89934229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46b415e100 0x7f46b40ce160 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.000+0000 7f46bc7cf640 1 --2- 172.21.15.100:0/89934229 >> v2:172.21.15.167:3300/0 conn(0x7f46b4158210 0x7f46b40707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.000+0000 7f46bc7cf640 1 -- 172.21.15.100:0/89934229 >> 172.21.15.100:0/89934229 conn(0x7f46b406de20 msgr2=0x7f46b406e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:31.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.000+0000 7f46bc7cf640 1 -- 172.21.15.100:0/89934229 shutdown_connections 2024-09-11T22:28:31.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.000+0000 7f46bc7cf640 1 -- 172.21.15.100:0/89934229 wait complete. 2024-09-11T22:28:31.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.001+0000 7f46bc7cf640 1 Processor -- start 2024-09-11T22:28:31.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.001+0000 7f46bc7cf640 1 -- start start 2024-09-11T22:28:31.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.002+0000 7f46bc7cf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46b40b0ca0 0x7f46b41f1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.002+0000 7f46bc7cf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46b4158210 0x7f46b4153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.002+0000 7f46bc7cf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b415e100 0x7f46b40cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.002+0000 7f46bc7cf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f46b406ffa0 con 0x7f46b40b0ca0 2024-09-11T22:28:31.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.002+0000 7f46bc7cf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f46b40c9c90 con 0x7f46b415e100 2024-09-11T22:28:31.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.002+0000 7f46bc7cf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f46b406db40 con 0x7f46b4158210 2024-09-11T22:28:31.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.002+0000 7f46ba56b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46b40b0ca0 0x7f46b41f1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.002+0000 7f46ba56b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46b40b0ca0 0x7f46b41f1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43878/0 (socket says 172.21.15.100:43878) 2024-09-11T22:28:31.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.002+0000 7f46ba56b640 1 -- 172.21.15.100:0/3224301516 learned_addr learned my addr 172.21.15.100:0/3224301516 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:31.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.002+0000 7f46b9d6a640 1 --2- 172.21.15.100:0/3224301516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46b4158210 0x7f46b4153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.002+0000 7f46bad6c640 1 --2- 172.21.15.100:0/3224301516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b415e100 0x7f46b40cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.002+0000 7f46ba56b640 1 -- 172.21.15.100:0/3224301516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46b4158210 msgr2=0x7f46b4153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.002+0000 7f46ba56b640 1 --2- 172.21.15.100:0/3224301516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46b4158210 0x7f46b4153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.002+0000 7f46ba56b640 1 -- 172.21.15.100:0/3224301516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b415e100 msgr2=0x7f46b40cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.002+0000 7f46ba56b640 1 --2- 172.21.15.100:0/3224301516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b415e100 0x7f46b40cc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.002+0000 7f46ba56b640 1 -- 172.21.15.100:0/3224301516 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b40cdfd0 con 0x7f46b40b0ca0 2024-09-11T22:28:31.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.003+0000 7f46ba56b640 1 --2- 172.21.15.100:0/3224301516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46b40b0ca0 0x7f46b41f1030 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f46b000ebe0 tx=0x7f46b000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:31.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.003+0000 7f46aaffd640 1 -- 172.21.15.100:0/3224301516 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b0017070 con 0x7f46b40b0ca0 2024-09-11T22:28:31.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.003+0000 7f46aaffd640 1 -- 172.21.15.100:0/3224301516 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b000cc30 con 0x7f46b40b0ca0 2024-09-11T22:28:31.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.003+0000 7f46aaffd640 1 -- 172.21.15.100:0/3224301516 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b0013470 con 0x7f46b40b0ca0 2024-09-11T22:28:31.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.003+0000 7f46bc7cf640 1 -- 172.21.15.100:0/3224301516 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b40ce2b0 con 0x7f46b40b0ca0 2024-09-11T22:28:31.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.003+0000 7f46bc7cf640 1 -- 172.21.15.100:0/3224301516 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b415b770 con 0x7f46b40b0ca0 2024-09-11T22:28:31.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.004+0000 7f46bc7cf640 1 --2- 172.21.15.100:0/3224301516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b41542a0 0x7f46b40cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.004+0000 7f46bc7cf640 1 -- 172.21.15.100:0/3224301516 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f46b40ce590 con 0x7f46b41542a0 2024-09-11T22:28:31.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.004+0000 7f46b9d6a640 1 --2- 172.21.15.100:0/3224301516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b41542a0 0x7f46b40cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.004+0000 7f46b9d6a640 1 -- 172.21.15.100:0/3224301516 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46b40707a0 con 0x7f46b41542a0 2024-09-11T22:28:31.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.004+0000 7f46b9d6a640 1 --2- 172.21.15.100:0/3224301516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b41542a0 0x7f46b40cca50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f46b40cd8a0 tx=0x7f46a400f9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:31.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.005+0000 7f46aaffd640 1 -- 172.21.15.100:0/3224301516 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f46b001a070 con 0x7f46b40b0ca0 2024-09-11T22:28:31.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.005+0000 7f46aaffd640 1 --2- 172.21.15.100:0/3224301516 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f469806be30 0x7f469806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.005+0000 7f46aaffd640 1 -- 172.21.15.100:0/3224301516 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a4019070 con 0x7f46b41542a0 2024-09-11T22:28:31.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.005+0000 7f46aaffd640 1 -- 172.21.15.100:0/3224301516 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f46b008b540 con 0x7f46b40b0ca0 2024-09-11T22:28:31.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.005+0000 7f46bad6c640 1 --2- 172.21.15.100:0/3224301516 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f469806be30 0x7f469806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.005+0000 7f46aaffd640 1 -- 172.21.15.100:0/3224301516 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f46a4005320 con 0x7f46b41542a0 2024-09-11T22:28:31.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.005+0000 7f46aaffd640 1 -- 172.21.15.100:0/3224301516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b41542a0 msgr2=0x7f46b40cca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.005+0000 7f46aaffd640 1 --2- 172.21.15.100:0/3224301516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b41542a0 0x7f46b40cca50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f46b40cd8a0 tx=0x7f46a400f9d0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.005+0000 7f46aaffd640 1 -- 172.21.15.100:0/3224301516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b41542a0 msgr2=0x7f46b40cca50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:28:31.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.005+0000 7f46aaffd640 1 --2- 172.21.15.100:0/3224301516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b41542a0 0x7f46b40cca50 secure :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f46b40cd8a0 tx=0x7f46a400f9d0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.006+0000 7f46bad6c640 1 --2- 172.21.15.100:0/3224301516 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f469806be30 0x7f469806e2f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f46ac033000 tx=0x7f46ac009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:31.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.012+0000 7f46bc7cf640 1 --2- 172.21.15.100:0/3224301516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b40cd8d0 0x7f46b41590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.012+0000 7f46bc7cf640 1 -- 172.21.15.100:0/3224301516 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f46b4070da0 con 0x7f46b40cd8d0 2024-09-11T22:28:31.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.012+0000 7f46b9d6a640 1 --2- 172.21.15.100:0/3224301516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b40cd8d0 0x7f46b41590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.012+0000 7f46b9d6a640 1 -- 172.21.15.100:0/3224301516 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f46b40cac70 con 0x7f46b40cd8d0 2024-09-11T22:28:31.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.013+0000 7f46b9d6a640 1 --2- 172.21.15.100:0/3224301516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b40cd8d0 0x7f46b41590f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f46b40cd8a0 tx=0x7f46a4000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:31.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.013+0000 7f46aaffd640 1 -- 172.21.15.100:0/3224301516 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a4019030 con 0x7f46b40cd8d0 2024-09-11T22:28:31.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.013+0000 7f46aaffd640 1 -- 172.21.15.100:0/3224301516 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4887 (secure 0 0 0) 0x7f46a4006b00 con 0x7f46b40cd8d0 2024-09-11T22:28:31.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.013+0000 7f46aaffd640 1 -- 172.21.15.100:0/3224301516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b40cd8d0 msgr2=0x7f46b41590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.013+0000 7f46aaffd640 1 --2- 172.21.15.100:0/3224301516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b40cd8d0 0x7f46b41590f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f46b40cd8a0 tx=0x7f46a4000ed0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.015 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:28:31.015 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:28:31.015 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:28:31.015 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:28:31.015 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 60, 2024-09-11T22:28:31.015 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 296291, 2024-09-11T22:28:31.015 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:28:31.015 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:28:31.015 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:28:31.015 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:28:31.016 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:31.016 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:28:31.016 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:28:31.016 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:28:31.016 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:28:31.016 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:31.016 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:31.016 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:31.016 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:31.016 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:31.016 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:31.016 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:31.016 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:31.017 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:31.017 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:31.017 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:31.017 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:31.017 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:28:31.017 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:28:31.017 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:31.017 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:31.017 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:31.017 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:31.017 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:31.017 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:31.017 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:31.017 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:31.017 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:31.018 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:31.018 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:31.018 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:31.018 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.018 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:28:31.018 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:28:31.018 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:28:31.018 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:28:31.018 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:28:31.018 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:28:31.018 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:28:31.018 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:28:31.018 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:28:31.019 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:28:31.019 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:28:31.019 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:28:31.019 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:28:31.019 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:28:31.019 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:28:31.019 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:28:31.019 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:28:31.019 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:31.019 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:31.019 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:31.019 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:31.019 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:31.019 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:31.020 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:31.020 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:31.020 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:31.020 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:31.020 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:31.020 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:31.020 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:28:31.020 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.020 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:28:31.020 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.020 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:28:31.020 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:28:31.020 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:31.020 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:31.021 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.021 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:31.021 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:28:31.021 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:31.021 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.021 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.021 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:31.021 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:28:31.021 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:31.021 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:31.021 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:31.021 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.021 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:28:31.021 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:28:31.022 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:31.022 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:31.022 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:31.022 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.022 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.022 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:28:31.022 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:28:31.022 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:31.022 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:31.022 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.022 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:31.022 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:28:31.022 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:31.023 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.023 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.023 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:31.023 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:28:31.023 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:31.023 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:31.023 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:31.023 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.023 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:28:31.023 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:28:31.024 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:31.024 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:31.024 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:31.024 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.024 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.024 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:28:31.024 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:28:31.024 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:31.024 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:31.024 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.024 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:31.024 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:28:31.024 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:31.025 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.025 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.025 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:31.025 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:28:31.025 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:31.025 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:31.025 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:31.025 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.025 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:28:31.025 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:28:31.025 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:31.025 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:31.025 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:31.025 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:31.026 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:31.026 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.026 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:28:31.026 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:28:31.026 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.026 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:31.026 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:31.026 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:28:31.026 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:31.026 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:31.026 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:28:31.026 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.026 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:31.026 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:31.027 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:28:31.027 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:31.027 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:31.027 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:28:31.027 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.027 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:31.027 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:31.027 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:28:31.027 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:31.027 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:31.027 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:28:31.027 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.027 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:31.028 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:31.028 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:28:31.028 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:31.028 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:31.028 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.028 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:28:31.028 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:28:31.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.013+0000 7f46aaffd640 1 -- 172.21.15.100:0/3224301516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b40cd8d0 msgr2=0x7f46b41590f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:28:31.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.013+0000 7f46aaffd640 1 --2- 172.21.15.100:0/3224301516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46b40cd8d0 0x7f46b41590f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.014+0000 7f46bc7cf640 1 -- 172.21.15.100:0/3224301516 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f469806be30 msgr2=0x7f469806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.014+0000 7f46bc7cf640 1 --2- 172.21.15.100:0/3224301516 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f469806be30 0x7f469806e2f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f46ac033000 tx=0x7f46ac009000 comp rx=0 tx=0).stop 2024-09-11T22:28:31.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.014+0000 7f46bc7cf640 1 -- 172.21.15.100:0/3224301516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46b40b0ca0 msgr2=0x7f46b41f1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.014+0000 7f46bc7cf640 1 --2- 172.21.15.100:0/3224301516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46b40b0ca0 0x7f46b41f1030 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f46b000ebe0 tx=0x7f46b000c520 comp rx=0 tx=0).stop 2024-09-11T22:28:31.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.014+0000 7f46bad6c640 1 -- 172.21.15.100:0/3224301516 reap_dead start 2024-09-11T22:28:31.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.014+0000 7f46bad6c640 1 -- 172.21.15.100:0/3224301516 reap_dead start 2024-09-11T22:28:31.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.014+0000 7f46bc7cf640 1 -- 172.21.15.100:0/3224301516 shutdown_connections 2024-09-11T22:28:31.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.014+0000 7f46bc7cf640 1 -- 172.21.15.100:0/3224301516 >> 172.21.15.100:0/3224301516 conn(0x7f46b406de20 msgr2=0x7f46b4071250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:31.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.014+0000 7f46bc7cf640 1 -- 172.21.15.100:0/3224301516 shutdown_connections 2024-09-11T22:28:31.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.014+0000 7f46bc7cf640 1 -- 172.21.15.100:0/3224301516 wait complete. 2024-09-11T22:28:31.031 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:28:31.031 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:28:31.031 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:28:31.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.136+0000 7fc829e47640 1 Processor -- start 2024-09-11T22:28:31.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.136+0000 7fc829e47640 1 -- start start 2024-09-11T22:28:31.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.137+0000 7fc829e47640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc824152a80 0x7fc82406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.137+0000 7fc829e47640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc8240b0c00 0x7fc8240cb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.137+0000 7fc829e47640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8240c98f0 con 0x7fc8240c8b10 2024-09-11T22:28:31.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.137+0000 7fc829e47640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fc824152e60 con 0x7fc8240b0c00 2024-09-11T22:28:31.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.137+0000 7fc829e47640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc8240c9050 con 0x7fc824152a80 2024-09-11T22:28:31.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.137+0000 7fc8237fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc824152a80 0x7fc82406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.137+0000 7fc823fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc8240b0c00 0x7fc8240cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.137+0000 7fc823fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc8240b0c00 0x7fc8240cb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:36342/0 (socket says 172.21.15.100:36342) 2024-09-11T22:28:31.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.137+0000 7fc823fff640 1 -- 172.21.15.100:0/1898938671 learned_addr learned my addr 172.21.15.100:0/1898938671 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:31.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.137+0000 7fc8237fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc824152a80 0x7fc82406ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:34016/0 (socket says 172.21.15.100:34016) 2024-09-11T22:28:31.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.138+0000 7fc823fff640 1 -- 172.21.15.100:0/1898938671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc824152a80 msgr2=0x7fc82406ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:31.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.138+0000 7fc823fff640 1 --2- 172.21.15.100:0/1898938671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc824152a80 0x7fc82406ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.138+0000 7fc823fff640 1 -- 172.21.15.100:0/1898938671 >> v1:172.21.15.167:6789/0 conn(0x7fc8240c8b10 legacy=0x7fc824159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.138+0000 7fc823fff640 1 -- 172.21.15.100:0/1898938671 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8240c9330 con 0x7fc8240b0c00 2024-09-11T22:28:31.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.138+0000 7fc8237fe640 1 --2- 172.21.15.100:0/1898938671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc824152a80 0x7fc82406ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:31.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.138+0000 7fc823fff640 1 --2- 172.21.15.100:0/1898938671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8240b0c00 0x7fc8240cb020 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc81c009e50 tx=0x7fc81c02a7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c973af15ee0c3d7d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:31.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.139+0000 7fc8227fc640 1 -- 172.21.15.100:0/1898938671 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c036070 con 0x7fc8240b0c00 2024-09-11T22:28:31.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.139+0000 7fc8227fc640 1 -- 172.21.15.100:0/1898938671 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc81c031600 con 0x7fc8240b0c00 2024-09-11T22:28:31.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.139+0000 7fc8227fc640 1 -- 172.21.15.100:0/1898938671 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c0319d0 con 0x7fc8240b0c00 2024-09-11T22:28:31.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.139+0000 7fc829e47640 1 -- 172.21.15.100:0/1898938671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8240b0c00 msgr2=0x7fc8240cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.139+0000 7fc829e47640 1 --2- 172.21.15.100:0/1898938671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8240b0c00 0x7fc8240cb020 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc81c009e50 tx=0x7fc81c02a7a0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.139+0000 7fc829e47640 1 -- 172.21.15.100:0/1898938671 shutdown_connections 2024-09-11T22:28:31.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.139+0000 7fc829e47640 1 --2- 172.21.15.100:0/1898938671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8240b0c00 0x7fc8240cb020 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.139+0000 7fc829e47640 1 --2- 172.21.15.100:0/1898938671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc824152a80 0x7fc82406ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.139+0000 7fc829e47640 1 -- 172.21.15.100:0/1898938671 >> 172.21.15.100:0/1898938671 conn(0x7fc82406e000 msgr2=0x7fc82406e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:31.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.139+0000 7fc829e47640 1 -- 172.21.15.100:0/1898938671 shutdown_connections 2024-09-11T22:28:31.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.139+0000 7fc829e47640 1 -- 172.21.15.100:0/1898938671 wait complete. 2024-09-11T22:28:31.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.141+0000 7fc829e47640 1 Processor -- start 2024-09-11T22:28:31.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.141+0000 7fc829e47640 1 -- start start 2024-09-11T22:28:31.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.142+0000 7fc829e47640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8240b0c00 0x7fc82415a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.142+0000 7fc829e47640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8240c8b10 0x7fc82415b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.142+0000 7fc829e47640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc824152a80 0x7fc8241e27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.142+0000 7fc829e47640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc824158b10 con 0x7fc8240c8b10 2024-09-11T22:28:31.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.142+0000 7fc829e47640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc824158830 con 0x7fc8240b0c00 2024-09-11T22:28:31.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.142+0000 7fc829e47640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc82415bc60 con 0x7fc824152a80 2024-09-11T22:28:31.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.142+0000 7fc822ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8240c8b10 0x7fc82415b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.142+0000 7fc822ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8240c8b10 0x7fc82415b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43890/0 (socket says 172.21.15.100:43890) 2024-09-11T22:28:31.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.142+0000 7fc822ffd640 1 -- 172.21.15.100:0/1612950689 learned_addr learned my addr 172.21.15.100:0/1612950689 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:31.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.142+0000 7fc8237fe640 1 --2- 172.21.15.100:0/1612950689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8240b0c00 0x7fc82415a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.142+0000 7fc823fff640 1 --2- 172.21.15.100:0/1612950689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc824152a80 0x7fc8241e27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.142+0000 7fc822ffd640 1 -- 172.21.15.100:0/1612950689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc824152a80 msgr2=0x7fc8241e27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.142+0000 7fc822ffd640 1 --2- 172.21.15.100:0/1612950689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc824152a80 0x7fc8241e27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.142+0000 7fc822ffd640 1 -- 172.21.15.100:0/1612950689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8240b0c00 msgr2=0x7fc82415a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.142+0000 7fc822ffd640 1 --2- 172.21.15.100:0/1612950689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8240b0c00 0x7fc82415a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.142+0000 7fc822ffd640 1 -- 172.21.15.100:0/1612950689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8240b1cb0 con 0x7fc8240c8b10 2024-09-11T22:28:31.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.142+0000 7fc822ffd640 1 --2- 172.21.15.100:0/1612950689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8240c8b10 0x7fc82415b2d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc81800c470 tx=0x7fc818001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:31.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.143+0000 7fc80bfff640 1 -- 172.21.15.100:0/1612950689 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8180052d0 con 0x7fc8240c8b10 2024-09-11T22:28:31.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.143+0000 7fc80bfff640 1 -- 172.21.15.100:0/1612950689 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc818005470 con 0x7fc8240c8b10 2024-09-11T22:28:31.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.143+0000 7fc829e47640 1 -- 172.21.15.100:0/1612950689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8241e33e0 con 0x7fc8240c8b10 2024-09-11T22:28:31.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.143+0000 7fc80bfff640 1 -- 172.21.15.100:0/1612950689 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818007260 con 0x7fc8240c8b10 2024-09-11T22:28:31.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.143+0000 7fc829e47640 1 -- 172.21.15.100:0/1612950689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8241e1ff0 con 0x7fc8240c8b10 2024-09-11T22:28:31.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.143+0000 7fc829e47640 1 --2- 172.21.15.100:0/1612950689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc824151b70 0x7fc8241e2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.143+0000 7fc829e47640 1 -- 172.21.15.100:0/1612950689 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc824159b30 con 0x7fc824151b70 2024-09-11T22:28:31.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.144+0000 7fc8237fe640 1 --2- 172.21.15.100:0/1612950689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc824151b70 0x7fc8241e2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.144+0000 7fc8237fe640 1 -- 172.21.15.100:0/1612950689 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc82406ff90 con 0x7fc824151b70 2024-09-11T22:28:31.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.144+0000 7fc8237fe640 1 --2- 172.21.15.100:0/1612950689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc824151b70 0x7fc8241e2d30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc81400d870 tx=0x7fc81400d9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:31.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.144+0000 7fc80bfff640 1 -- 172.21.15.100:0/1612950689 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc818007400 con 0x7fc8240c8b10 2024-09-11T22:28:31.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.145+0000 7fc80bfff640 1 --2- 172.21.15.100:0/1612950689 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc81006be60 0x7fc81006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.145+0000 7fc80bfff640 1 -- 172.21.15.100:0/1612950689 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fc81808a670 con 0x7fc8240c8b10 2024-09-11T22:28:31.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.145+0000 7fc823fff640 1 --2- 172.21.15.100:0/1612950689 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc81006be60 0x7fc81006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.145+0000 7fc80bfff640 1 -- 172.21.15.100:0/1612950689 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814021420 con 0x7fc824151b70 2024-09-11T22:28:31.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.145+0000 7fc80bfff640 1 -- 172.21.15.100:0/1612950689 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc8140215c0 con 0x7fc824151b70 2024-09-11T22:28:31.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.145+0000 7fc80bfff640 1 -- 172.21.15.100:0/1612950689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc824151b70 msgr2=0x7fc8241e2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.145+0000 7fc80bfff640 1 --2- 172.21.15.100:0/1612950689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc824151b70 0x7fc8241e2d30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc81400d870 tx=0x7fc81400d9c0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.145+0000 7fc80bfff640 1 -- 172.21.15.100:0/1612950689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc824151b70 msgr2=0x7fc8241e2d30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:28:31.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.145+0000 7fc80bfff640 1 --2- 172.21.15.100:0/1612950689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc824151b70 0x7fc8241e2d30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.145+0000 7fc823fff640 1 --2- 172.21.15.100:0/1612950689 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc81006be60 0x7fc81006e320 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc81c033000 tx=0x7fc81c009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:31.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.151+0000 7fc829e47640 1 --2- 172.21.15.100:0/1612950689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8241ef700 0x7fc8241efb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.151+0000 7fc829e47640 1 -- 172.21.15.100:0/1612950689 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc82414fcc0 con 0x7fc8241ef700 2024-09-11T22:28:31.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.152+0000 7fc8237fe640 1 --2- 172.21.15.100:0/1612950689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8241ef700 0x7fc8241efb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.152+0000 7fc8237fe640 1 -- 172.21.15.100:0/1612950689 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc8240cb6f0 con 0x7fc8241ef700 2024-09-11T22:28:31.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.152+0000 7fc8237fe640 1 --2- 172.21.15.100:0/1612950689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8241ef700 0x7fc8241efb10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc81400d870 tx=0x7fc8140046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:31.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.152+0000 7fc80bfff640 1 -- 172.21.15.100:0/1612950689 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814026040 con 0x7fc8241ef700 2024-09-11T22:28:31.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.153+0000 7fc80bfff640 1 -- 172.21.15.100:0/1612950689 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7fc814031430 con 0x7fc8241ef700 2024-09-11T22:28:31.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.153+0000 7fc80bfff640 1 -- 172.21.15.100:0/1612950689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8241ef700 msgr2=0x7fc8241efb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.153+0000 7fc80bfff640 1 --2- 172.21.15.100:0/1612950689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8241ef700 0x7fc8241efb10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc81400d870 tx=0x7fc8140046c0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.153+0000 7fc80bfff640 1 -- 172.21.15.100:0/1612950689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8241ef700 msgr2=0x7fc8241efb10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:28:31.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.153+0000 7fc80bfff640 1 --2- 172.21.15.100:0/1612950689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8241ef700 0x7fc8241efb10 secure :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc81400d870 tx=0x7fc8140046c0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.155 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:28:31.155 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:28:31.155 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:28:31.155 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:28:31.155 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 60, 2024-09-11T22:28:31.155 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 401874, 2024-09-11T22:28:31.155 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:28:31.155 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:28:31.155 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:28:31.155 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:28:31.155 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:31.156 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:28:31.156 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:28:31.156 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:28:31.156 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:28:31.156 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:31.156 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:31.156 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:31.156 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:31.156 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:31.156 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:31.156 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:31.157 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:31.157 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:31.157 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:31.157 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:31.157 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:31.157 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:28:31.157 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:28:31.157 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:31.157 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:31.157 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:31.157 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:31.157 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:31.157 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:31.157 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:31.158 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:31.158 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:31.158 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:31.158 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:31.158 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:31.158 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.158 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:28:31.158 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:28:31.158 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:28:31.158 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:28:31.158 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:28:31.158 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:28:31.158 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:28:31.158 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:28:31.159 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:28:31.159 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:28:31.159 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:28:31.159 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:28:31.159 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:28:31.159 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:28:31.159 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:28:31.159 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:28:31.159 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:28:31.159 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:31.159 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:31.159 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:31.159 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:31.159 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:31.160 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:31.160 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:31.160 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:31.160 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:31.160 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:31.160 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:31.160 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:31.160 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:28:31.160 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.160 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:28:31.160 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.160 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:28:31.160 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:28:31.161 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:31.161 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:31.161 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.161 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:31.161 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:28:31.161 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:31.161 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.161 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.161 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:31.161 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:28:31.161 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:31.161 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:31.161 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:31.162 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.162 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:28:31.162 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:28:31.162 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:31.162 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:31.162 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:31.162 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.162 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.163 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:28:31.164 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:28:31.164 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:31.164 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:31.164 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.164 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:31.164 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:28:31.164 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:31.164 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.164 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.164 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:31.164 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:28:31.164 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:28:31.165 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:31.166 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.167 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:28:31.167 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:28:31.167 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:31.167 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:31.167 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:31.167 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:31.167 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:31.167 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.167 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:28:31.167 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:28:31.167 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.167 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:31.168 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:31.168 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:28:31.168 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:31.168 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:31.168 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:28:31.168 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.168 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:31.168 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:31.168 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:28:31.168 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:31.168 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:31.168 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:28:31.169 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.169 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:31.169 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:31.169 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:28:31.169 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:31.169 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:31.169 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:28:31.169 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.169 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:31.169 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:31.169 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:28:31.169 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:31.169 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:31.169 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:28:31.170 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:31.170 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:31.170 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:31.170 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:28:31.170 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:31.170 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:31.170 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:31.170 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:28:31.170 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:28:31.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.153+0000 7fc829e47640 1 -- 172.21.15.100:0/1612950689 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc81006be60 msgr2=0x7fc81006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.153+0000 7fc829e47640 1 --2- 172.21.15.100:0/1612950689 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc81006be60 0x7fc81006e320 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc81c033000 tx=0x7fc81c009000 comp rx=0 tx=0).stop 2024-09-11T22:28:31.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.153+0000 7fc829e47640 1 -- 172.21.15.100:0/1612950689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8240c8b10 msgr2=0x7fc82415b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.153+0000 7fc829e47640 1 --2- 172.21.15.100:0/1612950689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8240c8b10 0x7fc82415b2d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc81800c470 tx=0x7fc818001e70 comp rx=0 tx=0).stop 2024-09-11T22:28:31.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.153+0000 7fc823fff640 1 -- 172.21.15.100:0/1612950689 reap_dead start 2024-09-11T22:28:31.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.153+0000 7fc823fff640 1 -- 172.21.15.100:0/1612950689 reap_dead start 2024-09-11T22:28:31.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.153+0000 7fc829e47640 1 -- 172.21.15.100:0/1612950689 shutdown_connections 2024-09-11T22:28:31.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.153+0000 7fc829e47640 1 -- 172.21.15.100:0/1612950689 >> 172.21.15.100:0/1612950689 conn(0x7fc82406e000 msgr2=0x7fc82406e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:31.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.153+0000 7fc829e47640 1 -- 172.21.15.100:0/1612950689 shutdown_connections 2024-09-11T22:28:31.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.153+0000 7fc829e47640 1 -- 172.21.15.100:0/1612950689 wait complete. 2024-09-11T22:28:31.173 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:28:31.173 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-11T22:28:31.173 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-11T22:28:31.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.280+0000 7f9dd3042640 1 Processor -- start 2024-09-11T22:28:31.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.280+0000 7f9dd3042640 1 -- start start 2024-09-11T22:28:31.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.281+0000 7f9dd3042640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dcc154c20 0x7f9dcc0cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.281+0000 7f9dd3042640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dcc15ac90 con 0x7f9dcc15a7e0 2024-09-11T22:28:31.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.281+0000 7f9dd3042640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dcc15af70 con 0x7f9dcc0b3190 2024-09-11T22:28:31.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.281+0000 7f9dd3042640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9dcc15e000 con 0x7f9dcc154c20 2024-09-11T22:28:31.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.281+0000 7f9dd15df640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f9dcc15a7e0 0x7f9dcc0cbd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57214/0 (socket says 172.21.15.100:57214) 2024-09-11T22:28:31.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.281+0000 7f9dd15df640 1 -- 172.21.15.100:0/3626387775 learned_addr learned my addr 172.21.15.100:0/3626387775 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:28:31.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.282+0000 7f9dd0dde640 1 --2- 172.21.15.100:0/3626387775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dcc154c20 0x7f9dcc0cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.282+0000 7f9dcb7fe640 1 -- 172.21.15.100:0/3626387775 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3377300736 0 0) 0x7f9dcc15ac90 con 0x7f9dcc15a7e0 2024-09-11T22:28:31.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.282+0000 7f9dcb7fe640 1 -- 172.21.15.100:0/3626387775 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dbc003520 con 0x7f9dcc15a7e0 2024-09-11T22:28:31.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.282+0000 7f9dcb7fe640 1 -- 172.21.15.100:0/3626387775 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3227054435 0 0) 0x7f9dcc15af70 con 0x7f9dcc0b3190 2024-09-11T22:28:31.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.282+0000 7f9dcb7fe640 1 -- 172.21.15.100:0/3626387775 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dcc15ac90 con 0x7f9dcc0b3190 2024-09-11T22:28:31.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.282+0000 7f9dd0dde640 1 -- 172.21.15.100:0/3626387775 >> v1:172.21.15.167:6789/0 conn(0x7f9dcc0b3190 legacy=0x7f9dcc15e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.282+0000 7f9dd0dde640 1 -- 172.21.15.100:0/3626387775 >> v1:172.21.15.100:6789/0 conn(0x7f9dcc15a7e0 legacy=0x7f9dcc0cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.282+0000 7f9dd0dde640 1 -- 172.21.15.100:0/3626387775 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dcc15b250 con 0x7f9dcc154c20 2024-09-11T22:28:31.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.283+0000 7f9dd0dde640 1 --2- 172.21.15.100:0/3626387775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dcc154c20 0x7f9dcc0cb120 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00097d0 tx=0x7f9dc002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dfab82076b23b4c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:31.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.283+0000 7f9dcb7fe640 1 -- 172.21.15.100:0/3626387775 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0037070 con 0x7f9dcc154c20 2024-09-11T22:28:31.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.283+0000 7f9dcb7fe640 1 -- 172.21.15.100:0/3626387775 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc0032440 con 0x7f9dcc154c20 2024-09-11T22:28:31.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.283+0000 7f9dcb7fe640 1 -- 172.21.15.100:0/3626387775 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0032810 con 0x7f9dcc154c20 2024-09-11T22:28:31.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.284+0000 7f9dd3042640 1 -- 172.21.15.100:0/3626387775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dcc154c20 msgr2=0x7f9dcc0cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.284+0000 7f9dd3042640 1 --2- 172.21.15.100:0/3626387775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dcc154c20 0x7f9dcc0cb120 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00097d0 tx=0x7f9dc002a210 comp rx=0 tx=0).stop 2024-09-11T22:28:31.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.284+0000 7f9dd3042640 1 -- 172.21.15.100:0/3626387775 shutdown_connections 2024-09-11T22:28:31.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.284+0000 7f9dd3042640 1 --2- 172.21.15.100:0/3626387775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dcc154c20 0x7f9dcc0cb120 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.284+0000 7f9dd3042640 1 -- 172.21.15.100:0/3626387775 >> 172.21.15.100:0/3626387775 conn(0x7f9dcc067d40 msgr2=0x7f9dcc06d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:31.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.284+0000 7f9dd3042640 1 -- 172.21.15.100:0/3626387775 shutdown_connections 2024-09-11T22:28:31.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.284+0000 7f9dd3042640 1 -- 172.21.15.100:0/3626387775 wait complete. 2024-09-11T22:28:31.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.285+0000 7f9dd3042640 1 Processor -- start 2024-09-11T22:28:31.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.285+0000 7f9dd3042640 1 -- start start 2024-09-11T22:28:31.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.286+0000 7f9dd3042640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dcc0b3190 0x7f9dcc1f11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.286+0000 7f9dd3042640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dcc154c20 0x7f9dcc0cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.286+0000 7f9dd3042640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dcc15a7e0 0x7f9dcc1502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.286+0000 7f9dd3042640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc15ed20 con 0x7f9dcc15a7e0 2024-09-11T22:28:31.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.286+0000 7f9dd3042640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc15eba0 con 0x7f9dcc154c20 2024-09-11T22:28:31.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.286+0000 7f9dd3042640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9dcc0cc420 con 0x7f9dcc0b3190 2024-09-11T22:28:31.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.286+0000 7f9dd15df640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dcc15a7e0 0x7f9dcc1502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.286+0000 7f9dd15df640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dcc15a7e0 0x7f9dcc1502b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:43906/0 (socket says 172.21.15.100:43906) 2024-09-11T22:28:31.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.286+0000 7f9dd15df640 1 -- 172.21.15.100:0/598731866 learned_addr learned my addr 172.21.15.100:0/598731866 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:31.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.286+0000 7f9dd0dde640 1 --2- 172.21.15.100:0/598731866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dcc0b3190 0x7f9dcc1f11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.286+0000 7f9dcbfff640 1 --2- 172.21.15.100:0/598731866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dcc154c20 0x7f9dcc0cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.286+0000 7f9dd15df640 1 -- 172.21.15.100:0/598731866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dcc0b3190 msgr2=0x7f9dcc1f11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.286+0000 7f9dd15df640 1 --2- 172.21.15.100:0/598731866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dcc0b3190 0x7f9dcc1f11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.286+0000 7f9dd15df640 1 -- 172.21.15.100:0/598731866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dcc154c20 msgr2=0x7f9dcc0cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.286+0000 7f9dd15df640 1 --2- 172.21.15.100:0/598731866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dcc154c20 0x7f9dcc0cf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.286+0000 7f9dd15df640 1 -- 172.21.15.100:0/598731866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dcc150c90 con 0x7f9dcc15a7e0 2024-09-11T22:28:31.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.287+0000 7f9dd15df640 1 --2- 172.21.15.100:0/598731866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dcc15a7e0 0x7f9dcc1502b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400cac0 tx=0x7f9dc400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:31.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.287+0000 7f9dc97fa640 1 -- 172.21.15.100:0/598731866 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4017070 con 0x7f9dcc15a7e0 2024-09-11T22:28:31.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.287+0000 7f9dc97fa640 1 -- 172.21.15.100:0/598731866 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc400abd0 con 0x7f9dcc15a7e0 2024-09-11T22:28:31.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.287+0000 7f9dd3042640 1 -- 172.21.15.100:0/598731866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dcc15d930 con 0x7f9dcc15a7e0 2024-09-11T22:28:31.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.287+0000 7f9dc97fa640 1 -- 172.21.15.100:0/598731866 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4012400 con 0x7f9dcc15a7e0 2024-09-11T22:28:31.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.287+0000 7f9dd3042640 1 -- 172.21.15.100:0/598731866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dcc15bd20 con 0x7f9dcc15a7e0 2024-09-11T22:28:31.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.288+0000 7f9dd3042640 1 -- 172.21.15.100:0/598731866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dcc0cbaf0 con 0x7f9dcc15a7e0 2024-09-11T22:28:31.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.288+0000 7f9dc97fa640 1 -- 172.21.15.100:0/598731866 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9dc401a070 con 0x7f9dcc15a7e0 2024-09-11T22:28:31.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.289+0000 7f9dc97fa640 1 --2- 172.21.15.100:0/598731866 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9db006be60 0x7f9db006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:31.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.289+0000 7f9dc97fa640 1 -- 172.21.15.100:0/598731866 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f9dc408b000 con 0x7f9dcc15a7e0 2024-09-11T22:28:31.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.289+0000 7f9dd0dde640 1 --2- 172.21.15.100:0/598731866 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9db006be60 0x7f9db006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:31.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.289+0000 7f9dd0dde640 1 --2- 172.21.15.100:0/598731866 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9db006be60 0x7f9db006e320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0034000 tx=0x7f9dc002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:31.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.295+0000 7f9dc97fa640 1 -- 172.21.15.100:0/598731866 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9dc4059500 con 0x7f9dcc15a7e0 2024-09-11T22:28:31.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.586+0000 7f9dd3042640 1 -- 172.21.15.100:0/598731866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f9dcc15e470 con 0x7f9dcc15a7e0 2024-09-11T22:28:31.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.587+0000 7f9dc97fa640 1 -- 172.21.15.100:0/598731866 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f9dc4058e00 con 0x7f9dcc15a7e0 2024-09-11T22:28:31.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.590+0000 7f9dd3042640 1 -- 172.21.15.100:0/598731866 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9db006be60 msgr2=0x7f9db006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.590+0000 7f9dd3042640 1 --2- 172.21.15.100:0/598731866 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9db006be60 0x7f9db006e320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0034000 tx=0x7f9dc002e000 comp rx=0 tx=0).stop 2024-09-11T22:28:31.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.590+0000 7f9dd3042640 1 -- 172.21.15.100:0/598731866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dcc15a7e0 msgr2=0x7f9dcc1502b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:31.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.590+0000 7f9dd3042640 1 --2- 172.21.15.100:0/598731866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dcc15a7e0 0x7f9dcc1502b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400cac0 tx=0x7f9dc400cf80 comp rx=0 tx=0).stop 2024-09-11T22:28:31.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.590+0000 7f9dd3042640 1 -- 172.21.15.100:0/598731866 shutdown_connections 2024-09-11T22:28:31.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.590+0000 7f9dd3042640 1 --2- 172.21.15.100:0/598731866 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9db006be60 0x7f9db006e320 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.590+0000 7f9dd3042640 1 --2- 172.21.15.100:0/598731866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9dcc15a7e0 0x7f9dcc1502b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.590+0000 7f9dd3042640 1 --2- 172.21.15.100:0/598731866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dcc154c20 0x7f9dcc0cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.590+0000 7f9dd3042640 1 --2- 172.21.15.100:0/598731866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dcc0b3190 0x7f9dcc1f11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:31.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.590+0000 7f9dd3042640 1 -- 172.21.15.100:0/598731866 >> 172.21.15.100:0/598731866 conn(0x7f9dcc067d40 msgr2=0x7f9dcc0cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:31.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.590+0000 7f9dd3042640 1 -- 172.21.15.100:0/598731866 shutdown_connections 2024-09-11T22:28:31.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:31.590+0000 7f9dd3042640 1 -- 172.21.15.100:0/598731866 wait complete. 2024-09-11T22:28:31.603 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-11T22:28:41.604 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:28:41.604 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:28:41.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.719+0000 7f91b6f5f640 1 Processor -- start 2024-09-11T22:28:41.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.719+0000 7f91b6f5f640 1 -- start start 2024-09-11T22:28:41.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.720+0000 7f91b6f5f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f91b00caf70 0x7f91b015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:41.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.720+0000 7f91b6f5f640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f91b00c98d0 0x7f91b00c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:41.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.720+0000 7f91b6f5f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b00c5a20 con 0x7f91b00c8020 2024-09-11T22:28:41.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.720+0000 7f91b6f5f640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f91b015ed80 con 0x7f91b00c98d0 2024-09-11T22:28:41.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.720+0000 7f91b6f5f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f91b015e4e0 con 0x7f91b00caf70 2024-09-11T22:28:41.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.720+0000 7f91b54fc640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f91b00c98d0 0x7f91b00c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:41.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.720+0000 7f91b54fc640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f91b00c98d0 0x7f91b00c9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59768/0 (socket says 172.21.15.100:59768) 2024-09-11T22:28:41.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.720+0000 7f91b54fc640 1 -- 172.21.15.100:0/3578559906 learned_addr learned my addr 172.21.15.100:0/3578559906 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:41.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.720+0000 7f91b4cfb640 1 --2- 172.21.15.100:0/3578559906 >> v2:172.21.15.167:3300/0 conn(0x7f91b00caf70 0x7f91b015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:41.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.721+0000 7f91b54fc640 1 -- 172.21.15.100:0/3578559906 >> v2:172.21.15.167:3300/0 conn(0x7f91b00caf70 msgr2=0x7f91b015de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:41.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.721+0000 7f91b54fc640 1 --2- 172.21.15.100:0/3578559906 >> v2:172.21.15.167:3300/0 conn(0x7f91b00caf70 0x7f91b015de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:41.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.721+0000 7f91b54fc640 1 -- 172.21.15.100:0/3578559906 >> v1:172.21.15.167:6789/0 conn(0x7f91b00c8020 legacy=0x7f91b015b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:41.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.721+0000 7f91b54fc640 1 -- 172.21.15.100:0/3578559906 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b015e7c0 con 0x7f91b00c98d0 2024-09-11T22:28:41.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.722+0000 7f91b54fc640 1 --2- 172.21.15.100:0/3578559906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91b00c98d0 0x7f91b00c9cf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f91b00cf110 tx=0x7f91a802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6cd05a4a1298756 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:41.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.722+0000 7f91af7fe640 1 -- 172.21.15.100:0/3578559906 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a8036070 con 0x7f91b00c98d0 2024-09-11T22:28:41.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.722+0000 7f91af7fe640 1 -- 172.21.15.100:0/3578559906 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a8031600 con 0x7f91b00c98d0 2024-09-11T22:28:41.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.722+0000 7f91af7fe640 1 -- 172.21.15.100:0/3578559906 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a80319f0 con 0x7f91b00c98d0 2024-09-11T22:28:41.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.722+0000 7f91b6f5f640 1 -- 172.21.15.100:0/3578559906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91b00c98d0 msgr2=0x7f91b00c9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:41.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.722+0000 7f91b6f5f640 1 --2- 172.21.15.100:0/3578559906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91b00c98d0 0x7f91b00c9cf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f91b00cf110 tx=0x7f91a802a7c0 comp rx=0 tx=0).stop 2024-09-11T22:28:41.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.723+0000 7f91b6f5f640 1 -- 172.21.15.100:0/3578559906 shutdown_connections 2024-09-11T22:28:41.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.723+0000 7f91b6f5f640 1 --2- 172.21.15.100:0/3578559906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91b00c98d0 0x7f91b00c9cf0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:41.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.723+0000 7f91b6f5f640 1 --2- 172.21.15.100:0/3578559906 >> v2:172.21.15.167:3300/0 conn(0x7f91b00caf70 0x7f91b015de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:41.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.723+0000 7f91b6f5f640 1 -- 172.21.15.100:0/3578559906 >> 172.21.15.100:0/3578559906 conn(0x7f91b0073900 msgr2=0x7f91b0073ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:41.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.723+0000 7f91b6f5f640 1 -- 172.21.15.100:0/3578559906 shutdown_connections 2024-09-11T22:28:41.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.723+0000 7f91b6f5f640 1 -- 172.21.15.100:0/3578559906 wait complete. 2024-09-11T22:28:41.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.724+0000 7f91b6f5f640 1 Processor -- start 2024-09-11T22:28:41.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.724+0000 7f91b6f5f640 1 -- start start 2024-09-11T22:28:41.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.725+0000 7f91b6f5f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91b00c8020 0x7f91b01e4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:41.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.725+0000 7f91b6f5f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91b00c98d0 0x7f91b01595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:41.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.725+0000 7f91b6f5f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91b00caf70 0x7f91b01f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:41.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.725+0000 7f91b6f5f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f91b015ad60 con 0x7f91b00caf70 2024-09-11T22:28:41.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.725+0000 7f91b6f5f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f91b015aa80 con 0x7f91b00c8020 2024-09-11T22:28:41.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.725+0000 7f91b6f5f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f91b00cb350 con 0x7f91b00c98d0 2024-09-11T22:28:41.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.725+0000 7f91b54fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91b00caf70 0x7f91b01f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:41.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.725+0000 7f91b54fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91b00caf70 0x7f91b01f42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59778/0 (socket says 172.21.15.100:59778) 2024-09-11T22:28:41.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.725+0000 7f91b54fc640 1 -- 172.21.15.100:0/3222389093 learned_addr learned my addr 172.21.15.100:0/3222389093 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:41.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.726+0000 7f91b4cfb640 1 --2- 172.21.15.100:0/3222389093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91b00c8020 0x7f91b01e4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:41.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.726+0000 7f91affff640 1 --2- 172.21.15.100:0/3222389093 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91b00c98d0 0x7f91b01595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:41.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.726+0000 7f91b54fc640 1 -- 172.21.15.100:0/3222389093 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91b00c98d0 msgr2=0x7f91b01595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:41.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.726+0000 7f91b54fc640 1 --2- 172.21.15.100:0/3222389093 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91b00c98d0 0x7f91b01595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:41.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.726+0000 7f91b54fc640 1 -- 172.21.15.100:0/3222389093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91b00c8020 msgr2=0x7f91b01e4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:41.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.726+0000 7f91b54fc640 1 --2- 172.21.15.100:0/3222389093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91b00c8020 0x7f91b01e4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:41.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.726+0000 7f91b54fc640 1 -- 172.21.15.100:0/3222389093 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b00c8750 con 0x7f91b00caf70 2024-09-11T22:28:41.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.726+0000 7f91b54fc640 1 --2- 172.21.15.100:0/3222389093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91b00caf70 0x7f91b01f42a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f91a802a800 tx=0x7f91a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:41.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.726+0000 7f91ad7fa640 1 -- 172.21.15.100:0/3222389093 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a8036050 con 0x7f91b00caf70 2024-09-11T22:28:41.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.726+0000 7f91ad7fa640 1 -- 172.21.15.100:0/3222389093 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a8042070 con 0x7f91b00caf70 2024-09-11T22:28:41.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.726+0000 7f91b6f5f640 1 -- 172.21.15.100:0/3222389093 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b00c8a30 con 0x7f91b00caf70 2024-09-11T22:28:41.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.726+0000 7f91ad7fa640 1 -- 172.21.15.100:0/3222389093 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a8009510 con 0x7f91b00caf70 2024-09-11T22:28:41.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.726+0000 7f91b6f5f640 1 -- 172.21.15.100:0/3222389093 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b00c8ff0 con 0x7f91b00caf70 2024-09-11T22:28:41.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.727+0000 7f91b6f5f640 1 -- 172.21.15.100:0/3222389093 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91b00c3090 con 0x7f91b00caf70 2024-09-11T22:28:41.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.728+0000 7f91ad7fa640 1 -- 172.21.15.100:0/3222389093 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f91a8004470 con 0x7f91b00caf70 2024-09-11T22:28:41.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.728+0000 7f91ad7fa640 1 --2- 172.21.15.100:0/3222389093 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f919406be30 0x7f919406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:41.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.729+0000 7f91b4cfb640 1 --2- 172.21.15.100:0/3222389093 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f919406be30 0x7f919406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:41.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.729+0000 7f91ad7fa640 1 -- 172.21.15.100:0/3222389093 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f91a80ac020 con 0x7f91b00caf70 2024-09-11T22:28:41.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.729+0000 7f91b4cfb640 1 --2- 172.21.15.100:0/3222389093 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f919406be30 0x7f919406e2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f91a4009b40 tx=0x7f91a4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:41.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:41.733+0000 7f91ad7fa640 1 -- 172.21.15.100:0/3222389093 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f91a8079ed0 con 0x7f91b00caf70 2024-09-11T22:28:42.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.018+0000 7f91b6f5f640 1 -- 172.21.15.100:0/3222389093 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f91b0154a50 con 0x7f91b00caf70 2024-09-11T22:28:42.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.018+0000 7f91ad7fa640 1 -- 172.21.15.100:0/3222389093 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f91a807e1d0 con 0x7f91b00caf70 2024-09-11T22:28:42.019 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":60,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:28:42.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.020+0000 7f91b6f5f640 1 -- 172.21.15.100:0/3222389093 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f919406be30 msgr2=0x7f919406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.020+0000 7f91b6f5f640 1 --2- 172.21.15.100:0/3222389093 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f919406be30 0x7f919406e2f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f91a4009b40 tx=0x7f91a4009190 comp rx=0 tx=0).stop 2024-09-11T22:28:42.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.020+0000 7f91b6f5f640 1 -- 172.21.15.100:0/3222389093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91b00caf70 msgr2=0x7f91b01f42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.020+0000 7f91b6f5f640 1 --2- 172.21.15.100:0/3222389093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91b00caf70 0x7f91b01f42a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f91a802a800 tx=0x7f91a8004a40 comp rx=0 tx=0).stop 2024-09-11T22:28:42.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.020+0000 7f91b6f5f640 1 -- 172.21.15.100:0/3222389093 shutdown_connections 2024-09-11T22:28:42.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.020+0000 7f91b6f5f640 1 --2- 172.21.15.100:0/3222389093 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f919406be30 0x7f919406e2f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.020+0000 7f91b6f5f640 1 --2- 172.21.15.100:0/3222389093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91b00caf70 0x7f91b01f42a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.020+0000 7f91b6f5f640 1 --2- 172.21.15.100:0/3222389093 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91b00c98d0 0x7f91b01595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.020+0000 7f91b6f5f640 1 --2- 172.21.15.100:0/3222389093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91b00c8020 0x7f91b01e4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.020+0000 7f91b6f5f640 1 -- 172.21.15.100:0/3222389093 >> 172.21.15.100:0/3222389093 conn(0x7f91b0073900 msgr2=0x7f91b01579b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:42.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.021+0000 7f91b6f5f640 1 -- 172.21.15.100:0/3222389093 shutdown_connections 2024-09-11T22:28:42.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.021+0000 7f91b6f5f640 1 -- 172.21.15.100:0/3222389093 wait complete. 2024-09-11T22:28:42.032 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:28:42.032 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-11T22:28:42.032 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:28:42.033 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:28:42.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.151+0000 7f3fe2d31640 1 Processor -- start 2024-09-11T22:28:42.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.151+0000 7f3fe2d31640 1 -- start start 2024-09-11T22:28:42.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.152+0000 7f3fe2d31640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3fdc154cd0 0x7f3fdc15bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.152+0000 7f3fe2d31640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fdc0c71e0 0x7f3fdc165140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.152+0000 7f3fe2d31640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fdc0738d0 con 0x7f3fdc15e7c0 2024-09-11T22:28:42.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.152+0000 7f3fe2d31640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f3fdc15ecb0 con 0x7f3fdc154cd0 2024-09-11T22:28:42.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.152+0000 7f3fe2d31640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3fdc072830 con 0x7f3fdc0c71e0 2024-09-11T22:28:42.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.153+0000 7f3fe12ce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fdc0c71e0 0x7f3fdc165140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.153+0000 7f3fe0acd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3fdc154cd0 0x7f3fdc15bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.153+0000 7f3fe12ce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fdc0c71e0 0x7f3fdc165140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:57730/0 (socket says 172.21.15.100:57730) 2024-09-11T22:28:42.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.153+0000 7f3fe12ce640 1 -- 172.21.15.100:0/1161732798 learned_addr learned my addr 172.21.15.100:0/1161732798 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:42.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.153+0000 7f3fe12ce640 1 -- 172.21.15.100:0/1161732798 >> v2:172.21.15.167:3300/0 conn(0x7f3fdc154cd0 msgr2=0x7f3fdc15bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:42.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.153+0000 7f3fe12ce640 1 --2- 172.21.15.100:0/1161732798 >> v2:172.21.15.167:3300/0 conn(0x7f3fdc154cd0 0x7f3fdc15bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.153+0000 7f3fe12ce640 1 -- 172.21.15.100:0/1161732798 >> v1:172.21.15.167:6789/0 conn(0x7f3fdc15e7c0 legacy=0x7f3fdc0cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.153+0000 7f3fe12ce640 1 -- 172.21.15.100:0/1161732798 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fdc072b10 con 0x7f3fdc0c71e0 2024-09-11T22:28:42.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.154+0000 7f3fe12ce640 1 --2- 172.21.15.100:0/1161732798 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fdc0c71e0 0x7f3fdc165140 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4009e50 tx=0x7f3fd402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e45b4e42bb746318 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:42.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.154+0000 7f3fdb7fe640 1 -- 172.21.15.100:0/1161732798 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4036070 con 0x7f3fdc0c71e0 2024-09-11T22:28:42.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.154+0000 7f3fdb7fe640 1 -- 172.21.15.100:0/1161732798 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd4031600 con 0x7f3fdc0c71e0 2024-09-11T22:28:42.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.154+0000 7f3fdb7fe640 1 -- 172.21.15.100:0/1161732798 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd40319d0 con 0x7f3fdc0c71e0 2024-09-11T22:28:42.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.155+0000 7f3fe2d31640 1 -- 172.21.15.100:0/1161732798 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fdc0c71e0 msgr2=0x7f3fdc165140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.155+0000 7f3fe2d31640 1 --2- 172.21.15.100:0/1161732798 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fdc0c71e0 0x7f3fdc165140 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4009e50 tx=0x7f3fd402a710 comp rx=0 tx=0).stop 2024-09-11T22:28:42.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.155+0000 7f3fe2d31640 1 -- 172.21.15.100:0/1161732798 shutdown_connections 2024-09-11T22:28:42.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.155+0000 7f3fe2d31640 1 --2- 172.21.15.100:0/1161732798 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fdc0c71e0 0x7f3fdc165140 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.155+0000 7f3fe2d31640 1 --2- 172.21.15.100:0/1161732798 >> v2:172.21.15.167:3300/0 conn(0x7f3fdc154cd0 0x7f3fdc15bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.155+0000 7f3fe2d31640 1 -- 172.21.15.100:0/1161732798 >> 172.21.15.100:0/1161732798 conn(0x7f3fdc06fa70 msgr2=0x7f3fdc06fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:42.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.155+0000 7f3fe2d31640 1 -- 172.21.15.100:0/1161732798 shutdown_connections 2024-09-11T22:28:42.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.155+0000 7f3fe2d31640 1 -- 172.21.15.100:0/1161732798 wait complete. 2024-09-11T22:28:42.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.156+0000 7f3fe2d31640 1 Processor -- start 2024-09-11T22:28:42.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.156+0000 7f3fe2d31640 1 -- start start 2024-09-11T22:28:42.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.157+0000 7f3fe2d31640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fdc0c71e0 0x7f3fdc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.157+0000 7f3fe2d31640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fdc154cd0 0x7f3fdc1588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.157+0000 7f3fe2d31640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fdc15e7c0 0x7f3fdc150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.157+0000 7f3fe2d31640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc075770 con 0x7f3fdc154cd0 2024-09-11T22:28:42.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.157+0000 7f3fe2d31640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc0730d0 con 0x7f3fdc0c71e0 2024-09-11T22:28:42.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.157+0000 7f3fe2d31640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3fdc0cce50 con 0x7f3fdc15e7c0 2024-09-11T22:28:42.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.157+0000 7f3fe0acd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fdc0c71e0 0x7f3fdc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.157+0000 7f3fdbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fdc154cd0 0x7f3fdc1588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.157+0000 7f3fe0acd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fdc0c71e0 0x7f3fdc0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:51974/0 (socket says 172.21.15.100:51974) 2024-09-11T22:28:42.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.157+0000 7f3fe12ce640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fdc15e7c0 0x7f3fdc150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.157+0000 7f3fe0acd640 1 -- 172.21.15.100:0/3968743480 learned_addr learned my addr 172.21.15.100:0/3968743480 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:42.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.158+0000 7f3fdbfff640 1 -- 172.21.15.100:0/3968743480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fdc15e7c0 msgr2=0x7f3fdc150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.158+0000 7f3fdbfff640 1 --2- 172.21.15.100:0/3968743480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fdc15e7c0 0x7f3fdc150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.158+0000 7f3fdbfff640 1 -- 172.21.15.100:0/3968743480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fdc0c71e0 msgr2=0x7f3fdc0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.158+0000 7f3fdbfff640 1 --2- 172.21.15.100:0/3968743480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fdc0c71e0 0x7f3fdc0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.158+0000 7f3fdbfff640 1 -- 172.21.15.100:0/3968743480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fdc0c3830 con 0x7f3fdc154cd0 2024-09-11T22:28:42.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.158+0000 7f3fe0acd640 1 --2- 172.21.15.100:0/3968743480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fdc0c71e0 0x7f3fdc0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:42.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.158+0000 7f3fe12ce640 1 --2- 172.21.15.100:0/3968743480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fdc15e7c0 0x7f3fdc150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:42.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.158+0000 7f3fdbfff640 1 --2- 172.21.15.100:0/3968743480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fdc154cd0 0x7f3fdc1588f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3fc800c340 tx=0x7f3fc800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:42.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.158+0000 7f3fd97fa640 1 -- 172.21.15.100:0/3968743480 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc80052d0 con 0x7f3fdc154cd0 2024-09-11T22:28:42.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.158+0000 7f3fd97fa640 1 -- 172.21.15.100:0/3968743480 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc8005490 con 0x7f3fdc154cd0 2024-09-11T22:28:42.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.158+0000 7f3fe2d31640 1 -- 172.21.15.100:0/3968743480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fdc1f3d70 con 0x7f3fdc154cd0 2024-09-11T22:28:42.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.158+0000 7f3fd97fa640 1 -- 172.21.15.100:0/3968743480 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8007260 con 0x7f3fdc154cd0 2024-09-11T22:28:42.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.158+0000 7f3fe2d31640 1 -- 172.21.15.100:0/3968743480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fdc1f0bc0 con 0x7f3fdc154cd0 2024-09-11T22:28:42.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.159+0000 7f3fe2d31640 1 --2- 172.21.15.100:0/3968743480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fdc158440 0x7f3fdc1f0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.159+0000 7f3fe2d31640 1 -- 172.21.15.100:0/3968743480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc1f16a0 con 0x7f3fdc158440 2024-09-11T22:28:42.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.159+0000 7f3fe0acd640 1 --2- 172.21.15.100:0/3968743480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fdc158440 0x7f3fdc1f0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.160+0000 7f3fe0acd640 1 -- 172.21.15.100:0/3968743480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3fdc0c7800 con 0x7f3fdc158440 2024-09-11T22:28:42.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.160+0000 7f3fe0acd640 1 --2- 172.21.15.100:0/3968743480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fdc158440 0x7f3fdc1f0dc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0011db0 tx=0x7f3fd000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:42.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.160+0000 7f3fd97fa640 1 -- 172.21.15.100:0/3968743480 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3fc8007400 con 0x7f3fdc154cd0 2024-09-11T22:28:42.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.160+0000 7f3fd97fa640 1 --2- 172.21.15.100:0/3968743480 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3fc006be30 0x7f3fc006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.161+0000 7f3fe12ce640 1 --2- 172.21.15.100:0/3968743480 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3fc006be30 0x7f3fc006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.161+0000 7f3fd97fa640 1 -- 172.21.15.100:0/3968743480 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f3fc808a6d0 con 0x7f3fdc154cd0 2024-09-11T22:28:42.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.161+0000 7f3fd97fa640 1 -- 172.21.15.100:0/3968743480 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0004030 con 0x7f3fdc158440 2024-09-11T22:28:42.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.161+0000 7f3fd97fa640 1 -- 172.21.15.100:0/3968743480 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3fd00041d0 con 0x7f3fdc158440 2024-09-11T22:28:42.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.161+0000 7f3fd97fa640 1 -- 172.21.15.100:0/3968743480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fdc158440 msgr2=0x7f3fdc1f0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.161+0000 7f3fd97fa640 1 --2- 172.21.15.100:0/3968743480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fdc158440 0x7f3fdc1f0dc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0011db0 tx=0x7f3fd000f610 comp rx=0 tx=0).stop 2024-09-11T22:28:42.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.161+0000 7f3fd97fa640 1 -- 172.21.15.100:0/3968743480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fdc158440 msgr2=0x7f3fdc1f0dc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:28:42.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.161+0000 7f3fd97fa640 1 --2- 172.21.15.100:0/3968743480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fdc158440 0x7f3fdc1f0dc0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.161+0000 7f3fe12ce640 1 --2- 172.21.15.100:0/3968743480 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3fc006be30 0x7f3fc006e2f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4033000 tx=0x7f3fd4009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:42.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.171+0000 7f3fe2d31640 1 --2- 172.21.15.100:0/3968743480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fdc15b350 0x7f3fdc1550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.171+0000 7f3fe2d31640 1 -- 172.21.15.100:0/3968743480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc0722d0 con 0x7f3fdc15b350 2024-09-11T22:28:42.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.171+0000 7f3fe0acd640 1 --2- 172.21.15.100:0/3968743480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fdc15b350 0x7f3fdc1550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.171+0000 7f3fe0acd640 1 -- 172.21.15.100:0/3968743480 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3fdc0c7d00 con 0x7f3fdc15b350 2024-09-11T22:28:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.171+0000 7f3fe0acd640 1 --2- 172.21.15.100:0/3968743480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fdc15b350 0x7f3fdc1550b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3fd001b000 tx=0x7f3fd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.171+0000 7f3fd97fa640 1 -- 172.21.15.100:0/3968743480 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0014970 con 0x7f3fdc15b350 2024-09-11T22:28:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.172+0000 7f3fd97fa640 1 -- 172.21.15.100:0/3968743480 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4555 (secure 0 0 0) 0x7f3fd0014970 con 0x7f3fdc15b350 2024-09-11T22:28:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.172+0000 7f3fd97fa640 1 -- 172.21.15.100:0/3968743480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fdc15b350 msgr2=0x7f3fdc1550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.172+0000 7f3fd97fa640 1 --2- 172.21.15.100:0/3968743480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fdc15b350 0x7f3fdc1550b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3fd001b000 tx=0x7f3fd00046c0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.172+0000 7f3fd97fa640 1 -- 172.21.15.100:0/3968743480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fdc15b350 msgr2=0x7f3fdc1550b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:28:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.172+0000 7f3fd97fa640 1 --2- 172.21.15.100:0/3968743480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fdc15b350 0x7f3fdc1550b0 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3fd001b000 tx=0x7f3fd00046c0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.173 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:28:42.173 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:28:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:28:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:28:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 60, 2024-09-11T22:28:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 18601, 2024-09-11T22:28:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:28:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:28:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:28:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:28:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 12, 2024-09-11T22:28:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:28:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:28:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:28:42.174 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:28:42.175 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:28:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:42.176 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:28:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:28:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:28:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:28:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:28:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:28:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:28:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:28:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:28:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:28:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:28:42.177 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:28:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:28:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:28:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:28:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:28:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:28:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:42.178 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:28:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:28:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:28:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:28:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.179 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:28:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:28:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:28:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:28:42.180 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:28:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:28:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:28:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.181 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:28:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:28:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:28:42.182 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:28:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:28:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:28:42.183 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:42.184 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.184 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.184 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:42.184 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:28:42.184 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:42.184 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:42.184 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:42.184 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.184 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:28:42.184 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:28:42.184 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:42.185 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:42.185 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:42.185 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:42.185 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:42.185 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.185 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:28:42.185 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:28:42.185 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.185 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:42.185 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:42.185 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:28:42.185 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:42.186 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:42.186 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:28:42.186 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.186 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:42.186 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:42.186 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:28:42.186 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:42.186 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:42.186 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.186 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:28:42.186 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:28:42.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.172+0000 7f3fe2d31640 1 -- 172.21.15.100:0/3968743480 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3fc006be30 msgr2=0x7f3fc006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.172+0000 7f3fe2d31640 1 --2- 172.21.15.100:0/3968743480 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3fc006be30 0x7f3fc006e2f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4033000 tx=0x7f3fd4009000 comp rx=0 tx=0).stop 2024-09-11T22:28:42.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.172+0000 7f3fe2d31640 1 -- 172.21.15.100:0/3968743480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fdc154cd0 msgr2=0x7f3fdc1588f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.172+0000 7f3fe2d31640 1 --2- 172.21.15.100:0/3968743480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fdc154cd0 0x7f3fdc1588f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3fc800c340 tx=0x7f3fc800c800 comp rx=0 tx=0).stop 2024-09-11T22:28:42.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.172+0000 7f3fe12ce640 1 -- 172.21.15.100:0/3968743480 reap_dead start 2024-09-11T22:28:42.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.172+0000 7f3fe12ce640 1 -- 172.21.15.100:0/3968743480 reap_dead start 2024-09-11T22:28:42.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.172+0000 7f3fe2d31640 1 -- 172.21.15.100:0/3968743480 shutdown_connections 2024-09-11T22:28:42.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.172+0000 7f3fe2d31640 1 -- 172.21.15.100:0/3968743480 >> 172.21.15.100:0/3968743480 conn(0x7f3fdc06fa70 msgr2=0x7f3fdc15c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:42.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.172+0000 7f3fe2d31640 1 -- 172.21.15.100:0/3968743480 shutdown_connections 2024-09-11T22:28:42.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.172+0000 7f3fe2d31640 1 -- 172.21.15.100:0/3968743480 wait complete. 2024-09-11T22:28:42.189 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:28:42.189 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:28:42.190 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:28:42.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.302+0000 7fd8e2b03640 1 Processor -- start 2024-09-11T22:28:42.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.302+0000 7fd8e2b03640 1 -- start start 2024-09-11T22:28:42.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.303+0000 7fd8e2b03640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd8dc154d60 0x7fd8dc0cc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.303+0000 7fd8e2b03640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd8dc0c8ca0 0x7fd8dc0ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.303+0000 7fd8e2b03640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8dc15a990 con 0x7fd8dc0c8020 2024-09-11T22:28:42.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.303+0000 7fd8e2b03640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fd8dc15ac70 con 0x7fd8dc0c8ca0 2024-09-11T22:28:42.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.303+0000 7fd8e2b03640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fd8dc15af50 con 0x7fd8dc154d60 2024-09-11T22:28:42.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.303+0000 7fd8e10a0640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd8dc0c8ca0 0x7fd8dc0ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.303+0000 7fd8dbfff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd8dc0c8020 0x7fd8dc0c8590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50594/0 (socket says 172.21.15.100:50594) 2024-09-11T22:28:42.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.303+0000 7fd8e10a0640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd8dc0c8ca0 0x7fd8dc0ccc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53048/0 (socket says 172.21.15.100:53048) 2024-09-11T22:28:42.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.303+0000 7fd8dbfff640 1 -- 172.21.15.100:0/1513603924 learned_addr learned my addr 172.21.15.100:0/1513603924 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:28:42.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.303+0000 7fd8e089f640 1 --2- 172.21.15.100:0/1513603924 >> v2:172.21.15.167:3300/0 conn(0x7fd8dc154d60 0x7fd8dc0cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.303+0000 7fd8e10a0640 1 -- 172.21.15.100:0/1513603924 >> v2:172.21.15.167:3300/0 conn(0x7fd8dc154d60 msgr2=0x7fd8dc0cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:42.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.303+0000 7fd8e10a0640 1 --2- 172.21.15.100:0/1513603924 >> v2:172.21.15.167:3300/0 conn(0x7fd8dc154d60 0x7fd8dc0cc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.303+0000 7fd8e10a0640 1 -- 172.21.15.100:0/1513603924 >> v1:172.21.15.100:6789/0 conn(0x7fd8dc0c8020 legacy=0x7fd8dc0c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.303+0000 7fd8e10a0640 1 -- 172.21.15.100:0/1513603924 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8dc15b230 con 0x7fd8dc0c8ca0 2024-09-11T22:28:42.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.304+0000 7fd8e10a0640 1 --2- 172.21.15.100:0/1513603924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8dc0c8ca0 0x7fd8dc0ccc80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc071810 tx=0x7fd8d402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d663c8db091a8a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:42.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.304+0000 7fd8db7fe640 1 -- 172.21.15.100:0/1513603924 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4007740 con 0x7fd8dc0c8ca0 2024-09-11T22:28:42.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.304+0000 7fd8db7fe640 1 -- 172.21.15.100:0/1513603924 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d40078e0 con 0x7fd8dc0c8ca0 2024-09-11T22:28:42.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.304+0000 7fd8db7fe640 1 -- 172.21.15.100:0/1513603924 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4007cb0 con 0x7fd8dc0c8ca0 2024-09-11T22:28:42.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.305+0000 7fd8e2b03640 1 -- 172.21.15.100:0/1513603924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8dc0c8ca0 msgr2=0x7fd8dc0ccc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.305+0000 7fd8e2b03640 1 --2- 172.21.15.100:0/1513603924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8dc0c8ca0 0x7fd8dc0ccc80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc071810 tx=0x7fd8d402a680 comp rx=0 tx=0).stop 2024-09-11T22:28:42.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.305+0000 7fd8e2b03640 1 -- 172.21.15.100:0/1513603924 shutdown_connections 2024-09-11T22:28:42.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.305+0000 7fd8e2b03640 1 --2- 172.21.15.100:0/1513603924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8dc0c8ca0 0x7fd8dc0ccc80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.305+0000 7fd8e2b03640 1 --2- 172.21.15.100:0/1513603924 >> v2:172.21.15.167:3300/0 conn(0x7fd8dc154d60 0x7fd8dc0cc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.305+0000 7fd8e2b03640 1 -- 172.21.15.100:0/1513603924 >> 172.21.15.100:0/1513603924 conn(0x7fd8dc06fa70 msgr2=0x7fd8dc06fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:42.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.305+0000 7fd8e2b03640 1 -- 172.21.15.100:0/1513603924 shutdown_connections 2024-09-11T22:28:42.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.305+0000 7fd8e2b03640 1 -- 172.21.15.100:0/1513603924 wait complete. 2024-09-11T22:28:42.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.306+0000 7fd8e2b03640 1 Processor -- start 2024-09-11T22:28:42.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.306+0000 7fd8e2b03640 1 -- start start 2024-09-11T22:28:42.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.307+0000 7fd8e2b03640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8dc0c8020 0x7fd8dc157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.307+0000 7fd8e2b03640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8dc0c8ca0 0x7fd8dc1f07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.307+0000 7fd8e2b03640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8dc154d60 0x7fd8dc14e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.307+0000 7fd8e2b03640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd8dc15e2a0 con 0x7fd8dc154d60 2024-09-11T22:28:42.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.307+0000 7fd8e2b03640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd8dc15e120 con 0x7fd8dc0c8020 2024-09-11T22:28:42.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.307+0000 7fd8e2b03640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd8dc15e420 con 0x7fd8dc0c8ca0 2024-09-11T22:28:42.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.307+0000 7fd8e10a0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8dc154d60 0x7fd8dc14e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.307+0000 7fd8e10a0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8dc154d60 0x7fd8dc14e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53064/0 (socket says 172.21.15.100:53064) 2024-09-11T22:28:42.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.307+0000 7fd8e10a0640 1 -- 172.21.15.100:0/2391509445 learned_addr learned my addr 172.21.15.100:0/2391509445 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:42.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.307+0000 7fd8e089f640 1 --2- 172.21.15.100:0/2391509445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8dc0c8020 0x7fd8dc157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.307+0000 7fd8dbfff640 1 --2- 172.21.15.100:0/2391509445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8dc0c8ca0 0x7fd8dc1f07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.308+0000 7fd8e10a0640 1 -- 172.21.15.100:0/2391509445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8dc0c8ca0 msgr2=0x7fd8dc1f07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.308+0000 7fd8e10a0640 1 --2- 172.21.15.100:0/2391509445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8dc0c8ca0 0x7fd8dc1f07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.308+0000 7fd8e10a0640 1 -- 172.21.15.100:0/2391509445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8dc0c8020 msgr2=0x7fd8dc157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.308+0000 7fd8e10a0640 1 --2- 172.21.15.100:0/2391509445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8dc0c8020 0x7fd8dc157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.308+0000 7fd8e10a0640 1 -- 172.21.15.100:0/2391509445 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8dc0c5160 con 0x7fd8dc154d60 2024-09-11T22:28:42.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.308+0000 7fd8e10a0640 1 --2- 172.21.15.100:0/2391509445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8dc154d60 0x7fd8dc14e160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd8d402ac70 tx=0x7fd8d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:42.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.308+0000 7fd8d97fa640 1 -- 172.21.15.100:0/2391509445 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4040070 con 0x7fd8dc154d60 2024-09-11T22:28:42.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.308+0000 7fd8d97fa640 1 -- 172.21.15.100:0/2391509445 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d4031bc0 con 0x7fd8dc154d60 2024-09-11T22:28:42.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.308+0000 7fd8d97fa640 1 -- 172.21.15.100:0/2391509445 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4045460 con 0x7fd8dc154d60 2024-09-11T22:28:42.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.308+0000 7fd8e2b03640 1 -- 172.21.15.100:0/2391509445 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8dc0c4c60 con 0x7fd8dc154d60 2024-09-11T22:28:42.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.308+0000 7fd8e2b03640 1 -- 172.21.15.100:0/2391509445 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8dc1f1220 con 0x7fd8dc154d60 2024-09-11T22:28:42.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.309+0000 7fd8e2b03640 1 --2- 172.21.15.100:0/2391509445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8dc157ec0 0x7fd8dc1572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.309+0000 7fd8e2b03640 1 -- 172.21.15.100:0/2391509445 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd8dc15d840 con 0x7fd8dc157ec0 2024-09-11T22:28:42.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.309+0000 7fd8e089f640 1 --2- 172.21.15.100:0/2391509445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8dc157ec0 0x7fd8dc1572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.310+0000 7fd8d97fa640 1 -- 172.21.15.100:0/2391509445 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8d4039040 con 0x7fd8dc154d60 2024-09-11T22:28:42.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.310+0000 7fd8e089f640 1 -- 172.21.15.100:0/2391509445 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd8dc1f13f0 con 0x7fd8dc157ec0 2024-09-11T22:28:42.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.310+0000 7fd8e089f640 1 --2- 172.21.15.100:0/2391509445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8dc157ec0 0x7fd8dc1572c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00107f0 tx=0x7fd8d0010cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:42.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.310+0000 7fd8d97fa640 1 --2- 172.21.15.100:0/2391509445 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd8c006be30 0x7fd8c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.310+0000 7fd8d97fa640 1 -- 172.21.15.100:0/2391509445 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fd8d40aca20 con 0x7fd8dc154d60 2024-09-11T22:28:42.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.310+0000 7fd8dbfff640 1 --2- 172.21.15.100:0/2391509445 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd8c006be30 0x7fd8c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.310+0000 7fd8d97fa640 1 -- 172.21.15.100:0/2391509445 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0018070 con 0x7fd8dc157ec0 2024-09-11T22:28:42.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.310+0000 7fd8d97fa640 1 -- 172.21.15.100:0/2391509445 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fd8d000e820 con 0x7fd8dc157ec0 2024-09-11T22:28:42.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.310+0000 7fd8d97fa640 1 -- 172.21.15.100:0/2391509445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8dc157ec0 msgr2=0x7fd8dc1572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.310+0000 7fd8d97fa640 1 --2- 172.21.15.100:0/2391509445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8dc157ec0 0x7fd8dc1572c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00107f0 tx=0x7fd8d0010cb0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.310+0000 7fd8d97fa640 1 -- 172.21.15.100:0/2391509445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8dc157ec0 msgr2=0x7fd8dc1572c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:28:42.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.310+0000 7fd8d97fa640 1 --2- 172.21.15.100:0/2391509445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8dc157ec0 0x7fd8dc1572c0 secure :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00107f0 tx=0x7fd8d0010cb0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.311+0000 7fd8dbfff640 1 --2- 172.21.15.100:0/2391509445 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd8c006be30 0x7fd8c006e2f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0caa90 tx=0x7fd8c8007e80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:42.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.318+0000 7fd8e2b03640 1 --2- 172.21.15.100:0/2391509445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8dc0cb580 0x7fd8dc15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.318+0000 7fd8e2b03640 1 -- 172.21.15.100:0/2391509445 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd8dc0c7d90 con 0x7fd8dc0cb580 2024-09-11T22:28:42.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.319+0000 7fd8e089f640 1 --2- 172.21.15.100:0/2391509445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8dc0cb580 0x7fd8dc15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.319+0000 7fd8e089f640 1 -- 172.21.15.100:0/2391509445 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd8dc0caac0 con 0x7fd8dc0cb580 2024-09-11T22:28:42.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.319+0000 7fd8e089f640 1 --2- 172.21.15.100:0/2391509445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8dc0cb580 0x7fd8dc15e7f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd8d001a000 tx=0x7fd8d00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:42.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.319+0000 7fd8d97fa640 1 -- 172.21.15.100:0/2391509445 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d002b020 con 0x7fd8dc0cb580 2024-09-11T22:28:42.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.320+0000 7fd8d97fa640 1 -- 172.21.15.100:0/2391509445 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4888 (secure 0 0 0) 0x7fd8d0014430 con 0x7fd8dc0cb580 2024-09-11T22:28:42.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.320+0000 7fd8d97fa640 1 -- 172.21.15.100:0/2391509445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8dc0cb580 msgr2=0x7fd8dc15e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.320+0000 7fd8d97fa640 1 --2- 172.21.15.100:0/2391509445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8dc0cb580 0x7fd8dc15e7f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd8d001a000 tx=0x7fd8d00046c0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.320+0000 7fd8d97fa640 1 -- 172.21.15.100:0/2391509445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8dc0cb580 msgr2=0x7fd8dc15e7f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:28:42.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.320+0000 7fd8d97fa640 1 --2- 172.21.15.100:0/2391509445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8dc0cb580 0x7fd8dc15e7f0 secure :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd8d001a000 tx=0x7fd8d00046c0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.323 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:28:42.323 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:28:42.323 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:28:42.323 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:28:42.323 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 60, 2024-09-11T22:28:42.324 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 307598, 2024-09-11T22:28:42.324 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:28:42.324 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:28:42.324 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:28:42.324 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:28:42.324 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:42.325 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 12, 2024-09-11T22:28:42.325 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:28:42.325 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:28:42.325 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:28:42.325 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:42.326 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:42.326 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:42.326 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:42.326 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:42.326 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:42.326 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:42.326 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:42.326 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:42.326 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:42.326 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:42.327 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:42.327 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:28:42.327 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:28:42.327 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:42.327 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:42.327 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:42.327 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:42.327 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:42.327 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:42.328 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:42.328 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:42.328 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:42.328 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:42.328 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:42.328 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:42.328 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.328 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:28:42.328 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:28:42.328 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:28:42.328 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:28:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:28:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:28:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:28:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:28:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:28:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:28:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:28:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:28:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:28:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:28:42.329 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:28:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:28:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:28:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:42.330 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:28:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:28:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:28:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:28:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:42.331 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:28:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:28:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:28:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:28:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:42.332 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:28:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:28:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:28:42.333 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:42.334 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.334 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.334 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:42.334 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:28:42.334 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:42.334 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:42.334 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:42.334 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:28:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:28:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:28:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:28:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:28:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:28:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:42.336 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:28:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:28:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:28:42.337 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:28:42.338 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.338 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:42.338 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:42.338 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:28:42.338 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:42.338 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:42.338 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:28:42.338 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:28:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:28:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:28:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:42.339 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:42.340 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:28:42.340 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.340 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:42.340 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:42.340 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:28:42.340 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:42.340 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:42.340 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.340 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:28:42.340 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:28:42.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.320+0000 7fd8e2b03640 1 -- 172.21.15.100:0/2391509445 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd8c006be30 msgr2=0x7fd8c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.320+0000 7fd8e2b03640 1 --2- 172.21.15.100:0/2391509445 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd8c006be30 0x7fd8c006e2f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc0caa90 tx=0x7fd8c8007e80 comp rx=0 tx=0).stop 2024-09-11T22:28:42.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.320+0000 7fd8e2b03640 1 -- 172.21.15.100:0/2391509445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8dc154d60 msgr2=0x7fd8dc14e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.320+0000 7fd8e2b03640 1 --2- 172.21.15.100:0/2391509445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8dc154d60 0x7fd8dc14e160 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd8d402ac70 tx=0x7fd8d4004a40 comp rx=0 tx=0).stop 2024-09-11T22:28:42.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.320+0000 7fd8e10a0640 1 -- 172.21.15.100:0/2391509445 reap_dead start 2024-09-11T22:28:42.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.320+0000 7fd8e2b03640 1 -- 172.21.15.100:0/2391509445 shutdown_connections 2024-09-11T22:28:42.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.320+0000 7fd8e2b03640 1 --2- 172.21.15.100:0/2391509445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8dc154d60 0x7fd8dc14e160 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.320+0000 7fd8e2b03640 1 -- 172.21.15.100:0/2391509445 >> 172.21.15.100:0/2391509445 conn(0x7fd8dc06fa70 msgr2=0x7fd8dc1514c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:42.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.320+0000 7fd8e2b03640 1 -- 172.21.15.100:0/2391509445 shutdown_connections 2024-09-11T22:28:42.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.320+0000 7fd8e2b03640 1 -- 172.21.15.100:0/2391509445 wait complete. 2024-09-11T22:28:42.343 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:28:42.343 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:28:42.343 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:28:42.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.455+0000 7efcef731640 1 Processor -- start 2024-09-11T22:28:42.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.456+0000 7efcef731640 1 -- start start 2024-09-11T22:28:42.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.457+0000 7efcef731640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efce8070610 0x7efce80c9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.457+0000 7efcef731640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efce80b0f00 con 0x7efce8152c70 2024-09-11T22:28:42.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.457+0000 7efcef731640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efce80ca440 con 0x7efce80c9dd0 2024-09-11T22:28:42.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.457+0000 7efcef731640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7efce8153050 con 0x7efce8070610 2024-09-11T22:28:42.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.457+0000 7efcedcce640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efce8070610 0x7efce80c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.457+0000 7efcedcce640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efce8070610 0x7efce80c9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53080/0 (socket says 172.21.15.100:53080) 2024-09-11T22:28:42.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.457+0000 7efcedcce640 1 -- 172.21.15.100:0/297235318 learned_addr learned my addr 172.21.15.100:0/297235318 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:42.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.457+0000 7efced4cd640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7efce8152c70 0x7efce80ce160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50606/0 (socket says 172.21.15.100:50606) 2024-09-11T22:28:42.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.457+0000 7efcedcce640 1 -- 172.21.15.100:0/297235318 >> v1:172.21.15.167:6789/0 conn(0x7efce80c9dd0 legacy=0x7efce806ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.457+0000 7efcedcce640 1 -- 172.21.15.100:0/297235318 >> v1:172.21.15.100:6789/0 conn(0x7efce8152c70 legacy=0x7efce80ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.457+0000 7efcedcce640 1 -- 172.21.15.100:0/297235318 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce80c33d0 con 0x7efce8070610 2024-09-11T22:28:42.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.458+0000 7efcedcce640 1 --2- 172.21.15.100:0/297235318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efce8070610 0x7efce80c9820 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efce0009e50 tx=0x7efce002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea2d9f2109d3a66 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:42.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.458+0000 7efcdffff640 1 -- 172.21.15.100:0/297235318 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce0036070 con 0x7efce8070610 2024-09-11T22:28:42.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.458+0000 7efcdffff640 1 -- 172.21.15.100:0/297235318 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efce0031600 con 0x7efce8070610 2024-09-11T22:28:42.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.458+0000 7efcdffff640 1 -- 172.21.15.100:0/297235318 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce00319d0 con 0x7efce8070610 2024-09-11T22:28:42.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.459+0000 7efcef731640 1 -- 172.21.15.100:0/297235318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efce8070610 msgr2=0x7efce80c9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.459+0000 7efcef731640 1 --2- 172.21.15.100:0/297235318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efce8070610 0x7efce80c9820 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efce0009e50 tx=0x7efce002a730 comp rx=0 tx=0).stop 2024-09-11T22:28:42.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.459+0000 7efcef731640 1 -- 172.21.15.100:0/297235318 shutdown_connections 2024-09-11T22:28:42.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.459+0000 7efcef731640 1 --2- 172.21.15.100:0/297235318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efce8070610 0x7efce80c9820 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.459+0000 7efcef731640 1 -- 172.21.15.100:0/297235318 >> 172.21.15.100:0/297235318 conn(0x7efce806de20 msgr2=0x7efce806e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:42.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.459+0000 7efcef731640 1 -- 172.21.15.100:0/297235318 shutdown_connections 2024-09-11T22:28:42.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.459+0000 7efcef731640 1 -- 172.21.15.100:0/297235318 wait complete. 2024-09-11T22:28:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.460+0000 7efcef731640 1 Processor -- start 2024-09-11T22:28:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.460+0000 7efcef731640 1 -- start start 2024-09-11T22:28:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.461+0000 7efcef731640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efce8070610 0x7efce80c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.461+0000 7efcef731640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efce80c9dd0 0x7efce81f03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.461+0000 7efcef731640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efce8152c70 0x7efce80c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.461+0000 7efcef731640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efce80c3990 con 0x7efce8070610 2024-09-11T22:28:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.461+0000 7efcef731640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efce80ca6e0 con 0x7efce80c9dd0 2024-09-11T22:28:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.461+0000 7efcef731640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7efce80ce870 con 0x7efce8152c70 2024-09-11T22:28:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.461+0000 7efced4cd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efce8070610 0x7efce80c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.461+0000 7efced4cd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efce8070610 0x7efce80c7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53086/0 (socket says 172.21.15.100:53086) 2024-09-11T22:28:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.461+0000 7efced4cd640 1 -- 172.21.15.100:0/3536172531 learned_addr learned my addr 172.21.15.100:0/3536172531 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.461+0000 7efcedcce640 1 --2- 172.21.15.100:0/3536172531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efce8152c70 0x7efce80c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.461+0000 7efcecccc640 1 --2- 172.21.15.100:0/3536172531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efce80c9dd0 0x7efce81f03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.462+0000 7efced4cd640 1 -- 172.21.15.100:0/3536172531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efce8152c70 msgr2=0x7efce80c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.462+0000 7efced4cd640 1 --2- 172.21.15.100:0/3536172531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efce8152c70 0x7efce80c5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.462+0000 7efced4cd640 1 -- 172.21.15.100:0/3536172531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efce80c9dd0 msgr2=0x7efce81f03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.462+0000 7efced4cd640 1 --2- 172.21.15.100:0/3536172531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efce80c9dd0 0x7efce81f03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.462+0000 7efced4cd640 1 -- 172.21.15.100:0/3536172531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce81ec470 con 0x7efce8070610 2024-09-11T22:28:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.462+0000 7efced4cd640 1 --2- 172.21.15.100:0/3536172531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efce8070610 0x7efce80c7b80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efce400c500 tx=0x7efce400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.462+0000 7efcddffb640 1 -- 172.21.15.100:0/3536172531 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce4018070 con 0x7efce8070610 2024-09-11T22:28:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.462+0000 7efcddffb640 1 -- 172.21.15.100:0/3536172531 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efce4007500 con 0x7efce8070610 2024-09-11T22:28:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.462+0000 7efcef731640 1 -- 172.21.15.100:0/3536172531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce80c8250 con 0x7efce8070610 2024-09-11T22:28:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.462+0000 7efcddffb640 1 -- 172.21.15.100:0/3536172531 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce40049e0 con 0x7efce8070610 2024-09-11T22:28:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.462+0000 7efcef731640 1 -- 172.21.15.100:0/3536172531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce81ec730 con 0x7efce8070610 2024-09-11T22:28:42.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.463+0000 7efcef731640 1 --2- 172.21.15.100:0/3536172531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efce81ed1f0 0x7efce814d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.463+0000 7efcef731640 1 -- 172.21.15.100:0/3536172531 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7efce81f0930 con 0x7efce81ed1f0 2024-09-11T22:28:42.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.463+0000 7efcecccc640 1 --2- 172.21.15.100:0/3536172531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efce81ed1f0 0x7efce814d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.464+0000 7efcecccc640 1 -- 172.21.15.100:0/3536172531 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efce80c4f80 con 0x7efce81ed1f0 2024-09-11T22:28:42.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.464+0000 7efcecccc640 1 --2- 172.21.15.100:0/3536172531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efce81ed1f0 0x7efce814d920 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efce81ea0a0 tx=0x7efcd800f900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:42.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.464+0000 7efcddffb640 1 -- 172.21.15.100:0/3536172531 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efce401b070 con 0x7efce8070610 2024-09-11T22:28:42.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.464+0000 7efcddffb640 1 --2- 172.21.15.100:0/3536172531 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efccc06be30 0x7efccc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.464+0000 7efcddffb640 1 -- 172.21.15.100:0/3536172531 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7efce408a520 con 0x7efce8070610 2024-09-11T22:28:42.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.464+0000 7efcedcce640 1 --2- 172.21.15.100:0/3536172531 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efccc06be30 0x7efccc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.464+0000 7efcddffb640 1 -- 172.21.15.100:0/3536172531 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd8019070 con 0x7efce81ed1f0 2024-09-11T22:28:42.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.465+0000 7efcddffb640 1 -- 172.21.15.100:0/3536172531 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7efcd8005320 con 0x7efce81ed1f0 2024-09-11T22:28:42.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.465+0000 7efcddffb640 1 -- 172.21.15.100:0/3536172531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efce81ed1f0 msgr2=0x7efce814d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.465+0000 7efcddffb640 1 --2- 172.21.15.100:0/3536172531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efce81ed1f0 0x7efce814d920 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efce81ea0a0 tx=0x7efcd800f900 comp rx=0 tx=0).stop 2024-09-11T22:28:42.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.465+0000 7efcddffb640 1 -- 172.21.15.100:0/3536172531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efce81ed1f0 msgr2=0x7efce814d920 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:28:42.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.465+0000 7efcddffb640 1 --2- 172.21.15.100:0/3536172531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efce81ed1f0 0x7efce814d920 secure :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efce81ea0a0 tx=0x7efcd800f900 comp rx=0 tx=0).stop 2024-09-11T22:28:42.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.465+0000 7efcedcce640 1 --2- 172.21.15.100:0/3536172531 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efccc06be30 0x7efccc06e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efce0033000 tx=0x7efce0009000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:42.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.471+0000 7efcef731640 1 --2- 172.21.15.100:0/3536172531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efce81ec970 0x7efce8148980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.471+0000 7efcef731640 1 -- 172.21.15.100:0/3536172531 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7efce8070da0 con 0x7efce81ec970 2024-09-11T22:28:42.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.471+0000 7efcecccc640 1 --2- 172.21.15.100:0/3536172531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efce81ec970 0x7efce8148980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.472+0000 7efcecccc640 1 -- 172.21.15.100:0/3536172531 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efce8071940 con 0x7efce81ec970 2024-09-11T22:28:42.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.472+0000 7efcecccc640 1 --2- 172.21.15.100:0/3536172531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efce81ec970 0x7efce8148980 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efcd8016000 tx=0x7efcd8000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:42.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.472+0000 7efcddffb640 1 -- 172.21.15.100:0/3536172531 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd8019030 con 0x7efce81ec970 2024-09-11T22:28:42.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.472+0000 7efcddffb640 1 -- 172.21.15.100:0/3536172531 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7efcd8006a40 con 0x7efce81ec970 2024-09-11T22:28:42.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.472+0000 7efcddffb640 1 -- 172.21.15.100:0/3536172531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efce81ec970 msgr2=0x7efce8148980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.472+0000 7efcddffb640 1 --2- 172.21.15.100:0/3536172531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efce81ec970 0x7efce8148980 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efcd8016000 tx=0x7efcd8000ed0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.472+0000 7efcddffb640 1 -- 172.21.15.100:0/3536172531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efce81ec970 msgr2=0x7efce8148980 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:28:42.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.472+0000 7efcddffb640 1 --2- 172.21.15.100:0/3536172531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efce81ec970 0x7efce8148980 secure :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efcd8016000 tx=0x7efcd8000ed0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.474 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:28:42.474 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:28:42.474 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:28:42.475 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:28:42.475 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 60, 2024-09-11T22:28:42.475 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 413194, 2024-09-11T22:28:42.475 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:28:42.475 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:28:42.475 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:28:42.475 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:28:42.475 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:42.475 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 12, 2024-09-11T22:28:42.475 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:28:42.475 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:28:42.475 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:28:42.475 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:42.475 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:42.476 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:42.476 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:42.476 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:42.476 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:42.476 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:42.476 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:42.476 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:42.476 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:42.476 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:42.476 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:42.476 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:28:42.476 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:28:42.476 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:42.476 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:42.477 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:42.477 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:42.477 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:42.477 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:42.477 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:42.477 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:42.477 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:42.477 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:42.477 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:42.477 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:42.477 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.477 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:28:42.477 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:28:42.477 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:28:42.478 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:28:42.478 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:28:42.478 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:28:42.478 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:28:42.478 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:28:42.478 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:28:42.478 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:28:42.478 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:28:42.478 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:28:42.478 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:28:42.478 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:28:42.478 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:28:42.478 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:28:42.478 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:28:42.479 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:42.479 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:42.479 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:42.479 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:42.479 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:42.479 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:42.479 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:42.479 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:42.479 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:42.479 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:42.479 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:42.479 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:42.479 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:28:42.479 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.480 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:28:42.480 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.480 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:28:42.480 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:28:42.480 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:42.480 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:42.480 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.480 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:42.480 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:28:42.480 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:42.480 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.480 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.480 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:42.481 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:28:42.481 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:42.481 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:42.481 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:42.481 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.481 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:28:42.481 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:28:42.481 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:42.481 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:42.481 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:42.481 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.481 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.481 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:28:42.481 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:28:42.482 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:42.482 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:42.482 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.482 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:42.482 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:28:42.482 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:42.482 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.482 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.482 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:42.482 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:28:42.482 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:42.482 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:42.482 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:42.482 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.482 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:28:42.483 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:28:42.483 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:42.483 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:42.483 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:42.483 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.483 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.483 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:28:42.483 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:28:42.483 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:42.483 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:42.483 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.483 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:42.483 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:28:42.483 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:42.484 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.484 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.484 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:42.484 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:28:42.484 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:42.484 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:42.484 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:42.484 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.484 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:28:42.484 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:28:42.484 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:42.484 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:42.484 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:42.484 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:42.485 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:42.485 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.485 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:28:42.485 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:28:42.485 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.485 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:42.485 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:42.485 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:28:42.485 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:42.485 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:42.485 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:28:42.485 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.485 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:42.485 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:42.486 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:28:42.486 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:42.486 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:42.486 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:28:42.486 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.486 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:42.486 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:42.486 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:28:42.486 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:42.486 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:42.486 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:28:42.486 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.486 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:42.486 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:42.486 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:28:42.487 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:42.487 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:42.487 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:28:42.487 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:42.487 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:42.487 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:42.487 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:28:42.487 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:42.487 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:42.487 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:42.487 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:28:42.487 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:28:42.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.473+0000 7efcef731640 1 -- 172.21.15.100:0/3536172531 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efccc06be30 msgr2=0x7efccc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.473+0000 7efcef731640 1 --2- 172.21.15.100:0/3536172531 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efccc06be30 0x7efccc06e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efce0033000 tx=0x7efce0009000 comp rx=0 tx=0).stop 2024-09-11T22:28:42.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.473+0000 7efcef731640 1 -- 172.21.15.100:0/3536172531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efce8070610 msgr2=0x7efce80c7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.473+0000 7efcef731640 1 --2- 172.21.15.100:0/3536172531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efce8070610 0x7efce80c7b80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efce400c500 tx=0x7efce400c9c0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.473+0000 7efcedcce640 1 -- 172.21.15.100:0/3536172531 reap_dead start 2024-09-11T22:28:42.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.473+0000 7efcedcce640 1 -- 172.21.15.100:0/3536172531 reap_dead start 2024-09-11T22:28:42.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.473+0000 7efcef731640 1 -- 172.21.15.100:0/3536172531 shutdown_connections 2024-09-11T22:28:42.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.473+0000 7efcef731640 1 -- 172.21.15.100:0/3536172531 >> 172.21.15.100:0/3536172531 conn(0x7efce806de20 msgr2=0x7efce8074e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:42.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.473+0000 7efcef731640 1 -- 172.21.15.100:0/3536172531 shutdown_connections 2024-09-11T22:28:42.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.473+0000 7efcef731640 1 -- 172.21.15.100:0/3536172531 wait complete. 2024-09-11T22:28:42.489 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:28:42.490 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-11T22:28:42.490 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-11T22:28:42.490 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-11T22:28:42.490 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:28:42.490 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T22:28:42.490 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:28:42.500 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T22:28:42.500 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-11T22:28:42.500 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:28:42.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.648+0000 7f72c3ed0640 1 Processor -- start 2024-09-11T22:28:42.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.649+0000 7f72c3ed0640 1 -- start start 2024-09-11T22:28:42.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.650+0000 7f72c3ed0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f72bc0cd720 0x7f72bc15b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.650+0000 7f72c3ed0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72bc0c7300 0x7f72bc15b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.650+0000 7f72c3ed0640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72bc0c80e0 con 0x7f72bc0cd340 2024-09-11T22:28:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.650+0000 7f72c3ed0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f72bc0c6b70 con 0x7f72bc0cd720 2024-09-11T22:28:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.650+0000 7f72c3ed0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f72bc0c62d0 con 0x7f72bc0c7300 2024-09-11T22:28:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.650+0000 7f72c1c6c640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f72bc0cd340 legacy=0x7f72bc0c46a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:28:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.650+0000 7f72c246d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72bc0c7300 0x7f72bc15b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.650+0000 7f72c146b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f72bc0cd720 0x7f72bc15b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.650+0000 7f72c246d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72bc0c7300 0x7f72bc15b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:37456/0 (socket says 172.21.15.100:37456) 2024-09-11T22:28:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.650+0000 7f72c246d640 1 -- 172.21.15.100:0/1715528204 learned_addr learned my addr 172.21.15.100:0/1715528204 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.651+0000 7f72c146b640 1 -- 172.21.15.100:0/1715528204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72bc0c7300 msgr2=0x7f72bc15b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.651+0000 7f72c146b640 1 --2- 172.21.15.100:0/1715528204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72bc0c7300 0x7f72bc15b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.651+0000 7f72c146b640 1 -- 172.21.15.100:0/1715528204 >> v1:172.21.15.100:6789/0 conn(0x7f72bc0cd340 legacy=0x7f72bc0c46a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:28:42.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.651+0000 7f72c146b640 1 -- 172.21.15.100:0/1715528204 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72bc0c65b0 con 0x7f72bc0cd720 2024-09-11T22:28:42.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.651+0000 7f72c246d640 1 --2- 172.21.15.100:0/1715528204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72bc0c7300 0x7f72bc15b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:42.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.651+0000 7f72c146b640 1 --2- 172.21.15.100:0/1715528204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72bc0cd720 0x7f72bc15b110 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f72ac0097a0 tx=0x7f72ac02a010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74c4c5e5722764dc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:42.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.652+0000 7f72c0c6a640 1 -- 172.21.15.100:0/1715528204 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ac037070 con 0x7f72bc0cd720 2024-09-11T22:28:42.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.652+0000 7f72c0c6a640 1 -- 172.21.15.100:0/1715528204 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ac02ad20 con 0x7f72bc0cd720 2024-09-11T22:28:42.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.652+0000 7f72c0c6a640 1 -- 172.21.15.100:0/1715528204 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ac032660 con 0x7f72bc0cd720 2024-09-11T22:28:42.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.652+0000 7f72c3ed0640 1 -- 172.21.15.100:0/1715528204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72bc0cd720 msgr2=0x7f72bc15b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.652+0000 7f72c3ed0640 1 --2- 172.21.15.100:0/1715528204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72bc0cd720 0x7f72bc15b110 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f72ac0097a0 tx=0x7f72ac02a010 comp rx=0 tx=0).stop 2024-09-11T22:28:42.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.652+0000 7f72c3ed0640 1 -- 172.21.15.100:0/1715528204 shutdown_connections 2024-09-11T22:28:42.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.652+0000 7f72c3ed0640 1 --2- 172.21.15.100:0/1715528204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72bc0c7300 0x7f72bc15b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.652+0000 7f72c3ed0640 1 --2- 172.21.15.100:0/1715528204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72bc0cd720 0x7f72bc15b110 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.652+0000 7f72c3ed0640 1 -- 172.21.15.100:0/1715528204 >> 172.21.15.100:0/1715528204 conn(0x7f72bc06e9a0 msgr2=0x7f72bc06ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:42.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.652+0000 7f72c3ed0640 1 -- 172.21.15.100:0/1715528204 shutdown_connections 2024-09-11T22:28:42.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.652+0000 7f72c3ed0640 1 -- 172.21.15.100:0/1715528204 wait complete. 2024-09-11T22:28:42.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.653+0000 7f72c3ed0640 1 Processor -- start 2024-09-11T22:28:42.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.653+0000 7f72c3ed0640 1 -- start start 2024-09-11T22:28:42.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.654+0000 7f72c3ed0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72bc0c7300 0x7f72bc149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.654+0000 7f72c3ed0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72bc0cd340 0x7f72bc1f07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.654+0000 7f72c3ed0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72bc0cd720 0x7f72bc1f0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.654+0000 7f72c3ed0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f72bc0c7d20 con 0x7f72bc0c7300 2024-09-11T22:28:42.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.654+0000 7f72c3ed0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f72bc0c7ba0 con 0x7f72bc0cd340 2024-09-11T22:28:42.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.654+0000 7f72c3ed0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f72bc0c7ea0 con 0x7f72bc0cd720 2024-09-11T22:28:42.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.654+0000 7f72c1c6c640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72bc0c7300 msgr2=0x7f72bc149a50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:28:42.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.654+0000 7f72c1c6c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72bc0c7300 0x7f72bc149a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:28:42.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.654+0000 7f72c246d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72bc0cd720 0x7f72bc1f0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.654+0000 7f72c146b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72bc0cd340 0x7f72bc1f07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.654+0000 7f72c146b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72bc0cd340 0x7f72bc1f07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:35360/0 (socket says 172.21.15.100:35360) 2024-09-11T22:28:42.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.654+0000 7f72c146b640 1 -- 172.21.15.100:0/2257586702 learned_addr learned my addr 172.21.15.100:0/2257586702 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:42.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.654+0000 7f72c246d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72bc0cd720 0x7f72bc1f0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:37458/0 (socket says 172.21.15.100:37458) 2024-09-11T22:28:42.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.655+0000 7f72c146b640 1 -- 172.21.15.100:0/2257586702 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72bc0cd720 msgr2=0x7f72bc1f0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.655+0000 7f72c146b640 1 --2- 172.21.15.100:0/2257586702 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72bc0cd720 0x7f72bc1f0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.655+0000 7f72c146b640 1 -- 172.21.15.100:0/2257586702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72bc0c7300 msgr2=0x7f72bc149a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:28:42.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.655+0000 7f72c146b640 1 --2- 172.21.15.100:0/2257586702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72bc0c7300 0x7f72bc149a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.655+0000 7f72c146b640 1 -- 172.21.15.100:0/2257586702 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72bc159b40 con 0x7f72bc0cd340 2024-09-11T22:28:42.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.655+0000 7f72c146b640 1 --2- 172.21.15.100:0/2257586702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72bc0cd340 0x7f72bc1f07a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f72ac035040 tx=0x7f72ac0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:42.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.655+0000 7f72b27fc640 1 -- 172.21.15.100:0/2257586702 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ac037050 con 0x7f72bc0cd340 2024-09-11T22:28:42.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.655+0000 7f72b27fc640 1 -- 172.21.15.100:0/2257586702 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ac043070 con 0x7f72bc0cd340 2024-09-11T22:28:42.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.655+0000 7f72c3ed0640 1 -- 172.21.15.100:0/2257586702 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72bc159de0 con 0x7f72bc0cd340 2024-09-11T22:28:42.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.655+0000 7f72b27fc640 1 -- 172.21.15.100:0/2257586702 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ac03ca50 con 0x7f72bc0cd340 2024-09-11T22:28:42.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.655+0000 7f72c3ed0640 1 -- 172.21.15.100:0/2257586702 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72bc1f3ca0 con 0x7f72bc0cd340 2024-09-11T22:28:42.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.656+0000 7f72c3ed0640 1 -- 172.21.15.100:0/2257586702 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72bc0c46a0 con 0x7f72bc0cd340 2024-09-11T22:28:42.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.657+0000 7f72b27fc640 1 -- 172.21.15.100:0/2257586702 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f72ac02aba0 con 0x7f72bc0cd340 2024-09-11T22:28:42.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.657+0000 7f72b27fc640 1 --2- 172.21.15.100:0/2257586702 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f72a006be10 0x7f72a006e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:42.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.657+0000 7f72b27fc640 1 -- 172.21.15.100:0/2257586702 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f72ac0abcf0 con 0x7f72bc0cd340 2024-09-11T22:28:42.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.657+0000 7f72c1c6c640 1 --2- 172.21.15.100:0/2257586702 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f72a006be10 0x7f72a006e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:42.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.658+0000 7f72c1c6c640 1 --2- 172.21.15.100:0/2257586702 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f72a006be10 0x7f72a006e2d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f72b8003980 tx=0x7f72b8006d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:42.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.662+0000 7f72b27fc640 1 -- 172.21.15.100:0/2257586702 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f72ac07a300 con 0x7f72bc0cd340 2024-09-11T22:28:42.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.960+0000 7f72c3ed0640 1 -- 172.21.15.100:0/2257586702 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f72bc1e0cf0 con 0x7f72bc0cd340 2024-09-11T22:28:42.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.961+0000 7f72b27fc640 1 -- 172.21.15.100:0/2257586702 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f72ac079c00 con 0x7f72bc0cd340 2024-09-11T22:28:42.962 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":60,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:28:42.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.963+0000 7f72c3ed0640 1 -- 172.21.15.100:0/2257586702 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f72a006be10 msgr2=0x7f72a006e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.963+0000 7f72c3ed0640 1 --2- 172.21.15.100:0/2257586702 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f72a006be10 0x7f72a006e2d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f72b8003980 tx=0x7f72b8006d30 comp rx=0 tx=0).stop 2024-09-11T22:28:42.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.963+0000 7f72c3ed0640 1 -- 172.21.15.100:0/2257586702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72bc0cd340 msgr2=0x7f72bc1f07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:42.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.963+0000 7f72c3ed0640 1 --2- 172.21.15.100:0/2257586702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72bc0cd340 0x7f72bc1f07a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f72ac035040 tx=0x7f72ac0046c0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.963+0000 7f72c3ed0640 1 -- 172.21.15.100:0/2257586702 shutdown_connections 2024-09-11T22:28:42.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.963+0000 7f72c3ed0640 1 --2- 172.21.15.100:0/2257586702 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f72a006be10 0x7f72a006e2d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.963+0000 7f72c3ed0640 1 --2- 172.21.15.100:0/2257586702 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72bc0cd720 0x7f72bc1f0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.963+0000 7f72c3ed0640 1 --2- 172.21.15.100:0/2257586702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72bc0cd340 0x7f72bc1f07a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.963+0000 7f72c3ed0640 1 --2- 172.21.15.100:0/2257586702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72bc0c7300 0x7f72bc149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:42.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.963+0000 7f72c3ed0640 1 -- 172.21.15.100:0/2257586702 >> 172.21.15.100:0/2257586702 conn(0x7f72bc06e9a0 msgr2=0x7f72bc0c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:42.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.963+0000 7f72c3ed0640 1 -- 172.21.15.100:0/2257586702 shutdown_connections 2024-09-11T22:28:42.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:42.963+0000 7f72c3ed0640 1 -- 172.21.15.100:0/2257586702 wait complete. 2024-09-11T22:28:45.976 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:28:46.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.093+0000 7f3e4aa37640 1 Processor -- start 2024-09-11T22:28:46.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.094+0000 7f3e4aa37640 1 -- start start 2024-09-11T22:28:46.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.094+0000 7f3e4aa37640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e440cd1b0 0x7f3e441512d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:46.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.095+0000 7f3e4aa37640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e4406d490 con 0x7f3e440c7320 2024-09-11T22:28:46.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.095+0000 7f3e4aa37640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e4406c530 con 0x7f3e4406bc10 2024-09-11T22:28:46.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.095+0000 7f3e4aa37640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3e4406c810 con 0x7f3e440cd1b0 2024-09-11T22:28:46.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.095+0000 7f3e48fd4640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f3e440c7320 legacy=0x7f3e44162070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:28:46.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.095+0000 7f3e43fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e440cd1b0 0x7f3e441512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:46.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.095+0000 7f3e3bfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f3e4406bc10 0x7f3e44157d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:57600/0 (socket says 172.21.15.100:57600) 2024-09-11T22:28:46.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.095+0000 7f3e3bfff640 1 -- 172.21.15.100:0/63549700 learned_addr learned my addr 172.21.15.100:0/63549700 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:28:46.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.095+0000 7f3e437fe640 1 -- 172.21.15.100:0/63549700 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2786374875 0 0) 0x7f3e4406c530 con 0x7f3e4406bc10 2024-09-11T22:28:46.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.095+0000 7f3e437fe640 1 -- 172.21.15.100:0/63549700 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e30003520 con 0x7f3e4406bc10 2024-09-11T22:28:46.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.095+0000 7f3e43fff640 1 -- 172.21.15.100:0/63549700 >> v1:172.21.15.167:6789/0 conn(0x7f3e4406bc10 legacy=0x7f3e44157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:46.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.095+0000 7f3e43fff640 1 -- 172.21.15.100:0/63549700 >> v1:172.21.15.100:6789/0 conn(0x7f3e440c7320 legacy=0x7f3e44162070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:28:46.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.095+0000 7f3e43fff640 1 -- 172.21.15.100:0/63549700 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4406ced0 con 0x7f3e440cd1b0 2024-09-11T22:28:46.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.096+0000 7f3e43fff640 1 --2- 172.21.15.100:0/63549700 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e440cd1b0 0x7f3e441512d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3e340097d0 tx=0x7f3e3402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88d878f8d47c793e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.096+0000 7f3e437fe640 1 -- 172.21.15.100:0/63549700 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e34037070 con 0x7f3e440cd1b0 2024-09-11T22:28:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.096+0000 7f3e437fe640 1 -- 172.21.15.100:0/63549700 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e34032440 con 0x7f3e440cd1b0 2024-09-11T22:28:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.096+0000 7f3e437fe640 1 -- 172.21.15.100:0/63549700 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e34032810 con 0x7f3e440cd1b0 2024-09-11T22:28:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.097+0000 7f3e4aa37640 1 -- 172.21.15.100:0/63549700 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e440cd1b0 msgr2=0x7f3e441512d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.097+0000 7f3e4aa37640 1 --2- 172.21.15.100:0/63549700 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e440cd1b0 0x7f3e441512d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3e340097d0 tx=0x7f3e3402a1c0 comp rx=0 tx=0).stop 2024-09-11T22:28:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.097+0000 7f3e4aa37640 1 -- 172.21.15.100:0/63549700 shutdown_connections 2024-09-11T22:28:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.097+0000 7f3e4aa37640 1 --2- 172.21.15.100:0/63549700 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e440cd1b0 0x7f3e441512d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.097+0000 7f3e4aa37640 1 -- 172.21.15.100:0/63549700 >> 172.21.15.100:0/63549700 conn(0x7f3e44072960 msgr2=0x7f3e44072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.097+0000 7f3e4aa37640 1 -- 172.21.15.100:0/63549700 shutdown_connections 2024-09-11T22:28:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.097+0000 7f3e4aa37640 1 -- 172.21.15.100:0/63549700 wait complete. 2024-09-11T22:28:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.098+0000 7f3e4aa37640 1 Processor -- start 2024-09-11T22:28:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.098+0000 7f3e4aa37640 1 -- start start 2024-09-11T22:28:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.099+0000 7f3e4aa37640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e4406bc10 0x7f3e44149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.099+0000 7f3e4aa37640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e440c7320 0x7f3e441e2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.099+0000 7f3e4aa37640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e440cd1b0 0x7f3e441f1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.099+0000 7f3e4aa37640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4406cc50 con 0x7f3e440cd1b0 2024-09-11T22:28:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.099+0000 7f3e4aa37640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3e44157800 con 0x7f3e440c7320 2024-09-11T22:28:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.099+0000 7f3e4aa37640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3e44158430 con 0x7f3e4406bc10 2024-09-11T22:28:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.099+0000 7f3e48fd4640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e440cd1b0 msgr2=0x7f3e441f1090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:28:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.099+0000 7f3e48fd4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e440cd1b0 0x7f3e441f1090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:28:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.100+0000 7f3e3bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e440c7320 0x7f3e441e2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.100+0000 7f3e43fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e4406bc10 0x7f3e44149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.100+0000 7f3e43fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e4406bc10 0x7f3e44149830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:37478/0 (socket says 172.21.15.100:37478) 2024-09-11T22:28:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.100+0000 7f3e3bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e440c7320 0x7f3e441e2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:35370/0 (socket says 172.21.15.100:35370) 2024-09-11T22:28:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.100+0000 7f3e43fff640 1 -- 172.21.15.100:0/70194929 learned_addr learned my addr 172.21.15.100:0/70194929 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:46.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.100+0000 7f3e43fff640 1 -- 172.21.15.100:0/70194929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e440c7320 msgr2=0x7f3e441e2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:46.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.100+0000 7f3e43fff640 1 --2- 172.21.15.100:0/70194929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e440c7320 0x7f3e441e2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:46.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.100+0000 7f3e43fff640 1 -- 172.21.15.100:0/70194929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e440cd1b0 msgr2=0x7f3e441f1090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:28:46.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.100+0000 7f3e43fff640 1 --2- 172.21.15.100:0/70194929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e440cd1b0 0x7f3e441f1090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:46.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.100+0000 7f3e43fff640 1 -- 172.21.15.100:0/70194929 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e441e30f0 con 0x7f3e4406bc10 2024-09-11T22:28:46.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.100+0000 7f3e43fff640 1 --2- 172.21.15.100:0/70194929 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e4406bc10 0x7f3e44149830 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3e340098f0 tx=0x7f3e340046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:46.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.100+0000 7f3e417fa640 1 -- 172.21.15.100:0/70194929 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e34042020 con 0x7f3e4406bc10 2024-09-11T22:28:46.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.100+0000 7f3e417fa640 1 -- 172.21.15.100:0/70194929 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e3403d750 con 0x7f3e4406bc10 2024-09-11T22:28:46.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.101+0000 7f3e4aa37640 1 -- 172.21.15.100:0/70194929 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e441e33d0 con 0x7f3e4406bc10 2024-09-11T22:28:46.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.101+0000 7f3e417fa640 1 -- 172.21.15.100:0/70194929 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e34037040 con 0x7f3e4406bc10 2024-09-11T22:28:46.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.101+0000 7f3e4aa37640 1 -- 172.21.15.100:0/70194929 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e441e1e30 con 0x7f3e4406bc10 2024-09-11T22:28:46.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.101+0000 7f3e4aa37640 1 -- 172.21.15.100:0/70194929 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e440cd590 con 0x7f3e4406bc10 2024-09-11T22:28:46.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.102+0000 7f3e417fa640 1 -- 172.21.15.100:0/70194929 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e34045020 con 0x7f3e4406bc10 2024-09-11T22:28:46.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.103+0000 7f3e417fa640 1 --2- 172.21.15.100:0/70194929 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3e2406be10 0x7f3e2406e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:46.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.103+0000 7f3e417fa640 1 -- 172.21.15.100:0/70194929 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f3e340abdb0 con 0x7f3e4406bc10 2024-09-11T22:28:46.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.103+0000 7f3e3bfff640 1 --2- 172.21.15.100:0/70194929 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3e2406be10 0x7f3e2406e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:46.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.103+0000 7f3e3bfff640 1 --2- 172.21.15.100:0/70194929 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3e2406be10 0x7f3e2406e2d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3e44071520 tx=0x7f3e2c007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:46.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.106+0000 7f3e417fa640 1 -- 172.21.15.100:0/70194929 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e3404c030 con 0x7f3e4406bc10 2024-09-11T22:28:46.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.426+0000 7f3e4aa37640 1 -- 172.21.15.100:0/70194929 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3e440c5910 con 0x7f3e4406bc10 2024-09-11T22:28:46.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.427+0000 7f3e417fa640 1 -- 172.21.15.100:0/70194929 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f3e3407a420 con 0x7f3e4406bc10 2024-09-11T22:28:46.428 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":60,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:28:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.429+0000 7f3e4aa37640 1 -- 172.21.15.100:0/70194929 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3e2406be10 msgr2=0x7f3e2406e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.430+0000 7f3e4aa37640 1 --2- 172.21.15.100:0/70194929 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3e2406be10 0x7f3e2406e2d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3e44071520 tx=0x7f3e2c007d30 comp rx=0 tx=0).stop 2024-09-11T22:28:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.430+0000 7f3e4aa37640 1 -- 172.21.15.100:0/70194929 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e4406bc10 msgr2=0x7f3e44149830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.430+0000 7f3e4aa37640 1 --2- 172.21.15.100:0/70194929 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e4406bc10 0x7f3e44149830 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3e340098f0 tx=0x7f3e340046c0 comp rx=0 tx=0).stop 2024-09-11T22:28:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.430+0000 7f3e4aa37640 1 -- 172.21.15.100:0/70194929 shutdown_connections 2024-09-11T22:28:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.430+0000 7f3e4aa37640 1 --2- 172.21.15.100:0/70194929 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3e2406be10 0x7f3e2406e2d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.430+0000 7f3e4aa37640 1 --2- 172.21.15.100:0/70194929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e440cd1b0 0x7f3e441f1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.430+0000 7f3e4aa37640 1 --2- 172.21.15.100:0/70194929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3e440c7320 0x7f3e441e2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.430+0000 7f3e4aa37640 1 --2- 172.21.15.100:0/70194929 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3e4406bc10 0x7f3e44149830 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.430+0000 7f3e4aa37640 1 -- 172.21.15.100:0/70194929 >> 172.21.15.100:0/70194929 conn(0x7f3e44072960 msgr2=0x7f3e4414f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.430+0000 7f3e4aa37640 1 -- 172.21.15.100:0/70194929 shutdown_connections 2024-09-11T22:28:46.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:46.430+0000 7f3e4aa37640 1 -- 172.21.15.100:0/70194929 wait complete. 2024-09-11T22:28:49.444 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:28:49.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.555+0000 7f3d9f186640 1 Processor -- start 2024-09-11T22:28:49.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.555+0000 7f3d9f186640 1 -- start start 2024-09-11T22:28:49.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.556+0000 7f3d9f186640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3d98154c20 0x7f3d980cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:49.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.556+0000 7f3d9f186640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d9815a7e0 0x7f3d980cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:49.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.556+0000 7f3d9f186640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d9815ac90 con 0x7f3d980b3190 2024-09-11T22:28:49.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.556+0000 7f3d9f186640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f3d9815e000 con 0x7f3d98154c20 2024-09-11T22:28:49.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.556+0000 7f3d9f186640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3d9815af70 con 0x7f3d9815a7e0 2024-09-11T22:28:49.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.556+0000 7f3d9cf22640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f3d98154c20 msgr2=0x7f3d980cb120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:28:49.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.556+0000 7f3d9cf22640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3d98154c20 0x7f3d980cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:28:49.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.556+0000 7f3d9d723640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d9815a7e0 0x7f3d980cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:49.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.556+0000 7f3d97fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f3d980b3190 0x7f3d9815e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:57616/0 (socket says 172.21.15.100:57616) 2024-09-11T22:28:49.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.556+0000 7f3d97fff640 1 -- 172.21.15.100:0/2330936663 learned_addr learned my addr 172.21.15.100:0/2330936663 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:28:49.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.557+0000 7f3d9d723640 1 -- 172.21.15.100:0/2330936663 >> v2:172.21.15.100:3300/0 conn(0x7f3d98154c20 msgr2=0x7f3d980cb120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:28:49.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.557+0000 7f3d9d723640 1 --2- 172.21.15.100:0/2330936663 >> v2:172.21.15.100:3300/0 conn(0x7f3d98154c20 0x7f3d980cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.557+0000 7f3d9d723640 1 -- 172.21.15.100:0/2330936663 >> v1:172.21.15.167:6789/0 conn(0x7f3d980b3190 legacy=0x7f3d9815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:49.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.557+0000 7f3d9d723640 1 -- 172.21.15.100:0/2330936663 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d9815b250 con 0x7f3d9815a7e0 2024-09-11T22:28:49.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.558+0000 7f3d9d723640 1 --2- 172.21.15.100:0/2330936663 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d9815a7e0 0x7f3d980cbd10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3d90009d90 tx=0x7f3d9002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=116918b85007e258 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:49.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.558+0000 7f3d977fe640 1 -- 172.21.15.100:0/2330936663 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90007740 con 0x7f3d9815a7e0 2024-09-11T22:28:49.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.558+0000 7f3d977fe640 1 -- 172.21.15.100:0/2330936663 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d900078e0 con 0x7f3d9815a7e0 2024-09-11T22:28:49.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.558+0000 7f3d977fe640 1 -- 172.21.15.100:0/2330936663 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90007cb0 con 0x7f3d9815a7e0 2024-09-11T22:28:49.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.558+0000 7f3d9f186640 1 -- 172.21.15.100:0/2330936663 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d9815a7e0 msgr2=0x7f3d980cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:49.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.558+0000 7f3d9f186640 1 --2- 172.21.15.100:0/2330936663 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d9815a7e0 0x7f3d980cbd10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3d90009d90 tx=0x7f3d9002a680 comp rx=0 tx=0).stop 2024-09-11T22:28:49.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.559+0000 7f3d9f186640 1 -- 172.21.15.100:0/2330936663 shutdown_connections 2024-09-11T22:28:49.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.559+0000 7f3d9f186640 1 --2- 172.21.15.100:0/2330936663 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d9815a7e0 0x7f3d980cbd10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.559+0000 7f3d9f186640 1 --2- 172.21.15.100:0/2330936663 >> v2:172.21.15.100:3300/0 conn(0x7f3d98154c20 0x7f3d980cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.559+0000 7f3d9f186640 1 -- 172.21.15.100:0/2330936663 >> 172.21.15.100:0/2330936663 conn(0x7f3d98067d40 msgr2=0x7f3d9806d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:49.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.559+0000 7f3d9f186640 1 -- 172.21.15.100:0/2330936663 shutdown_connections 2024-09-11T22:28:49.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.559+0000 7f3d9f186640 1 -- 172.21.15.100:0/2330936663 wait complete. 2024-09-11T22:28:49.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.560+0000 7f3d9f186640 1 Processor -- start 2024-09-11T22:28:49.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.560+0000 7f3d9f186640 1 -- start start 2024-09-11T22:28:49.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.561+0000 7f3d9f186640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d980b3190 0x7f3d98156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:49.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.561+0000 7f3d9f186640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d98154c20 0x7f3d980b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.561+0000 7f3d9f186640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d9815a7e0 0x7f3d98157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.561+0000 7f3d9f186640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9815ed20 con 0x7f3d980b3190 2024-09-11T22:28:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.561+0000 7f3d9f186640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9815eba0 con 0x7f3d98154c20 2024-09-11T22:28:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.561+0000 7f3d9f186640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3d980cb660 con 0x7f3d9815a7e0 2024-09-11T22:28:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.561+0000 7f3d9cf22640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d980b3190 msgr2=0x7f3d98156430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:28:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.561+0000 7f3d9cf22640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d980b3190 0x7f3d98156430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:28:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.561+0000 7f3d97fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d98154c20 0x7f3d980b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.561+0000 7f3d97fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d98154c20 0x7f3d980b54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:35376/0 (socket says 172.21.15.100:35376) 2024-09-11T22:28:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.561+0000 7f3d97fff640 1 -- 172.21.15.100:0/467051955 learned_addr learned my addr 172.21.15.100:0/467051955 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.561+0000 7f3d9d723640 1 --2- 172.21.15.100:0/467051955 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d9815a7e0 0x7f3d98157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.561+0000 7f3d97fff640 1 -- 172.21.15.100:0/467051955 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d9815a7e0 msgr2=0x7f3d98157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.561+0000 7f3d97fff640 1 --2- 172.21.15.100:0/467051955 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d9815a7e0 0x7f3d98157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.561+0000 7f3d97fff640 1 -- 172.21.15.100:0/467051955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d980b3190 msgr2=0x7f3d98156430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:28:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.561+0000 7f3d97fff640 1 --2- 172.21.15.100:0/467051955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d980b3190 0x7f3d98156430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.561+0000 7f3d97fff640 1 -- 172.21.15.100:0/467051955 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d9815d790 con 0x7f3d98154c20 2024-09-11T22:28:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.561+0000 7f3d97fff640 1 --2- 172.21.15.100:0/467051955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d98154c20 0x7f3d980b54b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400c400 tx=0x7f3d8400c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.562+0000 7f3d957fa640 1 -- 172.21.15.100:0/467051955 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d84017070 con 0x7f3d98154c20 2024-09-11T22:28:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.562+0000 7f3d957fa640 1 -- 172.21.15.100:0/467051955 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d84005ce0 con 0x7f3d98154c20 2024-09-11T22:28:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.562+0000 7f3d9f186640 1 -- 172.21.15.100:0/467051955 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d9815da70 con 0x7f3d98154c20 2024-09-11T22:28:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.562+0000 7f3d957fa640 1 -- 172.21.15.100:0/467051955 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d84007310 con 0x7f3d98154c20 2024-09-11T22:28:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.562+0000 7f3d9f186640 1 -- 172.21.15.100:0/467051955 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d98155640 con 0x7f3d98154c20 2024-09-11T22:28:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.563+0000 7f3d9f186640 1 -- 172.21.15.100:0/467051955 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d980b3b30 con 0x7f3d98154c20 2024-09-11T22:28:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.563+0000 7f3d957fa640 1 -- 172.21.15.100:0/467051955 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d8401a070 con 0x7f3d98154c20 2024-09-11T22:28:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.564+0000 7f3d957fa640 1 --2- 172.21.15.100:0/467051955 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d7c06be10 0x7f3d7c06e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.564+0000 7f3d957fa640 1 -- 172.21.15.100:0/467051955 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f3d8408a530 con 0x7f3d98154c20 2024-09-11T22:28:49.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.564+0000 7f3d9cf22640 1 --2- 172.21.15.100:0/467051955 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d7c06be10 0x7f3d7c06e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:49.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.564+0000 7f3d9cf22640 1 --2- 172.21.15.100:0/467051955 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d7c06be10 0x7f3d7c06e2d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c006fd0 tx=0x7f3d8c006d80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:49.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.568+0000 7f3d957fa640 1 -- 172.21.15.100:0/467051955 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3d980b3b30 con 0x7f3d98154c20 2024-09-11T22:28:49.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.855+0000 7f3d9f186640 1 -- 172.21.15.100:0/467051955 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3d980c6fc0 con 0x7f3d98154c20 2024-09-11T22:28:49.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.856+0000 7f3d957fa640 1 -- 172.21.15.100:0/467051955 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f3d980c6fc0 con 0x7f3d98154c20 2024-09-11T22:28:49.857 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":60,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:28:49.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.858+0000 7f3d9f186640 1 -- 172.21.15.100:0/467051955 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d7c06be10 msgr2=0x7f3d7c06e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:49.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.858+0000 7f3d9f186640 1 --2- 172.21.15.100:0/467051955 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d7c06be10 0x7f3d7c06e2d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c006fd0 tx=0x7f3d8c006d80 comp rx=0 tx=0).stop 2024-09-11T22:28:49.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.858+0000 7f3d9f186640 1 -- 172.21.15.100:0/467051955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d98154c20 msgr2=0x7f3d980b54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:49.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.858+0000 7f3d9f186640 1 --2- 172.21.15.100:0/467051955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d98154c20 0x7f3d980b54b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3d8400c400 tx=0x7f3d8400c8c0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.858+0000 7f3d9f186640 1 -- 172.21.15.100:0/467051955 shutdown_connections 2024-09-11T22:28:49.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.858+0000 7f3d9f186640 1 --2- 172.21.15.100:0/467051955 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d7c06be10 0x7f3d7c06e2d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.858+0000 7f3d9f186640 1 --2- 172.21.15.100:0/467051955 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d9815a7e0 0x7f3d98157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.858+0000 7f3d9f186640 1 --2- 172.21.15.100:0/467051955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d98154c20 0x7f3d980b54b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.858+0000 7f3d9f186640 1 --2- 172.21.15.100:0/467051955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d980b3190 0x7f3d98156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:49.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.858+0000 7f3d9f186640 1 -- 172.21.15.100:0/467051955 >> 172.21.15.100:0/467051955 conn(0x7f3d98067d40 msgr2=0x7f3d981596b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:49.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.858+0000 7f3d9f186640 1 -- 172.21.15.100:0/467051955 shutdown_connections 2024-09-11T22:28:49.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:49.858+0000 7f3d9f186640 1 -- 172.21.15.100:0/467051955 wait complete. 2024-09-11T22:28:51.212 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:28:51.215 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:28:52.870 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:28:52.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:52.981+0000 7f103b4d7640 1 Processor -- start 2024-09-11T22:28:52.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:52.981+0000 7f103b4d7640 1 -- start start 2024-09-11T22:28:52.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:52.982+0000 7f103b4d7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 0x7f10340b3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:52.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:52.982+0000 7f103b4d7640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10340cae70 con 0x7f10340b14e0 2024-09-11T22:28:52.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:52.982+0000 7f103b4d7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10340709c0 con 0x7f10340b18c0 2024-09-11T22:28:52.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:52.982+0000 7f103b4d7640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f10340b3880 con 0x7f10340cb600 2024-09-11T22:28:52.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:52.982+0000 7f1039273640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f10340b14e0 legacy=0x7f1034070030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:28:52.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:52.982+0000 7f1039a74640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 0x7f10340b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:52.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:52.983+0000 7f1039a74640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 0x7f10340b3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:43548/0 (socket says 172.21.15.100:43548) 2024-09-11T22:28:52.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:52.983+0000 7f1039a74640 1 -- 172.21.15.100:0/221025582 learned_addr learned my addr 172.21.15.100:0/221025582 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:52.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:52.983+0000 7f1038a72640 1 --1- 172.21.15.100:0/221025582 >> v1:172.21.15.167:6789/0 conn(0x7f10340b18c0 0x7f103415c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:42432/0 (socket says 172.21.15.100:42432) 2024-09-11T22:28:52.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:52.983+0000 7f1039a74640 1 -- 172.21.15.100:0/221025582 >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 msgr2=0x7f10340b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:28:52.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:52.983+0000 7f1039a74640 1 -- 172.21.15.100:0/221025582 >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 msgr2=0x7f10340b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:28:52.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:52.983+0000 7f1039a74640 1 --2- 172.21.15.100:0/221025582 >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 0x7f10340b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:28:52.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:52.983+0000 7f1039a74640 1 --2- 172.21.15.100:0/221025582 >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 0x7f10340b3230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:28:53.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:53.183+0000 7f1039273640 1 -- 172.21.15.100:0/221025582 >> v1:172.21.15.100:6789/0 conn(0x7f10340b14e0 legacy=0x7f1034070030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:28:53.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:53.184+0000 7f1039a74640 1 --2- 172.21.15.100:0/221025582 >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 0x7f10340b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:53.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:53.184+0000 7f1039a74640 1 -- 172.21.15.100:0/221025582 >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 msgr2=0x7f10340b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:28:53.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:53.184+0000 7f1039a74640 1 -- 172.21.15.100:0/221025582 >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 msgr2=0x7f10340b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:28:53.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:53.184+0000 7f1039a74640 1 --2- 172.21.15.100:0/221025582 >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 0x7f10340b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:28:53.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:53.184+0000 7f1039a74640 1 --2- 172.21.15.100:0/221025582 >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 0x7f10340b3230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:28:53.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:53.584+0000 7f1039273640 1 -- 172.21.15.100:0/221025582 >> v1:172.21.15.100:6789/0 conn(0x7f10340b14e0 legacy=0x7f1034070030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:28:53.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:53.585+0000 7f1039a74640 1 --2- 172.21.15.100:0/221025582 >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 0x7f10340b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:53.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:53.585+0000 7f1039a74640 1 -- 172.21.15.100:0/221025582 >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 msgr2=0x7f10340b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:28:53.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:53.585+0000 7f1039a74640 1 -- 172.21.15.100:0/221025582 >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 msgr2=0x7f10340b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:28:53.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:53.585+0000 7f1039a74640 1 --2- 172.21.15.100:0/221025582 >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 0x7f10340b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:28:53.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:53.585+0000 7f1039a74640 1 --2- 172.21.15.100:0/221025582 >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 0x7f10340b3230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:28:54.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:54.385+0000 7f1039273640 1 -- 172.21.15.100:0/221025582 >> v1:172.21.15.100:6789/0 conn(0x7f10340b14e0 legacy=0x7f1034070030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:28:54.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:54.386+0000 7f1039a74640 1 --2- 172.21.15.100:0/221025582 >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 0x7f10340b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:54.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:54.386+0000 7f1039a74640 1 -- 172.21.15.100:0/221025582 >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 msgr2=0x7f10340b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:28:54.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:54.386+0000 7f1039a74640 1 -- 172.21.15.100:0/221025582 >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 msgr2=0x7f10340b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:28:54.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:54.386+0000 7f1039a74640 1 --2- 172.21.15.100:0/221025582 >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 0x7f10340b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:28:54.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:54.386+0000 7f1039a74640 1 --2- 172.21.15.100:0/221025582 >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 0x7f10340b3230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:28:55.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:55.982+0000 7f102affd640 1 -- 172.21.15.100:0/221025582 >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 msgr2=0x7f10340b3230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:28:55.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:55.982+0000 7f102affd640 1 --2- 172.21.15.100:0/221025582 >> v2:172.21.15.167:3300/0 conn(0x7f10340cb600 0x7f10340b3230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:55.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:55.982+0000 7f102affd640 1 -- 172.21.15.100:0/221025582 >> v1:172.21.15.167:6789/0 conn(0x7f10340b18c0 legacy=0x7f103415c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:55.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:55.982+0000 7f102affd640 1 -- 172.21.15.100:0/221025582 >> v1:172.21.15.100:6789/0 conn(0x7f10340b14e0 legacy=0x7f1034070030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:28:55.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:55.982+0000 7f102affd640 1 --2- 172.21.15.100:0/221025582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10180036d0 0x7f1018005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:55.982+0000 7f102affd640 1 --2- 172.21.15.100:0/221025582 >> v2:172.21.15.100:3300/0 conn(0x7f1018006220 0x7f10180086e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:55.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:55.982+0000 7f102affd640 1 -- 172.21.15.100:0/221025582 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f10340b3880 con 0x7f1018006220 2024-09-11T22:28:55.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:55.982+0000 7f102affd640 1 -- 172.21.15.100:0/221025582 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1018008d90 con 0x7f10180036d0 2024-09-11T22:28:55.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:55.982+0000 7f1038a72640 1 -- 172.21.15.100:0/221025582 >> v2:172.21.15.100:3300/0 conn(0x7f1018006220 msgr2=0x7f10180086e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:28:55.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:55.982+0000 7f1038a72640 1 --2- 172.21.15.100:0/221025582 >> v2:172.21.15.100:3300/0 conn(0x7f1018006220 0x7f10180086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:28:55.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:55.982+0000 7f1039273640 1 --2- 172.21.15.100:0/221025582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10180036d0 0x7f1018005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:55.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:55.983+0000 7f1039273640 1 -- 172.21.15.100:0/221025582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10180036d0 msgr2=0x7f1018005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:28:55.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:55.983+0000 7f1039273640 1 -- 172.21.15.100:0/221025582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10180036d0 msgr2=0x7f1018005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:28:55.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:55.983+0000 7f1039273640 1 --2- 172.21.15.100:0/221025582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10180036d0 0x7f1018005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:28:55.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:55.983+0000 7f1039273640 1 --2- 172.21.15.100:0/221025582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10180036d0 0x7f1018005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:28:56.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:56.183+0000 7f1038a72640 1 -- 172.21.15.100:0/221025582 >> v2:172.21.15.100:3300/0 conn(0x7f1018006220 msgr2=0x7f10180086e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:28:56.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:56.183+0000 7f1038a72640 1 --2- 172.21.15.100:0/221025582 >> v2:172.21.15.100:3300/0 conn(0x7f1018006220 0x7f10180086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:28:56.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:56.184+0000 7f1039273640 1 --2- 172.21.15.100:0/221025582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10180036d0 0x7f1018005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:56.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:56.184+0000 7f1039273640 1 -- 172.21.15.100:0/221025582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10180036d0 msgr2=0x7f1018005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:28:56.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:56.184+0000 7f1039273640 1 -- 172.21.15.100:0/221025582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10180036d0 msgr2=0x7f1018005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:28:56.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:56.184+0000 7f1039273640 1 --2- 172.21.15.100:0/221025582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10180036d0 0x7f1018005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:28:56.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:56.184+0000 7f1039273640 1 --2- 172.21.15.100:0/221025582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10180036d0 0x7f1018005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:28:56.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:56.584+0000 7f1038a72640 1 -- 172.21.15.100:0/221025582 >> v2:172.21.15.100:3300/0 conn(0x7f1018006220 msgr2=0x7f10180086e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:28:56.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:56.584+0000 7f1038a72640 1 --2- 172.21.15.100:0/221025582 >> v2:172.21.15.100:3300/0 conn(0x7f1018006220 0x7f10180086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:28:56.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:56.585+0000 7f1039273640 1 --2- 172.21.15.100:0/221025582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10180036d0 0x7f1018005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:56.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:56.585+0000 7f1039273640 1 -- 172.21.15.100:0/221025582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10180036d0 msgr2=0x7f1018005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:28:56.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:56.585+0000 7f1039273640 1 -- 172.21.15.100:0/221025582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10180036d0 msgr2=0x7f1018005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:28:56.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:56.585+0000 7f1039273640 1 --2- 172.21.15.100:0/221025582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10180036d0 0x7f1018005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:28:56.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:56.585+0000 7f1039273640 1 --2- 172.21.15.100:0/221025582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10180036d0 0x7f1018005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:28:57.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.385+0000 7f1038a72640 1 -- 172.21.15.100:0/221025582 >> v2:172.21.15.100:3300/0 conn(0x7f1018006220 msgr2=0x7f10180086e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:28:57.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.385+0000 7f1038a72640 1 --2- 172.21.15.100:0/221025582 >> v2:172.21.15.100:3300/0 conn(0x7f1018006220 0x7f10180086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:28:57.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.386+0000 7f1039273640 1 --2- 172.21.15.100:0/221025582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10180036d0 0x7f1018005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:57.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.386+0000 7f1039273640 1 -- 172.21.15.100:0/221025582 >> v2:172.21.15.100:3300/0 conn(0x7f1018006220 msgr2=0x7f10180086e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:28:57.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.386+0000 7f1039273640 1 --2- 172.21.15.100:0/221025582 >> v2:172.21.15.100:3300/0 conn(0x7f1018006220 0x7f10180086e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.386+0000 7f1039273640 1 -- 172.21.15.100:0/221025582 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1034070ca0 con 0x7f10180036d0 2024-09-11T22:28:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.387+0000 7f1039273640 1 --2- 172.21.15.100:0/221025582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10180036d0 0x7f1018005b20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1030003980 tx=0x7f103002b160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4460d115cefbbd73 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.387+0000 7f102bfff640 1 -- 172.21.15.100:0/221025582 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1030031070 con 0x7f10180036d0 2024-09-11T22:28:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.387+0000 7f102bfff640 1 -- 172.21.15.100:0/221025582 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1030035410 con 0x7f10180036d0 2024-09-11T22:28:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.387+0000 7f102bfff640 1 -- 172.21.15.100:0/221025582 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1030035800 con 0x7f10180036d0 2024-09-11T22:28:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.388+0000 7f103b4d7640 1 -- 172.21.15.100:0/221025582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10180036d0 msgr2=0x7f1018005b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.388+0000 7f103b4d7640 1 --2- 172.21.15.100:0/221025582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10180036d0 0x7f1018005b20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1030003980 tx=0x7f103002b160 comp rx=0 tx=0).stop 2024-09-11T22:28:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.388+0000 7f1039a74640 1 -- 172.21.15.100:0/221025582 reap_dead start 2024-09-11T22:28:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.388+0000 7f103b4d7640 1 -- 172.21.15.100:0/221025582 shutdown_connections 2024-09-11T22:28:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.388+0000 7f103b4d7640 1 -- 172.21.15.100:0/221025582 >> 172.21.15.100:0/221025582 conn(0x7f1034071560 msgr2=0x7f1034071940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:57.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.388+0000 7f103b4d7640 1 -- 172.21.15.100:0/221025582 shutdown_connections 2024-09-11T22:28:57.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.388+0000 7f103b4d7640 1 -- 172.21.15.100:0/221025582 wait complete. 2024-09-11T22:28:57.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.389+0000 7f103b4d7640 1 Processor -- start 2024-09-11T22:28:57.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.389+0000 7f103b4d7640 1 -- start start 2024-09-11T22:28:57.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.390+0000 7f103b4d7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10340af9a0 0x7f10340afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.390+0000 7f103b4d7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10340aa550 0x7f10340aa990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.390+0000 7f103b4d7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10341585d0 0x7f1034158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.390+0000 7f103b4d7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1034070f80 con 0x7f10340af9a0 2024-09-11T22:28:57.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.390+0000 7f103b4d7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f10340b0fc0 con 0x7f10341585d0 2024-09-11T22:28:57.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.390+0000 7f103b4d7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f10340c5750 con 0x7f10340aa550 2024-09-11T22:28:57.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.390+0000 7f1039273640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10340af9a0 msgr2=0x7f10340afd80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:28:57.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.390+0000 7f1039273640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10340af9a0 0x7f10340afd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:28:57.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.390+0000 7f1038a72640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10340aa550 0x7f10340aa990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:57.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.390+0000 7f1039a74640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10341585d0 0x7f1034158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:57.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.390+0000 7f1039a74640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10341585d0 0x7f1034158a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:43588/0 (socket says 172.21.15.100:43588) 2024-09-11T22:28:57.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.390+0000 7f1038a72640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10340aa550 0x7f10340aa990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:34442/0 (socket says 172.21.15.100:34442) 2024-09-11T22:28:57.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.390+0000 7f1039a74640 1 -- 172.21.15.100:0/2791743425 learned_addr learned my addr 172.21.15.100:0/2791743425 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:57.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.391+0000 7f1038a72640 1 -- 172.21.15.100:0/2791743425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10341585d0 msgr2=0x7f1034158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.391+0000 7f1038a72640 1 --2- 172.21.15.100:0/2791743425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10341585d0 0x7f1034158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.391+0000 7f1038a72640 1 -- 172.21.15.100:0/2791743425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10340af9a0 msgr2=0x7f10340afd80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:28:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.391+0000 7f1038a72640 1 --2- 172.21.15.100:0/2791743425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10340af9a0 0x7f10340afd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.391+0000 7f1038a72640 1 -- 172.21.15.100:0/2791743425 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10340aaed0 con 0x7f10340aa550 2024-09-11T22:28:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.391+0000 7f1039a74640 1 --2- 172.21.15.100:0/2791743425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10341585d0 0x7f1034158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.391+0000 7f1038a72640 1 --2- 172.21.15.100:0/2791743425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10340aa550 0x7f10340aa990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f10340cbde0 tx=0x7f102400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.391+0000 7f1029ffb640 1 -- 172.21.15.100:0/2791743425 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10240074e0 con 0x7f10340aa550 2024-09-11T22:28:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.391+0000 7f1029ffb640 1 -- 172.21.15.100:0/2791743425 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10240047e0 con 0x7f10340aa550 2024-09-11T22:28:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.391+0000 7f103b4d7640 1 -- 172.21.15.100:0/2791743425 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10340c4470 con 0x7f10340aa550 2024-09-11T22:28:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.391+0000 7f1029ffb640 1 -- 172.21.15.100:0/2791743425 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1024004bd0 con 0x7f10340aa550 2024-09-11T22:28:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.391+0000 7f103b4d7640 1 -- 172.21.15.100:0/2791743425 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f10340c4a30 con 0x7f10340aa550 2024-09-11T22:28:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.392+0000 7f103b4d7640 1 -- 172.21.15.100:0/2791743425 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10340c8940 con 0x7f10340aa550 2024-09-11T22:28:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.393+0000 7f1029ffb640 1 -- 172.21.15.100:0/2791743425 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f102401a020 con 0x7f10340aa550 2024-09-11T22:28:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.393+0000 7f1029ffb640 1 --2- 172.21.15.100:0/2791743425 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f101806cc10 0x7f101806f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.393+0000 7f1029ffb640 1 -- 172.21.15.100:0/2791743425 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f102408aa60 con 0x7f10340aa550 2024-09-11T22:28:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.393+0000 7f1039273640 1 --2- 172.21.15.100:0/2791743425 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f101806cc10 0x7f101806f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.394+0000 7f1039273640 1 --2- 172.21.15.100:0/2791743425 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f101806cc10 0x7f101806f0d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1030035000 tx=0x7f103000f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:57.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.398+0000 7f1029ffb640 1 -- 172.21.15.100:0/2791743425 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f10340c8940 con 0x7f10340aa550 2024-09-11T22:28:57.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.677+0000 7f103b4d7640 1 -- 172.21.15.100:0/2791743425 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1034068db0 con 0x7f10340aa550 2024-09-11T22:28:57.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.677+0000 7f1029ffb640 1 -- 172.21.15.100:0/2791743425 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7f1034068db0 con 0x7f10340aa550 2024-09-11T22:28:57.678 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":62,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:28:57.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.680+0000 7f103b4d7640 1 -- 172.21.15.100:0/2791743425 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f101806cc10 msgr2=0x7f101806f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.680+0000 7f103b4d7640 1 --2- 172.21.15.100:0/2791743425 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f101806cc10 0x7f101806f0d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1030035000 tx=0x7f103000f040 comp rx=0 tx=0).stop 2024-09-11T22:28:57.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.680+0000 7f103b4d7640 1 -- 172.21.15.100:0/2791743425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10340aa550 msgr2=0x7f10340aa990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.680+0000 7f103b4d7640 1 --2- 172.21.15.100:0/2791743425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10340aa550 0x7f10340aa990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f10340cbde0 tx=0x7f102400c8f0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.680+0000 7f103b4d7640 1 -- 172.21.15.100:0/2791743425 shutdown_connections 2024-09-11T22:28:57.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.680+0000 7f103b4d7640 1 --2- 172.21.15.100:0/2791743425 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f101806cc10 0x7f101806f0d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.680+0000 7f103b4d7640 1 --2- 172.21.15.100:0/2791743425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10341585d0 0x7f1034158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.680+0000 7f103b4d7640 1 --2- 172.21.15.100:0/2791743425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10340aa550 0x7f10340aa990 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.680+0000 7f103b4d7640 1 --2- 172.21.15.100:0/2791743425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10340af9a0 0x7f10340afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.680+0000 7f103b4d7640 1 -- 172.21.15.100:0/2791743425 >> 172.21.15.100:0/2791743425 conn(0x7f1034071560 msgr2=0x7f10340cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:57.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.680+0000 7f103b4d7640 1 -- 172.21.15.100:0/2791743425 shutdown_connections 2024-09-11T22:28:57.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.680+0000 7f103b4d7640 1 -- 172.21.15.100:0/2791743425 wait complete. 2024-09-11T22:28:57.693 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-11T22:28:57.693 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-11T22:28:57.694 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:28:57.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.813+0000 7faabf277640 1 Processor -- start 2024-09-11T22:28:57.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.813+0000 7faabf277640 1 -- start start 2024-09-11T22:28:57.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.814+0000 7faabf277640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7faab8152a80 0x7faab806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.814+0000 7faabf277640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faab80b0c00 0x7faab80cb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.814+0000 7faabf277640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faab80c98f0 con 0x7faab80c8b10 2024-09-11T22:28:57.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.814+0000 7faabf277640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7faab8152e60 con 0x7faab8152a80 2024-09-11T22:28:57.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.814+0000 7faabf277640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7faab80c9050 con 0x7faab80b0c00 2024-09-11T22:28:57.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.814+0000 7faabc812640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7faab80c8b10 legacy=0x7faab8159030 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:28:57.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.814+0000 7faabd013640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7faab8152a80 0x7faab806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:57.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.814+0000 7faabd814640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faab80b0c00 0x7faab80cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:57.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.814+0000 7faabd013640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7faab8152a80 0x7faab806ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:43602/0 (socket says 172.21.15.100:43602) 2024-09-11T22:28:57.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.814+0000 7faabd013640 1 -- 172.21.15.100:0/3053022482 learned_addr learned my addr 172.21.15.100:0/3053022482 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:57.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.815+0000 7faabd013640 1 -- 172.21.15.100:0/3053022482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faab80b0c00 msgr2=0x7faab80cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:28:57.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.815+0000 7faabd013640 1 --2- 172.21.15.100:0/3053022482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faab80b0c00 0x7faab80cb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.815+0000 7faabd013640 1 -- 172.21.15.100:0/3053022482 >> v1:172.21.15.100:6789/0 conn(0x7faab80c8b10 legacy=0x7faab8159030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:28:57.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.815+0000 7faabd013640 1 -- 172.21.15.100:0/3053022482 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab80c9330 con 0x7faab8152a80 2024-09-11T22:28:57.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.815+0000 7faabd814640 1 --2- 172.21.15.100:0/3053022482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faab80b0c00 0x7faab80cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:28:57.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.815+0000 7faabd013640 1 --2- 172.21.15.100:0/3053022482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab8152a80 0x7faab806ff90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faab4009870 tx=0x7faab402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=494a389b2a6cff94 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:57.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.816+0000 7faaaffff640 1 -- 172.21.15.100:0/3053022482 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4037070 con 0x7faab8152a80 2024-09-11T22:28:57.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.816+0000 7faaaffff640 1 -- 172.21.15.100:0/3053022482 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab4032440 con 0x7faab8152a80 2024-09-11T22:28:57.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.816+0000 7faaaffff640 1 -- 172.21.15.100:0/3053022482 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4032810 con 0x7faab8152a80 2024-09-11T22:28:57.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.816+0000 7faabf277640 1 -- 172.21.15.100:0/3053022482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab8152a80 msgr2=0x7faab806ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.816+0000 7faabf277640 1 --2- 172.21.15.100:0/3053022482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab8152a80 0x7faab806ff90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faab4009870 tx=0x7faab402a210 comp rx=0 tx=0).stop 2024-09-11T22:28:57.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.816+0000 7faabf277640 1 -- 172.21.15.100:0/3053022482 shutdown_connections 2024-09-11T22:28:57.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.816+0000 7faabf277640 1 --2- 172.21.15.100:0/3053022482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faab80b0c00 0x7faab80cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.816+0000 7faabf277640 1 --2- 172.21.15.100:0/3053022482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab8152a80 0x7faab806ff90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.816+0000 7faabf277640 1 -- 172.21.15.100:0/3053022482 >> 172.21.15.100:0/3053022482 conn(0x7faab806e000 msgr2=0x7faab806e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:57.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.816+0000 7faabf277640 1 -- 172.21.15.100:0/3053022482 shutdown_connections 2024-09-11T22:28:57.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.816+0000 7faabf277640 1 -- 172.21.15.100:0/3053022482 wait complete. 2024-09-11T22:28:57.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.817+0000 7faabf277640 1 Processor -- start 2024-09-11T22:28:57.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.818+0000 7faabf277640 1 -- start start 2024-09-11T22:28:57.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.818+0000 7faabf277640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faab80b0c00 0x7faab815a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.818+0000 7faabf277640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab80c8b10 0x7faab81f1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.818+0000 7faabf277640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faab8152a80 0x7faab81565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.818+0000 7faabf277640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faab8158b10 con 0x7faab80b0c00 2024-09-11T22:28:57.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.818+0000 7faabf277640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faab8158830 con 0x7faab80c8b10 2024-09-11T22:28:57.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.818+0000 7faabf277640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7faab815bc60 con 0x7faab8152a80 2024-09-11T22:28:57.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.818+0000 7faabd013640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faab80b0c00 msgr2=0x7faab815a660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:28:57.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.818+0000 7faabd013640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faab80b0c00 0x7faab815a660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:28:57.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.819+0000 7faabc812640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab80c8b10 0x7faab81f1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:57.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.819+0000 7faabc812640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab80c8b10 0x7faab81f1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:43608/0 (socket says 172.21.15.100:43608) 2024-09-11T22:28:57.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.819+0000 7faabc812640 1 -- 172.21.15.100:0/4226480462 learned_addr learned my addr 172.21.15.100:0/4226480462 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:57.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.819+0000 7faabd814640 1 --2- 172.21.15.100:0/4226480462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faab8152a80 0x7faab81565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:57.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.819+0000 7faabc812640 1 -- 172.21.15.100:0/4226480462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faab8152a80 msgr2=0x7faab81565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.819+0000 7faabc812640 1 --2- 172.21.15.100:0/4226480462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faab8152a80 0x7faab81565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.819+0000 7faabc812640 1 -- 172.21.15.100:0/4226480462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faab80b0c00 msgr2=0x7faab815a660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:28:57.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.819+0000 7faabc812640 1 --2- 172.21.15.100:0/4226480462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faab80b0c00 0x7faab815a660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.819+0000 7faabc812640 1 -- 172.21.15.100:0/4226480462 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faab81f06a0 con 0x7faab80c8b10 2024-09-11T22:28:57.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.819+0000 7faabc812640 1 --2- 172.21.15.100:0/4226480462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab80c8b10 0x7faab81f1140 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faaa800b550 tx=0x7faaa800b950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:57.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.819+0000 7faaadffb640 1 -- 172.21.15.100:0/4226480462 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa8016070 con 0x7faab80c8b10 2024-09-11T22:28:57.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.819+0000 7faaadffb640 1 -- 172.21.15.100:0/4226480462 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaa8003de0 con 0x7faab80c8b10 2024-09-11T22:28:57.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.819+0000 7faaadffb640 1 -- 172.21.15.100:0/4226480462 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa80052b0 con 0x7faab80c8b10 2024-09-11T22:28:57.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.819+0000 7faabf277640 1 -- 172.21.15.100:0/4226480462 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faab81598b0 con 0x7faab80c8b10 2024-09-11T22:28:57.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.820+0000 7faabf277640 1 -- 172.21.15.100:0/4226480462 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faab81f0940 con 0x7faab80c8b10 2024-09-11T22:28:57.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.820+0000 7faabf277640 1 --2- 172.21.15.100:0/4226480462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab806d960 0x7faab8157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.820+0000 7faabf277640 1 -- 172.21.15.100:0/4226480462 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faab806ff90 con 0x7faab806d960 2024-09-11T22:28:57.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.821+0000 7faabd013640 1 --2- 172.21.15.100:0/4226480462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab806d960 0x7faab8157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:57.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.821+0000 7faabd013640 1 -- 172.21.15.100:0/4226480462 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faab80ca680 con 0x7faab806d960 2024-09-11T22:28:57.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.821+0000 7faabd013640 1 --2- 172.21.15.100:0/4226480462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab806d960 0x7faab8157590 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faab80743b0 tx=0x7faab40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:57.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.821+0000 7faaadffb640 1 -- 172.21.15.100:0/4226480462 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4037040 con 0x7faab806d960 2024-09-11T22:28:57.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.821+0000 7faaadffb640 1 -- 172.21.15.100:0/4226480462 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faaa8019070 con 0x7faab80c8b10 2024-09-11T22:28:57.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.822+0000 7faaadffb640 1 --2- 172.21.15.100:0/4226480462 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7faa9c06bd30 0x7faa9c06e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.822+0000 7faaadffb640 1 -- 172.21.15.100:0/4226480462 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7faaa808a4f0 con 0x7faab80c8b10 2024-09-11T22:28:57.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.822+0000 7faabd814640 1 --2- 172.21.15.100:0/4226480462 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7faa9c06bd30 0x7faa9c06e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:57.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.822+0000 7faaadffb640 1 -- 172.21.15.100:0/4226480462 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7faab4009490 con 0x7faab806d960 2024-09-11T22:28:57.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.822+0000 7faaadffb640 1 -- 172.21.15.100:0/4226480462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab806d960 msgr2=0x7faab8157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.822+0000 7faaadffb640 1 --2- 172.21.15.100:0/4226480462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab806d960 0x7faab8157590 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faab80743b0 tx=0x7faab40046c0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.822+0000 7faaadffb640 1 -- 172.21.15.100:0/4226480462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab806d960 msgr2=0x7faab8157590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:28:57.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.822+0000 7faaadffb640 1 --2- 172.21.15.100:0/4226480462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab806d960 0x7faab8157590 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.822+0000 7faabd814640 1 --2- 172.21.15.100:0/4226480462 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7faa9c06bd30 0x7faa9c06e1f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7faab0009c10 tx=0x7faab000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:57.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.828+0000 7faabf277640 1 --2- 172.21.15.100:0/4226480462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab814bea0 0x7faab814c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.828+0000 7faabf277640 1 -- 172.21.15.100:0/4226480462 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faab814c7c0 con 0x7faab814bea0 2024-09-11T22:28:57.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.829+0000 7faabd013640 1 --2- 172.21.15.100:0/4226480462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab814bea0 0x7faab814c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:57.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.829+0000 7faabd013640 1 -- 172.21.15.100:0/4226480462 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faab80ca3a0 con 0x7faab814bea0 2024-09-11T22:28:57.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.829+0000 7faabd013640 1 --2- 172.21.15.100:0/4226480462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab814bea0 0x7faab814c280 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faab4000c00 tx=0x7faab4009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:57.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.829+0000 7faaadffb640 1 -- 172.21.15.100:0/4226480462 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4003ba0 con 0x7faab814bea0 2024-09-11T22:28:57.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.829+0000 7faaadffb640 1 -- 172.21.15.100:0/4226480462 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4878 (secure 0 0 0) 0x7faab4003b80 con 0x7faab814bea0 2024-09-11T22:28:57.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.829+0000 7faaadffb640 1 -- 172.21.15.100:0/4226480462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab814bea0 msgr2=0x7faab814c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.829+0000 7faaadffb640 1 --2- 172.21.15.100:0/4226480462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab814bea0 0x7faab814c280 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faab4000c00 tx=0x7faab4009240 comp rx=0 tx=0).stop 2024-09-11T22:28:57.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.829+0000 7faaadffb640 1 -- 172.21.15.100:0/4226480462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab814bea0 msgr2=0x7faab814c280 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:28:57.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.829+0000 7faaadffb640 1 --2- 172.21.15.100:0/4226480462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab814bea0 0x7faab814c280 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.831 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:28:57.831 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:28:57.832 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:28:57.832 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:28:57.832 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 62, 2024-09-11T22:28:57.832 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 323108, 2024-09-11T22:28:57.832 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:28:57.832 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:28:57.832 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:28:57.832 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:57.832 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:28:57.832 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:28:57.832 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:28:57.832 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:28:57.833 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:57.833 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:57.833 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:57.833 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:57.833 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:57.833 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:57.833 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:57.833 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:57.833 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:57.833 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:57.833 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:57.833 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:57.833 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:28:57.833 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:28:57.834 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:57.834 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:57.834 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:57.834 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:57.834 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:57.834 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:57.834 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:57.834 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:57.834 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:57.834 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:57.834 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:57.834 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:57.834 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.835 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:28:57.835 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:28:57.835 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:28:57.835 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:28:57.835 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:28:57.835 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:28:57.835 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:28:57.835 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:28:57.835 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:28:57.835 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:28:57.835 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:28:57.835 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:28:57.835 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:28:57.835 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:28:57.836 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:28:57.836 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:28:57.836 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:28:57.836 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:57.836 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:57.836 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:57.836 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:57.836 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:57.836 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:57.836 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:57.836 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:57.836 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:57.836 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:57.837 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:57.837 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:57.837 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:28:57.837 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.837 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:28:57.837 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.837 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:28:57.837 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:28:57.837 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:57.837 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:57.837 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.837 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:57.837 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:28:57.838 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:57.838 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.838 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.838 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:57.838 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:28:57.838 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:57.838 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:57.838 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:57.838 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.838 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:28:57.838 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:28:57.838 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:57.838 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:57.838 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:57.839 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.839 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.839 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:28:57.839 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:28:57.839 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:57.839 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:57.839 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.839 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:57.839 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:28:57.839 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:57.839 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.839 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.839 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:57.840 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:28:57.840 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:57.840 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:57.840 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:57.840 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.840 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:28:57.840 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:28:57.840 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:57.840 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:57.840 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:57.840 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.840 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.840 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:28:57.841 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:28:57.841 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:57.841 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:57.841 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.841 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:57.841 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:28:57.841 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:57.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.841 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.841 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:57.841 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:28:57.841 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:57.841 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:57.842 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:57.842 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.842 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:28:57.842 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:28:57.842 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:57.842 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:57.842 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:57.842 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:57.842 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:57.842 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.842 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:28:57.842 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:28:57.842 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.842 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:57.843 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:57.843 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:28:57.843 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:57.843 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:57.843 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:28:57.843 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.843 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:57.843 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:57.843 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:28:57.843 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:57.843 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:57.843 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:28:57.843 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.843 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:57.844 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:57.844 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:28:57.844 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:57.844 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:57.844 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:28:57.844 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.844 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:57.844 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:57.844 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:28:57.844 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:57.844 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:57.844 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.844 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:28:57.844 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:28:57.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.830+0000 7faabf277640 1 -- 172.21.15.100:0/4226480462 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7faa9c06bd30 msgr2=0x7faa9c06e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.830+0000 7faabf277640 1 --2- 172.21.15.100:0/4226480462 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7faa9c06bd30 0x7faa9c06e1f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7faab0009c10 tx=0x7faab000b040 comp rx=0 tx=0).stop 2024-09-11T22:28:57.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.830+0000 7faabf277640 1 -- 172.21.15.100:0/4226480462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab80c8b10 msgr2=0x7faab81f1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.830+0000 7faabf277640 1 --2- 172.21.15.100:0/4226480462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab80c8b10 0x7faab81f1140 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faaa800b550 tx=0x7faaa800b950 comp rx=0 tx=0).stop 2024-09-11T22:28:57.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.830+0000 7faabd814640 1 -- 172.21.15.100:0/4226480462 reap_dead start 2024-09-11T22:28:57.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.830+0000 7faabf277640 1 -- 172.21.15.100:0/4226480462 shutdown_connections 2024-09-11T22:28:57.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.830+0000 7faabf277640 1 --2- 172.21.15.100:0/4226480462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faab80c8b10 0x7faab81f1140 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.830+0000 7faabf277640 1 -- 172.21.15.100:0/4226480462 >> 172.21.15.100:0/4226480462 conn(0x7faab806e000 msgr2=0x7faab80cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:57.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.830+0000 7faabf277640 1 -- 172.21.15.100:0/4226480462 shutdown_connections 2024-09-11T22:28:57.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.830+0000 7faabf277640 1 -- 172.21.15.100:0/4226480462 wait complete. 2024-09-11T22:28:57.847 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:28:57.847 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-11T22:28:57.847 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:28:57.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.952+0000 7fb0e91c6640 1 Processor -- start 2024-09-11T22:28:57.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.952+0000 7fb0e91c6640 1 -- start start 2024-09-11T22:28:57.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.953+0000 7fb0e91c6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb0e406ce60 0x7fb0e415bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.953+0000 7fb0e91c6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb0e406d240 0x7fb0e41651e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.953+0000 7fb0e91c6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0e40c6510 con 0x7fb0e415c290 2024-09-11T22:28:57.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.953+0000 7fb0e91c6640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb0e415b820 con 0x7fb0e406d240 2024-09-11T22:28:57.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.953+0000 7fb0e91c6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fb0e40c5470 con 0x7fb0e406ce60 2024-09-11T22:28:57.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.953+0000 7fb0e359e640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7fb0e406d240 msgr2=0x7fb0e41651e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:28:57.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.953+0000 7fb0e359e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb0e406d240 0x7fb0e41651e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:28:57.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.953+0000 7fb0e2d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb0e406ce60 0x7fb0e415bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:57.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.953+0000 7fb0e2d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb0e406ce60 0x7fb0e415bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:43642/0 (socket says 172.21.15.100:43642) 2024-09-11T22:28:57.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.953+0000 7fb0e2d9d640 1 -- 172.21.15.100:0/2857182510 learned_addr learned my addr 172.21.15.100:0/2857182510 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:57.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.953+0000 7fb0e259c640 1 --1- 172.21.15.100:0/2857182510 >> v1:172.21.15.167:6789/0 conn(0x7fb0e415c290 0x7fb0e41546b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:42438/0 (socket says 172.21.15.100:42438) 2024-09-11T22:28:57.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.954+0000 7fb0e2d9d640 1 -- 172.21.15.100:0/2857182510 >> v2:172.21.15.100:3300/0 conn(0x7fb0e406d240 msgr2=0x7fb0e41651e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:28:57.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.954+0000 7fb0e2d9d640 1 --2- 172.21.15.100:0/2857182510 >> v2:172.21.15.100:3300/0 conn(0x7fb0e406d240 0x7fb0e41651e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.954+0000 7fb0e2d9d640 1 -- 172.21.15.100:0/2857182510 >> v1:172.21.15.167:6789/0 conn(0x7fb0e415c290 legacy=0x7fb0e41546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.954+0000 7fb0e2d9d640 1 -- 172.21.15.100:0/2857182510 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e40c5750 con 0x7fb0e406ce60 2024-09-11T22:28:57.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.955+0000 7fb0e2d9d640 1 --2- 172.21.15.100:0/2857182510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0e406ce60 0x7fb0e415bd50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb0e408d7a0 tx=0x7fb0d402a290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c4219a1be3a0ff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:57.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.955+0000 7fb0e1d9b640 1 -- 172.21.15.100:0/2857182510 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4037070 con 0x7fb0e406ce60 2024-09-11T22:28:57.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.955+0000 7fb0e1d9b640 1 -- 172.21.15.100:0/2857182510 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d4032440 con 0x7fb0e406ce60 2024-09-11T22:28:57.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.955+0000 7fb0e1d9b640 1 -- 172.21.15.100:0/2857182510 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d40327f0 con 0x7fb0e406ce60 2024-09-11T22:28:57.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.955+0000 7fb0e91c6640 1 -- 172.21.15.100:0/2857182510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0e406ce60 msgr2=0x7fb0e415bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.955+0000 7fb0e91c6640 1 --2- 172.21.15.100:0/2857182510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0e406ce60 0x7fb0e415bd50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb0e408d7a0 tx=0x7fb0d402a290 comp rx=0 tx=0).stop 2024-09-11T22:28:57.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.955+0000 7fb0e91c6640 1 -- 172.21.15.100:0/2857182510 shutdown_connections 2024-09-11T22:28:57.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.955+0000 7fb0e91c6640 1 --2- 172.21.15.100:0/2857182510 >> v2:172.21.15.100:3300/0 conn(0x7fb0e406d240 0x7fb0e41651e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.955+0000 7fb0e91c6640 1 --2- 172.21.15.100:0/2857182510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0e406ce60 0x7fb0e415bd50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.955+0000 7fb0e91c6640 1 -- 172.21.15.100:0/2857182510 >> 172.21.15.100:0/2857182510 conn(0x7fb0e406bc10 msgr2=0x7fb0e406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:57.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.955+0000 7fb0e91c6640 1 -- 172.21.15.100:0/2857182510 shutdown_connections 2024-09-11T22:28:57.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.955+0000 7fb0e91c6640 1 -- 172.21.15.100:0/2857182510 wait complete. 2024-09-11T22:28:57.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.957+0000 7fb0e91c6640 1 Processor -- start 2024-09-11T22:28:57.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.957+0000 7fb0e91c6640 1 -- start start 2024-09-11T22:28:57.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.957+0000 7fb0e91c6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0e406ce60 0x7fb0e41f1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.957+0000 7fb0e91c6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e406d240 0x7fb0e41efc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.957+0000 7fb0e91c6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0e415c290 0x7fb0e41515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.957+0000 7fb0e91c6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e40cb1b0 con 0x7fb0e406ce60 2024-09-11T22:28:57.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.957+0000 7fb0e91c6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e40c5d10 con 0x7fb0e415c290 2024-09-11T22:28:57.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.957+0000 7fb0e91c6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb0e40cad20 con 0x7fb0e406d240 2024-09-11T22:28:57.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.957+0000 7fb0e2d9d640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0e406ce60 msgr2=0x7fb0e41f1790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:28:57.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.957+0000 7fb0e2d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0e406ce60 0x7fb0e41f1790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:28:57.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.958+0000 7fb0e359e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0e415c290 0x7fb0e41515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:57.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.958+0000 7fb0e259c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e406d240 0x7fb0e41efc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:57.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.958+0000 7fb0e359e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0e415c290 0x7fb0e41515c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:43654/0 (socket says 172.21.15.100:43654) 2024-09-11T22:28:57.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.958+0000 7fb0e359e640 1 -- 172.21.15.100:0/4148987647 learned_addr learned my addr 172.21.15.100:0/4148987647 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:28:57.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.958+0000 7fb0e359e640 1 -- 172.21.15.100:0/4148987647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e406d240 msgr2=0x7fb0e41efc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.958+0000 7fb0e359e640 1 --2- 172.21.15.100:0/4148987647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e406d240 0x7fb0e41efc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.958+0000 7fb0e359e640 1 -- 172.21.15.100:0/4148987647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0e406ce60 msgr2=0x7fb0e41f1790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:28:57.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.958+0000 7fb0e359e640 1 --2- 172.21.15.100:0/4148987647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0e406ce60 0x7fb0e41f1790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.958+0000 7fb0e359e640 1 -- 172.21.15.100:0/4148987647 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e40ca530 con 0x7fb0e415c290 2024-09-11T22:28:57.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.958+0000 7fb0e359e640 1 --2- 172.21.15.100:0/4148987647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0e415c290 0x7fb0e41515c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc00be80 tx=0x7fb0dc00bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:57.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.958+0000 7fb0cb7fe640 1 -- 172.21.15.100:0/4148987647 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc016430 con 0x7fb0e415c290 2024-09-11T22:28:57.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.958+0000 7fb0cb7fe640 1 -- 172.21.15.100:0/4148987647 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0dc010030 con 0x7fb0e415c290 2024-09-11T22:28:57.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.958+0000 7fb0e91c6640 1 -- 172.21.15.100:0/4148987647 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0e41eee50 con 0x7fb0e415c290 2024-09-11T22:28:57.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.958+0000 7fb0cb7fe640 1 -- 172.21.15.100:0/4148987647 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc016810 con 0x7fb0e415c290 2024-09-11T22:28:57.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.958+0000 7fb0e91c6640 1 -- 172.21.15.100:0/4148987647 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0e41ef410 con 0x7fb0e415c290 2024-09-11T22:28:57.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.959+0000 7fb0e91c6640 1 --2- 172.21.15.100:0/4148987647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e41ef650 0x7fb0e4151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.959+0000 7fb0e91c6640 1 -- 172.21.15.100:0/4148987647 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb0e40ca300 con 0x7fb0e41ef650 2024-09-11T22:28:57.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.960+0000 7fb0e2d9d640 1 --2- 172.21.15.100:0/4148987647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e41ef650 0x7fb0e4151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:57.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.960+0000 7fb0e2d9d640 1 -- 172.21.15.100:0/4148987647 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb0e415b2e0 con 0x7fb0e41ef650 2024-09-11T22:28:57.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.960+0000 7fb0e2d9d640 1 --2- 172.21.15.100:0/4148987647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e41ef650 0x7fb0e4151b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb0e40ca9e0 tx=0x7fb0d40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:57.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.960+0000 7fb0cb7fe640 1 -- 172.21.15.100:0/4148987647 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb0dc0153e0 con 0x7fb0e415c290 2024-09-11T22:28:57.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.961+0000 7fb0cb7fe640 1 --2- 172.21.15.100:0/4148987647 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb0d006bde0 0x7fb0d006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.961+0000 7fb0cb7fe640 1 -- 172.21.15.100:0/4148987647 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fb0dc08b6b0 con 0x7fb0e415c290 2024-09-11T22:28:57.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.961+0000 7fb0e259c640 1 --2- 172.21.15.100:0/4148987647 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb0d006bde0 0x7fb0d006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:57.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.961+0000 7fb0cb7fe640 1 -- 172.21.15.100:0/4148987647 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4037040 con 0x7fb0e41ef650 2024-09-11T22:28:57.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.961+0000 7fb0cb7fe640 1 -- 172.21.15.100:0/4148987647 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb0d4004020 con 0x7fb0e41ef650 2024-09-11T22:28:57.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.961+0000 7fb0cb7fe640 1 -- 172.21.15.100:0/4148987647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e41ef650 msgr2=0x7fb0e4151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.961+0000 7fb0cb7fe640 1 --2- 172.21.15.100:0/4148987647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e41ef650 0x7fb0e4151b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb0e40ca9e0 tx=0x7fb0d40046c0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.961+0000 7fb0cb7fe640 1 -- 172.21.15.100:0/4148987647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e41ef650 msgr2=0x7fb0e4151b00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:28:57.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.961+0000 7fb0cb7fe640 1 --2- 172.21.15.100:0/4148987647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e41ef650 0x7fb0e4151b00 secure :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb0e40ca9e0 tx=0x7fb0d40046c0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.961+0000 7fb0e259c640 1 --2- 172.21.15.100:0/4148987647 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb0d006bde0 0x7fb0d006e2a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8007fd0 tx=0x7fb0d8007e80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:57.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.969+0000 7fb0e91c6640 1 --2- 172.21.15.100:0/4148987647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e40cc380 0x7fb0e41f05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:28:57.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.969+0000 7fb0e91c6640 1 -- 172.21.15.100:0/4148987647 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb0e40cf590 con 0x7fb0e40cc380 2024-09-11T22:28:57.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.969+0000 7fb0e2d9d640 1 --2- 172.21.15.100:0/4148987647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e40cc380 0x7fb0e41f05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:28:57.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.969+0000 7fb0e2d9d640 1 -- 172.21.15.100:0/4148987647 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb0e40cf2b0 con 0x7fb0e40cc380 2024-09-11T22:28:57.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.970+0000 7fb0e2d9d640 1 --2- 172.21.15.100:0/4148987647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e40cc380 0x7fb0e41f05a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4000c00 tx=0x7fb0d4009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:28:57.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.970+0000 7fb0cb7fe640 1 -- 172.21.15.100:0/4148987647 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d404d070 con 0x7fb0e40cc380 2024-09-11T22:28:57.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.970+0000 7fb0cb7fe640 1 -- 172.21.15.100:0/4148987647 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5043 (secure 0 0 0) 0x7fb0d404b070 con 0x7fb0e40cc380 2024-09-11T22:28:57.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.970+0000 7fb0cb7fe640 1 -- 172.21.15.100:0/4148987647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e40cc380 msgr2=0x7fb0e41f05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.970+0000 7fb0cb7fe640 1 --2- 172.21.15.100:0/4148987647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e40cc380 0x7fb0e41f05a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4000c00 tx=0x7fb0d4009240 comp rx=0 tx=0).stop 2024-09-11T22:28:57.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.970+0000 7fb0cb7fe640 1 -- 172.21.15.100:0/4148987647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e40cc380 msgr2=0x7fb0e41f05a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:28:57.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.970+0000 7fb0cb7fe640 1 --2- 172.21.15.100:0/4148987647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0e40cc380 0x7fb0e41f05a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.972 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:28:57.972 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:28:57.972 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:28:57.972 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:28:57.972 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 62, 2024-09-11T22:28:57.972 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 428692, 2024-09-11T22:28:57.972 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:28:57.972 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:28:57.972 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:28:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:28:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:28:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:28:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:28:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:28:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:28:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:28:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:28:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:28:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:28:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:28:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:28:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:28:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:28:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:28:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:28:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:28:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:28:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:28:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:28:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:28:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:28:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:28:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:28:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:28:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:28:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:28:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:28:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:28:57.977 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:28:57.977 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:28:57.977 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:28:57.977 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:28:57.977 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:28:57.977 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:57.977 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:28:57.977 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.977 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:28:57.977 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.977 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:28:57.977 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:28:57.977 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:57.977 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:28:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:28:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:28:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:28:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:28:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:28:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:28:57.980 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:57.980 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.980 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.980 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:57.980 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:28:57.980 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:57.980 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:57.980 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:57.980 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.980 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:28:57.980 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:28:57.980 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:57.980 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:57.980 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:57.981 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.981 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.981 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:28:57.981 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:28:57.981 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:28:57.981 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:28:57.981 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.981 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:28:57.981 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:28:57.981 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:57.981 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.981 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.981 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:28:57.982 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:28:57.982 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:28:57.982 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:57.982 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:57.982 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.982 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:28:57.982 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:28:57.982 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:28:57.982 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:28:57.982 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:28:57.982 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:57.982 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:57.982 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.982 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:28:57.983 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:28:57.983 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.983 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:57.983 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:57.983 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:28:57.983 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:57.983 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:57.983 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:28:57.983 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.983 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:57.983 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:57.983 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:28:57.983 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:57.983 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:57.984 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:28:57.984 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.984 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:57.984 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:57.984 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:28:57.984 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:57.984 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:57.984 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:28:57.984 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.984 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:57.984 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:57.984 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:28:57.984 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:57.985 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:28:57.985 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:28:57.985 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:28:57.985 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:28:57.985 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:28:57.985 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:28:57.985 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:28:57.985 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:28:57.985 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:28:57.985 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:28:57.985 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:28:57.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.970+0000 7fb0e91c6640 1 -- 172.21.15.100:0/4148987647 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb0d006bde0 msgr2=0x7fb0d006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.970+0000 7fb0e91c6640 1 --2- 172.21.15.100:0/4148987647 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb0d006bde0 0x7fb0d006e2a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8007fd0 tx=0x7fb0d8007e80 comp rx=0 tx=0).stop 2024-09-11T22:28:57.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.970+0000 7fb0e91c6640 1 -- 172.21.15.100:0/4148987647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0e415c290 msgr2=0x7fb0e41515c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:28:57.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.970+0000 7fb0e91c6640 1 --2- 172.21.15.100:0/4148987647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0e415c290 0x7fb0e41515c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc00be80 tx=0x7fb0dc00bf70 comp rx=0 tx=0).stop 2024-09-11T22:28:57.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.970+0000 7fb0e359e640 1 -- 172.21.15.100:0/4148987647 reap_dead start 2024-09-11T22:28:57.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.970+0000 7fb0e91c6640 1 -- 172.21.15.100:0/4148987647 shutdown_connections 2024-09-11T22:28:57.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.970+0000 7fb0e91c6640 1 --2- 172.21.15.100:0/4148987647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0e415c290 0x7fb0e41515c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:28:57.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.970+0000 7fb0e91c6640 1 -- 172.21.15.100:0/4148987647 >> 172.21.15.100:0/4148987647 conn(0x7fb0e406bc10 msgr2=0x7fb0e40b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:28:57.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.970+0000 7fb0e91c6640 1 -- 172.21.15.100:0/4148987647 shutdown_connections 2024-09-11T22:28:57.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:28:57.970+0000 7fb0e91c6640 1 -- 172.21.15.100:0/4148987647 wait complete. 2024-09-11T22:28:57.987 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:28:57.987 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-11T22:29:17.989 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:29:17.989 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-11T22:29:17.989 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T22:29:17.990 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T22:29:17.992 INFO:tasks.ceph.mon.a:Started 2024-09-11T22:29:17.993 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:29:17.998 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:29:19.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.035+0000 7f3d2de35640 1 Processor -- start 2024-09-11T22:29:19.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.035+0000 7f3d2de35640 1 -- start start 2024-09-11T22:29:19.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.036+0000 7f3d2de35640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3d2806be80 0x7f3d280c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:19.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.036+0000 7f3d2de35640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3d2806c260 0x7f3d280c1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:19.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.036+0000 7f3d2de35640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d280c8380 con 0x7f3d28073f80 2024-09-11T22:29:19.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.036+0000 7f3d2de35640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f3d28072960 con 0x7f3d2806c260 2024-09-11T22:29:19.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.036+0000 7f3d2de35640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f3d28072c40 con 0x7f3d2806be80 2024-09-11T22:29:19.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.036+0000 7f3d26ffd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3d2806c260 0x7f3d280c1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:19.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.036+0000 7f3d26ffd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3d2806c260 0x7f3d280c1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58082/0 (socket says 172.21.15.100:58082) 2024-09-11T22:29:19.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.036+0000 7f3d26ffd640 1 -- 172.21.15.100:0/3733872523 learned_addr learned my addr 172.21.15.100:0/3733872523 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:19.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.036+0000 7f3d277fe640 1 --2- 172.21.15.100:0/3733872523 >> v2:172.21.15.167:3300/0 conn(0x7f3d2806be80 0x7f3d280c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:19.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.037+0000 7f3d267fc640 1 -- 172.21.15.100:0/3733872523 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2400586049 0 0) 0x7f3d280c8380 con 0x7f3d28073f80 2024-09-11T22:29:19.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.044+0000 7f3d267fc640 1 -- 172.21.15.100:0/3733872523 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d10003500 con 0x7f3d28073f80 2024-09-11T22:29:19.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.044+0000 7f3d26ffd640 1 -- 172.21.15.100:0/3733872523 >> v2:172.21.15.100:3300/0 conn(0x7f3d2806c260 msgr2=0x7f3d280c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:29:19.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.044+0000 7f3d26ffd640 1 -- 172.21.15.100:0/3733872523 >> v2:172.21.15.100:3300/0 conn(0x7f3d2806c260 msgr2=0x7f3d280c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:29:19.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.044+0000 7f3d26ffd640 1 --2- 172.21.15.100:0/3733872523 >> v2:172.21.15.100:3300/0 conn(0x7f3d2806c260 0x7f3d280c1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:29:19.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.044+0000 7f3d26ffd640 1 --2- 172.21.15.100:0/3733872523 >> v2:172.21.15.100:3300/0 conn(0x7f3d2806c260 0x7f3d280c1c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:29:19.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.044+0000 7f3d267fc640 1 -- 172.21.15.100:0/3733872523 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2453072478 0 0) 0x7f3d10003500 con 0x7f3d28073f80 2024-09-11T22:29:19.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.044+0000 7f3d267fc640 1 -- 172.21.15.100:0/3733872523 >> v2:172.21.15.167:3300/0 conn(0x7f3d2806be80 msgr2=0x7f3d280c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:19.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.044+0000 7f3d267fc640 1 --2- 172.21.15.100:0/3733872523 >> v2:172.21.15.167:3300/0 conn(0x7f3d2806be80 0x7f3d280c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.044+0000 7f3d267fc640 1 -- 172.21.15.100:0/3733872523 >> v2:172.21.15.100:3300/0 conn(0x7f3d2806c260 msgr2=0x7f3d280c1c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:29:19.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.044+0000 7f3d267fc640 1 --2- 172.21.15.100:0/3733872523 >> v2:172.21.15.100:3300/0 conn(0x7f3d2806c260 0x7f3d280c1c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.044+0000 7f3d267fc640 1 -- 172.21.15.100:0/3733872523 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d28072f20 con 0x7f3d28073f80 2024-09-11T22:29:19.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.044+0000 7f3d267fc640 1 -- 172.21.15.100:0/3733872523 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f3d200019f0 con 0x7f3d28073f80 2024-09-11T22:29:19.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.044+0000 7f3d267fc640 1 -- 172.21.15.100:0/3733872523 >> v1:172.21.15.167:6789/0 conn(0x7f3d28073f80 legacy=0x7f3d2806d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:19.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.044+0000 7f3d267fc640 1 --2- 172.21.15.100:0/3733872523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d10003b60 0x7f3d10003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:19.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.044+0000 7f3d267fc640 1 --2- 172.21.15.100:0/3733872523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d1000aa30 0x7f3d1000cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:19.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.044+0000 7f3d267fc640 1 --2- 172.21.15.100:0/3733872523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d1000d5e0 0x7f3d1000faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:19.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.044+0000 7f3d267fc640 1 -- 172.21.15.100:0/3733872523 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3d28072960 con 0x7f3d1000d5e0 2024-09-11T22:29:19.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.044+0000 7f3d267fc640 1 -- 172.21.15.100:0/3733872523 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3d28072c40 con 0x7f3d10003b60 2024-09-11T22:29:19.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.044+0000 7f3d267fc640 1 -- 172.21.15.100:0/3733872523 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3d100103f0 con 0x7f3d1000aa30 2024-09-11T22:29:19.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.044+0000 7f3d277fe640 1 --2- 172.21.15.100:0/3733872523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d10003b60 0x7f3d10003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:19.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.044+0000 7f3d27fff640 1 --2- 172.21.15.100:0/3733872523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d1000d5e0 0x7f3d1000faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:19.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.044+0000 7f3d26ffd640 1 --2- 172.21.15.100:0/3733872523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d1000aa30 0x7f3d1000cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:19.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.045+0000 7f3d277fe640 1 -- 172.21.15.100:0/3733872523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d1000aa30 msgr2=0x7f3d1000cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:19.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.045+0000 7f3d277fe640 1 --2- 172.21.15.100:0/3733872523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d1000aa30 0x7f3d1000cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.045+0000 7f3d277fe640 1 -- 172.21.15.100:0/3733872523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d1000d5e0 msgr2=0x7f3d1000faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:19.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.045+0000 7f3d277fe640 1 --2- 172.21.15.100:0/3733872523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d1000d5e0 0x7f3d1000faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.045+0000 7f3d277fe640 1 -- 172.21.15.100:0/3733872523 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d10003500 con 0x7f3d10003b60 2024-09-11T22:29:19.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.045+0000 7f3d27fff640 1 -- 172.21.15.100:0/3733872523 reap_dead start 2024-09-11T22:29:19.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.045+0000 7f3d277fe640 1 --2- 172.21.15.100:0/3733872523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d10003b60 0x7f3d10003f80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3d1800cb20 tx=0x7f3d100037f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31a211ea4804e37f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:19.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.046+0000 7f3d267fc640 1 -- 172.21.15.100:0/3733872523 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d18031070 con 0x7f3d10003b60 2024-09-11T22:29:19.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.046+0000 7f3d267fc640 1 -- 172.21.15.100:0/3733872523 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d1802ba80 con 0x7f3d10003b60 2024-09-11T22:29:19.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.046+0000 7f3d267fc640 1 -- 172.21.15.100:0/3733872523 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1800c770 con 0x7f3d10003b60 2024-09-11T22:29:19.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.047+0000 7f3d2de35640 1 -- 172.21.15.100:0/3733872523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d10003b60 msgr2=0x7f3d10003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:19.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.047+0000 7f3d2de35640 1 --2- 172.21.15.100:0/3733872523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d10003b60 0x7f3d10003f80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3d1800cb20 tx=0x7f3d100037f0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.047+0000 7f3d2de35640 1 -- 172.21.15.100:0/3733872523 shutdown_connections 2024-09-11T22:29:19.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.047+0000 7f3d2de35640 1 --2- 172.21.15.100:0/3733872523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d10003b60 0x7f3d10003f80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.047+0000 7f3d2de35640 1 -- 172.21.15.100:0/3733872523 >> 172.21.15.100:0/3733872523 conn(0x7f3d280cbf70 msgr2=0x7f3d280cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:19.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.047+0000 7f3d2de35640 1 -- 172.21.15.100:0/3733872523 shutdown_connections 2024-09-11T22:29:19.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.047+0000 7f3d2de35640 1 -- 172.21.15.100:0/3733872523 wait complete. 2024-09-11T22:29:19.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.048+0000 7f3d2de35640 1 Processor -- start 2024-09-11T22:29:19.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.049+0000 7f3d2de35640 1 -- start start 2024-09-11T22:29:19.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.050+0000 7f3d2de35640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d10003b60 0x7f3d28200e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:19.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.050+0000 7f3d2de35640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d28157870 0x7f3d2815d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:19.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.050+0000 7f3d2de35640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d281585f0 0x7f3d28158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:19.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.050+0000 7f3d2de35640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3d280c3000 con 0x7f3d10003b60 2024-09-11T22:29:19.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.050+0000 7f3d2de35640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2806cc70 con 0x7f3d281585f0 2024-09-11T22:29:19.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.050+0000 7f3d2de35640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3d280caf40 con 0x7f3d28157870 2024-09-11T22:29:19.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.050+0000 7f3d277fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d10003b60 0x7f3d28200e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:19.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.050+0000 7f3d277fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d10003b60 0x7f3d28200e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58098/0 (socket says 172.21.15.100:58098) 2024-09-11T22:29:19.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.050+0000 7f3d277fe640 1 -- 172.21.15.100:0/1046596266 learned_addr learned my addr 172.21.15.100:0/1046596266 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:19.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.050+0000 7f3d27fff640 1 --2- 172.21.15.100:0/1046596266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d281585f0 0x7f3d28158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:19.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.050+0000 7f3d26ffd640 1 --2- 172.21.15.100:0/1046596266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d28157870 0x7f3d2815d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:19.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.050+0000 7f3d277fe640 1 -- 172.21.15.100:0/1046596266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d10003b60 msgr2=0x7f3d28200e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-11T22:29:19.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.050+0000 7f3d277fe640 1 -- 172.21.15.100:0/1046596266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d10003b60 msgr2=0x7f3d28200e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:29:19.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.050+0000 7f3d277fe640 1 --2- 172.21.15.100:0/1046596266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d10003b60 0x7f3d28200e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:29:19.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.051+0000 7f3d277fe640 1 --2- 172.21.15.100:0/1046596266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d10003b60 0x7f3d28200e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:29:19.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.051+0000 7f3d27fff640 1 -- 172.21.15.100:0/1046596266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d28157870 msgr2=0x7f3d2815d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:19.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.051+0000 7f3d27fff640 1 --2- 172.21.15.100:0/1046596266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d28157870 0x7f3d2815d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.051+0000 7f3d27fff640 1 -- 172.21.15.100:0/1046596266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d10003b60 msgr2=0x7f3d28200e70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:29:19.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.051+0000 7f3d27fff640 1 --2- 172.21.15.100:0/1046596266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d10003b60 0x7f3d28200e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.051+0000 7f3d27fff640 1 -- 172.21.15.100:0/1046596266 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d28158fb0 con 0x7f3d281585f0 2024-09-11T22:29:19.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.051+0000 7f3d27fff640 1 --2- 172.21.15.100:0/1046596266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d281585f0 0x7f3d28158a70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3d280727c0 tx=0x7f3d2000feb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:19.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.051+0000 7f3d0ffff640 1 -- 172.21.15.100:0/1046596266 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d20019070 con 0x7f3d281585f0 2024-09-11T22:29:19.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.051+0000 7f3d0ffff640 1 -- 172.21.15.100:0/1046596266 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d20006d60 con 0x7f3d281585f0 2024-09-11T22:29:19.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.051+0000 7f3d2de35640 1 -- 172.21.15.100:0/1046596266 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d280c65f0 con 0x7f3d281585f0 2024-09-11T22:29:19.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.051+0000 7f3d0ffff640 1 -- 172.21.15.100:0/1046596266 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d20003b90 con 0x7f3d281585f0 2024-09-11T22:29:19.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.051+0000 7f3d2de35640 1 -- 172.21.15.100:0/1046596266 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d281580f0 con 0x7f3d281585f0 2024-09-11T22:29:19.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.052+0000 7f3d2de35640 1 -- 172.21.15.100:0/1046596266 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d280cb1f0 con 0x7f3d281585f0 2024-09-11T22:29:19.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.053+0000 7f3d0ffff640 1 -- 172.21.15.100:0/1046596266 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d20005030 con 0x7f3d281585f0 2024-09-11T22:29:19.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.054+0000 7f3d0ffff640 1 --2- 172.21.15.100:0/1046596266 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d1406be60 0x7f3d1406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:19.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.054+0000 7f3d0ffff640 1 -- 172.21.15.100:0/1046596266 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f3d2008a330 con 0x7f3d281585f0 2024-09-11T22:29:19.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.054+0000 7f3d277fe640 1 --2- 172.21.15.100:0/1046596266 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d1406be60 0x7f3d1406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:19.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.054+0000 7f3d277fe640 1 --2- 172.21.15.100:0/1046596266 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d1406be60 0x7f3d1406e320 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3d18005ed0 tx=0x7f3d18031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:19.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.058+0000 7f3d0ffff640 1 -- 172.21.15.100:0/1046596266 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3d280cb1f0 con 0x7f3d281585f0 2024-09-11T22:29:19.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.374+0000 7f3d2de35640 1 -- 172.21.15.100:0/1046596266 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3d281582c0 con 0x7f3d281585f0 2024-09-11T22:29:19.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.374+0000 7f3d0ffff640 1 -- 172.21.15.100:0/1046596266 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f3d28158fb0 con 0x7f3d281585f0 2024-09-11T22:29:19.375 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":62,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:29:19.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.376+0000 7f3d2de35640 1 -- 172.21.15.100:0/1046596266 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d1406be60 msgr2=0x7f3d1406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:19.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.376+0000 7f3d2de35640 1 --2- 172.21.15.100:0/1046596266 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d1406be60 0x7f3d1406e320 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3d18005ed0 tx=0x7f3d18031000 comp rx=0 tx=0).stop 2024-09-11T22:29:19.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.376+0000 7f3d2de35640 1 -- 172.21.15.100:0/1046596266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d281585f0 msgr2=0x7f3d28158a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:19.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.376+0000 7f3d2de35640 1 --2- 172.21.15.100:0/1046596266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d281585f0 0x7f3d28158a70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3d280727c0 tx=0x7f3d2000feb0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.377+0000 7f3d2de35640 1 -- 172.21.15.100:0/1046596266 shutdown_connections 2024-09-11T22:29:19.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.377+0000 7f3d2de35640 1 --2- 172.21.15.100:0/1046596266 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d1406be60 0x7f3d1406e320 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.377+0000 7f3d2de35640 1 --2- 172.21.15.100:0/1046596266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d281585f0 0x7f3d28158a70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.377+0000 7f3d2de35640 1 --2- 172.21.15.100:0/1046596266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d28157870 0x7f3d2815d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.377+0000 7f3d2de35640 1 --2- 172.21.15.100:0/1046596266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d10003b60 0x7f3d28200e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:19.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.377+0000 7f3d2de35640 1 -- 172.21.15.100:0/1046596266 >> 172.21.15.100:0/1046596266 conn(0x7f3d280cbf70 msgr2=0x7f3d2816bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:19.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.377+0000 7f3d2de35640 1 -- 172.21.15.100:0/1046596266 shutdown_connections 2024-09-11T22:29:19.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:19.377+0000 7f3d2de35640 1 -- 172.21.15.100:0/1046596266 wait complete. 2024-09-11T22:29:21.279 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:29:21.281 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:29:22.395 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:29:22.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.501+0000 7fa67aa27640 1 Processor -- start 2024-09-11T22:29:22.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.501+0000 7fa67aa27640 1 -- start start 2024-09-11T22:29:22.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.502+0000 7fa67aa27640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa6740b3190 0x7fa67415e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:22.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.502+0000 7fa67aa27640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa67415a7e0 0x7fa67415e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:22.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.502+0000 7fa67aa27640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67415ac90 con 0x7fa674154c20 2024-09-11T22:29:22.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.502+0000 7fa67aa27640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fa67415e000 con 0x7fa67415a7e0 2024-09-11T22:29:22.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.502+0000 7fa67aa27640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fa67415af70 con 0x7fa6740b3190 2024-09-11T22:29:22.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.502+0000 7fa678fc4640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa67415a7e0 0x7fa67415e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:22.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.502+0000 7fa673fff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa674154c20 0x7fa6740cb120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39066/0 (socket says 172.21.15.100:39066) 2024-09-11T22:29:22.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.502+0000 7fa673fff640 1 -- 172.21.15.100:0/891972948 learned_addr learned my addr 172.21.15.100:0/891972948 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:29:22.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.502+0000 7fa678fc4640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa67415a7e0 0x7fa67415e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48170/0 (socket says 172.21.15.100:48170) 2024-09-11T22:29:22.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.502+0000 7fa678fc4640 1 -- 172.21.15.100:0/891972948 >> v2:172.21.15.100:3300/0 conn(0x7fa67415a7e0 msgr2=0x7fa67415e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:29:22.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.502+0000 7fa678fc4640 1 -- 172.21.15.100:0/891972948 >> v2:172.21.15.100:3300/0 conn(0x7fa67415a7e0 msgr2=0x7fa67415e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:29:22.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.502+0000 7fa678fc4640 1 --2- 172.21.15.100:0/891972948 >> v2:172.21.15.100:3300/0 conn(0x7fa67415a7e0 0x7fa67415e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:29:22.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.502+0000 7fa678fc4640 1 --2- 172.21.15.100:0/891972948 >> v2:172.21.15.100:3300/0 conn(0x7fa67415a7e0 0x7fa67415e9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:29:22.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.503+0000 7fa6737fe640 1 --2- 172.21.15.100:0/891972948 >> v2:172.21.15.167:3300/0 conn(0x7fa6740b3190 0x7fa67415e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:22.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.503+0000 7fa6737fe640 1 -- 172.21.15.100:0/891972948 >> v2:172.21.15.100:3300/0 conn(0x7fa67415a7e0 msgr2=0x7fa67415e9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:29:22.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.503+0000 7fa6737fe640 1 --2- 172.21.15.100:0/891972948 >> v2:172.21.15.100:3300/0 conn(0x7fa67415a7e0 0x7fa67415e9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:22.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.503+0000 7fa6737fe640 1 -- 172.21.15.100:0/891972948 >> v1:172.21.15.100:6789/0 conn(0x7fa674154c20 legacy=0x7fa6740cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:22.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.503+0000 7fa6737fe640 1 -- 172.21.15.100:0/891972948 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67415b250 con 0x7fa6740b3190 2024-09-11T22:29:22.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.504+0000 7fa6737fe640 1 --2- 172.21.15.100:0/891972948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6740b3190 0x7fa67415e490 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa67406d770 tx=0x7fa66802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd362738a7bcf4e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:22.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.504+0000 7fa672ffd640 1 -- 172.21.15.100:0/891972948 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa668037070 con 0x7fa6740b3190 2024-09-11T22:29:22.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.504+0000 7fa672ffd640 1 -- 172.21.15.100:0/891972948 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa668032440 con 0x7fa6740b3190 2024-09-11T22:29:22.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.504+0000 7fa672ffd640 1 -- 172.21.15.100:0/891972948 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa668032810 con 0x7fa6740b3190 2024-09-11T22:29:22.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.505+0000 7fa67aa27640 1 -- 172.21.15.100:0/891972948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6740b3190 msgr2=0x7fa67415e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:22.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.505+0000 7fa67aa27640 1 --2- 172.21.15.100:0/891972948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6740b3190 0x7fa67415e490 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa67406d770 tx=0x7fa66802a1a0 comp rx=0 tx=0).stop 2024-09-11T22:29:22.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.505+0000 7fa67aa27640 1 -- 172.21.15.100:0/891972948 shutdown_connections 2024-09-11T22:29:22.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.505+0000 7fa67aa27640 1 --2- 172.21.15.100:0/891972948 >> v2:172.21.15.100:3300/0 conn(0x7fa67415a7e0 0x7fa67415e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:22.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.505+0000 7fa67aa27640 1 --2- 172.21.15.100:0/891972948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6740b3190 0x7fa67415e490 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:22.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.505+0000 7fa67aa27640 1 -- 172.21.15.100:0/891972948 >> 172.21.15.100:0/891972948 conn(0x7fa674067d40 msgr2=0x7fa67406d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:22.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.505+0000 7fa67aa27640 1 -- 172.21.15.100:0/891972948 shutdown_connections 2024-09-11T22:29:22.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.505+0000 7fa67aa27640 1 -- 172.21.15.100:0/891972948 wait complete. 2024-09-11T22:29:22.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.506+0000 7fa67aa27640 1 Processor -- start 2024-09-11T22:29:22.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.507+0000 7fa67aa27640 1 -- start start 2024-09-11T22:29:22.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.507+0000 7fa67aa27640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6740b3190 0x7fa6740cf490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:22.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.507+0000 7fa67aa27640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa674154c20 0x7fa6740cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:22.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.508+0000 7fa67aa27640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa67415a7e0 0x7fa6740c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:22.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.508+0000 7fa67aa27640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa6740cbd10 con 0x7fa674154c20 2024-09-11T22:29:22.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.508+0000 7fa67aa27640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa6740cb830 con 0x7fa67415a7e0 2024-09-11T22:29:22.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.508+0000 7fa67aa27640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa6740cbe90 con 0x7fa6740b3190 2024-09-11T22:29:22.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.508+0000 7fa6737fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa674154c20 0x7fa6740cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:22.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.508+0000 7fa6737fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa674154c20 0x7fa6740cf9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48176/0 (socket says 172.21.15.100:48176) 2024-09-11T22:29:22.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.508+0000 7fa6737fe640 1 -- 172.21.15.100:0/2639604625 learned_addr learned my addr 172.21.15.100:0/2639604625 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:22.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.508+0000 7fa673fff640 1 --2- 172.21.15.100:0/2639604625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6740b3190 0x7fa6740cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:22.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.508+0000 7fa678fc4640 1 --2- 172.21.15.100:0/2639604625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa67415a7e0 0x7fa6740c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:22.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.508+0000 7fa6737fe640 1 -- 172.21.15.100:0/2639604625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa674154c20 msgr2=0x7fa6740cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-11T22:29:22.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.508+0000 7fa6737fe640 1 -- 172.21.15.100:0/2639604625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa674154c20 msgr2=0x7fa6740cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:29:22.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.508+0000 7fa6737fe640 1 --2- 172.21.15.100:0/2639604625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa674154c20 0x7fa6740cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:29:22.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.508+0000 7fa6737fe640 1 --2- 172.21.15.100:0/2639604625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa674154c20 0x7fa6740cf9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:29:22.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.508+0000 7fa673fff640 1 -- 172.21.15.100:0/2639604625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa67415a7e0 msgr2=0x7fa6740c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:22.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.508+0000 7fa673fff640 1 --2- 172.21.15.100:0/2639604625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa67415a7e0 0x7fa6740c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:22.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.508+0000 7fa673fff640 1 -- 172.21.15.100:0/2639604625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa674154c20 msgr2=0x7fa6740cf9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:29:22.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.508+0000 7fa673fff640 1 --2- 172.21.15.100:0/2639604625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa674154c20 0x7fa6740cf9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:22.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.508+0000 7fa673fff640 1 -- 172.21.15.100:0/2639604625 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6740d0f30 con 0x7fa6740b3190 2024-09-11T22:29:22.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.508+0000 7fa678fc4640 1 --2- 172.21.15.100:0/2639604625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa67415a7e0 0x7fa6740c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:22.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.508+0000 7fa673fff640 1 --2- 172.21.15.100:0/2639604625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6740b3190 0x7fa6740cf490 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa66400c370 tx=0x7fa66400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:22.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.509+0000 7fa670ff9640 1 -- 172.21.15.100:0/2639604625 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa664017070 con 0x7fa6740b3190 2024-09-11T22:29:22.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.509+0000 7fa670ff9640 1 -- 172.21.15.100:0/2639604625 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa664005ce0 con 0x7fa6740b3190 2024-09-11T22:29:22.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.509+0000 7fa67aa27640 1 -- 172.21.15.100:0/2639604625 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6741f0c40 con 0x7fa6740b3190 2024-09-11T22:29:22.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.509+0000 7fa670ff9640 1 -- 172.21.15.100:0/2639604625 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa664007310 con 0x7fa6740b3190 2024-09-11T22:29:22.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.509+0000 7fa67aa27640 1 -- 172.21.15.100:0/2639604625 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6741f1200 con 0x7fa6740b3190 2024-09-11T22:29:22.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.510+0000 7fa67aa27640 1 -- 172.21.15.100:0/2639604625 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6740cc250 con 0x7fa6740b3190 2024-09-11T22:29:22.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.510+0000 7fa670ff9640 1 -- 172.21.15.100:0/2639604625 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa66401a070 con 0x7fa6740b3190 2024-09-11T22:29:22.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.511+0000 7fa670ff9640 1 --2- 172.21.15.100:0/2639604625 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa66006be30 0x7fa66006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:22.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.511+0000 7fa670ff9640 1 -- 172.21.15.100:0/2639604625 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fa66408a630 con 0x7fa6740b3190 2024-09-11T22:29:22.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.511+0000 7fa6737fe640 1 --2- 172.21.15.100:0/2639604625 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa66006be30 0x7fa66006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:22.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.511+0000 7fa6737fe640 1 --2- 172.21.15.100:0/2639604625 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa66006be30 0x7fa66006e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa6741ee680 tx=0x7fa66802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:22.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.515+0000 7fa670ff9640 1 -- 172.21.15.100:0/2639604625 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa664058440 con 0x7fa6740b3190 2024-09-11T22:29:22.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.819+0000 7fa67aa27640 1 -- 172.21.15.100:0/2639604625 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa6740cbaf0 con 0x7fa6740b3190 2024-09-11T22:29:22.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.820+0000 7fa670ff9640 1 -- 172.21.15.100:0/2639604625 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7fa66405c740 con 0x7fa6740b3190 2024-09-11T22:29:22.821 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":62,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:29:22.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.822+0000 7fa67aa27640 1 -- 172.21.15.100:0/2639604625 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa66006be30 msgr2=0x7fa66006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:22.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.822+0000 7fa67aa27640 1 --2- 172.21.15.100:0/2639604625 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa66006be30 0x7fa66006e2f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa6741ee680 tx=0x7fa66802e000 comp rx=0 tx=0).stop 2024-09-11T22:29:22.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.822+0000 7fa67aa27640 1 -- 172.21.15.100:0/2639604625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6740b3190 msgr2=0x7fa6740cf490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:22.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.822+0000 7fa67aa27640 1 --2- 172.21.15.100:0/2639604625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6740b3190 0x7fa6740cf490 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa66400c370 tx=0x7fa66400c830 comp rx=0 tx=0).stop 2024-09-11T22:29:22.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.822+0000 7fa67aa27640 1 -- 172.21.15.100:0/2639604625 shutdown_connections 2024-09-11T22:29:22.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.822+0000 7fa67aa27640 1 --2- 172.21.15.100:0/2639604625 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa66006be30 0x7fa66006e2f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:22.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.822+0000 7fa67aa27640 1 --2- 172.21.15.100:0/2639604625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa67415a7e0 0x7fa6740c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:22.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.822+0000 7fa67aa27640 1 --2- 172.21.15.100:0/2639604625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa674154c20 0x7fa6740cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:22.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.822+0000 7fa67aa27640 1 --2- 172.21.15.100:0/2639604625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa6740b3190 0x7fa6740cf490 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:22.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.822+0000 7fa67aa27640 1 -- 172.21.15.100:0/2639604625 >> 172.21.15.100:0/2639604625 conn(0x7fa674067d40 msgr2=0x7fa6740c6360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:22.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.822+0000 7fa67aa27640 1 -- 172.21.15.100:0/2639604625 shutdown_connections 2024-09-11T22:29:22.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:22.822+0000 7fa67aa27640 1 -- 172.21.15.100:0/2639604625 wait complete. 2024-09-11T22:29:25.836 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:29:25.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.946+0000 7f3b599cd640 1 Processor -- start 2024-09-11T22:29:25.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.946+0000 7f3b599cd640 1 -- start start 2024-09-11T22:29:25.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.947+0000 7f3b599cd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3b540c7ca0 0x7f3b54070090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:25.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.947+0000 7f3b599cd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b540c8080 0x7f3b5415a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:25.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.947+0000 7f3b599cd640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b5415b090 con 0x7f3b5415bc80 2024-09-11T22:29:25.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.947+0000 7f3b599cd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f3b540705d0 con 0x7f3b540c7ca0 2024-09-11T22:29:25.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.947+0000 7f3b599cd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3b5415b330 con 0x7f3b540c8080 2024-09-11T22:29:25.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.947+0000 7f3b537fe640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3b5415bc80 0x7f3b54154590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39068/0 (socket says 172.21.15.100:39068) 2024-09-11T22:29:25.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.947+0000 7f3b537fe640 1 -- 172.21.15.100:0/3269544076 learned_addr learned my addr 172.21.15.100:0/3269544076 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:29:25.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.947+0000 7f3b51ffb640 1 -- 172.21.15.100:0/3269544076 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3675210384 0 0) 0x7f3b5415b090 con 0x7f3b5415bc80 2024-09-11T22:29:25.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.947+0000 7f3b527fc640 1 --2- 172.21.15.100:0/3269544076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b540c8080 0x7f3b5415a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:25.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.947+0000 7f3b52ffd640 1 --2- 172.21.15.100:0/3269544076 >> v2:172.21.15.167:3300/0 conn(0x7f3b540c7ca0 0x7f3b54070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:25.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.947+0000 7f3b51ffb640 1 -- 172.21.15.100:0/3269544076 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b3c003520 con 0x7f3b5415bc80 2024-09-11T22:29:25.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.947+0000 7f3b51ffb640 1 -- 172.21.15.100:0/3269544076 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2163587343 0 0) 0x7f3b3c003520 con 0x7f3b5415bc80 2024-09-11T22:29:25.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.947+0000 7f3b51ffb640 1 -- 172.21.15.100:0/3269544076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b540c8080 msgr2=0x7f3b5415a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:25.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.947+0000 7f3b51ffb640 1 --2- 172.21.15.100:0/3269544076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b540c8080 0x7f3b5415a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:25.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.947+0000 7f3b51ffb640 1 -- 172.21.15.100:0/3269544076 >> v2:172.21.15.167:3300/0 conn(0x7f3b540c7ca0 msgr2=0x7f3b54070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:25.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.947+0000 7f3b51ffb640 1 --2- 172.21.15.100:0/3269544076 >> v2:172.21.15.167:3300/0 conn(0x7f3b540c7ca0 0x7f3b54070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:25.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.947+0000 7f3b51ffb640 1 -- 172.21.15.100:0/3269544076 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5415b610 con 0x7f3b5415bc80 2024-09-11T22:29:25.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.947+0000 7f3b51ffb640 1 -- 172.21.15.100:0/3269544076 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f3b4c0019f0 con 0x7f3b5415bc80 2024-09-11T22:29:25.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.947+0000 7f3b51ffb640 1 -- 172.21.15.100:0/3269544076 >> v1:172.21.15.100:6789/0 conn(0x7f3b5415bc80 legacy=0x7f3b54154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:25.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.948+0000 7f3b51ffb640 1 --2- 172.21.15.100:0/3269544076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b3c0039b0 0x7f3b3c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:25.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.948+0000 7f3b51ffb640 1 --2- 172.21.15.100:0/3269544076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b540c8080 0x7f3b3c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:25.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.948+0000 7f3b51ffb640 1 --2- 172.21.15.100:0/3269544076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b3c004d40 0x7f3b3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:25.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.948+0000 7f3b51ffb640 1 -- 172.21.15.100:0/3269544076 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3b540705d0 con 0x7f3b3c0039b0 2024-09-11T22:29:25.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.948+0000 7f3b51ffb640 1 -- 172.21.15.100:0/3269544076 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5415b330 con 0x7f3b3c004d40 2024-09-11T22:29:25.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.948+0000 7f3b51ffb640 1 -- 172.21.15.100:0/3269544076 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3b3c00b9c0 con 0x7f3b540c8080 2024-09-11T22:29:25.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.948+0000 7f3b52ffd640 1 --2- 172.21.15.100:0/3269544076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b3c0039b0 0x7f3b3c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:25.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.948+0000 7f3b527fc640 1 --2- 172.21.15.100:0/3269544076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b540c8080 0x7f3b3c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:25.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.948+0000 7f3b537fe640 1 --2- 172.21.15.100:0/3269544076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b3c004d40 0x7f3b3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:25.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.948+0000 7f3b52ffd640 1 -- 172.21.15.100:0/3269544076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b540c8080 msgr2=0x7f3b3c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:25.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.948+0000 7f3b52ffd640 1 --2- 172.21.15.100:0/3269544076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b540c8080 0x7f3b3c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:25.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.948+0000 7f3b52ffd640 1 -- 172.21.15.100:0/3269544076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b3c004d40 msgr2=0x7f3b3c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:25.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.948+0000 7f3b52ffd640 1 --2- 172.21.15.100:0/3269544076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b3c004d40 0x7f3b3c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:25.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.948+0000 7f3b52ffd640 1 -- 172.21.15.100:0/3269544076 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3c003520 con 0x7f3b3c0039b0 2024-09-11T22:29:25.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.949+0000 7f3b52ffd640 1 --2- 172.21.15.100:0/3269544076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b3c0039b0 0x7f3b3c003dd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009ac0 tx=0x7f3b3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead9699323e28086 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:25.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.949+0000 7f3b51ffb640 1 -- 172.21.15.100:0/3269544076 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b44036070 con 0x7f3b3c0039b0 2024-09-11T22:29:25.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.949+0000 7f3b51ffb640 1 -- 172.21.15.100:0/3269544076 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b44031400 con 0x7f3b3c0039b0 2024-09-11T22:29:25.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.949+0000 7f3b51ffb640 1 -- 172.21.15.100:0/3269544076 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b44009690 con 0x7f3b3c0039b0 2024-09-11T22:29:25.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.950+0000 7f3b599cd640 1 -- 172.21.15.100:0/3269544076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b3c0039b0 msgr2=0x7f3b3c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:25.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.950+0000 7f3b599cd640 1 --2- 172.21.15.100:0/3269544076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b3c0039b0 0x7f3b3c003dd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009ac0 tx=0x7f3b3c005830 comp rx=0 tx=0).stop 2024-09-11T22:29:25.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.950+0000 7f3b537fe640 1 -- 172.21.15.100:0/3269544076 reap_dead start 2024-09-11T22:29:25.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.950+0000 7f3b599cd640 1 -- 172.21.15.100:0/3269544076 shutdown_connections 2024-09-11T22:29:25.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.950+0000 7f3b599cd640 1 -- 172.21.15.100:0/3269544076 >> 172.21.15.100:0/3269544076 conn(0x7f3b5406bc10 msgr2=0x7f3b5406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:25.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.950+0000 7f3b599cd640 1 -- 172.21.15.100:0/3269544076 shutdown_connections 2024-09-11T22:29:25.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.950+0000 7f3b599cd640 1 -- 172.21.15.100:0/3269544076 wait complete. 2024-09-11T22:29:25.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.951+0000 7f3b599cd640 1 Processor -- start 2024-09-11T22:29:25.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.951+0000 7f3b599cd640 1 -- start start 2024-09-11T22:29:25.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.952+0000 7f3b599cd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b3c0039b0 0x7f3b5415d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:25.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.952+0000 7f3b599cd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b541f0670 0x7f3b541f0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:25.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.952+0000 7f3b599cd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b5414d670 0x7f3b5414daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:25.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.952+0000 7f3b599cd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5406fb70 con 0x7f3b3c0039b0 2024-09-11T22:29:25.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.952+0000 7f3b599cd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3b5406f890 con 0x7f3b5414d670 2024-09-11T22:29:25.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.952+0000 7f3b599cd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3b54075b90 con 0x7f3b541f0670 2024-09-11T22:29:25.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.952+0000 7f3b52ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b3c0039b0 0x7f3b5415d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:25.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.952+0000 7f3b52ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b3c0039b0 0x7f3b5415d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48194/0 (socket says 172.21.15.100:48194) 2024-09-11T22:29:25.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.952+0000 7f3b52ffd640 1 -- 172.21.15.100:0/4085177413 learned_addr learned my addr 172.21.15.100:0/4085177413 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:25.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.952+0000 7f3b527fc640 1 --2- 172.21.15.100:0/4085177413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b541f0670 0x7f3b541f0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:25.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.952+0000 7f3b537fe640 1 --2- 172.21.15.100:0/4085177413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b5414d670 0x7f3b5414daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:25.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.953+0000 7f3b52ffd640 1 -- 172.21.15.100:0/4085177413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b541f0670 msgr2=0x7f3b541f0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:25.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.953+0000 7f3b52ffd640 1 --2- 172.21.15.100:0/4085177413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b541f0670 0x7f3b541f0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:25.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.953+0000 7f3b52ffd640 1 -- 172.21.15.100:0/4085177413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b5414d670 msgr2=0x7f3b5414daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:25.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.953+0000 7f3b52ffd640 1 --2- 172.21.15.100:0/4085177413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b5414d670 0x7f3b5414daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:25.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.953+0000 7f3b52ffd640 1 -- 172.21.15.100:0/4085177413 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b5414e030 con 0x7f3b3c0039b0 2024-09-11T22:29:25.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.953+0000 7f3b537fe640 1 --2- 172.21.15.100:0/4085177413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b5414d670 0x7f3b5414daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:25.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.953+0000 7f3b52ffd640 1 --2- 172.21.15.100:0/4085177413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b3c0039b0 0x7f3b5415d8a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3b44034040 tx=0x7f3b44004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:25.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.953+0000 7f3b3bfff640 1 -- 172.21.15.100:0/4085177413 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b44040020 con 0x7f3b3c0039b0 2024-09-11T22:29:25.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.953+0000 7f3b3bfff640 1 -- 172.21.15.100:0/4085177413 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b44003890 con 0x7f3b3c0039b0 2024-09-11T22:29:25.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.953+0000 7f3b599cd640 1 -- 172.21.15.100:0/4085177413 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b541f1010 con 0x7f3b3c0039b0 2024-09-11T22:29:25.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.953+0000 7f3b3bfff640 1 -- 172.21.15.100:0/4085177413 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b44036040 con 0x7f3b3c0039b0 2024-09-11T22:29:25.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.953+0000 7f3b599cd640 1 -- 172.21.15.100:0/4085177413 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b541f4360 con 0x7f3b3c0039b0 2024-09-11T22:29:25.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.954+0000 7f3b599cd640 1 -- 172.21.15.100:0/4085177413 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b541f02b0 con 0x7f3b3c0039b0 2024-09-11T22:29:25.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.955+0000 7f3b3bfff640 1 -- 172.21.15.100:0/4085177413 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b44043020 con 0x7f3b3c0039b0 2024-09-11T22:29:25.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.955+0000 7f3b3bfff640 1 --2- 172.21.15.100:0/4085177413 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3b4006be60 0x7f3b4006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:25.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.955+0000 7f3b3bfff640 1 -- 172.21.15.100:0/4085177413 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f3b440ab280 con 0x7f3b3c0039b0 2024-09-11T22:29:25.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.955+0000 7f3b527fc640 1 --2- 172.21.15.100:0/4085177413 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3b4006be60 0x7f3b4006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:25.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.956+0000 7f3b527fc640 1 --2- 172.21.15.100:0/4085177413 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3b4006be60 0x7f3b4006e320 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3b5415ec90 tx=0x7f3b48009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:25.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:25.960+0000 7f3b3bfff640 1 -- 172.21.15.100:0/4085177413 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3b4404a070 con 0x7f3b3c0039b0 2024-09-11T22:29:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.250+0000 7f3b599cd640 1 -- 172.21.15.100:0/4085177413 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3b540c6670 con 0x7f3b3c0039b0 2024-09-11T22:29:26.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.250+0000 7f3b3bfff640 1 -- 172.21.15.100:0/4085177413 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7f3b5414e030 con 0x7f3b3c0039b0 2024-09-11T22:29:26.251 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:29:26.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.253+0000 7f3b599cd640 1 -- 172.21.15.100:0/4085177413 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3b4006be60 msgr2=0x7f3b4006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.253+0000 7f3b599cd640 1 --2- 172.21.15.100:0/4085177413 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3b4006be60 0x7f3b4006e320 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3b5415ec90 tx=0x7f3b48009190 comp rx=0 tx=0).stop 2024-09-11T22:29:26.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.253+0000 7f3b599cd640 1 -- 172.21.15.100:0/4085177413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b3c0039b0 msgr2=0x7f3b5415d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.253+0000 7f3b599cd640 1 --2- 172.21.15.100:0/4085177413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b3c0039b0 0x7f3b5415d8a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3b44034040 tx=0x7f3b44004730 comp rx=0 tx=0).stop 2024-09-11T22:29:26.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.253+0000 7f3b599cd640 1 -- 172.21.15.100:0/4085177413 shutdown_connections 2024-09-11T22:29:26.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.253+0000 7f3b599cd640 1 --2- 172.21.15.100:0/4085177413 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3b4006be60 0x7f3b4006e320 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.253+0000 7f3b599cd640 1 --2- 172.21.15.100:0/4085177413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b5414d670 0x7f3b5414daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.253+0000 7f3b599cd640 1 --2- 172.21.15.100:0/4085177413 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b541f0670 0x7f3b541f0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.253+0000 7f3b599cd640 1 --2- 172.21.15.100:0/4085177413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b3c0039b0 0x7f3b5415d8a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.253+0000 7f3b599cd640 1 -- 172.21.15.100:0/4085177413 >> 172.21.15.100:0/4085177413 conn(0x7f3b5406bc10 msgr2=0x7f3b5414f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:26.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.253+0000 7f3b599cd640 1 -- 172.21.15.100:0/4085177413 shutdown_connections 2024-09-11T22:29:26.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.253+0000 7f3b599cd640 1 -- 172.21.15.100:0/4085177413 wait complete. 2024-09-11T22:29:26.266 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:29:26.266 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:29:26.266 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:29:26.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.374+0000 7fe307b0a640 1 Processor -- start 2024-09-11T22:29:26.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.374+0000 7fe307b0a640 1 -- start start 2024-09-11T22:29:26.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.375+0000 7fe307b0a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3000b0ca0 0x7fe3000707a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.375+0000 7fe307b0a640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3001585f0 con 0x7fe300158210 2024-09-11T22:29:26.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.375+0000 7fe307b0a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3000c9430 con 0x7fe30015e100 2024-09-11T22:29:26.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.375+0000 7fe307b0a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe300070310 con 0x7fe3000b0ca0 2024-09-11T22:29:26.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.375+0000 7fe3058a6640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe300158210 0x7fe30006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39078/0 (socket says 172.21.15.100:39078) 2024-09-11T22:29:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.375+0000 7fe3058a6640 1 -- 172.21.15.100:0/2258474128 learned_addr learned my addr 172.21.15.100:0/2258474128 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:29:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.376+0000 7fe3050a5640 1 --2- 172.21.15.100:0/2258474128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3000b0ca0 0x7fe3000707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.376+0000 7fe3048a4640 1 -- 172.21.15.100:0/2258474128 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2014175831 0 0) 0x7fe3001585f0 con 0x7fe300158210 2024-09-11T22:29:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.376+0000 7fe3048a4640 1 -- 172.21.15.100:0/2258474128 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2ec003520 con 0x7fe300158210 2024-09-11T22:29:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.376+0000 7fe3048a4640 1 -- 172.21.15.100:0/2258474128 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2841711526 0 0) 0x7fe3000c9430 con 0x7fe30015e100 2024-09-11T22:29:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.376+0000 7fe3048a4640 1 -- 172.21.15.100:0/2258474128 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3001585f0 con 0x7fe30015e100 2024-09-11T22:29:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.376+0000 7fe3048a4640 1 -- 172.21.15.100:0/2258474128 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1024273603 0 0) 0x7fe2ec003520 con 0x7fe300158210 2024-09-11T22:29:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.376+0000 7fe3048a4640 1 -- 172.21.15.100:0/2258474128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3000b0ca0 msgr2=0x7fe3000707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.376+0000 7fe3048a4640 1 --2- 172.21.15.100:0/2258474128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3000b0ca0 0x7fe3000707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.376+0000 7fe3048a4640 1 -- 172.21.15.100:0/2258474128 >> v1:172.21.15.167:6789/0 conn(0x7fe30015e100 legacy=0x7fe3000ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.376+0000 7fe3048a4640 1 -- 172.21.15.100:0/2258474128 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3000c96d0 con 0x7fe300158210 2024-09-11T22:29:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.376+0000 7fe3048a4640 1 -- 172.21.15.100:0/2258474128 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fe2fc001670 con 0x7fe300158210 2024-09-11T22:29:26.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.376+0000 7fe3048a4640 1 -- 172.21.15.100:0/2258474128 >> v1:172.21.15.100:6789/0 conn(0x7fe300158210 legacy=0x7fe30006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.376+0000 7fe3048a4640 1 --2- 172.21.15.100:0/2258474128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2ec003b70 0x7fe2ec003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.376+0000 7fe3048a4640 1 --2- 172.21.15.100:0/2258474128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2ec004800 0x7fe2ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.376+0000 7fe3048a4640 1 --2- 172.21.15.100:0/2258474128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2ec0051c0 0x7fe2ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.376+0000 7fe3048a4640 1 -- 172.21.15.100:0/2258474128 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe300070310 con 0x7fe2ec0051c0 2024-09-11T22:29:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.376+0000 7fe3048a4640 1 -- 172.21.15.100:0/2258474128 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec00bf30 con 0x7fe2ec003b70 2024-09-11T22:29:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.376+0000 7fe3048a4640 1 -- 172.21.15.100:0/2258474128 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe2ec00c130 con 0x7fe2ec004800 2024-09-11T22:29:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.376+0000 7fe3050a5640 1 --2- 172.21.15.100:0/2258474128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3000b0ca0 0x7fe3000707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.376+0000 7fe3058a6640 1 --2- 172.21.15.100:0/2258474128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2ec003b70 0x7fe2ec003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.376+0000 7fe3060a7640 1 --2- 172.21.15.100:0/2258474128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2ec0051c0 0x7fe2ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.377+0000 7fe3050a5640 1 --2- 172.21.15.100:0/2258474128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2ec004800 0x7fe2ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.377+0000 7fe3058a6640 1 -- 172.21.15.100:0/2258474128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2ec004800 msgr2=0x7fe2ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:26.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.377+0000 7fe3058a6640 1 --2- 172.21.15.100:0/2258474128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2ec004800 0x7fe2ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.377+0000 7fe3058a6640 1 -- 172.21.15.100:0/2258474128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2ec0051c0 msgr2=0x7fe2ec00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.377+0000 7fe3058a6640 1 --2- 172.21.15.100:0/2258474128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2ec0051c0 0x7fe2ec00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.377+0000 7fe3058a6640 1 -- 172.21.15.100:0/2258474128 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ec003520 con 0x7fe2ec003b70 2024-09-11T22:29:26.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.377+0000 7fe3060a7640 1 --2- 172.21.15.100:0/2258474128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2ec0051c0 0x7fe2ec00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.378+0000 7fe3058a6640 1 --2- 172.21.15.100:0/2258474128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2ec003b70 0x7fe2ec003f70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00c160 tx=0x7fe2ec005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54e1cbbc14877602 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.378+0000 7fe3048a4640 1 -- 172.21.15.100:0/2258474128 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc007ca0 con 0x7fe2ec003b70 2024-09-11T22:29:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.378+0000 7fe3048a4640 1 -- 172.21.15.100:0/2258474128 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2fc005ad0 con 0x7fe2ec003b70 2024-09-11T22:29:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.378+0000 7fe3048a4640 1 -- 172.21.15.100:0/2258474128 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc007070 con 0x7fe2ec003b70 2024-09-11T22:29:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.379+0000 7fe307b0a640 1 -- 172.21.15.100:0/2258474128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2ec003b70 msgr2=0x7fe2ec003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.379+0000 7fe307b0a640 1 --2- 172.21.15.100:0/2258474128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2ec003b70 0x7fe2ec003f70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00c160 tx=0x7fe2ec005830 comp rx=0 tx=0).stop 2024-09-11T22:29:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.379+0000 7fe3060a7640 1 -- 172.21.15.100:0/2258474128 reap_dead start 2024-09-11T22:29:26.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.380+0000 7fe307b0a640 1 -- 172.21.15.100:0/2258474128 shutdown_connections 2024-09-11T22:29:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.380+0000 7fe307b0a640 1 -- 172.21.15.100:0/2258474128 >> 172.21.15.100:0/2258474128 conn(0x7fe30006de20 msgr2=0x7fe30006e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.380+0000 7fe307b0a640 1 -- 172.21.15.100:0/2258474128 shutdown_connections 2024-09-11T22:29:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.380+0000 7fe307b0a640 1 -- 172.21.15.100:0/2258474128 wait complete. 2024-09-11T22:29:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.382+0000 7fe307b0a640 1 Processor -- start 2024-09-11T22:29:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.382+0000 7fe307b0a640 1 -- start start 2024-09-11T22:29:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.383+0000 7fe307b0a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3000b1420 0x7fe30015c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.383+0000 7fe307b0a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3000b1800 0x7fe30015c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.383+0000 7fe307b0a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3000b1fd0 0x7fe300156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.383+0000 7fe307b0a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe30006ffa0 con 0x7fe3000b1800 2024-09-11T22:29:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.383+0000 7fe307b0a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe3000c9c90 con 0x7fe3000b1420 2024-09-11T22:29:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.383+0000 7fe307b0a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe30006db40 con 0x7fe3000b1fd0 2024-09-11T22:29:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.383+0000 7fe3050a5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3000b1800 0x7fe30015c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.383+0000 7fe3058a6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3000b1420 0x7fe30015c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.383+0000 7fe3060a7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3000b1fd0 0x7fe300156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.383+0000 7fe3050a5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3000b1800 0x7fe30015c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48224/0 (socket says 172.21.15.100:48224) 2024-09-11T22:29:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.383+0000 7fe3050a5640 1 -- 172.21.15.100:0/3961953081 learned_addr learned my addr 172.21.15.100:0/3961953081 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.384+0000 7fe3060a7640 1 -- 172.21.15.100:0/3961953081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3000b1420 msgr2=0x7fe30015c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.384+0000 7fe3060a7640 1 --2- 172.21.15.100:0/3961953081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3000b1420 0x7fe30015c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.384+0000 7fe3060a7640 1 -- 172.21.15.100:0/3961953081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3000b1800 msgr2=0x7fe30015c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.384+0000 7fe3060a7640 1 --2- 172.21.15.100:0/3961953081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3000b1800 0x7fe30015c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.384+0000 7fe3060a7640 1 -- 172.21.15.100:0/3961953081 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3001f38b0 con 0x7fe3000b1fd0 2024-09-11T22:29:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.384+0000 7fe3050a5640 1 --2- 172.21.15.100:0/3961953081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3000b1800 0x7fe30015c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.384+0000 7fe3060a7640 1 --2- 172.21.15.100:0/3961953081 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3000b1fd0 0x7fe300156c70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe3000ced40 tx=0x7fe2f80021d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.384+0000 7fe2f67fc640 1 -- 172.21.15.100:0/3961953081 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8001bf0 con 0x7fe3000b1fd0 2024-09-11T22:29:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.384+0000 7fe2f67fc640 1 -- 172.21.15.100:0/3961953081 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f8018070 con 0x7fe3000b1fd0 2024-09-11T22:29:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.384+0000 7fe307b0a640 1 -- 172.21.15.100:0/3961953081 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3001f3b90 con 0x7fe3000b1fd0 2024-09-11T22:29:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.384+0000 7fe2f67fc640 1 -- 172.21.15.100:0/3961953081 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8003e60 con 0x7fe3000b1fd0 2024-09-11T22:29:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.384+0000 7fe307b0a640 1 -- 172.21.15.100:0/3961953081 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3001f4150 con 0x7fe3000b1fd0 2024-09-11T22:29:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.385+0000 7fe307b0a640 1 --2- 172.21.15.100:0/3961953081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3001f4390 0x7fe3001571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.385+0000 7fe307b0a640 1 -- 172.21.15.100:0/3961953081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe30015bd80 con 0x7fe3001f4390 2024-09-11T22:29:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.385+0000 7fe3058a6640 1 --2- 172.21.15.100:0/3961953081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3001f4390 0x7fe3001571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.386+0000 7fe3058a6640 1 -- 172.21.15.100:0/3961953081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe3000707a0 con 0x7fe3001f4390 2024-09-11T22:29:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.386+0000 7fe3058a6640 1 --2- 172.21.15.100:0/3961953081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3001f4390 0x7fe3001571b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc02f000 tx=0x7fe30006d880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.386+0000 7fe2f67fc640 1 -- 172.21.15.100:0/3961953081 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe2f80050d0 con 0x7fe3000b1fd0 2024-09-11T22:29:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.386+0000 7fe2f67fc640 1 --2- 172.21.15.100:0/3961953081 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe2e406be60 0x7fe2e406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.387+0000 7fe2f67fc640 1 -- 172.21.15.100:0/3961953081 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fe2f808aee0 con 0x7fe3000b1fd0 2024-09-11T22:29:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.387+0000 7fe3050a5640 1 --2- 172.21.15.100:0/3961953081 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe2e406be60 0x7fe2e406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.387+0000 7fe2f67fc640 1 -- 172.21.15.100:0/3961953081 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc043070 con 0x7fe3001f4390 2024-09-11T22:29:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.387+0000 7fe2f67fc640 1 -- 172.21.15.100:0/3961953081 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe2fc038040 con 0x7fe3001f4390 2024-09-11T22:29:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.387+0000 7fe2f67fc640 1 -- 172.21.15.100:0/3961953081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3001f4390 msgr2=0x7fe3001571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.387+0000 7fe2f67fc640 1 --2- 172.21.15.100:0/3961953081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3001f4390 0x7fe3001571b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc02f000 tx=0x7fe30006d880 comp rx=0 tx=0).stop 2024-09-11T22:29:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.387+0000 7fe2f67fc640 1 -- 172.21.15.100:0/3961953081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3001f4390 msgr2=0x7fe3001571b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:29:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.387+0000 7fe2f67fc640 1 --2- 172.21.15.100:0/3961953081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3001f4390 0x7fe3001571b0 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc02f000 tx=0x7fe30006d880 comp rx=0 tx=0).stop 2024-09-11T22:29:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.387+0000 7fe3050a5640 1 --2- 172.21.15.100:0/3961953081 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe2e406be60 0x7fe2e406e320 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe3000ca830 tx=0x7fe2f0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.393+0000 7fe307b0a640 1 --2- 172.21.15.100:0/3961953081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3001f02a0 0x7fe3000b2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.393+0000 7fe307b0a640 1 -- 172.21.15.100:0/3961953081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe300070da0 con 0x7fe3001f02a0 2024-09-11T22:29:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.393+0000 7fe3058a6640 1 --2- 172.21.15.100:0/3961953081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3001f02a0 0x7fe3000b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.394+0000 7fe3058a6640 1 -- 172.21.15.100:0/3961953081 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe30006bf90 con 0x7fe3001f02a0 2024-09-11T22:29:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.394+0000 7fe3058a6640 1 --2- 172.21.15.100:0/3961953081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3001f02a0 0x7fe3000b2490 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe3001e5230 tx=0x7fe2fc02d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.394+0000 7fe2f67fc640 1 -- 172.21.15.100:0/3961953081 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc007280 con 0x7fe3001f02a0 2024-09-11T22:29:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.394+0000 7fe2f67fc640 1 -- 172.21.15.100:0/3961953081 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7fe2fc007280 con 0x7fe3001f02a0 2024-09-11T22:29:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.394+0000 7fe2f67fc640 1 -- 172.21.15.100:0/3961953081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3001f02a0 msgr2=0x7fe3000b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.394+0000 7fe2f67fc640 1 --2- 172.21.15.100:0/3961953081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3001f02a0 0x7fe3000b2490 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe3001e5230 tx=0x7fe2fc02d000 comp rx=0 tx=0).stop 2024-09-11T22:29:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.394+0000 7fe2f67fc640 1 -- 172.21.15.100:0/3961953081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3001f02a0 msgr2=0x7fe3000b2490 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:29:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.394+0000 7fe2f67fc640 1 --2- 172.21.15.100:0/3961953081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe3001f02a0 0x7fe3000b2490 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.396 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:29:26.396 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:29:26.396 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:29:26.396 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:29:26.397 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 66, 2024-09-11T22:29:26.397 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 7411, 2024-09-11T22:29:26.397 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:29:26.397 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:29:26.397 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:29:26.397 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:29:26.397 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:26.397 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:29:26.397 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:29:26.397 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:29:26.397 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:29:26.397 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:26.397 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:29:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:29:26.398 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:26.399 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:26.399 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:26.399 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:26.399 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:26.399 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:26.399 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:26.399 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:26.399 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:26.399 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:26.399 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:26.399 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:26.399 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.399 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:29:26.399 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:29:26.400 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:29:26.400 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:29:26.400 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:29:26.400 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:29:26.400 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:29:26.400 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:29:26.400 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:29:26.400 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:29:26.400 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:29:26.400 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:29:26.400 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:29:26.400 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:29:26.400 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:29:26.401 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:29:26.401 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:29:26.401 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:26.401 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:26.401 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:26.401 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:26.401 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:26.401 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:26.401 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:26.401 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:26.401 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:26.401 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:26.401 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:26.402 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:26.402 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:29:26.402 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.402 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:29:26.402 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.402 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:29:26.402 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:29:26.402 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:26.402 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:26.402 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.402 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:26.402 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:29:26.402 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:26.402 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.403 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.403 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:26.403 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:29:26.403 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:26.403 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:26.403 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:26.403 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.403 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:29:26.403 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:29:26.403 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:26.403 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:26.403 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:26.403 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.404 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.404 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:29:26.404 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:29:26.404 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:26.404 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:26.404 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.404 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:26.404 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:29:26.404 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:26.404 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.404 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.404 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:26.404 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:29:26.404 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:26.405 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:26.405 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:26.405 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.405 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:29:26.405 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:29:26.405 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:26.405 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:26.405 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:26.405 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.405 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.405 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:29:26.405 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:29:26.405 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:26.406 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:26.406 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.406 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:26.406 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:29:26.406 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:26.406 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.406 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.406 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:26.406 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:29:26.406 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:26.406 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:26.406 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:26.406 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.406 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:29:26.407 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:29:26.407 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:26.407 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:26.407 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:26.407 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:26.407 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:26.407 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.407 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:29:26.407 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:29:26.407 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.407 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:26.407 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:26.407 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:29:26.408 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:26.408 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:26.408 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:29:26.408 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.408 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:26.408 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:26.408 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:29:26.408 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:26.408 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:26.408 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.408 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:29:26.408 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:29:26.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.395+0000 7fe307b0a640 1 -- 172.21.15.100:0/3961953081 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe2e406be60 msgr2=0x7fe2e406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.395+0000 7fe307b0a640 1 --2- 172.21.15.100:0/3961953081 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe2e406be60 0x7fe2e406e320 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe3000ca830 tx=0x7fe2f0009190 comp rx=0 tx=0).stop 2024-09-11T22:29:26.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.395+0000 7fe307b0a640 1 -- 172.21.15.100:0/3961953081 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3000b1fd0 msgr2=0x7fe300156c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.395+0000 7fe307b0a640 1 --2- 172.21.15.100:0/3961953081 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3000b1fd0 0x7fe300156c70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe3000ced40 tx=0x7fe2f80021d0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.395+0000 7fe3060a7640 1 -- 172.21.15.100:0/3961953081 reap_dead start 2024-09-11T22:29:26.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.395+0000 7fe3060a7640 1 -- 172.21.15.100:0/3961953081 reap_dead start 2024-09-11T22:29:26.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.395+0000 7fe307b0a640 1 -- 172.21.15.100:0/3961953081 shutdown_connections 2024-09-11T22:29:26.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.395+0000 7fe307b0a640 1 -- 172.21.15.100:0/3961953081 >> 172.21.15.100:0/3961953081 conn(0x7fe30006de20 msgr2=0x7fe3000cc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:26.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.395+0000 7fe307b0a640 1 -- 172.21.15.100:0/3961953081 shutdown_connections 2024-09-11T22:29:26.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.395+0000 7fe307b0a640 1 -- 172.21.15.100:0/3961953081 wait complete. 2024-09-11T22:29:26.411 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:29:26.411 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:29:26.411 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:29:26.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.530+0000 7f309a16d640 1 Processor -- start 2024-09-11T22:29:26.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.530+0000 7f309a16d640 1 -- start start 2024-09-11T22:29:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.531+0000 7f309a16d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3094154d50 0x7f30940cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.531+0000 7f309a16d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30940cc9a0 0x7f30940cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.531+0000 7f309a16d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f30940d03d0 0x7f30940d0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.531+0000 7f309a16d640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f30940c5f10 con 0x7f3094154d50 2024-09-11T22:29:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.531+0000 7f309a16d640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f309415ab60 con 0x7f30940d03d0 2024-09-11T22:29:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.531+0000 7f309a16d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f309415ade0 con 0x7f30940cc9a0 2024-09-11T22:29:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.531+0000 7f30937fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3094154d50 0x7f30940cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.531+0000 7f30937fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3094154d50 0x7f30940cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48252/0 (socket says 172.21.15.100:48252) 2024-09-11T22:29:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.531+0000 7f30937fe640 1 -- 172.21.15.100:0/3853932599 learned_addr learned my addr 172.21.15.100:0/3853932599 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.531+0000 7f3093fff640 1 --2- 172.21.15.100:0/3853932599 >> v2:172.21.15.167:3300/0 conn(0x7f30940d03d0 0x7f30940d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.531+0000 7f3092ffd640 1 --2- 172.21.15.100:0/3853932599 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30940cc9a0 0x7f30940cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.532+0000 7f30937fe640 1 -- 172.21.15.100:0/3853932599 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30940cc9a0 msgr2=0x7f30940cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:26.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.532+0000 7f30937fe640 1 --2- 172.21.15.100:0/3853932599 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30940cc9a0 0x7f30940cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.532+0000 7f30937fe640 1 -- 172.21.15.100:0/3853932599 >> v2:172.21.15.167:3300/0 conn(0x7f30940d03d0 msgr2=0x7f30940d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:26.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.532+0000 7f30937fe640 1 --2- 172.21.15.100:0/3853932599 >> v2:172.21.15.167:3300/0 conn(0x7f30940d03d0 0x7f30940d0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.532+0000 7f30937fe640 1 -- 172.21.15.100:0/3853932599 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309415b0c0 con 0x7f3094154d50 2024-09-11T22:29:26.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.532+0000 7f30937fe640 1 --2- 172.21.15.100:0/3853932599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3094154d50 0x7f30940cb430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f309408e2d0 tx=0x7f308402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e593cbf27e19c939 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.533+0000 7f30927fc640 1 -- 172.21.15.100:0/3853932599 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3084037070 con 0x7f3094154d50 2024-09-11T22:29:26.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.533+0000 7f30927fc640 1 -- 172.21.15.100:0/3853932599 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3084032440 con 0x7f3094154d50 2024-09-11T22:29:26.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.533+0000 7f30927fc640 1 -- 172.21.15.100:0/3853932599 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3084032810 con 0x7f3094154d50 2024-09-11T22:29:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.533+0000 7f309a16d640 1 -- 172.21.15.100:0/3853932599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3094154d50 msgr2=0x7f30940cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.533+0000 7f309a16d640 1 --2- 172.21.15.100:0/3853932599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3094154d50 0x7f30940cb430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f309408e2d0 tx=0x7f308402a140 comp rx=0 tx=0).stop 2024-09-11T22:29:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.533+0000 7f309a16d640 1 -- 172.21.15.100:0/3853932599 shutdown_connections 2024-09-11T22:29:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.533+0000 7f309a16d640 1 --2- 172.21.15.100:0/3853932599 >> v2:172.21.15.167:3300/0 conn(0x7f30940d03d0 0x7f30940d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.533+0000 7f309a16d640 1 --2- 172.21.15.100:0/3853932599 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30940cc9a0 0x7f30940cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.533+0000 7f309a16d640 1 --2- 172.21.15.100:0/3853932599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3094154d50 0x7f30940cb430 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.533+0000 7f309a16d640 1 -- 172.21.15.100:0/3853932599 >> 172.21.15.100:0/3853932599 conn(0x7f309406d040 msgr2=0x7f309406d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.533+0000 7f309a16d640 1 -- 172.21.15.100:0/3853932599 shutdown_connections 2024-09-11T22:29:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.533+0000 7f309a16d640 1 -- 172.21.15.100:0/3853932599 wait complete. 2024-09-11T22:29:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.535+0000 7f309a16d640 1 Processor -- start 2024-09-11T22:29:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.535+0000 7f309a16d640 1 -- start start 2024-09-11T22:29:26.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.535+0000 7f309a16d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30940cc9a0 0x7f30941f4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.535+0000 7f309a16d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30940d03d0 0x7f30940b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.535+0000 7f309a16d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3094154d50 0x7f309415c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.536+0000 7f309a16d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f309415e300 con 0x7f3094154d50 2024-09-11T22:29:26.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.536+0000 7f309a16d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f309415b680 con 0x7f30940d03d0 2024-09-11T22:29:26.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.536+0000 7f309a16d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f309415e480 con 0x7f30940cc9a0 2024-09-11T22:29:26.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.536+0000 7f3093fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3094154d50 0x7f309415c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.536+0000 7f3093fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3094154d50 0x7f309415c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48254/0 (socket says 172.21.15.100:48254) 2024-09-11T22:29:26.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.536+0000 7f3093fff640 1 -- 172.21.15.100:0/1037642703 learned_addr learned my addr 172.21.15.100:0/1037642703 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:26.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.536+0000 7f30937fe640 1 --2- 172.21.15.100:0/1037642703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30940cc9a0 0x7f30941f4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.536+0000 7f3092ffd640 1 --2- 172.21.15.100:0/1037642703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30940d03d0 0x7f30940b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.536+0000 7f3093fff640 1 -- 172.21.15.100:0/1037642703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30940cc9a0 msgr2=0x7f30941f4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.536+0000 7f3093fff640 1 --2- 172.21.15.100:0/1037642703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f30940cc9a0 0x7f30941f4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.536+0000 7f3093fff640 1 -- 172.21.15.100:0/1037642703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30940d03d0 msgr2=0x7f30940b5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.536+0000 7f3093fff640 1 --2- 172.21.15.100:0/1037642703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30940d03d0 0x7f30940b5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.536+0000 7f3093fff640 1 -- 172.21.15.100:0/1037642703 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309415d0c0 con 0x7f3094154d50 2024-09-11T22:29:26.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.536+0000 7f3092ffd640 1 --2- 172.21.15.100:0/1037642703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30940d03d0 0x7f30940b5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:29:26.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.536+0000 7f3093fff640 1 --2- 172.21.15.100:0/1037642703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3094154d50 0x7f309415c370 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f308c009d20 tx=0x7f308c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.536+0000 7f307bfff640 1 -- 172.21.15.100:0/1037642703 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c018020 con 0x7f3094154d50 2024-09-11T22:29:26.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.536+0000 7f307bfff640 1 -- 172.21.15.100:0/1037642703 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f308c009b10 con 0x7f3094154d50 2024-09-11T22:29:26.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.536+0000 7f309a16d640 1 -- 172.21.15.100:0/1037642703 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f309415d3a0 con 0x7f3094154d50 2024-09-11T22:29:26.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.536+0000 7f307bfff640 1 -- 172.21.15.100:0/1037642703 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308c0146c0 con 0x7f3094154d50 2024-09-11T22:29:26.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.536+0000 7f309a16d640 1 -- 172.21.15.100:0/1037642703 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f309415d960 con 0x7f3094154d50 2024-09-11T22:29:26.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.537+0000 7f309a16d640 1 --2- 172.21.15.100:0/1037642703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f309415c8b0 0x7f30940c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.537+0000 7f309a16d640 1 -- 172.21.15.100:0/1037642703 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f30940692d0 con 0x7f309415c8b0 2024-09-11T22:29:26.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.537+0000 7f30937fe640 1 --2- 172.21.15.100:0/1037642703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f309415c8b0 0x7f30940c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.538+0000 7f30937fe640 1 -- 172.21.15.100:0/1037642703 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f309415e890 con 0x7f309415c8b0 2024-09-11T22:29:26.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.538+0000 7f30937fe640 1 --2- 172.21.15.100:0/1037642703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f309415c8b0 0x7f30940c7740 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f30940d1540 tx=0x7f30840046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.538+0000 7f307bfff640 1 -- 172.21.15.100:0/1037642703 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3084043070 con 0x7f309415c8b0 2024-09-11T22:29:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.538+0000 7f307bfff640 1 -- 172.21.15.100:0/1037642703 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f308c01b020 con 0x7f3094154d50 2024-09-11T22:29:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.539+0000 7f307bfff640 1 --2- 172.21.15.100:0/1037642703 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f308006bd30 0x7f308006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.539+0000 7f307bfff640 1 -- 172.21.15.100:0/1037642703 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f308c08bdb0 con 0x7f3094154d50 2024-09-11T22:29:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.539+0000 7f3092ffd640 1 --2- 172.21.15.100:0/1037642703 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f308006bd30 0x7f308006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.539+0000 7f307bfff640 1 -- 172.21.15.100:0/1037642703 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3084009490 con 0x7f309415c8b0 2024-09-11T22:29:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.539+0000 7f307bfff640 1 -- 172.21.15.100:0/1037642703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f309415c8b0 msgr2=0x7f30940c7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.539+0000 7f307bfff640 1 --2- 172.21.15.100:0/1037642703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f309415c8b0 0x7f30940c7740 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f30940d1540 tx=0x7f30840046c0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.539+0000 7f307bfff640 1 -- 172.21.15.100:0/1037642703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f309415c8b0 msgr2=0x7f30940c7740 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:29:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.539+0000 7f307bfff640 1 --2- 172.21.15.100:0/1037642703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f309415c8b0 0x7f30940c7740 secure :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f30940d1540 tx=0x7f30840046c0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.539+0000 7f3092ffd640 1 --2- 172.21.15.100:0/1037642703 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f308006bd30 0x7f308006e1f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3094158630 tx=0x7f3088008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.545+0000 7f309a16d640 1 --2- 172.21.15.100:0/1037642703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30940c7c80 0x7f30940c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.545+0000 7f309a16d640 1 -- 172.21.15.100:0/1037642703 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3094074290 con 0x7f30940c7c80 2024-09-11T22:29:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.545+0000 7f30937fe640 1 --2- 172.21.15.100:0/1037642703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30940c7c80 0x7f30940c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.546+0000 7f30937fe640 1 -- 172.21.15.100:0/1037642703 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f30940c85a0 con 0x7f30940c7c80 2024-09-11T22:29:26.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.546+0000 7f30937fe640 1 --2- 172.21.15.100:0/1037642703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30940c7c80 0x7f30940c8060 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3084000c00 tx=0x7f3084009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.546+0000 7f307bfff640 1 -- 172.21.15.100:0/1037642703 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3084055020 con 0x7f30940c7c80 2024-09-11T22:29:26.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.546+0000 7f307bfff640 1 -- 172.21.15.100:0/1037642703 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4887 (secure 0 0 0) 0x7f3084047b60 con 0x7f30940c7c80 2024-09-11T22:29:26.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.546+0000 7f307bfff640 1 -- 172.21.15.100:0/1037642703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30940c7c80 msgr2=0x7f30940c8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.546+0000 7f307bfff640 1 --2- 172.21.15.100:0/1037642703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30940c7c80 0x7f30940c8060 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3084000c00 tx=0x7f3084009240 comp rx=0 tx=0).stop 2024-09-11T22:29:26.548 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:29:26.548 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:29:26.548 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:29:26.548 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:29:26.548 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 66, 2024-09-11T22:29:26.548 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 351824, 2024-09-11T22:29:26.548 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:29:26.548 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:29:26.548 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:29:26.548 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:29:26.549 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:26.549 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:29:26.549 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:29:26.549 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:29:26.549 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:29:26.549 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:26.549 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:26.549 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:26.549 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:26.549 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:26.549 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:26.549 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:26.549 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:26.549 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:26.550 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:26.550 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:26.550 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:26.550 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:29:26.550 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:29:26.550 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:26.550 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:26.550 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:26.550 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:26.550 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:26.550 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:26.550 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:26.550 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:26.550 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:26.551 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:26.551 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:26.551 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:26.551 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.551 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:29:26.551 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:29:26.551 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:29:26.551 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:29:26.551 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:29:26.551 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:29:26.551 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:29:26.551 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:29:26.551 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:29:26.551 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:29:26.552 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:29:26.552 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:29:26.552 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:29:26.552 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:29:26.552 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:29:26.552 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:29:26.552 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:29:26.552 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:26.552 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:26.552 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:26.552 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:26.552 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:26.552 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:26.553 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:26.553 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:26.553 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:26.553 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:26.553 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:26.553 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:26.553 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:29:26.553 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.553 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:29:26.553 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.553 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:29:26.554 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:29:26.554 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:26.554 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:26.554 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.554 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:26.554 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:29:26.554 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:26.554 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.554 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.554 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:26.554 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:29:26.554 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:26.554 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:26.555 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:26.555 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.555 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:29:26.555 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:29:26.555 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:26.555 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:26.555 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:26.555 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.555 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.555 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:29:26.555 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:29:26.555 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:26.555 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:26.555 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.556 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:26.556 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:29:26.556 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:26.556 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.556 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.556 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:26.556 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:29:26.556 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:26.556 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:26.556 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:26.556 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.556 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:29:26.556 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:29:26.557 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:26.557 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:26.557 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:26.557 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.557 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.557 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:29:26.557 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:29:26.557 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:26.557 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:26.557 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.557 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:26.557 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:29:26.557 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:26.558 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.558 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.558 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:26.558 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:29:26.558 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:26.558 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:26.558 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:26.558 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.558 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:29:26.558 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:29:26.558 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:26.558 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:26.558 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:26.558 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:26.559 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:26.559 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.559 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:29:26.559 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:29:26.559 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.559 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:26.559 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:26.559 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:29:26.559 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:26.559 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:26.559 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:29:26.559 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.559 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:26.560 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:26.560 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:29:26.560 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:26.560 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:26.560 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:29:26.560 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.560 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:26.560 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:26.560 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:29:26.560 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:26.560 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:26.560 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:29:26.560 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.560 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:26.561 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:26.561 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:29:26.561 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:26.561 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:26.561 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.561 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:29:26.561 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:29:26.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.546+0000 7f307bfff640 1 -- 172.21.15.100:0/1037642703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30940c7c80 msgr2=0x7f30940c8060 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:29:26.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.546+0000 7f307bfff640 1 --2- 172.21.15.100:0/1037642703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30940c7c80 0x7f30940c8060 secure :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3084000c00 tx=0x7f3084009240 comp rx=0 tx=0).stop 2024-09-11T22:29:26.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.547+0000 7f309a16d640 1 -- 172.21.15.100:0/1037642703 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f308006bd30 msgr2=0x7f308006e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.547+0000 7f309a16d640 1 --2- 172.21.15.100:0/1037642703 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f308006bd30 0x7f308006e1f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3094158630 tx=0x7f3088008040 comp rx=0 tx=0).stop 2024-09-11T22:29:26.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.547+0000 7f309a16d640 1 -- 172.21.15.100:0/1037642703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3094154d50 msgr2=0x7f309415c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.547+0000 7f309a16d640 1 --2- 172.21.15.100:0/1037642703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3094154d50 0x7f309415c370 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f308c009d20 tx=0x7f308c00c490 comp rx=0 tx=0).stop 2024-09-11T22:29:26.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.547+0000 7f3093fff640 1 -- 172.21.15.100:0/1037642703 reap_dead start 2024-09-11T22:29:26.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.547+0000 7f3093fff640 1 -- 172.21.15.100:0/1037642703 reap_dead start 2024-09-11T22:29:26.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.547+0000 7f309a16d640 1 -- 172.21.15.100:0/1037642703 shutdown_connections 2024-09-11T22:29:26.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.547+0000 7f309a16d640 1 -- 172.21.15.100:0/1037642703 >> 172.21.15.100:0/1037642703 conn(0x7f309406d040 msgr2=0x7f3094153fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:26.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.547+0000 7f309a16d640 1 -- 172.21.15.100:0/1037642703 shutdown_connections 2024-09-11T22:29:26.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.547+0000 7f309a16d640 1 -- 172.21.15.100:0/1037642703 wait complete. 2024-09-11T22:29:26.564 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:29:26.564 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:29:26.564 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:29:26.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.679+0000 7f5232768640 1 Processor -- start 2024-09-11T22:29:26.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.679+0000 7f5232768640 1 -- start start 2024-09-11T22:29:26.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.680+0000 7f5232768640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c0c71e0 0x7f522c166150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.680+0000 7f5232768640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f522c0738d0 con 0x7f522c15e7c0 2024-09-11T22:29:26.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.680+0000 7f5232768640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f522c072830 con 0x7f522c154cd0 2024-09-11T22:29:26.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.680+0000 7f5232768640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f522c15ecb0 con 0x7f522c0c71e0 2024-09-11T22:29:26.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.680+0000 7f522b7fe640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f522c15e7c0 0x7f522c0cc740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39086/0 (socket says 172.21.15.100:39086) 2024-09-11T22:29:26.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.680+0000 7f522b7fe640 1 -- 172.21.15.100:0/2803640860 learned_addr learned my addr 172.21.15.100:0/2803640860 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:29:26.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.681+0000 7f5230d05640 1 --2- 172.21.15.100:0/2803640860 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c0c71e0 0x7f522c166150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.681+0000 7f522affd640 1 -- 172.21.15.100:0/2803640860 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1191383154 0 0) 0x7f522c0738d0 con 0x7f522c15e7c0 2024-09-11T22:29:26.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.681+0000 7f522affd640 1 -- 172.21.15.100:0/2803640860 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5214003520 con 0x7f522c15e7c0 2024-09-11T22:29:26.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.681+0000 7f522affd640 1 -- 172.21.15.100:0/2803640860 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081934826 0 0) 0x7f522c072830 con 0x7f522c154cd0 2024-09-11T22:29:26.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.681+0000 7f522affd640 1 -- 172.21.15.100:0/2803640860 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f522c0738d0 con 0x7f522c154cd0 2024-09-11T22:29:26.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.681+0000 7f5230d05640 1 -- 172.21.15.100:0/2803640860 >> v1:172.21.15.167:6789/0 conn(0x7f522c154cd0 legacy=0x7f522c15bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.681+0000 7f5230d05640 1 -- 172.21.15.100:0/2803640860 >> v1:172.21.15.100:6789/0 conn(0x7f522c15e7c0 legacy=0x7f522c0cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.681+0000 7f5230d05640 1 -- 172.21.15.100:0/2803640860 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f522c072b10 con 0x7f522c0c71e0 2024-09-11T22:29:26.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.682+0000 7f5230d05640 1 --2- 172.21.15.100:0/2803640860 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c0c71e0 0x7f522c166150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5224009dc0 tx=0x7f522402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe78ef8bf18db9a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.682+0000 7f522affd640 1 -- 172.21.15.100:0/2803640860 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5224007740 con 0x7f522c0c71e0 2024-09-11T22:29:26.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.682+0000 7f522affd640 1 -- 172.21.15.100:0/2803640860 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52240078e0 con 0x7f522c0c71e0 2024-09-11T22:29:26.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.682+0000 7f522affd640 1 -- 172.21.15.100:0/2803640860 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5224007cb0 con 0x7f522c0c71e0 2024-09-11T22:29:26.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.683+0000 7f5232768640 1 -- 172.21.15.100:0/2803640860 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c0c71e0 msgr2=0x7f522c166150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.683+0000 7f5232768640 1 --2- 172.21.15.100:0/2803640860 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c0c71e0 0x7f522c166150 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5224009dc0 tx=0x7f522402a6d0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.683+0000 7f5232768640 1 -- 172.21.15.100:0/2803640860 shutdown_connections 2024-09-11T22:29:26.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.683+0000 7f5232768640 1 --2- 172.21.15.100:0/2803640860 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c0c71e0 0x7f522c166150 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.683+0000 7f5232768640 1 -- 172.21.15.100:0/2803640860 >> 172.21.15.100:0/2803640860 conn(0x7f522c06fa70 msgr2=0x7f522c06fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:26.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.683+0000 7f5232768640 1 -- 172.21.15.100:0/2803640860 shutdown_connections 2024-09-11T22:29:26.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.683+0000 7f5232768640 1 -- 172.21.15.100:0/2803640860 wait complete. 2024-09-11T22:29:26.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.684+0000 7f5232768640 1 Processor -- start 2024-09-11T22:29:26.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.684+0000 7f5232768640 1 -- start start 2024-09-11T22:29:26.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.685+0000 7f5232768640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f522c0c71e0 0x7f522c0cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.685+0000 7f5232768640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c154cd0 0x7f522c0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.685+0000 7f5232768640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f522c15e7c0 0x7f522c153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.685+0000 7f5232768640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f522c075770 con 0x7f522c0c71e0 2024-09-11T22:29:26.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.685+0000 7f5232768640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f522c0730d0 con 0x7f522c15e7c0 2024-09-11T22:29:26.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.685+0000 7f5232768640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f522c15c3c0 con 0x7f522c154cd0 2024-09-11T22:29:26.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.685+0000 7f522bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f522c0c71e0 0x7f522c0cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.685+0000 7f522bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f522c0c71e0 0x7f522c0cb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48256/0 (socket says 172.21.15.100:48256) 2024-09-11T22:29:26.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.685+0000 7f522bfff640 1 -- 172.21.15.100:0/11553926 learned_addr learned my addr 172.21.15.100:0/11553926 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:26.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.685+0000 7f522b7fe640 1 --2- 172.21.15.100:0/11553926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c154cd0 0x7f522c0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.685+0000 7f522bfff640 1 -- 172.21.15.100:0/11553926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c154cd0 msgr2=0x7f522c0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.685+0000 7f522bfff640 1 --2- 172.21.15.100:0/11553926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c154cd0 0x7f522c0ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.685+0000 7f5230d05640 1 --2- 172.21.15.100:0/11553926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f522c15e7c0 0x7f522c153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.685+0000 7f522bfff640 1 -- 172.21.15.100:0/11553926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f522c15e7c0 msgr2=0x7f522c153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.685+0000 7f522bfff640 1 --2- 172.21.15.100:0/11553926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f522c15e7c0 0x7f522c153cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.685+0000 7f522bfff640 1 -- 172.21.15.100:0/11553926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f522c0cbf70 con 0x7f522c0c71e0 2024-09-11T22:29:26.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.686+0000 7f5230d05640 1 --2- 172.21.15.100:0/11553926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f522c15e7c0 0x7f522c153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:29:26.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.686+0000 7f522bfff640 1 --2- 172.21.15.100:0/11553926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f522c0c71e0 0x7f522c0cb8c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f521c00c500 tx=0x7f521c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.686+0000 7f5228ff9640 1 -- 172.21.15.100:0/11553926 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521c0052d0 con 0x7f522c0c71e0 2024-09-11T22:29:26.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.686+0000 7f5228ff9640 1 -- 172.21.15.100:0/11553926 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f521c005490 con 0x7f522c0c71e0 2024-09-11T22:29:26.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.686+0000 7f5232768640 1 -- 172.21.15.100:0/11553926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f522c0cc250 con 0x7f522c0c71e0 2024-09-11T22:29:26.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.686+0000 7f5228ff9640 1 -- 172.21.15.100:0/11553926 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521c012870 con 0x7f522c0c71e0 2024-09-11T22:29:26.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.686+0000 7f5232768640 1 -- 172.21.15.100:0/11553926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f522c1f0d80 con 0x7f522c0c71e0 2024-09-11T22:29:26.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.687+0000 7f5232768640 1 --2- 172.21.15.100:0/11553926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c1f1580 0x7f522c1f0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.687+0000 7f5232768640 1 -- 172.21.15.100:0/11553926 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f522c152070 con 0x7f522c1f1580 2024-09-11T22:29:26.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.687+0000 7f522b7fe640 1 --2- 172.21.15.100:0/11553926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c1f1580 0x7f522c1f0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.687+0000 7f5228ff9640 1 -- 172.21.15.100:0/11553926 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f521c012a10 con 0x7f522c0c71e0 2024-09-11T22:29:26.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.688+0000 7f522b7fe640 1 -- 172.21.15.100:0/11553926 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f522c1f0890 con 0x7f522c1f1580 2024-09-11T22:29:26.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.688+0000 7f5228ff9640 1 --2- 172.21.15.100:0/11553926 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f521806be30 0x7f521806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.688+0000 7f522b7fe640 1 --2- 172.21.15.100:0/11553926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c1f1580 0x7f522c1f0f80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f522c1e8250 tx=0x7f522000d950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.688+0000 7f5230d05640 1 --2- 172.21.15.100:0/11553926 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f521806be30 0x7f521806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.688+0000 7f5228ff9640 1 -- 172.21.15.100:0/11553926 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f521c08b010 con 0x7f522c0c71e0 2024-09-11T22:29:26.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.688+0000 7f5230d05640 1 --2- 172.21.15.100:0/11553926 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f521806be30 0x7f521806e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5224034000 tx=0x7f5224033040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.688+0000 7f5228ff9640 1 -- 172.21.15.100:0/11553926 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5220005da0 con 0x7f522c1f1580 2024-09-11T22:29:26.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.688+0000 7f5228ff9640 1 -- 172.21.15.100:0/11553926 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5220017070 con 0x7f522c1f1580 2024-09-11T22:29:26.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.688+0000 7f5228ff9640 1 -- 172.21.15.100:0/11553926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c1f1580 msgr2=0x7f522c1f0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.688+0000 7f5228ff9640 1 --2- 172.21.15.100:0/11553926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c1f1580 0x7f522c1f0f80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f522c1e8250 tx=0x7f522000d950 comp rx=0 tx=0).stop 2024-09-11T22:29:26.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.688+0000 7f5228ff9640 1 -- 172.21.15.100:0/11553926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c1f1580 msgr2=0x7f522c1f0f80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:29:26.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.688+0000 7f5228ff9640 1 --2- 172.21.15.100:0/11553926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c1f1580 0x7f522c1f0f80 secure :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f522c1e8250 tx=0x7f522000d950 comp rx=0 tx=0).stop 2024-09-11T22:29:26.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.694+0000 7f5232768640 1 --2- 172.21.15.100:0/11553926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c155ac0 0x7f522c14ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.694+0000 7f5232768640 1 -- 172.21.15.100:0/11553926 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f522c0c7800 con 0x7f522c155ac0 2024-09-11T22:29:26.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.695+0000 7f522b7fe640 1 --2- 172.21.15.100:0/11553926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c155ac0 0x7f522c14ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.695+0000 7f522b7fe640 1 -- 172.21.15.100:0/11553926 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f522c0c3870 con 0x7f522c155ac0 2024-09-11T22:29:26.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.695+0000 7f522b7fe640 1 --2- 172.21.15.100:0/11553926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c155ac0 0x7f522c14ae10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5220016000 tx=0x7f5220001150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.695+0000 7f5228ff9640 1 -- 172.21.15.100:0/11553926 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f522001ca20 con 0x7f522c155ac0 2024-09-11T22:29:26.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.696+0000 7f5228ff9640 1 -- 172.21.15.100:0/11553926 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7f522001ca20 con 0x7f522c155ac0 2024-09-11T22:29:26.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.696+0000 7f5228ff9640 1 -- 172.21.15.100:0/11553926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c155ac0 msgr2=0x7f522c14ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.696+0000 7f5228ff9640 1 --2- 172.21.15.100:0/11553926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c155ac0 0x7f522c14ae10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5220016000 tx=0x7f5220001150 comp rx=0 tx=0).stop 2024-09-11T22:29:26.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.696+0000 7f5228ff9640 1 -- 172.21.15.100:0/11553926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c155ac0 msgr2=0x7f522c14ae10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:29:26.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.696+0000 7f5228ff9640 1 --2- 172.21.15.100:0/11553926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f522c155ac0 0x7f522c14ae10 secure :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5220016000 tx=0x7f5220001150 comp rx=0 tx=0).stop 2024-09-11T22:29:26.697 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:29:26.697 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:29:26.697 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:29:26.698 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:29:26.698 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 66, 2024-09-11T22:29:26.698 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 457416, 2024-09-11T22:29:26.698 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:29:26.698 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:29:26.698 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:29:26.698 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:29:26.698 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:26.698 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:29:26.698 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:29:26.699 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:29:26.699 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:29:26.700 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:26.700 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:26.700 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:26.700 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:26.700 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:26.700 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:26.701 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:26.701 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:26.701 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:26.701 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:26.701 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:26.701 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:26.701 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:29:26.701 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:29:26.701 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:26.701 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:26.701 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:26.702 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:26.702 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:26.702 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:26.702 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:26.702 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:26.702 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:26.702 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:26.702 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:26.702 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:26.702 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.702 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:29:26.702 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:29:26.702 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:29:26.703 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:29:26.703 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:29:26.703 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:29:26.703 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:29:26.703 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:29:26.703 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:29:26.703 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:29:26.703 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:29:26.703 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:29:26.703 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:29:26.703 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:29:26.703 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:29:26.703 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:29:26.703 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:29:26.704 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:26.704 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:26.704 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:26.704 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:26.704 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:26.704 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:26.704 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:26.704 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:26.704 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:26.704 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:26.704 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:26.704 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:26.704 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:29:26.705 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.705 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:29:26.705 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.705 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:29:26.705 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:29:26.705 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:26.705 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:26.705 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.705 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:26.705 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:29:26.705 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:26.705 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.705 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.705 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:26.706 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:29:26.706 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:26.706 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:26.706 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:26.706 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.706 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:29:26.706 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:29:26.706 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:26.706 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:26.706 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:26.706 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.706 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.706 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:29:26.707 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:29:26.707 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:26.707 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:26.707 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.707 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:26.707 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:29:26.707 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:26.707 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.709 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.709 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:26.709 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:29:26.709 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:26.709 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:26.709 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:26.709 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.709 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:29:26.709 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:29:26.709 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:26.710 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:26.710 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:26.710 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.710 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.710 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:29:26.710 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:29:26.710 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:26.710 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:26.710 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.710 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:26.710 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:29:26.710 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:26.710 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.711 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.711 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:26.711 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:29:26.711 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:26.711 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:26.711 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:26.711 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.711 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:29:26.711 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:29:26.711 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:26.711 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:26.711 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:26.711 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:26.711 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:26.711 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.712 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:29:26.712 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:29:26.712 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.712 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:26.712 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:26.712 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:29:26.712 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:26.712 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:26.712 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:29:26.712 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.712 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:26.712 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:26.712 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:29:26.713 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:26.713 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:26.713 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:29:26.713 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.713 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:26.713 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:26.713 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:29:26.713 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:26.713 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:26.713 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:29:26.713 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.713 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:26.713 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:26.713 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:29:26.714 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:26.714 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:26.714 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:29:26.714 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:26.714 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:26.714 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:26.714 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:29:26.714 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:26.714 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:26.714 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:26.714 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:29:26.714 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:29:26.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.696+0000 7f5232768640 1 -- 172.21.15.100:0/11553926 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f521806be30 msgr2=0x7f521806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.696+0000 7f5232768640 1 --2- 172.21.15.100:0/11553926 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f521806be30 0x7f521806e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5224034000 tx=0x7f5224033040 comp rx=0 tx=0).stop 2024-09-11T22:29:26.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.696+0000 7f5232768640 1 -- 172.21.15.100:0/11553926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f522c0c71e0 msgr2=0x7f522c0cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.696+0000 7f5232768640 1 --2- 172.21.15.100:0/11553926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f522c0c71e0 0x7f522c0cb8c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f521c00c500 tx=0x7f521c00c9c0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.696+0000 7f5230d05640 1 -- 172.21.15.100:0/11553926 reap_dead start 2024-09-11T22:29:26.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.696+0000 7f5232768640 1 -- 172.21.15.100:0/11553926 shutdown_connections 2024-09-11T22:29:26.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.696+0000 7f5232768640 1 --2- 172.21.15.100:0/11553926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f522c0c71e0 0x7f522c0cb8c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.696+0000 7f5232768640 1 -- 172.21.15.100:0/11553926 >> 172.21.15.100:0/11553926 conn(0x7f522c06fa70 msgr2=0x7f522c1e7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:26.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.696+0000 7f5232768640 1 -- 172.21.15.100:0/11553926 shutdown_connections 2024-09-11T22:29:26.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.696+0000 7f5232768640 1 -- 172.21.15.100:0/11553926 wait complete. 2024-09-11T22:29:26.717 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:29:26.717 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-11T22:29:26.717 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-11T22:29:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.828+0000 7fb5240d7640 1 Processor -- start 2024-09-11T22:29:26.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.828+0000 7fb5240d7640 1 -- start start 2024-09-11T22:29:26.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.829+0000 7fb5240d7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb51c154c20 0x7fb51c0cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.829+0000 7fb5240d7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb51c0b3190 0x7fb51c15e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.829+0000 7fb5240d7640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb51c15ac90 con 0x7fb51c15a7e0 2024-09-11T22:29:26.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.829+0000 7fb5240d7640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fb51c15e000 con 0x7fb51c0b3190 2024-09-11T22:29:26.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.829+0000 7fb5240d7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb51c15af70 con 0x7fb51c154c20 2024-09-11T22:29:26.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.829+0000 7fb522674640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb51c15a7e0 0x7fb51c0cbd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39100/0 (socket says 172.21.15.100:39100) 2024-09-11T22:29:26.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.829+0000 7fb522674640 1 -- 172.21.15.100:0/1346363702 learned_addr learned my addr 172.21.15.100:0/1346363702 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:29:26.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.829+0000 7fb521e73640 1 --2- 172.21.15.100:0/1346363702 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb51c154c20 0x7fb51c0cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.829+0000 7fb521672640 1 --2- 172.21.15.100:0/1346363702 >> v2:172.21.15.167:3300/0 conn(0x7fb51c0b3190 0x7fb51c15e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.829+0000 7fb520e71640 1 -- 172.21.15.100:0/1346363702 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 76301993 0 0) 0x7fb51c15ac90 con 0x7fb51c15a7e0 2024-09-11T22:29:26.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.829+0000 7fb520e71640 1 -- 172.21.15.100:0/1346363702 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb508003520 con 0x7fb51c15a7e0 2024-09-11T22:29:26.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.829+0000 7fb521e73640 1 -- 172.21.15.100:0/1346363702 >> v2:172.21.15.167:3300/0 conn(0x7fb51c0b3190 msgr2=0x7fb51c15e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:26.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.829+0000 7fb521e73640 1 --2- 172.21.15.100:0/1346363702 >> v2:172.21.15.167:3300/0 conn(0x7fb51c0b3190 0x7fb51c15e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.829+0000 7fb521e73640 1 -- 172.21.15.100:0/1346363702 >> v1:172.21.15.100:6789/0 conn(0x7fb51c15a7e0 legacy=0x7fb51c0cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.829+0000 7fb521e73640 1 -- 172.21.15.100:0/1346363702 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51c15b250 con 0x7fb51c154c20 2024-09-11T22:29:26.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.830+0000 7fb521e73640 1 --2- 172.21.15.100:0/1346363702 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb51c154c20 0x7fb51c0cb120 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb5180097a0 tx=0x7fb51802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4943f945f63631fc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.830+0000 7fb520e71640 1 -- 172.21.15.100:0/1346363702 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb518037070 con 0x7fb51c154c20 2024-09-11T22:29:26.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.830+0000 7fb520e71640 1 -- 172.21.15.100:0/1346363702 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb518032440 con 0x7fb51c154c20 2024-09-11T22:29:26.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.830+0000 7fb520e71640 1 -- 172.21.15.100:0/1346363702 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb518032810 con 0x7fb51c154c20 2024-09-11T22:29:26.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.831+0000 7fb5240d7640 1 -- 172.21.15.100:0/1346363702 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb51c154c20 msgr2=0x7fb51c0cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.831+0000 7fb5240d7640 1 --2- 172.21.15.100:0/1346363702 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb51c154c20 0x7fb51c0cb120 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb5180097a0 tx=0x7fb51802a180 comp rx=0 tx=0).stop 2024-09-11T22:29:26.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.831+0000 7fb5240d7640 1 -- 172.21.15.100:0/1346363702 shutdown_connections 2024-09-11T22:29:26.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.831+0000 7fb5240d7640 1 --2- 172.21.15.100:0/1346363702 >> v2:172.21.15.167:3300/0 conn(0x7fb51c0b3190 0x7fb51c15e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.831+0000 7fb5240d7640 1 --2- 172.21.15.100:0/1346363702 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb51c154c20 0x7fb51c0cb120 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.831+0000 7fb5240d7640 1 -- 172.21.15.100:0/1346363702 >> 172.21.15.100:0/1346363702 conn(0x7fb51c067d40 msgr2=0x7fb51c06d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:26.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.831+0000 7fb5240d7640 1 -- 172.21.15.100:0/1346363702 shutdown_connections 2024-09-11T22:29:26.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.831+0000 7fb5240d7640 1 -- 172.21.15.100:0/1346363702 wait complete. 2024-09-11T22:29:26.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.832+0000 7fb5240d7640 1 Processor -- start 2024-09-11T22:29:26.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.832+0000 7fb5240d7640 1 -- start start 2024-09-11T22:29:26.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.833+0000 7fb5240d7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb51c0b3190 0x7fb51c150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.833+0000 7fb5240d7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb51c154c20 0x7fb51c15cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.833+0000 7fb5240d7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb51c15a7e0 0x7fb51c14fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.833+0000 7fb5240d7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c0cc5a0 con 0x7fb51c15a7e0 2024-09-11T22:29:26.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.833+0000 7fb5240d7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c0cc420 con 0x7fb51c154c20 2024-09-11T22:29:26.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.833+0000 7fb5240d7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb51c0cb660 con 0x7fb51c0b3190 2024-09-11T22:29:26.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.833+0000 7fb522674640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb51c15a7e0 0x7fb51c14fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.833+0000 7fb522674640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb51c15a7e0 0x7fb51c14fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48272/0 (socket says 172.21.15.100:48272) 2024-09-11T22:29:26.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.833+0000 7fb522674640 1 -- 172.21.15.100:0/87960519 learned_addr learned my addr 172.21.15.100:0/87960519 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:26.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.833+0000 7fb521e73640 1 --2- 172.21.15.100:0/87960519 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb51c0b3190 0x7fb51c150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.833+0000 7fb521672640 1 --2- 172.21.15.100:0/87960519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb51c154c20 0x7fb51c15cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.833+0000 7fb522674640 1 -- 172.21.15.100:0/87960519 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb51c0b3190 msgr2=0x7fb51c150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.833+0000 7fb522674640 1 --2- 172.21.15.100:0/87960519 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb51c0b3190 0x7fb51c150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.833+0000 7fb522674640 1 -- 172.21.15.100:0/87960519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb51c154c20 msgr2=0x7fb51c15cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:26.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.833+0000 7fb522674640 1 --2- 172.21.15.100:0/87960519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb51c154c20 0x7fb51c15cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:26.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.833+0000 7fb522674640 1 -- 172.21.15.100:0/87960519 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51c155260 con 0x7fb51c15a7e0 2024-09-11T22:29:26.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.834+0000 7fb522674640 1 --2- 172.21.15.100:0/87960519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb51c15a7e0 0x7fb51c14fff0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb51400cb10 tx=0x7fb51400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.834+0000 7fb5127fc640 1 -- 172.21.15.100:0/87960519 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb514017070 con 0x7fb51c15a7e0 2024-09-11T22:29:26.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.834+0000 7fb5127fc640 1 -- 172.21.15.100:0/87960519 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb51400ac90 con 0x7fb51c15a7e0 2024-09-11T22:29:26.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.834+0000 7fb5240d7640 1 -- 172.21.15.100:0/87960519 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb51c14f270 con 0x7fb51c15a7e0 2024-09-11T22:29:26.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.834+0000 7fb5127fc640 1 -- 172.21.15.100:0/87960519 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb514012640 con 0x7fb51c15a7e0 2024-09-11T22:29:26.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.834+0000 7fb5240d7640 1 -- 172.21.15.100:0/87960519 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb51c14f7f0 con 0x7fb51c15a7e0 2024-09-11T22:29:26.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.835+0000 7fb5240d7640 1 -- 172.21.15.100:0/87960519 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb51c15ac90 con 0x7fb51c15a7e0 2024-09-11T22:29:26.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.835+0000 7fb5127fc640 1 -- 172.21.15.100:0/87960519 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb51401a070 con 0x7fb51c15a7e0 2024-09-11T22:29:26.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.836+0000 7fb5127fc640 1 --2- 172.21.15.100:0/87960519 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb50006be30 0x7fb50006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:26.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.836+0000 7fb521e73640 1 --2- 172.21.15.100:0/87960519 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb50006be30 0x7fb50006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:26.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.836+0000 7fb5127fc640 1 -- 172.21.15.100:0/87960519 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fb51408aef0 con 0x7fb51c15a7e0 2024-09-11T22:29:26.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.837+0000 7fb521e73640 1 --2- 172.21.15.100:0/87960519 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb50006be30 0x7fb50006e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb518034000 tx=0x7fb51802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:26.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:26.841+0000 7fb5127fc640 1 -- 172.21.15.100:0/87960519 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb51c15ac90 con 0x7fb51c15a7e0 2024-09-11T22:29:27.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:27.139+0000 7fb5240d7640 1 -- 172.21.15.100:0/87960519 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fb51c0cb120 con 0x7fb51c15a7e0 2024-09-11T22:29:27.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:27.140+0000 7fb5127fc640 1 -- 172.21.15.100:0/87960519 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fb514058ec0 con 0x7fb51c15a7e0 2024-09-11T22:29:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:27.142+0000 7fb5240d7640 1 -- 172.21.15.100:0/87960519 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb50006be30 msgr2=0x7fb50006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:27.142+0000 7fb5240d7640 1 --2- 172.21.15.100:0/87960519 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb50006be30 0x7fb50006e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb518034000 tx=0x7fb51802e000 comp rx=0 tx=0).stop 2024-09-11T22:29:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:27.142+0000 7fb5240d7640 1 -- 172.21.15.100:0/87960519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb51c15a7e0 msgr2=0x7fb51c14fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:27.142+0000 7fb5240d7640 1 --2- 172.21.15.100:0/87960519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb51c15a7e0 0x7fb51c14fff0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb51400cb10 tx=0x7fb51400a060 comp rx=0 tx=0).stop 2024-09-11T22:29:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:27.142+0000 7fb5240d7640 1 -- 172.21.15.100:0/87960519 shutdown_connections 2024-09-11T22:29:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:27.142+0000 7fb5240d7640 1 --2- 172.21.15.100:0/87960519 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb50006be30 0x7fb50006e2f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:27.142+0000 7fb5240d7640 1 --2- 172.21.15.100:0/87960519 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb51c15a7e0 0x7fb51c14fff0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:27.142+0000 7fb5240d7640 1 --2- 172.21.15.100:0/87960519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb51c154c20 0x7fb51c15cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:27.142+0000 7fb5240d7640 1 --2- 172.21.15.100:0/87960519 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb51c0b3190 0x7fb51c150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:27.142+0000 7fb5240d7640 1 -- 172.21.15.100:0/87960519 >> 172.21.15.100:0/87960519 conn(0x7fb51c067d40 msgr2=0x7fb51c0c6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:27.143+0000 7fb5240d7640 1 -- 172.21.15.100:0/87960519 shutdown_connections 2024-09-11T22:29:27.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:27.143+0000 7fb5240d7640 1 -- 172.21.15.100:0/87960519 wait complete. 2024-09-11T22:29:27.155 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-11T22:29:37.156 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:29:37.157 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:29:37.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.261+0000 7fe609dc4640 1 Processor -- start 2024-09-11T22:29:37.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.261+0000 7fe609dc4640 1 -- start start 2024-09-11T22:29:37.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.262+0000 7fe609dc4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe604154c20 0x7fe6040cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.262+0000 7fe609dc4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe60415a7e0 0x7fe6040cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.262+0000 7fe609dc4640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe60415ac90 con 0x7fe6040b3190 2024-09-11T22:29:37.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.262+0000 7fe609dc4640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fe60415e000 con 0x7fe604154c20 2024-09-11T22:29:37.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.262+0000 7fe609dc4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe60415af70 con 0x7fe60415a7e0 2024-09-11T22:29:37.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.262+0000 7fe6037fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe604154c20 0x7fe6040cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.262+0000 7fe603fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe60415a7e0 0x7fe6040cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.262+0000 7fe6037fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe604154c20 0x7fe6040cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:60760/0 (socket says 172.21.15.100:60760) 2024-09-11T22:29:37.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.262+0000 7fe603fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe60415a7e0 0x7fe6040cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:56710/0 (socket says 172.21.15.100:56710) 2024-09-11T22:29:37.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.262+0000 7fe602ffd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fe6040b3190 0x7fe60415e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:52376/0 (socket says 172.21.15.100:52376) 2024-09-11T22:29:37.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.262+0000 7fe6037fe640 1 -- 172.21.15.100:0/976187430 learned_addr learned my addr 172.21.15.100:0/976187430 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:37.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.263+0000 7fe6037fe640 1 -- 172.21.15.100:0/976187430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe60415a7e0 msgr2=0x7fe6040cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:37.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.263+0000 7fe6037fe640 1 --2- 172.21.15.100:0/976187430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe60415a7e0 0x7fe6040cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.263+0000 7fe6037fe640 1 -- 172.21.15.100:0/976187430 >> v1:172.21.15.167:6789/0 conn(0x7fe6040b3190 legacy=0x7fe60415e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.263+0000 7fe6037fe640 1 -- 172.21.15.100:0/976187430 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60415b250 con 0x7fe604154c20 2024-09-11T22:29:37.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.263+0000 7fe6027fc640 1 -- 172.21.15.100:0/976187430 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1657607148 0 0) 0x7fe60415ac90 con 0x7fe6040b3190 2024-09-11T22:29:37.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.263+0000 7fe603fff640 1 --2- 172.21.15.100:0/976187430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe60415a7e0 0x7fe6040cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.263+0000 7fe6037fe640 1 --2- 172.21.15.100:0/976187430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe604154c20 0x7fe6040cb120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009870 tx=0x7fe5f402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f5622ee02c8415e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.264+0000 7fe6027fc640 1 -- 172.21.15.100:0/976187430 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4037070 con 0x7fe604154c20 2024-09-11T22:29:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.264+0000 7fe6027fc640 1 -- 172.21.15.100:0/976187430 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5f4032440 con 0x7fe604154c20 2024-09-11T22:29:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.264+0000 7fe6027fc640 1 -- 172.21.15.100:0/976187430 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4032810 con 0x7fe604154c20 2024-09-11T22:29:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.264+0000 7fe609dc4640 1 -- 172.21.15.100:0/976187430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe604154c20 msgr2=0x7fe6040cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.264+0000 7fe609dc4640 1 --2- 172.21.15.100:0/976187430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe604154c20 0x7fe6040cb120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009870 tx=0x7fe5f402a250 comp rx=0 tx=0).stop 2024-09-11T22:29:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.264+0000 7fe609dc4640 1 -- 172.21.15.100:0/976187430 shutdown_connections 2024-09-11T22:29:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.264+0000 7fe609dc4640 1 --2- 172.21.15.100:0/976187430 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe60415a7e0 0x7fe6040cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.264+0000 7fe609dc4640 1 --2- 172.21.15.100:0/976187430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe604154c20 0x7fe6040cb120 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.264+0000 7fe609dc4640 1 -- 172.21.15.100:0/976187430 >> 172.21.15.100:0/976187430 conn(0x7fe604067d40 msgr2=0x7fe60406d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:37.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.264+0000 7fe609dc4640 1 -- 172.21.15.100:0/976187430 shutdown_connections 2024-09-11T22:29:37.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.264+0000 7fe609dc4640 1 -- 172.21.15.100:0/976187430 wait complete. 2024-09-11T22:29:37.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.266+0000 7fe609dc4640 1 Processor -- start 2024-09-11T22:29:37.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.266+0000 7fe609dc4640 1 -- start start 2024-09-11T22:29:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.267+0000 7fe609dc4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6040b3190 0x7fe604153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.267+0000 7fe609dc4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe604154c20 0x7fe604158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.267+0000 7fe609dc4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe60415a7e0 0x7fe604155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.267+0000 7fe609dc4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe60415ed20 con 0x7fe6040b3190 2024-09-11T22:29:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.267+0000 7fe609dc4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe60415eba0 con 0x7fe604154c20 2024-09-11T22:29:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.267+0000 7fe609dc4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe6040cb660 con 0x7fe60415a7e0 2024-09-11T22:29:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.267+0000 7fe6037fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6040b3190 0x7fe604153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.267+0000 7fe6037fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6040b3190 0x7fe604153700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50290/0 (socket says 172.21.15.100:50290) 2024-09-11T22:29:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.267+0000 7fe6037fe640 1 -- 172.21.15.100:0/4272240348 learned_addr learned my addr 172.21.15.100:0/4272240348 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.267+0000 7fe603fff640 1 --2- 172.21.15.100:0/4272240348 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe60415a7e0 0x7fe604155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.267+0000 7fe602ffd640 1 --2- 172.21.15.100:0/4272240348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe604154c20 0x7fe604158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.267+0000 7fe6037fe640 1 -- 172.21.15.100:0/4272240348 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe60415a7e0 msgr2=0x7fe604155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.267+0000 7fe6037fe640 1 --2- 172.21.15.100:0/4272240348 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe60415a7e0 0x7fe604155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.267+0000 7fe6037fe640 1 -- 172.21.15.100:0/4272240348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe604154c20 msgr2=0x7fe604158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.267+0000 7fe6037fe640 1 --2- 172.21.15.100:0/4272240348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe604154c20 0x7fe604158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.267+0000 7fe6037fe640 1 -- 172.21.15.100:0/4272240348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe604159f10 con 0x7fe6040b3190 2024-09-11T22:29:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.267+0000 7fe602ffd640 1 --2- 172.21.15.100:0/4272240348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe604154c20 0x7fe604158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.268+0000 7fe6037fe640 1 --2- 172.21.15.100:0/4272240348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6040b3190 0x7fe604153700 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009870 tx=0x7fe5f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.268+0000 7fe5ebfff640 1 -- 172.21.15.100:0/4272240348 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4041020 con 0x7fe6040b3190 2024-09-11T22:29:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.268+0000 7fe5ebfff640 1 -- 172.21.15.100:0/4272240348 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5f4030660 con 0x7fe6040b3190 2024-09-11T22:29:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.268+0000 7fe609dc4640 1 -- 172.21.15.100:0/4272240348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6041f0fc0 con 0x7fe6040b3190 2024-09-11T22:29:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.268+0000 7fe5ebfff640 1 -- 172.21.15.100:0/4272240348 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4037040 con 0x7fe6040b3190 2024-09-11T22:29:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.268+0000 7fe609dc4640 1 -- 172.21.15.100:0/4272240348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6041f1260 con 0x7fe6040b3190 2024-09-11T22:29:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.269+0000 7fe609dc4640 1 -- 172.21.15.100:0/4272240348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6040cb120 con 0x7fe6040b3190 2024-09-11T22:29:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.269+0000 7fe5ebfff640 1 -- 172.21.15.100:0/4272240348 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe5f4044020 con 0x7fe6040b3190 2024-09-11T22:29:37.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.270+0000 7fe5ebfff640 1 --2- 172.21.15.100:0/4272240348 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe5f006be30 0x7fe5f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.270+0000 7fe5ebfff640 1 -- 172.21.15.100:0/4272240348 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fe5f40ab8f0 con 0x7fe6040b3190 2024-09-11T22:29:37.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.270+0000 7fe602ffd640 1 --2- 172.21.15.100:0/4272240348 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe5f006be30 0x7fe5f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.270+0000 7fe602ffd640 1 --2- 172.21.15.100:0/4272240348 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe5f006be30 0x7fe5f006e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe60414b860 tx=0x7fe5f8007e00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:37.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.276+0000 7fe5ebfff640 1 -- 172.21.15.100:0/4272240348 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe5f404b030 con 0x7fe6040b3190 2024-09-11T22:29:37.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.598+0000 7fe609dc4640 1 -- 172.21.15.100:0/4272240348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe6040cbaf0 con 0x7fe6040b3190 2024-09-11T22:29:37.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.598+0000 7fe5ebfff640 1 -- 172.21.15.100:0/4272240348 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fe5f40a9e20 con 0x7fe6040b3190 2024-09-11T22:29:37.600 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:29:37.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.600+0000 7fe609dc4640 1 -- 172.21.15.100:0/4272240348 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe5f006be30 msgr2=0x7fe5f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.600+0000 7fe609dc4640 1 --2- 172.21.15.100:0/4272240348 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe5f006be30 0x7fe5f006e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe60414b860 tx=0x7fe5f8007e00 comp rx=0 tx=0).stop 2024-09-11T22:29:37.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.600+0000 7fe609dc4640 1 -- 172.21.15.100:0/4272240348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6040b3190 msgr2=0x7fe604153700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.600+0000 7fe609dc4640 1 --2- 172.21.15.100:0/4272240348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6040b3190 0x7fe604153700 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009870 tx=0x7fe5f40046c0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.600+0000 7fe609dc4640 1 -- 172.21.15.100:0/4272240348 shutdown_connections 2024-09-11T22:29:37.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.600+0000 7fe609dc4640 1 --2- 172.21.15.100:0/4272240348 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe5f006be30 0x7fe5f006e2f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.600+0000 7fe609dc4640 1 --2- 172.21.15.100:0/4272240348 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe60415a7e0 0x7fe604155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.600+0000 7fe609dc4640 1 --2- 172.21.15.100:0/4272240348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe604154c20 0x7fe604158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.600+0000 7fe609dc4640 1 --2- 172.21.15.100:0/4272240348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6040b3190 0x7fe604153700 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.600+0000 7fe609dc4640 1 -- 172.21.15.100:0/4272240348 >> 172.21.15.100:0/4272240348 conn(0x7fe604067d40 msgr2=0x7fe6040b4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:37.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.601+0000 7fe609dc4640 1 -- 172.21.15.100:0/4272240348 shutdown_connections 2024-09-11T22:29:37.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.601+0000 7fe609dc4640 1 -- 172.21.15.100:0/4272240348 wait complete. 2024-09-11T22:29:37.613 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:29:37.614 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-11T22:29:37.614 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:29:37.614 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:29:37.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.723+0000 7fedca1f1640 1 Processor -- start 2024-09-11T22:29:37.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.723+0000 7fedca1f1640 1 -- start start 2024-09-11T22:29:37.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.724+0000 7fedca1f1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fedc4151220 0x7fedc406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.724+0000 7fedca1f1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fedc4157890 0x7fedc40c15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.724+0000 7fedca1f1640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedc415a6d0 con 0x7fedc406c150 2024-09-11T22:29:37.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.724+0000 7fedca1f1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fedc415a480 con 0x7fedc4157890 2024-09-11T22:29:37.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.724+0000 7fedca1f1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fedc415a9b0 con 0x7fedc4151220 2024-09-11T22:29:37.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.724+0000 7fedc37fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fedc4151220 0x7fedc406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.724+0000 7fedc3fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fedc4157890 0x7fedc40c15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.724+0000 7fedc2ffd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fedc406c150 0x7fedc4157180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:52380/0 (socket says 172.21.15.100:52380) 2024-09-11T22:29:37.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.724+0000 7fedc2ffd640 1 -- 172.21.15.100:0/3212595117 learned_addr learned my addr 172.21.15.100:0/3212595117 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:29:37.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.724+0000 7fedc27fc640 1 -- 172.21.15.100:0/3212595117 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2055105574 0 0) 0x7fedc415a6d0 con 0x7fedc406c150 2024-09-11T22:29:37.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.724+0000 7fedc27fc640 1 -- 172.21.15.100:0/3212595117 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedac003520 con 0x7fedc406c150 2024-09-11T22:29:37.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.725+0000 7fedc3fff640 1 -- 172.21.15.100:0/3212595117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fedc4151220 msgr2=0x7fedc406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:37.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.725+0000 7fedc3fff640 1 --2- 172.21.15.100:0/3212595117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fedc4151220 0x7fedc406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.725+0000 7fedc3fff640 1 -- 172.21.15.100:0/3212595117 >> v1:172.21.15.167:6789/0 conn(0x7fedc406c150 legacy=0x7fedc4157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.725+0000 7fedc3fff640 1 -- 172.21.15.100:0/3212595117 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc415ac90 con 0x7fedc4157890 2024-09-11T22:29:37.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.725+0000 7fedc37fe640 1 --2- 172.21.15.100:0/3212595117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fedc4151220 0x7fedc406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:37.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.726+0000 7fedc3fff640 1 --2- 172.21.15.100:0/3212595117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedc4157890 0x7fedc40c15a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fedbc009d90 tx=0x7fedbc02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=136bfc165f36b794 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:37.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.726+0000 7fedc27fc640 1 -- 172.21.15.100:0/3212595117 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedbc007740 con 0x7fedc4157890 2024-09-11T22:29:37.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.726+0000 7fedc27fc640 1 -- 172.21.15.100:0/3212595117 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedbc0078e0 con 0x7fedc4157890 2024-09-11T22:29:37.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.726+0000 7fedc27fc640 1 -- 172.21.15.100:0/3212595117 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedbc007cb0 con 0x7fedc4157890 2024-09-11T22:29:37.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.727+0000 7fedca1f1640 1 -- 172.21.15.100:0/3212595117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedc4157890 msgr2=0x7fedc40c15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.727+0000 7fedca1f1640 1 --2- 172.21.15.100:0/3212595117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedc4157890 0x7fedc40c15a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fedbc009d90 tx=0x7fedbc02a660 comp rx=0 tx=0).stop 2024-09-11T22:29:37.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.727+0000 7fedca1f1640 1 -- 172.21.15.100:0/3212595117 shutdown_connections 2024-09-11T22:29:37.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.727+0000 7fedca1f1640 1 --2- 172.21.15.100:0/3212595117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedc4157890 0x7fedc40c15a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.727+0000 7fedca1f1640 1 --2- 172.21.15.100:0/3212595117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fedc4151220 0x7fedc406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.727+0000 7fedca1f1640 1 -- 172.21.15.100:0/3212595117 >> 172.21.15.100:0/3212595117 conn(0x7fedc406f360 msgr2=0x7fedc406f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:37.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.727+0000 7fedca1f1640 1 -- 172.21.15.100:0/3212595117 shutdown_connections 2024-09-11T22:29:37.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.727+0000 7fedca1f1640 1 -- 172.21.15.100:0/3212595117 wait complete. 2024-09-11T22:29:37.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.728+0000 7fedca1f1640 1 Processor -- start 2024-09-11T22:29:37.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.729+0000 7fedca1f1640 1 -- start start 2024-09-11T22:29:37.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.729+0000 7fedca1f1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedc406c150 0x7fedc414e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.729+0000 7fedca1f1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc4151220 0x7fedc41ec880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.729+0000 7fedca1f1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fedc4157890 0x7fedc4153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.729+0000 7fedca1f1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fedc4151600 con 0x7fedc4151220 2024-09-11T22:29:37.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.729+0000 7fedca1f1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fedc415b250 con 0x7fedc406c150 2024-09-11T22:29:37.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.729+0000 7fedca1f1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fedc40719c0 con 0x7fedc4157890 2024-09-11T22:29:37.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.729+0000 7fedc2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc4151220 0x7fedc41ec880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.729+0000 7fedc2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc4151220 0x7fedc41ec880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50306/0 (socket says 172.21.15.100:50306) 2024-09-11T22:29:37.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.729+0000 7fedc2ffd640 1 -- 172.21.15.100:0/373099983 learned_addr learned my addr 172.21.15.100:0/373099983 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:37.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.730+0000 7fedc3fff640 1 --2- 172.21.15.100:0/373099983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fedc4157890 0x7fedc4153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.730+0000 7fedc37fe640 1 --2- 172.21.15.100:0/373099983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedc406c150 0x7fedc414e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.730+0000 7fedc2ffd640 1 -- 172.21.15.100:0/373099983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fedc4157890 msgr2=0x7fedc4153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.730+0000 7fedc2ffd640 1 --2- 172.21.15.100:0/373099983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fedc4157890 0x7fedc4153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.730+0000 7fedc2ffd640 1 -- 172.21.15.100:0/373099983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedc406c150 msgr2=0x7fedc414e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.730+0000 7fedc2ffd640 1 --2- 172.21.15.100:0/373099983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedc406c150 0x7fedc414e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.730+0000 7fedc2ffd640 1 -- 172.21.15.100:0/373099983 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc4159b70 con 0x7fedc4151220 2024-09-11T22:29:37.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.730+0000 7fedc2ffd640 1 --2- 172.21.15.100:0/373099983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc4151220 0x7fedc41ec880 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fedb800c400 tx=0x7fedb800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:37.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.730+0000 7fedabfff640 1 -- 172.21.15.100:0/373099983 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb8017070 con 0x7fedc4151220 2024-09-11T22:29:37.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.730+0000 7fedabfff640 1 -- 172.21.15.100:0/373099983 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedb8005d00 con 0x7fedc4151220 2024-09-11T22:29:37.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.730+0000 7fedca1f1640 1 -- 172.21.15.100:0/373099983 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedc41ef550 con 0x7fedc4151220 2024-09-11T22:29:37.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.730+0000 7fedabfff640 1 -- 172.21.15.100:0/373099983 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb8007310 con 0x7fedc4151220 2024-09-11T22:29:37.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.730+0000 7fedca1f1640 1 -- 172.21.15.100:0/373099983 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedc41ef7f0 con 0x7fedc4151220 2024-09-11T22:29:37.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.731+0000 7fedca1f1640 1 --2- 172.21.15.100:0/373099983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc41efb60 0x7fedc40c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.731+0000 7fedca1f1640 1 -- 172.21.15.100:0/373099983 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fedc415a0f0 con 0x7fedc41efb60 2024-09-11T22:29:37.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.731+0000 7fedc37fe640 1 --2- 172.21.15.100:0/373099983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc41efb60 0x7fedc40c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.732+0000 7fedc37fe640 1 -- 172.21.15.100:0/373099983 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fedc406bc10 con 0x7fedc41efb60 2024-09-11T22:29:37.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.732+0000 7fedc37fe640 1 --2- 172.21.15.100:0/373099983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc41efb60 0x7fedc40c7a00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fedb4012a10 tx=0x7fedb4012ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:37.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.732+0000 7fedabfff640 1 -- 172.21.15.100:0/373099983 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb4020070 con 0x7fedc41efb60 2024-09-11T22:29:37.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.732+0000 7fedabfff640 1 -- 172.21.15.100:0/373099983 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fedb801a070 con 0x7fedc4151220 2024-09-11T22:29:37.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.733+0000 7fedabfff640 1 --2- 172.21.15.100:0/373099983 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fedb006bd30 0x7fedb006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.733+0000 7fedc3fff640 1 --2- 172.21.15.100:0/373099983 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fedb006bd30 0x7fedb006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.733+0000 7fedabfff640 1 -- 172.21.15.100:0/373099983 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fedb808a720 con 0x7fedc4151220 2024-09-11T22:29:37.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.734+0000 7fedabfff640 1 -- 172.21.15.100:0/373099983 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fedb401b440 con 0x7fedc41efb60 2024-09-11T22:29:37.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.734+0000 7fedabfff640 1 -- 172.21.15.100:0/373099983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc41efb60 msgr2=0x7fedc40c7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.734+0000 7fedabfff640 1 --2- 172.21.15.100:0/373099983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc41efb60 0x7fedc40c7a00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fedb4012a10 tx=0x7fedb4012ed0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.734+0000 7fedabfff640 1 -- 172.21.15.100:0/373099983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc41efb60 msgr2=0x7fedc40c7a00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:29:37.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.734+0000 7fedabfff640 1 --2- 172.21.15.100:0/373099983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc41efb60 0x7fedc40c7a00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.734+0000 7fedc3fff640 1 --2- 172.21.15.100:0/373099983 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fedb006bd30 0x7fedb006e1f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fedbc034000 tx=0x7fedbc02f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:37.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.742+0000 7fedca1f1640 1 --2- 172.21.15.100:0/373099983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc41effd0 0x7fedc40c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.742+0000 7fedca1f1640 1 -- 172.21.15.100:0/373099983 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fedc41ecdc0 con 0x7fedc41effd0 2024-09-11T22:29:37.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.742+0000 7fedc37fe640 1 --2- 172.21.15.100:0/373099983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc41effd0 0x7fedc40c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.742+0000 7fedc37fe640 1 -- 172.21.15.100:0/373099983 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fedc40b2470 con 0x7fedc41effd0 2024-09-11T22:29:37.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.743+0000 7fedc37fe640 1 --2- 172.21.15.100:0/373099983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc41effd0 0x7fedc40c7f40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fedb4012a10 tx=0x7fedb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:37.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.743+0000 7fedabfff640 1 -- 172.21.15.100:0/373099983 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb400b040 con 0x7fedc41effd0 2024-09-11T22:29:37.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.743+0000 7fedabfff640 1 -- 172.21.15.100:0/373099983 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4555 (secure 0 0 0) 0x7fedb4013440 con 0x7fedc41effd0 2024-09-11T22:29:37.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.743+0000 7fedabfff640 1 -- 172.21.15.100:0/373099983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc41effd0 msgr2=0x7fedc40c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.743+0000 7fedabfff640 1 --2- 172.21.15.100:0/373099983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc41effd0 0x7fedc40c7f40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fedb4012a10 tx=0x7fedb40046c0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.743+0000 7fedabfff640 1 -- 172.21.15.100:0/373099983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc41effd0 msgr2=0x7fedc40c7f40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:29:37.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.743+0000 7fedabfff640 1 --2- 172.21.15.100:0/373099983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc41effd0 0x7fedc40c7f40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.746 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:29:37.746 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:29:37.746 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:29:37.746 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:29:37.746 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 66, 2024-09-11T22:29:37.747 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 18761, 2024-09-11T22:29:37.747 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:29:37.747 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:29:37.747 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:29:37.747 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:29:37.747 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:37.747 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 12, 2024-09-11T22:29:37.747 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:29:37.747 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:29:37.747 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:29:37.747 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:37.747 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:37.748 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:37.748 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:37.748 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:37.748 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:37.748 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:37.748 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:37.748 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:37.748 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:37.748 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:37.748 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:37.748 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:29:37.748 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:29:37.748 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:37.749 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:37.749 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:37.749 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:37.749 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:37.749 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:37.749 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:37.749 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:37.749 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:37.749 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:37.749 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:37.749 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:37.749 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.749 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:29:37.750 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:29:37.750 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:29:37.750 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:29:37.750 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:29:37.750 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:29:37.750 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:29:37.750 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:29:37.750 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:29:37.750 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:29:37.750 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:29:37.750 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:29:37.750 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:29:37.750 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:29:37.750 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:29:37.751 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:29:37.751 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:29:37.751 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:37.751 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:37.751 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:37.751 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:37.751 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:37.751 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:37.751 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:37.751 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:37.751 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:37.751 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:37.752 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:37.752 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:37.752 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:29:37.752 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.752 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:29:37.752 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.752 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:29:37.752 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:29:37.752 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:37.752 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:37.752 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.752 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:37.752 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:29:37.753 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:37.753 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.753 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.753 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:37.753 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:29:37.753 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:37.753 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:37.753 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:37.753 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.753 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:29:37.753 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:29:37.753 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:37.753 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:37.754 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:37.754 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.754 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.754 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:29:37.754 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:29:37.754 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:37.754 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:37.754 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.754 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:37.754 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:29:37.754 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:37.754 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.754 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.754 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:37.755 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:29:37.755 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:37.755 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:37.755 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:37.755 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.755 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:29:37.755 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:29:37.755 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:37.755 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:37.755 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:37.755 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.755 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.755 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:29:37.756 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:29:37.756 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:37.756 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:37.756 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.756 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:37.756 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:29:37.756 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:37.756 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.756 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.756 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:37.756 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:29:37.756 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:37.756 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:37.757 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:37.757 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.757 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:29:37.757 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:29:37.757 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:37.757 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:37.757 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:37.757 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:37.757 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:37.757 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.757 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:29:37.757 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:29:37.757 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.758 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:37.758 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:37.758 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:29:37.758 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:37.758 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:37.758 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:29:37.758 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.758 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:37.758 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:37.758 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:29:37.758 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:37.758 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:37.758 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.758 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:29:37.759 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:29:37.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.743+0000 7fedca1f1640 1 -- 172.21.15.100:0/373099983 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fedb006bd30 msgr2=0x7fedb006e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.743+0000 7fedca1f1640 1 --2- 172.21.15.100:0/373099983 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fedb006bd30 0x7fedb006e1f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fedbc034000 tx=0x7fedbc02f000 comp rx=0 tx=0).stop 2024-09-11T22:29:37.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.743+0000 7fedca1f1640 1 -- 172.21.15.100:0/373099983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc4151220 msgr2=0x7fedc41ec880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.743+0000 7fedca1f1640 1 --2- 172.21.15.100:0/373099983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc4151220 0x7fedc41ec880 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fedb800c400 tx=0x7fedb800c8c0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.743+0000 7fedc3fff640 1 -- 172.21.15.100:0/373099983 reap_dead start 2024-09-11T22:29:37.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.743+0000 7fedc3fff640 1 -- 172.21.15.100:0/373099983 reap_dead start 2024-09-11T22:29:37.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.743+0000 7fedca1f1640 1 -- 172.21.15.100:0/373099983 shutdown_connections 2024-09-11T22:29:37.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.743+0000 7fedca1f1640 1 -- 172.21.15.100:0/373099983 >> 172.21.15.100:0/373099983 conn(0x7fedc406f360 msgr2=0x7fedc40c6860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:37.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.744+0000 7fedca1f1640 1 -- 172.21.15.100:0/373099983 shutdown_connections 2024-09-11T22:29:37.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.744+0000 7fedca1f1640 1 -- 172.21.15.100:0/373099983 wait complete. 2024-09-11T22:29:37.761 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:29:37.761 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:29:37.761 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:29:37.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.870+0000 7f369e853640 1 Processor -- start 2024-09-11T22:29:37.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.870+0000 7f369e853640 1 -- start start 2024-09-11T22:29:37.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.871+0000 7f369e853640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f369806ce60 0x7f369815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.871+0000 7f369e853640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f369815c290 0x7f36981546b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.871+0000 7f369e853640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36980c6510 con 0x7f369806d240 2024-09-11T22:29:37.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.871+0000 7f369e853640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f369815b820 con 0x7f369815c290 2024-09-11T22:29:37.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.871+0000 7f369e853640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f36980c5470 con 0x7f369806ce60 2024-09-11T22:29:37.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.871+0000 7f36977fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f369815c290 0x7f36981546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.871+0000 7f36977fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f369815c290 0x7f36981546b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50344/0 (socket says 172.21.15.100:50344) 2024-09-11T22:29:37.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.872+0000 7f36977fe640 1 -- 172.21.15.100:0/169853150 learned_addr learned my addr 172.21.15.100:0/169853150 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:37.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.872+0000 7f3697fff640 1 --2- 172.21.15.100:0/169853150 >> v2:172.21.15.167:3300/0 conn(0x7f369806ce60 0x7f369815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.872+0000 7f36977fe640 1 -- 172.21.15.100:0/169853150 >> v2:172.21.15.167:3300/0 conn(0x7f369806ce60 msgr2=0x7f369815bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:37.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.872+0000 7f36977fe640 1 --2- 172.21.15.100:0/169853150 >> v2:172.21.15.167:3300/0 conn(0x7f369806ce60 0x7f369815bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.872+0000 7f36977fe640 1 -- 172.21.15.100:0/169853150 >> v1:172.21.15.167:6789/0 conn(0x7f369806d240 legacy=0x7f369815de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:37.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.872+0000 7f36977fe640 1 -- 172.21.15.100:0/169853150 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36980c5750 con 0x7f369815c290 2024-09-11T22:29:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.873+0000 7f36977fe640 1 --2- 172.21.15.100:0/169853150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f369815c290 0x7f36981546b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f369808d7a0 tx=0x7f368c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f891f0f489416d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.873+0000 7f3696ffd640 1 -- 172.21.15.100:0/169853150 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368c037070 con 0x7f369815c290 2024-09-11T22:29:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.873+0000 7f3696ffd640 1 -- 172.21.15.100:0/169853150 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f368c032440 con 0x7f369815c290 2024-09-11T22:29:37.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.873+0000 7f3696ffd640 1 -- 172.21.15.100:0/169853150 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368c032810 con 0x7f369815c290 2024-09-11T22:29:37.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.874+0000 7f369e853640 1 -- 172.21.15.100:0/169853150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f369815c290 msgr2=0x7f36981546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.874+0000 7f369e853640 1 --2- 172.21.15.100:0/169853150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f369815c290 0x7f36981546b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f369808d7a0 tx=0x7f368c02a230 comp rx=0 tx=0).stop 2024-09-11T22:29:37.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.874+0000 7f369e853640 1 -- 172.21.15.100:0/169853150 shutdown_connections 2024-09-11T22:29:37.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.874+0000 7f369e853640 1 --2- 172.21.15.100:0/169853150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f369815c290 0x7f36981546b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.874+0000 7f369e853640 1 --2- 172.21.15.100:0/169853150 >> v2:172.21.15.167:3300/0 conn(0x7f369806ce60 0x7f369815bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.874+0000 7f369e853640 1 -- 172.21.15.100:0/169853150 >> 172.21.15.100:0/169853150 conn(0x7f369806bc10 msgr2=0x7f369806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:37.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.874+0000 7f369e853640 1 -- 172.21.15.100:0/169853150 shutdown_connections 2024-09-11T22:29:37.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.874+0000 7f369e853640 1 -- 172.21.15.100:0/169853150 wait complete. 2024-09-11T22:29:37.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.875+0000 7f369e853640 1 Processor -- start 2024-09-11T22:29:37.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.876+0000 7f369e853640 1 -- start start 2024-09-11T22:29:37.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.876+0000 7f369e853640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f369806ce60 0x7f369814e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.876+0000 7f369e853640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f369806d240 0x7f36981f38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.877+0000 7f369e853640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f369815c290 0x7f36981e5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.877+0000 7f369e853640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f36980cb1b0 con 0x7f369806ce60 2024-09-11T22:29:37.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.877+0000 7f369e853640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f36980c5d10 con 0x7f369815c290 2024-09-11T22:29:37.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.877+0000 7f369e853640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f36980cad20 con 0x7f369806d240 2024-09-11T22:29:37.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.877+0000 7f3697fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f369806ce60 0x7f369814e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.877+0000 7f3697fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f369806ce60 0x7f369814e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50358/0 (socket says 172.21.15.100:50358) 2024-09-11T22:29:37.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.877+0000 7f3697fff640 1 -- 172.21.15.100:0/759274411 learned_addr learned my addr 172.21.15.100:0/759274411 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:37.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.877+0000 7f369cdf0640 1 --2- 172.21.15.100:0/759274411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f369815c290 0x7f36981e5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.877+0000 7f36977fe640 1 --2- 172.21.15.100:0/759274411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f369806d240 0x7f36981f38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.877+0000 7f3697fff640 1 -- 172.21.15.100:0/759274411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f369806d240 msgr2=0x7f36981f38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.877+0000 7f3697fff640 1 --2- 172.21.15.100:0/759274411 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f369806d240 0x7f36981f38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.877+0000 7f3697fff640 1 -- 172.21.15.100:0/759274411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f369815c290 msgr2=0x7f36981e5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.877+0000 7f3697fff640 1 --2- 172.21.15.100:0/759274411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f369815c290 0x7f36981e5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.877+0000 7f3697fff640 1 -- 172.21.15.100:0/759274411 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36980cd980 con 0x7f369806ce60 2024-09-11T22:29:37.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.877+0000 7f3697fff640 1 --2- 172.21.15.100:0/759274411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f369806ce60 0x7f369814e150 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f368800c7f0 tx=0x7f368800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:37.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.879+0000 7f3694ff9640 1 -- 172.21.15.100:0/759274411 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3688015070 con 0x7f369806ce60 2024-09-11T22:29:37.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.879+0000 7f3694ff9640 1 -- 172.21.15.100:0/759274411 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3688004240 con 0x7f369806ce60 2024-09-11T22:29:37.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.879+0000 7f369e853640 1 -- 172.21.15.100:0/759274411 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3698159540 con 0x7f369806ce60 2024-09-11T22:29:37.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.879+0000 7f3694ff9640 1 -- 172.21.15.100:0/759274411 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3688007620 con 0x7f369806ce60 2024-09-11T22:29:37.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.879+0000 7f369e853640 1 -- 172.21.15.100:0/759274411 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f369815aec0 con 0x7f369806ce60 2024-09-11T22:29:37.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.881+0000 7f369e853640 1 --2- 172.21.15.100:0/759274411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36981f3e00 0x7f36981e57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.881+0000 7f369e853640 1 -- 172.21.15.100:0/759274411 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3698159fc0 con 0x7f36981f3e00 2024-09-11T22:29:37.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.881+0000 7f36977fe640 1 --2- 172.21.15.100:0/759274411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36981f3e00 0x7f36981e57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.882+0000 7f3694ff9640 1 -- 172.21.15.100:0/759274411 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f36880077c0 con 0x7f369806ce60 2024-09-11T22:29:37.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.882+0000 7f36977fe640 1 -- 172.21.15.100:0/759274411 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3698158450 con 0x7f36981f3e00 2024-09-11T22:29:37.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.882+0000 7f36977fe640 1 --2- 172.21.15.100:0/759274411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36981f3e00 0x7f36981e57c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f36980b6880 tx=0x7f368c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:37.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.882+0000 7f3694ff9640 1 --2- 172.21.15.100:0/759274411 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f368406be80 0x7f368406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.882+0000 7f3694ff9640 1 -- 172.21.15.100:0/759274411 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f368808b020 con 0x7f369806ce60 2024-09-11T22:29:37.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.883+0000 7f369cdf0640 1 --2- 172.21.15.100:0/759274411 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f368406be80 0x7f368406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.883+0000 7f3694ff9640 1 -- 172.21.15.100:0/759274411 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368c037040 con 0x7f36981f3e00 2024-09-11T22:29:37.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.883+0000 7f3694ff9640 1 -- 172.21.15.100:0/759274411 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f368c03c850 con 0x7f36981f3e00 2024-09-11T22:29:37.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.883+0000 7f3694ff9640 1 -- 172.21.15.100:0/759274411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36981f3e00 msgr2=0x7f36981e57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.883+0000 7f3694ff9640 1 --2- 172.21.15.100:0/759274411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36981f3e00 0x7f36981e57c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f36980b6880 tx=0x7f368c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.883+0000 7f3694ff9640 1 -- 172.21.15.100:0/759274411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36981f3e00 msgr2=0x7f36981e57c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:29:37.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.883+0000 7f3694ff9640 1 --2- 172.21.15.100:0/759274411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36981f3e00 0x7f36981e57c0 secure :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f36980b6880 tx=0x7f368c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.883+0000 7f369cdf0640 1 --2- 172.21.15.100:0/759274411 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f368406be80 0x7f368406e340 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f369806d650 tx=0x7f3690003d10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:37.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.890+0000 7f369e853640 1 --2- 172.21.15.100:0/759274411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36980cd500 0x7f36980cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:37.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.890+0000 7f369e853640 1 -- 172.21.15.100:0/759274411 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f36981e6900 con 0x7f36980cd500 2024-09-11T22:29:37.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.890+0000 7f36977fe640 1 --2- 172.21.15.100:0/759274411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36980cd500 0x7f36980cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:37.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.890+0000 7f36977fe640 1 -- 172.21.15.100:0/759274411 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f36981e6620 con 0x7f36980cd500 2024-09-11T22:29:37.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.890+0000 7f36977fe640 1 --2- 172.21.15.100:0/759274411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36980cd500 0x7f36980cb330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f36980b3ed0 tx=0x7f368c009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:37.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.891+0000 7f3694ff9640 1 -- 172.21.15.100:0/759274411 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368c037030 con 0x7f36980cd500 2024-09-11T22:29:37.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.891+0000 7f3694ff9640 1 -- 172.21.15.100:0/759274411 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4888 (secure 0 0 0) 0x7f368c0476e0 con 0x7f36980cd500 2024-09-11T22:29:37.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.891+0000 7f3694ff9640 1 -- 172.21.15.100:0/759274411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36980cd500 msgr2=0x7f36980cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.891+0000 7f3694ff9640 1 --2- 172.21.15.100:0/759274411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36980cd500 0x7f36980cb330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f36980b3ed0 tx=0x7f368c009240 comp rx=0 tx=0).stop 2024-09-11T22:29:37.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.891+0000 7f3694ff9640 1 -- 172.21.15.100:0/759274411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36980cd500 msgr2=0x7f36980cb330 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:29:37.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.891+0000 7f3694ff9640 1 --2- 172.21.15.100:0/759274411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36980cd500 0x7f36980cb330 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.896 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:29:37.896 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:29:37.896 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:29:37.897 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:29:37.897 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 66, 2024-09-11T22:29:37.897 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 363171, 2024-09-11T22:29:37.897 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:29:37.897 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:29:37.897 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:29:37.898 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:29:37.898 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:37.898 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 12, 2024-09-11T22:29:37.898 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:29:37.898 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:29:37.899 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:29:37.899 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:37.899 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:37.899 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:37.899 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:37.899 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:37.900 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:37.900 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:37.900 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:37.900 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:37.900 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:37.900 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:37.901 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:37.901 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:29:37.901 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:29:37.901 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:37.901 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:37.902 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:37.902 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:37.902 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:37.902 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:37.902 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:37.902 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:37.903 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:37.903 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:37.903 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:37.903 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:37.903 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.904 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:29:37.904 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:29:37.904 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:29:37.904 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:29:37.904 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:29:37.904 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:29:37.905 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:29:37.905 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:29:37.905 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:29:37.905 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:29:37.905 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:29:37.905 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:29:37.906 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:29:37.906 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:29:37.906 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:29:37.906 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:29:37.906 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:29:37.906 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:37.907 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:37.907 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:37.907 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:37.907 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:37.907 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:37.907 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:37.908 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:37.908 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:37.908 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:37.908 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:37.908 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:37.909 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:29:37.909 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.909 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:29:37.909 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.909 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:29:37.909 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:29:37.910 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:37.910 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:37.910 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.910 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:37.910 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:29:37.911 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:37.911 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.911 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.912 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:37.912 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:29:37.912 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:37.912 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:37.912 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:37.912 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.913 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:29:37.913 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:29:37.913 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:37.913 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:37.913 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:37.914 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.914 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.914 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:29:37.914 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:29:37.914 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:37.914 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:37.915 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.915 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:37.915 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:29:37.915 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:37.915 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.916 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.916 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:37.916 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:29:37.916 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:37.916 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:37.916 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:37.917 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.917 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:29:37.917 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:29:37.917 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:37.917 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:37.917 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:37.918 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.918 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.918 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:29:37.918 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:29:37.918 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:37.919 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:37.919 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.919 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:37.919 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:29:37.919 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:37.919 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.920 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.920 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:37.920 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:29:37.920 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:37.920 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:37.921 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:37.921 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.921 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:29:37.921 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:29:37.921 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:37.921 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:37.922 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:37.922 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:37.922 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:37.922 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.922 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:29:37.922 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:29:37.923 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.923 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:37.923 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:37.923 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:29:37.923 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:37.923 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:37.924 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:29:37.924 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.924 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:37.924 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:37.924 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:29:37.925 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:37.925 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:37.925 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:29:37.925 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.925 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:37.925 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:37.926 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:29:37.926 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:37.926 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:37.926 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:29:37.926 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:37.926 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:37.927 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:37.927 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:29:37.927 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:37.927 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:37.927 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:37.927 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:29:37.928 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:29:37.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.891+0000 7f369e853640 1 -- 172.21.15.100:0/759274411 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f368406be80 msgr2=0x7f368406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.891+0000 7f369e853640 1 --2- 172.21.15.100:0/759274411 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f368406be80 0x7f368406e340 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f369806d650 tx=0x7f3690003d10 comp rx=0 tx=0).stop 2024-09-11T22:29:37.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.891+0000 7f369e853640 1 -- 172.21.15.100:0/759274411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f369806ce60 msgr2=0x7f369814e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:37.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.891+0000 7f369e853640 1 --2- 172.21.15.100:0/759274411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f369806ce60 0x7f369814e150 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f368800c7f0 tx=0x7f368800ccb0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.891+0000 7f369cdf0640 1 -- 172.21.15.100:0/759274411 reap_dead start 2024-09-11T22:29:37.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.891+0000 7f369e853640 1 -- 172.21.15.100:0/759274411 shutdown_connections 2024-09-11T22:29:37.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.891+0000 7f369e853640 1 --2- 172.21.15.100:0/759274411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f369806ce60 0x7f369814e150 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:37.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.891+0000 7f369e853640 1 -- 172.21.15.100:0/759274411 >> 172.21.15.100:0/759274411 conn(0x7f369806bc10 msgr2=0x7f36980cfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:37.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.891+0000 7f369e853640 1 -- 172.21.15.100:0/759274411 shutdown_connections 2024-09-11T22:29:37.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:37.891+0000 7f369e853640 1 -- 172.21.15.100:0/759274411 wait complete. 2024-09-11T22:29:37.933 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:29:37.933 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:29:37.933 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:29:38.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.045+0000 7f486c0c9640 1 Processor -- start 2024-09-11T22:29:38.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.045+0000 7f486c0c9640 1 -- start start 2024-09-11T22:29:38.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.046+0000 7f486c0c9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f48641518e0 0x7f48640c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:38.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.046+0000 7f486c0c9640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4864073280 0x7f4864157550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:38.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.046+0000 7f486c0c9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640c3bb0 0x7f48640c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:38.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.046+0000 7f486c0c9640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f4864151cc0 con 0x7f4864073280 2024-09-11T22:29:38.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.046+0000 7f486c0c9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f4864072020 con 0x7f48641518e0 2024-09-11T22:29:38.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.046+0000 7f486c0c9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4864072300 con 0x7f48640c3bb0 2024-09-11T22:29:38.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.046+0000 7f4869664640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4864073280 0x7f4864157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:38.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.046+0000 7f4869664640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4864073280 0x7f4864157550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50366/0 (socket says 172.21.15.100:50366) 2024-09-11T22:29:38.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.046+0000 7f4869664640 1 -- 172.21.15.100:0/111780710 learned_addr learned my addr 172.21.15.100:0/111780710 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:38.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.046+0000 7f4869e65640 1 --2- 172.21.15.100:0/111780710 >> v2:172.21.15.167:3300/0 conn(0x7f48641518e0 0x7f48640c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:38.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.046+0000 7f4869664640 1 -- 172.21.15.100:0/111780710 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640c3bb0 msgr2=0x7f48640c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:38.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.046+0000 7f486a666640 1 --2- 172.21.15.100:0/111780710 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640c3bb0 0x7f48640c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:38.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.046+0000 7f4869664640 1 --2- 172.21.15.100:0/111780710 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640c3bb0 0x7f48640c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.046+0000 7f4869664640 1 -- 172.21.15.100:0/111780710 >> v2:172.21.15.167:3300/0 conn(0x7f48641518e0 msgr2=0x7f48640c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:38.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.046+0000 7f4869664640 1 --2- 172.21.15.100:0/111780710 >> v2:172.21.15.167:3300/0 conn(0x7f48641518e0 0x7f48640c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.046+0000 7f4869664640 1 -- 172.21.15.100:0/111780710 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4864072a80 con 0x7f4864073280 2024-09-11T22:29:38.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.046+0000 7f4869e65640 1 --2- 172.21.15.100:0/111780710 >> v2:172.21.15.167:3300/0 conn(0x7f48641518e0 0x7f48640c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:29:38.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.046+0000 7f486a666640 1 --2- 172.21.15.100:0/111780710 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640c3bb0 0x7f48640c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:29:38.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.047+0000 7f4869664640 1 --2- 172.21.15.100:0/111780710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4864073280 0x7f4864157550 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4864071820 tx=0x7f485402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd64fe976da63dc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:38.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.047+0000 7f4868e63640 1 -- 172.21.15.100:0/111780710 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854037070 con 0x7f4864073280 2024-09-11T22:29:38.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.047+0000 7f4868e63640 1 -- 172.21.15.100:0/111780710 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4854032440 con 0x7f4864073280 2024-09-11T22:29:38.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.047+0000 7f4868e63640 1 -- 172.21.15.100:0/111780710 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854032810 con 0x7f4864073280 2024-09-11T22:29:38.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.048+0000 7f486c0c9640 1 -- 172.21.15.100:0/111780710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4864073280 msgr2=0x7f4864157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:38.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.048+0000 7f486c0c9640 1 --2- 172.21.15.100:0/111780710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4864073280 0x7f4864157550 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4864071820 tx=0x7f485402a270 comp rx=0 tx=0).stop 2024-09-11T22:29:38.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.048+0000 7f486c0c9640 1 -- 172.21.15.100:0/111780710 shutdown_connections 2024-09-11T22:29:38.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.048+0000 7f486c0c9640 1 --2- 172.21.15.100:0/111780710 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640c3bb0 0x7f48640c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.048+0000 7f486c0c9640 1 --2- 172.21.15.100:0/111780710 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4864073280 0x7f4864157550 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.048+0000 7f486c0c9640 1 --2- 172.21.15.100:0/111780710 >> v2:172.21.15.167:3300/0 conn(0x7f48641518e0 0x7f48640c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.048+0000 7f486c0c9640 1 -- 172.21.15.100:0/111780710 >> 172.21.15.100:0/111780710 conn(0x7f486406fa70 msgr2=0x7f486406fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:38.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.048+0000 7f486c0c9640 1 -- 172.21.15.100:0/111780710 shutdown_connections 2024-09-11T22:29:38.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.048+0000 7f486c0c9640 1 -- 172.21.15.100:0/111780710 wait complete. 2024-09-11T22:29:38.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.049+0000 7f486c0c9640 1 Processor -- start 2024-09-11T22:29:38.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.050+0000 7f486c0c9640 1 -- start start 2024-09-11T22:29:38.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.050+0000 7f486c0c9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4864073280 0x7f48641e1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:38.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.050+0000 7f486c0c9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640c3bb0 0x7f48641475d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:38.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.050+0000 7f486c0c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48641518e0 0x7f486414fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:38.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.051+0000 7f486c0c9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f48640c8b70 con 0x7f4864073280 2024-09-11T22:29:38.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.051+0000 7f486c0c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4864157a90 con 0x7f48641518e0 2024-09-11T22:29:38.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.051+0000 7f486c0c9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4864072730 con 0x7f48640c3bb0 2024-09-11T22:29:38.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.051+0000 7f4869e65640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4864073280 0x7f48641e1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:38.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.051+0000 7f4869e65640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4864073280 0x7f48641e1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50368/0 (socket says 172.21.15.100:50368) 2024-09-11T22:29:38.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.051+0000 7f4869e65640 1 -- 172.21.15.100:0/4044847588 learned_addr learned my addr 172.21.15.100:0/4044847588 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:38.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.051+0000 7f4869664640 1 --2- 172.21.15.100:0/4044847588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640c3bb0 0x7f48641475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:38.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.051+0000 7f486a666640 1 --2- 172.21.15.100:0/4044847588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48641518e0 0x7f486414fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:38.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.051+0000 7f4869e65640 1 -- 172.21.15.100:0/4044847588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640c3bb0 msgr2=0x7f48641475d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:38.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.051+0000 7f4869e65640 1 --2- 172.21.15.100:0/4044847588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640c3bb0 0x7f48641475d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.051+0000 7f4869e65640 1 -- 172.21.15.100:0/4044847588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48641518e0 msgr2=0x7f486414fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:38.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.051+0000 7f4869e65640 1 --2- 172.21.15.100:0/4044847588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48641518e0 0x7f486414fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.051+0000 7f4869e65640 1 -- 172.21.15.100:0/4044847588 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48640cbc70 con 0x7f4864073280 2024-09-11T22:29:38.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.051+0000 7f4869e65640 1 --2- 172.21.15.100:0/4044847588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4864073280 0x7f48641e1ec0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f486000c820 tx=0x7f486000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:38.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.051+0000 7f485a7fc640 1 -- 172.21.15.100:0/4044847588 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4860015070 con 0x7f4864073280 2024-09-11T22:29:38.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.051+0000 7f485a7fc640 1 -- 172.21.15.100:0/4044847588 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4860007a30 con 0x7f4864073280 2024-09-11T22:29:38.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.051+0000 7f486c0c9640 1 -- 172.21.15.100:0/4044847588 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f486414f230 con 0x7f4864073280 2024-09-11T22:29:38.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.051+0000 7f485a7fc640 1 -- 172.21.15.100:0/4044847588 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4860007e00 con 0x7f4864073280 2024-09-11T22:29:38.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.051+0000 7f486c0c9640 1 -- 172.21.15.100:0/4044847588 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4864150d80 con 0x7f4864073280 2024-09-11T22:29:38.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.052+0000 7f486c0c9640 1 --2- 172.21.15.100:0/4044847588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640cc160 0x7f48640ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:38.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.052+0000 7f486c0c9640 1 -- 172.21.15.100:0/4044847588 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4864074110 con 0x7f48640cc160 2024-09-11T22:29:38.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.052+0000 7f4869664640 1 --2- 172.21.15.100:0/4044847588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640cc160 0x7f48640ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:38.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.053+0000 7f4869664640 1 -- 172.21.15.100:0/4044847588 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f48640c9aa0 con 0x7f48640cc160 2024-09-11T22:29:38.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.053+0000 7f4869664640 1 --2- 172.21.15.100:0/4044847588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640cc160 0x7f48640ca590 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f486406d6f0 tx=0x7f48540046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:38.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.053+0000 7f485a7fc640 1 -- 172.21.15.100:0/4044847588 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4860018070 con 0x7f4864073280 2024-09-11T22:29:38.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.053+0000 7f485a7fc640 1 --2- 172.21.15.100:0/4044847588 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f484806be60 0x7f484806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:38.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.053+0000 7f485a7fc640 1 -- 172.21.15.100:0/4044847588 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f486008b160 con 0x7f4864073280 2024-09-11T22:29:38.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.054+0000 7f486a666640 1 --2- 172.21.15.100:0/4044847588 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f484806be60 0x7f484806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:38.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.054+0000 7f485a7fc640 1 -- 172.21.15.100:0/4044847588 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854043070 con 0x7f48640cc160 2024-09-11T22:29:38.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.054+0000 7f485a7fc640 1 -- 172.21.15.100:0/4044847588 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f485403c640 con 0x7f48640cc160 2024-09-11T22:29:38.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.054+0000 7f485a7fc640 1 -- 172.21.15.100:0/4044847588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640cc160 msgr2=0x7f48640ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:38.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.054+0000 7f485a7fc640 1 --2- 172.21.15.100:0/4044847588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640cc160 0x7f48640ca590 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f486406d6f0 tx=0x7f48540046c0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.054+0000 7f485a7fc640 1 -- 172.21.15.100:0/4044847588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640cc160 msgr2=0x7f48640ca590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:29:38.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.054+0000 7f485a7fc640 1 --2- 172.21.15.100:0/4044847588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640cc160 0x7f48640ca590 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.054+0000 7f486a666640 1 --2- 172.21.15.100:0/4044847588 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f484806be60 0x7f484806e320 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f48640cc030 tx=0x7f485c007710 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:38.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.060+0000 7f486c0c9640 1 --2- 172.21.15.100:0/4044847588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640caad0 0x7f48640caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:38.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.060+0000 7f486c0c9640 1 -- 172.21.15.100:0/4044847588 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f48640c8df0 con 0x7f48640caad0 2024-09-11T22:29:38.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.061+0000 7f4869664640 1 --2- 172.21.15.100:0/4044847588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640caad0 0x7f48640caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:38.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.061+0000 7f4869664640 1 -- 172.21.15.100:0/4044847588 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f48640c84b0 con 0x7f48640caad0 2024-09-11T22:29:38.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.061+0000 7f4869664640 1 --2- 172.21.15.100:0/4044847588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640caad0 0x7f48640caef0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f485402a2b0 tx=0x7f4854008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:38.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.061+0000 7f485a7fc640 1 -- 172.21.15.100:0/4044847588 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854037040 con 0x7f48640caad0 2024-09-11T22:29:38.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.061+0000 7f485a7fc640 1 -- 172.21.15.100:0/4044847588 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7f4854003aa0 con 0x7f48640caad0 2024-09-11T22:29:38.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.061+0000 7f485a7fc640 1 -- 172.21.15.100:0/4044847588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640caad0 msgr2=0x7f48640caef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:38.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.061+0000 7f485a7fc640 1 --2- 172.21.15.100:0/4044847588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640caad0 0x7f48640caef0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f485402a2b0 tx=0x7f4854008030 comp rx=0 tx=0).stop 2024-09-11T22:29:38.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.061+0000 7f485a7fc640 1 -- 172.21.15.100:0/4044847588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640caad0 msgr2=0x7f48640caef0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:29:38.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.061+0000 7f485a7fc640 1 --2- 172.21.15.100:0/4044847588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48640caad0 0x7f48640caef0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.064 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:29:38.064 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:29:38.064 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:29:38.064 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:29:38.065 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 66, 2024-09-11T22:29:38.065 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 468784, 2024-09-11T22:29:38.065 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:29:38.065 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:29:38.065 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:29:38.065 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:29:38.065 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:38.065 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 12, 2024-09-11T22:29:38.065 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:29:38.065 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:29:38.065 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:29:38.065 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:38.065 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:38.066 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:38.066 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:38.066 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:38.066 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:38.066 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:38.066 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:38.066 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:38.066 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:38.066 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:38.066 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:38.066 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:29:38.066 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:29:38.066 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:38.066 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:38.067 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:38.067 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:38.067 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:38.067 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:38.067 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:38.067 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:38.067 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:38.067 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:38.067 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:38.067 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:38.067 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:38.067 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:29:38.067 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:29:38.068 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:29:38.068 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:29:38.068 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:29:38.068 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:29:38.068 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:29:38.068 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:29:38.068 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:29:38.068 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:29:38.068 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:29:38.068 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:29:38.068 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:29:38.068 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:29:38.069 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:29:38.069 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:29:38.069 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:29:38.069 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:38.069 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:38.069 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:38.069 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:38.069 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:38.069 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:38.069 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:38.069 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:38.069 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:38.069 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:38.069 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:38.070 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:38.070 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:29:38.070 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:38.070 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:29:38.070 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:38.070 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:29:38.070 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:29:38.070 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:38.070 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:38.070 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:38.070 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:38.070 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:29:38.070 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:38.071 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:38.071 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:38.071 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:38.071 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:29:38.071 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:38.071 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:38.071 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:38.071 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:38.071 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:29:38.071 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:29:38.071 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:38.071 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:38.071 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:38.071 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:38.072 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:38.072 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:29:38.072 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:29:38.072 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:38.072 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:38.072 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:38.072 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:38.072 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:29:38.072 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:38.072 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:38.072 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:38.072 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:38.072 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:29:38.073 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:38.073 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:38.073 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:38.073 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:38.073 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:29:38.073 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:29:38.073 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:38.073 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:38.073 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:38.073 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:38.073 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:38.073 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:29:38.073 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:29:38.073 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:38.074 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:38.074 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:38.074 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:38.074 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:29:38.074 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:38.074 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:38.074 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:38.074 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:38.074 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:29:38.074 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:38.074 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:38.074 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:38.074 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:38.074 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:29:38.075 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:29:38.075 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:38.075 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:38.075 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:38.075 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:38.075 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:38.075 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:38.075 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:29:38.075 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:29:38.075 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:38.075 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:38.075 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:38.075 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:29:38.075 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:38.076 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:38.076 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:29:38.076 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:38.076 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:38.076 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:38.076 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:29:38.076 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:38.076 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:38.076 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:29:38.076 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:38.076 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:38.076 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:38.076 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:29:38.076 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:38.077 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:38.077 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:29:38.077 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:38.077 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:38.077 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:38.077 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:29:38.077 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:38.077 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:38.077 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:29:38.077 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:38.077 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:38.077 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:38.077 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:29:38.077 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:38.078 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:38.078 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:38.078 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:29:38.078 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:29:38.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.062+0000 7f486c0c9640 1 -- 172.21.15.100:0/4044847588 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f484806be60 msgr2=0x7f484806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:38.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.062+0000 7f486c0c9640 1 --2- 172.21.15.100:0/4044847588 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f484806be60 0x7f484806e320 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f48640cc030 tx=0x7f485c007710 comp rx=0 tx=0).stop 2024-09-11T22:29:38.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.062+0000 7f486c0c9640 1 -- 172.21.15.100:0/4044847588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4864073280 msgr2=0x7f48641e1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:38.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.062+0000 7f486c0c9640 1 --2- 172.21.15.100:0/4044847588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4864073280 0x7f48641e1ec0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f486000c820 tx=0x7f486000cc20 comp rx=0 tx=0).stop 2024-09-11T22:29:38.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.062+0000 7f486a666640 1 -- 172.21.15.100:0/4044847588 reap_dead start 2024-09-11T22:29:38.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.062+0000 7f486a666640 1 -- 172.21.15.100:0/4044847588 reap_dead start 2024-09-11T22:29:38.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.062+0000 7f486c0c9640 1 -- 172.21.15.100:0/4044847588 shutdown_connections 2024-09-11T22:29:38.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.062+0000 7f486c0c9640 1 -- 172.21.15.100:0/4044847588 >> 172.21.15.100:0/4044847588 conn(0x7f486406fa70 msgr2=0x7f4864157c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:38.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.062+0000 7f486c0c9640 1 -- 172.21.15.100:0/4044847588 shutdown_connections 2024-09-11T22:29:38.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.062+0000 7f486c0c9640 1 -- 172.21.15.100:0/4044847588 wait complete. 2024-09-11T22:29:38.080 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:29:38.080 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-11T22:29:38.080 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-11T22:29:38.080 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-11T22:29:38.080 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:29:38.081 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T22:29:38.081 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:29:38.091 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T22:29:38.092 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-11T22:29:38.092 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:29:38.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.237+0000 7fb3f0b9f640 1 Processor -- start 2024-09-11T22:29:38.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.238+0000 7fb3f0b9f640 1 -- start start 2024-09-11T22:29:38.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.238+0000 7fb3f0b9f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb3ec0c7ca0 0x7fb3ec070090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:38.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.238+0000 7fb3f0b9f640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb3ec15bc80 0x7fb3ec154590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:38.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.239+0000 7fb3f0b9f640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3ec15b090 con 0x7fb3ec0c8080 2024-09-11T22:29:38.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.239+0000 7fb3f0b9f640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb3ec0705d0 con 0x7fb3ec15bc80 2024-09-11T22:29:38.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.239+0000 7fb3f0b9f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fb3ec15b330 con 0x7fb3ec0c7ca0 2024-09-11T22:29:38.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.239+0000 7fb3e9d9b640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7fb3ec0c8080 legacy=0x7fb3ec15a790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:29:38.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.239+0000 7fb3ead9d640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7fb3ec15bc80 msgr2=0x7fb3ec154590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:29:38.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.239+0000 7fb3ead9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb3ec15bc80 0x7fb3ec154590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:29:38.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.239+0000 7fb3ea59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb3ec0c7ca0 0x7fb3ec070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:38.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.239+0000 7fb3ea59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb3ec0c7ca0 0x7fb3ec070090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:60828/0 (socket says 172.21.15.100:60828) 2024-09-11T22:29:38.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.239+0000 7fb3ea59c640 1 -- 172.21.15.100:0/1250318744 learned_addr learned my addr 172.21.15.100:0/1250318744 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:38.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.239+0000 7fb3ea59c640 1 -- 172.21.15.100:0/1250318744 >> v2:172.21.15.100:3300/0 conn(0x7fb3ec15bc80 msgr2=0x7fb3ec154590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:29:38.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.239+0000 7fb3ea59c640 1 --2- 172.21.15.100:0/1250318744 >> v2:172.21.15.100:3300/0 conn(0x7fb3ec15bc80 0x7fb3ec154590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.239+0000 7fb3ea59c640 1 -- 172.21.15.100:0/1250318744 >> v1:172.21.15.100:6789/0 conn(0x7fb3ec0c8080 legacy=0x7fb3ec15a790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:29:38.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.239+0000 7fb3ea59c640 1 -- 172.21.15.100:0/1250318744 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3ec15b610 con 0x7fb3ec0c7ca0 2024-09-11T22:29:38.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.240+0000 7fb3ea59c640 1 --2- 172.21.15.100:0/1250318744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3ec0c7ca0 0x7fb3ec070090 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec0c90a0 tx=0x7fb3dc02a2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=639e13492f919c87 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:38.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.240+0000 7fb3e959a640 1 -- 172.21.15.100:0/1250318744 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc037070 con 0x7fb3ec0c7ca0 2024-09-11T22:29:38.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.240+0000 7fb3e959a640 1 -- 172.21.15.100:0/1250318744 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3dc032440 con 0x7fb3ec0c7ca0 2024-09-11T22:29:38.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.240+0000 7fb3e959a640 1 -- 172.21.15.100:0/1250318744 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc032810 con 0x7fb3ec0c7ca0 2024-09-11T22:29:38.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.241+0000 7fb3f0b9f640 1 -- 172.21.15.100:0/1250318744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3ec0c7ca0 msgr2=0x7fb3ec070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:38.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.241+0000 7fb3f0b9f640 1 --2- 172.21.15.100:0/1250318744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3ec0c7ca0 0x7fb3ec070090 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec0c90a0 tx=0x7fb3dc02a2e0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.241+0000 7fb3f0b9f640 1 -- 172.21.15.100:0/1250318744 shutdown_connections 2024-09-11T22:29:38.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.241+0000 7fb3f0b9f640 1 --2- 172.21.15.100:0/1250318744 >> v2:172.21.15.100:3300/0 conn(0x7fb3ec15bc80 0x7fb3ec154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.241+0000 7fb3f0b9f640 1 --2- 172.21.15.100:0/1250318744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3ec0c7ca0 0x7fb3ec070090 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.241+0000 7fb3f0b9f640 1 -- 172.21.15.100:0/1250318744 >> 172.21.15.100:0/1250318744 conn(0x7fb3ec06bc10 msgr2=0x7fb3ec06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:38.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.241+0000 7fb3f0b9f640 1 -- 172.21.15.100:0/1250318744 shutdown_connections 2024-09-11T22:29:38.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.241+0000 7fb3f0b9f640 1 -- 172.21.15.100:0/1250318744 wait complete. 2024-09-11T22:29:38.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.242+0000 7fb3f0b9f640 1 Processor -- start 2024-09-11T22:29:38.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.242+0000 7fb3f0b9f640 1 -- start start 2024-09-11T22:29:38.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.243+0000 7fb3f0b9f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3ec0c7ca0 0x7fb3ec0cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:38.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.243+0000 7fb3f0b9f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3ec0c8080 0x7fb3ec159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:38.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.243+0000 7fb3f0b9f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3ec15bc80 0x7fb3ec1f3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:38.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.243+0000 7fb3f0b9f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ec06fb70 con 0x7fb3ec0c8080 2024-09-11T22:29:38.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.243+0000 7fb3f0b9f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ec06f890 con 0x7fb3ec0c7ca0 2024-09-11T22:29:38.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.243+0000 7fb3f0b9f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb3ec075b90 con 0x7fb3ec15bc80 2024-09-11T22:29:38.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.243+0000 7fb3e9d9b640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3ec0c8080 msgr2=0x7fb3ec159e90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:29:38.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.243+0000 7fb3e9d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3ec0c8080 0x7fb3ec159e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:29:38.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.243+0000 7fb3ead9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3ec15bc80 0x7fb3ec1f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:38.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.243+0000 7fb3ea59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3ec0c7ca0 0x7fb3ec0cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:38.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.243+0000 7fb3ead9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3ec15bc80 0x7fb3ec1f3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:56784/0 (socket says 172.21.15.100:56784) 2024-09-11T22:29:38.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.243+0000 7fb3ea59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3ec0c7ca0 0x7fb3ec0cae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:60838/0 (socket says 172.21.15.100:60838) 2024-09-11T22:29:38.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.243+0000 7fb3ead9d640 1 -- 172.21.15.100:0/3401055924 learned_addr learned my addr 172.21.15.100:0/3401055924 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:38.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.244+0000 7fb3ea59c640 1 -- 172.21.15.100:0/3401055924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3ec15bc80 msgr2=0x7fb3ec1f3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:38.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.244+0000 7fb3ea59c640 1 --2- 172.21.15.100:0/3401055924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3ec15bc80 0x7fb3ec1f3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.244+0000 7fb3ea59c640 1 -- 172.21.15.100:0/3401055924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3ec0c8080 msgr2=0x7fb3ec159e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:29:38.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.244+0000 7fb3ea59c640 1 --2- 172.21.15.100:0/3401055924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3ec0c8080 0x7fb3ec159e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.244+0000 7fb3ea59c640 1 -- 172.21.15.100:0/3401055924 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3ec0ccc00 con 0x7fb3ec0c7ca0 2024-09-11T22:29:38.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.244+0000 7fb3ead9d640 1 --2- 172.21.15.100:0/3401055924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3ec15bc80 0x7fb3ec1f3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:38.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.244+0000 7fb3ea59c640 1 --2- 172.21.15.100:0/3401055924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3ec0c7ca0 0x7fb3ec0cae80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec071680 tx=0x7fb3dc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:38.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.244+0000 7fb3daffd640 1 -- 172.21.15.100:0/3401055924 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc041070 con 0x7fb3ec0c7ca0 2024-09-11T22:29:38.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.244+0000 7fb3daffd640 1 -- 172.21.15.100:0/3401055924 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3dc03c660 con 0x7fb3ec0c7ca0 2024-09-11T22:29:38.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.244+0000 7fb3f0b9f640 1 -- 172.21.15.100:0/3401055924 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3ec0ccee0 con 0x7fb3ec0c7ca0 2024-09-11T22:29:38.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.244+0000 7fb3daffd640 1 -- 172.21.15.100:0/3401055924 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc037040 con 0x7fb3ec0c7ca0 2024-09-11T22:29:38.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.244+0000 7fb3f0b9f640 1 -- 172.21.15.100:0/3401055924 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3ec159690 con 0x7fb3ec0c7ca0 2024-09-11T22:29:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.245+0000 7fb3f0b9f640 1 -- 172.21.15.100:0/3401055924 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3ec0c6670 con 0x7fb3ec0c7ca0 2024-09-11T22:29:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.246+0000 7fb3daffd640 1 -- 172.21.15.100:0/3401055924 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3dc044070 con 0x7fb3ec0c7ca0 2024-09-11T22:29:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.246+0000 7fb3daffd640 1 --2- 172.21.15.100:0/3401055924 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb3cc06bde0 0x7fb3cc06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.246+0000 7fb3daffd640 1 -- 172.21.15.100:0/3401055924 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fb3dc0abcc0 con 0x7fb3ec0c7ca0 2024-09-11T22:29:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.246+0000 7fb3e9d9b640 1 --2- 172.21.15.100:0/3401055924 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb3cc06bde0 0x7fb3cc06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.247+0000 7fb3e9d9b640 1 --2- 172.21.15.100:0/3401055924 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb3cc06bde0 0x7fb3cc06e2a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec15d510 tx=0x7fb3e0006d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:38.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.250+0000 7fb3daffd640 1 -- 172.21.15.100:0/3401055924 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb3dc079c90 con 0x7fb3ec0c7ca0 2024-09-11T22:29:38.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.560+0000 7fb3f0b9f640 1 -- 172.21.15.100:0/3401055924 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb3ec0c4f90 con 0x7fb3ec0c7ca0 2024-09-11T22:29:38.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.561+0000 7fb3daffd640 1 -- 172.21.15.100:0/3401055924 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fb3dc07df90 con 0x7fb3ec0c7ca0 2024-09-11T22:29:38.562 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:29:38.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.563+0000 7fb3f0b9f640 1 -- 172.21.15.100:0/3401055924 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb3cc06bde0 msgr2=0x7fb3cc06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:38.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.563+0000 7fb3f0b9f640 1 --2- 172.21.15.100:0/3401055924 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb3cc06bde0 0x7fb3cc06e2a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec15d510 tx=0x7fb3e0006d30 comp rx=0 tx=0).stop 2024-09-11T22:29:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.563+0000 7fb3f0b9f640 1 -- 172.21.15.100:0/3401055924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3ec0c7ca0 msgr2=0x7fb3ec0cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.563+0000 7fb3f0b9f640 1 --2- 172.21.15.100:0/3401055924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3ec0c7ca0 0x7fb3ec0cae80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec071680 tx=0x7fb3dc0046c0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.563+0000 7fb3f0b9f640 1 -- 172.21.15.100:0/3401055924 shutdown_connections 2024-09-11T22:29:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.563+0000 7fb3f0b9f640 1 --2- 172.21.15.100:0/3401055924 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb3cc06bde0 0x7fb3cc06e2a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.563+0000 7fb3f0b9f640 1 --2- 172.21.15.100:0/3401055924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3ec15bc80 0x7fb3ec1f3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.563+0000 7fb3f0b9f640 1 --2- 172.21.15.100:0/3401055924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3ec0c8080 0x7fb3ec159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.563+0000 7fb3f0b9f640 1 --2- 172.21.15.100:0/3401055924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3ec0c7ca0 0x7fb3ec0cae80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.563+0000 7fb3f0b9f640 1 -- 172.21.15.100:0/3401055924 >> 172.21.15.100:0/3401055924 conn(0x7fb3ec06bc10 msgr2=0x7fb3ec0c5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.563+0000 7fb3f0b9f640 1 -- 172.21.15.100:0/3401055924 shutdown_connections 2024-09-11T22:29:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:38.563+0000 7fb3f0b9f640 1 -- 172.21.15.100:0/3401055924 wait complete. 2024-09-11T22:29:41.576 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:29:41.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.684+0000 7f7d928a6640 1 Processor -- start 2024-09-11T22:29:41.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.684+0000 7f7d928a6640 1 -- start start 2024-09-11T22:29:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.685+0000 7f7d928a6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7d8c15c660 0x7f7d8c1622f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.685+0000 7f7d928a6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d8c0728a0 0x7f7d8c15f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.685+0000 7f7d928a6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d8c0c3130 con 0x7f7d8c0c7cf0 2024-09-11T22:29:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.685+0000 7f7d928a6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f7d8c163240 con 0x7f7d8c15c660 2024-09-11T22:29:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.685+0000 7f7d928a6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7d8c15ca40 con 0x7f7d8c0728a0 2024-09-11T22:29:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.685+0000 7f7d8bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7d8c15c660 0x7f7d8c1622f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.685+0000 7f7d8b7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d8c0728a0 0x7f7d8c15f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.685+0000 7f7d90e43640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f7d8c0c7cf0 0x7f7d8c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:52408/0 (socket says 172.21.15.100:52408) 2024-09-11T22:29:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.685+0000 7f7d90e43640 1 -- 172.21.15.100:0/351934803 learned_addr learned my addr 172.21.15.100:0/351934803 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:29:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.685+0000 7f7d8bfff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7d8c15c660 0x7f7d8c1622f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:60842/0 (socket says 172.21.15.100:60842) 2024-09-11T22:29:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.685+0000 7f7d8affd640 1 -- 172.21.15.100:0/351934803 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2055031837 0 0) 0x7f7d84001490 con 0x7f7d8c0c7cf0 2024-09-11T22:29:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.686+0000 7f7d8affd640 1 -- 172.21.15.100:0/351934803 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d74003520 con 0x7f7d8c0c7cf0 2024-09-11T22:29:41.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.686+0000 7f7d8b7fe640 1 -- 172.21.15.100:0/351934803 >> v2:172.21.15.167:3300/0 conn(0x7f7d8c15c660 msgr2=0x7f7d8c1622f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:41.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.686+0000 7f7d8b7fe640 1 --2- 172.21.15.100:0/351934803 >> v2:172.21.15.167:3300/0 conn(0x7f7d8c15c660 0x7f7d8c1622f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:41.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.686+0000 7f7d8b7fe640 1 -- 172.21.15.100:0/351934803 >> v1:172.21.15.167:6789/0 conn(0x7f7d8c0c7cf0 legacy=0x7f7d8c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:41.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.686+0000 7f7d8b7fe640 1 -- 172.21.15.100:0/351934803 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c15fcd0 con 0x7f7d8c0728a0 2024-09-11T22:29:41.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.687+0000 7f7d8b7fe640 1 --2- 172.21.15.100:0/351934803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d8c0728a0 0x7f7d8c15f790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7d800097a0 tx=0x7f7d8002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0e0e5e536a965d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:41.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.687+0000 7f7d8affd640 1 -- 172.21.15.100:0/351934803 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80037070 con 0x7f7d8c0728a0 2024-09-11T22:29:41.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.687+0000 7f7d8affd640 1 -- 172.21.15.100:0/351934803 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d80032440 con 0x7f7d8c0728a0 2024-09-11T22:29:41.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.687+0000 7f7d8affd640 1 -- 172.21.15.100:0/351934803 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d800327f0 con 0x7f7d8c0728a0 2024-09-11T22:29:41.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.688+0000 7f7d928a6640 1 -- 172.21.15.100:0/351934803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d8c0728a0 msgr2=0x7f7d8c15f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:41.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.688+0000 7f7d928a6640 1 --2- 172.21.15.100:0/351934803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d8c0728a0 0x7f7d8c15f790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7d800097a0 tx=0x7f7d8002a210 comp rx=0 tx=0).stop 2024-09-11T22:29:41.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.688+0000 7f7d928a6640 1 -- 172.21.15.100:0/351934803 shutdown_connections 2024-09-11T22:29:41.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.688+0000 7f7d928a6640 1 --2- 172.21.15.100:0/351934803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d8c0728a0 0x7f7d8c15f790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:41.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.688+0000 7f7d928a6640 1 --2- 172.21.15.100:0/351934803 >> v2:172.21.15.167:3300/0 conn(0x7f7d8c15c660 0x7f7d8c1622f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:41.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.688+0000 7f7d928a6640 1 -- 172.21.15.100:0/351934803 >> 172.21.15.100:0/351934803 conn(0x7f7d8c0cbf70 msgr2=0x7f7d8c0cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:41.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.688+0000 7f7d928a6640 1 -- 172.21.15.100:0/351934803 shutdown_connections 2024-09-11T22:29:41.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.688+0000 7f7d928a6640 1 -- 172.21.15.100:0/351934803 wait complete. 2024-09-11T22:29:41.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.689+0000 7f7d928a6640 1 Processor -- start 2024-09-11T22:29:41.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.689+0000 7f7d928a6640 1 -- start start 2024-09-11T22:29:41.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.690+0000 7f7d928a6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d8c0728a0 0x7f7d8c159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:41.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.690+0000 7f7d928a6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d8c0c7cf0 0x7f7d8c1f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:41.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.690+0000 7f7d928a6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d8c15c660 0x7f7d8c1f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:41.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.690+0000 7f7d928a6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c162c80 con 0x7f7d8c0728a0 2024-09-11T22:29:41.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.690+0000 7f7d928a6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c15f300 con 0x7f7d8c15c660 2024-09-11T22:29:41.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.690+0000 7f7d928a6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7d8c162f60 con 0x7f7d8c0c7cf0 2024-09-11T22:29:41.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.690+0000 7f7d8bfff640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d8c0728a0 msgr2=0x7f7d8c159160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:29:41.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.690+0000 7f7d8bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d8c0728a0 0x7f7d8c159160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:29:41.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.690+0000 7f7d8b7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d8c0c7cf0 0x7f7d8c1f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:41.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.690+0000 7f7d8b7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d8c0c7cf0 0x7f7d8c1f49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:56796/0 (socket says 172.21.15.100:56796) 2024-09-11T22:29:41.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.690+0000 7f7d8b7fe640 1 -- 172.21.15.100:0/884790423 learned_addr learned my addr 172.21.15.100:0/884790423 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:41.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.690+0000 7f7d90e43640 1 --2- 172.21.15.100:0/884790423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d8c15c660 0x7f7d8c1f4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:41.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.690+0000 7f7d8b7fe640 1 -- 172.21.15.100:0/884790423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d8c15c660 msgr2=0x7f7d8c1f4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:41.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.690+0000 7f7d8b7fe640 1 --2- 172.21.15.100:0/884790423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d8c15c660 0x7f7d8c1f4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:41.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.690+0000 7f7d8b7fe640 1 -- 172.21.15.100:0/884790423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d8c0728a0 msgr2=0x7f7d8c159160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:29:41.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.690+0000 7f7d8b7fe640 1 --2- 172.21.15.100:0/884790423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d8c0728a0 0x7f7d8c159160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:41.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.690+0000 7f7d8b7fe640 1 -- 172.21.15.100:0/884790423 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c155110 con 0x7f7d8c0c7cf0 2024-09-11T22:29:41.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.690+0000 7f7d90e43640 1 --2- 172.21.15.100:0/884790423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d8c15c660 0x7f7d8c1f4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:41.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.690+0000 7f7d8b7fe640 1 --2- 172.21.15.100:0/884790423 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d8c0c7cf0 0x7f7d8c1f49d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7d80035040 tx=0x7f7d800046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:41.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.691+0000 7f7d88ff9640 1 -- 172.21.15.100:0/884790423 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80037040 con 0x7f7d8c0c7cf0 2024-09-11T22:29:41.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.691+0000 7f7d88ff9640 1 -- 172.21.15.100:0/884790423 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d80042070 con 0x7f7d8c0c7cf0 2024-09-11T22:29:41.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.691+0000 7f7d928a6640 1 -- 172.21.15.100:0/884790423 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d8c1553f0 con 0x7f7d8c0c7cf0 2024-09-11T22:29:41.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.691+0000 7f7d88ff9640 1 -- 172.21.15.100:0/884790423 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8003b930 con 0x7f7d8c0c7cf0 2024-09-11T22:29:41.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.691+0000 7f7d928a6640 1 -- 172.21.15.100:0/884790423 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d8c1559b0 con 0x7f7d8c0c7cf0 2024-09-11T22:29:41.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.692+0000 7f7d928a6640 1 -- 172.21.15.100:0/884790423 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d8c15ef90 con 0x7f7d8c0c7cf0 2024-09-11T22:29:41.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.692+0000 7f7d88ff9640 1 -- 172.21.15.100:0/884790423 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d8003bad0 con 0x7f7d8c0c7cf0 2024-09-11T22:29:41.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.693+0000 7f7d88ff9640 1 --2- 172.21.15.100:0/884790423 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7d7806bde0 0x7f7d7806e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:41.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.693+0000 7f7d8bfff640 1 --2- 172.21.15.100:0/884790423 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7d7806bde0 0x7f7d7806e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:41.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.693+0000 7f7d88ff9640 1 -- 172.21.15.100:0/884790423 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f7d800abb40 con 0x7f7d8c0c7cf0 2024-09-11T22:29:41.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.693+0000 7f7d8bfff640 1 --2- 172.21.15.100:0/884790423 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7d7806bde0 0x7f7d7806e2a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009450 tx=0x7f7d7c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:41.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.697+0000 7f7d88ff9640 1 -- 172.21.15.100:0/884790423 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7d8007a030 con 0x7f7d8c0c7cf0 2024-09-11T22:29:41.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.967+0000 7f7d928a6640 1 -- 172.21.15.100:0/884790423 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7d8c0c7ad0 con 0x7f7d8c0c7cf0 2024-09-11T22:29:41.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.968+0000 7f7d88ff9640 1 -- 172.21.15.100:0/884790423 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f7d80079930 con 0x7f7d8c0c7cf0 2024-09-11T22:29:41.969 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:29:41.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.970+0000 7f7d928a6640 1 -- 172.21.15.100:0/884790423 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7d7806bde0 msgr2=0x7f7d7806e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:41.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.970+0000 7f7d928a6640 1 --2- 172.21.15.100:0/884790423 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7d7806bde0 0x7f7d7806e2a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009450 tx=0x7f7d7c009190 comp rx=0 tx=0).stop 2024-09-11T22:29:41.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.970+0000 7f7d928a6640 1 -- 172.21.15.100:0/884790423 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d8c0c7cf0 msgr2=0x7f7d8c1f49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:41.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.970+0000 7f7d928a6640 1 --2- 172.21.15.100:0/884790423 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d8c0c7cf0 0x7f7d8c1f49d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7d80035040 tx=0x7f7d800046c0 comp rx=0 tx=0).stop 2024-09-11T22:29:41.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.970+0000 7f7d928a6640 1 -- 172.21.15.100:0/884790423 shutdown_connections 2024-09-11T22:29:41.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.970+0000 7f7d928a6640 1 --2- 172.21.15.100:0/884790423 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7d7806bde0 0x7f7d7806e2a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:41.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.970+0000 7f7d928a6640 1 --2- 172.21.15.100:0/884790423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d8c15c660 0x7f7d8c1f4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:41.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.970+0000 7f7d928a6640 1 --2- 172.21.15.100:0/884790423 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d8c0c7cf0 0x7f7d8c1f49d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:41.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.970+0000 7f7d928a6640 1 --2- 172.21.15.100:0/884790423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d8c0728a0 0x7f7d8c159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:41.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.970+0000 7f7d928a6640 1 -- 172.21.15.100:0/884790423 >> 172.21.15.100:0/884790423 conn(0x7f7d8c0cbf70 msgr2=0x7f7d8c15a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:41.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.970+0000 7f7d928a6640 1 -- 172.21.15.100:0/884790423 shutdown_connections 2024-09-11T22:29:41.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:41.970+0000 7f7d928a6640 1 -- 172.21.15.100:0/884790423 wait complete. 2024-09-11T22:29:44.986 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:29:45.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.095+0000 7ff0447af640 1 Processor -- start 2024-09-11T22:29:45.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.096+0000 7ff0447af640 1 -- start start 2024-09-11T22:29:45.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.097+0000 7ff0447af640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff03c0c64c0 0x7ff03c15b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:45.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.097+0000 7ff0447af640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff03c0c68a0 0x7ff03c06e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:45.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.097+0000 7ff0447af640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff03c15bb10 con 0x7ff03c0c7320 2024-09-11T22:29:45.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.097+0000 7ff0447af640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7ff03c06d4c0 con 0x7ff03c0c64c0 2024-09-11T22:29:45.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.097+0000 7ff0447af640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7ff03c06c6e0 con 0x7ff03c0c68a0 2024-09-11T22:29:45.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.097+0000 7ff04254b640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7ff03c0c64c0 msgr2=0x7ff03c15b5d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:29:45.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.097+0000 7ff04254b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff03c0c64c0 0x7ff03c15b5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:29:45.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.097+0000 7ff041d4a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff03c0c68a0 0x7ff03c06e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:45.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.097+0000 7ff041d4a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff03c0c68a0 0x7ff03c06e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:50910/0 (socket says 172.21.15.100:50910) 2024-09-11T22:29:45.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.097+0000 7ff041d4a640 1 -- 172.21.15.100:0/541253482 learned_addr learned my addr 172.21.15.100:0/541253482 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:45.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.098+0000 7ff041d4a640 1 -- 172.21.15.100:0/541253482 >> v2:172.21.15.100:3300/0 conn(0x7ff03c0c64c0 msgr2=0x7ff03c15b5d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:29:45.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.098+0000 7ff041d4a640 1 --2- 172.21.15.100:0/541253482 >> v2:172.21.15.100:3300/0 conn(0x7ff03c0c64c0 0x7ff03c15b5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:45.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.098+0000 7ff041d4a640 1 -- 172.21.15.100:0/541253482 >> v1:172.21.15.167:6789/0 conn(0x7ff03c0c7320 legacy=0x7ff03c1513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:45.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.098+0000 7ff041d4a640 1 -- 172.21.15.100:0/541253482 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff03c0c49e0 con 0x7ff03c0c68a0 2024-09-11T22:29:45.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.099+0000 7ff041d4a640 1 --2- 172.21.15.100:0/541253482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff03c0c68a0 0x7ff03c06e670 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff03c155240 tx=0x7ff02c02a320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d5e2a710cf27437 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:45.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.099+0000 7ff041549640 1 -- 172.21.15.100:0/541253482 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02c037070 con 0x7ff03c0c68a0 2024-09-11T22:29:45.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.099+0000 7ff041549640 1 -- 172.21.15.100:0/541253482 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff02c032640 con 0x7ff03c0c68a0 2024-09-11T22:29:45.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.099+0000 7ff041549640 1 -- 172.21.15.100:0/541253482 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02c032a10 con 0x7ff03c0c68a0 2024-09-11T22:29:45.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.099+0000 7ff0447af640 1 -- 172.21.15.100:0/541253482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff03c0c68a0 msgr2=0x7ff03c06e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:45.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.099+0000 7ff0447af640 1 --2- 172.21.15.100:0/541253482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff03c0c68a0 0x7ff03c06e670 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff03c155240 tx=0x7ff02c02a320 comp rx=0 tx=0).stop 2024-09-11T22:29:45.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.099+0000 7ff0447af640 1 -- 172.21.15.100:0/541253482 shutdown_connections 2024-09-11T22:29:45.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.100+0000 7ff0447af640 1 --2- 172.21.15.100:0/541253482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff03c0c68a0 0x7ff03c06e670 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:45.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.100+0000 7ff0447af640 1 --2- 172.21.15.100:0/541253482 >> v2:172.21.15.100:3300/0 conn(0x7ff03c0c64c0 0x7ff03c15b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:45.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.100+0000 7ff0447af640 1 -- 172.21.15.100:0/541253482 >> 172.21.15.100:0/541253482 conn(0x7ff03c0cd110 msgr2=0x7ff03c0cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:45.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.100+0000 7ff0447af640 1 -- 172.21.15.100:0/541253482 shutdown_connections 2024-09-11T22:29:45.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.100+0000 7ff0447af640 1 -- 172.21.15.100:0/541253482 wait complete. 2024-09-11T22:29:45.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.101+0000 7ff0447af640 1 Processor -- start 2024-09-11T22:29:45.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.101+0000 7ff0447af640 1 -- start start 2024-09-11T22:29:45.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.102+0000 7ff0447af640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff03c0c64c0 0x7ff03c1448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:45.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.102+0000 7ff0447af640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff03c0c68a0 0x7ff03c143a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:45.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.102+0000 7ff0447af640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff03c0c7320 0x7ff03c143fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:45.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.102+0000 7ff0447af640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff03c06c370 con 0x7ff03c0c7320 2024-09-11T22:29:45.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.102+0000 7ff0447af640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff03c06c090 con 0x7ff03c0c64c0 2024-09-11T22:29:45.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.102+0000 7ff0447af640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff03c06cb70 con 0x7ff03c0c68a0 2024-09-11T22:29:45.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.102+0000 7ff042d4c640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff03c0c7320 msgr2=0x7ff03c143fb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:29:45.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.102+0000 7ff042d4c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff03c0c7320 0x7ff03c143fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:29:45.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.102+0000 7ff04254b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff03c0c64c0 0x7ff03c1448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:45.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.102+0000 7ff04254b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff03c0c64c0 0x7ff03c1448b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:50926/0 (socket says 172.21.15.100:50926) 2024-09-11T22:29:45.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.102+0000 7ff04254b640 1 -- 172.21.15.100:0/835323149 learned_addr learned my addr 172.21.15.100:0/835323149 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:45.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.102+0000 7ff041d4a640 1 --2- 172.21.15.100:0/835323149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff03c0c68a0 0x7ff03c143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:45.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.102+0000 7ff04254b640 1 -- 172.21.15.100:0/835323149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff03c0c68a0 msgr2=0x7ff03c143a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:45.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.102+0000 7ff04254b640 1 --2- 172.21.15.100:0/835323149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff03c0c68a0 0x7ff03c143a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:45.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.102+0000 7ff04254b640 1 -- 172.21.15.100:0/835323149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff03c0c7320 msgr2=0x7ff03c143fb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:29:45.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.102+0000 7ff04254b640 1 --2- 172.21.15.100:0/835323149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff03c0c7320 0x7ff03c143fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:45.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.102+0000 7ff04254b640 1 -- 172.21.15.100:0/835323149 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff03c150cd0 con 0x7ff03c0c64c0 2024-09-11T22:29:45.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.102+0000 7ff04254b640 1 --2- 172.21.15.100:0/835323149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff03c0c64c0 0x7ff03c1448b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff03800b550 tx=0x7ff03800ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:45.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.103+0000 7ff032ffd640 1 -- 172.21.15.100:0/835323149 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff038013020 con 0x7ff03c0c64c0 2024-09-11T22:29:45.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.103+0000 7ff032ffd640 1 -- 172.21.15.100:0/835323149 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff038003de0 con 0x7ff03c0c64c0 2024-09-11T22:29:45.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.103+0000 7ff032ffd640 1 -- 172.21.15.100:0/835323149 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0380052b0 con 0x7ff03c0c64c0 2024-09-11T22:29:45.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.103+0000 7ff0447af640 1 -- 172.21.15.100:0/835323149 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff03c0cbfd0 con 0x7ff03c0c64c0 2024-09-11T22:29:45.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.103+0000 7ff0447af640 1 -- 172.21.15.100:0/835323149 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff03c13f680 con 0x7ff03c0c64c0 2024-09-11T22:29:45.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.104+0000 7ff0447af640 1 -- 172.21.15.100:0/835323149 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff03c0cc9d0 con 0x7ff03c0c64c0 2024-09-11T22:29:45.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.104+0000 7ff032ffd640 1 -- 172.21.15.100:0/835323149 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff038016020 con 0x7ff03c0c64c0 2024-09-11T22:29:45.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.105+0000 7ff032ffd640 1 --2- 172.21.15.100:0/835323149 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff02006bde0 0x7ff02006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:45.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.105+0000 7ff032ffd640 1 -- 172.21.15.100:0/835323149 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7ff03808afe0 con 0x7ff03c0c64c0 2024-09-11T22:29:45.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.105+0000 7ff041d4a640 1 --2- 172.21.15.100:0/835323149 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff02006bde0 0x7ff02006e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:45.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.105+0000 7ff041d4a640 1 --2- 172.21.15.100:0/835323149 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff02006bde0 0x7ff02006e2a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff02c034000 tx=0x7ff02c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:45.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.109+0000 7ff032ffd640 1 -- 172.21.15.100:0/835323149 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff03801d020 con 0x7ff03c0c64c0 2024-09-11T22:29:45.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.381+0000 7ff0447af640 1 -- 172.21.15.100:0/835323149 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff03c0c4610 con 0x7ff03c0c64c0 2024-09-11T22:29:45.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.381+0000 7ff032ffd640 1 -- 172.21.15.100:0/835323149 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7ff038059570 con 0x7ff03c0c64c0 2024-09-11T22:29:45.383 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":66,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:29:45.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.383+0000 7ff0447af640 1 -- 172.21.15.100:0/835323149 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff02006bde0 msgr2=0x7ff02006e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:45.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.383+0000 7ff0447af640 1 --2- 172.21.15.100:0/835323149 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff02006bde0 0x7ff02006e2a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff02c034000 tx=0x7ff02c02e000 comp rx=0 tx=0).stop 2024-09-11T22:29:45.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.383+0000 7ff0447af640 1 -- 172.21.15.100:0/835323149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff03c0c64c0 msgr2=0x7ff03c1448b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:45.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.383+0000 7ff0447af640 1 --2- 172.21.15.100:0/835323149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff03c0c64c0 0x7ff03c1448b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff03800b550 tx=0x7ff03800ba10 comp rx=0 tx=0).stop 2024-09-11T22:29:45.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.383+0000 7ff0447af640 1 -- 172.21.15.100:0/835323149 shutdown_connections 2024-09-11T22:29:45.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.383+0000 7ff0447af640 1 --2- 172.21.15.100:0/835323149 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff02006bde0 0x7ff02006e2a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:45.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.383+0000 7ff0447af640 1 --2- 172.21.15.100:0/835323149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff03c0c7320 0x7ff03c143fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:45.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.383+0000 7ff0447af640 1 --2- 172.21.15.100:0/835323149 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff03c0c68a0 0x7ff03c143a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:45.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.383+0000 7ff0447af640 1 --2- 172.21.15.100:0/835323149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff03c0c64c0 0x7ff03c1448b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:45.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.384+0000 7ff0447af640 1 -- 172.21.15.100:0/835323149 >> 172.21.15.100:0/835323149 conn(0x7ff03c0cd110 msgr2=0x7ff03c06e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:45.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.384+0000 7ff0447af640 1 -- 172.21.15.100:0/835323149 shutdown_connections 2024-09-11T22:29:45.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:45.384+0000 7ff0447af640 1 -- 172.21.15.100:0/835323149 wait complete. 2024-09-11T22:29:48.396 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:29:48.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.519+0000 7f47bcc45640 1 Processor -- start 2024-09-11T22:29:48.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.520+0000 7f47bcc45640 1 -- start start 2024-09-11T22:29:48.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.520+0000 7f47bcc45640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 0x7f47b80cb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.520+0000 7f47bcc45640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f47b80b3190 0x7f47b815e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.520+0000 7f47bcc45640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f47b815a7e0 0x7f47b815e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:48.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.520+0000 7f47bcc45640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f47b815e000 con 0x7f47b80b3190 2024-09-11T22:29:48.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.520+0000 7f47bcc45640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f47b815ac90 con 0x7f47b815a7e0 2024-09-11T22:29:48.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.520+0000 7f47bcc45640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f47b815af70 con 0x7f47b8154c20 2024-09-11T22:29:48.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.520+0000 7f47affff640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f47b80b3190 msgr2=0x7f47b815e490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:29:48.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.520+0000 7f47affff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f47b80b3190 0x7f47b815e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:29:48.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.521+0000 7f47b6d9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f47b815a7e0 0x7f47b815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.521+0000 7f47b659c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 0x7f47b80cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.521+0000 7f47b659c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 0x7f47b80cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:39550/0 (socket says 172.21.15.100:39550) 2024-09-11T22:29:48.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.521+0000 7f47b659c640 1 -- 172.21.15.100:0/1251513626 learned_addr learned my addr 172.21.15.100:0/1251513626 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:48.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.521+0000 7f47b659c640 1 -- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 msgr2=0x7f47b80cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:29:48.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.521+0000 7f47b659c640 1 -- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 msgr2=0x7f47b80cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:29:48.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.521+0000 7f47b6d9d640 1 -- 172.21.15.100:0/1251513626 >> v2:172.21.15.167:3300/0 conn(0x7f47b815a7e0 msgr2=0x7f47b815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:29:48.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.521+0000 7f47b659c640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 0x7f47b80cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:29:48.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.521+0000 7f47b6d9d640 1 -- 172.21.15.100:0/1251513626 >> v2:172.21.15.167:3300/0 conn(0x7f47b815a7e0 msgr2=0x7f47b815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:29:48.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.521+0000 7f47b6d9d640 1 --2- 172.21.15.100:0/1251513626 >> v2:172.21.15.167:3300/0 conn(0x7f47b815a7e0 0x7f47b815e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:29:48.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.521+0000 7f47b659c640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 0x7f47b80cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:29:48.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.521+0000 7f47b6d9d640 1 --2- 172.21.15.100:0/1251513626 >> v2:172.21.15.167:3300/0 conn(0x7f47b815a7e0 0x7f47b815e9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:29:48.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.721+0000 7f47affff640 1 -- 172.21.15.100:0/1251513626 >> v2:172.21.15.100:3300/0 conn(0x7f47b80b3190 msgr2=0x7f47b815e490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:29:48.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.721+0000 7f47affff640 1 --2- 172.21.15.100:0/1251513626 >> v2:172.21.15.100:3300/0 conn(0x7f47b80b3190 0x7f47b815e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:29:48.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.722+0000 7f47b6d9d640 1 --2- 172.21.15.100:0/1251513626 >> v2:172.21.15.167:3300/0 conn(0x7f47b815a7e0 0x7f47b815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.722+0000 7f47b659c640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 0x7f47b80cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:48.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.722+0000 7f47b6d9d640 1 -- 172.21.15.100:0/1251513626 >> v2:172.21.15.167:3300/0 conn(0x7f47b815a7e0 msgr2=0x7f47b815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:29:48.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.722+0000 7f47b659c640 1 -- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 msgr2=0x7f47b80cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:29:48.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.722+0000 7f47b6d9d640 1 -- 172.21.15.100:0/1251513626 >> v2:172.21.15.167:3300/0 conn(0x7f47b815a7e0 msgr2=0x7f47b815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:29:48.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.722+0000 7f47b659c640 1 -- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 msgr2=0x7f47b80cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:29:48.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.722+0000 7f47b6d9d640 1 --2- 172.21.15.100:0/1251513626 >> v2:172.21.15.167:3300/0 conn(0x7f47b815a7e0 0x7f47b815e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:29:48.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.722+0000 7f47b659c640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 0x7f47b80cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:29:48.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.722+0000 7f47b659c640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 0x7f47b80cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:29:48.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:48.722+0000 7f47b6d9d640 1 --2- 172.21.15.100:0/1251513626 >> v2:172.21.15.167:3300/0 conn(0x7f47b815a7e0 0x7f47b815e9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:29:49.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.122+0000 7f47affff640 1 -- 172.21.15.100:0/1251513626 >> v2:172.21.15.100:3300/0 conn(0x7f47b80b3190 msgr2=0x7f47b815e490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:29:49.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.122+0000 7f47affff640 1 --2- 172.21.15.100:0/1251513626 >> v2:172.21.15.100:3300/0 conn(0x7f47b80b3190 0x7f47b815e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:29:49.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.123+0000 7f47b659c640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 0x7f47b80cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:49.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.123+0000 7f47b6d9d640 1 --2- 172.21.15.100:0/1251513626 >> v2:172.21.15.167:3300/0 conn(0x7f47b815a7e0 0x7f47b815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:49.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.123+0000 7f47b6d9d640 1 -- 172.21.15.100:0/1251513626 >> v2:172.21.15.167:3300/0 conn(0x7f47b815a7e0 msgr2=0x7f47b815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:29:49.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.123+0000 7f47b6d9d640 1 -- 172.21.15.100:0/1251513626 >> v2:172.21.15.167:3300/0 conn(0x7f47b815a7e0 msgr2=0x7f47b815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:29:49.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.123+0000 7f47b6d9d640 1 --2- 172.21.15.100:0/1251513626 >> v2:172.21.15.167:3300/0 conn(0x7f47b815a7e0 0x7f47b815e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:29:49.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.123+0000 7f47b6d9d640 1 --2- 172.21.15.100:0/1251513626 >> v2:172.21.15.167:3300/0 conn(0x7f47b815a7e0 0x7f47b815e9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:29:49.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.123+0000 7f47b659c640 1 -- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 msgr2=0x7f47b80cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:29:49.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.123+0000 7f47b659c640 1 -- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 msgr2=0x7f47b80cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:29:49.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.123+0000 7f47b659c640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 0x7f47b80cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:29:49.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.123+0000 7f47b659c640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 0x7f47b80cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:29:49.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.923+0000 7f47affff640 1 -- 172.21.15.100:0/1251513626 >> v2:172.21.15.100:3300/0 conn(0x7f47b80b3190 msgr2=0x7f47b815e490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:29:49.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.923+0000 7f47affff640 1 --2- 172.21.15.100:0/1251513626 >> v2:172.21.15.100:3300/0 conn(0x7f47b80b3190 0x7f47b815e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:29:49.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.924+0000 7f47b6d9d640 1 --2- 172.21.15.100:0/1251513626 >> v2:172.21.15.167:3300/0 conn(0x7f47b815a7e0 0x7f47b815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:49.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.924+0000 7f47b659c640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 0x7f47b80cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:49.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.924+0000 7f47b6d9d640 1 -- 172.21.15.100:0/1251513626 >> v2:172.21.15.167:3300/0 conn(0x7f47b815a7e0 msgr2=0x7f47b815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:29:49.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.924+0000 7f47b6d9d640 1 -- 172.21.15.100:0/1251513626 >> v2:172.21.15.167:3300/0 conn(0x7f47b815a7e0 msgr2=0x7f47b815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:29:49.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.924+0000 7f47b6d9d640 1 --2- 172.21.15.100:0/1251513626 >> v2:172.21.15.167:3300/0 conn(0x7f47b815a7e0 0x7f47b815e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:29:49.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.924+0000 7f47b6d9d640 1 --2- 172.21.15.100:0/1251513626 >> v2:172.21.15.167:3300/0 conn(0x7f47b815a7e0 0x7f47b815e9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:29:49.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.924+0000 7f47b659c640 1 -- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 msgr2=0x7f47b80cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:29:49.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.924+0000 7f47b659c640 1 -- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 msgr2=0x7f47b80cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:29:49.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.924+0000 7f47b659c640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 0x7f47b80cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:29:49.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:49.924+0000 7f47b659c640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 0x7f47b80cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:29:51.347 INFO:tasks.workunit.client.0.smithi100.stdout:fs setup took 435 secs 2024-09-11T22:29:51.432 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:29:51.434 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:29:51.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:51.521+0000 7f47b4d99640 1 -- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 msgr2=0x7f47b80cb120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:29:51.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:51.521+0000 7f47b4d99640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b8154c20 0x7f47b80cb120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:51.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:51.521+0000 7f47b4d99640 1 -- 172.21.15.100:0/1251513626 >> v2:172.21.15.167:3300/0 conn(0x7f47b815a7e0 msgr2=0x7f47b815e9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:29:51.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:51.521+0000 7f47b4d99640 1 --2- 172.21.15.100:0/1251513626 >> v2:172.21.15.167:3300/0 conn(0x7f47b815a7e0 0x7f47b815e9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:51.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:51.521+0000 7f47b4d99640 1 -- 172.21.15.100:0/1251513626 >> v2:172.21.15.100:3300/0 conn(0x7f47b80b3190 msgr2=0x7f47b815e490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:29:51.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:51.521+0000 7f47b4d99640 1 --2- 172.21.15.100:0/1251513626 >> v2:172.21.15.100:3300/0 conn(0x7f47b80b3190 0x7f47b815e490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:51.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:51.521+0000 7f47b4d99640 1 -- 172.21.15.100:0/1251513626 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47b815b250 con 0x7f4798007320 2024-09-11T22:29:51.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:51.521+0000 7f47b4d99640 1 -- 172.21.15.100:0/1251513626 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f479800c090 con 0x7f4798003670 2024-09-11T22:29:51.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:51.521+0000 7f47affff640 1 -- 172.21.15.100:0/1251513626 >> v1:172.21.15.100:6789/0 conn(0x7f4798007320 legacy=0x7f47980097e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:29:51.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:51.722+0000 7f47affff640 1 -- 172.21.15.100:0/1251513626 >> v1:172.21.15.100:6789/0 conn(0x7f4798007320 legacy=0x7f47980097e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:29:52.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.123+0000 7f47affff640 1 -- 172.21.15.100:0/1251513626 >> v1:172.21.15.100:6789/0 conn(0x7f4798007320 legacy=0x7f47980097e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:29:52.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.496+0000 7f47b5d9b640 1 -- 172.21.15.100:0/1251513626 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 266360541 0 0) 0x7f479800c090 con 0x7f4798003670 2024-09-11T22:29:52.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.496+0000 7f47b5d9b640 1 -- 172.21.15.100:0/1251513626 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47a4003520 con 0x7f4798003670 2024-09-11T22:29:52.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.500+0000 7f47b5d9b640 1 -- 172.21.15.100:0/1251513626 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2281557953 0 0) 0x7f47a4003520 con 0x7f4798003670 2024-09-11T22:29:52.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.500+0000 7f47b5d9b640 1 -- 172.21.15.100:0/1251513626 >> v1:172.21.15.100:6789/0 conn(0x7f4798007320 legacy=0x7f47980097e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:29:52.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.500+0000 7f47b5d9b640 1 -- 172.21.15.100:0/1251513626 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f479800d390 con 0x7f4798003670 2024-09-11T22:29:52.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.500+0000 7f47b5d9b640 1 -- 172.21.15.100:0/1251513626 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f47a800f040 con 0x7f4798003670 2024-09-11T22:29:52.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.500+0000 7f47b5d9b640 1 -- 172.21.15.100:0/1251513626 >> v1:172.21.15.167:6789/0 conn(0x7f4798003670 legacy=0x7f4798005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:52.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.500+0000 7f47b6d9d640 1 -- 172.21.15.100:0/1251513626 reap_dead start 2024-09-11T22:29:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.500+0000 7f47b5d9b640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a40039b0 0x7f47a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.500+0000 7f47b5d9b640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47a4004800 0x7f47a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.500+0000 7f47b5d9b640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47a40052e0 0x7f47a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.500+0000 7f47b5d9b640 1 -- 172.21.15.100:0/1251513626 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f47a400c1d0 con 0x7f47a40039b0 2024-09-11T22:29:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.500+0000 7f47b5d9b640 1 -- 172.21.15.100:0/1251513626 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f47a400c380 con 0x7f47a40052e0 2024-09-11T22:29:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.500+0000 7f47b5d9b640 1 -- 172.21.15.100:0/1251513626 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f47a400c580 con 0x7f47a4004800 2024-09-11T22:29:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.500+0000 7f47b659c640 1 -- 172.21.15.100:0/1251513626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a40039b0 msgr2=0x7f47a4003d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:29:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.500+0000 7f47b659c640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a40039b0 0x7f47a4003d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:29:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.501+0000 7f47b6d9d640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47a40052e0 0x7f47a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.501+0000 7f47affff640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47a4004800 0x7f47a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.501+0000 7f47b6d9d640 1 -- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47a4004800 msgr2=0x7f47a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:29:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.501+0000 7f47b6d9d640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47a4004800 0x7f47a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.501+0000 7f47b6d9d640 1 -- 172.21.15.100:0/1251513626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a40039b0 msgr2=0x7f47a4003d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:29:52.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.501+0000 7f47b6d9d640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a40039b0 0x7f47a4003d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.501+0000 7f47b6d9d640 1 -- 172.21.15.100:0/1251513626 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a4003520 con 0x7f47a40052e0 2024-09-11T22:29:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.502+0000 7f47b6d9d640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47a40052e0 0x7f47a400b9c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f47b806d950 tx=0x7f47a4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b587aaef65b2bf20 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.502+0000 7f47b5d9b640 1 -- 172.21.15.100:0/1251513626 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0031070 con 0x7f47a40052e0 2024-09-11T22:29:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.503+0000 7f47b5d9b640 1 -- 172.21.15.100:0/1251513626 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b002b650 con 0x7f47a40052e0 2024-09-11T22:29:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.503+0000 7f47b5d9b640 1 -- 172.21.15.100:0/1251513626 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0003e60 con 0x7f47a40052e0 2024-09-11T22:29:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.503+0000 7f47bcc45640 1 -- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47a40052e0 msgr2=0x7f47a400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.503+0000 7f47bcc45640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47a40052e0 0x7f47a400b9c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f47b806d950 tx=0x7f47a4005830 comp rx=0 tx=0).stop 2024-09-11T22:29:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.504+0000 7f47bcc45640 1 -- 172.21.15.100:0/1251513626 shutdown_connections 2024-09-11T22:29:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.504+0000 7f47bcc45640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47a40052e0 0x7f47a400b9c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.504+0000 7f47bcc45640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47a4004800 0x7f47a4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.504+0000 7f47bcc45640 1 --2- 172.21.15.100:0/1251513626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a40039b0 0x7f47a4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.504+0000 7f47bcc45640 1 -- 172.21.15.100:0/1251513626 >> 172.21.15.100:0/1251513626 conn(0x7f47b8067d40 msgr2=0x7f47b806d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:52.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.504+0000 7f47bcc45640 1 -- 172.21.15.100:0/1251513626 shutdown_connections 2024-09-11T22:29:52.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.504+0000 7f47bcc45640 1 -- 172.21.15.100:0/1251513626 wait complete. 2024-09-11T22:29:52.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.505+0000 7f47bcc45640 1 Processor -- start 2024-09-11T22:29:52.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.506+0000 7f47bcc45640 1 -- start start 2024-09-11T22:29:52.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.506+0000 7f47bcc45640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a40039b0 0x7f47b80cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.506+0000 7f47bcc45640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47a4004800 0x7f47b8152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.506+0000 7f47bcc45640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47a40052e0 0x7f47b815cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.506+0000 7f47bcc45640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f47b80cb2a0 con 0x7f47a40039b0 2024-09-11T22:29:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.506+0000 7f47bcc45640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f47b80cb120 con 0x7f47a4004800 2024-09-11T22:29:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.506+0000 7f47bcc45640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f47b80cb420 con 0x7f47a40052e0 2024-09-11T22:29:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.506+0000 7f47b659c640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a40039b0 msgr2=0x7f47b80cf4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:29:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.506+0000 7f47b659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a40039b0 0x7f47b80cf4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:29:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.507+0000 7f47affff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47a4004800 0x7f47b8152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.507+0000 7f47affff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47a4004800 0x7f47b8152440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:50812/0 (socket says 172.21.15.100:50812) 2024-09-11T22:29:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.507+0000 7f47affff640 1 -- 172.21.15.100:0/3875684900 learned_addr learned my addr 172.21.15.100:0/3875684900 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.507+0000 7f47b6d9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47a40052e0 0x7f47b815cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.507+0000 7f47affff640 1 -- 172.21.15.100:0/3875684900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47a40052e0 msgr2=0x7f47b815cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.507+0000 7f47affff640 1 --2- 172.21.15.100:0/3875684900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47a40052e0 0x7f47b815cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.507+0000 7f47affff640 1 -- 172.21.15.100:0/3875684900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a40039b0 msgr2=0x7f47b80cf4a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:29:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.507+0000 7f47affff640 1 --2- 172.21.15.100:0/3875684900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a40039b0 0x7f47b80cf4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.507+0000 7f47affff640 1 -- 172.21.15.100:0/3875684900 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b80b57a0 con 0x7f47a4004800 2024-09-11T22:29:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.507+0000 7f47affff640 1 --2- 172.21.15.100:0/3875684900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47a4004800 0x7f47b8152440 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009fd0 tx=0x7f47a000ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:52.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.507+0000 7f47aeffd640 1 -- 172.21.15.100:0/3875684900 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a000cd70 con 0x7f47a4004800 2024-09-11T22:29:52.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.507+0000 7f47aeffd640 1 -- 172.21.15.100:0/3875684900 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a000ee50 con 0x7f47a4004800 2024-09-11T22:29:52.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.507+0000 7f47aeffd640 1 -- 172.21.15.100:0/3875684900 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a0017680 con 0x7f47a4004800 2024-09-11T22:29:52.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.507+0000 7f47bcc45640 1 -- 172.21.15.100:0/3875684900 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b80b6020 con 0x7f47a4004800 2024-09-11T22:29:52.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.507+0000 7f47bcc45640 1 -- 172.21.15.100:0/3875684900 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b81f0770 con 0x7f47a4004800 2024-09-11T22:29:52.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.509+0000 7f47bcc45640 1 -- 172.21.15.100:0/3875684900 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47b81f1230 con 0x7f47a4004800 2024-09-11T22:29:52.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.509+0000 7f47aeffd640 1 -- 172.21.15.100:0/3875684900 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47a000b3a0 con 0x7f47a4004800 2024-09-11T22:29:52.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.509+0000 7f47aeffd640 1 --2- 172.21.15.100:0/3875684900 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f479806c5b0 0x7f479806ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.510+0000 7f47aeffd640 1 -- 172.21.15.100:0/3875684900 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f47a008b780 con 0x7f47a4004800 2024-09-11T22:29:52.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.510+0000 7f47b659c640 1 --2- 172.21.15.100:0/3875684900 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f479806c5b0 0x7f479806ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.510+0000 7f47b659c640 1 --2- 172.21.15.100:0/3875684900 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f479806c5b0 0x7f479806ea70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009100 tx=0x7f47a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.514+0000 7f47aeffd640 1 -- 172.21.15.100:0/3875684900 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f47a001c060 con 0x7f47a4004800 2024-09-11T22:29:52.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.746+0000 7f47bcc45640 1 -- 172.21.15.100:0/3875684900 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f47b80cb850 con 0x7f47a4004800 2024-09-11T22:29:52.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.747+0000 7f47aeffd640 1 -- 172.21.15.100:0/3875684900 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7f47a0059c70 con 0x7f47a4004800 2024-09-11T22:29:52.748 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":68,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:29:52.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.749+0000 7f47bcc45640 1 -- 172.21.15.100:0/3875684900 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f479806c5b0 msgr2=0x7f479806ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:52.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.749+0000 7f47bcc45640 1 --2- 172.21.15.100:0/3875684900 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f479806c5b0 0x7f479806ea70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009100 tx=0x7f47a8008040 comp rx=0 tx=0).stop 2024-09-11T22:29:52.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.749+0000 7f47bcc45640 1 -- 172.21.15.100:0/3875684900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47a4004800 msgr2=0x7f47b8152440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:52.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.749+0000 7f47bcc45640 1 --2- 172.21.15.100:0/3875684900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47a4004800 0x7f47b8152440 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009fd0 tx=0x7f47a000ec00 comp rx=0 tx=0).stop 2024-09-11T22:29:52.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.749+0000 7f47bcc45640 1 -- 172.21.15.100:0/3875684900 shutdown_connections 2024-09-11T22:29:52.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.749+0000 7f47bcc45640 1 --2- 172.21.15.100:0/3875684900 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f479806c5b0 0x7f479806ea70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.749+0000 7f47bcc45640 1 --2- 172.21.15.100:0/3875684900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47a40052e0 0x7f47b815cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.749+0000 7f47bcc45640 1 --2- 172.21.15.100:0/3875684900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47a4004800 0x7f47b8152440 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.749+0000 7f47bcc45640 1 --2- 172.21.15.100:0/3875684900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a40039b0 0x7f47b80cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.749+0000 7f47bcc45640 1 -- 172.21.15.100:0/3875684900 >> 172.21.15.100:0/3875684900 conn(0x7f47b8067d40 msgr2=0x7f47b80c6390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:52.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.749+0000 7f47bcc45640 1 -- 172.21.15.100:0/3875684900 shutdown_connections 2024-09-11T22:29:52.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.749+0000 7f47bcc45640 1 -- 172.21.15.100:0/3875684900 wait complete. 2024-09-11T22:29:52.761 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-11T22:29:52.761 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-11T22:29:52.761 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:29:52.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.860+0000 7f03468dd640 1 Processor -- start 2024-09-11T22:29:52.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.860+0000 7f03468dd640 1 -- start start 2024-09-11T22:29:52.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.861+0000 7f03468dd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0340154d70 0x7f03400714c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.861+0000 7f03468dd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f03400c3230 0x7f03400c9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.861+0000 7f03468dd640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03400ca5c0 con 0x7f0340071a00 2024-09-11T22:29:52.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.861+0000 7f03468dd640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f03400c43b0 con 0x7f03400c3230 2024-09-11T22:29:52.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.861+0000 7f03468dd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f03400ae930 con 0x7f0340154d70 2024-09-11T22:29:52.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.861+0000 7f033f7fe640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f03400c3230 msgr2=0x7f03400c9860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:29:52.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.861+0000 7f0344e7a640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f0340071a00 legacy=0x7f034015ad20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:29:52.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.861+0000 7f033f7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f03400c3230 0x7f03400c9860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:29:52.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.861+0000 7f033ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0340154d70 0x7f03400714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.861+0000 7f033ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0340154d70 0x7f03400714c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:40200/0 (socket says 172.21.15.100:40200) 2024-09-11T22:29:52.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.861+0000 7f033ffff640 1 -- 172.21.15.100:0/3098599773 learned_addr learned my addr 172.21.15.100:0/3098599773 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:52.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.861+0000 7f033ffff640 1 -- 172.21.15.100:0/3098599773 >> v2:172.21.15.100:3300/0 conn(0x7f03400c3230 msgr2=0x7f03400c9860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:29:52.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.861+0000 7f033ffff640 1 --2- 172.21.15.100:0/3098599773 >> v2:172.21.15.100:3300/0 conn(0x7f03400c3230 0x7f03400c9860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.861+0000 7f033ffff640 1 -- 172.21.15.100:0/3098599773 >> v1:172.21.15.100:6789/0 conn(0x7f0340071a00 legacy=0x7f034015ad20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:29:52.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.861+0000 7f033ffff640 1 -- 172.21.15.100:0/3098599773 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03400c3830 con 0x7f0340154d70 2024-09-11T22:29:52.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.862+0000 7f033ffff640 1 --2- 172.21.15.100:0/3098599773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0340154d70 0x7f03400714c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0330009870 tx=0x7f033002a2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9aeef56910d2dbf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:52.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.863+0000 7f033effd640 1 -- 172.21.15.100:0/3098599773 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330037070 con 0x7f0340154d70 2024-09-11T22:29:52.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.863+0000 7f033effd640 1 -- 172.21.15.100:0/3098599773 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0330032440 con 0x7f0340154d70 2024-09-11T22:29:52.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.863+0000 7f033effd640 1 -- 172.21.15.100:0/3098599773 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330032810 con 0x7f0340154d70 2024-09-11T22:29:52.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.863+0000 7f03468dd640 1 -- 172.21.15.100:0/3098599773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0340154d70 msgr2=0x7f03400714c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:52.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.863+0000 7f03468dd640 1 --2- 172.21.15.100:0/3098599773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0340154d70 0x7f03400714c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0330009870 tx=0x7f033002a2c0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.863+0000 7f03468dd640 1 -- 172.21.15.100:0/3098599773 shutdown_connections 2024-09-11T22:29:52.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.863+0000 7f03468dd640 1 --2- 172.21.15.100:0/3098599773 >> v2:172.21.15.100:3300/0 conn(0x7f03400c3230 0x7f03400c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.863+0000 7f03468dd640 1 --2- 172.21.15.100:0/3098599773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0340154d70 0x7f03400714c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.863+0000 7f03468dd640 1 -- 172.21.15.100:0/3098599773 >> 172.21.15.100:0/3098599773 conn(0x7f034006f4c0 msgr2=0x7f034006f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:52.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.863+0000 7f03468dd640 1 -- 172.21.15.100:0/3098599773 shutdown_connections 2024-09-11T22:29:52.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.863+0000 7f03468dd640 1 -- 172.21.15.100:0/3098599773 wait complete. 2024-09-11T22:29:52.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.864+0000 7f03468dd640 1 Processor -- start 2024-09-11T22:29:52.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.865+0000 7f03468dd640 1 -- start start 2024-09-11T22:29:52.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.865+0000 7f03468dd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0340071a00 0x7f03400c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.865+0000 7f03468dd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03400c3230 0x7f03401f4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.865+0000 7f03468dd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0340154d70 0x7f034014b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.865+0000 7f03468dd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f03400c40d0 con 0x7f03400c3230 2024-09-11T22:29:52.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.865+0000 7f03468dd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f03400c3df0 con 0x7f0340071a00 2024-09-11T22:29:52.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.865+0000 7f03468dd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f034015b430 con 0x7f0340154d70 2024-09-11T22:29:52.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.865+0000 7f033f7fe640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03400c3230 msgr2=0x7f03401f4580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:29:52.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.865+0000 7f033f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03400c3230 0x7f03401f4580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:29:52.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.865+0000 7f033ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0340071a00 0x7f03400c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.865+0000 7f0344e7a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0340154d70 0x7f034014b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.866+0000 7f0344e7a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0340154d70 0x7f034014b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:40214/0 (socket says 172.21.15.100:40214) 2024-09-11T22:29:52.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.866+0000 7f0344e7a640 1 -- 172.21.15.100:0/687004031 learned_addr learned my addr 172.21.15.100:0/687004031 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.866+0000 7f0344e7a640 1 -- 172.21.15.100:0/687004031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0340071a00 msgr2=0x7f03400c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.866+0000 7f0344e7a640 1 --2- 172.21.15.100:0/687004031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0340071a00 0x7f03400c6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.866+0000 7f0344e7a640 1 -- 172.21.15.100:0/687004031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03400c3230 msgr2=0x7f03401f4580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:29:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.866+0000 7f0344e7a640 1 --2- 172.21.15.100:0/687004031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03400c3230 0x7f03401f4580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.866+0000 7f0344e7a640 1 -- 172.21.15.100:0/687004031 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f034014b610 con 0x7f0340154d70 2024-09-11T22:29:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.866+0000 7f033ffff640 1 --2- 172.21.15.100:0/687004031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0340071a00 0x7f03400c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:29:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.866+0000 7f0344e7a640 1 --2- 172.21.15.100:0/687004031 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0340154d70 0x7f034014b0d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f033800be00 tx=0x7f033800bef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.866+0000 7f033cff9640 1 -- 172.21.15.100:0/687004031 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0338015470 con 0x7f0340154d70 2024-09-11T22:29:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.866+0000 7f033cff9640 1 -- 172.21.15.100:0/687004031 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0338010070 con 0x7f0340154d70 2024-09-11T22:29:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.866+0000 7f03468dd640 1 -- 172.21.15.100:0/687004031 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03400b3b70 con 0x7f0340154d70 2024-09-11T22:29:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.866+0000 7f033cff9640 1 -- 172.21.15.100:0/687004031 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0338015870 con 0x7f0340154d70 2024-09-11T22:29:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.866+0000 7f03468dd640 1 -- 172.21.15.100:0/687004031 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f03400b13c0 con 0x7f0340154d70 2024-09-11T22:29:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.867+0000 7f03468dd640 1 --2- 172.21.15.100:0/687004031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03400b1590 0x7f03400b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.867+0000 7f03468dd640 1 -- 172.21.15.100:0/687004031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f03400b4130 con 0x7f03400b1590 2024-09-11T22:29:52.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.867+0000 7f033ffff640 1 --2- 172.21.15.100:0/687004031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03400b1590 0x7f03400b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.867+0000 7f033ffff640 1 -- 172.21.15.100:0/687004031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f034006edd0 con 0x7f03400b1590 2024-09-11T22:29:52.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.868+0000 7f033ffff640 1 --2- 172.21.15.100:0/687004031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03400b1590 0x7f03400b1e80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f03400c9580 tx=0x7f03300046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:52.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.868+0000 7f033cff9640 1 -- 172.21.15.100:0/687004031 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0338005070 con 0x7f0340154d70 2024-09-11T22:29:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.868+0000 7f033cff9640 1 --2- 172.21.15.100:0/687004031 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f032c06bde0 0x7f032c06e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.868+0000 7f033cff9640 1 -- 172.21.15.100:0/687004031 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f033808b7a0 con 0x7f0340154d70 2024-09-11T22:29:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.868+0000 7f033f7fe640 1 --2- 172.21.15.100:0/687004031 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f032c06bde0 0x7f032c06e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.868+0000 7f033cff9640 1 -- 172.21.15.100:0/687004031 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330037040 con 0x7f03400b1590 2024-09-11T22:29:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.868+0000 7f033cff9640 1 -- 172.21.15.100:0/687004031 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0330032440 con 0x7f03400b1590 2024-09-11T22:29:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.868+0000 7f033cff9640 1 -- 172.21.15.100:0/687004031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03400b1590 msgr2=0x7f03400b1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.868+0000 7f033cff9640 1 --2- 172.21.15.100:0/687004031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03400b1590 0x7f03400b1e80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f03400c9580 tx=0x7f03300046c0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.868+0000 7f033cff9640 1 -- 172.21.15.100:0/687004031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03400b1590 msgr2=0x7f03400b1e80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:29:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.868+0000 7f033cff9640 1 --2- 172.21.15.100:0/687004031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03400b1590 0x7f03400b1e80 secure :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f03400c9580 tx=0x7f03300046c0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.869+0000 7f033f7fe640 1 --2- 172.21.15.100:0/687004031 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f032c06bde0 0x7f032c06e2a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0334006fd0 tx=0x7f0334006d00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:52.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.875+0000 7f03468dd640 1 --2- 172.21.15.100:0/687004031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03400c6080 0x7f0340152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.875+0000 7f03468dd640 1 -- 172.21.15.100:0/687004031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f03400ca3a0 con 0x7f03400c6080 2024-09-11T22:29:52.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.875+0000 7f033ffff640 1 --2- 172.21.15.100:0/687004031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03400c6080 0x7f0340152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.875+0000 7f033ffff640 1 -- 172.21.15.100:0/687004031 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0340154570 con 0x7f03400c6080 2024-09-11T22:29:52.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.875+0000 7f033ffff640 1 --2- 172.21.15.100:0/687004031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03400c6080 0x7f0340152b40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0330009870 tx=0x7f0330008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:52.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.875+0000 7f033cff9640 1 -- 172.21.15.100:0/687004031 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330037040 con 0x7f03400c6080 2024-09-11T22:29:52.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.876+0000 7f033cff9640 1 -- 172.21.15.100:0/687004031 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4878 (secure 0 0 0) 0x7f033004b2d0 con 0x7f03400c6080 2024-09-11T22:29:52.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.876+0000 7f033cff9640 1 -- 172.21.15.100:0/687004031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03400c6080 msgr2=0x7f0340152b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:52.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.876+0000 7f033cff9640 1 --2- 172.21.15.100:0/687004031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03400c6080 0x7f0340152b40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0330009870 tx=0x7f0330008030 comp rx=0 tx=0).stop 2024-09-11T22:29:52.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.876+0000 7f033cff9640 1 -- 172.21.15.100:0/687004031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03400c6080 msgr2=0x7f0340152b40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:29:52.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.876+0000 7f033cff9640 1 --2- 172.21.15.100:0/687004031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f03400c6080 0x7f0340152b40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.877 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:29:52.879 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:29:52.879 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:29:52.879 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:29:52.879 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 68, 2024-09-11T22:29:52.879 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 378155, 2024-09-11T22:29:52.879 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:29:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:29:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:29:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:29:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:29:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:29:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:29:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:52.880 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:29:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:29:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:52.881 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:29:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:29:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:29:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:29:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:29:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:29:52.882 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:29:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:29:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:29:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:29:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:29:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:29:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:29:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:29:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:29:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:29:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:29:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:52.883 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:29:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:29:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:29:52.884 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:29:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:29:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:29:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:52.885 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:29:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:29:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:29:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:29:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:52.886 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:29:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:29:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:29:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:29:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:52.887 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:29:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:29:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:52.888 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:29:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:29:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:52.889 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:29:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:29:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:29:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:29:52.890 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:29:52.892 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:29:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:29:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:29:52.893 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:52.894 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:52.894 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:52.894 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:29:52.894 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:29:52.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.876+0000 7f03468dd640 1 -- 172.21.15.100:0/687004031 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f032c06bde0 msgr2=0x7f032c06e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:52.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.876+0000 7f03468dd640 1 --2- 172.21.15.100:0/687004031 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f032c06bde0 0x7f032c06e2a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0334006fd0 tx=0x7f0334006d00 comp rx=0 tx=0).stop 2024-09-11T22:29:52.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.876+0000 7f03468dd640 1 -- 172.21.15.100:0/687004031 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0340154d70 msgr2=0x7f034014b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:52.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.876+0000 7f03468dd640 1 --2- 172.21.15.100:0/687004031 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0340154d70 0x7f034014b0d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f033800be00 tx=0x7f033800bef0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.876+0000 7f0344e7a640 1 -- 172.21.15.100:0/687004031 reap_dead start 2024-09-11T22:29:52.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.876+0000 7f0344e7a640 1 -- 172.21.15.100:0/687004031 reap_dead start 2024-09-11T22:29:52.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.876+0000 7f03468dd640 1 -- 172.21.15.100:0/687004031 shutdown_connections 2024-09-11T22:29:52.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.876+0000 7f03468dd640 1 -- 172.21.15.100:0/687004031 >> 172.21.15.100:0/687004031 conn(0x7f034006f4c0 msgr2=0x7f0340153dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:52.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.876+0000 7f03468dd640 1 -- 172.21.15.100:0/687004031 shutdown_connections 2024-09-11T22:29:52.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.876+0000 7f03468dd640 1 -- 172.21.15.100:0/687004031 wait complete. 2024-09-11T22:29:52.896 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:29:52.896 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-11T22:29:52.896 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:29:52.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.995+0000 7f229a40e640 1 Processor -- start 2024-09-11T22:29:52.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.995+0000 7f229a40e640 1 -- start start 2024-09-11T22:29:52.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.996+0000 7f229a40e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22940c1750 0x7f2294157d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.996+0000 7f229a40e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f22940c2fc0 0x7f2294158290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:52.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.996+0000 7f229a40e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2294071840 con 0x7f22940c1370 2024-09-11T22:29:52.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.996+0000 7f229a40e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f22940c2db0 con 0x7f22940c2fc0 2024-09-11T22:29:52.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.996+0000 7f229a40e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2294071ae0 con 0x7f22940c1750 2024-09-11T22:29:52.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.996+0000 7f22989ab640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f22940c2fc0 msgr2=0x7f2294158290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:29:52.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.996+0000 7f22989ab640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f22940c2fc0 0x7f2294158290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:29:52.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.996+0000 7f22937fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22940c1750 0x7f2294157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:52.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.996+0000 7f2293fff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f22940c1370 0x7f22940739e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:47052/0 (socket says 172.21.15.100:47052) 2024-09-11T22:29:52.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.996+0000 7f2293fff640 1 -- 172.21.15.100:0/1088508227 learned_addr learned my addr 172.21.15.100:0/1088508227 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:29:52.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.996+0000 7f22937fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22940c1750 0x7f2294157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:40228/0 (socket says 172.21.15.100:40228) 2024-09-11T22:29:52.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.996+0000 7f22937fe640 1 -- 172.21.15.100:0/1088508227 >> v2:172.21.15.100:3300/0 conn(0x7f22940c2fc0 msgr2=0x7f2294158290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:29:52.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.996+0000 7f22937fe640 1 --2- 172.21.15.100:0/1088508227 >> v2:172.21.15.100:3300/0 conn(0x7f22940c2fc0 0x7f2294158290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:52.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.996+0000 7f22937fe640 1 -- 172.21.15.100:0/1088508227 >> v1:172.21.15.167:6789/0 conn(0x7f22940c1370 legacy=0x7f22940739e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:52.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.996+0000 7f22937fe640 1 -- 172.21.15.100:0/1088508227 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2294071dc0 con 0x7f22940c1750 2024-09-11T22:29:53.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.997+0000 7f22937fe640 1 --2- 172.21.15.100:0/1088508227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22940c1750 0x7f2294157d50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f22880097a0 tx=0x7f228802a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea5c4e637acf55cb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:53.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.997+0000 7f2292ffd640 1 -- 172.21.15.100:0/1088508227 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288037070 con 0x7f22940c1750 2024-09-11T22:29:53.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.997+0000 7f2292ffd640 1 -- 172.21.15.100:0/1088508227 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2288032440 con 0x7f22940c1750 2024-09-11T22:29:53.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.997+0000 7f2292ffd640 1 -- 172.21.15.100:0/1088508227 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288032810 con 0x7f22940c1750 2024-09-11T22:29:53.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.998+0000 7f229a40e640 1 -- 172.21.15.100:0/1088508227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22940c1750 msgr2=0x7f2294157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:53.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.998+0000 7f229a40e640 1 --2- 172.21.15.100:0/1088508227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22940c1750 0x7f2294157d50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f22880097a0 tx=0x7f228802a230 comp rx=0 tx=0).stop 2024-09-11T22:29:53.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.998+0000 7f229a40e640 1 -- 172.21.15.100:0/1088508227 shutdown_connections 2024-09-11T22:29:53.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.998+0000 7f229a40e640 1 --2- 172.21.15.100:0/1088508227 >> v2:172.21.15.100:3300/0 conn(0x7f22940c2fc0 0x7f2294158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.998+0000 7f229a40e640 1 --2- 172.21.15.100:0/1088508227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22940c1750 0x7f2294157d50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.998+0000 7f229a40e640 1 -- 172.21.15.100:0/1088508227 >> 172.21.15.100:0/1088508227 conn(0x7f229406f360 msgr2=0x7f229406f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:53.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.998+0000 7f229a40e640 1 -- 172.21.15.100:0/1088508227 shutdown_connections 2024-09-11T22:29:53.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.998+0000 7f229a40e640 1 -- 172.21.15.100:0/1088508227 wait complete. 2024-09-11T22:29:53.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.999+0000 7f229a40e640 1 Processor -- start 2024-09-11T22:29:53.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:52.999+0000 7f229a40e640 1 -- start start 2024-09-11T22:29:53.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.000+0000 7f229a40e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22940c1370 0x7f229414afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:53.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.000+0000 7f229a40e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22940c1750 0x7f2294156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:53.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.000+0000 7f229a40e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22940c2fc0 0x7f2294156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:53.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.000+0000 7f229a40e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2294072500 con 0x7f22940c2fc0 2024-09-11T22:29:53.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.000+0000 7f229a40e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2294072380 con 0x7f22940c1370 2024-09-11T22:29:53.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.000+0000 7f229a40e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f22940740f0 con 0x7f22940c1750 2024-09-11T22:29:53.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.000+0000 7f22989ab640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22940c2fc0 msgr2=0x7f2294156d40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:29:53.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.000+0000 7f22989ab640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22940c2fc0 0x7f2294156d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:29:53.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.000+0000 7f22937fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22940c1750 0x7f2294156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:53.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.000+0000 7f22937fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22940c1750 0x7f2294156800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:40240/0 (socket says 172.21.15.100:40240) 2024-09-11T22:29:53.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.000+0000 7f22937fe640 1 -- 172.21.15.100:0/135439063 learned_addr learned my addr 172.21.15.100:0/135439063 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:29:53.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.000+0000 7f2293fff640 1 --2- 172.21.15.100:0/135439063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22940c1370 0x7f229414afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:53.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.000+0000 7f22937fe640 1 -- 172.21.15.100:0/135439063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22940c1370 msgr2=0x7f229414afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:53.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.000+0000 7f22937fe640 1 --2- 172.21.15.100:0/135439063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22940c1370 0x7f229414afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.000+0000 7f22937fe640 1 -- 172.21.15.100:0/135439063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22940c2fc0 msgr2=0x7f2294156d40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:29:53.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.000+0000 7f22937fe640 1 --2- 172.21.15.100:0/135439063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22940c2fc0 0x7f2294156d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.000+0000 7f22937fe640 1 -- 172.21.15.100:0/135439063 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2294149c60 con 0x7f22940c1750 2024-09-11T22:29:53.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.000+0000 7f22937fe640 1 --2- 172.21.15.100:0/135439063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22940c1750 0x7f2294156800 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f22880097a0 tx=0x7f22880046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:53.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.001+0000 7f2290ff9640 1 -- 172.21.15.100:0/135439063 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288041070 con 0x7f22940c1750 2024-09-11T22:29:53.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.001+0000 7f2290ff9640 1 -- 172.21.15.100:0/135439063 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f228803c870 con 0x7f22940c1750 2024-09-11T22:29:53.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.001+0000 7f2290ff9640 1 -- 172.21.15.100:0/135439063 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288037040 con 0x7f22940c1750 2024-09-11T22:29:53.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.001+0000 7f229a40e640 1 -- 172.21.15.100:0/135439063 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2294155d20 con 0x7f22940c1750 2024-09-11T22:29:53.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.001+0000 7f229a40e640 1 -- 172.21.15.100:0/135439063 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f22941562e0 con 0x7f22940c1750 2024-09-11T22:29:53.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.001+0000 7f229a40e640 1 --2- 172.21.15.100:0/135439063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f229414a250 0x7f2294148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:53.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.001+0000 7f229a40e640 1 -- 172.21.15.100:0/135439063 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2294156520 con 0x7f229414a250 2024-09-11T22:29:53.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.002+0000 7f2293fff640 1 --2- 172.21.15.100:0/135439063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f229414a250 0x7f2294148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:53.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.002+0000 7f2293fff640 1 -- 172.21.15.100:0/135439063 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2294149a10 con 0x7f229414a250 2024-09-11T22:29:53.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.002+0000 7f2293fff640 1 --2- 172.21.15.100:0/135439063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f229414a250 0x7f2294148a80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f228400e4d0 tx=0x7f228400e990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:53.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.002+0000 7f2290ff9640 1 -- 172.21.15.100:0/135439063 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2284005ac0 con 0x7f229414a250 2024-09-11T22:29:53.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.002+0000 7f2290ff9640 1 -- 172.21.15.100:0/135439063 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2288044070 con 0x7f22940c1750 2024-09-11T22:29:53.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.003+0000 7f2290ff9640 1 --2- 172.21.15.100:0/135439063 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f228006bd30 0x7f228006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:53.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.003+0000 7f2290ff9640 1 -- 172.21.15.100:0/135439063 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f22880ac0e0 con 0x7f22940c1750 2024-09-11T22:29:53.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.003+0000 7f22989ab640 1 --2- 172.21.15.100:0/135439063 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f228006bd30 0x7f228006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:53.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.003+0000 7f2290ff9640 1 -- 172.21.15.100:0/135439063 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2284018070 con 0x7f229414a250 2024-09-11T22:29:53.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.003+0000 7f2290ff9640 1 -- 172.21.15.100:0/135439063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f229414a250 msgr2=0x7f2294148a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:53.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.003+0000 7f2290ff9640 1 --2- 172.21.15.100:0/135439063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f229414a250 0x7f2294148a80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f228400e4d0 tx=0x7f228400e990 comp rx=0 tx=0).stop 2024-09-11T22:29:53.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.003+0000 7f2290ff9640 1 -- 172.21.15.100:0/135439063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f229414a250 msgr2=0x7f2294148a80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:29:53.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.003+0000 7f2290ff9640 1 --2- 172.21.15.100:0/135439063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f229414a250 0x7f2294148a80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.003+0000 7f22989ab640 1 --2- 172.21.15.100:0/135439063 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f228006bd30 0x7f228006e1f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f228c003cb0 tx=0x7f228c0091f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:53.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.009+0000 7f229a40e640 1 --2- 172.21.15.100:0/135439063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2294148fc0 0x7f22941f1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:29:53.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.009+0000 7f229a40e640 1 -- 172.21.15.100:0/135439063 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2294155b60 con 0x7f2294148fc0 2024-09-11T22:29:53.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.009+0000 7f2293fff640 1 --2- 172.21.15.100:0/135439063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2294148fc0 0x7f22941f1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:29:53.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.010+0000 7f2293fff640 1 -- 172.21.15.100:0/135439063 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f22940739e0 con 0x7f2294148fc0 2024-09-11T22:29:53.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.010+0000 7f2293fff640 1 --2- 172.21.15.100:0/135439063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2294148fc0 0x7f22941f1fe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f228400e4d0 tx=0x7f2284000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:29:53.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.010+0000 7f2290ff9640 1 -- 172.21.15.100:0/135439063 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228401dc90 con 0x7f2294148fc0 2024-09-11T22:29:53.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.010+0000 7f2290ff9640 1 -- 172.21.15.100:0/135439063 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5043 (secure 0 0 0) 0x7f228401dc90 con 0x7f2294148fc0 2024-09-11T22:29:53.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.010+0000 7f2290ff9640 1 -- 172.21.15.100:0/135439063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2294148fc0 msgr2=0x7f22941f1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:53.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.010+0000 7f2290ff9640 1 --2- 172.21.15.100:0/135439063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2294148fc0 0x7f22941f1fe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f228400e4d0 tx=0x7f2284000ed0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.010+0000 7f2290ff9640 1 -- 172.21.15.100:0/135439063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2294148fc0 msgr2=0x7f22941f1fe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:29:53.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.010+0000 7f2290ff9640 1 --2- 172.21.15.100:0/135439063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2294148fc0 0x7f22941f1fe0 secure :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f228400e4d0 tx=0x7f2284000ed0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.013 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:29:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:29:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:29:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:29:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 68, 2024-09-11T22:29:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 483732, 2024-09-11T22:29:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:29:53.013 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:29:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:29:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:29:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:29:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:29:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:29:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:53.014 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:29:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:29:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:53.015 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:53.016 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:53.016 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:53.016 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:53.016 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:53.016 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:53.016 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:53.016 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:53.016 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:29:53.016 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:29:53.017 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:29:53.017 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:29:53.017 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:29:53.017 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:29:53.017 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:29:53.017 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:29:53.017 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:29:53.017 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:29:53.017 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:29:53.017 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:29:53.017 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:29:53.017 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:29:53.017 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:29:53.018 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:29:53.018 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:29:53.018 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:29:53.018 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:29:53.018 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:29:53.018 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:29:53.018 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:29:53.018 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:29:53.018 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:29:53.018 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:29:53.018 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:29:53.018 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:29:53.018 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:29:53.019 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:53.019 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:29:53.019 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:53.019 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:29:53.019 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:53.019 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:29:53.020 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:29:53.020 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:53.020 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:29:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:29:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:53.021 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:29:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:29:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:29:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:29:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:53.022 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:29:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:29:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:29:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:29:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:53.023 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:29:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:29:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:29:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:29:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:29:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:29:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:53.024 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:29:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:29:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:29:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:29:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:29:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:29:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:29:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:29:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:53.025 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:29:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:29:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:29:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:29:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:29:53.026 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:29:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:29:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:29:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:53.027 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 6 2024-09-11T22:29:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:29:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:29:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:29:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:29:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:29:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:29:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:29:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:29:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:29:53.028 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:29:53.029 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:29:53.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.010+0000 7f229a40e640 1 -- 172.21.15.100:0/135439063 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f228006bd30 msgr2=0x7f228006e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:53.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.010+0000 7f229a40e640 1 --2- 172.21.15.100:0/135439063 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f228006bd30 0x7f228006e1f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f228c003cb0 tx=0x7f228c0091f0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.010+0000 7f229a40e640 1 -- 172.21.15.100:0/135439063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22940c1750 msgr2=0x7f2294156800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:29:53.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.010+0000 7f229a40e640 1 --2- 172.21.15.100:0/135439063 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22940c1750 0x7f2294156800 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f22880097a0 tx=0x7f22880046c0 comp rx=0 tx=0).stop 2024-09-11T22:29:53.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.010+0000 7f22989ab640 1 -- 172.21.15.100:0/135439063 reap_dead start 2024-09-11T22:29:53.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.011+0000 7f22989ab640 1 -- 172.21.15.100:0/135439063 reap_dead start 2024-09-11T22:29:53.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.011+0000 7f229a40e640 1 -- 172.21.15.100:0/135439063 shutdown_connections 2024-09-11T22:29:53.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.011+0000 7f229a40e640 1 -- 172.21.15.100:0/135439063 >> 172.21.15.100:0/135439063 conn(0x7f229406f360 msgr2=0x7f229414e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:29:53.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.011+0000 7f229a40e640 1 -- 172.21.15.100:0/135439063 shutdown_connections 2024-09-11T22:29:53.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:29:53.011+0000 7f229a40e640 1 -- 172.21.15.100:0/135439063 wait complete. 2024-09-11T22:29:53.031 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:29:53.031 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-11T22:29:58.368 INFO:tasks.workunit.client.0.smithi100.stdout:Syncing()...7 sec 2024-09-11T22:29:58.369 INFO:tasks.workunit.client.0.smithi100.stdout:Starting Actual Benchmark At: Wed Sep 11 22:29:58 2024 2024-09-11T22:29:58.369 INFO:tasks.workunit.client.0.smithi100.stdout: 2024-09-11T22:30:13.032 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:30:13.032 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-11T22:30:13.032 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T22:30:13.033 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T22:30:13.036 INFO:tasks.ceph.mon.a:Started 2024-09-11T22:30:13.036 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:30:13.036 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:30:13.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.298+0000 7f6049c96640 1 Processor -- start 2024-09-11T22:30:13.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.299+0000 7f6049c96640 1 -- start start 2024-09-11T22:30:13.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.300+0000 7f6049c96640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6044158ee0 0x7f604415eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:13.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.300+0000 7f6049c96640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f60440c2d90 0x7f60440c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:13.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.300+0000 7f6049c96640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60440c0ee0 con 0x7f604406f930 2024-09-11T22:30:13.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.300+0000 7f6049c96640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f60440c1150 con 0x7f6044158ee0 2024-09-11T22:30:13.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.300+0000 7f6049c96640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f60440c1430 con 0x7f60440c2d90 2024-09-11T22:30:13.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.301+0000 7f6048c94640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f6044158ee0 msgr2=0x7f604415eba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:30:13.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.301+0000 7f6048c94640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6044158ee0 0x7f604415eba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:30:13.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.301+0000 7f6049495640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f60440c2d90 0x7f60440c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:13.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.301+0000 7f6049495640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f60440c2d90 0x7f60440c21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:58244/0 (socket says 172.21.15.100:58244) 2024-09-11T22:30:13.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.301+0000 7f6049495640 1 -- 172.21.15.100:0/3875342743 learned_addr learned my addr 172.21.15.100:0/3875342743 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:30:13.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.302+0000 7f6043fff640 1 -- 172.21.15.100:0/3875342743 >> v1:172.21.15.100:6789/0 conn(0x7f604406f930 legacy=0x7f60440c7830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:30:13.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.302+0000 7f6049495640 1 -- 172.21.15.100:0/3875342743 >> v2:172.21.15.100:3300/0 conn(0x7f6044158ee0 msgr2=0x7f604415eba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:30:13.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.302+0000 7f6049495640 1 --2- 172.21.15.100:0/3875342743 >> v2:172.21.15.100:3300/0 conn(0x7f6044158ee0 0x7f604415eba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:13.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.302+0000 7f6049495640 1 -- 172.21.15.100:0/3875342743 >> v1:172.21.15.100:6789/0 conn(0x7f604406f930 legacy=0x7f60440c7830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:30:13.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.302+0000 7f6049495640 1 -- 172.21.15.100:0/3875342743 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60440c1710 con 0x7f60440c2d90 2024-09-11T22:30:13.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.303+0000 7f6049495640 1 --2- 172.21.15.100:0/3875342743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60440c2d90 0x7f60440c21f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6034009870 tx=0x7f603402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb172f10d2032e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:13.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.304+0000 7f60437fe640 1 -- 172.21.15.100:0/3875342743 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6034037070 con 0x7f60440c2d90 2024-09-11T22:30:13.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.304+0000 7f60437fe640 1 -- 172.21.15.100:0/3875342743 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6034032440 con 0x7f60440c2d90 2024-09-11T22:30:13.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.304+0000 7f60437fe640 1 -- 172.21.15.100:0/3875342743 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6034032810 con 0x7f60440c2d90 2024-09-11T22:30:13.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.306+0000 7f6049c96640 1 -- 172.21.15.100:0/3875342743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60440c2d90 msgr2=0x7f60440c21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:13.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.306+0000 7f6049c96640 1 --2- 172.21.15.100:0/3875342743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60440c2d90 0x7f60440c21f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6034009870 tx=0x7f603402a270 comp rx=0 tx=0).stop 2024-09-11T22:30:13.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.307+0000 7f6049c96640 1 -- 172.21.15.100:0/3875342743 shutdown_connections 2024-09-11T22:30:13.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.307+0000 7f6049c96640 1 --2- 172.21.15.100:0/3875342743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60440c2d90 0x7f60440c21f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:13.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.307+0000 7f6049c96640 1 --2- 172.21.15.100:0/3875342743 >> v2:172.21.15.100:3300/0 conn(0x7f6044158ee0 0x7f604415eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:13.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.307+0000 7f6049c96640 1 -- 172.21.15.100:0/3875342743 >> 172.21.15.100:0/3875342743 conn(0x7f604406ee10 msgr2=0x7f604406f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:13.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.317+0000 7f6049c96640 1 -- 172.21.15.100:0/3875342743 shutdown_connections 2024-09-11T22:30:13.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.318+0000 7f6049c96640 1 -- 172.21.15.100:0/3875342743 wait complete. 2024-09-11T22:30:13.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.319+0000 7f6049c96640 1 Processor -- start 2024-09-11T22:30:13.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.320+0000 7f6049c96640 1 -- start start 2024-09-11T22:30:13.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.321+0000 7f6049c96640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f604406f930 0x7f604415aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:13.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.321+0000 7f6049c96640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60440c2d90 0x7f60441509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:13.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.321+0000 7f6049c96640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6044158ee0 0x7f6044159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:13.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.321+0000 7f6049c96640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f60441592c0 con 0x7f60440c2d90 2024-09-11T22:30:13.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.321+0000 7f6049c96640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f60440c1cd0 con 0x7f604406f930 2024-09-11T22:30:13.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.321+0000 7f6049c96640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f604406e6f0 con 0x7f6044158ee0 2024-09-11T22:30:13.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.321+0000 7f6043fff640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60440c2d90 msgr2=0x7f60441509d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:30:13.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.321+0000 7f6043fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60440c2d90 0x7f60441509d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:30:13.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.322+0000 7f6049495640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6044158ee0 0x7f6044159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:13.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.322+0000 7f6049495640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6044158ee0 0x7f6044159740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:43796/0 (socket says 172.21.15.100:43796) 2024-09-11T22:30:13.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.322+0000 7f6049495640 1 -- 172.21.15.100:0/3450188068 learned_addr learned my addr 172.21.15.100:0/3450188068 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:30:13.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.322+0000 7f6048c94640 1 --2- 172.21.15.100:0/3450188068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f604406f930 0x7f604415aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:13.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.322+0000 7f6049495640 1 -- 172.21.15.100:0/3450188068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f604406f930 msgr2=0x7f604415aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:13.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.322+0000 7f6049495640 1 --2- 172.21.15.100:0/3450188068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f604406f930 0x7f604415aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:13.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.322+0000 7f6049495640 1 -- 172.21.15.100:0/3450188068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60440c2d90 msgr2=0x7f60441509d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:30:13.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.322+0000 7f6049495640 1 --2- 172.21.15.100:0/3450188068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60440c2d90 0x7f60441509d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:13.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.322+0000 7f6049495640 1 -- 172.21.15.100:0/3450188068 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f604414ff10 con 0x7f6044158ee0 2024-09-11T22:30:13.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.323+0000 7f6049495640 1 --2- 172.21.15.100:0/3450188068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6044158ee0 0x7f6044159740 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6034009990 tx=0x7f60340046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:13.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.324+0000 7f60417fa640 1 -- 172.21.15.100:0/3450188068 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6034037040 con 0x7f6044158ee0 2024-09-11T22:30:13.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.324+0000 7f60417fa640 1 -- 172.21.15.100:0/3450188068 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6034004230 con 0x7f6044158ee0 2024-09-11T22:30:13.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.324+0000 7f60417fa640 1 -- 172.21.15.100:0/3450188068 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603403c730 con 0x7f6044158ee0 2024-09-11T22:30:13.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.324+0000 7f6049c96640 1 -- 172.21.15.100:0/3450188068 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6044151e90 con 0x7f6044158ee0 2024-09-11T22:30:13.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.324+0000 7f6049c96640 1 -- 172.21.15.100:0/3450188068 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f60441501d0 con 0x7f6044158ee0 2024-09-11T22:30:13.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.328+0000 7f60417fa640 1 -- 172.21.15.100:0/3450188068 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f603403a070 con 0x7f6044158ee0 2024-09-11T22:30:13.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.329+0000 7f60417fa640 1 --2- 172.21.15.100:0/3450188068 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f603006be30 0x7f603006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:13.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.329+0000 7f60417fa640 1 -- 172.21.15.100:0/3450188068 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f60340abb80 con 0x7f6044158ee0 2024-09-11T22:30:13.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.330+0000 7f6048c94640 1 --2- 172.21.15.100:0/3450188068 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f603006be30 0x7f603006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:13.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.331+0000 7f6048c94640 1 --2- 172.21.15.100:0/3450188068 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f603006be30 0x7f603006e2f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f603c003d00 tx=0x7f603c0094d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:13.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.331+0000 7f6049c96640 1 -- 172.21.15.100:0/3450188068 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6024005290 con 0x7f6044158ee0 2024-09-11T22:30:13.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.336+0000 7f60417fa640 1 -- 172.21.15.100:0/3450188068 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6034041020 con 0x7f6044158ee0 2024-09-11T22:30:13.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.852+0000 7f6049c96640 1 -- 172.21.15.100:0/3450188068 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6024005580 con 0x7f6044158ee0 2024-09-11T22:30:13.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.853+0000 7f60417fa640 1 -- 172.21.15.100:0/3450188068 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f603407a060 con 0x7f6044158ee0 2024-09-11T22:30:13.855 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":68,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:30:13.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.858+0000 7f602affd640 1 -- 172.21.15.100:0/3450188068 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f603006be30 msgr2=0x7f603006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:13.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.858+0000 7f602affd640 1 --2- 172.21.15.100:0/3450188068 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f603006be30 0x7f603006e2f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f603c003d00 tx=0x7f603c0094d0 comp rx=0 tx=0).stop 2024-09-11T22:30:13.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.859+0000 7f602affd640 1 -- 172.21.15.100:0/3450188068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6044158ee0 msgr2=0x7f6044159740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:13.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.859+0000 7f602affd640 1 --2- 172.21.15.100:0/3450188068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6044158ee0 0x7f6044159740 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6034009990 tx=0x7f60340046c0 comp rx=0 tx=0).stop 2024-09-11T22:30:13.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.859+0000 7f602affd640 1 -- 172.21.15.100:0/3450188068 shutdown_connections 2024-09-11T22:30:13.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.859+0000 7f602affd640 1 --2- 172.21.15.100:0/3450188068 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f603006be30 0x7f603006e2f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:13.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.859+0000 7f602affd640 1 --2- 172.21.15.100:0/3450188068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6044158ee0 0x7f6044159740 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:13.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.859+0000 7f602affd640 1 --2- 172.21.15.100:0/3450188068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60440c2d90 0x7f60441509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:13.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.859+0000 7f602affd640 1 --2- 172.21.15.100:0/3450188068 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f604406f930 0x7f604415aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:13.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.859+0000 7f602affd640 1 -- 172.21.15.100:0/3450188068 >> 172.21.15.100:0/3450188068 conn(0x7f604406ee10 msgr2=0x7f604406ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:13.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.860+0000 7f602affd640 1 -- 172.21.15.100:0/3450188068 shutdown_connections 2024-09-11T22:30:13.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:13.860+0000 7f602affd640 1 -- 172.21.15.100:0/3450188068 wait complete. 2024-09-11T22:30:16.886 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:30:17.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.097+0000 7fec0b5bd640 1 Processor -- start 2024-09-11T22:30:17.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.098+0000 7fec0b5bd640 1 -- start start 2024-09-11T22:30:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.099+0000 7fec0b5bd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec04151ae0 0x7fec04071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.099+0000 7fec0b5bd640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec04071cc0 con 0x7fec040c8570 2024-09-11T22:30:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.099+0000 7fec0b5bd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec040c1ec0 con 0x7fec040c2de0 2024-09-11T22:30:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.099+0000 7fec0b5bd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fec04071f50 con 0x7fec04151ae0 2024-09-11T22:30:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.100+0000 7fec08b58640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fec040c8570 0x7fec040c0f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:34622/0 (socket says 172.21.15.100:34622) 2024-09-11T22:30:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.100+0000 7fec08b58640 1 -- 172.21.15.100:0/550760942 learned_addr learned my addr 172.21.15.100:0/550760942 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:30:17.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.100+0000 7fec09359640 1 --2- 172.21.15.100:0/550760942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec04151ae0 0x7fec04071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.101+0000 7fec09359640 1 -- 172.21.15.100:0/550760942 >> v1:172.21.15.167:6789/0 conn(0x7fec040c2de0 legacy=0x7fec0406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:17.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.101+0000 7febfbfff640 1 -- 172.21.15.100:0/550760942 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3641882176 0 0) 0x7fec040c1ec0 con 0x7fec040c2de0 2024-09-11T22:30:17.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.101+0000 7fec09359640 1 -- 172.21.15.100:0/550760942 >> v1:172.21.15.100:6789/0 conn(0x7fec040c8570 legacy=0x7fec040c0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:17.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.101+0000 7fec09359640 1 -- 172.21.15.100:0/550760942 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec04072230 con 0x7fec04151ae0 2024-09-11T22:30:17.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.105+0000 7fec09359640 1 --2- 172.21.15.100:0/550760942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec04151ae0 0x7fec04071780 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fec000097d0 tx=0x7fec0002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83c5527c1041e04 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:17.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.106+0000 7febfbfff640 1 -- 172.21.15.100:0/550760942 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec00037070 con 0x7fec04151ae0 2024-09-11T22:30:17.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.106+0000 7febfbfff640 1 -- 172.21.15.100:0/550760942 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec00032440 con 0x7fec04151ae0 2024-09-11T22:30:17.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.106+0000 7febfbfff640 1 -- 172.21.15.100:0/550760942 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec00032810 con 0x7fec04151ae0 2024-09-11T22:30:17.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.107+0000 7fec0b5bd640 1 -- 172.21.15.100:0/550760942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec04151ae0 msgr2=0x7fec04071780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:17.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.107+0000 7fec0b5bd640 1 --2- 172.21.15.100:0/550760942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec04151ae0 0x7fec04071780 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fec000097d0 tx=0x7fec0002a210 comp rx=0 tx=0).stop 2024-09-11T22:30:17.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.107+0000 7fec0b5bd640 1 -- 172.21.15.100:0/550760942 shutdown_connections 2024-09-11T22:30:17.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.107+0000 7fec0b5bd640 1 --2- 172.21.15.100:0/550760942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec04151ae0 0x7fec04071780 secure :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fec000097d0 tx=0x7fec0002a210 comp rx=0 tx=0).stop 2024-09-11T22:30:17.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.107+0000 7fec0b5bd640 1 -- 172.21.15.100:0/550760942 >> 172.21.15.100:0/550760942 conn(0x7fec040cbf70 msgr2=0x7fec040cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:17.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.108+0000 7fec0b5bd640 1 -- 172.21.15.100:0/550760942 shutdown_connections 2024-09-11T22:30:17.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.109+0000 7fec0b5bd640 1 -- 172.21.15.100:0/550760942 wait complete. 2024-09-11T22:30:17.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.110+0000 7fec0b5bd640 1 Processor -- start 2024-09-11T22:30:17.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.111+0000 7fec0b5bd640 1 -- start start 2024-09-11T22:30:17.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.112+0000 7fec0b5bd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec040c2de0 0x7fec0413a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.113+0000 7fec0b5bd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec040c8570 0x7fec04152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.113+0000 7fec0b5bd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec04138ee0 0x7fec04150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.113+0000 7fec0b5bd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fec040c2720 con 0x7fec040c8570 2024-09-11T22:30:17.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.113+0000 7fec0b5bd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fec040c2440 con 0x7fec04138ee0 2024-09-11T22:30:17.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.113+0000 7fec0b5bd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fec040c16a0 con 0x7fec040c2de0 2024-09-11T22:30:17.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.113+0000 7fec08b58640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec040c8570 0x7fec04152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.113+0000 7fec08b58640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec040c8570 0x7fec04152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41378/0 (socket says 172.21.15.100:41378) 2024-09-11T22:30:17.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.113+0000 7fec08b58640 1 -- 172.21.15.100:0/3085181554 learned_addr learned my addr 172.21.15.100:0/3085181554 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:30:17.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.113+0000 7fec09b5a640 1 --2- 172.21.15.100:0/3085181554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec04138ee0 0x7fec04150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.113+0000 7fec08b58640 1 -- 172.21.15.100:0/3085181554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec040c8570 msgr2=0x7fec04152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-11T22:30:17.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.113+0000 7fec08b58640 1 -- 172.21.15.100:0/3085181554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec040c8570 msgr2=0x7fec04152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:30:17.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.113+0000 7fec08b58640 1 --2- 172.21.15.100:0/3085181554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec040c8570 0x7fec04152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:30:17.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.113+0000 7fec08b58640 1 --2- 172.21.15.100:0/3085181554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec040c8570 0x7fec04152d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:30:17.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.114+0000 7fec09359640 1 --2- 172.21.15.100:0/3085181554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec040c2de0 0x7fec0413a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.114+0000 7fec09b5a640 1 -- 172.21.15.100:0/3085181554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec040c2de0 msgr2=0x7fec0413a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:17.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.114+0000 7fec09b5a640 1 --2- 172.21.15.100:0/3085181554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec040c2de0 0x7fec0413a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.114+0000 7fec09b5a640 1 -- 172.21.15.100:0/3085181554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec040c8570 msgr2=0x7fec04152d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:30:17.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.114+0000 7fec09b5a640 1 --2- 172.21.15.100:0/3085181554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec040c8570 0x7fec04152d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.114+0000 7fec09b5a640 1 -- 172.21.15.100:0/3085181554 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec041fded0 con 0x7fec04138ee0 2024-09-11T22:30:17.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.116+0000 7fec09b5a640 1 --2- 172.21.15.100:0/3085181554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec04138ee0 0x7fec04150350 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fec040c3290 tx=0x7febf400c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:17.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.116+0000 7febf9ffb640 1 -- 172.21.15.100:0/3085181554 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4017070 con 0x7fec04138ee0 2024-09-11T22:30:17.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.116+0000 7febf9ffb640 1 -- 172.21.15.100:0/3085181554 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf40035f0 con 0x7fec04138ee0 2024-09-11T22:30:17.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.116+0000 7febf9ffb640 1 -- 172.21.15.100:0/3085181554 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf40039e0 con 0x7fec04138ee0 2024-09-11T22:30:17.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.117+0000 7fec0b5bd640 1 -- 172.21.15.100:0/3085181554 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec04154fa0 con 0x7fec04138ee0 2024-09-11T22:30:17.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.117+0000 7fec0b5bd640 1 -- 172.21.15.100:0/3085181554 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec041fe140 con 0x7fec04138ee0 2024-09-11T22:30:17.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.121+0000 7febf9ffb640 1 -- 172.21.15.100:0/3085181554 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7febf401a070 con 0x7fec04138ee0 2024-09-11T22:30:17.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.123+0000 7febf9ffb640 1 --2- 172.21.15.100:0/3085181554 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7febe806bf30 0x7febe806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:17.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.123+0000 7febf9ffb640 1 -- 172.21.15.100:0/3085181554 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7febf408a450 con 0x7fec04138ee0 2024-09-11T22:30:17.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.126+0000 7fec0b5bd640 1 -- 172.21.15.100:0/3085181554 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febe4005290 con 0x7fec04138ee0 2024-09-11T22:30:17.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.127+0000 7fec09359640 1 --2- 172.21.15.100:0/3085181554 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7febe806bf30 0x7febe806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:17.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.127+0000 7fec09359640 1 --2- 172.21.15.100:0/3085181554 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7febe806bf30 0x7febe806e3f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fec00034000 tx=0x7fec0002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:17.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.134+0000 7febf9ffb640 1 -- 172.21.15.100:0/3085181554 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7febf4058a50 con 0x7fec04138ee0 2024-09-11T22:30:17.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.649+0000 7fec0b5bd640 1 -- 172.21.15.100:0/3085181554 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7febe4005580 con 0x7fec04138ee0 2024-09-11T22:30:17.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.651+0000 7febf9ffb640 1 -- 172.21.15.100:0/3085181554 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7febf4058350 con 0x7fec04138ee0 2024-09-11T22:30:17.653 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":68,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":25,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:30:17.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.656+0000 7febef7fe640 1 -- 172.21.15.100:0/3085181554 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7febe806bf30 msgr2=0x7febe806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:17.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.656+0000 7febef7fe640 1 --2- 172.21.15.100:0/3085181554 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7febe806bf30 0x7febe806e3f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fec00034000 tx=0x7fec0002e000 comp rx=0 tx=0).stop 2024-09-11T22:30:17.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.656+0000 7febef7fe640 1 -- 172.21.15.100:0/3085181554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec04138ee0 msgr2=0x7fec04150350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:17.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.656+0000 7febef7fe640 1 --2- 172.21.15.100:0/3085181554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec04138ee0 0x7fec04150350 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fec040c3290 tx=0x7febf400c870 comp rx=0 tx=0).stop 2024-09-11T22:30:17.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.656+0000 7febef7fe640 1 -- 172.21.15.100:0/3085181554 shutdown_connections 2024-09-11T22:30:17.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.656+0000 7febef7fe640 1 --2- 172.21.15.100:0/3085181554 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7febe806bf30 0x7febe806e3f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.656+0000 7febef7fe640 1 --2- 172.21.15.100:0/3085181554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec04138ee0 0x7fec04150350 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.656+0000 7febef7fe640 1 --2- 172.21.15.100:0/3085181554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec040c8570 0x7fec04152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.656+0000 7febef7fe640 1 --2- 172.21.15.100:0/3085181554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec040c2de0 0x7fec0413a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:17.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.656+0000 7febef7fe640 1 -- 172.21.15.100:0/3085181554 >> 172.21.15.100:0/3085181554 conn(0x7fec040cbf70 msgr2=0x7fec0406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:17.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.657+0000 7febef7fe640 1 -- 172.21.15.100:0/3085181554 shutdown_connections 2024-09-11T22:30:17.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:17.657+0000 7febef7fe640 1 -- 172.21.15.100:0/3085181554 wait complete. 2024-09-11T22:30:20.679 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:30:20.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.857+0000 7fb6d9542640 1 Processor -- start 2024-09-11T22:30:20.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.857+0000 7fb6d9542640 1 -- start start 2024-09-11T22:30:20.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.858+0000 7fb6d9542640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6d4153ec0 0x7fb6d4072c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:20.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.858+0000 7fb6d9542640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb6d41573a0 0x7fb6d406c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:20.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.858+0000 7fb6d9542640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6d40c1000 con 0x7fb6d406c1a0 2024-09-11T22:30:20.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.858+0000 7fb6d9542640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb6d4073570 con 0x7fb6d41573a0 2024-09-11T22:30:20.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.858+0000 7fb6d9542640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb6d4159eb0 con 0x7fb6d4153ec0 2024-09-11T22:30:20.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.859+0000 7fb6d27fc640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb6d406c1a0 0x7fb6d4156c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:47172/0 (socket says 172.21.15.100:47172) 2024-09-11T22:30:20.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.859+0000 7fb6d27fc640 1 -- 172.21.15.100:0/618382414 learned_addr learned my addr 172.21.15.100:0/618382414 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:30:20.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.859+0000 7fb6d37fe640 1 --2- 172.21.15.100:0/618382414 >> v2:172.21.15.100:3300/0 conn(0x7fb6d41573a0 0x7fb6d406c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:20.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.859+0000 7fb6d2ffd640 1 --2- 172.21.15.100:0/618382414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6d4153ec0 0x7fb6d4072c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:20.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.860+0000 7fb6d37fe640 1 -- 172.21.15.100:0/618382414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6d4153ec0 msgr2=0x7fb6d4072c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:20.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.860+0000 7fb6d37fe640 1 --2- 172.21.15.100:0/618382414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6d4153ec0 0x7fb6d4072c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:20.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.860+0000 7fb6d37fe640 1 -- 172.21.15.100:0/618382414 >> v1:172.21.15.167:6789/0 conn(0x7fb6d406c1a0 legacy=0x7fb6d4156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:20.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.860+0000 7fb6d37fe640 1 -- 172.21.15.100:0/618382414 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d415a190 con 0x7fb6d41573a0 2024-09-11T22:30:20.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.861+0000 7fb6d37fe640 1 --2- 172.21.15.100:0/618382414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6d41573a0 0x7fb6d406c5e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009440 tx=0x7fb6c802b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de21fbeb99c7bd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:20.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.862+0000 7fb6d1ffb640 1 -- 172.21.15.100:0/618382414 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c8037070 con 0x7fb6d41573a0 2024-09-11T22:30:20.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.862+0000 7fb6d1ffb640 1 -- 172.21.15.100:0/618382414 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c8032600 con 0x7fb6d41573a0 2024-09-11T22:30:20.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.863+0000 7fb6d9542640 1 -- 172.21.15.100:0/618382414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6d41573a0 msgr2=0x7fb6d406c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:20.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.863+0000 7fb6d9542640 1 --2- 172.21.15.100:0/618382414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6d41573a0 0x7fb6d406c5e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8009440 tx=0x7fb6c802b5b0 comp rx=0 tx=0).stop 2024-09-11T22:30:20.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.864+0000 7fb6d9542640 1 -- 172.21.15.100:0/618382414 shutdown_connections 2024-09-11T22:30:20.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.864+0000 7fb6d9542640 1 --2- 172.21.15.100:0/618382414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6d41573a0 0x7fb6d406c5e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:20.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.864+0000 7fb6d9542640 1 --2- 172.21.15.100:0/618382414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6d4153ec0 0x7fb6d4072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:20.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.864+0000 7fb6d9542640 1 -- 172.21.15.100:0/618382414 >> 172.21.15.100:0/618382414 conn(0x7fb6d40cbf70 msgr2=0x7fb6d40cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:20.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.866+0000 7fb6d9542640 1 -- 172.21.15.100:0/618382414 shutdown_connections 2024-09-11T22:30:20.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.866+0000 7fb6d9542640 1 -- 172.21.15.100:0/618382414 wait complete. 2024-09-11T22:30:20.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.868+0000 7fb6d9542640 1 Processor -- start 2024-09-11T22:30:20.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.868+0000 7fb6d9542640 1 -- start start 2024-09-11T22:30:20.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.869+0000 7fb6d9542640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6d406c1a0 0x7fb6d4162340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:20.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.869+0000 7fb6d9542640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6d4153ec0 0x7fb6d413c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:20.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.870+0000 7fb6d9542640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6d41552f0 0x7fb6d4155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:20.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.870+0000 7fb6d9542640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d415aa30 con 0x7fb6d41552f0 2024-09-11T22:30:20.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.870+0000 7fb6d9542640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d415a750 con 0x7fb6d4153ec0 2024-09-11T22:30:20.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.870+0000 7fb6d9542640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb6d415ad10 con 0x7fb6d406c1a0 2024-09-11T22:30:20.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.870+0000 7fb6d27fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6d4153ec0 0x7fb6d413c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:20.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.870+0000 7fb6d27fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6d4153ec0 0x7fb6d413c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:58332/0 (socket says 172.21.15.100:58332) 2024-09-11T22:30:20.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.870+0000 7fb6d27fc640 1 -- 172.21.15.100:0/890361978 learned_addr learned my addr 172.21.15.100:0/890361978 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:30:20.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.870+0000 7fb6d27fc640 1 -- 172.21.15.100:0/890361978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6d406c1a0 msgr2=0x7fb6d4162340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:30:20.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.870+0000 7fb6d27fc640 1 --2- 172.21.15.100:0/890361978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6d406c1a0 0x7fb6d4162340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:20.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.870+0000 7fb6d27fc640 1 -- 172.21.15.100:0/890361978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6d41552f0 msgr2=0x7fb6d4155780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:30:20.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.870+0000 7fb6d27fc640 1 --2- 172.21.15.100:0/890361978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6d41552f0 0x7fb6d4155780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:20.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.870+0000 7fb6d27fc640 1 -- 172.21.15.100:0/890361978 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d4162ad0 con 0x7fb6d4153ec0 2024-09-11T22:30:20.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.871+0000 7fb6d27fc640 1 --2- 172.21.15.100:0/890361978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6d4153ec0 0x7fb6d413c660 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc00cb20 tx=0x7fb6cc002090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:20.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.873+0000 7fb6bb7fe640 1 -- 172.21.15.100:0/890361978 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc018070 con 0x7fb6d4153ec0 2024-09-11T22:30:20.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.873+0000 7fb6d9542640 1 -- 172.21.15.100:0/890361978 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6d4152530 con 0x7fb6d4153ec0 2024-09-11T22:30:20.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.873+0000 7fb6d9542640 1 -- 172.21.15.100:0/890361978 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6d41595a0 con 0x7fb6d4153ec0 2024-09-11T22:30:20.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.875+0000 7fb6d9542640 1 -- 172.21.15.100:0/890361978 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6d4074110 con 0x7fb6d4153ec0 2024-09-11T22:30:20.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.875+0000 7fb6bb7fe640 1 -- 172.21.15.100:0/890361978 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6cc00a700 con 0x7fb6d4153ec0 2024-09-11T22:30:20.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.878+0000 7fb6bb7fe640 1 -- 172.21.15.100:0/890361978 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc00aab0 con 0x7fb6d4153ec0 2024-09-11T22:30:20.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.879+0000 7fb6bb7fe640 1 -- 172.21.15.100:0/890361978 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb6cc01b070 con 0x7fb6d4153ec0 2024-09-11T22:30:20.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.879+0000 7fb6bb7fe640 1 --2- 172.21.15.100:0/890361978 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb6c006bf60 0x7fb6c006e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:20.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.891+0000 7fb6bb7fe640 1 -- 172.21.15.100:0/890361978 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fb6cc08aa50 con 0x7fb6d4153ec0 2024-09-11T22:30:20.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.892+0000 7fb6d2ffd640 1 --2- 172.21.15.100:0/890361978 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb6c006bf60 0x7fb6c006e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:20.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.892+0000 7fb6bb7fe640 1 -- 172.21.15.100:0/890361978 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb6cc058a00 con 0x7fb6d4153ec0 2024-09-11T22:30:20.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:20.892+0000 7fb6d2ffd640 1 --2- 172.21.15.100:0/890361978 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb6c006bf60 0x7fb6c006e420 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4006b10 tx=0x7fb6c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:21.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.433+0000 7fb6d9542640 1 -- 172.21.15.100:0/890361978 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb6d4143920 con 0x7fb6d4153ec0 2024-09-11T22:30:21.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.434+0000 7fb6bb7fe640 1 -- 172.21.15.100:0/890361978 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7fb6cc05cd00 con 0x7fb6d4153ec0 2024-09-11T22:30:21.438 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":72,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:30:21.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.440+0000 7fb6d9542640 1 -- 172.21.15.100:0/890361978 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb6c006bf60 msgr2=0x7fb6c006e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:21.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.440+0000 7fb6d9542640 1 --2- 172.21.15.100:0/890361978 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb6c006bf60 0x7fb6c006e420 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4006b10 tx=0x7fb6c4008040 comp rx=0 tx=0).stop 2024-09-11T22:30:21.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.440+0000 7fb6d9542640 1 -- 172.21.15.100:0/890361978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6d4153ec0 msgr2=0x7fb6d413c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:21.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.440+0000 7fb6d9542640 1 --2- 172.21.15.100:0/890361978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6d4153ec0 0x7fb6d413c660 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc00cb20 tx=0x7fb6cc002090 comp rx=0 tx=0).stop 2024-09-11T22:30:21.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.440+0000 7fb6d9542640 1 -- 172.21.15.100:0/890361978 shutdown_connections 2024-09-11T22:30:21.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.440+0000 7fb6d9542640 1 --2- 172.21.15.100:0/890361978 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb6c006bf60 0x7fb6c006e420 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.440+0000 7fb6d9542640 1 --2- 172.21.15.100:0/890361978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6d41552f0 0x7fb6d4155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.440+0000 7fb6d9542640 1 --2- 172.21.15.100:0/890361978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6d4153ec0 0x7fb6d413c660 secure :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc00cb20 tx=0x7fb6cc002090 comp rx=0 tx=0).stop 2024-09-11T22:30:21.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.440+0000 7fb6d9542640 1 --2- 172.21.15.100:0/890361978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6d406c1a0 0x7fb6d4162340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.440+0000 7fb6d9542640 1 -- 172.21.15.100:0/890361978 >> 172.21.15.100:0/890361978 conn(0x7fb6d40cbf70 msgr2=0x7fb6d40c11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:21.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.444+0000 7fb6d9542640 1 -- 172.21.15.100:0/890361978 shutdown_connections 2024-09-11T22:30:21.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.445+0000 7fb6d9542640 1 -- 172.21.15.100:0/890361978 wait complete. 2024-09-11T22:30:21.469 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:30:21.469 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:30:21.469 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:30:21.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.682+0000 7f9c33fff640 1 Processor -- start 2024-09-11T22:30:21.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.682+0000 7f9c33fff640 1 -- start start 2024-09-11T22:30:21.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.684+0000 7f9c33fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9c3415c3d0 0x7f9c34071d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:21.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.684+0000 7f9c33fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c3415ee20 0x7f9c340c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:21.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.684+0000 7f9c33fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9c3415f240 0x7f9c340c8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:21.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.684+0000 7f9c33fff640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f9c34162cc0 con 0x7f9c3415f240 2024-09-11T22:30:21.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.684+0000 7f9c33fff640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f9c3406e050 con 0x7f9c3415c3d0 2024-09-11T22:30:21.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.684+0000 7f9c33fff640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9c3406e2f0 con 0x7f9c3415ee20 2024-09-11T22:30:21.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.684+0000 7f9c32ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9c3415c3d0 0x7f9c34071d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:21.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.684+0000 7f9c337fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9c3415f240 0x7f9c340c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:21.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.684+0000 7f9c337fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9c3415f240 0x7f9c340c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41398/0 (socket says 172.21.15.100:41398) 2024-09-11T22:30:21.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.684+0000 7f9c337fe640 1 -- 172.21.15.100:0/1500955498 learned_addr learned my addr 172.21.15.100:0/1500955498 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:30:21.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.685+0000 7f9c337fe640 1 -- 172.21.15.100:0/1500955498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c3415ee20 msgr2=0x7f9c340c7b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:30:21.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.685+0000 7f9c337fe640 1 --2- 172.21.15.100:0/1500955498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c3415ee20 0x7f9c340c7b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.685+0000 7f9c337fe640 1 -- 172.21.15.100:0/1500955498 >> v2:172.21.15.167:3300/0 conn(0x7f9c3415c3d0 msgr2=0x7f9c34071d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:21.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.685+0000 7f9c337fe640 1 --2- 172.21.15.100:0/1500955498 >> v2:172.21.15.167:3300/0 conn(0x7f9c3415c3d0 0x7f9c34071d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.685+0000 7f9c337fe640 1 -- 172.21.15.100:0/1500955498 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c3406e5d0 con 0x7f9c3415f240 2024-09-11T22:30:21.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.686+0000 7f9c337fe640 1 --2- 172.21.15.100:0/1500955498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c3415f240 0x7f9c340c8090 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9c3406fea0 tx=0x7f9c2c02a930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124f9a7a070f69b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:21.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.688+0000 7f9c31ffb640 1 -- 172.21.15.100:0/1500955498 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c030420 con 0x7f9c3415f240 2024-09-11T22:30:21.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.688+0000 7f9c31ffb640 1 -- 172.21.15.100:0/1500955498 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c2c035070 con 0x7f9c3415f240 2024-09-11T22:30:21.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.689+0000 7f9c31ffb640 1 -- 172.21.15.100:0/1500955498 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c030820 con 0x7f9c3415f240 2024-09-11T22:30:21.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.689+0000 7f9c33fff640 1 -- 172.21.15.100:0/1500955498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c3415f240 msgr2=0x7f9c340c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:21.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.689+0000 7f9c33fff640 1 --2- 172.21.15.100:0/1500955498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c3415f240 0x7f9c340c8090 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9c3406fea0 tx=0x7f9c2c02a930 comp rx=0 tx=0).stop 2024-09-11T22:30:21.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.689+0000 7f9c33fff640 1 -- 172.21.15.100:0/1500955498 shutdown_connections 2024-09-11T22:30:21.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.689+0000 7f9c33fff640 1 --2- 172.21.15.100:0/1500955498 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c3415f240 0x7f9c340c8090 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.689+0000 7f9c33fff640 1 --2- 172.21.15.100:0/1500955498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c3415ee20 0x7f9c340c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.689+0000 7f9c33fff640 1 --2- 172.21.15.100:0/1500955498 >> v2:172.21.15.167:3300/0 conn(0x7f9c3415c3d0 0x7f9c34071d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.689+0000 7f9c33fff640 1 -- 172.21.15.100:0/1500955498 >> 172.21.15.100:0/1500955498 conn(0x7f9c3406ed10 msgr2=0x7f9c3406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:21.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.689+0000 7f9c33fff640 1 -- 172.21.15.100:0/1500955498 shutdown_connections 2024-09-11T22:30:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.689+0000 7f9c33fff640 1 -- 172.21.15.100:0/1500955498 wait complete. 2024-09-11T22:30:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.691+0000 7f9c33fff640 1 Processor -- start 2024-09-11T22:30:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.691+0000 7f9c33fff640 1 -- start start 2024-09-11T22:30:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.693+0000 7f9c33fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c3415c3d0 0x7f9c340caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.693+0000 7f9c33fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c3415ee20 0x7f9c34153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.693+0000 7f9c33fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c3415f240 0x7f9c3415ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.693+0000 7f9c33fff640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9c34162340 con 0x7f9c3415ee20 2024-09-11T22:30:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.693+0000 7f9c32ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c3415c3d0 0x7f9c340caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.693+0000 7f9c32ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c3415c3d0 0x7f9c340caf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:58348/0 (socket says 172.21.15.100:58348) 2024-09-11T22:30:21.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.693+0000 7f9c32ffd640 1 -- 172.21.15.100:0/2336939049 learned_addr learned my addr 172.21.15.100:0/2336939049 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:30:21.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.693+0000 7f9c33fff640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9c34162950 con 0x7f9c3415c3d0 2024-09-11T22:30:21.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.693+0000 7f9c33fff640 1 -- 172.21.15.100:0/2336939049 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9c34163150 con 0x7f9c3415f240 2024-09-11T22:30:21.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.693+0000 7f9c337fe640 1 --2- 172.21.15.100:0/2336939049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c3415f240 0x7f9c3415ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:21.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.693+0000 7f9c32ffd640 1 -- 172.21.15.100:0/2336939049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c3415f240 msgr2=0x7f9c3415ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:21.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.693+0000 7f9c32ffd640 1 --2- 172.21.15.100:0/2336939049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c3415f240 0x7f9c3415ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.693+0000 7f9c32ffd640 1 -- 172.21.15.100:0/2336939049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c3415ee20 msgr2=0x7f9c34153b80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:30:21.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.693+0000 7f9c32ffd640 1 --2- 172.21.15.100:0/2336939049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c3415ee20 0x7f9c34153b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.693+0000 7f9c32ffd640 1 -- 172.21.15.100:0/2336939049 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c34152d20 con 0x7f9c3415c3d0 2024-09-11T22:30:21.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.694+0000 7f9c32ffd640 1 --2- 172.21.15.100:0/2336939049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c3415c3d0 0x7f9c340caf40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400e9b0 tx=0x7f9c2400ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:21.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.702+0000 7f9c1b7fe640 1 -- 172.21.15.100:0/2336939049 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24017070 con 0x7f9c3415c3d0 2024-09-11T22:30:21.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.702+0000 7f9c33fff640 1 -- 172.21.15.100:0/2336939049 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c3415e4f0 con 0x7f9c3415c3d0 2024-09-11T22:30:21.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.702+0000 7f9c33fff640 1 -- 172.21.15.100:0/2336939049 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c340cb830 con 0x7f9c3415c3d0 2024-09-11T22:30:21.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.703+0000 7f9c1b7fe640 1 -- 172.21.15.100:0/2336939049 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c2400c9a0 con 0x7f9c3415c3d0 2024-09-11T22:30:21.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.703+0000 7f9c1b7fe640 1 -- 172.21.15.100:0/2336939049 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2400cd70 con 0x7f9c3415c3d0 2024-09-11T22:30:21.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.704+0000 7f9c33fff640 1 --2- 172.21.15.100:0/2336939049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c14002a70 0x7f9c14004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:21.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.704+0000 7f9c33fff640 1 -- 172.21.15.100:0/2336939049 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9c14007ec0 con 0x7f9c14002a70 2024-09-11T22:30:21.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.704+0000 7f9c327fc640 1 --2- 172.21.15.100:0/2336939049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c14002a70 0x7f9c14004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:21.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.705+0000 7f9c327fc640 1 -- 172.21.15.100:0/2336939049 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9c140080c0 con 0x7f9c14002a70 2024-09-11T22:30:21.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.706+0000 7f9c327fc640 1 --2- 172.21.15.100:0/2336939049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c14002a70 0x7f9c14004f30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9c3415bde0 tx=0x7f9c2800b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:21.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.707+0000 7f9c1b7fe640 1 -- 172.21.15.100:0/2336939049 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28015020 con 0x7f9c14002a70 2024-09-11T22:30:21.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.707+0000 7f9c1b7fe640 1 -- 172.21.15.100:0/2336939049 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f9c28011830 con 0x7f9c14002a70 2024-09-11T22:30:21.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.707+0000 7f9c1b7fe640 1 -- 172.21.15.100:0/2336939049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c14002a70 msgr2=0x7f9c14004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:21.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.707+0000 7f9c1b7fe640 1 --2- 172.21.15.100:0/2336939049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c14002a70 0x7f9c14004f30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9c3415bde0 tx=0x7f9c2800b7a0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.707+0000 7f9c1b7fe640 1 -- 172.21.15.100:0/2336939049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c14002a70 msgr2=0x7f9c14004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:30:21.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.707+0000 7f9c1b7fe640 1 --2- 172.21.15.100:0/2336939049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c14002a70 0x7f9c14004f30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.719+0000 7f9c1b7fe640 1 -- 172.21.15.100:0/2336939049 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c2401a070 con 0x7f9c3415c3d0 2024-09-11T22:30:21.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.720+0000 7f9c1b7fe640 1 --2- 172.21.15.100:0/2336939049 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9c2006b8f0 0x7f9c2006ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:21.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.720+0000 7f9c327fc640 1 --2- 172.21.15.100:0/2336939049 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9c2006b8f0 0x7f9c2006ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:21.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.721+0000 7f9c327fc640 1 --2- 172.21.15.100:0/2336939049 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9c2006b8f0 0x7f9c2006ddb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9c28016000 tx=0x7f9c2801e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:21.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.721+0000 7f9c1b7fe640 1 -- 172.21.15.100:0/2336939049 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f9c2408b270 con 0x7f9c3415c3d0 2024-09-11T22:30:21.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.723+0000 7f9c197fa640 1 --2- 172.21.15.100:0/2336939049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c14001de0 0x7f9c1400cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:21.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.723+0000 7f9c197fa640 1 -- 172.21.15.100:0/2336939049 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1400a2e0 con 0x7f9c14001de0 2024-09-11T22:30:21.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.723+0000 7f9c337fe640 1 --2- 172.21.15.100:0/2336939049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c14001de0 0x7f9c1400cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:21.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.727+0000 7f9c337fe640 1 -- 172.21.15.100:0/2336939049 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9c1400a4e0 con 0x7f9c14001de0 2024-09-11T22:30:21.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.727+0000 7f9c337fe640 1 --2- 172.21.15.100:0/2336939049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c14001de0 0x7f9c1400cbf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9c340c8840 tx=0x7f9c2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:21.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.729+0000 7f9c1b7fe640 1 -- 172.21.15.100:0/2336939049 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c004040 con 0x7f9c14001de0 2024-09-11T22:30:21.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.729+0000 7f9c1b7fe640 1 -- 172.21.15.100:0/2336939049 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7f9c2c035070 con 0x7f9c14001de0 2024-09-11T22:30:21.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.729+0000 7f9c1b7fe640 1 -- 172.21.15.100:0/2336939049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c14001de0 msgr2=0x7f9c1400cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:21.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.729+0000 7f9c1b7fe640 1 --2- 172.21.15.100:0/2336939049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c14001de0 0x7f9c1400cbf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9c340c8840 tx=0x7f9c2c004a40 comp rx=0 tx=0).stop 2024-09-11T22:30:21.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.730+0000 7f9c1b7fe640 1 -- 172.21.15.100:0/2336939049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c14001de0 msgr2=0x7f9c1400cbf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:30:21.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.730+0000 7f9c1b7fe640 1 --2- 172.21.15.100:0/2336939049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c14001de0 0x7f9c1400cbf0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.733 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:30:21.733 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:30:21.733 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:30:21.733 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:30:21.733 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 72, 2024-09-11T22:30:21.733 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 8408, 2024-09-11T22:30:21.733 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:30:21.733 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:30:21.733 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:30:21.733 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:30:21.734 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:21.734 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 2, 2024-09-11T22:30:21.734 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:30:21.734 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:30:21.734 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:30:21.734 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:21.734 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:21.734 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:21.734 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:21.734 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:21.734 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:21.734 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:21.734 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:21.734 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:21.735 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:21.735 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:21.735 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:21.735 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:30:21.735 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:30:21.735 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:21.735 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:21.735 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:21.735 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:21.735 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:21.735 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:21.735 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:21.735 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:21.735 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:21.736 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:21.736 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:21.736 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:21.736 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:21.736 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:30:21.736 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:30:21.736 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:30:21.736 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:30:21.736 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:30:21.736 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:30:21.736 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:30:21.736 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:30:21.736 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:30:21.736 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:30:21.737 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:30:21.737 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:30:21.737 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:30:21.737 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:30:21.737 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:30:21.737 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:30:21.737 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:30:21.738 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:21.738 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:21.738 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:21.738 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:21.738 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:21.738 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:21.738 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:21.738 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:21.738 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:21.738 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:21.739 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:21.739 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:21.739 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:30:21.739 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:21.739 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:30:21.739 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:21.739 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:30:21.739 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:30:21.739 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:21.739 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:21.739 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:21.739 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:21.739 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:30:21.739 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:21.740 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:21.740 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:21.740 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:21.740 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:30:21.740 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:21.740 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:21.740 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:21.740 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:21.740 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:30:21.740 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:30:21.740 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:21.740 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:21.740 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:21.740 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:21.741 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:21.741 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:30:21.741 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:30:21.741 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:21.741 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:21.741 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:21.741 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:21.741 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:30:21.741 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:21.741 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:21.741 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:21.741 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:21.741 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:30:21.741 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:21.742 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:21.742 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:21.742 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:21.742 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:30:21.742 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:30:21.742 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:21.742 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:21.742 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:21.742 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:21.742 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:21.742 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:30:21.742 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:30:21.742 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:21.742 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:21.742 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:21.743 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:21.743 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:30:21.743 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:21.743 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:21.743 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:21.743 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:21.743 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:30:21.743 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:21.743 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:21.743 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:21.743 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:21.743 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:30:21.743 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:30:21.743 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:21.744 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:21.744 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:21.744 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:21.744 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:21.744 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:21.744 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:30:21.744 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:30:21.744 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:21.744 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:21.744 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:21.744 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:30:21.744 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:21.744 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:21.745 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:30:21.745 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:21.745 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:21.745 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:21.745 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:30:21.745 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:21.745 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:21.745 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:21.745 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:30:21.745 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:30:21.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.734+0000 7f9c197fa640 1 -- 172.21.15.100:0/2336939049 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9c2006b8f0 msgr2=0x7f9c2006ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:21.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.734+0000 7f9c197fa640 1 --2- 172.21.15.100:0/2336939049 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9c2006b8f0 0x7f9c2006ddb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9c28016000 tx=0x7f9c2801e040 comp rx=0 tx=0).stop 2024-09-11T22:30:21.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.734+0000 7f9c337fe640 1 -- 172.21.15.100:0/2336939049 reap_dead start 2024-09-11T22:30:21.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.735+0000 7f9c197fa640 1 -- 172.21.15.100:0/2336939049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c3415c3d0 msgr2=0x7f9c340caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:21.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.735+0000 7f9c197fa640 1 --2- 172.21.15.100:0/2336939049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c3415c3d0 0x7f9c340caf40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400e9b0 tx=0x7f9c2400ee70 comp rx=0 tx=0).stop 2024-09-11T22:30:21.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.735+0000 7f9c197fa640 1 -- 172.21.15.100:0/2336939049 shutdown_connections 2024-09-11T22:30:21.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.735+0000 7f9c197fa640 1 --2- 172.21.15.100:0/2336939049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c3415c3d0 0x7f9c340caf40 secure :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400e9b0 tx=0x7f9c2400ee70 comp rx=0 tx=0).stop 2024-09-11T22:30:21.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.735+0000 7f9c197fa640 1 -- 172.21.15.100:0/2336939049 >> 172.21.15.100:0/2336939049 conn(0x7f9c3406ed10 msgr2=0x7f9c340c1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:21.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.737+0000 7f9c197fa640 1 -- 172.21.15.100:0/2336939049 shutdown_connections 2024-09-11T22:30:21.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.737+0000 7f9c197fa640 1 -- 172.21.15.100:0/2336939049 wait complete. 2024-09-11T22:30:21.758 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:30:21.759 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:30:21.759 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:30:21.819 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:30:21.824 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:30:21.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.960+0000 7f2782647640 1 Processor -- start 2024-09-11T22:30:21.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.960+0000 7f2782647640 1 -- start start 2024-09-11T22:30:21.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.962+0000 7f2782647640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f277c15ab30 0x7f277c0c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:21.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.962+0000 7f2782647640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f277c0c9530 0x7f277c0c7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:21.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.962+0000 7f2782647640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f277c073470 con 0x7f277c06fe50 2024-09-11T22:30:21.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.962+0000 7f2782647640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f277c156e70 con 0x7f277c15ab30 2024-09-11T22:30:21.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.962+0000 7f2782647640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f277c157150 con 0x7f277c0c9530 2024-09-11T22:30:21.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.962+0000 7f277bfff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f277c06fe50 0x7f277c072c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:34636/0 (socket says 172.21.15.100:34636) 2024-09-11T22:30:21.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.962+0000 7f277bfff640 1 -- 172.21.15.100:0/2187949612 learned_addr learned my addr 172.21.15.100:0/2187949612 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:30:21.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.962+0000 7f2780be4640 1 --2- 172.21.15.100:0/2187949612 >> v2:172.21.15.167:3300/0 conn(0x7f277c0c9530 0x7f277c0c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:21.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.963+0000 7f2780be4640 1 -- 172.21.15.100:0/2187949612 >> v2:172.21.15.100:3300/0 conn(0x7f277c15ab30 msgr2=0x7f277c0c8ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:30:21.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.963+0000 7f277b7fe640 1 --2- 172.21.15.100:0/2187949612 >> v2:172.21.15.100:3300/0 conn(0x7f277c15ab30 0x7f277c0c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:21.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.964+0000 7f2780be4640 1 --2- 172.21.15.100:0/2187949612 >> v2:172.21.15.100:3300/0 conn(0x7f277c15ab30 0x7f277c0c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.964+0000 7f2780be4640 1 -- 172.21.15.100:0/2187949612 >> v1:172.21.15.100:6789/0 conn(0x7f277c06fe50 legacy=0x7f277c072c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:21.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.964+0000 7f2780be4640 1 -- 172.21.15.100:0/2187949612 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f277c157430 con 0x7f277c0c9530 2024-09-11T22:30:21.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.965+0000 7f277b7fe640 1 --2- 172.21.15.100:0/2187949612 >> v2:172.21.15.100:3300/0 conn(0x7f277c15ab30 0x7f277c0c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:30:21.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.965+0000 7f2780be4640 1 --2- 172.21.15.100:0/2187949612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f277c0c9530 0x7f277c0c7510 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f277c071830 tx=0x7f276c02c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34161a435dd4dabd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:21.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.967+0000 7f277affd640 1 -- 172.21.15.100:0/2187949612 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c038070 con 0x7f277c0c9530 2024-09-11T22:30:21.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.967+0000 7f277affd640 1 -- 172.21.15.100:0/2187949612 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276c009540 con 0x7f277c0c9530 2024-09-11T22:30:21.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.967+0000 7f277affd640 1 -- 172.21.15.100:0/2187949612 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c0098f0 con 0x7f277c0c9530 2024-09-11T22:30:21.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.969+0000 7f2782647640 1 -- 172.21.15.100:0/2187949612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f277c0c9530 msgr2=0x7f277c0c7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:21.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.969+0000 7f2782647640 1 --2- 172.21.15.100:0/2187949612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f277c0c9530 0x7f277c0c7510 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f277c071830 tx=0x7f276c02c7a0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.970+0000 7f2782647640 1 -- 172.21.15.100:0/2187949612 shutdown_connections 2024-09-11T22:30:21.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.970+0000 7f2782647640 1 --2- 172.21.15.100:0/2187949612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f277c0c9530 0x7f277c0c7510 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.970+0000 7f2782647640 1 --2- 172.21.15.100:0/2187949612 >> v2:172.21.15.100:3300/0 conn(0x7f277c15ab30 0x7f277c0c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.970+0000 7f2782647640 1 -- 172.21.15.100:0/2187949612 >> 172.21.15.100:0/2187949612 conn(0x7f277c06f360 msgr2=0x7f277c06f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:21.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.972+0000 7f2782647640 1 -- 172.21.15.100:0/2187949612 shutdown_connections 2024-09-11T22:30:21.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.972+0000 7f2782647640 1 -- 172.21.15.100:0/2187949612 wait complete. 2024-09-11T22:30:21.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.974+0000 7f2782647640 1 Processor -- start 2024-09-11T22:30:21.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.977+0000 7f2782647640 1 -- start start 2024-09-11T22:30:21.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.978+0000 7f2782647640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f277c06fe50 0x7f277c0b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:21.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.978+0000 7f2782647640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f277c0c9530 0x7f277c0cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:21.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.978+0000 7f2782647640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f277c15ab30 0x7f277c14da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:21.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.978+0000 7f2782647640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f277c15afa0 con 0x7f277c15ab30 2024-09-11T22:30:21.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.978+0000 7f2782647640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f277c0c13a0 con 0x7f277c0c9530 2024-09-11T22:30:21.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.978+0000 7f2782647640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f277c0c7a50 con 0x7f277c06fe50 2024-09-11T22:30:21.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.979+0000 7f277bfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f277c06fe50 0x7f277c0b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:21.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.979+0000 7f277bfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f277c06fe50 0x7f277c0b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:43880/0 (socket says 172.21.15.100:43880) 2024-09-11T22:30:21.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.979+0000 7f277bfff640 1 -- 172.21.15.100:0/2694967364 learned_addr learned my addr 172.21.15.100:0/2694967364 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:30:21.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.980+0000 7f277bfff640 1 -- 172.21.15.100:0/2694967364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f277c0c9530 msgr2=0x7f277c0cb260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:30:21.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.980+0000 7f277bfff640 1 --2- 172.21.15.100:0/2694967364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f277c0c9530 0x7f277c0cb260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.980+0000 7f277bfff640 1 -- 172.21.15.100:0/2694967364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f277c15ab30 msgr2=0x7f277c14da30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:30:21.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.980+0000 7f277bfff640 1 --2- 172.21.15.100:0/2694967364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f277c15ab30 0x7f277c14da30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:21.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.980+0000 7f277bfff640 1 -- 172.21.15.100:0/2694967364 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f277c0c6510 con 0x7f277c06fe50 2024-09-11T22:30:21.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.980+0000 7f277bfff640 1 --2- 172.21.15.100:0/2694967364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f277c06fe50 0x7f277c0b0c90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f277400c5d0 tx=0x7f277400ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:21.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.981+0000 7f2778ff9640 1 -- 172.21.15.100:0/2694967364 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27740070d0 con 0x7f277c06fe50 2024-09-11T22:30:21.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.981+0000 7f2782647640 1 -- 172.21.15.100:0/2694967364 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f277c0c3b10 con 0x7f277c06fe50 2024-09-11T22:30:21.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.981+0000 7f2782647640 1 -- 172.21.15.100:0/2694967364 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f277c0c40d0 con 0x7f277c06fe50 2024-09-11T22:30:21.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.982+0000 7f2778ff9640 1 -- 172.21.15.100:0/2694967364 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2774019030 con 0x7f277c06fe50 2024-09-11T22:30:21.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.982+0000 7f2778ff9640 1 -- 172.21.15.100:0/2694967364 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27740074b0 con 0x7f277c06fe50 2024-09-11T22:30:21.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.984+0000 7f2782647640 1 --2- 172.21.15.100:0/2694967364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f275c002a70 0x7f275c004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:21.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.984+0000 7f2782647640 1 -- 172.21.15.100:0/2694967364 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f275c007ec0 con 0x7f275c002a70 2024-09-11T22:30:21.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.985+0000 7f277b7fe640 1 --2- 172.21.15.100:0/2694967364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f275c002a70 0x7f275c004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:21.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.986+0000 7f2778ff9640 1 -- 172.21.15.100:0/2694967364 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f27740047e0 con 0x7f277c06fe50 2024-09-11T22:30:21.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.987+0000 7f277b7fe640 1 -- 172.21.15.100:0/2694967364 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f275c0080c0 con 0x7f275c002a70 2024-09-11T22:30:21.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.987+0000 7f2778ff9640 1 --2- 172.21.15.100:0/2694967364 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f276806bf00 0x7f276806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:21.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.988+0000 7f277b7fe640 1 --2- 172.21.15.100:0/2694967364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f275c002a70 0x7f275c004f30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f277c0c6720 tx=0x7f277000cb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:21.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.988+0000 7f2778ff9640 1 -- 172.21.15.100:0/2694967364 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f277408ade0 con 0x7f277c06fe50 2024-09-11T22:30:21.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.989+0000 7f2780be4640 1 --2- 172.21.15.100:0/2694967364 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f276806bf00 0x7f276806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:21.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.990+0000 7f2780be4640 1 --2- 172.21.15.100:0/2694967364 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f276806bf00 0x7f276806e3c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f276c035000 tx=0x7f276c00b000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:21.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.990+0000 7f2778ff9640 1 -- 172.21.15.100:0/2694967364 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2770015070 con 0x7f275c002a70 2024-09-11T22:30:21.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.990+0000 7f2778ff9640 1 -- 172.21.15.100:0/2694967364 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2770007860 con 0x7f275c002a70 2024-09-11T22:30:21.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.990+0000 7f2778ff9640 1 -- 172.21.15.100:0/2694967364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f275c002a70 msgr2=0x7f275c004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:21.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.990+0000 7f2778ff9640 1 --2- 172.21.15.100:0/2694967364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f275c002a70 0x7f275c004f30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f277c0c6720 tx=0x7f277000cb80 comp rx=0 tx=0).stop 2024-09-11T22:30:21.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.990+0000 7f2778ff9640 1 -- 172.21.15.100:0/2694967364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f275c002a70 msgr2=0x7f275c004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:30:21.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:21.991+0000 7f2778ff9640 1 --2- 172.21.15.100:0/2694967364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f275c002a70 0x7f275c004f30 secure :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f277c0c6720 tx=0x7f277000cb80 comp rx=0 tx=0).stop 2024-09-11T22:30:22.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.016+0000 7f2782647640 1 --2- 172.21.15.100:0/2694967364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f275c006f00 0x7f275c007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:22.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.016+0000 7f2782647640 1 -- 172.21.15.100:0/2694967364 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f275c00a4a0 con 0x7f275c006f00 2024-09-11T22:30:22.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.018+0000 7f277b7fe640 1 --2- 172.21.15.100:0/2694967364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f275c006f00 0x7f275c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:22.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.018+0000 7f277b7fe640 1 -- 172.21.15.100:0/2694967364 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f275c0078d0 con 0x7f275c006f00 2024-09-11T22:30:22.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.020+0000 7f277b7fe640 1 --2- 172.21.15.100:0/2694967364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f275c006f00 0x7f275c007390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2770006fd0 tx=0x7f2770004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:22.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.020+0000 7f2778ff9640 1 -- 172.21.15.100:0/2694967364 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2770028020 con 0x7f275c006f00 2024-09-11T22:30:22.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.020+0000 7f2778ff9640 1 -- 172.21.15.100:0/2694967364 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4887 (secure 0 0 0) 0x7f277001ae00 con 0x7f275c006f00 2024-09-11T22:30:22.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.020+0000 7f2778ff9640 1 -- 172.21.15.100:0/2694967364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f275c006f00 msgr2=0x7f275c007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:22.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.020+0000 7f2778ff9640 1 --2- 172.21.15.100:0/2694967364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f275c006f00 0x7f275c007390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2770006fd0 tx=0x7f2770004730 comp rx=0 tx=0).stop 2024-09-11T22:30:22.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.021+0000 7f2778ff9640 1 -- 172.21.15.100:0/2694967364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f275c006f00 msgr2=0x7f275c007390 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:30:22.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.021+0000 7f2778ff9640 1 --2- 172.21.15.100:0/2694967364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f275c006f00 0x7f275c007390 secure :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2770006fd0 tx=0x7f2770004730 comp rx=0 tx=0).stop 2024-09-11T22:30:22.023 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:30:22.023 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:30:22.023 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:30:22.023 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:30:22.023 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 72, 2024-09-11T22:30:22.023 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 407298, 2024-09-11T22:30:22.023 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:30:22.023 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:30:22.023 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:30:22.023 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:30:22.023 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:22.023 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 2, 2024-09-11T22:30:22.023 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:30:22.024 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:30:22.024 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:30:22.024 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:22.024 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:22.024 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:22.024 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:22.024 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:22.024 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:22.024 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:22.024 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:22.024 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:22.024 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:22.024 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:22.025 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:22.025 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:30:22.025 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:30:22.025 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:22.025 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:22.025 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:22.025 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:22.025 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:22.025 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:22.025 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:22.025 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:22.025 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:22.025 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:22.025 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:22.026 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:22.026 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.026 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:30:22.026 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:30:22.026 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:30:22.026 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:30:22.026 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:30:22.026 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:30:22.026 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:30:22.026 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:30:22.026 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:30:22.026 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:30:22.026 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:30:22.027 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:30:22.027 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:30:22.027 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:30:22.027 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:30:22.027 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:30:22.027 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:30:22.027 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:22.027 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:22.027 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:22.027 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:22.027 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:22.028 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:22.028 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:22.028 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:22.028 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:22.028 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:22.028 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:22.028 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:22.028 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:30:22.029 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.029 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:30:22.029 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.029 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:30:22.029 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:30:22.029 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:22.029 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:22.029 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.029 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:22.029 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:30:22.030 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:22.030 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.030 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.030 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:22.030 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:30:22.030 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:22.031 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:22.031 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:22.031 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.031 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:30:22.031 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:30:22.031 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:22.031 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:22.031 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:22.031 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.031 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.031 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:30:22.031 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:30:22.031 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:22.032 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:22.032 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.032 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:22.032 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:30:22.032 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:22.032 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.032 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.032 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:22.032 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:30:22.032 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:22.032 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:22.032 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:22.032 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.033 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:30:22.033 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:30:22.033 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:22.033 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:22.033 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:22.033 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.033 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.033 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:30:22.033 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:30:22.033 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:22.033 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:22.033 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.033 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:22.034 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:30:22.034 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:22.034 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.034 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.034 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:22.034 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:30:22.034 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:22.034 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:22.034 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:22.034 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.034 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:30:22.034 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:30:22.034 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:22.034 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:22.035 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:22.035 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:22.035 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:22.035 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.035 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:30:22.035 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:30:22.035 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.035 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:22.035 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:22.035 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:30:22.035 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:22.035 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:22.035 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:30:22.036 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.036 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:22.036 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:22.036 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:30:22.036 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:22.036 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:22.036 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:30:22.036 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.036 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:22.036 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:22.036 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:30:22.036 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:22.036 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:22.036 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:30:22.037 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.037 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:22.037 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:22.037 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:30:22.037 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:22.037 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:22.037 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.037 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:30:22.037 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:30:22.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.021+0000 7f2782647640 1 -- 172.21.15.100:0/2694967364 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f276806bf00 msgr2=0x7f276806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:22.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.021+0000 7f2782647640 1 --2- 172.21.15.100:0/2694967364 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f276806bf00 0x7f276806e3c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f276c035000 tx=0x7f276c00b000 comp rx=0 tx=0).stop 2024-09-11T22:30:22.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.021+0000 7f2780be4640 1 -- 172.21.15.100:0/2694967364 reap_dead start 2024-09-11T22:30:22.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.021+0000 7f2782647640 1 -- 172.21.15.100:0/2694967364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f277c06fe50 msgr2=0x7f277c0b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:22.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.021+0000 7f2782647640 1 --2- 172.21.15.100:0/2694967364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f277c06fe50 0x7f277c0b0c90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f277400c5d0 tx=0x7f277400ca90 comp rx=0 tx=0).stop 2024-09-11T22:30:22.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.022+0000 7f2782647640 1 -- 172.21.15.100:0/2694967364 shutdown_connections 2024-09-11T22:30:22.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.022+0000 7f2782647640 1 --2- 172.21.15.100:0/2694967364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f277c06fe50 0x7f277c0b0c90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:22.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.022+0000 7f2782647640 1 -- 172.21.15.100:0/2694967364 >> 172.21.15.100:0/2694967364 conn(0x7f277c06f360 msgr2=0x7f277c14e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:22.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.022+0000 7f2782647640 1 -- 172.21.15.100:0/2694967364 shutdown_connections 2024-09-11T22:30:22.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.022+0000 7f2782647640 1 -- 172.21.15.100:0/2694967364 wait complete. 2024-09-11T22:30:22.042 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:30:22.042 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:30:22.042 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:30:22.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.275+0000 7fb2dba5e640 1 Processor -- start 2024-09-11T22:30:22.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.275+0000 7fb2dba5e640 1 -- start start 2024-09-11T22:30:22.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.276+0000 7fb2dba5e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc0d4940 0x7fb2cc005a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:22.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.276+0000 7fb2dba5e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb2cc0450f0 0x7fb2cc0ddc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:22.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.276+0000 7fb2dba5e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2cc04aa40 con 0x7fb2cc04c090 2024-09-11T22:30:22.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.276+0000 7fb2dba5e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb2cc044c60 con 0x7fb2cc0450f0 2024-09-11T22:30:22.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.276+0000 7fb2dba5e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb2cc04ace0 con 0x7fb2cc0d4940 2024-09-11T22:30:22.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.276+0000 7fb2d9ffb640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb2cc04c090 0x7fb2cc0de190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44718/0 (socket says 172.21.15.100:44718) 2024-09-11T22:30:22.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.276+0000 7fb2d9ffb640 1 -- 172.21.15.100:0/1958926010 learned_addr learned my addr 172.21.15.100:0/1958926010 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:30:22.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.277+0000 7fb2d8ff9640 1 --2- 172.21.15.100:0/1958926010 >> v2:172.21.15.100:3300/0 conn(0x7fb2cc0450f0 0x7fb2cc0ddc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:22.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.277+0000 7fb2cbfff640 1 -- 172.21.15.100:0/1958926010 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3751647635 0 0) 0x7fb2cc04aa40 con 0x7fb2cc04c090 2024-09-11T22:30:22.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.277+0000 7fb2cbfff640 1 -- 172.21.15.100:0/1958926010 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2c0003520 con 0x7fb2cc04c090 2024-09-11T22:30:22.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.278+0000 7fb2cbfff640 1 -- 172.21.15.100:0/1958926010 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 539603121 0 0) 0x7fb2c0003520 con 0x7fb2cc04c090 2024-09-11T22:30:22.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.278+0000 7fb2cbfff640 1 -- 172.21.15.100:0/1958926010 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc0d4940 msgr2=0x7fb2cc005a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:22.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.278+0000 7fb2cbfff640 1 --2- 172.21.15.100:0/1958926010 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc0d4940 0x7fb2cc005a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:22.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.278+0000 7fb2cbfff640 1 -- 172.21.15.100:0/1958926010 >> v2:172.21.15.100:3300/0 conn(0x7fb2cc0450f0 msgr2=0x7fb2cc0ddc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:22.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.282+0000 7fb2cbfff640 1 --2- 172.21.15.100:0/1958926010 >> v2:172.21.15.100:3300/0 conn(0x7fb2cc0450f0 0x7fb2cc0ddc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:22.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.282+0000 7fb2cbfff640 1 -- 172.21.15.100:0/1958926010 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2cc04afa0 con 0x7fb2cc04c090 2024-09-11T22:30:22.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.282+0000 7fb2cbfff640 1 -- 172.21.15.100:0/1958926010 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fb2d4063850 con 0x7fb2cc04c090 2024-09-11T22:30:22.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.282+0000 7fb2cbfff640 1 -- 172.21.15.100:0/1958926010 >> v1:172.21.15.100:6789/0 conn(0x7fb2cc04c090 legacy=0x7fb2cc0de190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:22.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.282+0000 7fb2cbfff640 1 --2- 172.21.15.100:0/1958926010 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc0d4940 0x7fb2c00039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:22.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.282+0000 7fb2cbfff640 1 --2- 172.21.15.100:0/1958926010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2c00040e0 0x7fb2c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:22.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.282+0000 7fb2cbfff640 1 --2- 172.21.15.100:0/1958926010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2c0004dd0 0x7fb2c0005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:22.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.282+0000 7fb2cbfff640 1 -- 172.21.15.100:0/1958926010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc044c60 con 0x7fb2c0004dd0 2024-09-11T22:30:22.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.282+0000 7fb2cbfff640 1 -- 172.21.15.100:0/1958926010 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc04ace0 con 0x7fb2c00040e0 2024-09-11T22:30:22.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.282+0000 7fb2cbfff640 1 -- 172.21.15.100:0/1958926010 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb2c000bce0 con 0x7fb2cc0d4940 2024-09-11T22:30:22.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.282+0000 7fb2d8ff9640 1 --2- 172.21.15.100:0/1958926010 >> v2:172.21.15.100:3300/0 conn(0x7fb2cc0450f0 0x7fb2cc0ddc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:30:22.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.282+0000 7fb2d9ffb640 1 --2- 172.21.15.100:0/1958926010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2c0004dd0 0x7fb2c0005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:22.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.282+0000 7fb2d9ffb640 1 -- 172.21.15.100:0/1958926010 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc0d4940 msgr2=0x7fb2c00039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:22.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.282+0000 7fb2d9ffb640 1 --2- 172.21.15.100:0/1958926010 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc0d4940 0x7fb2c00039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:22.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.282+0000 7fb2d9ffb640 1 -- 172.21.15.100:0/1958926010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2c00040e0 msgr2=0x7fb2c0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:22.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.282+0000 7fb2d9ffb640 1 --2- 172.21.15.100:0/1958926010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2c00040e0 0x7fb2c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:22.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.282+0000 7fb2d9ffb640 1 -- 172.21.15.100:0/1958926010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2cc04afa0 con 0x7fb2c0004dd0 2024-09-11T22:30:22.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.285+0000 7fb2d9ffb640 1 --2- 172.21.15.100:0/1958926010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2c0004dd0 0x7fb2c0005250 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4051500 tx=0x7fb2c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a259dc14e99acf25 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:22.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.285+0000 7fb2cbfff640 1 -- 172.21.15.100:0/1958926010 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4068db0 con 0x7fb2c0004dd0 2024-09-11T22:30:22.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.285+0000 7fb2cbfff640 1 -- 172.21.15.100:0/1958926010 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2d4074e50 con 0x7fb2c0004dd0 2024-09-11T22:30:22.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.286+0000 7fb2dba5e640 1 -- 172.21.15.100:0/1958926010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2c0004dd0 msgr2=0x7fb2c0005250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:22.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.286+0000 7fb2dba5e640 1 --2- 172.21.15.100:0/1958926010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2c0004dd0 0x7fb2c0005250 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4051500 tx=0x7fb2c0005830 comp rx=0 tx=0).stop 2024-09-11T22:30:22.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.286+0000 7fb2d9ffb640 1 -- 172.21.15.100:0/1958926010 reap_dead start 2024-09-11T22:30:22.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.287+0000 7fb2dba5e640 1 -- 172.21.15.100:0/1958926010 shutdown_connections 2024-09-11T22:30:22.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.287+0000 7fb2dba5e640 1 -- 172.21.15.100:0/1958926010 >> 172.21.15.100:0/1958926010 conn(0x7fb2cc04fc50 msgr2=0x7fb2cc050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:22.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.287+0000 7fb2dba5e640 1 -- 172.21.15.100:0/1958926010 shutdown_connections 2024-09-11T22:30:22.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.287+0000 7fb2dba5e640 1 -- 172.21.15.100:0/1958926010 wait complete. 2024-09-11T22:30:22.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.289+0000 7fb2dba5e640 1 Processor -- start 2024-09-11T22:30:22.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.289+0000 7fb2dba5e640 1 -- start start 2024-09-11T22:30:22.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.290+0000 7fb2dba5e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2cc190a50 0x7fb2cc0d6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:22.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.290+0000 7fb2dba5e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2cc034580 0x7fb2cc0349e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:22.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.290+0000 7fb2dba5e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc196b90 0x7fb2cc197010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:22.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.290+0000 7fb2dba5e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc046770 con 0x7fb2cc034580 2024-09-11T22:30:22.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.290+0000 7fb2dba5e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc046490 con 0x7fb2cc190a50 2024-09-11T22:30:22.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.290+0000 7fb2dba5e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb2cc04b2e0 con 0x7fb2cc196b90 2024-09-11T22:30:22.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.291+0000 7fb2d97fa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2cc190a50 0x7fb2cc0d6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:22.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.291+0000 7fb2d97fa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2cc190a50 0x7fb2cc0d6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:46568/0 (socket says 172.21.15.100:46568) 2024-09-11T22:30:22.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.291+0000 7fb2d97fa640 1 -- 172.21.15.100:0/2976901240 learned_addr learned my addr 172.21.15.100:0/2976901240 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:30:22.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.291+0000 7fb2d8ff9640 1 --2- 172.21.15.100:0/2976901240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2cc034580 0x7fb2cc0349e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:22.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.291+0000 7fb2d9ffb640 1 --2- 172.21.15.100:0/2976901240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc196b90 0x7fb2cc197010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:22.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.291+0000 7fb2d97fa640 1 -- 172.21.15.100:0/2976901240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc196b90 msgr2=0x7fb2cc197010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:22.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.291+0000 7fb2d97fa640 1 --2- 172.21.15.100:0/2976901240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc196b90 0x7fb2cc197010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:22.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.291+0000 7fb2d97fa640 1 -- 172.21.15.100:0/2976901240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2cc034580 msgr2=0x7fb2cc0349e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:22.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.291+0000 7fb2d97fa640 1 --2- 172.21.15.100:0/2976901240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2cc034580 0x7fb2cc0349e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:22.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.291+0000 7fb2d97fa640 1 -- 172.21.15.100:0/2976901240 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2cc197550 con 0x7fb2cc190a50 2024-09-11T22:30:22.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.291+0000 7fb2d8ff9640 1 --2- 172.21.15.100:0/2976901240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2cc034580 0x7fb2cc0349e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:30:22.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.292+0000 7fb2d97fa640 1 --2- 172.21.15.100:0/2976901240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2cc190a50 0x7fb2cc0d6910 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000b480 tx=0x7fb2d000b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:22.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.292+0000 7fb2c9ffb640 1 -- 172.21.15.100:0/2976901240 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0014070 con 0x7fb2cc190a50 2024-09-11T22:30:22.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.292+0000 7fb2c9ffb640 1 -- 172.21.15.100:0/2976901240 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2d0010870 con 0x7fb2cc190a50 2024-09-11T22:30:22.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.292+0000 7fb2c9ffb640 1 -- 172.21.15.100:0/2976901240 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0010c40 con 0x7fb2cc190a50 2024-09-11T22:30:22.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.292+0000 7fb2dba5e640 1 -- 172.21.15.100:0/2976901240 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2cc0d5d10 con 0x7fb2cc190a50 2024-09-11T22:30:22.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.292+0000 7fb2dba5e640 1 -- 172.21.15.100:0/2976901240 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2cc0d5470 con 0x7fb2cc190a50 2024-09-11T22:30:22.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.299+0000 7fb2dba5e640 1 --2- 172.21.15.100:0/2976901240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc0d56b0 0x7fb2cc0cae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:22.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.299+0000 7fb2dba5e640 1 -- 172.21.15.100:0/2976901240 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb2cc0d8150 con 0x7fb2cc0d56b0 2024-09-11T22:30:22.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.299+0000 7fb2d8ff9640 1 --2- 172.21.15.100:0/2976901240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc0d56b0 0x7fb2cc0cae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:22.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.299+0000 7fb2c9ffb640 1 -- 172.21.15.100:0/2976901240 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb2d0017070 con 0x7fb2cc190a50 2024-09-11T22:30:22.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.300+0000 7fb2c9ffb640 1 --2- 172.21.15.100:0/2976901240 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb2b806bea0 0x7fb2b806e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:22.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.300+0000 7fb2c9ffb640 1 -- 172.21.15.100:0/2976901240 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fb2d008afc0 con 0x7fb2cc190a50 2024-09-11T22:30:22.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.300+0000 7fb2d8ff9640 1 -- 172.21.15.100:0/2976901240 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb2cc0d4d20 con 0x7fb2cc0d56b0 2024-09-11T22:30:22.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.301+0000 7fb2d9ffb640 1 --2- 172.21.15.100:0/2976901240 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb2b806bea0 0x7fb2b806e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:22.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.301+0000 7fb2d8ff9640 1 --2- 172.21.15.100:0/2976901240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc0d56b0 0x7fb2cc0cae40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc036090 tx=0x7fb2c400eb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:22.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.302+0000 7fb2c9ffb640 1 -- 172.21.15.100:0/2976901240 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4019030 con 0x7fb2cc0d56b0 2024-09-11T22:30:22.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.302+0000 7fb2c9ffb640 1 -- 172.21.15.100:0/2976901240 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb2c4004020 con 0x7fb2cc0d56b0 2024-09-11T22:30:22.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.302+0000 7fb2c9ffb640 1 -- 172.21.15.100:0/2976901240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc0d56b0 msgr2=0x7fb2cc0cae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:22.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.302+0000 7fb2c9ffb640 1 --2- 172.21.15.100:0/2976901240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc0d56b0 0x7fb2cc0cae40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc036090 tx=0x7fb2c400eb90 comp rx=0 tx=0).stop 2024-09-11T22:30:22.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.302+0000 7fb2c9ffb640 1 -- 172.21.15.100:0/2976901240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc0d56b0 msgr2=0x7fb2cc0cae40 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:30:22.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.302+0000 7fb2c9ffb640 1 --2- 172.21.15.100:0/2976901240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc0d56b0 0x7fb2cc0cae40 secure :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc036090 tx=0x7fb2c400eb90 comp rx=0 tx=0).stop 2024-09-11T22:30:22.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.303+0000 7fb2d9ffb640 1 --2- 172.21.15.100:0/2976901240 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb2b806bea0 0x7fb2b806e360 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000bc30 tx=0x7fb2d407e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:22.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.318+0000 7fb2dba5e640 1 --2- 172.21.15.100:0/2976901240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc0cb380 0x7fb2cc0cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:22.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.318+0000 7fb2dba5e640 1 -- 172.21.15.100:0/2976901240 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb2cc196840 con 0x7fb2cc0cb380 2024-09-11T22:30:22.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.320+0000 7fb2d8ff9640 1 --2- 172.21.15.100:0/2976901240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc0cb380 0x7fb2cc0cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:22.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.321+0000 7fb2d8ff9640 1 -- 172.21.15.100:0/2976901240 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb2cc04bc60 con 0x7fb2cc0cb380 2024-09-11T22:30:22.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.322+0000 7fb2d8ff9640 1 --2- 172.21.15.100:0/2976901240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc0cb380 0x7fb2cc0cb7f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc036090 tx=0x7fb2c4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:22.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.322+0000 7fb2c9ffb640 1 -- 172.21.15.100:0/2976901240 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c400ab50 con 0x7fb2cc0cb380 2024-09-11T22:30:22.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.323+0000 7fb2c9ffb640 1 -- 172.21.15.100:0/2976901240 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7fb2c400ab50 con 0x7fb2cc0cb380 2024-09-11T22:30:22.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.323+0000 7fb2c9ffb640 1 -- 172.21.15.100:0/2976901240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc0cb380 msgr2=0x7fb2cc0cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:22.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.323+0000 7fb2c9ffb640 1 --2- 172.21.15.100:0/2976901240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc0cb380 0x7fb2cc0cb7f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc036090 tx=0x7fb2c4004730 comp rx=0 tx=0).stop 2024-09-11T22:30:22.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.323+0000 7fb2c9ffb640 1 -- 172.21.15.100:0/2976901240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc0cb380 msgr2=0x7fb2cc0cb7f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:30:22.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.323+0000 7fb2c9ffb640 1 --2- 172.21.15.100:0/2976901240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2cc0cb380 0x7fb2cc0cb7f0 secure :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc036090 tx=0x7fb2c4004730 comp rx=0 tx=0).stop 2024-09-11T22:30:22.325 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:30:22.325 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:30:22.325 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:30:22.325 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:30:22.325 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 72, 2024-09-11T22:30:22.325 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 513044, 2024-09-11T22:30:22.325 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:30:22.325 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:30:22.325 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:30:22.326 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:30:22.326 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:22.326 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 2, 2024-09-11T22:30:22.326 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:30:22.326 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:30:22.326 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:30:22.326 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:22.326 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:22.326 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:22.326 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:22.326 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:22.326 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:22.326 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:22.326 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:22.327 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:22.327 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:22.327 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:22.327 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:22.327 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:30:22.327 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:30:22.327 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:22.327 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:22.327 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:22.327 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:22.327 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:22.327 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:22.327 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:22.328 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:22.328 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:22.328 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:22.328 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:22.328 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:22.328 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.328 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:30:22.328 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:30:22.328 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:30:22.328 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:30:22.328 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:30:22.328 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:30:22.328 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:30:22.328 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:30:22.329 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:30:22.329 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:30:22.329 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:30:22.329 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:30:22.329 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:30:22.329 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:30:22.329 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:30:22.329 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:30:22.329 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:30:22.329 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:22.329 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:22.329 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:22.329 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:22.330 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:22.330 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:22.330 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:22.330 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:22.330 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:22.330 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:22.330 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:22.330 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:22.330 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:30:22.330 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.330 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:30:22.330 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.330 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:30:22.330 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:30:22.331 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:22.331 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:22.331 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.331 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:22.331 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:30:22.331 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:22.331 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.331 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.331 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:22.331 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:30:22.331 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:22.331 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:22.331 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:22.331 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.332 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:30:22.332 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:30:22.332 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:22.332 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:22.332 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:22.332 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.332 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.332 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:30:22.332 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:30:22.332 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:22.332 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:22.332 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.332 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:22.333 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:30:22.333 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:22.333 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.333 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.333 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:22.333 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:30:22.333 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:22.333 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:22.333 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:22.333 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.333 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:30:22.333 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:30:22.333 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:22.333 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:22.334 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:22.334 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.334 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.334 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:30:22.334 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:30:22.334 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:22.334 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:22.334 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.334 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:22.334 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:30:22.334 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:22.334 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.334 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.335 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:22.335 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:30:22.335 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:22.335 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:22.335 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:22.335 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.335 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:30:22.335 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:30:22.335 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:22.335 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:22.335 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:22.335 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:22.335 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:22.335 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.336 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:30:22.336 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:30:22.336 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.336 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:22.336 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:22.336 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:30:22.336 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:22.336 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:22.336 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:30:22.336 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.336 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:22.336 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:22.336 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:30:22.337 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:22.337 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:22.337 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:30:22.337 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.337 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:22.337 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:22.337 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:30:22.337 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:22.337 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:22.338 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:30:22.338 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.338 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:22.338 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:22.338 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:30:22.338 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:22.338 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:22.338 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:30:22.338 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:22.338 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:22.338 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:22.338 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:30:22.338 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:22.339 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:22.339 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:22.339 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:30:22.339 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:30:22.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.324+0000 7fb2dba5e640 1 -- 172.21.15.100:0/2976901240 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb2b806bea0 msgr2=0x7fb2b806e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:22.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.324+0000 7fb2dba5e640 1 --2- 172.21.15.100:0/2976901240 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb2b806bea0 0x7fb2b806e360 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000bc30 tx=0x7fb2d407e040 comp rx=0 tx=0).stop 2024-09-11T22:30:22.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.324+0000 7fb2d9ffb640 1 -- 172.21.15.100:0/2976901240 reap_dead start 2024-09-11T22:30:22.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.324+0000 7fb2dba5e640 1 -- 172.21.15.100:0/2976901240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2cc190a50 msgr2=0x7fb2cc0d6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:22.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.324+0000 7fb2dba5e640 1 --2- 172.21.15.100:0/2976901240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2cc190a50 0x7fb2cc0d6910 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb2d000b480 tx=0x7fb2d000b940 comp rx=0 tx=0).stop 2024-09-11T22:30:22.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.324+0000 7fb2dba5e640 1 -- 172.21.15.100:0/2976901240 shutdown_connections 2024-09-11T22:30:22.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.325+0000 7fb2dba5e640 1 --2- 172.21.15.100:0/2976901240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2cc190a50 0x7fb2cc0d6910 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:22.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.325+0000 7fb2dba5e640 1 -- 172.21.15.100:0/2976901240 >> 172.21.15.100:0/2976901240 conn(0x7fb2cc04fc50 msgr2=0x7fb2cc006dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:22.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.325+0000 7fb2dba5e640 1 -- 172.21.15.100:0/2976901240 shutdown_connections 2024-09-11T22:30:22.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.325+0000 7fb2dba5e640 1 -- 172.21.15.100:0/2976901240 wait complete. 2024-09-11T22:30:22.351 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:30:22.352 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-11T22:30:22.352 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-11T22:30:22.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.556+0000 7fecc88e6640 1 Processor -- start 2024-09-11T22:30:22.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.557+0000 7fecc88e6640 1 -- start start 2024-09-11T22:30:22.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.559+0000 7fecc88e6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fecc406bc10 0x7fecc406c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:22.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.559+0000 7fecc88e6640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc40c2b90 con 0x7fecc40b1860 2024-09-11T22:30:22.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.559+0000 7fecc88e6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc40c2e70 con 0x7fecc40c9500 2024-09-11T22:30:22.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.559+0000 7fecc88e6640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fecc406c560 con 0x7fecc406bc10 2024-09-11T22:30:22.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.559+0000 7fecc259c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fecc40c9500 0x7fecc40b1db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:38968/0 (socket says 172.21.15.100:38968) 2024-09-11T22:30:22.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.559+0000 7fecc259c640 1 -- 172.21.15.100:0/2240830606 learned_addr learned my addr 172.21.15.100:0/2240830606 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:30:22.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.560+0000 7fecc2d9d640 1 --2- 172.21.15.100:0/2240830606 >> v2:172.21.15.100:3300/0 conn(0x7fecc406bc10 0x7fecc406c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:22.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.560+0000 7fecc159a640 1 -- 172.21.15.100:0/2240830606 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 92045604 0 0) 0x7fecc40c2e70 con 0x7fecc40c9500 2024-09-11T22:30:22.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.560+0000 7fecc159a640 1 -- 172.21.15.100:0/2240830606 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecac003520 con 0x7fecc40c9500 2024-09-11T22:30:22.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.562+0000 7fecc159a640 1 -- 172.21.15.100:0/2240830606 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1252876516 0 0) 0x7fecac003520 con 0x7fecc40c9500 2024-09-11T22:30:22.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.562+0000 7fecc2d9d640 1 -- 172.21.15.100:0/2240830606 >> v1:172.21.15.167:6789/0 conn(0x7fecc40c9500 legacy=0x7fecc40b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:22.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.562+0000 7fecc2d9d640 1 -- 172.21.15.100:0/2240830606 >> v1:172.21.15.100:6789/0 conn(0x7fecc40b1860 legacy=0x7fecc40c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:22.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.562+0000 7fecc2d9d640 1 -- 172.21.15.100:0/2240830606 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc406ccb0 con 0x7fecc406bc10 2024-09-11T22:30:22.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.563+0000 7fecc2d9d640 1 --2- 172.21.15.100:0/2240830606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecc406bc10 0x7fecc406c020 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fecc406c6e0 tx=0x7fecbc02a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c29c404836eab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:22.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.564+0000 7fecc159a640 1 -- 172.21.15.100:0/2240830606 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc035020 con 0x7fecc406bc10 2024-09-11T22:30:22.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.564+0000 7fecc159a640 1 -- 172.21.15.100:0/2240830606 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecbc007540 con 0x7fecc406bc10 2024-09-11T22:30:22.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.564+0000 7fecc159a640 1 -- 172.21.15.100:0/2240830606 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb4001670 con 0x7fecc406bc10 2024-09-11T22:30:22.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.565+0000 7fecc88e6640 1 -- 172.21.15.100:0/2240830606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecc406bc10 msgr2=0x7fecc406c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:22.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.565+0000 7fecc88e6640 1 --2- 172.21.15.100:0/2240830606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecc406bc10 0x7fecc406c020 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fecc406c6e0 tx=0x7fecbc02a630 comp rx=0 tx=0).stop 2024-09-11T22:30:22.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.565+0000 7fecc88e6640 1 -- 172.21.15.100:0/2240830606 shutdown_connections 2024-09-11T22:30:22.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.565+0000 7fecc88e6640 1 --2- 172.21.15.100:0/2240830606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecc406bc10 0x7fecc406c020 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:22.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.565+0000 7fecc88e6640 1 -- 172.21.15.100:0/2240830606 >> 172.21.15.100:0/2240830606 conn(0x7fecc40c89e0 msgr2=0x7fecc40c8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.566+0000 7fecc88e6640 1 -- 172.21.15.100:0/2240830606 shutdown_connections 2024-09-11T22:30:22.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.566+0000 7fecc88e6640 1 -- 172.21.15.100:0/2240830606 wait complete. 2024-09-11T22:30:22.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.568+0000 7fecc88e6640 1 Processor -- start 2024-09-11T22:30:22.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.568+0000 7fecc88e6640 1 -- start start 2024-09-11T22:30:22.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.570+0000 7fecc88e6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecc406bc10 0x7fecc41539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:22.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.570+0000 7fecc88e6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecc40b1860 0x7fecc414b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:22.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.570+0000 7fecc1d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecc40b1860 0x7fecc414b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:22.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.571+0000 7fecc1d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecc40b1860 0x7fecc414b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33812/0 (socket says 172.21.15.100:33812) 2024-09-11T22:30:22.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.571+0000 7fecc259c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecc406bc10 0x7fecc41539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:22.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.571+0000 7fecc259c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecc406bc10 0x7fecc41539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:55128/0 (socket says 172.21.15.100:55128) 2024-09-11T22:30:22.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.571+0000 7fecc1d9b640 1 -- 172.21.15.100:0/3788817414 learned_addr learned my addr 172.21.15.100:0/3788817414 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:30:22.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.571+0000 7fecc88e6640 1 --2- 172.21.15.100:0/3788817414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecc40c9500 0x7fecc414bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:22.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.571+0000 7fecc88e6640 1 -- 172.21.15.100:0/3788817414 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fecc40741b0 con 0x7fecc40b1860 2024-09-11T22:30:22.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.572+0000 7fecc2d9d640 1 --2- 172.21.15.100:0/3788817414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecc40c9500 0x7fecc414bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:22.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.572+0000 7fecc88e6640 1 -- 172.21.15.100:0/3788817414 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fecc406d270 con 0x7fecc40c9500 2024-09-11T22:30:22.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.572+0000 7fecc88e6640 1 -- 172.21.15.100:0/3788817414 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fecc40c8000 con 0x7fecc406bc10 2024-09-11T22:30:22.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.573+0000 7fecc1d9b640 1 -- 172.21.15.100:0/3788817414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecc406bc10 msgr2=0x7fecc41539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:22.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.573+0000 7fecc1d9b640 1 --2- 172.21.15.100:0/3788817414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecc406bc10 0x7fecc41539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:22.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.573+0000 7fecc1d9b640 1 -- 172.21.15.100:0/3788817414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecc40c9500 msgr2=0x7fecc414bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:22.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.573+0000 7fecc1d9b640 1 --2- 172.21.15.100:0/3788817414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecc40c9500 0x7fecc414bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:22.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.573+0000 7fecc1d9b640 1 -- 172.21.15.100:0/3788817414 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc4149710 con 0x7fecc40b1860 2024-09-11T22:30:22.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.573+0000 7fecc1d9b640 1 --2- 172.21.15.100:0/3788817414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecc40b1860 0x7fecc414b980 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fecb800c7e0 tx=0x7fecb800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:22.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.574+0000 7fecb2ffd640 1 -- 172.21.15.100:0/3788817414 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb8005270 con 0x7fecc40b1860 2024-09-11T22:30:22.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.574+0000 7fecb2ffd640 1 -- 172.21.15.100:0/3788817414 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb8005410 con 0x7fecc40b1860 2024-09-11T22:30:22.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.574+0000 7fecb2ffd640 1 -- 172.21.15.100:0/3788817414 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb800a840 con 0x7fecc40b1860 2024-09-11T22:30:22.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.574+0000 7fecc259c640 1 --2- 172.21.15.100:0/3788817414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecc406bc10 0x7fecc41539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:30:22.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.574+0000 7fecc2d9d640 1 --2- 172.21.15.100:0/3788817414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecc40c9500 0x7fecc414bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:30:22.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.575+0000 7fecc88e6640 1 -- 172.21.15.100:0/3788817414 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc4148fa0 con 0x7fecc40b1860 2024-09-11T22:30:22.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.577+0000 7fecc88e6640 1 -- 172.21.15.100:0/3788817414 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc40c7c80 con 0x7fecc40b1860 2024-09-11T22:30:22.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.578+0000 7fecb2ffd640 1 -- 172.21.15.100:0/3788817414 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fecb800a9e0 con 0x7fecc40b1860 2024-09-11T22:30:22.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.579+0000 7fecb2ffd640 1 --2- 172.21.15.100:0/3788817414 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7feca406be80 0x7feca406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:22.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.579+0000 7fecb2ffd640 1 -- 172.21.15.100:0/3788817414 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fecb808f060 con 0x7fecc40b1860 2024-09-11T22:30:22.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.579+0000 7fecc259c640 1 --2- 172.21.15.100:0/3788817414 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7feca406be80 0x7feca406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:22.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.580+0000 7fecc259c640 1 --2- 172.21.15.100:0/3788817414 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7feca406be80 0x7feca406e340 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fecb40011e0 tx=0x7fecb4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:22.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.582+0000 7fecc88e6640 1 -- 172.21.15.100:0/3788817414 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecc406c020 con 0x7fecc40b1860 2024-09-11T22:30:22.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:22.593+0000 7fecb2ffd640 1 -- 172.21.15.100:0/3788817414 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fecb8058d20 con 0x7fecc40b1860 2024-09-11T22:30:23.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:23.169+0000 7fecc88e6640 1 -- 172.21.15.100:0/3788817414 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fecc40c9140 con 0x7fecc40b1860 2024-09-11T22:30:23.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:23.172+0000 7fecb2ffd640 1 -- 172.21.15.100:0/3788817414 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fecb8058620 con 0x7fecc40b1860 2024-09-11T22:30:23.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:23.177+0000 7fecc88e6640 1 -- 172.21.15.100:0/3788817414 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7feca406be80 msgr2=0x7feca406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:23.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:23.177+0000 7fecc88e6640 1 --2- 172.21.15.100:0/3788817414 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7feca406be80 0x7feca406e340 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fecb40011e0 tx=0x7fecb4009040 comp rx=0 tx=0).stop 2024-09-11T22:30:23.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:23.177+0000 7fecc88e6640 1 -- 172.21.15.100:0/3788817414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecc40b1860 msgr2=0x7fecc414b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:23.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:23.177+0000 7fecc88e6640 1 --2- 172.21.15.100:0/3788817414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecc40b1860 0x7fecc414b980 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fecb800c7e0 tx=0x7fecb800cca0 comp rx=0 tx=0).stop 2024-09-11T22:30:23.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:23.178+0000 7fecc88e6640 1 -- 172.21.15.100:0/3788817414 shutdown_connections 2024-09-11T22:30:23.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:23.178+0000 7fecc88e6640 1 --2- 172.21.15.100:0/3788817414 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7feca406be80 0x7feca406e340 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:23.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:23.178+0000 7fecc88e6640 1 --2- 172.21.15.100:0/3788817414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecc40c9500 0x7fecc414bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:23.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:23.178+0000 7fecc88e6640 1 --2- 172.21.15.100:0/3788817414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecc40b1860 0x7fecc414b980 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:23.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:23.178+0000 7fecc88e6640 1 --2- 172.21.15.100:0/3788817414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecc406bc10 0x7fecc41539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:23.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:23.178+0000 7fecc88e6640 1 -- 172.21.15.100:0/3788817414 >> 172.21.15.100:0/3788817414 conn(0x7fecc40c89e0 msgr2=0x7fecc4146cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:23.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:23.178+0000 7fecc88e6640 1 -- 172.21.15.100:0/3788817414 shutdown_connections 2024-09-11T22:30:23.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:23.178+0000 7fecc88e6640 1 -- 172.21.15.100:0/3788817414 wait complete. 2024-09-11T22:30:23.202 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-11T22:30:33.202 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:30:33.203 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:30:33.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.402+0000 7f99aaf1f640 1 Processor -- start 2024-09-11T22:30:33.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.402+0000 7f99aaf1f640 1 -- start start 2024-09-11T22:30:33.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.403+0000 7f99aaf1f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f999c005a20 0x7f999c044b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:33.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.403+0000 7f99aaf1f640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f999c100300 con 0x7f999c0f66b0 2024-09-11T22:30:33.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.403+0000 7f99aaf1f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f999c1005e0 con 0x7f999c04aa60 2024-09-11T22:30:33.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.403+0000 7f99aaf1f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f999c045680 con 0x7f999c005a20 2024-09-11T22:30:33.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.404+0000 7f99a8cbb640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f999c0f66b0 0x7f999c0463b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44766/0 (socket says 172.21.15.100:44766) 2024-09-11T22:30:33.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.404+0000 7f99a8cbb640 1 -- 172.21.15.100:0/2616428036 learned_addr learned my addr 172.21.15.100:0/2616428036 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:30:33.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.404+0000 7f99a94bc640 1 --2- 172.21.15.100:0/2616428036 >> v2:172.21.15.167:3300/0 conn(0x7f999c005a20 0x7f999c044b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:33.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.405+0000 7f99a37fe640 1 -- 172.21.15.100:0/2616428036 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1509183718 0 0) 0x7f999c1005e0 con 0x7f999c04aa60 2024-09-11T22:30:33.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.405+0000 7f99a37fe640 1 -- 172.21.15.100:0/2616428036 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9994003520 con 0x7f999c04aa60 2024-09-11T22:30:33.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.405+0000 7f99a37fe640 1 -- 172.21.15.100:0/2616428036 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 61100113 0 0) 0x7f999c100300 con 0x7f999c0f66b0 2024-09-11T22:30:33.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.407+0000 7f99a94bc640 1 -- 172.21.15.100:0/2616428036 >> v1:172.21.15.167:6789/0 conn(0x7f999c04aa60 legacy=0x7f999c0ff850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:33.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.407+0000 7f99a94bc640 1 -- 172.21.15.100:0/2616428036 >> v1:172.21.15.100:6789/0 conn(0x7f999c0f66b0 legacy=0x7f999c0463b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:33.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.407+0000 7f99a94bc640 1 -- 172.21.15.100:0/2616428036 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f999c0458d0 con 0x7f999c005a20 2024-09-11T22:30:33.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.412+0000 7f99a94bc640 1 --2- 172.21.15.100:0/2616428036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f999c005a20 0x7f999c044b50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9990010b20 tx=0x7f999002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=facae6f352d93046 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:33.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.414+0000 7f99a37fe640 1 -- 172.21.15.100:0/2616428036 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9990030070 con 0x7f999c005a20 2024-09-11T22:30:33.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.414+0000 7f99a37fe640 1 -- 172.21.15.100:0/2616428036 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f999002ad60 con 0x7f999c005a20 2024-09-11T22:30:33.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.415+0000 7f99aaf1f640 1 -- 172.21.15.100:0/2616428036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f999c005a20 msgr2=0x7f999c044b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:33.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.415+0000 7f99aaf1f640 1 --2- 172.21.15.100:0/2616428036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f999c005a20 0x7f999c044b50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9990010b20 tx=0x7f999002a250 comp rx=0 tx=0).stop 2024-09-11T22:30:33.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.416+0000 7f99aaf1f640 1 -- 172.21.15.100:0/2616428036 shutdown_connections 2024-09-11T22:30:33.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.416+0000 7f99aaf1f640 1 --2- 172.21.15.100:0/2616428036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f999c005a20 0x7f999c044b50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.416+0000 7f99aaf1f640 1 -- 172.21.15.100:0/2616428036 >> 172.21.15.100:0/2616428036 conn(0x7f999c04fc70 msgr2=0x7f999c050080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:33.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.418+0000 7f99aaf1f640 1 -- 172.21.15.100:0/2616428036 shutdown_connections 2024-09-11T22:30:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.419+0000 7f99aaf1f640 1 -- 172.21.15.100:0/2616428036 wait complete. 2024-09-11T22:30:33.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.421+0000 7f99aaf1f640 1 Processor -- start 2024-09-11T22:30:33.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.421+0000 7f99aaf1f640 1 -- start start 2024-09-11T22:30:33.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.423+0000 7f99aaf1f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f999c005a20 0x7f999c0f0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.423+0000 7f99aaf1f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f999c04aa60 0x7f999c0ec660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.423+0000 7f99aaf1f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f999c0f66b0 0x7f999c0ecba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.423+0000 7f99aaf1f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f999c0f6a90 con 0x7f999c04aa60 2024-09-11T22:30:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.423+0000 7f99aaf1f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f999c045f20 con 0x7f999c0f66b0 2024-09-11T22:30:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.423+0000 7f99aaf1f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f999c0fff60 con 0x7f999c005a20 2024-09-11T22:30:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.423+0000 7f99a3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f999c04aa60 0x7f999c0ec660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.423+0000 7f99a3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f999c04aa60 0x7f999c0ec660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56912/0 (socket says 172.21.15.100:56912) 2024-09-11T22:30:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.423+0000 7f99a3fff640 1 -- 172.21.15.100:0/2307759226 learned_addr learned my addr 172.21.15.100:0/2307759226 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:30:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.423+0000 7f99a8cbb640 1 --2- 172.21.15.100:0/2307759226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f999c005a20 0x7f999c0f0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.423+0000 7f99a94bc640 1 --2- 172.21.15.100:0/2307759226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f999c0f66b0 0x7f999c0ecba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.424+0000 7f99a3fff640 1 -- 172.21.15.100:0/2307759226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f999c005a20 msgr2=0x7f999c0f0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:33.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.424+0000 7f99a3fff640 1 --2- 172.21.15.100:0/2307759226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f999c005a20 0x7f999c0f0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.424+0000 7f99a3fff640 1 -- 172.21.15.100:0/2307759226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f999c0f66b0 msgr2=0x7f999c0ecba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:33.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.424+0000 7f99a3fff640 1 --2- 172.21.15.100:0/2307759226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f999c0f66b0 0x7f999c0ecba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.424+0000 7f99a3fff640 1 -- 172.21.15.100:0/2307759226 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f999c0f9ae0 con 0x7f999c04aa60 2024-09-11T22:30:33.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.424+0000 7f99a3fff640 1 --2- 172.21.15.100:0/2307759226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f999c04aa60 0x7f999c0ec660 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f99a406a840 tx=0x7f99a40714b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:33.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.424+0000 7f99a17fa640 1 -- 172.21.15.100:0/2307759226 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a4080070 con 0x7f999c04aa60 2024-09-11T22:30:33.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.424+0000 7f99a17fa640 1 -- 172.21.15.100:0/2307759226 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99a4071b30 con 0x7f999c04aa60 2024-09-11T22:30:33.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.424+0000 7f99a17fa640 1 -- 172.21.15.100:0/2307759226 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a40843b0 con 0x7f999c04aa60 2024-09-11T22:30:33.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.424+0000 7f99aaf1f640 1 -- 172.21.15.100:0/2307759226 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f999c0f8c20 con 0x7f999c04aa60 2024-09-11T22:30:33.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.425+0000 7f99aaf1f640 1 -- 172.21.15.100:0/2307759226 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f999c0f8ec0 con 0x7f999c04aa60 2024-09-11T22:30:33.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.426+0000 7f99aaf1f640 1 -- 172.21.15.100:0/2307759226 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f999c0ff850 con 0x7f999c04aa60 2024-09-11T22:30:33.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.427+0000 7f99a17fa640 1 -- 172.21.15.100:0/2307759226 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f99a4083070 con 0x7f999c04aa60 2024-09-11T22:30:33.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.428+0000 7f99a17fa640 1 --2- 172.21.15.100:0/2307759226 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f998806be30 0x7f998806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:33.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.428+0000 7f99a17fa640 1 -- 172.21.15.100:0/2307759226 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f99a40f67d0 con 0x7f999c04aa60 2024-09-11T22:30:33.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.430+0000 7f99a8cbb640 1 --2- 172.21.15.100:0/2307759226 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f998806be30 0x7f998806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:33.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.433+0000 7f99a8cbb640 1 --2- 172.21.15.100:0/2307759226 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f998806be30 0x7f998806e2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f99980049d0 tx=0x7f99980094c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:33.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.442+0000 7f99a17fa640 1 -- 172.21.15.100:0/2307759226 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f99a40c4700 con 0x7f999c04aa60 2024-09-11T22:30:33.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.966+0000 7f99aaf1f640 1 -- 172.21.15.100:0/2307759226 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f999c046ad0 con 0x7f999c04aa60 2024-09-11T22:30:33.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.969+0000 7f99a17fa640 1 -- 172.21.15.100:0/2307759226 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f99a40c8a00 con 0x7f999c04aa60 2024-09-11T22:30:33.972 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":72,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:30:33.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.974+0000 7f99aaf1f640 1 -- 172.21.15.100:0/2307759226 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f998806be30 msgr2=0x7f998806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:33.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.974+0000 7f99aaf1f640 1 --2- 172.21.15.100:0/2307759226 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f998806be30 0x7f998806e2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f99980049d0 tx=0x7f99980094c0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.974+0000 7f99aaf1f640 1 -- 172.21.15.100:0/2307759226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f999c04aa60 msgr2=0x7f999c0ec660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:33.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.974+0000 7f99aaf1f640 1 --2- 172.21.15.100:0/2307759226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f999c04aa60 0x7f999c0ec660 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f99a406a840 tx=0x7f99a40714b0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.975+0000 7f99aaf1f640 1 -- 172.21.15.100:0/2307759226 shutdown_connections 2024-09-11T22:30:33.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.975+0000 7f99aaf1f640 1 --2- 172.21.15.100:0/2307759226 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f998806be30 0x7f998806e2f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.975+0000 7f99aaf1f640 1 --2- 172.21.15.100:0/2307759226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f999c0f66b0 0x7f999c0ecba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.975+0000 7f99aaf1f640 1 --2- 172.21.15.100:0/2307759226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f999c04aa60 0x7f999c0ec660 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.975+0000 7f99aaf1f640 1 --2- 172.21.15.100:0/2307759226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f999c005a20 0x7f999c0f0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:33.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.975+0000 7f99aaf1f640 1 -- 172.21.15.100:0/2307759226 >> 172.21.15.100:0/2307759226 conn(0x7f999c04fc70 msgr2=0x7f999c033e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:33.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.976+0000 7f99aaf1f640 1 -- 172.21.15.100:0/2307759226 shutdown_connections 2024-09-11T22:30:33.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:33.976+0000 7f99aaf1f640 1 -- 172.21.15.100:0/2307759226 wait complete. 2024-09-11T22:30:33.996 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:30:33.996 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-11T22:30:33.996 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:30:33.996 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:30:34.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.140+0000 7f83f7caf640 1 Processor -- start 2024-09-11T22:30:34.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.140+0000 7f83f7caf640 1 -- start start 2024-09-11T22:30:34.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.142+0000 7f83f7caf640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f83f0150ad0 0x7f83f00c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.142+0000 7f83f7caf640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83f00c6eb0 con 0x7f83f00c7580 2024-09-11T22:30:34.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.142+0000 7f83f7caf640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83f0156730 con 0x7f83f006fc80 2024-09-11T22:30:34.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.142+0000 7f83f7caf640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f83f0150f20 con 0x7f83f0150ad0 2024-09-11T22:30:34.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.142+0000 7f83f624c640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f83f00c7580 0x7f83f0159ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44770/0 (socket says 172.21.15.100:44770) 2024-09-11T22:30:34.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.142+0000 7f83f624c640 1 -- 172.21.15.100:0/245615146 learned_addr learned my addr 172.21.15.100:0/245615146 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:30:34.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.142+0000 7f83f5a4b640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f83f006fc80 0x7f83f00c80c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:43130/0 (socket says 172.21.15.100:43130) 2024-09-11T22:30:34.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.143+0000 7f83f4a49640 1 -- 172.21.15.100:0/245615146 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4274558187 0 0) 0x7f83f00c6eb0 con 0x7f83f00c7580 2024-09-11T22:30:34.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.143+0000 7f83f4a49640 1 -- 172.21.15.100:0/245615146 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83dc003520 con 0x7f83f00c7580 2024-09-11T22:30:34.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.144+0000 7f83f4a49640 1 -- 172.21.15.100:0/245615146 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 42039816 0 0) 0x7f83f0156730 con 0x7f83f006fc80 2024-09-11T22:30:34.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.144+0000 7f83f4a49640 1 -- 172.21.15.100:0/245615146 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83dc0048e0 con 0x7f83f006fc80 2024-09-11T22:30:34.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.144+0000 7f83f524a640 1 --2- 172.21.15.100:0/245615146 >> v2:172.21.15.167:3300/0 conn(0x7f83f0150ad0 0x7f83f00c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.145+0000 7f83f4a49640 1 -- 172.21.15.100:0/245615146 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2957942786 0 0) 0x7f83dc003520 con 0x7f83f00c7580 2024-09-11T22:30:34.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.147+0000 7f83f4a49640 1 -- 172.21.15.100:0/245615146 >> v2:172.21.15.167:3300/0 conn(0x7f83f0150ad0 msgr2=0x7f83f00c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:34.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.147+0000 7f83f4a49640 1 --2- 172.21.15.100:0/245615146 >> v2:172.21.15.167:3300/0 conn(0x7f83f0150ad0 0x7f83f00c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.147+0000 7f83f4a49640 1 -- 172.21.15.100:0/245615146 >> v1:172.21.15.167:6789/0 conn(0x7f83f006fc80 legacy=0x7f83f00c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.147+0000 7f83f4a49640 1 -- 172.21.15.100:0/245615146 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f01569f0 con 0x7f83f00c7580 2024-09-11T22:30:34.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.147+0000 7f83f4a49640 1 -- 172.21.15.100:0/245615146 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f83e80019d0 con 0x7f83f00c7580 2024-09-11T22:30:34.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.147+0000 7f83f4a49640 1 -- 172.21.15.100:0/245615146 >> v1:172.21.15.100:6789/0 conn(0x7f83f00c7580 legacy=0x7f83f0159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.147+0000 7f83f4a49640 1 --2- 172.21.15.100:0/245615146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83dc004db0 0x7f83dc0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.147+0000 7f83f4a49640 1 --2- 172.21.15.100:0/245615146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83dc0037a0 0x7f83dc003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.147+0000 7f83f4a49640 1 --2- 172.21.15.100:0/245615146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83dc0043d0 0x7f83dc0142a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.147+0000 7f83f4a49640 1 -- 172.21.15.100:0/245615146 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f83f0150f20 con 0x7f83dc004db0 2024-09-11T22:30:34.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.147+0000 7f83f4a49640 1 -- 172.21.15.100:0/245615146 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc014b70 con 0x7f83dc0037a0 2024-09-11T22:30:34.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.147+0000 7f83f4a49640 1 -- 172.21.15.100:0/245615146 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f83dc014d70 con 0x7f83dc0043d0 2024-09-11T22:30:34.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.147+0000 7f83f624c640 1 --2- 172.21.15.100:0/245615146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83dc0043d0 0x7f83dc0142a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.147+0000 7f83f5a4b640 1 --2- 172.21.15.100:0/245615146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83dc004db0 0x7f83dc0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.148+0000 7f83f5a4b640 1 -- 172.21.15.100:0/245615146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83dc0043d0 msgr2=0x7f83dc0142a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:34.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.148+0000 7f83f5a4b640 1 --2- 172.21.15.100:0/245615146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83dc0043d0 0x7f83dc0142a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.148+0000 7f83f5a4b640 1 -- 172.21.15.100:0/245615146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83dc0037a0 msgr2=0x7f83dc003c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:30:34.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.148+0000 7f83f5a4b640 1 --2- 172.21.15.100:0/245615146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83dc0037a0 0x7f83dc003c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.148+0000 7f83f5a4b640 1 -- 172.21.15.100:0/245615146 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f01569f0 con 0x7f83dc004db0 2024-09-11T22:30:34.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.149+0000 7f83f524a640 1 --2- 172.21.15.100:0/245615146 >> v2:172.21.15.167:3300/0 conn(0x7f83f0150ad0 0x7f83f00c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:30:34.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.150+0000 7f83f624c640 1 -- 172.21.15.100:0/245615146 reap_dead start 2024-09-11T22:30:34.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.151+0000 7f83f5a4b640 1 --2- 172.21.15.100:0/245615146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83dc004db0 0x7f83dc0051f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f83ec001870 tx=0x7f83dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82ceaa3d910db94 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:34.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.152+0000 7f83f4a49640 1 -- 172.21.15.100:0/245615146 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ec001490 con 0x7f83dc004db0 2024-09-11T22:30:34.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.152+0000 7f83f4a49640 1 -- 172.21.15.100:0/245615146 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ec02e030 con 0x7f83dc004db0 2024-09-11T22:30:34.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.153+0000 7f83f7caf640 1 -- 172.21.15.100:0/245615146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83dc004db0 msgr2=0x7f83dc0051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.153+0000 7f83f4a49640 1 -- 172.21.15.100:0/245615146 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ec0070d0 con 0x7f83dc004db0 2024-09-11T22:30:34.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.153+0000 7f83f7caf640 1 --2- 172.21.15.100:0/245615146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83dc004db0 0x7f83dc0051f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f83ec001870 tx=0x7f83dc005830 comp rx=0 tx=0).stop 2024-09-11T22:30:34.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.156+0000 7f83f7caf640 1 -- 172.21.15.100:0/245615146 shutdown_connections 2024-09-11T22:30:34.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.156+0000 7f83f7caf640 1 --2- 172.21.15.100:0/245615146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83dc004db0 0x7f83dc0051f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.156+0000 7f83f7caf640 1 -- 172.21.15.100:0/245615146 >> 172.21.15.100:0/245615146 conn(0x7f83f006f190 msgr2=0x7f83f006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:34.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.156+0000 7f83f7caf640 1 -- 172.21.15.100:0/245615146 shutdown_connections 2024-09-11T22:30:34.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.157+0000 7f83f7caf640 1 -- 172.21.15.100:0/245615146 wait complete. 2024-09-11T22:30:34.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.159+0000 7f83f7caf640 1 Processor -- start 2024-09-11T22:30:34.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.160+0000 7f83f7caf640 1 -- start start 2024-09-11T22:30:34.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.161+0000 7f83f7caf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83dc004db0 0x7f83f01478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.161+0000 7f83f7caf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83f01519e0 0x7f83f0151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.162+0000 7f83f7caf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83f01482e0 0x7f83f0148760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.162+0000 7f83f5a4b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83dc004db0 0x7f83f01478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.162+0000 7f83f5a4b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83dc004db0 0x7f83f01478d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:53190/0 (socket says 172.21.15.100:53190) 2024-09-11T22:30:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.162+0000 7f83f524a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83f01519e0 0x7f83f0151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.162+0000 7f83f524a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83f01519e0 0x7f83f0151e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:43020/0 (socket says 172.21.15.100:43020) 2024-09-11T22:30:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.162+0000 7f83f624c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83f01482e0 0x7f83f0148760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.162+0000 7f83f624c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83f01482e0 0x7f83f0148760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56922/0 (socket says 172.21.15.100:56922) 2024-09-11T22:30:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.162+0000 7f83f5a4b640 1 -- 172.21.15.100:0/3163961172 learned_addr learned my addr 172.21.15.100:0/3163961172 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:30:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.162+0000 7f83f7caf640 1 -- 172.21.15.100:0/3163961172 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f83f0157290 con 0x7f83f01482e0 2024-09-11T22:30:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.162+0000 7f83f7caf640 1 -- 172.21.15.100:0/3163961172 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f83f0156fb0 con 0x7f83dc004db0 2024-09-11T22:30:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.162+0000 7f83f7caf640 1 -- 172.21.15.100:0/3163961172 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f83f0071b20 con 0x7f83f01519e0 2024-09-11T22:30:34.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.163+0000 7f83f624c640 1 -- 172.21.15.100:0/3163961172 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83f01519e0 msgr2=0x7f83f0151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.163+0000 7f83f624c640 1 --2- 172.21.15.100:0/3163961172 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83f01519e0 0x7f83f0151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.163+0000 7f83f624c640 1 -- 172.21.15.100:0/3163961172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83dc004db0 msgr2=0x7f83f01478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.163+0000 7f83f624c640 1 --2- 172.21.15.100:0/3163961172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83dc004db0 0x7f83f01478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.163+0000 7f83f624c640 1 -- 172.21.15.100:0/3163961172 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f0152360 con 0x7f83f01482e0 2024-09-11T22:30:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.164+0000 7f83f624c640 1 --2- 172.21.15.100:0/3163961172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83f01482e0 0x7f83f0148760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f83f00b24f0 tx=0x7f83e8007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.164+0000 7f83e27fc640 1 -- 172.21.15.100:0/3163961172 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e800a870 con 0x7f83f01482e0 2024-09-11T22:30:34.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.165+0000 7f83e27fc640 1 -- 172.21.15.100:0/3163961172 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e8018070 con 0x7f83f01482e0 2024-09-11T22:30:34.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.165+0000 7f83e27fc640 1 -- 172.21.15.100:0/3163961172 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e800ac70 con 0x7f83f01482e0 2024-09-11T22:30:34.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.165+0000 7f83f7caf640 1 -- 172.21.15.100:0/3163961172 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83f0151510 con 0x7f83f01482e0 2024-09-11T22:30:34.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.165+0000 7f83f7caf640 1 -- 172.21.15.100:0/3163961172 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83f0149670 con 0x7f83f01482e0 2024-09-11T22:30:34.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.168+0000 7f83e27fc640 1 -- 172.21.15.100:0/3163961172 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f83e801d460 con 0x7f83f01482e0 2024-09-11T22:30:34.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.168+0000 7f83f7caf640 1 --2- 172.21.15.100:0/3163961172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83d8002a70 0x7f83d8004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.169+0000 7f83f5a4b640 1 --2- 172.21.15.100:0/3163961172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83d8002a70 0x7f83d8004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.169+0000 7f83f7caf640 1 -- 172.21.15.100:0/3163961172 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f83d8007ec0 con 0x7f83d8002a70 2024-09-11T22:30:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.173+0000 7f83e27fc640 1 --2- 172.21.15.100:0/3163961172 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f83d40aff10 0x7f83d40b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.173+0000 7f83e27fc640 1 -- 172.21.15.100:0/3163961172 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f83e808b0f0 con 0x7f83f01482e0 2024-09-11T22:30:34.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.173+0000 7f83f5a4b640 1 -- 172.21.15.100:0/3163961172 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83d80080c0 con 0x7f83d8002a70 2024-09-11T22:30:34.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.180+0000 7f83f524a640 1 --2- 172.21.15.100:0/3163961172 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f83d40aff10 0x7f83d40b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.181+0000 7f83f524a640 1 --2- 172.21.15.100:0/3163961172 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f83d40aff10 0x7f83d40b23d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f83f00cbd50 tx=0x7f83e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:34.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.183+0000 7f83f5a4b640 1 --2- 172.21.15.100:0/3163961172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83d8002a70 0x7f83d8004f30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f83ec007b40 tx=0x7f83ec001320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:34.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.184+0000 7f83e27fc640 1 -- 172.21.15.100:0/3163961172 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ec044070 con 0x7f83d8002a70 2024-09-11T22:30:34.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.184+0000 7f83e27fc640 1 -- 172.21.15.100:0/3163961172 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f83ec007630 con 0x7f83d8002a70 2024-09-11T22:30:34.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.184+0000 7f83e27fc640 1 -- 172.21.15.100:0/3163961172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83d8002a70 msgr2=0x7f83d8004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.184+0000 7f83e27fc640 1 --2- 172.21.15.100:0/3163961172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83d8002a70 0x7f83d8004f30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f83ec007b40 tx=0x7f83ec001320 comp rx=0 tx=0).stop 2024-09-11T22:30:34.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.184+0000 7f83e27fc640 1 -- 172.21.15.100:0/3163961172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83d8002a70 msgr2=0x7f83d8004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:30:34.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.184+0000 7f83e27fc640 1 --2- 172.21.15.100:0/3163961172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83d8002a70 0x7f83d8004f30 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f83ec007b40 tx=0x7f83ec001320 comp rx=0 tx=0).stop 2024-09-11T22:30:34.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.205+0000 7f83f7caf640 1 --2- 172.21.15.100:0/3163961172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83d8006f00 0x7f83d8007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.205+0000 7f83f7caf640 1 -- 172.21.15.100:0/3163961172 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f83d800a4a0 con 0x7f83d8006f00 2024-09-11T22:30:34.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.209+0000 7f83f5a4b640 1 --2- 172.21.15.100:0/3163961172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83d8006f00 0x7f83d8007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.209+0000 7f83f5a4b640 1 -- 172.21.15.100:0/3163961172 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f83d80078d0 con 0x7f83d8006f00 2024-09-11T22:30:34.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.210+0000 7f83f5a4b640 1 --2- 172.21.15.100:0/3163961172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83d8006f00 0x7f83d8007390 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f83ec03f000 tx=0x7f83ec0012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:34.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.211+0000 7f83e27fc640 1 -- 172.21.15.100:0/3163961172 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ec044040 con 0x7f83d8006f00 2024-09-11T22:30:34.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.211+0000 7f83e27fc640 1 -- 172.21.15.100:0/3163961172 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4555 (secure 0 0 0) 0x7f83ec0472d0 con 0x7f83d8006f00 2024-09-11T22:30:34.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.211+0000 7f83e27fc640 1 -- 172.21.15.100:0/3163961172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83d8006f00 msgr2=0x7f83d8007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.211+0000 7f83e27fc640 1 --2- 172.21.15.100:0/3163961172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83d8006f00 0x7f83d8007390 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f83ec03f000 tx=0x7f83ec0012b0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.211+0000 7f83e27fc640 1 -- 172.21.15.100:0/3163961172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83d8006f00 msgr2=0x7f83d8007390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:30:34.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.211+0000 7f83e27fc640 1 --2- 172.21.15.100:0/3163961172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83d8006f00 0x7f83d8007390 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.215 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:30:34.215 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:30:34.215 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:30:34.215 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:30:34.215 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 72, 2024-09-11T22:30:34.215 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 20890, 2024-09-11T22:30:34.215 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:30:34.215 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:30:34.215 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:30:34.215 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:30:34.216 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:34.216 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 14, 2024-09-11T22:30:34.216 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:30:34.216 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:30:34.216 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:30:34.216 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:34.216 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:34.216 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:34.216 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:34.217 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:34.217 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:34.217 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:34.217 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:34.217 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:34.217 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:34.217 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:34.217 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:34.217 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:30:34.217 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:30:34.217 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:34.217 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:34.218 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:34.218 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:34.218 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:34.218 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:34.218 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:34.218 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:34.218 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:34.218 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:34.218 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:34.219 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:34.219 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.219 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:30:34.219 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:30:34.219 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:30:34.219 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:30:34.219 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:30:34.219 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:30:34.219 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:30:34.219 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:30:34.219 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:30:34.219 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:30:34.220 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:30:34.220 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:30:34.220 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:30:34.220 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:30:34.220 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:30:34.220 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:30:34.220 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:30:34.220 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:34.220 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:34.220 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:34.221 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:34.221 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:34.221 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:34.221 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:34.221 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:34.221 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:34.221 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:34.221 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:34.221 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:34.221 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:30:34.221 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.222 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:30:34.222 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.222 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:30:34.222 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:30:34.222 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:34.222 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:34.222 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.222 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:34.222 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:30:34.222 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:34.222 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.223 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.223 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:34.223 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:30:34.223 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:34.223 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:34.223 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:34.223 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.223 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:30:34.224 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:30:34.224 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:34.224 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:34.224 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:34.224 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.224 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.224 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:30:34.224 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:30:34.224 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:34.225 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:34.225 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.225 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:34.225 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:30:34.225 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:34.225 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.225 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.225 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:34.225 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:30:34.225 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:34.225 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:34.225 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:34.226 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.226 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:30:34.226 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:30:34.226 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:34.226 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:34.226 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:34.226 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.226 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.226 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:30:34.226 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:30:34.226 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:34.226 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:34.226 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.226 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:34.227 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:30:34.227 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:34.227 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.227 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.227 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:34.227 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:30:34.227 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:34.227 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:34.227 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:34.227 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.227 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:30:34.227 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:30:34.227 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:34.227 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:34.228 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:34.228 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:34.228 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:34.228 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.228 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:30:34.228 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:30:34.228 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.228 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:34.228 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:34.228 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:30:34.228 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:34.228 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:34.228 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:30:34.229 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.229 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:34.229 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:34.229 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:30:34.229 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:34.229 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:34.229 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.229 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:30:34.229 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:30:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.214+0000 7f83f7caf640 1 -- 172.21.15.100:0/3163961172 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f83d40aff10 msgr2=0x7f83d40b23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.214+0000 7f83f7caf640 1 --2- 172.21.15.100:0/3163961172 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f83d40aff10 0x7f83d40b23d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f83f00cbd50 tx=0x7f83e4008040 comp rx=0 tx=0).stop 2024-09-11T22:30:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.214+0000 7f83f7caf640 1 -- 172.21.15.100:0/3163961172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83f01482e0 msgr2=0x7f83f0148760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.214+0000 7f83f7caf640 1 --2- 172.21.15.100:0/3163961172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83f01482e0 0x7f83f0148760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f83f00b24f0 tx=0x7f83e8007a90 comp rx=0 tx=0).stop 2024-09-11T22:30:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.214+0000 7f83f624c640 1 -- 172.21.15.100:0/3163961172 reap_dead start 2024-09-11T22:30:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.214+0000 7f83f624c640 1 -- 172.21.15.100:0/3163961172 reap_dead start 2024-09-11T22:30:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.214+0000 7f83f7caf640 1 -- 172.21.15.100:0/3163961172 shutdown_connections 2024-09-11T22:30:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.214+0000 7f83f7caf640 1 -- 172.21.15.100:0/3163961172 >> 172.21.15.100:0/3163961172 conn(0x7f83f006f190 msgr2=0x7f83f006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.215+0000 7f83f7caf640 1 -- 172.21.15.100:0/3163961172 shutdown_connections 2024-09-11T22:30:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.215+0000 7f83f7caf640 1 -- 172.21.15.100:0/3163961172 wait complete. 2024-09-11T22:30:34.248 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:30:34.249 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:30:34.249 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:30:34.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.454+0000 7f31f1d82640 1 Processor -- start 2024-09-11T22:30:34.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.456+0000 7f31f1d82640 1 -- start start 2024-09-11T22:30:34.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.458+0000 7f31f1d82640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31ec06d620 0x7f31ec153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.458+0000 7f31f1d82640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31ec072f30 con 0x7f31ec06e2d0 2024-09-11T22:30:34.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.458+0000 7f31f1d82640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31ec073210 con 0x7f31ec06d240 2024-09-11T22:30:34.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.458+0000 7f31f1d82640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f31ec0734f0 con 0x7f31ec06d620 2024-09-11T22:30:34.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.458+0000 7f31ebfff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f31ec06e2d0 0x7f31ec15a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44778/0 (socket says 172.21.15.100:44778) 2024-09-11T22:30:34.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.458+0000 7f31ebfff640 1 -- 172.21.15.100:0/44274770 learned_addr learned my addr 172.21.15.100:0/44274770 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:30:34.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.458+0000 7f31eb7fe640 1 -- 172.21.15.100:0/44274770 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 554050191 0 0) 0x7f31ec072f30 con 0x7f31ec06e2d0 2024-09-11T22:30:34.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.459+0000 7f31eb7fe640 1 -- 172.21.15.100:0/44274770 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31d4003520 con 0x7f31ec06e2d0 2024-09-11T22:30:34.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.459+0000 7f31eb7fe640 1 -- 172.21.15.100:0/44274770 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3282014510 0 0) 0x7f31ec073210 con 0x7f31ec06d240 2024-09-11T22:30:34.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.459+0000 7f31eb7fe640 1 -- 172.21.15.100:0/44274770 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31ec072f30 con 0x7f31ec06d240 2024-09-11T22:30:34.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.459+0000 7f31eb7fe640 1 -- 172.21.15.100:0/44274770 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4167506508 0 0) 0x7f31ec072f30 con 0x7f31ec06d240 2024-09-11T22:30:34.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.459+0000 7f31eb7fe640 1 -- 172.21.15.100:0/44274770 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31ec06d620 msgr2=0x7f31ec153ae0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:30:34.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.459+0000 7f31eb7fe640 1 --2- 172.21.15.100:0/44274770 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31ec06d620 0x7f31ec153ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.459+0000 7f31eb7fe640 1 -- 172.21.15.100:0/44274770 >> v1:172.21.15.100:6789/0 conn(0x7f31ec06e2d0 legacy=0x7f31ec15a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.459+0000 7f31eb7fe640 1 -- 172.21.15.100:0/44274770 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ec156bf0 con 0x7f31ec06d240 2024-09-11T22:30:34.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.459+0000 7f31eb7fe640 1 -- 172.21.15.100:0/44274770 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f31dc001670 con 0x7f31ec06d240 2024-09-11T22:30:34.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.459+0000 7f31eb7fe640 1 -- 172.21.15.100:0/44274770 >> v1:172.21.15.167:6789/0 conn(0x7f31ec06d240 legacy=0x7f31ec0c0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.459+0000 7f31eb7fe640 1 --2- 172.21.15.100:0/44274770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31d4004ba0 0x7f31d4004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.459+0000 7f31eb7fe640 1 --2- 172.21.15.100:0/44274770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31d40037a0 0x7f31d4003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.460+0000 7f31eb7fe640 1 --2- 172.21.15.100:0/44274770 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31d40041b0 0x7f31d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.460+0000 7f31eb7fe640 1 -- 172.21.15.100:0/44274770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec0734f0 con 0x7f31d4004ba0 2024-09-11T22:30:34.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.460+0000 7f31eb7fe640 1 -- 172.21.15.100:0/44274770 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f31d400c030 con 0x7f31d40037a0 2024-09-11T22:30:34.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.460+0000 7f31eb7fe640 1 -- 172.21.15.100:0/44274770 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f31d400c230 con 0x7f31d40041b0 2024-09-11T22:30:34.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.460+0000 7f31f0d80640 1 --2- 172.21.15.100:0/44274770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31d4004ba0 0x7f31d4004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.460+0000 7f31ebfff640 1 --2- 172.21.15.100:0/44274770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31d40037a0 0x7f31d4003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.460+0000 7f31f1581640 1 --2- 172.21.15.100:0/44274770 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31d40041b0 0x7f31d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.461+0000 7f31f0d80640 1 -- 172.21.15.100:0/44274770 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31d40041b0 msgr2=0x7f31d400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:34.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.461+0000 7f31f0d80640 1 --2- 172.21.15.100:0/44274770 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31d40041b0 0x7f31d400b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.461+0000 7f31f0d80640 1 -- 172.21.15.100:0/44274770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31d40037a0 msgr2=0x7f31d4003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:34.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.461+0000 7f31f0d80640 1 --2- 172.21.15.100:0/44274770 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31d40037a0 0x7f31d4003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.461+0000 7f31f0d80640 1 -- 172.21.15.100:0/44274770 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ec072f30 con 0x7f31d4004ba0 2024-09-11T22:30:34.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.462+0000 7f31f0d80640 1 --2- 172.21.15.100:0/44274770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31d4004ba0 0x7f31d4004f80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f31dc007f10 tx=0x7f31d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb68ca254bc9320 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:34.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.463+0000 7f31eb7fe640 1 -- 172.21.15.100:0/44274770 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc007b30 con 0x7f31d4004ba0 2024-09-11T22:30:34.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.463+0000 7f31eb7fe640 1 -- 172.21.15.100:0/44274770 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31dc02ae50 con 0x7f31d4004ba0 2024-09-11T22:30:34.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.464+0000 7f31f1d82640 1 -- 172.21.15.100:0/44274770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31d4004ba0 msgr2=0x7f31d4004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.464+0000 7f31f1d82640 1 --2- 172.21.15.100:0/44274770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31d4004ba0 0x7f31d4004f80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f31dc007f10 tx=0x7f31d4005830 comp rx=0 tx=0).stop 2024-09-11T22:30:34.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.464+0000 7f31f1581640 1 -- 172.21.15.100:0/44274770 reap_dead start 2024-09-11T22:30:34.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.464+0000 7f31f1d82640 1 -- 172.21.15.100:0/44274770 shutdown_connections 2024-09-11T22:30:34.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.464+0000 7f31f1d82640 1 -- 172.21.15.100:0/44274770 >> 172.21.15.100:0/44274770 conn(0x7f31ec06ed10 msgr2=0x7f31ec06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:34.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.465+0000 7f31f1d82640 1 -- 172.21.15.100:0/44274770 shutdown_connections 2024-09-11T22:30:34.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.465+0000 7f31f1d82640 1 -- 172.21.15.100:0/44274770 wait complete. 2024-09-11T22:30:34.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.467+0000 7f31f1d82640 1 Processor -- start 2024-09-11T22:30:34.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.467+0000 7f31f1d82640 1 -- start start 2024-09-11T22:30:34.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.468+0000 7f31f1d82640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31ec1ef600 0x7f31ec0c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.468+0000 7f31f1d82640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31ec0c2f90 0x7f31ec0c6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.468+0000 7f31f1d82640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31ec1ef9e0 0x7f31ec14c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.468+0000 7f31f1d82640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec072b40 con 0x7f31ec0c2f90 2024-09-11T22:30:34.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.468+0000 7f31f1d82640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec071490 con 0x7f31ec1ef600 2024-09-11T22:30:34.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.468+0000 7f31f1d82640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f31ec072cc0 con 0x7f31ec1ef9e0 2024-09-11T22:30:34.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.469+0000 7f31ebfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31ec0c2f90 0x7f31ec0c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.469+0000 7f31ebfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31ec0c2f90 0x7f31ec0c6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56970/0 (socket says 172.21.15.100:56970) 2024-09-11T22:30:34.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.469+0000 7f31ebfff640 1 -- 172.21.15.100:0/2877091964 learned_addr learned my addr 172.21.15.100:0/2877091964 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:30:34.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.470+0000 7f31ebfff640 1 -- 172.21.15.100:0/2877091964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31ec1ef9e0 msgr2=0x7f31ec14c640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:30:34.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.470+0000 7f31ebfff640 1 --2- 172.21.15.100:0/2877091964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31ec1ef9e0 0x7f31ec14c640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.470+0000 7f31ebfff640 1 -- 172.21.15.100:0/2877091964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31ec1ef600 msgr2=0x7f31ec0c4a70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:30:34.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.470+0000 7f31ebfff640 1 --2- 172.21.15.100:0/2877091964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31ec1ef600 0x7f31ec0c4a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.470+0000 7f31ebfff640 1 -- 172.21.15.100:0/2877091964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ec0c29d0 con 0x7f31ec0c2f90 2024-09-11T22:30:34.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.471+0000 7f31ebfff640 1 --2- 172.21.15.100:0/2877091964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31ec0c2f90 0x7f31ec0c6380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f31e4006a90 tx=0x7f31e4006f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:34.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.473+0000 7f31e97fa640 1 -- 172.21.15.100:0/2877091964 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e400fbb0 con 0x7f31ec0c2f90 2024-09-11T22:30:34.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.473+0000 7f31f1d82640 1 -- 172.21.15.100:0/2877091964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31ec0c3f90 con 0x7f31ec0c2f90 2024-09-11T22:30:34.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.473+0000 7f31f1d82640 1 -- 172.21.15.100:0/2877091964 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31ec0c4550 con 0x7f31ec0c2f90 2024-09-11T22:30:34.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.474+0000 7f31f1d82640 1 --2- 172.21.15.100:0/2877091964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31ec1efde0 0x7f31ec14cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.474+0000 7f31f1d82640 1 -- 172.21.15.100:0/2877091964 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec1f0360 con 0x7f31ec1efde0 2024-09-11T22:30:34.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.475+0000 7f31f0d80640 1 --2- 172.21.15.100:0/2877091964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31ec1efde0 0x7f31ec14cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.476+0000 7f31e97fa640 1 -- 172.21.15.100:0/2877091964 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e400fd50 con 0x7f31ec0c2f90 2024-09-11T22:30:34.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.478+0000 7f31f0d80640 1 -- 172.21.15.100:0/2877091964 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f31ec0c4750 con 0x7f31ec1efde0 2024-09-11T22:30:34.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.478+0000 7f31e97fa640 1 -- 172.21.15.100:0/2877091964 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4019640 con 0x7f31ec0c2f90 2024-09-11T22:30:34.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.478+0000 7f31f0d80640 1 --2- 172.21.15.100:0/2877091964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31ec1efde0 0x7f31ec14cb80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f31dc007ee0 tx=0x7f31ec1571b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:34.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.478+0000 7f31e97fa640 1 -- 172.21.15.100:0/2877091964 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f31e4022440 con 0x7f31ec0c2f90 2024-09-11T22:30:34.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.479+0000 7f31e97fa640 1 --2- 172.21.15.100:0/2877091964 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f31d806bee0 0x7f31d806e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.480+0000 7f31e97fa640 1 -- 172.21.15.100:0/2877091964 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc005270 con 0x7f31ec1efde0 2024-09-11T22:30:34.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.480+0000 7f31e97fa640 1 -- 172.21.15.100:0/2877091964 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f31e408d900 con 0x7f31ec0c2f90 2024-09-11T22:30:34.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.480+0000 7f31e97fa640 1 -- 172.21.15.100:0/2877091964 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f31dc005410 con 0x7f31ec1efde0 2024-09-11T22:30:34.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.480+0000 7f31f1581640 1 --2- 172.21.15.100:0/2877091964 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f31d806bee0 0x7f31d806e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.485+0000 7f31e97fa640 1 -- 172.21.15.100:0/2877091964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31ec1efde0 msgr2=0x7f31ec14cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.485+0000 7f31e97fa640 1 --2- 172.21.15.100:0/2877091964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31ec1efde0 0x7f31ec14cb80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f31dc007ee0 tx=0x7f31ec1571b0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.485+0000 7f31e97fa640 1 -- 172.21.15.100:0/2877091964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31ec1efde0 msgr2=0x7f31ec14cb80 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:30:34.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.485+0000 7f31e97fa640 1 --2- 172.21.15.100:0/2877091964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31ec1efde0 0x7f31ec14cb80 secure :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f31dc007ee0 tx=0x7f31ec1571b0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.489+0000 7f31f1581640 1 --2- 172.21.15.100:0/2877091964 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f31d806bee0 0x7f31d806e3a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f31ec0b2300 tx=0x7f31e0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:34.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.493+0000 7f31f1d82640 1 --2- 172.21.15.100:0/2877091964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31ec1ebda0 0x7f31ec1ec180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.493+0000 7f31f1d82640 1 -- 172.21.15.100:0/2877091964 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f31ec06f830 con 0x7f31ec1ebda0 2024-09-11T22:30:34.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.494+0000 7f31f0d80640 1 --2- 172.21.15.100:0/2877091964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31ec1ebda0 0x7f31ec1ec180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.495+0000 7f31f0d80640 1 -- 172.21.15.100:0/2877091964 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f31ec14d0c0 con 0x7f31ec1ebda0 2024-09-11T22:30:34.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.496+0000 7f31f0d80640 1 --2- 172.21.15.100:0/2877091964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31ec1ebda0 0x7f31ec1ec180 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f31dc007f10 tx=0x7f31dc001df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:34.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.496+0000 7f31e97fa640 1 -- 172.21.15.100:0/2877091964 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31dc003800 con 0x7f31ec1ebda0 2024-09-11T22:30:34.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.497+0000 7f31e97fa640 1 -- 172.21.15.100:0/2877091964 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4888 (secure 0 0 0) 0x7f31dc0039a0 con 0x7f31ec1ebda0 2024-09-11T22:30:34.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.497+0000 7f31e97fa640 1 -- 172.21.15.100:0/2877091964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31ec1ebda0 msgr2=0x7f31ec1ec180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.497+0000 7f31e97fa640 1 --2- 172.21.15.100:0/2877091964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31ec1ebda0 0x7f31ec1ec180 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f31dc007f10 tx=0x7f31dc001df0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.497+0000 7f31e97fa640 1 -- 172.21.15.100:0/2877091964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31ec1ebda0 msgr2=0x7f31ec1ec180 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:30:34.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.497+0000 7f31e97fa640 1 --2- 172.21.15.100:0/2877091964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31ec1ebda0 0x7f31ec1ec180 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.506 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:30:34.506 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:30:34.506 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:30:34.506 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:30:34.506 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 72, 2024-09-11T22:30:34.506 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 419775, 2024-09-11T22:30:34.506 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:30:34.506 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:30:34.506 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:30:34.507 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:30:34.507 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:34.507 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 14, 2024-09-11T22:30:34.507 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:30:34.507 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:30:34.507 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:30:34.507 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:34.507 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:34.507 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:34.507 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:34.507 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:34.507 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:34.507 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:34.508 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:34.508 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:34.508 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:34.508 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:34.508 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:34.508 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:30:34.508 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:30:34.508 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:34.508 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:34.508 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:34.508 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:34.508 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:34.508 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:34.509 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:34.509 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:34.509 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:34.509 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:34.509 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:34.509 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:34.509 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.509 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:30:34.509 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:30:34.509 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:30:34.509 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:30:34.509 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:30:34.509 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:30:34.510 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:30:34.510 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:30:34.510 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:30:34.510 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:30:34.510 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:30:34.510 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:30:34.510 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:30:34.510 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:30:34.510 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:30:34.510 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:30:34.511 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:30:34.511 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:34.511 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:34.511 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:34.511 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:34.511 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:34.511 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:34.511 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:34.511 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:34.511 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:34.511 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:34.511 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:34.512 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:34.512 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:30:34.512 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.512 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:30:34.512 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.512 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:30:34.512 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:30:34.512 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:34.512 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:34.512 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.512 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:34.512 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:30:34.512 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:34.513 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.513 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.513 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:34.513 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:30:34.513 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:34.513 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:34.513 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:34.513 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.513 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:30:34.513 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:30:34.513 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:34.513 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:34.514 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:34.514 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.514 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.514 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:30:34.514 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:30:34.514 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:34.514 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:34.514 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.514 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:34.514 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:30:34.514 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:34.514 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.514 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.515 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:34.515 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:30:34.515 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:34.515 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:34.515 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:34.515 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.515 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:30:34.515 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:30:34.515 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:34.515 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:34.515 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:34.515 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.515 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.516 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:30:34.516 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:30:34.516 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:34.516 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:34.516 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.516 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:34.516 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:30:34.516 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:34.516 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.516 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.516 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:34.516 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:30:34.516 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:34.517 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:34.517 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:34.517 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.517 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:30:34.517 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:30:34.517 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:34.517 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:34.517 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:34.517 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:34.517 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:34.517 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.517 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:30:34.517 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:30:34.517 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.518 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:34.518 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:34.518 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:30:34.518 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:34.518 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:34.518 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:30:34.518 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.518 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:34.518 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:34.518 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:30:34.518 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:34.518 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:34.518 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:30:34.519 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.519 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:34.519 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:34.519 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:30:34.519 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:34.519 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:34.519 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:30:34.519 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.519 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:34.519 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:34.519 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:30:34.520 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:34.520 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:34.520 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.520 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:30:34.520 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:30:34.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.519+0000 7f31f1d82640 1 -- 172.21.15.100:0/2877091964 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f31d806bee0 msgr2=0x7f31d806e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.519+0000 7f31f1d82640 1 --2- 172.21.15.100:0/2877091964 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f31d806bee0 0x7f31d806e3a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f31ec0b2300 tx=0x7f31e0008040 comp rx=0 tx=0).stop 2024-09-11T22:30:34.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.519+0000 7f31f1581640 1 -- 172.21.15.100:0/2877091964 reap_dead start 2024-09-11T22:30:34.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.519+0000 7f31f1d82640 1 -- 172.21.15.100:0/2877091964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31ec0c2f90 msgr2=0x7f31ec0c6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.519+0000 7f31f1d82640 1 --2- 172.21.15.100:0/2877091964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31ec0c2f90 0x7f31ec0c6380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f31e4006a90 tx=0x7f31e4006f50 comp rx=0 tx=0).stop 2024-09-11T22:30:34.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.521+0000 7f31f1d82640 1 -- 172.21.15.100:0/2877091964 shutdown_connections 2024-09-11T22:30:34.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.522+0000 7f31f1d82640 1 --2- 172.21.15.100:0/2877091964 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31ec0c2f90 0x7f31ec0c6380 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.522+0000 7f31f1d82640 1 -- 172.21.15.100:0/2877091964 >> 172.21.15.100:0/2877091964 conn(0x7f31ec06ed10 msgr2=0x7f31ec1559e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:34.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.524+0000 7f31f1d82640 1 -- 172.21.15.100:0/2877091964 shutdown_connections 2024-09-11T22:30:34.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.524+0000 7f31f1d82640 1 -- 172.21.15.100:0/2877091964 wait complete. 2024-09-11T22:30:34.566 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:30:34.566 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:30:34.566 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:30:34.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.775+0000 7fc100f0a640 1 Processor -- start 2024-09-11T22:30:34.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.775+0000 7fc100f0a640 1 -- start start 2024-09-11T22:30:34.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.779+0000 7fc100f0a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0fc15c7d0 0x7fc0fc15fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.779+0000 7fc100f0a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc0fc0728c0 0x7fc0fc162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.779+0000 7fc100f0a640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0fc15ef90 con 0x7fc0fc0c7eb0 2024-09-11T22:30:34.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.779+0000 7fc100f0a640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fc0fc15cbb0 con 0x7fc0fc0728c0 2024-09-11T22:30:34.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.779+0000 7fc100f0a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc0fc0c7750 con 0x7fc0fc15c7d0 2024-09-11T22:30:34.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.779+0000 7fc0f9d9b640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc0fc0c7eb0 0x7fc0fc0c8dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44792/0 (socket says 172.21.15.100:44792) 2024-09-11T22:30:34.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.779+0000 7fc0f9d9b640 1 -- 172.21.15.100:0/2978277275 learned_addr learned my addr 172.21.15.100:0/2978277275 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:30:34.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.780+0000 7fc0fa59c640 1 --2- 172.21.15.100:0/2978277275 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0fc15c7d0 0x7fc0fc15fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.780+0000 7fc0fad9d640 1 --2- 172.21.15.100:0/2978277275 >> v2:172.21.15.100:3300/0 conn(0x7fc0fc0728c0 0x7fc0fc162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.780+0000 7fc0fa59c640 1 -- 172.21.15.100:0/2978277275 >> v2:172.21.15.100:3300/0 conn(0x7fc0fc0728c0 msgr2=0x7fc0fc162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:34.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.780+0000 7fc0fa59c640 1 --2- 172.21.15.100:0/2978277275 >> v2:172.21.15.100:3300/0 conn(0x7fc0fc0728c0 0x7fc0fc162da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.780+0000 7fc0fa59c640 1 -- 172.21.15.100:0/2978277275 >> v1:172.21.15.100:6789/0 conn(0x7fc0fc0c7eb0 legacy=0x7fc0fc0c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.780+0000 7fc0fa59c640 1 -- 172.21.15.100:0/2978277275 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0fc15f230 con 0x7fc0fc15c7d0 2024-09-11T22:30:34.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.783+0000 7fc0fa59c640 1 --2- 172.21.15.100:0/2978277275 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0fc15c7d0 0x7fc0fc15fa30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc0f00097a0 tx=0x7fc0f002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=879fa8dae79136f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:34.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.783+0000 7fc0f959a640 1 -- 172.21.15.100:0/2978277275 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0037070 con 0x7fc0fc15c7d0 2024-09-11T22:30:34.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.783+0000 7fc0f959a640 1 -- 172.21.15.100:0/2978277275 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f0032440 con 0x7fc0fc15c7d0 2024-09-11T22:30:34.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.783+0000 7fc0f959a640 1 -- 172.21.15.100:0/2978277275 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0032810 con 0x7fc0fc15c7d0 2024-09-11T22:30:34.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.784+0000 7fc100f0a640 1 -- 172.21.15.100:0/2978277275 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0fc15c7d0 msgr2=0x7fc0fc15fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.784+0000 7fc100f0a640 1 --2- 172.21.15.100:0/2978277275 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0fc15c7d0 0x7fc0fc15fa30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc0f00097a0 tx=0x7fc0f002a180 comp rx=0 tx=0).stop 2024-09-11T22:30:34.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.785+0000 7fc100f0a640 1 -- 172.21.15.100:0/2978277275 shutdown_connections 2024-09-11T22:30:34.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.785+0000 7fc100f0a640 1 --2- 172.21.15.100:0/2978277275 >> v2:172.21.15.100:3300/0 conn(0x7fc0fc0728c0 0x7fc0fc162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.785+0000 7fc100f0a640 1 --2- 172.21.15.100:0/2978277275 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0fc15c7d0 0x7fc0fc15fa30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.785+0000 7fc100f0a640 1 -- 172.21.15.100:0/2978277275 >> 172.21.15.100:0/2978277275 conn(0x7fc0fc06f360 msgr2=0x7fc0fc06f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:34.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.785+0000 7fc100f0a640 1 -- 172.21.15.100:0/2978277275 shutdown_connections 2024-09-11T22:30:34.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.785+0000 7fc100f0a640 1 -- 172.21.15.100:0/2978277275 wait complete. 2024-09-11T22:30:34.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.787+0000 7fc100f0a640 1 Processor -- start 2024-09-11T22:30:34.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.787+0000 7fc100f0a640 1 -- start start 2024-09-11T22:30:34.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.788+0000 7fc100f0a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0fc0728c0 0x7fc0fc1536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.788+0000 7fc100f0a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0fc0c7eb0 0x7fc0fc155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.788+0000 7fc100f0a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0fc15c7d0 0x7fc0fc155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.788+0000 7fc100f0a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc0fc0c7a30 con 0x7fc0fc15c7d0 2024-09-11T22:30:34.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.788+0000 7fc100f0a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc0fc0c70e0 con 0x7fc0fc0c7eb0 2024-09-11T22:30:34.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.788+0000 7fc100f0a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc0fc0c7430 con 0x7fc0fc0728c0 2024-09-11T22:30:34.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.788+0000 7fc0f9d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0fc0c7eb0 0x7fc0fc155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.788+0000 7fc0fa59c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0fc0728c0 0x7fc0fc1536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.788+0000 7fc0fad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0fc15c7d0 0x7fc0fc155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.788+0000 7fc0fa59c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0fc0728c0 0x7fc0fc1536e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:43048/0 (socket says 172.21.15.100:43048) 2024-09-11T22:30:34.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.788+0000 7fc0fa59c640 1 -- 172.21.15.100:0/3497049878 learned_addr learned my addr 172.21.15.100:0/3497049878 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:30:34.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.789+0000 7fc0fa59c640 1 -- 172.21.15.100:0/3497049878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0fc0c7eb0 msgr2=0x7fc0fc155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.789+0000 7fc0fa59c640 1 --2- 172.21.15.100:0/3497049878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0fc0c7eb0 0x7fc0fc155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.789+0000 7fc0fa59c640 1 -- 172.21.15.100:0/3497049878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0fc15c7d0 msgr2=0x7fc0fc155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.789+0000 7fc0fa59c640 1 --2- 172.21.15.100:0/3497049878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0fc15c7d0 0x7fc0fc155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.789+0000 7fc0fa59c640 1 -- 172.21.15.100:0/3497049878 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0fc1e9950 con 0x7fc0fc0728c0 2024-09-11T22:30:34.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.789+0000 7fc0fad9d640 1 --2- 172.21.15.100:0/3497049878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0fc15c7d0 0x7fc0fc155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:34.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.790+0000 7fc0fa59c640 1 --2- 172.21.15.100:0/3497049878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0fc0728c0 0x7fc0fc1536e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc0f00098c0 tx=0x7fc0f00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:34.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.790+0000 7fc0eaffd640 1 -- 172.21.15.100:0/3497049878 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0037040 con 0x7fc0fc0728c0 2024-09-11T22:30:34.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.790+0000 7fc0eaffd640 1 -- 172.21.15.100:0/3497049878 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0f0042070 con 0x7fc0fc0728c0 2024-09-11T22:30:34.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.790+0000 7fc0eaffd640 1 -- 172.21.15.100:0/3497049878 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0037040 con 0x7fc0fc0728c0 2024-09-11T22:30:34.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.791+0000 7fc100f0a640 1 -- 172.21.15.100:0/3497049878 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0fc1e9c30 con 0x7fc0fc0728c0 2024-09-11T22:30:34.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.791+0000 7fc100f0a640 1 -- 172.21.15.100:0/3497049878 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0fc153c20 con 0x7fc0fc0728c0 2024-09-11T22:30:34.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.792+0000 7fc100f0a640 1 --2- 172.21.15.100:0/3497049878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0e0002a70 0x7fc0e0004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.792+0000 7fc100f0a640 1 -- 172.21.15.100:0/3497049878 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc0e0007ec0 con 0x7fc0e0002a70 2024-09-11T22:30:34.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.793+0000 7fc0f9d9b640 1 --2- 172.21.15.100:0/3497049878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0e0002a70 0x7fc0e0004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.793+0000 7fc0f9d9b640 1 -- 172.21.15.100:0/3497049878 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0e00080c0 con 0x7fc0e0002a70 2024-09-11T22:30:34.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.794+0000 7fc0eaffd640 1 -- 172.21.15.100:0/3497049878 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc0f00306c0 con 0x7fc0fc0728c0 2024-09-11T22:30:34.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.795+0000 7fc0eaffd640 1 --2- 172.21.15.100:0/3497049878 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc0dc06c260 0x7fc0dc06e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.795+0000 7fc0f9d9b640 1 --2- 172.21.15.100:0/3497049878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0e0002a70 0x7fc0e0004f30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0c26a0 tx=0x7fc0ec00e940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:34.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.795+0000 7fc0fad9d640 1 --2- 172.21.15.100:0/3497049878 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc0dc06c260 0x7fc0dc06e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.796+0000 7fc0fad9d640 1 --2- 172.21.15.100:0/3497049878 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc0dc06c260 0x7fc0dc06e720 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4009fd0 tx=0x7fc0f400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:34.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.796+0000 7fc0eaffd640 1 -- 172.21.15.100:0/3497049878 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec005ac0 con 0x7fc0e0002a70 2024-09-11T22:30:34.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.796+0000 7fc0eaffd640 1 -- 172.21.15.100:0/3497049878 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fc0f00304c0 con 0x7fc0fc0728c0 2024-09-11T22:30:34.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.797+0000 7fc0eaffd640 1 -- 172.21.15.100:0/3497049878 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc0ec018070 con 0x7fc0e0002a70 2024-09-11T22:30:34.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.797+0000 7fc0eaffd640 1 -- 172.21.15.100:0/3497049878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0e0002a70 msgr2=0x7fc0e0004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.797+0000 7fc0eaffd640 1 --2- 172.21.15.100:0/3497049878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0e0002a70 0x7fc0e0004f30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0c26a0 tx=0x7fc0ec00e940 comp rx=0 tx=0).stop 2024-09-11T22:30:34.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.797+0000 7fc0eaffd640 1 -- 172.21.15.100:0/3497049878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0e0002a70 msgr2=0x7fc0e0004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:30:34.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.797+0000 7fc0eaffd640 1 --2- 172.21.15.100:0/3497049878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0e0002a70 0x7fc0e0004f30 secure :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0c26a0 tx=0x7fc0ec00e940 comp rx=0 tx=0).stop 2024-09-11T22:30:34.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.811+0000 7fc100f0a640 1 --2- 172.21.15.100:0/3497049878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0e0006f50 0x7fc0e00073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:34.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.811+0000 7fc100f0a640 1 -- 172.21.15.100:0/3497049878 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc0e000a4a0 con 0x7fc0e0006f50 2024-09-11T22:30:34.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.811+0000 7fc0f9d9b640 1 --2- 172.21.15.100:0/3497049878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0e0006f50 0x7fc0e00073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:34.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.812+0000 7fc0f9d9b640 1 -- 172.21.15.100:0/3497049878 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc0e0007920 con 0x7fc0e0006f50 2024-09-11T22:30:34.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.814+0000 7fc0f9d9b640 1 --2- 172.21.15.100:0/3497049878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0e0006f50 0x7fc0e00073e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0008090 tx=0x7fc0ec0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:34.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.815+0000 7fc0eaffd640 1 -- 172.21.15.100:0/3497049878 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec01d7c0 con 0x7fc0e0006f50 2024-09-11T22:30:34.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.815+0000 7fc0eaffd640 1 -- 172.21.15.100:0/3497049878 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7fc0ec01d960 con 0x7fc0e0006f50 2024-09-11T22:30:34.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.815+0000 7fc0eaffd640 1 -- 172.21.15.100:0/3497049878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0e0006f50 msgr2=0x7fc0e00073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.815+0000 7fc0eaffd640 1 --2- 172.21.15.100:0/3497049878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0e0006f50 0x7fc0e00073e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0008090 tx=0x7fc0ec0057f0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.815+0000 7fc0eaffd640 1 -- 172.21.15.100:0/3497049878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0e0006f50 msgr2=0x7fc0e00073e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:30:34.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.815+0000 7fc0eaffd640 1 --2- 172.21.15.100:0/3497049878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0e0006f50 0x7fc0e00073e0 secure :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0008090 tx=0x7fc0ec0057f0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.817 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:30:34.818 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:30:34.818 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:30:34.818 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:30:34.818 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 72, 2024-09-11T22:30:34.818 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 525536, 2024-09-11T22:30:34.818 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:30:34.818 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:30:34.818 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:30:34.818 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:30:34.818 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:34.818 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 15, 2024-09-11T22:30:34.818 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:30:34.819 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:30:34.819 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:30:34.819 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:34.819 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:34.819 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:34.819 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:34.819 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:34.819 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:34.819 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:34.819 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:34.819 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:34.819 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:34.819 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:34.820 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:34.820 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:30:34.820 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:30:34.820 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:34.820 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:34.820 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:34.820 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:34.820 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:34.820 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:34.820 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:34.820 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:34.820 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:34.820 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:34.821 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:34.821 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:34.821 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.821 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:30:34.821 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:30:34.821 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:30:34.821 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:30:34.821 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:30:34.821 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:30:34.821 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:30:34.821 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:30:34.821 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:30:34.822 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:30:34.822 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:30:34.822 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:30:34.822 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:30:34.822 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:30:34.822 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:30:34.822 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:30:34.822 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:30:34.822 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:34.822 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:34.822 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:34.822 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:34.822 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:34.823 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:34.823 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:34.823 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:34.823 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:34.823 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:34.823 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:34.823 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:34.823 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:30:34.823 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.823 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:30:34.823 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.823 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:30:34.824 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:30:34.824 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:34.824 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:34.824 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.824 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:34.824 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:30:34.824 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:34.824 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.824 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.824 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:34.824 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:30:34.824 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:34.825 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:34.825 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:34.825 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.825 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:30:34.825 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:30:34.825 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:34.825 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:34.825 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:34.825 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.825 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.825 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:30:34.825 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:30:34.825 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:34.826 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:34.826 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.826 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:34.826 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:30:34.826 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:34.826 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.826 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.826 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:34.826 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:30:34.826 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:34.826 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:34.826 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:34.826 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.827 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:30:34.827 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:30:34.827 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:34.827 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:34.827 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:34.827 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.827 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.827 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:30:34.827 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:30:34.827 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:34.827 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:34.827 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.828 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:34.828 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:30:34.828 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:34.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.828 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.828 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:34.828 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:30:34.828 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:34.828 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:34.828 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:34.828 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.828 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:30:34.828 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:30:34.828 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:34.829 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:34.829 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:34.829 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:34.829 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:34.829 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.829 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:30:34.829 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:30:34.829 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.829 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:34.829 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:34.829 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:30:34.829 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:34.830 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:34.830 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:30:34.830 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.830 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:34.830 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:34.830 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:30:34.830 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:34.830 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:34.830 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:30:34.830 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.830 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:34.830 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:34.830 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:30:34.831 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:34.831 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:34.831 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:30:34.831 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.831 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:34.831 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:34.831 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 6 2024-09-11T22:30:34.831 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:34.831 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:34.831 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:30:34.831 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:34.831 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:34.831 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:34.832 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:30:34.832 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:34.832 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:34.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:34.832 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:30:34.832 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:30:34.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.817+0000 7fc0e8ff9640 1 -- 172.21.15.100:0/3497049878 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc0dc06c260 msgr2=0x7fc0dc06e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.817+0000 7fc0e8ff9640 1 --2- 172.21.15.100:0/3497049878 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc0dc06c260 0x7fc0dc06e720 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4009fd0 tx=0x7fc0f400b040 comp rx=0 tx=0).stop 2024-09-11T22:30:34.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.817+0000 7fc0e8ff9640 1 -- 172.21.15.100:0/3497049878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0fc0728c0 msgr2=0x7fc0fc1536e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:34.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.817+0000 7fc0e8ff9640 1 --2- 172.21.15.100:0/3497049878 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0fc0728c0 0x7fc0fc1536e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc0f00098c0 tx=0x7fc0f00046c0 comp rx=0 tx=0).stop 2024-09-11T22:30:34.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.817+0000 7fc0fad9d640 1 -- 172.21.15.100:0/3497049878 reap_dead start 2024-09-11T22:30:34.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.817+0000 7fc0fad9d640 1 -- 172.21.15.100:0/3497049878 reap_dead start 2024-09-11T22:30:34.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.817+0000 7fc0e8ff9640 1 -- 172.21.15.100:0/3497049878 shutdown_connections 2024-09-11T22:30:34.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.817+0000 7fc0e8ff9640 1 -- 172.21.15.100:0/3497049878 >> 172.21.15.100:0/3497049878 conn(0x7fc0fc06f360 msgr2=0x7fc0fc1ea9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:34.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.818+0000 7fc0e8ff9640 1 -- 172.21.15.100:0/3497049878 shutdown_connections 2024-09-11T22:30:34.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:34.818+0000 7fc0e8ff9640 1 -- 172.21.15.100:0/3497049878 wait complete. 2024-09-11T22:30:34.839 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:30:34.839 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-11T22:30:34.839 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c'] 2024-09-11T22:30:34.839 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-11T22:30:34.839 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:30:34.839 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T22:30:34.840 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:30:34.856 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T22:30:34.856 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-09-11T22:30:34.857 INFO:tasks.ceph.mon.c:Sent signal 19 2024-09-11T22:30:34.857 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-11T22:30:49.858 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-09-11T22:30:49.859 INFO:tasks.ceph.mon.c:Sent signal 18 2024-09-11T22:30:49.859 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-11T22:30:49.860 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:30:50.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.079+0000 7f876d801640 1 Processor -- start 2024-09-11T22:30:50.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.081+0000 7f876d801640 1 -- start start 2024-09-11T22:30:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.083+0000 7f876d801640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 0x7f87680b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.083+0000 7f876d801640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8768162070 0x7f87680c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.083+0000 7f876d801640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f876806bc10 con 0x7f876806c9e0 2024-09-11T22:30:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.083+0000 7f876d801640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f87680b22e0 con 0x7f8768162070 2024-09-11T22:30:50.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.083+0000 7f876d801640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f876806bed0 con 0x7f8768158d90 2024-09-11T22:30:50.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.083+0000 7f87667fc640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f876806c9e0 legacy=0x7f876815f560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:30:50.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.088+0000 7f87677fe640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f8768162070 msgr2=0x7f87680c78f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:30:50.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.088+0000 7f87677fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8768162070 0x7f87680c78f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:30:50.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.088+0000 7f8766ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 0x7f87680b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:50.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.088+0000 7f8766ffd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 0x7f87680b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:44018/0 (socket says 172.21.15.100:44018) 2024-09-11T22:30:50.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.088+0000 7f8766ffd640 1 -- 172.21.15.100:0/181387826 learned_addr learned my addr 172.21.15.100:0/181387826 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:30:50.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.088+0000 7f8766ffd640 1 -- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 msgr2=0x7f87680b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:30:50.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.088+0000 7f8766ffd640 1 -- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 msgr2=0x7f87680b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:30:50.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.088+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 0x7f87680b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:30:50.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.088+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 0x7f87680b1da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:30:50.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.284+0000 7f87667fc640 1 -- 172.21.15.100:0/181387826 >> v1:172.21.15.100:6789/0 conn(0x7f876806c9e0 legacy=0x7f876815f560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:30:50.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.289+0000 7f87677fe640 1 -- 172.21.15.100:0/181387826 >> v2:172.21.15.100:3300/0 conn(0x7f8768162070 msgr2=0x7f87680c78f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:30:50.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.289+0000 7f87677fe640 1 --2- 172.21.15.100:0/181387826 >> v2:172.21.15.100:3300/0 conn(0x7f8768162070 0x7f87680c78f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:30:50.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.291+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 0x7f87680b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:50.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.292+0000 7f8766ffd640 1 -- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 msgr2=0x7f87680b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:30:50.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.292+0000 7f8766ffd640 1 -- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 msgr2=0x7f87680b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:30:50.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.292+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 0x7f87680b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:30:50.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.292+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 0x7f87680b1da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:30:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.685+0000 7f87667fc640 1 -- 172.21.15.100:0/181387826 >> v1:172.21.15.100:6789/0 conn(0x7f876806c9e0 legacy=0x7f876815f560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:30:50.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.690+0000 7f87677fe640 1 -- 172.21.15.100:0/181387826 >> v2:172.21.15.100:3300/0 conn(0x7f8768162070 msgr2=0x7f87680c78f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:30:50.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.690+0000 7f87677fe640 1 --2- 172.21.15.100:0/181387826 >> v2:172.21.15.100:3300/0 conn(0x7f8768162070 0x7f87680c78f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:30:50.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.693+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 0x7f87680b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:50.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.693+0000 7f8766ffd640 1 -- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 msgr2=0x7f87680b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:30:50.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.693+0000 7f8766ffd640 1 -- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 msgr2=0x7f87680b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:30:50.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.693+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 0x7f87680b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:30:50.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:50.693+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 0x7f87680b1da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:30:51.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:51.486+0000 7f87667fc640 1 -- 172.21.15.100:0/181387826 >> v1:172.21.15.100:6789/0 conn(0x7f876806c9e0 legacy=0x7f876815f560 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:30:51.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:51.491+0000 7f87677fe640 1 -- 172.21.15.100:0/181387826 >> v2:172.21.15.100:3300/0 conn(0x7f8768162070 msgr2=0x7f87680c78f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:30:51.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:51.491+0000 7f87677fe640 1 --2- 172.21.15.100:0/181387826 >> v2:172.21.15.100:3300/0 conn(0x7f8768162070 0x7f87680c78f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:30:51.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:51.495+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 0x7f87680b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:51.496+0000 7f8766ffd640 1 -- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 msgr2=0x7f87680b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:30:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:51.496+0000 7f8766ffd640 1 -- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 msgr2=0x7f87680b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:30:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:51.496+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 0x7f87680b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:30:51.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:51.496+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 0x7f87680b1da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:30:52.055 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:30:52.061 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:30:53.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:53.083+0000 7f8764ff9640 1 -- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 msgr2=0x7f87680b1da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:30:53.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:53.083+0000 7f8764ff9640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 0x7f87680b1da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:53.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:53.083+0000 7f8764ff9640 1 -- 172.21.15.100:0/181387826 >> v2:172.21.15.100:3300/0 conn(0x7f8768162070 msgr2=0x7f87680c78f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:30:53.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:53.083+0000 7f8764ff9640 1 --2- 172.21.15.100:0/181387826 >> v2:172.21.15.100:3300/0 conn(0x7f8768162070 0x7f87680c78f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:53.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:53.083+0000 7f8764ff9640 1 -- 172.21.15.100:0/181387826 >> v1:172.21.15.100:6789/0 conn(0x7f876806c9e0 legacy=0x7f876815f560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:30:53.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:53.083+0000 7f8764ff9640 1 --2- 172.21.15.100:0/181387826 >> v2:172.21.15.167:3300/0 conn(0x7f87540036c0 0x7f8754005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:53.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:53.083+0000 7f8764ff9640 1 -- 172.21.15.100:0/181387826 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f876806c1b0 con 0x7f8754006190 2024-09-11T22:30:53.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:53.083+0000 7f8764ff9640 1 -- 172.21.15.100:0/181387826 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f87680b22e0 con 0x7f87540036c0 2024-09-11T22:30:53.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:53.086+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> v2:172.21.15.167:3300/0 conn(0x7f87540036c0 0x7f8754005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:53.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:53.086+0000 7f8766ffd640 1 -- 172.21.15.100:0/181387826 >> v2:172.21.15.167:3300/0 conn(0x7f87540036c0 msgr2=0x7f8754005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:30:53.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:53.086+0000 7f8766ffd640 1 -- 172.21.15.100:0/181387826 >> v2:172.21.15.167:3300/0 conn(0x7f87540036c0 msgr2=0x7f8754005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:30:53.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:53.086+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> v2:172.21.15.167:3300/0 conn(0x7f87540036c0 0x7f8754005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:30:53.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:53.086+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> v2:172.21.15.167:3300/0 conn(0x7f87540036c0 0x7f8754005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:30:53.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:53.287+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> v2:172.21.15.167:3300/0 conn(0x7f87540036c0 0x7f8754005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:53.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:53.287+0000 7f8766ffd640 1 -- 172.21.15.100:0/181387826 >> v2:172.21.15.167:3300/0 conn(0x7f87540036c0 msgr2=0x7f8754005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:30:53.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:53.287+0000 7f8766ffd640 1 -- 172.21.15.100:0/181387826 >> v2:172.21.15.167:3300/0 conn(0x7f87540036c0 msgr2=0x7f8754005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:30:53.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:53.287+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> v2:172.21.15.167:3300/0 conn(0x7f87540036c0 0x7f8754005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:30:53.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:53.287+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> v2:172.21.15.167:3300/0 conn(0x7f87540036c0 0x7f8754005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:30:53.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:53.688+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> v2:172.21.15.167:3300/0 conn(0x7f87540036c0 0x7f8754005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:53.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:53.688+0000 7f8766ffd640 1 -- 172.21.15.100:0/181387826 >> v2:172.21.15.167:3300/0 conn(0x7f87540036c0 msgr2=0x7f8754005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:30:53.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:53.688+0000 7f8766ffd640 1 -- 172.21.15.100:0/181387826 >> v2:172.21.15.167:3300/0 conn(0x7f87540036c0 msgr2=0x7f8754005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:30:53.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:53.688+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> v2:172.21.15.167:3300/0 conn(0x7f87540036c0 0x7f8754005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:30:53.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:53.688+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> v2:172.21.15.167:3300/0 conn(0x7f87540036c0 0x7f8754005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:30:54.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.489+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> v2:172.21.15.167:3300/0 conn(0x7f87540036c0 0x7f8754005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:54.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.489+0000 7f8766ffd640 1 -- 172.21.15.100:0/181387826 >> v2:172.21.15.167:3300/0 conn(0x7f87540036c0 msgr2=0x7f8754005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:30:54.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.489+0000 7f8766ffd640 1 -- 172.21.15.100:0/181387826 >> v2:172.21.15.167:3300/0 conn(0x7f87540036c0 msgr2=0x7f8754005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:30:54.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.489+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> v2:172.21.15.167:3300/0 conn(0x7f87540036c0 0x7f8754005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:30:54.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.489+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> v2:172.21.15.167:3300/0 conn(0x7f87540036c0 0x7f8754005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:30:54.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.868+0000 7f8765ffb640 1 -- 172.21.15.100:0/181387826 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 165798409 0 0) 0x7f876806c1b0 con 0x7f8754006190 2024-09-11T22:30:54.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.868+0000 7f8765ffb640 1 -- 172.21.15.100:0/181387826 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8750003520 con 0x7f8754006190 2024-09-11T22:30:54.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.870+0000 7f8765ffb640 1 -- 172.21.15.100:0/181387826 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4045265492 0 0) 0x7f8750003520 con 0x7f8754006190 2024-09-11T22:30:54.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.870+0000 7f8765ffb640 1 -- 172.21.15.100:0/181387826 >> v2:172.21.15.167:3300/0 conn(0x7f87540036c0 msgr2=0x7f8754005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:30:54.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.870+0000 7f8765ffb640 1 --2- 172.21.15.100:0/181387826 >> v2:172.21.15.167:3300/0 conn(0x7f87540036c0 0x7f8754005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.870+0000 7f8765ffb640 1 -- 172.21.15.100:0/181387826 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876806bc10 con 0x7f8754006190 2024-09-11T22:30:54.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.870+0000 7f8765ffb640 1 -- 172.21.15.100:0/181387826 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f875c0041f0 con 0x7f8754006190 2024-09-11T22:30:54.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.870+0000 7f8765ffb640 1 -- 172.21.15.100:0/181387826 >> v1:172.21.15.167:6789/0 conn(0x7f8754006190 legacy=0x7f8754008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:54.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.870+0000 7f8765ffb640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87500039b0 0x7f8750003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.870+0000 7f8765ffb640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 0x7f8750004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.870+0000 7f8765ffb640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8750004d40 0x7f87500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.870+0000 7f8765ffb640 1 -- 172.21.15.100:0/181387826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f87680b22e0 con 0x7f87500039b0 2024-09-11T22:30:54.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.870+0000 7f8765ffb640 1 -- 172.21.15.100:0/181387826 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f875000bb50 con 0x7f8750004d40 2024-09-11T22:30:54.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.870+0000 7f8765ffb640 1 -- 172.21.15.100:0/181387826 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f875000bd20 con 0x7f8768158d90 2024-09-11T22:30:54.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.870+0000 7f87677fe640 1 -- 172.21.15.100:0/181387826 reap_dead start 2024-09-11T22:30:54.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.870+0000 7f8766ffd640 1 -- 172.21.15.100:0/181387826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87500039b0 msgr2=0x7f8750003db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:30:54.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.870+0000 7f8766ffd640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87500039b0 0x7f8750003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:30:54.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.870+0000 7f87677fe640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8750004d40 0x7f87500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:54.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.870+0000 7f87667fc640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 0x7f8750004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:54.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.871+0000 7f87677fe640 1 -- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 msgr2=0x7f8750004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:54.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.871+0000 7f87677fe640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 0x7f8750004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.871+0000 7f87677fe640 1 -- 172.21.15.100:0/181387826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87500039b0 msgr2=0x7f8750003db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:30:54.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.871+0000 7f87677fe640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87500039b0 0x7f8750003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.871+0000 7f87677fe640 1 -- 172.21.15.100:0/181387826 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876806bc10 con 0x7f8750004d40 2024-09-11T22:30:54.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.874+0000 7f87677fe640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8750004d40 0x7f87500051c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f87680726e0 tx=0x7f8750005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c0621ae5d07562 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:54.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.874+0000 7f8765ffb640 1 -- 172.21.15.100:0/181387826 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8760007aa0 con 0x7f8750004d40 2024-09-11T22:30:54.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.875+0000 7f8765ffb640 1 -- 172.21.15.100:0/181387826 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8760032630 con 0x7f8750004d40 2024-09-11T22:30:54.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.875+0000 7f8765ffb640 1 -- 172.21.15.100:0/181387826 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8760032a20 con 0x7f8750004d40 2024-09-11T22:30:54.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.876+0000 7f876d801640 1 -- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8750004d40 msgr2=0x7f87500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:54.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.876+0000 7f876d801640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8750004d40 0x7f87500051c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f87680726e0 tx=0x7f8750005830 comp rx=0 tx=0).stop 2024-09-11T22:30:54.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.876+0000 7f876d801640 1 -- 172.21.15.100:0/181387826 shutdown_connections 2024-09-11T22:30:54.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.876+0000 7f876d801640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8750004d40 0x7f87500051c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.876+0000 7f876d801640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8768158d90 0x7f8750004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.876+0000 7f876d801640 1 --2- 172.21.15.100:0/181387826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87500039b0 0x7f8750003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.876+0000 7f876d801640 1 -- 172.21.15.100:0/181387826 >> 172.21.15.100:0/181387826 conn(0x7f87680c89e0 msgr2=0x7f87680c8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:54.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.876+0000 7f876d801640 1 -- 172.21.15.100:0/181387826 shutdown_connections 2024-09-11T22:30:54.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.876+0000 7f876d801640 1 -- 172.21.15.100:0/181387826 wait complete. 2024-09-11T22:30:54.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.879+0000 7f876d801640 1 Processor -- start 2024-09-11T22:30:54.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.879+0000 7f876d801640 1 -- start start 2024-09-11T22:30:54.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.880+0000 7f876d801640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87500039b0 0x7f87681615a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.880+0000 7f876d801640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8750004d40 0x7f8768160370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.880+0000 7f876d801640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8768158d90 0x7f87681f4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.880+0000 7f876d801640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8768159170 con 0x7f87500039b0 2024-09-11T22:30:54.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.880+0000 7f876d801640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f876815f040 con 0x7f8768158d90 2024-09-11T22:30:54.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.880+0000 7f876d801640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f87681592f0 con 0x7f8750004d40 2024-09-11T22:30:54.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.880+0000 7f8766ffd640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87500039b0 msgr2=0x7f87681615a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:30:54.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.881+0000 7f8766ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87500039b0 0x7f87681615a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:30:54.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.881+0000 7f87677fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8768158d90 0x7f87681f4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:54.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.881+0000 7f87677fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8768158d90 0x7f87681f4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:52864/0 (socket says 172.21.15.100:52864) 2024-09-11T22:30:54.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.881+0000 7f87677fe640 1 -- 172.21.15.100:0/1946777098 learned_addr learned my addr 172.21.15.100:0/1946777098 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:30:54.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.881+0000 7f87677fe640 1 -- 172.21.15.100:0/1946777098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8750004d40 msgr2=0x7f8768160370 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:30:54.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.881+0000 7f87677fe640 1 --2- 172.21.15.100:0/1946777098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8750004d40 0x7f8768160370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.881+0000 7f87677fe640 1 -- 172.21.15.100:0/1946777098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87500039b0 msgr2=0x7f87681615a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:30:54.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.881+0000 7f87677fe640 1 --2- 172.21.15.100:0/1946777098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87500039b0 0x7f87681615a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:54.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.881+0000 7f87677fe640 1 -- 172.21.15.100:0/1946777098 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87680cb850 con 0x7f8768158d90 2024-09-11T22:30:54.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.882+0000 7f87677fe640 1 --2- 172.21.15.100:0/1946777098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8768158d90 0x7f87681f4000 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f876002acf0 tx=0x7f8760005ff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:54.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.883+0000 7f874f7fe640 1 -- 172.21.15.100:0/1946777098 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8760032430 con 0x7f8768158d90 2024-09-11T22:30:54.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.883+0000 7f874f7fe640 1 -- 172.21.15.100:0/1946777098 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8760043070 con 0x7f8768158d90 2024-09-11T22:30:54.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.884+0000 7f876d801640 1 -- 172.21.15.100:0/1946777098 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87680cbaf0 con 0x7f8768158d90 2024-09-11T22:30:54.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.884+0000 7f876d801640 1 -- 172.21.15.100:0/1946777098 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f876815fe50 con 0x7f8768158d90 2024-09-11T22:30:54.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.884+0000 7f874f7fe640 1 -- 172.21.15.100:0/1946777098 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8760032bf0 con 0x7f8768158d90 2024-09-11T22:30:54.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.887+0000 7f874f7fe640 1 -- 172.21.15.100:0/1946777098 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8760048460 con 0x7f8768158d90 2024-09-11T22:30:54.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.887+0000 7f876d801640 1 -- 172.21.15.100:0/1946777098 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87680cab80 con 0x7f8768158d90 2024-09-11T22:30:54.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.888+0000 7f874f7fe640 1 --2- 172.21.15.100:0/1946777098 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f875406c960 0x7f875406ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:54.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.888+0000 7f874f7fe640 1 -- 172.21.15.100:0/1946777098 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f87600ab7b0 con 0x7f8768158d90 2024-09-11T22:30:54.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.888+0000 7f8766ffd640 1 --2- 172.21.15.100:0/1946777098 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f875406c960 0x7f875406ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:54.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.889+0000 7f8766ffd640 1 --2- 172.21.15.100:0/1946777098 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f875406c960 0x7f875406ee20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f87540060a0 tx=0x7f8758008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:54.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:54.896+0000 7f874f7fe640 1 -- 172.21.15.100:0/1946777098 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f87680cab80 con 0x7f8768158d90 2024-09-11T22:30:55.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.405+0000 7f876d801640 1 -- 172.21.15.100:0/1946777098 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8768160050 con 0x7f8768158d90 2024-09-11T22:30:55.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.406+0000 7f874f7fe640 1 -- 172.21.15.100:0/1946777098 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7f8768160050 con 0x7f8768158d90 2024-09-11T22:30:55.408 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":74,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:30:55.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.410+0000 7f876d801640 1 -- 172.21.15.100:0/1946777098 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f875406c960 msgr2=0x7f875406ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:55.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.410+0000 7f876d801640 1 --2- 172.21.15.100:0/1946777098 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f875406c960 0x7f875406ee20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f87540060a0 tx=0x7f8758008040 comp rx=0 tx=0).stop 2024-09-11T22:30:55.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.410+0000 7f876d801640 1 -- 172.21.15.100:0/1946777098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8768158d90 msgr2=0x7f87681f4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:55.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.410+0000 7f876d801640 1 --2- 172.21.15.100:0/1946777098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8768158d90 0x7f87681f4000 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f876002acf0 tx=0x7f8760005ff0 comp rx=0 tx=0).stop 2024-09-11T22:30:55.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.410+0000 7f876d801640 1 -- 172.21.15.100:0/1946777098 shutdown_connections 2024-09-11T22:30:55.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.411+0000 7f876d801640 1 --2- 172.21.15.100:0/1946777098 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f875406c960 0x7f875406ee20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:55.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.411+0000 7f876d801640 1 --2- 172.21.15.100:0/1946777098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8768158d90 0x7f87681f4000 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:55.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.411+0000 7f876d801640 1 --2- 172.21.15.100:0/1946777098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8750004d40 0x7f8768160370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:55.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.411+0000 7f876d801640 1 --2- 172.21.15.100:0/1946777098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87500039b0 0x7f87681615a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:55.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.411+0000 7f876d801640 1 -- 172.21.15.100:0/1946777098 >> 172.21.15.100:0/1946777098 conn(0x7f87680c89e0 msgr2=0x7f8768157410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:55.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.411+0000 7f876d801640 1 -- 172.21.15.100:0/1946777098 shutdown_connections 2024-09-11T22:30:55.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.411+0000 7f876d801640 1 -- 172.21.15.100:0/1946777098 wait complete. 2024-09-11T22:30:55.441 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-11T22:30:55.441 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-11T22:30:55.441 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:30:55.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.628+0000 7f2824a45640 1 Processor -- start 2024-09-11T22:30:55.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.628+0000 7f2824a45640 1 -- start start 2024-09-11T22:30:55.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.629+0000 7f2824a45640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f28200c8b70 0x7f28200c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:55.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.629+0000 7f2824a45640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28200c8f50 0x7f28200c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:55.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.629+0000 7f2824a45640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2820073290 con 0x7f282006bc10 2024-09-11T22:30:55.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.629+0000 7f2824a45640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f28200c8570 con 0x7f28200c8b70 2024-09-11T22:30:55.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.629+0000 7f2824a45640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f28200c1230 con 0x7f28200c8f50 2024-09-11T22:30:55.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.629+0000 7f281e59c640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f28200c8b70 msgr2=0x7f28200c7e60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:30:55.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.629+0000 7f281e59c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f28200c8b70 0x7f28200c7e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:30:55.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.629+0000 7f281dd9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28200c8f50 0x7f28200c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:55.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.629+0000 7f281dd9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28200c8f50 0x7f28200c1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:51354/0 (socket says 172.21.15.100:51354) 2024-09-11T22:30:55.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.629+0000 7f281dd9b640 1 -- 172.21.15.100:0/427528171 learned_addr learned my addr 172.21.15.100:0/427528171 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:30:55.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.630+0000 7f281dd9b640 1 -- 172.21.15.100:0/427528171 >> v2:172.21.15.100:3300/0 conn(0x7f28200c8b70 msgr2=0x7f28200c7e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:30:55.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.630+0000 7f281dd9b640 1 --2- 172.21.15.100:0/427528171 >> v2:172.21.15.100:3300/0 conn(0x7f28200c8b70 0x7f28200c7e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:55.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.630+0000 7f281dd9b640 1 -- 172.21.15.100:0/427528171 >> v1:172.21.15.167:6789/0 conn(0x7f282006bc10 legacy=0x7f282006c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:55.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.630+0000 7f281dd9b640 1 -- 172.21.15.100:0/427528171 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28200729f0 con 0x7f28200c8f50 2024-09-11T22:30:55.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.633+0000 7f281dd9b640 1 --2- 172.21.15.100:0/427528171 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28200c8f50 0x7f28200c1d30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2818008f20 tx=0x7f281802f0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4df34a7c07a9b68 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:55.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.635+0000 7f281d59a640 1 -- 172.21.15.100:0/427528171 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2818035070 con 0x7f28200c8f50 2024-09-11T22:30:55.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.635+0000 7f281d59a640 1 -- 172.21.15.100:0/427528171 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f281802fe30 con 0x7f28200c8f50 2024-09-11T22:30:55.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.636+0000 7f2824a45640 1 -- 172.21.15.100:0/427528171 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28200c8f50 msgr2=0x7f28200c1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:55.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.636+0000 7f2824a45640 1 --2- 172.21.15.100:0/427528171 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28200c8f50 0x7f28200c1d30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2818008f20 tx=0x7f281802f0e0 comp rx=0 tx=0).stop 2024-09-11T22:30:55.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.636+0000 7f2824a45640 1 -- 172.21.15.100:0/427528171 shutdown_connections 2024-09-11T22:30:55.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.636+0000 7f2824a45640 1 --2- 172.21.15.100:0/427528171 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28200c8f50 0x7f28200c1d30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:55.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.636+0000 7f2824a45640 1 --2- 172.21.15.100:0/427528171 >> v2:172.21.15.100:3300/0 conn(0x7f28200c8b70 0x7f28200c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:55.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.636+0000 7f2824a45640 1 -- 172.21.15.100:0/427528171 >> 172.21.15.100:0/427528171 conn(0x7f282006f360 msgr2=0x7f282006f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:55.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.636+0000 7f2824a45640 1 -- 172.21.15.100:0/427528171 shutdown_connections 2024-09-11T22:30:55.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.636+0000 7f2824a45640 1 -- 172.21.15.100:0/427528171 wait complete. 2024-09-11T22:30:55.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.638+0000 7f2824a45640 1 Processor -- start 2024-09-11T22:30:55.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.639+0000 7f2824a45640 1 -- start start 2024-09-11T22:30:55.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.640+0000 7f2824a45640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f282006bc10 0x7f28201f8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:55.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.640+0000 7f2824a45640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28200c8b70 0x7f28201f8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:55.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.640+0000 7f2824a45640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28201f5350 0x7f2820211140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:55.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.640+0000 7f2824a45640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f28200c14d0 con 0x7f28201f5350 2024-09-11T22:30:55.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.640+0000 7f2824a45640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2820072fb0 con 0x7f28200c8b70 2024-09-11T22:30:55.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.640+0000 7f2824a45640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f28200c93a0 con 0x7f282006bc10 2024-09-11T22:30:55.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.640+0000 7f281ed9d640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28201f5350 msgr2=0x7f2820211140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:30:55.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.640+0000 7f281ed9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28201f5350 0x7f2820211140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:30:55.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.640+0000 7f281e59c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f282006bc10 0x7f28201f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:55.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.640+0000 7f281dd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28200c8b70 0x7f28201f8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:55.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.640+0000 7f281e59c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f282006bc10 0x7f28201f8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:51362/0 (socket says 172.21.15.100:51362) 2024-09-11T22:30:55.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.640+0000 7f281e59c640 1 -- 172.21.15.100:0/132775544 learned_addr learned my addr 172.21.15.100:0/132775544 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:30:55.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.641+0000 7f281e59c640 1 -- 172.21.15.100:0/132775544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28200c8b70 msgr2=0x7f28201f8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:55.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.641+0000 7f281e59c640 1 --2- 172.21.15.100:0/132775544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28200c8b70 0x7f28201f8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:55.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.641+0000 7f281e59c640 1 -- 172.21.15.100:0/132775544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28201f5350 msgr2=0x7f2820211140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:30:55.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.641+0000 7f281e59c640 1 --2- 172.21.15.100:0/132775544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28201f5350 0x7f2820211140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:55.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.641+0000 7f281e59c640 1 -- 172.21.15.100:0/132775544 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282016b570 con 0x7f282006bc10 2024-09-11T22:30:55.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.641+0000 7f281e59c640 1 --2- 172.21.15.100:0/132775544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f282006bc10 0x7f28201f8a20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f281000b580 tx=0x7f281000ba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:55.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.642+0000 7f280effd640 1 -- 172.21.15.100:0/132775544 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2810003dc0 con 0x7f282006bc10 2024-09-11T22:30:55.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.642+0000 7f2824a45640 1 -- 172.21.15.100:0/132775544 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28201f1580 con 0x7f282006bc10 2024-09-11T22:30:55.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.642+0000 7f2824a45640 1 -- 172.21.15.100:0/132775544 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f282016b810 con 0x7f282006bc10 2024-09-11T22:30:55.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.643+0000 7f280effd640 1 -- 172.21.15.100:0/132775544 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2810015070 con 0x7f282006bc10 2024-09-11T22:30:55.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.643+0000 7f280effd640 1 -- 172.21.15.100:0/132775544 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2810005310 con 0x7f282006bc10 2024-09-11T22:30:55.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.645+0000 7f280effd640 1 -- 172.21.15.100:0/132775544 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f28100054b0 con 0x7f282006bc10 2024-09-11T22:30:55.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.645+0000 7f280effd640 1 --2- 172.21.15.100:0/132775544 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f280006bf00 0x7f280006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:55.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.646+0000 7f281dd9b640 1 --2- 172.21.15.100:0/132775544 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f280006bf00 0x7f280006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:55.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.645+0000 7f280effd640 1 -- 172.21.15.100:0/132775544 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f281008b090 con 0x7f282006bc10 2024-09-11T22:30:55.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.648+0000 7f281dd9b640 1 --2- 172.21.15.100:0/132775544 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f280006bf00 0x7f280006e3c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f281803a000 tx=0x7f2818012040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:55.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.648+0000 7f2824a45640 1 --2- 172.21.15.100:0/132775544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2804002a70 0x7f2804004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:55.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.648+0000 7f2824a45640 1 -- 172.21.15.100:0/132775544 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2804007ec0 con 0x7f2804002a70 2024-09-11T22:30:55.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.648+0000 7f281ed9d640 1 --2- 172.21.15.100:0/132775544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2804002a70 0x7f2804004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:55.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.649+0000 7f281ed9d640 1 -- 172.21.15.100:0/132775544 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f28040080c0 con 0x7f2804002a70 2024-09-11T22:30:55.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.650+0000 7f281ed9d640 1 --2- 172.21.15.100:0/132775544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2804002a70 0x7f2804004f30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f281400c340 tx=0x7f281400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:55.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.652+0000 7f280effd640 1 -- 172.21.15.100:0/132775544 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28140075a0 con 0x7f2804002a70 2024-09-11T22:30:55.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.652+0000 7f280effd640 1 -- 172.21.15.100:0/132775544 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2814004020 con 0x7f2804002a70 2024-09-11T22:30:55.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.652+0000 7f280effd640 1 -- 172.21.15.100:0/132775544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2804002a70 msgr2=0x7f2804004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:55.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.655+0000 7f280effd640 1 --2- 172.21.15.100:0/132775544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2804002a70 0x7f2804004f30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f281400c340 tx=0x7f281400c800 comp rx=0 tx=0).stop 2024-09-11T22:30:55.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.655+0000 7f280effd640 1 -- 172.21.15.100:0/132775544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2804002a70 msgr2=0x7f2804004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:30:55.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.655+0000 7f280effd640 1 --2- 172.21.15.100:0/132775544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2804002a70 0x7f2804004f30 secure :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f281400c340 tx=0x7f281400c800 comp rx=0 tx=0).stop 2024-09-11T22:30:55.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.689+0000 7f280cff9640 1 --2- 172.21.15.100:0/132775544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2804001db0 0x7f280400cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:55.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.689+0000 7f280cff9640 1 -- 172.21.15.100:0/132775544 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2804002400 con 0x7f2804001db0 2024-09-11T22:30:55.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.690+0000 7f281ed9d640 1 --2- 172.21.15.100:0/132775544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2804001db0 0x7f280400cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:55.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.693+0000 7f281ed9d640 1 -- 172.21.15.100:0/132775544 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f280400a360 con 0x7f2804001db0 2024-09-11T22:30:55.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.694+0000 7f281ed9d640 1 --2- 172.21.15.100:0/132775544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2804001db0 0x7f280400cbf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f281400c340 tx=0x7f2814000fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:55.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.695+0000 7f280effd640 1 -- 172.21.15.100:0/132775544 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2814019670 con 0x7f2804001db0 2024-09-11T22:30:55.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.695+0000 7f280effd640 1 -- 172.21.15.100:0/132775544 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4878 (secure 0 0 0) 0x7f2814019810 con 0x7f2804001db0 2024-09-11T22:30:55.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.695+0000 7f280effd640 1 -- 172.21.15.100:0/132775544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2804001db0 msgr2=0x7f280400cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:55.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.695+0000 7f280effd640 1 --2- 172.21.15.100:0/132775544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2804001db0 0x7f280400cbf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f281400c340 tx=0x7f2814000fe0 comp rx=0 tx=0).stop 2024-09-11T22:30:55.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.695+0000 7f280effd640 1 -- 172.21.15.100:0/132775544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2804001db0 msgr2=0x7f280400cbf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:30:55.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.695+0000 7f280effd640 1 --2- 172.21.15.100:0/132775544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2804001db0 0x7f280400cbf0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:55.701 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:30:55.701 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:30:55.701 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:30:55.701 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:30:55.701 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 74, 2024-09-11T22:30:55.701 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 440973, 2024-09-11T22:30:55.702 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:30:55.702 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:30:55.702 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:30:55.702 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:55.702 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:30:55.702 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:30:55.702 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:30:55.702 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:30:55.702 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:55.702 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:55.702 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:55.702 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:55.702 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:55.703 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:55.703 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:55.703 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:55.703 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:55.703 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:55.703 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:55.703 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:55.703 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:30:55.703 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:30:55.703 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:55.703 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:55.704 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:55.704 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:55.704 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:55.704 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:55.704 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:55.704 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:55.704 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:55.704 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:55.704 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:55.704 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:55.704 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.704 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:30:55.704 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:30:55.704 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:30:55.705 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:30:55.705 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:30:55.705 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:30:55.705 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:30:55.705 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:30:55.705 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:30:55.705 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:30:55.705 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:30:55.705 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:30:55.705 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:30:55.705 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:30:55.705 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:30:55.705 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:30:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:30:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:55.706 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:55.707 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:30:55.707 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.707 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:30:55.707 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.707 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:30:55.707 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:30:55.707 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:55.707 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:55.707 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.707 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:55.707 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:30:55.707 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:55.707 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.707 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.708 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:55.708 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:30:55.708 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:55.708 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:55.708 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:55.708 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.708 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:30:55.708 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:30:55.708 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:55.708 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:55.708 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:55.708 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.708 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.708 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:30:55.709 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:30:55.709 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:55.709 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:55.709 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.709 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:55.709 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:30:55.709 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:55.709 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.709 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.709 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:55.709 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:30:55.709 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:55.709 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:55.710 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:55.710 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.710 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:30:55.710 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:30:55.710 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:55.710 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:55.710 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:55.710 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.710 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.710 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:30:55.710 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:30:55.710 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:55.711 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:55.711 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.711 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:55.711 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:30:55.711 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:55.711 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.711 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.711 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:55.711 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:30:55.711 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:55.711 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:55.711 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:55.712 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.712 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:30:55.712 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:30:55.712 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:55.712 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:55.712 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:55.712 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:55.712 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:55.712 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.712 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:30:55.712 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:30:55.712 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.712 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:55.713 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:55.713 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:30:55.713 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:55.713 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:55.713 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:30:55.713 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.713 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:55.713 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:55.713 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:30:55.713 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:55.713 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:55.714 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:30:55.714 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.714 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:55.714 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:55.714 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:30:55.714 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:55.714 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:55.714 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:30:55.714 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.714 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:55.714 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:55.715 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:30:55.715 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:55.715 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:55.715 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.715 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:30:55.715 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:30:55.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.699+0000 7f2824a45640 1 -- 172.21.15.100:0/132775544 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f280006bf00 msgr2=0x7f280006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:55.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.699+0000 7f2824a45640 1 --2- 172.21.15.100:0/132775544 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f280006bf00 0x7f280006e3c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f281803a000 tx=0x7f2818012040 comp rx=0 tx=0).stop 2024-09-11T22:30:55.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.699+0000 7f2824a45640 1 -- 172.21.15.100:0/132775544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f282006bc10 msgr2=0x7f28201f8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:55.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.699+0000 7f2824a45640 1 --2- 172.21.15.100:0/132775544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f282006bc10 0x7f28201f8a20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f281000b580 tx=0x7f281000ba40 comp rx=0 tx=0).stop 2024-09-11T22:30:55.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.699+0000 7f281ed9d640 1 -- 172.21.15.100:0/132775544 reap_dead start 2024-09-11T22:30:55.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.699+0000 7f2824a45640 1 -- 172.21.15.100:0/132775544 shutdown_connections 2024-09-11T22:30:55.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.699+0000 7f2824a45640 1 --2- 172.21.15.100:0/132775544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f282006bc10 0x7f28201f8a20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:55.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.699+0000 7f2824a45640 1 -- 172.21.15.100:0/132775544 >> 172.21.15.100:0/132775544 conn(0x7f282006f360 msgr2=0x7f28200cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:55.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.700+0000 7f2824a45640 1 -- 172.21.15.100:0/132775544 shutdown_connections 2024-09-11T22:30:55.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.700+0000 7f2824a45640 1 -- 172.21.15.100:0/132775544 wait complete. 2024-09-11T22:30:55.722 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:30:55.723 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-11T22:30:55.723 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:30:55.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.860+0000 7f92c3fff640 1 Processor -- start 2024-09-11T22:30:55.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.861+0000 7f92c3fff640 1 -- start start 2024-09-11T22:30:55.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.862+0000 7f92c3fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c4153e70 0x7f92c40c0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:55.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.862+0000 7f92c3fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f92c4154250 0x7f92c4072bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:55.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.862+0000 7f92c3fff640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92c406e070 con 0x7f92c4071400 2024-09-11T22:30:55.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.862+0000 7f92c3fff640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f92c40740d0 con 0x7f92c4154250 2024-09-11T22:30:55.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.862+0000 7f92c3fff640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f92c406e310 con 0x7f92c4153e70 2024-09-11T22:30:55.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.862+0000 7f92c27fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f92c4154250 0x7f92c4072bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:55.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.862+0000 7f92c27fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f92c4154250 0x7f92c4072bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:52906/0 (socket says 172.21.15.100:52906) 2024-09-11T22:30:55.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.862+0000 7f92c27fc640 1 -- 172.21.15.100:0/3456514752 learned_addr learned my addr 172.21.15.100:0/3456514752 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:30:55.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.863+0000 7f92c2ffd640 1 --2- 172.21.15.100:0/3456514752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c4153e70 0x7f92c40c0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:55.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.863+0000 7f92c27fc640 1 -- 172.21.15.100:0/3456514752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c4153e70 msgr2=0x7f92c40c0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:30:55.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.863+0000 7f92c27fc640 1 --2- 172.21.15.100:0/3456514752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c4153e70 0x7f92c40c0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:55.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.863+0000 7f92c27fc640 1 -- 172.21.15.100:0/3456514752 >> v1:172.21.15.167:6789/0 conn(0x7f92c4071400 legacy=0x7f92c4159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:55.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.863+0000 7f92c27fc640 1 -- 172.21.15.100:0/3456514752 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c406d070 con 0x7f92c4154250 2024-09-11T22:30:55.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.863+0000 7f92c2ffd640 1 --2- 172.21.15.100:0/3456514752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c4153e70 0x7f92c40c0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:30:55.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.866+0000 7f92c27fc640 1 --2- 172.21.15.100:0/3456514752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92c4154250 0x7f92c4072bb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00d170 tx=0x7f92bc02a7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e01c8be663dada80 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:55.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.867+0000 7f92c1ffb640 1 -- 172.21.15.100:0/3456514752 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc00b020 con 0x7f92c4154250 2024-09-11T22:30:55.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.867+0000 7f92c1ffb640 1 -- 172.21.15.100:0/3456514752 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92bc00b1c0 con 0x7f92c4154250 2024-09-11T22:30:55.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.867+0000 7f92c1ffb640 1 -- 172.21.15.100:0/3456514752 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc00a630 con 0x7f92c4154250 2024-09-11T22:30:55.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.868+0000 7f92c3fff640 1 -- 172.21.15.100:0/3456514752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92c4154250 msgr2=0x7f92c4072bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:55.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.868+0000 7f92c3fff640 1 --2- 172.21.15.100:0/3456514752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92c4154250 0x7f92c4072bb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00d170 tx=0x7f92bc02a7e0 comp rx=0 tx=0).stop 2024-09-11T22:30:55.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.868+0000 7f92c3fff640 1 -- 172.21.15.100:0/3456514752 shutdown_connections 2024-09-11T22:30:55.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.868+0000 7f92c3fff640 1 --2- 172.21.15.100:0/3456514752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92c4154250 0x7f92c4072bb0 secure :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00d170 tx=0x7f92bc02a7e0 comp rx=0 tx=0).stop 2024-09-11T22:30:55.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.868+0000 7f92c3fff640 1 --2- 172.21.15.100:0/3456514752 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c4153e70 0x7f92c40c0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:55.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.868+0000 7f92c3fff640 1 -- 172.21.15.100:0/3456514752 >> 172.21.15.100:0/3456514752 conn(0x7f92c406ed10 msgr2=0x7f92c406f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:55.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.871+0000 7f92c3fff640 1 -- 172.21.15.100:0/3456514752 shutdown_connections 2024-09-11T22:30:55.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.871+0000 7f92c3fff640 1 -- 172.21.15.100:0/3456514752 wait complete. 2024-09-11T22:30:55.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.873+0000 7f92c3fff640 1 Processor -- start 2024-09-11T22:30:55.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.873+0000 7f92c3fff640 1 -- start start 2024-09-11T22:30:55.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.874+0000 7f92c3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92c4071400 0x7f92c41567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:55.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.874+0000 7f92c3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92c4153e70 0x7f92c40cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:55.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.874+0000 7f92c2ffd640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92c4071400 msgr2=0x7f92c41567e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:30:55.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.874+0000 7f92c3fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c414cb00 0x7f92c4154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:55.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.874+0000 7f92c2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92c4071400 0x7f92c41567e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:30:55.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.874+0000 7f92c27fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92c4153e70 0x7f92c40cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.874+0000 7f92c27fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92c4153e70 0x7f92c40cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:52916/0 (socket says 172.21.15.100:52916) 2024-09-11T22:30:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.874+0000 7f92c27fc640 1 -- 172.21.15.100:0/2889728584 learned_addr learned my addr 172.21.15.100:0/2889728584 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:30:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.874+0000 7f92c3fff640 1 -- 172.21.15.100:0/2889728584 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f92c406e5f0 con 0x7f92c4071400 2024-09-11T22:30:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.874+0000 7f92c3fff640 1 -- 172.21.15.100:0/2889728584 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f92c406d630 con 0x7f92c4153e70 2024-09-11T22:30:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.874+0000 7f92c3fff640 1 -- 172.21.15.100:0/2889728584 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f92c40c1380 con 0x7f92c414cb00 2024-09-11T22:30:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.875+0000 7f92c37fe640 1 --2- 172.21.15.100:0/2889728584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c414cb00 0x7f92c4154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.875+0000 7f92c27fc640 1 -- 172.21.15.100:0/2889728584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c414cb00 msgr2=0x7f92c4154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.875+0000 7f92c27fc640 1 --2- 172.21.15.100:0/2889728584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c414cb00 0x7f92c4154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.875+0000 7f92c27fc640 1 -- 172.21.15.100:0/2889728584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92c4071400 msgr2=0x7f92c41567e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:30:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.875+0000 7f92c27fc640 1 --2- 172.21.15.100:0/2889728584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92c4071400 0x7f92c41567e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:55.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.875+0000 7f92c27fc640 1 -- 172.21.15.100:0/2889728584 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c41ec9f0 con 0x7f92c4153e70 2024-09-11T22:30:55.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.876+0000 7f92c27fc640 1 --2- 172.21.15.100:0/2889728584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92c4153e70 0x7f92c40cb0b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00d170 tx=0x7f92bc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:55.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.876+0000 7f92ab7fe640 1 -- 172.21.15.100:0/2889728584 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc003e30 con 0x7f92c4153e70 2024-09-11T22:30:55.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.876+0000 7f92ab7fe640 1 -- 172.21.15.100:0/2889728584 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92bc030070 con 0x7f92c4153e70 2024-09-11T22:30:55.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.877+0000 7f92c3fff640 1 -- 172.21.15.100:0/2889728584 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92c4156010 con 0x7f92c4153e70 2024-09-11T22:30:55.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.877+0000 7f92ab7fe640 1 -- 172.21.15.100:0/2889728584 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc003e30 con 0x7f92c4153e70 2024-09-11T22:30:55.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.877+0000 7f92c3fff640 1 -- 172.21.15.100:0/2889728584 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92c414c580 con 0x7f92c4153e70 2024-09-11T22:30:55.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.879+0000 7f92a97fa640 1 --2- 172.21.15.100:0/2889728584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c41ecbc0 0x7f92c40c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:55.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.879+0000 7f92a97fa640 1 -- 172.21.15.100:0/2889728584 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f92c40c16d0 con 0x7f92c41ecbc0 2024-09-11T22:30:55.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.879+0000 7f92c2ffd640 1 --2- 172.21.15.100:0/2889728584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c41ecbc0 0x7f92c40c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:55.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.880+0000 7f92ab7fe640 1 -- 172.21.15.100:0/2889728584 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f92bc047020 con 0x7f92c4153e70 2024-09-11T22:30:55.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.880+0000 7f92c2ffd640 1 -- 172.21.15.100:0/2889728584 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f92c41510e0 con 0x7f92c41ecbc0 2024-09-11T22:30:55.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.880+0000 7f92ab7fe640 1 --2- 172.21.15.100:0/2889728584 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f92b006c010 0x7f92b006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:55.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.882+0000 7f92c2ffd640 1 --2- 172.21.15.100:0/2889728584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c41ecbc0 0x7f92c40c5de0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009f00 tx=0x7f92b400b510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:55.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.882+0000 7f92ab7fe640 1 -- 172.21.15.100:0/2889728584 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b4022070 con 0x7f92c41ecbc0 2024-09-11T22:30:55.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.882+0000 7f92c37fe640 1 --2- 172.21.15.100:0/2889728584 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f92b006c010 0x7f92b006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:55.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.883+0000 7f92ab7fe640 1 -- 172.21.15.100:0/2889728584 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f92b400be20 con 0x7f92c41ecbc0 2024-09-11T22:30:55.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.883+0000 7f92ab7fe640 1 -- 172.21.15.100:0/2889728584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c41ecbc0 msgr2=0x7f92c40c5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:55.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.883+0000 7f92ab7fe640 1 --2- 172.21.15.100:0/2889728584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c41ecbc0 0x7f92c40c5de0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009f00 tx=0x7f92b400b510 comp rx=0 tx=0).stop 2024-09-11T22:30:55.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.883+0000 7f92ab7fe640 1 -- 172.21.15.100:0/2889728584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c41ecbc0 msgr2=0x7f92c40c5de0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:30:55.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.883+0000 7f92ab7fe640 1 --2- 172.21.15.100:0/2889728584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c41ecbc0 0x7f92c40c5de0 secure :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009f00 tx=0x7f92b400b510 comp rx=0 tx=0).stop 2024-09-11T22:30:55.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.883+0000 7f92c37fe640 1 --2- 172.21.15.100:0/2889728584 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f92b006c010 0x7f92b006e4d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f92b8007fd0 tx=0x7f92b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:55.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.884+0000 7f92ab7fe640 1 -- 172.21.15.100:0/2889728584 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f92bc0779c0 con 0x7f92c4153e70 2024-09-11T22:30:55.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.906+0000 7f92a97fa640 1 --2- 172.21.15.100:0/2889728584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c4154c60 0x7f92c41ef4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:30:55.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.907+0000 7f92a97fa640 1 -- 172.21.15.100:0/2889728584 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f92c4150b20 con 0x7f92c4154c60 2024-09-11T22:30:55.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.907+0000 7f92c2ffd640 1 --2- 172.21.15.100:0/2889728584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c4154c60 0x7f92c41ef4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:30:55.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.910+0000 7f92c2ffd640 1 -- 172.21.15.100:0/2889728584 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f92c4155070 con 0x7f92c4154c60 2024-09-11T22:30:55.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.912+0000 7f92c2ffd640 1 --2- 172.21.15.100:0/2889728584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c4154c60 0x7f92c41ef4c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009f00 tx=0x7f92b4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:30:55.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.914+0000 7f92ab7fe640 1 -- 172.21.15.100:0/2889728584 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b4022070 con 0x7f92c4154c60 2024-09-11T22:30:55.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.914+0000 7f92ab7fe640 1 -- 172.21.15.100:0/2889728584 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5043 (secure 0 0 0) 0x7f92b4004020 con 0x7f92c4154c60 2024-09-11T22:30:55.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.914+0000 7f92ab7fe640 1 -- 172.21.15.100:0/2889728584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c4154c60 msgr2=0x7f92c41ef4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:55.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.914+0000 7f92ab7fe640 1 --2- 172.21.15.100:0/2889728584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c4154c60 0x7f92c41ef4c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009f00 tx=0x7f92b4004730 comp rx=0 tx=0).stop 2024-09-11T22:30:55.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.914+0000 7f92ab7fe640 1 -- 172.21.15.100:0/2889728584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c4154c60 msgr2=0x7f92c41ef4c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:30:55.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.914+0000 7f92ab7fe640 1 --2- 172.21.15.100:0/2889728584 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f92c4154c60 0x7f92c41ef4c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:30:55.920 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:30:55.920 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:30:55.920 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:30:55.920 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:30:55.920 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 74, 2024-09-11T22:30:55.920 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 546635, 2024-09-11T22:30:55.920 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:30:55.920 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:30:55.920 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:30:55.921 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:55.921 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:30:55.921 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:30:55.921 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:30:55.921 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:30:55.921 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:55.921 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:55.921 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:55.921 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:55.921 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:55.921 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:55.921 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:55.921 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:55.921 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:55.922 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:55.922 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:55.922 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:55.922 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:30:55.922 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:30:55.922 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:55.922 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:55.922 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:55.922 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:55.922 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:55.922 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:55.922 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:55.922 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:55.922 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:55.923 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:55.923 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:55.923 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:55.923 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.923 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:30:55.923 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:30:55.923 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:30:55.923 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:30:55.923 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:30:55.923 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:30:55.923 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:30:55.923 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:30:55.923 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:30:55.923 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:30:55.924 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:30:55.924 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:30:55.924 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:30:55.924 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:30:55.924 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:30:55.924 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:30:55.924 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:30:55.924 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:30:55.924 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:30:55.924 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:30:55.924 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:30:55.924 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:30:55.924 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:30:55.925 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:30:55.925 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:30:55.925 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:30:55.925 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:30:55.925 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:30:55.925 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:55.925 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:30:55.925 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.925 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:30:55.925 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.925 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:30:55.925 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:30:55.925 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:55.926 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:55.926 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.926 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:55.926 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:30:55.926 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:55.926 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.926 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.926 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:55.926 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:30:55.926 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:55.926 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:55.926 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:55.926 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.927 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:30:55.927 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:30:55.927 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:55.927 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:55.927 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:55.927 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.927 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.927 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:30:55.927 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:30:55.927 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:55.927 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:55.927 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.927 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:55.927 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:30:55.927 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:55.928 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.928 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.928 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:55.928 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:30:55.928 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:55.928 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:55.928 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:55.928 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.928 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:30:55.928 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:30:55.928 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:55.929 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:55.929 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:55.929 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.929 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.929 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:30:55.929 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:30:55.929 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:30:55.929 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:30:55.929 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.929 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:30:55.929 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:30:55.929 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:55.929 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.929 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.930 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:30:55.930 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:30:55.930 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:30:55.930 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:55.930 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:55.930 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.930 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:30:55.930 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:30:55.930 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:30:55.930 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:30:55.930 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:30:55.930 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:55.930 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:55.930 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.931 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:30:55.931 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:30:55.931 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.931 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:55.931 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:55.931 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:30:55.931 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:55.931 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:55.931 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:30:55.931 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.931 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:55.931 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:55.931 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:30:55.931 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:55.932 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:55.932 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:30:55.932 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.932 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:55.932 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:55.932 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:30:55.932 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:55.932 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:55.932 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:30:55.932 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.932 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:55.932 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:55.932 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:30:55.932 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:55.933 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:30:55.933 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:30:55.933 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:30:55.933 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:30:55.933 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:30:55.933 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:30:55.933 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:30:55.933 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:30:55.933 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:30:55.933 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:30:55.933 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:30:55.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.918+0000 7f92a97fa640 1 -- 172.21.15.100:0/2889728584 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f92b006c010 msgr2=0x7f92b006e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:55.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.918+0000 7f92a97fa640 1 --2- 172.21.15.100:0/2889728584 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f92b006c010 0x7f92b006e4d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f92b8007fd0 tx=0x7f92b8009040 comp rx=0 tx=0).stop 2024-09-11T22:30:55.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.918+0000 7f92a97fa640 1 -- 172.21.15.100:0/2889728584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92c4153e70 msgr2=0x7f92c40cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:30:55.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.918+0000 7f92a97fa640 1 --2- 172.21.15.100:0/2889728584 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92c4153e70 0x7f92c40cb0b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f92bc00d170 tx=0x7f92bc004a40 comp rx=0 tx=0).stop 2024-09-11T22:30:55.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.919+0000 7f92c37fe640 1 -- 172.21.15.100:0/2889728584 reap_dead start 2024-09-11T22:30:55.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.919+0000 7f92c37fe640 1 -- 172.21.15.100:0/2889728584 reap_dead start 2024-09-11T22:30:55.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.919+0000 7f92a97fa640 1 -- 172.21.15.100:0/2889728584 shutdown_connections 2024-09-11T22:30:55.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.919+0000 7f92a97fa640 1 -- 172.21.15.100:0/2889728584 >> 172.21.15.100:0/2889728584 conn(0x7f92c406ed10 msgr2=0x7f92c40c6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:30:55.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.920+0000 7f92a97fa640 1 -- 172.21.15.100:0/2889728584 shutdown_connections 2024-09-11T22:30:55.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:30:55.920+0000 7f92a97fa640 1 -- 172.21.15.100:0/2889728584 wait complete. 2024-09-11T22:30:55.947 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:30:55.947 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-11T22:31:15.948 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:31:15.948 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-11T22:31:15.948 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T22:31:15.949 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T22:31:15.952 INFO:tasks.ceph.mon.a:Started 2024-09-11T22:31:15.952 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-09-11T22:31:15.952 INFO:tasks.ceph.mon.c:Sent signal 19 2024-09-11T22:31:15.952 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-11T22:31:22.462 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:31:22.465 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:31:30.952 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-09-11T22:31:30.953 INFO:tasks.ceph.mon.c:Sent signal 18 2024-09-11T22:31:30.953 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:31:30.953 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:31:31.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.148+0000 7fc4109b7640 1 Processor -- start 2024-09-11T22:31:31.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.148+0000 7fc4109b7640 1 -- start start 2024-09-11T22:31:31.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.150+0000 7fc4109b7640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc40c06c1a0 0x7fc40c06c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:31.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.150+0000 7fc4109b7640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc40c0c1000 con 0x7fc40c156c90 2024-09-11T22:31:31.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.150+0000 7fc4109b7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc40c073570 con 0x7fc40c153ec0 2024-09-11T22:31:31.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.150+0000 7fc4109b7640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fc40c159eb0 con 0x7fc40c06c1a0 2024-09-11T22:31:31.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.160+0000 7fc40a59c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fc40c153ec0 0x7fc40c072c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:60504/0 (socket says 172.21.15.100:60504) 2024-09-11T22:31:31.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.160+0000 7fc40a59c640 1 -- 172.21.15.100:0/3783750960 learned_addr learned my addr 172.21.15.100:0/3783750960 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:31:31.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.160+0000 7fc409d9b640 1 --2- 172.21.15.100:0/3783750960 >> v2:172.21.15.100:3300/0 conn(0x7fc40c06c1a0 0x7fc40c06c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:31.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.161+0000 7fc409d9b640 1 -- 172.21.15.100:0/3783750960 >> v2:172.21.15.100:3300/0 conn(0x7fc40c06c1a0 msgr2=0x7fc40c06c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:31:31.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.161+0000 7fc409d9b640 1 -- 172.21.15.100:0/3783750960 >> v2:172.21.15.100:3300/0 conn(0x7fc40c06c1a0 msgr2=0x7fc40c06c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:31:31.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.161+0000 7fc409d9b640 1 --2- 172.21.15.100:0/3783750960 >> v2:172.21.15.100:3300/0 conn(0x7fc40c06c1a0 0x7fc40c06c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:31:31.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.161+0000 7fc409d9b640 1 --2- 172.21.15.100:0/3783750960 >> v2:172.21.15.100:3300/0 conn(0x7fc40c06c1a0 0x7fc40c06c610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:31:31.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.367+0000 7fc40959a640 1 -- 172.21.15.100:0/3783750960 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1442948940 0 0) 0x7fc40c073570 con 0x7fc40c153ec0 2024-09-11T22:31:31.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.367+0000 7fc40959a640 1 -- 172.21.15.100:0/3783750960 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3f4003520 con 0x7fc40c153ec0 2024-09-11T22:31:31.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.368+0000 7fc40959a640 1 -- 172.21.15.100:0/3783750960 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3981939467 0 0) 0x7fc3f4003520 con 0x7fc40c153ec0 2024-09-11T22:31:31.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.368+0000 7fc40959a640 1 -- 172.21.15.100:0/3783750960 >> v2:172.21.15.100:3300/0 conn(0x7fc40c06c1a0 msgr2=0x7fc40c06c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:31.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.368+0000 7fc40959a640 1 --2- 172.21.15.100:0/3783750960 >> v2:172.21.15.100:3300/0 conn(0x7fc40c06c1a0 0x7fc40c06c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:31.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.368+0000 7fc40959a640 1 -- 172.21.15.100:0/3783750960 >> v1:172.21.15.100:6789/0 conn(0x7fc40c156c90 legacy=0x7fc40c157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:31.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.368+0000 7fc40959a640 1 -- 172.21.15.100:0/3783750960 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40c15a190 con 0x7fc40c153ec0 2024-09-11T22:31:31.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.368+0000 7fc40959a640 1 -- 172.21.15.100:0/3783750960 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fc3fc000ed0 con 0x7fc40c153ec0 2024-09-11T22:31:31.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.368+0000 7fc40959a640 1 -- 172.21.15.100:0/3783750960 >> v1:172.21.15.167:6789/0 conn(0x7fc40c153ec0 legacy=0x7fc40c072c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:31.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.368+0000 7fc40959a640 1 --2- 172.21.15.100:0/3783750960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3f40039b0 0x7fc3f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:31.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.368+0000 7fc40959a640 1 --2- 172.21.15.100:0/3783750960 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3f4004800 0x7fc3f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:31.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.368+0000 7fc40959a640 1 --2- 172.21.15.100:0/3783750960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3f40051c0 0x7fc3f400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:31.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.368+0000 7fc40959a640 1 -- 172.21.15.100:0/3783750960 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c159eb0 con 0x7fc3f40039b0 2024-09-11T22:31:31.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.368+0000 7fc40959a640 1 -- 172.21.15.100:0/3783750960 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f4014930 con 0x7fc3f40051c0 2024-09-11T22:31:31.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.368+0000 7fc40959a640 1 -- 172.21.15.100:0/3783750960 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc3f4014b30 con 0x7fc3f4004800 2024-09-11T22:31:31.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.368+0000 7fc40ad9d640 1 --2- 172.21.15.100:0/3783750960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3f40051c0 0x7fc3f400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:31.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.368+0000 7fc409d9b640 1 --2- 172.21.15.100:0/3783750960 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3f4004800 0x7fc3f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:31.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.369+0000 7fc40ad9d640 1 -- 172.21.15.100:0/3783750960 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3f4004800 msgr2=0x7fc3f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:31.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.369+0000 7fc40ad9d640 1 --2- 172.21.15.100:0/3783750960 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3f4004800 0x7fc3f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:31.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.369+0000 7fc40ad9d640 1 -- 172.21.15.100:0/3783750960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3f40039b0 msgr2=0x7fc3f4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:31.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.369+0000 7fc40ad9d640 1 --2- 172.21.15.100:0/3783750960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3f40039b0 0x7fc3f4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:31.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.369+0000 7fc40ad9d640 1 -- 172.21.15.100:0/3783750960 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40c15a190 con 0x7fc3f40051c0 2024-09-11T22:31:31.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.370+0000 7fc40ad9d640 1 -- 172.21.15.100:0/3783750960 reap_dead start 2024-09-11T22:31:31.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.370+0000 7fc40ad9d640 1 --2- 172.21.15.100:0/3783750960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3f40051c0 0x7fc3f400b9c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc400001720 tx=0x7fc3f4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da74ef23fc2ffcfa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:31.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.371+0000 7fc40959a640 1 -- 172.21.15.100:0/3783750960 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc400001370 con 0x7fc3f40051c0 2024-09-11T22:31:31.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.371+0000 7fc40959a640 1 -- 172.21.15.100:0/3783750960 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4000052d0 con 0x7fc3f40051c0 2024-09-11T22:31:31.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.371+0000 7fc40959a640 1 -- 172.21.15.100:0/3783750960 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40002ab00 con 0x7fc3f40051c0 2024-09-11T22:31:31.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.372+0000 7fc4109b7640 1 -- 172.21.15.100:0/3783750960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3f40051c0 msgr2=0x7fc3f400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:31.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.372+0000 7fc4109b7640 1 --2- 172.21.15.100:0/3783750960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3f40051c0 0x7fc3f400b9c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc400001720 tx=0x7fc3f4005830 comp rx=0 tx=0).stop 2024-09-11T22:31:31.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.372+0000 7fc4109b7640 1 -- 172.21.15.100:0/3783750960 shutdown_connections 2024-09-11T22:31:31.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.372+0000 7fc4109b7640 1 --2- 172.21.15.100:0/3783750960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3f40051c0 0x7fc3f400b9c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:31.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.372+0000 7fc4109b7640 1 -- 172.21.15.100:0/3783750960 >> 172.21.15.100:0/3783750960 conn(0x7fc40c0cbf70 msgr2=0x7fc40c0cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:31.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.372+0000 7fc4109b7640 1 -- 172.21.15.100:0/3783750960 shutdown_connections 2024-09-11T22:31:31.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.372+0000 7fc4109b7640 1 -- 172.21.15.100:0/3783750960 wait complete. 2024-09-11T22:31:31.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.374+0000 7fc4109b7640 1 Processor -- start 2024-09-11T22:31:31.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.374+0000 7fc4109b7640 1 -- start start 2024-09-11T22:31:31.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.379+0000 7fc4109b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3f40051c0 0x7fc40c145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:31.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.379+0000 7fc4109b7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc40c159a20 0x7fc40c1558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:31.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.379+0000 7fc4109b7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc40c0c9070 0x7fc40c155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:31.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.379+0000 7fc4109b7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c15aa30 con 0x7fc3f40051c0 2024-09-11T22:31:31.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.379+0000 7fc4109b7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c15a750 con 0x7fc40c0c9070 2024-09-11T22:31:31.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.379+0000 7fc4109b7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc40c15ad10 con 0x7fc40c159a20 2024-09-11T22:31:31.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.382+0000 7fc409d9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc40c159a20 0x7fc40c1558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:31.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.382+0000 7fc409d9b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc40c159a20 0x7fc40c1558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:48068/0 (socket says 172.21.15.100:48068) 2024-09-11T22:31:31.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.382+0000 7fc409d9b640 1 -- 172.21.15.100:0/894516045 learned_addr learned my addr 172.21.15.100:0/894516045 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:31:31.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.382+0000 7fc40ad9d640 1 --2- 172.21.15.100:0/894516045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc40c0c9070 0x7fc40c155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:31.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.385+0000 7fc40a59c640 1 --2- 172.21.15.100:0/894516045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3f40051c0 0x7fc40c145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:31.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.385+0000 7fc409d9b640 1 -- 172.21.15.100:0/894516045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc40c0c9070 msgr2=0x7fc40c155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:31.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.385+0000 7fc409d9b640 1 --2- 172.21.15.100:0/894516045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc40c0c9070 0x7fc40c155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:31.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.385+0000 7fc409d9b640 1 -- 172.21.15.100:0/894516045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3f40051c0 msgr2=0x7fc40c145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:31.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.385+0000 7fc409d9b640 1 --2- 172.21.15.100:0/894516045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3f40051c0 0x7fc40c145bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:31.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.385+0000 7fc409d9b640 1 -- 172.21.15.100:0/894516045 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40c159340 con 0x7fc40c159a20 2024-09-11T22:31:31.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.385+0000 7fc40a59c640 1 --2- 172.21.15.100:0/894516045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3f40051c0 0x7fc40c145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:31:31.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.388+0000 7fc409d9b640 1 --2- 172.21.15.100:0/894516045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc40c159a20 0x7fc40c1558c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc40400aed0 tx=0x7fc404010580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:31.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.392+0000 7fc3faffd640 1 -- 172.21.15.100:0/894516045 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc404019020 con 0x7fc40c159a20 2024-09-11T22:31:31.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.397+0000 7fc3faffd640 1 -- 172.21.15.100:0/894516045 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc404010e30 con 0x7fc40c159a20 2024-09-11T22:31:31.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.397+0000 7fc4109b7640 1 -- 172.21.15.100:0/894516045 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc40c1ebdc0 con 0x7fc40c159a20 2024-09-11T22:31:31.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.397+0000 7fc4109b7640 1 -- 172.21.15.100:0/894516045 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc40c1ec360 con 0x7fc40c159a20 2024-09-11T22:31:31.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.397+0000 7fc3faffd640 1 -- 172.21.15.100:0/894516045 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc404015670 con 0x7fc40c159a20 2024-09-11T22:31:31.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.399+0000 7fc4109b7640 1 -- 172.21.15.100:0/894516045 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc40c074110 con 0x7fc40c159a20 2024-09-11T22:31:31.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.401+0000 7fc3faffd640 1 -- 172.21.15.100:0/894516045 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc404005d10 con 0x7fc40c159a20 2024-09-11T22:31:31.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.402+0000 7fc3faffd640 1 --2- 172.21.15.100:0/894516045 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc3ec06bf00 0x7fc3ec06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:31.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.402+0000 7fc40a59c640 1 --2- 172.21.15.100:0/894516045 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc3ec06bf00 0x7fc3ec06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:31.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.403+0000 7fc40a59c640 1 --2- 172.21.15.100:0/894516045 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc3ec06bf00 0x7fc3ec06e3c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0518b0 tx=0x7fc3fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:31.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.403+0000 7fc3faffd640 1 -- 172.21.15.100:0/894516045 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fc40408c060 con 0x7fc40c159a20 2024-09-11T22:31:31.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.410+0000 7fc3faffd640 1 -- 172.21.15.100:0/894516045 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc404023030 con 0x7fc40c159a20 2024-09-11T22:31:31.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.917+0000 7fc4109b7640 1 -- 172.21.15.100:0/894516045 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc40c072d00 con 0x7fc40c159a20 2024-09-11T22:31:31.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.918+0000 7fc3faffd640 1 -- 172.21.15.100:0/894516045 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7fc40408b020 con 0x7fc40c159a20 2024-09-11T22:31:31.919 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":82,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:31:31.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.922+0000 7fc4109b7640 1 -- 172.21.15.100:0/894516045 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc3ec06bf00 msgr2=0x7fc3ec06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:31.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.922+0000 7fc4109b7640 1 --2- 172.21.15.100:0/894516045 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc3ec06bf00 0x7fc3ec06e3c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc40c0518b0 tx=0x7fc3fc009040 comp rx=0 tx=0).stop 2024-09-11T22:31:31.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.922+0000 7fc4109b7640 1 -- 172.21.15.100:0/894516045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc40c159a20 msgr2=0x7fc40c1558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:31.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.922+0000 7fc4109b7640 1 --2- 172.21.15.100:0/894516045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc40c159a20 0x7fc40c1558c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc40400aed0 tx=0x7fc404010580 comp rx=0 tx=0).stop 2024-09-11T22:31:31.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.924+0000 7fc4109b7640 1 -- 172.21.15.100:0/894516045 shutdown_connections 2024-09-11T22:31:31.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.924+0000 7fc4109b7640 1 --2- 172.21.15.100:0/894516045 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc3ec06bf00 0x7fc3ec06e3c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:31.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.924+0000 7fc4109b7640 1 --2- 172.21.15.100:0/894516045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc40c0c9070 0x7fc40c155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:31.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.924+0000 7fc4109b7640 1 --2- 172.21.15.100:0/894516045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc40c159a20 0x7fc40c1558c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:31.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.924+0000 7fc4109b7640 1 --2- 172.21.15.100:0/894516045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3f40051c0 0x7fc40c145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:31.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.924+0000 7fc4109b7640 1 -- 172.21.15.100:0/894516045 >> 172.21.15.100:0/894516045 conn(0x7fc40c0cbf70 msgr2=0x7fc40c151980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:31.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.924+0000 7fc4109b7640 1 -- 172.21.15.100:0/894516045 shutdown_connections 2024-09-11T22:31:31.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:31.924+0000 7fc4109b7640 1 -- 172.21.15.100:0/894516045 wait complete. 2024-09-11T22:31:31.949 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:31:31.949 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:31:31.949 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:31:32.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.147+0000 7fb9a156b640 1 Processor -- start 2024-09-11T22:31:32.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.147+0000 7fb9a156b640 1 -- start start 2024-09-11T22:31:32.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.148+0000 7fb9a156b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb99c06f830 0x7fb99c15a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:32.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.148+0000 7fb9a156b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb99c1576d0 0x7fb99c06d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:32.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.148+0000 7fb9a156b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb99c15aec0 con 0x7fb99c06e2d0 2024-09-11T22:31:32.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.148+0000 7fb9a156b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fb99c0734f0 con 0x7fb99c1576d0 2024-09-11T22:31:32.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.148+0000 7fb9a156b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb99c072f30 con 0x7fb99c06f830 2024-09-11T22:31:32.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.149+0000 7fb9a0d6a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb99c1576d0 0x7fb99c06d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:32.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.149+0000 7fb9a0d6a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb99c1576d0 0x7fb99c06d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:57212/0 (socket says 172.21.15.100:57212) 2024-09-11T22:31:32.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.149+0000 7fb9a0d6a640 1 -- 172.21.15.100:0/696613802 learned_addr learned my addr 172.21.15.100:0/696613802 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:31:32.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.149+0000 7fb99b7fe640 1 --2- 172.21.15.100:0/696613802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb99c06f830 0x7fb99c15a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:32.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.149+0000 7fb9a0d6a640 1 -- 172.21.15.100:0/696613802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb99c06f830 msgr2=0x7fb99c15a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:32.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.149+0000 7fb9a0d6a640 1 --2- 172.21.15.100:0/696613802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb99c06f830 0x7fb99c15a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.149+0000 7fb9a0d6a640 1 -- 172.21.15.100:0/696613802 >> v1:172.21.15.167:6789/0 conn(0x7fb99c06e2d0 legacy=0x7fb99c0c0e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:31:32.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.149+0000 7fb9a0d6a640 1 -- 172.21.15.100:0/696613802 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99c073210 con 0x7fb99c1576d0 2024-09-11T22:31:32.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.151+0000 7fb9a0d6a640 1 --2- 172.21.15.100:0/696613802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb99c1576d0 0x7fb99c06d240 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb990009870 tx=0x7fb99002a2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12fc48fb96462053 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:32.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.151+0000 7fb99affd640 1 -- 172.21.15.100:0/696613802 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990037070 con 0x7fb99c1576d0 2024-09-11T22:31:32.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.151+0000 7fb99affd640 1 -- 172.21.15.100:0/696613802 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb990032440 con 0x7fb99c1576d0 2024-09-11T22:31:32.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.151+0000 7fb99affd640 1 -- 172.21.15.100:0/696613802 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990032810 con 0x7fb99c1576d0 2024-09-11T22:31:32.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.152+0000 7fb9a156b640 1 -- 172.21.15.100:0/696613802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb99c1576d0 msgr2=0x7fb99c06d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:32.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.152+0000 7fb9a156b640 1 --2- 172.21.15.100:0/696613802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb99c1576d0 0x7fb99c06d240 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb990009870 tx=0x7fb99002a2a0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.152+0000 7fb9a156b640 1 -- 172.21.15.100:0/696613802 shutdown_connections 2024-09-11T22:31:32.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.152+0000 7fb9a156b640 1 --2- 172.21.15.100:0/696613802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb99c1576d0 0x7fb99c06d240 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.152+0000 7fb9a156b640 1 --2- 172.21.15.100:0/696613802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb99c06f830 0x7fb99c15a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.152+0000 7fb9a156b640 1 -- 172.21.15.100:0/696613802 >> 172.21.15.100:0/696613802 conn(0x7fb99c06ed10 msgr2=0x7fb99c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:32.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.153+0000 7fb9a156b640 1 -- 172.21.15.100:0/696613802 shutdown_connections 2024-09-11T22:31:32.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.153+0000 7fb9a156b640 1 -- 172.21.15.100:0/696613802 wait complete. 2024-09-11T22:31:32.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.155+0000 7fb9a156b640 1 Processor -- start 2024-09-11T22:31:32.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.155+0000 7fb9a156b640 1 -- start start 2024-09-11T22:31:32.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.156+0000 7fb9a156b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb99c06e2d0 0x7fb99c147760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:32.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.156+0000 7fb9a156b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb99c06f830 0x7fb99c1f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:32.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.156+0000 7fb9a156b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb99c1576d0 0x7fb99c159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:32.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.157+0000 7fb99bfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb99c06e2d0 0x7fb99c147760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:32.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.157+0000 7fb99bfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb99c06e2d0 0x7fb99c147760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:48080/0 (socket says 172.21.15.100:48080) 2024-09-11T22:31:32.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.157+0000 7fb99b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb99c06f830 0x7fb99c1f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:32.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.157+0000 7fb99b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb99c06f830 0x7fb99c1f2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:57214/0 (socket says 172.21.15.100:57214) 2024-09-11T22:31:32.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.157+0000 7fb99bfff640 1 -- 172.21.15.100:0/1133206664 learned_addr learned my addr 172.21.15.100:0/1133206664 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:31:32.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.157+0000 7fb9a0d6a640 1 --2- 172.21.15.100:0/1133206664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb99c1576d0 0x7fb99c159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:32.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.157+0000 7fb9a156b640 1 -- 172.21.15.100:0/1133206664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c071490 con 0x7fb99c1576d0 2024-09-11T22:31:32.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.157+0000 7fb9a156b640 1 -- 172.21.15.100:0/1133206664 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c156ed0 con 0x7fb99c06f830 2024-09-11T22:31:32.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.158+0000 7fb9a156b640 1 -- 172.21.15.100:0/1133206664 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb99c06d780 con 0x7fb99c06e2d0 2024-09-11T22:31:32.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.159+0000 7fb99b7fe640 1 -- 172.21.15.100:0/1133206664 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb99c06e2d0 msgr2=0x7fb99c147760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:32.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.159+0000 7fb99b7fe640 1 --2- 172.21.15.100:0/1133206664 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb99c06e2d0 0x7fb99c147760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.159+0000 7fb99b7fe640 1 -- 172.21.15.100:0/1133206664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb99c1576d0 msgr2=0x7fb99c159570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:32.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.159+0000 7fb99b7fe640 1 --2- 172.21.15.100:0/1133206664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb99c1576d0 0x7fb99c159570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.159+0000 7fb99b7fe640 1 -- 172.21.15.100:0/1133206664 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99c149860 con 0x7fb99c06f830 2024-09-11T22:31:32.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.159+0000 7fb9a0d6a640 1 --2- 172.21.15.100:0/1133206664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb99c1576d0 0x7fb99c159570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:31:32.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.159+0000 7fb99b7fe640 1 --2- 172.21.15.100:0/1133206664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb99c06f830 0x7fb99c1f2d30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb994007e30 tx=0x7fb99400e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:32.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.161+0000 7fb998ff9640 1 -- 172.21.15.100:0/1133206664 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99401a070 con 0x7fb99c06f830 2024-09-11T22:31:32.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.161+0000 7fb9a156b640 1 -- 172.21.15.100:0/1133206664 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb99c15a710 con 0x7fb99c06f830 2024-09-11T22:31:32.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.161+0000 7fb9a156b640 1 -- 172.21.15.100:0/1133206664 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb99c1f2530 con 0x7fb99c06f830 2024-09-11T22:31:32.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.161+0000 7fb998ff9640 1 -- 172.21.15.100:0/1133206664 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb99400ee90 con 0x7fb99c06f830 2024-09-11T22:31:32.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.161+0000 7fb998ff9640 1 -- 172.21.15.100:0/1133206664 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb994003dd0 con 0x7fb99c06f830 2024-09-11T22:31:32.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.168+0000 7fb998ff9640 1 -- 172.21.15.100:0/1133206664 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb99401d070 con 0x7fb99c06f830 2024-09-11T22:31:32.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.168+0000 7fb998ff9640 1 --2- 172.21.15.100:0/1133206664 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb98806bf00 0x7fb98806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:32.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.168+0000 7fb998ff9640 1 -- 172.21.15.100:0/1133206664 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fb99408b2f0 con 0x7fb99c06f830 2024-09-11T22:31:32.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.170+0000 7fb99bfff640 1 --2- 172.21.15.100:0/1133206664 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb98806bf00 0x7fb98806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:32.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.170+0000 7fb9a156b640 1 --2- 172.21.15.100:0/1133206664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb97c002a70 0x7fb97c004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:32.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.171+0000 7fb9a156b640 1 -- 172.21.15.100:0/1133206664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb97c007ec0 con 0x7fb97c002a70 2024-09-11T22:31:32.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.171+0000 7fb99bfff640 1 --2- 172.21.15.100:0/1133206664 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb98806bf00 0x7fb98806e3c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0018b0 tx=0x7fb98c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:32.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.175+0000 7fb9a0d6a640 1 --2- 172.21.15.100:0/1133206664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb97c002a70 0x7fb97c004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:32.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.180+0000 7fb9a0d6a640 1 -- 172.21.15.100:0/1133206664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb97c0080c0 con 0x7fb97c002a70 2024-09-11T22:31:32.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.180+0000 7fb9a0d6a640 1 --2- 172.21.15.100:0/1133206664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb97c002a70 0x7fb97c004f30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb99c070ff0 tx=0x7fb9900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:32.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.184+0000 7fb998ff9640 1 -- 172.21.15.100:0/1133206664 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990037040 con 0x7fb97c002a70 2024-09-11T22:31:32.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.184+0000 7fb998ff9640 1 -- 172.21.15.100:0/1133206664 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb990032440 con 0x7fb97c002a70 2024-09-11T22:31:32.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.184+0000 7fb998ff9640 1 -- 172.21.15.100:0/1133206664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb97c002a70 msgr2=0x7fb97c004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:32.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.184+0000 7fb998ff9640 1 --2- 172.21.15.100:0/1133206664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb97c002a70 0x7fb97c004f30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb99c070ff0 tx=0x7fb9900046c0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.184+0000 7fb998ff9640 1 -- 172.21.15.100:0/1133206664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb97c002a70 msgr2=0x7fb97c004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:31:32.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.184+0000 7fb998ff9640 1 --2- 172.21.15.100:0/1133206664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb97c002a70 0x7fb97c004f30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.216+0000 7fb9a156b640 1 --2- 172.21.15.100:0/1133206664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb97c006f30 0x7fb97c0073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:32.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.216+0000 7fb9a0d6a640 1 --2- 172.21.15.100:0/1133206664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb97c006f30 0x7fb97c0073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:32.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.217+0000 7fb9a156b640 1 -- 172.21.15.100:0/1133206664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb97c00a4a0 con 0x7fb97c006f30 2024-09-11T22:31:32.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.218+0000 7fb9a0d6a640 1 -- 172.21.15.100:0/1133206664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb97c007900 con 0x7fb97c006f30 2024-09-11T22:31:32.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.218+0000 7fb9a0d6a640 1 --2- 172.21.15.100:0/1133206664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb97c006f30 0x7fb97c0073c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb97c008090 tx=0x7fb990008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:32.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.219+0000 7fb998ff9640 1 -- 172.21.15.100:0/1133206664 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990037040 con 0x7fb97c006f30 2024-09-11T22:31:32.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.219+0000 7fb998ff9640 1 -- 172.21.15.100:0/1133206664 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4554 (secure 0 0 0) 0x7fb99004c2b0 con 0x7fb97c006f30 2024-09-11T22:31:32.221 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:31:32.221 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:31:32.221 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:31:32.221 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:31:32.221 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 82, 2024-09-11T22:31:32.221 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 16117, 2024-09-11T22:31:32.221 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:31:32.221 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:31:32.221 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:31:32.221 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:31:32.221 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:32.222 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:31:32.222 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:31:32.222 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:31:32.222 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:31:32.222 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:31:32.222 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:31:32.222 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:31:32.222 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:31:32.222 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:31:32.222 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:31:32.222 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:31:32.222 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:31:32.223 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:31:32.223 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:31:32.223 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:31:32.223 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:32.223 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:31:32.223 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:31:32.224 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:31:32.224 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:31:32.224 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:31:32.224 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:31:32.224 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:31:32.224 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:31:32.225 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:31:32.225 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:31:32.225 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:31:32.225 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:31:32.225 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:31:32.225 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:32.225 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.225 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:31:32.225 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:31:32.226 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:31:32.226 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:31:32.226 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:31:32.226 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:31:32.226 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:31:32.226 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:31:32.226 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:31:32.227 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:31:32.227 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:31:32.227 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:31:32.227 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:31:32.227 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:31:32.227 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:31:32.228 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:31:32.228 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:31:32.228 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:31:32.228 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:31:32.228 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:31:32.228 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:31:32.229 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:31:32.229 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:31:32.229 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:31:32.229 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:31:32.229 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:31:32.230 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:31:32.230 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:31:32.230 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:32.230 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:31:32.230 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.230 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:31:32.230 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.230 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:31:32.231 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:31:32.231 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:31:32.231 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:31:32.232 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.232 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:31:32.232 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:31:32.232 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:32.232 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.232 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.232 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:31:32.232 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:31:32.232 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:32.232 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:32.232 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:32.232 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.233 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:31:32.233 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:31:32.233 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:31:32.233 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:31:32.233 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:31:32.233 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.233 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.233 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:31:32.233 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:31:32.233 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:31:32.233 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:31:32.233 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.233 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:31:32.234 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:31:32.234 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:32.234 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.234 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.234 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:31:32.234 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:31:32.234 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:32.234 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:32.234 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:32.234 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.234 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:31:32.234 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:31:32.234 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:31:32.234 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:31:32.235 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:31:32.235 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.235 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.235 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:31:32.235 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:31:32.235 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:31:32.235 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:31:32.235 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.235 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:31:32.235 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:31:32.235 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:32.235 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.235 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.236 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:31:32.236 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:31:32.236 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:32.236 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:32.236 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:32.236 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.236 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:31:32.236 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:31:32.236 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:31:32.236 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:31:32.236 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:31:32.236 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:32.236 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:32.236 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.237 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:31:32.237 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:31:32.237 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.237 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:31:32.237 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:31:32.237 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:31:32.237 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:32.237 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:32.238 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:31:32.238 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.238 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:31:32.238 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:31:32.238 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:31:32.238 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:32.239 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:32.239 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.239 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:31:32.239 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:31:32.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.220+0000 7fb998ff9640 1 -- 172.21.15.100:0/1133206664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb97c006f30 msgr2=0x7fb97c0073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:32.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.220+0000 7fb998ff9640 1 --2- 172.21.15.100:0/1133206664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb97c006f30 0x7fb97c0073c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb97c008090 tx=0x7fb990008030 comp rx=0 tx=0).stop 2024-09-11T22:31:32.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.221+0000 7fb998ff9640 1 -- 172.21.15.100:0/1133206664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb97c006f30 msgr2=0x7fb97c0073c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:31:32.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.221+0000 7fb998ff9640 1 --2- 172.21.15.100:0/1133206664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb97c006f30 0x7fb97c0073c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.222+0000 7fb9a156b640 1 -- 172.21.15.100:0/1133206664 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb98806bf00 msgr2=0x7fb98806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:32.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.222+0000 7fb9a156b640 1 --2- 172.21.15.100:0/1133206664 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb98806bf00 0x7fb98806e3c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0018b0 tx=0x7fb98c009040 comp rx=0 tx=0).stop 2024-09-11T22:31:32.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.222+0000 7fb9a0d6a640 1 -- 172.21.15.100:0/1133206664 reap_dead start 2024-09-11T22:31:32.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.222+0000 7fb9a156b640 1 -- 172.21.15.100:0/1133206664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb99c06f830 msgr2=0x7fb99c1f2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:32.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.222+0000 7fb9a156b640 1 --2- 172.21.15.100:0/1133206664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb99c06f830 0x7fb99c1f2d30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb994007e30 tx=0x7fb99400e4b0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.226+0000 7fb9a156b640 1 -- 172.21.15.100:0/1133206664 shutdown_connections 2024-09-11T22:31:32.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.226+0000 7fb9a156b640 1 --2- 172.21.15.100:0/1133206664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb99c06f830 0x7fb99c1f2d30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.226+0000 7fb9a156b640 1 -- 172.21.15.100:0/1133206664 >> 172.21.15.100:0/1133206664 conn(0x7fb99c06ed10 msgr2=0x7fb99c154690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:32.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.230+0000 7fb9a156b640 1 -- 172.21.15.100:0/1133206664 shutdown_connections 2024-09-11T22:31:32.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.230+0000 7fb9a156b640 1 -- 172.21.15.100:0/1133206664 wait complete. 2024-09-11T22:31:32.250 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:31:32.250 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:31:32.250 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:31:32.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.463+0000 7f7af11b9640 1 Processor -- start 2024-09-11T22:31:32.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.463+0000 7f7af11b9640 1 -- start start 2024-09-11T22:31:32.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.465+0000 7f7af11b9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7aec0c8de0 0x7f7aec0c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:32.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.465+0000 7f7af11b9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7aec0c91c0 0x7f7aec15f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:32.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.465+0000 7f7af11b9640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aec162850 con 0x7f7aec0aebe0 2024-09-11T22:31:32.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.465+0000 7f7af11b9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f7aec162600 con 0x7f7aec0c8de0 2024-09-11T22:31:32.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.465+0000 7f7af11b9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7aec162b30 con 0x7f7aec0c91c0 2024-09-11T22:31:32.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.465+0000 7f7aead9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7aec0c8de0 0x7f7aec0c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:32.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.465+0000 7f7aead9d640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7aec0c8de0 0x7f7aec0c7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:48970/0 (socket says 172.21.15.100:48970) 2024-09-11T22:31:32.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.465+0000 7f7aead9d640 1 -- 172.21.15.100:0/1613358069 learned_addr learned my addr 172.21.15.100:0/1613358069 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:31:32.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.469+0000 7f7aead9d640 1 -- 172.21.15.100:0/1613358069 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7aec0c91c0 msgr2=0x7f7aec15f5e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:31:32.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.469+0000 7f7aead9d640 1 --2- 172.21.15.100:0/1613358069 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7aec0c91c0 0x7f7aec15f5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.469+0000 7f7aead9d640 1 -- 172.21.15.100:0/1613358069 >> v1:172.21.15.100:6789/0 conn(0x7f7aec0aebe0 legacy=0x7f7aec15c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:32.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.469+0000 7f7aead9d640 1 -- 172.21.15.100:0/1613358069 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aec162e10 con 0x7f7aec0c8de0 2024-09-11T22:31:32.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.471+0000 7f7aead9d640 1 --2- 172.21.15.100:0/1613358069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0c8de0 0x7f7aec0c7e60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0009870 tx=0x7f7ae002a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a41265a357567f9a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:32.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.476+0000 7f7ae9d9b640 1 -- 172.21.15.100:0/1613358069 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0037070 con 0x7f7aec0c8de0 2024-09-11T22:31:32.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.476+0000 7f7ae9d9b640 1 -- 172.21.15.100:0/1613358069 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ae0032440 con 0x7f7aec0c8de0 2024-09-11T22:31:32.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.476+0000 7f7ae9d9b640 1 -- 172.21.15.100:0/1613358069 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0032810 con 0x7f7aec0c8de0 2024-09-11T22:31:32.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.477+0000 7f7af11b9640 1 -- 172.21.15.100:0/1613358069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0c8de0 msgr2=0x7f7aec0c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:32.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.477+0000 7f7af11b9640 1 --2- 172.21.15.100:0/1613358069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0c8de0 0x7f7aec0c7e60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0009870 tx=0x7f7ae002a2c0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.478+0000 7f7af11b9640 1 -- 172.21.15.100:0/1613358069 shutdown_connections 2024-09-11T22:31:32.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.478+0000 7f7af11b9640 1 --2- 172.21.15.100:0/1613358069 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7aec0c91c0 0x7f7aec15f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.478+0000 7f7af11b9640 1 --2- 172.21.15.100:0/1613358069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0c8de0 0x7f7aec0c7e60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.478+0000 7f7af11b9640 1 -- 172.21.15.100:0/1613358069 >> 172.21.15.100:0/1613358069 conn(0x7f7aec06f360 msgr2=0x7f7aec06f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:32.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.481+0000 7f7af11b9640 1 -- 172.21.15.100:0/1613358069 shutdown_connections 2024-09-11T22:31:32.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.482+0000 7f7af11b9640 1 -- 172.21.15.100:0/1613358069 wait complete. 2024-09-11T22:31:32.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.484+0000 7f7af11b9640 1 Processor -- start 2024-09-11T22:31:32.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.484+0000 7f7af11b9640 1 -- start start 2024-09-11T22:31:32.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.485+0000 7f7af11b9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7aec0aebe0 0x7f7aec0caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:32.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.485+0000 7f7af11b9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7aec0c8de0 0x7f7aec0cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:32.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.485+0000 7f7af11b9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0c91c0 0x7f7aec150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:32.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.486+0000 7f7af11b9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec15f090 con 0x7f7aec0c8de0 2024-09-11T22:31:32.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.486+0000 7f7af11b9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec1633d0 con 0x7f7aec0c91c0 2024-09-11T22:31:32.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.486+0000 7f7aead9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7aec0aebe0 0x7f7aec0caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:32.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.486+0000 7f7af11b9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7aec0c83a0 con 0x7f7aec0aebe0 2024-09-11T22:31:32.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.486+0000 7f7aead9d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7aec0aebe0 0x7f7aec0caeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:35726/0 (socket says 172.21.15.100:35726) 2024-09-11T22:31:32.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.486+0000 7f7aead9d640 1 -- 172.21.15.100:0/544310641 learned_addr learned my addr 172.21.15.100:0/544310641 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:31:32.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.486+0000 7f7aea59c640 1 --2- 172.21.15.100:0/544310641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7aec0c8de0 0x7f7aec0cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:32.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.486+0000 7f7aeb59e640 1 --2- 172.21.15.100:0/544310641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0c91c0 0x7f7aec150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:32.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.486+0000 7f7aeb59e640 1 -- 172.21.15.100:0/544310641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7aec0aebe0 msgr2=0x7f7aec0caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:32.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.487+0000 7f7aeb59e640 1 --2- 172.21.15.100:0/544310641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7aec0aebe0 0x7f7aec0caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.487+0000 7f7aeb59e640 1 -- 172.21.15.100:0/544310641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7aec0c8de0 msgr2=0x7f7aec0cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:32.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.487+0000 7f7aeb59e640 1 --2- 172.21.15.100:0/544310641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7aec0c8de0 0x7f7aec0cb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.487+0000 7f7aeb59e640 1 -- 172.21.15.100:0/544310641 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aec0cbb80 con 0x7f7aec0c91c0 2024-09-11T22:31:32.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.487+0000 7f7aea59c640 1 --2- 172.21.15.100:0/544310641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7aec0c8de0 0x7f7aec0cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:31:32.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.487+0000 7f7aeb59e640 1 --2- 172.21.15.100:0/544310641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0c91c0 0x7f7aec150150 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7ae400c780 tx=0x7f7ae400cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:32.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.487+0000 7f7ad37fe640 1 -- 172.21.15.100:0/544310641 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4017070 con 0x7f7aec0c91c0 2024-09-11T22:31:32.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.487+0000 7f7ad37fe640 1 -- 172.21.15.100:0/544310641 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ae4003b70 con 0x7f7aec0c91c0 2024-09-11T22:31:32.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.487+0000 7f7ad37fe640 1 -- 172.21.15.100:0/544310641 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4005070 con 0x7f7aec0c91c0 2024-09-11T22:31:32.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.492+0000 7f7af11b9640 1 -- 172.21.15.100:0/544310641 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aec0cbe40 con 0x7f7aec0c91c0 2024-09-11T22:31:32.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.492+0000 7f7af11b9640 1 -- 172.21.15.100:0/544310641 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aec0ccc80 con 0x7f7aec0c91c0 2024-09-11T22:31:32.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.493+0000 7f7ad17fa640 1 --2- 172.21.15.100:0/544310641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0c7c40 0x7f7aec1f8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:32.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.494+0000 7f7ad17fa640 1 -- 172.21.15.100:0/544310641 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec159a60 con 0x7f7aec0c7c40 2024-09-11T22:31:32.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.494+0000 7f7aead9d640 1 --2- 172.21.15.100:0/544310641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0c7c40 0x7f7aec1f8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:32.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.498+0000 7f7ad37fe640 1 -- 172.21.15.100:0/544310641 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ae401a070 con 0x7f7aec0c91c0 2024-09-11T22:31:32.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.498+0000 7f7aead9d640 1 -- 172.21.15.100:0/544310641 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7aec0c2530 con 0x7f7aec0c7c40 2024-09-11T22:31:32.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.499+0000 7f7aead9d640 1 --2- 172.21.15.100:0/544310641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0c7c40 0x7f7aec1f8d20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0000c00 tx=0x7f7ae00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:32.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.500+0000 7f7ad37fe640 1 --2- 172.21.15.100:0/544310641 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7ad406c080 0x7f7ad406e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:32.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.500+0000 7f7ad37fe640 1 -- 172.21.15.100:0/544310641 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f7ae408a7f0 con 0x7f7aec0c91c0 2024-09-11T22:31:32.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.500+0000 7f7ad37fe640 1 -- 172.21.15.100:0/544310641 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0037040 con 0x7f7aec0c7c40 2024-09-11T22:31:32.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.500+0000 7f7ad37fe640 1 -- 172.21.15.100:0/544310641 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7ae0032440 con 0x7f7aec0c7c40 2024-09-11T22:31:32.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.500+0000 7f7ad37fe640 1 -- 172.21.15.100:0/544310641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0c7c40 msgr2=0x7f7aec1f8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:32.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.500+0000 7f7ad37fe640 1 --2- 172.21.15.100:0/544310641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0c7c40 0x7f7aec1f8d20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0000c00 tx=0x7f7ae00046c0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.500+0000 7f7ad37fe640 1 -- 172.21.15.100:0/544310641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0c7c40 msgr2=0x7f7aec1f8d20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:31:32.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.500+0000 7f7ad37fe640 1 --2- 172.21.15.100:0/544310641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0c7c40 0x7f7aec1f8d20 secure :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0000c00 tx=0x7f7ae00046c0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.501+0000 7f7aea59c640 1 --2- 172.21.15.100:0/544310641 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7ad406c080 0x7f7ad406e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:32.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.501+0000 7f7aea59c640 1 --2- 172.21.15.100:0/544310641 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7ad406c080 0x7f7ad406e540 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7adc006fd0 tx=0x7f7adc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:32.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.515+0000 7f7ad17fa640 1 --2- 172.21.15.100:0/544310641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0cc360 0x7f7aec150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:32.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.515+0000 7f7ad17fa640 1 -- 172.21.15.100:0/544310641 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7aec150bd0 con 0x7f7aec0cc360 2024-09-11T22:31:32.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.516+0000 7f7aead9d640 1 --2- 172.21.15.100:0/544310641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0cc360 0x7f7aec150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:32.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.516+0000 7f7aead9d640 1 -- 172.21.15.100:0/544310641 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7aec0c2250 con 0x7f7aec0cc360 2024-09-11T22:31:32.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.517+0000 7f7aead9d640 1 --2- 172.21.15.100:0/544310641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0cc360 0x7f7aec150690 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0043000 tx=0x7f7ae0008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:32.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.522+0000 7f7ad37fe640 1 -- 172.21.15.100:0/544310641 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0037040 con 0x7f7aec0cc360 2024-09-11T22:31:32.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.522+0000 7f7ad37fe640 1 -- 172.21.15.100:0/544310641 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4887 (secure 0 0 0) 0x7f7ae003ce50 con 0x7f7aec0cc360 2024-09-11T22:31:32.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.523+0000 7f7ad37fe640 1 -- 172.21.15.100:0/544310641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0cc360 msgr2=0x7f7aec150690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:32.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.523+0000 7f7ad37fe640 1 --2- 172.21.15.100:0/544310641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0cc360 0x7f7aec150690 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0043000 tx=0x7f7ae0008030 comp rx=0 tx=0).stop 2024-09-11T22:31:32.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.523+0000 7f7ad37fe640 1 -- 172.21.15.100:0/544310641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0cc360 msgr2=0x7f7aec150690 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:31:32.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.523+0000 7f7ad37fe640 1 --2- 172.21.15.100:0/544310641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0cc360 0x7f7aec150690 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.525 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:31:32.525 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:31:32.525 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:31:32.525 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:31:32.525 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 82, 2024-09-11T22:31:32.525 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 477797, 2024-09-11T22:31:32.525 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:31:32.525 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:31:32.525 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:31:32.525 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:31:32.526 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:32.526 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:31:32.526 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:31:32.526 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:31:32.526 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:31:32.526 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:31:32.526 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:31:32.526 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:31:32.526 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:31:32.526 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:31:32.526 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:31:32.526 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:31:32.526 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:31:32.526 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:31:32.527 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:31:32.527 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:31:32.527 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:32.527 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:31:32.527 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:31:32.527 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:31:32.527 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:31:32.527 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:31:32.527 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:31:32.527 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:31:32.527 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:31:32.527 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:31:32.527 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:31:32.527 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:31:32.528 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:31:32.528 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:31:32.528 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:32.528 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.528 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:31:32.528 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:31:32.528 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:31:32.528 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:31:32.528 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:31:32.529 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:31:32.529 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:31:32.529 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:31:32.529 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:31:32.529 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:31:32.529 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:31:32.529 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:31:32.529 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:31:32.529 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:31:32.529 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:31:32.529 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:31:32.530 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:31:32.530 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:31:32.530 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:31:32.530 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:31:32.530 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:31:32.530 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:31:32.530 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:31:32.530 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:31:32.530 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:31:32.530 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:31:32.530 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:31:32.530 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:31:32.531 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:32.531 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:31:32.531 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.531 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:31:32.531 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.531 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:31:32.531 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:31:32.531 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:31:32.531 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:31:32.531 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.531 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:31:32.531 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:31:32.531 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:32.531 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.532 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.532 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:31:32.532 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:31:32.532 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:32.532 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:32.532 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:32.532 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.532 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:31:32.532 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:31:32.532 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:31:32.532 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:31:32.532 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:31:32.532 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.533 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.533 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:31:32.533 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:31:32.533 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:31:32.533 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:31:32.533 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.533 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:31:32.533 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:31:32.533 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:32.533 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.533 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.533 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:31:32.533 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:31:32.533 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:32.534 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:32.534 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:32.534 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.534 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:31:32.534 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:31:32.534 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:31:32.534 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:31:32.534 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:31:32.534 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.534 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.534 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:31:32.535 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:31:32.535 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:31:32.535 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:31:32.535 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.535 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:31:32.535 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:31:32.535 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:32.535 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.535 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.535 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:31:32.535 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:31:32.535 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:32.535 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:32.536 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:32.536 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.536 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:31:32.536 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:31:32.536 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:31:32.536 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:31:32.536 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:31:32.536 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:32.536 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:32.536 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.536 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:31:32.536 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:31:32.536 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.537 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:31:32.537 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:31:32.537 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:31:32.537 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:32.537 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:32.537 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:31:32.538 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.538 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:31:32.538 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:31:32.538 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:31:32.538 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:32.539 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:32.539 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:31:32.539 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.539 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:31:32.539 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:31:32.539 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:31:32.540 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:32.540 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:32.540 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:31:32.540 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.540 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:31:32.540 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:31:32.540 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:31:32.540 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:32.540 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:32.540 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.540 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:31:32.540 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:31:32.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.526+0000 7f7ad17fa640 1 -- 172.21.15.100:0/544310641 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7ad406c080 msgr2=0x7f7ad406e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:32.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.526+0000 7f7ad17fa640 1 --2- 172.21.15.100:0/544310641 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7ad406c080 0x7f7ad406e540 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7adc006fd0 tx=0x7f7adc008040 comp rx=0 tx=0).stop 2024-09-11T22:31:32.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.526+0000 7f7aeb59e640 1 -- 172.21.15.100:0/544310641 reap_dead start 2024-09-11T22:31:32.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.526+0000 7f7ad17fa640 1 -- 172.21.15.100:0/544310641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0c91c0 msgr2=0x7f7aec150150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:32.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.526+0000 7f7ad17fa640 1 --2- 172.21.15.100:0/544310641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0c91c0 0x7f7aec150150 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7ae400c780 tx=0x7f7ae400cc40 comp rx=0 tx=0).stop 2024-09-11T22:31:32.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.526+0000 7f7ad17fa640 1 -- 172.21.15.100:0/544310641 shutdown_connections 2024-09-11T22:31:32.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.526+0000 7f7ad17fa640 1 --2- 172.21.15.100:0/544310641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7aec0c91c0 0x7f7aec150150 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.526+0000 7f7ad17fa640 1 -- 172.21.15.100:0/544310641 >> 172.21.15.100:0/544310641 conn(0x7f7aec06f360 msgr2=0x7f7aec1521e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:32.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.526+0000 7f7ad17fa640 1 -- 172.21.15.100:0/544310641 shutdown_connections 2024-09-11T22:31:32.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.526+0000 7f7ad17fa640 1 -- 172.21.15.100:0/544310641 wait complete. 2024-09-11T22:31:32.549 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:31:32.550 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:31:32.550 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:31:32.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.737+0000 7fe93be42640 1 Processor -- start 2024-09-11T22:31:32.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.737+0000 7fe93be42640 1 -- start start 2024-09-11T22:31:32.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.739+0000 7fe93be42640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe92c04e380 0x7fe92c0060c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:32.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.739+0000 7fe93be42640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe92c0e2f50 con 0x7fe92c0e2aa0 2024-09-11T22:31:32.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.739+0000 7fe93be42640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe92c0e3230 con 0x7fe92c0dcd50 2024-09-11T22:31:32.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.739+0000 7fe93be42640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fe92c0e3510 con 0x7fe92c04e380 2024-09-11T22:31:32.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.739+0000 7fe93a3df640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe92c04e380 0x7fe92c0060c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:32.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.739+0000 7fe93a3df640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe92c04e380 0x7fe92c0060c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:48990/0 (socket says 172.21.15.100:48990) 2024-09-11T22:31:32.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.739+0000 7fe93a3df640 1 -- 172.21.15.100:0/2266037243 learned_addr learned my addr 172.21.15.100:0/2266037243 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:31:32.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.740+0000 7fe93a3df640 1 -- 172.21.15.100:0/2266037243 >> v1:172.21.15.167:6789/0 conn(0x7fe92c0dcd50 legacy=0x7fe92c04cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:32.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.740+0000 7fe93a3df640 1 -- 172.21.15.100:0/2266037243 >> v1:172.21.15.100:6789/0 conn(0x7fe92c0e2aa0 legacy=0x7fe92c04dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:32.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.740+0000 7fe93a3df640 1 -- 172.21.15.100:0/2266037243 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe92c0e37f0 con 0x7fe92c04e380 2024-09-11T22:31:32.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.742+0000 7fe93a3df640 1 --2- 172.21.15.100:0/2266037243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe92c04e380 0x7fe92c0060c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe93406b1f0 tx=0x7fe9340a6ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61baeda1e7a401ac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:32.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.742+0000 7fe938bdc640 1 -- 172.21.15.100:0/2266037243 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9340a8980 con 0x7fe92c04e380 2024-09-11T22:31:32.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.743+0000 7fe938bdc640 1 -- 172.21.15.100:0/2266037243 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9340a8b20 con 0x7fe92c04e380 2024-09-11T22:31:32.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.743+0000 7fe938bdc640 1 -- 172.21.15.100:0/2266037243 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9340b0420 con 0x7fe92c04e380 2024-09-11T22:31:32.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.744+0000 7fe93be42640 1 -- 172.21.15.100:0/2266037243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe92c04e380 msgr2=0x7fe92c0060c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:32.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.744+0000 7fe93be42640 1 --2- 172.21.15.100:0/2266037243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe92c04e380 0x7fe92c0060c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe93406b1f0 tx=0x7fe9340a6ba0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.744+0000 7fe93be42640 1 -- 172.21.15.100:0/2266037243 shutdown_connections 2024-09-11T22:31:32.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.744+0000 7fe93be42640 1 --2- 172.21.15.100:0/2266037243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe92c04e380 0x7fe92c0060c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.744+0000 7fe93be42640 1 -- 172.21.15.100:0/2266037243 >> 172.21.15.100:0/2266037243 conn(0x7fe92c051e60 msgr2=0x7fe92c052270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:32.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.745+0000 7fe93be42640 1 -- 172.21.15.100:0/2266037243 shutdown_connections 2024-09-11T22:31:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.747+0000 7fe93be42640 1 -- 172.21.15.100:0/2266037243 wait complete. 2024-09-11T22:31:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.749+0000 7fe93be42640 1 Processor -- start 2024-09-11T22:31:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.749+0000 7fe93be42640 1 -- start start 2024-09-11T22:31:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.750+0000 7fe93be42640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe92c0dcd50 0x7fe92c04bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.751+0000 7fe93be42640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe92c0e2aa0 0x7fe92c04b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.751+0000 7fe9393dd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe92c0e2aa0 0x7fe92c04b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.751+0000 7fe9393dd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe92c0e2aa0 0x7fe92c04b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51648/0 (socket says 172.21.15.100:51648) 2024-09-11T22:31:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.751+0000 7fe93be42640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe92c04b6b0 0x7fe92c0ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.751+0000 7fe93be42640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe92c04d360 con 0x7fe92c0e2aa0 2024-09-11T22:31:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.751+0000 7fe939bde640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe92c0dcd50 0x7fe92c04bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.751+0000 7fe93be42640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe92c0dd130 con 0x7fe92c0dcd50 2024-09-11T22:31:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.751+0000 7fe93be42640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe92c04d4e0 con 0x7fe92c04b6b0 2024-09-11T22:31:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.751+0000 7fe939bde640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe92c0dcd50 0x7fe92c04bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:48992/0 (socket says 172.21.15.100:48992) 2024-09-11T22:31:32.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.751+0000 7fe939bde640 1 -- 172.21.15.100:0/3943088868 learned_addr learned my addr 172.21.15.100:0/3943088868 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:31:32.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.752+0000 7fe93a3df640 1 --2- 172.21.15.100:0/3943088868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe92c04b6b0 0x7fe92c0ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:32.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.752+0000 7fe939bde640 1 -- 172.21.15.100:0/3943088868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe92c04b6b0 msgr2=0x7fe92c0ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:32.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.752+0000 7fe939bde640 1 --2- 172.21.15.100:0/3943088868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe92c04b6b0 0x7fe92c0ca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.752+0000 7fe939bde640 1 -- 172.21.15.100:0/3943088868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe92c0e2aa0 msgr2=0x7fe92c04b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:32.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.752+0000 7fe939bde640 1 --2- 172.21.15.100:0/3943088868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe92c0e2aa0 0x7fe92c04b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.752+0000 7fe939bde640 1 -- 172.21.15.100:0/3943088868 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe92c0c7480 con 0x7fe92c0dcd50 2024-09-11T22:31:32.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.752+0000 7fe9393dd640 1 --2- 172.21.15.100:0/3943088868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe92c0e2aa0 0x7fe92c04b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:31:32.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.758+0000 7fe939bde640 1 --2- 172.21.15.100:0/3943088868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe92c0dcd50 0x7fe92c04bf30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe93000c450 tx=0x7fe93000c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.759+0000 7fe92a7fc640 1 -- 172.21.15.100:0/3943088868 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9300052d0 con 0x7fe92c0dcd50 2024-09-11T22:31:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.759+0000 7fe92a7fc640 1 -- 172.21.15.100:0/3943088868 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe930005470 con 0x7fe92c0dcd50 2024-09-11T22:31:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.759+0000 7fe93be42640 1 -- 172.21.15.100:0/3943088868 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe92c04c470 con 0x7fe92c0dcd50 2024-09-11T22:31:32.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.760+0000 7fe93be42640 1 -- 172.21.15.100:0/3943088868 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe92c0c1130 con 0x7fe92c0dcd50 2024-09-11T22:31:32.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.765+0000 7fe92a7fc640 1 -- 172.21.15.100:0/3943088868 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe930012870 con 0x7fe92c0dcd50 2024-09-11T22:31:32.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.765+0000 7fe93be42640 1 --2- 172.21.15.100:0/3943088868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe92c049160 0x7fe92c0cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:32.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.766+0000 7fe93be42640 1 -- 172.21.15.100:0/3943088868 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe92c04cc50 con 0x7fe92c049160 2024-09-11T22:31:32.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.766+0000 7fe92a7fc640 1 -- 172.21.15.100:0/3943088868 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe930012a50 con 0x7fe92c0dcd50 2024-09-11T22:31:32.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.766+0000 7fe9393dd640 1 --2- 172.21.15.100:0/3943088868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe92c049160 0x7fe92c0cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.767+0000 7fe9393dd640 1 -- 172.21.15.100:0/3943088868 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe92c04d790 con 0x7fe92c049160 2024-09-11T22:31:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.767+0000 7fe9393dd640 1 --2- 172.21.15.100:0/3943088868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe92c049160 0x7fe92c0cae10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe92c050cc0 tx=0x7fe92400ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.768+0000 7fe92a7fc640 1 --2- 172.21.15.100:0/3943088868 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe91806bf30 0x7fe91806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.769+0000 7fe92a7fc640 1 -- 172.21.15.100:0/3943088868 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fe93008a5e0 con 0x7fe92c0dcd50 2024-09-11T22:31:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.769+0000 7fe93a3df640 1 --2- 172.21.15.100:0/3943088868 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe91806bf30 0x7fe91806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.769+0000 7fe92a7fc640 1 -- 172.21.15.100:0/3943088868 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe924017070 con 0x7fe92c049160 2024-09-11T22:31:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.769+0000 7fe92a7fc640 1 -- 172.21.15.100:0/3943088868 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fe92400ca40 con 0x7fe92c049160 2024-09-11T22:31:32.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.770+0000 7fe93a3df640 1 --2- 172.21.15.100:0/3943088868 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe91806bf30 0x7fe91806e3f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe92c048ee0 tx=0x7fe93406e030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:32.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.771+0000 7fe92a7fc640 1 -- 172.21.15.100:0/3943088868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe92c049160 msgr2=0x7fe92c0cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:32.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.771+0000 7fe92a7fc640 1 --2- 172.21.15.100:0/3943088868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe92c049160 0x7fe92c0cae10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe92c050cc0 tx=0x7fe92400ef70 comp rx=0 tx=0).stop 2024-09-11T22:31:32.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.772+0000 7fe92a7fc640 1 -- 172.21.15.100:0/3943088868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe92c049160 msgr2=0x7fe92c0cae10 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:31:32.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.772+0000 7fe92a7fc640 1 --2- 172.21.15.100:0/3943088868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe92c049160 0x7fe92c0cae10 secure :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe92c050cc0 tx=0x7fe92400ef70 comp rx=0 tx=0).stop 2024-09-11T22:31:32.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.781+0000 7fe93be42640 1 --2- 172.21.15.100:0/3943088868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe92c0c3b50 0x7fe92c0c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:32.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.781+0000 7fe93be42640 1 -- 172.21.15.100:0/3943088868 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe92c050a10 con 0x7fe92c0c3b50 2024-09-11T22:31:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.783+0000 7fe9393dd640 1 --2- 172.21.15.100:0/3943088868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe92c0c3b50 0x7fe92c0c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:32.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.784+0000 7fe9393dd640 1 -- 172.21.15.100:0/3943088868 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe92c050730 con 0x7fe92c0c3b50 2024-09-11T22:31:32.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.786+0000 7fe9393dd640 1 --2- 172.21.15.100:0/3943088868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe92c0c3b50 0x7fe92c0c3f60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe924019000 tx=0x7fe9240046b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:32.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.788+0000 7fe92a7fc640 1 -- 172.21.15.100:0/3943088868 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe924017070 con 0x7fe92c0c3b50 2024-09-11T22:31:32.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.788+0000 7fe92a7fc640 1 -- 172.21.15.100:0/3943088868 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7fe9240064d0 con 0x7fe92c0c3b50 2024-09-11T22:31:32.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.788+0000 7fe92a7fc640 1 -- 172.21.15.100:0/3943088868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe92c0c3b50 msgr2=0x7fe92c0c3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:32.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.788+0000 7fe92a7fc640 1 --2- 172.21.15.100:0/3943088868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe92c0c3b50 0x7fe92c0c3f60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe924019000 tx=0x7fe9240046b0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.788+0000 7fe92a7fc640 1 -- 172.21.15.100:0/3943088868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe92c0c3b50 msgr2=0x7fe92c0c3f60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:31:32.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.788+0000 7fe92a7fc640 1 --2- 172.21.15.100:0/3943088868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe92c0c3b50 0x7fe92c0c3f60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.791 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:31:32.791 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:31:32.791 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:31:32.792 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:31:32.792 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 82, 2024-09-11T22:31:32.792 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 583509, 2024-09-11T22:31:32.792 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:31:32.792 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:31:32.792 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:31:32.792 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:31:32.792 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:32.792 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:31:32.792 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:31:32.792 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:31:32.793 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:31:32.793 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:31:32.793 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:31:32.793 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:31:32.793 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:31:32.793 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:31:32.793 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:31:32.793 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:31:32.793 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:31:32.793 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:31:32.793 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:31:32.793 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:31:32.793 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:32.794 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:31:32.794 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:31:32.794 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:31:32.794 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:31:32.794 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:31:32.794 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:31:32.794 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:31:32.794 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:31:32.794 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:31:32.794 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:31:32.794 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:31:32.794 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:31:32.794 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:31:32.794 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:32.795 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.795 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:31:32.795 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:31:32.795 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:31:32.795 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:31:32.795 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:31:32.795 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:31:32.795 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:31:32.795 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:31:32.795 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:31:32.795 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:31:32.795 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:31:32.795 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:31:32.795 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:31:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:31:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:31:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:31:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:31:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:31:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:31:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:31:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:31:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:31:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:31:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:31:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:31:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:31:32.797 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:31:32.797 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:31:32.797 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:32.797 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:31:32.797 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.797 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:31:32.797 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.797 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:31:32.797 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:31:32.797 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:31:32.797 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:31:32.797 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.797 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:31:32.797 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:31:32.798 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:32.798 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.798 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.798 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:31:32.798 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:31:32.798 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:32.798 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:32.798 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:32.798 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.799 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:31:32.799 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:31:32.799 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:31:32.799 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:31:32.799 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:31:32.799 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.799 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.799 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:31:32.799 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:31:32.799 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:31:32.799 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:31:32.799 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.799 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:31:32.799 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:31:32.800 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:32.800 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.800 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.800 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:31:32.800 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:31:32.800 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:32.800 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:32.800 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:32.800 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.800 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:31:32.801 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:31:32.801 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:31:32.801 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:31:32.801 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:31:32.801 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.801 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.801 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:31:32.801 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:31:32.801 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:31:32.801 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:31:32.801 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.801 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:31:32.802 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:31:32.802 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:32.802 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.802 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.802 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:31:32.802 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:31:32.802 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:32.802 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:32.802 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:32.802 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.802 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:31:32.802 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:31:32.802 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:31:32.802 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:31:32.803 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:31:32.803 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:32.803 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:32.803 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.803 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:31:32.803 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:31:32.803 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.803 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:31:32.803 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:31:32.803 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:31:32.803 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:32.803 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:32.803 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:31:32.803 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.804 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:31:32.804 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:31:32.804 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:31:32.804 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:32.804 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:32.804 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:31:32.804 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.804 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:31:32.804 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:31:32.804 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:31:32.804 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:32.804 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:32.804 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:31:32.805 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.805 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:31:32.805 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:31:32.805 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:31:32.805 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:32.805 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:32.805 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:31:32.805 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:32.805 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:31:32.805 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:31:32.805 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:31:32.805 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:32.805 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:32.806 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:32.806 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:31:32.806 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:31:32.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.791+0000 7fe917fff640 1 -- 172.21.15.100:0/3943088868 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe91806bf30 msgr2=0x7fe91806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:32.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.792+0000 7fe917fff640 1 --2- 172.21.15.100:0/3943088868 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe91806bf30 0x7fe91806e3f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe92c048ee0 tx=0x7fe93406e030 comp rx=0 tx=0).stop 2024-09-11T22:31:32.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.793+0000 7fe93a3df640 1 -- 172.21.15.100:0/3943088868 reap_dead start 2024-09-11T22:31:32.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.793+0000 7fe917fff640 1 -- 172.21.15.100:0/3943088868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe92c0dcd50 msgr2=0x7fe92c04bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:32.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.793+0000 7fe917fff640 1 --2- 172.21.15.100:0/3943088868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe92c0dcd50 0x7fe92c04bf30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe93000c450 tx=0x7fe93000c910 comp rx=0 tx=0).stop 2024-09-11T22:31:32.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.798+0000 7fe917fff640 1 -- 172.21.15.100:0/3943088868 shutdown_connections 2024-09-11T22:31:32.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.798+0000 7fe917fff640 1 --2- 172.21.15.100:0/3943088868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe92c0dcd50 0x7fe92c04bf30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:32.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.798+0000 7fe917fff640 1 -- 172.21.15.100:0/3943088868 >> 172.21.15.100:0/3943088868 conn(0x7fe92c051e60 msgr2=0x7fe92c04fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:32.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.798+0000 7fe917fff640 1 -- 172.21.15.100:0/3943088868 shutdown_connections 2024-09-11T22:31:32.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:32.800+0000 7fe917fff640 1 -- 172.21.15.100:0/3943088868 wait complete. 2024-09-11T22:31:32.823 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:31:32.823 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-11T22:31:32.823 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-11T22:31:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.015+0000 7f3f96467640 1 Processor -- start 2024-09-11T22:31:33.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.016+0000 7f3f96467640 1 -- start start 2024-09-11T22:31:33.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.017+0000 7f3f96467640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f90153ec0 0x7f3f90072c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:33.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.017+0000 7f3f96467640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3f9006c1a0 0x7f3f9006c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:33.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.017+0000 7f3f96467640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3f90156c90 0x7f3f901570e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:33.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.017+0000 7f3f96467640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f3f900c1000 con 0x7f3f90156c90 2024-09-11T22:31:33.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.017+0000 7f3f96467640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f3f90157620 con 0x7f3f9006c1a0 2024-09-11T22:31:33.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.017+0000 7f3f96467640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3f90073570 con 0x7f3f90153ec0 2024-09-11T22:31:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.018+0000 7f3f8ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f90153ec0 0x7f3f90072c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.018+0000 7f3f8ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f90153ec0 0x7f3f90072c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:35746/0 (socket says 172.21.15.100:35746) 2024-09-11T22:31:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.018+0000 7f3f8ffff640 1 -- 172.21.15.100:0/195387366 learned_addr learned my addr 172.21.15.100:0/195387366 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:31:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.018+0000 7f3f8f7fe640 1 --2- 172.21.15.100:0/195387366 >> v2:172.21.15.167:3300/0 conn(0x7f3f9006c1a0 0x7f3f9006c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.019+0000 7f3f8ffff640 1 -- 172.21.15.100:0/195387366 >> v2:172.21.15.167:3300/0 conn(0x7f3f9006c1a0 msgr2=0x7f3f9006c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.019+0000 7f3f8ffff640 1 --2- 172.21.15.100:0/195387366 >> v2:172.21.15.167:3300/0 conn(0x7f3f9006c1a0 0x7f3f9006c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.019+0000 7f3f8ffff640 1 -- 172.21.15.100:0/195387366 >> v2:172.21.15.100:3300/0 conn(0x7f3f90156c90 msgr2=0x7f3f901570e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:31:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.019+0000 7f3f8ffff640 1 --2- 172.21.15.100:0/195387366 >> v2:172.21.15.100:3300/0 conn(0x7f3f90156c90 0x7f3f901570e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.019+0000 7f3f8ffff640 1 -- 172.21.15.100:0/195387366 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f90159eb0 con 0x7f3f90153ec0 2024-09-11T22:31:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.020+0000 7f3f8ffff640 1 --2- 172.21.15.100:0/195387366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f90153ec0 0x7f3f90072c80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3f9006ea10 tx=0x7f3f88033130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bad8404cab7167d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.021+0000 7f3f8effd640 1 -- 172.21.15.100:0/195387366 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f88039070 con 0x7f3f90153ec0 2024-09-11T22:31:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.021+0000 7f3f8effd640 1 -- 172.21.15.100:0/195387366 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f8803d400 con 0x7f3f90153ec0 2024-09-11T22:31:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.021+0000 7f3f8effd640 1 -- 172.21.15.100:0/195387366 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8800be60 con 0x7f3f90153ec0 2024-09-11T22:31:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.022+0000 7f3f96467640 1 -- 172.21.15.100:0/195387366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f90153ec0 msgr2=0x7f3f90072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.022+0000 7f3f96467640 1 --2- 172.21.15.100:0/195387366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f90153ec0 0x7f3f90072c80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3f9006ea10 tx=0x7f3f88033130 comp rx=0 tx=0).stop 2024-09-11T22:31:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.022+0000 7f3f96467640 1 -- 172.21.15.100:0/195387366 shutdown_connections 2024-09-11T22:31:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.022+0000 7f3f96467640 1 --2- 172.21.15.100:0/195387366 >> v2:172.21.15.100:3300/0 conn(0x7f3f90156c90 0x7f3f901570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.022+0000 7f3f96467640 1 --2- 172.21.15.100:0/195387366 >> v2:172.21.15.167:3300/0 conn(0x7f3f9006c1a0 0x7f3f9006c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.022+0000 7f3f96467640 1 --2- 172.21.15.100:0/195387366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f90153ec0 0x7f3f90072c80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.022+0000 7f3f96467640 1 -- 172.21.15.100:0/195387366 >> 172.21.15.100:0/195387366 conn(0x7f3f900cbf70 msgr2=0x7f3f900cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.026+0000 7f3f96467640 1 -- 172.21.15.100:0/195387366 shutdown_connections 2024-09-11T22:31:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.027+0000 7f3f96467640 1 -- 172.21.15.100:0/195387366 wait complete. 2024-09-11T22:31:33.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.029+0000 7f3f96467640 1 Processor -- start 2024-09-11T22:31:33.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.034+0000 7f3f96467640 1 -- start start 2024-09-11T22:31:33.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.035+0000 7f3f96467640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f9006c1a0 0x7f3f900caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:33.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.036+0000 7f3f96467640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f90153ec0 0x7f3f90153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:33.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.038+0000 7f3f96467640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f90156c90 0x7f3f90158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:33.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.038+0000 7f3f96467640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9015a750 con 0x7f3f90156c90 2024-09-11T22:31:33.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.038+0000 7f3f96467640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9015a470 con 0x7f3f90153ec0 2024-09-11T22:31:33.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.038+0000 7f3f96467640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3f9015aa30 con 0x7f3f9006c1a0 2024-09-11T22:31:33.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.038+0000 7f3f8ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f9006c1a0 0x7f3f900caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:33.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.038+0000 7f3f8ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f9006c1a0 0x7f3f900caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:35748/0 (socket says 172.21.15.100:35748) 2024-09-11T22:31:33.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.038+0000 7f3f8ffff640 1 -- 172.21.15.100:0/3948838001 learned_addr learned my addr 172.21.15.100:0/3948838001 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:31:33.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.039+0000 7f3f8f7fe640 1 --2- 172.21.15.100:0/3948838001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f90153ec0 0x7f3f90153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.039+0000 7f3f94a04640 1 --2- 172.21.15.100:0/3948838001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f90156c90 0x7f3f90158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.040+0000 7f3f8f7fe640 1 -- 172.21.15.100:0/3948838001 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f9006c1a0 msgr2=0x7f3f900caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.040+0000 7f3f8f7fe640 1 --2- 172.21.15.100:0/3948838001 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f9006c1a0 0x7f3f900caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.040+0000 7f3f8f7fe640 1 -- 172.21.15.100:0/3948838001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f90156c90 msgr2=0x7f3f90158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.040+0000 7f3f8f7fe640 1 --2- 172.21.15.100:0/3948838001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f90156c90 0x7f3f90158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:33.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.040+0000 7f3f8f7fe640 1 -- 172.21.15.100:0/3948838001 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f90159530 con 0x7f3f90153ec0 2024-09-11T22:31:33.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.041+0000 7f3f8f7fe640 1 --2- 172.21.15.100:0/3948838001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f90153ec0 0x7f3f90153080 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000c620 tx=0x7f3f8000cae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.044+0000 7f3f8cff9640 1 -- 172.21.15.100:0/3948838001 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f80015070 con 0x7f3f90153ec0 2024-09-11T22:31:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.044+0000 7f3f96467640 1 -- 172.21.15.100:0/3948838001 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f90155050 con 0x7f3f90153ec0 2024-09-11T22:31:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.044+0000 7f3f96467640 1 -- 172.21.15.100:0/3948838001 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f90154850 con 0x7f3f90153ec0 2024-09-11T22:31:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.044+0000 7f3f8cff9640 1 -- 172.21.15.100:0/3948838001 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f80004220 con 0x7f3f90153ec0 2024-09-11T22:31:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.044+0000 7f3f8cff9640 1 -- 172.21.15.100:0/3948838001 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f80003610 con 0x7f3f90153ec0 2024-09-11T22:31:33.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.047+0000 7f3f8cff9640 1 -- 172.21.15.100:0/3948838001 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f800037b0 con 0x7f3f90153ec0 2024-09-11T22:31:33.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.047+0000 7f3f8cff9640 1 --2- 172.21.15.100:0/3948838001 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3f7c06bf00 0x7f3f7c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:33.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.048+0000 7f3f8ffff640 1 --2- 172.21.15.100:0/3948838001 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3f7c06bf00 0x7f3f7c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:33.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.048+0000 7f3f96467640 1 -- 172.21.15.100:0/3948838001 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f70005290 con 0x7f3f90153ec0 2024-09-11T22:31:33.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.049+0000 7f3f8ffff640 1 --2- 172.21.15.100:0/3948838001 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3f7c06bf00 0x7f3f7c06e3c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3f88033170 tx=0x7f3f88039000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:33.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.049+0000 7f3f8cff9640 1 -- 172.21.15.100:0/3948838001 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f3f8008af50 con 0x7f3f90153ec0 2024-09-11T22:31:33.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.060+0000 7f3f8cff9640 1 -- 172.21.15.100:0/3948838001 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3f80058e70 con 0x7f3f90153ec0 2024-09-11T22:31:33.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.563+0000 7f3f96467640 1 -- 172.21.15.100:0/3948838001 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f3f70005d90 con 0x7f3f90153ec0 2024-09-11T22:31:33.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.567+0000 7f3f8cff9640 1 -- 172.21.15.100:0/3948838001 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f3f8005d170 con 0x7f3f90153ec0 2024-09-11T22:31:33.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.570+0000 7f3f96467640 1 -- 172.21.15.100:0/3948838001 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3f7c06bf00 msgr2=0x7f3f7c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:33.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.570+0000 7f3f96467640 1 --2- 172.21.15.100:0/3948838001 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3f7c06bf00 0x7f3f7c06e3c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3f88033170 tx=0x7f3f88039000 comp rx=0 tx=0).stop 2024-09-11T22:31:33.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.570+0000 7f3f96467640 1 -- 172.21.15.100:0/3948838001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f90153ec0 msgr2=0x7f3f90153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:33.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.570+0000 7f3f96467640 1 --2- 172.21.15.100:0/3948838001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f90153ec0 0x7f3f90153080 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3f8000c620 tx=0x7f3f8000cae0 comp rx=0 tx=0).stop 2024-09-11T22:31:33.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.574+0000 7f3f96467640 1 -- 172.21.15.100:0/3948838001 shutdown_connections 2024-09-11T22:31:33.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.574+0000 7f3f96467640 1 --2- 172.21.15.100:0/3948838001 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3f7c06bf00 0x7f3f7c06e3c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:33.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.574+0000 7f3f96467640 1 --2- 172.21.15.100:0/3948838001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f90156c90 0x7f3f90158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:33.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.574+0000 7f3f96467640 1 --2- 172.21.15.100:0/3948838001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f90153ec0 0x7f3f90153080 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:33.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.574+0000 7f3f96467640 1 --2- 172.21.15.100:0/3948838001 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f9006c1a0 0x7f3f900caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:33.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.574+0000 7f3f96467640 1 -- 172.21.15.100:0/3948838001 >> 172.21.15.100:0/3948838001 conn(0x7f3f900cbf70 msgr2=0x7f3f900c1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:33.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.574+0000 7f3f96467640 1 -- 172.21.15.100:0/3948838001 shutdown_connections 2024-09-11T22:31:33.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:33.574+0000 7f3f96467640 1 -- 172.21.15.100:0/3948838001 wait complete. 2024-09-11T22:31:33.609 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-11T22:31:43.611 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:31:43.611 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:31:43.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.785+0000 7f6959e3c640 1 Processor -- start 2024-09-11T22:31:43.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.786+0000 7f6959e3c640 1 -- start start 2024-09-11T22:31:43.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.787+0000 7f6959e3c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f695406be80 0x7f69540c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:43.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.787+0000 7f6959e3c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f695406c260 0x7f69540c1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:43.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.787+0000 7f6959e3c640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69540c8380 con 0x7f6954073f80 2024-09-11T22:31:43.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.787+0000 7f6959e3c640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f6954072960 con 0x7f695406be80 2024-09-11T22:31:43.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.787+0000 7f6959e3c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f6954072c40 con 0x7f695406c260 2024-09-11T22:31:43.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.787+0000 7f69537fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f695406be80 0x7f69540c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:43.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.787+0000 7f69537fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f695406be80 0x7f69540c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38784/0 (socket says 172.21.15.100:38784) 2024-09-11T22:31:43.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.787+0000 7f69537fe640 1 -- 172.21.15.100:0/4138356006 learned_addr learned my addr 172.21.15.100:0/4138356006 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:31:43.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.788+0000 7f6952ffd640 1 --2- 172.21.15.100:0/4138356006 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f695406c260 0x7f69540c1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:43.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.788+0000 7f69537fe640 1 -- 172.21.15.100:0/4138356006 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f695406c260 msgr2=0x7f69540c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:43.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.788+0000 7f69537fe640 1 --2- 172.21.15.100:0/4138356006 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f695406c260 0x7f69540c1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:43.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.788+0000 7f69537fe640 1 -- 172.21.15.100:0/4138356006 >> v1:172.21.15.100:6789/0 conn(0x7f6954073f80 legacy=0x7f695406d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:43.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.787+0000 7f6953fff640 1 --1- 172.21.15.100:0/4138356006 >> v1:172.21.15.100:6789/0 conn(0x7f6954073f80 0x7f695406d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45434/0 (socket says 172.21.15.100:45434) 2024-09-11T22:31:43.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.789+0000 7f69537fe640 1 -- 172.21.15.100:0/4138356006 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6954072f20 con 0x7f695406be80 2024-09-11T22:31:43.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.798+0000 7f69537fe640 1 --2- 172.21.15.100:0/4138356006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f695406be80 0x7f69540c7cf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f694800a900 tx=0x7f6948032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e234508d285b29ec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:43.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.799+0000 7f69527fc640 1 -- 172.21.15.100:0/4138356006 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6948039070 con 0x7f695406be80 2024-09-11T22:31:43.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.799+0000 7f69527fc640 1 -- 172.21.15.100:0/4138356006 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6948033990 con 0x7f695406be80 2024-09-11T22:31:43.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.799+0000 7f69527fc640 1 -- 172.21.15.100:0/4138356006 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6948033dc0 con 0x7f695406be80 2024-09-11T22:31:43.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.805+0000 7f6959e3c640 1 -- 172.21.15.100:0/4138356006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f695406be80 msgr2=0x7f69540c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:43.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.805+0000 7f6959e3c640 1 --2- 172.21.15.100:0/4138356006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f695406be80 0x7f69540c7cf0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f694800a900 tx=0x7f6948032c40 comp rx=0 tx=0).stop 2024-09-11T22:31:43.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.806+0000 7f6959e3c640 1 -- 172.21.15.100:0/4138356006 shutdown_connections 2024-09-11T22:31:43.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.806+0000 7f6959e3c640 1 --2- 172.21.15.100:0/4138356006 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f695406c260 0x7f69540c1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:43.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.806+0000 7f6959e3c640 1 --2- 172.21.15.100:0/4138356006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f695406be80 0x7f69540c7cf0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:43.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.806+0000 7f6959e3c640 1 -- 172.21.15.100:0/4138356006 >> 172.21.15.100:0/4138356006 conn(0x7f69540cbf70 msgr2=0x7f69540cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:43.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.807+0000 7f6959e3c640 1 -- 172.21.15.100:0/4138356006 shutdown_connections 2024-09-11T22:31:43.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.807+0000 7f6959e3c640 1 -- 172.21.15.100:0/4138356006 wait complete. 2024-09-11T22:31:43.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.809+0000 7f6959e3c640 1 Processor -- start 2024-09-11T22:31:43.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.809+0000 7f6959e3c640 1 -- start start 2024-09-11T22:31:43.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.810+0000 7f6959e3c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f695406be80 0x7f69540c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:43.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.810+0000 7f6959e3c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f695406c260 0x7f695415fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:43.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.810+0000 7f6959e3c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6954073f80 0x7f69541fd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:43.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.810+0000 7f6959e3c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f69540c3000 con 0x7f695406c260 2024-09-11T22:31:43.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.810+0000 7f6959e3c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f695406cc70 con 0x7f6954073f80 2024-09-11T22:31:43.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.810+0000 7f6959e3c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f69540c4ee0 con 0x7f695406be80 2024-09-11T22:31:43.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.811+0000 7f69537fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f695406be80 0x7f69540c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:43.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.811+0000 7f69537fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f695406be80 0x7f69540c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:51176/0 (socket says 172.21.15.100:51176) 2024-09-11T22:31:43.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.811+0000 7f69537fe640 1 -- 172.21.15.100:0/3764903544 learned_addr learned my addr 172.21.15.100:0/3764903544 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:31:43.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.811+0000 7f6953fff640 1 --2- 172.21.15.100:0/3764903544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6954073f80 0x7f69541fd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:43.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.811+0000 7f6952ffd640 1 --2- 172.21.15.100:0/3764903544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f695406c260 0x7f695415fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:43.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.811+0000 7f69537fe640 1 -- 172.21.15.100:0/3764903544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6954073f80 msgr2=0x7f69541fd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:43.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.811+0000 7f69537fe640 1 --2- 172.21.15.100:0/3764903544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6954073f80 0x7f69541fd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:43.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.811+0000 7f69537fe640 1 -- 172.21.15.100:0/3764903544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f695406c260 msgr2=0x7f695415fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:43.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.811+0000 7f69537fe640 1 --2- 172.21.15.100:0/3764903544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f695406c260 0x7f695415fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:43.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.811+0000 7f69537fe640 1 -- 172.21.15.100:0/3764903544 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69542008c0 con 0x7f695406be80 2024-09-11T22:31:43.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.812+0000 7f69537fe640 1 --2- 172.21.15.100:0/3764903544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f695406be80 0x7f69540c49a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6948000c00 tx=0x7f69480046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:43.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.812+0000 7f693bfff640 1 -- 172.21.15.100:0/3764903544 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694804c020 con 0x7f695406be80 2024-09-11T22:31:43.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.813+0000 7f6959e3c640 1 -- 172.21.15.100:0/3764903544 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6954200ba0 con 0x7f695406be80 2024-09-11T22:31:43.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.813+0000 7f6959e3c640 1 -- 172.21.15.100:0/3764903544 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6954201160 con 0x7f695406be80 2024-09-11T22:31:43.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.813+0000 7f693bfff640 1 -- 172.21.15.100:0/3764903544 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6948003aa0 con 0x7f695406be80 2024-09-11T22:31:43.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.813+0000 7f693bfff640 1 -- 172.21.15.100:0/3764903544 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6948048470 con 0x7f695406be80 2024-09-11T22:31:43.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.814+0000 7f6959e3c640 1 -- 172.21.15.100:0/3764903544 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6934005290 con 0x7f695406be80 2024-09-11T22:31:43.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.820+0000 7f693bfff640 1 -- 172.21.15.100:0/3764903544 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f694804f020 con 0x7f695406be80 2024-09-11T22:31:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.821+0000 7f693bfff640 1 --2- 172.21.15.100:0/3764903544 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f694006be30 0x7f694006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.821+0000 7f6952ffd640 1 --2- 172.21.15.100:0/3764903544 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f694006be30 0x7f694006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:43.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.821+0000 7f693bfff640 1 -- 172.21.15.100:0/3764903544 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f69480b4870 con 0x7f695406be80 2024-09-11T22:31:43.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.822+0000 7f6952ffd640 1 --2- 172.21.15.100:0/3764903544 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f694006be30 0x7f694006e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6954160470 tx=0x7f6944008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:43.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:43.827+0000 7f693bfff640 1 -- 172.21.15.100:0/3764903544 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6948056070 con 0x7f695406be80 2024-09-11T22:31:44.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.355+0000 7f6959e3c640 1 -- 172.21.15.100:0/3764903544 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6934005580 con 0x7f695406be80 2024-09-11T22:31:44.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.356+0000 7f693bfff640 1 -- 172.21.15.100:0/3764903544 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f6948082720 con 0x7f695406be80 2024-09-11T22:31:44.358 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":82,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:31:44.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.365+0000 7f6959e3c640 1 -- 172.21.15.100:0/3764903544 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f694006be30 msgr2=0x7f694006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.365+0000 7f6959e3c640 1 --2- 172.21.15.100:0/3764903544 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f694006be30 0x7f694006e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6954160470 tx=0x7f6944008040 comp rx=0 tx=0).stop 2024-09-11T22:31:44.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.365+0000 7f6959e3c640 1 -- 172.21.15.100:0/3764903544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f695406be80 msgr2=0x7f69540c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.365+0000 7f6959e3c640 1 --2- 172.21.15.100:0/3764903544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f695406be80 0x7f69540c49a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6948000c00 tx=0x7f69480046c0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.365+0000 7f6959e3c640 1 -- 172.21.15.100:0/3764903544 shutdown_connections 2024-09-11T22:31:44.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.365+0000 7f6959e3c640 1 --2- 172.21.15.100:0/3764903544 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f694006be30 0x7f694006e2f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.365+0000 7f6959e3c640 1 --2- 172.21.15.100:0/3764903544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6954073f80 0x7f69541fd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.365+0000 7f6959e3c640 1 --2- 172.21.15.100:0/3764903544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f695406c260 0x7f695415fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.365+0000 7f6959e3c640 1 --2- 172.21.15.100:0/3764903544 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f695406be80 0x7f69540c49a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.365+0000 7f6959e3c640 1 -- 172.21.15.100:0/3764903544 >> 172.21.15.100:0/3764903544 conn(0x7f69540cbf70 msgr2=0x7f69540c8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:44.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.366+0000 7f6959e3c640 1 -- 172.21.15.100:0/3764903544 shutdown_connections 2024-09-11T22:31:44.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.366+0000 7f6959e3c640 1 -- 172.21.15.100:0/3764903544 wait complete. 2024-09-11T22:31:44.386 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:31:44.386 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-11T22:31:44.386 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:31:44.387 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:31:44.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.593+0000 7efde1a1e640 1 Processor -- start 2024-09-11T22:31:44.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.600+0000 7efde1a1e640 1 -- start start 2024-09-11T22:31:44.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.601+0000 7efde1a1e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efdd404b860 0x7efdd404bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.601+0000 7efde1a1e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efdd4044fb0 0x7efdd40459d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.601+0000 7efde1a1e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdd40dd210 con 0x7efdd404c3a0 2024-09-11T22:31:44.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.601+0000 7efde1a1e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7efdd4035890 con 0x7efdd404b860 2024-09-11T22:31:44.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.601+0000 7efde1a1e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7efdd40337c0 con 0x7efdd4044fb0 2024-09-11T22:31:44.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.601+0000 7efddb7fe640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7efdd404c3a0 0x7efdd40e2a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:45438/0 (socket says 172.21.15.100:45438) 2024-09-11T22:31:44.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.601+0000 7efddb7fe640 1 -- 172.21.15.100:0/4167219490 learned_addr learned my addr 172.21.15.100:0/4167219490 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:31:44.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.601+0000 7efddaffd640 1 --2- 172.21.15.100:0/4167219490 >> v2:172.21.15.100:3300/0 conn(0x7efdd404b860 0x7efdd404bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.602+0000 7efdd9ffb640 1 -- 172.21.15.100:0/4167219490 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 628378670 0 0) 0x7efdd40dd210 con 0x7efdd404c3a0 2024-09-11T22:31:44.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.602+0000 7efdd9ffb640 1 -- 172.21.15.100:0/4167219490 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdc4003520 con 0x7efdd404c3a0 2024-09-11T22:31:44.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.602+0000 7efddaffd640 1 -- 172.21.15.100:0/4167219490 >> v2:172.21.15.167:3300/0 conn(0x7efdd4044fb0 msgr2=0x7efdd40459d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:31:44.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.602+0000 7efddaffd640 1 --2- 172.21.15.100:0/4167219490 >> v2:172.21.15.167:3300/0 conn(0x7efdd4044fb0 0x7efdd40459d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.602+0000 7efddaffd640 1 -- 172.21.15.100:0/4167219490 >> v1:172.21.15.100:6789/0 conn(0x7efdd404c3a0 legacy=0x7efdd40e2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.602+0000 7efdd9ffb640 1 -- 172.21.15.100:0/4167219490 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3246077617 0 0) 0x7efdc4003520 con 0x7efdd404c3a0 2024-09-11T22:31:44.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.602+0000 7efddaffd640 1 -- 172.21.15.100:0/4167219490 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd40454c0 con 0x7efdd404b860 2024-09-11T22:31:44.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.603+0000 7efddaffd640 1 --2- 172.21.15.100:0/4167219490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdd404b860 0x7efdd404bc40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efddc065710 tx=0x7efddc0a69f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77b1e83ea381dbc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:44.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.606+0000 7efdd9ffb640 1 -- 172.21.15.100:0/4167219490 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc0b0020 con 0x7efdd404b860 2024-09-11T22:31:44.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.606+0000 7efdd9ffb640 1 -- 172.21.15.100:0/4167219490 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efddc0ac6f0 con 0x7efdd404b860 2024-09-11T22:31:44.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.606+0000 7efdd9ffb640 1 -- 172.21.15.100:0/4167219490 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc001670 con 0x7efdd404b860 2024-09-11T22:31:44.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.607+0000 7efde1a1e640 1 -- 172.21.15.100:0/4167219490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdd404b860 msgr2=0x7efdd404bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.607+0000 7efde1a1e640 1 --2- 172.21.15.100:0/4167219490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdd404b860 0x7efdd404bc40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efddc065710 tx=0x7efddc0a69f0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.608+0000 7efde1a1e640 1 -- 172.21.15.100:0/4167219490 shutdown_connections 2024-09-11T22:31:44.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.608+0000 7efde1a1e640 1 --2- 172.21.15.100:0/4167219490 >> v2:172.21.15.167:3300/0 conn(0x7efdd4044fb0 0x7efdd40459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.608+0000 7efde1a1e640 1 --2- 172.21.15.100:0/4167219490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdd404b860 0x7efdd404bc40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.608+0000 7efde1a1e640 1 -- 172.21.15.100:0/4167219490 >> 172.21.15.100:0/4167219490 conn(0x7efdd40500d0 msgr2=0x7efdd40504e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:44.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.609+0000 7efde1a1e640 1 -- 172.21.15.100:0/4167219490 shutdown_connections 2024-09-11T22:31:44.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.611+0000 7efde1a1e640 1 -- 172.21.15.100:0/4167219490 wait complete. 2024-09-11T22:31:44.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.613+0000 7efde1a1e640 1 Processor -- start 2024-09-11T22:31:44.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.613+0000 7efde1a1e640 1 -- start start 2024-09-11T22:31:44.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.614+0000 7efde1a1e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efdd4044fb0 0x7efdd40cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.614+0000 7efde1a1e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efdd404b860 0x7efdd40bf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.614+0000 7efde1a1e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdd404c3a0 0x7efdd40c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.615+0000 7efddb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdd404c3a0 0x7efdd40c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.615+0000 7efddb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdd404c3a0 0x7efdd40c78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38816/0 (socket says 172.21.15.100:38816) 2024-09-11T22:31:44.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.615+0000 7efddb7fe640 1 -- 172.21.15.100:0/2382922577 learned_addr learned my addr 172.21.15.100:0/2382922577 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:31:44.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.615+0000 7efde1a1e640 1 -- 172.21.15.100:0/2382922577 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efdd40e6300 con 0x7efdd404c3a0 2024-09-11T22:31:44.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.615+0000 7efde1a1e640 1 -- 172.21.15.100:0/2382922577 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efdd40e6f10 con 0x7efdd4044fb0 2024-09-11T22:31:44.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.615+0000 7efde1a1e640 1 -- 172.21.15.100:0/2382922577 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7efdd40e65e0 con 0x7efdd404b860 2024-09-11T22:31:44.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.616+0000 7efdda7fc640 1 --2- 172.21.15.100:0/2382922577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efdd404b860 0x7efdd40bf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.616+0000 7efddaffd640 1 --2- 172.21.15.100:0/2382922577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efdd4044fb0 0x7efdd40cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.617+0000 7efdda7fc640 1 -- 172.21.15.100:0/2382922577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efdd4044fb0 msgr2=0x7efdd40cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.617+0000 7efdda7fc640 1 --2- 172.21.15.100:0/2382922577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efdd4044fb0 0x7efdd40cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.617+0000 7efdda7fc640 1 -- 172.21.15.100:0/2382922577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdd404c3a0 msgr2=0x7efdd40c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.617+0000 7efdda7fc640 1 --2- 172.21.15.100:0/2382922577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdd404c3a0 0x7efdd40c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.617+0000 7efdda7fc640 1 -- 172.21.15.100:0/2382922577 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd40cf3e0 con 0x7efdd404b860 2024-09-11T22:31:44.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.617+0000 7efddb7fe640 1 --2- 172.21.15.100:0/2382922577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdd404c3a0 0x7efdd40c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:31:44.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.618+0000 7efdda7fc640 1 --2- 172.21.15.100:0/2382922577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efdd404b860 0x7efdd40bf1b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efdd0009fd0 tx=0x7efdd000b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:44.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.618+0000 7efdc3fff640 1 -- 172.21.15.100:0/2382922577 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0015020 con 0x7efdd404b860 2024-09-11T22:31:44.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.618+0000 7efde1a1e640 1 -- 172.21.15.100:0/2382922577 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd40cf130 con 0x7efdd404b860 2024-09-11T22:31:44.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.618+0000 7efde1a1e640 1 -- 172.21.15.100:0/2382922577 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd40c8450 con 0x7efdd404b860 2024-09-11T22:31:44.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.618+0000 7efdc3fff640 1 -- 172.21.15.100:0/2382922577 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd0011850 con 0x7efdd404b860 2024-09-11T22:31:44.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.618+0000 7efdc3fff640 1 -- 172.21.15.100:0/2382922577 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0011c40 con 0x7efdd404b860 2024-09-11T22:31:44.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.623+0000 7efde1a1e640 1 --2- 172.21.15.100:0/2382922577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdbc002a70 0x7efdbc004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.623+0000 7efde1a1e640 1 -- 172.21.15.100:0/2382922577 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efdbc007ec0 con 0x7efdbc002a70 2024-09-11T22:31:44.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.623+0000 7efddaffd640 1 --2- 172.21.15.100:0/2382922577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdbc002a70 0x7efdbc004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.624+0000 7efddaffd640 1 -- 172.21.15.100:0/2382922577 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efdbc0080c0 con 0x7efdbc002a70 2024-09-11T22:31:44.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.624+0000 7efddaffd640 1 --2- 172.21.15.100:0/2382922577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdbc002a70 0x7efdbc004f30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efddc06b3b0 tx=0x7efddc06bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:44.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.624+0000 7efdc3fff640 1 -- 172.21.15.100:0/2382922577 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efdd0018020 con 0x7efdd404b860 2024-09-11T22:31:44.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.625+0000 7efdc3fff640 1 --2- 172.21.15.100:0/2382922577 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efdc806be30 0x7efdc806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.625+0000 7efddb7fe640 1 --2- 172.21.15.100:0/2382922577 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efdc806be30 0x7efdc806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.626+0000 7efddb7fe640 1 --2- 172.21.15.100:0/2382922577 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efdc806be30 0x7efdc806e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efdcc000f60 tx=0x7efdcc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:44.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.626+0000 7efdc3fff640 1 -- 172.21.15.100:0/2382922577 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7efdd008b1f0 con 0x7efdd404b860 2024-09-11T22:31:44.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.626+0000 7efdc3fff640 1 -- 172.21.15.100:0/2382922577 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc08b070 con 0x7efdbc002a70 2024-09-11T22:31:44.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.626+0000 7efdc3fff640 1 -- 172.21.15.100:0/2382922577 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7efddc0acbc0 con 0x7efdbc002a70 2024-09-11T22:31:44.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.626+0000 7efdc3fff640 1 -- 172.21.15.100:0/2382922577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdbc002a70 msgr2=0x7efdbc004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.626+0000 7efdc3fff640 1 --2- 172.21.15.100:0/2382922577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdbc002a70 0x7efdbc004f30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efddc06b3b0 tx=0x7efddc06bb40 comp rx=0 tx=0).stop 2024-09-11T22:31:44.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.626+0000 7efdc3fff640 1 -- 172.21.15.100:0/2382922577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdbc002a70 msgr2=0x7efdbc004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:31:44.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.626+0000 7efdc3fff640 1 --2- 172.21.15.100:0/2382922577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdbc002a70 0x7efdbc004f30 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efddc06b3b0 tx=0x7efddc06bb40 comp rx=0 tx=0).stop 2024-09-11T22:31:44.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.649+0000 7efde1a1e640 1 --2- 172.21.15.100:0/2382922577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdbc006f30 0x7efdbc0073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.649+0000 7efde1a1e640 1 -- 172.21.15.100:0/2382922577 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efdbc00a4a0 con 0x7efdbc006f30 2024-09-11T22:31:44.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.650+0000 7efddaffd640 1 --2- 172.21.15.100:0/2382922577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdbc006f30 0x7efdbc0073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.650+0000 7efddaffd640 1 -- 172.21.15.100:0/2382922577 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efdbc007900 con 0x7efdbc006f30 2024-09-11T22:31:44.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.650+0000 7efddaffd640 1 --2- 172.21.15.100:0/2382922577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdbc006f30 0x7efdbc0073c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efddc06b1f0 tx=0x7efddc069df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:44.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.651+0000 7efdc3fff640 1 -- 172.21.15.100:0/2382922577 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc08b040 con 0x7efdbc006f30 2024-09-11T22:31:44.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.651+0000 7efdc3fff640 1 -- 172.21.15.100:0/2382922577 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4555 (secure 0 0 0) 0x7efddc0b5420 con 0x7efdbc006f30 2024-09-11T22:31:44.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.651+0000 7efdc3fff640 1 -- 172.21.15.100:0/2382922577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdbc006f30 msgr2=0x7efdbc0073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.651+0000 7efdc3fff640 1 --2- 172.21.15.100:0/2382922577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdbc006f30 0x7efdbc0073c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efddc06b1f0 tx=0x7efddc069df0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.651+0000 7efdc3fff640 1 -- 172.21.15.100:0/2382922577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdbc006f30 msgr2=0x7efdbc0073c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:31:44.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.651+0000 7efdc3fff640 1 --2- 172.21.15.100:0/2382922577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efdbc006f30 0x7efdbc0073c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 82, 2024-09-11T22:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 28550, 2024-09-11T22:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:31:44.653 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 13, 2024-09-11T22:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:31:44.654 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:31:44.655 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:31:44.656 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:31:44.657 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:31:44.657 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:31:44.657 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:31:44.657 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:31:44.657 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:31:44.657 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:31:44.657 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:31:44.657 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:31:44.657 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:31:44.657 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:31:44.657 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:31:44.657 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:31:44.657 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:31:44.657 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.658 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:31:44.659 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.660 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.661 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:44.662 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:31:44.663 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:31:44.664 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:31:44.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.652+0000 7efde1a1e640 1 -- 172.21.15.100:0/2382922577 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efdc806be30 msgr2=0x7efdc806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.652+0000 7efde1a1e640 1 --2- 172.21.15.100:0/2382922577 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efdc806be30 0x7efdc806e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efdcc000f60 tx=0x7efdcc009040 comp rx=0 tx=0).stop 2024-09-11T22:31:44.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.652+0000 7efddb7fe640 1 -- 172.21.15.100:0/2382922577 reap_dead start 2024-09-11T22:31:44.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.652+0000 7efde1a1e640 1 -- 172.21.15.100:0/2382922577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efdd404b860 msgr2=0x7efdd40bf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.652+0000 7efde1a1e640 1 --2- 172.21.15.100:0/2382922577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efdd404b860 0x7efdd40bf1b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efdd0009fd0 tx=0x7efdd000b870 comp rx=0 tx=0).stop 2024-09-11T22:31:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.655+0000 7efde1a1e640 1 -- 172.21.15.100:0/2382922577 shutdown_connections 2024-09-11T22:31:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.655+0000 7efde1a1e640 1 --2- 172.21.15.100:0/2382922577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efdd404b860 0x7efdd40bf1b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.655+0000 7efde1a1e640 1 -- 172.21.15.100:0/2382922577 >> 172.21.15.100:0/2382922577 conn(0x7efdd40500d0 msgr2=0x7efdd40cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.656+0000 7efde1a1e640 1 -- 172.21.15.100:0/2382922577 shutdown_connections 2024-09-11T22:31:44.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.657+0000 7efde1a1e640 1 -- 172.21.15.100:0/2382922577 wait complete. 2024-09-11T22:31:44.679 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:31:44.679 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:31:44.679 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:31:44.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.893+0000 7fbf2159f640 1 Processor -- start 2024-09-11T22:31:44.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.893+0000 7fbf2159f640 1 -- start start 2024-09-11T22:31:44.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.895+0000 7fbf2159f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf1c0c81a0 0x7fbf1c0c0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.895+0000 7fbf2159f640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbf1c0c1380 0x7fbf1c0c6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.895+0000 7fbf2159f640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf1c06cfd0 con 0x7fbf1c0c7dc0 2024-09-11T22:31:44.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.895+0000 7fbf2159f640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fbf1c06da70 con 0x7fbf1c0c1380 2024-09-11T22:31:44.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.895+0000 7fbf2159f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbf1c074060 con 0x7fbf1c0c81a0 2024-09-11T22:31:44.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.895+0000 7fbf1b7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf1c0c81a0 0x7fbf1c0c0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.895+0000 7fbf1b7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf1c0c81a0 0x7fbf1c0c0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:51208/0 (socket says 172.21.15.100:51208) 2024-09-11T22:31:44.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.895+0000 7fbf1b7fe640 1 -- 172.21.15.100:0/2995189209 learned_addr learned my addr 172.21.15.100:0/2995189209 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:31:44.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.896+0000 7fbf20d9e640 1 --2- 172.21.15.100:0/2995189209 >> v2:172.21.15.100:3300/0 conn(0x7fbf1c0c1380 0x7fbf1c0c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.897+0000 7fbf1b7fe640 1 -- 172.21.15.100:0/2995189209 >> v2:172.21.15.100:3300/0 conn(0x7fbf1c0c1380 msgr2=0x7fbf1c0c6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:44.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.897+0000 7fbf1b7fe640 1 --2- 172.21.15.100:0/2995189209 >> v2:172.21.15.100:3300/0 conn(0x7fbf1c0c1380 0x7fbf1c0c6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.897+0000 7fbf1b7fe640 1 -- 172.21.15.100:0/2995189209 >> v1:172.21.15.100:6789/0 conn(0x7fbf1c0c7dc0 legacy=0x7fbf1c071d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.897+0000 7fbf1b7fe640 1 -- 172.21.15.100:0/2995189209 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1c06dfe0 con 0x7fbf1c0c81a0 2024-09-11T22:31:44.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.898+0000 7fbf20d9e640 1 --2- 172.21.15.100:0/2995189209 >> v2:172.21.15.100:3300/0 conn(0x7fbf1c0c1380 0x7fbf1c0c6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:31:44.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.902+0000 7fbf1b7fe640 1 --2- 172.21.15.100:0/2995189209 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf1c0c81a0 0x7fbf1c0c0e40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbf14008e10 tx=0x7fbf14033030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8473d0268d003209 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:44.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.902+0000 7fbf1affd640 1 -- 172.21.15.100:0/2995189209 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf14040070 con 0x7fbf1c0c81a0 2024-09-11T22:31:44.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.902+0000 7fbf1affd640 1 -- 172.21.15.100:0/2995189209 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf14033cc0 con 0x7fbf1c0c81a0 2024-09-11T22:31:44.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.902+0000 7fbf1affd640 1 -- 172.21.15.100:0/2995189209 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1403b660 con 0x7fbf1c0c81a0 2024-09-11T22:31:44.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.905+0000 7fbf2159f640 1 -- 172.21.15.100:0/2995189209 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf1c0c81a0 msgr2=0x7fbf1c0c0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.905+0000 7fbf2159f640 1 --2- 172.21.15.100:0/2995189209 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf1c0c81a0 0x7fbf1c0c0e40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbf14008e10 tx=0x7fbf14033030 comp rx=0 tx=0).stop 2024-09-11T22:31:44.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.905+0000 7fbf2159f640 1 -- 172.21.15.100:0/2995189209 shutdown_connections 2024-09-11T22:31:44.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.905+0000 7fbf2159f640 1 --2- 172.21.15.100:0/2995189209 >> v2:172.21.15.100:3300/0 conn(0x7fbf1c0c1380 0x7fbf1c0c6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.905+0000 7fbf2159f640 1 --2- 172.21.15.100:0/2995189209 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf1c0c81a0 0x7fbf1c0c0e40 secure :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbf14008e10 tx=0x7fbf14033030 comp rx=0 tx=0).stop 2024-09-11T22:31:44.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.905+0000 7fbf2159f640 1 -- 172.21.15.100:0/2995189209 >> 172.21.15.100:0/2995189209 conn(0x7fbf1c06ed10 msgr2=0x7fbf1c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:44.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.905+0000 7fbf2159f640 1 -- 172.21.15.100:0/2995189209 shutdown_connections 2024-09-11T22:31:44.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.905+0000 7fbf2159f640 1 -- 172.21.15.100:0/2995189209 wait complete. 2024-09-11T22:31:44.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.907+0000 7fbf2159f640 1 Processor -- start 2024-09-11T22:31:44.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.907+0000 7fbf2159f640 1 -- start start 2024-09-11T22:31:44.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.910+0000 7fbf2159f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf1c0c1380 0x7fbf1c1651c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.914+0000 7fbf2159f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf1c0c7dc0 0x7fbf1c21fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.915+0000 7fbf1b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf1c0c7dc0 0x7fbf1c21fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.915+0000 7fbf1b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf1c0c7dc0 0x7fbf1c21fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38844/0 (socket says 172.21.15.100:38844) 2024-09-11T22:31:44.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.916+0000 7fbf1bfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf1c0c1380 0x7fbf1c1651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.916+0000 7fbf1bfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf1c0c1380 0x7fbf1c1651c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:51210/0 (socket says 172.21.15.100:51210) 2024-09-11T22:31:44.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.917+0000 7fbf2159f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf1c223020 0x7fbf1c08c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.917+0000 7fbf2159f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1c06d270 con 0x7fbf1c0c7dc0 2024-09-11T22:31:44.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.917+0000 7fbf2159f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1c06e5a0 con 0x7fbf1c223020 2024-09-11T22:31:44.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.917+0000 7fbf2159f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbf1c06d550 con 0x7fbf1c0c1380 2024-09-11T22:31:44.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.918+0000 7fbf20d9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf1c223020 0x7fbf1c08c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.918+0000 7fbf20d9e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf1c223020 0x7fbf1c08c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:49472/0 (socket says 172.21.15.100:49472) 2024-09-11T22:31:44.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.918+0000 7fbf20d9e640 1 -- 172.21.15.100:0/2125736450 learned_addr learned my addr 172.21.15.100:0/2125736450 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:31:44.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.919+0000 7fbf1b7fe640 1 -- 172.21.15.100:0/2125736450 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf1c0c1380 msgr2=0x7fbf1c1651c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.919+0000 7fbf1b7fe640 1 --2- 172.21.15.100:0/2125736450 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf1c0c1380 0x7fbf1c1651c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.919+0000 7fbf1b7fe640 1 -- 172.21.15.100:0/2125736450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf1c223020 msgr2=0x7fbf1c08c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.919+0000 7fbf1b7fe640 1 --2- 172.21.15.100:0/2125736450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf1c223020 0x7fbf1c08c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.919+0000 7fbf1b7fe640 1 -- 172.21.15.100:0/2125736450 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1c0cb7f0 con 0x7fbf1c0c7dc0 2024-09-11T22:31:44.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.919+0000 7fbf1b7fe640 1 --2- 172.21.15.100:0/2125736450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf1c0c7dc0 0x7fbf1c21fb60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c06dbf0 tx=0x7fbf14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:44.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.920+0000 7fbf18ff9640 1 -- 172.21.15.100:0/2125736450 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf14040020 con 0x7fbf1c0c7dc0 2024-09-11T22:31:44.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.920+0000 7fbf2159f640 1 -- 172.21.15.100:0/2125736450 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf1c0c3660 con 0x7fbf1c0c7dc0 2024-09-11T22:31:44.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.920+0000 7fbf2159f640 1 -- 172.21.15.100:0/2125736450 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf1c21f0a0 con 0x7fbf1c0c7dc0 2024-09-11T22:31:44.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.921+0000 7fbf027fc640 1 --2- 172.21.15.100:0/2125736450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbefc002a70 0x7fbefc004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.921+0000 7fbf027fc640 1 -- 172.21.15.100:0/2125736450 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbefc007ec0 con 0x7fbefc002a70 2024-09-11T22:31:44.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.922+0000 7fbf18ff9640 1 -- 172.21.15.100:0/2125736450 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf140084c0 con 0x7fbf1c0c7dc0 2024-09-11T22:31:44.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.922+0000 7fbf18ff9640 1 -- 172.21.15.100:0/2125736450 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf14007dd0 con 0x7fbf1c0c7dc0 2024-09-11T22:31:44.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.923+0000 7fbf1bfff640 1 --2- 172.21.15.100:0/2125736450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbefc002a70 0x7fbefc004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.925+0000 7fbf18ff9640 1 -- 172.21.15.100:0/2125736450 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf14043020 con 0x7fbf1c0c7dc0 2024-09-11T22:31:44.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.925+0000 7fbf18ff9640 1 --2- 172.21.15.100:0/2125736450 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbf0806bf30 0x7fbf0806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.925+0000 7fbf1bfff640 1 -- 172.21.15.100:0/2125736450 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbefc0080c0 con 0x7fbefc002a70 2024-09-11T22:31:44.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.926+0000 7fbf18ff9640 1 -- 172.21.15.100:0/2125736450 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fbf140ab5f0 con 0x7fbf1c0c7dc0 2024-09-11T22:31:44.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.926+0000 7fbf1bfff640 1 --2- 172.21.15.100:0/2125736450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbefc002a70 0x7fbefc004f30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00f7a0 tx=0x7fbf0c00fc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:44.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.926+0000 7fbf20d9e640 1 --2- 172.21.15.100:0/2125736450 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbf0806bf30 0x7fbf0806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.926+0000 7fbf18ff9640 1 -- 172.21.15.100:0/2125736450 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c019070 con 0x7fbefc002a70 2024-09-11T22:31:44.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.926+0000 7fbf20d9e640 1 --2- 172.21.15.100:0/2125736450 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbf0806bf30 0x7fbf0806e3f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbf1000bcc0 tx=0x7fbf10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:44.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.927+0000 7fbf18ff9640 1 -- 172.21.15.100:0/2125736450 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fbf0c00fe50 con 0x7fbefc002a70 2024-09-11T22:31:44.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.927+0000 7fbf18ff9640 1 -- 172.21.15.100:0/2125736450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbefc002a70 msgr2=0x7fbefc004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.927+0000 7fbf18ff9640 1 --2- 172.21.15.100:0/2125736450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbefc002a70 0x7fbefc004f30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00f7a0 tx=0x7fbf0c00fc60 comp rx=0 tx=0).stop 2024-09-11T22:31:44.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.927+0000 7fbf18ff9640 1 -- 172.21.15.100:0/2125736450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbefc002a70 msgr2=0x7fbefc004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:31:44.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.927+0000 7fbf18ff9640 1 --2- 172.21.15.100:0/2125736450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbefc002a70 0x7fbefc004f30 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.943+0000 7fbf027fc640 1 --2- 172.21.15.100:0/2125736450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbefc006f30 0x7fbefc0073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:44.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.943+0000 7fbf027fc640 1 -- 172.21.15.100:0/2125736450 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbefc00a4a0 con 0x7fbefc006f30 2024-09-11T22:31:44.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.945+0000 7fbf1bfff640 1 --2- 172.21.15.100:0/2125736450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbefc006f30 0x7fbefc0073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:44.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.947+0000 7fbf1bfff640 1 -- 172.21.15.100:0/2125736450 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbefc007900 con 0x7fbefc006f30 2024-09-11T22:31:44.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.948+0000 7fbf1bfff640 1 --2- 172.21.15.100:0/2125736450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbefc006f30 0x7fbefc0073c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c016000 tx=0x7fbf0c000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:44.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.950+0000 7fbf18ff9640 1 -- 172.21.15.100:0/2125736450 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c019070 con 0x7fbefc006f30 2024-09-11T22:31:44.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.950+0000 7fbf18ff9640 1 -- 172.21.15.100:0/2125736450 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4888 (secure 0 0 0) 0x7fbf0c01a040 con 0x7fbefc006f30 2024-09-11T22:31:44.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.950+0000 7fbf18ff9640 1 -- 172.21.15.100:0/2125736450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbefc006f30 msgr2=0x7fbefc0073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.950+0000 7fbf18ff9640 1 --2- 172.21.15.100:0/2125736450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbefc006f30 0x7fbefc0073c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c016000 tx=0x7fbf0c000f40 comp rx=0 tx=0).stop 2024-09-11T22:31:44.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.950+0000 7fbf18ff9640 1 -- 172.21.15.100:0/2125736450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbefc006f30 msgr2=0x7fbefc0073c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:31:44.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.950+0000 7fbf18ff9640 1 --2- 172.21.15.100:0/2125736450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbefc006f30 0x7fbefc0073c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:44.952 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:31:44.952 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:31:44.952 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:31:44.952 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:31:44.952 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 82, 2024-09-11T22:31:44.952 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 490227, 2024-09-11T22:31:44.952 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:31:44.952 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:31:44.952 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:31:44.952 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:31:44.952 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:44.953 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 13, 2024-09-11T22:31:44.953 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:31:44.953 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:31:44.953 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:31:44.953 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:31:44.953 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:31:44.953 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:31:44.953 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:31:44.953 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:31:44.953 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:31:44.953 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:31:44.953 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:31:44.953 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:31:44.954 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:31:44.954 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:31:44.954 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:44.954 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:31:44.954 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:31:44.954 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:31:44.954 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:31:44.954 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:31:44.954 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:31:44.954 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:31:44.954 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:31:44.954 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:31:44.954 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:31:44.954 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:31:44.955 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:31:44.955 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:31:44.955 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:44.955 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.955 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:31:44.955 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:31:44.955 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:31:44.955 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:31:44.955 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:31:44.955 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:31:44.955 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:31:44.955 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:31:44.955 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:31:44.956 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:31:44.956 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:31:44.956 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:31:44.956 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:31:44.956 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:31:44.956 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:31:44.956 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:31:44.956 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:31:44.956 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:31:44.956 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:31:44.956 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:31:44.956 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:31:44.957 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:31:44.957 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:31:44.957 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:31:44.957 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:31:44.957 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:31:44.957 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:31:44.957 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:31:44.957 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:44.957 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:31:44.957 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.957 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:31:44.957 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.957 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:31:44.957 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:31:44.958 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:31:44.958 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:31:44.958 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.958 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:31:44.958 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:31:44.958 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:44.958 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.958 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.958 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:31:44.958 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:31:44.958 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:44.958 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:44.958 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:44.959 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.959 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:31:44.959 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:31:44.959 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:31:44.959 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:31:44.959 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:31:44.959 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.959 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.959 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:31:44.959 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:31:44.959 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:31:44.959 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:31:44.959 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.959 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:31:44.960 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:31:44.960 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:44.960 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.960 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.960 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:31:44.960 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:31:44.960 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:44.960 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:44.960 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:44.960 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.960 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:31:44.960 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:31:44.960 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:31:44.961 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:31:44.961 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:31:44.961 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.961 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.961 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:31:44.961 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:31:44.961 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:31:44.961 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:31:44.961 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.961 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:31:44.961 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:31:44.961 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:44.961 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.962 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.962 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:31:44.962 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:31:44.962 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:44.962 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:44.962 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:44.962 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.962 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:31:44.962 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:31:44.962 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:31:44.962 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:31:44.962 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:31:44.962 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:44.962 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:44.963 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.963 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:31:44.963 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:31:44.963 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.963 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:31:44.963 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:31:44.963 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:31:44.963 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:44.963 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:44.963 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:31:44.963 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.963 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:31:44.963 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:31:44.964 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:31:44.964 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:44.964 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:44.964 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:31:44.964 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.964 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:31:44.964 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:31:44.964 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:31:44.964 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:44.964 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:44.964 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:31:44.964 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:44.964 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:31:44.964 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:31:44.965 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:31:44.965 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:44.965 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:44.965 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:44.965 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:31:44.965 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:31:44.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.951+0000 7fbf027fc640 1 -- 172.21.15.100:0/2125736450 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbf0806bf30 msgr2=0x7fbf0806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.951+0000 7fbf027fc640 1 --2- 172.21.15.100:0/2125736450 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbf0806bf30 0x7fbf0806e3f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbf1000bcc0 tx=0x7fbf10008040 comp rx=0 tx=0).stop 2024-09-11T22:31:44.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.951+0000 7fbf027fc640 1 -- 172.21.15.100:0/2125736450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf1c0c7dc0 msgr2=0x7fbf1c21fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:44.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.951+0000 7fbf027fc640 1 --2- 172.21.15.100:0/2125736450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf1c0c7dc0 0x7fbf1c21fb60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c06dbf0 tx=0x7fbf14004a40 comp rx=0 tx=0).stop 2024-09-11T22:31:44.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.952+0000 7fbf20d9e640 1 -- 172.21.15.100:0/2125736450 reap_dead start 2024-09-11T22:31:44.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.952+0000 7fbf20d9e640 1 -- 172.21.15.100:0/2125736450 reap_dead start 2024-09-11T22:31:44.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.954+0000 7fbf027fc640 1 -- 172.21.15.100:0/2125736450 shutdown_connections 2024-09-11T22:31:44.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.954+0000 7fbf027fc640 1 -- 172.21.15.100:0/2125736450 >> 172.21.15.100:0/2125736450 conn(0x7fbf1c06ed10 msgr2=0x7fbf1c0c6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:44.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.955+0000 7fbf027fc640 1 -- 172.21.15.100:0/2125736450 shutdown_connections 2024-09-11T22:31:44.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:44.955+0000 7fbf027fc640 1 -- 172.21.15.100:0/2125736450 wait complete. 2024-09-11T22:31:44.978 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:31:44.979 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:31:44.979 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:31:45.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.198+0000 7f4ba5b03640 1 Processor -- start 2024-09-11T22:31:45.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.202+0000 7f4ba5b03640 1 -- start start 2024-09-11T22:31:45.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.203+0000 7f4ba5b03640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ba00b4cb0 0x7f4ba00c6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.203+0000 7f4ba5b03640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4ba00b5090 0x7f4ba0158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.203+0000 7f4ba5b03640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4ba00c5f40 0x7f4ba0159130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.203+0000 7f4ba5b03640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f4ba0162e90 con 0x7f4ba00b5090 2024-09-11T22:31:45.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.203+0000 7f4ba5b03640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f4ba015ee20 con 0x7f4ba00c5f40 2024-09-11T22:31:45.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.203+0000 7f4ba5b03640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4ba015f100 con 0x7f4ba00b4cb0 2024-09-11T22:31:45.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.204+0000 7f4b9effd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4ba00b5090 0x7f4ba0158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.204+0000 7f4b9ffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4ba00c5f40 0x7f4ba0159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.204+0000 7f4b9effd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4ba00b5090 0x7f4ba0158bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38858/0 (socket says 172.21.15.100:38858) 2024-09-11T22:31:45.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.204+0000 7f4b9effd640 1 -- 172.21.15.100:0/2183211871 learned_addr learned my addr 172.21.15.100:0/2183211871 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:31:45.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.204+0000 7f4b9f7fe640 1 --2- 172.21.15.100:0/2183211871 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ba00b4cb0 0x7f4ba00c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.204+0000 7f4b9effd640 1 -- 172.21.15.100:0/2183211871 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ba00b4cb0 msgr2=0x7f4ba00c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:45.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.204+0000 7f4b9effd640 1 --2- 172.21.15.100:0/2183211871 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ba00b4cb0 0x7f4ba00c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.204+0000 7f4b9effd640 1 -- 172.21.15.100:0/2183211871 >> v2:172.21.15.167:3300/0 conn(0x7f4ba00c5f40 msgr2=0x7f4ba0159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:45.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.204+0000 7f4b9effd640 1 --2- 172.21.15.100:0/2183211871 >> v2:172.21.15.167:3300/0 conn(0x7f4ba00c5f40 0x7f4ba0159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.204+0000 7f4b9effd640 1 -- 172.21.15.100:0/2183211871 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba015f3e0 con 0x7f4ba00b5090 2024-09-11T22:31:45.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.205+0000 7f4b9effd640 1 --2- 172.21.15.100:0/2183211871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba00b5090 0x7f4ba0158bf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00cda90 tx=0x7f4b9002a260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d10792314f919c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:45.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.206+0000 7f4b9e7fc640 1 -- 172.21.15.100:0/2183211871 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90037070 con 0x7f4ba00b5090 2024-09-11T22:31:45.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.206+0000 7f4b9e7fc640 1 -- 172.21.15.100:0/2183211871 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b90032440 con 0x7f4ba00b5090 2024-09-11T22:31:45.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.207+0000 7f4ba5b03640 1 -- 172.21.15.100:0/2183211871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba00b5090 msgr2=0x7f4ba0158bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:45.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.207+0000 7f4ba5b03640 1 --2- 172.21.15.100:0/2183211871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba00b5090 0x7f4ba0158bf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00cda90 tx=0x7f4b9002a260 comp rx=0 tx=0).stop 2024-09-11T22:31:45.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.208+0000 7f4ba5b03640 1 -- 172.21.15.100:0/2183211871 shutdown_connections 2024-09-11T22:31:45.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.208+0000 7f4ba5b03640 1 --2- 172.21.15.100:0/2183211871 >> v2:172.21.15.167:3300/0 conn(0x7f4ba00c5f40 0x7f4ba0159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.208+0000 7f4ba5b03640 1 --2- 172.21.15.100:0/2183211871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba00b5090 0x7f4ba0158bf0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.208+0000 7f4ba5b03640 1 --2- 172.21.15.100:0/2183211871 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ba00b4cb0 0x7f4ba00c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.208+0000 7f4ba5b03640 1 -- 172.21.15.100:0/2183211871 >> 172.21.15.100:0/2183211871 conn(0x7f4ba006bc10 msgr2=0x7f4ba006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.209+0000 7f4ba5b03640 1 -- 172.21.15.100:0/2183211871 shutdown_connections 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.209+0000 7f4ba5b03640 1 -- 172.21.15.100:0/2183211871 wait complete. 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.210+0000 7f4ba5b03640 1 Processor -- start 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.211+0000 7f4ba5b03640 1 -- start start 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.212+0000 7f4ba5b03640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ba00b4cb0 0x7f4ba00c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.212+0000 7f4ba5b03640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba00b5090 0x7f4ba01622f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.212+0000 7f4ba5b03640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ba00c5f40 0x7f4ba0150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.212+0000 7f4ba5b03640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba0163170 con 0x7f4ba00b5090 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.212+0000 7f4ba5b03640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba015fbe0 con 0x7f4ba00c5f40 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.212+0000 7f4ba5b03640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4ba00c69d0 con 0x7f4ba00b4cb0 2024-09-11T22:31:45.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.212+0000 7f4b9f7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ba00b4cb0 0x7f4ba00c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.212+0000 7f4b9f7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ba00b4cb0 0x7f4ba00c9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:51226/0 (socket says 172.21.15.100:51226) 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.212+0000 7f4b9f7fe640 1 -- 172.21.15.100:0/3263622 learned_addr learned my addr 172.21.15.100:0/3263622 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.212+0000 7f4b9effd640 1 --2- 172.21.15.100:0/3263622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba00b5090 0x7f4ba01622f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.213+0000 7f4b9ffff640 1 --2- 172.21.15.100:0/3263622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ba00c5f40 0x7f4ba0150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.213+0000 7f4b9f7fe640 1 -- 172.21.15.100:0/3263622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ba00c5f40 msgr2=0x7f4ba0150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.213+0000 7f4b9f7fe640 1 --2- 172.21.15.100:0/3263622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ba00c5f40 0x7f4ba0150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.213+0000 7f4b9f7fe640 1 -- 172.21.15.100:0/3263622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba00b5090 msgr2=0x7f4ba01622f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.213+0000 7f4b9f7fe640 1 --2- 172.21.15.100:0/3263622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba00b5090 0x7f4ba01622f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.213+0000 7f4b9f7fe640 1 -- 172.21.15.100:0/3263622 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba00c8ec0 con 0x7f4ba00b4cb0 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.213+0000 7f4b9effd640 1 --2- 172.21.15.100:0/3263622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ba00b5090 0x7f4ba01622f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.214+0000 7f4b9f7fe640 1 --2- 172.21.15.100:0/3263622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ba00b4cb0 0x7f4ba00c9690 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c00d830 tx=0x7f4b8c00dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.214+0000 7f4b97fff640 1 -- 172.21.15.100:0/3263622 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c018020 con 0x7f4ba00b4cb0 2024-09-11T22:31:45.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.214+0000 7f4b97fff640 1 -- 172.21.15.100:0/3263622 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b8c0096a0 con 0x7f4ba00b4cb0 2024-09-11T22:31:45.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.214+0000 7f4b97fff640 1 -- 172.21.15.100:0/3263622 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c009a70 con 0x7f4ba00b4cb0 2024-09-11T22:31:45.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.214+0000 7f4ba5b03640 1 -- 172.21.15.100:0/3263622 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba00c9180 con 0x7f4ba00b4cb0 2024-09-11T22:31:45.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.214+0000 7f4ba5b03640 1 -- 172.21.15.100:0/3263622 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba015e920 con 0x7f4ba00b4cb0 2024-09-11T22:31:45.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.218+0000 7f4ba5b03640 1 --2- 172.21.15.100:0/3263622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b7c002a70 0x7f4b7c004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.218+0000 7f4ba5b03640 1 -- 172.21.15.100:0/3263622 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4b7c007ec0 con 0x7f4b7c002a70 2024-09-11T22:31:45.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.220+0000 7f4b9effd640 1 --2- 172.21.15.100:0/3263622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b7c002a70 0x7f4b7c004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.221+0000 7f4b97fff640 1 -- 172.21.15.100:0/3263622 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4b8c01b020 con 0x7f4ba00b4cb0 2024-09-11T22:31:45.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.222+0000 7f4b97fff640 1 --2- 172.21.15.100:0/3263622 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4b8806bf00 0x7f4b8806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.222+0000 7f4b97fff640 1 -- 172.21.15.100:0/3263622 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f4b8c08b3b0 con 0x7f4ba00b4cb0 2024-09-11T22:31:45.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.225+0000 7f4b9effd640 1 -- 172.21.15.100:0/3263622 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4b7c0080c0 con 0x7f4b7c002a70 2024-09-11T22:31:45.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.225+0000 7f4b9ffff640 1 --2- 172.21.15.100:0/3263622 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4b8806bf00 0x7f4b8806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.225+0000 7f4b9effd640 1 --2- 172.21.15.100:0/3263622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b7c002a70 0x7f4b7c004f30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00cdc00 tx=0x7f4b900046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:45.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.226+0000 7f4b9ffff640 1 --2- 172.21.15.100:0/3263622 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4b8806bf00 0x7f4b8806e3c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00c63f0 tx=0x7f4b9800d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:45.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.229+0000 7f4b97fff640 1 -- 172.21.15.100:0/3263622 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90042070 con 0x7f4b7c002a70 2024-09-11T22:31:45.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.229+0000 7f4b97fff640 1 -- 172.21.15.100:0/3263622 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4b90030a00 con 0x7f4b7c002a70 2024-09-11T22:31:45.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.229+0000 7f4b97fff640 1 -- 172.21.15.100:0/3263622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b7c002a70 msgr2=0x7f4b7c004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:45.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.229+0000 7f4b97fff640 1 --2- 172.21.15.100:0/3263622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b7c002a70 0x7f4b7c004f30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00cdc00 tx=0x7f4b900046c0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.229+0000 7f4b97fff640 1 -- 172.21.15.100:0/3263622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b7c002a70 msgr2=0x7f4b7c004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:31:45.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.229+0000 7f4b97fff640 1 --2- 172.21.15.100:0/3263622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b7c002a70 0x7f4b7c004f30 secure :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00cdc00 tx=0x7f4b900046c0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.250+0000 7f4ba5b03640 1 --2- 172.21.15.100:0/3263622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b7c006f00 0x7f4b7c007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.251+0000 7f4ba5b03640 1 -- 172.21.15.100:0/3263622 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f4b7c00a4a0 con 0x7f4b7c006f00 2024-09-11T22:31:45.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.251+0000 7f4b9effd640 1 --2- 172.21.15.100:0/3263622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b7c006f00 0x7f4b7c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.252+0000 7f4b9effd640 1 -- 172.21.15.100:0/3263622 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4b7c0078d0 con 0x7f4b7c006f00 2024-09-11T22:31:45.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.252+0000 7f4b9effd640 1 --2- 172.21.15.100:0/3263622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b7c006f00 0x7f4b7c007390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c008090 tx=0x7f4b90009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:45.258 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:31:45.258 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:31:45.259 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:31:45.259 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:31:45.259 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 82, 2024-09-11T22:31:45.259 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 595975, 2024-09-11T22:31:45.259 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:31:45.259 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:31:45.259 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:31:45.259 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:31:45.259 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:45.259 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 13, 2024-09-11T22:31:45.259 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:31:45.259 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:31:45.259 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:31:45.260 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:31:45.260 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:31:45.260 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:31:45.260 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:31:45.260 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:31:45.260 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:31:45.260 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:31:45.260 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:31:45.260 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:31:45.260 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:31:45.260 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:31:45.260 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:45.260 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:31:45.261 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:31:45.261 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:31:45.261 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:31:45.261 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:31:45.261 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:31:45.261 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:31:45.261 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:31:45.261 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:31:45.261 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:31:45.261 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:31:45.261 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:31:45.261 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:31:45.261 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:45.261 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:45.262 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:31:45.262 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:31:45.262 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:31:45.262 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:31:45.262 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:31:45.262 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:31:45.262 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:31:45.262 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:31:45.262 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:31:45.262 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:31:45.262 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:31:45.262 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:31:45.262 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:31:45.262 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:31:45.263 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:31:45.263 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:31:45.263 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:31:45.263 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:31:45.263 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:31:45.263 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:31:45.263 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:31:45.263 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:31:45.263 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:31:45.263 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:31:45.263 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:31:45.263 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:31:45.263 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:31:45.263 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:31:45.264 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:45.264 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:31:45.264 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:45.264 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:31:45.264 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:45.264 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:31:45.264 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:31:45.264 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:31:45.264 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:31:45.264 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:45.264 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:31:45.264 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:31:45.264 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:45.265 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:45.265 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:45.265 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:31:45.265 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:31:45.265 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:45.265 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:45.265 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:45.265 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:45.265 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:31:45.265 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:31:45.265 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:31:45.265 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:31:45.265 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:31:45.266 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:45.266 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:45.266 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:31:45.266 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:31:45.266 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:31:45.266 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:31:45.266 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:45.266 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:31:45.266 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:31:45.266 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:45.266 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:45.266 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:45.266 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:31:45.267 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:31:45.267 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:45.267 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:45.267 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:45.267 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:45.267 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:31:45.267 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:31:45.267 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:31:45.267 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:31:45.267 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:31:45.267 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:45.267 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:45.267 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:31:45.267 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:31:45.268 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:31:45.268 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:31:45.268 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:45.268 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:31:45.268 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:31:45.268 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:45.268 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:45.268 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:45.268 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:31:45.268 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:31:45.268 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:31:45.268 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:45.268 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:45.269 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:45.269 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:31:45.269 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:31:45.269 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:31:45.269 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:31:45.269 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:31:45.269 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:45.269 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:45.269 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:45.269 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:31:45.269 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:31:45.269 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:45.270 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:31:45.270 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:31:45.270 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:31:45.270 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:45.270 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:45.270 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:31:45.270 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:45.270 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:31:45.270 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:31:45.270 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:31:45.270 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:45.270 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:45.270 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:31:45.270 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:45.271 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:31:45.271 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:31:45.271 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:31:45.271 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:45.271 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:45.271 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:31:45.271 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:45.271 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:31:45.271 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:31:45.271 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 6 2024-09-11T22:31:45.271 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:45.271 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:31:45.271 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:31:45.271 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:31:45.272 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:31:45.272 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:31:45.272 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:31:45.272 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:31:45.272 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:31:45.272 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:31:45.272 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:31:45.273 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:31:45.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.257+0000 7f4b97fff640 1 -- 172.21.15.100:0/3263622 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90037040 con 0x7f4b7c006f00 2024-09-11T22:31:45.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.257+0000 7f4b97fff640 1 -- 172.21.15.100:0/3263622 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7f4b90003aa0 con 0x7f4b7c006f00 2024-09-11T22:31:45.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.257+0000 7f4b97fff640 1 -- 172.21.15.100:0/3263622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b7c006f00 msgr2=0x7f4b7c007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:45.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.257+0000 7f4b97fff640 1 --2- 172.21.15.100:0/3263622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b7c006f00 0x7f4b7c007390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c008090 tx=0x7f4b90009240 comp rx=0 tx=0).stop 2024-09-11T22:31:45.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.257+0000 7f4b97fff640 1 -- 172.21.15.100:0/3263622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b7c006f00 msgr2=0x7f4b7c007390 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:31:45.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.257+0000 7f4b97fff640 1 --2- 172.21.15.100:0/3263622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b7c006f00 0x7f4b7c007390 secure :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c008090 tx=0x7f4b90009240 comp rx=0 tx=0).stop 2024-09-11T22:31:45.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.259+0000 7f4ba5b03640 1 -- 172.21.15.100:0/3263622 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4b8806bf00 msgr2=0x7f4b8806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:45.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.259+0000 7f4ba5b03640 1 --2- 172.21.15.100:0/3263622 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f4b8806bf00 0x7f4b8806e3c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00c63f0 tx=0x7f4b9800d040 comp rx=0 tx=0).stop 2024-09-11T22:31:45.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.259+0000 7f4ba5b03640 1 -- 172.21.15.100:0/3263622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ba00b4cb0 msgr2=0x7f4ba00c9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:45.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.259+0000 7f4ba5b03640 1 --2- 172.21.15.100:0/3263622 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ba00b4cb0 0x7f4ba00c9690 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c00d830 tx=0x7f4b8c00dcf0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.259+0000 7f4b9ffff640 1 -- 172.21.15.100:0/3263622 reap_dead start 2024-09-11T22:31:45.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.259+0000 7f4b9ffff640 1 -- 172.21.15.100:0/3263622 reap_dead start 2024-09-11T22:31:45.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.259+0000 7f4ba5b03640 1 -- 172.21.15.100:0/3263622 shutdown_connections 2024-09-11T22:31:45.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.259+0000 7f4ba5b03640 1 -- 172.21.15.100:0/3263622 >> 172.21.15.100:0/3263622 conn(0x7f4ba006bc10 msgr2=0x7f4ba0157260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:45.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.260+0000 7f4ba5b03640 1 -- 172.21.15.100:0/3263622 shutdown_connections 2024-09-11T22:31:45.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.260+0000 7f4ba5b03640 1 -- 172.21.15.100:0/3263622 wait complete. 2024-09-11T22:31:45.294 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:31:45.294 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-11T22:31:45.294 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-11T22:31:45.294 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-11T22:31:45.295 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:31:45.295 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T22:31:45.295 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:31:45.320 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T22:31:45.320 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-11T22:31:45.320 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:31:45.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.549+0000 7feed93cf640 1 Processor -- start 2024-09-11T22:31:45.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.549+0000 7feed93cf640 1 -- start start 2024-09-11T22:31:45.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.551+0000 7feed93cf640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feed40c7b60 0x7feed40b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.551+0000 7feed93cf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feed40c7f40 0x7feed406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.551+0000 7feed93cf640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feed408c380 0x7feed40c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.551+0000 7feed93cf640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7feed416b510 con 0x7feed408c380 2024-09-11T22:31:45.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.551+0000 7feed93cf640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7feed416b7f0 con 0x7feed40c7b60 2024-09-11T22:31:45.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.551+0000 7feed93cf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7feed40c26b0 con 0x7feed40c7f40 2024-09-11T22:31:45.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.551+0000 7feed37fe640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7feed408c380 msgr2=0x7feed40c2d20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:31:45.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.551+0000 7feed37fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feed408c380 0x7feed40c2d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:31:45.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.551+0000 7feed2ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feed40c7b60 0x7feed40b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.551+0000 7feed2ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7feed40c7b60 0x7feed40b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:49504/0 (socket says 172.21.15.100:49504) 2024-09-11T22:31:45.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.551+0000 7feed2ffd640 1 -- 172.21.15.100:0/2288239714 learned_addr learned my addr 172.21.15.100:0/2288239714 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:31:45.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.551+0000 7feed27fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feed40c7f40 0x7feed406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.551+0000 7feed2ffd640 1 -- 172.21.15.100:0/2288239714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feed40c7f40 msgr2=0x7feed406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:45.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.552+0000 7feed2ffd640 1 --2- 172.21.15.100:0/2288239714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feed40c7f40 0x7feed406c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.552+0000 7feed2ffd640 1 -- 172.21.15.100:0/2288239714 >> v2:172.21.15.100:3300/0 conn(0x7feed408c380 msgr2=0x7feed40c2d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:31:45.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.552+0000 7feed2ffd640 1 --2- 172.21.15.100:0/2288239714 >> v2:172.21.15.100:3300/0 conn(0x7feed408c380 0x7feed40c2d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.552+0000 7feed2ffd640 1 -- 172.21.15.100:0/2288239714 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed40c2990 con 0x7feed40c7b60 2024-09-11T22:31:45.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.554+0000 7feed2ffd640 1 --2- 172.21.15.100:0/2288239714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feed40c7b60 0x7feed40b1da0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7feed4071170 tx=0x7feec400a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=496560329788f7fb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:45.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.559+0000 7feed1ffb640 1 -- 172.21.15.100:0/2288239714 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec4030070 con 0x7feed40c7b60 2024-09-11T22:31:45.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.559+0000 7feed1ffb640 1 -- 172.21.15.100:0/2288239714 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feec4034600 con 0x7feed40c7b60 2024-09-11T22:31:45.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.560+0000 7feed93cf640 1 -- 172.21.15.100:0/2288239714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feed40c7b60 msgr2=0x7feed40b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:45.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.560+0000 7feed93cf640 1 --2- 172.21.15.100:0/2288239714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feed40c7b60 0x7feed40b1da0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7feed4071170 tx=0x7feec400a3f0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.560+0000 7feed93cf640 1 -- 172.21.15.100:0/2288239714 shutdown_connections 2024-09-11T22:31:45.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.560+0000 7feed93cf640 1 --2- 172.21.15.100:0/2288239714 >> v2:172.21.15.100:3300/0 conn(0x7feed408c380 0x7feed40c2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.560+0000 7feed93cf640 1 --2- 172.21.15.100:0/2288239714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feed40c7f40 0x7feed406c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.560+0000 7feed93cf640 1 --2- 172.21.15.100:0/2288239714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feed40c7b60 0x7feed40b1da0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.560+0000 7feed93cf640 1 -- 172.21.15.100:0/2288239714 >> 172.21.15.100:0/2288239714 conn(0x7feed40c89e0 msgr2=0x7feed40c8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:45.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.560+0000 7feed93cf640 1 -- 172.21.15.100:0/2288239714 shutdown_connections 2024-09-11T22:31:45.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.560+0000 7feed93cf640 1 -- 172.21.15.100:0/2288239714 wait complete. 2024-09-11T22:31:45.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.562+0000 7feed93cf640 1 Processor -- start 2024-09-11T22:31:45.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.562+0000 7feed93cf640 1 -- start start 2024-09-11T22:31:45.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.563+0000 7feed93cf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feed408c380 0x7feed415c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.563+0000 7feed93cf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feed40c7b60 0x7feed415caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.563+0000 7feed93cf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feed40c7f40 0x7feed415e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.563+0000 7feed93cf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7feed4167880 con 0x7feed40c7b60 2024-09-11T22:31:45.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.563+0000 7feed93cf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7feed4167700 con 0x7feed408c380 2024-09-11T22:31:45.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.563+0000 7feed93cf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7feed4167a00 con 0x7feed40c7f40 2024-09-11T22:31:45.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.563+0000 7feed27fc640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feed40c7b60 msgr2=0x7feed415caa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:31:45.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.563+0000 7feed27fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feed40c7b60 0x7feed415caa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:31:45.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.564+0000 7feed37fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feed40c7f40 0x7feed415e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.566+0000 7feed2ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feed408c380 0x7feed415c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.566+0000 7feed37fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feed40c7f40 0x7feed415e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:51266/0 (socket says 172.21.15.100:51266) 2024-09-11T22:31:45.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.566+0000 7feed37fe640 1 -- 172.21.15.100:0/3818153285 learned_addr learned my addr 172.21.15.100:0/3818153285 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:31:45.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.571+0000 7feed2ffd640 1 -- 172.21.15.100:0/3818153285 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feed40c7f40 msgr2=0x7feed415e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:45.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.571+0000 7feed2ffd640 1 --2- 172.21.15.100:0/3818153285 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feed40c7f40 0x7feed415e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.571+0000 7feed2ffd640 1 -- 172.21.15.100:0/3818153285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feed40c7b60 msgr2=0x7feed415caa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:31:45.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.571+0000 7feed2ffd640 1 --2- 172.21.15.100:0/3818153285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feed40c7b60 0x7feed415caa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:45.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.571+0000 7feed2ffd640 1 -- 172.21.15.100:0/3818153285 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed40c4e10 con 0x7feed408c380 2024-09-11T22:31:45.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.571+0000 7feed2ffd640 1 --2- 172.21.15.100:0/3818153285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feed408c380 0x7feed415c560 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7feed416b970 tx=0x7feec40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:45.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.571+0000 7feebb7fe640 1 -- 172.21.15.100:0/3818153285 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec4043020 con 0x7feed408c380 2024-09-11T22:31:45.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.571+0000 7feed93cf640 1 -- 172.21.15.100:0/3818153285 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feed40c50d0 con 0x7feed408c380 2024-09-11T22:31:45.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.571+0000 7feed93cf640 1 -- 172.21.15.100:0/3818153285 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feed40c5690 con 0x7feed408c380 2024-09-11T22:31:45.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.572+0000 7feebb7fe640 1 -- 172.21.15.100:0/3818153285 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feec4003820 con 0x7feed408c380 2024-09-11T22:31:45.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.572+0000 7feebb7fe640 1 -- 172.21.15.100:0/3818153285 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec4003bf0 con 0x7feed408c380 2024-09-11T22:31:45.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.576+0000 7feebb7fe640 1 -- 172.21.15.100:0/3818153285 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feec4046020 con 0x7feed408c380 2024-09-11T22:31:45.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.576+0000 7feebb7fe640 1 --2- 172.21.15.100:0/3818153285 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7feec006be30 0x7feec006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:45.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.577+0000 7feed93cf640 1 -- 172.21.15.100:0/3818153285 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeb4005290 con 0x7feed408c380 2024-09-11T22:31:45.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.578+0000 7feebb7fe640 1 -- 172.21.15.100:0/3818153285 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7feec40abe40 con 0x7feed408c380 2024-09-11T22:31:45.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.580+0000 7feed27fc640 1 --2- 172.21.15.100:0/3818153285 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7feec006be30 0x7feec006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:45.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.581+0000 7feed27fc640 1 --2- 172.21.15.100:0/3818153285 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7feec006be30 0x7feec006e2f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7feecc00db30 tx=0x7feecc00f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:45.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:45.590+0000 7feebb7fe640 1 -- 172.21.15.100:0/3818153285 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feec407a3b0 con 0x7feed408c380 2024-09-11T22:31:46.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:46.143+0000 7feed93cf640 1 -- 172.21.15.100:0/3818153285 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7feeb4005580 con 0x7feed408c380 2024-09-11T22:31:46.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:46.148+0000 7feebb7fe640 1 -- 172.21.15.100:0/3818153285 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7feec4079cb0 con 0x7feed408c380 2024-09-11T22:31:46.150 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":82,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:31:46.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:46.153+0000 7feed93cf640 1 -- 172.21.15.100:0/3818153285 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7feec006be30 msgr2=0x7feec006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:46.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:46.153+0000 7feed93cf640 1 --2- 172.21.15.100:0/3818153285 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7feec006be30 0x7feec006e2f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7feecc00db30 tx=0x7feecc00f040 comp rx=0 tx=0).stop 2024-09-11T22:31:46.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:46.153+0000 7feed93cf640 1 -- 172.21.15.100:0/3818153285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feed408c380 msgr2=0x7feed415c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:46.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:46.153+0000 7feed93cf640 1 --2- 172.21.15.100:0/3818153285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feed408c380 0x7feed415c560 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7feed416b970 tx=0x7feec40046c0 comp rx=0 tx=0).stop 2024-09-11T22:31:46.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:46.155+0000 7feed93cf640 1 -- 172.21.15.100:0/3818153285 shutdown_connections 2024-09-11T22:31:46.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:46.155+0000 7feed93cf640 1 --2- 172.21.15.100:0/3818153285 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7feec006be30 0x7feec006e2f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:46.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:46.155+0000 7feed93cf640 1 --2- 172.21.15.100:0/3818153285 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feed40c7f40 0x7feed415e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:46.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:46.155+0000 7feed93cf640 1 --2- 172.21.15.100:0/3818153285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feed40c7b60 0x7feed415caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:46.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:46.155+0000 7feed93cf640 1 --2- 172.21.15.100:0/3818153285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feed408c380 0x7feed415c560 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:46.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:46.156+0000 7feed93cf640 1 -- 172.21.15.100:0/3818153285 >> 172.21.15.100:0/3818153285 conn(0x7feed40c89e0 msgr2=0x7feed4165120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:46.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:46.156+0000 7feed93cf640 1 -- 172.21.15.100:0/3818153285 shutdown_connections 2024-09-11T22:31:46.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:46.156+0000 7feed93cf640 1 -- 172.21.15.100:0/3818153285 wait complete. 2024-09-11T22:31:49.183 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:31:49.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.388+0000 7fac072a6640 1 Processor -- start 2024-09-11T22:31:49.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.392+0000 7fac072a6640 1 -- start start 2024-09-11T22:31:49.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.393+0000 7fac072a6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fac000c8590 0x7fac001625e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:49.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.393+0000 7fac072a6640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac000b2100 con 0x7fac001511e0 2024-09-11T22:31:49.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.393+0000 7fac072a6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac000b1860 con 0x7fac00071780 2024-09-11T22:31:49.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.393+0000 7fac072a6640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fac000b1b40 con 0x7fac000c8590 2024-09-11T22:31:49.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.393+0000 7fac05042640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7fac001511e0 legacy=0x7fac001573b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:31:49.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.393+0000 7fac05843640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7fac000c8590 msgr2=0x7fac001625e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:31:49.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.393+0000 7fac05843640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fac000c8590 0x7fac001625e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:31:49.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.395+0000 7fac04841640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fac00071780 0x7fac0006d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:46146/0 (socket says 172.21.15.100:46146) 2024-09-11T22:31:49.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.395+0000 7fac04841640 1 -- 172.21.15.100:0/995674933 learned_addr learned my addr 172.21.15.100:0/995674933 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:31:49.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.396+0000 7fabf7fff640 1 -- 172.21.15.100:0/995674933 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3947063660 0 0) 0x7fac000b1860 con 0x7fac00071780 2024-09-11T22:31:49.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.396+0000 7fabf7fff640 1 -- 172.21.15.100:0/995674933 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabec003440 con 0x7fac00071780 2024-09-11T22:31:49.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.396+0000 7fabf7fff640 1 -- 172.21.15.100:0/995674933 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2056341681 0 0) 0x7fabec003440 con 0x7fac00071780 2024-09-11T22:31:49.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.396+0000 7fabf7fff640 1 -- 172.21.15.100:0/995674933 >> v2:172.21.15.100:3300/0 conn(0x7fac000c8590 msgr2=0x7fac001625e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:31:49.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.396+0000 7fabf7fff640 1 --2- 172.21.15.100:0/995674933 >> v2:172.21.15.100:3300/0 conn(0x7fac000c8590 0x7fac001625e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:49.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.396+0000 7fabf7fff640 1 -- 172.21.15.100:0/995674933 >> v1:172.21.15.100:6789/0 conn(0x7fac001511e0 legacy=0x7fac001573b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:31:49.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.396+0000 7fabf7fff640 1 -- 172.21.15.100:0/995674933 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac000b1e20 con 0x7fac00071780 2024-09-11T22:31:49.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.396+0000 7fabf7fff640 1 -- 172.21.15.100:0/995674933 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fabf80019f0 con 0x7fac00071780 2024-09-11T22:31:49.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.397+0000 7fabf7fff640 1 -- 172.21.15.100:0/995674933 >> v1:172.21.15.167:6789/0 conn(0x7fac00071780 legacy=0x7fac0006d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:49.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.397+0000 7fabf7fff640 1 --2- 172.21.15.100:0/995674933 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabec003aa0 0x7fabec003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:49.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.397+0000 7fabf7fff640 1 --2- 172.21.15.100:0/995674933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabec0089a0 0x7fabec00ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:49.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.397+0000 7fac04841640 1 -- 172.21.15.100:0/995674933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabec0089a0 msgr2=0x7fabec00ae30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:31:49.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.397+0000 7fac04841640 1 --2- 172.21.15.100:0/995674933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabec0089a0 0x7fabec00ae30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:31:49.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.397+0000 7fac05042640 1 --2- 172.21.15.100:0/995674933 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabec003aa0 0x7fabec003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:49.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.397+0000 7fabf7fff640 1 --2- 172.21.15.100:0/995674933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabec00b630 0x7fabec00daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:49.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.397+0000 7fabf7fff640 1 -- 172.21.15.100:0/995674933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fac000b1b40 con 0x7fabec0089a0 2024-09-11T22:31:49.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.397+0000 7fabf7fff640 1 -- 172.21.15.100:0/995674933 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fabec00e3c0 con 0x7fabec00b630 2024-09-11T22:31:49.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.397+0000 7fabf7fff640 1 -- 172.21.15.100:0/995674933 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fabec00e5c0 con 0x7fabec003aa0 2024-09-11T22:31:49.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.397+0000 7fac05843640 1 --2- 172.21.15.100:0/995674933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabec00b630 0x7fabec00daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:49.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.398+0000 7fac05843640 1 -- 172.21.15.100:0/995674933 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabec003aa0 msgr2=0x7fabec003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:49.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.398+0000 7fac05843640 1 --2- 172.21.15.100:0/995674933 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabec003aa0 0x7fabec003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:49.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.398+0000 7fac05843640 1 -- 172.21.15.100:0/995674933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabec0089a0 msgr2=0x7fabec00ae30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:31:49.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.398+0000 7fac05843640 1 --2- 172.21.15.100:0/995674933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabec0089a0 0x7fabec00ae30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:49.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.398+0000 7fac05843640 1 -- 172.21.15.100:0/995674933 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabec003440 con 0x7fabec00b630 2024-09-11T22:31:49.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.399+0000 7fac05843640 1 -- 172.21.15.100:0/995674933 reap_dead start 2024-09-11T22:31:49.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.402+0000 7fac05843640 1 --2- 172.21.15.100:0/995674933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabec00b630 0x7fabec00daf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fabfc009830 tx=0x7fabec003730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be199ad08da2839a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:49.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.403+0000 7fabf7fff640 1 -- 172.21.15.100:0/995674933 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc009430 con 0x7fabec00b630 2024-09-11T22:31:49.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.404+0000 7fabf7fff640 1 -- 172.21.15.100:0/995674933 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabfc02e070 con 0x7fabec00b630 2024-09-11T22:31:49.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.405+0000 7fac072a6640 1 -- 172.21.15.100:0/995674933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabec00b630 msgr2=0x7fabec00daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:49.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.405+0000 7fac072a6640 1 --2- 172.21.15.100:0/995674933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabec00b630 0x7fabec00daf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fabfc009830 tx=0x7fabec003730 comp rx=0 tx=0).stop 2024-09-11T22:31:49.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.406+0000 7fac072a6640 1 -- 172.21.15.100:0/995674933 shutdown_connections 2024-09-11T22:31:49.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.406+0000 7fac072a6640 1 --2- 172.21.15.100:0/995674933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabec00b630 0x7fabec00daf0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:49.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.406+0000 7fac072a6640 1 -- 172.21.15.100:0/995674933 >> 172.21.15.100:0/995674933 conn(0x7fac000cbf70 msgr2=0x7fac000cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:49.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.408+0000 7fac072a6640 1 -- 172.21.15.100:0/995674933 shutdown_connections 2024-09-11T22:31:49.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.411+0000 7fac072a6640 1 -- 172.21.15.100:0/995674933 wait complete. 2024-09-11T22:31:49.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.413+0000 7fac072a6640 1 Processor -- start 2024-09-11T22:31:49.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.413+0000 7fac072a6640 1 -- start start 2024-09-11T22:31:49.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.414+0000 7fac072a6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabec00b630 0x7fac00152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:49.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.414+0000 7fac072a6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac001563f0 0x7fac001536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:49.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.414+0000 7fac072a6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac00073a80 0x7fac00151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:49.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.414+0000 7fac072a6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fac000c1110 con 0x7fac001563f0 2024-09-11T22:31:49.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.414+0000 7fac072a6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fac000c0f90 con 0x7fac00073a80 2024-09-11T22:31:49.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.414+0000 7fac072a6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fac0006bc10 con 0x7fabec00b630 2024-09-11T22:31:49.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.415+0000 7fac04841640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac001563f0 msgr2=0x7fac001536d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:31:49.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.415+0000 7fac04841640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac001563f0 0x7fac001536d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:31:49.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.415+0000 7fac05843640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac00073a80 0x7fac00151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:49.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.415+0000 7fac05042640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabec00b630 0x7fac00152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:49.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.415+0000 7fac05843640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac00073a80 0x7fac00151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:49540/0 (socket says 172.21.15.100:49540) 2024-09-11T22:31:49.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.415+0000 7fac05843640 1 -- 172.21.15.100:0/3760502630 learned_addr learned my addr 172.21.15.100:0/3760502630 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:31:49.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.416+0000 7fac05843640 1 -- 172.21.15.100:0/3760502630 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabec00b630 msgr2=0x7fac00152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:49.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.416+0000 7fac05843640 1 --2- 172.21.15.100:0/3760502630 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabec00b630 0x7fac00152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:49.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.416+0000 7fac05843640 1 -- 172.21.15.100:0/3760502630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac001563f0 msgr2=0x7fac001536d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:31:49.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.416+0000 7fac05843640 1 --2- 172.21.15.100:0/3760502630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac001563f0 0x7fac001536d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:49.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.416+0000 7fac05843640 1 -- 172.21.15.100:0/3760502630 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac000c7880 con 0x7fac00073a80 2024-09-11T22:31:49.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.418+0000 7fac05843640 1 --2- 172.21.15.100:0/3760502630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac00073a80 0x7fac00151710 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fabfc009920 tx=0x7fabfc005940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:49.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.418+0000 7fabf5ffb640 1 -- 172.21.15.100:0/3760502630 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc005540 con 0x7fac00073a80 2024-09-11T22:31:49.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.418+0000 7fac072a6640 1 -- 172.21.15.100:0/3760502630 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac000c7b60 con 0x7fac00073a80 2024-09-11T22:31:49.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.419+0000 7fac072a6640 1 -- 172.21.15.100:0/3760502630 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac000c5770 con 0x7fac00073a80 2024-09-11T22:31:49.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.419+0000 7fabf5ffb640 1 -- 172.21.15.100:0/3760502630 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabfc041070 con 0x7fac00073a80 2024-09-11T22:31:49.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.419+0000 7fabf5ffb640 1 -- 172.21.15.100:0/3760502630 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc033470 con 0x7fac00073a80 2024-09-11T22:31:49.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.422+0000 7fabf5ffb640 1 -- 172.21.15.100:0/3760502630 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fabfc03b070 con 0x7fac00073a80 2024-09-11T22:31:49.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.422+0000 7fabf5ffb640 1 --2- 172.21.15.100:0/3760502630 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fabe406be10 0x7fabe406e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:49.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.424+0000 7fac05042640 1 --2- 172.21.15.100:0/3760502630 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fabe406be10 0x7fabe406e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:49.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.425+0000 7fac05042640 1 --2- 172.21.15.100:0/3760502630 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fabe406be10 0x7fabe406e2d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fabf0003950 tx=0x7fabf0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:49.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.425+0000 7fabf5ffb640 1 -- 172.21.15.100:0/3760502630 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fabfc0aad30 con 0x7fac00073a80 2024-09-11T22:31:49.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.426+0000 7fac072a6640 1 -- 172.21.15.100:0/3760502630 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabe0005290 con 0x7fac00073a80 2024-09-11T22:31:49.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.432+0000 7fabf5ffb640 1 -- 172.21.15.100:0/3760502630 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fabfc04a020 con 0x7fac00073a80 2024-09-11T22:31:49.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.934+0000 7fac072a6640 1 -- 172.21.15.100:0/3760502630 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fabe0005580 con 0x7fac00073a80 2024-09-11T22:31:49.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.935+0000 7fabf5ffb640 1 -- 172.21.15.100:0/3760502630 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fabfc039040 con 0x7fac00073a80 2024-09-11T22:31:49.942 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":82,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:31:49.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.941+0000 7fac072a6640 1 -- 172.21.15.100:0/3760502630 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fabe406be10 msgr2=0x7fabe406e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:49.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.941+0000 7fac072a6640 1 --2- 172.21.15.100:0/3760502630 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fabe406be10 0x7fabe406e2d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fabf0003950 tx=0x7fabf0008040 comp rx=0 tx=0).stop 2024-09-11T22:31:49.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.941+0000 7fac072a6640 1 -- 172.21.15.100:0/3760502630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac00073a80 msgr2=0x7fac00151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:49.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.941+0000 7fac072a6640 1 --2- 172.21.15.100:0/3760502630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac00073a80 0x7fac00151710 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fabfc009920 tx=0x7fabfc005940 comp rx=0 tx=0).stop 2024-09-11T22:31:49.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.942+0000 7fac072a6640 1 -- 172.21.15.100:0/3760502630 shutdown_connections 2024-09-11T22:31:49.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.942+0000 7fac072a6640 1 --2- 172.21.15.100:0/3760502630 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fabe406be10 0x7fabe406e2d0 secure :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fabf0003950 tx=0x7fabf0008040 comp rx=0 tx=0).stop 2024-09-11T22:31:49.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.942+0000 7fac072a6640 1 --2- 172.21.15.100:0/3760502630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac00073a80 0x7fac00151710 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:49.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.942+0000 7fac072a6640 1 --2- 172.21.15.100:0/3760502630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac001563f0 0x7fac001536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:49.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.942+0000 7fac072a6640 1 --2- 172.21.15.100:0/3760502630 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fabec00b630 0x7fac00152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:49.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.942+0000 7fac072a6640 1 -- 172.21.15.100:0/3760502630 >> 172.21.15.100:0/3760502630 conn(0x7fac000cbf70 msgr2=0x7fac0014cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:49.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.944+0000 7fac072a6640 1 -- 172.21.15.100:0/3760502630 shutdown_connections 2024-09-11T22:31:49.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:49.944+0000 7fac072a6640 1 -- 172.21.15.100:0/3760502630 wait complete. 2024-09-11T22:31:52.792 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:31:52.797 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:31:52.964 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:31:53.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.152+0000 7fb09f02e640 1 Processor -- start 2024-09-11T22:31:53.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.152+0000 7fb09f02e640 1 -- start start 2024-09-11T22:31:53.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.153+0000 7fb09f02e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb098073a30 0x7fb09806c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:53.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.153+0000 7fb09f02e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb0980afc80 0x7fb09806c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:53.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.153+0000 7fb09f02e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb098151e90 con 0x7fb098151ab0 2024-09-11T22:31:53.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.153+0000 7fb09f02e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb098072f00 con 0x7fb098073a30 2024-09-11T22:31:53.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.153+0000 7fb09f02e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fb09806bc10 con 0x7fb0980afc80 2024-09-11T22:31:53.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.155+0000 7fb09cdca640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb098151ab0 0x7fb0980c39a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:38010/0 (socket says 172.21.15.100:38010) 2024-09-11T22:31:53.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.155+0000 7fb09cdca640 1 -- 172.21.15.100:0/2052850629 learned_addr learned my addr 172.21.15.100:0/2052850629 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:31:53.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.157+0000 7fb09d5cb640 1 --2- 172.21.15.100:0/2052850629 >> v2:172.21.15.167:3300/0 conn(0x7fb0980afc80 0x7fb09806c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:53.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.157+0000 7fb097fff640 1 -- 172.21.15.100:0/2052850629 >> v2:172.21.15.100:3300/0 conn(0x7fb098073a30 msgr2=0x7fb09806c380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:31:53.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.157+0000 7fb097fff640 1 --2- 172.21.15.100:0/2052850629 >> v2:172.21.15.100:3300/0 conn(0x7fb098073a30 0x7fb09806c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:31:53.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.161+0000 7fb09d5cb640 1 -- 172.21.15.100:0/2052850629 >> v2:172.21.15.100:3300/0 conn(0x7fb098073a30 msgr2=0x7fb09806c380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:31:53.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.161+0000 7fb09d5cb640 1 --2- 172.21.15.100:0/2052850629 >> v2:172.21.15.100:3300/0 conn(0x7fb098073a30 0x7fb09806c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:53.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.161+0000 7fb09d5cb640 1 -- 172.21.15.100:0/2052850629 >> v1:172.21.15.167:6789/0 conn(0x7fb098151ab0 legacy=0x7fb0980c39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:53.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.161+0000 7fb09d5cb640 1 -- 172.21.15.100:0/2052850629 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0981584c0 con 0x7fb0980afc80 2024-09-11T22:31:53.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.166+0000 7fb09d5cb640 1 --2- 172.21.15.100:0/2052850629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0980afc80 0x7fb09806c8c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb0980727d0 tx=0x7fb09002a630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8c2beca0fef4f19 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.171+0000 7fb0977fe640 1 -- 172.21.15.100:0/2052850629 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb090007740 con 0x7fb0980afc80 2024-09-11T22:31:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.171+0000 7fb0977fe640 1 -- 172.21.15.100:0/2052850629 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb09002ae50 con 0x7fb0980afc80 2024-09-11T22:31:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.172+0000 7fb09f02e640 1 -- 172.21.15.100:0/2052850629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0980afc80 msgr2=0x7fb09806c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:53.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.172+0000 7fb09f02e640 1 --2- 172.21.15.100:0/2052850629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0980afc80 0x7fb09806c8c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb0980727d0 tx=0x7fb09002a630 comp rx=0 tx=0).stop 2024-09-11T22:31:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.173+0000 7fb09f02e640 1 -- 172.21.15.100:0/2052850629 shutdown_connections 2024-09-11T22:31:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.173+0000 7fb09f02e640 1 --2- 172.21.15.100:0/2052850629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0980afc80 0x7fb09806c8c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.173+0000 7fb09f02e640 1 --2- 172.21.15.100:0/2052850629 >> v2:172.21.15.100:3300/0 conn(0x7fb098073a30 0x7fb09806c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.173+0000 7fb09f02e640 1 -- 172.21.15.100:0/2052850629 >> 172.21.15.100:0/2052850629 conn(0x7fb0980cd200 msgr2=0x7fb0980cd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.173+0000 7fb09f02e640 1 -- 172.21.15.100:0/2052850629 shutdown_connections 2024-09-11T22:31:53.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.173+0000 7fb09f02e640 1 -- 172.21.15.100:0/2052850629 wait complete. 2024-09-11T22:31:53.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.175+0000 7fb09f02e640 1 Processor -- start 2024-09-11T22:31:53.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.175+0000 7fb09f02e640 1 -- start start 2024-09-11T22:31:53.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.178+0000 7fb09f02e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb098073a30 0x7fb0980c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:53.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.178+0000 7fb09f02e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0980afc80 0x7fb098158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:53.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.178+0000 7fb09f02e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb098151ab0 0x7fb098159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:53.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.178+0000 7fb09f02e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb098073430 con 0x7fb0980afc80 2024-09-11T22:31:53.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.178+0000 7fb09f02e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb09806bef0 con 0x7fb098151ab0 2024-09-11T22:31:53.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.178+0000 7fb09f02e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb098158180 con 0x7fb098073a30 2024-09-11T22:31:53.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.179+0000 7fb09d5cb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb098151ab0 0x7fb098159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:53.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.179+0000 7fb09d5cb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb098151ab0 0x7fb098159990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:56174/0 (socket says 172.21.15.100:56174) 2024-09-11T22:31:53.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.179+0000 7fb09d5cb640 1 -- 172.21.15.100:0/1405709236 learned_addr learned my addr 172.21.15.100:0/1405709236 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:31:53.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.180+0000 7fb09d5cb640 1 -- 172.21.15.100:0/1405709236 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb098073a30 msgr2=0x7fb0980c5c50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:31:53.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.180+0000 7fb09d5cb640 1 --2- 172.21.15.100:0/1405709236 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb098073a30 0x7fb0980c5c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:53.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.180+0000 7fb09d5cb640 1 -- 172.21.15.100:0/1405709236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0980afc80 msgr2=0x7fb098158b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:31:53.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.180+0000 7fb09d5cb640 1 --2- 172.21.15.100:0/1405709236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0980afc80 0x7fb098158b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:53.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.180+0000 7fb09d5cb640 1 -- 172.21.15.100:0/1405709236 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb09814a0d0 con 0x7fb098151ab0 2024-09-11T22:31:53.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.181+0000 7fb09d5cb640 1 --2- 172.21.15.100:0/1405709236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb098151ab0 0x7fb098159990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb09002ac20 tx=0x7fb090004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:53.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.183+0000 7fb0957fa640 1 -- 172.21.15.100:0/1405709236 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb090040070 con 0x7fb098151ab0 2024-09-11T22:31:53.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.183+0000 7fb09f02e640 1 -- 172.21.15.100:0/1405709236 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb09814b6c0 con 0x7fb098151ab0 2024-09-11T22:31:53.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.183+0000 7fb0957fa640 1 -- 172.21.15.100:0/1405709236 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb09003c420 con 0x7fb098151ab0 2024-09-11T22:31:53.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.183+0000 7fb09f02e640 1 -- 172.21.15.100:0/1405709236 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb09814e3c0 con 0x7fb098151ab0 2024-09-11T22:31:53.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.183+0000 7fb0957fa640 1 -- 172.21.15.100:0/1405709236 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb090007740 con 0x7fb098151ab0 2024-09-11T22:31:53.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.185+0000 7fb09f02e640 1 -- 172.21.15.100:0/1405709236 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb098073ee0 con 0x7fb098151ab0 2024-09-11T22:31:53.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.188+0000 7fb0957fa640 1 -- 172.21.15.100:0/1405709236 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb090039040 con 0x7fb098151ab0 2024-09-11T22:31:53.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.188+0000 7fb0957fa640 1 --2- 172.21.15.100:0/1405709236 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb07806beb0 0x7fb07806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:53.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.188+0000 7fb0957fa640 1 -- 172.21.15.100:0/1405709236 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fb0900078e0 con 0x7fb098151ab0 2024-09-11T22:31:53.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.189+0000 7fb09cdca640 1 --2- 172.21.15.100:0/1405709236 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb07806beb0 0x7fb07806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:53.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.190+0000 7fb09cdca640 1 --2- 172.21.15.100:0/1405709236 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb07806beb0 0x7fb07806e370 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb0800015d0 tx=0x7fb080007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:53.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.193+0000 7fb0957fa640 1 -- 172.21.15.100:0/1405709236 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb098073ee0 con 0x7fb098151ab0 2024-09-11T22:31:53.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.683+0000 7fb09f02e640 1 -- 172.21.15.100:0/1405709236 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb0980c2220 con 0x7fb098151ab0 2024-09-11T22:31:53.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.689+0000 7fb0957fa640 1 -- 172.21.15.100:0/1405709236 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fb098073ee0 con 0x7fb098151ab0 2024-09-11T22:31:53.691 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":82,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:31:53.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.700+0000 7fb09f02e640 1 -- 172.21.15.100:0/1405709236 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb07806beb0 msgr2=0x7fb07806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:53.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.700+0000 7fb09f02e640 1 --2- 172.21.15.100:0/1405709236 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb07806beb0 0x7fb07806e370 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb0800015d0 tx=0x7fb080007a40 comp rx=0 tx=0).stop 2024-09-11T22:31:53.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.700+0000 7fb09f02e640 1 -- 172.21.15.100:0/1405709236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb098151ab0 msgr2=0x7fb098159990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:53.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.700+0000 7fb09f02e640 1 --2- 172.21.15.100:0/1405709236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb098151ab0 0x7fb098159990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb09002ac20 tx=0x7fb090004a40 comp rx=0 tx=0).stop 2024-09-11T22:31:53.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.700+0000 7fb09f02e640 1 -- 172.21.15.100:0/1405709236 shutdown_connections 2024-09-11T22:31:53.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.700+0000 7fb09f02e640 1 --2- 172.21.15.100:0/1405709236 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb07806beb0 0x7fb07806e370 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:53.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.700+0000 7fb09f02e640 1 --2- 172.21.15.100:0/1405709236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb098151ab0 0x7fb098159990 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:53.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.700+0000 7fb09f02e640 1 --2- 172.21.15.100:0/1405709236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0980afc80 0x7fb098158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:53.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.700+0000 7fb09f02e640 1 --2- 172.21.15.100:0/1405709236 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb098073a30 0x7fb0980c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:53.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.700+0000 7fb09f02e640 1 -- 172.21.15.100:0/1405709236 >> 172.21.15.100:0/1405709236 conn(0x7fb0980cd200 msgr2=0x7fb09814bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:53.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.700+0000 7fb09f02e640 1 -- 172.21.15.100:0/1405709236 shutdown_connections 2024-09-11T22:31:53.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:53.700+0000 7fb09f02e640 1 -- 172.21.15.100:0/1405709236 wait complete. 2024-09-11T22:31:56.728 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:31:56.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:56.924+0000 7fbd283b9640 1 Processor -- start 2024-09-11T22:31:56.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:56.924+0000 7fbd283b9640 1 -- start start 2024-09-11T22:31:56.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:56.925+0000 7fbd283b9640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbd20154d20 0x7fbd200cac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:56.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:56.925+0000 7fbd283b9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200c5a10 0x7fbd2015dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:56.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:56.925+0000 7fbd283b9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd200c53b0 con 0x7fbd20073d10 2024-09-11T22:31:56.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:56.925+0000 7fbd283b9640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fbd200728a0 con 0x7fbd20154d20 2024-09-11T22:31:56.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:56.925+0000 7fbd283b9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbd2015b340 con 0x7fbd200c5a10 2024-09-11T22:31:56.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:56.926+0000 7fbd26155640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7fbd20154d20 msgr2=0x7fbd200cac10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:31:56.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:56.926+0000 7fbd26155640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbd20154d20 0x7fbd200cac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:31:56.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:56.926+0000 7fbd25954640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200c5a10 0x7fbd2015dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:56.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:56.927+0000 7fbd26956640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fbd20073d10 0x7fbd2015e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:38020/0 (socket says 172.21.15.100:38020) 2024-09-11T22:31:56.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:56.927+0000 7fbd26956640 1 -- 172.21.15.100:0/3247999532 learned_addr learned my addr 172.21.15.100:0/3247999532 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:31:56.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:56.927+0000 7fbd25954640 1 -- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200c5a10 msgr2=0x7fbd2015dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:31:56.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:56.927+0000 7fbd25954640 1 -- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200c5a10 msgr2=0x7fbd2015dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:31:56.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:56.927+0000 7fbd25954640 1 --2- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200c5a10 0x7fbd2015dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:31:56.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:56.928+0000 7fbd25954640 1 --2- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200c5a10 0x7fbd2015dde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:31:57.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:57.127+0000 7fbd26155640 1 -- 172.21.15.100:0/3247999532 >> v2:172.21.15.100:3300/0 conn(0x7fbd20154d20 msgr2=0x7fbd200cac10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:31:57.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:57.127+0000 7fbd26155640 1 --2- 172.21.15.100:0/3247999532 >> v2:172.21.15.100:3300/0 conn(0x7fbd20154d20 0x7fbd200cac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:31:57.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:57.130+0000 7fbd25954640 1 --2- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200c5a10 0x7fbd2015dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:57.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:57.132+0000 7fbd25954640 1 -- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200c5a10 msgr2=0x7fbd2015dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:31:57.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:57.132+0000 7fbd25954640 1 -- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200c5a10 msgr2=0x7fbd2015dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:31:57.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:57.132+0000 7fbd25954640 1 --2- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200c5a10 0x7fbd2015dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:31:57.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:57.132+0000 7fbd25954640 1 --2- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200c5a10 0x7fbd2015dde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:31:57.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:57.528+0000 7fbd26155640 1 -- 172.21.15.100:0/3247999532 >> v2:172.21.15.100:3300/0 conn(0x7fbd20154d20 msgr2=0x7fbd200cac10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:31:57.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:57.528+0000 7fbd26155640 1 --2- 172.21.15.100:0/3247999532 >> v2:172.21.15.100:3300/0 conn(0x7fbd20154d20 0x7fbd200cac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:31:57.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:57.533+0000 7fbd25954640 1 --2- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200c5a10 0x7fbd2015dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:57.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:57.533+0000 7fbd25954640 1 -- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200c5a10 msgr2=0x7fbd2015dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:31:57.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:57.533+0000 7fbd25954640 1 -- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200c5a10 msgr2=0x7fbd2015dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:31:57.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:57.533+0000 7fbd25954640 1 --2- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200c5a10 0x7fbd2015dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:31:57.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:57.533+0000 7fbd25954640 1 --2- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200c5a10 0x7fbd2015dde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:31:58.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:58.329+0000 7fbd26155640 1 -- 172.21.15.100:0/3247999532 >> v2:172.21.15.100:3300/0 conn(0x7fbd20154d20 msgr2=0x7fbd200cac10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:31:58.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:58.329+0000 7fbd26155640 1 --2- 172.21.15.100:0/3247999532 >> v2:172.21.15.100:3300/0 conn(0x7fbd20154d20 0x7fbd200cac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:31:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:58.334+0000 7fbd25954640 1 --2- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200c5a10 0x7fbd2015dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:58.334+0000 7fbd25954640 1 -- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200c5a10 msgr2=0x7fbd2015dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:31:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:58.334+0000 7fbd25954640 1 -- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200c5a10 msgr2=0x7fbd2015dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:31:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:58.334+0000 7fbd25954640 1 --2- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200c5a10 0x7fbd2015dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:31:58.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:58.334+0000 7fbd25954640 1 --2- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200c5a10 0x7fbd2015dde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:31:59.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.547+0000 7fbd25153640 1 -- 172.21.15.100:0/3247999532 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 793769558 0 0) 0x7fbd200c53b0 con 0x7fbd20073d10 2024-09-11T22:31:59.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.547+0000 7fbd25153640 1 -- 172.21.15.100:0/3247999532 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd0c003520 con 0x7fbd20073d10 2024-09-11T22:31:59.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.558+0000 7fbd25153640 1 -- 172.21.15.100:0/3247999532 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2529853019 0 0) 0x7fbd0c003520 con 0x7fbd20073d10 2024-09-11T22:31:59.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.558+0000 7fbd25153640 1 -- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200c5a10 msgr2=0x7fbd2015dde0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:31:59.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.558+0000 7fbd25153640 1 --2- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200c5a10 0x7fbd2015dde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:59.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.558+0000 7fbd25153640 1 -- 172.21.15.100:0/3247999532 >> v2:172.21.15.100:3300/0 conn(0x7fbd20154d20 msgr2=0x7fbd200cac10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:31:59.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.558+0000 7fbd25153640 1 --2- 172.21.15.100:0/3247999532 >> v2:172.21.15.100:3300/0 conn(0x7fbd20154d20 0x7fbd200cac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:59.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.558+0000 7fbd25153640 1 -- 172.21.15.100:0/3247999532 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd2015b620 con 0x7fbd20073d10 2024-09-11T22:31:59.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.558+0000 7fbd25153640 1 -- 172.21.15.100:0/3247999532 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fbd10001650 con 0x7fbd20073d10 2024-09-11T22:31:59.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.558+0000 7fbd25153640 1 -- 172.21.15.100:0/3247999532 >> v1:172.21.15.167:6789/0 conn(0x7fbd20073d10 legacy=0x7fbd2015e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:59.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.558+0000 7fbd25153640 1 --2- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd0c0039b0 0x7fbd0c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:59.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.558+0000 7fbd25153640 1 --2- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd0c004800 0x7fbd0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:59.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.558+0000 7fbd25153640 1 --2- 172.21.15.100:0/3247999532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd0c0051c0 0x7fbd0c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:59.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.558+0000 7fbd25153640 1 -- 172.21.15.100:0/3247999532 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbd200728a0 con 0x7fbd0c0051c0 2024-09-11T22:31:59.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.559+0000 7fbd25153640 1 -- 172.21.15.100:0/3247999532 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2015b340 con 0x7fbd0c004800 2024-09-11T22:31:59.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.559+0000 7fbd25153640 1 -- 172.21.15.100:0/3247999532 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbd0c00bfe0 con 0x7fbd0c0039b0 2024-09-11T22:31:59.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.559+0000 7fbd26956640 1 -- 172.21.15.100:0/3247999532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd0c0051c0 msgr2=0x7fbd0c00b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:31:59.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.559+0000 7fbd26956640 1 --2- 172.21.15.100:0/3247999532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd0c0051c0 0x7fbd0c00b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:31:59.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.559+0000 7fbd26155640 1 --2- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd0c0039b0 0x7fbd0c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:59.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.559+0000 7fbd25954640 1 --2- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd0c004800 0x7fbd0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:59.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.559+0000 7fbd26155640 1 -- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd0c004800 msgr2=0x7fbd0c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:31:59.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.559+0000 7fbd26155640 1 --2- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd0c004800 0x7fbd0c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:59.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.559+0000 7fbd26155640 1 -- 172.21.15.100:0/3247999532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd0c0051c0 msgr2=0x7fbd0c00b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:31:59.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.559+0000 7fbd26155640 1 --2- 172.21.15.100:0/3247999532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd0c0051c0 0x7fbd0c00b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:59.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.559+0000 7fbd26155640 1 -- 172.21.15.100:0/3247999532 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd2015b620 con 0x7fbd0c0039b0 2024-09-11T22:31:59.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.561+0000 7fbd26155640 1 --2- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd0c0039b0 0x7fbd0c003dd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800c320 tx=0x7fbd0c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19fbdc4f648ab9c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:59.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.561+0000 7fbd25153640 1 -- 172.21.15.100:0/3247999532 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18007be0 con 0x7fbd0c0039b0 2024-09-11T22:31:59.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.561+0000 7fbd25153640 1 -- 172.21.15.100:0/3247999532 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd1802f070 con 0x7fbd0c0039b0 2024-09-11T22:31:59.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.561+0000 7fbd25153640 1 -- 172.21.15.100:0/3247999532 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1802bb90 con 0x7fbd0c0039b0 2024-09-11T22:31:59.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.562+0000 7fbd283b9640 1 -- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd0c0039b0 msgr2=0x7fbd0c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:59.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.562+0000 7fbd283b9640 1 --2- 172.21.15.100:0/3247999532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd0c0039b0 0x7fbd0c003dd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800c320 tx=0x7fbd0c005830 comp rx=0 tx=0).stop 2024-09-11T22:31:59.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.562+0000 7fbd26956640 1 -- 172.21.15.100:0/3247999532 reap_dead start 2024-09-11T22:31:59.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.562+0000 7fbd283b9640 1 -- 172.21.15.100:0/3247999532 shutdown_connections 2024-09-11T22:31:59.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.562+0000 7fbd283b9640 1 -- 172.21.15.100:0/3247999532 >> 172.21.15.100:0/3247999532 conn(0x7fbd200ccd10 msgr2=0x7fbd200cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:31:59.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.562+0000 7fbd283b9640 1 -- 172.21.15.100:0/3247999532 shutdown_connections 2024-09-11T22:31:59.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.562+0000 7fbd283b9640 1 -- 172.21.15.100:0/3247999532 wait complete. 2024-09-11T22:31:59.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.564+0000 7fbd283b9640 1 Processor -- start 2024-09-11T22:31:59.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.566+0000 7fbd283b9640 1 -- start start 2024-09-11T22:31:59.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.568+0000 7fbd283b9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd0c0039b0 0x7fbd20155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:59.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.569+0000 7fbd26155640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd0c0039b0 msgr2=0x7fbd20155230 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:31:59.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.569+0000 7fbd26155640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd0c0039b0 0x7fbd20155230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:31:59.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.569+0000 7fbd283b9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd200cf4e0 0x7fbd2015a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:59.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.569+0000 7fbd283b9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200cf920 0x7fbd20158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:59.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.570+0000 7fbd25954640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd200cf4e0 0x7fbd2015a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:59.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.570+0000 7fbd25954640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd200cf4e0 0x7fbd2015a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:56206/0 (socket says 172.21.15.100:56206) 2024-09-11T22:31:59.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.570+0000 7fbd26956640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200cf920 0x7fbd20158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:59.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.570+0000 7fbd26956640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200cf920 0x7fbd20158f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:33420/0 (socket says 172.21.15.100:33420) 2024-09-11T22:31:59.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.570+0000 7fbd25954640 1 -- 172.21.15.100:0/1238968971 learned_addr learned my addr 172.21.15.100:0/1238968971 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:31:59.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.570+0000 7fbd283b9640 1 -- 172.21.15.100:0/1238968971 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbd20072d30 con 0x7fbd0c0039b0 2024-09-11T22:31:59.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.570+0000 7fbd283b9640 1 -- 172.21.15.100:0/1238968971 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbd200cb150 con 0x7fbd200cf4e0 2024-09-11T22:31:59.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.570+0000 7fbd283b9640 1 -- 172.21.15.100:0/1238968971 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbd20072eb0 con 0x7fbd200cf920 2024-09-11T22:31:59.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.570+0000 7fbd25954640 1 -- 172.21.15.100:0/1238968971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200cf920 msgr2=0x7fbd20158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:31:59.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.570+0000 7fbd25954640 1 --2- 172.21.15.100:0/1238968971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200cf920 0x7fbd20158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:59.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.570+0000 7fbd25954640 1 -- 172.21.15.100:0/1238968971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd0c0039b0 msgr2=0x7fbd20155230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:31:59.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.570+0000 7fbd25954640 1 --2- 172.21.15.100:0/1238968971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd0c0039b0 0x7fbd20155230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:31:59.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.571+0000 7fbd25954640 1 -- 172.21.15.100:0/1238968971 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd200b6120 con 0x7fbd200cf4e0 2024-09-11T22:31:59.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.571+0000 7fbd25954640 1 --2- 172.21.15.100:0/1238968971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd200cf4e0 0x7fbd2015a020 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c015700 tx=0x7fbd1c015bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:31:59.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.571+0000 7fbd16ffd640 1 -- 172.21.15.100:0/1238968971 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c0138c0 con 0x7fbd200cf4e0 2024-09-11T22:31:59.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.572+0000 7fbd283b9640 1 -- 172.21.15.100:0/1238968971 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd200b4a10 con 0x7fbd200cf4e0 2024-09-11T22:31:59.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.572+0000 7fbd283b9640 1 -- 172.21.15.100:0/1238968971 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd200b4fd0 con 0x7fbd200cf4e0 2024-09-11T22:31:59.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.572+0000 7fbd16ffd640 1 -- 172.21.15.100:0/1238968971 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd1c013a60 con 0x7fbd200cf4e0 2024-09-11T22:31:59.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.572+0000 7fbd16ffd640 1 -- 172.21.15.100:0/1238968971 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c013e10 con 0x7fbd200cf4e0 2024-09-11T22:31:59.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.575+0000 7fbd283b9640 1 -- 172.21.15.100:0/1238968971 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd08005290 con 0x7fbd200cf4e0 2024-09-11T22:31:59.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.576+0000 7fbd16ffd640 1 -- 172.21.15.100:0/1238968971 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbd1c01f020 con 0x7fbd200cf4e0 2024-09-11T22:31:59.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.577+0000 7fbd16ffd640 1 --2- 172.21.15.100:0/1238968971 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbd0c06d880 0x7fbd0c06fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:31:59.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.581+0000 7fbd26155640 1 --2- 172.21.15.100:0/1238968971 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbd0c06d880 0x7fbd0c06fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:31:59.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.585+0000 7fbd16ffd640 1 -- 172.21.15.100:0/1238968971 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fbd1c08b8d0 con 0x7fbd200cf4e0 2024-09-11T22:31:59.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.588+0000 7fbd16ffd640 1 -- 172.21.15.100:0/1238968971 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbd1c0597f0 con 0x7fbd200cf4e0 2024-09-11T22:31:59.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:31:59.591+0000 7fbd26155640 1 --2- 172.21.15.100:0/1238968971 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbd0c06d880 0x7fbd0c06fd40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbd18034000 tx=0x7fbd1802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:00.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.073+0000 7fbd283b9640 1 -- 172.21.15.100:0/1238968971 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbd08005580 con 0x7fbd200cf4e0 2024-09-11T22:32:00.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.074+0000 7fbd16ffd640 1 -- 172.21.15.100:0/1238968971 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7fbd1c05daf0 con 0x7fbd200cf4e0 2024-09-11T22:32:00.077 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":84,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:32:00.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.081+0000 7fbd283b9640 1 -- 172.21.15.100:0/1238968971 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbd0c06d880 msgr2=0x7fbd0c06fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:00.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.081+0000 7fbd283b9640 1 --2- 172.21.15.100:0/1238968971 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbd0c06d880 0x7fbd0c06fd40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbd18034000 tx=0x7fbd1802e000 comp rx=0 tx=0).stop 2024-09-11T22:32:00.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.081+0000 7fbd283b9640 1 -- 172.21.15.100:0/1238968971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd200cf4e0 msgr2=0x7fbd2015a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:00.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.081+0000 7fbd283b9640 1 --2- 172.21.15.100:0/1238968971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd200cf4e0 0x7fbd2015a020 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c015700 tx=0x7fbd1c015bc0 comp rx=0 tx=0).stop 2024-09-11T22:32:00.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.081+0000 7fbd283b9640 1 -- 172.21.15.100:0/1238968971 shutdown_connections 2024-09-11T22:32:00.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.081+0000 7fbd283b9640 1 --2- 172.21.15.100:0/1238968971 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbd0c06d880 0x7fbd0c06fd40 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:00.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.082+0000 7fbd283b9640 1 --2- 172.21.15.100:0/1238968971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbd200cf920 0x7fbd20158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:00.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.082+0000 7fbd283b9640 1 --2- 172.21.15.100:0/1238968971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd200cf4e0 0x7fbd2015a020 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:00.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.082+0000 7fbd283b9640 1 --2- 172.21.15.100:0/1238968971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd0c0039b0 0x7fbd20155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:00.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.082+0000 7fbd283b9640 1 -- 172.21.15.100:0/1238968971 >> 172.21.15.100:0/1238968971 conn(0x7fbd200ccd10 msgr2=0x7fbd200c5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:00.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.082+0000 7fbd283b9640 1 -- 172.21.15.100:0/1238968971 shutdown_connections 2024-09-11T22:32:00.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.082+0000 7fbd283b9640 1 -- 172.21.15.100:0/1238968971 wait complete. 2024-09-11T22:32:00.114 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-11T22:32:00.115 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-11T22:32:00.115 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:32:00.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.313+0000 7fa3aab9f640 1 Processor -- start 2024-09-11T22:32:00.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.319+0000 7fa3aab9f640 1 -- start start 2024-09-11T22:32:00.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.320+0000 7fa3aab9f640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa3a4157e00 0x7fa3a40c8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:00.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.320+0000 7fa3aab9f640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3a406eb20 con 0x7fa3a40c8cb0 2024-09-11T22:32:00.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.320+0000 7fa3aab9f640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3a415b690 con 0x7fa3a40b0c50 2024-09-11T22:32:00.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.320+0000 7fa3aab9f640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fa3a406e610 con 0x7fa3a4157e00 2024-09-11T22:32:00.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.321+0000 7fa39bfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fa3a40b0c50 0x7fa3a406cc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:38022/0 (socket says 172.21.15.100:38022) 2024-09-11T22:32:00.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.321+0000 7fa39bfff640 1 -- 172.21.15.100:0/1276923635 learned_addr learned my addr 172.21.15.100:0/1276923635 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:32:00.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.321+0000 7fa3a913c640 1 -- 172.21.15.100:0/1276923635 >> v1:172.21.15.100:6789/0 conn(0x7fa3a40c8cb0 legacy=0x7fa3a4165060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:32:00.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.321+0000 7fa3a893b640 1 -- 172.21.15.100:0/1276923635 >> v2:172.21.15.100:3300/0 conn(0x7fa3a4157e00 msgr2=0x7fa3a40c8410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:32:00.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.321+0000 7fa3a893b640 1 --2- 172.21.15.100:0/1276923635 >> v2:172.21.15.100:3300/0 conn(0x7fa3a4157e00 0x7fa3a40c8410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:32:00.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.321+0000 7fa39b7fe640 1 -- 172.21.15.100:0/1276923635 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 503374815 0 0) 0x7fa3a415b690 con 0x7fa3a40b0c50 2024-09-11T22:32:00.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.321+0000 7fa39b7fe640 1 -- 172.21.15.100:0/1276923635 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa38c003520 con 0x7fa3a40b0c50 2024-09-11T22:32:00.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.321+0000 7fa39b7fe640 1 -- 172.21.15.100:0/1276923635 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 867746005 0 0) 0x7fa38c003520 con 0x7fa3a40b0c50 2024-09-11T22:32:00.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.322+0000 7fa39b7fe640 1 -- 172.21.15.100:0/1276923635 >> v2:172.21.15.100:3300/0 conn(0x7fa3a4157e00 msgr2=0x7fa3a40c8410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:32:00.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.322+0000 7fa39b7fe640 1 --2- 172.21.15.100:0/1276923635 >> v2:172.21.15.100:3300/0 conn(0x7fa3a4157e00 0x7fa3a40c8410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:00.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.322+0000 7fa39b7fe640 1 -- 172.21.15.100:0/1276923635 >> v1:172.21.15.100:6789/0 conn(0x7fa3a40c8cb0 legacy=0x7fa3a4165060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:32:00.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.322+0000 7fa39b7fe640 1 -- 172.21.15.100:0/1276923635 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a41581e0 con 0x7fa3a40b0c50 2024-09-11T22:32:00.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.322+0000 7fa39b7fe640 1 -- 172.21.15.100:0/1276923635 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fa3940015a0 con 0x7fa3a40b0c50 2024-09-11T22:32:00.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.322+0000 7fa39b7fe640 1 -- 172.21.15.100:0/1276923635 >> v1:172.21.15.167:6789/0 conn(0x7fa3a40b0c50 legacy=0x7fa3a406cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:00.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.322+0000 7fa39b7fe640 1 --2- 172.21.15.100:0/1276923635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa38c0039b0 0x7fa38c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:00.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.322+0000 7fa3a893b640 1 -- 172.21.15.100:0/1276923635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa38c0039b0 msgr2=0x7fa38c003d90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:32:00.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.322+0000 7fa3a893b640 1 --2- 172.21.15.100:0/1276923635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa38c0039b0 0x7fa38c003d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:32:00.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.322+0000 7fa39b7fe640 1 --2- 172.21.15.100:0/1276923635 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa38c004800 0x7fa38c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:00.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.322+0000 7fa39b7fe640 1 --2- 172.21.15.100:0/1276923635 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa38c0052e0 0x7fa38c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:00.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.322+0000 7fa39b7fe640 1 -- 172.21.15.100:0/1276923635 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa38c00c180 con 0x7fa38c0039b0 2024-09-11T22:32:00.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.322+0000 7fa39b7fe640 1 -- 172.21.15.100:0/1276923635 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa38c00c330 con 0x7fa38c004800 2024-09-11T22:32:00.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.322+0000 7fa3a913c640 1 --2- 172.21.15.100:0/1276923635 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa38c0052e0 0x7fa38c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:00.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.322+0000 7fa39b7fe640 1 -- 172.21.15.100:0/1276923635 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa38c00c530 con 0x7fa38c0052e0 2024-09-11T22:32:00.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.322+0000 7fa39bfff640 1 --2- 172.21.15.100:0/1276923635 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa38c004800 0x7fa38c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:00.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.323+0000 7fa3a913c640 1 -- 172.21.15.100:0/1276923635 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa38c004800 msgr2=0x7fa38c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:00.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.323+0000 7fa3a913c640 1 --2- 172.21.15.100:0/1276923635 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa38c004800 0x7fa38c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:00.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.323+0000 7fa3a913c640 1 -- 172.21.15.100:0/1276923635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa38c0039b0 msgr2=0x7fa38c003d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:32:00.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.323+0000 7fa3a913c640 1 --2- 172.21.15.100:0/1276923635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa38c0039b0 0x7fa38c003d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:00.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.323+0000 7fa3a913c640 1 -- 172.21.15.100:0/1276923635 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38c003520 con 0x7fa38c0052e0 2024-09-11T22:32:00.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.323+0000 7fa39bfff640 1 --2- 172.21.15.100:0/1276923635 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa38c004800 0x7fa38c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:32:00.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.324+0000 7fa3a913c640 1 -- 172.21.15.100:0/1276923635 reap_dead start 2024-09-11T22:32:00.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.325+0000 7fa3a913c640 1 --2- 172.21.15.100:0/1276923635 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa38c0052e0 0x7fa38c00b9c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa39c003d00 tx=0x7fa38c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48da1e0a2c6d1e37 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:00.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.325+0000 7fa39b7fe640 1 -- 172.21.15.100:0/1276923635 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c009a30 con 0x7fa38c0052e0 2024-09-11T22:32:00.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.325+0000 7fa39b7fe640 1 -- 172.21.15.100:0/1276923635 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa39c030410 con 0x7fa38c0052e0 2024-09-11T22:32:00.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.325+0000 7fa39b7fe640 1 -- 172.21.15.100:0/1276923635 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c030800 con 0x7fa38c0052e0 2024-09-11T22:32:00.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.326+0000 7fa3aab9f640 1 -- 172.21.15.100:0/1276923635 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa38c0052e0 msgr2=0x7fa38c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:00.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.326+0000 7fa3aab9f640 1 --2- 172.21.15.100:0/1276923635 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa38c0052e0 0x7fa38c00b9c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa39c003d00 tx=0x7fa38c005830 comp rx=0 tx=0).stop 2024-09-11T22:32:00.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.327+0000 7fa3aab9f640 1 -- 172.21.15.100:0/1276923635 shutdown_connections 2024-09-11T22:32:00.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.327+0000 7fa3aab9f640 1 --2- 172.21.15.100:0/1276923635 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa38c0052e0 0x7fa38c00b9c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:00.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.327+0000 7fa3aab9f640 1 -- 172.21.15.100:0/1276923635 >> 172.21.15.100:0/1276923635 conn(0x7fa3a406f190 msgr2=0x7fa3a406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:00.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.327+0000 7fa3aab9f640 1 -- 172.21.15.100:0/1276923635 shutdown_connections 2024-09-11T22:32:00.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.327+0000 7fa3aab9f640 1 -- 172.21.15.100:0/1276923635 wait complete. 2024-09-11T22:32:00.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.329+0000 7fa3aab9f640 1 Processor -- start 2024-09-11T22:32:00.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.329+0000 7fa3aab9f640 1 -- start start 2024-09-11T22:32:00.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.331+0000 7fa3aab9f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa38c0052e0 0x7fa3a40ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:00.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.331+0000 7fa3aab9f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3a40cc6a0 0x7fa3a40cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:00.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.331+0000 7fa3aab9f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3a40cb120 0x7fa3a415df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:00.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.331+0000 7fa3aab9f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a415abb0 con 0x7fa3a40cc6a0 2024-09-11T22:32:00.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.331+0000 7fa3aab9f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a415a8d0 con 0x7fa38c0052e0 2024-09-11T22:32:00.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.331+0000 7fa3aab9f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a415ae90 con 0x7fa3a40cb120 2024-09-11T22:32:00.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.331+0000 7fa39bfff640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3a40cc6a0 msgr2=0x7fa3a40cabe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:32:00.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.331+0000 7fa39bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3a40cc6a0 0x7fa3a40cabe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:32:00.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.332+0000 7fa3a913c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3a40cb120 0x7fa3a415df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:00.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.332+0000 7fa3a913c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3a40cb120 0x7fa3a415df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:33436/0 (socket says 172.21.15.100:33436) 2024-09-11T22:32:00.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.332+0000 7fa3a913c640 1 -- 172.21.15.100:0/1760418669 learned_addr learned my addr 172.21.15.100:0/1760418669 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:32:00.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.332+0000 7fa3a893b640 1 --2- 172.21.15.100:0/1760418669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa38c0052e0 0x7fa3a40ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:00.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.333+0000 7fa3a913c640 1 -- 172.21.15.100:0/1760418669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa38c0052e0 msgr2=0x7fa3a40ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:00.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.333+0000 7fa3a913c640 1 --2- 172.21.15.100:0/1760418669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa38c0052e0 0x7fa3a40ca0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:00.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.333+0000 7fa3a913c640 1 -- 172.21.15.100:0/1760418669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3a40cc6a0 msgr2=0x7fa3a40cabe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:32:00.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.333+0000 7fa3a913c640 1 --2- 172.21.15.100:0/1760418669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3a40cc6a0 0x7fa3a40cabe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:00.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.333+0000 7fa3a913c640 1 -- 172.21.15.100:0/1760418669 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a40cb5a0 con 0x7fa3a40cb120 2024-09-11T22:32:00.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.334+0000 7fa3a913c640 1 --2- 172.21.15.100:0/1760418669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3a40cb120 0x7fa3a415df50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa39c02af30 tx=0x7fa39c005d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:00.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.334+0000 7fa3997fa640 1 -- 172.21.15.100:0/1760418669 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c03c840 con 0x7fa3a40cb120 2024-09-11T22:32:00.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.334+0000 7fa3aab9f640 1 -- 172.21.15.100:0/1760418669 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a41fd240 con 0x7fa3a40cb120 2024-09-11T22:32:00.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.334+0000 7fa3aab9f640 1 -- 172.21.15.100:0/1760418669 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a40738e0 con 0x7fa3a40cb120 2024-09-11T22:32:00.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.335+0000 7fa3997fa640 1 -- 172.21.15.100:0/1760418669 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa39c03c9e0 con 0x7fa3a40cb120 2024-09-11T22:32:00.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.335+0000 7fa3997fa640 1 -- 172.21.15.100:0/1760418669 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c03cdb0 con 0x7fa3a40cb120 2024-09-11T22:32:00.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.339+0000 7fa3997fa640 1 -- 172.21.15.100:0/1760418669 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa39c045420 con 0x7fa3a40cb120 2024-09-11T22:32:00.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.340+0000 7fa3997fa640 1 --2- 172.21.15.100:0/1760418669 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa39006be30 0x7fa39006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.342+0000 7fa3aab9f640 1 --2- 172.21.15.100:0/1760418669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa384002a70 0x7fa384004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.342+0000 7fa3aab9f640 1 -- 172.21.15.100:0/1760418669 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa384007ec0 con 0x7fa384002a70 2024-09-11T22:32:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.342+0000 7fa3a893b640 1 --2- 172.21.15.100:0/1760418669 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa39006be30 0x7fa39006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:00.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.344+0000 7fa3a893b640 1 --2- 172.21.15.100:0/1760418669 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa39006be30 0x7fa39006e2f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00093d0 tx=0x7fa3a0009360 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:00.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.342+0000 7fa3997fa640 1 -- 172.21.15.100:0/1760418669 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fa39c0ac800 con 0x7fa3a40cb120 2024-09-11T22:32:00.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.344+0000 7fa39bfff640 1 --2- 172.21.15.100:0/1760418669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa384002a70 0x7fa384004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:00.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.347+0000 7fa39bfff640 1 -- 172.21.15.100:0/1760418669 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa3840080c0 con 0x7fa384002a70 2024-09-11T22:32:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.352+0000 7fa39bfff640 1 --2- 172.21.15.100:0/1760418669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa384002a70 0x7fa384004f30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa394004930 tx=0x7fa394008430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:00.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.356+0000 7fa3997fa640 1 -- 172.21.15.100:0/1760418669 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa394019070 con 0x7fa384002a70 2024-09-11T22:32:00.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.356+0000 7fa3997fa640 1 -- 172.21.15.100:0/1760418669 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa394004c70 con 0x7fa384002a70 2024-09-11T22:32:00.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.356+0000 7fa3997fa640 1 -- 172.21.15.100:0/1760418669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa384002a70 msgr2=0x7fa384004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:00.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.356+0000 7fa3997fa640 1 --2- 172.21.15.100:0/1760418669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa384002a70 0x7fa384004f30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa394004930 tx=0x7fa394008430 comp rx=0 tx=0).stop 2024-09-11T22:32:00.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.356+0000 7fa3997fa640 1 -- 172.21.15.100:0/1760418669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa384002a70 msgr2=0x7fa384004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:32:00.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.356+0000 7fa3997fa640 1 --2- 172.21.15.100:0/1760418669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa384002a70 0x7fa384004f30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:00.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.368+0000 7fa3aab9f640 1 --2- 172.21.15.100:0/1760418669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa384006f30 0x7fa3840073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:00.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.368+0000 7fa3aab9f640 1 -- 172.21.15.100:0/1760418669 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa38400a4a0 con 0x7fa384006f30 2024-09-11T22:32:00.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.368+0000 7fa39bfff640 1 --2- 172.21.15.100:0/1760418669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa384006f30 0x7fa3840073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:00.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.370+0000 7fa39bfff640 1 -- 172.21.15.100:0/1760418669 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa384007900 con 0x7fa384006f30 2024-09-11T22:32:00.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.370+0000 7fa39bfff640 1 --2- 172.21.15.100:0/1760418669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa384006f30 0x7fa3840073c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa394016000 tx=0x7fa394004a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:00.373 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:32:00.373 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:32:00.373 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:32:00.373 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:32:00.373 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 84, 2024-09-11T22:32:00.373 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 505649, 2024-09-11T22:32:00.373 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:32:00.373 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:32:00.374 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:32:00.374 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:00.374 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:32:00.374 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:32:00.374 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:32:00.374 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:32:00.374 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:00.374 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:00.374 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:00.374 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:00.374 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:00.374 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:00.374 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:00.374 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:00.375 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:00.375 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:00.375 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:00.375 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:00.375 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:32:00.375 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:32:00.375 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:00.375 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:00.375 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:00.375 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:00.375 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:00.375 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:00.375 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:00.375 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:00.376 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:00.376 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:00.376 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:00.376 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:00.376 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.376 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:32:00.376 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:32:00.376 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:32:00.376 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:32:00.376 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:32:00.376 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:32:00.376 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:32:00.376 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:32:00.377 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:32:00.377 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:32:00.377 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:32:00.377 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:32:00.377 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:32:00.377 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:32:00.377 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:32:00.377 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:32:00.377 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:32:00.377 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:00.377 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:00.377 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:00.377 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:00.377 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:00.378 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:00.378 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:00.378 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:00.378 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:00.378 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:00.378 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:00.378 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:00.378 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:32:00.378 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.378 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:32:00.378 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.378 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:32:00.378 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:32:00.378 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:00.379 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:00.379 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.379 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:00.379 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:32:00.379 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:00.379 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.379 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.379 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:00.379 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:32:00.379 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:00.379 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:00.379 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:00.380 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.380 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:32:00.380 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:32:00.380 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:00.380 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:00.380 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:00.380 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.380 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.380 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:32:00.380 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:32:00.380 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:00.380 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:00.380 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.380 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:00.381 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:32:00.381 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:00.381 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.381 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.381 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:00.381 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:32:00.381 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:00.381 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:00.381 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:00.381 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.381 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:32:00.381 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:32:00.381 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:00.382 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:00.382 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:00.382 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.382 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.382 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:32:00.382 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:32:00.382 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:00.382 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:00.382 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.382 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:00.382 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:32:00.382 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:00.382 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.382 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.383 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:00.383 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:32:00.383 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:00.383 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:00.383 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:00.383 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.383 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:32:00.383 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:32:00.383 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:00.383 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:00.383 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:00.383 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:00.383 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:00.383 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.384 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:32:00.384 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:32:00.384 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.384 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:00.384 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:00.384 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:32:00.384 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:00.384 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:00.384 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:32:00.384 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.384 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:00.384 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:00.384 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:32:00.384 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:00.385 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:00.385 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:32:00.385 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.385 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:00.385 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:00.385 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:32:00.385 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:00.385 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:00.385 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:32:00.385 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.385 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:00.385 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:00.385 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:32:00.385 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:00.386 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:00.386 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.386 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:32:00.386 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:32:00.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.371+0000 7fa3997fa640 1 -- 172.21.15.100:0/1760418669 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa394019070 con 0x7fa384006f30 2024-09-11T22:32:00.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.371+0000 7fa3997fa640 1 -- 172.21.15.100:0/1760418669 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4878 (secure 0 0 0) 0x7fa39401a040 con 0x7fa384006f30 2024-09-11T22:32:00.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.372+0000 7fa3997fa640 1 -- 172.21.15.100:0/1760418669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa384006f30 msgr2=0x7fa3840073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:00.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.372+0000 7fa3997fa640 1 --2- 172.21.15.100:0/1760418669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa384006f30 0x7fa3840073c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa394016000 tx=0x7fa394004a00 comp rx=0 tx=0).stop 2024-09-11T22:32:00.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.372+0000 7fa3997fa640 1 -- 172.21.15.100:0/1760418669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa384006f30 msgr2=0x7fa3840073c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:32:00.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.372+0000 7fa3997fa640 1 --2- 172.21.15.100:0/1760418669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa384006f30 0x7fa3840073c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:00.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.379+0000 7fa38affd640 1 -- 172.21.15.100:0/1760418669 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa39006be30 msgr2=0x7fa39006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:00.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.379+0000 7fa38affd640 1 --2- 172.21.15.100:0/1760418669 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa39006be30 0x7fa39006e2f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00093d0 tx=0x7fa3a0009360 comp rx=0 tx=0).stop 2024-09-11T22:32:00.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.379+0000 7fa38affd640 1 -- 172.21.15.100:0/1760418669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3a40cb120 msgr2=0x7fa3a415df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:00.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.379+0000 7fa38affd640 1 --2- 172.21.15.100:0/1760418669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3a40cb120 0x7fa3a415df50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa39c02af30 tx=0x7fa39c005d90 comp rx=0 tx=0).stop 2024-09-11T22:32:00.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.379+0000 7fa3a913c640 1 -- 172.21.15.100:0/1760418669 reap_dead start 2024-09-11T22:32:00.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.379+0000 7fa3a913c640 1 -- 172.21.15.100:0/1760418669 reap_dead start 2024-09-11T22:32:00.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.379+0000 7fa38affd640 1 -- 172.21.15.100:0/1760418669 shutdown_connections 2024-09-11T22:32:00.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.379+0000 7fa38affd640 1 -- 172.21.15.100:0/1760418669 >> 172.21.15.100:0/1760418669 conn(0x7fa3a406f190 msgr2=0x7fa3a4152290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:00.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.380+0000 7fa38affd640 1 -- 172.21.15.100:0/1760418669 shutdown_connections 2024-09-11T22:32:00.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.380+0000 7fa38affd640 1 -- 172.21.15.100:0/1760418669 wait complete. 2024-09-11T22:32:00.407 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:32:00.408 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-11T22:32:00.408 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:32:00.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.584+0000 7f0aa1ed2640 1 Processor -- start 2024-09-11T22:32:00.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.584+0000 7f0aa1ed2640 1 -- start start 2024-09-11T22:32:00.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.585+0000 7f0aa1ed2640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0a94005a30 0x7f0a940da570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:00.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.585+0000 7f0aa1ed2640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0a9404aea0 0x7f0a9404b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:00.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.585+0000 7f0aa1ed2640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a940d4a00 con 0x7f0a940d4620 2024-09-11T22:32:00.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.585+0000 7f0aa1ed2640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f0a94032c40 con 0x7f0a9404aea0 2024-09-11T22:32:00.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.585+0000 7f0aa1ed2640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f0a94006000 con 0x7f0a94005a30 2024-09-11T22:32:00.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.585+0000 7f0a9bfff640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f0a9404aea0 msgr2=0x7f0a9404b2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:32:00.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.585+0000 7f0a9bfff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0a9404aea0 0x7f0a9404b2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:32:00.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.586+0000 7f0a9affd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0a94005a30 0x7f0a940da570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:00.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.586+0000 7f0a9affd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0a94005a30 0x7f0a940da570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:56242/0 (socket says 172.21.15.100:56242) 2024-09-11T22:32:00.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.586+0000 7f0a9affd640 1 -- 172.21.15.100:0/3046440655 learned_addr learned my addr 172.21.15.100:0/3046440655 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:32:00.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.586+0000 7f0a9affd640 1 -- 172.21.15.100:0/3046440655 >> v2:172.21.15.100:3300/0 conn(0x7f0a9404aea0 msgr2=0x7f0a9404b2b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:32:00.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.586+0000 7f0a9affd640 1 --2- 172.21.15.100:0/3046440655 >> v2:172.21.15.100:3300/0 conn(0x7f0a9404aea0 0x7f0a9404b2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:00.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.586+0000 7f0a9affd640 1 -- 172.21.15.100:0/3046440655 >> v1:172.21.15.167:6789/0 conn(0x7f0a940d4620 legacy=0x7f0a94034280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:32:00.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.586+0000 7f0a9affd640 1 -- 172.21.15.100:0/3046440655 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a940062e0 con 0x7f0a94005a30 2024-09-11T22:32:00.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.588+0000 7f0a9affd640 1 --2- 172.21.15.100:0/3046440655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a94005a30 0x7f0a940da570 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009530 tx=0x7f0a9002a2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0f798453a810bd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:00.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.590+0000 7f0a9a7fc640 1 -- 172.21.15.100:0/3046440655 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a90037070 con 0x7f0a94005a30 2024-09-11T22:32:00.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.590+0000 7f0a9a7fc640 1 -- 172.21.15.100:0/3046440655 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a90032440 con 0x7f0a94005a30 2024-09-11T22:32:00.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.591+0000 7f0aa1ed2640 1 -- 172.21.15.100:0/3046440655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a94005a30 msgr2=0x7f0a940da570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:00.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.591+0000 7f0aa1ed2640 1 --2- 172.21.15.100:0/3046440655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a94005a30 0x7f0a940da570 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009530 tx=0x7f0a9002a2e0 comp rx=0 tx=0).stop 2024-09-11T22:32:00.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.592+0000 7f0aa1ed2640 1 -- 172.21.15.100:0/3046440655 shutdown_connections 2024-09-11T22:32:00.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.592+0000 7f0aa1ed2640 1 --2- 172.21.15.100:0/3046440655 >> v2:172.21.15.100:3300/0 conn(0x7f0a9404aea0 0x7f0a9404b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:00.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.592+0000 7f0aa1ed2640 1 --2- 172.21.15.100:0/3046440655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a94005a30 0x7f0a940da570 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:00.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.592+0000 7f0aa1ed2640 1 -- 172.21.15.100:0/3046440655 >> 172.21.15.100:0/3046440655 conn(0x7f0a9404fc80 msgr2=0x7f0a94050090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:00.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.594+0000 7f0aa1ed2640 1 -- 172.21.15.100:0/3046440655 shutdown_connections 2024-09-11T22:32:00.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.595+0000 7f0aa1ed2640 1 -- 172.21.15.100:0/3046440655 wait complete. 2024-09-11T22:32:00.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.597+0000 7f0aa1ed2640 1 Processor -- start 2024-09-11T22:32:00.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.597+0000 7f0aa1ed2640 1 -- start start 2024-09-11T22:32:00.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.598+0000 7f0aa1ed2640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a94005a30 0x7f0a94045fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:00.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.599+0000 7f0aa1ed2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a9404aea0 0x7f0a940e7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:00.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.599+0000 7f0aa1ed2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a940d4620 0x7f0a940e7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:00.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.599+0000 7f0a9bfff640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a940d4620 msgr2=0x7f0a940e7c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:32:00.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.599+0000 7f0a9bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a940d4620 0x7f0a940e7c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:32:00.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.599+0000 7f0a9b7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a94005a30 0x7f0a94045fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:00.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.600+0000 7f0a9b7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a94005a30 0x7f0a94045fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:33440/0 (socket says 172.21.15.100:33440) 2024-09-11T22:32:00.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.601+0000 7f0aa1ed2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0a94006b80 con 0x7f0a940d4620 2024-09-11T22:32:00.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.601+0000 7f0aa1ed2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0a940068a0 con 0x7f0a9404aea0 2024-09-11T22:32:00.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.601+0000 7f0aa1ed2640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0a94006e60 con 0x7f0a94005a30 2024-09-11T22:32:00.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.602+0000 7f0a9affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a9404aea0 0x7f0a940e7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:00.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.602+0000 7f0a9affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a9404aea0 0x7f0a940e7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:56244/0 (socket says 172.21.15.100:56244) 2024-09-11T22:32:00.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.602+0000 7f0a9affd640 1 -- 172.21.15.100:0/2675180484 learned_addr learned my addr 172.21.15.100:0/2675180484 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:32:00.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.602+0000 7f0a9affd640 1 -- 172.21.15.100:0/2675180484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a94005a30 msgr2=0x7f0a94045fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:00.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.602+0000 7f0a9affd640 1 --2- 172.21.15.100:0/2675180484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a94005a30 0x7f0a94045fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:00.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.602+0000 7f0a9affd640 1 -- 172.21.15.100:0/2675180484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a940d4620 msgr2=0x7f0a940e7c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:32:00.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.602+0000 7f0a9affd640 1 --2- 172.21.15.100:0/2675180484 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a940d4620 0x7f0a940e7c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:00.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.602+0000 7f0a9affd640 1 -- 172.21.15.100:0/2675180484 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9404f200 con 0x7f0a9404aea0 2024-09-11T22:32:00.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.606+0000 7f0a9affd640 1 --2- 172.21.15.100:0/2675180484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a9404aea0 0x7f0a940e7700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009960 tx=0x7f0a900046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:00.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.606+0000 7f0a87fff640 1 -- 172.21.15.100:0/2675180484 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a90041020 con 0x7f0a9404aea0 2024-09-11T22:32:00.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.606+0000 7f0aa1ed2640 1 -- 172.21.15.100:0/2675180484 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a9417cec0 con 0x7f0a9404aea0 2024-09-11T22:32:00.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.606+0000 7f0aa1ed2640 1 -- 172.21.15.100:0/2675180484 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a9404e880 con 0x7f0a9404aea0 2024-09-11T22:32:00.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.607+0000 7f0aa1ed2640 1 --2- 172.21.15.100:0/2675180484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a940d5c90 0x7f0a94179290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:00.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.607+0000 7f0aa1ed2640 1 -- 172.21.15.100:0/2675180484 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0a9404e700 con 0x7f0a940d5c90 2024-09-11T22:32:00.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.608+0000 7f0a87fff640 1 -- 172.21.15.100:0/2675180484 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a90030970 con 0x7f0a9404aea0 2024-09-11T22:32:00.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.608+0000 7f0a9b7fe640 1 --2- 172.21.15.100:0/2675180484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a940d5c90 0x7f0a94179290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:00.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.608+0000 7f0a87fff640 1 -- 172.21.15.100:0/2675180484 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a90037040 con 0x7f0a9404aea0 2024-09-11T22:32:00.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.609+0000 7f0a9b7fe640 1 -- 172.21.15.100:0/2675180484 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a9417d3e0 con 0x7f0a940d5c90 2024-09-11T22:32:00.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.609+0000 7f0a9b7fe640 1 --2- 172.21.15.100:0/2675180484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a940d5c90 0x7f0a94179290 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0a8800e7a0 tx=0x7f0a8800ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:00.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.613+0000 7f0a87fff640 1 -- 172.21.15.100:0/2675180484 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a88017070 con 0x7f0a940d5c90 2024-09-11T22:32:00.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.614+0000 7f0a87fff640 1 -- 172.21.15.100:0/2675180484 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0a8800c740 con 0x7f0a940d5c90 2024-09-11T22:32:00.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.614+0000 7f0a87fff640 1 -- 172.21.15.100:0/2675180484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a940d5c90 msgr2=0x7f0a94179290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:00.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.614+0000 7f0a87fff640 1 --2- 172.21.15.100:0/2675180484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a940d5c90 0x7f0a94179290 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0a8800e7a0 tx=0x7f0a8800ec60 comp rx=0 tx=0).stop 2024-09-11T22:32:00.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.614+0000 7f0a87fff640 1 -- 172.21.15.100:0/2675180484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a940d5c90 msgr2=0x7f0a94179290 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:32:00.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.614+0000 7f0a87fff640 1 --2- 172.21.15.100:0/2675180484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a940d5c90 0x7f0a94179290 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:00.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.620+0000 7f0a87fff640 1 -- 172.21.15.100:0/2675180484 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a90044020 con 0x7f0a9404aea0 2024-09-11T22:32:00.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.621+0000 7f0a87fff640 1 --2- 172.21.15.100:0/2675180484 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0a8006b8a0 0x7f0a8006dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:00.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.623+0000 7f0a87fff640 1 -- 172.21.15.100:0/2675180484 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f0a900aba10 con 0x7f0a9404aea0 2024-09-11T22:32:00.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.623+0000 7f0a9b7fe640 1 --2- 172.21.15.100:0/2675180484 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0a8006b8a0 0x7f0a8006dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:00.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.624+0000 7f0a9b7fe640 1 --2- 172.21.15.100:0/2675180484 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0a8006b8a0 0x7f0a8006dd60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0a8800c5c0 tx=0x7f0a88008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.629+0000 7f0aa1ed2640 1 --2- 172.21.15.100:0/2675180484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a940d4e40 0x7f0a941797d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.629+0000 7f0aa1ed2640 1 -- 172.21.15.100:0/2675180484 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0a9404a600 con 0x7f0a940d4e40 2024-09-11T22:32:00.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.634+0000 7f0a9bfff640 1 --2- 172.21.15.100:0/2675180484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a940d4e40 0x7f0a941797d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:00.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.635+0000 7f0a9bfff640 1 -- 172.21.15.100:0/2675180484 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0a94178f40 con 0x7f0a940d4e40 2024-09-11T22:32:00.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.635+0000 7f0a9bfff640 1 --2- 172.21.15.100:0/2675180484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a940d4e40 0x7f0a941797d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c051790 tx=0x7f0a9c069180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:00.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.637+0000 7f0a87fff640 1 -- 172.21.15.100:0/2675180484 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c091070 con 0x7f0a940d4e40 2024-09-11T22:32:00.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.637+0000 7f0a87fff640 1 -- 172.21.15.100:0/2675180484 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5043 (secure 0 0 0) 0x7f0a9c074260 con 0x7f0a940d4e40 2024-09-11T22:32:00.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.637+0000 7f0a87fff640 1 -- 172.21.15.100:0/2675180484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a940d4e40 msgr2=0x7f0a941797d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:00.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.637+0000 7f0a87fff640 1 --2- 172.21.15.100:0/2675180484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a940d4e40 0x7f0a941797d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c051790 tx=0x7f0a9c069180 comp rx=0 tx=0).stop 2024-09-11T22:32:00.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.637+0000 7f0a87fff640 1 -- 172.21.15.100:0/2675180484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a940d4e40 msgr2=0x7f0a941797d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:32:00.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.637+0000 7f0a87fff640 1 --2- 172.21.15.100:0/2675180484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a940d4e40 0x7f0a941797d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:00.641 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:32:00.641 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:32:00.641 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:32:00.641 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:32:00.641 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 84, 2024-09-11T22:32:00.641 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 611357, 2024-09-11T22:32:00.641 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:32:00.641 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:32:00.641 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:32:00.641 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:00.641 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:32:00.642 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:32:00.642 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:32:00.642 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:32:00.642 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:00.642 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:00.642 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:00.642 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:00.642 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:00.642 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:00.642 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:00.642 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:00.642 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:00.642 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:00.643 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:00.643 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:00.643 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:32:00.643 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:32:00.643 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:00.643 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:00.643 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:00.643 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:00.643 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:00.643 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:00.643 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:00.643 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:00.643 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:00.643 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:00.644 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:00.644 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:00.644 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.644 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:32:00.644 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:32:00.644 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:32:00.644 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:32:00.644 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:32:00.644 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:32:00.644 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:32:00.644 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:32:00.644 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:32:00.644 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:32:00.645 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:32:00.645 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:32:00.645 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:32:00.645 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:32:00.645 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:32:00.645 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:32:00.645 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:32:00.645 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:00.645 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:00.645 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:00.645 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:00.645 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:00.645 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:00.645 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:00.646 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:00.646 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:00.646 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:00.646 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:00.646 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:00.646 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:32:00.646 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.646 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:32:00.646 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.646 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:32:00.647 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:32:00.647 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:00.647 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:00.647 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.647 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:00.647 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:32:00.647 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:00.647 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.647 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.647 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:00.647 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:32:00.647 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:00.647 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:00.648 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:00.648 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.648 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:32:00.648 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:32:00.648 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:00.648 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:00.648 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:00.648 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.648 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.648 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:32:00.648 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:32:00.648 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:00.648 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:00.649 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.649 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:00.649 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:32:00.649 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:00.649 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.649 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.649 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:00.649 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:32:00.649 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:00.649 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:00.649 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:00.649 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.649 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:32:00.649 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:32:00.650 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:00.650 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:00.650 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:00.650 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.650 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.650 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:32:00.650 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:32:00.650 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:00.650 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:00.650 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.650 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:00.650 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:32:00.650 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:00.651 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.651 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.651 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:00.651 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:32:00.651 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:00.652 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:00.652 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:00.652 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.652 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:32:00.652 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:32:00.652 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:00.652 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:00.652 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:00.652 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:00.652 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:00.652 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.652 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:32:00.652 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:32:00.653 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.653 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:00.653 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:00.653 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:32:00.653 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:00.653 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:00.653 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:32:00.653 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.653 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:00.653 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:00.653 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:32:00.653 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:00.653 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:00.653 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:32:00.654 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.654 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:00.654 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:00.654 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:32:00.654 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:00.654 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:00.654 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:32:00.654 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.654 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:00.654 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:00.654 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:32:00.654 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:00.654 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:00.654 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:32:00.655 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:00.655 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:00.655 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:00.655 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:32:00.655 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:00.655 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:00.655 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:00.655 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:32:00.655 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:32:00.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.639+0000 7f0aa1ed2640 1 -- 172.21.15.100:0/2675180484 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0a8006b8a0 msgr2=0x7f0a8006dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:00.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.639+0000 7f0aa1ed2640 1 --2- 172.21.15.100:0/2675180484 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0a8006b8a0 0x7f0a8006dd60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0a8800c5c0 tx=0x7f0a88008030 comp rx=0 tx=0).stop 2024-09-11T22:32:00.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.639+0000 7f0a9bfff640 1 -- 172.21.15.100:0/2675180484 reap_dead start 2024-09-11T22:32:00.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.639+0000 7f0aa1ed2640 1 -- 172.21.15.100:0/2675180484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a9404aea0 msgr2=0x7f0a940e7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:00.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.639+0000 7f0aa1ed2640 1 --2- 172.21.15.100:0/2675180484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a9404aea0 0x7f0a940e7700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009960 tx=0x7f0a900046c0 comp rx=0 tx=0).stop 2024-09-11T22:32:00.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.639+0000 7f0aa1ed2640 1 -- 172.21.15.100:0/2675180484 shutdown_connections 2024-09-11T22:32:00.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.639+0000 7f0aa1ed2640 1 --2- 172.21.15.100:0/2675180484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a9404aea0 0x7f0a940e7700 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:00.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.639+0000 7f0aa1ed2640 1 -- 172.21.15.100:0/2675180484 >> 172.21.15.100:0/2675180484 conn(0x7f0a9404fc80 msgr2=0x7f0a940d3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:00.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.644+0000 7f0aa1ed2640 1 -- 172.21.15.100:0/2675180484 shutdown_connections 2024-09-11T22:32:00.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:00.644+0000 7f0aa1ed2640 1 -- 172.21.15.100:0/2675180484 wait complete. 2024-09-11T22:32:00.669 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:32:00.670 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-11T22:32:20.671 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:32:20.671 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-11T22:32:20.671 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T22:32:20.672 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T22:32:20.675 INFO:tasks.ceph.mon.a:Started 2024-09-11T22:32:20.675 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:32:20.675 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:32:20.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.868+0000 7fdaa759e640 1 Processor -- start 2024-09-11T22:32:20.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.868+0000 7fdaa759e640 1 -- start start 2024-09-11T22:32:20.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.869+0000 7fdaa759e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdaa806c5a0 0x7fdaa80c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:20.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.869+0000 7fdaa759e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa80c0fe0 con 0x7fdaa80c7830 2024-09-11T22:32:20.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.869+0000 7fdaa759e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa80c12c0 con 0x7fdaa80c83e0 2024-09-11T22:32:20.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.869+0000 7fdaa759e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fdaa80c15a0 con 0x7fdaa806c5a0 2024-09-11T22:32:20.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.870+0000 7fdaa659c640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7fdaa80c7830 legacy=0x7fdaa806be90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:32:20.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.871+0000 7fdaa5d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdaa806c5a0 0x7fdaa80c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:20.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.871+0000 7fdaa5d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdaa806c5a0 0x7fdaa80c7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:34416/0 (socket says 172.21.15.100:34416) 2024-09-11T22:32:20.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.871+0000 7fdaa5d9b640 1 -- 172.21.15.100:0/3890537674 learned_addr learned my addr 172.21.15.100:0/3890537674 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:32:20.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.871+0000 7fdaa5d9b640 1 -- 172.21.15.100:0/3890537674 >> v1:172.21.15.167:6789/0 conn(0x7fdaa80c83e0 legacy=0x7fdaa8161230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:32:20.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.871+0000 7fdaa5d9b640 1 -- 172.21.15.100:0/3890537674 >> v1:172.21.15.100:6789/0 conn(0x7fdaa80c7830 legacy=0x7fdaa806be90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:32:20.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.872+0000 7fdaa5d9b640 1 -- 172.21.15.100:0/3890537674 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa80c1880 con 0x7fdaa806c5a0 2024-09-11T22:32:20.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.874+0000 7fdaa5d9b640 1 --2- 172.21.15.100:0/3890537674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdaa806c5a0 0x7fdaa80c7c10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009870 tx=0x7fda9c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cab10479ac78d805 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:20.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.878+0000 7fdaa559a640 1 -- 172.21.15.100:0/3890537674 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c037070 con 0x7fdaa806c5a0 2024-09-11T22:32:20.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.878+0000 7fdaa559a640 1 -- 172.21.15.100:0/3890537674 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda9c032440 con 0x7fdaa806c5a0 2024-09-11T22:32:20.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.878+0000 7fdaa559a640 1 -- 172.21.15.100:0/3890537674 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c032810 con 0x7fdaa806c5a0 2024-09-11T22:32:20.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.879+0000 7fdaa759e640 1 -- 172.21.15.100:0/3890537674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdaa806c5a0 msgr2=0x7fdaa80c7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:20.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.879+0000 7fdaa759e640 1 --2- 172.21.15.100:0/3890537674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdaa806c5a0 0x7fdaa80c7c10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009870 tx=0x7fda9c02a1c0 comp rx=0 tx=0).stop 2024-09-11T22:32:20.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.885+0000 7fdaa759e640 1 -- 172.21.15.100:0/3890537674 shutdown_connections 2024-09-11T22:32:20.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.885+0000 7fdaa759e640 1 --2- 172.21.15.100:0/3890537674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdaa806c5a0 0x7fdaa80c7c10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:20.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.885+0000 7fdaa759e640 1 -- 172.21.15.100:0/3890537674 >> 172.21.15.100:0/3890537674 conn(0x7fdaa806ee10 msgr2=0x7fdaa806f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:20.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.891+0000 7fdaa759e640 1 -- 172.21.15.100:0/3890537674 shutdown_connections 2024-09-11T22:32:20.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.892+0000 7fdaa759e640 1 -- 172.21.15.100:0/3890537674 wait complete. 2024-09-11T22:32:20.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.894+0000 7fdaa759e640 1 Processor -- start 2024-09-11T22:32:20.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.896+0000 7fdaa759e640 1 -- start start 2024-09-11T22:32:20.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.897+0000 7fdaa759e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdaa80c7830 0x7fdaa8149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:20.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.897+0000 7fdaa759e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaa80c83e0 0x7fdaa814a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:20.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.897+0000 7fdaa759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdaa8152dd0 0x7fdaa8153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:20.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.897+0000 7fdaa759e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa8150c20 con 0x7fdaa80c83e0 2024-09-11T22:32:20.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.897+0000 7fdaa759e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa80c2200 con 0x7fdaa8152dd0 2024-09-11T22:32:20.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.897+0000 7fdaa759e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa8150da0 con 0x7fdaa80c7830 2024-09-11T22:32:20.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.897+0000 7fdaa5d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaa80c83e0 0x7fdaa814a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:20.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.897+0000 7fdaa6d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdaa8152dd0 0x7fdaa8153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:20.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.897+0000 7fdaa5d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaa80c83e0 0x7fdaa814a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35766/0 (socket says 172.21.15.100:35766) 2024-09-11T22:32:20.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.897+0000 7fdaa5d9b640 1 -- 172.21.15.100:0/2975226697 learned_addr learned my addr 172.21.15.100:0/2975226697 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:32:20.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.897+0000 7fdaa5d9b640 1 -- 172.21.15.100:0/2975226697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaa80c83e0 msgr2=0x7fdaa814a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-11T22:32:20.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.897+0000 7fdaa5d9b640 1 -- 172.21.15.100:0/2975226697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaa80c83e0 msgr2=0x7fdaa814a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:32:20.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.897+0000 7fdaa5d9b640 1 --2- 172.21.15.100:0/2975226697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaa80c83e0 0x7fdaa814a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:32:20.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.897+0000 7fdaa5d9b640 1 --2- 172.21.15.100:0/2975226697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaa80c83e0 0x7fdaa814a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:32:20.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.897+0000 7fdaa659c640 1 --2- 172.21.15.100:0/2975226697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdaa80c7830 0x7fdaa8149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:20.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.898+0000 7fdaa6d9d640 1 -- 172.21.15.100:0/2975226697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdaa80c7830 msgr2=0x7fdaa8149f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:20.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.898+0000 7fdaa6d9d640 1 --2- 172.21.15.100:0/2975226697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdaa80c7830 0x7fdaa8149f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:20.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.898+0000 7fdaa6d9d640 1 -- 172.21.15.100:0/2975226697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaa80c83e0 msgr2=0x7fdaa814a470 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:32:20.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.899+0000 7fdaa6d9d640 1 --2- 172.21.15.100:0/2975226697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaa80c83e0 0x7fdaa814a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:20.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.899+0000 7fdaa6d9d640 1 -- 172.21.15.100:0/2975226697 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa81537a0 con 0x7fdaa8152dd0 2024-09-11T22:32:20.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.900+0000 7fdaa6d9d640 1 --2- 172.21.15.100:0/2975226697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdaa8152dd0 0x7fdaa8153260 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdaa000be20 tx=0x7fdaa0009ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:20.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.901+0000 7fda96ffd640 1 -- 172.21.15.100:0/2975226697 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0019070 con 0x7fdaa8152dd0 2024-09-11T22:32:20.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.901+0000 7fdaa759e640 1 -- 172.21.15.100:0/2975226697 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa8147940 con 0x7fdaa8152dd0 2024-09-11T22:32:20.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.901+0000 7fdaa759e640 1 -- 172.21.15.100:0/2975226697 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa81493d0 con 0x7fdaa8152dd0 2024-09-11T22:32:20.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.901+0000 7fda96ffd640 1 -- 172.21.15.100:0/2975226697 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaa000cdb0 con 0x7fdaa8152dd0 2024-09-11T22:32:20.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.901+0000 7fda96ffd640 1 -- 172.21.15.100:0/2975226697 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0014680 con 0x7fdaa8152dd0 2024-09-11T22:32:20.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.906+0000 7fda96ffd640 1 -- 172.21.15.100:0/2975226697 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdaa001c070 con 0x7fdaa8152dd0 2024-09-11T22:32:20.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.907+0000 7fdaa759e640 1 -- 172.21.15.100:0/2975226697 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda8c005290 con 0x7fdaa8152dd0 2024-09-11T22:32:20.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.907+0000 7fda96ffd640 1 --2- 172.21.15.100:0/2975226697 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fda8806bf00 0x7fda8806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.907+0000 7fda96ffd640 1 -- 172.21.15.100:0/2975226697 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fdaa008b170 con 0x7fdaa8152dd0 2024-09-11T22:32:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.907+0000 7fdaa659c640 1 --2- 172.21.15.100:0/2975226697 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fda8806bf00 0x7fda8806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:20.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.908+0000 7fdaa659c640 1 --2- 172.21.15.100:0/2975226697 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fda8806bf00 0x7fda8806e3c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fda98003980 tx=0x7fda98009110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:20.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:20.916+0000 7fda96ffd640 1 -- 172.21.15.100:0/2975226697 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdaa00596e0 con 0x7fdaa8152dd0 2024-09-11T22:32:21.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:21.443+0000 7fdaa759e640 1 -- 172.21.15.100:0/2975226697 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fda8c005580 con 0x7fdaa8152dd0 2024-09-11T22:32:21.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:21.444+0000 7fda96ffd640 1 -- 172.21.15.100:0/2975226697 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7fdaa0058fe0 con 0x7fdaa8152dd0 2024-09-11T22:32:21.446 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":84,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:32:21.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:21.448+0000 7fdaa759e640 1 -- 172.21.15.100:0/2975226697 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fda8806bf00 msgr2=0x7fda8806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:21.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:21.448+0000 7fdaa759e640 1 --2- 172.21.15.100:0/2975226697 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fda8806bf00 0x7fda8806e3c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fda98003980 tx=0x7fda98009110 comp rx=0 tx=0).stop 2024-09-11T22:32:21.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:21.448+0000 7fdaa759e640 1 -- 172.21.15.100:0/2975226697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdaa8152dd0 msgr2=0x7fdaa8153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:21.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:21.448+0000 7fdaa759e640 1 --2- 172.21.15.100:0/2975226697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdaa8152dd0 0x7fdaa8153260 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdaa000be20 tx=0x7fdaa0009ef0 comp rx=0 tx=0).stop 2024-09-11T22:32:21.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:21.448+0000 7fdaa759e640 1 -- 172.21.15.100:0/2975226697 shutdown_connections 2024-09-11T22:32:21.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:21.448+0000 7fdaa759e640 1 --2- 172.21.15.100:0/2975226697 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fda8806bf00 0x7fda8806e3c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:21.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:21.448+0000 7fdaa759e640 1 --2- 172.21.15.100:0/2975226697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdaa8152dd0 0x7fdaa8153260 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:21.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:21.448+0000 7fdaa759e640 1 --2- 172.21.15.100:0/2975226697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaa80c83e0 0x7fdaa814a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:21.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:21.448+0000 7fdaa759e640 1 --2- 172.21.15.100:0/2975226697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdaa80c7830 0x7fdaa8149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:21.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:21.448+0000 7fdaa759e640 1 -- 172.21.15.100:0/2975226697 >> 172.21.15.100:0/2975226697 conn(0x7fdaa806ee10 msgr2=0x7fdaa814fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:21.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:21.449+0000 7fdaa759e640 1 -- 172.21.15.100:0/2975226697 shutdown_connections 2024-09-11T22:32:21.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:21.449+0000 7fdaa759e640 1 -- 172.21.15.100:0/2975226697 wait complete. 2024-09-11T22:32:22.876 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:32:22.879 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:32:24.476 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:32:24.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:24.683+0000 7fa6822a8640 1 Processor -- start 2024-09-11T22:32:24.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:24.684+0000 7fa6822a8640 1 -- start start 2024-09-11T22:32:24.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:24.685+0000 7fa6822a8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa67404c080 0x7fa6740dad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:24.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:24.685+0000 7fa6822a8640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67404aa30 con 0x7fa6740450e0 2024-09-11T22:32:24.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:24.685+0000 7fa6822a8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67404acd0 con 0x7fa6740d4930 2024-09-11T22:32:24.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:24.685+0000 7fa6822a8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fa674044c50 con 0x7fa67404c080 2024-09-11T22:32:24.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:24.685+0000 7fa680aa5640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa6740450e0 0x7fa6740da670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38682/0 (socket says 172.21.15.100:38682) 2024-09-11T22:32:24.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:24.685+0000 7fa680aa5640 1 -- 172.21.15.100:0/1140657382 learned_addr learned my addr 172.21.15.100:0/1140657382 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:32:24.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:24.686+0000 7fa681aa7640 1 --2- 172.21.15.100:0/1140657382 >> v2:172.21.15.167:3300/0 conn(0x7fa67404c080 0x7fa6740dad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:24.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:24.686+0000 7fa681aa7640 1 -- 172.21.15.100:0/1140657382 >> v2:172.21.15.167:3300/0 conn(0x7fa67404c080 msgr2=0x7fa6740dad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:32:24.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:24.686+0000 7fa681aa7640 1 -- 172.21.15.100:0/1140657382 >> v2:172.21.15.167:3300/0 conn(0x7fa67404c080 msgr2=0x7fa6740dad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:32:24.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:24.686+0000 7fa681aa7640 1 --2- 172.21.15.100:0/1140657382 >> v2:172.21.15.167:3300/0 conn(0x7fa67404c080 0x7fa6740dad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:32:24.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:24.686+0000 7fa681aa7640 1 --2- 172.21.15.100:0/1140657382 >> v2:172.21.15.167:3300/0 conn(0x7fa67404c080 0x7fa6740dad80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:32:24.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:24.888+0000 7fa681aa7640 1 --2- 172.21.15.100:0/1140657382 >> v2:172.21.15.167:3300/0 conn(0x7fa67404c080 0x7fa6740dad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:24.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:24.889+0000 7fa681aa7640 1 -- 172.21.15.100:0/1140657382 >> v2:172.21.15.167:3300/0 conn(0x7fa67404c080 msgr2=0x7fa6740dad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:32:24.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:24.889+0000 7fa681aa7640 1 -- 172.21.15.100:0/1140657382 >> v2:172.21.15.167:3300/0 conn(0x7fa67404c080 msgr2=0x7fa6740dad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:32:24.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:24.889+0000 7fa681aa7640 1 --2- 172.21.15.100:0/1140657382 >> v2:172.21.15.167:3300/0 conn(0x7fa67404c080 0x7fa6740dad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:32:24.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:24.889+0000 7fa681aa7640 1 --2- 172.21.15.100:0/1140657382 >> v2:172.21.15.167:3300/0 conn(0x7fa67404c080 0x7fa6740dad80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:32:25.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:25.290+0000 7fa681aa7640 1 --2- 172.21.15.100:0/1140657382 >> v2:172.21.15.167:3300/0 conn(0x7fa67404c080 0x7fa6740dad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:25.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:25.290+0000 7fa681aa7640 1 -- 172.21.15.100:0/1140657382 >> v2:172.21.15.167:3300/0 conn(0x7fa67404c080 msgr2=0x7fa6740dad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:32:25.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:25.290+0000 7fa681aa7640 1 -- 172.21.15.100:0/1140657382 >> v2:172.21.15.167:3300/0 conn(0x7fa67404c080 msgr2=0x7fa6740dad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:32:25.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:25.290+0000 7fa681aa7640 1 --2- 172.21.15.100:0/1140657382 >> v2:172.21.15.167:3300/0 conn(0x7fa67404c080 0x7fa6740dad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:32:25.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:25.290+0000 7fa681aa7640 1 --2- 172.21.15.100:0/1140657382 >> v2:172.21.15.167:3300/0 conn(0x7fa67404c080 0x7fa6740dad80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:32:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:26.091+0000 7fa681aa7640 1 --2- 172.21.15.100:0/1140657382 >> v2:172.21.15.167:3300/0 conn(0x7fa67404c080 0x7fa6740dad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:26.092+0000 7fa681aa7640 1 -- 172.21.15.100:0/1140657382 >> v2:172.21.15.167:3300/0 conn(0x7fa67404c080 msgr2=0x7fa6740dad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:32:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:26.092+0000 7fa681aa7640 1 -- 172.21.15.100:0/1140657382 >> v2:172.21.15.167:3300/0 conn(0x7fa67404c080 msgr2=0x7fa6740dad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:32:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:26.092+0000 7fa681aa7640 1 --2- 172.21.15.100:0/1140657382 >> v2:172.21.15.167:3300/0 conn(0x7fa67404c080 0x7fa6740dad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:32:26.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:26.092+0000 7fa681aa7640 1 --2- 172.21.15.100:0/1140657382 >> v2:172.21.15.167:3300/0 conn(0x7fa67404c080 0x7fa6740dad80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:32:27.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.127+0000 7fa673fff640 1 -- 172.21.15.100:0/1140657382 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3889222486 0 0) 0x7fa67404acd0 con 0x7fa6740d4930 2024-09-11T22:32:27.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.127+0000 7fa673fff640 1 -- 172.21.15.100:0/1140657382 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa668003520 con 0x7fa6740d4930 2024-09-11T22:32:27.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.128+0000 7fa673fff640 1 -- 172.21.15.100:0/1140657382 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2359194218 0 0) 0x7fa668003520 con 0x7fa6740d4930 2024-09-11T22:32:27.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.128+0000 7fa673fff640 1 -- 172.21.15.100:0/1140657382 >> v2:172.21.15.167:3300/0 conn(0x7fa67404c080 msgr2=0x7fa6740dad80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:32:27.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.128+0000 7fa673fff640 1 --2- 172.21.15.100:0/1140657382 >> v2:172.21.15.167:3300/0 conn(0x7fa67404c080 0x7fa6740dad80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.128+0000 7fa673fff640 1 -- 172.21.15.100:0/1140657382 >> v1:172.21.15.100:6789/0 conn(0x7fa6740450e0 legacy=0x7fa6740da670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:27.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.128+0000 7fa673fff640 1 -- 172.21.15.100:0/1140657382 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67404af90 con 0x7fa6740d4930 2024-09-11T22:32:27.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.128+0000 7fa673fff640 1 -- 172.21.15.100:0/1140657382 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fa678001670 con 0x7fa6740d4930 2024-09-11T22:32:27.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.128+0000 7fa673fff640 1 -- 172.21.15.100:0/1140657382 >> v1:172.21.15.167:6789/0 conn(0x7fa6740d4930 legacy=0x7fa6740059f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:27.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.128+0000 7fa673fff640 1 --2- 172.21.15.100:0/1140657382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6680039b0 0x7fa668003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.129+0000 7fa673fff640 1 --2- 172.21.15.100:0/1140657382 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa668004800 0x7fa668004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.129+0000 7fa673fff640 1 --2- 172.21.15.100:0/1140657382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6680051c0 0x7fa6680145c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.129+0000 7fa673fff640 1 -- 172.21.15.100:0/1140657382 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa674044c50 con 0x7fa6680051c0 2024-09-11T22:32:27.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.129+0000 7fa673fff640 1 -- 172.21.15.100:0/1140657382 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa668009c10 con 0x7fa6680039b0 2024-09-11T22:32:27.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.129+0000 7fa673fff640 1 -- 172.21.15.100:0/1140657382 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa668014b50 con 0x7fa668004800 2024-09-11T22:32:27.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.129+0000 7fa681aa7640 1 --2- 172.21.15.100:0/1140657382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6680051c0 0x7fa6680145c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.129+0000 7fa6812a6640 1 --2- 172.21.15.100:0/1140657382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6680039b0 0x7fa668003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.129+0000 7fa680aa5640 1 --2- 172.21.15.100:0/1140657382 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa668004800 0x7fa668004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.129+0000 7fa680aa5640 1 -- 172.21.15.100:0/1140657382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6680039b0 msgr2=0x7fa668003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:27.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.129+0000 7fa680aa5640 1 --2- 172.21.15.100:0/1140657382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa6680039b0 0x7fa668003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.129+0000 7fa680aa5640 1 -- 172.21.15.100:0/1140657382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6680051c0 msgr2=0x7fa6680145c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:27.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.129+0000 7fa680aa5640 1 --2- 172.21.15.100:0/1140657382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6680051c0 0x7fa6680145c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.129+0000 7fa680aa5640 1 -- 172.21.15.100:0/1140657382 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67404af90 con 0x7fa668004800 2024-09-11T22:32:27.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.130+0000 7fa681aa7640 1 -- 172.21.15.100:0/1140657382 reap_dead start 2024-09-11T22:32:27.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.131+0000 7fa680aa5640 1 --2- 172.21.15.100:0/1140657382 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa668004800 0x7fa668004c80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00a660 tx=0x7fa668005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8063ff5648be76b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:27.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.131+0000 7fa673fff640 1 -- 172.21.15.100:0/1140657382 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c058070 con 0x7fa668004800 2024-09-11T22:32:27.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.131+0000 7fa673fff640 1 -- 172.21.15.100:0/1140657382 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa66c053660 con 0x7fa668004800 2024-09-11T22:32:27.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.132+0000 7fa673fff640 1 -- 172.21.15.100:0/1140657382 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c008040 con 0x7fa668004800 2024-09-11T22:32:27.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.132+0000 7fa6822a8640 1 -- 172.21.15.100:0/1140657382 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa668004800 msgr2=0x7fa668004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:27.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.132+0000 7fa6822a8640 1 --2- 172.21.15.100:0/1140657382 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa668004800 0x7fa668004c80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00a660 tx=0x7fa668005830 comp rx=0 tx=0).stop 2024-09-11T22:32:27.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.133+0000 7fa6822a8640 1 -- 172.21.15.100:0/1140657382 shutdown_connections 2024-09-11T22:32:27.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.133+0000 7fa6822a8640 1 --2- 172.21.15.100:0/1140657382 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa668004800 0x7fa668004c80 secure :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00a660 tx=0x7fa668005830 comp rx=0 tx=0).stop 2024-09-11T22:32:27.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.133+0000 7fa6822a8640 1 -- 172.21.15.100:0/1140657382 >> 172.21.15.100:0/1140657382 conn(0x7fa67404fc40 msgr2=0x7fa674050050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:27.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.133+0000 7fa6822a8640 1 -- 172.21.15.100:0/1140657382 shutdown_connections 2024-09-11T22:32:27.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.133+0000 7fa6822a8640 1 -- 172.21.15.100:0/1140657382 wait complete. 2024-09-11T22:32:27.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.135+0000 7fa6822a8640 1 Processor -- start 2024-09-11T22:32:27.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.135+0000 7fa6822a8640 1 -- start start 2024-09-11T22:32:27.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.136+0000 7fa6822a8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa67404e750 0x7fa6740de540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.136+0000 7fa6822a8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa67404eb30 0x7fa6740c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.136+0000 7fa6812a6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa67404e750 0x7fa6740de540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.136+0000 7fa6812a6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa67404e750 0x7fa6740de540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:36380/0 (socket says 172.21.15.100:36380) 2024-09-11T22:32:27.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.136+0000 7fa6812a6640 1 -- 172.21.15.100:0/1681900767 learned_addr learned my addr 172.21.15.100:0/1681900767 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:32:27.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.137+0000 7fa6822a8640 1 --2- 172.21.15.100:0/1681900767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6740d4fe0 0x7fa6740c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.137+0000 7fa6822a8640 1 -- 172.21.15.100:0/1681900767 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa67404b2d0 con 0x7fa6740d4fe0 2024-09-11T22:32:27.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.137+0000 7fa6822a8640 1 -- 172.21.15.100:0/1681900767 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa674046760 con 0x7fa67404eb30 2024-09-11T22:32:27.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.137+0000 7fa6822a8640 1 -- 172.21.15.100:0/1681900767 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa6740d4d10 con 0x7fa67404e750 2024-09-11T22:32:27.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.137+0000 7fa6812a6640 1 -- 172.21.15.100:0/1681900767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa67404eb30 msgr2=0x7fa6740c8560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:32:27.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.137+0000 7fa6812a6640 1 --2- 172.21.15.100:0/1681900767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa67404eb30 0x7fa6740c8560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.137+0000 7fa6812a6640 1 -- 172.21.15.100:0/1681900767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6740d4fe0 msgr2=0x7fa6740c8aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:32:27.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.137+0000 7fa681aa7640 1 --2- 172.21.15.100:0/1681900767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6740d4fe0 0x7fa6740c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.137+0000 7fa6812a6640 1 --2- 172.21.15.100:0/1681900767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6740d4fe0 0x7fa6740c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.137+0000 7fa6812a6640 1 -- 172.21.15.100:0/1681900767 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6740470e0 con 0x7fa67404e750 2024-09-11T22:32:27.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.138+0000 7fa681aa7640 1 --2- 172.21.15.100:0/1681900767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6740d4fe0 0x7fa6740c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:32:27.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.138+0000 7fa6812a6640 1 --2- 172.21.15.100:0/1681900767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa67404e750 0x7fa6740de540 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa678007fd0 tx=0x7fa67800ff70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:27.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.138+0000 7fa671ffb640 1 -- 172.21.15.100:0/1681900767 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6780052e0 con 0x7fa67404e750 2024-09-11T22:32:27.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.138+0000 7fa6822a8640 1 -- 172.21.15.100:0/1681900767 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa674047380 con 0x7fa67404e750 2024-09-11T22:32:27.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.140+0000 7fa6822a8640 1 -- 172.21.15.100:0/1681900767 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6740d6b90 con 0x7fa67404e750 2024-09-11T22:32:27.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.141+0000 7fa671ffb640 1 -- 172.21.15.100:0/1681900767 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa678018070 con 0x7fa67404e750 2024-09-11T22:32:27.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.144+0000 7fa671ffb640 1 -- 172.21.15.100:0/1681900767 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67800d8d0 con 0x7fa67404e750 2024-09-11T22:32:27.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.144+0000 7fa6822a8640 1 -- 172.21.15.100:0/1681900767 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa65c005290 con 0x7fa67404e750 2024-09-11T22:32:27.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.144+0000 7fa671ffb640 1 -- 172.21.15.100:0/1681900767 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa67800dab0 con 0x7fa67404e750 2024-09-11T22:32:27.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.145+0000 7fa671ffb640 1 --2- 172.21.15.100:0/1681900767 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa66006bf60 0x7fa66006e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.145+0000 7fa671ffb640 1 -- 172.21.15.100:0/1681900767 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fa67808b730 con 0x7fa67404e750 2024-09-11T22:32:27.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.145+0000 7fa680aa5640 1 --2- 172.21.15.100:0/1681900767 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa66006bf60 0x7fa66006e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.146+0000 7fa680aa5640 1 --2- 172.21.15.100:0/1681900767 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa66006bf60 0x7fa66006e420 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa66c055000 tx=0x7fa66c051000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:27.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.152+0000 7fa671ffb640 1 -- 172.21.15.100:0/1681900767 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa678059d30 con 0x7fa67404e750 2024-09-11T22:32:27.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.672+0000 7fa6822a8640 1 -- 172.21.15.100:0/1681900767 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa65c005580 con 0x7fa67404e750 2024-09-11T22:32:27.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.674+0000 7fa671ffb640 1 -- 172.21.15.100:0/1681900767 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7fa678059630 con 0x7fa67404e750 2024-09-11T22:32:27.675 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":88,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:32:27.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.678+0000 7fa6822a8640 1 -- 172.21.15.100:0/1681900767 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa66006bf60 msgr2=0x7fa66006e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:27.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.678+0000 7fa6822a8640 1 --2- 172.21.15.100:0/1681900767 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa66006bf60 0x7fa66006e420 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa66c055000 tx=0x7fa66c051000 comp rx=0 tx=0).stop 2024-09-11T22:32:27.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.678+0000 7fa6822a8640 1 -- 172.21.15.100:0/1681900767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa67404e750 msgr2=0x7fa6740de540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:27.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.678+0000 7fa6822a8640 1 --2- 172.21.15.100:0/1681900767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa67404e750 0x7fa6740de540 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa678007fd0 tx=0x7fa67800ff70 comp rx=0 tx=0).stop 2024-09-11T22:32:27.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.678+0000 7fa6822a8640 1 -- 172.21.15.100:0/1681900767 shutdown_connections 2024-09-11T22:32:27.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.678+0000 7fa6822a8640 1 --2- 172.21.15.100:0/1681900767 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa66006bf60 0x7fa66006e420 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.679+0000 7fa6822a8640 1 --2- 172.21.15.100:0/1681900767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6740d4fe0 0x7fa6740c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.679+0000 7fa6822a8640 1 --2- 172.21.15.100:0/1681900767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa67404eb30 0x7fa6740c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.679+0000 7fa6822a8640 1 --2- 172.21.15.100:0/1681900767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa67404e750 0x7fa6740de540 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.679+0000 7fa6822a8640 1 -- 172.21.15.100:0/1681900767 >> 172.21.15.100:0/1681900767 conn(0x7fa67404fc40 msgr2=0x7fa6740d36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:27.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.679+0000 7fa6822a8640 1 -- 172.21.15.100:0/1681900767 shutdown_connections 2024-09-11T22:32:27.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.679+0000 7fa6822a8640 1 -- 172.21.15.100:0/1681900767 wait complete. 2024-09-11T22:32:27.701 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:32:27.701 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:32:27.701 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:32:27.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.884+0000 7f451483b640 1 Processor -- start 2024-09-11T22:32:27.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.884+0000 7f451483b640 1 -- start start 2024-09-11T22:32:27.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.885+0000 7f451483b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4508005a00 0x7f45080da540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.885+0000 7f451483b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4508034250 0x7f450804ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.885+0000 7f451483b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4508005fd0 con 0x7f4508050770 2024-09-11T22:32:27.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.885+0000 7f451483b640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f4508032c10 con 0x7f4508005a00 2024-09-11T22:32:27.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.885+0000 7f451483b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f45080062b0 con 0x7f4508034250 2024-09-11T22:32:27.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.886+0000 7f450ed9d640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f4508050770 0x7f45080d4380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:57990/0 (socket says 172.21.15.100:57990) 2024-09-11T22:32:27.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.886+0000 7f450ed9d640 1 -- 172.21.15.100:0/2496044333 learned_addr learned my addr 172.21.15.100:0/2496044333 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:32:27.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.886+0000 7f450dd9b640 1 -- 172.21.15.100:0/2496044333 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1469290921 0 0) 0x7f4508005fd0 con 0x7f4508050770 2024-09-11T22:32:27.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.886+0000 7f450dd9b640 1 -- 172.21.15.100:0/2496044333 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44f8003520 con 0x7f4508050770 2024-09-11T22:32:27.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.886+0000 7f450f59e640 1 --2- 172.21.15.100:0/2496044333 >> v2:172.21.15.167:3300/0 conn(0x7f4508034250 0x7f450804ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.887+0000 7f450e59c640 1 --2- 172.21.15.100:0/2496044333 >> v2:172.21.15.100:3300/0 conn(0x7f4508005a00 0x7f45080da540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.887+0000 7f450dd9b640 1 -- 172.21.15.100:0/2496044333 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 508851116 0 0) 0x7f44f8003520 con 0x7f4508050770 2024-09-11T22:32:27.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.887+0000 7f450dd9b640 1 -- 172.21.15.100:0/2496044333 >> v2:172.21.15.167:3300/0 conn(0x7f4508034250 msgr2=0x7f450804ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:27.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.887+0000 7f450dd9b640 1 --2- 172.21.15.100:0/2496044333 >> v2:172.21.15.167:3300/0 conn(0x7f4508034250 0x7f450804ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.887+0000 7f450dd9b640 1 -- 172.21.15.100:0/2496044333 >> v2:172.21.15.100:3300/0 conn(0x7f4508005a00 msgr2=0x7f45080da540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:27.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.887+0000 7f450dd9b640 1 --2- 172.21.15.100:0/2496044333 >> v2:172.21.15.100:3300/0 conn(0x7f4508005a00 0x7f45080da540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.887+0000 7f450dd9b640 1 -- 172.21.15.100:0/2496044333 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4508006590 con 0x7f4508050770 2024-09-11T22:32:27.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.887+0000 7f450dd9b640 1 -- 172.21.15.100:0/2496044333 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f4510063850 con 0x7f4508050770 2024-09-11T22:32:27.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.887+0000 7f450dd9b640 1 -- 172.21.15.100:0/2496044333 >> v1:172.21.15.167:6789/0 conn(0x7f4508050770 legacy=0x7f45080d4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:27.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.887+0000 7f450dd9b640 1 --2- 172.21.15.100:0/2496044333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44f80039b0 0x7f44f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.887+0000 7f450dd9b640 1 --2- 172.21.15.100:0/2496044333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44f8004800 0x7f44f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.887+0000 7f450dd9b640 1 --2- 172.21.15.100:0/2496044333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44f80051c0 0x7f44f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.887+0000 7f450dd9b640 1 -- 172.21.15.100:0/2496044333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4508032c10 con 0x7f44f80039b0 2024-09-11T22:32:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.887+0000 7f450dd9b640 1 -- 172.21.15.100:0/2496044333 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f45080062b0 con 0x7f44f8004800 2024-09-11T22:32:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.887+0000 7f450dd9b640 1 -- 172.21.15.100:0/2496044333 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f44f800c140 con 0x7f44f80051c0 2024-09-11T22:32:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.887+0000 7f450f59e640 1 --2- 172.21.15.100:0/2496044333 >> v2:172.21.15.167:3300/0 conn(0x7f4508034250 0x7f450804ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:32:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.887+0000 7f450ed9d640 1 --2- 172.21.15.100:0/2496044333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44f80039b0 0x7f44f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.888+0000 7f450e59c640 1 --2- 172.21.15.100:0/2496044333 >> v2:172.21.15.100:3300/0 conn(0x7f4508005a00 0x7f45080da540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:32:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.888+0000 7f450ed9d640 1 -- 172.21.15.100:0/2496044333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44f80051c0 msgr2=0x7f44f800b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:32:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.888+0000 7f450ed9d640 1 --2- 172.21.15.100:0/2496044333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f44f80051c0 0x7f44f800b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.888+0000 7f450ed9d640 1 -- 172.21.15.100:0/2496044333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44f8004800 msgr2=0x7f44f8004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:32:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.888+0000 7f450ed9d640 1 --2- 172.21.15.100:0/2496044333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44f8004800 0x7f44f8004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.888+0000 7f450ed9d640 1 -- 172.21.15.100:0/2496044333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f8003520 con 0x7f44f80039b0 2024-09-11T22:32:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.889+0000 7f450f59e640 1 -- 172.21.15.100:0/2496044333 reap_dead start 2024-09-11T22:32:27.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.889+0000 7f450ed9d640 1 --2- 172.21.15.100:0/2496044333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44f80039b0 0x7f44f8003dd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f451006b3b0 tx=0x7f44f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10920bf40655a32e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:27.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.889+0000 7f450dd9b640 1 -- 172.21.15.100:0/2496044333 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45100b4070 con 0x7f44f80039b0 2024-09-11T22:32:27.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.889+0000 7f450dd9b640 1 -- 172.21.15.100:0/2496044333 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45100a7c00 con 0x7f44f80039b0 2024-09-11T22:32:27.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.889+0000 7f450dd9b640 1 -- 172.21.15.100:0/2496044333 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451006a120 con 0x7f44f80039b0 2024-09-11T22:32:27.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.890+0000 7f451483b640 1 -- 172.21.15.100:0/2496044333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44f80039b0 msgr2=0x7f44f8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:27.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.890+0000 7f451483b640 1 --2- 172.21.15.100:0/2496044333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44f80039b0 0x7f44f8003dd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f451006b3b0 tx=0x7f44f8005830 comp rx=0 tx=0).stop 2024-09-11T22:32:27.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.892+0000 7f451483b640 1 -- 172.21.15.100:0/2496044333 shutdown_connections 2024-09-11T22:32:27.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.892+0000 7f451483b640 1 --2- 172.21.15.100:0/2496044333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44f80039b0 0x7f44f8003dd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.892+0000 7f451483b640 1 -- 172.21.15.100:0/2496044333 >> 172.21.15.100:0/2496044333 conn(0x7f450804fc50 msgr2=0x7f4508050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:27.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.892+0000 7f451483b640 1 -- 172.21.15.100:0/2496044333 shutdown_connections 2024-09-11T22:32:27.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.892+0000 7f451483b640 1 -- 172.21.15.100:0/2496044333 wait complete. 2024-09-11T22:32:27.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.894+0000 7f451483b640 1 Processor -- start 2024-09-11T22:32:27.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.895+0000 7f451483b640 1 -- start start 2024-09-11T22:32:27.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.896+0000 7f451483b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44f80039b0 0x7f45080cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.896+0000 7f451483b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f450804f350 0x7f45080d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.897+0000 7f451483b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080ccfd0 0x7f45080cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.897+0000 7f451483b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4508006e30 con 0x7f45080ccfd0 2024-09-11T22:32:27.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.897+0000 7f451483b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4508006b50 con 0x7f44f80039b0 2024-09-11T22:32:27.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.897+0000 7f451483b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f450804a5d0 con 0x7f450804f350 2024-09-11T22:32:27.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.897+0000 7f450ed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44f80039b0 0x7f45080cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.897+0000 7f450ed9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44f80039b0 0x7f45080cbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:35296/0 (socket says 172.21.15.100:35296) 2024-09-11T22:32:27.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.897+0000 7f450ed9d640 1 -- 172.21.15.100:0/2395457839 learned_addr learned my addr 172.21.15.100:0/2395457839 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:32:27.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.897+0000 7f450f59e640 1 --2- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080ccfd0 0x7f45080cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.898+0000 7f450f59e640 1 -- 172.21.15.100:0/2395457839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f450804f350 msgr2=0x7f45080d00e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:32:27.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.898+0000 7f450f59e640 1 --2- 172.21.15.100:0/2395457839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f450804f350 0x7f45080d00e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.898+0000 7f450f59e640 1 -- 172.21.15.100:0/2395457839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44f80039b0 msgr2=0x7f45080cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:27.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.898+0000 7f450f59e640 1 --2- 172.21.15.100:0/2395457839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44f80039b0 0x7f45080cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.898+0000 7f450f59e640 1 -- 172.21.15.100:0/2395457839 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45080cd990 con 0x7f45080ccfd0 2024-09-11T22:32:27.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.898+0000 7f450f59e640 1 --2- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080ccfd0 0x7f45080cd450 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f450800d4e0 tx=0x7f450000e830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:27.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.899+0000 7f44f77fe640 1 -- 172.21.15.100:0/2395457839 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450001a070 con 0x7f45080ccfd0 2024-09-11T22:32:27.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.899+0000 7f44f77fe640 1 -- 172.21.15.100:0/2395457839 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4500004230 con 0x7f45080ccfd0 2024-09-11T22:32:27.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.899+0000 7f451483b640 1 -- 172.21.15.100:0/2395457839 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f450804e5e0 con 0x7f45080ccfd0 2024-09-11T22:32:27.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.899+0000 7f44f77fe640 1 -- 172.21.15.100:0/2395457839 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450000f040 con 0x7f45080ccfd0 2024-09-11T22:32:27.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.899+0000 7f451483b640 1 -- 172.21.15.100:0/2395457839 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f450804eba0 con 0x7f45080ccfd0 2024-09-11T22:32:27.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.902+0000 7f44f77fe640 1 -- 172.21.15.100:0/2395457839 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f450001d070 con 0x7f45080ccfd0 2024-09-11T22:32:27.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.902+0000 7f44f77fe640 1 --2- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f44fc06be30 0x7f44fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.903+0000 7f44f77fe640 1 -- 172.21.15.100:0/2395457839 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f4500089dc0 con 0x7f45080ccfd0 2024-09-11T22:32:27.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.903+0000 7f450ed9d640 1 --2- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f44fc06be30 0x7f44fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.903+0000 7f44f57fa640 1 --2- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080cc730 0x7f45080c3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.903+0000 7f44f57fa640 1 -- 172.21.15.100:0/2395457839 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f45080cccf0 con 0x7f45080cc730 2024-09-11T22:32:27.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.903+0000 7f450e59c640 1 --2- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080cc730 0x7f45080c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.904+0000 7f450e59c640 1 -- 172.21.15.100:0/2395457839 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4508046470 con 0x7f45080cc730 2024-09-11T22:32:27.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.904+0000 7f450e59c640 1 --2- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080cc730 0x7f45080c3890 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f450804f2e0 tx=0x7f450400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:27.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.905+0000 7f44f77fe640 1 -- 172.21.15.100:0/2395457839 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4504015020 con 0x7f45080cc730 2024-09-11T22:32:27.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.905+0000 7f450ed9d640 1 --2- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f44fc06be30 0x7f44fc06e2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f451006b3b0 tx=0x7f45100ab000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:27.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.907+0000 7f44f77fe640 1 -- 172.21.15.100:0/2395457839 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f4504004440 con 0x7f45080cc730 2024-09-11T22:32:27.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.907+0000 7f44f77fe640 1 -- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080cc730 msgr2=0x7f45080c3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:27.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.907+0000 7f44f77fe640 1 --2- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080cc730 0x7f45080c3890 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f450804f2e0 tx=0x7f450400c950 comp rx=0 tx=0).stop 2024-09-11T22:32:27.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.907+0000 7f44f77fe640 1 -- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080cc730 msgr2=0x7f45080c3890 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:32:27.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.907+0000 7f44f77fe640 1 --2- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080cc730 0x7f45080c3890 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f450804f2e0 tx=0x7f450400c950 comp rx=0 tx=0).stop 2024-09-11T22:32:27.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.926+0000 7f44f57fa640 1 --2- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080c9a60 0x7f45080c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:27.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.926+0000 7f44f57fa640 1 -- 172.21.15.100:0/2395457839 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4508034660 con 0x7f45080c9a60 2024-09-11T22:32:27.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.926+0000 7f450e59c640 1 --2- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080c9a60 0x7f45080c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:27.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.927+0000 7f450e59c640 1 -- 172.21.15.100:0/2395457839 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f450804f730 con 0x7f45080c9a60 2024-09-11T22:32:27.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.927+0000 7f450e59c640 1 --2- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080c9a60 0x7f45080c9e70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f450804f2e0 tx=0x7f4504004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.928+0000 7f44f77fe640 1 -- 172.21.15.100:0/2395457839 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4504015020 con 0x7f45080c9a60 2024-09-11T22:32:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.928+0000 7f44f77fe640 1 -- 172.21.15.100:0/2395457839 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7f4504003c60 con 0x7f45080c9a60 2024-09-11T22:32:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.928+0000 7f44f77fe640 1 -- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080c9a60 msgr2=0x7f45080c9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.928+0000 7f44f77fe640 1 --2- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080c9a60 0x7f45080c9e70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f450804f2e0 tx=0x7f4504004730 comp rx=0 tx=0).stop 2024-09-11T22:32:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.928+0000 7f44f77fe640 1 -- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080c9a60 msgr2=0x7f45080c9e70 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:32:27.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.928+0000 7f44f77fe640 1 --2- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080c9a60 0x7f45080c9e70 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f450804f2e0 tx=0x7f4504004730 comp rx=0 tx=0).stop 2024-09-11T22:32:27.929 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:32:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:32:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:32:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:32:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 88, 2024-09-11T22:32:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 7065, 2024-09-11T22:32:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:32:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:32:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:32:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:32:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:32:27.930 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:32:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:32:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:32:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:27.931 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:27.932 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:27.932 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:32:27.932 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:32:27.932 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:27.932 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:27.932 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:27.932 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:27.932 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:27.932 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:27.932 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:27.932 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:27.932 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:32:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:32:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:32:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:32:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:32:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:32:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:32:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:32:27.933 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:32:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:32:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:32:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:32:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:32:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:32:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:32:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:32:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:32:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:27.934 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:32:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:32:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:32:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:32:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:27.935 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:32:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:32:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:32:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:32:27.936 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:32:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:32:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:32:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:27.937 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:32:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:32:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:32:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:32:27.938 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:32:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:32:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:32:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:27.939 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:27.940 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:32:27.940 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:32:27.940 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:27.940 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:27.940 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:27.940 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:27.940 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:27.940 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:32:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:32:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:32:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:32:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:27.941 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:32:27.942 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:27.942 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:27.942 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:27.942 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:32:27.942 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:32:27.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.929+0000 7f44f57fa640 1 -- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f44fc06be30 msgr2=0x7f44fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.930+0000 7f44f57fa640 1 --2- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f44fc06be30 0x7f44fc06e2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f451006b3b0 tx=0x7f45100ab000 comp rx=0 tx=0).stop 2024-09-11T22:32:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.930+0000 7f450f59e640 1 -- 172.21.15.100:0/2395457839 reap_dead start 2024-09-11T22:32:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.930+0000 7f44f57fa640 1 -- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080ccfd0 msgr2=0x7f45080cd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.930+0000 7f44f57fa640 1 --2- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080ccfd0 0x7f45080cd450 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f450800d4e0 tx=0x7f450000e830 comp rx=0 tx=0).stop 2024-09-11T22:32:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.930+0000 7f44f57fa640 1 -- 172.21.15.100:0/2395457839 shutdown_connections 2024-09-11T22:32:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.930+0000 7f44f57fa640 1 --2- 172.21.15.100:0/2395457839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45080ccfd0 0x7f45080cd450 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.930+0000 7f44f57fa640 1 -- 172.21.15.100:0/2395457839 >> 172.21.15.100:0/2395457839 conn(0x7f450804fc50 msgr2=0x7f45080d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.930+0000 7f44f57fa640 1 -- 172.21.15.100:0/2395457839 shutdown_connections 2024-09-11T22:32:27.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:27.930+0000 7f44f57fa640 1 -- 172.21.15.100:0/2395457839 wait complete. 2024-09-11T22:32:27.965 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:32:27.966 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:32:27.966 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:32:28.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.163+0000 7fa7f94ac640 1 Processor -- start 2024-09-11T22:32:28.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.163+0000 7fa7f94ac640 1 -- start start 2024-09-11T22:32:28.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.165+0000 7fa7f94ac640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa7f415c7d0 0x7fa7f415fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:28.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.165+0000 7fa7f94ac640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7f40728c0 0x7fa7f4162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:28.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.165+0000 7fa7f94ac640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f415ef90 con 0x7fa7f40c7eb0 2024-09-11T22:32:28.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.165+0000 7fa7f94ac640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fa7f4072d30 con 0x7fa7f415c7d0 2024-09-11T22:32:28.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.165+0000 7fa7f94ac640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa7f415cbb0 con 0x7fa7f40728c0 2024-09-11T22:32:28.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.165+0000 7fa7f37fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7f40728c0 0x7fa7f4162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:28.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.165+0000 7fa7f2ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa7f415c7d0 0x7fa7f415fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:28.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.165+0000 7fa7f37fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7f40728c0 0x7fa7f4162da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:36418/0 (socket says 172.21.15.100:36418) 2024-09-11T22:32:28.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.165+0000 7fa7f37fe640 1 -- 172.21.15.100:0/495808245 learned_addr learned my addr 172.21.15.100:0/495808245 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:32:28.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.166+0000 7fa7f2ffd640 1 -- 172.21.15.100:0/495808245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7f40728c0 msgr2=0x7fa7f4162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:28.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.166+0000 7fa7f2ffd640 1 --2- 172.21.15.100:0/495808245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7f40728c0 0x7fa7f4162da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.170+0000 7fa7f2ffd640 1 -- 172.21.15.100:0/495808245 >> v1:172.21.15.100:6789/0 conn(0x7fa7f40c7eb0 legacy=0x7fa7f40c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:28.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.170+0000 7fa7f2ffd640 1 -- 172.21.15.100:0/495808245 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f40c7750 con 0x7fa7f415c7d0 2024-09-11T22:32:28.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.180+0000 7fa7f2ffd640 1 --2- 172.21.15.100:0/495808245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7f415c7d0 0x7fa7f415fa30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009d90 tx=0x7fa7ec02a550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f3452976b65209b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:28.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.181+0000 7fa7f1ffb640 1 -- 172.21.15.100:0/495808245 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec007740 con 0x7fa7f415c7d0 2024-09-11T22:32:28.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.181+0000 7fa7f1ffb640 1 -- 172.21.15.100:0/495808245 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7ec0078e0 con 0x7fa7f415c7d0 2024-09-11T22:32:28.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.181+0000 7fa7f1ffb640 1 -- 172.21.15.100:0/495808245 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec007cb0 con 0x7fa7f415c7d0 2024-09-11T22:32:28.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.183+0000 7fa7f94ac640 1 -- 172.21.15.100:0/495808245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7f415c7d0 msgr2=0x7fa7f415fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:28.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.183+0000 7fa7f94ac640 1 --2- 172.21.15.100:0/495808245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7f415c7d0 0x7fa7f415fa30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009d90 tx=0x7fa7ec02a550 comp rx=0 tx=0).stop 2024-09-11T22:32:28.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.183+0000 7fa7f94ac640 1 -- 172.21.15.100:0/495808245 shutdown_connections 2024-09-11T22:32:28.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.183+0000 7fa7f94ac640 1 --2- 172.21.15.100:0/495808245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7f40728c0 0x7fa7f4162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.183+0000 7fa7f94ac640 1 --2- 172.21.15.100:0/495808245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7f415c7d0 0x7fa7f415fa30 secure :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009d90 tx=0x7fa7ec02a550 comp rx=0 tx=0).stop 2024-09-11T22:32:28.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.183+0000 7fa7f94ac640 1 -- 172.21.15.100:0/495808245 >> 172.21.15.100:0/495808245 conn(0x7fa7f406f360 msgr2=0x7fa7f406f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:28.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.184+0000 7fa7f94ac640 1 -- 172.21.15.100:0/495808245 shutdown_connections 2024-09-11T22:32:28.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.188+0000 7fa7f94ac640 1 -- 172.21.15.100:0/495808245 wait complete. 2024-09-11T22:32:28.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.190+0000 7fa7f94ac640 1 Processor -- start 2024-09-11T22:32:28.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.190+0000 7fa7f94ac640 1 -- start start 2024-09-11T22:32:28.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.191+0000 7fa7f94ac640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7f40728c0 0x7fa7f41f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:28.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.191+0000 7fa7f94ac640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7f40c7eb0 0x7fa7f415fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:28.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.191+0000 7fa7f94ac640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7f415de90 0x7fa7f4151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:28.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.191+0000 7fa7f94ac640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f40c70e0 con 0x7fa7f415de90 2024-09-11T22:32:28.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.191+0000 7fa7f94ac640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f415f510 con 0x7fa7f40728c0 2024-09-11T22:32:28.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.191+0000 7fa7f94ac640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa7f40c7a30 con 0x7fa7f40c7eb0 2024-09-11T22:32:28.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.192+0000 7fa7f27fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7f40c7eb0 0x7fa7f415fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:28.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.192+0000 7fa7f27fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7f40c7eb0 0x7fa7f415fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:36432/0 (socket says 172.21.15.100:36432) 2024-09-11T22:32:28.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.192+0000 7fa7f27fc640 1 -- 172.21.15.100:0/2049931316 learned_addr learned my addr 172.21.15.100:0/2049931316 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:32:28.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.192+0000 7fa7f2ffd640 1 --2- 172.21.15.100:0/2049931316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7f40728c0 0x7fa7f41f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:28.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.193+0000 7fa7f27fc640 1 -- 172.21.15.100:0/2049931316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7f40728c0 msgr2=0x7fa7f41f5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:28.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.193+0000 7fa7f27fc640 1 --2- 172.21.15.100:0/2049931316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7f40728c0 0x7fa7f41f5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.193+0000 7fa7f27fc640 1 -- 172.21.15.100:0/2049931316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7f415de90 msgr2=0x7fa7f4151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:28.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.193+0000 7fa7f27fc640 1 --2- 172.21.15.100:0/2049931316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7f415de90 0x7fa7f4151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.193+0000 7fa7f27fc640 1 -- 172.21.15.100:0/2049931316 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f41f8100 con 0x7fa7f40c7eb0 2024-09-11T22:32:28.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.194+0000 7fa7f27fc640 1 --2- 172.21.15.100:0/2049931316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7f40c7eb0 0x7fa7f415fef0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400c5a0 tx=0x7fa7e400ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:28.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.201+0000 7fa7db7fe640 1 -- 172.21.15.100:0/2049931316 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4017070 con 0x7fa7f40c7eb0 2024-09-11T22:32:28.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.201+0000 7fa7f94ac640 1 -- 172.21.15.100:0/2049931316 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f41e98d0 con 0x7fa7f40c7eb0 2024-09-11T22:32:28.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.201+0000 7fa7f94ac640 1 -- 172.21.15.100:0/2049931316 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7f41e8290 con 0x7fa7f40c7eb0 2024-09-11T22:32:28.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.201+0000 7fa7db7fe640 1 -- 172.21.15.100:0/2049931316 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e40052d0 con 0x7fa7f40c7eb0 2024-09-11T22:32:28.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.201+0000 7fa7db7fe640 1 -- 172.21.15.100:0/2049931316 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4012870 con 0x7fa7f40c7eb0 2024-09-11T22:32:28.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.203+0000 7fa7f94ac640 1 --2- 172.21.15.100:0/2049931316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7d4002a70 0x7fa7d4004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:28.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.203+0000 7fa7f94ac640 1 -- 172.21.15.100:0/2049931316 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d4007ec0 con 0x7fa7d4002a70 2024-09-11T22:32:28.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.205+0000 7fa7f2ffd640 1 --2- 172.21.15.100:0/2049931316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7d4002a70 0x7fa7d4004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:28.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.206+0000 7fa7f2ffd640 1 -- 172.21.15.100:0/2049931316 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa7d40080c0 con 0x7fa7d4002a70 2024-09-11T22:32:28.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.209+0000 7fa7f2ffd640 1 --2- 172.21.15.100:0/2049931316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7d4002a70 0x7fa7d4004f30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40c85b0 tx=0x7fa7ec004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:28.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.210+0000 7fa7db7fe640 1 -- 172.21.15.100:0/2049931316 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa7e401a070 con 0x7fa7f40c7eb0 2024-09-11T22:32:28.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.210+0000 7fa7db7fe640 1 --2- 172.21.15.100:0/2049931316 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa7e006beb0 0x7fa7e006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:28.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.211+0000 7fa7db7fe640 1 -- 172.21.15.100:0/2049931316 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fa7e408a550 con 0x7fa7f40c7eb0 2024-09-11T22:32:28.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.212+0000 7fa7f37fe640 1 --2- 172.21.15.100:0/2049931316 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa7e006beb0 0x7fa7e006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:28.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.212+0000 7fa7f37fe640 1 --2- 172.21.15.100:0/2049931316 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa7e006beb0 0x7fa7e006e370 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80094a0 tx=0x7fa7e80093f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:28.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.214+0000 7fa7db7fe640 1 -- 172.21.15.100:0/2049931316 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec009450 con 0x7fa7d4002a70 2024-09-11T22:32:28.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.214+0000 7fa7db7fe640 1 -- 172.21.15.100:0/2049931316 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fa7ec004880 con 0x7fa7d4002a70 2024-09-11T22:32:28.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.214+0000 7fa7db7fe640 1 -- 172.21.15.100:0/2049931316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7d4002a70 msgr2=0x7fa7d4004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:28.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.214+0000 7fa7db7fe640 1 --2- 172.21.15.100:0/2049931316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7d4002a70 0x7fa7d4004f30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40c85b0 tx=0x7fa7ec004a40 comp rx=0 tx=0).stop 2024-09-11T22:32:28.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.214+0000 7fa7db7fe640 1 -- 172.21.15.100:0/2049931316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7d4002a70 msgr2=0x7fa7d4004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:32:28.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.214+0000 7fa7db7fe640 1 --2- 172.21.15.100:0/2049931316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7d4002a70 0x7fa7d4004f30 secure :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40c85b0 tx=0x7fa7ec004a40 comp rx=0 tx=0).stop 2024-09-11T22:32:28.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.228+0000 7fa7f94ac640 1 --2- 172.21.15.100:0/2049931316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7d4006f30 0x7fa7d40073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:28.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.228+0000 7fa7f94ac640 1 -- 172.21.15.100:0/2049931316 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d400a4a0 con 0x7fa7d4006f30 2024-09-11T22:32:28.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.229+0000 7fa7f2ffd640 1 --2- 172.21.15.100:0/2049931316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7d4006f30 0x7fa7d40073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:28.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.233+0000 7fa7f2ffd640 1 -- 172.21.15.100:0/2049931316 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa7d4007900 con 0x7fa7d4006f30 2024-09-11T22:32:28.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.235+0000 7fa7f2ffd640 1 --2- 172.21.15.100:0/2049931316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7d4006f30 0x7fa7d40073c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec02aac0 tx=0x7fa7ec030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:28.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.236+0000 7fa7db7fe640 1 -- 172.21.15.100:0/2049931316 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec047920 con 0x7fa7d4006f30 2024-09-11T22:32:28.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.241+0000 7fa7db7fe640 1 -- 172.21.15.100:0/2049931316 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4887 (secure 0 0 0) 0x7fa7ec047920 con 0x7fa7d4006f30 2024-09-11T22:32:28.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.241+0000 7fa7db7fe640 1 -- 172.21.15.100:0/2049931316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7d4006f30 msgr2=0x7fa7d40073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:28.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.241+0000 7fa7db7fe640 1 --2- 172.21.15.100:0/2049931316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7d4006f30 0x7fa7d40073c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec02aac0 tx=0x7fa7ec030000 comp rx=0 tx=0).stop 2024-09-11T22:32:28.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.241+0000 7fa7db7fe640 1 -- 172.21.15.100:0/2049931316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7d4006f30 msgr2=0x7fa7d40073c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:32:28.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.241+0000 7fa7db7fe640 1 --2- 172.21.15.100:0/2049931316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7d4006f30 0x7fa7d40073c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.242 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:32:28.243 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:32:28.243 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:32:28.243 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:32:28.243 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 88, 2024-09-11T22:32:28.243 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 533515, 2024-09-11T22:32:28.243 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:32:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:32:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:32:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:32:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:32:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:32:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:32:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:32:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:28.244 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:32:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:32:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:28.245 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:32:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:32:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:32:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:32:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:32:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:32:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:32:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:32:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:32:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:32:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:32:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:32:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:32:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:32:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:32:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:32:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:32:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:28.247 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:32:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:32:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.248 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:32:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:32:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:32:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:32:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:28.249 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:32:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:32:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:32:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:32:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:28.250 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:32:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:32:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:32:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:32:28.251 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:32:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:32:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:32:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.252 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:32:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:32:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:32:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:28.253 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:32:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:32:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:32:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:32:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:32:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:28.254 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:32:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:32:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:32:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:32:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:28.255 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:28.256 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.256 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:32:28.256 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:32:28.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.243+0000 7fa7f94ac640 1 -- 172.21.15.100:0/2049931316 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa7e006beb0 msgr2=0x7fa7e006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:28.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.243+0000 7fa7f94ac640 1 --2- 172.21.15.100:0/2049931316 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa7e006beb0 0x7fa7e006e370 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa7e80094a0 tx=0x7fa7e80093f0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.243+0000 7fa7f94ac640 1 -- 172.21.15.100:0/2049931316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7f40c7eb0 msgr2=0x7fa7f415fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:28.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.243+0000 7fa7f94ac640 1 --2- 172.21.15.100:0/2049931316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7f40c7eb0 0x7fa7f415fef0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400c5a0 tx=0x7fa7e400ca60 comp rx=0 tx=0).stop 2024-09-11T22:32:28.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.243+0000 7fa7f37fe640 1 -- 172.21.15.100:0/2049931316 reap_dead start 2024-09-11T22:32:28.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.243+0000 7fa7f37fe640 1 -- 172.21.15.100:0/2049931316 reap_dead start 2024-09-11T22:32:28.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.244+0000 7fa7f94ac640 1 -- 172.21.15.100:0/2049931316 shutdown_connections 2024-09-11T22:32:28.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.244+0000 7fa7f94ac640 1 -- 172.21.15.100:0/2049931316 >> 172.21.15.100:0/2049931316 conn(0x7fa7f406f360 msgr2=0x7fa7f4073180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:28.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.244+0000 7fa7f94ac640 1 -- 172.21.15.100:0/2049931316 shutdown_connections 2024-09-11T22:32:28.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.244+0000 7fa7f94ac640 1 -- 172.21.15.100:0/2049931316 wait complete. 2024-09-11T22:32:28.265 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:32:28.265 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:32:28.265 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:32:28.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.451+0000 7f60019c5640 1 Processor -- start 2024-09-11T22:32:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.451+0000 7f60019c5640 1 -- start start 2024-09-11T22:32:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.453+0000 7f60019c5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ffc15c3d0 0x7f5ffc071d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.453+0000 7f60019c5640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5ffc15ee20 0x7f5ffc0c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.453+0000 7f60019c5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5ffc15f240 0x7f5ffc0c8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.453+0000 7f60019c5640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f5ffc162cc0 con 0x7f5ffc15ee20 2024-09-11T22:32:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.453+0000 7f60019c5640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f5ffc06e050 con 0x7f5ffc15f240 2024-09-11T22:32:28.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.453+0000 7f60019c5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5ffc06e2f0 con 0x7f5ffc15c3d0 2024-09-11T22:32:28.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.454+0000 7f5ffbfff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5ffc15ee20 0x7f5ffc0c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:28.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.455+0000 7f5ffbfff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5ffc15ee20 0x7f5ffc0c7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52624/0 (socket says 172.21.15.100:52624) 2024-09-11T22:32:28.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.455+0000 7f5ffbfff640 1 -- 172.21.15.100:0/907180759 learned_addr learned my addr 172.21.15.100:0/907180759 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:32:28.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.455+0000 7f60009c3640 1 --2- 172.21.15.100:0/907180759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ffc15c3d0 0x7f5ffc071d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:28.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.455+0000 7f5ffbfff640 1 -- 172.21.15.100:0/907180759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ffc15c3d0 msgr2=0x7f5ffc071d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:28.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.455+0000 7f5ffbfff640 1 --2- 172.21.15.100:0/907180759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ffc15c3d0 0x7f5ffc071d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.455+0000 7f5ffbfff640 1 -- 172.21.15.100:0/907180759 >> v2:172.21.15.167:3300/0 conn(0x7f5ffc15f240 msgr2=0x7f5ffc0c8090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:32:28.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.455+0000 7f5ffbfff640 1 --2- 172.21.15.100:0/907180759 >> v2:172.21.15.167:3300/0 conn(0x7f5ffc15f240 0x7f5ffc0c8090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.455+0000 7f5ffbfff640 1 -- 172.21.15.100:0/907180759 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ffc06e5d0 con 0x7f5ffc15ee20 2024-09-11T22:32:28.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.457+0000 7f5ffbfff640 1 --2- 172.21.15.100:0/907180759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ffc15ee20 0x7f5ffc0c7b50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc0c8840 tx=0x7f5fec02a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fcddab6c86da2a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:28.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.458+0000 7f5ffb7fe640 1 -- 172.21.15.100:0/907180759 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec036070 con 0x7f5ffc15ee20 2024-09-11T22:32:28.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.458+0000 7f5ffb7fe640 1 -- 172.21.15.100:0/907180759 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fec031600 con 0x7f5ffc15ee20 2024-09-11T22:32:28.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.458+0000 7f5ffb7fe640 1 -- 172.21.15.100:0/907180759 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec0319d0 con 0x7f5ffc15ee20 2024-09-11T22:32:28.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.459+0000 7f60019c5640 1 -- 172.21.15.100:0/907180759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ffc15ee20 msgr2=0x7f5ffc0c7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:28.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.459+0000 7f60019c5640 1 --2- 172.21.15.100:0/907180759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ffc15ee20 0x7f5ffc0c7b50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc0c8840 tx=0x7f5fec02a6b0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.460+0000 7f60019c5640 1 -- 172.21.15.100:0/907180759 shutdown_connections 2024-09-11T22:32:28.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.460+0000 7f60019c5640 1 --2- 172.21.15.100:0/907180759 >> v2:172.21.15.167:3300/0 conn(0x7f5ffc15f240 0x7f5ffc0c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.460+0000 7f60019c5640 1 --2- 172.21.15.100:0/907180759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ffc15ee20 0x7f5ffc0c7b50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.460+0000 7f60019c5640 1 --2- 172.21.15.100:0/907180759 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ffc15c3d0 0x7f5ffc071d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.460+0000 7f60019c5640 1 -- 172.21.15.100:0/907180759 >> 172.21.15.100:0/907180759 conn(0x7f5ffc06ed10 msgr2=0x7f5ffc06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:28.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.460+0000 7f60019c5640 1 -- 172.21.15.100:0/907180759 shutdown_connections 2024-09-11T22:32:28.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.460+0000 7f60019c5640 1 -- 172.21.15.100:0/907180759 wait complete. 2024-09-11T22:32:28.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.463+0000 7f60019c5640 1 Processor -- start 2024-09-11T22:32:28.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.463+0000 7f60019c5640 1 -- start start 2024-09-11T22:32:28.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.465+0000 7f60019c5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ffc15c3d0 0x7f5ffc161240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:28.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.465+0000 7f60019c5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ffc15ee20 0x7f5ffc15c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:28.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.465+0000 7f60019c5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ffc15f240 0x7f5ffc15cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:28.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.465+0000 7f60019c5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc162340 con 0x7f5ffc15ee20 2024-09-11T22:32:28.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.465+0000 7f60019c5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5ffc162950 con 0x7f5ffc15c3d0 2024-09-11T22:32:28.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.465+0000 7f60019c5640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5ffc163150 con 0x7f5ffc15f240 2024-09-11T22:32:28.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.465+0000 7f5ffbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ffc15ee20 0x7f5ffc15c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:28.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.465+0000 7f5ffbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ffc15ee20 0x7f5ffc15c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52628/0 (socket says 172.21.15.100:52628) 2024-09-11T22:32:28.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.465+0000 7f5ffbfff640 1 -- 172.21.15.100:0/1917449266 learned_addr learned my addr 172.21.15.100:0/1917449266 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:32:28.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.465+0000 7f60009c3640 1 --2- 172.21.15.100:0/1917449266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ffc15c3d0 0x7f5ffc161240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:28.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.465+0000 7f60011c4640 1 --2- 172.21.15.100:0/1917449266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ffc15f240 0x7f5ffc15cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:28.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.467+0000 7f5ffbfff640 1 -- 172.21.15.100:0/1917449266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ffc15f240 msgr2=0x7f5ffc15cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:28.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.467+0000 7f5ffbfff640 1 --2- 172.21.15.100:0/1917449266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ffc15f240 0x7f5ffc15cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.467+0000 7f5ffbfff640 1 -- 172.21.15.100:0/1917449266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ffc15c3d0 msgr2=0x7f5ffc161240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:28.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.467+0000 7f5ffbfff640 1 --2- 172.21.15.100:0/1917449266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ffc15c3d0 0x7f5ffc161240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.467+0000 7f5ffbfff640 1 -- 172.21.15.100:0/1917449266 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ffc151ed0 con 0x7f5ffc15ee20 2024-09-11T22:32:28.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.467+0000 7f5ffbfff640 1 --2- 172.21.15.100:0/1917449266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ffc15ee20 0x7f5ffc15c960 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009f40 tx=0x7f5fec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:28.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.468+0000 7f5ff97fa640 1 -- 172.21.15.100:0/1917449266 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec041020 con 0x7f5ffc15ee20 2024-09-11T22:32:28.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.468+0000 7f5ff97fa640 1 -- 172.21.15.100:0/1917449266 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fec008ab0 con 0x7f5ffc15ee20 2024-09-11T22:32:28.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.469+0000 7f5ff97fa640 1 -- 172.21.15.100:0/1917449266 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec036040 con 0x7f5ffc15ee20 2024-09-11T22:32:28.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.469+0000 7f60019c5640 1 -- 172.21.15.100:0/1917449266 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ffc15e1f0 con 0x7f5ffc15ee20 2024-09-11T22:32:28.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.469+0000 7f60019c5640 1 -- 172.21.15.100:0/1917449266 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ffc15e7b0 con 0x7f5ffc15ee20 2024-09-11T22:32:28.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.472+0000 7f5ff97fa640 1 -- 172.21.15.100:0/1917449266 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5fec044020 con 0x7f5ffc15ee20 2024-09-11T22:32:28.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.472+0000 7f5ff97fa640 1 --2- 172.21.15.100:0/1917449266 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5fdc06be80 0x7f5fdc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:28.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.473+0000 7f5ff97fa640 1 -- 172.21.15.100:0/1917449266 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f5fec0ac430 con 0x7f5ffc15ee20 2024-09-11T22:32:28.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.473+0000 7f60009c3640 1 --2- 172.21.15.100:0/1917449266 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5fdc06be80 0x7f5fdc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:28.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.474+0000 7f60019c5640 1 --2- 172.21.15.100:0/1917449266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ffc1538e0 0x7f5ffc1500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:28.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.474+0000 7f60019c5640 1 -- 172.21.15.100:0/1917449266 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5ffc15dfa0 con 0x7f5ffc1538e0 2024-09-11T22:32:28.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.476+0000 7f60009c3640 1 --2- 172.21.15.100:0/1917449266 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5fdc06be80 0x7f5fdc06e340 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400aac0 tx=0x7f5fe4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:28.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.477+0000 7f60011c4640 1 --2- 172.21.15.100:0/1917449266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ffc1538e0 0x7f5ffc1500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:28.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.478+0000 7f60011c4640 1 -- 172.21.15.100:0/1917449266 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ffc068ec0 con 0x7f5ffc1538e0 2024-09-11T22:32:28.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.479+0000 7f60011c4640 1 --2- 172.21.15.100:0/1917449266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ffc1538e0 0x7f5ffc1500a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400d400 tx=0x7f5ff400d8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:28.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.479+0000 7f5ff97fa640 1 -- 172.21.15.100:0/1917449266 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4018020 con 0x7f5ffc1538e0 2024-09-11T22:32:28.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.479+0000 7f5ff97fa640 1 -- 172.21.15.100:0/1917449266 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5ff4014620 con 0x7f5ffc1538e0 2024-09-11T22:32:28.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.479+0000 7f5ff97fa640 1 -- 172.21.15.100:0/1917449266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ffc1538e0 msgr2=0x7f5ffc1500a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:28.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.479+0000 7f5ff97fa640 1 --2- 172.21.15.100:0/1917449266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ffc1538e0 0x7f5ffc1500a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400d400 tx=0x7f5ff400d8c0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.480+0000 7f5ff97fa640 1 -- 172.21.15.100:0/1917449266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ffc1538e0 msgr2=0x7f5ffc1500a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:32:28.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.491+0000 7f5ff97fa640 1 --2- 172.21.15.100:0/1917449266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ffc1538e0 0x7f5ffc1500a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.497+0000 7f60019c5640 1 --2- 172.21.15.100:0/1917449266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ffc151a00 0x7f5ffc1505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:28.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.497+0000 7f60019c5640 1 -- 172.21.15.100:0/1917449266 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5ffc150b20 con 0x7f5ffc151a00 2024-09-11T22:32:28.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.498+0000 7f60011c4640 1 --2- 172.21.15.100:0/1917449266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ffc151a00 0x7f5ffc1505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:28.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.499+0000 7f60011c4640 1 -- 172.21.15.100:0/1917449266 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5ffc071d40 con 0x7f5ffc151a00 2024-09-11T22:32:28.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.500+0000 7f60011c4640 1 --2- 172.21.15.100:0/1917449266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ffc151a00 0x7f5ffc1505e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400d400 tx=0x7f5ff40046b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:28.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.501+0000 7f5ff97fa640 1 -- 172.21.15.100:0/1917449266 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4018040 con 0x7f5ffc151a00 2024-09-11T22:32:28.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.501+0000 7f5ff97fa640 1 -- 172.21.15.100:0/1917449266 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7f5ff401f2b0 con 0x7f5ffc151a00 2024-09-11T22:32:28.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.501+0000 7f5ff97fa640 1 -- 172.21.15.100:0/1917449266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ffc151a00 msgr2=0x7f5ffc1505e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:28.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.501+0000 7f5ff97fa640 1 --2- 172.21.15.100:0/1917449266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ffc151a00 0x7f5ffc1505e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400d400 tx=0x7f5ff40046b0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.501+0000 7f5ff97fa640 1 -- 172.21.15.100:0/1917449266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ffc151a00 msgr2=0x7f5ffc1505e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:32:28.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.501+0000 7f5ff97fa640 1 --2- 172.21.15.100:0/1917449266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ffc151a00 0x7f5ffc1505e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.506 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:32:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:32:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:32:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:32:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 88, 2024-09-11T22:32:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 639222, 2024-09-11T22:32:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:32:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:32:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:32:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:32:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:32:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:32:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:32:28.507 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:32:28.508 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:28.508 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:28.508 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:28.508 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:28.508 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:28.508 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:28.508 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:28.508 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:28.508 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:28.508 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:28.508 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:28.509 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:28.509 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:32:28.509 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:32:28.509 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:28.509 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:28.509 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:28.509 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:32:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:32:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:32:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:32:28.510 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:32:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:32:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:32:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:32:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:32:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:32:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:32:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:32:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:32:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:32:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:32:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:32:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:32:28.511 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:32:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.512 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:32:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:32:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:32:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:32:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:28.513 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:32:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:32:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:32:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:32:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:32:28.514 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:32:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:32:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:28.515 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:32:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:32:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:32:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:32:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:28.516 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:32:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:32:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:32:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:32:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:28.518 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:28.518 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:28.518 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:28.518 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.518 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:32:28.518 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:32:28.518 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.518 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:28.518 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:28.518 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:32:28.518 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:32:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:32:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:32:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:32:28.519 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:32:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:32:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:32:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:28.520 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:32:28.521 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:28.521 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:28.521 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:28.521 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:32:28.521 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:32:28.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.507+0000 7f5ff2ffd640 1 -- 172.21.15.100:0/1917449266 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5fdc06be80 msgr2=0x7f5fdc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:28.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.507+0000 7f5ff2ffd640 1 --2- 172.21.15.100:0/1917449266 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5fdc06be80 0x7f5fdc06e340 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400aac0 tx=0x7f5fe4008040 comp rx=0 tx=0).stop 2024-09-11T22:32:28.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.507+0000 7f60011c4640 1 -- 172.21.15.100:0/1917449266 reap_dead start 2024-09-11T22:32:28.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.507+0000 7f5ff2ffd640 1 -- 172.21.15.100:0/1917449266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ffc15ee20 msgr2=0x7f5ffc15c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:28.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.507+0000 7f5ff2ffd640 1 --2- 172.21.15.100:0/1917449266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ffc15ee20 0x7f5ffc15c960 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009f40 tx=0x7f5fec004a40 comp rx=0 tx=0).stop 2024-09-11T22:32:28.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.508+0000 7f5ff2ffd640 1 -- 172.21.15.100:0/1917449266 shutdown_connections 2024-09-11T22:32:28.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.508+0000 7f5ff2ffd640 1 --2- 172.21.15.100:0/1917449266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ffc15ee20 0x7f5ffc15c960 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.508+0000 7f5ff2ffd640 1 -- 172.21.15.100:0/1917449266 >> 172.21.15.100:0/1917449266 conn(0x7f5ffc06ed10 msgr2=0x7f5ffc157a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:28.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.513+0000 7f5ff2ffd640 1 -- 172.21.15.100:0/1917449266 shutdown_connections 2024-09-11T22:32:28.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.513+0000 7f5ff2ffd640 1 -- 172.21.15.100:0/1917449266 wait complete. 2024-09-11T22:32:28.536 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:32:28.536 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-11T22:32:28.536 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-11T22:32:28.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.743+0000 7f2d27250640 1 Processor -- start 2024-09-11T22:32:28.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.743+0000 7f2d27250640 1 -- start start 2024-09-11T22:32:28.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.745+0000 7f2d27250640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2d20153ec0 0x7f2d20072c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:28.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.745+0000 7f2d27250640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2d201573a0 0x7f2d2006c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:28.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.745+0000 7f2d27250640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d200c1000 con 0x7f2d2006c1a0 2024-09-11T22:32:28.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.745+0000 7f2d27250640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f2d20073570 con 0x7f2d20153ec0 2024-09-11T22:32:28.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.745+0000 7f2d27250640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f2d20159eb0 con 0x7f2d201573a0 2024-09-11T22:32:28.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.746+0000 7f2d1ffff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2d2006c1a0 0x7f2d20156c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:38694/0 (socket says 172.21.15.100:38694) 2024-09-11T22:32:28.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.746+0000 7f2d1ffff640 1 -- 172.21.15.100:0/3528023861 learned_addr learned my addr 172.21.15.100:0/3528023861 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:32:28.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.746+0000 7f2d24fec640 1 --2- 172.21.15.100:0/3528023861 >> v2:172.21.15.100:3300/0 conn(0x7f2d20153ec0 0x7f2d20072c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:28.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.746+0000 7f2d257ed640 1 --2- 172.21.15.100:0/3528023861 >> v2:172.21.15.167:3300/0 conn(0x7f2d201573a0 0x7f2d2006c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:28.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.747+0000 7f2d257ed640 1 -- 172.21.15.100:0/3528023861 >> v2:172.21.15.100:3300/0 conn(0x7f2d20153ec0 msgr2=0x7f2d20072c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:28.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.747+0000 7f2d257ed640 1 --2- 172.21.15.100:0/3528023861 >> v2:172.21.15.100:3300/0 conn(0x7f2d20153ec0 0x7f2d20072c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.747+0000 7f2d257ed640 1 -- 172.21.15.100:0/3528023861 >> v1:172.21.15.100:6789/0 conn(0x7f2d2006c1a0 legacy=0x7f2d20156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:28.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.747+0000 7f2d257ed640 1 -- 172.21.15.100:0/3528023861 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2015a190 con 0x7f2d201573a0 2024-09-11T22:32:28.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.753+0000 7f2d257ed640 1 --2- 172.21.15.100:0/3528023861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d201573a0 0x7f2d2006c610 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2d200ccf70 tx=0x7f2d1002a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=affe23096b66bef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:28.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.753+0000 7f2d1f7fe640 1 -- 172.21.15.100:0/3528023861 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1002f710 con 0x7f2d201573a0 2024-09-11T22:32:28.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.753+0000 7f2d1f7fe640 1 -- 172.21.15.100:0/3528023861 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d1002f8b0 con 0x7f2d201573a0 2024-09-11T22:32:28.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.753+0000 7f2d1f7fe640 1 -- 172.21.15.100:0/3528023861 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1002f710 con 0x7f2d201573a0 2024-09-11T22:32:28.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.754+0000 7f2d27250640 1 -- 172.21.15.100:0/3528023861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d201573a0 msgr2=0x7f2d2006c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:28.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.754+0000 7f2d27250640 1 --2- 172.21.15.100:0/3528023861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d201573a0 0x7f2d2006c610 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2d200ccf70 tx=0x7f2d1002a620 comp rx=0 tx=0).stop 2024-09-11T22:32:28.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.754+0000 7f2d27250640 1 -- 172.21.15.100:0/3528023861 shutdown_connections 2024-09-11T22:32:28.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.754+0000 7f2d27250640 1 --2- 172.21.15.100:0/3528023861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d201573a0 0x7f2d2006c610 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.754+0000 7f2d27250640 1 --2- 172.21.15.100:0/3528023861 >> v2:172.21.15.100:3300/0 conn(0x7f2d20153ec0 0x7f2d20072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.754+0000 7f2d27250640 1 -- 172.21.15.100:0/3528023861 >> 172.21.15.100:0/3528023861 conn(0x7f2d200cbf70 msgr2=0x7f2d200cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:28.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.754+0000 7f2d27250640 1 -- 172.21.15.100:0/3528023861 shutdown_connections 2024-09-11T22:32:28.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.755+0000 7f2d27250640 1 -- 172.21.15.100:0/3528023861 wait complete. 2024-09-11T22:32:28.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.756+0000 7f2d27250640 1 Processor -- start 2024-09-11T22:32:28.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.757+0000 7f2d27250640 1 -- start start 2024-09-11T22:32:28.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.758+0000 7f2d27250640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d2006c1a0 0x7f2d200c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:28.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.758+0000 7f2d27250640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d20153ec0 0x7f2d20157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:28.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.758+0000 7f2d27250640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d201573a0 0x7f2d201583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:28.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.758+0000 7f2d27250640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2015aa30 con 0x7f2d2006c1a0 2024-09-11T22:32:28.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.758+0000 7f2d27250640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2015a750 con 0x7f2d20153ec0 2024-09-11T22:32:28.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.758+0000 7f2d27250640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2d2015ad10 con 0x7f2d201573a0 2024-09-11T22:32:28.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.759+0000 7f2d1ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d20153ec0 0x7f2d20157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:28.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.759+0000 7f2d1ffff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d20153ec0 0x7f2d20157e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:35384/0 (socket says 172.21.15.100:35384) 2024-09-11T22:32:28.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.759+0000 7f2d1ffff640 1 -- 172.21.15.100:0/4157215144 learned_addr learned my addr 172.21.15.100:0/4157215144 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:32:28.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.759+0000 7f2d24fec640 1 --2- 172.21.15.100:0/4157215144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d2006c1a0 0x7f2d200c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:28.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.759+0000 7f2d257ed640 1 --2- 172.21.15.100:0/4157215144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d201573a0 0x7f2d201583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:28.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.759+0000 7f2d1ffff640 1 -- 172.21.15.100:0/4157215144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d201573a0 msgr2=0x7f2d201583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:28.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.759+0000 7f2d1ffff640 1 --2- 172.21.15.100:0/4157215144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d201573a0 0x7f2d201583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.759+0000 7f2d1ffff640 1 -- 172.21.15.100:0/4157215144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d2006c1a0 msgr2=0x7f2d200c37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:28.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.759+0000 7f2d1ffff640 1 --2- 172.21.15.100:0/4157215144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d2006c1a0 0x7f2d200c37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:28.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.759+0000 7f2d1ffff640 1 -- 172.21.15.100:0/4157215144 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d200c4300 con 0x7f2d20153ec0 2024-09-11T22:32:28.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.760+0000 7f2d1ffff640 1 --2- 172.21.15.100:0/4157215144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d20153ec0 0x7f2d20157e80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2d1801db30 tx=0x7f2d18007ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:28.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.760+0000 7f2d1d7fa640 1 -- 172.21.15.100:0/4157215144 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1800a9d0 con 0x7f2d20153ec0 2024-09-11T22:32:28.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.760+0000 7f2d27250640 1 -- 172.21.15.100:0/4157215144 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d20156400 con 0x7f2d20153ec0 2024-09-11T22:32:28.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.760+0000 7f2d27250640 1 -- 172.21.15.100:0/4157215144 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d20159be0 con 0x7f2d20153ec0 2024-09-11T22:32:28.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.760+0000 7f2d1d7fa640 1 -- 172.21.15.100:0/4157215144 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d18028070 con 0x7f2d20153ec0 2024-09-11T22:32:28.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.761+0000 7f2d1d7fa640 1 -- 172.21.15.100:0/4157215144 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1800add0 con 0x7f2d20153ec0 2024-09-11T22:32:28.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.764+0000 7f2d27250640 1 -- 172.21.15.100:0/4157215144 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d00005290 con 0x7f2d20153ec0 2024-09-11T22:32:28.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.765+0000 7f2d1d7fa640 1 -- 172.21.15.100:0/4157215144 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d1802d460 con 0x7f2d20153ec0 2024-09-11T22:32:28.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.767+0000 7f2d1d7fa640 1 --2- 172.21.15.100:0/4157215144 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2d0c06be30 0x7f2d0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:28.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.768+0000 7f2d1d7fa640 1 -- 172.21.15.100:0/4157215144 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f2d1809c290 con 0x7f2d20153ec0 2024-09-11T22:32:28.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.771+0000 7f2d24fec640 1 --2- 172.21.15.100:0/4157215144 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2d0c06be30 0x7f2d0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:28.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.772+0000 7f2d24fec640 1 --2- 172.21.15.100:0/4157215144 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2d0c06be30 0x7f2d0c06e2f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400d430 tx=0x7f2d14009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:28.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:28.774+0000 7f2d1d7fa640 1 -- 172.21.15.100:0/4157215144 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2d1806a780 con 0x7f2d20153ec0 2024-09-11T22:32:29.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:29.295+0000 7f2d27250640 1 -- 172.21.15.100:0/4157215144 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f2d00005d90 con 0x7f2d20153ec0 2024-09-11T22:32:29.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:29.301+0000 7f2d1d7fa640 1 -- 172.21.15.100:0/4157215144 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f2d1806a080 con 0x7f2d20153ec0 2024-09-11T22:32:29.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:29.307+0000 7f2d27250640 1 -- 172.21.15.100:0/4157215144 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2d0c06be30 msgr2=0x7f2d0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:29.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:29.307+0000 7f2d27250640 1 --2- 172.21.15.100:0/4157215144 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2d0c06be30 0x7f2d0c06e2f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400d430 tx=0x7f2d14009040 comp rx=0 tx=0).stop 2024-09-11T22:32:29.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:29.307+0000 7f2d27250640 1 -- 172.21.15.100:0/4157215144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d20153ec0 msgr2=0x7f2d20157e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:29.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:29.307+0000 7f2d27250640 1 --2- 172.21.15.100:0/4157215144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d20153ec0 0x7f2d20157e80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2d1801db30 tx=0x7f2d18007ee0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:29.308+0000 7f2d27250640 1 -- 172.21.15.100:0/4157215144 shutdown_connections 2024-09-11T22:32:29.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:29.308+0000 7f2d27250640 1 --2- 172.21.15.100:0/4157215144 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2d0c06be30 0x7f2d0c06e2f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:29.308+0000 7f2d27250640 1 --2- 172.21.15.100:0/4157215144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d201573a0 0x7f2d201583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:29.308+0000 7f2d27250640 1 --2- 172.21.15.100:0/4157215144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d20153ec0 0x7f2d20157e80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:29.308+0000 7f2d27250640 1 --2- 172.21.15.100:0/4157215144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d2006c1a0 0x7f2d200c37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:29.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:29.308+0000 7f2d27250640 1 -- 172.21.15.100:0/4157215144 >> 172.21.15.100:0/4157215144 conn(0x7f2d200cbf70 msgr2=0x7f2d200ca900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:29.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:29.312+0000 7f2d27250640 1 -- 172.21.15.100:0/4157215144 shutdown_connections 2024-09-11T22:32:29.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:29.313+0000 7f2d27250640 1 -- 172.21.15.100:0/4157215144 wait complete. 2024-09-11T22:32:29.334 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-11T22:32:39.335 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:32:39.336 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:32:39.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.524+0000 7f173d4e9640 1 Processor -- start 2024-09-11T22:32:39.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.524+0000 7f173d4e9640 1 -- start start 2024-09-11T22:32:39.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.526+0000 7f173d4e9640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1738158ee0 0x7f173815eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:39.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.526+0000 7f173d4e9640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f173806f930 0x7f17380c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:39.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.526+0000 7f173d4e9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17380c2d90 0x7f173806c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:39.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.526+0000 7f173d4e9640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f17380c0ee0 con 0x7f1738158ee0 2024-09-11T22:32:39.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.526+0000 7f173d4e9640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f17380c1150 con 0x7f173806f930 2024-09-11T22:32:39.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.526+0000 7f173d4e9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f17380c1430 con 0x7f17380c2d90 2024-09-11T22:32:39.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.526+0000 7f173cce8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17380c2d90 0x7f173806c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:39.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.526+0000 7f173cce8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17380c2d90 0x7f173806c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45966/0 (socket says 172.21.15.100:45966) 2024-09-11T22:32:39.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.526+0000 7f173cce8640 1 -- 172.21.15.100:0/3219714811 learned_addr learned my addr 172.21.15.100:0/3219714811 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:32:39.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.526+0000 7f1737fff640 1 --2- 172.21.15.100:0/3219714811 >> v2:172.21.15.100:3300/0 conn(0x7f1738158ee0 0x7f173815eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:39.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.527+0000 7f17377fe640 1 --2- 172.21.15.100:0/3219714811 >> v2:172.21.15.167:3300/0 conn(0x7f173806f930 0x7f17380c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:39.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.527+0000 7f173cce8640 1 -- 172.21.15.100:0/3219714811 >> v2:172.21.15.167:3300/0 conn(0x7f173806f930 msgr2=0x7f17380c21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:39.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.527+0000 7f173cce8640 1 --2- 172.21.15.100:0/3219714811 >> v2:172.21.15.167:3300/0 conn(0x7f173806f930 0x7f17380c21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:39.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.527+0000 7f173cce8640 1 -- 172.21.15.100:0/3219714811 >> v2:172.21.15.100:3300/0 conn(0x7f1738158ee0 msgr2=0x7f173815eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:39.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.527+0000 7f173cce8640 1 --2- 172.21.15.100:0/3219714811 >> v2:172.21.15.100:3300/0 conn(0x7f1738158ee0 0x7f173815eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:39.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.527+0000 7f173cce8640 1 -- 172.21.15.100:0/3219714811 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17380c1710 con 0x7f17380c2d90 2024-09-11T22:32:39.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.528+0000 7f17377fe640 1 --2- 172.21.15.100:0/3219714811 >> v2:172.21.15.167:3300/0 conn(0x7f173806f930 0x7f17380c21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:32:39.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.528+0000 7f173cce8640 1 --2- 172.21.15.100:0/3219714811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17380c2d90 0x7f173806c040 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f17380c9cd0 tx=0x7f173002a6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df495665926ca103 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:39.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.529+0000 7f1736ffd640 1 -- 172.21.15.100:0/3219714811 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730036070 con 0x7f17380c2d90 2024-09-11T22:32:39.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.529+0000 7f1736ffd640 1 -- 172.21.15.100:0/3219714811 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1730031600 con 0x7f17380c2d90 2024-09-11T22:32:39.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.530+0000 7f173d4e9640 1 -- 172.21.15.100:0/3219714811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17380c2d90 msgr2=0x7f173806c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:39.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.530+0000 7f173d4e9640 1 --2- 172.21.15.100:0/3219714811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17380c2d90 0x7f173806c040 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f17380c9cd0 tx=0x7f173002a6c0 comp rx=0 tx=0).stop 2024-09-11T22:32:39.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.530+0000 7f173d4e9640 1 -- 172.21.15.100:0/3219714811 shutdown_connections 2024-09-11T22:32:39.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.530+0000 7f173d4e9640 1 --2- 172.21.15.100:0/3219714811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17380c2d90 0x7f173806c040 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:39.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.530+0000 7f173d4e9640 1 --2- 172.21.15.100:0/3219714811 >> v2:172.21.15.167:3300/0 conn(0x7f173806f930 0x7f17380c21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:39.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.530+0000 7f173d4e9640 1 --2- 172.21.15.100:0/3219714811 >> v2:172.21.15.100:3300/0 conn(0x7f1738158ee0 0x7f173815eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:39.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.530+0000 7f173d4e9640 1 -- 172.21.15.100:0/3219714811 >> 172.21.15.100:0/3219714811 conn(0x7f173806ee10 msgr2=0x7f173806f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:39.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.532+0000 7f173d4e9640 1 -- 172.21.15.100:0/3219714811 shutdown_connections 2024-09-11T22:32:39.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.533+0000 7f173d4e9640 1 -- 172.21.15.100:0/3219714811 wait complete. 2024-09-11T22:32:39.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.534+0000 7f173d4e9640 1 Processor -- start 2024-09-11T22:32:39.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.535+0000 7f173d4e9640 1 -- start start 2024-09-11T22:32:39.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.536+0000 7f173d4e9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f173806f930 0x7f1738211650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:39.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.536+0000 7f173d4e9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17380c2d90 0x7f173815e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:39.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.536+0000 7f173d4e9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1738158ee0 0x7f17380c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:39.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.536+0000 7f173d4e9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f17381592c0 con 0x7f173806f930 2024-09-11T22:32:39.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.536+0000 7f173d4e9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f17380c1cd0 con 0x7f1738158ee0 2024-09-11T22:32:39.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.536+0000 7f173d4e9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f173806e6f0 con 0x7f17380c2d90 2024-09-11T22:32:39.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.537+0000 7f17377fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17380c2d90 0x7f173815e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:39.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.537+0000 7f17377fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17380c2d90 0x7f173815e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45976/0 (socket says 172.21.15.100:45976) 2024-09-11T22:32:39.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.537+0000 7f17377fe640 1 -- 172.21.15.100:0/3978295624 learned_addr learned my addr 172.21.15.100:0/3978295624 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:32:39.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.538+0000 7f17377fe640 1 -- 172.21.15.100:0/3978295624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1738158ee0 msgr2=0x7f17380c4440 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:32:39.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.538+0000 7f17377fe640 1 --2- 172.21.15.100:0/3978295624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1738158ee0 0x7f17380c4440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:39.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.538+0000 7f17377fe640 1 -- 172.21.15.100:0/3978295624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f173806f930 msgr2=0x7f1738211650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:32:39.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.539+0000 7f1737fff640 1 --2- 172.21.15.100:0/3978295624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f173806f930 0x7f1738211650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:39.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.543+0000 7f17377fe640 1 --2- 172.21.15.100:0/3978295624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f173806f930 0x7f1738211650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:39.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.543+0000 7f17377fe640 1 -- 172.21.15.100:0/3978295624 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17380c34f0 con 0x7f17380c2d90 2024-09-11T22:32:39.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.543+0000 7f1737fff640 1 --2- 172.21.15.100:0/3978295624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f173806f930 0x7f1738211650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:32:39.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.545+0000 7f17377fe640 1 --2- 172.21.15.100:0/3978295624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17380c2d90 0x7f173815e7a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f172c00e7c0 tx=0x7f172c00ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:39.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.550+0000 7f1734ff9640 1 -- 172.21.15.100:0/3978295624 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c00f040 con 0x7f17380c2d90 2024-09-11T22:32:39.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.550+0000 7f173d4e9640 1 -- 172.21.15.100:0/3978295624 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17380c37b0 con 0x7f17380c2d90 2024-09-11T22:32:39.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.550+0000 7f173d4e9640 1 -- 172.21.15.100:0/3978295624 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f17380c54a0 con 0x7f17380c2d90 2024-09-11T22:32:39.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.550+0000 7f1734ff9640 1 -- 172.21.15.100:0/3978295624 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f172c004030 con 0x7f17380c2d90 2024-09-11T22:32:39.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.550+0000 7f1734ff9640 1 -- 172.21.15.100:0/3978295624 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c004400 con 0x7f17380c2d90 2024-09-11T22:32:39.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.551+0000 7f173d4e9640 1 -- 172.21.15.100:0/3978295624 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1718005290 con 0x7f17380c2d90 2024-09-11T22:32:39.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.554+0000 7f1734ff9640 1 -- 172.21.15.100:0/3978295624 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f172c00c6d0 con 0x7f17380c2d90 2024-09-11T22:32:39.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.554+0000 7f1734ff9640 1 --2- 172.21.15.100:0/3978295624 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f172406bf00 0x7f172406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:39.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.555+0000 7f1734ff9640 1 -- 172.21.15.100:0/3978295624 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f172c08b3a0 con 0x7f17380c2d90 2024-09-11T22:32:39.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.555+0000 7f1737fff640 1 --2- 172.21.15.100:0/3978295624 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f172406bf00 0x7f172406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:39.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.556+0000 7f1737fff640 1 --2- 172.21.15.100:0/3978295624 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f172406bf00 0x7f172406e3c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f17280099a0 tx=0x7f1728008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:39.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:39.558+0000 7f1734ff9640 1 -- 172.21.15.100:0/3978295624 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f172c017020 con 0x7f17380c2d90 2024-09-11T22:32:40.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.089+0000 7f173d4e9640 1 -- 172.21.15.100:0/3978295624 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1718005580 con 0x7f17380c2d90 2024-09-11T22:32:40.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.089+0000 7f1734ff9640 1 -- 172.21.15.100:0/3978295624 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f172c059910 con 0x7f17380c2d90 2024-09-11T22:32:40.097 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":88,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:32:40.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.099+0000 7f173d4e9640 1 -- 172.21.15.100:0/3978295624 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f172406bf00 msgr2=0x7f172406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:40.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.099+0000 7f173d4e9640 1 --2- 172.21.15.100:0/3978295624 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f172406bf00 0x7f172406e3c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f17280099a0 tx=0x7f1728008040 comp rx=0 tx=0).stop 2024-09-11T22:32:40.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.099+0000 7f173d4e9640 1 -- 172.21.15.100:0/3978295624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17380c2d90 msgr2=0x7f173815e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:40.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.099+0000 7f173d4e9640 1 --2- 172.21.15.100:0/3978295624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17380c2d90 0x7f173815e7a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f172c00e7c0 tx=0x7f172c00ec80 comp rx=0 tx=0).stop 2024-09-11T22:32:40.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.101+0000 7f173d4e9640 1 -- 172.21.15.100:0/3978295624 shutdown_connections 2024-09-11T22:32:40.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.101+0000 7f173d4e9640 1 --2- 172.21.15.100:0/3978295624 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f172406bf00 0x7f172406e3c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.101+0000 7f173d4e9640 1 --2- 172.21.15.100:0/3978295624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1738158ee0 0x7f17380c4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.101+0000 7f173d4e9640 1 --2- 172.21.15.100:0/3978295624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17380c2d90 0x7f173815e7a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.101+0000 7f173d4e9640 1 --2- 172.21.15.100:0/3978295624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f173806f930 0x7f1738211650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.101+0000 7f173d4e9640 1 -- 172.21.15.100:0/3978295624 >> 172.21.15.100:0/3978295624 conn(0x7f173806ee10 msgr2=0x7f173806f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:40.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.102+0000 7f173d4e9640 1 -- 172.21.15.100:0/3978295624 shutdown_connections 2024-09-11T22:32:40.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.102+0000 7f173d4e9640 1 -- 172.21.15.100:0/3978295624 wait complete. 2024-09-11T22:32:40.133 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:32:40.133 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-11T22:32:40.133 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:32:40.134 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:32:40.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.341+0000 7ff28c50a640 1 Processor -- start 2024-09-11T22:32:40.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.342+0000 7ff28c50a640 1 -- start start 2024-09-11T22:32:40.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.343+0000 7ff28c50a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff284150b60 0x7ff2840c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.344+0000 7ff28c50a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2840c6970 0x7ff2840c7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.344+0000 7ff28c50a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2840c8600 con 0x7ff2840c7ac0 2024-09-11T22:32:40.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.344+0000 7ff28c50a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7ff284156730 con 0x7ff284150b60 2024-09-11T22:32:40.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.344+0000 7ff28c50a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff2841569f0 con 0x7ff2840c6970 2024-09-11T22:32:40.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.344+0000 7ff289aa5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2840c6970 0x7ff2840c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:40.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.344+0000 7ff289aa5640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2840c6970 0x7ff2840c7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45992/0 (socket says 172.21.15.100:45992) 2024-09-11T22:32:40.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.344+0000 7ff289aa5640 1 -- 172.21.15.100:0/2132850639 learned_addr learned my addr 172.21.15.100:0/2132850639 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:32:40.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.344+0000 7ff28a2a6640 1 --2- 172.21.15.100:0/2132850639 >> v2:172.21.15.167:3300/0 conn(0x7ff284150b60 0x7ff2840c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:40.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.344+0000 7ff289aa5640 1 -- 172.21.15.100:0/2132850639 >> v2:172.21.15.167:3300/0 conn(0x7ff284150b60 msgr2=0x7ff2840c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:40.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.344+0000 7ff289aa5640 1 --2- 172.21.15.100:0/2132850639 >> v2:172.21.15.167:3300/0 conn(0x7ff284150b60 0x7ff2840c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.344+0000 7ff289aa5640 1 -- 172.21.15.100:0/2132850639 >> v1:172.21.15.167:6789/0 conn(0x7ff2840c7ac0 legacy=0x7ff284159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:40.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.345+0000 7ff289aa5640 1 -- 172.21.15.100:0/2132850639 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff284156cd0 con 0x7ff2840c6970 2024-09-11T22:32:40.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.346+0000 7ff289aa5640 1 --2- 172.21.15.100:0/2132850639 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2840c6970 0x7ff2840c7580 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff27c00c110 tx=0x7ff27c00ace0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=588e6d927b3f0548 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:40.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.348+0000 7ff2892a4640 1 -- 172.21.15.100:0/2132850639 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27c039070 con 0x7ff2840c6970 2024-09-11T22:32:40.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.348+0000 7ff2892a4640 1 -- 172.21.15.100:0/2132850639 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff27c0316a0 con 0x7ff2840c6970 2024-09-11T22:32:40.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.348+0000 7ff2892a4640 1 -- 172.21.15.100:0/2132850639 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27c030050 con 0x7ff2840c6970 2024-09-11T22:32:40.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.349+0000 7ff28c50a640 1 -- 172.21.15.100:0/2132850639 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2840c6970 msgr2=0x7ff2840c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:40.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.349+0000 7ff28c50a640 1 --2- 172.21.15.100:0/2132850639 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2840c6970 0x7ff2840c7580 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff27c00c110 tx=0x7ff27c00ace0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.349+0000 7ff28c50a640 1 -- 172.21.15.100:0/2132850639 shutdown_connections 2024-09-11T22:32:40.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.349+0000 7ff28c50a640 1 --2- 172.21.15.100:0/2132850639 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2840c6970 0x7ff2840c7580 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.349+0000 7ff28c50a640 1 --2- 172.21.15.100:0/2132850639 >> v2:172.21.15.167:3300/0 conn(0x7ff284150b60 0x7ff2840c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.349+0000 7ff28c50a640 1 -- 172.21.15.100:0/2132850639 >> 172.21.15.100:0/2132850639 conn(0x7ff28406f190 msgr2=0x7ff28406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:40.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.352+0000 7ff28c50a640 1 -- 172.21.15.100:0/2132850639 shutdown_connections 2024-09-11T22:32:40.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.352+0000 7ff28c50a640 1 -- 172.21.15.100:0/2132850639 wait complete. 2024-09-11T22:32:40.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.353+0000 7ff28c50a640 1 Processor -- start 2024-09-11T22:32:40.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.353+0000 7ff28c50a640 1 -- start start 2024-09-11T22:32:40.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.355+0000 7ff28c50a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2840c6970 0x7ff28414f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.355+0000 7ff28c50a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2840c7ac0 0x7ff2841578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.355+0000 7ff28c50a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff284150b60 0x7ff28414aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.355+0000 7ff28c50a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff284071b20 con 0x7ff2840c7ac0 2024-09-11T22:32:40.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.355+0000 7ff28c50a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff284157290 con 0x7ff2840c6970 2024-09-11T22:32:40.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.355+0000 7ff28c50a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff2840c6d70 con 0x7ff284150b60 2024-09-11T22:32:40.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.355+0000 7ff289aa5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2840c7ac0 0x7ff2841578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:40.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.355+0000 7ff289aa5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2840c7ac0 0x7ff2841578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51390/0 (socket says 172.21.15.100:51390) 2024-09-11T22:32:40.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.355+0000 7ff289aa5640 1 -- 172.21.15.100:0/3788734232 learned_addr learned my addr 172.21.15.100:0/3788734232 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:32:40.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.355+0000 7ff289aa5640 1 -- 172.21.15.100:0/3788734232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff284150b60 msgr2=0x7ff28414aaa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:32:40.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.355+0000 7ff289aa5640 1 --2- 172.21.15.100:0/3788734232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff284150b60 0x7ff28414aaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.355+0000 7ff289aa5640 1 -- 172.21.15.100:0/3788734232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2840c6970 msgr2=0x7ff28414f410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:32:40.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.355+0000 7ff289aa5640 1 --2- 172.21.15.100:0/3788734232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2840c6970 0x7ff28414f410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.355+0000 7ff289aa5640 1 -- 172.21.15.100:0/3788734232 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2841e2440 con 0x7ff2840c7ac0 2024-09-11T22:32:40.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.356+0000 7ff289aa5640 1 --2- 172.21.15.100:0/3788734232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2840c7ac0 0x7ff2841578f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff27c02ae60 tx=0x7ff27c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:40.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.357+0000 7ff27affd640 1 -- 172.21.15.100:0/3788734232 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27c044020 con 0x7ff2840c7ac0 2024-09-11T22:32:40.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.357+0000 7ff27affd640 1 -- 172.21.15.100:0/3788734232 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff27c008240 con 0x7ff2840c7ac0 2024-09-11T22:32:40.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.357+0000 7ff27affd640 1 -- 172.21.15.100:0/3788734232 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27c039040 con 0x7ff2840c7ac0 2024-09-11T22:32:40.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.357+0000 7ff28c50a640 1 -- 172.21.15.100:0/3788734232 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff28408cd10 con 0x7ff2840c7ac0 2024-09-11T22:32:40.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.357+0000 7ff28c50a640 1 -- 172.21.15.100:0/3788734232 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2841e0860 con 0x7ff2840c7ac0 2024-09-11T22:32:40.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.362+0000 7ff27affd640 1 -- 172.21.15.100:0/3788734232 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff27c047020 con 0x7ff2840c7ac0 2024-09-11T22:32:40.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.363+0000 7ff27affd640 1 --2- 172.21.15.100:0/3788734232 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff27006c080 0x7ff27006e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.363+0000 7ff27affd640 1 -- 172.21.15.100:0/3788734232 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7ff27c0ac5f0 con 0x7ff2840c7ac0 2024-09-11T22:32:40.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.363+0000 7ff28a2a6640 1 --2- 172.21.15.100:0/3788734232 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff27006c080 0x7ff27006e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:40.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.364+0000 7ff278ff9640 1 --2- 172.21.15.100:0/3788734232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff26c002a70 0x7ff26c004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.364+0000 7ff28aaa7640 1 --2- 172.21.15.100:0/3788734232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff26c002a70 0x7ff26c004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:40.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.364+0000 7ff278ff9640 1 -- 172.21.15.100:0/3788734232 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff26c007ec0 con 0x7ff26c002a70 2024-09-11T22:32:40.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.366+0000 7ff28a2a6640 1 --2- 172.21.15.100:0/3788734232 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff27006c080 0x7ff27006e540 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff28000d440 tx=0x7ff280008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:40.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.368+0000 7ff28aaa7640 1 -- 172.21.15.100:0/3788734232 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff26c0080c0 con 0x7ff26c002a70 2024-09-11T22:32:40.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.368+0000 7ff28aaa7640 1 --2- 172.21.15.100:0/3788734232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff26c002a70 0x7ff26c004f30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff27400c450 tx=0x7ff27400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:40.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.369+0000 7ff27affd640 1 -- 172.21.15.100:0/3788734232 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff274016020 con 0x7ff26c002a70 2024-09-11T22:32:40.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.369+0000 7ff27affd640 1 -- 172.21.15.100:0/3788734232 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff274012620 con 0x7ff26c002a70 2024-09-11T22:32:40.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.369+0000 7ff27affd640 1 -- 172.21.15.100:0/3788734232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff26c002a70 msgr2=0x7ff26c004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:40.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.369+0000 7ff27affd640 1 --2- 172.21.15.100:0/3788734232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff26c002a70 0x7ff26c004f30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff27400c450 tx=0x7ff27400c910 comp rx=0 tx=0).stop 2024-09-11T22:32:40.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.369+0000 7ff27affd640 1 -- 172.21.15.100:0/3788734232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff26c002a70 msgr2=0x7ff26c004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:32:40.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.369+0000 7ff27affd640 1 --2- 172.21.15.100:0/3788734232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff26c002a70 0x7ff26c004f30 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff27400c450 tx=0x7ff27400c910 comp rx=0 tx=0).stop 2024-09-11T22:32:40.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.385+0000 7ff278ff9640 1 --2- 172.21.15.100:0/3788734232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff26c006eb0 0x7ff26c007340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.386+0000 7ff28aaa7640 1 --2- 172.21.15.100:0/3788734232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff26c006eb0 0x7ff26c007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:40.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.386+0000 7ff278ff9640 1 -- 172.21.15.100:0/3788734232 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff26c00a4a0 con 0x7ff26c006eb0 2024-09-11T22:32:40.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.387+0000 7ff28aaa7640 1 -- 172.21.15.100:0/3788734232 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff26c007880 con 0x7ff26c006eb0 2024-09-11T22:32:40.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.387+0000 7ff28aaa7640 1 --2- 172.21.15.100:0/3788734232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff26c006eb0 0x7ff26c007340 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff274017000 tx=0x7ff2740036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:40.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.388+0000 7ff27affd640 1 -- 172.21.15.100:0/3788734232 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff274016050 con 0x7ff26c006eb0 2024-09-11T22:32:40.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.388+0000 7ff27affd640 1 -- 172.21.15.100:0/3788734232 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4555 (secure 0 0 0) 0x7ff27401d0d0 con 0x7ff26c006eb0 2024-09-11T22:32:40.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.388+0000 7ff27affd640 1 -- 172.21.15.100:0/3788734232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff26c006eb0 msgr2=0x7ff26c007340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:40.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.388+0000 7ff27affd640 1 --2- 172.21.15.100:0/3788734232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff26c006eb0 0x7ff26c007340 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff274017000 tx=0x7ff2740036f0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.388+0000 7ff27affd640 1 -- 172.21.15.100:0/3788734232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff26c006eb0 msgr2=0x7ff26c007340 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:32:40.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.388+0000 7ff27affd640 1 --2- 172.21.15.100:0/3788734232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff26c006eb0 0x7ff26c007340 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.391 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:32:40.391 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:32:40.391 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:32:40.391 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:32:40.391 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 88, 2024-09-11T22:32:40.391 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 19524, 2024-09-11T22:32:40.391 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:32:40.391 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:32:40.391 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:32:40.392 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:32:40.392 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:40.392 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 13, 2024-09-11T22:32:40.392 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:32:40.392 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:32:40.392 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:32:40.392 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:40.392 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:40.392 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:40.392 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:40.392 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:40.392 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:40.393 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:40.393 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:40.393 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:40.393 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:40.393 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:40.393 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:40.393 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:32:40.393 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:32:40.393 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:40.393 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:40.393 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:40.393 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:40.393 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:40.394 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:40.394 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:40.394 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:40.394 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:40.394 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:40.394 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:40.394 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:40.394 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.394 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:32:40.394 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:32:40.394 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:32:40.394 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:32:40.394 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:32:40.394 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:32:40.395 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:32:40.395 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:32:40.395 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:32:40.395 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:32:40.395 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:32:40.395 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:32:40.395 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:32:40.395 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:32:40.395 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:32:40.396 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:32:40.396 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:32:40.396 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:40.396 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:40.396 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:40.396 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:40.396 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:40.396 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:40.396 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:40.396 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:40.396 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:40.396 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:40.396 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:40.397 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:40.397 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:32:40.397 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.397 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:32:40.397 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.397 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:32:40.397 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:32:40.397 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:40.397 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:40.397 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.397 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:40.397 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:32:40.397 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:40.397 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.398 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.398 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:40.398 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:32:40.398 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:40.398 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:40.398 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:40.398 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.398 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:32:40.398 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:32:40.398 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:40.398 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:40.398 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:40.398 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.399 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.399 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:32:40.399 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:32:40.399 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:40.399 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:40.399 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.399 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:40.399 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:32:40.399 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:40.399 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.399 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.399 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:40.399 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:32:40.400 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:40.400 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:40.400 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:40.400 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.400 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:32:40.400 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:32:40.400 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:40.400 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:40.400 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:40.400 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.400 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.400 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:32:40.400 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:32:40.401 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:40.401 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:40.401 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.401 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:40.401 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:32:40.401 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:40.401 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.401 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.401 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:40.401 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:32:40.401 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:40.401 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:40.401 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:40.402 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.402 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:32:40.402 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:32:40.402 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:40.402 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:40.402 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:40.402 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:40.402 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:40.402 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.402 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:32:40.402 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:32:40.402 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.402 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:40.403 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:40.403 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:32:40.403 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:40.403 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:40.403 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:32:40.403 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.403 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:40.403 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:40.403 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:32:40.403 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:40.403 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:40.403 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.403 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:32:40.404 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:32:40.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.392+0000 7ff28c50a640 1 -- 172.21.15.100:0/3788734232 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff27006c080 msgr2=0x7ff27006e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:40.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.392+0000 7ff28c50a640 1 --2- 172.21.15.100:0/3788734232 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff27006c080 0x7ff27006e540 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff28000d440 tx=0x7ff280008040 comp rx=0 tx=0).stop 2024-09-11T22:32:40.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.392+0000 7ff28c50a640 1 -- 172.21.15.100:0/3788734232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2840c7ac0 msgr2=0x7ff2841578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:40.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.392+0000 7ff28c50a640 1 --2- 172.21.15.100:0/3788734232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2840c7ac0 0x7ff2841578f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff27c02ae60 tx=0x7ff27c004a40 comp rx=0 tx=0).stop 2024-09-11T22:32:40.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.393+0000 7ff28aaa7640 1 -- 172.21.15.100:0/3788734232 reap_dead start 2024-09-11T22:32:40.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.397+0000 7ff28c50a640 1 -- 172.21.15.100:0/3788734232 shutdown_connections 2024-09-11T22:32:40.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.397+0000 7ff28c50a640 1 -- 172.21.15.100:0/3788734232 >> 172.21.15.100:0/3788734232 conn(0x7ff28406f190 msgr2=0x7ff28406cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:40.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.403+0000 7ff28c50a640 1 -- 172.21.15.100:0/3788734232 shutdown_connections 2024-09-11T22:32:40.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.403+0000 7ff28c50a640 1 -- 172.21.15.100:0/3788734232 wait complete. 2024-09-11T22:32:40.430 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:32:40.430 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:32:40.430 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:32:40.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.653+0000 7fc6fa1c1640 1 Processor -- start 2024-09-11T22:32:40.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.653+0000 7fc6fa1c1640 1 -- start start 2024-09-11T22:32:40.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.655+0000 7fc6fa1c1640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc6ec046150 0x7fc6ec04bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.655+0000 7fc6f99c0640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc6ec046150 0x7fc6ec04bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:40.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.655+0000 7fc6f99c0640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc6ec046150 0x7fc6ec04bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51398/0 (socket says 172.21.15.100:51398) 2024-09-11T22:32:40.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.655+0000 7fc6f99c0640 1 -- 172.21.15.100:0/2025066347 learned_addr learned my addr 172.21.15.100:0/2025066347 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:32:40.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.655+0000 7fc6fa1c1640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6ec0dd1e0 con 0x7fc6ec04c370 2024-09-11T22:32:40.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.655+0000 7fc6fa1c1640 1 -- 172.21.15.100:0/2025066347 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6ec0e2b50 con 0x7fc6ec04b830 2024-09-11T22:32:40.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.655+0000 7fc6fa1c1640 1 -- 172.21.15.100:0/2025066347 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fc6ec0e3a00 con 0x7fc6ec046150 2024-09-11T22:32:40.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.659+0000 7fc6ebfff640 1 -- 172.21.15.100:0/2025066347 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 866274410 0 0) 0x7fc6ec0e2b50 con 0x7fc6ec04b830 2024-09-11T22:32:40.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.660+0000 7fc6ebfff640 1 -- 172.21.15.100:0/2025066347 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6e0003520 con 0x7fc6ec04b830 2024-09-11T22:32:40.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.660+0000 7fc6f99c0640 1 -- 172.21.15.100:0/2025066347 >> v1:172.21.15.167:6789/0 conn(0x7fc6ec04b830 legacy=0x7fc6ec044f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:40.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.660+0000 7fc6f99c0640 1 -- 172.21.15.100:0/2025066347 >> v1:172.21.15.100:6789/0 conn(0x7fc6ec04c370 legacy=0x7fc6ec045a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:40.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.660+0000 7fc6f99c0640 1 -- 172.21.15.100:0/2025066347 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ec0e2df0 con 0x7fc6ec046150 2024-09-11T22:32:40.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.661+0000 7fc6f99c0640 1 --2- 172.21.15.100:0/2025066347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6ec046150 0x7fc6ec04bc10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4074630 tx=0x7fc6f40a69f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93188dbe15df557 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:40.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.664+0000 7fc6ebfff640 1 -- 172.21.15.100:0/2025066347 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f40af070 con 0x7fc6ec046150 2024-09-11T22:32:40.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.664+0000 7fc6ebfff640 1 -- 172.21.15.100:0/2025066347 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6f40ab6d0 con 0x7fc6ec046150 2024-09-11T22:32:40.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.665+0000 7fc6ebfff640 1 -- 172.21.15.100:0/2025066347 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f40abb20 con 0x7fc6ec046150 2024-09-11T22:32:40.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.672+0000 7fc6fa1c1640 1 -- 172.21.15.100:0/2025066347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6ec046150 msgr2=0x7fc6ec04bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:40.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.672+0000 7fc6fa1c1640 1 --2- 172.21.15.100:0/2025066347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6ec046150 0x7fc6ec04bc10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4074630 tx=0x7fc6f40a69f0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.673+0000 7fc6fa1c1640 1 -- 172.21.15.100:0/2025066347 shutdown_connections 2024-09-11T22:32:40.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.673+0000 7fc6fa1c1640 1 --2- 172.21.15.100:0/2025066347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6ec046150 0x7fc6ec04bc10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.673+0000 7fc6fa1c1640 1 -- 172.21.15.100:0/2025066347 >> 172.21.15.100:0/2025066347 conn(0x7fc6ec0500a0 msgr2=0x7fc6ec0504b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:40.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.673+0000 7fc6fa1c1640 1 -- 172.21.15.100:0/2025066347 shutdown_connections 2024-09-11T22:32:40.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.673+0000 7fc6fa1c1640 1 -- 172.21.15.100:0/2025066347 wait complete. 2024-09-11T22:32:40.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.675+0000 7fc6fa1c1640 1 Processor -- start 2024-09-11T22:32:40.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.675+0000 7fc6fa1c1640 1 -- start start 2024-09-11T22:32:40.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.676+0000 7fc6fa1c1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6ec046150 0x7fc6ec047e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.676+0000 7fc6fa1c1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6ec04b830 0x7fc6ec048830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.676+0000 7fc6fa1c1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6ec04c370 0x7fc6ec048d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.676+0000 7fc6fa1c1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec0e3690 con 0x7fc6ec04b830 2024-09-11T22:32:40.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.676+0000 7fc6fa1c1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec0e33b0 con 0x7fc6ec046150 2024-09-11T22:32:40.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.676+0000 7fc6fa1c1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc6ec032fe0 con 0x7fc6ec04c370 2024-09-11T22:32:40.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.677+0000 7fc6f99c0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6ec04c370 0x7fc6ec048d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:40.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.677+0000 7fc6f99c0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6ec04c370 0x7fc6ec048d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:46008/0 (socket says 172.21.15.100:46008) 2024-09-11T22:32:40.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.677+0000 7fc6f99c0640 1 -- 172.21.15.100:0/600426592 learned_addr learned my addr 172.21.15.100:0/600426592 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:32:40.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.677+0000 7fc6f89be640 1 --2- 172.21.15.100:0/600426592 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6ec04b830 0x7fc6ec048830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:40.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.677+0000 7fc6f89be640 1 -- 172.21.15.100:0/600426592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6ec04c370 msgr2=0x7fc6ec048d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:40.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.677+0000 7fc6f89be640 1 --2- 172.21.15.100:0/600426592 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6ec04c370 0x7fc6ec048d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.677+0000 7fc6f89be640 1 -- 172.21.15.100:0/600426592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6ec046150 msgr2=0x7fc6ec047e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:40.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.677+0000 7fc6f89be640 1 --2- 172.21.15.100:0/600426592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6ec046150 0x7fc6ec047e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.677+0000 7fc6f89be640 1 -- 172.21.15.100:0/600426592 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ec049c20 con 0x7fc6ec04b830 2024-09-11T22:32:40.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.678+0000 7fc6f89be640 1 --2- 172.21.15.100:0/600426592 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6ec04b830 0x7fc6ec048830 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc6f000b410 tx=0x7fc6f000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:40.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.678+0000 7fc6e9ffb640 1 -- 172.21.15.100:0/600426592 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0015020 con 0x7fc6ec04b830 2024-09-11T22:32:40.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.679+0000 7fc6e9ffb640 1 -- 172.21.15.100:0/600426592 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6f0011830 con 0x7fc6ec04b830 2024-09-11T22:32:40.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.679+0000 7fc6e9ffb640 1 -- 172.21.15.100:0/600426592 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0011be0 con 0x7fc6ec04b830 2024-09-11T22:32:40.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.680+0000 7fc6fa1c1640 1 -- 172.21.15.100:0/600426592 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6ec0e3e90 con 0x7fc6ec04b830 2024-09-11T22:32:40.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.680+0000 7fc6fa1c1640 1 -- 172.21.15.100:0/600426592 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6ec049e90 con 0x7fc6ec04b830 2024-09-11T22:32:40.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.682+0000 7fc6e9ffb640 1 -- 172.21.15.100:0/600426592 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc6f0018020 con 0x7fc6ec04b830 2024-09-11T22:32:40.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.682+0000 7fc6fa1c1640 1 --2- 172.21.15.100:0/600426592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6ec04a0d0 0x7fc6ec181300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.682+0000 7fc6fa1c1640 1 -- 172.21.15.100:0/600426592 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec04bc10 con 0x7fc6ec04a0d0 2024-09-11T22:32:40.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.683+0000 7fc6e9ffb640 1 --2- 172.21.15.100:0/600426592 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc6d806bf30 0x7fc6d806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.683+0000 7fc6e9ffb640 1 -- 172.21.15.100:0/600426592 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fc6f008ac60 con 0x7fc6ec04b830 2024-09-11T22:32:40.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.683+0000 7fc6f91bf640 1 --2- 172.21.15.100:0/600426592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6ec04a0d0 0x7fc6ec181300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:40.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.684+0000 7fc6f99c0640 1 --2- 172.21.15.100:0/600426592 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc6d806bf30 0x7fc6d806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:40.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.684+0000 7fc6f91bf640 1 -- 172.21.15.100:0/600426592 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc6ec04b610 con 0x7fc6ec04a0d0 2024-09-11T22:32:40.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.684+0000 7fc6f91bf640 1 --2- 172.21.15.100:0/600426592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6ec04a0d0 0x7fc6ec181300 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400c310 tx=0x7fc6e400c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:40.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.684+0000 7fc6e9ffb640 1 -- 172.21.15.100:0/600426592 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4017070 con 0x7fc6ec04a0d0 2024-09-11T22:32:40.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.685+0000 7fc6e9ffb640 1 -- 172.21.15.100:0/600426592 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc6e40035f0 con 0x7fc6ec04a0d0 2024-09-11T22:32:40.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.685+0000 7fc6e9ffb640 1 -- 172.21.15.100:0/600426592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6ec04a0d0 msgr2=0x7fc6ec181300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:40.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.685+0000 7fc6e9ffb640 1 --2- 172.21.15.100:0/600426592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6ec04a0d0 0x7fc6ec181300 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc6e400c310 tx=0x7fc6e400c7d0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.685+0000 7fc6e9ffb640 1 -- 172.21.15.100:0/600426592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6ec04a0d0 msgr2=0x7fc6ec181300 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:32:40.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.685+0000 7fc6e9ffb640 1 --2- 172.21.15.100:0/600426592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6ec04a0d0 0x7fc6ec181300 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.685+0000 7fc6f99c0640 1 --2- 172.21.15.100:0/600426592 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc6d806bf30 0x7fc6d806e3f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4069460 tx=0x7fc6f40b6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:40.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.702+0000 7fc6fa1c1640 1 --2- 172.21.15.100:0/600426592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6ec0e4dd0 0x7fc6ec181840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.703+0000 7fc6fa1c1640 1 -- 172.21.15.100:0/600426592 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ec180f30 con 0x7fc6ec0e4dd0 2024-09-11T22:32:40.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.703+0000 7fc6f91bf640 1 --2- 172.21.15.100:0/600426592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6ec0e4dd0 0x7fc6ec181840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:40.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.703+0000 7fc6f91bf640 1 -- 172.21.15.100:0/600426592 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc6ec045020 con 0x7fc6ec0e4dd0 2024-09-11T22:32:40.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.704+0000 7fc6f91bf640 1 --2- 172.21.15.100:0/600426592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6ec0e4dd0 0x7fc6ec181840 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4000fb0 tx=0x7fc6e4001080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:40.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.704+0000 7fc6e9ffb640 1 -- 172.21.15.100:0/600426592 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4017030 con 0x7fc6ec0e4dd0 2024-09-11T22:32:40.705 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:32:40.706 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:32:40.706 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:32:40.706 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:32:40.706 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 88, 2024-09-11T22:32:40.706 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 545982, 2024-09-11T22:32:40.706 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:32:40.706 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:32:40.706 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:32:40.706 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:32:40.706 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:40.706 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 13, 2024-09-11T22:32:40.707 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:32:40.707 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:32:40.707 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:32:40.707 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:40.707 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:40.707 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:40.707 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:40.707 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:40.707 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:40.707 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:40.707 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:40.707 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:40.707 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:40.708 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:40.708 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:40.708 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:32:40.708 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:32:40.708 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:40.708 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:40.708 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:40.708 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:40.708 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:40.708 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:40.708 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:40.708 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:40.708 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:40.709 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:40.709 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:40.709 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:40.709 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.709 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:32:40.709 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:32:40.709 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:32:40.709 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:32:40.709 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:32:40.709 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:32:40.709 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:32:40.709 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:32:40.709 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:32:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:32:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:32:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:32:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:32:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:32:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:32:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:32:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:32:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:40.710 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:32:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:32:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:32:40.711 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:32:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:32:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:32:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:40.712 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.713 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:32:40.713 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:32:40.713 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:40.713 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:40.713 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:40.713 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.713 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.713 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:32:40.713 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:32:40.713 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:40.713 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:40.713 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.713 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:32:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:32:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:32:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:32:40.714 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:32:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:32:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:32:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.715 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.716 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:40.716 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:32:40.716 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:40.716 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:40.716 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:40.716 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.716 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:32:40.716 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:32:40.716 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:40.716 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:40.716 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:40.716 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:32:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:32:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:32:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:32:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:40.717 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:32:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:32:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:32:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:32:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:40.718 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:40.719 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:32:40.719 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:40.719 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:40.719 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:40.719 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:32:40.719 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:32:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.704+0000 7fc6e9ffb640 1 -- 172.21.15.100:0/600426592 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4888 (secure 0 0 0) 0x7fc6e4021370 con 0x7fc6ec0e4dd0 2024-09-11T22:32:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.704+0000 7fc6e9ffb640 1 -- 172.21.15.100:0/600426592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6ec0e4dd0 msgr2=0x7fc6ec181840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.704+0000 7fc6e9ffb640 1 --2- 172.21.15.100:0/600426592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6ec0e4dd0 0x7fc6ec181840 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4000fb0 tx=0x7fc6e4001080 comp rx=0 tx=0).stop 2024-09-11T22:32:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.704+0000 7fc6e9ffb640 1 -- 172.21.15.100:0/600426592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6ec0e4dd0 msgr2=0x7fc6ec181840 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:32:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.704+0000 7fc6e9ffb640 1 --2- 172.21.15.100:0/600426592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6ec0e4dd0 0x7fc6ec181840 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.709+0000 7fc6d77fe640 1 -- 172.21.15.100:0/600426592 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc6d806bf30 msgr2=0x7fc6d806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.709+0000 7fc6d77fe640 1 --2- 172.21.15.100:0/600426592 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc6d806bf30 0x7fc6d806e3f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4069460 tx=0x7fc6f40b6040 comp rx=0 tx=0).stop 2024-09-11T22:32:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.709+0000 7fc6f99c0640 1 -- 172.21.15.100:0/600426592 reap_dead start 2024-09-11T22:32:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.709+0000 7fc6d77fe640 1 -- 172.21.15.100:0/600426592 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6ec04b830 msgr2=0x7fc6ec048830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:40.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.709+0000 7fc6d77fe640 1 --2- 172.21.15.100:0/600426592 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6ec04b830 0x7fc6ec048830 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc6f000b410 tx=0x7fc6f000b8d0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.710+0000 7fc6d77fe640 1 -- 172.21.15.100:0/600426592 shutdown_connections 2024-09-11T22:32:40.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.710+0000 7fc6d77fe640 1 --2- 172.21.15.100:0/600426592 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6ec04b830 0x7fc6ec048830 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.710+0000 7fc6d77fe640 1 -- 172.21.15.100:0/600426592 >> 172.21.15.100:0/600426592 conn(0x7fc6ec0500a0 msgr2=0x7fc6ec0e0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:40.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.710+0000 7fc6d77fe640 1 -- 172.21.15.100:0/600426592 shutdown_connections 2024-09-11T22:32:40.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.710+0000 7fc6d77fe640 1 -- 172.21.15.100:0/600426592 wait complete. 2024-09-11T22:32:40.740 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:32:40.740 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:32:40.740 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:32:40.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.957+0000 7fb426196640 1 Processor -- start 2024-09-11T22:32:40.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.958+0000 7fb426196640 1 -- start start 2024-09-11T22:32:40.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.959+0000 7fb426196640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb418005a00 0x7fb418044b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.959+0000 7fb426196640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4180e6ae0 con 0x7fb4180dce90 2024-09-11T22:32:40.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.959+0000 7fb426196640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4180e6dc0 con 0x7fb41804aa40 2024-09-11T22:32:40.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.959+0000 7fb426196640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb418045660 con 0x7fb418005a00 2024-09-11T22:32:40.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.963+0000 7fb425194640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb4180dce90 0x7fb418046390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48890/0 (socket says 172.21.15.100:48890) 2024-09-11T22:32:40.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.963+0000 7fb425194640 1 -- 172.21.15.100:0/2491429768 learned_addr learned my addr 172.21.15.100:0/2491429768 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:32:40.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.965+0000 7fb417fff640 1 -- 172.21.15.100:0/2491429768 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4050795283 0 0) 0x7fb4180e6dc0 con 0x7fb41804aa40 2024-09-11T22:32:40.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.965+0000 7fb417fff640 1 -- 172.21.15.100:0/2491429768 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb40c003520 con 0x7fb41804aa40 2024-09-11T22:32:40.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.965+0000 7fb425995640 1 --2- 172.21.15.100:0/2491429768 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb418005a00 0x7fb418044b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:40.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.966+0000 7fb417fff640 1 -- 172.21.15.100:0/2491429768 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1053104837 0 0) 0x7fb40c003520 con 0x7fb41804aa40 2024-09-11T22:32:40.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.966+0000 7fb417fff640 1 -- 172.21.15.100:0/2491429768 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb418005a00 msgr2=0x7fb418044b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:40.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.966+0000 7fb417fff640 1 --2- 172.21.15.100:0/2491429768 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb418005a00 0x7fb418044b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.966+0000 7fb417fff640 1 -- 172.21.15.100:0/2491429768 >> v1:172.21.15.100:6789/0 conn(0x7fb4180dce90 legacy=0x7fb418046390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:40.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.966+0000 7fb417fff640 1 -- 172.21.15.100:0/2491429768 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4180458b0 con 0x7fb41804aa40 2024-09-11T22:32:40.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.966+0000 7fb417fff640 1 -- 172.21.15.100:0/2491429768 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fb420050800 con 0x7fb41804aa40 2024-09-11T22:32:40.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.966+0000 7fb417fff640 1 -- 172.21.15.100:0/2491429768 >> v1:172.21.15.167:6789/0 conn(0x7fb41804aa40 legacy=0x7fb4180e6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:40.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.966+0000 7fb417fff640 1 --2- 172.21.15.100:0/2491429768 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb418005a00 0x7fb40c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.966+0000 7fb417fff640 1 --2- 172.21.15.100:0/2491429768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb40c004020 0x7fb40c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.966+0000 7fb417fff640 1 --2- 172.21.15.100:0/2491429768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb40c004d40 0x7fb40c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.966+0000 7fb417fff640 1 -- 172.21.15.100:0/2491429768 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb418045660 con 0x7fb40c004d40 2024-09-11T22:32:40.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.966+0000 7fb417fff640 1 -- 172.21.15.100:0/2491429768 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c01cb10 con 0x7fb40c004020 2024-09-11T22:32:40.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.966+0000 7fb417fff640 1 -- 172.21.15.100:0/2491429768 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb40c01cd10 con 0x7fb418005a00 2024-09-11T22:32:40.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.966+0000 7fb424993640 1 --2- 172.21.15.100:0/2491429768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb40c004020 0x7fb40c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:40.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.967+0000 7fb425194640 1 --2- 172.21.15.100:0/2491429768 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb418005a00 0x7fb40c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:40.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.967+0000 7fb425995640 1 --2- 172.21.15.100:0/2491429768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb40c004d40 0x7fb40c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:40.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.967+0000 7fb424993640 1 -- 172.21.15.100:0/2491429768 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb418005a00 msgr2=0x7fb40c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:40.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.967+0000 7fb424993640 1 --2- 172.21.15.100:0/2491429768 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb418005a00 0x7fb40c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.967+0000 7fb424993640 1 -- 172.21.15.100:0/2491429768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb40c004d40 msgr2=0x7fb40c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:32:40.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.967+0000 7fb424993640 1 --2- 172.21.15.100:0/2491429768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb40c004d40 0x7fb40c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.967+0000 7fb424993640 1 -- 172.21.15.100:0/2491429768 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4180458b0 con 0x7fb40c004020 2024-09-11T22:32:40.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.967+0000 7fb425995640 1 --2- 172.21.15.100:0/2491429768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb40c004d40 0x7fb40c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:32:40.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.969+0000 7fb424993640 1 --2- 172.21.15.100:0/2491429768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb40c004020 0x7fb40c004800 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb42006a4c0 tx=0x7fb40c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9277e02c2e5fb280 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:40.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.969+0000 7fb417fff640 1 -- 172.21.15.100:0/2491429768 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4200d6070 con 0x7fb40c004020 2024-09-11T22:32:40.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.969+0000 7fb417fff640 1 -- 172.21.15.100:0/2491429768 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4200c9d00 con 0x7fb40c004020 2024-09-11T22:32:40.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.970+0000 7fb426196640 1 -- 172.21.15.100:0/2491429768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb40c004020 msgr2=0x7fb40c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:40.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.970+0000 7fb417fff640 1 -- 172.21.15.100:0/2491429768 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4200d6070 con 0x7fb40c004020 2024-09-11T22:32:40.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.970+0000 7fb426196640 1 --2- 172.21.15.100:0/2491429768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb40c004020 0x7fb40c004800 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb42006a4c0 tx=0x7fb40c005830 comp rx=0 tx=0).stop 2024-09-11T22:32:40.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.970+0000 7fb425995640 1 -- 172.21.15.100:0/2491429768 reap_dead start 2024-09-11T22:32:40.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.972+0000 7fb426196640 1 -- 172.21.15.100:0/2491429768 shutdown_connections 2024-09-11T22:32:40.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.972+0000 7fb426196640 1 -- 172.21.15.100:0/2491429768 >> 172.21.15.100:0/2491429768 conn(0x7fb41804fc50 msgr2=0x7fb418050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:40.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.972+0000 7fb426196640 1 -- 172.21.15.100:0/2491429768 shutdown_connections 2024-09-11T22:32:40.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.976+0000 7fb426196640 1 -- 172.21.15.100:0/2491429768 wait complete. 2024-09-11T22:32:40.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.978+0000 7fb426196640 1 Processor -- start 2024-09-11T22:32:40.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.979+0000 7fb426196640 1 -- start start 2024-09-11T22:32:40.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.980+0000 7fb426196640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb40c004020 0x7fb418046f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.980+0000 7fb426196640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb418049d10 0x7fb4180dbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.980+0000 7fb426196640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4181744e0 0x7fb418174960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.980+0000 7fb426196640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb4180dd270 con 0x7fb4181744e0 2024-09-11T22:32:40.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.980+0000 7fb426196640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb418045f00 con 0x7fb418049d10 2024-09-11T22:32:40.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.980+0000 7fb426196640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb4180e6740 con 0x7fb40c004020 2024-09-11T22:32:40.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.980+0000 7fb425194640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb40c004020 0x7fb418046f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:40.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.981+0000 7fb425194640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb40c004020 0x7fb418046f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:46048/0 (socket says 172.21.15.100:46048) 2024-09-11T22:32:40.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.981+0000 7fb425194640 1 -- 172.21.15.100:0/4047038758 learned_addr learned my addr 172.21.15.100:0/4047038758 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:32:40.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.981+0000 7fb424993640 1 --2- 172.21.15.100:0/4047038758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb418049d10 0x7fb4180dbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:40.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.983+0000 7fb424993640 1 -- 172.21.15.100:0/4047038758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb40c004020 msgr2=0x7fb418046f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:40.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.983+0000 7fb424993640 1 --2- 172.21.15.100:0/4047038758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb40c004020 0x7fb418046f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.983+0000 7fb424993640 1 -- 172.21.15.100:0/4047038758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4181744e0 msgr2=0x7fb418174960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:32:40.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.983+0000 7fb424993640 1 --2- 172.21.15.100:0/4047038758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4181744e0 0x7fb418174960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:40.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.983+0000 7fb424993640 1 -- 172.21.15.100:0/4047038758 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb418174ea0 con 0x7fb418049d10 2024-09-11T22:32:40.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.983+0000 7fb424993640 1 --2- 172.21.15.100:0/4047038758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb418049d10 0x7fb4180dbf30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb420050d60 tx=0x7fb420069df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:40.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.985+0000 7fb415ffb640 1 -- 172.21.15.100:0/4047038758 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4200de020 con 0x7fb418049d10 2024-09-11T22:32:40.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.985+0000 7fb426196640 1 -- 172.21.15.100:0/4047038758 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb418047490 con 0x7fb418049d10 2024-09-11T22:32:40.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.986+0000 7fb415ffb640 1 -- 172.21.15.100:0/4047038758 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb420074e50 con 0x7fb418049d10 2024-09-11T22:32:40.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.986+0000 7fb415ffb640 1 -- 172.21.15.100:0/4047038758 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4200d6040 con 0x7fb418049d10 2024-09-11T22:32:40.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.986+0000 7fb426196640 1 -- 172.21.15.100:0/4047038758 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4180df910 con 0x7fb418049d10 2024-09-11T22:32:40.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.988+0000 7fb426196640 1 --2- 172.21.15.100:0/4047038758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4180dfbf0 0x7fb4180dd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.988+0000 7fb426196640 1 -- 172.21.15.100:0/4047038758 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb41804a7d0 con 0x7fb4180dfbf0 2024-09-11T22:32:40.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.988+0000 7fb425194640 1 --2- 172.21.15.100:0/4047038758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4180dfbf0 0x7fb4180dd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:40.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.989+0000 7fb415ffb640 1 -- 172.21.15.100:0/4047038758 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb4200e1020 con 0x7fb418049d10 2024-09-11T22:32:40.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.989+0000 7fb415ffb640 1 --2- 172.21.15.100:0/4047038758 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb40406bf30 0x7fb40406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:40.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.991+0000 7fb415ffb640 1 -- 172.21.15.100:0/4047038758 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fb4201497c0 con 0x7fb418049d10 2024-09-11T22:32:40.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.991+0000 7fb425995640 1 --2- 172.21.15.100:0/4047038758 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb40406bf30 0x7fb40406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:40.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.992+0000 7fb425995640 1 --2- 172.21.15.100:0/4047038758 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb40406bf30 0x7fb40406e3f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb4180e06f0 tx=0x7fb410008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:40.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.992+0000 7fb425194640 1 -- 172.21.15.100:0/4047038758 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb4180e6030 con 0x7fb4180dfbf0 2024-09-11T22:32:40.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.995+0000 7fb425194640 1 --2- 172.21.15.100:0/4047038758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4180dfbf0 0x7fb4180dd3f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb41c000fb0 tx=0x7fb41c001920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:40.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.995+0000 7fb415ffb640 1 -- 172.21.15.100:0/4047038758 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c019020 con 0x7fb4180dfbf0 2024-09-11T22:32:40.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.995+0000 7fb415ffb640 1 -- 172.21.15.100:0/4047038758 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fb41c015680 con 0x7fb4180dfbf0 2024-09-11T22:32:41.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.995+0000 7fb415ffb640 1 -- 172.21.15.100:0/4047038758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4180dfbf0 msgr2=0x7fb4180dd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:41.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.995+0000 7fb415ffb640 1 --2- 172.21.15.100:0/4047038758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4180dfbf0 0x7fb4180dd3f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb41c000fb0 tx=0x7fb41c001920 comp rx=0 tx=0).stop 2024-09-11T22:32:41.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.996+0000 7fb415ffb640 1 -- 172.21.15.100:0/4047038758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4180dfbf0 msgr2=0x7fb4180dd3f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:32:41.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:40.996+0000 7fb415ffb640 1 --2- 172.21.15.100:0/4047038758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4180dfbf0 0x7fb4180dd3f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:41.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:41.012+0000 7fb426196640 1 --2- 172.21.15.100:0/4047038758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4180dffd0 0x7fb4180dd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:41.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:41.013+0000 7fb426196640 1 -- 172.21.15.100:0/4047038758 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb4180da260 con 0x7fb4180dffd0 2024-09-11T22:32:41.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:41.013+0000 7fb425194640 1 --2- 172.21.15.100:0/4047038758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4180dffd0 0x7fb4180dd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:41.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:41.013+0000 7fb425194640 1 -- 172.21.15.100:0/4047038758 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb418046ab0 con 0x7fb4180dffd0 2024-09-11T22:32:41.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:41.014+0000 7fb425194640 1 --2- 172.21.15.100:0/4047038758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4180dffd0 0x7fb4180dd930 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb41c01a000 tx=0x7fb41c001120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:32:41.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:41.014+0000 7fb415ffb640 1 -- 172.21.15.100:0/4047038758 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c019030 con 0x7fb4180dffd0 2024-09-11T22:32:41.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:41.014+0000 7fb415ffb640 1 -- 172.21.15.100:0/4047038758 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7fb41c011750 con 0x7fb4180dffd0 2024-09-11T22:32:41.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:41.014+0000 7fb415ffb640 1 -- 172.21.15.100:0/4047038758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4180dffd0 msgr2=0x7fb4180dd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:41.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:41.014+0000 7fb415ffb640 1 --2- 172.21.15.100:0/4047038758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4180dffd0 0x7fb4180dd930 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb41c01a000 tx=0x7fb41c001120 comp rx=0 tx=0).stop 2024-09-11T22:32:41.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:41.014+0000 7fb415ffb640 1 -- 172.21.15.100:0/4047038758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4180dffd0 msgr2=0x7fb4180dd930 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:32:41.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:41.014+0000 7fb415ffb640 1 --2- 172.21.15.100:0/4047038758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4180dffd0 0x7fb4180dd930 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:41.022 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:32:41.022 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:32:41.022 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:32:41.022 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:32:41.022 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 88, 2024-09-11T22:32:41.022 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 651735, 2024-09-11T22:32:41.022 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:32:41.022 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:32:41.022 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:32:41.022 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:32:41.023 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:41.023 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 13, 2024-09-11T22:32:41.023 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:32:41.023 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:32:41.023 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:32:41.023 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:41.023 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:41.023 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:41.023 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:41.023 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:41.023 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:41.023 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:41.023 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:41.023 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:41.024 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:41.024 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:41.024 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:41.024 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:32:41.024 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:32:41.024 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:41.024 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:41.024 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:41.024 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:41.024 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:41.024 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:41.024 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:41.024 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:41.025 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:41.025 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:41.025 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:41.025 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:41.025 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:41.025 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:32:41.025 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:32:41.025 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:32:41.025 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:32:41.025 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:32:41.025 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:32:41.025 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:32:41.025 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:32:41.025 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:32:41.026 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:32:41.026 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:32:41.026 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:32:41.026 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:32:41.026 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:32:41.026 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:32:41.026 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:32:41.026 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:32:41.026 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:32:41.026 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:32:41.026 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:32:41.026 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:32:41.026 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:32:41.026 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:32:41.027 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:32:41.027 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:32:41.027 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:32:41.027 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:32:41.027 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:32:41.027 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:41.027 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:32:41.027 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:41.027 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:32:41.027 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:41.027 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:32:41.027 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:32:41.027 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:41.027 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:41.028 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:41.028 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:41.028 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:32:41.028 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:41.028 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:41.028 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:41.028 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:41.028 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:32:41.028 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:41.028 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:41.028 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:41.028 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:41.029 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:32:41.029 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:32:41.029 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:41.029 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:41.029 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:41.029 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:41.029 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:41.029 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:32:41.029 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:32:41.029 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:41.029 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:41.029 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:41.029 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:41.029 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:32:41.030 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:41.030 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:41.030 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:41.030 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:41.030 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:32:41.030 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:41.030 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:41.030 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:41.030 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:41.030 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:32:41.030 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:32:41.030 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:41.030 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:41.031 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:41.031 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:41.031 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:41.031 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:32:41.031 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:32:41.031 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:32:41.031 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:32:41.031 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:41.031 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:32:41.031 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:32:41.031 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:41.031 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:41.031 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:41.031 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:32:41.032 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:32:41.032 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:32:41.032 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:41.032 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:41.032 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:41.032 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:32:41.032 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:32:41.032 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:32:41.032 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:32:41.032 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:32:41.032 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:41.032 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:41.032 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:41.032 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:32:41.033 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:32:41.033 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:41.033 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:41.033 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:41.033 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:32:41.033 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:41.033 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:41.033 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:32:41.033 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:41.033 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:41.033 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:41.033 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:32:41.034 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:41.034 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:41.034 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:32:41.034 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:41.034 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:41.034 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:41.034 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:32:41.034 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:41.034 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:41.034 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:32:41.034 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:41.034 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:41.034 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:41.034 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:32:41.035 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:41.035 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:32:41.035 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:32:41.035 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:32:41.035 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:32:41.035 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:32:41.035 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:32:41.035 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:32:41.035 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:32:41.035 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:32:41.035 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:32:41.035 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:32:41.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:41.025+0000 7fb40b7fe640 1 -- 172.21.15.100:0/4047038758 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb40406bf30 msgr2=0x7fb40406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:41.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:41.025+0000 7fb40b7fe640 1 --2- 172.21.15.100:0/4047038758 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb40406bf30 0x7fb40406e3f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb4180e06f0 tx=0x7fb410008040 comp rx=0 tx=0).stop 2024-09-11T22:32:41.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:41.025+0000 7fb425995640 1 -- 172.21.15.100:0/4047038758 reap_dead start 2024-09-11T22:32:41.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:41.026+0000 7fb40b7fe640 1 -- 172.21.15.100:0/4047038758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb418049d10 msgr2=0x7fb4180dbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:41.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:41.026+0000 7fb40b7fe640 1 --2- 172.21.15.100:0/4047038758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb418049d10 0x7fb4180dbf30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb420050d60 tx=0x7fb420069df0 comp rx=0 tx=0).stop 2024-09-11T22:32:41.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:41.026+0000 7fb40b7fe640 1 -- 172.21.15.100:0/4047038758 shutdown_connections 2024-09-11T22:32:41.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:41.026+0000 7fb40b7fe640 1 --2- 172.21.15.100:0/4047038758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb418049d10 0x7fb4180dbf30 secure :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb420050d60 tx=0x7fb420069df0 comp rx=0 tx=0).stop 2024-09-11T22:32:41.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:41.026+0000 7fb40b7fe640 1 -- 172.21.15.100:0/4047038758 >> 172.21.15.100:0/4047038758 conn(0x7fb41804fc50 msgr2=0x7fb41804c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:32:41.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:41.027+0000 7fb40b7fe640 1 -- 172.21.15.100:0/4047038758 shutdown_connections 2024-09-11T22:32:41.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:41.032+0000 7fb40b7fe640 1 -- 172.21.15.100:0/4047038758 wait complete. 2024-09-11T22:32:41.058 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:32:41.059 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2024-09-11T22:32:41.059 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2024-09-11T22:32:41.059 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-11T22:32:41.059 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-11T22:32:41.059 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-11T22:32:41.059 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:32:41.074 INFO:tasks.ceph.mon.b:Stopped 2024-09-11T22:32:41.074 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-09-11T22:32:41.075 INFO:tasks.ceph.mon.a:Sent signal 19 2024-09-11T22:32:41.075 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-11T22:32:53.283 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:32:53.286 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:32:56.075 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-09-11T22:32:56.076 INFO:tasks.ceph.mon.a:Sent signal 18 2024-09-11T22:32:56.076 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-11T22:32:56.076 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:32:56.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.264+0000 7f732dcc9640 1 Processor -- start 2024-09-11T22:32:56.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.266+0000 7f732dcc9640 1 -- start start 2024-09-11T22:32:56.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.267+0000 7f732dcc9640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 0x7f7328151420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:56.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.267+0000 7f732dcc9640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73280c5b50 con 0x7f73280c7c10 2024-09-11T22:32:56.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.267+0000 7f732dcc9640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73280c6410 con 0x7f73280c72b0 2024-09-11T22:32:56.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.267+0000 7f732dcc9640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f73281577f0 con 0x7f73280c4710 2024-09-11T22:32:56.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.267+0000 7f7327fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 0x7f7328151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:56.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.267+0000 7f7327fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 0x7f7328151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58902/0 (socket says 172.21.15.100:58902) 2024-09-11T22:32:56.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.267+0000 7f7327fff640 1 -- 172.21.15.100:0/3752440596 learned_addr learned my addr 172.21.15.100:0/3752440596 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:32:56.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.268+0000 7f7327fff640 1 -- 172.21.15.100:0/3752440596 >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 msgr2=0x7f7328151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:32:56.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.268+0000 7f7327fff640 1 -- 172.21.15.100:0/3752440596 >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 msgr2=0x7f7328151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:32:56.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.268+0000 7f7327fff640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 0x7f7328151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:32:56.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.268+0000 7f7327fff640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 0x7f7328151420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:32:56.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.270+0000 7f731ffff640 1 -- 172.21.15.100:0/3752440596 >> v1:172.21.15.167:6789/0 conn(0x7f73280c72b0 legacy=0x7f7328157c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2024-09-11T22:32:56.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.471+0000 7f731ffff640 1 -- 172.21.15.100:0/3752440596 >> v1:172.21.15.167:6789/0 conn(0x7f73280c72b0 legacy=0x7f7328157c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2024-09-11T22:32:56.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.476+0000 7f7327fff640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 0x7f7328151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:56.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.476+0000 7f7327fff640 1 -- 172.21.15.100:0/3752440596 >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 msgr2=0x7f7328151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:32:56.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.476+0000 7f7327fff640 1 -- 172.21.15.100:0/3752440596 >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 msgr2=0x7f7328151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:32:56.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.476+0000 7f7327fff640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 0x7f7328151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:32:56.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.476+0000 7f7327fff640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 0x7f7328151420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:32:56.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.872+0000 7f731ffff640 1 -- 172.21.15.100:0/3752440596 >> v1:172.21.15.167:6789/0 conn(0x7f73280c72b0 legacy=0x7f7328157c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2024-09-11T22:32:56.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.877+0000 7f7327fff640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 0x7f7328151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:56.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.877+0000 7f7327fff640 1 -- 172.21.15.100:0/3752440596 >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 msgr2=0x7f7328151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:32:56.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.877+0000 7f7327fff640 1 -- 172.21.15.100:0/3752440596 >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 msgr2=0x7f7328151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:32:56.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.877+0000 7f7327fff640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 0x7f7328151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:32:56.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:56.877+0000 7f7327fff640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 0x7f7328151420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:32:57.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:57.673+0000 7f731ffff640 1 -- 172.21.15.100:0/3752440596 >> v1:172.21.15.167:6789/0 conn(0x7f73280c72b0 legacy=0x7f7328157c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2024-09-11T22:32:57.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:57.681+0000 7f7327fff640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 0x7f7328151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:57.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:57.681+0000 7f7327fff640 1 -- 172.21.15.100:0/3752440596 >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 msgr2=0x7f7328151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:32:57.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:57.681+0000 7f7327fff640 1 -- 172.21.15.100:0/3752440596 >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 msgr2=0x7f7328151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:32:57.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:57.681+0000 7f7327fff640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 0x7f7328151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:32:57.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:57.681+0000 7f7327fff640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 0x7f7328151420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:32:59.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.267+0000 7f7325ffb640 1 -- 172.21.15.100:0/3752440596 >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 msgr2=0x7f7328151420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:32:59.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.267+0000 7f7325ffb640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.100:3300/0 conn(0x7f73280c4710 0x7f7328151420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:32:59.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.267+0000 7f7325ffb640 1 -- 172.21.15.100:0/3752440596 >> v1:172.21.15.167:6789/0 conn(0x7f73280c72b0 legacy=0x7f7328157c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:32:59.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.267+0000 7f7325ffb640 1 -- 172.21.15.100:0/3752440596 >> v1:172.21.15.100:6789/0 conn(0x7f73280c7c10 legacy=0x7f73280cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:32:59.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.267+0000 7f7325ffb640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.167:3300/0 conn(0x7f73080036a0 0x7f7308005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:59.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.267+0000 7f7325ffb640 1 --2- 172.21.15.100:0/3752440596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308006110 0x7f73080085d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:32:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.267+0000 7f7325ffb640 1 -- 172.21.15.100:0/3752440596 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f73281577f0 con 0x7f73080036a0 2024-09-11T22:32:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.267+0000 7f7325ffb640 1 -- 172.21.15.100:0/3752440596 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7308008cf0 con 0x7f7308006110 2024-09-11T22:32:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.267+0000 7f73277fe640 1 -- 172.21.15.100:0/3752440596 >> v2:172.21.15.167:3300/0 conn(0x7f73080036a0 msgr2=0x7f7308005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2024-09-11T22:32:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.267+0000 7f73277fe640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.167:3300/0 conn(0x7f73080036a0 0x7f7308005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:32:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.268+0000 7f731ffff640 1 --2- 172.21.15.100:0/3752440596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308006110 0x7f73080085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.268+0000 7f731ffff640 1 -- 172.21.15.100:0/3752440596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308006110 msgr2=0x7f73080085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:32:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.268+0000 7f731ffff640 1 -- 172.21.15.100:0/3752440596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308006110 msgr2=0x7f73080085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:32:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.268+0000 7f731ffff640 1 --2- 172.21.15.100:0/3752440596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308006110 0x7f73080085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:32:59.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.268+0000 7f731ffff640 1 --2- 172.21.15.100:0/3752440596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308006110 0x7f73080085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:32:59.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.468+0000 7f73277fe640 1 -- 172.21.15.100:0/3752440596 >> v2:172.21.15.167:3300/0 conn(0x7f73080036a0 msgr2=0x7f7308005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2024-09-11T22:32:59.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.468+0000 7f73277fe640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.167:3300/0 conn(0x7f73080036a0 0x7f7308005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:32:59.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.469+0000 7f731ffff640 1 --2- 172.21.15.100:0/3752440596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308006110 0x7f73080085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:59.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.469+0000 7f731ffff640 1 -- 172.21.15.100:0/3752440596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308006110 msgr2=0x7f73080085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:32:59.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.469+0000 7f731ffff640 1 -- 172.21.15.100:0/3752440596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308006110 msgr2=0x7f73080085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:32:59.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.469+0000 7f731ffff640 1 --2- 172.21.15.100:0/3752440596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308006110 0x7f73080085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:32:59.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.469+0000 7f731ffff640 1 --2- 172.21.15.100:0/3752440596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308006110 0x7f73080085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:32:59.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.869+0000 7f73277fe640 1 -- 172.21.15.100:0/3752440596 >> v2:172.21.15.167:3300/0 conn(0x7f73080036a0 msgr2=0x7f7308005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2024-09-11T22:32:59.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.869+0000 7f73277fe640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.167:3300/0 conn(0x7f73080036a0 0x7f7308005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:32:59.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.870+0000 7f731ffff640 1 --2- 172.21.15.100:0/3752440596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308006110 0x7f73080085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:32:59.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.871+0000 7f731ffff640 1 -- 172.21.15.100:0/3752440596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308006110 msgr2=0x7f73080085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:32:59.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.871+0000 7f731ffff640 1 -- 172.21.15.100:0/3752440596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308006110 msgr2=0x7f73080085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:32:59.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.871+0000 7f731ffff640 1 --2- 172.21.15.100:0/3752440596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308006110 0x7f73080085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:32:59.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:32:59.871+0000 7f731ffff640 1 --2- 172.21.15.100:0/3752440596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308006110 0x7f73080085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:33:00.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:00.673+0000 7f73277fe640 1 -- 172.21.15.100:0/3752440596 >> v2:172.21.15.167:3300/0 conn(0x7f73080036a0 msgr2=0x7f7308005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2024-09-11T22:33:00.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:00.673+0000 7f73277fe640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.167:3300/0 conn(0x7f73080036a0 0x7f7308005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:33:00.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:00.673+0000 7f731ffff640 1 --2- 172.21.15.100:0/3752440596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308006110 0x7f73080085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:00.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:00.673+0000 7f731ffff640 1 -- 172.21.15.100:0/3752440596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308006110 msgr2=0x7f73080085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:33:00.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:00.673+0000 7f731ffff640 1 -- 172.21.15.100:0/3752440596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308006110 msgr2=0x7f73080085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:33:00.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:00.673+0000 7f731ffff640 1 --2- 172.21.15.100:0/3752440596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308006110 0x7f73080085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:33:00.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:00.673+0000 7f731ffff640 1 --2- 172.21.15.100:0/3752440596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308006110 0x7f73080085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:33:02.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.267+0000 7f7325ffb640 1 -- 172.21.15.100:0/3752440596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308006110 msgr2=0x7f73080085d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:33:02.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.267+0000 7f7325ffb640 1 --2- 172.21.15.100:0/3752440596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308006110 0x7f73080085d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:02.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.267+0000 7f7325ffb640 1 -- 172.21.15.100:0/3752440596 >> v2:172.21.15.167:3300/0 conn(0x7f73080036a0 msgr2=0x7f7308005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:33:02.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.267+0000 7f7325ffb640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.167:3300/0 conn(0x7f73080036a0 0x7f7308005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:02.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.267+0000 7f7327fff640 1 -- 172.21.15.100:0/3752440596 reap_dead start 2024-09-11T22:33:02.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.268+0000 7f7325ffb640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.100:3300/0 conn(0x7f73080065c0 0x7f7308011900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:02.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.268+0000 7f7325ffb640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.167:3300/0 conn(0x7f7308015b00 0x7f7308017fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:02.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.268+0000 7f7325ffb640 1 -- 172.21.15.100:0/3752440596 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f732815dee0 con 0x7f7308011e40 2024-09-11T22:33:02.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.268+0000 7f7325ffb640 1 -- 172.21.15.100:0/3752440596 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f73281577f0 con 0x7f73080065c0 2024-09-11T22:33:02.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.268+0000 7f7325ffb640 1 -- 172.21.15.100:0/3752440596 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f7308008cf0 con 0x7f7308015b00 2024-09-11T22:33:02.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.268+0000 7f7327fff640 1 -- 172.21.15.100:0/3752440596 >> v2:172.21.15.167:3300/0 conn(0x7f7308015b00 msgr2=0x7f7308017fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2024-09-11T22:33:02.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.268+0000 7f7327fff640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.167:3300/0 conn(0x7f7308015b00 0x7f7308017fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:33:02.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.268+0000 7f73277fe640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.100:3300/0 conn(0x7f73080065c0 0x7f7308011900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:02.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.269+0000 7f7326ffd640 1 -- 172.21.15.100:0/3752440596 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3321322110 0 0) 0x7f732815dee0 con 0x7f7308011e40 2024-09-11T22:33:02.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.269+0000 7f73277fe640 1 -- 172.21.15.100:0/3752440596 >> v2:172.21.15.167:3300/0 conn(0x7f7308015b00 msgr2=0x7f7308017fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:33:02.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.269+0000 7f73277fe640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.167:3300/0 conn(0x7f7308015b00 0x7f7308017fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:02.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.269+0000 7f73277fe640 1 -- 172.21.15.100:0/3752440596 >> v1:172.21.15.100:6789/0 conn(0x7f7308011e40 legacy=0x7f7308014230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:02.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.269+0000 7f73277fe640 1 -- 172.21.15.100:0/3752440596 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73280c6410 con 0x7f73080065c0 2024-09-11T22:33:02.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.274+0000 7f73277fe640 1 --2- 172.21.15.100:0/3752440596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73080065c0 0x7f7308011900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7308015ad0 tx=0x7f731002a1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f331ac7db7a42204 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:02.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.275+0000 7f7326ffd640 1 -- 172.21.15.100:0/3752440596 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7310007070 con 0x7f73080065c0 2024-09-11T22:33:02.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.275+0000 7f7326ffd640 1 -- 172.21.15.100:0/3752440596 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f731002e070 con 0x7f73080065c0 2024-09-11T22:33:02.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.276+0000 7f732dcc9640 1 -- 172.21.15.100:0/3752440596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73080065c0 msgr2=0x7f7308011900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:02.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.276+0000 7f732dcc9640 1 --2- 172.21.15.100:0/3752440596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73080065c0 0x7f7308011900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7308015ad0 tx=0x7f731002a1b0 comp rx=0 tx=0).stop 2024-09-11T22:33:02.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.276+0000 7f732dcc9640 1 -- 172.21.15.100:0/3752440596 shutdown_connections 2024-09-11T22:33:02.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.276+0000 7f732dcc9640 1 --2- 172.21.15.100:0/3752440596 >> v2:172.21.15.167:3300/0 conn(0x7f7308015b00 0x7f7308017fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:02.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.276+0000 7f732dcc9640 1 --2- 172.21.15.100:0/3752440596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73080065c0 0x7f7308011900 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7308015ad0 tx=0x7f731002a1b0 comp rx=0 tx=0).stop 2024-09-11T22:33:02.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.276+0000 7f732dcc9640 1 -- 172.21.15.100:0/3752440596 >> 172.21.15.100:0/3752440596 conn(0x7f732806e670 msgr2=0x7f732806ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:02.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.276+0000 7f732dcc9640 1 -- 172.21.15.100:0/3752440596 shutdown_connections 2024-09-11T22:33:02.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.276+0000 7f732dcc9640 1 -- 172.21.15.100:0/3752440596 wait complete. 2024-09-11T22:33:02.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.278+0000 7f732dcc9640 1 Processor -- start 2024-09-11T22:33:02.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.278+0000 7f732dcc9640 1 -- start start 2024-09-11T22:33:02.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.279+0000 7f732dcc9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7308011e40 0x7f7328151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:02.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.279+0000 7f732dcc9640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308015b00 0x7f73281f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:02.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.279+0000 7f732dcc9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73280cc220 0x7f73281f72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:02.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.279+0000 7f732dcc9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f73280cd410 con 0x7f73280cc220 2024-09-11T22:33:02.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.279+0000 7f732dcc9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f73280c69d0 con 0x7f7308011e40 2024-09-11T22:33:02.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.279+0000 7f732dcc9640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f73280cd590 con 0x7f7308015b00 2024-09-11T22:33:02.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.280+0000 7f731ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308015b00 0x7f73281f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:02.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.280+0000 7f731ffff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308015b00 0x7f73281f6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:60238/0 (socket says 172.21.15.100:60238) 2024-09-11T22:33:02.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.280+0000 7f731ffff640 1 -- 172.21.15.100:0/1917026889 learned_addr learned my addr 172.21.15.100:0/1917026889 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:33:02.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.280+0000 7f73277fe640 1 -- 172.21.15.100:0/1917026889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7308011e40 msgr2=0x7f7328151460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2024-09-11T22:33:02.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.280+0000 7f73277fe640 1 --2- 172.21.15.100:0/1917026889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7308011e40 0x7f7328151460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:33:02.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.286+0000 7f731ffff640 1 -- 172.21.15.100:0/1917026889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7308011e40 msgr2=0x7f7328151460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:33:02.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.286+0000 7f731ffff640 1 --2- 172.21.15.100:0/1917026889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7308011e40 0x7f7328151460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:02.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.286+0000 7f731ffff640 1 -- 172.21.15.100:0/1917026889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73280cc220 msgr2=0x7f73281f72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:02.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.286+0000 7f731ffff640 1 --2- 172.21.15.100:0/1917026889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73280cc220 0x7f73281f72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:02.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.286+0000 7f731ffff640 1 -- 172.21.15.100:0/1917026889 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73281fd080 con 0x7f7308015b00 2024-09-11T22:33:02.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.286+0000 7f731ffff640 1 --2- 172.21.15.100:0/1917026889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308015b00 0x7f73281f6da0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f731800ba90 tx=0x7f731800bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:02.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.289+0000 7f7324ff9640 1 -- 172.21.15.100:0/1917026889 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7318017480 con 0x7f7308015b00 2024-09-11T22:33:02.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.289+0000 7f7324ff9640 1 -- 172.21.15.100:0/1917026889 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f731801c070 con 0x7f7308015b00 2024-09-11T22:33:02.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.289+0000 7f7324ff9640 1 -- 172.21.15.100:0/1917026889 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7318017880 con 0x7f7308015b00 2024-09-11T22:33:02.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.290+0000 7f732dcc9640 1 -- 172.21.15.100:0/1917026889 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73281fd340 con 0x7f7308015b00 2024-09-11T22:33:02.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.290+0000 7f732dcc9640 1 -- 172.21.15.100:0/1917026889 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f73281fd900 con 0x7f7308015b00 2024-09-11T22:33:02.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.293+0000 7f7324ff9640 1 -- 172.21.15.100:0/1917026889 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7318017a20 con 0x7f7308015b00 2024-09-11T22:33:02.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.293+0000 7f732dcc9640 1 -- 172.21.15.100:0/1917026889 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73280cd920 con 0x7f7308015b00 2024-09-11T22:33:02.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.293+0000 7f7324ff9640 1 --2- 172.21.15.100:0/1917026889 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f730806da40 0x7f730806ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:02.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.293+0000 7f7324ff9640 1 -- 172.21.15.100:0/1917026889 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f731808c260 con 0x7f7308015b00 2024-09-11T22:33:02.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.294+0000 7f73277fe640 1 --2- 172.21.15.100:0/1917026889 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f730806da40 0x7f730806ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:02.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.295+0000 7f73277fe640 1 --2- 172.21.15.100:0/1917026889 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f730806da40 0x7f730806ff00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7310032000 tx=0x7f7310007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:02.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.308+0000 7f7324ff9640 1 -- 172.21.15.100:0/1917026889 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7318012050 con 0x7f7308015b00 2024-09-11T22:33:02.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.814+0000 7f732dcc9640 1 -- 172.21.15.100:0/1917026889 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f732806a240 con 0x7f7308015b00 2024-09-11T22:33:02.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.814+0000 7f7324ff9640 1 -- 172.21.15.100:0/1917026889 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1562 (secure 0 0 0) 0x7f731805a7d0 con 0x7f7308015b00 2024-09-11T22:33:02.815 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":92,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:33:02.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.822+0000 7f732dcc9640 1 -- 172.21.15.100:0/1917026889 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f730806da40 msgr2=0x7f730806ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:02.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.822+0000 7f732dcc9640 1 --2- 172.21.15.100:0/1917026889 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f730806da40 0x7f730806ff00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7310032000 tx=0x7f7310007000 comp rx=0 tx=0).stop 2024-09-11T22:33:02.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.822+0000 7f732dcc9640 1 -- 172.21.15.100:0/1917026889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308015b00 msgr2=0x7f73281f6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:02.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.822+0000 7f732dcc9640 1 --2- 172.21.15.100:0/1917026889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308015b00 0x7f73281f6da0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f731800ba90 tx=0x7f731800bf50 comp rx=0 tx=0).stop 2024-09-11T22:33:02.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.822+0000 7f732dcc9640 1 -- 172.21.15.100:0/1917026889 shutdown_connections 2024-09-11T22:33:02.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.822+0000 7f732dcc9640 1 --2- 172.21.15.100:0/1917026889 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f730806da40 0x7f730806ff00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:02.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.822+0000 7f732dcc9640 1 --2- 172.21.15.100:0/1917026889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73280cc220 0x7f73281f72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:02.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.822+0000 7f732dcc9640 1 --2- 172.21.15.100:0/1917026889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7308015b00 0x7f73281f6da0 secure :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f731800ba90 tx=0x7f731800bf50 comp rx=0 tx=0).stop 2024-09-11T22:33:02.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.822+0000 7f732dcc9640 1 --2- 172.21.15.100:0/1917026889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7308011e40 0x7f7328151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:02.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.822+0000 7f732dcc9640 1 -- 172.21.15.100:0/1917026889 >> 172.21.15.100:0/1917026889 conn(0x7f732806e670 msgr2=0x7f732814ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:02.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.826+0000 7f732dcc9640 1 -- 172.21.15.100:0/1917026889 shutdown_connections 2024-09-11T22:33:02.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:02.828+0000 7f732dcc9640 1 -- 172.21.15.100:0/1917026889 wait complete. 2024-09-11T22:33:02.857 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-11T22:33:02.857 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-11T22:33:02.857 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:33:03.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.055+0000 7f1719c0a640 1 Processor -- start 2024-09-11T22:33:03.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.055+0000 7f1719c0a640 1 -- start start 2024-09-11T22:33:03.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.056+0000 7f1719c0a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f17140c9260 0x7f171415ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.056+0000 7f1719c0a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f17140c9640 0x7f1714072c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.056+0000 7f1719c0a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17140731c0 con 0x7f17140c7510 2024-09-11T22:33:03.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.056+0000 7f1719c0a640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f171415b070 con 0x7f17140c9640 2024-09-11T22:33:03.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.056+0000 7f1719c0a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f1714156bb0 con 0x7f17140c9260 2024-09-11T22:33:03.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.056+0000 7f17137fe640 1 -- >> v2:172.21.15.167:3300/0 conn(0x7f17140c9260 msgr2=0x7f171415ab30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.167:3300/0 2024-09-11T22:33:03.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.056+0000 7f17137fe640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f17140c9260 0x7f171415ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:33:03.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.056+0000 7f1713fff640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7f17140c7510 legacy=0x7f1714150a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2024-09-11T22:33:03.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.057+0000 7f1712ffd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f17140c9640 0x7f1714072c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.057+0000 7f1712ffd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f17140c9640 0x7f1714072c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55438/0 (socket says 172.21.15.100:55438) 2024-09-11T22:33:03.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.057+0000 7f1712ffd640 1 -- 172.21.15.100:0/3472426040 learned_addr learned my addr 172.21.15.100:0/3472426040 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:33:03.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.057+0000 7f1712ffd640 1 -- 172.21.15.100:0/3472426040 >> v2:172.21.15.167:3300/0 conn(0x7f17140c9260 msgr2=0x7f171415ab30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:33:03.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.057+0000 7f1712ffd640 1 --2- 172.21.15.100:0/3472426040 >> v2:172.21.15.167:3300/0 conn(0x7f17140c9260 0x7f171415ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.057+0000 7f1712ffd640 1 -- 172.21.15.100:0/3472426040 >> v1:172.21.15.167:6789/0 conn(0x7f17140c7510 legacy=0x7f1714150a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:33:03.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.057+0000 7f1712ffd640 1 -- 172.21.15.100:0/3472426040 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1714073470 con 0x7f17140c9640 2024-09-11T22:33:03.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.062+0000 7f1712ffd640 1 --2- 172.21.15.100:0/3472426040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17140c9640 0x7f1714072c80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f17140c6fc0 tx=0x7f170802ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6408a75e58272a06 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:03.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.064+0000 7f17127fc640 1 -- 172.21.15.100:0/3472426040 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1708037070 con 0x7f17140c9640 2024-09-11T22:33:03.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.064+0000 7f17127fc640 1 -- 172.21.15.100:0/3472426040 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1708033660 con 0x7f17140c9640 2024-09-11T22:33:03.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.068+0000 7f17127fc640 1 -- 172.21.15.100:0/3472426040 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1708033a30 con 0x7f17140c9640 2024-09-11T22:33:03.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.069+0000 7f1719c0a640 1 -- 172.21.15.100:0/3472426040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17140c9640 msgr2=0x7f1714072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:03.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.069+0000 7f1719c0a640 1 --2- 172.21.15.100:0/3472426040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17140c9640 0x7f1714072c80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f17140c6fc0 tx=0x7f170802ea50 comp rx=0 tx=0).stop 2024-09-11T22:33:03.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.072+0000 7f1719c0a640 1 -- 172.21.15.100:0/3472426040 shutdown_connections 2024-09-11T22:33:03.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.072+0000 7f1719c0a640 1 --2- 172.21.15.100:0/3472426040 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17140c9640 0x7f1714072c80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.072+0000 7f1719c0a640 1 --2- 172.21.15.100:0/3472426040 >> v2:172.21.15.167:3300/0 conn(0x7f17140c9260 0x7f171415ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.072+0000 7f1719c0a640 1 -- 172.21.15.100:0/3472426040 >> 172.21.15.100:0/3472426040 conn(0x7f171406f360 msgr2=0x7f171406f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:03.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.072+0000 7f1719c0a640 1 -- 172.21.15.100:0/3472426040 shutdown_connections 2024-09-11T22:33:03.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.073+0000 7f1719c0a640 1 -- 172.21.15.100:0/3472426040 wait complete. 2024-09-11T22:33:03.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.074+0000 7f1719c0a640 1 Processor -- start 2024-09-11T22:33:03.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.077+0000 7f1719c0a640 1 -- start start 2024-09-11T22:33:03.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.079+0000 7f1719c0a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17140c7510 0x7f17140cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.079+0000 7f1719c0a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17140c9260 0x7f171414bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.079+0000 7f1719c0a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17140c9640 0x7f171414c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.079+0000 7f1719c0a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1714157430 con 0x7f17140c9260 2024-09-11T22:33:03.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.079+0000 7f1719c0a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1714157150 con 0x7f17140c9640 2024-09-11T22:33:03.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.079+0000 7f1719c0a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1714157710 con 0x7f17140c7510 2024-09-11T22:33:03.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.082+0000 7f1713fff640 1 -- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17140c9640 msgr2=0x7f171414c2e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2024-09-11T22:33:03.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.082+0000 7f1713fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17140c9640 0x7f171414c2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:33:03.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.084+0000 7f1712ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17140c9260 0x7f171414bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.084+0000 7f1712ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17140c9260 0x7f171414bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55442/0 (socket says 172.21.15.100:55442) 2024-09-11T22:33:03.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.084+0000 7f1712ffd640 1 -- 172.21.15.100:0/3974083650 learned_addr learned my addr 172.21.15.100:0/3974083650 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:33:03.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.084+0000 7f17137fe640 1 --2- 172.21.15.100:0/3974083650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17140c7510 0x7f17140cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.084+0000 7f1712ffd640 1 -- 172.21.15.100:0/3974083650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17140c7510 msgr2=0x7f17140cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:03.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.084+0000 7f1712ffd640 1 --2- 172.21.15.100:0/3974083650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f17140c7510 0x7f17140cbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.084+0000 7f1712ffd640 1 -- 172.21.15.100:0/3974083650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17140c9640 msgr2=0x7f171414c2e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:33:03.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.084+0000 7f1712ffd640 1 --2- 172.21.15.100:0/3974083650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17140c9640 0x7f171414c2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.084+0000 7f1712ffd640 1 -- 172.21.15.100:0/3974083650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1714143980 con 0x7f17140c9260 2024-09-11T22:33:03.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.085+0000 7f1712ffd640 1 --2- 172.21.15.100:0/3974083650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17140c9260 0x7f171414bda0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1708009530 tx=0x7f17080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:03.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.088+0000 7f16fbfff640 1 -- 172.21.15.100:0/3974083650 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1708037050 con 0x7f17140c9260 2024-09-11T22:33:03.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.088+0000 7f1719c0a640 1 -- 172.21.15.100:0/3974083650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17141fdb50 con 0x7f17140c9260 2024-09-11T22:33:03.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.088+0000 7f1719c0a640 1 -- 172.21.15.100:0/3974083650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17140ca160 con 0x7f17140c9260 2024-09-11T22:33:03.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.089+0000 7f16fbfff640 1 -- 172.21.15.100:0/3974083650 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1708043070 con 0x7f17140c9260 2024-09-11T22:33:03.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.089+0000 7f16fbfff640 1 -- 172.21.15.100:0/3974083650 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17080135a0 con 0x7f17140c9260 2024-09-11T22:33:03.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.090+0000 7f1719c0a640 1 --2- 172.21.15.100:0/3974083650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4002a70 0x7f16f4004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.090+0000 7f1719c0a640 1 -- 172.21.15.100:0/3974083650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f16f4007ec0 con 0x7f16f4002a70 2024-09-11T22:33:03.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.093+0000 7f17137fe640 1 --2- 172.21.15.100:0/3974083650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4002a70 0x7f16f4004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.093+0000 7f17137fe640 1 -- 172.21.15.100:0/3974083650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f16f40080c0 con 0x7f16f4002a70 2024-09-11T22:33:03.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.093+0000 7f17137fe640 1 --2- 172.21.15.100:0/3974083650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4002a70 0x7f16f4004f30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f170400c4c0 tx=0x7f170400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:03.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.094+0000 7f16fbfff640 1 -- 172.21.15.100:0/3974083650 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f170803a070 con 0x7f17140c9260 2024-09-11T22:33:03.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.095+0000 7f16fbfff640 1 --2- 172.21.15.100:0/3974083650 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f170006be30 0x7f170006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.095+0000 7f16fbfff640 1 -- 172.21.15.100:0/3974083650 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f17080ab6a0 con 0x7f17140c9260 2024-09-11T22:33:03.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.096+0000 7f1713fff640 1 --2- 172.21.15.100:0/3974083650 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f170006be30 0x7f170006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.100+0000 7f1713fff640 1 --2- 172.21.15.100:0/3974083650 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f170006be30 0x7f170006e2f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f170c003c30 tx=0x7f170c009270 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:03.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.100+0000 7f16fbfff640 1 -- 172.21.15.100:0/3974083650 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704003dc0 con 0x7f16f4002a70 2024-09-11T22:33:03.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.101+0000 7f16fbfff640 1 -- 172.21.15.100:0/3974083650 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1704016070 con 0x7f16f4002a70 2024-09-11T22:33:03.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.101+0000 7f16fbfff640 1 -- 172.21.15.100:0/3974083650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4002a70 msgr2=0x7f16f4004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:03.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.101+0000 7f16fbfff640 1 --2- 172.21.15.100:0/3974083650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4002a70 0x7f16f4004f30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f170400c4c0 tx=0x7f170400c980 comp rx=0 tx=0).stop 2024-09-11T22:33:03.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.101+0000 7f16fbfff640 1 -- 172.21.15.100:0/3974083650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4002a70 msgr2=0x7f16f4004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:33:03.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.101+0000 7f16fbfff640 1 --2- 172.21.15.100:0/3974083650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4002a70 0x7f16f4004f30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.115+0000 7f1719c0a640 1 --2- 172.21.15.100:0/3974083650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4006f30 0x7f16f40073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.115+0000 7f1719c0a640 1 -- 172.21.15.100:0/3974083650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f16f400a4a0 con 0x7f16f4006f30 2024-09-11T22:33:03.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.119+0000 7f17137fe640 1 --2- 172.21.15.100:0/3974083650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4006f30 0x7f16f40073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.125+0000 7f17137fe640 1 -- 172.21.15.100:0/3974083650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f16f4007900 con 0x7f16f4006f30 2024-09-11T22:33:03.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.125+0000 7f17137fe640 1 --2- 172.21.15.100:0/3974083650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4006f30 0x7f16f40073c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f170400c4c0 tx=0x7f17040059d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:03.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.127+0000 7f16fbfff640 1 -- 172.21.15.100:0/3974083650 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704003dc0 con 0x7f16f4006f30 2024-09-11T22:33:03.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.127+0000 7f16fbfff640 1 -- 172.21.15.100:0/3974083650 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5044 (secure 0 0 0) 0x7f1704026470 con 0x7f16f4006f30 2024-09-11T22:33:03.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.127+0000 7f16fbfff640 1 -- 172.21.15.100:0/3974083650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4006f30 msgr2=0x7f16f40073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:03.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.127+0000 7f16fbfff640 1 --2- 172.21.15.100:0/3974083650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4006f30 0x7f16f40073c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f170400c4c0 tx=0x7f17040059d0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.127+0000 7f16fbfff640 1 -- 172.21.15.100:0/3974083650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4006f30 msgr2=0x7f16f40073c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:33:03.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.129+0000 7f16fbfff640 1 --2- 172.21.15.100:0/3974083650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16f4006f30 0x7f16f40073c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.131 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:33:03.131 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:33:03.131 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:33:03.131 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:33:03.131 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 92, 2024-09-11T22:33:03.131 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 42264, 2024-09-11T22:33:03.131 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:33:03.131 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:33:03.131 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:33:03.131 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:03.132 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 2, 2024-09-11T22:33:03.132 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:33:03.132 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:33:03.132 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:33:03.132 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:03.132 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:03.132 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:03.132 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:03.132 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:03.132 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:03.132 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:03.132 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:03.132 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:03.133 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:03.133 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:03.133 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:03.133 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:33:03.133 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:33:03.133 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:03.133 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:03.133 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:03.133 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:03.133 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:03.133 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:03.133 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:03.134 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:03.134 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:03.134 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:03.134 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:03.134 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:03.134 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.134 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:33:03.134 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:33:03.134 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:33:03.134 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:33:03.134 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:33:03.134 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:33:03.134 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:33:03.135 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:33:03.135 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:33:03.135 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:33:03.135 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:33:03.135 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:33:03.135 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:33:03.135 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:33:03.135 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:33:03.135 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:33:03.135 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:33:03.135 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:03.135 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:03.135 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:03.136 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:03.136 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:03.136 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:03.136 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:03.136 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:03.136 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:03.136 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:03.136 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:03.136 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:03.136 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:33:03.136 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.136 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:33:03.136 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.137 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:33:03.137 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:33:03.137 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:03.137 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:03.137 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.137 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:03.137 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:33:03.137 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:03.137 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.137 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.137 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:03.137 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:33:03.137 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:03.138 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:03.138 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:03.138 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.138 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:33:03.138 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:33:03.138 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:03.138 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:03.138 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:03.138 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.138 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.138 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:33:03.138 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:33:03.138 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:03.139 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:03.139 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.139 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:03.139 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:33:03.139 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:03.139 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.139 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.139 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:03.139 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:33:03.139 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:03.139 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:03.139 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:03.139 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.139 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:33:03.140 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:33:03.140 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:03.140 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:03.140 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:03.140 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.140 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.140 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:33:03.140 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:33:03.140 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:03.140 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:03.140 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.140 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:03.140 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:33:03.141 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:03.141 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.141 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.141 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:03.141 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:33:03.141 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:03.141 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:03.141 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:03.141 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.141 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:33:03.141 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:33:03.141 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:03.141 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:03.141 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:03.142 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:03.142 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:03.142 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.142 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:33:03.142 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:33:03.142 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.142 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:03.142 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:03.142 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:33:03.142 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:03.142 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:03.142 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:33:03.142 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.142 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:03.142 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:03.143 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4 2024-09-11T22:33:03.143 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:03.143 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:03.143 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:33:03.143 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.143 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:03.143 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:03.143 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:33:03.143 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:03.143 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:03.143 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:33:03.143 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.143 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:03.143 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:03.143 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4 2024-09-11T22:33:03.144 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:03.144 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:03.144 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:33:03.144 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.144 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:03.144 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:03.144 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:33:03.144 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:03.144 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:03.144 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.144 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:33:03.144 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:33:03.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.132+0000 7f1719c0a640 1 -- 172.21.15.100:0/3974083650 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f170006be30 msgr2=0x7f170006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:03.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.132+0000 7f1719c0a640 1 --2- 172.21.15.100:0/3974083650 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f170006be30 0x7f170006e2f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f170c003c30 tx=0x7f170c009270 comp rx=0 tx=0).stop 2024-09-11T22:33:03.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.132+0000 7f1713fff640 1 -- 172.21.15.100:0/3974083650 reap_dead start 2024-09-11T22:33:03.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.132+0000 7f1719c0a640 1 -- 172.21.15.100:0/3974083650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17140c9260 msgr2=0x7f171414bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:03.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.132+0000 7f1719c0a640 1 --2- 172.21.15.100:0/3974083650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17140c9260 0x7f171414bda0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1708009530 tx=0x7f17080046c0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.133+0000 7f1719c0a640 1 -- 172.21.15.100:0/3974083650 shutdown_connections 2024-09-11T22:33:03.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.133+0000 7f1719c0a640 1 --2- 172.21.15.100:0/3974083650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17140c9260 0x7f171414bda0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.135+0000 7f1719c0a640 1 -- 172.21.15.100:0/3974083650 >> 172.21.15.100:0/3974083650 conn(0x7f171406f360 msgr2=0x7f1714159f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:03.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.136+0000 7f1719c0a640 1 -- 172.21.15.100:0/3974083650 shutdown_connections 2024-09-11T22:33:03.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.136+0000 7f1719c0a640 1 -- 172.21.15.100:0/3974083650 wait complete. 2024-09-11T22:33:03.161 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:33:03.162 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-11T22:33:03.162 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:33:03.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.377+0000 7f97e759e640 1 Processor -- start 2024-09-11T22:33:03.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.377+0000 7f97e759e640 1 -- start start 2024-09-11T22:33:03.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.379+0000 7f97e759e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f97e8072630 0x7f97e8151810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.379+0000 7f97e759e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97e815abc0 con 0x7f97e806d290 2024-09-11T22:33:03.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.379+0000 7f97e759e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97e815aea0 con 0x7f97e8157e10 2024-09-11T22:33:03.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.379+0000 7f97e759e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f97e8158260 con 0x7f97e8072630 2024-09-11T22:33:03.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.379+0000 7f97e6d9d640 1 -- >> v1:172.21.15.167:6789/0 conn(0x7f97e8157e10 legacy=0x7f97e806bdc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.167:6789/0 2024-09-11T22:33:03.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.379+0000 7f97e5d9b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f97e8072630 0x7f97e8151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.379+0000 7f97e5d9b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f97e8072630 0x7f97e8151810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55464/0 (socket says 172.21.15.100:55464) 2024-09-11T22:33:03.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.379+0000 7f97e5d9b640 1 -- 172.21.15.100:0/3186474886 learned_addr learned my addr 172.21.15.100:0/3186474886 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:33:03.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.380+0000 7f97e559a640 1 -- 172.21.15.100:0/3186474886 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3721608411 0 0) 0x7f97e815abc0 con 0x7f97e806d290 2024-09-11T22:33:03.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.380+0000 7f97e559a640 1 -- 172.21.15.100:0/3186474886 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97d0003520 con 0x7f97e806d290 2024-09-11T22:33:03.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.380+0000 7f97e5d9b640 1 -- 172.21.15.100:0/3186474886 >> v1:172.21.15.167:6789/0 conn(0x7f97e8157e10 legacy=0x7f97e806bdc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:33:03.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.380+0000 7f97e5d9b640 1 -- 172.21.15.100:0/3186474886 >> v1:172.21.15.100:6789/0 conn(0x7f97e806d290 legacy=0x7f97e806e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:03.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.380+0000 7f97e5d9b640 1 -- 172.21.15.100:0/3186474886 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e815dcf0 con 0x7f97e8072630 2024-09-11T22:33:03.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.381+0000 7f97e5d9b640 1 --2- 172.21.15.100:0/3186474886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97e8072630 0x7f97e8151810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f97d8009870 tx=0x7f97d802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55735b1ebafa9236 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:03.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.382+0000 7f97e559a640 1 -- 172.21.15.100:0/3186474886 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d8037070 con 0x7f97e8072630 2024-09-11T22:33:03.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.382+0000 7f97e559a640 1 -- 172.21.15.100:0/3186474886 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97d8032640 con 0x7f97e8072630 2024-09-11T22:33:03.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.382+0000 7f97e559a640 1 -- 172.21.15.100:0/3186474886 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d8032a10 con 0x7f97e8072630 2024-09-11T22:33:03.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.383+0000 7f97e759e640 1 -- 172.21.15.100:0/3186474886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97e8072630 msgr2=0x7f97e8151810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:03.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.383+0000 7f97e759e640 1 --2- 172.21.15.100:0/3186474886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97e8072630 0x7f97e8151810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f97d8009870 tx=0x7f97d802a300 comp rx=0 tx=0).stop 2024-09-11T22:33:03.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.385+0000 7f97e759e640 1 -- 172.21.15.100:0/3186474886 shutdown_connections 2024-09-11T22:33:03.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.385+0000 7f97e759e640 1 --2- 172.21.15.100:0/3186474886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97e8072630 0x7f97e8151810 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.385+0000 7f97e759e640 1 -- 172.21.15.100:0/3186474886 >> 172.21.15.100:0/3186474886 conn(0x7f97e80cd410 msgr2=0x7f97e80cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:03.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.386+0000 7f97e759e640 1 -- 172.21.15.100:0/3186474886 shutdown_connections 2024-09-11T22:33:03.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.386+0000 7f97e759e640 1 -- 172.21.15.100:0/3186474886 wait complete. 2024-09-11T22:33:03.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.388+0000 7f97e759e640 1 Processor -- start 2024-09-11T22:33:03.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.389+0000 7f97e759e640 1 -- start start 2024-09-11T22:33:03.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.390+0000 7f97e759e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97e806d290 0x7f97e8142c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.390+0000 7f97e759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97e8072630 0x7f97e81506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.390+0000 7f97e759e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97e8157e10 0x7f97e8150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.390+0000 7f97e759e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f97e815b7d0 con 0x7f97e806d290 2024-09-11T22:33:03.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.390+0000 7f97e759e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f97e815a970 con 0x7f97e8072630 2024-09-11T22:33:03.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.390+0000 7f97e759e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f97e80c7aa0 con 0x7f97e8157e10 2024-09-11T22:33:03.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.391+0000 7f97e659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97e806d290 0x7f97e8142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.391+0000 7f97e659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97e806d290 0x7f97e8142c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55466/0 (socket says 172.21.15.100:55466) 2024-09-11T22:33:03.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.391+0000 7f97e659c640 1 -- 172.21.15.100:0/1220483556 learned_addr learned my addr 172.21.15.100:0/1220483556 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:33:03.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.391+0000 7f97e5d9b640 1 -- 172.21.15.100:0/1220483556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97e8072630 msgr2=0x7f97e81506c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.167:3300/0 2024-09-11T22:33:03.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.391+0000 7f97e5d9b640 1 --2- 172.21.15.100:0/1220483556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97e8072630 0x7f97e81506c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:33:03.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.392+0000 7f97e659c640 1 -- 172.21.15.100:0/1220483556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97e8157e10 msgr2=0x7f97e8150c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:33:03.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.392+0000 7f97e659c640 1 --2- 172.21.15.100:0/1220483556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97e8157e10 0x7f97e8150c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.392+0000 7f97e659c640 1 -- 172.21.15.100:0/1220483556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97e8072630 msgr2=0x7f97e81506c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:33:03.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.392+0000 7f97e659c640 1 --2- 172.21.15.100:0/1220483556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97e8072630 0x7f97e81506c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.392+0000 7f97e659c640 1 -- 172.21.15.100:0/1220483556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e8143160 con 0x7f97e806d290 2024-09-11T22:33:03.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.392+0000 7f97e659c640 1 --2- 172.21.15.100:0/1220483556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97e806d290 0x7f97e8142c20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00c790 tx=0x7f97dc00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:03.415 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:33:03.415 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:33:03.415 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:33:03.415 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:33:03.415 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 92, 2024-09-11T22:33:03.415 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 674135, 2024-09-11T22:33:03.415 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:33:03.415 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:33:03.415 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:33:03.416 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:03.416 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 2, 2024-09-11T22:33:03.416 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:33:03.416 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:33:03.416 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:33:03.416 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:03.416 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:03.416 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:03.416 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:03.416 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:03.416 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:03.416 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:03.416 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:03.417 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:03.417 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:03.417 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:03.417 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:03.417 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:33:03.417 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:33:03.417 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:03.417 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:03.417 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:03.417 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:03.417 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:03.417 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:03.417 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:03.418 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:03.418 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:03.418 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:03.418 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:03.418 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:03.418 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.418 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:33:03.418 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:33:03.418 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:33:03.418 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:33:03.418 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:33:03.418 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:33:03.418 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:33:03.418 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:33:03.419 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:33:03.419 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:33:03.419 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:33:03.419 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:33:03.419 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:33:03.419 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:33:03.419 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:33:03.419 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:33:03.419 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:33:03.419 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:03.419 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:03.419 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:03.419 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:03.420 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:03.420 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:03.420 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:03.420 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:03.420 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:03.420 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:03.420 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:03.420 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:03.420 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:33:03.420 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.420 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:33:03.420 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.420 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:33:03.420 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:33:03.421 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:03.421 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:03.421 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.424 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:03.424 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:33:03.424 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:03.424 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.424 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.424 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:03.424 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:33:03.424 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:03.425 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:03.425 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:03.425 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.425 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:33:03.425 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:33:03.425 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:03.425 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:03.425 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:03.425 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.425 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.425 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:33:03.425 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:33:03.425 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:03.425 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:03.426 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.426 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:03.426 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:33:03.426 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:03.426 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.426 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.426 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:03.426 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:33:03.426 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:03.426 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:03.426 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:03.426 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.426 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:33:03.426 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:33:03.427 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:03.427 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:03.427 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:03.427 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.427 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.427 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:33:03.427 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:33:03.427 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:03.427 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:03.427 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.427 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:03.427 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:33:03.427 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:03.428 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.428 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.428 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:03.428 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:33:03.428 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:03.428 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:03.428 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:03.428 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.428 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:33:03.428 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:33:03.428 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:03.428 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:03.428 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:03.428 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:03.428 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:03.428 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.429 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:33:03.429 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:33:03.429 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.429 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:03.429 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:03.429 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:33:03.429 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:03.429 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:03.429 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:33:03.429 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.429 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:03.429 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:03.429 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:33:03.430 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:03.430 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:03.430 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:33:03.430 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.430 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:03.430 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:03.430 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:33:03.430 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:03.430 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:03.430 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:33:03.430 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.430 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:03.430 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:03.430 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4 2024-09-11T22:33:03.430 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:03.431 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:03.431 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:33:03.431 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:03.431 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:03.431 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:03.431 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:33:03.431 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:03.431 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:03.431 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:03.431 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:33:03.431 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:33:03.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.393+0000 7f97d6ffd640 1 -- 172.21.15.100:0/1220483556 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97dc017070 con 0x7f97e806d290 2024-09-11T22:33:03.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.393+0000 7f97d6ffd640 1 -- 172.21.15.100:0/1220483556 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97dc005270 con 0x7f97e806d290 2024-09-11T22:33:03.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.393+0000 7f97d6ffd640 1 -- 172.21.15.100:0/1220483556 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97dc00a640 con 0x7f97e806d290 2024-09-11T22:33:03.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.395+0000 7f97e759e640 1 -- 172.21.15.100:0/1220483556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97e815d890 con 0x7f97e806d290 2024-09-11T22:33:03.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.395+0000 7f97e759e640 1 -- 172.21.15.100:0/1220483556 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97e81f0480 con 0x7f97e806d290 2024-09-11T22:33:03.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.398+0000 7f97e759e640 1 --2- 172.21.15.100:0/1220483556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97e815a470 0x7f97e81593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.398+0000 7f97e759e640 1 -- 172.21.15.100:0/1220483556 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f97e81f0650 con 0x7f97e815a470 2024-09-11T22:33:03.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.398+0000 7f97e5d9b640 1 --2- 172.21.15.100:0/1220483556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97e815a470 0x7f97e81593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.400+0000 7f97d6ffd640 1 -- 172.21.15.100:0/1220483556 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f97dc01a070 con 0x7f97e806d290 2024-09-11T22:33:03.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.400+0000 7f97e5d9b640 1 -- 172.21.15.100:0/1220483556 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97e815b460 con 0x7f97e815a470 2024-09-11T22:33:03.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.400+0000 7f97e5d9b640 1 --2- 172.21.15.100:0/1220483556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97e815a470 0x7f97e81593a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f97e80cab60 tx=0x7f97d80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:03.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.401+0000 7f97d6ffd640 1 --2- 172.21.15.100:0/1220483556 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f97c806bf00 0x7f97c806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.401+0000 7f97d6ffd640 1 -- 172.21.15.100:0/1220483556 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f97dc08a540 con 0x7f97e806d290 2024-09-11T22:33:03.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.401+0000 7f97d6ffd640 1 -- 172.21.15.100:0/1220483556 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d8041070 con 0x7f97e815a470 2024-09-11T22:33:03.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.401+0000 7f97d6ffd640 1 -- 172.21.15.100:0/1220483556 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f97d802ae10 con 0x7f97e815a470 2024-09-11T22:33:03.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.401+0000 7f97d6ffd640 1 -- 172.21.15.100:0/1220483556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97e815a470 msgr2=0x7f97e81593a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:03.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.401+0000 7f97d6ffd640 1 --2- 172.21.15.100:0/1220483556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97e815a470 0x7f97e81593a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f97e80cab60 tx=0x7f97d80046c0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.401+0000 7f97d6ffd640 1 -- 172.21.15.100:0/1220483556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97e815a470 msgr2=0x7f97e81593a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:33:03.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.401+0000 7f97d6ffd640 1 --2- 172.21.15.100:0/1220483556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97e815a470 0x7f97e81593a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.402+0000 7f97e6d9d640 1 --2- 172.21.15.100:0/1220483556 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f97c806bf00 0x7f97c806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.404+0000 7f97e6d9d640 1 --2- 172.21.15.100:0/1220483556 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f97c806bf00 0x7f97c806e3c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f97e0003cb0 tx=0x7f97e0009230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:03.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.413+0000 7f97e759e640 1 --2- 172.21.15.100:0/1220483556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97e81f0960 0x7f97e81f0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:03.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.413+0000 7f97e759e640 1 -- 172.21.15.100:0/1220483556 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f97e81f1280 con 0x7f97e81f0960 2024-09-11T22:33:03.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.413+0000 7f97e5d9b640 1 --2- 172.21.15.100:0/1220483556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97e81f0960 0x7f97e81f0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:03.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.413+0000 7f97e5d9b640 1 -- 172.21.15.100:0/1220483556 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f97e8072d60 con 0x7f97e81f0960 2024-09-11T22:33:03.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.414+0000 7f97e5d9b640 1 --2- 172.21.15.100:0/1220483556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97e81f0960 0x7f97e81f0d40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f97d8000c00 tx=0x7f97d8008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:03.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.414+0000 7f97d6ffd640 1 -- 172.21.15.100:0/1220483556 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d806f070 con 0x7f97e81f0960 2024-09-11T22:33:03.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.414+0000 7f97d6ffd640 1 -- 172.21.15.100:0/1220483556 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5043 (secure 0 0 0) 0x7f97d8003610 con 0x7f97e81f0960 2024-09-11T22:33:03.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.414+0000 7f97d6ffd640 1 -- 172.21.15.100:0/1220483556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97e81f0960 msgr2=0x7f97e81f0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:03.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.414+0000 7f97d6ffd640 1 --2- 172.21.15.100:0/1220483556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97e81f0960 0x7f97e81f0d40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f97d8000c00 tx=0x7f97d8008030 comp rx=0 tx=0).stop 2024-09-11T22:33:03.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.414+0000 7f97d6ffd640 1 -- 172.21.15.100:0/1220483556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97e81f0960 msgr2=0x7f97e81f0d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:33:03.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.414+0000 7f97d6ffd640 1 --2- 172.21.15.100:0/1220483556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97e81f0960 0x7f97e81f0d40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:03.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.414+0000 7f97e759e640 1 -- 172.21.15.100:0/1220483556 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f97c806bf00 msgr2=0x7f97c806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:03.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.414+0000 7f97e759e640 1 --2- 172.21.15.100:0/1220483556 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f97c806bf00 0x7f97c806e3c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f97e0003cb0 tx=0x7f97e0009230 comp rx=0 tx=0).stop 2024-09-11T22:33:03.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.414+0000 7f97e759e640 1 -- 172.21.15.100:0/1220483556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97e806d290 msgr2=0x7f97e8142c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:03.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.414+0000 7f97e759e640 1 --2- 172.21.15.100:0/1220483556 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97e806d290 0x7f97e8142c20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00c790 tx=0x7f97dc00cc50 comp rx=0 tx=0).stop 2024-09-11T22:33:03.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.414+0000 7f97e6d9d640 1 -- 172.21.15.100:0/1220483556 reap_dead start 2024-09-11T22:33:03.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.414+0000 7f97e6d9d640 1 -- 172.21.15.100:0/1220483556 reap_dead start 2024-09-11T22:33:03.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.414+0000 7f97e759e640 1 -- 172.21.15.100:0/1220483556 shutdown_connections 2024-09-11T22:33:03.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.414+0000 7f97e759e640 1 -- 172.21.15.100:0/1220483556 >> 172.21.15.100:0/1220483556 conn(0x7f97e80cd410 msgr2=0x7f97e80c2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:03.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.415+0000 7f97e759e640 1 -- 172.21.15.100:0/1220483556 shutdown_connections 2024-09-11T22:33:03.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:03.415+0000 7f97e759e640 1 -- 172.21.15.100:0/1220483556 wait complete. 2024-09-11T22:33:03.488 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:33:03.488 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-11T22:33:23.489 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-11T22:33:23.490 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-11T22:33:23.490 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-11T22:33:23.490 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-11T22:33:23.494 INFO:tasks.ceph.mon.b:Started 2024-09-11T22:33:23.494 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-09-11T22:33:23.494 INFO:tasks.ceph.mon.a:Sent signal 19 2024-09-11T22:33:23.495 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-11T22:33:23.627 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:33:23.630 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:33:38.495 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-09-11T22:33:38.496 INFO:tasks.ceph.mon.a:Sent signal 18 2024-09-11T22:33:38.496 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:33:38.496 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:33:38.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:38.681+0000 7fa4db513640 1 Processor -- start 2024-09-11T22:33:38.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:38.681+0000 7fa4db513640 1 -- start start 2024-09-11T22:33:38.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:38.682+0000 7fa4db513640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4d4158fa0 0x7fa4d40c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:38.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:38.683+0000 7fa4db513640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4d41621c0 con 0x7fa4d406f490 2024-09-11T22:33:38.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:38.683+0000 7fa4db513640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4d415ee60 con 0x7fa4d40c7300 2024-09-11T22:33:38.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:38.683+0000 7fa4db513640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d415f140 con 0x7fa4d4158fa0 2024-09-11T22:33:38.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:38.683+0000 7fa4d92af640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4d4158fa0 0x7fa4d40c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:38.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:38.683+0000 7fa4d8aae640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fa4d40c7300 0x7fa4d41626c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:54226/0 (socket says 172.21.15.100:54226) 2024-09-11T22:33:38.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:38.683+0000 7fa4d8aae640 1 -- 172.21.15.100:0/1628486966 learned_addr learned my addr 172.21.15.100:0/1628486966 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:33:38.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:38.683+0000 7fa4d92af640 1 -- 172.21.15.100:0/1628486966 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4d4158fa0 msgr2=0x7fa4d40c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:33:38.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:38.683+0000 7fa4d92af640 1 -- 172.21.15.100:0/1628486966 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4d4158fa0 msgr2=0x7fa4d40c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:33:38.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:38.683+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4d4158fa0 0x7fa4d40c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:33:38.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:38.683+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4d4158fa0 0x7fa4d40c6dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:33:38.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:38.884+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4d4158fa0 0x7fa4d40c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:38.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:38.884+0000 7fa4d92af640 1 -- 172.21.15.100:0/1628486966 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4d4158fa0 msgr2=0x7fa4d40c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:33:38.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:38.884+0000 7fa4d92af640 1 -- 172.21.15.100:0/1628486966 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4d4158fa0 msgr2=0x7fa4d40c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:33:38.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:38.884+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4d4158fa0 0x7fa4d40c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:33:38.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:38.884+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4d4158fa0 0x7fa4d40c6dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:33:39.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:39.285+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4d4158fa0 0x7fa4d40c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:39.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:39.285+0000 7fa4d92af640 1 -- 172.21.15.100:0/1628486966 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4d4158fa0 msgr2=0x7fa4d40c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:33:39.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:39.285+0000 7fa4d92af640 1 -- 172.21.15.100:0/1628486966 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4d4158fa0 msgr2=0x7fa4d40c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:33:39.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:39.285+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4d4158fa0 0x7fa4d40c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:33:39.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:39.285+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4d4158fa0 0x7fa4d40c6dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:33:40.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:40.086+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4d4158fa0 0x7fa4d40c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:40.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:40.089+0000 7fa4d92af640 1 -- 172.21.15.100:0/1628486966 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4d4158fa0 msgr2=0x7fa4d40c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:33:40.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:40.089+0000 7fa4d92af640 1 -- 172.21.15.100:0/1628486966 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4d4158fa0 msgr2=0x7fa4d40c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:33:40.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:40.089+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4d4158fa0 0x7fa4d40c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:33:40.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:40.089+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4d4158fa0 0x7fa4d40c6dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:33:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.683+0000 7fa4c6ffd640 1 -- 172.21.15.100:0/1628486966 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4d4158fa0 msgr2=0x7fa4d40c6dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:33:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.683+0000 7fa4c6ffd640 1 --2- 172.21.15.100:0/1628486966 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4d4158fa0 0x7fa4d40c6dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:41.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.683+0000 7fa4c6ffd640 1 -- 172.21.15.100:0/1628486966 >> v1:172.21.15.167:6789/0 conn(0x7fa4d40c7300 legacy=0x7fa4d41626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:41.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.683+0000 7fa4c6ffd640 1 -- 172.21.15.100:0/1628486966 >> v1:172.21.15.100:6789/0 conn(0x7fa4d406f490 legacy=0x7fa4d406f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:41.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.683+0000 7fa4c6ffd640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 0x7fa4b8005b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:41.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.683+0000 7fa4c6ffd640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b80061e0 0x7fa4b80086a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:41.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.683+0000 7fa4c6ffd640 1 -- 172.21.15.100:0/1628486966 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fa4d415f140 con 0x7fa4b80061e0 2024-09-11T22:33:41.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.683+0000 7fa4c6ffd640 1 -- 172.21.15.100:0/1628486966 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fa4b8008d50 con 0x7fa4b8003710 2024-09-11T22:33:41.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.683+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 0x7fa4b8005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:41.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.683+0000 7fa4d8aae640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b80061e0 0x7fa4b80086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:41.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.683+0000 7fa4d92af640 1 -- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 msgr2=0x7fa4b8005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:33:41.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.683+0000 7fa4d92af640 1 -- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 msgr2=0x7fa4b8005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:33:41.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.683+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 0x7fa4b8005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:33:41.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.683+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 0x7fa4b8005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:33:41.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.683+0000 7fa4d8aae640 1 -- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b80061e0 msgr2=0x7fa4b80086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:33:41.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.683+0000 7fa4d8aae640 1 -- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b80061e0 msgr2=0x7fa4b80086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:33:41.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.683+0000 7fa4d8aae640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b80061e0 0x7fa4b80086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:33:41.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.683+0000 7fa4d8aae640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b80061e0 0x7fa4b80086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:33:41.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.884+0000 7fa4d8aae640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b80061e0 0x7fa4b80086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:41.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.884+0000 7fa4d8aae640 1 -- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b80061e0 msgr2=0x7fa4b80086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:33:41.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.884+0000 7fa4d8aae640 1 -- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b80061e0 msgr2=0x7fa4b80086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:33:41.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.884+0000 7fa4d8aae640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b80061e0 0x7fa4b80086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:33:41.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.884+0000 7fa4d8aae640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b80061e0 0x7fa4b80086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:33:41.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.885+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 0x7fa4b8005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:41.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.885+0000 7fa4d92af640 1 -- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 msgr2=0x7fa4b8005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:33:41.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.885+0000 7fa4d92af640 1 -- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 msgr2=0x7fa4b8005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:33:41.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.885+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 0x7fa4b8005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:33:41.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:41.885+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 0x7fa4b8005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:33:42.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:42.285+0000 7fa4d8aae640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b80061e0 0x7fa4b80086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:42.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:42.285+0000 7fa4d8aae640 1 -- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b80061e0 msgr2=0x7fa4b80086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:33:42.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:42.285+0000 7fa4d8aae640 1 -- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b80061e0 msgr2=0x7fa4b80086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:33:42.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:42.285+0000 7fa4d8aae640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b80061e0 0x7fa4b80086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:33:42.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:42.285+0000 7fa4d8aae640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b80061e0 0x7fa4b80086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:33:42.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:42.286+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 0x7fa4b8005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:42.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:42.286+0000 7fa4d92af640 1 -- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 msgr2=0x7fa4b8005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:33:42.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:42.286+0000 7fa4d92af640 1 -- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 msgr2=0x7fa4b8005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:33:42.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:42.286+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 0x7fa4b8005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:33:42.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:42.286+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 0x7fa4b8005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:33:43.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:43.086+0000 7fa4d8aae640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b80061e0 0x7fa4b80086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:43.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:43.086+0000 7fa4d8aae640 1 -- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b80061e0 msgr2=0x7fa4b80086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:33:43.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:43.086+0000 7fa4d8aae640 1 -- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b80061e0 msgr2=0x7fa4b80086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:33:43.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:43.086+0000 7fa4d8aae640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b80061e0 0x7fa4b80086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:33:43.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:43.086+0000 7fa4d8aae640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b80061e0 0x7fa4b80086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:33:43.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:43.087+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 0x7fa4b8005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:43.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:43.087+0000 7fa4d92af640 1 -- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 msgr2=0x7fa4b8005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:33:43.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:43.087+0000 7fa4d92af640 1 -- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 msgr2=0x7fa4b8005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:33:43.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:43.087+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 0x7fa4b8005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:33:43.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:43.087+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 0x7fa4b8005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:33:44.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.683+0000 7fa4c6ffd640 1 -- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 msgr2=0x7fa4b8005b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:33:44.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.683+0000 7fa4c6ffd640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 0x7fa4b8005b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:44.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.683+0000 7fa4c6ffd640 1 -- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b80061e0 msgr2=0x7fa4b80086a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:33:44.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.683+0000 7fa4c6ffd640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b80061e0 0x7fa4b80086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:44.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.683+0000 7fa4d9ab0640 1 -- 172.21.15.100:0/1628486966 reap_dead start 2024-09-11T22:33:44.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.683+0000 7fa4c6ffd640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 0x7fa4b8005b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:44.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.683+0000 7fa4c6ffd640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b800a860 0x7fa4b800cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:44.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.683+0000 7fa4c6ffd640 1 -- 172.21.15.100:0/1628486966 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4d415f420 con 0x7fa4b8006610 2024-09-11T22:33:44.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.683+0000 7fa4c6ffd640 1 -- 172.21.15.100:0/1628486966 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fa4d415f140 con 0x7fa4b800a860 2024-09-11T22:33:44.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.683+0000 7fa4c6ffd640 1 -- 172.21.15.100:0/1628486966 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fa4b8008d50 con 0x7fa4b8003710 2024-09-11T22:33:44.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.683+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 0x7fa4b8005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:44.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.683+0000 7fa4d92af640 1 -- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 msgr2=0x7fa4b8005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:33:44.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.683+0000 7fa4d92af640 1 -- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 msgr2=0x7fa4b8005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:33:44.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.683+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 0x7fa4b8005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:33:44.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.683+0000 7fa4d92af640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 0x7fa4b8005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:33:44.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.683+0000 7fa4d9ab0640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.100:3300/0 conn(0x7fa4b800a860 0x7fa4b800cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:44.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.684+0000 7fa4d9ab0640 1 -- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 msgr2=0x7fa4b8005b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:33:44.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.684+0000 7fa4d9ab0640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 0x7fa4b8005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:44.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.684+0000 7fa4d9ab0640 1 -- 172.21.15.100:0/1628486966 >> v1:172.21.15.167:6789/0 conn(0x7fa4b8006610 legacy=0x7fa4b8009140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:44.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.684+0000 7fa4d9ab0640 1 -- 172.21.15.100:0/1628486966 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b800e410 con 0x7fa4b800a860 2024-09-11T22:33:44.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.685+0000 7fa4d9ab0640 1 --2- 172.21.15.100:0/1628486966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4b800a860 0x7fa4b800cc50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4073600 tx=0x7fa4cc02a240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c41c73c33f8a029 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:44.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.686+0000 7fa4c7fff640 1 -- 172.21.15.100:0/1628486966 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc02ab40 con 0x7fa4b800a860 2024-09-11T22:33:44.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.686+0000 7fa4c7fff640 1 -- 172.21.15.100:0/1628486966 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4cc02e070 con 0x7fa4b800a860 2024-09-11T22:33:44.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.686+0000 7fa4c7fff640 1 -- 172.21.15.100:0/1628486966 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc007070 con 0x7fa4b800a860 2024-09-11T22:33:44.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.688+0000 7fa4db513640 1 -- 172.21.15.100:0/1628486966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4b800a860 msgr2=0x7fa4b800cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:44.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.688+0000 7fa4db513640 1 --2- 172.21.15.100:0/1628486966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4b800a860 0x7fa4b800cc50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4073600 tx=0x7fa4cc02a240 comp rx=0 tx=0).stop 2024-09-11T22:33:44.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.688+0000 7fa4db513640 1 -- 172.21.15.100:0/1628486966 shutdown_connections 2024-09-11T22:33:44.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.688+0000 7fa4db513640 1 --2- 172.21.15.100:0/1628486966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4b800a860 0x7fa4b800cc50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:44.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.688+0000 7fa4db513640 1 --2- 172.21.15.100:0/1628486966 >> v2:172.21.15.167:3300/0 conn(0x7fa4b8003710 0x7fa4b8005b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:44.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.688+0000 7fa4db513640 1 -- 172.21.15.100:0/1628486966 >> 172.21.15.100:0/1628486966 conn(0x7fa4d40cc2a0 msgr2=0x7fa4d40cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:44.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.691+0000 7fa4db513640 1 -- 172.21.15.100:0/1628486966 shutdown_connections 2024-09-11T22:33:44.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.691+0000 7fa4db513640 1 -- 172.21.15.100:0/1628486966 wait complete. 2024-09-11T22:33:44.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.693+0000 7fa4db513640 1 Processor -- start 2024-09-11T22:33:44.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.693+0000 7fa4db513640 1 -- start start 2024-09-11T22:33:44.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.694+0000 7fa4db513640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4b8003710 0x7fa4d41e95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:44.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.694+0000 7fa4db513640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4b8006610 0x7fa4d4160c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:44.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.694+0000 7fa4db513640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4b800a860 0x7fa4d4161180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:44.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.694+0000 7fa4db513640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d415eb50 con 0x7fa4b8003710 2024-09-11T22:33:44.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.694+0000 7fa4db513640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d415f9e0 con 0x7fa4b8006610 2024-09-11T22:33:44.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.694+0000 7fa4db513640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d40c6dc0 con 0x7fa4b800a860 2024-09-11T22:33:44.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.694+0000 7fa4d9ab0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4b800a860 0x7fa4d4161180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:44.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.694+0000 7fa4d9ab0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4b800a860 0x7fa4d4161180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:58664/0 (socket says 172.21.15.100:58664) 2024-09-11T22:33:44.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.694+0000 7fa4d9ab0640 1 -- 172.21.15.100:0/2268532170 learned_addr learned my addr 172.21.15.100:0/2268532170 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:33:44.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.696+0000 7fa4d8aae640 1 --2- 172.21.15.100:0/2268532170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4b8006610 0x7fa4d4160c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:44.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.696+0000 7fa4d92af640 1 --2- 172.21.15.100:0/2268532170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4b8003710 0x7fa4d41e95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:44.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.696+0000 7fa4d8aae640 1 -- 172.21.15.100:0/2268532170 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4b800a860 msgr2=0x7fa4d4161180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:44.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.696+0000 7fa4d8aae640 1 --2- 172.21.15.100:0/2268532170 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4b800a860 0x7fa4d4161180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:44.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.696+0000 7fa4d8aae640 1 -- 172.21.15.100:0/2268532170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4b8003710 msgr2=0x7fa4d41e95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:44.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.696+0000 7fa4d8aae640 1 --2- 172.21.15.100:0/2268532170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4b8003710 0x7fa4d41e95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:44.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.696+0000 7fa4d8aae640 1 -- 172.21.15.100:0/2268532170 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d40c32e0 con 0x7fa4b8006610 2024-09-11T22:33:44.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.697+0000 7fa4d92af640 1 --2- 172.21.15.100:0/2268532170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4b8003710 0x7fa4d41e95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:33:44.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.697+0000 7fa4d8aae640 1 --2- 172.21.15.100:0/2268532170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4b8006610 0x7fa4d4160c40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8007620 tx=0x7fa4c8001630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:44.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.697+0000 7fa4c5ffb640 1 -- 172.21.15.100:0/2268532170 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c80049f0 con 0x7fa4b8006610 2024-09-11T22:33:44.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.697+0000 7fa4db513640 1 -- 172.21.15.100:0/2268532170 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d40c62e0 con 0x7fa4b8006610 2024-09-11T22:33:44.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.698+0000 7fa4db513640 1 -- 172.21.15.100:0/2268532170 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d40c5dc0 con 0x7fa4b8006610 2024-09-11T22:33:44.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.699+0000 7fa4c5ffb640 1 -- 172.21.15.100:0/2268532170 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c8004bb0 con 0x7fa4b8006610 2024-09-11T22:33:44.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.699+0000 7fa4c5ffb640 1 -- 172.21.15.100:0/2268532170 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8005050 con 0x7fa4b8006610 2024-09-11T22:33:44.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.701+0000 7fa4c5ffb640 1 -- 172.21.15.100:0/2268532170 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa4c80051f0 con 0x7fa4b8006610 2024-09-11T22:33:44.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.702+0000 7fa4c5ffb640 1 --2- 172.21.15.100:0/2268532170 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa4b806d720 0x7fa4b806fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:44.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.702+0000 7fa4c5ffb640 1 -- 172.21.15.100:0/2268532170 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fa4c808bb70 con 0x7fa4b8006610 2024-09-11T22:33:44.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.702+0000 7fa4d92af640 1 --2- 172.21.15.100:0/2268532170 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa4b806d720 0x7fa4b806fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:44.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.703+0000 7fa4db513640 1 -- 172.21.15.100:0/2268532170 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4b4005290 con 0x7fa4b8006610 2024-09-11T22:33:44.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.704+0000 7fa4d92af640 1 --2- 172.21.15.100:0/2268532170 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa4b806d720 0x7fa4b806fbe0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0006fd0 tx=0x7fa4d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:44.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:44.720+0000 7fa4c5ffb640 1 -- 172.21.15.100:0/2268532170 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa4c8015350 con 0x7fa4b8006610 2024-09-11T22:33:45.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.232+0000 7fa4db513640 1 -- 172.21.15.100:0/2268532170 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa4b4005580 con 0x7fa4b8006610 2024-09-11T22:33:45.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.233+0000 7fa4c5ffb640 1 -- 172.21.15.100:0/2268532170 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1568 (secure 0 0 0) 0x7fa4c805a170 con 0x7fa4b8006610 2024-09-11T22:33:45.235 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":98,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:33:45.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.237+0000 7fa4bf7fe640 1 -- 172.21.15.100:0/2268532170 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa4b806d720 msgr2=0x7fa4b806fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:45.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.237+0000 7fa4bf7fe640 1 --2- 172.21.15.100:0/2268532170 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa4b806d720 0x7fa4b806fbe0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0006fd0 tx=0x7fa4d0008040 comp rx=0 tx=0).stop 2024-09-11T22:33:45.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.237+0000 7fa4bf7fe640 1 -- 172.21.15.100:0/2268532170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4b8006610 msgr2=0x7fa4d4160c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:45.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.237+0000 7fa4bf7fe640 1 --2- 172.21.15.100:0/2268532170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4b8006610 0x7fa4d4160c40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8007620 tx=0x7fa4c8001630 comp rx=0 tx=0).stop 2024-09-11T22:33:45.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.238+0000 7fa4bf7fe640 1 -- 172.21.15.100:0/2268532170 shutdown_connections 2024-09-11T22:33:45.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.238+0000 7fa4bf7fe640 1 --2- 172.21.15.100:0/2268532170 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa4b806d720 0x7fa4b806fbe0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:45.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.238+0000 7fa4bf7fe640 1 --2- 172.21.15.100:0/2268532170 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4b800a860 0x7fa4d4161180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:45.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.238+0000 7fa4bf7fe640 1 --2- 172.21.15.100:0/2268532170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4b8006610 0x7fa4d4160c40 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8007620 tx=0x7fa4c8001630 comp rx=0 tx=0).stop 2024-09-11T22:33:45.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.238+0000 7fa4bf7fe640 1 --2- 172.21.15.100:0/2268532170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4b8003710 0x7fa4d41e95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:45.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.238+0000 7fa4bf7fe640 1 -- 172.21.15.100:0/2268532170 >> 172.21.15.100:0/2268532170 conn(0x7fa4d40cc2a0 msgr2=0x7fa4d4162510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:45.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.239+0000 7fa4bf7fe640 1 -- 172.21.15.100:0/2268532170 shutdown_connections 2024-09-11T22:33:45.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.242+0000 7fa4bf7fe640 1 -- 172.21.15.100:0/2268532170 wait complete. 2024-09-11T22:33:45.263 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:33:45.263 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:33:45.263 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:33:45.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.485+0000 7f0c7194b640 1 Processor -- start 2024-09-11T22:33:45.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.485+0000 7f0c7194b640 1 -- start start 2024-09-11T22:33:45.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.487+0000 7f0c7194b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0c6404aa70 0x7f0c64005a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:45.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.487+0000 7f0c7194b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0c640ff860 0x7f0c640ffcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:45.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.487+0000 7f0c7194b640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c64100310 con 0x7f0c640f66c0 2024-09-11T22:33:45.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.487+0000 7f0c7194b640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f0c64045690 con 0x7f0c6404aa70 2024-09-11T22:33:45.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.487+0000 7f0c7194b640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f0c64045f30 con 0x7f0c640ff860 2024-09-11T22:33:45.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.487+0000 7f0c6a7fc640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0c6404aa70 0x7f0c64005a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:45.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.487+0000 7f0c6a7fc640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0c6404aa70 0x7f0c64005a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57840/0 (socket says 172.21.15.100:57840) 2024-09-11T22:33:45.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.487+0000 7f0c6a7fc640 1 -- 172.21.15.100:0/1121993453 learned_addr learned my addr 172.21.15.100:0/1121993453 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:33:45.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.489+0000 7f0c69ffb640 1 -- 172.21.15.100:0/1121993453 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2858670891 0 0) 0x7f0c64100310 con 0x7f0c640f66c0 2024-09-11T22:33:45.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.489+0000 7f0c69ffb640 1 -- 172.21.15.100:0/1121993453 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c54003970 con 0x7f0c640f66c0 2024-09-11T22:33:45.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.489+0000 7f0c6a7fc640 1 -- 172.21.15.100:0/1121993453 >> v2:172.21.15.167:3300/0 conn(0x7f0c640ff860 msgr2=0x7f0c640ffcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:45.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.489+0000 7f0c6a7fc640 1 --2- 172.21.15.100:0/1121993453 >> v2:172.21.15.167:3300/0 conn(0x7f0c640ff860 0x7f0c640ffcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:45.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.489+0000 7f0c6a7fc640 1 -- 172.21.15.100:0/1121993453 >> v1:172.21.15.100:6789/0 conn(0x7f0c640f66c0 legacy=0x7f0c640463c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:45.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.489+0000 7f0c6a7fc640 1 -- 172.21.15.100:0/1121993453 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c641005f0 con 0x7f0c6404aa70 2024-09-11T22:33:45.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.491+0000 7f0c6a7fc640 1 --2- 172.21.15.100:0/1121993453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c6404aa70 0x7f0c64005a30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c074630 tx=0x7f0c6c095b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdbcbd058d4bd79d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:45.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.491+0000 7f0c69ffb640 1 -- 172.21.15.100:0/1121993453 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c097880 con 0x7f0c6404aa70 2024-09-11T22:33:45.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.491+0000 7f0c69ffb640 1 -- 172.21.15.100:0/1121993453 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c6c097a60 con 0x7f0c6404aa70 2024-09-11T22:33:45.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.491+0000 7f0c69ffb640 1 -- 172.21.15.100:0/1121993453 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c098450 con 0x7f0c6404aa70 2024-09-11T22:33:45.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.492+0000 7f0c7194b640 1 -- 172.21.15.100:0/1121993453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c6404aa70 msgr2=0x7f0c64005a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:45.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.492+0000 7f0c7194b640 1 --2- 172.21.15.100:0/1121993453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c6404aa70 0x7f0c64005a30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c074630 tx=0x7f0c6c095b20 comp rx=0 tx=0).stop 2024-09-11T22:33:45.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.494+0000 7f0c7194b640 1 -- 172.21.15.100:0/1121993453 shutdown_connections 2024-09-11T22:33:45.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.494+0000 7f0c7194b640 1 --2- 172.21.15.100:0/1121993453 >> v2:172.21.15.167:3300/0 conn(0x7f0c640ff860 0x7f0c640ffcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:45.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.494+0000 7f0c7194b640 1 --2- 172.21.15.100:0/1121993453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c6404aa70 0x7f0c64005a30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:45.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.494+0000 7f0c7194b640 1 -- 172.21.15.100:0/1121993453 >> 172.21.15.100:0/1121993453 conn(0x7f0c6404fc80 msgr2=0x7f0c64050090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:45.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.497+0000 7f0c7194b640 1 -- 172.21.15.100:0/1121993453 shutdown_connections 2024-09-11T22:33:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.498+0000 7f0c7194b640 1 -- 172.21.15.100:0/1121993453 wait complete. 2024-09-11T22:33:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.500+0000 7f0c7194b640 1 Processor -- start 2024-09-11T22:33:45.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.500+0000 7f0c7194b640 1 -- start start 2024-09-11T22:33:45.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.501+0000 7f0c7194b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c6404aa70 0x7f0c640fa1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.503+0000 7f0c7194b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c640f66c0 0x7f0c640fb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:45.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.503+0000 7f0c7194b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c640ff860 0x7f0c640fbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:45.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.504+0000 7f0c6affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c6404aa70 0x7f0c640fa1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:45.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.504+0000 7f0c6affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c6404aa70 0x7f0c640fa1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57856/0 (socket says 172.21.15.100:57856) 2024-09-11T22:33:45.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.504+0000 7f0c6a7fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c640f66c0 0x7f0c640fb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:45.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.506+0000 7f0c7194b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0c64045bc0 con 0x7f0c6404aa70 2024-09-11T22:33:45.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.506+0000 7f0c6b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c640ff860 0x7f0c640fbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:45.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.506+0000 7f0c6b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c640ff860 0x7f0c640fbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:59052/0 (socket says 172.21.15.100:59052) 2024-09-11T22:33:45.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.506+0000 7f0c6b7fe640 1 -- 172.21.15.100:0/2669589177 learned_addr learned my addr 172.21.15.100:0/2669589177 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:33:45.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.506+0000 7f0c7194b640 1 -- 172.21.15.100:0/2669589177 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0c640f6aa0 con 0x7f0c640ff860 2024-09-11T22:33:45.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.506+0000 7f0c7194b640 1 -- 172.21.15.100:0/2669589177 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0c64044b60 con 0x7f0c640f66c0 2024-09-11T22:33:45.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.507+0000 7f0c6b7fe640 1 -- 172.21.15.100:0/2669589177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c640f66c0 msgr2=0x7f0c640fb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:45.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.507+0000 7f0c6b7fe640 1 --2- 172.21.15.100:0/2669589177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c640f66c0 0x7f0c640fb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:45.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.507+0000 7f0c6b7fe640 1 -- 172.21.15.100:0/2669589177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c6404aa70 msgr2=0x7f0c640fa1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:45.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.507+0000 7f0c6b7fe640 1 --2- 172.21.15.100:0/2669589177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c6404aa70 0x7f0c640fa1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:45.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.507+0000 7f0c6b7fe640 1 -- 172.21.15.100:0/2669589177 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c64049a90 con 0x7f0c640ff860 2024-09-11T22:33:45.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.507+0000 7f0c6a7fc640 1 --2- 172.21.15.100:0/2669589177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c640f66c0 0x7f0c640fb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:33:45.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.507+0000 7f0c6affd640 1 --2- 172.21.15.100:0/2669589177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c6404aa70 0x7f0c640fa1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-11T22:33:45.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.507+0000 7f0c6b7fe640 1 --2- 172.21.15.100:0/2669589177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c640ff860 0x7f0c640fbba0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000b3c0 tx=0x7f0c6000b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:45.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.507+0000 7f0c53fff640 1 -- 172.21.15.100:0/2669589177 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c60012b80 con 0x7f0c640ff860 2024-09-11T22:33:45.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.508+0000 7f0c7194b640 1 -- 172.21.15.100:0/2669589177 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c640fd3a0 con 0x7f0c640ff860 2024-09-11T22:33:45.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.508+0000 7f0c7194b640 1 -- 172.21.15.100:0/2669589177 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c640fab80 con 0x7f0c640ff860 2024-09-11T22:33:45.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.508+0000 7f0c53fff640 1 -- 172.21.15.100:0/2669589177 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c60012d20 con 0x7f0c640ff860 2024-09-11T22:33:45.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.508+0000 7f0c53fff640 1 -- 172.21.15.100:0/2669589177 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6001b640 con 0x7f0c640ff860 2024-09-11T22:33:45.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.510+0000 7f0c53fff640 1 -- 172.21.15.100:0/2669589177 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c6001b7e0 con 0x7f0c640ff860 2024-09-11T22:33:45.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.510+0000 7f0c53fff640 1 --2- 172.21.15.100:0/2669589177 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0c5806bf00 0x7f0c5806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:45.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.511+0000 7f0c53fff640 1 -- 172.21.15.100:0/2669589177 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f0c6008ef30 con 0x7f0c640ff860 2024-09-11T22:33:45.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.513+0000 7f0c6affd640 1 --2- 172.21.15.100:0/2669589177 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0c5806bf00 0x7f0c5806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:45.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.514+0000 7f0c6affd640 1 --2- 172.21.15.100:0/2669589177 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0c5806bf00 0x7f0c5806e3c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c0011e0 tx=0x7f0c5c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:45.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.515+0000 7f0c7194b640 1 --2- 172.21.15.100:0/2669589177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c4c002a70 0x7f0c4c004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:45.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.515+0000 7f0c7194b640 1 -- 172.21.15.100:0/2669589177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c007ec0 con 0x7f0c4c002a70 2024-09-11T22:33:45.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.521+0000 7f0c6a7fc640 1 --2- 172.21.15.100:0/2669589177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c4c002a70 0x7f0c4c004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:45.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.521+0000 7f0c6a7fc640 1 -- 172.21.15.100:0/2669589177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0c4c0080c0 con 0x7f0c4c002a70 2024-09-11T22:33:45.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.522+0000 7f0c6a7fc640 1 --2- 172.21.15.100:0/2669589177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c4c002a70 0x7f0c4c004f30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c06b3b0 tx=0x7f0c6c069df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:45.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.526+0000 7f0c53fff640 1 -- 172.21.15.100:0/2669589177 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c097d70 con 0x7f0c4c002a70 2024-09-11T22:33:45.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.526+0000 7f0c53fff640 1 -- 172.21.15.100:0/2669589177 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f0c6c062630 con 0x7f0c4c002a70 2024-09-11T22:33:45.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.526+0000 7f0c53fff640 1 -- 172.21.15.100:0/2669589177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c4c002a70 msgr2=0x7f0c4c004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:45.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.526+0000 7f0c53fff640 1 --2- 172.21.15.100:0/2669589177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c4c002a70 0x7f0c4c004f30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c06b3b0 tx=0x7f0c6c069df0 comp rx=0 tx=0).stop 2024-09-11T22:33:45.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.526+0000 7f0c53fff640 1 -- 172.21.15.100:0/2669589177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c4c002a70 msgr2=0x7f0c4c004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:33:45.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.526+0000 7f0c53fff640 1 --2- 172.21.15.100:0/2669589177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c4c002a70 0x7f0c4c004f30 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c06b3b0 tx=0x7f0c6c069df0 comp rx=0 tx=0).stop 2024-09-11T22:33:45.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.542+0000 7f0c7194b640 1 --2- 172.21.15.100:0/2669589177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c4c006f30 0x7f0c4c0073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:45.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.542+0000 7f0c7194b640 1 -- 172.21.15.100:0/2669589177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c00a4a0 con 0x7f0c4c006f30 2024-09-11T22:33:45.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.545+0000 7f0c6a7fc640 1 --2- 172.21.15.100:0/2669589177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c4c006f30 0x7f0c4c0073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:45.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.546+0000 7f0c6a7fc640 1 -- 172.21.15.100:0/2669589177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0c4c007900 con 0x7f0c4c006f30 2024-09-11T22:33:45.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.546+0000 7f0c6a7fc640 1 --2- 172.21.15.100:0/2669589177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c4c006f30 0x7f0c4c0073c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c074630 tx=0x7f0c6c09b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:45.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.547+0000 7f0c53fff640 1 -- 172.21.15.100:0/2669589177 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c0ade40 con 0x7f0c4c006f30 2024-09-11T22:33:45.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.547+0000 7f0c53fff640 1 -- 172.21.15.100:0/2669589177 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7f0c6c098450 con 0x7f0c4c006f30 2024-09-11T22:33:45.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.547+0000 7f0c53fff640 1 -- 172.21.15.100:0/2669589177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c4c006f30 msgr2=0x7f0c4c0073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:45.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.547+0000 7f0c53fff640 1 --2- 172.21.15.100:0/2669589177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c4c006f30 0x7f0c4c0073c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c074630 tx=0x7f0c6c09b000 comp rx=0 tx=0).stop 2024-09-11T22:33:45.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.547+0000 7f0c53fff640 1 -- 172.21.15.100:0/2669589177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c4c006f30 msgr2=0x7f0c4c0073c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:33:45.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.547+0000 7f0c53fff640 1 --2- 172.21.15.100:0/2669589177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c4c006f30 0x7f0c4c0073c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:45.549 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:33:45.549 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:33:45.549 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:33:45.549 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:33:45.549 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 98, 2024-09-11T22:33:45.550 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 84683, 2024-09-11T22:33:45.550 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:33:45.550 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:33:45.550 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:33:45.550 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:33:45.551 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:45.551 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 2, 2024-09-11T22:33:45.551 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:33:45.551 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:33:45.551 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:33:45.551 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:45.551 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:45.551 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:45.551 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:45.551 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:45.551 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:45.551 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:45.552 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:45.552 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:45.552 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:45.552 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:45.552 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:45.552 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:33:45.552 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:33:45.552 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:45.552 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:45.552 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:45.552 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:45.552 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:45.552 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:45.552 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:45.553 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:45.553 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:45.553 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:45.553 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:45.553 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:45.553 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.553 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:33:45.553 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:33:45.553 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:33:45.553 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:33:45.553 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:33:45.553 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:33:45.553 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:33:45.554 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:33:45.554 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:33:45.554 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:33:45.554 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:33:45.554 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:33:45.554 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:33:45.554 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:33:45.554 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:33:45.554 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:33:45.554 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:33:45.554 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:45.554 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:45.554 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:45.555 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:45.555 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:45.555 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:45.555 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:45.555 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:45.555 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:45.555 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:45.555 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:45.555 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:45.555 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:33:45.555 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.555 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:33:45.556 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.556 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:33:45.556 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:33:45.556 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:45.556 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:45.556 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.556 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:45.556 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:33:45.556 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:45.556 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.556 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.556 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:45.557 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:33:45.557 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:45.557 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:45.557 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:45.557 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.557 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:33:45.557 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:33:45.557 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:45.557 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:45.557 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:45.557 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.557 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.557 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:33:45.557 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:33:45.558 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:45.558 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:45.558 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.558 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:45.558 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:33:45.558 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:45.558 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.558 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.558 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:45.558 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:33:45.558 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:45.558 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:45.558 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:45.558 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.559 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:33:45.559 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:33:45.559 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:45.559 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:45.559 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:45.559 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.559 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.559 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:33:45.559 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:33:45.559 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:45.560 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:45.560 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.560 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:45.560 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:33:45.560 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:45.560 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.560 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.560 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:45.560 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:33:45.560 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:45.560 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:45.560 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:45.560 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.561 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:33:45.561 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:33:45.561 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:45.561 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:45.561 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:45.561 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:45.561 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:45.561 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.561 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:33:45.561 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:33:45.561 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.561 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:45.561 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:45.562 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:33:45.562 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:45.562 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:45.562 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:33:45.562 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.562 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:45.562 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:45.562 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4 2024-09-11T22:33:45.562 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:45.562 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:45.562 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:33:45.562 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.562 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:45.562 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:45.562 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:33:45.563 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:45.563 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:45.563 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:33:45.563 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.563 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:45.563 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:45.563 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:33:45.563 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:45.563 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:45.563 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:33:45.563 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.563 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:45.563 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:45.563 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:33:45.564 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:45.564 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:45.564 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.564 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:33:45.564 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:33:45.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.549+0000 7f0c7194b640 1 -- 172.21.15.100:0/2669589177 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0c5806bf00 msgr2=0x7f0c5806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:45.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.549+0000 7f0c7194b640 1 --2- 172.21.15.100:0/2669589177 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0c5806bf00 0x7f0c5806e3c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c0011e0 tx=0x7f0c5c009040 comp rx=0 tx=0).stop 2024-09-11T22:33:45.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.550+0000 7f0c6b7fe640 1 -- 172.21.15.100:0/2669589177 reap_dead start 2024-09-11T22:33:45.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.550+0000 7f0c7194b640 1 -- 172.21.15.100:0/2669589177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c640ff860 msgr2=0x7f0c640fbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:45.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.550+0000 7f0c7194b640 1 --2- 172.21.15.100:0/2669589177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c640ff860 0x7f0c640fbba0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000b3c0 tx=0x7f0c6000b880 comp rx=0 tx=0).stop 2024-09-11T22:33:45.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.550+0000 7f0c7194b640 1 -- 172.21.15.100:0/2669589177 shutdown_connections 2024-09-11T22:33:45.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.550+0000 7f0c7194b640 1 --2- 172.21.15.100:0/2669589177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c640ff860 0x7f0c640fbba0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:45.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.550+0000 7f0c7194b640 1 -- 172.21.15.100:0/2669589177 >> 172.21.15.100:0/2669589177 conn(0x7f0c6404fc80 msgr2=0x7f0c6404f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:45.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.550+0000 7f0c7194b640 1 -- 172.21.15.100:0/2669589177 shutdown_connections 2024-09-11T22:33:45.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.550+0000 7f0c7194b640 1 -- 172.21.15.100:0/2669589177 wait complete. 2024-09-11T22:33:45.582 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:33:45.583 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:33:45.583 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:33:45.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.785+0000 7f56b8959640 1 Processor -- start 2024-09-11T22:33:45.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.786+0000 7f56b8959640 1 -- start start 2024-09-11T22:33:45.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.787+0000 7f56b8959640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b40c91c0 0x7f56b415f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:45.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.788+0000 7f56b8959640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56b4162850 con 0x7f56b40aebe0 2024-09-11T22:33:45.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.788+0000 7f56b8959640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56b4162b30 con 0x7f56b40c8de0 2024-09-11T22:33:45.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.788+0000 7f56b8959640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f56b4162600 con 0x7f56b40c91c0 2024-09-11T22:33:45.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.788+0000 7f56b2d9d640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f56b40aebe0 0x7f56b415c180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41200/0 (socket says 172.21.15.100:41200) 2024-09-11T22:33:45.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.788+0000 7f56b2d9d640 1 -- 172.21.15.100:0/1486912104 learned_addr learned my addr 172.21.15.100:0/1486912104 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:33:45.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.789+0000 7f56b159a640 1 -- 172.21.15.100:0/1486912104 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3326989167 0 0) 0x7f56b4162850 con 0x7f56b40aebe0 2024-09-11T22:33:45.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.789+0000 7f56b159a640 1 -- 172.21.15.100:0/1486912104 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f569c003520 con 0x7f56b40aebe0 2024-09-11T22:33:45.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.789+0000 7f56b1d9b640 1 --2- 172.21.15.100:0/1486912104 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b40c91c0 0x7f56b415f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:45.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.790+0000 7f56b159a640 1 -- 172.21.15.100:0/1486912104 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3227677006 0 0) 0x7f569c003520 con 0x7f56b40aebe0 2024-09-11T22:33:45.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.790+0000 7f56b159a640 1 -- 172.21.15.100:0/1486912104 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b40c91c0 msgr2=0x7f56b415f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:45.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.790+0000 7f56b159a640 1 --2- 172.21.15.100:0/1486912104 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b40c91c0 0x7f56b415f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:45.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.790+0000 7f56b159a640 1 -- 172.21.15.100:0/1486912104 >> v1:172.21.15.167:6789/0 conn(0x7f56b40c8de0 legacy=0x7f56b40c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:45.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.790+0000 7f56b159a640 1 -- 172.21.15.100:0/1486912104 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b4162e10 con 0x7f56b40aebe0 2024-09-11T22:33:45.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.791+0000 7f56b159a640 1 -- 172.21.15.100:0/1486912104 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f56a8001670 con 0x7f56b40aebe0 2024-09-11T22:33:45.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.791+0000 7f56b159a640 1 -- 172.21.15.100:0/1486912104 >> v1:172.21.15.100:6789/0 conn(0x7f56b40aebe0 legacy=0x7f56b415c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:45.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.792+0000 7f56b159a640 1 --2- 172.21.15.100:0/1486912104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f569c0039e0 0x7f569c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:45.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.792+0000 7f56b159a640 1 --2- 172.21.15.100:0/1486912104 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b40c91c0 0x7f569c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:45.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.792+0000 7f56b159a640 1 --2- 172.21.15.100:0/1486912104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f569c004d40 0x7f569c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:45.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.792+0000 7f56b159a640 1 -- 172.21.15.100:0/1486912104 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f56b4162600 con 0x7f569c0039e0 2024-09-11T22:33:45.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.792+0000 7f56b159a640 1 -- 172.21.15.100:0/1486912104 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f569c00bb00 con 0x7f569c004d40 2024-09-11T22:33:45.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.793+0000 7f56b159a640 1 -- 172.21.15.100:0/1486912104 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f569c00bd00 con 0x7f56b40c91c0 2024-09-11T22:33:45.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.793+0000 7f56b2d9d640 1 --2- 172.21.15.100:0/1486912104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f569c004d40 0x7f569c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:45.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.793+0000 7f56b259c640 1 --2- 172.21.15.100:0/1486912104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f569c0039e0 0x7f569c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:45.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.794+0000 7f56b259c640 1 -- 172.21.15.100:0/1486912104 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b40c91c0 msgr2=0x7f569c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:45.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.794+0000 7f56b1d9b640 1 --2- 172.21.15.100:0/1486912104 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b40c91c0 0x7f569c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:45.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.795+0000 7f56b259c640 1 --2- 172.21.15.100:0/1486912104 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b40c91c0 0x7f569c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:45.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.795+0000 7f56b259c640 1 -- 172.21.15.100:0/1486912104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f569c004d40 msgr2=0x7f569c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:45.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.795+0000 7f56b259c640 1 --2- 172.21.15.100:0/1486912104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f569c004d40 0x7f569c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:45.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.795+0000 7f56b259c640 1 -- 172.21.15.100:0/1486912104 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f569c003520 con 0x7f569c0039e0 2024-09-11T22:33:45.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.799+0000 7f56b259c640 1 --2- 172.21.15.100:0/1486912104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f569c0039e0 0x7f569c003dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f56a4001720 tx=0x7f569c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f617edf961b54530 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:45.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.799+0000 7f56b159a640 1 -- 172.21.15.100:0/1486912104 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a4001370 con 0x7f569c0039e0 2024-09-11T22:33:45.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.799+0000 7f56b159a640 1 -- 172.21.15.100:0/1486912104 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56a40052d0 con 0x7f569c0039e0 2024-09-11T22:33:45.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.799+0000 7f56b159a640 1 -- 172.21.15.100:0/1486912104 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a402abe0 con 0x7f569c0039e0 2024-09-11T22:33:45.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.803+0000 7f56b2d9d640 1 --2- 172.21.15.100:0/1486912104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f569c004d40 0x7f569c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:33:45.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.808+0000 7f56b1d9b640 1 --2- 172.21.15.100:0/1486912104 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b40c91c0 0x7f569c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:33:45.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.809+0000 7f56b8959640 1 -- 172.21.15.100:0/1486912104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f569c0039e0 msgr2=0x7f569c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:45.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.809+0000 7f56b8959640 1 --2- 172.21.15.100:0/1486912104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f569c0039e0 0x7f569c003dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f56a4001720 tx=0x7f569c005830 comp rx=0 tx=0).stop 2024-09-11T22:33:45.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.809+0000 7f56b2d9d640 1 -- 172.21.15.100:0/1486912104 reap_dead start 2024-09-11T22:33:45.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.813+0000 7f56b8959640 1 -- 172.21.15.100:0/1486912104 shutdown_connections 2024-09-11T22:33:45.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.813+0000 7f56b8959640 1 -- 172.21.15.100:0/1486912104 >> 172.21.15.100:0/1486912104 conn(0x7f56b406f360 msgr2=0x7f56b406f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:45.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.814+0000 7f56b8959640 1 -- 172.21.15.100:0/1486912104 shutdown_connections 2024-09-11T22:33:45.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.814+0000 7f56b8959640 1 -- 172.21.15.100:0/1486912104 wait complete. 2024-09-11T22:33:45.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.816+0000 7f56b8959640 1 Processor -- start 2024-09-11T22:33:45.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.817+0000 7f56b8959640 1 -- start start 2024-09-11T22:33:45.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.818+0000 7f56b8959640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b406be80 0x7f56b41f8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:45.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.818+0000 7f56b8959640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56b406c260 0x7f56b41577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:45.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.818+0000 7f56b8959640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b4156de0 0x7f56b4157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:45.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.818+0000 7f56b8959640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f56b415f090 con 0x7f56b406c260 2024-09-11T22:33:45.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.819+0000 7f56b8959640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f56b41633d0 con 0x7f56b406be80 2024-09-11T22:33:45.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.819+0000 7f56b8959640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f56b415c890 con 0x7f56b4156de0 2024-09-11T22:33:45.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.819+0000 7f56b259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b406be80 0x7f56b41f8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:45.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.819+0000 7f56b259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b406be80 0x7f56b41f8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:59076/0 (socket says 172.21.15.100:59076) 2024-09-11T22:33:45.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.819+0000 7f56b259c640 1 -- 172.21.15.100:0/2136931743 learned_addr learned my addr 172.21.15.100:0/2136931743 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:33:45.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.819+0000 7f56b1d9b640 1 --2- 172.21.15.100:0/2136931743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56b406c260 0x7f56b41577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:45.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.820+0000 7f56b2d9d640 1 --2- 172.21.15.100:0/2136931743 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b4156de0 0x7f56b4157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:45.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.820+0000 7f56b259c640 1 -- 172.21.15.100:0/2136931743 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b4156de0 msgr2=0x7f56b4157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:45.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.820+0000 7f56b259c640 1 --2- 172.21.15.100:0/2136931743 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b4156de0 0x7f56b4157d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:45.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.820+0000 7f56b259c640 1 -- 172.21.15.100:0/2136931743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56b406c260 msgr2=0x7f56b41577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:45.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.820+0000 7f56b259c640 1 --2- 172.21.15.100:0/2136931743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56b406c260 0x7f56b41577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:45.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.820+0000 7f56b259c640 1 -- 172.21.15.100:0/2136931743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b406c950 con 0x7f56b406be80 2024-09-11T22:33:45.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.820+0000 7f56b2d9d640 1 --2- 172.21.15.100:0/2136931743 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b4156de0 0x7f56b4157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:33:45.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.820+0000 7f56b259c640 1 --2- 172.21.15.100:0/2136931743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b406be80 0x7f56b41f8de0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f56a4001840 tx=0x7f56a4001120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:45.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.821+0000 7f56a2ffd640 1 -- 172.21.15.100:0/2136931743 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a4001370 con 0x7f56b406be80 2024-09-11T22:33:45.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.821+0000 7f56b8959640 1 -- 172.21.15.100:0/2136931743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56b41f51b0 con 0x7f56b406be80 2024-09-11T22:33:45.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.821+0000 7f56b8959640 1 -- 172.21.15.100:0/2136931743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56b41f5770 con 0x7f56b406be80 2024-09-11T22:33:45.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.821+0000 7f56a2ffd640 1 -- 172.21.15.100:0/2136931743 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56a4040070 con 0x7f56b406be80 2024-09-11T22:33:45.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.821+0000 7f56a2ffd640 1 -- 172.21.15.100:0/2136931743 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a4005480 con 0x7f56b406be80 2024-09-11T22:33:45.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.822+0000 7f56b8959640 1 --2- 172.21.15.100:0/2136931743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5698002a70 0x7f5698004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:45.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.822+0000 7f56b8959640 1 -- 172.21.15.100:0/2136931743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5698007ec0 con 0x7f5698002a70 2024-09-11T22:33:45.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.823+0000 7f56b1d9b640 1 --2- 172.21.15.100:0/2136931743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5698002a70 0x7f5698004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:45.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.824+0000 7f56a2ffd640 1 -- 172.21.15.100:0/2136931743 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f56a403a070 con 0x7f56b406be80 2024-09-11T22:33:45.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.824+0000 7f56a2ffd640 1 --2- 172.21.15.100:0/2136931743 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f569406bf30 0x7f569406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:45.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.824+0000 7f56a2ffd640 1 -- 172.21.15.100:0/2136931743 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f56a40aa980 con 0x7f56b406be80 2024-09-11T22:33:45.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.825+0000 7f56b2d9d640 1 --2- 172.21.15.100:0/2136931743 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f569406bf30 0x7f569406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:45.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.826+0000 7f56b2d9d640 1 --2- 172.21.15.100:0/2136931743 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f569406bf30 0x7f569406e3f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f56b4070270 tx=0x7f56a8006040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:45.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.827+0000 7f56b1d9b640 1 -- 172.21.15.100:0/2136931743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f56980080c0 con 0x7f5698002a70 2024-09-11T22:33:45.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.828+0000 7f56b1d9b640 1 --2- 172.21.15.100:0/2136931743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5698002a70 0x7f5698004f30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f56b41ef7a0 tx=0x7f56ac0075e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:45.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.828+0000 7f56a2ffd640 1 -- 172.21.15.100:0/2136931743 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac017480 con 0x7f5698002a70 2024-09-11T22:33:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.829+0000 7f56a2ffd640 1 -- 172.21.15.100:0/2136931743 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f56ac01c070 con 0x7f5698002a70 2024-09-11T22:33:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.829+0000 7f56a2ffd640 1 -- 172.21.15.100:0/2136931743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5698002a70 msgr2=0x7f5698004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.829+0000 7f56a2ffd640 1 --2- 172.21.15.100:0/2136931743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5698002a70 0x7f5698004f30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f56b41ef7a0 tx=0x7f56ac0075e0 comp rx=0 tx=0).stop 2024-09-11T22:33:45.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.829+0000 7f56a2ffd640 1 -- 172.21.15.100:0/2136931743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5698002a70 msgr2=0x7f5698004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:33:45.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.829+0000 7f56a2ffd640 1 --2- 172.21.15.100:0/2136931743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5698002a70 0x7f5698004f30 secure :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f56b41ef7a0 tx=0x7f56ac0075e0 comp rx=0 tx=0).stop 2024-09-11T22:33:45.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.854+0000 7f56b8959640 1 --2- 172.21.15.100:0/2136931743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5698006eb0 0x7f5698007340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:45.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.854+0000 7f56b8959640 1 -- 172.21.15.100:0/2136931743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f569800a4a0 con 0x7f5698006eb0 2024-09-11T22:33:45.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.855+0000 7f56b1d9b640 1 --2- 172.21.15.100:0/2136931743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5698006eb0 0x7f5698007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:45.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.856+0000 7f56b1d9b640 1 -- 172.21.15.100:0/2136931743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5698007880 con 0x7f5698006eb0 2024-09-11T22:33:45.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.856+0000 7f56b1d9b640 1 --2- 172.21.15.100:0/2136931743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5698006eb0 0x7f5698007340 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f56ac008010 tx=0x7f56ac004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.857+0000 7f56a2ffd640 1 -- 172.21.15.100:0/2136931743 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac021bd0 con 0x7f5698006eb0 2024-09-11T22:33:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.857+0000 7f56a2ffd640 1 -- 172.21.15.100:0/2136931743 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4552 (secure 0 0 0) 0x7f56ac021d70 con 0x7f5698006eb0 2024-09-11T22:33:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.857+0000 7f56a2ffd640 1 -- 172.21.15.100:0/2136931743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5698006eb0 msgr2=0x7f5698007340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.857+0000 7f56a2ffd640 1 --2- 172.21.15.100:0/2136931743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5698006eb0 0x7f5698007340 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f56ac008010 tx=0x7f56ac004ab0 comp rx=0 tx=0).stop 2024-09-11T22:33:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.857+0000 7f56a2ffd640 1 -- 172.21.15.100:0/2136931743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5698006eb0 msgr2=0x7f5698007340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:33:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.857+0000 7f56a2ffd640 1 --2- 172.21.15.100:0/2136931743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5698006eb0 0x7f5698007340 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f56ac008010 tx=0x7f56ac004ab0 comp rx=0 tx=0).stop 2024-09-11T22:33:45.862 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:33:45.862 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:33:45.862 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:33:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:33:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 98, 2024-09-11T22:33:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 17388, 2024-09-11T22:33:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:33:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:33:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:33:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:33:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 2, 2024-09-11T22:33:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:33:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:33:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:33:45.863 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:45.864 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:45.864 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:45.864 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:45.864 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:45.864 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:45.864 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:45.864 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:45.864 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:45.864 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:45.864 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:45.864 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:45.864 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:33:45.864 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:33:45.865 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:45.865 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:45.865 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:45.865 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:45.865 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:45.865 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:45.865 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:45.865 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:45.865 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:45.865 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:45.865 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:45.865 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:45.865 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.866 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:33:45.866 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:33:45.866 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:33:45.866 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:33:45.866 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:33:45.866 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:33:45.866 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:33:45.866 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:33:45.866 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:33:45.866 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:33:45.866 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:33:45.866 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:33:45.866 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:33:45.866 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:33:45.866 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:33:45.867 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:33:45.867 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:33:45.867 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:45.867 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:45.867 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:45.867 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:45.867 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:45.867 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:45.867 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:45.867 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:45.867 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:45.867 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:45.867 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:45.867 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:45.868 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:33:45.868 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.868 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:33:45.868 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.868 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:33:45.868 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:33:45.868 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:45.868 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:45.868 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.868 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:45.868 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:33:45.868 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:45.869 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.869 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.869 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:45.869 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:33:45.869 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:45.869 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:45.869 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:45.869 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.869 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:33:45.869 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:33:45.869 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:45.869 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:45.869 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:45.870 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.870 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.870 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:33:45.870 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:33:45.870 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:45.870 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:45.870 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.870 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:45.870 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:33:45.870 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:45.870 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.870 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.870 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:45.871 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:33:45.871 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:45.871 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:45.871 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:45.871 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.871 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:33:45.871 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:33:45.871 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:45.871 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:45.871 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:45.871 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.871 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.871 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:33:45.871 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:33:45.872 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:45.872 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:45.872 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.872 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:45.872 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:33:45.872 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:45.872 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.872 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.872 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:45.872 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:33:45.872 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:45.872 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:45.872 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:45.873 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.873 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:33:45.873 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:33:45.873 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:45.873 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:45.873 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:45.873 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:45.873 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:45.873 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.873 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:33:45.873 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:33:45.873 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.873 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:45.874 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:45.874 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:33:45.874 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:45.874 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:45.874 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:33:45.874 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:45.874 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:45.874 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:45.874 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:33:45.874 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:45.874 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:45.874 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:45.874 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:33:45.874 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:33:45.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.863+0000 7f56b8959640 1 -- 172.21.15.100:0/2136931743 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f569406bf30 msgr2=0x7f569406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:45.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.863+0000 7f56b8959640 1 --2- 172.21.15.100:0/2136931743 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f569406bf30 0x7f569406e3f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f56b4070270 tx=0x7f56a8006040 comp rx=0 tx=0).stop 2024-09-11T22:33:45.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.863+0000 7f56b2d9d640 1 -- 172.21.15.100:0/2136931743 reap_dead start 2024-09-11T22:33:45.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.863+0000 7f56b8959640 1 -- 172.21.15.100:0/2136931743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b406be80 msgr2=0x7f56b41f8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:45.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.863+0000 7f56b8959640 1 --2- 172.21.15.100:0/2136931743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b406be80 0x7f56b41f8de0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f56a4001840 tx=0x7f56a4001120 comp rx=0 tx=0).stop 2024-09-11T22:33:45.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.863+0000 7f56b8959640 1 -- 172.21.15.100:0/2136931743 shutdown_connections 2024-09-11T22:33:45.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.863+0000 7f56b8959640 1 --2- 172.21.15.100:0/2136931743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b406be80 0x7f56b41f8de0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:45.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.863+0000 7f56b8959640 1 -- 172.21.15.100:0/2136931743 >> 172.21.15.100:0/2136931743 conn(0x7f56b406f360 msgr2=0x7f56b406f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:45.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.869+0000 7f56b8959640 1 -- 172.21.15.100:0/2136931743 shutdown_connections 2024-09-11T22:33:45.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:45.871+0000 7f56b8959640 1 -- 172.21.15.100:0/2136931743 wait complete. 2024-09-11T22:33:45.895 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:33:45.895 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:33:45.895 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:33:46.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.079+0000 7f8a94e4c640 1 Processor -- start 2024-09-11T22:33:46.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.079+0000 7f8a94e4c640 1 -- start start 2024-09-11T22:33:46.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.080+0000 7f8a94e4c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a900726c0 0x7f8a90151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:46.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.080+0000 7f8a94e4c640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a90072aa0 con 0x7f8a90072f30 2024-09-11T22:33:46.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.080+0000 7f8a94e4c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a90073bf0 con 0x7f8a900c3c60 2024-09-11T22:33:46.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.080+0000 7f8a94e4c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8a90151eb0 con 0x7f8a900726c0 2024-09-11T22:33:46.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.081+0000 7f8a8e59c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a900726c0 0x7f8a90151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:46.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.081+0000 7f8a8dd9b640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f8a900c3c60 0x7f8a901576c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:57652/0 (socket says 172.21.15.100:57652) 2024-09-11T22:33:46.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.081+0000 7f8a8dd9b640 1 -- 172.21.15.100:0/1761926466 learned_addr learned my addr 172.21.15.100:0/1761926466 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:33:46.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.081+0000 7f8a8d59a640 1 -- 172.21.15.100:0/1761926466 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 705959364 0 0) 0x7f8a90073bf0 con 0x7f8a900c3c60 2024-09-11T22:33:46.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.081+0000 7f8a8d59a640 1 -- 172.21.15.100:0/1761926466 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a78003520 con 0x7f8a900c3c60 2024-09-11T22:33:46.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.082+0000 7f8a8d59a640 1 -- 172.21.15.100:0/1761926466 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 854675156 0 0) 0x7f8a90072aa0 con 0x7f8a90072f30 2024-09-11T22:33:46.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.082+0000 7f8a8d59a640 1 -- 172.21.15.100:0/1761926466 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a90073bf0 con 0x7f8a90072f30 2024-09-11T22:33:46.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.082+0000 7f8a8e59c640 1 -- 172.21.15.100:0/1761926466 >> v1:172.21.15.167:6789/0 conn(0x7f8a900c3c60 legacy=0x7f8a901576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:46.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.082+0000 7f8a8d59a640 1 -- 172.21.15.100:0/1761926466 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1238200024 0 0) 0x7f8a78003520 con 0x7f8a900c3c60 2024-09-11T22:33:46.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.082+0000 7f8a8e59c640 1 -- 172.21.15.100:0/1761926466 >> v1:172.21.15.100:6789/0 conn(0x7f8a90072f30 legacy=0x7f8a90067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:46.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.082+0000 7f8a8e59c640 1 -- 172.21.15.100:0/1761926466 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9015df90 con 0x7f8a900726c0 2024-09-11T22:33:46.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.086+0000 7f8a8e59c640 1 --2- 172.21.15.100:0/1761926466 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a900726c0 0x7f8a90151970 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009750 tx=0x7f8a8402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68e83ba6a9a9257b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:46.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.093+0000 7f8a8d59a640 1 -- 172.21.15.100:0/1761926466 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a84037070 con 0x7f8a900726c0 2024-09-11T22:33:46.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.093+0000 7f8a8d59a640 1 -- 172.21.15.100:0/1761926466 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a8402acd0 con 0x7f8a900726c0 2024-09-11T22:33:46.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.093+0000 7f8a8d59a640 1 -- 172.21.15.100:0/1761926466 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a880019f0 con 0x7f8a900726c0 2024-09-11T22:33:46.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.097+0000 7f8a94e4c640 1 -- 172.21.15.100:0/1761926466 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a900726c0 msgr2=0x7f8a90151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:46.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.097+0000 7f8a94e4c640 1 --2- 172.21.15.100:0/1761926466 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a900726c0 0x7f8a90151970 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009750 tx=0x7f8a8402a1c0 comp rx=0 tx=0).stop 2024-09-11T22:33:46.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.098+0000 7f8a94e4c640 1 -- 172.21.15.100:0/1761926466 shutdown_connections 2024-09-11T22:33:46.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.098+0000 7f8a94e4c640 1 --2- 172.21.15.100:0/1761926466 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a900726c0 0x7f8a90151970 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.098+0000 7f8a94e4c640 1 -- 172.21.15.100:0/1761926466 >> 172.21.15.100:0/1761926466 conn(0x7f8a9006ee80 msgr2=0x7f8a90070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:46.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.098+0000 7f8a94e4c640 1 -- 172.21.15.100:0/1761926466 shutdown_connections 2024-09-11T22:33:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.100+0000 7f8a94e4c640 1 -- 172.21.15.100:0/1761926466 wait complete. 2024-09-11T22:33:46.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.102+0000 7f8a94e4c640 1 Processor -- start 2024-09-11T22:33:46.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.102+0000 7f8a94e4c640 1 -- start start 2024-09-11T22:33:46.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.103+0000 7f8a94e4c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a900726c0 0x7f8a90150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:46.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.103+0000 7f8a8e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a900726c0 0x7f8a90150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:46.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.103+0000 7f8a8e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a900726c0 0x7f8a90150ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57886/0 (socket says 172.21.15.100:57886) 2024-09-11T22:33:46.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.104+0000 7f8a8e59c640 1 -- 172.21.15.100:0/1533792339 learned_addr learned my addr 172.21.15.100:0/1533792339 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:33:46.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.104+0000 7f8a94e4c640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a90072f30 0x7f8a90150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:46.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.104+0000 7f8a94e4c640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a900c3c60 0x7f8a9014b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:46.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.104+0000 7f8a94e4c640 1 -- 172.21.15.100:0/1533792339 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8a900c9f60 con 0x7f8a900726c0 2024-09-11T22:33:46.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.104+0000 7f8a94e4c640 1 -- 172.21.15.100:0/1533792339 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a900ca3f0 con 0x7f8a90072f30 2024-09-11T22:33:46.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.104+0000 7f8a94e4c640 1 -- 172.21.15.100:0/1533792339 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8a900741b0 con 0x7f8a900c3c60 2024-09-11T22:33:46.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.104+0000 7f8a8dd9b640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a90072f30 0x7f8a90150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:46.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.104+0000 7f8a8ed9d640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a900c3c60 0x7f8a9014b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:46.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.105+0000 7f8a8e59c640 1 -- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a900c3c60 msgr2=0x7f8a9014b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:46.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.105+0000 7f8a8e59c640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a900c3c60 0x7f8a9014b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:46.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.105+0000 7f8a8e59c640 1 -- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a90072f30 msgr2=0x7f8a90150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:46.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.105+0000 7f8a8e59c640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a90072f30 0x7f8a90150610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:46.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.105+0000 7f8a8e59c640 1 -- 172.21.15.100:0/1533792339 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a9014f310 con 0x7f8a900726c0 2024-09-11T22:33:46.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.105+0000 7f8a8e59c640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a900726c0 0x7f8a90150ce0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009870 tx=0x7f8a840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:46.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.106+0000 7f8a8dd9b640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a90072f30 0x7f8a90150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:33:46.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.106+0000 7f8a8ed9d640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a900c3c60 0x7f8a9014b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:33:46.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.106+0000 7f8a7effd640 1 -- 172.21.15.100:0/1533792339 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a84040020 con 0x7f8a900726c0 2024-09-11T22:33:46.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.106+0000 7f8a94e4c640 1 -- 172.21.15.100:0/1533792339 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a9014cee0 con 0x7f8a900726c0 2024-09-11T22:33:46.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.106+0000 7f8a94e4c640 1 -- 172.21.15.100:0/1533792339 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a9014be20 con 0x7f8a900726c0 2024-09-11T22:33:46.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.108+0000 7f8a7effd640 1 -- 172.21.15.100:0/1533792339 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a84038040 con 0x7f8a900726c0 2024-09-11T22:33:46.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.108+0000 7f8a7effd640 1 -- 172.21.15.100:0/1533792339 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a84037070 con 0x7f8a900726c0 2024-09-11T22:33:46.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.108+0000 7f8a94e4c640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a90158330 0x7f8a9013bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:46.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.108+0000 7f8a94e4c640 1 -- 172.21.15.100:0/1533792339 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8a9014c020 con 0x7f8a90158330 2024-09-11T22:33:46.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.109+0000 7f8a8dd9b640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a90158330 0x7f8a9013bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:46.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.110+0000 7f8a7effd640 1 -- 172.21.15.100:0/1533792339 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a84043020 con 0x7f8a900726c0 2024-09-11T22:33:46.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.110+0000 7f8a7effd640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8a7006bf00 0x7f8a7006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:46.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.110+0000 7f8a8dd9b640 1 -- 172.21.15.100:0/1533792339 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a900c9910 con 0x7f8a90158330 2024-09-11T22:33:46.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.110+0000 7f8a7effd640 1 -- 172.21.15.100:0/1533792339 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f8a840aae80 con 0x7f8a900726c0 2024-09-11T22:33:46.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.111+0000 7f8a8ed9d640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8a7006bf00 0x7f8a7006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:46.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.112+0000 7f8a8ed9d640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8a7006bf00 0x7f8a7006e3c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8a800011e0 tx=0x7f8a80009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:46.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.113+0000 7f8a8dd9b640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a90158330 0x7f8a9013bba0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8a88001460 tx=0x7f8a8800def0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:46.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.116+0000 7f8a7effd640 1 -- 172.21.15.100:0/1533792339 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a88018070 con 0x7f8a90158330 2024-09-11T22:33:46.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.116+0000 7f8a7effd640 1 -- 172.21.15.100:0/1533792339 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8a8800b7b0 con 0x7f8a90158330 2024-09-11T22:33:46.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.116+0000 7f8a7effd640 1 -- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a90158330 msgr2=0x7f8a9013bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:46.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.116+0000 7f8a7effd640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a90158330 0x7f8a9013bba0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8a88001460 tx=0x7f8a8800def0 comp rx=0 tx=0).stop 2024-09-11T22:33:46.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.116+0000 7f8a7effd640 1 -- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a90158330 msgr2=0x7f8a9013bba0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:33:46.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.116+0000 7f8a7effd640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a90158330 0x7f8a9013bba0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:46.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.138+0000 7f8a94e4c640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a9014d8b0 0x7f8a9013c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:46.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.138+0000 7f8a94e4c640 1 -- 172.21.15.100:0/1533792339 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8a90072d10 con 0x7f8a9014d8b0 2024-09-11T22:33:46.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.140+0000 7f8a8dd9b640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a9014d8b0 0x7f8a9013c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:46.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.141+0000 7f8a8dd9b640 1 -- 172.21.15.100:0/1533792339 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8a9014cc20 con 0x7f8a9014d8b0 2024-09-11T22:33:46.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.142+0000 7f8a8dd9b640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a9014d8b0 0x7f8a9013c0e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8a88012000 tx=0x7f8a880014d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:46.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.142+0000 7f8a7effd640 1 -- 172.21.15.100:0/1533792339 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a88018040 con 0x7f8a9014d8b0 2024-09-11T22:33:46.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.143+0000 7f8a7effd640 1 -- 172.21.15.100:0/1533792339 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7f8a880070d0 con 0x7f8a9014d8b0 2024-09-11T22:33:46.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.143+0000 7f8a7effd640 1 -- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a9014d8b0 msgr2=0x7f8a9013c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:46.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.143+0000 7f8a7effd640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a9014d8b0 0x7f8a9013c0e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8a88012000 tx=0x7f8a880014d0 comp rx=0 tx=0).stop 2024-09-11T22:33:46.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.143+0000 7f8a7effd640 1 -- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a9014d8b0 msgr2=0x7f8a9013c0e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:33:46.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.143+0000 7f8a7effd640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a9014d8b0 0x7f8a9013c0e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:46.149 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:33:46.149 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:33:46.149 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:33:46.149 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:33:46.149 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 98, 2024-09-11T22:33:46.149 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 716863, 2024-09-11T22:33:46.149 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:33:46.149 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:33:46.149 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:33:46.149 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:33:46.149 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:46.149 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 2, 2024-09-11T22:33:46.150 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:33:46.150 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:33:46.150 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:33:46.150 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:46.150 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:46.150 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:46.150 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:46.150 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:46.150 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:46.150 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:46.150 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:46.150 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:46.150 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:46.151 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:46.151 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:46.151 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:33:46.151 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:33:46.151 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:46.151 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:46.151 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:46.151 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:46.151 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:46.151 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:46.151 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:46.151 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:46.151 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:46.152 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:46.152 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:46.152 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:46.152 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:46.152 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:33:46.152 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:33:46.152 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:33:46.152 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:33:46.152 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:33:46.152 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:33:46.152 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:33:46.152 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:33:46.152 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:33:46.153 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:33:46.153 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:33:46.153 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:33:46.153 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:33:46.153 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:33:46.153 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:33:46.153 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:33:46.153 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:33:46.153 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:46.153 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:46.153 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:46.153 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:46.153 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:46.153 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:46.154 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:46.154 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:46.154 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:46.154 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:46.154 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:46.154 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:46.154 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:33:46.154 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:46.154 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:33:46.154 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:46.154 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:33:46.154 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:33:46.154 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:46.154 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:46.155 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:46.155 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:46.155 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:33:46.155 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:46.155 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:46.155 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:46.155 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:46.155 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:33:46.155 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:46.155 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:46.155 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:46.155 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:46.155 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:33:46.155 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:33:46.156 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:46.156 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:46.156 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:46.156 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:46.156 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:46.156 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:33:46.156 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:33:46.156 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:46.156 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:46.156 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:46.157 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:46.157 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:33:46.157 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:46.157 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:46.157 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:46.157 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:46.157 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:33:46.157 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:46.157 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:46.157 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:46.157 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:46.157 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:33:46.158 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:33:46.158 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:46.158 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:46.158 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:46.158 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:46.158 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:46.158 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:33:46.158 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:33:46.158 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:46.158 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:46.158 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:46.158 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:46.158 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:33:46.158 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:46.159 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:46.159 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:46.159 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:46.159 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:33:46.159 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:46.159 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:46.159 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:46.159 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:46.159 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:33:46.159 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:33:46.159 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:46.159 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:46.159 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:46.160 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:46.160 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:46.160 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:46.160 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:33:46.160 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:33:46.160 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:46.160 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:46.160 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:46.160 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:33:46.160 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:46.160 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:46.160 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:33:46.160 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:46.161 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:46.161 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:46.161 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:33:46.161 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:46.161 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:46.161 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:33:46.161 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:46.161 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:46.161 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:46.161 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:33:46.162 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:46.162 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:46.162 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:33:46.162 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:46.162 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:46.162 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:46.162 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4 2024-09-11T22:33:46.162 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:46.162 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:46.162 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:33:46.162 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:46.162 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:46.162 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:46.163 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:33:46.163 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:46.163 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:46.163 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:46.163 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:33:46.163 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:33:46.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.147+0000 7f8a94e4c640 1 -- 172.21.15.100:0/1533792339 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8a7006bf00 msgr2=0x7f8a7006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:46.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.147+0000 7f8a94e4c640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8a7006bf00 0x7f8a7006e3c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8a800011e0 tx=0x7f8a80009040 comp rx=0 tx=0).stop 2024-09-11T22:33:46.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.148+0000 7f8a8ed9d640 1 -- 172.21.15.100:0/1533792339 reap_dead start 2024-09-11T22:33:46.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.148+0000 7f8a94e4c640 1 -- 172.21.15.100:0/1533792339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a900726c0 msgr2=0x7f8a90150ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:46.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.148+0000 7f8a94e4c640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a900726c0 0x7f8a90150ce0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009870 tx=0x7f8a840046c0 comp rx=0 tx=0).stop 2024-09-11T22:33:46.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.148+0000 7f8a94e4c640 1 -- 172.21.15.100:0/1533792339 shutdown_connections 2024-09-11T22:33:46.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.148+0000 7f8a94e4c640 1 --2- 172.21.15.100:0/1533792339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a900726c0 0x7f8a90150ce0 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009870 tx=0x7f8a840046c0 comp rx=0 tx=0).stop 2024-09-11T22:33:46.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.148+0000 7f8a94e4c640 1 -- 172.21.15.100:0/1533792339 >> 172.21.15.100:0/1533792339 conn(0x7f8a9006ee80 msgr2=0x7f8a900c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:46.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.151+0000 7f8a94e4c640 1 -- 172.21.15.100:0/1533792339 shutdown_connections 2024-09-11T22:33:46.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.152+0000 7f8a94e4c640 1 -- 172.21.15.100:0/1533792339 wait complete. 2024-09-11T22:33:46.177 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:33:46.177 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-11T22:33:46.178 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-11T22:33:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.394+0000 7f9ee35d6640 1 Processor -- start 2024-09-11T22:33:46.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.394+0000 7f9ee35d6640 1 -- start start 2024-09-11T22:33:46.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.395+0000 7f9ee35d6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9edc153ec0 0x7f9edc072c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:46.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.395+0000 7f9ee35d6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9edc06c1a0 0x7f9edc06c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:46.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.395+0000 7f9ee35d6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9edc156c90 0x7f9edc1570a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:46.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.395+0000 7f9ee35d6640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f9edc0c1000 con 0x7f9edc153ec0 2024-09-11T22:33:46.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.395+0000 7f9ee35d6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f9edc073570 con 0x7f9edc06c1a0 2024-09-11T22:33:46.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.395+0000 7f9ee35d6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9edc159eb0 con 0x7f9edc156c90 2024-09-11T22:33:46.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.396+0000 7f9ee1372640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9edc153ec0 0x7f9edc072c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:46.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.396+0000 7f9ee1372640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9edc153ec0 0x7f9edc072c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57890/0 (socket says 172.21.15.100:57890) 2024-09-11T22:33:46.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.396+0000 7f9ee1372640 1 -- 172.21.15.100:0/1278772883 learned_addr learned my addr 172.21.15.100:0/1278772883 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:33:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.396+0000 7f9ee1372640 1 -- 172.21.15.100:0/1278772883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9edc156c90 msgr2=0x7f9edc1570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.396+0000 7f9ee1372640 1 --2- 172.21.15.100:0/1278772883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9edc156c90 0x7f9edc1570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.396+0000 7f9ee1372640 1 -- 172.21.15.100:0/1278772883 >> v2:172.21.15.167:3300/0 conn(0x7f9edc06c1a0 msgr2=0x7f9edc06c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.396+0000 7f9ee1372640 1 --2- 172.21.15.100:0/1278772883 >> v2:172.21.15.167:3300/0 conn(0x7f9edc06c1a0 0x7f9edc06c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.396+0000 7f9ee1372640 1 -- 172.21.15.100:0/1278772883 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc15a190 con 0x7f9edc153ec0 2024-09-11T22:33:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.398+0000 7f9ee1372640 1 --2- 172.21.15.100:0/1278772883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9edc153ec0 0x7f9edc072c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0c9e20 tx=0x7f9ecc02e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1adde6f556863 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:46.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.398+0000 7f9ed3fff640 1 -- 172.21.15.100:0/1278772883 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc039020 con 0x7f9edc153ec0 2024-09-11T22:33:46.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.398+0000 7f9ed3fff640 1 -- 172.21.15.100:0/1278772883 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ecc035800 con 0x7f9edc153ec0 2024-09-11T22:33:46.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.398+0000 7f9ed3fff640 1 -- 172.21.15.100:0/1278772883 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc035c10 con 0x7f9edc153ec0 2024-09-11T22:33:46.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.405+0000 7f9ee35d6640 1 -- 172.21.15.100:0/1278772883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9edc153ec0 msgr2=0x7f9edc072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:46.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.405+0000 7f9ee35d6640 1 --2- 172.21.15.100:0/1278772883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9edc153ec0 0x7f9edc072c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0c9e20 tx=0x7f9ecc02e990 comp rx=0 tx=0).stop 2024-09-11T22:33:46.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.410+0000 7f9ee35d6640 1 -- 172.21.15.100:0/1278772883 shutdown_connections 2024-09-11T22:33:46.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.410+0000 7f9ee35d6640 1 --2- 172.21.15.100:0/1278772883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9edc156c90 0x7f9edc1570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:46.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.410+0000 7f9ee35d6640 1 --2- 172.21.15.100:0/1278772883 >> v2:172.21.15.167:3300/0 conn(0x7f9edc06c1a0 0x7f9edc06c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:46.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.410+0000 7f9ee35d6640 1 --2- 172.21.15.100:0/1278772883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9edc153ec0 0x7f9edc072c80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:46.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.410+0000 7f9ee35d6640 1 -- 172.21.15.100:0/1278772883 >> 172.21.15.100:0/1278772883 conn(0x7f9edc0cbf70 msgr2=0x7f9edc0cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:46.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.412+0000 7f9ee35d6640 1 -- 172.21.15.100:0/1278772883 shutdown_connections 2024-09-11T22:33:46.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.416+0000 7f9ee35d6640 1 -- 172.21.15.100:0/1278772883 wait complete. 2024-09-11T22:33:46.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.418+0000 7f9ee35d6640 1 Processor -- start 2024-09-11T22:33:46.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.418+0000 7f9ee35d6640 1 -- start start 2024-09-11T22:33:46.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.419+0000 7f9ee35d6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9edc06c1a0 0x7f9edc155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:46.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.419+0000 7f9ee35d6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9edc153ec0 0x7f9edc152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:46.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.419+0000 7f9ee35d6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9edc156c90 0x7f9edc152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:46.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.420+0000 7f9ee0b71640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9edc153ec0 0x7f9edc152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:46.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.420+0000 7f9ee0b71640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9edc153ec0 0x7f9edc152730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:59126/0 (socket says 172.21.15.100:59126) 2024-09-11T22:33:46.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.420+0000 7f9ee1b73640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9edc156c90 0x7f9edc152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:46.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.420+0000 7f9ee1b73640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9edc156c90 0x7f9edc152c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57906/0 (socket says 172.21.15.100:57906) 2024-09-11T22:33:46.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.420+0000 7f9ee0b71640 1 -- 172.21.15.100:0/4202414337 learned_addr learned my addr 172.21.15.100:0/4202414337 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:33:46.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.420+0000 7f9ee35d6640 1 -- 172.21.15.100:0/4202414337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc15aa30 con 0x7f9edc156c90 2024-09-11T22:33:46.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.420+0000 7f9ee35d6640 1 -- 172.21.15.100:0/4202414337 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc15a750 con 0x7f9edc153ec0 2024-09-11T22:33:46.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.420+0000 7f9ee35d6640 1 -- 172.21.15.100:0/4202414337 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9edc15ad10 con 0x7f9edc06c1a0 2024-09-11T22:33:46.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.421+0000 7f9ee1372640 1 --2- 172.21.15.100:0/4202414337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9edc06c1a0 0x7f9edc155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:46.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.421+0000 7f9ee1b73640 1 -- 172.21.15.100:0/4202414337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9edc06c1a0 msgr2=0x7f9edc155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:46.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.421+0000 7f9ee1b73640 1 --2- 172.21.15.100:0/4202414337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9edc06c1a0 0x7f9edc155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:46.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.421+0000 7f9ee1b73640 1 -- 172.21.15.100:0/4202414337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9edc153ec0 msgr2=0x7f9edc152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:46.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.421+0000 7f9ee1b73640 1 --2- 172.21.15.100:0/4202414337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9edc153ec0 0x7f9edc152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:46.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.421+0000 7f9ee1b73640 1 -- 172.21.15.100:0/4202414337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc1ecab0 con 0x7f9edc156c90 2024-09-11T22:33:46.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.422+0000 7f9ee1b73640 1 --2- 172.21.15.100:0/4202414337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9edc156c90 0x7f9edc152c70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400be20 tx=0x7f9ed400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:46.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.422+0000 7f9ed1ffb640 1 -- 172.21.15.100:0/4202414337 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4019070 con 0x7f9edc156c90 2024-09-11T22:33:46.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.423+0000 7f9ed1ffb640 1 -- 172.21.15.100:0/4202414337 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed400ce10 con 0x7f9edc156c90 2024-09-11T22:33:46.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.423+0000 7f9ed1ffb640 1 -- 172.21.15.100:0/4202414337 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4014680 con 0x7f9edc156c90 2024-09-11T22:33:46.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.425+0000 7f9ee35d6640 1 -- 172.21.15.100:0/4202414337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9edc1f01a0 con 0x7f9edc156c90 2024-09-11T22:33:46.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.425+0000 7f9ee35d6640 1 -- 172.21.15.100:0/4202414337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9edc1ef3e0 con 0x7f9edc156c90 2024-09-11T22:33:46.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.427+0000 7f9ed1ffb640 1 -- 172.21.15.100:0/4202414337 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ed401c070 con 0x7f9edc156c90 2024-09-11T22:33:46.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.428+0000 7f9ed1ffb640 1 --2- 172.21.15.100:0/4202414337 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9ec006beb0 0x7f9ec006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:46.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.429+0000 7f9ed1ffb640 1 -- 172.21.15.100:0/4202414337 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f9ed408ada0 con 0x7f9edc156c90 2024-09-11T22:33:46.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.429+0000 7f9ee1372640 1 --2- 172.21.15.100:0/4202414337 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9ec006beb0 0x7f9ec006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:46.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.430+0000 7f9ee1372640 1 --2- 172.21.15.100:0/4202414337 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9ec006beb0 0x7f9ec006e370 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc03a000 tx=0x7f9ecc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:46.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.430+0000 7f9ee35d6640 1 -- 172.21.15.100:0/4202414337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9edc074110 con 0x7f9edc156c90 2024-09-11T22:33:46.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.439+0000 7f9ed1ffb640 1 -- 172.21.15.100:0/4202414337 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ed4058d60 con 0x7f9edc156c90 2024-09-11T22:33:47.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:46.992+0000 7f9ee35d6640 1 -- 172.21.15.100:0/4202414337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f9edc158da0 con 0x7f9edc156c90 2024-09-11T22:33:47.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:47.008+0000 7f9ed1ffb640 1 -- 172.21.15.100:0/4202414337 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f9ed405d060 con 0x7f9edc156c90 2024-09-11T22:33:47.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:47.020+0000 7f9ee35d6640 1 -- 172.21.15.100:0/4202414337 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9ec006beb0 msgr2=0x7f9ec006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:47.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:47.020+0000 7f9ee35d6640 1 --2- 172.21.15.100:0/4202414337 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9ec006beb0 0x7f9ec006e370 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc03a000 tx=0x7f9ecc008040 comp rx=0 tx=0).stop 2024-09-11T22:33:47.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:47.020+0000 7f9ee35d6640 1 -- 172.21.15.100:0/4202414337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9edc156c90 msgr2=0x7f9edc152c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:47.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:47.020+0000 7f9ee35d6640 1 --2- 172.21.15.100:0/4202414337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9edc156c90 0x7f9edc152c70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400be20 tx=0x7f9ed400bf10 comp rx=0 tx=0).stop 2024-09-11T22:33:47.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:47.023+0000 7f9ee35d6640 1 -- 172.21.15.100:0/4202414337 shutdown_connections 2024-09-11T22:33:47.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:47.023+0000 7f9ee35d6640 1 --2- 172.21.15.100:0/4202414337 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9ec006beb0 0x7f9ec006e370 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:47.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:47.023+0000 7f9ee35d6640 1 --2- 172.21.15.100:0/4202414337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9edc156c90 0x7f9edc152c70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:47.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:47.023+0000 7f9ee35d6640 1 --2- 172.21.15.100:0/4202414337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9edc153ec0 0x7f9edc152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:47.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:47.023+0000 7f9ee35d6640 1 --2- 172.21.15.100:0/4202414337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9edc06c1a0 0x7f9edc155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:47.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:47.023+0000 7f9ee35d6640 1 -- 172.21.15.100:0/4202414337 >> 172.21.15.100:0/4202414337 conn(0x7f9edc0cbf70 msgr2=0x7f9edc0c1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:47.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:47.026+0000 7f9ee35d6640 1 -- 172.21.15.100:0/4202414337 shutdown_connections 2024-09-11T22:33:47.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:47.026+0000 7f9ee35d6640 1 -- 172.21.15.100:0/4202414337 wait complete. 2024-09-11T22:33:47.053 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-11T22:33:55.738 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:33:55.742 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:33:57.053 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:33:57.054 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:33:57.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.239+0000 7f0533fff640 1 Processor -- start 2024-09-11T22:33:57.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.239+0000 7f0533fff640 1 -- start start 2024-09-11T22:33:57.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.240+0000 7f0533fff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f053406f930 0x7f053415eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:57.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.240+0000 7f0533fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f05340c2d90 0x7f05340c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:57.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.240+0000 7f0533fff640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05340c0ee0 con 0x7f0534158ee0 2024-09-11T22:33:57.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.240+0000 7f0533fff640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f05340c1150 con 0x7f05340c2d90 2024-09-11T22:33:57.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.240+0000 7f0533fff640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f05340c1430 con 0x7f053406f930 2024-09-11T22:33:57.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.241+0000 7f05337fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f05340c2d90 0x7f05340c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:57.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.241+0000 7f05337fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f05340c2d90 0x7f05340c21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53026/0 (socket says 172.21.15.100:53026) 2024-09-11T22:33:57.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.241+0000 7f05337fe640 1 -- 172.21.15.100:0/1818035563 learned_addr learned my addr 172.21.15.100:0/1818035563 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:33:57.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.243+0000 7f05327fc640 1 --2- 172.21.15.100:0/1818035563 >> v2:172.21.15.167:3300/0 conn(0x7f053406f930 0x7f053415eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:57.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.245+0000 7f05337fe640 1 -- 172.21.15.100:0/1818035563 >> v2:172.21.15.167:3300/0 conn(0x7f053406f930 msgr2=0x7f053415eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:57.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.245+0000 7f05337fe640 1 --2- 172.21.15.100:0/1818035563 >> v2:172.21.15.167:3300/0 conn(0x7f053406f930 0x7f053415eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:57.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.246+0000 7f05337fe640 1 -- 172.21.15.100:0/1818035563 >> v1:172.21.15.167:6789/0 conn(0x7f0534158ee0 legacy=0x7f05340c7830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:33:57.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.246+0000 7f05337fe640 1 -- 172.21.15.100:0/1818035563 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05340c1710 con 0x7f05340c2d90 2024-09-11T22:33:57.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.247+0000 7f05337fe640 1 --2- 172.21.15.100:0/1818035563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05340c2d90 0x7f05340c21f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f052c009e50 tx=0x7f052c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6464066b34344b26 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:57.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.247+0000 7f0531ffb640 1 -- 172.21.15.100:0/1818035563 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c036070 con 0x7f05340c2d90 2024-09-11T22:33:57.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.247+0000 7f0531ffb640 1 -- 172.21.15.100:0/1818035563 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f052c031600 con 0x7f05340c2d90 2024-09-11T22:33:57.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.248+0000 7f0533fff640 1 -- 172.21.15.100:0/1818035563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05340c2d90 msgr2=0x7f05340c21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:57.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.248+0000 7f0533fff640 1 --2- 172.21.15.100:0/1818035563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05340c2d90 0x7f05340c21f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f052c009e50 tx=0x7f052c02a730 comp rx=0 tx=0).stop 2024-09-11T22:33:57.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.252+0000 7f0533fff640 1 -- 172.21.15.100:0/1818035563 shutdown_connections 2024-09-11T22:33:57.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.252+0000 7f0533fff640 1 --2- 172.21.15.100:0/1818035563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05340c2d90 0x7f05340c21f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:57.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.252+0000 7f0533fff640 1 --2- 172.21.15.100:0/1818035563 >> v2:172.21.15.167:3300/0 conn(0x7f053406f930 0x7f053415eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:57.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.252+0000 7f0533fff640 1 -- 172.21.15.100:0/1818035563 >> 172.21.15.100:0/1818035563 conn(0x7f053406ee10 msgr2=0x7f053406f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:57.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.259+0000 7f0533fff640 1 -- 172.21.15.100:0/1818035563 shutdown_connections 2024-09-11T22:33:57.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.260+0000 7f0533fff640 1 -- 172.21.15.100:0/1818035563 wait complete. 2024-09-11T22:33:57.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.261+0000 7f0533fff640 1 Processor -- start 2024-09-11T22:33:57.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.262+0000 7f0533fff640 1 -- start start 2024-09-11T22:33:57.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.263+0000 7f0533fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f053406f930 0x7f05341420f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:57.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.263+0000 7f0533fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05340c2d90 0x7f05340c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:57.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.263+0000 7f0533fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0534158ee0 0x7f05341417f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:57.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.263+0000 7f0533fff640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f05341592c0 con 0x7f0534158ee0 2024-09-11T22:33:57.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.263+0000 7f0533fff640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f05340c1cd0 con 0x7f05340c2d90 2024-09-11T22:33:57.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.263+0000 7f0533fff640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f053406e6f0 con 0x7f053406f930 2024-09-11T22:33:57.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.265+0000 7f05337fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0534158ee0 0x7f05341417f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:57.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.265+0000 7f05337fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0534158ee0 0x7f05341417f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53038/0 (socket says 172.21.15.100:53038) 2024-09-11T22:33:57.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.265+0000 7f05337fe640 1 -- 172.21.15.100:0/162838667 learned_addr learned my addr 172.21.15.100:0/162838667 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:33:57.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.266+0000 7f0532ffd640 1 --2- 172.21.15.100:0/162838667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f053406f930 0x7f05341420f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:57.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.266+0000 7f05327fc640 1 --2- 172.21.15.100:0/162838667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05340c2d90 0x7f05340c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:57.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.266+0000 7f05337fe640 1 -- 172.21.15.100:0/162838667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f053406f930 msgr2=0x7f05341420f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:57.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.266+0000 7f05337fe640 1 --2- 172.21.15.100:0/162838667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f053406f930 0x7f05341420f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:57.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.266+0000 7f05337fe640 1 -- 172.21.15.100:0/162838667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05340c2d90 msgr2=0x7f05340c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:57.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.266+0000 7f05337fe640 1 --2- 172.21.15.100:0/162838667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05340c2d90 0x7f05340c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:57.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.266+0000 7f05337fe640 1 -- 172.21.15.100:0/162838667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05340c4cf0 con 0x7f0534158ee0 2024-09-11T22:33:57.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.267+0000 7f05337fe640 1 --2- 172.21.15.100:0/162838667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0534158ee0 0x7f05341417f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f052c02ad20 tx=0x7f052c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:57.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.271+0000 7f051b7fe640 1 -- 172.21.15.100:0/162838667 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c041020 con 0x7f0534158ee0 2024-09-11T22:33:57.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.271+0000 7f051b7fe640 1 -- 172.21.15.100:0/162838667 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f052c008e30 con 0x7f0534158ee0 2024-09-11T22:33:57.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.271+0000 7f051b7fe640 1 -- 172.21.15.100:0/162838667 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c036040 con 0x7f0534158ee0 2024-09-11T22:33:57.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.271+0000 7f0533fff640 1 -- 172.21.15.100:0/162838667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05341575e0 con 0x7f0534158ee0 2024-09-11T22:33:57.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.271+0000 7f0533fff640 1 -- 172.21.15.100:0/162838667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05341400b0 con 0x7f0534158ee0 2024-09-11T22:33:57.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.274+0000 7f051b7fe640 1 -- 172.21.15.100:0/162838667 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f052c044020 con 0x7f0534158ee0 2024-09-11T22:33:57.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.275+0000 7f051b7fe640 1 --2- 172.21.15.100:0/162838667 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f052006bf00 0x7f052006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:57.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.275+0000 7f0532ffd640 1 --2- 172.21.15.100:0/162838667 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f052006bf00 0x7f052006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:57.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.276+0000 7f051b7fe640 1 -- 172.21.15.100:0/162838667 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f052c0ac500 con 0x7f0534158ee0 2024-09-11T22:33:57.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.276+0000 7f0532ffd640 1 --2- 172.21.15.100:0/162838667 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f052006bf00 0x7f052006e3c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0524006fd0 tx=0x7f0524009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:57.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.279+0000 7f0533fff640 1 -- 172.21.15.100:0/162838667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0514005290 con 0x7f0534158ee0 2024-09-11T22:33:57.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.288+0000 7f051b7fe640 1 -- 172.21.15.100:0/162838667 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05341575e0 con 0x7f0534158ee0 2024-09-11T22:33:57.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.833+0000 7f0533fff640 1 -- 172.21.15.100:0/162838667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0514005580 con 0x7f0534158ee0 2024-09-11T22:33:57.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.834+0000 7f051b7fe640 1 -- 172.21.15.100:0/162838667 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f052c07a420 con 0x7f0534158ee0 2024-09-11T22:33:57.836 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":98,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:33:57.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.838+0000 7f0533fff640 1 -- 172.21.15.100:0/162838667 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f052006bf00 msgr2=0x7f052006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:57.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.838+0000 7f0533fff640 1 --2- 172.21.15.100:0/162838667 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f052006bf00 0x7f052006e3c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0524006fd0 tx=0x7f0524009060 comp rx=0 tx=0).stop 2024-09-11T22:33:57.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.838+0000 7f0533fff640 1 -- 172.21.15.100:0/162838667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0534158ee0 msgr2=0x7f05341417f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:57.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.838+0000 7f0533fff640 1 --2- 172.21.15.100:0/162838667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0534158ee0 0x7f05341417f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f052c02ad20 tx=0x7f052c004a40 comp rx=0 tx=0).stop 2024-09-11T22:33:57.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.838+0000 7f0533fff640 1 -- 172.21.15.100:0/162838667 shutdown_connections 2024-09-11T22:33:57.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.838+0000 7f0533fff640 1 --2- 172.21.15.100:0/162838667 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f052006bf00 0x7f052006e3c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:57.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.838+0000 7f0533fff640 1 --2- 172.21.15.100:0/162838667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0534158ee0 0x7f05341417f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:57.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.838+0000 7f0533fff640 1 --2- 172.21.15.100:0/162838667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f05340c2d90 0x7f05340c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:57.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.838+0000 7f0533fff640 1 --2- 172.21.15.100:0/162838667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f053406f930 0x7f05341420f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:57.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.838+0000 7f0533fff640 1 -- 172.21.15.100:0/162838667 >> 172.21.15.100:0/162838667 conn(0x7f053406ee10 msgr2=0x7f0534156ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:57.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.839+0000 7f0533fff640 1 -- 172.21.15.100:0/162838667 shutdown_connections 2024-09-11T22:33:57.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:57.839+0000 7f0533fff640 1 -- 172.21.15.100:0/162838667 wait complete. 2024-09-11T22:33:57.858 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:33:57.858 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-11T22:33:57.858 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:33:57.859 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:33:58.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.088+0000 7fac6447b640 1 Processor -- start 2024-09-11T22:33:58.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.088+0000 7fac6447b640 1 -- start start 2024-09-11T22:33:58.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.089+0000 7fac6447b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac5c070610 0x7fac5c0c9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.089+0000 7fac6447b640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac5c0b0f00 con 0x7fac5c152c70 2024-09-11T22:33:58.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.089+0000 7fac6447b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac5c0ca440 con 0x7fac5c0c9dd0 2024-09-11T22:33:58.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.089+0000 7fac6447b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fac5c153050 con 0x7fac5c070610 2024-09-11T22:33:58.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.090+0000 7fac62217640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fac5c152c70 0x7fac5c0ce160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:52082/0 (socket says 172.21.15.100:52082) 2024-09-11T22:33:58.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.090+0000 7fac62217640 1 -- 172.21.15.100:0/2891850406 learned_addr learned my addr 172.21.15.100:0/2891850406 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:33:58.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.090+0000 7fac61215640 1 -- 172.21.15.100:0/2891850406 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 383753860 0 0) 0x7fac5c0b0f00 con 0x7fac5c152c70 2024-09-11T22:33:58.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.090+0000 7fac61215640 1 -- 172.21.15.100:0/2891850406 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac48003520 con 0x7fac5c152c70 2024-09-11T22:33:58.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.091+0000 7fac61215640 1 -- 172.21.15.100:0/2891850406 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3075729854 0 0) 0x7fac48003520 con 0x7fac5c152c70 2024-09-11T22:33:58.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.091+0000 7fac61215640 1 -- 172.21.15.100:0/2891850406 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac5c070610 msgr2=0x7fac5c0c9820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:33:58.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.091+0000 7fac61215640 1 --2- 172.21.15.100:0/2891850406 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac5c070610 0x7fac5c0c9820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.091+0000 7fac61215640 1 -- 172.21.15.100:0/2891850406 >> v1:172.21.15.167:6789/0 conn(0x7fac5c0c9dd0 legacy=0x7fac5c06ff00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:33:58.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.091+0000 7fac61215640 1 -- 172.21.15.100:0/2891850406 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c0c33d0 con 0x7fac5c152c70 2024-09-11T22:33:58.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.091+0000 7fac61215640 1 -- 172.21.15.100:0/2891850406 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fac540019f0 con 0x7fac5c152c70 2024-09-11T22:33:58.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.091+0000 7fac61215640 1 -- 172.21.15.100:0/2891850406 >> v1:172.21.15.100:6789/0 conn(0x7fac5c152c70 legacy=0x7fac5c0ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.091+0000 7fac61215640 1 --2- 172.21.15.100:0/2891850406 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac5c070610 0x7fac480039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.091+0000 7fac61215640 1 --2- 172.21.15.100:0/2891850406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac48004140 0x7fac48004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.091+0000 7fac61215640 1 --2- 172.21.15.100:0/2891850406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac48004e10 0x7fac48005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.091+0000 7fac61215640 1 -- 172.21.15.100:0/2891850406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c153050 con 0x7fac48004e10 2024-09-11T22:33:58.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.091+0000 7fac61215640 1 -- 172.21.15.100:0/2891850406 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fac4802dd30 con 0x7fac48004140 2024-09-11T22:33:58.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.091+0000 7fac62217640 1 --2- 172.21.15.100:0/2891850406 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac5c070610 0x7fac480039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:58.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.091+0000 7fac61215640 1 -- 172.21.15.100:0/2891850406 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fac4802df30 con 0x7fac5c070610 2024-09-11T22:33:58.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.093+0000 7fac62217640 1 -- 172.21.15.100:0/2891850406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac48004140 msgr2=0x7fac48004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:58.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.093+0000 7fac62217640 1 --2- 172.21.15.100:0/2891850406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac48004140 0x7fac48004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.093+0000 7fac62217640 1 -- 172.21.15.100:0/2891850406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac48004e10 msgr2=0x7fac48005290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:33:58.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.093+0000 7fac62217640 1 --2- 172.21.15.100:0/2891850406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac48004e10 0x7fac48005290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.093+0000 7fac62217640 1 -- 172.21.15.100:0/2891850406 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac48003520 con 0x7fac5c070610 2024-09-11T22:33:58.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.094+0000 7fac62217640 1 --2- 172.21.15.100:0/2891850406 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac5c070610 0x7fac480039e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fac5400a7c0 tx=0x7fac48005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69eeaa944048bfaf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:58.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.098+0000 7fac61215640 1 -- 172.21.15.100:0/2891850406 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac5400a410 con 0x7fac5c070610 2024-09-11T22:33:58.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.098+0000 7fac61215640 1 -- 172.21.15.100:0/2891850406 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac54033070 con 0x7fac5c070610 2024-09-11T22:33:58.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.099+0000 7fac61215640 1 -- 172.21.15.100:0/2891850406 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac540386b0 con 0x7fac5c070610 2024-09-11T22:33:58.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.099+0000 7fac6447b640 1 -- 172.21.15.100:0/2891850406 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac5c070610 msgr2=0x7fac480039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.099+0000 7fac6447b640 1 --2- 172.21.15.100:0/2891850406 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac5c070610 0x7fac480039e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fac5400a7c0 tx=0x7fac48005830 comp rx=0 tx=0).stop 2024-09-11T22:33:58.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.099+0000 7fac62a18640 1 -- 172.21.15.100:0/2891850406 reap_dead start 2024-09-11T22:33:58.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.099+0000 7fac6447b640 1 -- 172.21.15.100:0/2891850406 shutdown_connections 2024-09-11T22:33:58.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.099+0000 7fac6447b640 1 -- 172.21.15.100:0/2891850406 >> 172.21.15.100:0/2891850406 conn(0x7fac5c06de20 msgr2=0x7fac5c06e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:58.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.101+0000 7fac6447b640 1 -- 172.21.15.100:0/2891850406 shutdown_connections 2024-09-11T22:33:58.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.101+0000 7fac6447b640 1 -- 172.21.15.100:0/2891850406 wait complete. 2024-09-11T22:33:58.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.102+0000 7fac6447b640 1 Processor -- start 2024-09-11T22:33:58.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.103+0000 7fac6447b640 1 -- start start 2024-09-11T22:33:58.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.104+0000 7fac6447b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac5c070610 0x7fac5c1372b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.107+0000 7fac6447b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac5c0c6630 0x7fac5c1377f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.107+0000 7fac6447b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac5c0c7c60 0x7fac5c0c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.107+0000 7fac6447b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c0c3990 con 0x7fac5c0c6630 2024-09-11T22:33:58.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.107+0000 7fac6447b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c0ca6e0 con 0x7fac5c0c7c60 2024-09-11T22:33:58.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.107+0000 7fac6447b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fac5c0ce870 con 0x7fac5c070610 2024-09-11T22:33:58.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.108+0000 7fac61a16640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac5c0c6630 0x7fac5c1377f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:58.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.108+0000 7fac61a16640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac5c0c6630 0x7fac5c1377f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53042/0 (socket says 172.21.15.100:53042) 2024-09-11T22:33:58.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.108+0000 7fac61a16640 1 -- 172.21.15.100:0/2597197719 learned_addr learned my addr 172.21.15.100:0/2597197719 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:33:58.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.108+0000 7fac62217640 1 --2- 172.21.15.100:0/2597197719 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac5c070610 0x7fac5c1372b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:58.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.109+0000 7fac62217640 1 -- 172.21.15.100:0/2597197719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac5c0c7c60 msgr2=0x7fac5c0c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.109+0000 7fac62217640 1 --2- 172.21.15.100:0/2597197719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac5c0c7c60 0x7fac5c0c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.109+0000 7fac62217640 1 -- 172.21.15.100:0/2597197719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac5c0c6630 msgr2=0x7fac5c1377f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.109+0000 7fac62217640 1 --2- 172.21.15.100:0/2597197719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac5c0c6630 0x7fac5c1377f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.109+0000 7fac62217640 1 -- 172.21.15.100:0/2597197719 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c146f60 con 0x7fac5c070610 2024-09-11T22:33:58.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.109+0000 7fac62217640 1 --2- 172.21.15.100:0/2597197719 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac5c070610 0x7fac5c1372b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fac54034000 tx=0x7fac54001cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:58.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.109+0000 7fac52ffd640 1 -- 172.21.15.100:0/2597197719 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac54010040 con 0x7fac5c070610 2024-09-11T22:33:58.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.109+0000 7fac6447b640 1 -- 172.21.15.100:0/2597197719 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac5c155ef0 con 0x7fac5c070610 2024-09-11T22:33:58.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.110+0000 7fac6447b640 1 -- 172.21.15.100:0/2597197719 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fac5c136850 con 0x7fac5c070610 2024-09-11T22:33:58.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.110+0000 7fac52ffd640 1 -- 172.21.15.100:0/2597197719 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac5400a3f0 con 0x7fac5c070610 2024-09-11T22:33:58.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.110+0000 7fac52ffd640 1 -- 172.21.15.100:0/2597197719 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac54038b00 con 0x7fac5c070610 2024-09-11T22:33:58.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.111+0000 7fac6447b640 1 --2- 172.21.15.100:0/2597197719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac44002a70 0x7fac44004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.111+0000 7fac6447b640 1 -- 172.21.15.100:0/2597197719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fac44007ec0 con 0x7fac44002a70 2024-09-11T22:33:58.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.112+0000 7fac61a16640 1 --2- 172.21.15.100:0/2597197719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac44002a70 0x7fac44004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:58.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.113+0000 7fac52ffd640 1 -- 172.21.15.100:0/2597197719 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fac54038ca0 con 0x7fac5c070610 2024-09-11T22:33:58.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.113+0000 7fac61a16640 1 -- 172.21.15.100:0/2597197719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac440080c0 con 0x7fac44002a70 2024-09-11T22:33:58.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.113+0000 7fac61a16640 1 --2- 172.21.15.100:0/2597197719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac44002a70 0x7fac44004f30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fac5c1558a0 tx=0x7fac4c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:58.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.113+0000 7fac52ffd640 1 --2- 172.21.15.100:0/2597197719 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fac4006be30 0x7fac4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.113+0000 7fac52ffd640 1 -- 172.21.15.100:0/2597197719 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fac540ac010 con 0x7fac5c070610 2024-09-11T22:33:58.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.114+0000 7fac62a18640 1 --2- 172.21.15.100:0/2597197719 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fac4006be30 0x7fac4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:58.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.114+0000 7fac52ffd640 1 -- 172.21.15.100:0/2597197719 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c017070 con 0x7fac44002a70 2024-09-11T22:33:58.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.114+0000 7fac52ffd640 1 -- 172.21.15.100:0/2597197719 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fac4c00c770 con 0x7fac44002a70 2024-09-11T22:33:58.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.114+0000 7fac52ffd640 1 -- 172.21.15.100:0/2597197719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac44002a70 msgr2=0x7fac44004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.114+0000 7fac52ffd640 1 --2- 172.21.15.100:0/2597197719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac44002a70 0x7fac44004f30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fac5c1558a0 tx=0x7fac4c00ec00 comp rx=0 tx=0).stop 2024-09-11T22:33:58.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.114+0000 7fac52ffd640 1 -- 172.21.15.100:0/2597197719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac44002a70 msgr2=0x7fac44004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:33:58.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.114+0000 7fac52ffd640 1 --2- 172.21.15.100:0/2597197719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac44002a70 0x7fac44004f30 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fac5c1558a0 tx=0x7fac4c00ec00 comp rx=0 tx=0).stop 2024-09-11T22:33:58.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.115+0000 7fac62a18640 1 --2- 172.21.15.100:0/2597197719 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fac4006be30 0x7fac4006e2f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0ced40 tx=0x7fac58006b70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:58.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.136+0000 7fac6447b640 1 --2- 172.21.15.100:0/2597197719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac44006f00 0x7fac44007390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.136+0000 7fac6447b640 1 -- 172.21.15.100:0/2597197719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fac4400a4a0 con 0x7fac44006f00 2024-09-11T22:33:58.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.137+0000 7fac61a16640 1 --2- 172.21.15.100:0/2597197719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac44006f00 0x7fac44007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:58.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.137+0000 7fac61a16640 1 -- 172.21.15.100:0/2597197719 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fac440078d0 con 0x7fac44006f00 2024-09-11T22:33:58.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.138+0000 7fac61a16640 1 --2- 172.21.15.100:0/2597197719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac44006f00 0x7fac44007390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fac4c019000 tx=0x7fac4c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:58.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.141+0000 7fac52ffd640 1 -- 172.21.15.100:0/2597197719 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4c017070 con 0x7fac44006f00 2024-09-11T22:33:58.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.141+0000 7fac52ffd640 1 -- 172.21.15.100:0/2597197719 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5056 (secure 0 0 0) 0x7fac4c006360 con 0x7fac44006f00 2024-09-11T22:33:58.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.141+0000 7fac52ffd640 1 -- 172.21.15.100:0/2597197719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac44006f00 msgr2=0x7fac44007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.141+0000 7fac52ffd640 1 --2- 172.21.15.100:0/2597197719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac44006f00 0x7fac44007390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fac4c019000 tx=0x7fac4c0047e0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.141+0000 7fac52ffd640 1 -- 172.21.15.100:0/2597197719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac44006f00 msgr2=0x7fac44007390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:33:58.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.141+0000 7fac52ffd640 1 --2- 172.21.15.100:0/2597197719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac44006f00 0x7fac44007390 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.142 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:33:58.143 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:33:58.143 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:33:58.143 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:33:58.143 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 98, 2024-09-11T22:33:58.143 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 97275, 2024-09-11T22:33:58.143 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:33:58.143 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:33:58.143 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:33:58.143 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:33:58.143 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:58.143 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 14, 2024-09-11T22:33:58.143 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:33:58.144 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:33:58.144 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:33:58.144 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:58.144 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:58.144 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:58.144 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:58.144 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:58.144 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:58.144 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:58.144 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:58.144 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:58.144 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:58.144 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:58.145 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:58.145 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:33:58.145 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:33:58.145 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:58.145 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:58.145 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:58.145 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:58.145 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:58.145 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:58.145 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:58.145 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:58.145 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:58.145 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:58.146 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:58.146 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:58.146 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.146 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:33:58.146 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:33:58.146 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:33:58.146 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:33:58.146 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:33:58.146 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:33:58.146 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:33:58.146 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:33:58.146 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:33:58.146 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:33:58.146 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:33:58.147 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:33:58.147 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:33:58.147 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:33:58.147 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:33:58.147 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:33:58.147 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:33:58.147 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:58.147 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:58.147 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:58.147 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:58.147 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:58.147 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:58.147 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:58.147 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:58.148 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:58.148 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:58.148 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:58.148 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:58.148 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:33:58.148 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.148 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:33:58.148 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.148 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:33:58.148 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:33:58.148 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:58.148 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:58.148 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.149 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:58.149 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:33:58.149 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:58.149 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.149 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.149 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:58.149 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:33:58.149 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:58.149 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.149 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:58.149 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.149 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:33:58.149 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:33:58.150 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:58.150 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:58.150 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:58.150 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.150 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.150 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:33:58.150 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:33:58.150 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:58.150 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:58.150 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.150 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:58.150 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:33:58.150 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:58.151 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.151 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.151 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:58.151 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:33:58.151 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:58.151 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.151 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:58.151 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.151 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:33:58.151 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:33:58.151 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:58.151 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:58.151 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:58.151 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.152 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.152 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:33:58.152 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:33:58.152 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:58.152 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:58.152 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.152 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:58.152 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:33:58.152 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:58.152 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.152 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.152 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:58.152 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:33:58.153 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:58.153 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.153 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:58.153 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.153 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:33:58.153 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:33:58.153 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:58.153 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:58.153 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:58.153 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.153 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:58.153 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.153 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:33:58.154 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:33:58.154 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.154 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:58.154 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:58.154 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:33:58.154 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.154 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:58.154 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:33:58.154 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.154 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:58.154 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:58.154 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4 2024-09-11T22:33:58.154 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.154 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:58.154 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:33:58.155 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.155 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:58.155 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:58.155 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:33:58.155 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.155 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:58.155 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:33:58.155 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.155 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:58.155 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:58.155 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:33:58.155 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.155 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:58.155 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:33:58.155 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.156 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:58.156 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:58.156 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:33:58.156 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.156 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:58.156 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.156 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:33:58.156 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:33:58.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.142+0000 7fac6447b640 1 -- 172.21.15.100:0/2597197719 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fac4006be30 msgr2=0x7fac4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.142+0000 7fac6447b640 1 --2- 172.21.15.100:0/2597197719 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fac4006be30 0x7fac4006e2f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0ced40 tx=0x7fac58006b70 comp rx=0 tx=0).stop 2024-09-11T22:33:58.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.142+0000 7fac6447b640 1 -- 172.21.15.100:0/2597197719 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac5c070610 msgr2=0x7fac5c1372b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.142+0000 7fac6447b640 1 --2- 172.21.15.100:0/2597197719 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac5c070610 0x7fac5c1372b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fac54034000 tx=0x7fac54001cf0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.143+0000 7fac62a18640 1 -- 172.21.15.100:0/2597197719 reap_dead start 2024-09-11T22:33:58.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.143+0000 7fac62a18640 1 -- 172.21.15.100:0/2597197719 reap_dead start 2024-09-11T22:33:58.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.143+0000 7fac6447b640 1 -- 172.21.15.100:0/2597197719 shutdown_connections 2024-09-11T22:33:58.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.143+0000 7fac6447b640 1 -- 172.21.15.100:0/2597197719 >> 172.21.15.100:0/2597197719 conn(0x7fac5c06de20 msgr2=0x7fac5c071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:58.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.151+0000 7fac6447b640 1 -- 172.21.15.100:0/2597197719 shutdown_connections 2024-09-11T22:33:58.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.151+0000 7fac6447b640 1 -- 172.21.15.100:0/2597197719 wait complete. 2024-09-11T22:33:58.176 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:33:58.177 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:33:58.177 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:33:58.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.380+0000 7f2fda70b640 1 Processor -- start 2024-09-11T22:33:58.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.380+0000 7f2fda70b640 1 -- start start 2024-09-11T22:33:58.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.382+0000 7f2fda70b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2fcc005a00 0x7f2fcc0da540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.382+0000 7f2fda70b640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fcc005fd0 con 0x7f2fcc034250 2024-09-11T22:33:58.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.382+0000 7f2fda70b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fcc0062b0 con 0x7f2fcc050770 2024-09-11T22:33:58.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.382+0000 7f2fda70b640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f2fcc032c10 con 0x7f2fcc005a00 2024-09-11T22:33:58.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.382+0000 7f2fd9709640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f2fcc050770 0x7f2fcc0d4380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:38454/0 (socket says 172.21.15.100:38454) 2024-09-11T22:33:58.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.382+0000 7f2fd9709640 1 -- 172.21.15.100:0/3757049280 learned_addr learned my addr 172.21.15.100:0/3757049280 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:33:58.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.382+0000 7f2fd8f08640 1 --2- 172.21.15.100:0/3757049280 >> v2:172.21.15.100:3300/0 conn(0x7f2fcc005a00 0x7f2fcc0da540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:58.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.383+0000 7f2fd8f08640 1 -- 172.21.15.100:0/3757049280 >> v1:172.21.15.167:6789/0 conn(0x7f2fcc050770 legacy=0x7f2fcc0d4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.383+0000 7f2fd8f08640 1 -- 172.21.15.100:0/3757049280 >> v1:172.21.15.100:6789/0 conn(0x7f2fcc034250 legacy=0x7f2fcc04ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.383+0000 7f2fd8f08640 1 -- 172.21.15.100:0/3757049280 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fcc006590 con 0x7f2fcc005a00 2024-09-11T22:33:58.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.385+0000 7f2fd8f08640 1 --2- 172.21.15.100:0/3757049280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fcc005a00 0x7f2fcc0da540 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40097a0 tx=0x7f2fc4029fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402cb2ebec7b82ff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:58.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.385+0000 7f2fcbfff640 1 -- 172.21.15.100:0/3757049280 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4037070 con 0x7f2fcc005a00 2024-09-11T22:33:58.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.386+0000 7f2fcbfff640 1 -- 172.21.15.100:0/3757049280 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc402ac40 con 0x7f2fcc005a00 2024-09-11T22:33:58.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.387+0000 7f2fda70b640 1 -- 172.21.15.100:0/3757049280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fcc005a00 msgr2=0x7f2fcc0da540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.387+0000 7f2fcbfff640 1 -- 172.21.15.100:0/3757049280 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4037070 con 0x7f2fcc005a00 2024-09-11T22:33:58.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.387+0000 7f2fda70b640 1 --2- 172.21.15.100:0/3757049280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fcc005a00 0x7f2fcc0da540 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40097a0 tx=0x7f2fc4029fb0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.387+0000 7f2fda70b640 1 -- 172.21.15.100:0/3757049280 shutdown_connections 2024-09-11T22:33:58.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.387+0000 7f2fda70b640 1 --2- 172.21.15.100:0/3757049280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fcc005a00 0x7f2fcc0da540 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.387+0000 7f2fda70b640 1 -- 172.21.15.100:0/3757049280 >> 172.21.15.100:0/3757049280 conn(0x7f2fcc04fc50 msgr2=0x7f2fcc050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:58.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.390+0000 7f2fda70b640 1 -- 172.21.15.100:0/3757049280 shutdown_connections 2024-09-11T22:33:58.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.390+0000 7f2fda70b640 1 -- 172.21.15.100:0/3757049280 wait complete. 2024-09-11T22:33:58.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.391+0000 7f2fda70b640 1 Processor -- start 2024-09-11T22:33:58.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.392+0000 7f2fda70b640 1 -- start start 2024-09-11T22:33:58.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.393+0000 7f2fda70b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fcc005a00 0x7f2fcc0cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.393+0000 7f2fda70b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fcc034250 0x7f2fcc048420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.393+0000 7f2fda70b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fcc050770 0x7f2fcc0d9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.393+0000 7f2fd9709640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fcc005a00 0x7f2fcc0cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:58.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.393+0000 7f2fd9709640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fcc005a00 0x7f2fcc0cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:37962/0 (socket says 172.21.15.100:37962) 2024-09-11T22:33:58.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.393+0000 7f2fd9709640 1 -- 172.21.15.100:0/3701827098 learned_addr learned my addr 172.21.15.100:0/3701827098 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:33:58.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.393+0000 7f2fda70b640 1 -- 172.21.15.100:0/3701827098 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc006e30 con 0x7f2fcc050770 2024-09-11T22:33:58.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.393+0000 7f2fda70b640 1 -- 172.21.15.100:0/3701827098 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc006b50 con 0x7f2fcc034250 2024-09-11T22:33:58.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.393+0000 7f2fda70b640 1 -- 172.21.15.100:0/3701827098 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2fcc04a5d0 con 0x7f2fcc005a00 2024-09-11T22:33:58.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.393+0000 7f2fd9f0a640 1 --2- 172.21.15.100:0/3701827098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fcc050770 0x7f2fcc0d9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:58.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.393+0000 7f2fd8f08640 1 --2- 172.21.15.100:0/3701827098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fcc034250 0x7f2fcc048420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:58.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.394+0000 7f2fd9709640 1 -- 172.21.15.100:0/3701827098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fcc034250 msgr2=0x7f2fcc048420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.394+0000 7f2fd9709640 1 --2- 172.21.15.100:0/3701827098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fcc034250 0x7f2fcc048420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.394+0000 7f2fd9709640 1 -- 172.21.15.100:0/3701827098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fcc050770 msgr2=0x7f2fcc0d9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.394+0000 7f2fd9709640 1 --2- 172.21.15.100:0/3701827098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fcc050770 0x7f2fcc0d9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.394+0000 7f2fd9709640 1 -- 172.21.15.100:0/3701827098 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fcc185350 con 0x7f2fcc005a00 2024-09-11T22:33:58.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.394+0000 7f2fd9709640 1 --2- 172.21.15.100:0/3701827098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fcc005a00 0x7f2fcc0cdf80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2fd002e7c0 tx=0x7f2fd002ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:58.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.394+0000 7f2fc9ffb640 1 -- 172.21.15.100:0/3701827098 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd003a070 con 0x7f2fcc005a00 2024-09-11T22:33:58.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.394+0000 7f2fc9ffb640 1 -- 172.21.15.100:0/3701827098 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd00072e0 con 0x7f2fcc005a00 2024-09-11T22:33:58.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.396+0000 7f2fc9ffb640 1 -- 172.21.15.100:0/3701827098 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd00047e0 con 0x7f2fcc005a00 2024-09-11T22:33:58.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.396+0000 7f2fda70b640 1 -- 172.21.15.100:0/3701827098 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fcc047760 con 0x7f2fcc005a00 2024-09-11T22:33:58.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.396+0000 7f2fda70b640 1 -- 172.21.15.100:0/3701827098 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fcc0471a0 con 0x7f2fcc005a00 2024-09-11T22:33:58.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.397+0000 7f2fb77fe640 1 --2- 172.21.15.100:0/3701827098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fcc047370 0x7f2fcc0028c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.398+0000 7f2fb77fe640 1 -- 172.21.15.100:0/3701827098 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc034660 con 0x7f2fcc047370 2024-09-11T22:33:58.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.398+0000 7f2fd8f08640 1 --2- 172.21.15.100:0/3701827098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fcc047370 0x7f2fcc0028c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:58.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.398+0000 7f2fc9ffb640 1 -- 172.21.15.100:0/3701827098 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2fd003d070 con 0x7f2fcc005a00 2024-09-11T22:33:58.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.399+0000 7f2fc9ffb640 1 --2- 172.21.15.100:0/3701827098 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2fb806bf00 0x7f2fb806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.399+0000 7f2fd9f0a640 1 --2- 172.21.15.100:0/3701827098 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2fb806bf00 0x7f2fb806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:58.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.400+0000 7f2fd9f0a640 1 --2- 172.21.15.100:0/3701827098 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2fb806bf00 0x7f2fb806e3c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2fd406ac40 tx=0x7f2fd406e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:58.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.400+0000 7f2fc9ffb640 1 -- 172.21.15.100:0/3701827098 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f2fd00ac5a0 con 0x7f2fcc005a00 2024-09-11T22:33:58.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.402+0000 7f2fd8f08640 1 -- 172.21.15.100:0/3701827098 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2fcc034dc0 con 0x7f2fcc047370 2024-09-11T22:33:58.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.403+0000 7f2fd8f08640 1 --2- 172.21.15.100:0/3701827098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fcc047370 0x7f2fcc0028c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc04ab90 tx=0x7f2fc40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:58.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.404+0000 7f2fc9ffb640 1 -- 172.21.15.100:0/3701827098 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4042030 con 0x7f2fcc047370 2024-09-11T22:33:58.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.404+0000 7f2fc9ffb640 1 -- 172.21.15.100:0/3701827098 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f2fc4003610 con 0x7f2fcc047370 2024-09-11T22:33:58.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.404+0000 7f2fc9ffb640 1 -- 172.21.15.100:0/3701827098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fcc047370 msgr2=0x7f2fcc0028c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.404+0000 7f2fc9ffb640 1 --2- 172.21.15.100:0/3701827098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fcc047370 0x7f2fcc0028c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc04ab90 tx=0x7f2fc40046c0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.404+0000 7f2fc9ffb640 1 -- 172.21.15.100:0/3701827098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fcc047370 msgr2=0x7f2fcc0028c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:33:58.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.404+0000 7f2fc9ffb640 1 --2- 172.21.15.100:0/3701827098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fcc047370 0x7f2fcc0028c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.419+0000 7f2fb77fe640 1 --2- 172.21.15.100:0/3701827098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fcc002e00 0x7f2fcc003210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.419+0000 7f2fb77fe640 1 -- 172.21.15.100:0/3701827098 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc04b9d0 con 0x7f2fcc002e00 2024-09-11T22:33:58.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.419+0000 7f2fd8f08640 1 --2- 172.21.15.100:0/3701827098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fcc002e00 0x7f2fcc003210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:58.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.419+0000 7f2fd8f08640 1 -- 172.21.15.100:0/3701827098 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2fcc0d2a70 con 0x7f2fcc002e00 2024-09-11T22:33:58.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.423+0000 7f2fd8f08640 1 --2- 172.21.15.100:0/3701827098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fcc002e00 0x7f2fcc003210 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4000c00 tx=0x7f2fc4008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:58.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.423+0000 7f2fc9ffb640 1 -- 172.21.15.100:0/3701827098 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4042040 con 0x7f2fcc002e00 2024-09-11T22:33:58.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.424+0000 7f2fc9ffb640 1 -- 172.21.15.100:0/3701827098 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4553 (secure 0 0 0) 0x7f2fc4048c20 con 0x7f2fcc002e00 2024-09-11T22:33:58.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.424+0000 7f2fc9ffb640 1 -- 172.21.15.100:0/3701827098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fcc002e00 msgr2=0x7f2fcc003210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.424+0000 7f2fc9ffb640 1 --2- 172.21.15.100:0/3701827098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fcc002e00 0x7f2fcc003210 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4000c00 tx=0x7f2fc4008030 comp rx=0 tx=0).stop 2024-09-11T22:33:58.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.424+0000 7f2fc9ffb640 1 -- 172.21.15.100:0/3701827098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fcc002e00 msgr2=0x7f2fcc003210 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:33:58.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.424+0000 7f2fc9ffb640 1 --2- 172.21.15.100:0/3701827098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fcc002e00 0x7f2fcc003210 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4000c00 tx=0x7f2fc4008030 comp rx=0 tx=0).stop 2024-09-11T22:33:58.429 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:33:58.430 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:33:58.430 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:33:58.430 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:33:58.430 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 98, 2024-09-11T22:33:58.430 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 29955, 2024-09-11T22:33:58.430 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:33:58.430 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:33:58.430 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:33:58.430 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:33:58.430 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:58.430 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 14, 2024-09-11T22:33:58.430 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:33:58.430 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:33:58.431 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:33:58.431 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:58.431 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:58.431 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:58.431 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:58.431 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:58.431 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:58.431 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:58.431 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:58.431 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:58.431 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:58.431 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:58.431 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:58.432 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:33:58.432 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:33:58.432 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:58.432 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:58.432 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:58.432 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:58.432 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:58.432 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:58.432 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:58.432 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:58.432 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:58.432 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:58.433 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:58.433 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:58.433 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.433 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:33:58.433 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:33:58.433 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:33:58.433 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:33:58.433 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:33:58.433 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:33:58.433 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:33:58.433 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:33:58.433 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:33:58.433 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:33:58.433 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:33:58.434 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:33:58.434 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:33:58.434 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:33:58.434 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:33:58.434 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:33:58.434 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:33:58.434 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:58.434 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:58.434 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:58.434 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:58.434 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:58.434 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:58.434 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:58.435 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:58.435 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:58.435 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:58.435 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:58.435 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:58.435 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:33:58.435 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.435 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:33:58.435 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.435 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:33:58.435 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:33:58.435 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:58.435 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:58.435 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.436 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:58.436 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:33:58.436 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:58.436 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.436 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.436 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:58.436 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:33:58.436 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:58.436 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.436 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:58.436 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.436 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:33:58.436 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:33:58.437 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:58.437 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:58.437 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:58.437 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.437 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.437 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:33:58.437 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:33:58.437 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:58.437 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:58.437 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.437 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:58.437 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:33:58.437 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:58.438 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.438 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.438 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:58.438 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:33:58.438 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:58.438 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.438 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:58.438 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.438 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:33:58.438 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:33:58.438 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:58.438 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:58.438 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:58.439 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.439 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.439 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:33:58.439 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:33:58.439 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:58.439 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:58.439 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.439 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:58.439 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:33:58.439 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:58.439 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.439 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.439 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:58.440 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:33:58.440 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:58.440 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.440 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:58.440 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.440 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:33:58.440 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:33:58.440 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:58.440 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:58.440 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:58.440 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.440 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:58.440 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.440 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:33:58.441 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:33:58.441 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.441 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:58.441 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:58.441 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:33:58.441 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.441 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:58.441 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:33:58.441 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.441 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:58.441 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:58.441 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:33:58.441 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.442 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:58.442 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.442 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:33:58.442 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:33:58.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.430+0000 7f2fb77fe640 1 -- 172.21.15.100:0/3701827098 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2fb806bf00 msgr2=0x7f2fb806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.430+0000 7f2fb77fe640 1 --2- 172.21.15.100:0/3701827098 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2fb806bf00 0x7f2fb806e3c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2fd406ac40 tx=0x7f2fd406e040 comp rx=0 tx=0).stop 2024-09-11T22:33:58.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.430+0000 7f2fd9f0a640 1 -- 172.21.15.100:0/3701827098 reap_dead start 2024-09-11T22:33:58.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.430+0000 7f2fb77fe640 1 -- 172.21.15.100:0/3701827098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fcc005a00 msgr2=0x7f2fcc0cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.430+0000 7f2fb77fe640 1 --2- 172.21.15.100:0/3701827098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fcc005a00 0x7f2fcc0cdf80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2fd002e7c0 tx=0x7f2fd002ec80 comp rx=0 tx=0).stop 2024-09-11T22:33:58.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.431+0000 7f2fb77fe640 1 -- 172.21.15.100:0/3701827098 shutdown_connections 2024-09-11T22:33:58.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.431+0000 7f2fb77fe640 1 --2- 172.21.15.100:0/3701827098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fcc005a00 0x7f2fcc0cdf80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.431+0000 7f2fb77fe640 1 -- 172.21.15.100:0/3701827098 >> 172.21.15.100:0/3701827098 conn(0x7f2fcc04fc50 msgr2=0x7f2fcc04c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:58.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.434+0000 7f2fb77fe640 1 -- 172.21.15.100:0/3701827098 shutdown_connections 2024-09-11T22:33:58.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.434+0000 7f2fb77fe640 1 -- 172.21.15.100:0/3701827098 wait complete. 2024-09-11T22:33:58.456 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:33:58.456 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:33:58.457 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:33:58.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.678+0000 7f5b9d986640 1 Processor -- start 2024-09-11T22:33:58.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.678+0000 7f5b9d986640 1 -- start start 2024-09-11T22:33:58.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.679+0000 7f5b9d986640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5b9004aa40 0x7f5b90005a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.679+0000 7f5b9d986640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b900ff830 0x7f5b900ffcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.679+0000 7f5b9d986640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b901002e0 con 0x7f5b900f6690 2024-09-11T22:33:58.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.679+0000 7f5b9d986640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f5b90045660 con 0x7f5b9004aa40 2024-09-11T22:33:58.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.679+0000 7f5b9d986640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5b90045f00 con 0x7f5b900ff830 2024-09-11T22:33:58.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.679+0000 7f5b977fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b900ff830 0x7f5b900ffcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:58.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.680+0000 7f5b977fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b900ff830 0x7f5b900ffcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:37972/0 (socket says 172.21.15.100:37972) 2024-09-11T22:33:58.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.680+0000 7f5b977fe640 1 -- 172.21.15.100:0/221958383 learned_addr learned my addr 172.21.15.100:0/221958383 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:33:58.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.680+0000 7f5b967fc640 1 --2- 172.21.15.100:0/221958383 >> v2:172.21.15.167:3300/0 conn(0x7f5b9004aa40 0x7f5b90005a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:58.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.680+0000 7f5b967fc640 1 -- 172.21.15.100:0/221958383 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b900ff830 msgr2=0x7f5b900ffcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:33:58.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.680+0000 7f5b967fc640 1 --2- 172.21.15.100:0/221958383 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b900ff830 0x7f5b900ffcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.680+0000 7f5b967fc640 1 -- 172.21.15.100:0/221958383 >> v1:172.21.15.167:6789/0 conn(0x7f5b900f6690 legacy=0x7f5b90046390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.680+0000 7f5b967fc640 1 -- 172.21.15.100:0/221958383 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b901005c0 con 0x7f5b9004aa40 2024-09-11T22:33:58.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.681+0000 7f5b967fc640 1 --2- 172.21.15.100:0/221958383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b9004aa40 0x7f5b90005a00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5b98051790 tx=0x7f5b9809e6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e34f24e134dffe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:58.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.682+0000 7f5b95ffb640 1 -- 172.21.15.100:0/221958383 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b980a37d0 con 0x7f5b9004aa40 2024-09-11T22:33:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.682+0000 7f5b95ffb640 1 -- 172.21.15.100:0/221958383 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b980a3970 con 0x7f5b9004aa40 2024-09-11T22:33:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.682+0000 7f5b95ffb640 1 -- 172.21.15.100:0/221958383 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b980a3de0 con 0x7f5b9004aa40 2024-09-11T22:33:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.683+0000 7f5b9d986640 1 -- 172.21.15.100:0/221958383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b9004aa40 msgr2=0x7f5b90005a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.683+0000 7f5b9d986640 1 --2- 172.21.15.100:0/221958383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b9004aa40 0x7f5b90005a00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5b98051790 tx=0x7f5b9809e6e0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.686+0000 7f5b9d986640 1 -- 172.21.15.100:0/221958383 shutdown_connections 2024-09-11T22:33:58.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.686+0000 7f5b9d986640 1 --2- 172.21.15.100:0/221958383 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b900ff830 0x7f5b900ffcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.687+0000 7f5b9d986640 1 --2- 172.21.15.100:0/221958383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b9004aa40 0x7f5b90005a00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.687+0000 7f5b9d986640 1 -- 172.21.15.100:0/221958383 >> 172.21.15.100:0/221958383 conn(0x7f5b9004fc50 msgr2=0x7f5b90050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:58.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.691+0000 7f5b9d986640 1 -- 172.21.15.100:0/221958383 shutdown_connections 2024-09-11T22:33:58.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.691+0000 7f5b9d986640 1 -- 172.21.15.100:0/221958383 wait complete. 2024-09-11T22:33:58.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.693+0000 7f5b9d986640 1 Processor -- start 2024-09-11T22:33:58.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.693+0000 7f5b9d986640 1 -- start start 2024-09-11T22:33:58.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.694+0000 7f5b9d986640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b9004aa40 0x7f5b900f7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.694+0000 7f5b9d986640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b900f6690 0x7f5b9004f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.694+0000 7f5b9d986640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b900ff830 0x7f5b90047660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.695+0000 7f5b967fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b900f6690 0x7f5b9004f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:58.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.695+0000 7f5b967fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b900f6690 0x7f5b9004f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53080/0 (socket says 172.21.15.100:53080) 2024-09-11T22:33:58.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.695+0000 7f5b967fc640 1 -- 172.21.15.100:0/1551722246 learned_addr learned my addr 172.21.15.100:0/1551722246 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:33:58.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.695+0000 7f5b9d986640 1 -- 172.21.15.100:0/1551722246 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5b90045b90 con 0x7f5b900f6690 2024-09-11T22:33:58.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.695+0000 7f5b977fe640 1 --2- 172.21.15.100:0/1551722246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b900ff830 0x7f5b90047660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:58.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.695+0000 7f5b96ffd640 1 --2- 172.21.15.100:0/1551722246 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b9004aa40 0x7f5b900f7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:58.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.695+0000 7f5b9d986640 1 -- 172.21.15.100:0/1551722246 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5b900f6a70 con 0x7f5b900ff830 2024-09-11T22:33:58.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.695+0000 7f5b9d986640 1 -- 172.21.15.100:0/1551722246 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5b90044b30 con 0x7f5b9004aa40 2024-09-11T22:33:58.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.696+0000 7f5b967fc640 1 -- 172.21.15.100:0/1551722246 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b9004aa40 msgr2=0x7f5b900f7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.696+0000 7f5b967fc640 1 --2- 172.21.15.100:0/1551722246 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b9004aa40 0x7f5b900f7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.696+0000 7f5b967fc640 1 -- 172.21.15.100:0/1551722246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b900ff830 msgr2=0x7f5b90047660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.696+0000 7f5b967fc640 1 --2- 172.21.15.100:0/1551722246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b900ff830 0x7f5b90047660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.696+0000 7f5b967fc640 1 -- 172.21.15.100:0/1551722246 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b900f8090 con 0x7f5b900f6690 2024-09-11T22:33:58.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.697+0000 7f5b96ffd640 1 --2- 172.21.15.100:0/1551722246 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b9004aa40 0x7f5b900f7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:33:58.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.697+0000 7f5b967fc640 1 --2- 172.21.15.100:0/1551722246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b900f6690 0x7f5b9004f110 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5b98069cd0 tx=0x7f5b9806bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:58.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.697+0000 7f5b7ffff640 1 -- 172.21.15.100:0/1551722246 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b980b3070 con 0x7f5b900f6690 2024-09-11T22:33:58.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.697+0000 7f5b7ffff640 1 -- 172.21.15.100:0/1551722246 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b980839b0 con 0x7f5b900f6690 2024-09-11T22:33:58.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.697+0000 7f5b9d986640 1 -- 172.21.15.100:0/1551722246 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b90035df0 con 0x7f5b900f6690 2024-09-11T22:33:58.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.698+0000 7f5b9d986640 1 -- 172.21.15.100:0/1551722246 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b90049d10 con 0x7f5b900f6690 2024-09-11T22:33:58.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.700+0000 7f5b7ffff640 1 -- 172.21.15.100:0/1551722246 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b98083d60 con 0x7f5b900f6690 2024-09-11T22:33:58.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.700+0000 7f5b7ffff640 1 -- 172.21.15.100:0/1551722246 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b980b6070 con 0x7f5b900f6690 2024-09-11T22:33:58.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.701+0000 7f5b7ffff640 1 --2- 172.21.15.100:0/1551722246 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5b8406bf00 0x7f5b8406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.701+0000 7f5b96ffd640 1 --2- 172.21.15.100:0/1551722246 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5b8406bf00 0x7f5b8406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:58.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.701+0000 7f5b7ffff640 1 -- 172.21.15.100:0/1551722246 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f5b98117580 con 0x7f5b900f6690 2024-09-11T22:33:58.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.702+0000 7f5b9d986640 1 --2- 172.21.15.100:0/1551722246 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b90047ba0 0x7f5b90046f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.702+0000 7f5b9d986640 1 -- 172.21.15.100:0/1551722246 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5b900f0350 con 0x7f5b90047ba0 2024-09-11T22:33:58.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.702+0000 7f5b977fe640 1 --2- 172.21.15.100:0/1551722246 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b90047ba0 0x7f5b90046f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:58.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.702+0000 7f5b96ffd640 1 --2- 172.21.15.100:0/1551722246 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5b8406bf00 0x7f5b8406e3c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5b88000f60 tx=0x7f5b88009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:58.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.705+0000 7f5b977fe640 1 -- 172.21.15.100:0/1551722246 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b90035ba0 con 0x7f5b90047ba0 2024-09-11T22:33:58.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.706+0000 7f5b977fe640 1 --2- 172.21.15.100:0/1551722246 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b90047ba0 0x7f5b90046f50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c003820 tx=0x7f5b8c003ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:58.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.707+0000 7f5b7ffff640 1 -- 172.21.15.100:0/1551722246 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c019070 con 0x7f5b90047ba0 2024-09-11T22:33:58.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.707+0000 7f5b7ffff640 1 -- 172.21.15.100:0/1551722246 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f5b8c00ae50 con 0x7f5b90047ba0 2024-09-11T22:33:58.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.707+0000 7f5b7ffff640 1 -- 172.21.15.100:0/1551722246 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b90047ba0 msgr2=0x7f5b90046f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.707+0000 7f5b7ffff640 1 --2- 172.21.15.100:0/1551722246 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b90047ba0 0x7f5b90046f50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c003820 tx=0x7f5b8c003ce0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.707+0000 7f5b7ffff640 1 -- 172.21.15.100:0/1551722246 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b90047ba0 msgr2=0x7f5b90046f50 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:33:58.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.707+0000 7f5b7ffff640 1 --2- 172.21.15.100:0/1551722246 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b90047ba0 0x7f5b90046f50 secure :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c003820 tx=0x7f5b8c003ce0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.717+0000 7f5b7dffb640 1 --2- 172.21.15.100:0/1551722246 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b70002920 0x7f5b70004dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:58.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.717+0000 7f5b7dffb640 1 -- 172.21.15.100:0/1551722246 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f5b70007d50 con 0x7f5b70002920 2024-09-11T22:33:58.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.718+0000 7f5b977fe640 1 --2- 172.21.15.100:0/1551722246 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b70002920 0x7f5b70004dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:58.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.721+0000 7f5b977fe640 1 -- 172.21.15.100:0/1551722246 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5b70007f50 con 0x7f5b70002920 2024-09-11T22:33:58.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.726+0000 7f5b977fe640 1 --2- 172.21.15.100:0/1551722246 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b70002920 0x7f5b70004dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c003820 tx=0x7f5b8c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:58.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.727+0000 7f5b7ffff640 1 -- 172.21.15.100:0/1551722246 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c008b80 con 0x7f5b70002920 2024-09-11T22:33:58.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.727+0000 7f5b7ffff640 1 -- 172.21.15.100:0/1551722246 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7f5b8c008d20 con 0x7f5b70002920 2024-09-11T22:33:58.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.727+0000 7f5b7ffff640 1 -- 172.21.15.100:0/1551722246 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b70002920 msgr2=0x7f5b70004dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.727+0000 7f5b7ffff640 1 --2- 172.21.15.100:0/1551722246 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b70002920 0x7f5b70004dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c003820 tx=0x7f5b8c004730 comp rx=0 tx=0).stop 2024-09-11T22:33:58.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.727+0000 7f5b7ffff640 1 -- 172.21.15.100:0/1551722246 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b70002920 msgr2=0x7f5b70004dc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:33:58.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.727+0000 7f5b7ffff640 1 --2- 172.21.15.100:0/1551722246 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b70002920 0x7f5b70004dc0 secure :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c003820 tx=0x7f5b8c004730 comp rx=0 tx=0).stop 2024-09-11T22:33:58.729 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:33:58.729 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:33:58.729 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:33:58.729 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:33:58.729 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 98, 2024-09-11T22:33:58.730 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 729447, 2024-09-11T22:33:58.730 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:33:58.730 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:33:58.730 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:33:58.730 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:33:58.730 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:58.730 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 15, 2024-09-11T22:33:58.730 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:33:58.730 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:33:58.730 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:33:58.730 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:58.730 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:58.730 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:58.731 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:58.731 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:58.731 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:58.731 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:58.731 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:58.731 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:58.731 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:58.731 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:58.731 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:58.731 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:33:58.731 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:33:58.731 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:58.731 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:58.732 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:58.732 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:58.732 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:58.732 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:58.732 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:58.732 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:58.732 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:58.732 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:58.732 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:58.732 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:58.732 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.732 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:33:58.732 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:33:58.733 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:33:58.733 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:33:58.733 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:33:58.733 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:33:58.733 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:33:58.733 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:33:58.733 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:33:58.733 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:33:58.733 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:33:58.733 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:33:58.733 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:33:58.733 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:33:58.733 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:33:58.734 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:33:58.734 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:33:58.734 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:33:58.734 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:33:58.734 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:33:58.734 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:33:58.734 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:33:58.734 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:33:58.734 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:33:58.734 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:33:58.734 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:33:58.734 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:33:58.734 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:33:58.734 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:58.735 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:33:58.735 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.735 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:33:58.735 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.735 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:33:58.735 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:33:58.735 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:58.735 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:58.735 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.735 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:58.735 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:33:58.735 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:58.735 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.735 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.736 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:58.736 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:33:58.736 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:58.736 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.736 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:58.736 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.736 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:33:58.736 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:33:58.736 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:58.736 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:58.736 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:58.736 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.736 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.737 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:33:58.737 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:33:58.737 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:58.737 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:58.737 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.737 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:58.737 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:33:58.737 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:58.737 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.737 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.737 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:58.737 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:33:58.737 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:58.738 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.738 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:58.738 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.738 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:33:58.738 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:33:58.738 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:58.738 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:58.738 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:58.738 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.738 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.738 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:33:58.738 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:33:58.738 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:33:58.738 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:33:58.739 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.739 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:33:58.739 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:33:58.739 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:58.739 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.739 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.739 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:33:58.739 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:33:58.739 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:33:58.739 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.739 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:58.739 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.739 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:33:58.739 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:33:58.740 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:33:58.740 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:33:58.740 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:33:58.740 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.740 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:58.740 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.740 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:33:58.740 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:33:58.740 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.740 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:58.740 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:58.740 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:33:58.741 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.741 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:58.741 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:33:58.741 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.741 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:58.741 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:58.741 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:33:58.741 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.741 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:58.741 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:33:58.741 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.741 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:58.741 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:58.742 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:33:58.742 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.742 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:58.742 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:33:58.742 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.742 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:58.742 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:58.742 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4 2024-09-11T22:33:58.742 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.742 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:33:58.742 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:33:58.742 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:33:58.742 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:33:58.742 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:33:58.743 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:33:58.743 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:33:58.743 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:33:58.743 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:33:58.743 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:33:58.743 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:33:58.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.730+0000 7f5b7dffb640 1 -- 172.21.15.100:0/1551722246 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5b8406bf00 msgr2=0x7f5b8406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.730+0000 7f5b7dffb640 1 --2- 172.21.15.100:0/1551722246 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f5b8406bf00 0x7f5b8406e3c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5b88000f60 tx=0x7f5b88009040 comp rx=0 tx=0).stop 2024-09-11T22:33:58.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.730+0000 7f5b977fe640 1 -- 172.21.15.100:0/1551722246 reap_dead start 2024-09-11T22:33:58.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.730+0000 7f5b7dffb640 1 -- 172.21.15.100:0/1551722246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b900f6690 msgr2=0x7f5b9004f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:58.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.730+0000 7f5b7dffb640 1 --2- 172.21.15.100:0/1551722246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b900f6690 0x7f5b9004f110 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5b98069cd0 tx=0x7f5b9806bb40 comp rx=0 tx=0).stop 2024-09-11T22:33:58.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.731+0000 7f5b7dffb640 1 -- 172.21.15.100:0/1551722246 shutdown_connections 2024-09-11T22:33:58.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.731+0000 7f5b7dffb640 1 --2- 172.21.15.100:0/1551722246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b900f6690 0x7f5b9004f110 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:58.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.731+0000 7f5b7dffb640 1 -- 172.21.15.100:0/1551722246 >> 172.21.15.100:0/1551722246 conn(0x7f5b9004fc50 msgr2=0x7f5b9004c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:58.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.735+0000 7f5b7dffb640 1 -- 172.21.15.100:0/1551722246 shutdown_connections 2024-09-11T22:33:58.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:58.735+0000 7f5b7dffb640 1 -- 172.21.15.100:0/1551722246 wait complete. 2024-09-11T22:33:58.761 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:33:58.761 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-11T22:33:58.761 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-11T22:33:58.761 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-11T22:33:58.761 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:33:58.762 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T22:33:58.762 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:33:58.782 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T22:33:58.782 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-11T22:33:58.782 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:33:59.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.021+0000 7f8bb5f96640 1 Processor -- start 2024-09-11T22:33:59.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.021+0000 7f8bb5f96640 1 -- start start 2024-09-11T22:33:59.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.022+0000 7f8bb5f96640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8ba80450e0 0x7f8ba80da670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:59.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.022+0000 7f8bb5f96640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ba804aa30 con 0x7f8ba80d4930 2024-09-11T22:33:59.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.022+0000 7f8bb5f96640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ba804acd0 con 0x7f8ba804c080 2024-09-11T22:33:59.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.022+0000 7f8bb5f96640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f8ba8044c50 con 0x7f8ba80450e0 2024-09-11T22:33:59.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.023+0000 7f8bb4f94640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f8ba80d4930 legacy=0x7f8ba80059f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:33:59.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.023+0000 7f8bb5795640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f8ba804c080 0x7f8ba80dabb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:38472/0 (socket says 172.21.15.100:38472) 2024-09-11T22:33:59.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.023+0000 7f8bb5795640 1 -- 172.21.15.100:0/960398683 learned_addr learned my addr 172.21.15.100:0/960398683 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:33:59.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.023+0000 7f8baffff640 1 --2- 172.21.15.100:0/960398683 >> v2:172.21.15.167:3300/0 conn(0x7f8ba80450e0 0x7f8ba80da670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:59.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.023+0000 7f8baffff640 1 -- 172.21.15.100:0/960398683 >> v1:172.21.15.167:6789/0 conn(0x7f8ba804c080 legacy=0x7f8ba80dabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:59.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.023+0000 7f8baffff640 1 -- 172.21.15.100:0/960398683 >> v1:172.21.15.100:6789/0 conn(0x7f8ba80d4930 legacy=0x7f8ba80059f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:33:59.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.023+0000 7f8baffff640 1 -- 172.21.15.100:0/960398683 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba804af90 con 0x7f8ba80450e0 2024-09-11T22:33:59.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.025+0000 7f8baffff640 1 --2- 172.21.15.100:0/960398683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba80450e0 0x7f8ba80da670 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8044dd0 tx=0x7f8b9c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4709f1fc1fb5364f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:59.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.026+0000 7f8baf7fe640 1 -- 172.21.15.100:0/960398683 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c037070 con 0x7f8ba80450e0 2024-09-11T22:33:59.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.030+0000 7f8baf7fe640 1 -- 172.21.15.100:0/960398683 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b9c032440 con 0x7f8ba80450e0 2024-09-11T22:33:59.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.031+0000 7f8bb5f96640 1 -- 172.21.15.100:0/960398683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba80450e0 msgr2=0x7f8ba80da670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:59.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.031+0000 7f8baf7fe640 1 -- 172.21.15.100:0/960398683 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c032810 con 0x7f8ba80450e0 2024-09-11T22:33:59.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.031+0000 7f8bb5f96640 1 --2- 172.21.15.100:0/960398683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba80450e0 0x7f8ba80da670 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8044dd0 tx=0x7f8b9c02a1c0 comp rx=0 tx=0).stop 2024-09-11T22:33:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.032+0000 7f8bb5f96640 1 -- 172.21.15.100:0/960398683 shutdown_connections 2024-09-11T22:33:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.032+0000 7f8bb5f96640 1 --2- 172.21.15.100:0/960398683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba80450e0 0x7f8ba80da670 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:59.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.032+0000 7f8bb5f96640 1 -- 172.21.15.100:0/960398683 >> 172.21.15.100:0/960398683 conn(0x7f8ba804fc40 msgr2=0x7f8ba8050050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.032+0000 7f8bb5f96640 1 -- 172.21.15.100:0/960398683 shutdown_connections 2024-09-11T22:33:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.032+0000 7f8bb5f96640 1 -- 172.21.15.100:0/960398683 wait complete. 2024-09-11T22:33:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.035+0000 7f8bb5f96640 1 Processor -- start 2024-09-11T22:33:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.035+0000 7f8bb5f96640 1 -- start start 2024-09-11T22:33:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.036+0000 7f8bb5f96640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba80450e0 0x7f8ba80d7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.036+0000 7f8bb5f96640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba804c080 0x7f8ba80c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.036+0000 7f8bb5f96640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ba80d4930 0x7f8ba8197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.036+0000 7f8bb5f96640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba8046760 con 0x7f8ba80450e0 2024-09-11T22:33:59.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.036+0000 7f8bb5f96640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba8046480 con 0x7f8ba804c080 2024-09-11T22:33:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.036+0000 7f8bb5f96640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8ba804b2d0 con 0x7f8ba80d4930 2024-09-11T22:33:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.036+0000 7f8bb4f94640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba80450e0 msgr2=0x7f8ba80d7cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:33:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.036+0000 7f8bb4f94640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba80450e0 0x7f8ba80d7cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:33:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.036+0000 7f8bb5795640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ba80d4930 0x7f8ba8197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.036+0000 7f8bb5795640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ba80d4930 0x7f8ba8197990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:38058/0 (socket says 172.21.15.100:38058) 2024-09-11T22:33:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.036+0000 7f8bb5795640 1 -- 172.21.15.100:0/1702288685 learned_addr learned my addr 172.21.15.100:0/1702288685 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:33:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.037+0000 7f8baffff640 1 --2- 172.21.15.100:0/1702288685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba804c080 0x7f8ba80c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.037+0000 7f8bb5795640 1 -- 172.21.15.100:0/1702288685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba804c080 msgr2=0x7f8ba80c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.037+0000 7f8bb5795640 1 --2- 172.21.15.100:0/1702288685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba804c080 0x7f8ba80c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.037+0000 7f8bb5795640 1 -- 172.21.15.100:0/1702288685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba80450e0 msgr2=0x7f8ba80d7cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:33:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.037+0000 7f8bb5795640 1 --2- 172.21.15.100:0/1702288685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba80450e0 0x7f8ba80d7cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.037+0000 7f8bb5795640 1 -- 172.21.15.100:0/1702288685 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba80d5b40 con 0x7f8ba80d4930 2024-09-11T22:33:59.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.038+0000 7f8bb5795640 1 --2- 172.21.15.100:0/1702288685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ba80d4930 0x7f8ba8197990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0051220 tx=0x7f8bb0069890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:59.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.039+0000 7f8bad7fa640 1 -- 172.21.15.100:0/1702288685 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0082070 con 0x7f8ba80d4930 2024-09-11T22:33:59.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.039+0000 7f8bad7fa640 1 -- 172.21.15.100:0/1702288685 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb0071a40 con 0x7f8ba80d4930 2024-09-11T22:33:59.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.040+0000 7f8bad7fa640 1 -- 172.21.15.100:0/1702288685 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0071e30 con 0x7f8ba80d4930 2024-09-11T22:33:59.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.042+0000 7f8bb5f96640 1 -- 172.21.15.100:0/1702288685 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba80d2130 con 0x7f8ba80d4930 2024-09-11T22:33:59.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.042+0000 7f8bb5f96640 1 -- 172.21.15.100:0/1702288685 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba80d1e50 con 0x7f8ba80d4930 2024-09-11T22:33:59.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.045+0000 7f8bb5f96640 1 -- 172.21.15.100:0/1702288685 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba804a290 con 0x7f8ba80d4930 2024-09-11T22:33:59.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.049+0000 7f8bad7fa640 1 -- 172.21.15.100:0/1702288685 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8bb0085070 con 0x7f8ba80d4930 2024-09-11T22:33:59.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.049+0000 7f8bad7fa640 1 --2- 172.21.15.100:0/1702288685 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8ba006bfa0 0x7f8ba006e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:33:59.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.054+0000 7f8bb4f94640 1 --2- 172.21.15.100:0/1702288685 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8ba006bfa0 0x7f8ba006e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:33:59.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.054+0000 7f8bb4f94640 1 --2- 172.21.15.100:0/1702288685 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8ba006bfa0 0x7f8ba006e460 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4003980 tx=0x7f8ba4006d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:33:59.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.055+0000 7f8bad7fa640 1 -- 172.21.15.100:0/1702288685 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f8bb00f5c20 con 0x7f8ba80d4930 2024-09-11T22:33:59.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.055+0000 7f8bad7fa640 1 -- 172.21.15.100:0/1702288685 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ba804a290 con 0x7f8ba80d4930 2024-09-11T22:33:59.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.571+0000 7f8bb5f96640 1 -- 172.21.15.100:0/1702288685 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8ba80d4d10 con 0x7f8ba80d4930 2024-09-11T22:33:59.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.573+0000 7f8bad7fa640 1 -- 172.21.15.100:0/1702288685 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f8bb00c3bd0 con 0x7f8ba80d4930 2024-09-11T22:33:59.577 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":98,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:33:59.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.577+0000 7f8b9affd640 1 -- 172.21.15.100:0/1702288685 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8ba006bfa0 msgr2=0x7f8ba006e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:59.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.577+0000 7f8b9affd640 1 --2- 172.21.15.100:0/1702288685 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8ba006bfa0 0x7f8ba006e460 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4003980 tx=0x7f8ba4006d30 comp rx=0 tx=0).stop 2024-09-11T22:33:59.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.577+0000 7f8b9affd640 1 -- 172.21.15.100:0/1702288685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ba80d4930 msgr2=0x7f8ba8197990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:33:59.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.577+0000 7f8b9affd640 1 --2- 172.21.15.100:0/1702288685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ba80d4930 0x7f8ba8197990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0051220 tx=0x7f8bb0069890 comp rx=0 tx=0).stop 2024-09-11T22:33:59.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.577+0000 7f8b9affd640 1 -- 172.21.15.100:0/1702288685 shutdown_connections 2024-09-11T22:33:59.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.577+0000 7f8b9affd640 1 --2- 172.21.15.100:0/1702288685 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8ba006bfa0 0x7f8ba006e460 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:59.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.577+0000 7f8b9affd640 1 --2- 172.21.15.100:0/1702288685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ba80d4930 0x7f8ba8197990 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:59.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.577+0000 7f8b9affd640 1 --2- 172.21.15.100:0/1702288685 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ba804c080 0x7f8ba80c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:59.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.577+0000 7f8b9affd640 1 --2- 172.21.15.100:0/1702288685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ba80450e0 0x7f8ba80d7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:33:59.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.577+0000 7f8b9affd640 1 -- 172.21.15.100:0/1702288685 >> 172.21.15.100:0/1702288685 conn(0x7f8ba804fc40 msgr2=0x7f8ba80d2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:33:59.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.578+0000 7f8b9affd640 1 -- 172.21.15.100:0/1702288685 shutdown_connections 2024-09-11T22:33:59.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:33:59.578+0000 7f8b9affd640 1 -- 172.21.15.100:0/1702288685 wait complete. 2024-09-11T22:34:02.600 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:34:02.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.810+0000 7f80cfaf1640 1 Processor -- start 2024-09-11T22:34:02.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.810+0000 7f80cfaf1640 1 -- start start 2024-09-11T22:34:02.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.811+0000 7f80cfaf1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80c80c37b0 0x7f80c815ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:02.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.811+0000 7f80cfaf1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f80c80c7a00 0x7f80c8075670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:02.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.811+0000 7f80cfaf1640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80c80c8650 con 0x7f80c8150dc0 2024-09-11T22:34:02.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.811+0000 7f80cfaf1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f80c80c8ef0 con 0x7f80c80c7a00 2024-09-11T22:34:02.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.811+0000 7f80cfaf1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f80c80c8930 con 0x7f80c80c37b0 2024-09-11T22:34:02.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.812+0000 7f80ce08e640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f80c8150dc0 legacy=0x7f80c80c92f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:34:02.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.812+0000 7f80cd88d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80c80c37b0 0x7f80c815ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:02.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.812+0000 7f80cd08c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f80c80c7a00 0x7f80c8075670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:02.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.812+0000 7f80cd08c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f80c80c7a00 0x7f80c8075670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:54682/0 (socket says 172.21.15.100:54682) 2024-09-11T22:34:02.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.812+0000 7f80cd08c640 1 -- 172.21.15.100:0/663727774 learned_addr learned my addr 172.21.15.100:0/663727774 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:02.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.812+0000 7f80cd08c640 1 -- 172.21.15.100:0/663727774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80c80c37b0 msgr2=0x7f80c815ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:02.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.812+0000 7f80cd08c640 1 --2- 172.21.15.100:0/663727774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80c80c37b0 0x7f80c815ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:02.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.812+0000 7f80cd08c640 1 -- 172.21.15.100:0/663727774 >> v1:172.21.15.100:6789/0 conn(0x7f80c8150dc0 legacy=0x7f80c80c92f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:34:02.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.812+0000 7f80cd08c640 1 -- 172.21.15.100:0/663727774 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c80c8c10 con 0x7f80c80c7a00 2024-09-11T22:34:02.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.814+0000 7f80cd08c640 1 --2- 172.21.15.100:0/663727774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80c80c7a00 0x7f80c8075670 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009870 tx=0x7f80c402a2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41d5b4eee35da291 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:02.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.814+0000 7f80cc88b640 1 -- 172.21.15.100:0/663727774 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c4037070 con 0x7f80c80c7a00 2024-09-11T22:34:02.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.814+0000 7f80cc88b640 1 -- 172.21.15.100:0/663727774 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80c4032440 con 0x7f80c80c7a00 2024-09-11T22:34:02.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.814+0000 7f80cc88b640 1 -- 172.21.15.100:0/663727774 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c4037070 con 0x7f80c80c7a00 2024-09-11T22:34:02.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.815+0000 7f80cfaf1640 1 -- 172.21.15.100:0/663727774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80c80c7a00 msgr2=0x7f80c8075670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:02.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.815+0000 7f80cfaf1640 1 --2- 172.21.15.100:0/663727774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80c80c7a00 0x7f80c8075670 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009870 tx=0x7f80c402a2a0 comp rx=0 tx=0).stop 2024-09-11T22:34:02.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.815+0000 7f80cfaf1640 1 -- 172.21.15.100:0/663727774 shutdown_connections 2024-09-11T22:34:02.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.815+0000 7f80cfaf1640 1 --2- 172.21.15.100:0/663727774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80c80c7a00 0x7f80c8075670 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009870 tx=0x7f80c402a2a0 comp rx=0 tx=0).stop 2024-09-11T22:34:02.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.815+0000 7f80cfaf1640 1 --2- 172.21.15.100:0/663727774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80c80c37b0 0x7f80c815ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:02.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.815+0000 7f80cfaf1640 1 -- 172.21.15.100:0/663727774 >> 172.21.15.100:0/663727774 conn(0x7f80c806bc10 msgr2=0x7f80c806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:02.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.819+0000 7f80cfaf1640 1 -- 172.21.15.100:0/663727774 shutdown_connections 2024-09-11T22:34:02.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.820+0000 7f80cfaf1640 1 -- 172.21.15.100:0/663727774 wait complete. 2024-09-11T22:34:02.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.821+0000 7f80cfaf1640 1 Processor -- start 2024-09-11T22:34:02.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.822+0000 7f80cfaf1640 1 -- start start 2024-09-11T22:34:02.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.823+0000 7f80cfaf1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80c80c37b0 0x7f80c8154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:02.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.823+0000 7f80cfaf1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80c8150dc0 0x7f80c8155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:02.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.823+0000 7f80cfaf1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c8143a60 0x7f80c8143ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:02.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.823+0000 7f80ce08e640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c8143a60 msgr2=0x7f80c8143ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:34:02.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.823+0000 7f80ce08e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c8143a60 0x7f80c8143ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:34:02.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.823+0000 7f80cfaf1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f80c815b270 con 0x7f80c8143a60 2024-09-11T22:34:02.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.823+0000 7f80cd88d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80c80c37b0 0x7f80c8154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:02.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.823+0000 7f80cfaf1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f80c815a810 con 0x7f80c80c37b0 2024-09-11T22:34:02.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.823+0000 7f80cfaf1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f80c8075bb0 con 0x7f80c8150dc0 2024-09-11T22:34:02.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.823+0000 7f80cd88d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80c80c37b0 0x7f80c8154ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:54692/0 (socket says 172.21.15.100:54692) 2024-09-11T22:34:02.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.823+0000 7f80cd88d640 1 -- 172.21.15.100:0/1616633131 learned_addr learned my addr 172.21.15.100:0/1616633131 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:02.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.823+0000 7f80cd08c640 1 --2- 172.21.15.100:0/1616633131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80c8150dc0 0x7f80c8155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:02.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.824+0000 7f80cd88d640 1 -- 172.21.15.100:0/1616633131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80c8150dc0 msgr2=0x7f80c8155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:02.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.824+0000 7f80cd88d640 1 --2- 172.21.15.100:0/1616633131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80c8150dc0 0x7f80c8155220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:02.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.824+0000 7f80cd88d640 1 -- 172.21.15.100:0/1616633131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c8143a60 msgr2=0x7f80c8143ef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:34:02.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.824+0000 7f80cd88d640 1 --2- 172.21.15.100:0/1616633131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c8143a60 0x7f80c8143ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:02.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.824+0000 7f80cd88d640 1 -- 172.21.15.100:0/1616633131 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c8153060 con 0x7f80c80c37b0 2024-09-11T22:34:02.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.824+0000 7f80cd88d640 1 --2- 172.21.15.100:0/1616633131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80c80c37b0 0x7f80c8154ce0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f80bc00d5f0 tx=0x7f80bc00dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:02.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.830+0000 7f80ba7fc640 1 -- 172.21.15.100:0/1616633131 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc0125f0 con 0x7f80c80c37b0 2024-09-11T22:34:02.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.830+0000 7f80ba7fc640 1 -- 172.21.15.100:0/1616633131 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80bc019070 con 0x7f80c80c37b0 2024-09-11T22:34:02.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.830+0000 7f80ba7fc640 1 -- 172.21.15.100:0/1616633131 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc0129d0 con 0x7f80c80c37b0 2024-09-11T22:34:02.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.831+0000 7f80cfaf1640 1 -- 172.21.15.100:0/1616633131 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c8153340 con 0x7f80c80c37b0 2024-09-11T22:34:02.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.831+0000 7f80cfaf1640 1 -- 172.21.15.100:0/1616633131 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c8153900 con 0x7f80c80c37b0 2024-09-11T22:34:02.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.834+0000 7f80cfaf1640 1 -- 172.21.15.100:0/1616633131 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80c80c6f80 con 0x7f80c80c37b0 2024-09-11T22:34:02.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.836+0000 7f80ba7fc640 1 -- 172.21.15.100:0/1616633131 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f80bc012b70 con 0x7f80c80c37b0 2024-09-11T22:34:02.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.836+0000 7f80ba7fc640 1 --2- 172.21.15.100:0/1616633131 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f80ac06be60 0x7f80ac06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:02.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.837+0000 7f80ba7fc640 1 -- 172.21.15.100:0/1616633131 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f80bc08c130 con 0x7f80c80c37b0 2024-09-11T22:34:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.837+0000 7f80cd08c640 1 --2- 172.21.15.100:0/1616633131 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f80ac06be60 0x7f80ac06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.838+0000 7f80cd08c640 1 --2- 172.21.15.100:0/1616633131 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f80ac06be60 0x7f80ac06e320 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f80c4034000 tx=0x7f80c402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:02.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:02.844+0000 7f80ba7fc640 1 -- 172.21.15.100:0/1616633131 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f80c80c6f80 con 0x7f80c80c37b0 2024-09-11T22:34:03.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:03.334+0000 7f80cfaf1640 1 -- 172.21.15.100:0/1616633131 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f80c806f840 con 0x7f80c80c37b0 2024-09-11T22:34:03.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:03.335+0000 7f80ba7fc640 1 -- 172.21.15.100:0/1616633131 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f80bc05a6a0 con 0x7f80c80c37b0 2024-09-11T22:34:03.336 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":98,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:34:03.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:03.339+0000 7f80cfaf1640 1 -- 172.21.15.100:0/1616633131 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f80ac06be60 msgr2=0x7f80ac06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:03.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:03.339+0000 7f80cfaf1640 1 --2- 172.21.15.100:0/1616633131 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f80ac06be60 0x7f80ac06e320 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f80c4034000 tx=0x7f80c402e000 comp rx=0 tx=0).stop 2024-09-11T22:34:03.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:03.339+0000 7f80cfaf1640 1 -- 172.21.15.100:0/1616633131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80c80c37b0 msgr2=0x7f80c8154ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:03.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:03.339+0000 7f80cfaf1640 1 --2- 172.21.15.100:0/1616633131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80c80c37b0 0x7f80c8154ce0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f80bc00d5f0 tx=0x7f80bc00dab0 comp rx=0 tx=0).stop 2024-09-11T22:34:03.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:03.342+0000 7f80cfaf1640 1 -- 172.21.15.100:0/1616633131 shutdown_connections 2024-09-11T22:34:03.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:03.342+0000 7f80cfaf1640 1 --2- 172.21.15.100:0/1616633131 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f80ac06be60 0x7f80ac06e320 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:03.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:03.342+0000 7f80cfaf1640 1 --2- 172.21.15.100:0/1616633131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c8143a60 0x7f80c8143ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:03.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:03.342+0000 7f80cfaf1640 1 --2- 172.21.15.100:0/1616633131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80c8150dc0 0x7f80c8155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:03.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:03.342+0000 7f80cfaf1640 1 --2- 172.21.15.100:0/1616633131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80c80c37b0 0x7f80c8154ce0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:03.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:03.342+0000 7f80cfaf1640 1 -- 172.21.15.100:0/1616633131 >> 172.21.15.100:0/1616633131 conn(0x7f80c806bc10 msgr2=0x7f80c80c50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:03.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:03.348+0000 7f80cfaf1640 1 -- 172.21.15.100:0/1616633131 shutdown_connections 2024-09-11T22:34:03.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:03.348+0000 7f80cfaf1640 1 -- 172.21.15.100:0/1616633131 wait complete. 2024-09-11T22:34:06.368 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:34:06.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.565+0000 7fc631cae640 1 Processor -- start 2024-09-11T22:34:06.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.565+0000 7fc631cae640 1 -- start start 2024-09-11T22:34:06.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.566+0000 7fc631cae640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc62c06c260 0x7fc62c0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:06.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.566+0000 7fc631cae640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc62c0c8380 con 0x7fc62c06be80 2024-09-11T22:34:06.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.566+0000 7fc631cae640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc62c072960 con 0x7fc62c0c2380 2024-09-11T22:34:06.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.566+0000 7fc631cae640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc62c072c40 con 0x7fc62c06c260 2024-09-11T22:34:06.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.568+0000 7fc62bfff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fc62c0c2380 0x7fc62c16b050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:54594/0 (socket says 172.21.15.100:54594) 2024-09-11T22:34:06.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.568+0000 7fc62bfff640 1 -- 172.21.15.100:0/772699504 learned_addr learned my addr 172.21.15.100:0/772699504 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:34:06.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.568+0000 7fc62b7fe640 1 -- 172.21.15.100:0/772699504 >> v1:172.21.15.100:6789/0 conn(0x7fc62c06be80 legacy=0x7fc62c0c1c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:34:06.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.569+0000 7fc62affd640 1 --2- 172.21.15.100:0/772699504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc62c06c260 0x7fc62c0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:06.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.572+0000 7fc62affd640 1 -- 172.21.15.100:0/772699504 >> v1:172.21.15.167:6789/0 conn(0x7fc62c0c2380 legacy=0x7fc62c16b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:06.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.572+0000 7fc62affd640 1 -- 172.21.15.100:0/772699504 >> v1:172.21.15.100:6789/0 conn(0x7fc62c06be80 legacy=0x7fc62c0c1c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:34:06.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.572+0000 7fc62affd640 1 -- 172.21.15.100:0/772699504 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc62c072f20 con 0x7fc62c06c260 2024-09-11T22:34:06.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.574+0000 7fc62affd640 1 --2- 172.21.15.100:0/772699504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc62c06c260 0x7fc62c0c7cf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc6200097d0 tx=0x7fc62002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc7ce3c0e4a96dea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:06.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.575+0000 7fc62a7fc640 1 -- 172.21.15.100:0/772699504 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620037070 con 0x7fc62c06c260 2024-09-11T22:34:06.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.575+0000 7fc62a7fc640 1 -- 172.21.15.100:0/772699504 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc620032440 con 0x7fc62c06c260 2024-09-11T22:34:06.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.575+0000 7fc62a7fc640 1 -- 172.21.15.100:0/772699504 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620032850 con 0x7fc62c06c260 2024-09-11T22:34:06.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.576+0000 7fc631cae640 1 -- 172.21.15.100:0/772699504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc62c06c260 msgr2=0x7fc62c0c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:06.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.576+0000 7fc631cae640 1 --2- 172.21.15.100:0/772699504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc62c06c260 0x7fc62c0c7cf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc6200097d0 tx=0x7fc62002a270 comp rx=0 tx=0).stop 2024-09-11T22:34:06.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.576+0000 7fc631cae640 1 -- 172.21.15.100:0/772699504 shutdown_connections 2024-09-11T22:34:06.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.576+0000 7fc631cae640 1 --2- 172.21.15.100:0/772699504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc62c06c260 0x7fc62c0c7cf0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:06.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.576+0000 7fc631cae640 1 -- 172.21.15.100:0/772699504 >> 172.21.15.100:0/772699504 conn(0x7fc62c0cbf70 msgr2=0x7fc62c0cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:06.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.579+0000 7fc631cae640 1 -- 172.21.15.100:0/772699504 shutdown_connections 2024-09-11T22:34:06.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.579+0000 7fc631cae640 1 -- 172.21.15.100:0/772699504 wait complete. 2024-09-11T22:34:06.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.580+0000 7fc631cae640 1 Processor -- start 2024-09-11T22:34:06.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.581+0000 7fc631cae640 1 -- start start 2024-09-11T22:34:06.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.582+0000 7fc631cae640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc62c06be80 0x7fc62c1658c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:06.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.582+0000 7fc631cae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc62c06c260 0x7fc62c0c3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:06.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.582+0000 7fc631cae640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc62c0c2380 0x7fc62c201960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:06.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.582+0000 7fc631cae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c0c3000 con 0x7fc62c06c260 2024-09-11T22:34:06.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.582+0000 7fc631cae640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c06cc70 con 0x7fc62c06be80 2024-09-11T22:34:06.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.582+0000 7fc631cae640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc62c0c4c60 con 0x7fc62c0c2380 2024-09-11T22:34:06.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.582+0000 7fc62bfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc62c0c2380 0x7fc62c201960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:06.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.582+0000 7fc62bfff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc62c0c2380 0x7fc62c201960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:53414/0 (socket says 172.21.15.100:53414) 2024-09-11T22:34:06.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.582+0000 7fc62bfff640 1 -- 172.21.15.100:0/2509660468 learned_addr learned my addr 172.21.15.100:0/2509660468 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:06.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.583+0000 7fc62bfff640 1 -- 172.21.15.100:0/2509660468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc62c06be80 msgr2=0x7fc62c1658c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:34:06.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.583+0000 7fc62bfff640 1 --2- 172.21.15.100:0/2509660468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc62c06be80 0x7fc62c1658c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:06.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.583+0000 7fc62bfff640 1 -- 172.21.15.100:0/2509660468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc62c06c260 msgr2=0x7fc62c0c3350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:34:06.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.583+0000 7fc62affd640 1 -- 172.21.15.100:0/2509660468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc62c06c260 msgr2=0x7fc62c0c3350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:34:06.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.583+0000 7fc62affd640 1 --2- 172.21.15.100:0/2509660468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc62c06c260 0x7fc62c0c3350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:34:06.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.583+0000 7fc62bfff640 1 --2- 172.21.15.100:0/2509660468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc62c06c260 0x7fc62c0c3350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:06.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.583+0000 7fc62bfff640 1 -- 172.21.15.100:0/2509660468 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc62c0c3890 con 0x7fc62c0c2380 2024-09-11T22:34:06.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.583+0000 7fc62bfff640 1 --2- 172.21.15.100:0/2509660468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc62c0c2380 0x7fc62c201960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc62400b870 tx=0x7fc62400bd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:06.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.584+0000 7fc613fff640 1 -- 172.21.15.100:0/2509660468 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62400cbf0 con 0x7fc62c0c2380 2024-09-11T22:34:06.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.584+0000 7fc631cae640 1 -- 172.21.15.100:0/2509660468 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc62c202da0 con 0x7fc62c0c2380 2024-09-11T22:34:06.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.584+0000 7fc631cae640 1 -- 172.21.15.100:0/2509660468 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc62c203360 con 0x7fc62c0c2380 2024-09-11T22:34:06.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.584+0000 7fc613fff640 1 -- 172.21.15.100:0/2509660468 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc624010070 con 0x7fc62c0c2380 2024-09-11T22:34:06.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.585+0000 7fc631cae640 1 -- 172.21.15.100:0/2509660468 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc60c005290 con 0x7fc62c0c2380 2024-09-11T22:34:06.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.587+0000 7fc613fff640 1 -- 172.21.15.100:0/2509660468 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc624015470 con 0x7fc62c0c2380 2024-09-11T22:34:06.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.590+0000 7fc613fff640 1 -- 172.21.15.100:0/2509660468 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc624015610 con 0x7fc62c0c2380 2024-09-11T22:34:06.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.590+0000 7fc613fff640 1 --2- 172.21.15.100:0/2509660468 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc61406bfb0 0x7fc61406e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:06.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.590+0000 7fc613fff640 1 -- 172.21.15.100:0/2509660468 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fc62408b4c0 con 0x7fc62c0c2380 2024-09-11T22:34:06.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.591+0000 7fc62b7fe640 1 --2- 172.21.15.100:0/2509660468 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc61406bfb0 0x7fc61406e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:06.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.592+0000 7fc62b7fe640 1 --2- 172.21.15.100:0/2509660468 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc61406bfb0 0x7fc61406e470 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0049c0 tx=0x7fc61c006c20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:06.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:06.599+0000 7fc613fff640 1 -- 172.21.15.100:0/2509660468 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc624059a30 con 0x7fc62c0c2380 2024-09-11T22:34:07.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:07.156+0000 7fc631cae640 1 -- 172.21.15.100:0/2509660468 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc60c005580 con 0x7fc62c0c2380 2024-09-11T22:34:07.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:07.161+0000 7fc613fff640 1 -- 172.21.15.100:0/2509660468 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7fc624059330 con 0x7fc62c0c2380 2024-09-11T22:34:07.162 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":98,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":23,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:34:07.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:07.173+0000 7fc631cae640 1 -- 172.21.15.100:0/2509660468 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc61406bfb0 msgr2=0x7fc61406e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:07.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:07.173+0000 7fc631cae640 1 --2- 172.21.15.100:0/2509660468 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc61406bfb0 0x7fc61406e470 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0049c0 tx=0x7fc61c006c20 comp rx=0 tx=0).stop 2024-09-11T22:34:07.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:07.173+0000 7fc631cae640 1 -- 172.21.15.100:0/2509660468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc62c0c2380 msgr2=0x7fc62c201960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:07.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:07.173+0000 7fc631cae640 1 --2- 172.21.15.100:0/2509660468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc62c0c2380 0x7fc62c201960 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc62400b870 tx=0x7fc62400bd30 comp rx=0 tx=0).stop 2024-09-11T22:34:07.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:07.174+0000 7fc631cae640 1 -- 172.21.15.100:0/2509660468 shutdown_connections 2024-09-11T22:34:07.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:07.174+0000 7fc631cae640 1 --2- 172.21.15.100:0/2509660468 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc61406bfb0 0x7fc61406e470 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:07.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:07.174+0000 7fc631cae640 1 --2- 172.21.15.100:0/2509660468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc62c0c2380 0x7fc62c201960 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:07.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:07.174+0000 7fc631cae640 1 --2- 172.21.15.100:0/2509660468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc62c06c260 0x7fc62c0c3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:07.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:07.174+0000 7fc631cae640 1 --2- 172.21.15.100:0/2509660468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc62c06be80 0x7fc62c1658c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:07.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:07.174+0000 7fc631cae640 1 -- 172.21.15.100:0/2509660468 >> 172.21.15.100:0/2509660468 conn(0x7fc62c0cbf70 msgr2=0x7fc62c073820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:07.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:07.174+0000 7fc631cae640 1 -- 172.21.15.100:0/2509660468 shutdown_connections 2024-09-11T22:34:07.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:07.174+0000 7fc631cae640 1 -- 172.21.15.100:0/2509660468 wait complete. 2024-09-11T22:34:10.200 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:34:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.387+0000 7fa0ae8cf640 1 Processor -- start 2024-09-11T22:34:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.387+0000 7fa0ae8cf640 1 -- start start 2024-09-11T22:34:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.388+0000 7fa0ae8cf640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa0a8158ee0 0x7fa0a815eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.388+0000 7fa0ae8cf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 0x7fa0a80c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.388+0000 7fa0ae8cf640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0a80c0ee0 con 0x7fa0a80c2d90 2024-09-11T22:34:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.388+0000 7fa0ae8cf640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fa0a80c1150 con 0x7fa0a8158ee0 2024-09-11T22:34:10.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.388+0000 7fa0ae8cf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa0a80c1430 con 0x7fa0a806f930 2024-09-11T22:34:10.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.388+0000 7fa0ae0ce640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7fa0a80c2d90 legacy=0x7fa0a80c7830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:34:10.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.390+0000 7fa0ad0cc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 0x7fa0a80c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:10.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.390+0000 7fa0ad0cc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 0x7fa0a80c21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:53416/0 (socket says 172.21.15.100:53416) 2024-09-11T22:34:10.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.390+0000 7fa0ad0cc640 1 -- 172.21.15.100:0/24130886 learned_addr learned my addr 172.21.15.100:0/24130886 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:10.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.390+0000 7fa0ad8cd640 1 --2- 172.21.15.100:0/24130886 >> v2:172.21.15.167:3300/0 conn(0x7fa0a8158ee0 0x7fa0a815eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:10.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.390+0000 7fa0ad0cc640 1 -- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 msgr2=0x7fa0a80c21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:34:10.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.390+0000 7fa0ad0cc640 1 -- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 msgr2=0x7fa0a80c21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:34:10.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.390+0000 7fa0ad0cc640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 0x7fa0a80c21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:34:10.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.390+0000 7fa0ad0cc640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 0x7fa0a80c21f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:34:10.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.390+0000 7fa0ad8cd640 1 -- 172.21.15.100:0/24130886 >> v2:172.21.15.167:3300/0 conn(0x7fa0a8158ee0 msgr2=0x7fa0a815eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:34:10.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.390+0000 7fa0ad8cd640 1 -- 172.21.15.100:0/24130886 >> v2:172.21.15.167:3300/0 conn(0x7fa0a8158ee0 msgr2=0x7fa0a815eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:34:10.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.390+0000 7fa0ad8cd640 1 --2- 172.21.15.100:0/24130886 >> v2:172.21.15.167:3300/0 conn(0x7fa0a8158ee0 0x7fa0a815eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:34:10.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.390+0000 7fa0ad8cd640 1 --2- 172.21.15.100:0/24130886 >> v2:172.21.15.167:3300/0 conn(0x7fa0a8158ee0 0x7fa0a815eba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:34:10.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.589+0000 7fa0ae0ce640 1 -- 172.21.15.100:0/24130886 >> v1:172.21.15.100:6789/0 conn(0x7fa0a80c2d90 legacy=0x7fa0a80c7830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:34:10.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.591+0000 7fa0ad0cc640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 0x7fa0a80c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:10.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.591+0000 7fa0ad0cc640 1 -- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 msgr2=0x7fa0a80c21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:34:10.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.591+0000 7fa0ad0cc640 1 -- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 msgr2=0x7fa0a80c21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:34:10.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.591+0000 7fa0ad0cc640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 0x7fa0a80c21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:34:10.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.591+0000 7fa0ad0cc640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 0x7fa0a80c21f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:34:10.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.591+0000 7fa0ad8cd640 1 --2- 172.21.15.100:0/24130886 >> v2:172.21.15.167:3300/0 conn(0x7fa0a8158ee0 0x7fa0a815eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:10.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.591+0000 7fa0ad8cd640 1 -- 172.21.15.100:0/24130886 >> v2:172.21.15.167:3300/0 conn(0x7fa0a8158ee0 msgr2=0x7fa0a815eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:34:10.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.591+0000 7fa0ad8cd640 1 -- 172.21.15.100:0/24130886 >> v2:172.21.15.167:3300/0 conn(0x7fa0a8158ee0 msgr2=0x7fa0a815eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:34:10.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.591+0000 7fa0ad8cd640 1 --2- 172.21.15.100:0/24130886 >> v2:172.21.15.167:3300/0 conn(0x7fa0a8158ee0 0x7fa0a815eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:34:10.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.591+0000 7fa0ad8cd640 1 --2- 172.21.15.100:0/24130886 >> v2:172.21.15.167:3300/0 conn(0x7fa0a8158ee0 0x7fa0a815eba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:34:10.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.990+0000 7fa0ae0ce640 1 -- 172.21.15.100:0/24130886 >> v1:172.21.15.100:6789/0 conn(0x7fa0a80c2d90 legacy=0x7fa0a80c7830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:34:10.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.994+0000 7fa0ad8cd640 1 --2- 172.21.15.100:0/24130886 >> v2:172.21.15.167:3300/0 conn(0x7fa0a8158ee0 0x7fa0a815eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:10.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.994+0000 7fa0ad0cc640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 0x7fa0a80c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:10.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.994+0000 7fa0ad0cc640 1 -- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 msgr2=0x7fa0a80c21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:34:10.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.994+0000 7fa0ad0cc640 1 -- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 msgr2=0x7fa0a80c21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:34:10.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.994+0000 7fa0ad0cc640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 0x7fa0a80c21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:34:10.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.994+0000 7fa0ad0cc640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 0x7fa0a80c21f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:34:10.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.994+0000 7fa0ad8cd640 1 -- 172.21.15.100:0/24130886 >> v2:172.21.15.167:3300/0 conn(0x7fa0a8158ee0 msgr2=0x7fa0a815eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:34:10.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.994+0000 7fa0ad8cd640 1 -- 172.21.15.100:0/24130886 >> v2:172.21.15.167:3300/0 conn(0x7fa0a8158ee0 msgr2=0x7fa0a815eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:34:10.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.994+0000 7fa0ad8cd640 1 --2- 172.21.15.100:0/24130886 >> v2:172.21.15.167:3300/0 conn(0x7fa0a8158ee0 0x7fa0a815eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:34:10.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:10.994+0000 7fa0ad8cd640 1 --2- 172.21.15.100:0/24130886 >> v2:172.21.15.167:3300/0 conn(0x7fa0a8158ee0 0x7fa0a815eba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:34:11.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:11.792+0000 7fa0ae0ce640 1 -- 172.21.15.100:0/24130886 >> v1:172.21.15.100:6789/0 conn(0x7fa0a80c2d90 legacy=0x7fa0a80c7830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:34:11.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:11.796+0000 7fa0ad0cc640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 0x7fa0a80c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:11.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:11.796+0000 7fa0ad8cd640 1 --2- 172.21.15.100:0/24130886 >> v2:172.21.15.167:3300/0 conn(0x7fa0a8158ee0 0x7fa0a815eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:11.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:11.796+0000 7fa0ad8cd640 1 -- 172.21.15.100:0/24130886 >> v2:172.21.15.167:3300/0 conn(0x7fa0a8158ee0 msgr2=0x7fa0a815eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:34:11.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:11.796+0000 7fa0ad8cd640 1 -- 172.21.15.100:0/24130886 >> v2:172.21.15.167:3300/0 conn(0x7fa0a8158ee0 msgr2=0x7fa0a815eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:34:11.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:11.796+0000 7fa0ad8cd640 1 --2- 172.21.15.100:0/24130886 >> v2:172.21.15.167:3300/0 conn(0x7fa0a8158ee0 0x7fa0a815eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:34:11.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:11.796+0000 7fa0ad0cc640 1 -- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 msgr2=0x7fa0a80c21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:34:11.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:11.796+0000 7fa0ad0cc640 1 -- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 msgr2=0x7fa0a80c21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:34:11.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:11.796+0000 7fa0ad0cc640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 0x7fa0a80c21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:34:11.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:11.796+0000 7fa0ad8cd640 1 --2- 172.21.15.100:0/24130886 >> v2:172.21.15.167:3300/0 conn(0x7fa0a8158ee0 0x7fa0a815eba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:34:11.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:11.796+0000 7fa0ad0cc640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 0x7fa0a80c21f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:34:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.389+0000 7fa09f7fe640 1 -- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 msgr2=0x7fa0a80c21f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:34:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.389+0000 7fa09f7fe640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 0x7fa0a80c21f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.389+0000 7fa09f7fe640 1 -- 172.21.15.100:0/24130886 >> v2:172.21.15.167:3300/0 conn(0x7fa0a8158ee0 msgr2=0x7fa0a815eba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:34:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.389+0000 7fa09f7fe640 1 --2- 172.21.15.100:0/24130886 >> v2:172.21.15.167:3300/0 conn(0x7fa0a8158ee0 0x7fa0a815eba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.389+0000 7fa09f7fe640 1 -- 172.21.15.100:0/24130886 >> v1:172.21.15.100:6789/0 conn(0x7fa0a80c2d90 legacy=0x7fa0a80c7830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:34:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.389+0000 7fa09f7fe640 1 --2- 172.21.15.100:0/24130886 >> v2:172.21.15.100:3300/0 conn(0x7fa08c0036c0 0x7fa08c005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.389+0000 7fa09f7fe640 1 -- 172.21.15.100:0/24130886 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0a80c1710 con 0x7fa08c006190 2024-09-11T22:34:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.389+0000 7fa09f7fe640 1 -- 172.21.15.100:0/24130886 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fa0a80c1150 con 0x7fa08c0036c0 2024-09-11T22:34:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.390+0000 7fa0ad8cd640 1 -- 172.21.15.100:0/24130886 >> v2:172.21.15.100:3300/0 conn(0x7fa08c0036c0 msgr2=0x7fa08c005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:34:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.390+0000 7fa0ad8cd640 1 --2- 172.21.15.100:0/24130886 >> v2:172.21.15.100:3300/0 conn(0x7fa08c0036c0 0x7fa08c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:34:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.591+0000 7fa0ad8cd640 1 -- 172.21.15.100:0/24130886 >> v2:172.21.15.100:3300/0 conn(0x7fa08c0036c0 msgr2=0x7fa08c005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:34:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.591+0000 7fa0ad8cd640 1 --2- 172.21.15.100:0/24130886 >> v2:172.21.15.100:3300/0 conn(0x7fa08c0036c0 0x7fa08c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:34:13.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.773+0000 7fa0ac8cb640 1 -- 172.21.15.100:0/24130886 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 588786765 0 0) 0x7fa0a80c1710 con 0x7fa08c006190 2024-09-11T22:34:13.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.773+0000 7fa0ac8cb640 1 -- 172.21.15.100:0/24130886 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa094003520 con 0x7fa08c006190 2024-09-11T22:34:13.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.795+0000 7fa0ac8cb640 1 -- 172.21.15.100:0/24130886 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2627060971 0 0) 0x7fa094003520 con 0x7fa08c006190 2024-09-11T22:34:13.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.795+0000 7fa0ac8cb640 1 -- 172.21.15.100:0/24130886 >> v2:172.21.15.100:3300/0 conn(0x7fa08c0036c0 msgr2=0x7fa08c005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:34:13.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.795+0000 7fa0ac8cb640 1 --2- 172.21.15.100:0/24130886 >> v2:172.21.15.100:3300/0 conn(0x7fa08c0036c0 0x7fa08c005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:13.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.795+0000 7fa0ac8cb640 1 -- 172.21.15.100:0/24130886 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a80c0ee0 con 0x7fa08c006190 2024-09-11T22:34:13.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.795+0000 7fa0ac8cb640 1 -- 172.21.15.100:0/24130886 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fa09800f040 con 0x7fa08c006190 2024-09-11T22:34:13.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.795+0000 7fa0ac8cb640 1 -- 172.21.15.100:0/24130886 >> v1:172.21.15.167:6789/0 conn(0x7fa08c006190 legacy=0x7fa08c008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:13.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.796+0000 7fa0ac8cb640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0940039d0 0x7fa094003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:13.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.796+0000 7fa0ac8cb640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 0x7fa094004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:13.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.796+0000 7fa0ac8cb640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa094004e10 0x7fa094005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:13.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.796+0000 7fa0ac8cb640 1 -- 172.21.15.100:0/24130886 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a80c1150 con 0x7fa094004e10 2024-09-11T22:34:13.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.796+0000 7fa0ac8cb640 1 -- 172.21.15.100:0/24130886 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa09400bc70 con 0x7fa0940039d0 2024-09-11T22:34:13.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.796+0000 7fa0ac8cb640 1 -- 172.21.15.100:0/24130886 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa09400be70 con 0x7fa0a806f930 2024-09-11T22:34:13.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.796+0000 7fa0ae0ce640 1 -- 172.21.15.100:0/24130886 reap_dead start 2024-09-11T22:34:13.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.796+0000 7fa0ae0ce640 1 -- 172.21.15.100:0/24130886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa094004e10 msgr2=0x7fa094005290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:34:13.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.796+0000 7fa0ae0ce640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa094004e10 0x7fa094005290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:34:13.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.801+0000 7fa0ad8cd640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0940039d0 0x7fa094003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:13.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.802+0000 7fa0ad0cc640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 0x7fa094004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:13.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.802+0000 7fa0ad0cc640 1 -- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0940039d0 msgr2=0x7fa094003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:13.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.802+0000 7fa0ad0cc640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0940039d0 0x7fa094003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:13.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.802+0000 7fa0ad0cc640 1 -- 172.21.15.100:0/24130886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa094004e10 msgr2=0x7fa094005290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:34:13.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.802+0000 7fa0ad0cc640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa094004e10 0x7fa094005290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:13.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.802+0000 7fa0ad0cc640 1 -- 172.21.15.100:0/24130886 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a80c0ee0 con 0x7fa0a806f930 2024-09-11T22:34:13.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.803+0000 7fa0ad0cc640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 0x7fa094004800 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009d90 tx=0x7fa094005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f808a93021188a14 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:13.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.804+0000 7fa0ac8cb640 1 -- 172.21.15.100:0/24130886 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa098031070 con 0x7fa0a806f930 2024-09-11T22:34:13.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.804+0000 7fa0ac8cb640 1 -- 172.21.15.100:0/24130886 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa09802f070 con 0x7fa0a806f930 2024-09-11T22:34:13.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.805+0000 7fa0ae8cf640 1 -- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 msgr2=0x7fa094004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:13.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.805+0000 7fa0ae8cf640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 0x7fa094004800 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009d90 tx=0x7fa094005830 comp rx=0 tx=0).stop 2024-09-11T22:34:13.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.805+0000 7fa0ae8cf640 1 -- 172.21.15.100:0/24130886 shutdown_connections 2024-09-11T22:34:13.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.805+0000 7fa0ae8cf640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa094004e10 0x7fa094005290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:13.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.805+0000 7fa0ae8cf640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0a806f930 0x7fa094004800 secure :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa08c009d90 tx=0x7fa094005830 comp rx=0 tx=0).stop 2024-09-11T22:34:13.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.805+0000 7fa0ae8cf640 1 --2- 172.21.15.100:0/24130886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0940039d0 0x7fa094003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:13.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.805+0000 7fa0ae8cf640 1 -- 172.21.15.100:0/24130886 >> 172.21.15.100:0/24130886 conn(0x7fa0a806ee10 msgr2=0x7fa0a806f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:13.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.805+0000 7fa0ae8cf640 1 -- 172.21.15.100:0/24130886 shutdown_connections 2024-09-11T22:34:13.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.808+0000 7fa0ae8cf640 1 -- 172.21.15.100:0/24130886 wait complete. 2024-09-11T22:34:13.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.810+0000 7fa0ae8cf640 1 Processor -- start 2024-09-11T22:34:13.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.810+0000 7fa0ae8cf640 1 -- start start 2024-09-11T22:34:13.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.811+0000 7fa0ae8cf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0940039d0 0x7fa0a8132070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:13.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.811+0000 7fa0ae8cf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa094004e10 0x7fa0a815c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:13.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.811+0000 7fa0ae8cf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0a815db50 0x7fa0a815cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:13.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.811+0000 7fa0ae8cf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a81592c0 con 0x7fa094004e10 2024-09-11T22:34:13.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.811+0000 7fa0ae8cf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a80c1cd0 con 0x7fa0a815db50 2024-09-11T22:34:13.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.811+0000 7fa0ae8cf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fa0a806e6f0 con 0x7fa0940039d0 2024-09-11T22:34:13.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.812+0000 7fa0ae0ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0a815db50 0x7fa0a815cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:13.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.812+0000 7fa0ae0ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0a815db50 0x7fa0a815cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:37486/0 (socket says 172.21.15.100:37486) 2024-09-11T22:34:13.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.812+0000 7fa0ae0ce640 1 -- 172.21.15.100:0/1169420606 learned_addr learned my addr 172.21.15.100:0/1169420606 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:13.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.812+0000 7fa0ad0cc640 1 -- 172.21.15.100:0/1169420606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa094004e10 msgr2=0x7fa0a815c800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:34:13.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.812+0000 7fa0ad0cc640 1 --2- 172.21.15.100:0/1169420606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa094004e10 0x7fa0a815c800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:34:13.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.813+0000 7fa0ae0ce640 1 -- 172.21.15.100:0/1169420606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0940039d0 msgr2=0x7fa0a8132070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:13.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.813+0000 7fa0ae0ce640 1 --2- 172.21.15.100:0/1169420606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0940039d0 0x7fa0a8132070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:13.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.813+0000 7fa0ae0ce640 1 -- 172.21.15.100:0/1169420606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa094004e10 msgr2=0x7fa0a815c800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:34:13.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.813+0000 7fa0ae0ce640 1 --2- 172.21.15.100:0/1169420606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa094004e10 0x7fa0a815c800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:13.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.813+0000 7fa0ae0ce640 1 -- 172.21.15.100:0/1169420606 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a8134ed0 con 0x7fa0a815db50 2024-09-11T22:34:13.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.816+0000 7fa0ae0ce640 1 --2- 172.21.15.100:0/1169420606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0a815db50 0x7fa0a815cd40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0003d00 tx=0x7fa0a000cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:13.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.818+0000 7fa09e7fc640 1 -- 172.21.15.100:0/1169420606 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a000a900 con 0x7fa0a815db50 2024-09-11T22:34:13.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.818+0000 7fa0ae8cf640 1 -- 172.21.15.100:0/1169420606 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0a8134230 con 0x7fa0a815db50 2024-09-11T22:34:13.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.818+0000 7fa0ae8cf640 1 -- 172.21.15.100:0/1169420606 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0a8073510 con 0x7fa0a815db50 2024-09-11T22:34:13.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.818+0000 7fa09e7fc640 1 -- 172.21.15.100:0/1169420606 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0a000aaa0 con 0x7fa0a815db50 2024-09-11T22:34:13.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.818+0000 7fa09e7fc640 1 -- 172.21.15.100:0/1169420606 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a000ae90 con 0x7fa0a815db50 2024-09-11T22:34:13.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.821+0000 7fa09e7fc640 1 -- 172.21.15.100:0/1169420606 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa0a001c470 con 0x7fa0a815db50 2024-09-11T22:34:13.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.821+0000 7fa09e7fc640 1 --2- 172.21.15.100:0/1169420606 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa08c06ca30 0x7fa08c06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:13.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.822+0000 7fa09e7fc640 1 -- 172.21.15.100:0/1169420606 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fa0a008b690 con 0x7fa0a815db50 2024-09-11T22:34:13.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.822+0000 7fa0ae8cf640 1 -- 172.21.15.100:0/1169420606 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa090005290 con 0x7fa0a815db50 2024-09-11T22:34:13.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.823+0000 7fa0ad8cd640 1 --2- 172.21.15.100:0/1169420606 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa08c06ca30 0x7fa08c06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:13.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.824+0000 7fa0ad8cd640 1 --2- 172.21.15.100:0/1169420606 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa08c06ca30 0x7fa08c06eef0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa0a400f220 tx=0x7fa0a4006e30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:13.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:13.833+0000 7fa09e7fc640 1 -- 172.21.15.100:0/1169420606 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa0a0059d90 con 0x7fa0a815db50 2024-09-11T22:34:14.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.358+0000 7fa0ae8cf640 1 -- 172.21.15.100:0/1169420606 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa090005850 con 0x7fa0a815db50 2024-09-11T22:34:14.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.361+0000 7fa09e7fc640 1 -- 172.21.15.100:0/1169420606 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7fa0a0059690 con 0x7fa0a815db50 2024-09-11T22:34:14.365 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":100,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:34:14.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.369+0000 7fa0ae8cf640 1 -- 172.21.15.100:0/1169420606 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa08c06ca30 msgr2=0x7fa08c06eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:14.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.369+0000 7fa0ae8cf640 1 --2- 172.21.15.100:0/1169420606 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa08c06ca30 0x7fa08c06eef0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa0a400f220 tx=0x7fa0a4006e30 comp rx=0 tx=0).stop 2024-09-11T22:34:14.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.369+0000 7fa0ae8cf640 1 -- 172.21.15.100:0/1169420606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0a815db50 msgr2=0x7fa0a815cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:14.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.369+0000 7fa0ae8cf640 1 --2- 172.21.15.100:0/1169420606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0a815db50 0x7fa0a815cd40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0003d00 tx=0x7fa0a000cbe0 comp rx=0 tx=0).stop 2024-09-11T22:34:14.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.369+0000 7fa0ae8cf640 1 -- 172.21.15.100:0/1169420606 shutdown_connections 2024-09-11T22:34:14.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.369+0000 7fa0ae8cf640 1 --2- 172.21.15.100:0/1169420606 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fa08c06ca30 0x7fa08c06eef0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:14.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.369+0000 7fa0ae8cf640 1 --2- 172.21.15.100:0/1169420606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa0a815db50 0x7fa0a815cd40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:14.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.369+0000 7fa0ae8cf640 1 --2- 172.21.15.100:0/1169420606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa094004e10 0x7fa0a815c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:14.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.369+0000 7fa0ae8cf640 1 --2- 172.21.15.100:0/1169420606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0940039d0 0x7fa0a8132070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:14.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.369+0000 7fa0ae8cf640 1 -- 172.21.15.100:0/1169420606 >> 172.21.15.100:0/1169420606 conn(0x7fa0a806ee10 msgr2=0x7fa0a8155d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:14.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.369+0000 7fa0ae8cf640 1 -- 172.21.15.100:0/1169420606 shutdown_connections 2024-09-11T22:34:14.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.370+0000 7fa0ae8cf640 1 -- 172.21.15.100:0/1169420606 wait complete. 2024-09-11T22:34:14.394 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-11T22:34:14.394 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-11T22:34:14.394 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:34:14.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.546+0000 7f7297dd8640 1 Processor -- start 2024-09-11T22:34:14.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.546+0000 7f7297dd8640 1 -- start start 2024-09-11T22:34:14.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.547+0000 7f7297dd8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f72900c8f50 0x7f729016bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:14.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.547+0000 7f7297dd8640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7290073290 con 0x7f72900c7e60 2024-09-11T22:34:14.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.547+0000 7f7297dd8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72900c1230 con 0x7f72900c8b70 2024-09-11T22:34:14.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.547+0000 7f7297dd8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f72900c2440 con 0x7f72900c8f50 2024-09-11T22:34:14.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.547+0000 7f7295373640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f72900c7e60 legacy=0x7f729016b4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:34:14.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.547+0000 7f7296375640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f72900c8f50 0x7f729016bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:14.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.547+0000 7f7296375640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f72900c8f50 0x7f729016bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:37498/0 (socket says 172.21.15.100:37498) 2024-09-11T22:34:14.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.547+0000 7f7296375640 1 -- 172.21.15.100:0/3439525901 learned_addr learned my addr 172.21.15.100:0/3439525901 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:14.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.547+0000 7f7295b74640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f72900c8b70 0x7f72900c1d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:42918/0 (socket says 172.21.15.100:42918) 2024-09-11T22:34:14.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.547+0000 7f7294b72640 1 -- 172.21.15.100:0/3439525901 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2142251718 0 0) 0x7f72900c1230 con 0x7f72900c8b70 2024-09-11T22:34:14.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.585+0000 7f7294b72640 1 -- 172.21.15.100:0/3439525901 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7278003520 con 0x7f72900c8b70 2024-09-11T22:34:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.590+0000 7f7296375640 1 -- 172.21.15.100:0/3439525901 >> v1:172.21.15.167:6789/0 conn(0x7f72900c8b70 legacy=0x7f72900c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.590+0000 7f7296375640 1 -- 172.21.15.100:0/3439525901 >> v1:172.21.15.100:6789/0 conn(0x7f72900c7e60 legacy=0x7f729016b4b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:34:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.590+0000 7f7296375640 1 -- 172.21.15.100:0/3439525901 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72900c82b0 con 0x7f72900c8f50 2024-09-11T22:34:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.592+0000 7f7296375640 1 --2- 172.21.15.100:0/3439525901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72900c8f50 0x7f729016bbc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7280007ee0 tx=0x7f728002bad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5e9f713af131d83 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:14.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.594+0000 7f7294b72640 1 -- 172.21.15.100:0/3439525901 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728002f850 con 0x7f72900c8f50 2024-09-11T22:34:14.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.594+0000 7f7294b72640 1 -- 172.21.15.100:0/3439525901 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728002f9f0 con 0x7f72900c8f50 2024-09-11T22:34:14.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.594+0000 7f7294b72640 1 -- 172.21.15.100:0/3439525901 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728002fda0 con 0x7f72900c8f50 2024-09-11T22:34:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.596+0000 7f7297dd8640 1 -- 172.21.15.100:0/3439525901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72900c8f50 msgr2=0x7f729016bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.596+0000 7f7297dd8640 1 --2- 172.21.15.100:0/3439525901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72900c8f50 0x7f729016bbc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7280007ee0 tx=0x7f728002bad0 comp rx=0 tx=0).stop 2024-09-11T22:34:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.597+0000 7f7297dd8640 1 -- 172.21.15.100:0/3439525901 shutdown_connections 2024-09-11T22:34:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.597+0000 7f7297dd8640 1 --2- 172.21.15.100:0/3439525901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72900c8f50 0x7f729016bbc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.597+0000 7f7297dd8640 1 -- 172.21.15.100:0/3439525901 >> 172.21.15.100:0/3439525901 conn(0x7f729006f360 msgr2=0x7f729006f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:14.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.601+0000 7f7297dd8640 1 -- 172.21.15.100:0/3439525901 shutdown_connections 2024-09-11T22:34:14.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.601+0000 7f7297dd8640 1 -- 172.21.15.100:0/3439525901 wait complete. 2024-09-11T22:34:14.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.602+0000 7f7297dd8640 1 Processor -- start 2024-09-11T22:34:14.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.603+0000 7f7297dd8640 1 -- start start 2024-09-11T22:34:14.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.604+0000 7f7297dd8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72900c7e60 0x7f72900cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:14.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.604+0000 7f7295b74640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72900c7e60 msgr2=0x7f72900cc320 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:34:14.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.604+0000 7f7295b74640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72900c7e60 0x7f72900cc320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:34:14.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.604+0000 7f7297dd8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72900c8b70 0x7f729007bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:14.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.604+0000 7f7297dd8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72900c8f50 0x7f7290208ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.604+0000 7f7297dd8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7290072cd0 con 0x7f72900c7e60 2024-09-11T22:34:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.604+0000 7f7297dd8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f72900c8570 con 0x7f72900c8b70 2024-09-11T22:34:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.604+0000 7f7297dd8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7290072fb0 con 0x7f72900c8f50 2024-09-11T22:34:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.605+0000 7f7296375640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72900c8f50 0x7f7290208ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.605+0000 7f7296375640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72900c8f50 0x7f7290208ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:59480/0 (socket says 172.21.15.100:59480) 2024-09-11T22:34:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.605+0000 7f7296375640 1 -- 172.21.15.100:0/669173980 learned_addr learned my addr 172.21.15.100:0/669173980 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.605+0000 7f7295373640 1 --2- 172.21.15.100:0/669173980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72900c8b70 0x7f729007bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.606+0000 7f7296375640 1 -- 172.21.15.100:0/669173980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72900c8b70 msgr2=0x7f729007bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.606+0000 7f7296375640 1 --2- 172.21.15.100:0/669173980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72900c8b70 0x7f729007bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.606+0000 7f7296375640 1 -- 172.21.15.100:0/669173980 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72900c7e60 msgr2=0x7f72900cc320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:34:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.606+0000 7f7296375640 1 --2- 172.21.15.100:0/669173980 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72900c7e60 0x7f72900cc320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.606+0000 7f7296375640 1 -- 172.21.15.100:0/669173980 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729007dc30 con 0x7f72900c8f50 2024-09-11T22:34:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.608+0000 7f7296375640 1 --2- 172.21.15.100:0/669173980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72900c8f50 0x7f7290208ba0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7280007ee0 tx=0x7f7280004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:14.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.608+0000 7f728e7fc640 1 -- 172.21.15.100:0/669173980 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7280044070 con 0x7f72900c8f50 2024-09-11T22:34:14.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.608+0000 7f728e7fc640 1 -- 172.21.15.100:0/669173980 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7280003e50 con 0x7f72900c8f50 2024-09-11T22:34:14.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.608+0000 7f728e7fc640 1 -- 172.21.15.100:0/669173980 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7280004480 con 0x7f72900c8f50 2024-09-11T22:34:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.608+0000 7f7297dd8640 1 -- 172.21.15.100:0/669173980 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f729007c860 con 0x7f72900c8f50 2024-09-11T22:34:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.608+0000 7f7297dd8640 1 -- 172.21.15.100:0/669173980 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7290205aa0 con 0x7f72900c8f50 2024-09-11T22:34:14.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.610+0000 7f7297dd8640 1 --2- 172.21.15.100:0/669173980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f729008a6c0 0x7f7290168860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:14.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.611+0000 7f728e7fc640 1 -- 172.21.15.100:0/669173980 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7280004620 con 0x7f72900c8f50 2024-09-11T22:34:14.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.612+0000 7f7297dd8640 1 -- 172.21.15.100:0/669173980 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f72900c9b40 con 0x7f729008a6c0 2024-09-11T22:34:14.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.612+0000 7f728e7fc640 1 --2- 172.21.15.100:0/669173980 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f727c06be30 0x7f727c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:14.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.612+0000 7f728e7fc640 1 -- 172.21.15.100:0/669173980 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f72800ac740 con 0x7f72900c8f50 2024-09-11T22:34:14.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.615+0000 7f7295373640 1 --2- 172.21.15.100:0/669173980 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f727c06be30 0x7f727c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:14.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.615+0000 7f7295b74640 1 --2- 172.21.15.100:0/669173980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f729008a6c0 0x7f7290168860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:14.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.619+0000 7f7295373640 1 --2- 172.21.15.100:0/669173980 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f727c06be30 0x7f727c06e2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f72901ffed0 tx=0x7f7284009110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:14.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.620+0000 7f7295b74640 1 -- 172.21.15.100:0/669173980 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7290073480 con 0x7f729008a6c0 2024-09-11T22:34:14.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.621+0000 7f7295b74640 1 --2- 172.21.15.100:0/669173980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f729008a6c0 0x7f7290168860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7288001080 tx=0x7f728800c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:14.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.622+0000 7f728e7fc640 1 -- 172.21.15.100:0/669173980 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72880074e0 con 0x7f729008a6c0 2024-09-11T22:34:14.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.622+0000 7f728e7fc640 1 -- 172.21.15.100:0/669173980 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f7288007680 con 0x7f729008a6c0 2024-09-11T22:34:14.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.622+0000 7f728e7fc640 1 -- 172.21.15.100:0/669173980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f729008a6c0 msgr2=0x7f7290168860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:14.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.622+0000 7f728e7fc640 1 --2- 172.21.15.100:0/669173980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f729008a6c0 0x7f7290168860 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7288001080 tx=0x7f728800c7f0 comp rx=0 tx=0).stop 2024-09-11T22:34:14.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.622+0000 7f728e7fc640 1 -- 172.21.15.100:0/669173980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f729008a6c0 msgr2=0x7f7290168860 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:34:14.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.622+0000 7f728e7fc640 1 --2- 172.21.15.100:0/669173980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f729008a6c0 0x7f7290168860 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7288001080 tx=0x7f728800c7f0 comp rx=0 tx=0).stop 2024-09-11T22:34:14.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.644+0000 7f7297dd8640 1 --2- 172.21.15.100:0/669173980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72902090e0 0x7f7290168da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:14.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.644+0000 7f7297dd8640 1 -- 172.21.15.100:0/669173980 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f72900c93c0 con 0x7f72902090e0 2024-09-11T22:34:14.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.645+0000 7f7295b74640 1 --2- 172.21.15.100:0/669173980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72902090e0 0x7f7290168da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:14.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.649+0000 7f7295b74640 1 -- 172.21.15.100:0/669173980 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f72900c7c40 con 0x7f72902090e0 2024-09-11T22:34:14.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.650+0000 7f7295b74640 1 --2- 172.21.15.100:0/669173980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72902090e0 0x7f7290168da0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f728800cfd0 tx=0x7f7288000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:14.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.650+0000 7f728e7fc640 1 -- 172.21.15.100:0/669173980 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7288019880 con 0x7f72902090e0 2024-09-11T22:34:14.652 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:34:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:34:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:34:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:34:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 100, 2024-09-11T22:34:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 46183, 2024-09-11T22:34:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:34:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:34:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:34:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:34:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:34:14.653 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:34:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:34:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:14.654 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:14.655 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:34:14.655 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:34:14.655 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:14.656 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:14.656 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:34:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:34:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:34:14.657 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:34:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:34:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:34:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:34:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:34:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:34:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:34:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:34:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:34:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:34:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:34:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:34:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:34:14.658 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:34:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:14.659 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:34:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:34:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:34:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:34:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:34:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:14.660 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:34:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:34:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:34:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:14.661 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:34:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:34:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:34:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.662 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:34:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:34:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:34:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.663 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:34:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:34:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:34:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:34:14.664 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:34:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:34:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:34:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:34:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:34:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:34:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4 2024-09-11T22:34:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:14.666 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:34:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:34:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:34:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:34:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:14.667 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:14.668 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:34:14.668 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.668 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:14.668 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:14.668 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:34:14.668 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:14.668 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:14.668 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.668 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:34:14.668 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:34:14.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.651+0000 7f728e7fc640 1 -- 172.21.15.100:0/669173980 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5045 (secure 0 0 0) 0x7f7288019880 con 0x7f72902090e0 2024-09-11T22:34:14.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.651+0000 7f728e7fc640 1 -- 172.21.15.100:0/669173980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72902090e0 msgr2=0x7f7290168da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:14.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.651+0000 7f728e7fc640 1 --2- 172.21.15.100:0/669173980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72902090e0 0x7f7290168da0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f728800cfd0 tx=0x7f7288000bc0 comp rx=0 tx=0).stop 2024-09-11T22:34:14.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.651+0000 7f728e7fc640 1 -- 172.21.15.100:0/669173980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72902090e0 msgr2=0x7f7290168da0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:34:14.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.651+0000 7f728e7fc640 1 --2- 172.21.15.100:0/669173980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72902090e0 0x7f7290168da0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:14.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.658+0000 7f7297dd8640 1 -- 172.21.15.100:0/669173980 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f727c06be30 msgr2=0x7f727c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:14.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.658+0000 7f7297dd8640 1 --2- 172.21.15.100:0/669173980 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f727c06be30 0x7f727c06e2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f72901ffed0 tx=0x7f7284009110 comp rx=0 tx=0).stop 2024-09-11T22:34:14.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.658+0000 7f7297dd8640 1 -- 172.21.15.100:0/669173980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72900c8f50 msgr2=0x7f7290208ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:14.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.658+0000 7f7297dd8640 1 --2- 172.21.15.100:0/669173980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72900c8f50 0x7f7290208ba0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7280007ee0 tx=0x7f7280004a40 comp rx=0 tx=0).stop 2024-09-11T22:34:14.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.659+0000 7f7296375640 1 -- 172.21.15.100:0/669173980 reap_dead start 2024-09-11T22:34:14.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.659+0000 7f7296375640 1 -- 172.21.15.100:0/669173980 reap_dead start 2024-09-11T22:34:14.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.661+0000 7f7297dd8640 1 -- 172.21.15.100:0/669173980 shutdown_connections 2024-09-11T22:34:14.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.661+0000 7f7297dd8640 1 -- 172.21.15.100:0/669173980 >> 172.21.15.100:0/669173980 conn(0x7f729006f360 msgr2=0x7f72900cb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:14.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.661+0000 7f7297dd8640 1 -- 172.21.15.100:0/669173980 shutdown_connections 2024-09-11T22:34:14.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.662+0000 7f7297dd8640 1 -- 172.21.15.100:0/669173980 wait complete. 2024-09-11T22:34:14.681 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:34:14.682 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-11T22:34:14.682 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:34:14.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.885+0000 7f3ce3a65640 1 Processor -- start 2024-09-11T22:34:14.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.885+0000 7f3ce3a65640 1 -- start start 2024-09-11T22:34:14.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.886+0000 7f3ce3a65640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3cdc0c1370 0x7f3cdc0739e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:14.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.886+0000 7f3ce3a65640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3cdc0c1750 0x7f3cdc157d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:14.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.886+0000 7f3ce3a65640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cdc071840 con 0x7f3cdc073f20 2024-09-11T22:34:14.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.886+0000 7f3ce3a65640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f3cdc0c2db0 con 0x7f3cdc0c1370 2024-09-11T22:34:14.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.886+0000 7f3ce3a65640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f3cdc071ae0 con 0x7f3cdc0c1750 2024-09-11T22:34:14.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.887+0000 7f3ce1801640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f3cdc0c1370 msgr2=0x7f3cdc0739e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:34:14.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.887+0000 7f3ce1801640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3cdc0c1370 0x7f3cdc0739e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:34:14.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.887+0000 7f3ce1000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3cdc0c1750 0x7f3cdc157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:14.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.887+0000 7f3ce1000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3cdc0c1750 0x7f3cdc157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:37532/0 (socket says 172.21.15.100:37532) 2024-09-11T22:34:14.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.887+0000 7f3ce1000640 1 -- 172.21.15.100:0/3762699617 learned_addr learned my addr 172.21.15.100:0/3762699617 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:14.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.888+0000 7f3ce1000640 1 -- 172.21.15.100:0/3762699617 >> v2:172.21.15.100:3300/0 conn(0x7f3cdc0c1370 msgr2=0x7f3cdc0739e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:34:14.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.888+0000 7f3ce1000640 1 --2- 172.21.15.100:0/3762699617 >> v2:172.21.15.100:3300/0 conn(0x7f3cdc0c1370 0x7f3cdc0739e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:14.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.888+0000 7f3ce1000640 1 -- 172.21.15.100:0/3762699617 >> v1:172.21.15.167:6789/0 conn(0x7f3cdc073f20 legacy=0x7f3cdc1515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:14.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.888+0000 7f3ce1000640 1 -- 172.21.15.100:0/3762699617 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cdc071dc0 con 0x7f3cdc0c1750 2024-09-11T22:34:14.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.889+0000 7f3ce1000640 1 --2- 172.21.15.100:0/3762699617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cdc0c1750 0x7f3cdc157d50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0c9c00 tx=0x7f3cd802a2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b6b26c1c1ced7db server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:14.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.897+0000 7f3cd3fff640 1 -- 172.21.15.100:0/3762699617 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8037070 con 0x7f3cdc0c1750 2024-09-11T22:34:14.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.897+0000 7f3cd3fff640 1 -- 172.21.15.100:0/3762699617 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cd8032440 con 0x7f3cdc0c1750 2024-09-11T22:34:14.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.898+0000 7f3ce3a65640 1 -- 172.21.15.100:0/3762699617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cdc0c1750 msgr2=0x7f3cdc157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:14.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.898+0000 7f3ce3a65640 1 --2- 172.21.15.100:0/3762699617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cdc0c1750 0x7f3cdc157d50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0c9c00 tx=0x7f3cd802a2e0 comp rx=0 tx=0).stop 2024-09-11T22:34:14.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.898+0000 7f3ce3a65640 1 -- 172.21.15.100:0/3762699617 shutdown_connections 2024-09-11T22:34:14.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.898+0000 7f3ce3a65640 1 --2- 172.21.15.100:0/3762699617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cdc0c1750 0x7f3cdc157d50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:14.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.898+0000 7f3ce3a65640 1 --2- 172.21.15.100:0/3762699617 >> v2:172.21.15.100:3300/0 conn(0x7f3cdc0c1370 0x7f3cdc0739e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:14.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.898+0000 7f3ce3a65640 1 -- 172.21.15.100:0/3762699617 >> 172.21.15.100:0/3762699617 conn(0x7f3cdc06f360 msgr2=0x7f3cdc06f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:14.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.899+0000 7f3ce3a65640 1 -- 172.21.15.100:0/3762699617 shutdown_connections 2024-09-11T22:34:14.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.899+0000 7f3ce3a65640 1 -- 172.21.15.100:0/3762699617 wait complete. 2024-09-11T22:34:14.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.901+0000 7f3ce3a65640 1 Processor -- start 2024-09-11T22:34:14.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.902+0000 7f3ce3a65640 1 -- start start 2024-09-11T22:34:14.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.903+0000 7f3ce3a65640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cdc073f20 0x7f3cdc154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.903+0000 7f3ce3a65640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cdc0c1370 0x7f3cdc0aa710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.903+0000 7f3ce3a65640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cdc152640 0x7f3cdc152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.903+0000 7f3ce3a65640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc072500 con 0x7f3cdc073f20 2024-09-11T22:34:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.903+0000 7f3ce3a65640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3cdc072380 con 0x7f3cdc152640 2024-09-11T22:34:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.903+0000 7f3ce3a65640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3cdc151cb0 con 0x7f3cdc0c1370 2024-09-11T22:34:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.903+0000 7f3ce1801640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cdc073f20 msgr2=0x7f3cdc154ab0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:34:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.903+0000 7f3ce1801640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cdc073f20 0x7f3cdc154ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:34:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.903+0000 7f3ce2002640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cdc152640 0x7f3cdc152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.903+0000 7f3ce2002640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cdc152640 0x7f3cdc152ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:37546/0 (socket says 172.21.15.100:37546) 2024-09-11T22:34:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.903+0000 7f3ce2002640 1 -- 172.21.15.100:0/926739133 learned_addr learned my addr 172.21.15.100:0/926739133 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.904+0000 7f3ce2002640 1 -- 172.21.15.100:0/926739133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cdc0c1370 msgr2=0x7f3cdc0aa710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:34:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.904+0000 7f3ce2002640 1 --2- 172.21.15.100:0/926739133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cdc0c1370 0x7f3cdc0aa710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:14.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.904+0000 7f3ce2002640 1 -- 172.21.15.100:0/926739133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cdc073f20 msgr2=0x7f3cdc154ab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:34:14.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.904+0000 7f3ce2002640 1 --2- 172.21.15.100:0/926739133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cdc073f20 0x7f3cdc154ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:14.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.904+0000 7f3ce2002640 1 -- 172.21.15.100:0/926739133 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cdc153010 con 0x7f3cdc152640 2024-09-11T22:34:14.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.904+0000 7f3ce2002640 1 --2- 172.21.15.100:0/926739133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cdc152640 0x7f3cdc152ad0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00c440 tx=0x7f3ccc00c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:14.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.907+0000 7f3cd1ffb640 1 -- 172.21.15.100:0/926739133 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc011790 con 0x7f3cdc152640 2024-09-11T22:34:14.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.908+0000 7f3cd1ffb640 1 -- 172.21.15.100:0/926739133 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ccc017070 con 0x7f3cdc152640 2024-09-11T22:34:14.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.908+0000 7f3cd1ffb640 1 -- 172.21.15.100:0/926739133 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc011b70 con 0x7f3cdc152640 2024-09-11T22:34:14.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.908+0000 7f3ce3a65640 1 -- 172.21.15.100:0/926739133 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cdc1fcee0 con 0x7f3cdc152640 2024-09-11T22:34:14.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.908+0000 7f3ce3a65640 1 -- 172.21.15.100:0/926739133 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cdc1fd4a0 con 0x7f3cdc152640 2024-09-11T22:34:14.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.911+0000 7f3ce3a65640 1 --2- 172.21.15.100:0/926739133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cdc0ad620 0x7f3cdc0ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:14.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.911+0000 7f3ce3a65640 1 -- 172.21.15.100:0/926739133 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3cdc1fcc90 con 0x7f3cdc0ad620 2024-09-11T22:34:14.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.912+0000 7f3ce1801640 1 --2- 172.21.15.100:0/926739133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cdc0ad620 0x7f3cdc0ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.913+0000 7f3cd1ffb640 1 -- 172.21.15.100:0/926739133 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ccc011d10 con 0x7f3cdc152640 2024-09-11T22:34:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.914+0000 7f3ce1801640 1 -- 172.21.15.100:0/926739133 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3cdc0c1750 con 0x7f3cdc0ad620 2024-09-11T22:34:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.914+0000 7f3ce1801640 1 --2- 172.21.15.100:0/926739133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cdc0ad620 0x7f3cdc0ada00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400bcc0 tx=0x7f3cd4009f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.914+0000 7f3cd1ffb640 1 --2- 172.21.15.100:0/926739133 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3cc006be60 0x7f3cc006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.914+0000 7f3cd1ffb640 1 -- 172.21.15.100:0/926739133 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f3ccc08b0d0 con 0x7f3cdc152640 2024-09-11T22:34:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.915+0000 7f3ce1000640 1 --2- 172.21.15.100:0/926739133 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3cc006be60 0x7f3cc006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.915+0000 7f3cd1ffb640 1 -- 172.21.15.100:0/926739133 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4014630 con 0x7f3cdc0ad620 2024-09-11T22:34:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.915+0000 7f3cd1ffb640 1 -- 172.21.15.100:0/926739133 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f3cd40147d0 con 0x7f3cdc0ad620 2024-09-11T22:34:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.915+0000 7f3cd1ffb640 1 -- 172.21.15.100:0/926739133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cdc0ad620 msgr2=0x7f3cdc0ada00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.915+0000 7f3cd1ffb640 1 --2- 172.21.15.100:0/926739133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cdc0ad620 0x7f3cdc0ada00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400bcc0 tx=0x7f3cd4009f30 comp rx=0 tx=0).stop 2024-09-11T22:34:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.915+0000 7f3cd1ffb640 1 -- 172.21.15.100:0/926739133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cdc0ad620 msgr2=0x7f3cdc0ada00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:34:14.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.915+0000 7f3cd1ffb640 1 --2- 172.21.15.100:0/926739133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cdc0ad620 0x7f3cdc0ada00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:14.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.923+0000 7f3ce1000640 1 --2- 172.21.15.100:0/926739133 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3cc006be60 0x7f3cc006e320 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8034000 tx=0x7f3cd802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:14.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.937+0000 7f3ce3a65640 1 --2- 172.21.15.100:0/926739133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cdc200200 0x7f3cdc2005e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:14.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.937+0000 7f3ce3a65640 1 -- 172.21.15.100:0/926739133 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3cdc154770 con 0x7f3cdc200200 2024-09-11T22:34:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.938+0000 7f3ce1801640 1 --2- 172.21.15.100:0/926739133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cdc200200 0x7f3cdc2005e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:14.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.943+0000 7f3ce1801640 1 -- 172.21.15.100:0/926739133 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3cdc150c80 con 0x7f3cdc200200 2024-09-11T22:34:14.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.948+0000 7f3ce1801640 1 --2- 172.21.15.100:0/926739133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cdc200200 0x7f3cdc2005e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009fd0 tx=0x7f3cd4005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:14.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.949+0000 7f3cd1ffb640 1 -- 172.21.15.100:0/926739133 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4019040 con 0x7f3cdc200200 2024-09-11T22:34:14.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.950+0000 7f3cd1ffb640 1 -- 172.21.15.100:0/926739133 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5044 (secure 0 0 0) 0x7f3cd40133d0 con 0x7f3cdc200200 2024-09-11T22:34:14.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.950+0000 7f3cd1ffb640 1 -- 172.21.15.100:0/926739133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cdc200200 msgr2=0x7f3cdc2005e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:14.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.950+0000 7f3cd1ffb640 1 --2- 172.21.15.100:0/926739133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cdc200200 0x7f3cdc2005e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009fd0 tx=0x7f3cd4005d50 comp rx=0 tx=0).stop 2024-09-11T22:34:14.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.950+0000 7f3cd1ffb640 1 -- 172.21.15.100:0/926739133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cdc200200 msgr2=0x7f3cdc2005e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:34:14.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.950+0000 7f3cd1ffb640 1 --2- 172.21.15.100:0/926739133 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3cdc200200 0x7f3cdc2005e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:14.952 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:34:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:34:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:34:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:34:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 100, 2024-09-11T22:34:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 745671, 2024-09-11T22:34:14.952 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:34:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:34:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:34:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:34:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:34:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:34:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:34:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:14.953 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:34:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:34:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:14.954 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:34:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:34:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:34:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:34:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:34:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:34:14.955 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:34:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:34:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:34:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:34:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:34:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:34:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:34:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:34:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:34:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:34:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:34:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:34:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:34:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:34:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:34:14.957 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:34:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:34:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.958 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:34:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:34:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:34:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:34:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:14.959 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:34:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:34:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:34:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:34:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:14.960 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:34:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:34:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:34:14.961 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:34:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:34:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:34:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:14.962 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:34:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:34:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:34:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:34:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.963 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:34:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:34:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:34:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:34:14.964 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4 2024-09-11T22:34:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:34:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:34:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:14.965 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:14.966 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:34:14.966 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:34:14.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.952+0000 7f3ce3a65640 1 -- 172.21.15.100:0/926739133 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3cc006be60 msgr2=0x7f3cc006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:14.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.952+0000 7f3ce3a65640 1 --2- 172.21.15.100:0/926739133 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3cc006be60 0x7f3cc006e320 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8034000 tx=0x7f3cd802e000 comp rx=0 tx=0).stop 2024-09-11T22:34:14.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.952+0000 7f3ce3a65640 1 -- 172.21.15.100:0/926739133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cdc152640 msgr2=0x7f3cdc152ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:14.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.952+0000 7f3ce3a65640 1 --2- 172.21.15.100:0/926739133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3cdc152640 0x7f3cdc152ad0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00c440 tx=0x7f3ccc00c900 comp rx=0 tx=0).stop 2024-09-11T22:34:14.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.952+0000 7f3ce2002640 1 -- 172.21.15.100:0/926739133 reap_dead start 2024-09-11T22:34:14.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.952+0000 7f3ce2002640 1 -- 172.21.15.100:0/926739133 reap_dead start 2024-09-11T22:34:14.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.953+0000 7f3ce3a65640 1 -- 172.21.15.100:0/926739133 shutdown_connections 2024-09-11T22:34:14.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.953+0000 7f3ce3a65640 1 -- 172.21.15.100:0/926739133 >> 172.21.15.100:0/926739133 conn(0x7f3cdc06f360 msgr2=0x7f3cdc0c1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:14.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.957+0000 7f3ce3a65640 1 -- 172.21.15.100:0/926739133 shutdown_connections 2024-09-11T22:34:14.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:14.957+0000 7f3ce3a65640 1 -- 172.21.15.100:0/926739133 wait complete. 2024-09-11T22:34:14.988 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:34:14.988 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-11T22:34:26.100 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:34:26.103 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-11T22:34:26.344 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-09-11T22:34:26.342+0000 7f9ec4ec4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94187) UID: 0 2024-09-11T22:34:26.345 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-09-11T22:34:26.342+0000 7fe1bf69b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94187) UID: 0 2024-09-11T22:34:26.346 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-09-11T22:34:26.344+0000 7f6ad297f640 -1 received signal: Hangup from (PID: 94187) UID: 0 2024-09-11T22:34:26.361 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-09-11T22:34:26.341+0000 7f4dfc893640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 94187) UID: 0 2024-09-11T22:34:34.990 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:34:34.990 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-11T22:34:34.990 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T22:34:34.990 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T22:34:34.993 INFO:tasks.ceph.mon.a:Started 2024-09-11T22:34:34.993 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:34:34.993 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:34:35.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.207+0000 7f58f6eaf640 1 Processor -- start 2024-09-11T22:34:35.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.207+0000 7f58f6eaf640 1 -- start start 2024-09-11T22:34:35.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.212+0000 7f58f6eaf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e80d8ba0 0x7f58e804e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:35.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.212+0000 7f58f6eaf640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e8050510 con 0x7f58e8007330 2024-09-11T22:34:35.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.212+0000 7f58f6eaf640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e80507f0 con 0x7f58e804f860 2024-09-11T22:34:35.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.212+0000 7f58f6eaf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f58e804f060 con 0x7f58e80d8ba0 2024-09-11T22:34:35.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.213+0000 7f58f4c4b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e80d8ba0 0x7f58e804e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:35.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.213+0000 7f58f544c640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f58e804f860 0x7f58e80e8f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:47762/0 (socket says 172.21.15.100:47762) 2024-09-11T22:34:35.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.213+0000 7f58f544c640 1 -- 172.21.15.100:0/142356099 learned_addr learned my addr 172.21.15.100:0/142356099 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:34:35.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.213+0000 7f58effff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f58e8007330 0x7f58e800e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48830/0 (socket says 172.21.15.100:48830) 2024-09-11T22:34:35.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.217+0000 7f58f4c4b640 1 -- 172.21.15.100:0/142356099 >> v1:172.21.15.167:6789/0 conn(0x7f58e804f860 legacy=0x7f58e80e8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:35.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.217+0000 7f58f4c4b640 1 -- 172.21.15.100:0/142356099 >> v1:172.21.15.100:6789/0 conn(0x7f58e8007330 legacy=0x7f58e800e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:35.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.217+0000 7f58f4c4b640 1 -- 172.21.15.100:0/142356099 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e804f340 con 0x7f58e80d8ba0 2024-09-11T22:34:35.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.219+0000 7f58f4c4b640 1 --2- 172.21.15.100:0/142356099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e80d8ba0 0x7f58e804e9f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009750 tx=0x7f58e402a010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83756ef497bb8290 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:35.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.219+0000 7f58ef7fe640 1 -- 172.21.15.100:0/142356099 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e4037070 con 0x7f58e80d8ba0 2024-09-11T22:34:35.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.221+0000 7f58ef7fe640 1 -- 172.21.15.100:0/142356099 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e402ad20 con 0x7f58e80d8ba0 2024-09-11T22:34:35.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.221+0000 7f58ef7fe640 1 -- 172.21.15.100:0/142356099 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e4032660 con 0x7f58e80d8ba0 2024-09-11T22:34:35.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.222+0000 7f58f6eaf640 1 -- 172.21.15.100:0/142356099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e80d8ba0 msgr2=0x7f58e804e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:35.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.222+0000 7f58f6eaf640 1 --2- 172.21.15.100:0/142356099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e80d8ba0 0x7f58e804e9f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009750 tx=0x7f58e402a010 comp rx=0 tx=0).stop 2024-09-11T22:34:35.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.222+0000 7f58f6eaf640 1 -- 172.21.15.100:0/142356099 shutdown_connections 2024-09-11T22:34:35.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.222+0000 7f58f6eaf640 1 --2- 172.21.15.100:0/142356099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e80d8ba0 0x7f58e804e9f0 secure :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009750 tx=0x7f58e402a010 comp rx=0 tx=0).stop 2024-09-11T22:34:35.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.222+0000 7f58f6eaf640 1 -- 172.21.15.100:0/142356099 >> 172.21.15.100:0/142356099 conn(0x7f58e8054460 msgr2=0x7f58e8054870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:35.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.224+0000 7f58f6eaf640 1 -- 172.21.15.100:0/142356099 shutdown_connections 2024-09-11T22:34:35.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.224+0000 7f58f6eaf640 1 -- 172.21.15.100:0/142356099 wait complete. 2024-09-11T22:34:35.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.226+0000 7f58f6eaf640 1 Processor -- start 2024-09-11T22:34:35.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.226+0000 7f58f6eaf640 1 -- start start 2024-09-11T22:34:35.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.228+0000 7f58f6eaf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58e8007330 0x7f58e80d5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:35.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.228+0000 7f58f6eaf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e804f860 0x7f58e8053190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:35.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.228+0000 7f58f6eaf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58e80df7a0 0x7f58e80cb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:35.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.228+0000 7f58f6eaf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f58e8049330 con 0x7f58e8007330 2024-09-11T22:34:35.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.228+0000 7f58f6eaf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f58e80491b0 con 0x7f58e80df7a0 2024-09-11T22:34:35.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.228+0000 7f58f6eaf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f58e800ead0 con 0x7f58e804f860 2024-09-11T22:34:35.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.229+0000 7f58effff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e804f860 0x7f58e8053190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:35.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.229+0000 7f58f544c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58e80df7a0 0x7f58e80cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:35.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.229+0000 7f58f544c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58e80df7a0 0x7f58e80cb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:49036/0 (socket says 172.21.15.100:49036) 2024-09-11T22:34:35.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.229+0000 7f58f544c640 1 -- 172.21.15.100:0/3162918150 learned_addr learned my addr 172.21.15.100:0/3162918150 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:35.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.229+0000 7f58effff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e804f860 0x7f58e8053190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:45834/0 (socket says 172.21.15.100:45834) 2024-09-11T22:34:35.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.229+0000 7f58f4c4b640 1 --2- 172.21.15.100:0/3162918150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58e8007330 0x7f58e80d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:35.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.230+0000 7f58f4c4b640 1 -- 172.21.15.100:0/3162918150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58e8007330 msgr2=0x7f58e80d5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-11T22:34:35.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.230+0000 7f58f4c4b640 1 -- 172.21.15.100:0/3162918150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58e8007330 msgr2=0x7f58e80d5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:34:35.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.230+0000 7f58f544c640 1 -- 172.21.15.100:0/3162918150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e804f860 msgr2=0x7f58e8053190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:35.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.230+0000 7f58f4c4b640 1 --2- 172.21.15.100:0/3162918150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58e8007330 0x7f58e80d5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:34:35.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.230+0000 7f58f4c4b640 1 --2- 172.21.15.100:0/3162918150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58e8007330 0x7f58e80d5b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:34:35.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.230+0000 7f58f544c640 1 --2- 172.21.15.100:0/3162918150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e804f860 0x7f58e8053190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.230+0000 7f58f544c640 1 -- 172.21.15.100:0/3162918150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58e8007330 msgr2=0x7f58e80d5b30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:34:35.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.230+0000 7f58f544c640 1 --2- 172.21.15.100:0/3162918150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58e8007330 0x7f58e80d5b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.230+0000 7f58f544c640 1 -- 172.21.15.100:0/3162918150 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e8184c40 con 0x7f58e80df7a0 2024-09-11T22:34:35.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.230+0000 7f58effff640 1 --2- 172.21.15.100:0/3162918150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e804f860 0x7f58e8053190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:34:35.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.231+0000 7f58f544c640 1 --2- 172.21.15.100:0/3162918150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58e80df7a0 0x7f58e80cb760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f58f006a4c0 tx=0x7f58f0069890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:35.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.232+0000 7f58ed7fa640 1 -- 172.21.15.100:0/3162918150 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f0091070 con 0x7f58e80df7a0 2024-09-11T22:34:35.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.232+0000 7f58f6eaf640 1 -- 172.21.15.100:0/3162918150 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e804bdb0 con 0x7f58e80df7a0 2024-09-11T22:34:35.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.232+0000 7f58f6eaf640 1 -- 172.21.15.100:0/3162918150 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e8185190 con 0x7f58e80df7a0 2024-09-11T22:34:35.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.234+0000 7f58ed7fa640 1 -- 172.21.15.100:0/3162918150 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f0071840 con 0x7f58e80df7a0 2024-09-11T22:34:35.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.234+0000 7f58daffd640 1 -- 172.21.15.100:0/3162918150 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58d0005290 con 0x7f58e80df7a0 2024-09-11T22:34:35.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.234+0000 7f58ed7fa640 1 -- 172.21.15.100:0/3162918150 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f0071c30 con 0x7f58e80df7a0 2024-09-11T22:34:35.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.238+0000 7f58ed7fa640 1 -- 172.21.15.100:0/3162918150 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f58f0094070 con 0x7f58e80df7a0 2024-09-11T22:34:35.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.238+0000 7f58ed7fa640 1 --2- 172.21.15.100:0/3162918150 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f58d406beb0 0x7f58d406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:35.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.238+0000 7f58ed7fa640 1 -- 172.21.15.100:0/3162918150 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f58f0107460 con 0x7f58e80df7a0 2024-09-11T22:34:35.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.243+0000 7f58f4c4b640 1 --2- 172.21.15.100:0/3162918150 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f58d406beb0 0x7f58d406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:35.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.244+0000 7f58f4c4b640 1 --2- 172.21.15.100:0/3162918150 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f58d406beb0 0x7f58d406e370 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f58e4034000 tx=0x7f58e402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:35.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.252+0000 7f58ed7fa640 1 -- 172.21.15.100:0/3162918150 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f58f00d5510 con 0x7f58e80df7a0 2024-09-11T22:34:35.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.801+0000 7f58daffd640 1 -- 172.21.15.100:0/3162918150 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f58d0005580 con 0x7f58e80df7a0 2024-09-11T22:34:35.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.803+0000 7f58ed7fa640 1 -- 172.21.15.100:0/3162918150 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f58f00d9810 con 0x7f58e80df7a0 2024-09-11T22:34:35.804 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":100,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:34:35.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.809+0000 7f58f6eaf640 1 -- 172.21.15.100:0/3162918150 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f58d406beb0 msgr2=0x7f58d406e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:35.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.809+0000 7f58f6eaf640 1 --2- 172.21.15.100:0/3162918150 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f58d406beb0 0x7f58d406e370 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f58e4034000 tx=0x7f58e402e000 comp rx=0 tx=0).stop 2024-09-11T22:34:35.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.809+0000 7f58f6eaf640 1 -- 172.21.15.100:0/3162918150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58e80df7a0 msgr2=0x7f58e80cb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:35.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.809+0000 7f58f6eaf640 1 --2- 172.21.15.100:0/3162918150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58e80df7a0 0x7f58e80cb760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f58f006a4c0 tx=0x7f58f0069890 comp rx=0 tx=0).stop 2024-09-11T22:34:35.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.809+0000 7f58f6eaf640 1 -- 172.21.15.100:0/3162918150 shutdown_connections 2024-09-11T22:34:35.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.809+0000 7f58f6eaf640 1 --2- 172.21.15.100:0/3162918150 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f58d406beb0 0x7f58d406e370 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.809+0000 7f58f6eaf640 1 --2- 172.21.15.100:0/3162918150 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58e80df7a0 0x7f58e80cb760 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.809+0000 7f58f6eaf640 1 --2- 172.21.15.100:0/3162918150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58e804f860 0x7f58e8053190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.809+0000 7f58f6eaf640 1 --2- 172.21.15.100:0/3162918150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58e8007330 0x7f58e80d5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:35.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.809+0000 7f58f6eaf640 1 -- 172.21.15.100:0/3162918150 >> 172.21.15.100:0/3162918150 conn(0x7f58e8054460 msgr2=0x7f58e80d7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:35.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.809+0000 7f58f6eaf640 1 -- 172.21.15.100:0/3162918150 shutdown_connections 2024-09-11T22:34:35.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:35.809+0000 7f58f6eaf640 1 -- 172.21.15.100:0/3162918150 wait complete. 2024-09-11T22:34:38.832 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:34:39.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:39.031+0000 7f64f6d91640 1 Processor -- start 2024-09-11T22:34:39.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:39.031+0000 7f64f6d91640 1 -- start start 2024-09-11T22:34:39.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:39.033+0000 7f64f6d91640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f64f015c540 0x7f64f00c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:39.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:39.033+0000 7f64f6d91640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64f015ed80 con 0x7f64f006bc10 2024-09-11T22:34:39.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:39.033+0000 7f64f6d91640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64f00728a0 con 0x7f64f01622a0 2024-09-11T22:34:39.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:39.033+0000 7f64f6d91640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f64f015f0d0 con 0x7f64f015c540 2024-09-11T22:34:39.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:39.033+0000 7f64effff640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f64f01622a0 0x7f64f015f560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:47768/0 (socket says 172.21.15.100:47768) 2024-09-11T22:34:39.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:39.033+0000 7f64effff640 1 -- 172.21.15.100:0/1789102773 learned_addr learned my addr 172.21.15.100:0/1789102773 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:34:39.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:39.033+0000 7f64f4b2d640 1 --2- 172.21.15.100:0/1789102773 >> v2:172.21.15.167:3300/0 conn(0x7f64f015c540 0x7f64f00c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:39.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:39.034+0000 7f64f4b2d640 1 -- 172.21.15.100:0/1789102773 >> v2:172.21.15.167:3300/0 conn(0x7f64f015c540 msgr2=0x7f64f00c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:34:39.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:39.034+0000 7f64f4b2d640 1 -- 172.21.15.100:0/1789102773 >> v2:172.21.15.167:3300/0 conn(0x7f64f015c540 msgr2=0x7f64f00c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:34:39.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:39.034+0000 7f64f4b2d640 1 --2- 172.21.15.100:0/1789102773 >> v2:172.21.15.167:3300/0 conn(0x7f64f015c540 0x7f64f00c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:34:39.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:39.034+0000 7f64f4b2d640 1 --2- 172.21.15.100:0/1789102773 >> v2:172.21.15.167:3300/0 conn(0x7f64f015c540 0x7f64f00c7cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:34:39.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:39.236+0000 7f64f4b2d640 1 --2- 172.21.15.100:0/1789102773 >> v2:172.21.15.167:3300/0 conn(0x7f64f015c540 0x7f64f00c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:39.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:39.236+0000 7f64f4b2d640 1 -- 172.21.15.100:0/1789102773 >> v2:172.21.15.167:3300/0 conn(0x7f64f015c540 msgr2=0x7f64f00c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:34:39.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:39.236+0000 7f64f4b2d640 1 -- 172.21.15.100:0/1789102773 >> v2:172.21.15.167:3300/0 conn(0x7f64f015c540 msgr2=0x7f64f00c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:34:39.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:39.236+0000 7f64f4b2d640 1 --2- 172.21.15.100:0/1789102773 >> v2:172.21.15.167:3300/0 conn(0x7f64f015c540 0x7f64f00c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:34:39.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:39.236+0000 7f64f4b2d640 1 --2- 172.21.15.100:0/1789102773 >> v2:172.21.15.167:3300/0 conn(0x7f64f015c540 0x7f64f00c7cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:34:39.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:39.637+0000 7f64f4b2d640 1 --2- 172.21.15.100:0/1789102773 >> v2:172.21.15.167:3300/0 conn(0x7f64f015c540 0x7f64f00c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:39.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:39.637+0000 7f64f4b2d640 1 -- 172.21.15.100:0/1789102773 >> v2:172.21.15.167:3300/0 conn(0x7f64f015c540 msgr2=0x7f64f00c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:34:39.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:39.637+0000 7f64f4b2d640 1 -- 172.21.15.100:0/1789102773 >> v2:172.21.15.167:3300/0 conn(0x7f64f015c540 msgr2=0x7f64f00c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:34:39.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:39.637+0000 7f64f4b2d640 1 --2- 172.21.15.100:0/1789102773 >> v2:172.21.15.167:3300/0 conn(0x7f64f015c540 0x7f64f00c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:34:39.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:39.637+0000 7f64f4b2d640 1 --2- 172.21.15.100:0/1789102773 >> v2:172.21.15.167:3300/0 conn(0x7f64f015c540 0x7f64f00c7cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:34:40.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:40.438+0000 7f64f4b2d640 1 --2- 172.21.15.100:0/1789102773 >> v2:172.21.15.167:3300/0 conn(0x7f64f015c540 0x7f64f00c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:40.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:40.438+0000 7f64f4b2d640 1 -- 172.21.15.100:0/1789102773 >> v2:172.21.15.167:3300/0 conn(0x7f64f015c540 msgr2=0x7f64f00c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:34:40.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:40.438+0000 7f64f4b2d640 1 -- 172.21.15.100:0/1789102773 >> v2:172.21.15.167:3300/0 conn(0x7f64f015c540 msgr2=0x7f64f00c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:34:40.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:40.438+0000 7f64f4b2d640 1 --2- 172.21.15.100:0/1789102773 >> v2:172.21.15.167:3300/0 conn(0x7f64f015c540 0x7f64f00c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:34:40.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:40.438+0000 7f64f4b2d640 1 --2- 172.21.15.100:0/1789102773 >> v2:172.21.15.167:3300/0 conn(0x7f64f015c540 0x7f64f00c7cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:34:41.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.423+0000 7f64ef7fe640 1 -- 172.21.15.100:0/1789102773 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2070410768 0 0) 0x7f64f00728a0 con 0x7f64f01622a0 2024-09-11T22:34:41.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.423+0000 7f64ef7fe640 1 -- 172.21.15.100:0/1789102773 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64d8003520 con 0x7f64f01622a0 2024-09-11T22:34:41.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.424+0000 7f64ef7fe640 1 -- 172.21.15.100:0/1789102773 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3068221934 0 0) 0x7f64d8003520 con 0x7f64f01622a0 2024-09-11T22:34:41.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.424+0000 7f64ef7fe640 1 -- 172.21.15.100:0/1789102773 >> v2:172.21.15.167:3300/0 conn(0x7f64f015c540 msgr2=0x7f64f00c7cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:34:41.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.424+0000 7f64ef7fe640 1 --2- 172.21.15.100:0/1789102773 >> v2:172.21.15.167:3300/0 conn(0x7f64f015c540 0x7f64f00c7cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:41.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.424+0000 7f64ef7fe640 1 -- 172.21.15.100:0/1789102773 >> v1:172.21.15.100:6789/0 conn(0x7f64f006bc10 legacy=0x7f64f0169620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:41.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.424+0000 7f64ef7fe640 1 -- 172.21.15.100:0/1789102773 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64f01627c0 con 0x7f64f01622a0 2024-09-11T22:34:41.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.424+0000 7f64ef7fe640 1 -- 172.21.15.100:0/1789102773 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f64e80019f0 con 0x7f64f01622a0 2024-09-11T22:34:41.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.424+0000 7f64ef7fe640 1 -- 172.21.15.100:0/1789102773 >> v1:172.21.15.167:6789/0 conn(0x7f64f01622a0 legacy=0x7f64f015f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:41.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.424+0000 7f64ef7fe640 1 --2- 172.21.15.100:0/1789102773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64d8003a50 0x7f64d8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:41.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.424+0000 7f64ef7fe640 1 --2- 172.21.15.100:0/1789102773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64d8004800 0x7f64d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:41.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.424+0000 7f64f4b2d640 1 --2- 172.21.15.100:0/1789102773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64d8003a50 0x7f64d8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:41.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.424+0000 7f64ef7fe640 1 --2- 172.21.15.100:0/1789102773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64d80052e0 0x7f64d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:41.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.424+0000 7f64ef7fe640 1 -- 172.21.15.100:0/1789102773 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f64f015f0d0 con 0x7f64d8004800 2024-09-11T22:34:41.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.424+0000 7f64ef7fe640 1 -- 172.21.15.100:0/1789102773 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f64d800c1a0 con 0x7f64d80052e0 2024-09-11T22:34:41.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.424+0000 7f64ef7fe640 1 -- 172.21.15.100:0/1789102773 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f64d800c3a0 con 0x7f64d8003a50 2024-09-11T22:34:41.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.425+0000 7f64effff640 1 --2- 172.21.15.100:0/1789102773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64d8004800 0x7f64d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:41.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.425+0000 7f64f532e640 1 --2- 172.21.15.100:0/1789102773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64d80052e0 0x7f64d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:41.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.425+0000 7f64f4b2d640 1 -- 172.21.15.100:0/1789102773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64d80052e0 msgr2=0x7f64d800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:41.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.425+0000 7f64f4b2d640 1 --2- 172.21.15.100:0/1789102773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64d80052e0 0x7f64d800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:41.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.425+0000 7f64f4b2d640 1 -- 172.21.15.100:0/1789102773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64d8004800 msgr2=0x7f64d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:41.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.425+0000 7f64f4b2d640 1 --2- 172.21.15.100:0/1789102773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64d8004800 0x7f64d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:41.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.425+0000 7f64f4b2d640 1 -- 172.21.15.100:0/1789102773 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64d8003520 con 0x7f64d8003a50 2024-09-11T22:34:41.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.426+0000 7f64f532e640 1 -- 172.21.15.100:0/1789102773 reap_dead start 2024-09-11T22:34:41.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.427+0000 7f64f4b2d640 1 --2- 172.21.15.100:0/1789102773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64d8003a50 0x7f64d8003e70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f64e0006fd0 tx=0x7f64d8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=573bbbb4c8534166 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:41.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.427+0000 7f64ef7fe640 1 -- 172.21.15.100:0/1789102773 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e0031070 con 0x7f64d8003a50 2024-09-11T22:34:41.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.427+0000 7f64ef7fe640 1 -- 172.21.15.100:0/1789102773 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e002b790 con 0x7f64d8003a50 2024-09-11T22:34:41.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.428+0000 7f64f6d91640 1 -- 172.21.15.100:0/1789102773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64d8003a50 msgr2=0x7f64d8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:41.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.428+0000 7f64f6d91640 1 --2- 172.21.15.100:0/1789102773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64d8003a50 0x7f64d8003e70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f64e0006fd0 tx=0x7f64d8005830 comp rx=0 tx=0).stop 2024-09-11T22:34:41.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.429+0000 7f64f6d91640 1 -- 172.21.15.100:0/1789102773 shutdown_connections 2024-09-11T22:34:41.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.429+0000 7f64f6d91640 1 --2- 172.21.15.100:0/1789102773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64d8003a50 0x7f64d8003e70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:41.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.429+0000 7f64f6d91640 1 -- 172.21.15.100:0/1789102773 >> 172.21.15.100:0/1789102773 conn(0x7f64f00cbf70 msgr2=0x7f64f00cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:41.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.429+0000 7f64f6d91640 1 -- 172.21.15.100:0/1789102773 shutdown_connections 2024-09-11T22:34:41.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.429+0000 7f64f6d91640 1 -- 172.21.15.100:0/1789102773 wait complete. 2024-09-11T22:34:41.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.430+0000 7f64f6d91640 1 Processor -- start 2024-09-11T22:34:41.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.431+0000 7f64f6d91640 1 -- start start 2024-09-11T22:34:41.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.432+0000 7f64f6d91640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64f0211e00 0x7f64f00c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:41.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.432+0000 7f64f6d91640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64f00c3be0 0x7f64f00c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:41.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.432+0000 7f64f6d91640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64f00cb2d0 0x7f64f00cb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:41.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.432+0000 7f64f6d91640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f64f0163060 con 0x7f64f00cb2d0 2024-09-11T22:34:41.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.432+0000 7f64f6d91640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f64f0162d80 con 0x7f64f0211e00 2024-09-11T22:34:41.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.432+0000 7f64f6d91640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f64f015c920 con 0x7f64f00c3be0 2024-09-11T22:34:41.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.433+0000 7f64f532e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64f00cb2d0 0x7f64f00cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:41.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.433+0000 7f64f532e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64f00cb2d0 0x7f64f00cb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57436/0 (socket says 172.21.15.100:57436) 2024-09-11T22:34:41.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.433+0000 7f64f532e640 1 -- 172.21.15.100:0/1501220920 learned_addr learned my addr 172.21.15.100:0/1501220920 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:41.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.434+0000 7f64effff640 1 --2- 172.21.15.100:0/1501220920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64f00c3be0 0x7f64f00c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:41.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.434+0000 7f64f532e640 1 -- 172.21.15.100:0/1501220920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64f00cb2d0 msgr2=0x7f64f00cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-11T22:34:41.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.434+0000 7f64f532e640 1 -- 172.21.15.100:0/1501220920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64f00cb2d0 msgr2=0x7f64f00cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:34:41.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.434+0000 7f64f532e640 1 --2- 172.21.15.100:0/1501220920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64f00cb2d0 0x7f64f00cb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:34:41.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.434+0000 7f64f532e640 1 --2- 172.21.15.100:0/1501220920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64f00cb2d0 0x7f64f00cb750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:34:41.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.434+0000 7f64effff640 1 -- 172.21.15.100:0/1501220920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64f0211e00 msgr2=0x7f64f00c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:41.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.434+0000 7f64effff640 1 --2- 172.21.15.100:0/1501220920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64f0211e00 0x7f64f00c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:41.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.434+0000 7f64effff640 1 -- 172.21.15.100:0/1501220920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64f00cb2d0 msgr2=0x7f64f00cb750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:34:41.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.434+0000 7f64effff640 1 --2- 172.21.15.100:0/1501220920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64f00cb2d0 0x7f64f00cb750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:41.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.434+0000 7f64effff640 1 -- 172.21.15.100:0/1501220920 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64f00c5080 con 0x7f64f00c3be0 2024-09-11T22:34:41.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.434+0000 7f64effff640 1 --2- 172.21.15.100:0/1501220920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64f00c3be0 0x7f64f00c5c20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f64e8007a70 tx=0x7f64e800e530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:41.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.435+0000 7f64ed7fa640 1 -- 172.21.15.100:0/1501220920 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e800edf0 con 0x7f64f00c3be0 2024-09-11T22:34:41.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.435+0000 7f64f6d91640 1 -- 172.21.15.100:0/1501220920 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64f017d430 con 0x7f64f00c3be0 2024-09-11T22:34:41.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.435+0000 7f64f6d91640 1 -- 172.21.15.100:0/1501220920 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f64f0156930 con 0x7f64f00c3be0 2024-09-11T22:34:41.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.436+0000 7f64ed7fa640 1 -- 172.21.15.100:0/1501220920 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e8018070 con 0x7f64f00c3be0 2024-09-11T22:34:41.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.436+0000 7f64ed7fa640 1 -- 172.21.15.100:0/1501220920 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e8013660 con 0x7f64f00c3be0 2024-09-11T22:34:41.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.437+0000 7f64f6d91640 1 -- 172.21.15.100:0/1501220920 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64f00c2fc0 con 0x7f64f00c3be0 2024-09-11T22:34:41.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.438+0000 7f64ed7fa640 1 -- 172.21.15.100:0/1501220920 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f64e8013800 con 0x7f64f00c3be0 2024-09-11T22:34:41.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.439+0000 7f64ed7fa640 1 --2- 172.21.15.100:0/1501220920 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f64dc06bf00 0x7f64dc06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:41.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.439+0000 7f64ed7fa640 1 -- 172.21.15.100:0/1501220920 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f64e808b850 con 0x7f64f00c3be0 2024-09-11T22:34:41.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.439+0000 7f64f4b2d640 1 --2- 172.21.15.100:0/1501220920 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f64dc06bf00 0x7f64dc06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:41.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.441+0000 7f64f4b2d640 1 --2- 172.21.15.100:0/1501220920 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f64dc06bf00 0x7f64dc06e3c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f64e0036000 tx=0x7f64e002d000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:41.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.447+0000 7f64ed7fa640 1 -- 172.21.15.100:0/1501220920 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f64e8059dc0 con 0x7f64f00c3be0 2024-09-11T22:34:41.955 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":104,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:34:41.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.950+0000 7f64f6d91640 1 -- 172.21.15.100:0/1501220920 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f64f00c7ad0 con 0x7f64f00c3be0 2024-09-11T22:34:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.954+0000 7f64ed7fa640 1 -- 172.21.15.100:0/1501220920 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f64e80596c0 con 0x7f64f00c3be0 2024-09-11T22:34:41.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.958+0000 7f64d6ffd640 1 -- 172.21.15.100:0/1501220920 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f64dc06bf00 msgr2=0x7f64dc06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:41.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.958+0000 7f64d6ffd640 1 --2- 172.21.15.100:0/1501220920 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f64dc06bf00 0x7f64dc06e3c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f64e0036000 tx=0x7f64e002d000 comp rx=0 tx=0).stop 2024-09-11T22:34:41.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.958+0000 7f64d6ffd640 1 -- 172.21.15.100:0/1501220920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64f00c3be0 msgr2=0x7f64f00c5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:41.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.958+0000 7f64d6ffd640 1 --2- 172.21.15.100:0/1501220920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64f00c3be0 0x7f64f00c5c20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f64e8007a70 tx=0x7f64e800e530 comp rx=0 tx=0).stop 2024-09-11T22:34:41.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.958+0000 7f64d6ffd640 1 -- 172.21.15.100:0/1501220920 shutdown_connections 2024-09-11T22:34:41.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.958+0000 7f64d6ffd640 1 --2- 172.21.15.100:0/1501220920 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f64dc06bf00 0x7f64dc06e3c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:41.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.958+0000 7f64d6ffd640 1 --2- 172.21.15.100:0/1501220920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64f00cb2d0 0x7f64f00cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:41.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.958+0000 7f64d6ffd640 1 --2- 172.21.15.100:0/1501220920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64f00c3be0 0x7f64f00c5c20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:41.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.958+0000 7f64d6ffd640 1 --2- 172.21.15.100:0/1501220920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64f0211e00 0x7f64f00c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:41.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.958+0000 7f64d6ffd640 1 -- 172.21.15.100:0/1501220920 >> 172.21.15.100:0/1501220920 conn(0x7f64f00cbf70 msgr2=0x7f64f01595b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:41.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.958+0000 7f64d6ffd640 1 -- 172.21.15.100:0/1501220920 shutdown_connections 2024-09-11T22:34:41.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:41.958+0000 7f64d6ffd640 1 -- 172.21.15.100:0/1501220920 wait complete. 2024-09-11T22:34:41.978 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:34:41.978 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:34:41.978 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:34:42.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.161+0000 7ff44f096640 1 Processor -- start 2024-09-11T22:34:42.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.161+0000 7ff44f096640 1 -- start start 2024-09-11T22:34:42.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.162+0000 7ff44f096640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff44004c950 0x7ff4400d4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.162+0000 7ff44e094640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff44004c950 0x7ff4400d4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:42.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.162+0000 7ff44f096640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff4400dabc0 0x7ff4400db010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.162+0000 7ff44f096640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4400dbb50 con 0x7ff440046fc0 2024-09-11T22:34:42.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.162+0000 7ff44f096640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7ff4400473f0 con 0x7ff44004c950 2024-09-11T22:34:42.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.162+0000 7ff44f096640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7ff440046b30 con 0x7ff4400dabc0 2024-09-11T22:34:42.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.163+0000 7ff44e094640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff44004c950 0x7ff4400d4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57444/0 (socket says 172.21.15.100:57444) 2024-09-11T22:34:42.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.163+0000 7ff44e094640 1 -- 172.21.15.100:0/2595742731 learned_addr learned my addr 172.21.15.100:0/2595742731 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:42.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.163+0000 7ff44e895640 1 --2- 172.21.15.100:0/2595742731 >> v2:172.21.15.167:3300/0 conn(0x7ff4400dabc0 0x7ff4400db010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:42.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.163+0000 7ff44e094640 1 -- 172.21.15.100:0/2595742731 >> v2:172.21.15.167:3300/0 conn(0x7ff4400dabc0 msgr2=0x7ff4400db010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:42.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.163+0000 7ff44e094640 1 --2- 172.21.15.100:0/2595742731 >> v2:172.21.15.167:3300/0 conn(0x7ff4400dabc0 0x7ff4400db010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.163+0000 7ff44e094640 1 -- 172.21.15.100:0/2595742731 >> v1:172.21.15.167:6789/0 conn(0x7ff440046fc0 legacy=0x7ff44004b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:42.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.163+0000 7ff44e094640 1 -- 172.21.15.100:0/2595742731 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4400db870 con 0x7ff44004c950 2024-09-11T22:34:42.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.165+0000 7ff44e094640 1 --2- 172.21.15.100:0/2595742731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff44004c950 0x7ff4400d4f90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff4480518b0 tx=0x7ff4480a6b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418c0ed09e12439a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:42.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.165+0000 7ff44d092640 1 -- 172.21.15.100:0/2595742731 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4480a8850 con 0x7ff44004c950 2024-09-11T22:34:42.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.166+0000 7ff44d092640 1 -- 172.21.15.100:0/2595742731 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4480a89f0 con 0x7ff44004c950 2024-09-11T22:34:42.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.166+0000 7ff44d092640 1 -- 172.21.15.100:0/2595742731 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4480a8e60 con 0x7ff44004c950 2024-09-11T22:34:42.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.168+0000 7ff44f096640 1 -- 172.21.15.100:0/2595742731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff44004c950 msgr2=0x7ff4400d4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:42.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.168+0000 7ff44f096640 1 --2- 172.21.15.100:0/2595742731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff44004c950 0x7ff4400d4f90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff4480518b0 tx=0x7ff4480a6b30 comp rx=0 tx=0).stop 2024-09-11T22:34:42.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.169+0000 7ff44f096640 1 -- 172.21.15.100:0/2595742731 shutdown_connections 2024-09-11T22:34:42.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.169+0000 7ff44f096640 1 --2- 172.21.15.100:0/2595742731 >> v2:172.21.15.167:3300/0 conn(0x7ff4400dabc0 0x7ff4400db010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.169+0000 7ff44f096640 1 --2- 172.21.15.100:0/2595742731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff44004c950 0x7ff4400d4f90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.169+0000 7ff44f096640 1 -- 172.21.15.100:0/2595742731 >> 172.21.15.100:0/2595742731 conn(0x7ff440050560 msgr2=0x7ff440050940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:42.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.170+0000 7ff44f096640 1 -- 172.21.15.100:0/2595742731 shutdown_connections 2024-09-11T22:34:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.173+0000 7ff44f096640 1 -- 172.21.15.100:0/2595742731 wait complete. 2024-09-11T22:34:42.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.175+0000 7ff44f096640 1 Processor -- start 2024-09-11T22:34:42.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.175+0000 7ff44f096640 1 -- start start 2024-09-11T22:34:42.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.176+0000 7ff44f096640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff440046fc0 0x7ff4400d1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.176+0000 7ff44f096640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff44004c950 0x7ff4400c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.177+0000 7ff44e094640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff440046fc0 0x7ff4400d1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.177+0000 7ff44e094640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff440046fc0 0x7ff4400d1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:49180/0 (socket says 172.21.15.100:49180) 2024-09-11T22:34:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.177+0000 7ff44d893640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff44004c950 0x7ff4400c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.177+0000 7ff44e094640 1 -- 172.21.15.100:0/2702802801 learned_addr learned my addr 172.21.15.100:0/2702802801 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.177+0000 7ff44f096640 1 --2- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4400dabc0 0x7ff4400c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.177+0000 7ff44f096640 1 -- 172.21.15.100:0/2702802801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff4400467c0 con 0x7ff4400dabc0 2024-09-11T22:34:42.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.177+0000 7ff44f096640 1 -- 172.21.15.100:0/2702802801 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff4400464e0 con 0x7ff440046fc0 2024-09-11T22:34:42.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.177+0000 7ff44f096640 1 -- 172.21.15.100:0/2702802801 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff4400db550 con 0x7ff44004c950 2024-09-11T22:34:42.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.178+0000 7ff44e895640 1 --2- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4400dabc0 0x7ff4400c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:42.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.178+0000 7ff44e094640 1 -- 172.21.15.100:0/2702802801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff44004c950 msgr2=0x7ff4400c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:42.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.178+0000 7ff44e094640 1 --2- 172.21.15.100:0/2702802801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff44004c950 0x7ff4400c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.178+0000 7ff44e094640 1 -- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4400dabc0 msgr2=0x7ff4400c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:42.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.178+0000 7ff44e094640 1 --2- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4400dabc0 0x7ff4400c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.178+0000 7ff44e094640 1 -- 172.21.15.100:0/2702802801 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4400d7830 con 0x7ff440046fc0 2024-09-11T22:34:42.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.178+0000 7ff44e895640 1 --2- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4400dabc0 0x7ff4400c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:34:42.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.179+0000 7ff44e094640 1 --2- 172.21.15.100:0/2702802801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff440046fc0 0x7ff4400d1770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff448074890 tx=0x7ff448069df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:42.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.179+0000 7ff43effd640 1 -- 172.21.15.100:0/2702802801 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4480a9be0 con 0x7ff440046fc0 2024-09-11T22:34:42.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.179+0000 7ff43effd640 1 -- 172.21.15.100:0/2702802801 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4480a9d80 con 0x7ff440046fc0 2024-09-11T22:34:42.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.179+0000 7ff44f096640 1 -- 172.21.15.100:0/2702802801 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4400d56b0 con 0x7ff440046fc0 2024-09-11T22:34:42.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.180+0000 7ff44f096640 1 -- 172.21.15.100:0/2702802801 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff44004f760 con 0x7ff440046fc0 2024-09-11T22:34:42.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.180+0000 7ff43effd640 1 -- 172.21.15.100:0/2702802801 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4480bd670 con 0x7ff440046fc0 2024-09-11T22:34:42.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.181+0000 7ff43cff9640 1 --2- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4400d73a0 0x7ff440175990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.181+0000 7ff43cff9640 1 -- 172.21.15.100:0/2702802801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff4400516b0 con 0x7ff4400d73a0 2024-09-11T22:34:42.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.182+0000 7ff44d893640 1 --2- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4400d73a0 0x7ff440175990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:42.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.182+0000 7ff43effd640 1 -- 172.21.15.100:0/2702802801 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff4480bd810 con 0x7ff440046fc0 2024-09-11T22:34:42.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.183+0000 7ff44d893640 1 -- 172.21.15.100:0/2702802801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff440047570 con 0x7ff4400d73a0 2024-09-11T22:34:42.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.183+0000 7ff43effd640 1 --2- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff42c06bf30 0x7ff42c06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.183+0000 7ff43effd640 1 -- 172.21.15.100:0/2702802801 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7ff4480c4070 con 0x7ff440046fc0 2024-09-11T22:34:42.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.183+0000 7ff44d893640 1 --2- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4400d73a0 0x7ff440175990 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff4400d2200 tx=0x7ff43800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:42.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.183+0000 7ff44e895640 1 --2- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff42c06bf30 0x7ff42c06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:42.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.184+0000 7ff44e895640 1 --2- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff42c06bf30 0x7ff42c06e3f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff444009b10 tx=0x7ff444008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:42.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.184+0000 7ff43effd640 1 -- 172.21.15.100:0/2702802801 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff438017070 con 0x7ff4400d73a0 2024-09-11T22:34:42.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.184+0000 7ff43effd640 1 -- 172.21.15.100:0/2702802801 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff43800c770 con 0x7ff4400d73a0 2024-09-11T22:34:42.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.184+0000 7ff43effd640 1 -- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4400d73a0 msgr2=0x7ff440175990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:42.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.184+0000 7ff43effd640 1 --2- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4400d73a0 0x7ff440175990 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff4400d2200 tx=0x7ff43800ec70 comp rx=0 tx=0).stop 2024-09-11T22:34:42.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.184+0000 7ff43effd640 1 -- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4400d73a0 msgr2=0x7ff440175990 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:34:42.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.184+0000 7ff43effd640 1 --2- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4400d73a0 0x7ff440175990 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.196+0000 7ff43cff9640 1 --2- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4400d8200 0x7ff440173e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.196+0000 7ff43cff9640 1 -- 172.21.15.100:0/2702802801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff44004c040 con 0x7ff4400d8200 2024-09-11T22:34:42.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.196+0000 7ff44d893640 1 --2- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4400d8200 0x7ff440173e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:42.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.198+0000 7ff44d893640 1 -- 172.21.15.100:0/2702802801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff4400d0fe0 con 0x7ff4400d8200 2024-09-11T22:34:42.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.198+0000 7ff44d893640 1 --2- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4400d8200 0x7ff440173e30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff4400d2200 tx=0x7ff4380046f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:42.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.199+0000 7ff43effd640 1 -- 172.21.15.100:0/2702802801 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff438017070 con 0x7ff4400d8200 2024-09-11T22:34:42.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.199+0000 7ff43effd640 1 -- 172.21.15.100:0/2702802801 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4554 (secure 0 0 0) 0x7ff438005e00 con 0x7ff4400d8200 2024-09-11T22:34:42.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.199+0000 7ff43effd640 1 -- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4400d8200 msgr2=0x7ff440173e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:42.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.199+0000 7ff43effd640 1 --2- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4400d8200 0x7ff440173e30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff4400d2200 tx=0x7ff4380046f0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.200+0000 7ff43effd640 1 -- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4400d8200 msgr2=0x7ff440173e30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:34:42.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.200+0000 7ff43effd640 1 --2- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4400d8200 0x7ff440173e30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.201 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:34:42.202 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:34:42.202 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:34:42.202 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:34:42.202 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 104, 2024-09-11T22:34:42.202 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 7044, 2024-09-11T22:34:42.202 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:34:42.202 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:34:42.202 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:34:42.202 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:34:42.202 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:42.202 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:34:42.202 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:34:42.203 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:34:42.203 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:34:42.203 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:42.204 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:42.204 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:42.204 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:42.204 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:42.204 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:42.204 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:42.204 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:42.204 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:42.204 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:42.205 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:42.205 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:42.205 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:34:42.205 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:34:42.205 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:42.205 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:42.205 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:42.205 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:42.205 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:42.205 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:42.205 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:42.205 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:42.206 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:42.206 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:42.206 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:42.206 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:42.206 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.206 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:34:42.206 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:34:42.206 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:34:42.206 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:34:42.206 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:34:42.206 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:34:42.206 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:34:42.206 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:34:42.207 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:34:42.207 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:34:42.207 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:34:42.207 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:34:42.207 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:34:42.207 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:34:42.207 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:34:42.207 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:34:42.207 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:34:42.207 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:42.207 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:42.207 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:42.207 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:42.208 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:42.208 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:42.208 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:42.208 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:42.208 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:42.208 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:42.208 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:42.208 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:42.208 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:34:42.208 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.208 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:34:42.208 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.208 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:34:42.209 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:34:42.209 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:42.209 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:42.209 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.209 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:42.209 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:34:42.209 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:42.209 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.209 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.209 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:42.209 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:34:42.209 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:42.209 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.210 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:42.210 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.210 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:34:42.210 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:34:42.210 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:42.210 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:42.210 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:42.210 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.210 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.210 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:34:42.210 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:34:42.210 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:42.210 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:42.211 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.211 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:42.211 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:34:42.211 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:42.211 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.211 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.211 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:42.211 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:34:42.211 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:42.211 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.211 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:42.211 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.211 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:34:42.212 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:34:42.212 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:42.212 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:42.212 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:42.212 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.212 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.212 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:34:42.212 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:34:42.212 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:42.212 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:42.212 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.212 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:42.212 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:34:42.213 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:42.213 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.213 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.213 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:42.213 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:34:42.213 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:42.213 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.213 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:42.213 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.213 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:34:42.213 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:34:42.213 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:42.213 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:42.214 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:42.214 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.214 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:42.214 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.214 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:34:42.214 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:34:42.214 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.214 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:42.214 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:42.214 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:34:42.214 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.214 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:42.215 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:34:42.215 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.215 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:42.215 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:42.215 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:34:42.215 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.215 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:42.215 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.215 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:34:42.215 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:34:42.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.201+0000 7ff43cff9640 1 -- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff42c06bf30 msgr2=0x7ff42c06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:42.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.201+0000 7ff43cff9640 1 --2- 172.21.15.100:0/2702802801 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff42c06bf30 0x7ff42c06e3f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff444009b10 tx=0x7ff444008040 comp rx=0 tx=0).stop 2024-09-11T22:34:42.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.201+0000 7ff43cff9640 1 -- 172.21.15.100:0/2702802801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff440046fc0 msgr2=0x7ff4400d1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:42.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.201+0000 7ff43cff9640 1 --2- 172.21.15.100:0/2702802801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff440046fc0 0x7ff4400d1770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff448074890 tx=0x7ff448069df0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.201+0000 7ff44e895640 1 -- 172.21.15.100:0/2702802801 reap_dead start 2024-09-11T22:34:42.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.201+0000 7ff43cff9640 1 -- 172.21.15.100:0/2702802801 shutdown_connections 2024-09-11T22:34:42.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.201+0000 7ff43cff9640 1 --2- 172.21.15.100:0/2702802801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff440046fc0 0x7ff4400d1770 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.201+0000 7ff43cff9640 1 -- 172.21.15.100:0/2702802801 >> 172.21.15.100:0/2702802801 conn(0x7ff440050560 msgr2=0x7ff4400cb240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:42.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.202+0000 7ff43cff9640 1 -- 172.21.15.100:0/2702802801 shutdown_connections 2024-09-11T22:34:42.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.202+0000 7ff43cff9640 1 -- 172.21.15.100:0/2702802801 wait complete. 2024-09-11T22:34:42.223 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:34:42.223 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:34:42.224 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:34:42.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.437+0000 7fccde752640 1 Processor -- start 2024-09-11T22:34:42.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.437+0000 7fccde752640 1 -- start start 2024-09-11T22:34:42.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.438+0000 7fccde752640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccd815c7d0 0x7fccd815fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.438+0000 7fccde752640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fccd80728c0 0x7fccd8162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.438+0000 7fccde752640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccd815ef90 con 0x7fccd80c7eb0 2024-09-11T22:34:42.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.438+0000 7fccde752640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fccd815cbb0 con 0x7fccd80728c0 2024-09-11T22:34:42.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.438+0000 7fccde752640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fccd80c7750 con 0x7fccd815c7d0 2024-09-11T22:34:42.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.439+0000 7fccd7fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccd815c7d0 0x7fccd815fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:42.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.439+0000 7fccd77fe640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fccd80c7eb0 0x7fccd80c8dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:34136/0 (socket says 172.21.15.100:34136) 2024-09-11T22:34:42.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.439+0000 7fccd77fe640 1 -- 172.21.15.100:0/1500934448 learned_addr learned my addr 172.21.15.100:0/1500934448 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:34:42.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.440+0000 7fccd6ffd640 1 -- 172.21.15.100:0/1500934448 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3118411291 0 0) 0x7fccd815ef90 con 0x7fccd80c7eb0 2024-09-11T22:34:42.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.440+0000 7fccd6ffd640 1 -- 172.21.15.100:0/1500934448 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccc0003520 con 0x7fccd80c7eb0 2024-09-11T22:34:42.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.440+0000 7fccd7fff640 1 -- 172.21.15.100:0/1500934448 >> v2:172.21.15.167:3300/0 conn(0x7fccd80728c0 msgr2=0x7fccd8162da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:34:42.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.440+0000 7fccd7fff640 1 --2- 172.21.15.100:0/1500934448 >> v2:172.21.15.167:3300/0 conn(0x7fccd80728c0 0x7fccd8162da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.440+0000 7fccd7fff640 1 -- 172.21.15.100:0/1500934448 >> v1:172.21.15.100:6789/0 conn(0x7fccd80c7eb0 legacy=0x7fccd80c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:42.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.440+0000 7fccd7fff640 1 -- 172.21.15.100:0/1500934448 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd815f230 con 0x7fccd815c7d0 2024-09-11T22:34:42.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.445+0000 7fccd7fff640 1 --2- 172.21.15.100:0/1500934448 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccd815c7d0 0x7fccd815fa30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fccc80097a0 tx=0x7fccc802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ae3305f076dfc49 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:42.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.445+0000 7fccd6ffd640 1 -- 172.21.15.100:0/1500934448 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc8037070 con 0x7fccd815c7d0 2024-09-11T22:34:42.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.445+0000 7fccd6ffd640 1 -- 172.21.15.100:0/1500934448 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc8032440 con 0x7fccd815c7d0 2024-09-11T22:34:42.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.446+0000 7fccde752640 1 -- 172.21.15.100:0/1500934448 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccd815c7d0 msgr2=0x7fccd815fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:42.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.446+0000 7fccde752640 1 --2- 172.21.15.100:0/1500934448 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccd815c7d0 0x7fccd815fa30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fccc80097a0 tx=0x7fccc802a1a0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.446+0000 7fccde752640 1 -- 172.21.15.100:0/1500934448 shutdown_connections 2024-09-11T22:34:42.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.446+0000 7fccde752640 1 --2- 172.21.15.100:0/1500934448 >> v2:172.21.15.167:3300/0 conn(0x7fccd80728c0 0x7fccd8162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.446+0000 7fccde752640 1 --2- 172.21.15.100:0/1500934448 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccd815c7d0 0x7fccd815fa30 secure :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fccc80097a0 tx=0x7fccc802a1a0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.446+0000 7fccde752640 1 -- 172.21.15.100:0/1500934448 >> 172.21.15.100:0/1500934448 conn(0x7fccd806f360 msgr2=0x7fccd806f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:42.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.449+0000 7fccde752640 1 -- 172.21.15.100:0/1500934448 shutdown_connections 2024-09-11T22:34:42.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.449+0000 7fccde752640 1 -- 172.21.15.100:0/1500934448 wait complete. 2024-09-11T22:34:42.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.451+0000 7fccde752640 1 Processor -- start 2024-09-11T22:34:42.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.451+0000 7fccde752640 1 -- start start 2024-09-11T22:34:42.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.452+0000 7fccde752640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccd80728c0 0x7fccd80cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.452+0000 7fccde752640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccd80c7eb0 0x7fccd80c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.452+0000 7fccde752640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccd80c5060 0x7fccd80c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.452+0000 7fccde752640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fccd80c7a30 con 0x7fccd80c5060 2024-09-11T22:34:42.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.452+0000 7fccde752640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fccd80c70e0 con 0x7fccd80c7eb0 2024-09-11T22:34:42.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.452+0000 7fccde752640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fccd80c7430 con 0x7fccd80728c0 2024-09-11T22:34:42.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.453+0000 7fccdccef640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccd80c5060 0x7fccd80c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:42.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.453+0000 7fccdccef640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccd80c5060 0x7fccd80c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58576/0 (socket says 172.21.15.100:58576) 2024-09-11T22:34:42.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.453+0000 7fccdccef640 1 -- 172.21.15.100:0/851773061 learned_addr learned my addr 172.21.15.100:0/851773061 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:42.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.453+0000 7fccd7fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccd80728c0 0x7fccd80cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:42.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.454+0000 7fccd77fe640 1 --2- 172.21.15.100:0/851773061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccd80c7eb0 0x7fccd80c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:42.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.454+0000 7fccdccef640 1 -- 172.21.15.100:0/851773061 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccd80728c0 msgr2=0x7fccd80cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:42.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.454+0000 7fccdccef640 1 --2- 172.21.15.100:0/851773061 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccd80728c0 0x7fccd80cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.454+0000 7fccdccef640 1 -- 172.21.15.100:0/851773061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccd80c7eb0 msgr2=0x7fccd80c5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:42.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.454+0000 7fccdccef640 1 --2- 172.21.15.100:0/851773061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccd80c7eb0 0x7fccd80c5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.454+0000 7fccdccef640 1 -- 172.21.15.100:0/851773061 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd80c33b0 con 0x7fccd80c5060 2024-09-11T22:34:42.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.455+0000 7fccdccef640 1 --2- 172.21.15.100:0/851773061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccd80c5060 0x7fccd80c5f40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fccd000b990 tx=0x7fccd000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:42.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.455+0000 7fccd4ff9640 1 -- 172.21.15.100:0/851773061 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd0019070 con 0x7fccd80c5060 2024-09-11T22:34:42.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.455+0000 7fccd4ff9640 1 -- 172.21.15.100:0/851773061 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccd000cba0 con 0x7fccd80c5060 2024-09-11T22:34:42.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.455+0000 7fccde752640 1 -- 172.21.15.100:0/851773061 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccd80c3650 con 0x7fccd80c5060 2024-09-11T22:34:42.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.455+0000 7fccd4ff9640 1 -- 172.21.15.100:0/851773061 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd0014440 con 0x7fccd80c5060 2024-09-11T22:34:42.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.455+0000 7fccde752640 1 -- 172.21.15.100:0/851773061 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccd80ca400 con 0x7fccd80c5060 2024-09-11T22:34:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.463+0000 7fccd4ff9640 1 -- 172.21.15.100:0/851773061 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fccd001c070 con 0x7fccd80c5060 2024-09-11T22:34:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.463+0000 7fccde752640 1 --2- 172.21.15.100:0/851773061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccd8179f10 0x7fccd817a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.463+0000 7fccde752640 1 -- 172.21.15.100:0/851773061 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fccd80c31a0 con 0x7fccd8179f10 2024-09-11T22:34:42.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.464+0000 7fccd4ff9640 1 --2- 172.21.15.100:0/851773061 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fccc406bf00 0x7fccc406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.464+0000 7fccd4ff9640 1 -- 172.21.15.100:0/851773061 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fccd008afa0 con 0x7fccd80c5060 2024-09-11T22:34:42.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.469+0000 7fccd77fe640 1 --2- 172.21.15.100:0/851773061 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fccc406bf00 0x7fccc406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:42.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.470+0000 7fccd77fe640 1 --2- 172.21.15.100:0/851773061 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fccc406bf00 0x7fccc406e3c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fccd80c5010 tx=0x7fcccc007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:42.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.478+0000 7fccd7fff640 1 --2- 172.21.15.100:0/851773061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccd8179f10 0x7fccd817a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:42.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.478+0000 7fccd7fff640 1 -- 172.21.15.100:0/851773061 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fccd80c7c90 con 0x7fccd8179f10 2024-09-11T22:34:42.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.483+0000 7fccd7fff640 1 --2- 172.21.15.100:0/851773061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccd8179f10 0x7fccd817a2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fccd80c9ad0 tx=0x7fccc80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:42.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.487+0000 7fccd4ff9640 1 -- 172.21.15.100:0/851773061 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc8037040 con 0x7fccd8179f10 2024-09-11T22:34:42.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.487+0000 7fccd4ff9640 1 -- 172.21.15.100:0/851773061 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fccc8038040 con 0x7fccd8179f10 2024-09-11T22:34:42.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.487+0000 7fccd4ff9640 1 -- 172.21.15.100:0/851773061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccd8179f10 msgr2=0x7fccd817a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:42.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.487+0000 7fccd4ff9640 1 --2- 172.21.15.100:0/851773061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccd8179f10 0x7fccd817a2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fccd80c9ad0 tx=0x7fccc80046c0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.487+0000 7fccd4ff9640 1 -- 172.21.15.100:0/851773061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccd8179f10 msgr2=0x7fccd817a2f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:34:42.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.487+0000 7fccd4ff9640 1 --2- 172.21.15.100:0/851773061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccd8179f10 0x7fccd817a2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.502+0000 7fccde752640 1 --2- 172.21.15.100:0/851773061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccd80ca9f0 0x7fccd80cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.502+0000 7fccde752640 1 -- 172.21.15.100:0/851773061 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fccd80c13e0 con 0x7fccd80ca9f0 2024-09-11T22:34:42.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.504+0000 7fccd7fff640 1 --2- 172.21.15.100:0/851773061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccd80ca9f0 0x7fccd80cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:42.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.507+0000 7fccd7fff640 1 -- 172.21.15.100:0/851773061 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fccd80c1100 con 0x7fccd80ca9f0 2024-09-11T22:34:42.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.507+0000 7fccd7fff640 1 --2- 172.21.15.100:0/851773061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccd80ca9f0 0x7fccd80cadd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fccd80c3320 tx=0x7fccc8008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:42.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.510+0000 7fccd4ff9640 1 -- 172.21.15.100:0/851773061 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc8037070 con 0x7fccd80ca9f0 2024-09-11T22:34:42.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.511+0000 7fccd4ff9640 1 -- 172.21.15.100:0/851773061 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5054 (secure 0 0 0) 0x7fccc804d070 con 0x7fccd80ca9f0 2024-09-11T22:34:42.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.511+0000 7fccd4ff9640 1 -- 172.21.15.100:0/851773061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccd80ca9f0 msgr2=0x7fccd80cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:42.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.511+0000 7fccd4ff9640 1 --2- 172.21.15.100:0/851773061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccd80ca9f0 0x7fccd80cadd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fccd80c3320 tx=0x7fccc8008030 comp rx=0 tx=0).stop 2024-09-11T22:34:42.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.511+0000 7fccd4ff9640 1 -- 172.21.15.100:0/851773061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccd80ca9f0 msgr2=0x7fccd80cadd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:34:42.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.511+0000 7fccd4ff9640 1 --2- 172.21.15.100:0/851773061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccd80ca9f0 0x7fccd80cadd0 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fccd80c3320 tx=0x7fccc8008030 comp rx=0 tx=0).stop 2024-09-11T22:34:42.513 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:34:42.513 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:34:42.513 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:34:42.513 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:34:42.514 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 104, 2024-09-11T22:34:42.514 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 74042, 2024-09-11T22:34:42.514 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:34:42.514 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:34:42.514 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:34:42.514 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:34:42.514 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:42.514 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:34:42.514 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:34:42.514 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:34:42.514 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:34:42.514 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:42.514 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:42.514 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:42.515 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:42.515 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:42.515 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:42.515 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:42.515 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:42.515 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:42.515 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:42.515 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:42.515 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:42.515 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:34:42.515 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:34:42.515 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:42.515 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:42.515 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:42.516 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:42.516 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:42.516 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:42.516 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:42.516 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:42.516 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:42.516 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:42.516 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:42.516 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:42.516 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.516 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:34:42.516 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:34:42.516 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:34:42.516 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:34:42.516 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:34:42.517 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:34:42.517 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:34:42.517 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:34:42.517 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:34:42.517 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:34:42.517 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:34:42.517 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:34:42.517 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:34:42.517 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:34:42.517 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:34:42.517 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:34:42.517 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:34:42.517 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:42.517 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:42.518 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:42.518 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:42.518 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:42.518 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:42.518 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:42.518 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:42.518 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:42.518 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:42.518 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:42.518 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:42.518 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:34:42.518 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.518 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:34:42.518 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.519 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:34:42.519 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:34:42.519 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:42.519 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:42.519 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.519 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:42.519 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:34:42.519 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:42.519 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.519 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.519 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:42.519 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:34:42.519 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:42.519 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.519 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:42.520 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.520 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:34:42.520 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:34:42.520 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:42.520 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:42.520 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:42.520 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.520 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.520 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:34:42.520 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:34:42.520 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:42.520 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:42.520 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.520 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:42.521 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:34:42.521 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:42.521 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.521 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.521 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:42.521 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:34:42.521 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:42.521 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.521 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:42.521 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.521 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:34:42.521 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:34:42.521 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:42.521 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:42.522 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:42.522 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.522 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.522 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:34:42.522 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:34:42.522 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:42.522 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:42.522 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.522 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:42.522 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:34:42.522 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:42.522 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.522 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.522 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:42.523 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:34:42.523 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:42.523 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.523 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:42.523 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.523 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:34:42.523 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:34:42.523 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:42.523 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:42.523 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:42.523 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.523 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:42.523 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.523 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:34:42.523 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:34:42.524 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.524 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:42.524 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:42.524 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:34:42.524 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.524 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:42.524 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:34:42.524 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.524 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:42.524 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:42.524 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4 2024-09-11T22:34:42.524 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.524 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:42.524 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:34:42.525 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.525 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:42.525 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:42.525 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:34:42.525 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.525 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:42.525 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:34:42.525 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.525 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:42.525 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:42.525 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:34:42.525 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.525 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:42.526 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:34:42.526 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.526 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:42.526 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:42.526 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:34:42.526 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.526 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:42.526 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.526 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:34:42.526 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:34:42.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.514+0000 7fccde752640 1 -- 172.21.15.100:0/851773061 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fccc406bf00 msgr2=0x7fccc406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:42.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.514+0000 7fccde752640 1 --2- 172.21.15.100:0/851773061 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fccc406bf00 0x7fccc406e3c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fccd80c5010 tx=0x7fcccc007d30 comp rx=0 tx=0).stop 2024-09-11T22:34:42.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.514+0000 7fccdccef640 1 -- 172.21.15.100:0/851773061 reap_dead start 2024-09-11T22:34:42.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.514+0000 7fccde752640 1 -- 172.21.15.100:0/851773061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccd80c5060 msgr2=0x7fccd80c5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:42.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.514+0000 7fccde752640 1 --2- 172.21.15.100:0/851773061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccd80c5060 0x7fccd80c5f40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fccd000b990 tx=0x7fccd000be50 comp rx=0 tx=0).stop 2024-09-11T22:34:42.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.514+0000 7fccde752640 1 -- 172.21.15.100:0/851773061 shutdown_connections 2024-09-11T22:34:42.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.514+0000 7fccde752640 1 --2- 172.21.15.100:0/851773061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccd80c5060 0x7fccd80c5f40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.514+0000 7fccde752640 1 -- 172.21.15.100:0/851773061 >> 172.21.15.100:0/851773061 conn(0x7fccd806f360 msgr2=0x7fccd8162b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:42.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.515+0000 7fccde752640 1 -- 172.21.15.100:0/851773061 shutdown_connections 2024-09-11T22:34:42.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.515+0000 7fccde752640 1 -- 172.21.15.100:0/851773061 wait complete. 2024-09-11T22:34:42.539 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:34:42.539 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:34:42.539 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:34:42.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.746+0000 7ff4752eb640 1 Processor -- start 2024-09-11T22:34:42.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.748+0000 7ff4752eb640 1 -- start start 2024-09-11T22:34:42.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.749+0000 7ff4752eb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4700c9260 0x7ff47015ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.749+0000 7ff4752eb640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff4700c9640 0x7ff470072c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.749+0000 7ff4752eb640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4700731c0 con 0x7ff4700c7510 2024-09-11T22:34:42.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.749+0000 7ff4752eb640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7ff47015b070 con 0x7ff4700c9640 2024-09-11T22:34:42.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.749+0000 7ff4752eb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff470156bb0 con 0x7ff4700c9260 2024-09-11T22:34:42.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.750+0000 7ff46e7fc640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff4700c9640 0x7ff470072c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:42.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.750+0000 7ff46e7fc640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff4700c9640 0x7ff470072c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58588/0 (socket says 172.21.15.100:58588) 2024-09-11T22:34:42.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.750+0000 7ff46e7fc640 1 -- 172.21.15.100:0/3400358714 learned_addr learned my addr 172.21.15.100:0/3400358714 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:42.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.751+0000 7ff46effd640 1 --2- 172.21.15.100:0/3400358714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4700c9260 0x7ff47015ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:42.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.751+0000 7ff46e7fc640 1 -- 172.21.15.100:0/3400358714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4700c9260 msgr2=0x7ff47015ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:42.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.751+0000 7ff46e7fc640 1 --2- 172.21.15.100:0/3400358714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4700c9260 0x7ff47015ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.751+0000 7ff46e7fc640 1 -- 172.21.15.100:0/3400358714 >> v1:172.21.15.100:6789/0 conn(0x7ff4700c7510 legacy=0x7ff470150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:42.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.751+0000 7ff46e7fc640 1 -- 172.21.15.100:0/3400358714 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff470073470 con 0x7ff4700c9640 2024-09-11T22:34:42.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.752+0000 7ff46e7fc640 1 --2- 172.21.15.100:0/3400358714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4700c9640 0x7ff470072c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff46800d370 tx=0x7ff46802cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c7b32110650b2d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:42.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.753+0000 7ff46dffb640 1 -- 172.21.15.100:0/3400358714 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46800be60 con 0x7ff4700c9640 2024-09-11T22:34:42.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.753+0000 7ff46dffb640 1 -- 172.21.15.100:0/3400358714 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff46802e8d0 con 0x7ff4700c9640 2024-09-11T22:34:42.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.753+0000 7ff46dffb640 1 -- 172.21.15.100:0/3400358714 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46802eca0 con 0x7ff4700c9640 2024-09-11T22:34:42.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.754+0000 7ff4752eb640 1 -- 172.21.15.100:0/3400358714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4700c9640 msgr2=0x7ff470072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:42.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.754+0000 7ff4752eb640 1 --2- 172.21.15.100:0/3400358714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4700c9640 0x7ff470072c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff46800d370 tx=0x7ff46802cb70 comp rx=0 tx=0).stop 2024-09-11T22:34:42.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.755+0000 7ff4752eb640 1 -- 172.21.15.100:0/3400358714 shutdown_connections 2024-09-11T22:34:42.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.755+0000 7ff4752eb640 1 --2- 172.21.15.100:0/3400358714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4700c9640 0x7ff470072c80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.755+0000 7ff4752eb640 1 --2- 172.21.15.100:0/3400358714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4700c9260 0x7ff47015ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.755+0000 7ff4752eb640 1 -- 172.21.15.100:0/3400358714 >> 172.21.15.100:0/3400358714 conn(0x7ff47006f360 msgr2=0x7ff47006f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:42.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.757+0000 7ff4752eb640 1 -- 172.21.15.100:0/3400358714 shutdown_connections 2024-09-11T22:34:42.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.760+0000 7ff4752eb640 1 -- 172.21.15.100:0/3400358714 wait complete. 2024-09-11T22:34:42.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.762+0000 7ff4752eb640 1 Processor -- start 2024-09-11T22:34:42.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.762+0000 7ff4752eb640 1 -- start start 2024-09-11T22:34:42.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.763+0000 7ff4752eb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4700c7510 0x7ff4700c3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.764+0000 7ff46effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4700c7510 0x7ff4700c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:42.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.764+0000 7ff46effd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4700c7510 0x7ff4700c3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58592/0 (socket says 172.21.15.100:58592) 2024-09-11T22:34:42.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.764+0000 7ff4752eb640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4700c9260 0x7ff47008c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.764+0000 7ff4752eb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4700c9640 0x7ff47006f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.764+0000 7ff4752eb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff470157430 con 0x7ff4700c7510 2024-09-11T22:34:42.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.764+0000 7ff4752eb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff470157150 con 0x7ff4700c9640 2024-09-11T22:34:42.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.764+0000 7ff4752eb640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff470157710 con 0x7ff4700c9260 2024-09-11T22:34:42.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.764+0000 7ff46effd640 1 -- 172.21.15.100:0/770947274 learned_addr learned my addr 172.21.15.100:0/770947274 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:42.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.765+0000 7ff46effd640 1 -- 172.21.15.100:0/770947274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4700c9260 msgr2=0x7ff47008c540 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T22:34:42.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.765+0000 7ff46effd640 1 --2- 172.21.15.100:0/770947274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4700c9260 0x7ff47008c540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.765+0000 7ff46effd640 1 -- 172.21.15.100:0/770947274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4700c9640 msgr2=0x7ff47006f8d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:34:42.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.765+0000 7ff46effd640 1 --2- 172.21.15.100:0/770947274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4700c9640 0x7ff47006f8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.765+0000 7ff46effd640 1 -- 172.21.15.100:0/770947274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4700c3c20 con 0x7ff4700c7510 2024-09-11T22:34:42.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.766+0000 7ff46effd640 1 --2- 172.21.15.100:0/770947274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4700c7510 0x7ff4700c3270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff46000d8f0 tx=0x7ff46000ddb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:42.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.767+0000 7ff4577fe640 1 -- 172.21.15.100:0/770947274 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46000b6c0 con 0x7ff4700c7510 2024-09-11T22:34:42.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.767+0000 7ff4752eb640 1 -- 172.21.15.100:0/770947274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff470147af0 con 0x7ff4700c7510 2024-09-11T22:34:42.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.767+0000 7ff4752eb640 1 -- 172.21.15.100:0/770947274 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4701480b0 con 0x7ff4700c7510 2024-09-11T22:34:42.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.771+0000 7ff4577fe640 1 -- 172.21.15.100:0/770947274 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff460019070 con 0x7ff4700c7510 2024-09-11T22:34:42.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.773+0000 7ff4577fe640 1 -- 172.21.15.100:0/770947274 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46000ba60 con 0x7ff4700c7510 2024-09-11T22:34:42.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.774+0000 7ff4577fe640 1 -- 172.21.15.100:0/770947274 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff46000bc00 con 0x7ff4700c7510 2024-09-11T22:34:42.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.774+0000 7ff4577fe640 1 --2- 172.21.15.100:0/770947274 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff45c06bf30 0x7ff45c06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.775+0000 7ff46e7fc640 1 --2- 172.21.15.100:0/770947274 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff45c06bf30 0x7ff45c06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:42.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.775+0000 7ff46e7fc640 1 --2- 172.21.15.100:0/770947274 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff45c06bf30 0x7ff45c06e3f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff468038000 tx=0x7ff468031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:42.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.776+0000 7ff4577fe640 1 -- 172.21.15.100:0/770947274 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7ff46008b880 con 0x7ff4700c7510 2024-09-11T22:34:42.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.776+0000 7ff4752eb640 1 --2- 172.21.15.100:0/770947274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff450002a70 0x7ff450004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.776+0000 7ff4752eb640 1 -- 172.21.15.100:0/770947274 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff450007ec0 con 0x7ff450002a70 2024-09-11T22:34:42.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.777+0000 7ff46f7fe640 1 --2- 172.21.15.100:0/770947274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff450002a70 0x7ff450004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:42.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.780+0000 7ff46f7fe640 1 -- 172.21.15.100:0/770947274 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff4500080c0 con 0x7ff450002a70 2024-09-11T22:34:42.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.781+0000 7ff46f7fe640 1 --2- 172.21.15.100:0/770947274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff450002a70 0x7ff450004f30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff4701fe210 tx=0x7ff46400c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:42.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.782+0000 7ff4577fe640 1 -- 172.21.15.100:0/770947274 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4640052d0 con 0x7ff450002a70 2024-09-11T22:34:42.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.782+0000 7ff4577fe640 1 -- 172.21.15.100:0/770947274 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7ff464005470 con 0x7ff450002a70 2024-09-11T22:34:42.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.782+0000 7ff4577fe640 1 -- 172.21.15.100:0/770947274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff450002a70 msgr2=0x7ff450004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:42.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.782+0000 7ff4577fe640 1 --2- 172.21.15.100:0/770947274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff450002a70 0x7ff450004f30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff4701fe210 tx=0x7ff46400c7a0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.782+0000 7ff4577fe640 1 -- 172.21.15.100:0/770947274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff450002a70 msgr2=0x7ff450004f30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:34:42.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.782+0000 7ff4577fe640 1 --2- 172.21.15.100:0/770947274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff450002a70 0x7ff450004f30 secure :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff4701fe210 tx=0x7ff46400c7a0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.794+0000 7ff4752eb640 1 --2- 172.21.15.100:0/770947274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff450006eb0 0x7ff450007340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:42.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.794+0000 7ff4752eb640 1 -- 172.21.15.100:0/770947274 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff45000a4a0 con 0x7ff450006eb0 2024-09-11T22:34:42.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.797+0000 7ff46f7fe640 1 --2- 172.21.15.100:0/770947274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff450006eb0 0x7ff450007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:42.800 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:34:42.800 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:34:42.800 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:34:42.800 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:34:42.801 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 104, 2024-09-11T22:34:42.801 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 773519, 2024-09-11T22:34:42.801 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:34:42.801 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:34:42.801 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:34:42.801 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:34:42.801 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:42.801 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:34:42.801 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:34:42.801 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:34:42.801 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:34:42.801 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:42.801 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:42.801 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:42.801 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:42.802 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:42.802 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:42.802 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:42.802 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:42.802 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:42.802 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:42.802 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:42.802 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:42.802 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:34:42.802 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:34:42.802 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:42.802 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:42.802 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:42.802 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:42.803 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:42.803 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:42.803 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:42.803 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:42.803 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:42.803 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:42.803 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:42.803 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:42.803 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.803 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:34:42.803 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:34:42.803 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:34:42.803 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:34:42.803 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:34:42.803 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:34:42.804 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:34:42.804 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:34:42.804 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:34:42.804 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:34:42.804 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:34:42.804 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:34:42.804 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:34:42.804 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:34:42.804 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:34:42.804 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:34:42.804 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:34:42.804 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:42.804 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:42.805 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:42.805 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:42.805 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:42.805 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:42.805 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:42.805 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:42.805 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:42.805 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:42.805 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:42.805 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:42.805 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:34:42.805 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.805 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:34:42.805 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.806 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:34:42.806 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:34:42.806 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:42.806 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:42.806 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.806 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:42.806 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:34:42.806 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:42.806 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.806 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.806 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:42.806 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:34:42.806 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:42.806 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.806 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:42.807 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.807 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:34:42.807 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:34:42.807 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:42.807 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:42.807 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:42.807 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.807 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.807 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:34:42.807 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:34:42.807 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:42.807 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:42.807 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.807 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:42.808 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:34:42.808 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:42.808 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.808 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.808 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:42.808 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:34:42.808 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:42.808 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.808 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:42.808 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.808 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:34:42.808 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:34:42.808 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:42.808 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:42.809 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:42.809 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.809 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.809 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:34:42.809 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:34:42.809 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:42.809 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:42.809 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.809 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:42.809 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:34:42.809 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:42.809 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.809 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.809 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:42.809 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:34:42.810 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:42.810 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.810 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:42.810 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.810 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:34:42.810 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:34:42.810 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:42.810 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:42.810 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:42.810 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.810 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:42.810 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.810 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:34:42.810 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:34:42.811 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.811 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:42.811 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:42.811 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:34:42.811 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.811 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:42.811 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:34:42.811 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.811 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:42.811 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:42.811 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:34:42.811 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.811 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:42.811 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:34:42.811 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.812 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:42.812 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:42.812 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:34:42.812 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.812 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:42.812 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:34:42.812 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.812 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:42.812 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:42.812 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4 2024-09-11T22:34:42.812 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.812 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:42.812 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:34:42.813 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:42.813 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:42.813 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:42.813 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:34:42.813 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:42.813 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:42.813 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:42.813 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:34:42.813 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:34:42.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.798+0000 7ff46f7fe640 1 -- 172.21.15.100:0/770947274 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff450007880 con 0x7ff450006eb0 2024-09-11T22:34:42.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.798+0000 7ff46f7fe640 1 --2- 172.21.15.100:0/770947274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff450006eb0 0x7ff450007340 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff4701fe210 tx=0x7ff464000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:42.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.799+0000 7ff4577fe640 1 -- 172.21.15.100:0/770947274 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff464007020 con 0x7ff450006eb0 2024-09-11T22:34:42.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.799+0000 7ff4577fe640 1 -- 172.21.15.100:0/770947274 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7ff4640071c0 con 0x7ff450006eb0 2024-09-11T22:34:42.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.799+0000 7ff4577fe640 1 -- 172.21.15.100:0/770947274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff450006eb0 msgr2=0x7ff450007340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:42.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.799+0000 7ff4577fe640 1 --2- 172.21.15.100:0/770947274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff450006eb0 0x7ff450007340 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff4701fe210 tx=0x7ff464000bc0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.799+0000 7ff4577fe640 1 -- 172.21.15.100:0/770947274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff450006eb0 msgr2=0x7ff450007340 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:34:42.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.799+0000 7ff4577fe640 1 --2- 172.21.15.100:0/770947274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff450006eb0 0x7ff450007340 secure :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff4701fe210 tx=0x7ff464000bc0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.802+0000 7ff4557fa640 1 -- 172.21.15.100:0/770947274 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff45c06bf30 msgr2=0x7ff45c06e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:42.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.802+0000 7ff4557fa640 1 --2- 172.21.15.100:0/770947274 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff45c06bf30 0x7ff45c06e3f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff468038000 tx=0x7ff468031000 comp rx=0 tx=0).stop 2024-09-11T22:34:42.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.802+0000 7ff4557fa640 1 -- 172.21.15.100:0/770947274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4700c7510 msgr2=0x7ff4700c3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:42.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.802+0000 7ff4557fa640 1 --2- 172.21.15.100:0/770947274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4700c7510 0x7ff4700c3270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff46000d8f0 tx=0x7ff46000ddb0 comp rx=0 tx=0).stop 2024-09-11T22:34:42.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.802+0000 7ff46f7fe640 1 -- 172.21.15.100:0/770947274 reap_dead start 2024-09-11T22:34:42.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.803+0000 7ff4557fa640 1 -- 172.21.15.100:0/770947274 shutdown_connections 2024-09-11T22:34:42.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.803+0000 7ff4557fa640 1 -- 172.21.15.100:0/770947274 >> 172.21.15.100:0/770947274 conn(0x7ff47006f360 msgr2=0x7ff4700ca680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:42.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.810+0000 7ff4557fa640 1 -- 172.21.15.100:0/770947274 shutdown_connections 2024-09-11T22:34:42.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:42.815+0000 7ff4557fa640 1 -- 172.21.15.100:0/770947274 wait complete. 2024-09-11T22:34:42.850 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:34:42.850 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-11T22:34:42.850 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-11T22:34:43.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.051+0000 7fd076c2b640 1 Processor -- start 2024-09-11T22:34:43.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.052+0000 7fd076c2b640 1 -- start start 2024-09-11T22:34:43.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.053+0000 7fd076c2b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd07006bc10 0x7fd070150d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:43.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.053+0000 7fd076c2b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd07006c690 0x7fd0700c7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:43.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.053+0000 7fd076c2b640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd07015b1e0 con 0x7fd0700722d0 2024-09-11T22:34:43.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.053+0000 7fd076c2b640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fd07006d780 con 0x7fd07006c690 2024-09-11T22:34:43.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.053+0000 7fd076c2b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd07006dd40 con 0x7fd07006bc10 2024-09-11T22:34:43.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.054+0000 7fd075428640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd07006c690 0x7fd0700c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:43.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.054+0000 7fd075428640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd07006c690 0x7fd0700c7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58606/0 (socket says 172.21.15.100:58606) 2024-09-11T22:34:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.054+0000 7fd075428640 1 -- 172.21.15.100:0/1908852307 learned_addr learned my addr 172.21.15.100:0/1908852307 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.054+0000 7fd075428640 1 -- 172.21.15.100:0/1908852307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd07006bc10 msgr2=0x7fd070150d60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:34:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.054+0000 7fd075428640 1 --2- 172.21.15.100:0/1908852307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd07006bc10 0x7fd070150d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.054+0000 7fd075428640 1 -- 172.21.15.100:0/1908852307 >> v1:172.21.15.167:6789/0 conn(0x7fd0700722d0 legacy=0x7fd07015a210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:34:43.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.054+0000 7fd075428640 1 -- 172.21.15.100:0/1908852307 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0700c81d0 con 0x7fd07006c690 2024-09-11T22:34:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.056+0000 7fd075428640 1 --2- 172.21.15.100:0/1908852307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd07006c690 0x7fd0700c7830 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd064009870 tx=0x7fd06402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0b82880b2398e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.056+0000 7fd074c27640 1 -- 172.21.15.100:0/1908852307 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd064037070 con 0x7fd07006c690 2024-09-11T22:34:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.056+0000 7fd074c27640 1 -- 172.21.15.100:0/1908852307 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd064032440 con 0x7fd07006c690 2024-09-11T22:34:43.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.056+0000 7fd074c27640 1 -- 172.21.15.100:0/1908852307 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd064032810 con 0x7fd07006c690 2024-09-11T22:34:43.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.059+0000 7fd076c2b640 1 -- 172.21.15.100:0/1908852307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd07006c690 msgr2=0x7fd0700c7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:43.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.059+0000 7fd076c2b640 1 --2- 172.21.15.100:0/1908852307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd07006c690 0x7fd0700c7830 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd064009870 tx=0x7fd06402a230 comp rx=0 tx=0).stop 2024-09-11T22:34:43.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.059+0000 7fd076c2b640 1 -- 172.21.15.100:0/1908852307 shutdown_connections 2024-09-11T22:34:43.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.059+0000 7fd076c2b640 1 --2- 172.21.15.100:0/1908852307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd07006c690 0x7fd0700c7830 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:43.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.059+0000 7fd076c2b640 1 --2- 172.21.15.100:0/1908852307 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd07006bc10 0x7fd070150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:43.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.059+0000 7fd076c2b640 1 -- 172.21.15.100:0/1908852307 >> 172.21.15.100:0/1908852307 conn(0x7fd07006ee10 msgr2=0x7fd07006f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:43.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.060+0000 7fd076c2b640 1 -- 172.21.15.100:0/1908852307 shutdown_connections 2024-09-11T22:34:43.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.060+0000 7fd076c2b640 1 -- 172.21.15.100:0/1908852307 wait complete. 2024-09-11T22:34:43.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.061+0000 7fd076c2b640 1 Processor -- start 2024-09-11T22:34:43.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.062+0000 7fd076c2b640 1 -- start start 2024-09-11T22:34:43.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.067+0000 7fd076c2b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd07006bc10 0x7fd0700c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:43.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.068+0000 7fd076c2b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd07006c690 0x7fd070201260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:43.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.068+0000 7fd075428640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd07006c690 0x7fd070201260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:43.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.068+0000 7fd075428640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd07006c690 0x7fd070201260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58622/0 (socket says 172.21.15.100:58622) 2024-09-11T22:34:43.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.068+0000 7fd075c29640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd07006bc10 0x7fd0700c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:43.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.068+0000 7fd075c29640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd07006bc10 0x7fd0700c4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44904/0 (socket says 172.21.15.100:44904) 2024-09-11T22:34:43.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.068+0000 7fd076c2b640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0700722d0 0x7fd070143460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:43.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.068+0000 7fd076c2b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd07006e730 con 0x7fd07006c690 2024-09-11T22:34:43.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.068+0000 7fd076c2b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd07006d9d0 con 0x7fd07006bc10 2024-09-11T22:34:43.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.068+0000 7fd076c2b640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd0701512a0 con 0x7fd0700722d0 2024-09-11T22:34:43.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.068+0000 7fd075428640 1 -- 172.21.15.100:0/4170964808 learned_addr learned my addr 172.21.15.100:0/4170964808 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:43.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.069+0000 7fd075428640 1 -- 172.21.15.100:0/4170964808 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0700722d0 msgr2=0x7fd070143460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:34:43.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.069+0000 7fd075428640 1 --2- 172.21.15.100:0/4170964808 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0700722d0 0x7fd070143460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:43.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.069+0000 7fd075428640 1 -- 172.21.15.100:0/4170964808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd07006bc10 msgr2=0x7fd0700c4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:43.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.069+0000 7fd075428640 1 --2- 172.21.15.100:0/4170964808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd07006bc10 0x7fd0700c4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:43.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.069+0000 7fd075428640 1 -- 172.21.15.100:0/4170964808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd070201d60 con 0x7fd07006c690 2024-09-11T22:34:43.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.070+0000 7fd075428640 1 --2- 172.21.15.100:0/4170964808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd07006c690 0x7fd070201260 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd064009990 tx=0x7fd0640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:43.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.071+0000 7fd0627fc640 1 -- 172.21.15.100:0/4170964808 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd064041070 con 0x7fd07006c690 2024-09-11T22:34:43.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.071+0000 7fd076c2b640 1 -- 172.21.15.100:0/4170964808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd07015aac0 con 0x7fd07006c690 2024-09-11T22:34:43.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.071+0000 7fd076c2b640 1 -- 172.21.15.100:0/4170964808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0701577c0 con 0x7fd07006c690 2024-09-11T22:34:43.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.075+0000 7fd0627fc640 1 -- 172.21.15.100:0/4170964808 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd064032e50 con 0x7fd07006c690 2024-09-11T22:34:43.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.075+0000 7fd0627fc640 1 -- 172.21.15.100:0/4170964808 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd064037040 con 0x7fd07006c690 2024-09-11T22:34:43.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.075+0000 7fd0627fc640 1 -- 172.21.15.100:0/4170964808 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd064044070 con 0x7fd07006c690 2024-09-11T22:34:43.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.076+0000 7fd0627fc640 1 --2- 172.21.15.100:0/4170964808 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd05406bf60 0x7fd05406e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:43.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.076+0000 7fd075c29640 1 --2- 172.21.15.100:0/4170964808 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd05406bf60 0x7fd05406e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:43.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.077+0000 7fd0627fc640 1 -- 172.21.15.100:0/4170964808 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fd0640ac260 con 0x7fd07006c690 2024-09-11T22:34:43.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.077+0000 7fd05bfff640 1 -- 172.21.15.100:0/4170964808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd050005290 con 0x7fd07006c690 2024-09-11T22:34:43.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.081+0000 7fd075c29640 1 --2- 172.21.15.100:0/4170964808 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd05406bf60 0x7fd05406e420 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd06c006fd0 tx=0x7fd06c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:43.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.087+0000 7fd0627fc640 1 -- 172.21.15.100:0/4170964808 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd06407a980 con 0x7fd07006c690 2024-09-11T22:34:43.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.614+0000 7fd05bfff640 1 -- 172.21.15.100:0/4170964808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fd050005d90 con 0x7fd07006c690 2024-09-11T22:34:43.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.624+0000 7fd0627fc640 1 -- 172.21.15.100:0/4170964808 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fd06407a280 con 0x7fd07006c690 2024-09-11T22:34:43.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.629+0000 7fd05bfff640 1 -- 172.21.15.100:0/4170964808 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd05406bf60 msgr2=0x7fd05406e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:43.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.629+0000 7fd05bfff640 1 --2- 172.21.15.100:0/4170964808 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd05406bf60 0x7fd05406e420 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd06c006fd0 tx=0x7fd06c008040 comp rx=0 tx=0).stop 2024-09-11T22:34:43.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.629+0000 7fd05bfff640 1 -- 172.21.15.100:0/4170964808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd07006c690 msgr2=0x7fd070201260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:43.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.629+0000 7fd05bfff640 1 --2- 172.21.15.100:0/4170964808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd07006c690 0x7fd070201260 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd064009990 tx=0x7fd0640046c0 comp rx=0 tx=0).stop 2024-09-11T22:34:43.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.629+0000 7fd05bfff640 1 -- 172.21.15.100:0/4170964808 shutdown_connections 2024-09-11T22:34:43.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.629+0000 7fd05bfff640 1 --2- 172.21.15.100:0/4170964808 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd05406bf60 0x7fd05406e420 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:43.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.629+0000 7fd05bfff640 1 --2- 172.21.15.100:0/4170964808 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0700722d0 0x7fd070143460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:43.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.629+0000 7fd05bfff640 1 --2- 172.21.15.100:0/4170964808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd07006c690 0x7fd070201260 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:43.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.629+0000 7fd05bfff640 1 --2- 172.21.15.100:0/4170964808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd07006bc10 0x7fd0700c4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:43.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.629+0000 7fd05bfff640 1 -- 172.21.15.100:0/4170964808 >> 172.21.15.100:0/4170964808 conn(0x7fd07006ee10 msgr2=0x7fd0700c7940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:43.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.629+0000 7fd05bfff640 1 -- 172.21.15.100:0/4170964808 shutdown_connections 2024-09-11T22:34:43.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:43.629+0000 7fd05bfff640 1 -- 172.21.15.100:0/4170964808 wait complete. 2024-09-11T22:34:43.662 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-11T22:34:53.663 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:34:53.663 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:34:53.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.884+0000 7fba508cf640 1 Processor -- start 2024-09-11T22:34:53.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.884+0000 7fba508cf640 1 -- start start 2024-09-11T22:34:53.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.885+0000 7fba508cf640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fba44046230 0x7fba440e60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:53.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.885+0000 7fba508cf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba440e6620 0x7fba440e6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:53.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.885+0000 7fba508cf640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba44046bf0 con 0x7fba440dce30 2024-09-11T22:34:53.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.885+0000 7fba508cf640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fba44047730 con 0x7fba44046230 2024-09-11T22:34:53.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.885+0000 7fba508cf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fba44046e90 con 0x7fba440e6620 2024-09-11T22:34:53.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.886+0000 7fba4a59c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fba44046230 0x7fba440e60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:53.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.886+0000 7fba4a59c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fba44046230 0x7fba440e60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49022/0 (socket says 172.21.15.100:49022) 2024-09-11T22:34:53.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.886+0000 7fba4a59c640 1 -- 172.21.15.100:0/1677269761 learned_addr learned my addr 172.21.15.100:0/1677269761 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:53.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.886+0000 7fba4a59c640 1 -- 172.21.15.100:0/1677269761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba440e6620 msgr2=0x7fba440e6a50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:34:53.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.886+0000 7fba4a59c640 1 --2- 172.21.15.100:0/1677269761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba440e6620 0x7fba440e6a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:53.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.886+0000 7fba4a59c640 1 -- 172.21.15.100:0/1677269761 >> v1:172.21.15.100:6789/0 conn(0x7fba440dce30 legacy=0x7fba44007570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:53.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.886+0000 7fba4a59c640 1 -- 172.21.15.100:0/1677269761 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba44047150 con 0x7fba44046230 2024-09-11T22:34:53.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.888+0000 7fba4a59c640 1 --2- 172.21.15.100:0/1677269761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba44046230 0x7fba440e60e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fba440478b0 tx=0x7fba3c02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ad3bfcd5c623f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:53.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.888+0000 7fba49d9b640 1 -- 172.21.15.100:0/1677269761 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c037070 con 0x7fba44046230 2024-09-11T22:34:53.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.888+0000 7fba49d9b640 1 -- 172.21.15.100:0/1677269761 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba3c032440 con 0x7fba44046230 2024-09-11T22:34:53.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.888+0000 7fba49d9b640 1 -- 172.21.15.100:0/1677269761 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3c032850 con 0x7fba44046230 2024-09-11T22:34:53.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.889+0000 7fba508cf640 1 -- 172.21.15.100:0/1677269761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba44046230 msgr2=0x7fba440e60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:53.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.889+0000 7fba508cf640 1 --2- 172.21.15.100:0/1677269761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba44046230 0x7fba440e60e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fba440478b0 tx=0x7fba3c02a200 comp rx=0 tx=0).stop 2024-09-11T22:34:53.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.891+0000 7fba508cf640 1 -- 172.21.15.100:0/1677269761 shutdown_connections 2024-09-11T22:34:53.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.891+0000 7fba508cf640 1 --2- 172.21.15.100:0/1677269761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba440e6620 0x7fba440e6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:53.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.891+0000 7fba508cf640 1 --2- 172.21.15.100:0/1677269761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba44046230 0x7fba440e60e0 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fba440478b0 tx=0x7fba3c02a200 comp rx=0 tx=0).stop 2024-09-11T22:34:53.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.891+0000 7fba508cf640 1 -- 172.21.15.100:0/1677269761 >> 172.21.15.100:0/1677269761 conn(0x7fba4404d830 msgr2=0x7fba4404dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:53.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.892+0000 7fba508cf640 1 -- 172.21.15.100:0/1677269761 shutdown_connections 2024-09-11T22:34:53.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.892+0000 7fba508cf640 1 -- 172.21.15.100:0/1677269761 wait complete. 2024-09-11T22:34:53.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.894+0000 7fba508cf640 1 Processor -- start 2024-09-11T22:34:53.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.894+0000 7fba508cf640 1 -- start start 2024-09-11T22:34:53.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.895+0000 7fba508cf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba440dce30 0x7fba440e1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:53.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.896+0000 7fba508cf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba440e6620 0x7fba440d56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:53.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.896+0000 7fba508cf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba44036d10 0x7fba44048560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:53.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.896+0000 7fba508cf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fba44007c80 con 0x7fba440e6620 2024-09-11T22:34:53.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.896+0000 7fba508cf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fba44047c60 con 0x7fba440dce30 2024-09-11T22:34:53.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.896+0000 7fba508cf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fba440dd210 con 0x7fba44036d10 2024-09-11T22:34:53.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.896+0000 7fba4ad9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba440dce30 0x7fba440e1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:53.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.896+0000 7fba4ad9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba440dce30 0x7fba440e1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:59396/0 (socket says 172.21.15.100:59396) 2024-09-11T22:34:53.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.896+0000 7fba4ad9d640 1 -- 172.21.15.100:0/1082756982 learned_addr learned my addr 172.21.15.100:0/1082756982 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:53.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.897+0000 7fba4a59c640 1 --2- 172.21.15.100:0/1082756982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba440e6620 0x7fba440d56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:53.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.897+0000 7fba4ad9d640 1 -- 172.21.15.100:0/1082756982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba44036d10 msgr2=0x7fba44048560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:34:53.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.897+0000 7fba4ad9d640 1 --2- 172.21.15.100:0/1082756982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba44036d10 0x7fba44048560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:53.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.897+0000 7fba4ad9d640 1 -- 172.21.15.100:0/1082756982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba440e6620 msgr2=0x7fba440d56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:53.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.897+0000 7fba4ad9d640 1 --2- 172.21.15.100:0/1082756982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba440e6620 0x7fba440d56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:53.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.897+0000 7fba4ad9d640 1 -- 172.21.15.100:0/1082756982 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba440d6a10 con 0x7fba440dce30 2024-09-11T22:34:53.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.897+0000 7fba4a59c640 1 --2- 172.21.15.100:0/1082756982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba440e6620 0x7fba440d56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:34:53.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.898+0000 7fba4ad9d640 1 --2- 172.21.15.100:0/1082756982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba440dce30 0x7fba440e1d40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fba4000c400 tx=0x7fba4000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:53.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.898+0000 7fba337fe640 1 -- 172.21.15.100:0/1082756982 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40017070 con 0x7fba440dce30 2024-09-11T22:34:53.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.898+0000 7fba508cf640 1 -- 172.21.15.100:0/1082756982 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba440d5f60 con 0x7fba440dce30 2024-09-11T22:34:53.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.898+0000 7fba508cf640 1 -- 172.21.15.100:0/1082756982 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba440e0410 con 0x7fba440dce30 2024-09-11T22:34:53.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.899+0000 7fba337fe640 1 -- 172.21.15.100:0/1082756982 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba400052d0 con 0x7fba440dce30 2024-09-11T22:34:53.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.899+0000 7fba337fe640 1 -- 172.21.15.100:0/1082756982 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40003810 con 0x7fba440dce30 2024-09-11T22:34:53.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.905+0000 7fba508cf640 1 -- 172.21.15.100:0/1082756982 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba2c005290 con 0x7fba440dce30 2024-09-11T22:34:53.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.906+0000 7fba337fe640 1 -- 172.21.15.100:0/1082756982 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fba4001a070 con 0x7fba440dce30 2024-09-11T22:34:53.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.906+0000 7fba337fe640 1 --2- 172.21.15.100:0/1082756982 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fba3806bf30 0x7fba3806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:53.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.910+0000 7fba337fe640 1 -- 172.21.15.100:0/1082756982 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fba4008a600 con 0x7fba440dce30 2024-09-11T22:34:53.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.913+0000 7fba4a59c640 1 --2- 172.21.15.100:0/1082756982 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fba3806bf30 0x7fba3806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:53.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.914+0000 7fba337fe640 1 -- 172.21.15.100:0/1082756982 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fba40058c00 con 0x7fba440dce30 2024-09-11T22:34:53.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:53.914+0000 7fba4a59c640 1 --2- 172.21.15.100:0/1082756982 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fba3806bf30 0x7fba3806e3f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fba3c034000 tx=0x7fba3c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:54.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.442+0000 7fba508cf640 1 -- 172.21.15.100:0/1082756982 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fba2c005580 con 0x7fba440dce30 2024-09-11T22:34:54.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.449+0000 7fba337fe640 1 -- 172.21.15.100:0/1082756982 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1570 (secure 0 0 0) 0x7fba40058500 con 0x7fba440dce30 2024-09-11T22:34:54.450 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":104,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":13,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:34:54.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.452+0000 7fba317fa640 1 -- 172.21.15.100:0/1082756982 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fba3806bf30 msgr2=0x7fba3806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:54.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.452+0000 7fba317fa640 1 --2- 172.21.15.100:0/1082756982 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fba3806bf30 0x7fba3806e3f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fba3c034000 tx=0x7fba3c02e000 comp rx=0 tx=0).stop 2024-09-11T22:34:54.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.452+0000 7fba317fa640 1 -- 172.21.15.100:0/1082756982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba440dce30 msgr2=0x7fba440e1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:54.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.452+0000 7fba317fa640 1 --2- 172.21.15.100:0/1082756982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba440dce30 0x7fba440e1d40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fba4000c400 tx=0x7fba4000c8c0 comp rx=0 tx=0).stop 2024-09-11T22:34:54.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.453+0000 7fba317fa640 1 -- 172.21.15.100:0/1082756982 shutdown_connections 2024-09-11T22:34:54.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.453+0000 7fba317fa640 1 --2- 172.21.15.100:0/1082756982 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fba3806bf30 0x7fba3806e3f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:54.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.453+0000 7fba317fa640 1 --2- 172.21.15.100:0/1082756982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba44036d10 0x7fba44048560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:54.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.453+0000 7fba317fa640 1 --2- 172.21.15.100:0/1082756982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba440e6620 0x7fba440d56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:54.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.453+0000 7fba317fa640 1 --2- 172.21.15.100:0/1082756982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba440dce30 0x7fba440e1d40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:54.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.453+0000 7fba317fa640 1 -- 172.21.15.100:0/1082756982 >> 172.21.15.100:0/1082756982 conn(0x7fba4404d830 msgr2=0x7fba440dc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:54.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.458+0000 7fba317fa640 1 -- 172.21.15.100:0/1082756982 shutdown_connections 2024-09-11T22:34:54.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.462+0000 7fba317fa640 1 -- 172.21.15.100:0/1082756982 wait complete. 2024-09-11T22:34:54.492 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:34:54.492 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-11T22:34:54.492 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:34:54.492 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:34:54.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.689+0000 7f1906e17640 1 Processor -- start 2024-09-11T22:34:54.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.689+0000 7f1906e17640 1 -- start start 2024-09-11T22:34:54.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.691+0000 7f1906e17640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f190015aeb0 0x7f1900071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:54.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.691+0000 7f1906e17640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1900072a40 con 0x7f1900150e00 2024-09-11T22:34:54.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.691+0000 7f1906e17640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19000724a0 con 0x7f1900156cb0 2024-09-11T22:34:54.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.691+0000 7f1906e17640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f1900075d80 con 0x7f190015aeb0 2024-09-11T22:34:54.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.692+0000 7f1904bb3640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f190015aeb0 0x7f1900071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:54.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.692+0000 7f19053b4640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1900150e00 0x7f1900075670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41272/0 (socket says 172.21.15.100:41272) 2024-09-11T22:34:54.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.692+0000 7f19053b4640 1 -- 172.21.15.100:0/1259115565 learned_addr learned my addr 172.21.15.100:0/1259115565 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:34:54.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.694+0000 7f18ff7fe640 1 -- 172.21.15.100:0/1259115565 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3808351965 0 0) 0x7f19000724a0 con 0x7f1900156cb0 2024-09-11T22:34:54.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.694+0000 7f18ff7fe640 1 -- 172.21.15.100:0/1259115565 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18e8003520 con 0x7f1900156cb0 2024-09-11T22:34:54.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.694+0000 7f1904bb3640 1 -- 172.21.15.100:0/1259115565 >> v1:172.21.15.167:6789/0 conn(0x7f1900156cb0 legacy=0x7f19000c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:54.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.694+0000 7f1904bb3640 1 -- 172.21.15.100:0/1259115565 >> v1:172.21.15.100:6789/0 conn(0x7f1900150e00 legacy=0x7f1900075670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:54.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.696+0000 7f1904bb3640 1 -- 172.21.15.100:0/1259115565 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1900072760 con 0x7f190015aeb0 2024-09-11T22:34:54.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.700+0000 7f1904bb3640 1 --2- 172.21.15.100:0/1259115565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f190015aeb0 0x7f1900071e80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f18f00097d0 tx=0x7f18f002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=891787842b281052 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:54.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.700+0000 7f18ff7fe640 1 -- 172.21.15.100:0/1259115565 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f0037070 con 0x7f190015aeb0 2024-09-11T22:34:54.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.700+0000 7f18ff7fe640 1 -- 172.21.15.100:0/1259115565 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f002ae30 con 0x7f190015aeb0 2024-09-11T22:34:54.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.701+0000 7f1906e17640 1 -- 172.21.15.100:0/1259115565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f190015aeb0 msgr2=0x7f1900071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:54.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.701+0000 7f1906e17640 1 --2- 172.21.15.100:0/1259115565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f190015aeb0 0x7f1900071e80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f18f00097d0 tx=0x7f18f002a1a0 comp rx=0 tx=0).stop 2024-09-11T22:34:54.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.702+0000 7f1906e17640 1 -- 172.21.15.100:0/1259115565 shutdown_connections 2024-09-11T22:34:54.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.702+0000 7f1906e17640 1 --2- 172.21.15.100:0/1259115565 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f190015aeb0 0x7f1900071e80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:54.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.702+0000 7f1906e17640 1 -- 172.21.15.100:0/1259115565 >> 172.21.15.100:0/1259115565 conn(0x7f190006fa70 msgr2=0x7f190006fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:54.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.702+0000 7f1906e17640 1 -- 172.21.15.100:0/1259115565 shutdown_connections 2024-09-11T22:34:54.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.702+0000 7f1906e17640 1 -- 172.21.15.100:0/1259115565 wait complete. 2024-09-11T22:34:54.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.703+0000 7f1906e17640 1 Processor -- start 2024-09-11T22:34:54.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.704+0000 7f1906e17640 1 -- start start 2024-09-11T22:34:54.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.705+0000 7f1906e17640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1900150e00 0x7f1900163d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:54.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.705+0000 7f1906e17640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1900156cb0 0x7f1900158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:54.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.705+0000 7f1906e17640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f190015aeb0 0x7f1900151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:54.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.705+0000 7f1906e17640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f190015a990 con 0x7f1900150e00 2024-09-11T22:34:54.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.705+0000 7f1906e17640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f190015a6b0 con 0x7f1900156cb0 2024-09-11T22:34:54.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.705+0000 7f1906e17640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f19001570c0 con 0x7f190015aeb0 2024-09-11T22:34:54.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.706+0000 7f19053b4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f190015aeb0 0x7f1900151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:54.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.706+0000 7f19053b4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f190015aeb0 0x7f1900151da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:59266/0 (socket says 172.21.15.100:59266) 2024-09-11T22:34:54.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.706+0000 7f19053b4640 1 -- 172.21.15.100:0/1800721882 learned_addr learned my addr 172.21.15.100:0/1800721882 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:54.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.706+0000 7f1904bb3640 1 --2- 172.21.15.100:0/1800721882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1900150e00 0x7f1900163d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:54.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.707+0000 7f19053b4640 1 -- 172.21.15.100:0/1800721882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1900156cb0 msgr2=0x7f1900158050 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:34:54.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.707+0000 7f19053b4640 1 --2- 172.21.15.100:0/1800721882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1900156cb0 0x7f1900158050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:54.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.707+0000 7f19053b4640 1 -- 172.21.15.100:0/1800721882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1900150e00 msgr2=0x7f1900163d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:54.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.707+0000 7f19053b4640 1 --2- 172.21.15.100:0/1800721882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1900150e00 0x7f1900163d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:54.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.707+0000 7f19053b4640 1 -- 172.21.15.100:0/1800721882 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1900153ff0 con 0x7f190015aeb0 2024-09-11T22:34:54.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.707+0000 7f1904bb3640 1 --2- 172.21.15.100:0/1800721882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1900150e00 0x7f1900163d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:34:54.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.708+0000 7f19053b4640 1 --2- 172.21.15.100:0/1800721882 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f190015aeb0 0x7f1900151da0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f18f800cb20 tx=0x7f18f8002100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:54.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.708+0000 7f18fd7fa640 1 -- 172.21.15.100:0/1800721882 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8018070 con 0x7f190015aeb0 2024-09-11T22:34:54.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.709+0000 7f1906e17640 1 -- 172.21.15.100:0/1800721882 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1900153770 con 0x7f190015aeb0 2024-09-11T22:34:54.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.709+0000 7f1906e17640 1 -- 172.21.15.100:0/1800721882 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1900153d10 con 0x7f190015aeb0 2024-09-11T22:34:54.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.709+0000 7f18fd7fa640 1 -- 172.21.15.100:0/1800721882 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f800a730 con 0x7f190015aeb0 2024-09-11T22:34:54.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.709+0000 7f18fd7fa640 1 -- 172.21.15.100:0/1800721882 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f800ab00 con 0x7f190015aeb0 2024-09-11T22:34:54.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.711+0000 7f1906e17640 1 --2- 172.21.15.100:0/1800721882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1900158590 0x7f19001522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:54.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.711+0000 7f1906e17640 1 -- 172.21.15.100:0/1800721882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f19000c5dd0 con 0x7f1900158590 2024-09-11T22:34:54.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.711+0000 7f18fd7fa640 1 -- 172.21.15.100:0/1800721882 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f18f801b070 con 0x7f190015aeb0 2024-09-11T22:34:54.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.712+0000 7f18fd7fa640 1 --2- 172.21.15.100:0/1800721882 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f18ec06bf00 0x7f18ec06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:54.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.712+0000 7f18fd7fa640 1 -- 172.21.15.100:0/1800721882 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f18f808ab10 con 0x7f190015aeb0 2024-09-11T22:34:54.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.713+0000 7f1904bb3640 1 --2- 172.21.15.100:0/1800721882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1900158590 0x7f19001522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:54.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.713+0000 7f18fffff640 1 --2- 172.21.15.100:0/1800721882 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f18ec06bf00 0x7f18ec06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:54.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.714+0000 7f1904bb3640 1 -- 172.21.15.100:0/1800721882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f19000c3740 con 0x7f1900158590 2024-09-11T22:34:54.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.714+0000 7f1904bb3640 1 --2- 172.21.15.100:0/1800721882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1900158590 0x7f19001522e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f190006f130 tx=0x7f18f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:54.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.715+0000 7f18fffff640 1 --2- 172.21.15.100:0/1800721882 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f18ec06bf00 0x7f18ec06e3c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f190015a270 tx=0x7f18f4007930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:54.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.716+0000 7f18fd7fa640 1 -- 172.21.15.100:0/1800721882 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f0043030 con 0x7f1900158590 2024-09-11T22:34:54.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.716+0000 7f18fd7fa640 1 -- 172.21.15.100:0/1800721882 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f18f0038040 con 0x7f1900158590 2024-09-11T22:34:54.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.716+0000 7f18fd7fa640 1 -- 172.21.15.100:0/1800721882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1900158590 msgr2=0x7f19001522e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:54.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.716+0000 7f18fd7fa640 1 --2- 172.21.15.100:0/1800721882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1900158590 0x7f19001522e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f190006f130 tx=0x7f18f00046c0 comp rx=0 tx=0).stop 2024-09-11T22:34:54.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.716+0000 7f18fd7fa640 1 -- 172.21.15.100:0/1800721882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1900158590 msgr2=0x7f19001522e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:34:54.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.716+0000 7f18fd7fa640 1 --2- 172.21.15.100:0/1800721882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1900158590 0x7f19001522e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:54.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.748+0000 7f1906e17640 1 --2- 172.21.15.100:0/1800721882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19000cbe80 0x7f19000ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:54.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.749+0000 7f1904bb3640 1 --2- 172.21.15.100:0/1800721882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19000cbe80 0x7f19000ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:54.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.753+0000 7f1906e17640 1 -- 172.21.15.100:0/1800721882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f19000c73b0 con 0x7f19000cbe80 2024-09-11T22:34:54.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.754+0000 7f1904bb3640 1 -- 172.21.15.100:0/1800721882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f19000cc9e0 con 0x7f19000cbe80 2024-09-11T22:34:54.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.754+0000 7f1904bb3640 1 --2- 172.21.15.100:0/1800721882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19000cbe80 0x7f19000ca690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f18f002a1e0 tx=0x7f18f0008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:54.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.756+0000 7f18fd7fa640 1 -- 172.21.15.100:0/1800721882 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f0043040 con 0x7f19000cbe80 2024-09-11T22:34:54.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.756+0000 7f18fd7fa640 1 -- 172.21.15.100:0/1800721882 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4556 (secure 0 0 0) 0x7f18f0049d30 con 0x7f19000cbe80 2024-09-11T22:34:54.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.756+0000 7f18fd7fa640 1 -- 172.21.15.100:0/1800721882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19000cbe80 msgr2=0x7f19000ca690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:54.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.756+0000 7f18fd7fa640 1 --2- 172.21.15.100:0/1800721882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19000cbe80 0x7f19000ca690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f18f002a1e0 tx=0x7f18f0008030 comp rx=0 tx=0).stop 2024-09-11T22:34:54.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.756+0000 7f18fd7fa640 1 -- 172.21.15.100:0/1800721882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19000cbe80 msgr2=0x7f19000ca690 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:34:54.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.756+0000 7f18fd7fa640 1 --2- 172.21.15.100:0/1800721882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19000cbe80 0x7f19000ca690 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:54.757 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:34:54.757 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:34:54.758 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:34:54.758 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:34:54.758 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 104, 2024-09-11T22:34:54.758 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 19601, 2024-09-11T22:34:54.758 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:34:54.758 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:34:54.758 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:34:54.758 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:34:54.758 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:54.758 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 13, 2024-09-11T22:34:54.758 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:34:54.758 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:34:54.758 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:34:54.759 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:54.759 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:54.759 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:54.759 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:54.759 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:54.759 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:54.759 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:54.759 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:54.759 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:54.759 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:54.759 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:54.759 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:54.759 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:34:54.759 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:34:54.760 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:54.760 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:54.760 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:54.760 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:54.760 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:54.760 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:54.760 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:54.760 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:54.760 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:54.760 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:54.760 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:54.760 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:54.760 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:54.760 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:34:54.761 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:34:54.761 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:34:54.761 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:34:54.761 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:34:54.761 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:34:54.761 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:34:54.761 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:34:54.761 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:34:54.761 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:34:54.761 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:34:54.761 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:34:54.761 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:34:54.762 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:34:54.762 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:34:54.762 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:34:54.762 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:34:54.762 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:54.762 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:54.762 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:54.762 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:54.762 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:54.762 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:54.762 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:54.762 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:54.762 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:54.763 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:54.763 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:54.763 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:54.763 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:34:54.763 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:54.763 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:34:54.763 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:54.763 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:34:54.763 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:34:54.763 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:54.763 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:54.763 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:54.763 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:54.764 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:34:54.764 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:54.764 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:54.764 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:54.764 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:54.764 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:34:54.764 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:54.764 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:54.764 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:54.764 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:54.764 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:34:54.764 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:34:54.764 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:54.765 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:54.765 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:54.765 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:54.765 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:54.765 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:34:54.765 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:34:54.765 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:54.765 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:54.765 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:54.765 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:54.765 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:34:54.765 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:54.765 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:54.765 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:54.766 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:54.766 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:34:54.766 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:54.766 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:54.766 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:54.766 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:54.766 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:34:54.766 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:34:54.766 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:54.766 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:54.766 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:54.766 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:54.766 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:54.766 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:34:54.767 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:34:54.767 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:54.767 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:54.767 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:54.767 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:54.767 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:34:54.767 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:54.767 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:54.767 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:54.767 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:54.767 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:34:54.767 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:54.767 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:54.768 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:54.768 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:54.768 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:34:54.768 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:34:54.768 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:54.768 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:54.768 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:54.768 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:54.768 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:54.768 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:54.768 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:34:54.768 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:34:54.768 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:54.768 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:54.769 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:54.769 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:34:54.769 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:54.769 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:54.769 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:34:54.769 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:54.769 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:54.769 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:54.769 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:34:54.769 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:54.769 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:54.769 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:54.769 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:34:54.770 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:34:54.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.757+0000 7f18e6ffd640 1 -- 172.21.15.100:0/1800721882 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f18ec06bf00 msgr2=0x7f18ec06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:54.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.757+0000 7f18e6ffd640 1 --2- 172.21.15.100:0/1800721882 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f18ec06bf00 0x7f18ec06e3c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f190015a270 tx=0x7f18f4007930 comp rx=0 tx=0).stop 2024-09-11T22:34:54.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.757+0000 7f19053b4640 1 -- 172.21.15.100:0/1800721882 reap_dead start 2024-09-11T22:34:54.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.757+0000 7f18e6ffd640 1 -- 172.21.15.100:0/1800721882 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f190015aeb0 msgr2=0x7f1900151da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:54.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.757+0000 7f18e6ffd640 1 --2- 172.21.15.100:0/1800721882 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f190015aeb0 0x7f1900151da0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f18f800cb20 tx=0x7f18f8002100 comp rx=0 tx=0).stop 2024-09-11T22:34:54.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.757+0000 7f18e6ffd640 1 -- 172.21.15.100:0/1800721882 shutdown_connections 2024-09-11T22:34:54.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.757+0000 7f18e6ffd640 1 --2- 172.21.15.100:0/1800721882 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f190015aeb0 0x7f1900151da0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:54.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.757+0000 7f18e6ffd640 1 -- 172.21.15.100:0/1800721882 >> 172.21.15.100:0/1800721882 conn(0x7f190006fa70 msgr2=0x7f1900072f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:54.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.760+0000 7f18e6ffd640 1 -- 172.21.15.100:0/1800721882 shutdown_connections 2024-09-11T22:34:54.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.760+0000 7f18e6ffd640 1 -- 172.21.15.100:0/1800721882 wait complete. 2024-09-11T22:34:54.780 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:34:54.781 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:34:54.781 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:34:55.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.978+0000 7f06d8877640 1 Processor -- start 2024-09-11T22:34:55.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.978+0000 7f06d8877640 1 -- start start 2024-09-11T22:34:55.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.992+0000 7f06d8877640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f06d40c9050 0x7f06d40c8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:55.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.992+0000 7f06d8877640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f06d40c1850 0x7f06d4164720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:55.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.992+0000 7f06d8877640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06d40c30f0 con 0x7f06d40c8c70 2024-09-11T22:34:55.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.992+0000 7f06d8877640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f06d4167720 con 0x7f06d40c1850 2024-09-11T22:34:55.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.992+0000 7f06d8877640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f06d4167a00 con 0x7f06d40c9050 2024-09-11T22:34:55.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.993+0000 7f06d1d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f06d40c9050 0x7f06d40c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:55.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.993+0000 7f06d1d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f06d40c9050 0x7f06d40c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:59412/0 (socket says 172.21.15.100:59412) 2024-09-11T22:34:55.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.993+0000 7f06d1d9b640 1 -- 172.21.15.100:0/2056603730 learned_addr learned my addr 172.21.15.100:0/2056603730 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:55.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.993+0000 7f06d2d9d640 1 --2- 172.21.15.100:0/2056603730 >> v2:172.21.15.100:3300/0 conn(0x7f06d40c1850 0x7f06d4164720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:55.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.994+0000 7f06d2d9d640 1 -- 172.21.15.100:0/2056603730 >> v2:172.21.15.167:3300/0 conn(0x7f06d40c9050 msgr2=0x7f06d40c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:55.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.994+0000 7f06d2d9d640 1 --2- 172.21.15.100:0/2056603730 >> v2:172.21.15.167:3300/0 conn(0x7f06d40c9050 0x7f06d40c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.994+0000 7f06d2d9d640 1 -- 172.21.15.100:0/2056603730 >> v1:172.21.15.100:6789/0 conn(0x7f06d40c8c70 legacy=0x7f06d40c1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:55.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.994+0000 7f06d2d9d640 1 -- 172.21.15.100:0/2056603730 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d4167ce0 con 0x7f06d40c1850 2024-09-11T22:34:55.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:54.999+0000 7f06d2d9d640 1 --2- 172.21.15.100:0/2056603730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06d40c1850 0x7f06d4164720 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f06d406f120 tx=0x7f06c8032d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a14e6a79c39a98 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:55.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.008+0000 7f06d159a640 1 -- 172.21.15.100:0/2056603730 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8040070 con 0x7f06d40c1850 2024-09-11T22:34:55.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.009+0000 7f06d159a640 1 -- 172.21.15.100:0/2056603730 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c80337c0 con 0x7f06d40c1850 2024-09-11T22:34:55.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.010+0000 7f06d8877640 1 -- 172.21.15.100:0/2056603730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06d40c1850 msgr2=0x7f06d4164720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:55.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.010+0000 7f06d8877640 1 --2- 172.21.15.100:0/2056603730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06d40c1850 0x7f06d4164720 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f06d406f120 tx=0x7f06c8032d40 comp rx=0 tx=0).stop 2024-09-11T22:34:55.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.010+0000 7f06d8877640 1 -- 172.21.15.100:0/2056603730 shutdown_connections 2024-09-11T22:34:55.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.010+0000 7f06d8877640 1 --2- 172.21.15.100:0/2056603730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06d40c1850 0x7f06d4164720 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.010+0000 7f06d8877640 1 --2- 172.21.15.100:0/2056603730 >> v2:172.21.15.167:3300/0 conn(0x7f06d40c9050 0x7f06d40c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.010+0000 7f06d8877640 1 -- 172.21.15.100:0/2056603730 >> 172.21.15.100:0/2056603730 conn(0x7f06d406f190 msgr2=0x7f06d406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:55.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.014+0000 7f06d8877640 1 -- 172.21.15.100:0/2056603730 shutdown_connections 2024-09-11T22:34:55.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.014+0000 7f06d8877640 1 -- 172.21.15.100:0/2056603730 wait complete. 2024-09-11T22:34:55.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.016+0000 7f06d8877640 1 Processor -- start 2024-09-11T22:34:55.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.016+0000 7f06d8877640 1 -- start start 2024-09-11T22:34:55.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.017+0000 7f06d8877640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06d40c1850 0x7f06d4161630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:55.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.017+0000 7f06d8877640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d40c8c70 0x7f06d40c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:55.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.017+0000 7f06d8877640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06d40c9050 0x7f06d4200590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:55.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.017+0000 7f06d8877640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f06d40c7380 con 0x7f06d40c1850 2024-09-11T22:34:55.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.017+0000 7f06d8877640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f06d41682a0 con 0x7f06d40c8c70 2024-09-11T22:34:55.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.017+0000 7f06d8877640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f06d40c7500 con 0x7f06d40c9050 2024-09-11T22:34:55.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.018+0000 7f06d1d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d40c8c70 0x7f06d40c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:55.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.018+0000 7f06d1d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d40c8c70 0x7f06d40c4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:59420/0 (socket says 172.21.15.100:59420) 2024-09-11T22:34:55.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.018+0000 7f06d1d9b640 1 -- 172.21.15.100:0/3650888185 learned_addr learned my addr 172.21.15.100:0/3650888185 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:55.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.018+0000 7f06d259c640 1 --2- 172.21.15.100:0/3650888185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06d40c1850 0x7f06d4161630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:55.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.019+0000 7f06d2d9d640 1 --2- 172.21.15.100:0/3650888185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06d40c9050 0x7f06d4200590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:55.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.019+0000 7f06d259c640 1 -- 172.21.15.100:0/3650888185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06d40c9050 msgr2=0x7f06d4200590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:55.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.019+0000 7f06d259c640 1 --2- 172.21.15.100:0/3650888185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06d40c9050 0x7f06d4200590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.019+0000 7f06d259c640 1 -- 172.21.15.100:0/3650888185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d40c8c70 msgr2=0x7f06d40c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:55.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.019+0000 7f06d259c640 1 --2- 172.21.15.100:0/3650888185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d40c8c70 0x7f06d40c4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.019+0000 7f06d259c640 1 -- 172.21.15.100:0/3650888185 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d4200f30 con 0x7f06d40c1850 2024-09-11T22:34:55.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.020+0000 7f06d259c640 1 --2- 172.21.15.100:0/3650888185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06d40c1850 0x7f06d4161630 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f06c400c7e0 tx=0x7f06c400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:55.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.023+0000 7f06c2ffd640 1 -- 172.21.15.100:0/3650888185 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c4017070 con 0x7f06d40c1850 2024-09-11T22:34:55.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.023+0000 7f06c2ffd640 1 -- 172.21.15.100:0/3650888185 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c4005270 con 0x7f06d40c1850 2024-09-11T22:34:55.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.023+0000 7f06c2ffd640 1 -- 172.21.15.100:0/3650888185 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c400a640 con 0x7f06d40c1850 2024-09-11T22:34:55.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.030+0000 7f06d8877640 1 -- 172.21.15.100:0/3650888185 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d42011f0 con 0x7f06d40c1850 2024-09-11T22:34:55.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.030+0000 7f06d8877640 1 -- 172.21.15.100:0/3650888185 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d416b830 con 0x7f06d40c1850 2024-09-11T22:34:55.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.034+0000 7f06d8877640 1 --2- 172.21.15.100:0/3650888185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d40cb270 0x7f06d4160f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:55.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.034+0000 7f06d8877640 1 -- 172.21.15.100:0/3650888185 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f06d4169100 con 0x7f06d40cb270 2024-09-11T22:34:55.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.035+0000 7f06c2ffd640 1 -- 172.21.15.100:0/3650888185 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f06c401a070 con 0x7f06d40c1850 2024-09-11T22:34:55.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.036+0000 7f06d1d9b640 1 --2- 172.21.15.100:0/3650888185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d40cb270 0x7f06d4160f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:55.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.036+0000 7f06c2ffd640 1 --2- 172.21.15.100:0/3650888185 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f06b406bf00 0x7f06b406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:55.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.037+0000 7f06c2ffd640 1 -- 172.21.15.100:0/3650888185 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f06c408a6e0 con 0x7f06d40c1850 2024-09-11T22:34:55.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.037+0000 7f06d2d9d640 1 --2- 172.21.15.100:0/3650888185 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f06b406bf00 0x7f06b406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:55.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.038+0000 7f06d2d9d640 1 --2- 172.21.15.100:0/3650888185 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f06b406bf00 0x7f06b406e3c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f06c803d000 tx=0x7f06c8037000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:55.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.043+0000 7f06d1d9b640 1 -- 172.21.15.100:0/3650888185 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f06d406e610 con 0x7f06d40cb270 2024-09-11T22:34:55.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.045+0000 7f06d1d9b640 1 --2- 172.21.15.100:0/3650888185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d40cb270 0x7f06d4160f00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f06d408c260 tx=0x7f06cc00e5e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:55.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.046+0000 7f06c2ffd640 1 -- 172.21.15.100:0/3650888185 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc018020 con 0x7f06d40cb270 2024-09-11T22:34:55.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.046+0000 7f06c2ffd640 1 -- 172.21.15.100:0/3650888185 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f06cc003b90 con 0x7f06d40cb270 2024-09-11T22:34:55.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.046+0000 7f06c2ffd640 1 -- 172.21.15.100:0/3650888185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d40cb270 msgr2=0x7f06d4160f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:55.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.046+0000 7f06c2ffd640 1 --2- 172.21.15.100:0/3650888185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d40cb270 0x7f06d4160f00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f06d408c260 tx=0x7f06cc00e5e0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.046+0000 7f06c2ffd640 1 -- 172.21.15.100:0/3650888185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d40cb270 msgr2=0x7f06d4160f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:34:55.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.047+0000 7f06c2ffd640 1 --2- 172.21.15.100:0/3650888185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d40cb270 0x7f06d4160f00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.077+0000 7f06d8877640 1 --2- 172.21.15.100:0/3650888185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d40c3fb0 0x7f06d415d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:55.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.077+0000 7f06d8877640 1 -- 172.21.15.100:0/3650888185 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f06d40c7e00 con 0x7f06d40c3fb0 2024-09-11T22:34:55.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.078+0000 7f06d1d9b640 1 --2- 172.21.15.100:0/3650888185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d40c3fb0 0x7f06d415d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:55.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.078+0000 7f06d1d9b640 1 -- 172.21.15.100:0/3650888185 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f06d406f8f0 con 0x7f06d40c3fb0 2024-09-11T22:34:55.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.078+0000 7f06d1d9b640 1 --2- 172.21.15.100:0/3650888185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d40c3fb0 0x7f06d415d9e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f06cc019000 tx=0x7f06cc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:55.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.079+0000 7f06c2ffd640 1 -- 172.21.15.100:0/3650888185 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06cc018030 con 0x7f06d40c3fb0 2024-09-11T22:34:55.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.079+0000 7f06c2ffd640 1 -- 172.21.15.100:0/3650888185 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7f06cc004600 con 0x7f06d40c3fb0 2024-09-11T22:34:55.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.079+0000 7f06c2ffd640 1 -- 172.21.15.100:0/3650888185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d40c3fb0 msgr2=0x7f06d415d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:55.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.079+0000 7f06c2ffd640 1 --2- 172.21.15.100:0/3650888185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d40c3fb0 0x7f06d415d9e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f06cc019000 tx=0x7f06cc004a40 comp rx=0 tx=0).stop 2024-09-11T22:34:55.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.079+0000 7f06c2ffd640 1 -- 172.21.15.100:0/3650888185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d40c3fb0 msgr2=0x7f06d415d9e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:34:55.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.079+0000 7f06c2ffd640 1 --2- 172.21.15.100:0/3650888185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06d40c3fb0 0x7f06d415d9e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.080 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:34:55.081 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:34:55.081 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:34:55.081 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:34:55.081 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 104, 2024-09-11T22:34:55.081 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 86611, 2024-09-11T22:34:55.081 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:34:55.081 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:34:55.081 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:34:55.081 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:34:55.081 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:55.081 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 13, 2024-09-11T22:34:55.081 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:34:55.081 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:34:55.082 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:34:55.082 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:55.082 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:55.082 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:55.082 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:55.082 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:55.082 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:55.082 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:55.082 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:55.082 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:55.082 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:55.082 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:55.082 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:55.083 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:34:55.083 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:34:55.083 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:55.083 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:55.083 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:55.083 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:55.083 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:55.083 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:55.083 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:55.083 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:55.083 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:55.083 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:55.083 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:55.083 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:55.084 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.084 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:34:55.084 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:34:55.084 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:34:55.084 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:34:55.084 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:34:55.084 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:34:55.084 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:34:55.084 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:34:55.084 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:34:55.084 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:34:55.084 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:34:55.084 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:34:55.085 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:34:55.085 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:34:55.085 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:34:55.085 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:34:55.085 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:34:55.085 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:55.085 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:55.085 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:55.085 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:55.085 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:55.085 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:55.085 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:55.086 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:55.086 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:55.086 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:55.086 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:55.086 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:55.086 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:34:55.086 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.086 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:34:55.086 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.086 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:34:55.086 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:34:55.086 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:55.086 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:55.086 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.087 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:55.087 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:34:55.087 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:55.087 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.087 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.087 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:55.087 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:34:55.087 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:55.087 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:55.087 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:55.087 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.087 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:34:55.087 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:34:55.087 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:55.088 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:55.088 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:55.088 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.088 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.088 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:34:55.088 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:34:55.088 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:55.088 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:55.088 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.088 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:55.088 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:34:55.088 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:55.088 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.088 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.089 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:55.089 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:34:55.089 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:55.089 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:55.089 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:55.089 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.089 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:34:55.089 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:34:55.089 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:55.089 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:55.089 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:55.089 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.089 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.090 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:34:55.090 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:34:55.090 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:55.090 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:55.090 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.090 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:55.090 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:34:55.090 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:55.090 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.090 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.090 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:55.090 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:34:55.090 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:55.090 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:55.091 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:55.091 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.091 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:34:55.091 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:34:55.091 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:55.091 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:55.091 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:55.091 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:55.091 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:55.091 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.091 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:34:55.091 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:34:55.091 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.091 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:55.092 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:55.092 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:34:55.092 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:55.092 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:55.092 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:34:55.092 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.092 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:55.092 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:55.092 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4 2024-09-11T22:34:55.092 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:55.092 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:55.092 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:34:55.092 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.093 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:55.093 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:55.093 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:34:55.093 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:55.093 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:55.093 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:34:55.093 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.093 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:55.093 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:55.093 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:34:55.093 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:55.093 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:55.093 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:34:55.093 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.094 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:55.094 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:55.094 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:34:55.094 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:55.094 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:55.094 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.094 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:34:55.094 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:34:55.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.082+0000 7f06d8877640 1 -- 172.21.15.100:0/3650888185 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f06b406bf00 msgr2=0x7f06b406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:55.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.082+0000 7f06d8877640 1 --2- 172.21.15.100:0/3650888185 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f06b406bf00 0x7f06b406e3c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f06c803d000 tx=0x7f06c8037000 comp rx=0 tx=0).stop 2024-09-11T22:34:55.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.082+0000 7f06d8877640 1 -- 172.21.15.100:0/3650888185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06d40c1850 msgr2=0x7f06d4161630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:55.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.082+0000 7f06d8877640 1 --2- 172.21.15.100:0/3650888185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06d40c1850 0x7f06d4161630 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f06c400c7e0 tx=0x7f06c400cca0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.082+0000 7f06d2d9d640 1 -- 172.21.15.100:0/3650888185 reap_dead start 2024-09-11T22:34:55.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.083+0000 7f06d8877640 1 -- 172.21.15.100:0/3650888185 shutdown_connections 2024-09-11T22:34:55.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.083+0000 7f06d8877640 1 --2- 172.21.15.100:0/3650888185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06d40c1850 0x7f06d4161630 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.083+0000 7f06d8877640 1 -- 172.21.15.100:0/3650888185 >> 172.21.15.100:0/3650888185 conn(0x7f06d406f190 msgr2=0x7f06d41644f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:55.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.084+0000 7f06d8877640 1 -- 172.21.15.100:0/3650888185 shutdown_connections 2024-09-11T22:34:55.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.085+0000 7f06d8877640 1 -- 172.21.15.100:0/3650888185 wait complete. 2024-09-11T22:34:55.117 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:34:55.117 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:34:55.117 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:34:55.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.322+0000 7f8fef59e640 1 Processor -- start 2024-09-11T22:34:55.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.322+0000 7f8fef59e640 1 -- start start 2024-09-11T22:34:55.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.323+0000 7f8fef59e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8fe80f6690 0x7f8fe8005a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:55.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.323+0000 7f8fef59e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8fe804aa40 0x7f8fe8046390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:55.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.323+0000 7f8fef59e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fe80ff830 0x7f8fe80ffcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:55.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.323+0000 7f8fee59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8fe80f6690 0x7f8fe8005a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:55.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.323+0000 7f8fee59c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8fe80f6690 0x7f8fe8005a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:59440/0 (socket says 172.21.15.100:59440) 2024-09-11T22:34:55.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.324+0000 7f8fee59c640 1 -- 172.21.15.100:0/3682586465 learned_addr learned my addr 172.21.15.100:0/3682586465 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:55.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.324+0000 7f8fef59e640 1 -- 172.21.15.100:0/3682586465 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f8fe8045660 con 0x7f8fe804aa40 2024-09-11T22:34:55.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.324+0000 7f8fef59e640 1 -- 172.21.15.100:0/3682586465 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f8fe8045f00 con 0x7f8fe80f6690 2024-09-11T22:34:55.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.324+0000 7f8fef59e640 1 -- 172.21.15.100:0/3682586465 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8fe80f6a70 con 0x7f8fe80ff830 2024-09-11T22:34:55.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.324+0000 7f8feed9d640 1 --2- 172.21.15.100:0/3682586465 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fe80ff830 0x7f8fe80ffcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:55.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.324+0000 7f8fedd9b640 1 --2- 172.21.15.100:0/3682586465 >> v2:172.21.15.100:3300/0 conn(0x7f8fe804aa40 0x7f8fe8046390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:55.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.324+0000 7f8fedd9b640 1 -- 172.21.15.100:0/3682586465 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fe80ff830 msgr2=0x7f8fe80ffcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:55.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.324+0000 7f8fedd9b640 1 --2- 172.21.15.100:0/3682586465 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fe80ff830 0x7f8fe80ffcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.324+0000 7f8fedd9b640 1 -- 172.21.15.100:0/3682586465 >> v2:172.21.15.167:3300/0 conn(0x7f8fe80f6690 msgr2=0x7f8fe8005a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:55.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.324+0000 7f8fedd9b640 1 --2- 172.21.15.100:0/3682586465 >> v2:172.21.15.167:3300/0 conn(0x7f8fe80f6690 0x7f8fe8005a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.324+0000 7f8fedd9b640 1 -- 172.21.15.100:0/3682586465 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe80468d0 con 0x7f8fe804aa40 2024-09-11T22:34:55.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.326+0000 7f8fedd9b640 1 --2- 172.21.15.100:0/3682586465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fe804aa40 0x7f8fe8046390 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8007530 tx=0x7f8fe402e6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd0e6cd387f5932 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:55.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.326+0000 7f8feed9d640 1 --2- 172.21.15.100:0/3682586465 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fe80ff830 0x7f8fe80ffcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:34:55.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.326+0000 7f8fee59c640 1 --2- 172.21.15.100:0/3682586465 >> v2:172.21.15.167:3300/0 conn(0x7f8fe80f6690 0x7f8fe8005a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:34:55.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.327+0000 7f8fed59a640 1 -- 172.21.15.100:0/3682586465 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe403c070 con 0x7f8fe804aa40 2024-09-11T22:34:55.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.327+0000 7f8fed59a640 1 -- 172.21.15.100:0/3682586465 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe4034480 con 0x7f8fe804aa40 2024-09-11T22:34:55.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.327+0000 7f8fed59a640 1 -- 172.21.15.100:0/3682586465 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4034850 con 0x7f8fe804aa40 2024-09-11T22:34:55.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.328+0000 7f8fef59e640 1 -- 172.21.15.100:0/3682586465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fe804aa40 msgr2=0x7f8fe8046390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:55.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.328+0000 7f8fef59e640 1 --2- 172.21.15.100:0/3682586465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fe804aa40 0x7f8fe8046390 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8007530 tx=0x7f8fe402e6f0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.330+0000 7f8fef59e640 1 -- 172.21.15.100:0/3682586465 shutdown_connections 2024-09-11T22:34:55.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.330+0000 7f8fef59e640 1 --2- 172.21.15.100:0/3682586465 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fe80ff830 0x7f8fe80ffcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.330+0000 7f8fef59e640 1 --2- 172.21.15.100:0/3682586465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fe804aa40 0x7f8fe8046390 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.330+0000 7f8fef59e640 1 --2- 172.21.15.100:0/3682586465 >> v2:172.21.15.167:3300/0 conn(0x7f8fe80f6690 0x7f8fe8005a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.330+0000 7f8fef59e640 1 -- 172.21.15.100:0/3682586465 >> 172.21.15.100:0/3682586465 conn(0x7f8fe804fc50 msgr2=0x7f8fe8050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:55.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.330+0000 7f8fef59e640 1 -- 172.21.15.100:0/3682586465 shutdown_connections 2024-09-11T22:34:55.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.331+0000 7f8fef59e640 1 -- 172.21.15.100:0/3682586465 wait complete. 2024-09-11T22:34:55.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.333+0000 7f8fef59e640 1 Processor -- start 2024-09-11T22:34:55.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.333+0000 7f8fef59e640 1 -- start start 2024-09-11T22:34:55.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.334+0000 7f8fef59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8fe804aa40 0x7f8fe80499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:55.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.334+0000 7f8fef59e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fe80f6690 0x7f8fe8047560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:55.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.334+0000 7f8fef59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fe80ff830 0x7f8fe8048620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:55.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.334+0000 7f8fef59e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe80458b0 con 0x7f8fe80ff830 2024-09-11T22:34:55.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.334+0000 7f8fef59e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe81005c0 con 0x7f8fe804aa40 2024-09-11T22:34:55.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.334+0000 7f8fef59e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8fe8045b90 con 0x7f8fe80f6690 2024-09-11T22:34:55.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.335+0000 7f8fee59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8fe804aa40 0x7f8fe80499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:55.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.335+0000 7f8fee59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8fe804aa40 0x7f8fe80499c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:59442/0 (socket says 172.21.15.100:59442) 2024-09-11T22:34:55.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.335+0000 7f8fee59c640 1 -- 172.21.15.100:0/757097245 learned_addr learned my addr 172.21.15.100:0/757097245 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:55.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.335+0000 7f8fedd9b640 1 --2- 172.21.15.100:0/757097245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fe80f6690 0x7f8fe8047560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:55.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.336+0000 7f8fedd9b640 1 -- 172.21.15.100:0/757097245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8fe804aa40 msgr2=0x7f8fe80499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:55.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.336+0000 7f8fedd9b640 1 --2- 172.21.15.100:0/757097245 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8fe804aa40 0x7f8fe80499c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.336+0000 7f8fedd9b640 1 -- 172.21.15.100:0/757097245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fe80ff830 msgr2=0x7f8fe8048620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:55.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.336+0000 7f8fedd9b640 1 --2- 172.21.15.100:0/757097245 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fe80ff830 0x7f8fe8048620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.336+0000 7f8fedd9b640 1 -- 172.21.15.100:0/757097245 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe80eb9d0 con 0x7f8fe80f6690 2024-09-11T22:34:55.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.336+0000 7f8fedd9b640 1 --2- 172.21.15.100:0/757097245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fe80f6690 0x7f8fe8047560 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8046cd0 tx=0x7f8fe40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:55.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.337+0000 7f8fdeffd640 1 -- 172.21.15.100:0/757097245 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe403c070 con 0x7f8fe80f6690 2024-09-11T22:34:55.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.337+0000 7f8fdeffd640 1 -- 172.21.15.100:0/757097245 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe403e070 con 0x7f8fe80f6690 2024-09-11T22:34:55.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.337+0000 7f8fdeffd640 1 -- 172.21.15.100:0/757097245 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe40377c0 con 0x7f8fe80f6690 2024-09-11T22:34:55.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.338+0000 7f8fef59e640 1 -- 172.21.15.100:0/757097245 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fe80f5050 con 0x7f8fe80f6690 2024-09-11T22:34:55.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.338+0000 7f8fef59e640 1 -- 172.21.15.100:0/757097245 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fe80ebf50 con 0x7f8fe80f6690 2024-09-11T22:34:55.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.343+0000 7f8fef59e640 1 --2- 172.21.15.100:0/757097245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd4002a70 0x7f8fd4004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:55.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.343+0000 7f8fef59e640 1 -- 172.21.15.100:0/757097245 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8fd4007ec0 con 0x7f8fd4002a70 2024-09-11T22:34:55.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.343+0000 7f8fdeffd640 1 -- 172.21.15.100:0/757097245 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8fe4006a00 con 0x7f8fe80f6690 2024-09-11T22:34:55.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.343+0000 7f8fdeffd640 1 --2- 172.21.15.100:0/757097245 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8fd006bf00 0x7f8fd006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:55.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.344+0000 7f8fdeffd640 1 -- 172.21.15.100:0/757097245 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f8fe40abe20 con 0x7f8fe80f6690 2024-09-11T22:34:55.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.344+0000 7f8feed9d640 1 --2- 172.21.15.100:0/757097245 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8fd006bf00 0x7f8fd006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:55.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.345+0000 7f8feed9d640 1 --2- 172.21.15.100:0/757097245 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8fd006bf00 0x7f8fd006e3c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0051790 tx=0x7f8ff006e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:55.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.345+0000 7f8fee59c640 1 --2- 172.21.15.100:0/757097245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd4002a70 0x7f8fd4004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:55.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.346+0000 7f8fee59c640 1 -- 172.21.15.100:0/757097245 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8fd40080c0 con 0x7f8fd4002a70 2024-09-11T22:34:55.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.347+0000 7f8fee59c640 1 --2- 172.21.15.100:0/757097245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd4002a70 0x7f8fd4004f30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000fb50 tx=0x7f8fe000d590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:55.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.349+0000 7f8fdeffd640 1 -- 172.21.15.100:0/757097245 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe000fe40 con 0x7f8fd4002a70 2024-09-11T22:34:55.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.349+0000 7f8fdeffd640 1 -- 172.21.15.100:0/757097245 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f8fe0013440 con 0x7f8fd4002a70 2024-09-11T22:34:55.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.349+0000 7f8fdeffd640 1 -- 172.21.15.100:0/757097245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd4002a70 msgr2=0x7f8fd4004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:55.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.349+0000 7f8fdeffd640 1 --2- 172.21.15.100:0/757097245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd4002a70 0x7f8fd4004f30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000fb50 tx=0x7f8fe000d590 comp rx=0 tx=0).stop 2024-09-11T22:34:55.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.349+0000 7f8fdeffd640 1 -- 172.21.15.100:0/757097245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd4002a70 msgr2=0x7f8fd4004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:34:55.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.349+0000 7f8fdeffd640 1 --2- 172.21.15.100:0/757097245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd4002a70 0x7f8fd4004f30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.366+0000 7f8fef59e640 1 --2- 172.21.15.100:0/757097245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd4006f40 0x7f8fd40073d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:55.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.366+0000 7f8fef59e640 1 -- 172.21.15.100:0/757097245 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8fd400a4a0 con 0x7f8fd4006f40 2024-09-11T22:34:55.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.371+0000 7f8fee59c640 1 --2- 172.21.15.100:0/757097245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd4006f40 0x7f8fd40073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:55.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.374+0000 7f8fee59c640 1 -- 172.21.15.100:0/757097245 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8fd4007910 con 0x7f8fd4006f40 2024-09-11T22:34:55.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.374+0000 7f8fee59c640 1 --2- 172.21.15.100:0/757097245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd4006f40 0x7f8fd40073d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000afd0 tx=0x7f8fe00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:55.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.375+0000 7f8fdeffd640 1 -- 172.21.15.100:0/757097245 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe0006800 con 0x7f8fd4006f40 2024-09-11T22:34:55.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.375+0000 7f8fdeffd640 1 -- 172.21.15.100:0/757097245 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5056 (secure 0 0 0) 0x7f8fe00135f0 con 0x7f8fd4006f40 2024-09-11T22:34:55.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.375+0000 7f8fdeffd640 1 -- 172.21.15.100:0/757097245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd4006f40 msgr2=0x7f8fd40073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:55.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.375+0000 7f8fdeffd640 1 --2- 172.21.15.100:0/757097245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd4006f40 0x7f8fd40073d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000afd0 tx=0x7f8fe00046c0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.375+0000 7f8fdeffd640 1 -- 172.21.15.100:0/757097245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd4006f40 msgr2=0x7f8fd40073d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:34:55.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.376+0000 7f8fdeffd640 1 --2- 172.21.15.100:0/757097245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fd4006f40 0x7f8fd40073d0 secure :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000afd0 tx=0x7f8fe00046c0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.380 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:34:55.380 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:34:55.380 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:34:55.380 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:34:55.380 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 104, 2024-09-11T22:34:55.380 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 786096, 2024-09-11T22:34:55.380 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:34:55.380 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:34:55.381 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:34:55.381 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:34:55.381 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:55.381 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 13, 2024-09-11T22:34:55.381 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:34:55.381 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:34:55.381 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:34:55.381 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:55.381 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:55.381 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:55.381 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:55.381 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:55.381 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:55.382 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:55.382 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:55.382 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:55.382 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:55.382 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:55.382 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:55.382 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:34:55.382 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:34:55.382 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:55.382 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:55.382 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:55.382 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:55.383 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:55.383 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:55.383 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:55.383 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:55.383 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:55.383 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:55.383 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:55.383 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:55.383 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.383 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:34:55.383 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:34:55.383 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:34:55.383 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:34:55.384 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:34:55.384 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:34:55.384 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:34:55.384 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:34:55.384 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:34:55.384 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:34:55.384 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:34:55.384 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:34:55.384 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:34:55.384 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:34:55.384 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:34:55.384 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:34:55.384 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:34:55.384 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:34:55.385 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:34:55.385 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:34:55.385 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:34:55.385 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:34:55.385 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:34:55.385 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:34:55.385 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:34:55.385 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:34:55.385 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:34:55.385 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:34:55.385 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:55.385 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:34:55.385 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.385 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:34:55.386 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.386 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:34:55.386 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:34:55.386 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:55.386 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:55.386 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.386 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:55.386 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:34:55.386 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:55.386 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.386 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.387 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:55.387 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:34:55.387 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:55.387 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:55.387 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:55.387 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.387 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:34:55.387 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:34:55.387 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:55.387 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:55.387 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:55.387 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.387 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.387 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:34:55.387 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:34:55.388 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:55.388 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:55.388 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.388 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:55.388 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:34:55.388 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:55.388 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.388 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.388 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:55.388 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:34:55.388 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:55.389 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:55.389 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:55.389 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.389 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:34:55.389 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:34:55.389 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:55.389 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:55.389 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:55.389 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.389 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.389 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:34:55.389 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:34:55.389 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:34:55.390 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:34:55.390 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.390 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:34:55.390 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:34:55.390 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:55.390 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.390 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.390 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:34:55.390 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:34:55.390 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:34:55.390 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:55.390 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:55.390 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.391 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:34:55.391 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:34:55.391 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:34:55.391 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:34:55.391 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:34:55.391 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:55.391 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:55.391 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.391 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:34:55.391 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:34:55.391 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.391 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:55.391 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:55.391 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:34:55.392 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:55.392 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:55.392 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:34:55.392 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.392 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:55.392 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:55.392 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:34:55.392 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:55.392 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:55.392 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:34:55.392 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.392 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:55.392 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:55.392 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:34:55.393 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:55.393 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:55.393 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:34:55.393 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.393 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:55.393 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:55.393 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 5 2024-09-11T22:34:55.393 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:55.393 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:34:55.393 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:34:55.393 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:34:55.393 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:34:55.393 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:34:55.393 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:34:55.394 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:34:55.394 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:34:55.394 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:34:55.394 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:34:55.394 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:34:55.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.379+0000 7f8fef59e640 1 -- 172.21.15.100:0/757097245 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8fd006bf00 msgr2=0x7f8fd006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:55.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.379+0000 7f8fef59e640 1 --2- 172.21.15.100:0/757097245 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8fd006bf00 0x7f8fd006e3c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0051790 tx=0x7f8ff006e040 comp rx=0 tx=0).stop 2024-09-11T22:34:55.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.379+0000 7f8feed9d640 1 -- 172.21.15.100:0/757097245 reap_dead start 2024-09-11T22:34:55.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.379+0000 7f8fef59e640 1 -- 172.21.15.100:0/757097245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fe80f6690 msgr2=0x7f8fe8047560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:55.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.379+0000 7f8fef59e640 1 --2- 172.21.15.100:0/757097245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fe80f6690 0x7f8fe8047560 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8046cd0 tx=0x7f8fe40046c0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.380+0000 7f8fef59e640 1 -- 172.21.15.100:0/757097245 shutdown_connections 2024-09-11T22:34:55.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.380+0000 7f8fef59e640 1 --2- 172.21.15.100:0/757097245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fe80f6690 0x7f8fe8047560 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.380+0000 7f8fef59e640 1 -- 172.21.15.100:0/757097245 >> 172.21.15.100:0/757097245 conn(0x7f8fe804fc50 msgr2=0x7f8fe804c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:55.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.382+0000 7f8fef59e640 1 -- 172.21.15.100:0/757097245 shutdown_connections 2024-09-11T22:34:55.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.386+0000 7f8fef59e640 1 -- 172.21.15.100:0/757097245 wait complete. 2024-09-11T22:34:55.411 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:34:55.411 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-11T22:34:55.411 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-11T22:34:55.411 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-11T22:34:55.412 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:34:55.412 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T22:34:55.412 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:34:55.428 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T22:34:55.428 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-11T22:34:55.429 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:34:55.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.689+0000 7fe13d924640 1 Processor -- start 2024-09-11T22:34:55.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.692+0000 7fe13d924640 1 -- start start 2024-09-11T22:34:55.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.694+0000 7fe13d924640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe1300dcdd0 0x7fe1300471c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:55.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.694+0000 7fe13d924640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1300067c0 0x7fe1300ed360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:55.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.694+0000 7fe13d924640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe130045c30 con 0x7fe130047700 2024-09-11T22:34:55.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.694+0000 7fe13d924640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fe13004b6d0 con 0x7fe1300dcdd0 2024-09-11T22:34:55.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.694+0000 7fe13d924640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe130046d30 con 0x7fe1300067c0 2024-09-11T22:34:55.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.696+0000 7fe13c922640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe1300dcdd0 0x7fe1300471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:55.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.696+0000 7fe13c922640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe1300dcdd0 0x7fe1300471c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:59456/0 (socket says 172.21.15.100:59456) 2024-09-11T22:34:55.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.696+0000 7fe13c922640 1 -- 172.21.15.100:0/3558827818 learned_addr learned my addr 172.21.15.100:0/3558827818 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:55.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.697+0000 7fe13d123640 1 --2- 172.21.15.100:0/3558827818 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1300067c0 0x7fe1300ed360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:55.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.697+0000 7fe13c922640 1 -- 172.21.15.100:0/3558827818 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1300067c0 msgr2=0x7fe1300ed360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:55.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.697+0000 7fe13c922640 1 --2- 172.21.15.100:0/3558827818 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1300067c0 0x7fe1300ed360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.697+0000 7fe13c922640 1 -- 172.21.15.100:0/3558827818 >> v1:172.21.15.100:6789/0 conn(0x7fe130047700 legacy=0x7fe130006fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:34:55.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.697+0000 7fe13c922640 1 -- 172.21.15.100:0/3558827818 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1300e3880 con 0x7fe1300dcdd0 2024-09-11T22:34:55.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.701+0000 7fe13c922640 1 --2- 172.21.15.100:0/3558827818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1300dcdd0 0x7fe1300471c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe124009870 tx=0x7fe12402a2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b316de49f85ee448 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:55.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.702+0000 7fe1377fe640 1 -- 172.21.15.100:0/3558827818 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe124037070 con 0x7fe1300dcdd0 2024-09-11T22:34:55.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.702+0000 7fe1377fe640 1 -- 172.21.15.100:0/3558827818 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe124032440 con 0x7fe1300dcdd0 2024-09-11T22:34:55.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.705+0000 7fe1377fe640 1 -- 172.21.15.100:0/3558827818 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe124032810 con 0x7fe1300dcdd0 2024-09-11T22:34:55.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.706+0000 7fe13d924640 1 -- 172.21.15.100:0/3558827818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1300dcdd0 msgr2=0x7fe1300471c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:55.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.707+0000 7fe13d924640 1 --2- 172.21.15.100:0/3558827818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1300dcdd0 0x7fe1300471c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe124009870 tx=0x7fe12402a2a0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.707+0000 7fe13d924640 1 -- 172.21.15.100:0/3558827818 shutdown_connections 2024-09-11T22:34:55.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.707+0000 7fe13d924640 1 --2- 172.21.15.100:0/3558827818 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1300067c0 0x7fe1300ed360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.707+0000 7fe13d924640 1 --2- 172.21.15.100:0/3558827818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1300dcdd0 0x7fe1300471c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.707+0000 7fe13d924640 1 -- 172.21.15.100:0/3558827818 >> 172.21.15.100:0/3558827818 conn(0x7fe130050d50 msgr2=0x7fe130051160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:55.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.707+0000 7fe13d924640 1 -- 172.21.15.100:0/3558827818 shutdown_connections 2024-09-11T22:34:55.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.707+0000 7fe13d924640 1 -- 172.21.15.100:0/3558827818 wait complete. 2024-09-11T22:34:55.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.709+0000 7fe13d924640 1 Processor -- start 2024-09-11T22:34:55.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.710+0000 7fe13d924640 1 -- start start 2024-09-11T22:34:55.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.711+0000 7fe13d924640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1300067c0 0x7fe1300df650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:55.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.711+0000 7fe13d924640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe130047700 0x7fe13017c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:55.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.711+0000 7fe13d924640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1300dcdd0 0x7fe1300dd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:55.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.711+0000 7fe13d924640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe1300469c0 con 0x7fe130047700 2024-09-11T22:34:55.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.712+0000 7fe13d924640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe1300461d0 con 0x7fe1300dcdd0 2024-09-11T22:34:55.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.712+0000 7fe13d924640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe130007c30 con 0x7fe1300067c0 2024-09-11T22:34:55.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.712+0000 7fe13d123640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1300dcdd0 0x7fe1300dd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:55.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.712+0000 7fe13d123640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1300dcdd0 0x7fe1300dd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:59466/0 (socket says 172.21.15.100:59466) 2024-09-11T22:34:55.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.712+0000 7fe13d123640 1 -- 172.21.15.100:0/4223782336 learned_addr learned my addr 172.21.15.100:0/4223782336 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:55.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.712+0000 7fe137fff640 1 -- 172.21.15.100:0/4223782336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe130047700 msgr2=0x7fe13017c010 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:34:55.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.712+0000 7fe137fff640 1 --2- 172.21.15.100:0/4223782336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe130047700 0x7fe13017c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:34:55.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.712+0000 7fe13c922640 1 --2- 172.21.15.100:0/4223782336 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1300067c0 0x7fe1300df650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:55.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.713+0000 7fe13c922640 1 -- 172.21.15.100:0/4223782336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1300dcdd0 msgr2=0x7fe1300dd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:55.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.713+0000 7fe13c922640 1 --2- 172.21.15.100:0/4223782336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1300dcdd0 0x7fe1300dd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.713+0000 7fe13c922640 1 -- 172.21.15.100:0/4223782336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe130047700 msgr2=0x7fe13017c010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:34:55.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.713+0000 7fe13c922640 1 --2- 172.21.15.100:0/4223782336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe130047700 0x7fe13017c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:55.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.713+0000 7fe13c922640 1 -- 172.21.15.100:0/4223782336 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1300e66e0 con 0x7fe1300067c0 2024-09-11T22:34:55.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.714+0000 7fe13c922640 1 --2- 172.21.15.100:0/4223782336 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1300067c0 0x7fe1300df650 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe124031000 tx=0x7fe1240046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:55.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.720+0000 7fe1357fa640 1 -- 172.21.15.100:0/4223782336 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe124041020 con 0x7fe1300067c0 2024-09-11T22:34:55.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.720+0000 7fe13d924640 1 -- 172.21.15.100:0/4223782336 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe13017cad0 con 0x7fe1300067c0 2024-09-11T22:34:55.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.720+0000 7fe13d924640 1 -- 172.21.15.100:0/4223782336 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1300dc340 con 0x7fe1300067c0 2024-09-11T22:34:55.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.721+0000 7fe1357fa640 1 -- 172.21.15.100:0/4223782336 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1240307a0 con 0x7fe1300067c0 2024-09-11T22:34:55.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.722+0000 7fe1357fa640 1 -- 172.21.15.100:0/4223782336 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe124037040 con 0x7fe1300067c0 2024-09-11T22:34:55.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.722+0000 7fe13d924640 1 -- 172.21.15.100:0/4223782336 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe118005290 con 0x7fe1300067c0 2024-09-11T22:34:55.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.735+0000 7fe1357fa640 1 -- 172.21.15.100:0/4223782336 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe124044020 con 0x7fe1300067c0 2024-09-11T22:34:55.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.736+0000 7fe1357fa640 1 --2- 172.21.15.100:0/4223782336 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe11c06be60 0x7fe11c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:55.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.736+0000 7fe1357fa640 1 -- 172.21.15.100:0/4223782336 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fe1240abdc0 con 0x7fe1300067c0 2024-09-11T22:34:55.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.736+0000 7fe137fff640 1 --2- 172.21.15.100:0/4223782336 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe11c06be60 0x7fe11c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:55.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.736+0000 7fe1357fa640 1 -- 172.21.15.100:0/4223782336 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe12404b030 con 0x7fe1300067c0 2024-09-11T22:34:55.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:55.738+0000 7fe137fff640 1 --2- 172.21.15.100:0/4223782336 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe11c06be60 0x7fe11c06e320 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe1301799b0 tx=0x7fe12c006cc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:56.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:56.245+0000 7fe13d924640 1 -- 172.21.15.100:0/4223782336 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe118005880 con 0x7fe1300067c0 2024-09-11T22:34:56.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:56.246+0000 7fe1357fa640 1 -- 172.21.15.100:0/4223782336 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1570 (secure 0 0 0) 0x7fe12407a450 con 0x7fe1300067c0 2024-09-11T22:34:56.250 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":104,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:34:56.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:56.250+0000 7fe13d924640 1 -- 172.21.15.100:0/4223782336 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe11c06be60 msgr2=0x7fe11c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:56.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:56.250+0000 7fe13d924640 1 --2- 172.21.15.100:0/4223782336 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe11c06be60 0x7fe11c06e320 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe1301799b0 tx=0x7fe12c006cc0 comp rx=0 tx=0).stop 2024-09-11T22:34:56.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:56.250+0000 7fe13d924640 1 -- 172.21.15.100:0/4223782336 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1300067c0 msgr2=0x7fe1300df650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:56.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:56.250+0000 7fe13d924640 1 --2- 172.21.15.100:0/4223782336 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1300067c0 0x7fe1300df650 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe124031000 tx=0x7fe1240046c0 comp rx=0 tx=0).stop 2024-09-11T22:34:56.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:56.250+0000 7fe13d924640 1 -- 172.21.15.100:0/4223782336 shutdown_connections 2024-09-11T22:34:56.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:56.251+0000 7fe13d924640 1 --2- 172.21.15.100:0/4223782336 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe11c06be60 0x7fe11c06e320 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:56.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:56.251+0000 7fe13d924640 1 --2- 172.21.15.100:0/4223782336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1300dcdd0 0x7fe1300dd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:56.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:56.251+0000 7fe13d924640 1 --2- 172.21.15.100:0/4223782336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe130047700 0x7fe13017c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:56.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:56.251+0000 7fe13d924640 1 --2- 172.21.15.100:0/4223782336 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1300067c0 0x7fe1300df650 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:56.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:56.251+0000 7fe13d924640 1 -- 172.21.15.100:0/4223782336 >> 172.21.15.100:0/4223782336 conn(0x7fe130050d50 msgr2=0x7fe13004bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:56.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:56.251+0000 7fe13d924640 1 -- 172.21.15.100:0/4223782336 shutdown_connections 2024-09-11T22:34:56.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:56.251+0000 7fe13d924640 1 -- 172.21.15.100:0/4223782336 wait complete. 2024-09-11T22:34:59.270 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:34:59.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.456+0000 7fe1bd696640 1 Processor -- start 2024-09-11T22:34:59.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.456+0000 7fe1bd696640 1 -- start start 2024-09-11T22:34:59.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.457+0000 7fe1bd696640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1b815c660 0x7fe1b81622f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:59.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.457+0000 7fe1bd696640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe1b80728a0 0x7fe1b815f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:59.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.457+0000 7fe1bd696640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1b80c3130 con 0x7fe1b80c7cf0 2024-09-11T22:34:59.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.457+0000 7fe1bd696640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fe1b8163240 con 0x7fe1b80728a0 2024-09-11T22:34:59.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.457+0000 7fe1bd696640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe1b815ca40 con 0x7fe1b815c660 2024-09-11T22:34:59.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.458+0000 7fe1b77fe640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7fe1b80c7cf0 legacy=0x7fe1b806bc10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:34:59.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.458+0000 7fe1b67fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe1b80728a0 0x7fe1b815f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:59.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.458+0000 7fe1b67fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe1b80728a0 0x7fe1b815f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:59482/0 (socket says 172.21.15.100:59482) 2024-09-11T22:34:59.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.458+0000 7fe1b67fc640 1 -- 172.21.15.100:0/2995409632 learned_addr learned my addr 172.21.15.100:0/2995409632 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:59.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.459+0000 7fe1b6ffd640 1 --2- 172.21.15.100:0/2995409632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1b815c660 0x7fe1b81622f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:59.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.460+0000 7fe1b6ffd640 1 -- 172.21.15.100:0/2995409632 >> v2:172.21.15.167:3300/0 conn(0x7fe1b80728a0 msgr2=0x7fe1b815f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:34:59.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.460+0000 7fe1b6ffd640 1 --2- 172.21.15.100:0/2995409632 >> v2:172.21.15.167:3300/0 conn(0x7fe1b80728a0 0x7fe1b815f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:59.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.460+0000 7fe1b6ffd640 1 -- 172.21.15.100:0/2995409632 >> v1:172.21.15.100:6789/0 conn(0x7fe1b80c7cf0 legacy=0x7fe1b806bc10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:34:59.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.460+0000 7fe1b6ffd640 1 -- 172.21.15.100:0/2995409632 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b815fcd0 con 0x7fe1b815c660 2024-09-11T22:34:59.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.462+0000 7fe1b6ffd640 1 --2- 172.21.15.100:0/2995409632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1b815c660 0x7fe1b81622f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac0097a0 tx=0x7fe1ac02a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c65b1169703f60f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:59.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.463+0000 7fe1b5ffb640 1 -- 172.21.15.100:0/2995409632 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac037070 con 0x7fe1b815c660 2024-09-11T22:34:59.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.463+0000 7fe1b5ffb640 1 -- 172.21.15.100:0/2995409632 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1ac032440 con 0x7fe1b815c660 2024-09-11T22:34:59.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.463+0000 7fe1b5ffb640 1 -- 172.21.15.100:0/2995409632 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac032850 con 0x7fe1b815c660 2024-09-11T22:34:59.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.464+0000 7fe1bd696640 1 -- 172.21.15.100:0/2995409632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1b815c660 msgr2=0x7fe1b81622f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:59.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.464+0000 7fe1bd696640 1 --2- 172.21.15.100:0/2995409632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1b815c660 0x7fe1b81622f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac0097a0 tx=0x7fe1ac02a1e0 comp rx=0 tx=0).stop 2024-09-11T22:34:59.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.465+0000 7fe1bd696640 1 -- 172.21.15.100:0/2995409632 shutdown_connections 2024-09-11T22:34:59.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.465+0000 7fe1bd696640 1 --2- 172.21.15.100:0/2995409632 >> v2:172.21.15.167:3300/0 conn(0x7fe1b80728a0 0x7fe1b815f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:59.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.465+0000 7fe1bd696640 1 --2- 172.21.15.100:0/2995409632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1b815c660 0x7fe1b81622f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:59.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.465+0000 7fe1bd696640 1 -- 172.21.15.100:0/2995409632 >> 172.21.15.100:0/2995409632 conn(0x7fe1b80cbf70 msgr2=0x7fe1b80cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:34:59.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.468+0000 7fe1bd696640 1 -- 172.21.15.100:0/2995409632 shutdown_connections 2024-09-11T22:34:59.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.468+0000 7fe1bd696640 1 -- 172.21.15.100:0/2995409632 wait complete. 2024-09-11T22:34:59.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.470+0000 7fe1bd696640 1 Processor -- start 2024-09-11T22:34:59.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.470+0000 7fe1bd696640 1 -- start start 2024-09-11T22:34:59.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.471+0000 7fe1bd696640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b80728a0 0x7fe1b80c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:59.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.471+0000 7fe1bd696640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1b80c7cf0 0x7fe1b8160310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:59.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.471+0000 7fe1bd696640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b815c660 0x7fe1b8160850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:59.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.471+0000 7fe1bd696640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b8162c80 con 0x7fe1b80728a0 2024-09-11T22:34:59.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.471+0000 7fe1bd696640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b815f300 con 0x7fe1b815c660 2024-09-11T22:34:59.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.471+0000 7fe1bd696640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe1b8162f60 con 0x7fe1b80c7cf0 2024-09-11T22:34:59.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.475+0000 7fe1b67fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1b80c7cf0 0x7fe1b8160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:59.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.475+0000 7fe1b67fc640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1b80c7cf0 0x7fe1b8160310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:59336/0 (socket says 172.21.15.100:59336) 2024-09-11T22:34:59.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.475+0000 7fe1b67fc640 1 -- 172.21.15.100:0/917777577 learned_addr learned my addr 172.21.15.100:0/917777577 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:34:59.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.476+0000 7fe1b77fe640 1 --2- 172.21.15.100:0/917777577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b815c660 0x7fe1b8160850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:59.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.476+0000 7fe1b67fc640 1 -- 172.21.15.100:0/917777577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b815c660 msgr2=0x7fe1b8160850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:34:59.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.476+0000 7fe1b67fc640 1 --2- 172.21.15.100:0/917777577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b815c660 0x7fe1b8160850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:59.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.476+0000 7fe1b67fc640 1 -- 172.21.15.100:0/917777577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b80728a0 msgr2=0x7fe1b80c5df0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:34:59.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.476+0000 7fe1b6ffd640 1 -- 172.21.15.100:0/917777577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b80728a0 msgr2=0x7fe1b80c5df0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:34:59.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.476+0000 7fe1b6ffd640 1 --2- 172.21.15.100:0/917777577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b80728a0 0x7fe1b80c5df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:34:59.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.476+0000 7fe1b67fc640 1 --2- 172.21.15.100:0/917777577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b80728a0 0x7fe1b80c5df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:34:59.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.476+0000 7fe1b67fc640 1 -- 172.21.15.100:0/917777577 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b80c3630 con 0x7fe1b80c7cf0 2024-09-11T22:34:59.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.476+0000 7fe1b67fc640 1 --2- 172.21.15.100:0/917777577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1b80c7cf0 0x7fe1b8160310 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0009d70 tx=0x7fe1b000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:34:59.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.478+0000 7fe19f7fe640 1 -- 172.21.15.100:0/917777577 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b000cda0 con 0x7fe1b80c7cf0 2024-09-11T22:34:59.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.478+0000 7fe1bd696640 1 -- 172.21.15.100:0/917777577 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1b80c3910 con 0x7fe1b80c7cf0 2024-09-11T22:34:59.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.478+0000 7fe1bd696640 1 -- 172.21.15.100:0/917777577 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1b80c3ed0 con 0x7fe1b80c7cf0 2024-09-11T22:34:59.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.479+0000 7fe19f7fe640 1 -- 172.21.15.100:0/917777577 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1b0019070 con 0x7fe1b80c7cf0 2024-09-11T22:34:59.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.479+0000 7fe19f7fe640 1 -- 172.21.15.100:0/917777577 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0014680 con 0x7fe1b80c7cf0 2024-09-11T22:34:59.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.479+0000 7fe1bd696640 1 -- 172.21.15.100:0/917777577 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1b8071820 con 0x7fe1b80c7cf0 2024-09-11T22:34:59.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.482+0000 7fe19f7fe640 1 -- 172.21.15.100:0/917777577 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe1b0005d10 con 0x7fe1b80c7cf0 2024-09-11T22:34:59.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.487+0000 7fe19f7fe640 1 --2- 172.21.15.100:0/917777577 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe1a406be10 0x7fe1a406e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:34:59.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.489+0000 7fe19f7fe640 1 -- 172.21.15.100:0/917777577 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fe1b008b7a0 con 0x7fe1b80c7cf0 2024-09-11T22:34:59.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.490+0000 7fe1b6ffd640 1 --2- 172.21.15.100:0/917777577 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe1a406be10 0x7fe1a406e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:34:59.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.490+0000 7fe19f7fe640 1 -- 172.21.15.100:0/917777577 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe1b8071820 con 0x7fe1b80c7cf0 2024-09-11T22:34:59.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:34:59.496+0000 7fe1b6ffd640 1 --2- 172.21.15.100:0/917777577 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe1a406be10 0x7fe1a406e2d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac034000 tx=0x7fe1ac02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:00.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:00.031+0000 7fe1bd696640 1 -- 172.21.15.100:0/917777577 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fe1b815ef90 con 0x7fe1b80c7cf0 2024-09-11T22:35:00.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:00.035+0000 7fe19f7fe640 1 -- 172.21.15.100:0/917777577 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1570 (secure 0 0 0) 0x7fe1b0010040 con 0x7fe1b80c7cf0 2024-09-11T22:35:00.036 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":104,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:35:00.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:00.038+0000 7fe1bd696640 1 -- 172.21.15.100:0/917777577 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe1a406be10 msgr2=0x7fe1a406e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:00.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:00.038+0000 7fe1bd696640 1 --2- 172.21.15.100:0/917777577 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe1a406be10 0x7fe1a406e2d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac034000 tx=0x7fe1ac02e000 comp rx=0 tx=0).stop 2024-09-11T22:35:00.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:00.038+0000 7fe1bd696640 1 -- 172.21.15.100:0/917777577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1b80c7cf0 msgr2=0x7fe1b8160310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:00.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:00.038+0000 7fe1bd696640 1 --2- 172.21.15.100:0/917777577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1b80c7cf0 0x7fe1b8160310 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0009d70 tx=0x7fe1b000c490 comp rx=0 tx=0).stop 2024-09-11T22:35:00.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:00.045+0000 7fe1bd696640 1 -- 172.21.15.100:0/917777577 shutdown_connections 2024-09-11T22:35:00.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:00.045+0000 7fe1bd696640 1 --2- 172.21.15.100:0/917777577 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe1a406be10 0x7fe1a406e2d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:00.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:00.045+0000 7fe1bd696640 1 --2- 172.21.15.100:0/917777577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1b815c660 0x7fe1b8160850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:00.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:00.045+0000 7fe1bd696640 1 --2- 172.21.15.100:0/917777577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1b80c7cf0 0x7fe1b8160310 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:00.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:00.045+0000 7fe1bd696640 1 --2- 172.21.15.100:0/917777577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b80728a0 0x7fe1b80c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:00.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:00.045+0000 7fe1bd696640 1 -- 172.21.15.100:0/917777577 >> 172.21.15.100:0/917777577 conn(0x7fe1b80cbf70 msgr2=0x7fe1b80ca070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:00.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:00.045+0000 7fe1bd696640 1 -- 172.21.15.100:0/917777577 shutdown_connections 2024-09-11T22:35:00.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:00.046+0000 7fe1bd696640 1 -- 172.21.15.100:0/917777577 wait complete. 2024-09-11T22:35:03.078 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:35:03.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.302+0000 7f474bbcf640 1 Processor -- start 2024-09-11T22:35:03.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.302+0000 7f474bbcf640 1 -- start start 2024-09-11T22:35:03.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.303+0000 7f474bbcf640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4744154e20 0x7f47440b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:03.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.303+0000 7f474bbcf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47440cbdc0 0x7f474415a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:03.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.303+0000 7f474bbcf640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47440cc670 con 0x7f47440cc1a0 2024-09-11T22:35:03.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.303+0000 7f474bbcf640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f474415e8b0 con 0x7f4744154e20 2024-09-11T22:35:03.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.303+0000 7f474bbcf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f47440cc950 con 0x7f47440cbdc0 2024-09-11T22:35:03.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.303+0000 7f474a16c640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f47440cc1a0 legacy=0x7f47440ccc60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:35:03.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.303+0000 7f474916a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47440cbdc0 0x7f474415a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:03.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.304+0000 7f474916a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47440cbdc0 0x7f474415a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:57528/0 (socket says 172.21.15.100:57528) 2024-09-11T22:35:03.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.304+0000 7f474916a640 1 -- 172.21.15.100:0/3790065926 learned_addr learned my addr 172.21.15.100:0/3790065926 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:03.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.304+0000 7f474996b640 1 --2- 172.21.15.100:0/3790065926 >> v2:172.21.15.167:3300/0 conn(0x7f4744154e20 0x7f47440b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:03.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.309+0000 7f474916a640 1 -- 172.21.15.100:0/3790065926 >> v2:172.21.15.167:3300/0 conn(0x7f4744154e20 msgr2=0x7f47440b2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:03.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.309+0000 7f474916a640 1 --2- 172.21.15.100:0/3790065926 >> v2:172.21.15.167:3300/0 conn(0x7f4744154e20 0x7f47440b2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:03.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.309+0000 7f474916a640 1 -- 172.21.15.100:0/3790065926 >> v1:172.21.15.100:6789/0 conn(0x7f47440cc1a0 legacy=0x7f47440ccc60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:35:03.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.309+0000 7f474916a640 1 -- 172.21.15.100:0/3790065926 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f474415df80 con 0x7f47440cbdc0 2024-09-11T22:35:03.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.310+0000 7f474916a640 1 --2- 172.21.15.100:0/3790065926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47440cbdc0 0x7f474415a970 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4740009870 tx=0x7f474002a2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc8c1f2ab477d89e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:03.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.311+0000 7f4748969640 1 -- 172.21.15.100:0/3790065926 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4740037070 con 0x7f47440cbdc0 2024-09-11T22:35:03.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.311+0000 7f4748969640 1 -- 172.21.15.100:0/3790065926 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4740032440 con 0x7f47440cbdc0 2024-09-11T22:35:03.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.311+0000 7f4748969640 1 -- 172.21.15.100:0/3790065926 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4740037070 con 0x7f47440cbdc0 2024-09-11T22:35:03.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.313+0000 7f474bbcf640 1 -- 172.21.15.100:0/3790065926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47440cbdc0 msgr2=0x7f474415a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:03.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.313+0000 7f474bbcf640 1 --2- 172.21.15.100:0/3790065926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47440cbdc0 0x7f474415a970 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4740009870 tx=0x7f474002a2a0 comp rx=0 tx=0).stop 2024-09-11T22:35:03.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.313+0000 7f474bbcf640 1 -- 172.21.15.100:0/3790065926 shutdown_connections 2024-09-11T22:35:03.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.313+0000 7f474bbcf640 1 --2- 172.21.15.100:0/3790065926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47440cbdc0 0x7f474415a970 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:03.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.313+0000 7f474bbcf640 1 --2- 172.21.15.100:0/3790065926 >> v2:172.21.15.167:3300/0 conn(0x7f4744154e20 0x7f47440b2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:03.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.313+0000 7f474bbcf640 1 -- 172.21.15.100:0/3790065926 >> 172.21.15.100:0/3790065926 conn(0x7f474406cf00 msgr2=0x7f474406d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:03.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.313+0000 7f474bbcf640 1 -- 172.21.15.100:0/3790065926 shutdown_connections 2024-09-11T22:35:03.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.314+0000 7f474bbcf640 1 -- 172.21.15.100:0/3790065926 wait complete. 2024-09-11T22:35:03.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.315+0000 7f474bbcf640 1 Processor -- start 2024-09-11T22:35:03.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.315+0000 7f474bbcf640 1 -- start start 2024-09-11T22:35:03.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.316+0000 7f474bbcf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47440cc1a0 0x7f47440c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:03.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.316+0000 7f474bbcf640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4744154e20 0x7f47441e6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:03.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.316+0000 7f474bbcf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47440c3480 0x7f47441efc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:03.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.316+0000 7f474bbcf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f474415ed40 con 0x7f47440cc1a0 2024-09-11T22:35:03.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.316+0000 7f474bbcf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f474415e540 con 0x7f47440c3480 2024-09-11T22:35:03.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.316+0000 7f474bbcf640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f47440b3680 con 0x7f4744154e20 2024-09-11T22:35:03.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.317+0000 7f474996b640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47440cc1a0 msgr2=0x7f47440c9170 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:35:03.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.317+0000 7f474996b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47440cc1a0 0x7f47440c9170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:35:03.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.317+0000 7f474a16c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47440c3480 0x7f47441efc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:03.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.317+0000 7f474a16c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47440c3480 0x7f47441efc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:42874/0 (socket says 172.21.15.100:42874) 2024-09-11T22:35:03.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.317+0000 7f474a16c640 1 -- 172.21.15.100:0/2289135557 learned_addr learned my addr 172.21.15.100:0/2289135557 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:03.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.317+0000 7f474a16c640 1 -- 172.21.15.100:0/2289135557 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4744154e20 msgr2=0x7f47441e6640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:35:03.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.317+0000 7f474a16c640 1 --2- 172.21.15.100:0/2289135557 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4744154e20 0x7f47441e6640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:03.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.317+0000 7f474a16c640 1 -- 172.21.15.100:0/2289135557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47440cc1a0 msgr2=0x7f47440c9170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:35:03.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.317+0000 7f474a16c640 1 --2- 172.21.15.100:0/2289135557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47440cc1a0 0x7f47440c9170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:03.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.317+0000 7f474a16c640 1 -- 172.21.15.100:0/2289135557 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47440c96b0 con 0x7f47440c3480 2024-09-11T22:35:03.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.317+0000 7f474a16c640 1 --2- 172.21.15.100:0/2289135557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47440c3480 0x7f47441efc70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f473c00ba10 tx=0x7f473c00bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:03.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.318+0000 7f473a7fc640 1 -- 172.21.15.100:0/2289135557 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473c00cba0 con 0x7f47440c3480 2024-09-11T22:35:03.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.318+0000 7f473a7fc640 1 -- 172.21.15.100:0/2289135557 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f473c010070 con 0x7f47440c3480 2024-09-11T22:35:03.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.318+0000 7f473a7fc640 1 -- 172.21.15.100:0/2289135557 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473c015470 con 0x7f47440c3480 2024-09-11T22:35:03.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.318+0000 7f474bbcf640 1 -- 172.21.15.100:0/2289135557 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47440c7660 con 0x7f47440c3480 2024-09-11T22:35:03.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.318+0000 7f474bbcf640 1 -- 172.21.15.100:0/2289135557 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47441ec890 con 0x7f47440c3480 2024-09-11T22:35:03.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.324+0000 7f473a7fc640 1 -- 172.21.15.100:0/2289135557 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f473c01e3f0 con 0x7f47440c3480 2024-09-11T22:35:03.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.324+0000 7f473a7fc640 1 --2- 172.21.15.100:0/2289135557 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f473006bfb0 0x7f473006e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:03.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.324+0000 7f473a7fc640 1 -- 172.21.15.100:0/2289135557 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f473c08b3d0 con 0x7f47440c3480 2024-09-11T22:35:03.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.325+0000 7f472ffff640 1 -- 172.21.15.100:0/2289135557 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47441ec680 con 0x7f47440c3480 2024-09-11T22:35:03.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.325+0000 7f474996b640 1 --2- 172.21.15.100:0/2289135557 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f473006bfb0 0x7f473006e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:03.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.326+0000 7f474996b640 1 --2- 172.21.15.100:0/2289135557 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f473006bfb0 0x7f473006e470 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4734009450 tx=0x7f4734009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:03.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.330+0000 7f473a7fc640 1 -- 172.21.15.100:0/2289135557 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f473c0599d0 con 0x7f47440c3480 2024-09-11T22:35:03.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.818+0000 7f472ffff640 1 -- 172.21.15.100:0/2289135557 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f47440b2b50 con 0x7f47440c3480 2024-09-11T22:35:03.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.824+0000 7f473a7fc640 1 -- 172.21.15.100:0/2289135557 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1570 (secure 0 0 0) 0x7f473c0592d0 con 0x7f47440c3480 2024-09-11T22:35:03.828 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":104,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":22,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:35:03.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.833+0000 7f472ffff640 1 -- 172.21.15.100:0/2289135557 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f473006bfb0 msgr2=0x7f473006e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:03.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.833+0000 7f472ffff640 1 --2- 172.21.15.100:0/2289135557 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f473006bfb0 0x7f473006e470 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4734009450 tx=0x7f4734009190 comp rx=0 tx=0).stop 2024-09-11T22:35:03.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.833+0000 7f472ffff640 1 -- 172.21.15.100:0/2289135557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47440c3480 msgr2=0x7f47441efc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:03.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.833+0000 7f472ffff640 1 --2- 172.21.15.100:0/2289135557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47440c3480 0x7f47441efc70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f473c00ba10 tx=0x7f473c00bed0 comp rx=0 tx=0).stop 2024-09-11T22:35:03.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.835+0000 7f472ffff640 1 -- 172.21.15.100:0/2289135557 shutdown_connections 2024-09-11T22:35:03.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.835+0000 7f472ffff640 1 --2- 172.21.15.100:0/2289135557 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f473006bfb0 0x7f473006e470 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:03.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.835+0000 7f472ffff640 1 --2- 172.21.15.100:0/2289135557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47440c3480 0x7f47441efc70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:03.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.835+0000 7f472ffff640 1 --2- 172.21.15.100:0/2289135557 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4744154e20 0x7f47441e6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:03.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.835+0000 7f472ffff640 1 --2- 172.21.15.100:0/2289135557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47440cc1a0 0x7f47440c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:03.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.835+0000 7f472ffff640 1 -- 172.21.15.100:0/2289135557 >> 172.21.15.100:0/2289135557 conn(0x7f474406cf00 msgr2=0x7f4744151ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:03.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.835+0000 7f472ffff640 1 -- 172.21.15.100:0/2289135557 shutdown_connections 2024-09-11T22:35:03.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:03.835+0000 7f472ffff640 1 -- 172.21.15.100:0/2289135557 wait complete. 2024-09-11T22:35:06.869 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:35:07.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.049+0000 7f693759e640 1 Processor -- start 2024-09-11T22:35:07.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.049+0000 7f693759e640 1 -- start start 2024-09-11T22:35:07.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.051+0000 7f693759e640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 0x7f69380c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:07.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.051+0000 7f693759e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6938073250 con 0x7f6938151830 2024-09-11T22:35:07.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.051+0000 7f693759e640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f693806d250 con 0x7f693806eac0 2024-09-11T22:35:07.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.051+0000 7f693759e640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f693806fb00 con 0x7f693806eea0 2024-09-11T22:35:07.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.051+0000 7f6936d9d640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f6938151830 legacy=0x7f6938161c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:35:07.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.051+0000 7f6935d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 0x7f69380c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:07.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.051+0000 7f6935d9b640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 0x7f69380c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:42880/0 (socket says 172.21.15.100:42880) 2024-09-11T22:35:07.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.051+0000 7f6935d9b640 1 -- 172.21.15.100:0/961422240 learned_addr learned my addr 172.21.15.100:0/961422240 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:07.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.052+0000 7f6935d9b640 1 -- 172.21.15.100:0/961422240 >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 msgr2=0x7f69380c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:35:07.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.052+0000 7f6935d9b640 1 -- 172.21.15.100:0/961422240 >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 msgr2=0x7f69380c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:35:07.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.052+0000 7f6935d9b640 1 --2- 172.21.15.100:0/961422240 >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 0x7f69380c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:35:07.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.052+0000 7f6935d9b640 1 --2- 172.21.15.100:0/961422240 >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 0x7f69380c89b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:35:07.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.252+0000 7f6936d9d640 1 -- 172.21.15.100:0/961422240 >> v1:172.21.15.100:6789/0 conn(0x7f6938151830 legacy=0x7f6938161c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:35:07.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.256+0000 7f6935d9b640 1 --2- 172.21.15.100:0/961422240 >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 0x7f69380c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:07.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.256+0000 7f6935d9b640 1 -- 172.21.15.100:0/961422240 >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 msgr2=0x7f69380c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:35:07.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.256+0000 7f6935d9b640 1 -- 172.21.15.100:0/961422240 >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 msgr2=0x7f69380c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:35:07.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.257+0000 7f6935d9b640 1 --2- 172.21.15.100:0/961422240 >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 0x7f69380c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:35:07.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.257+0000 7f6935d9b640 1 --2- 172.21.15.100:0/961422240 >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 0x7f69380c89b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:35:07.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.653+0000 7f6936d9d640 1 -- 172.21.15.100:0/961422240 >> v1:172.21.15.100:6789/0 conn(0x7f6938151830 legacy=0x7f6938161c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:35:07.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.658+0000 7f6935d9b640 1 --2- 172.21.15.100:0/961422240 >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 0x7f69380c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:07.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.658+0000 7f6935d9b640 1 -- 172.21.15.100:0/961422240 >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 msgr2=0x7f69380c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:35:07.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.658+0000 7f6935d9b640 1 -- 172.21.15.100:0/961422240 >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 msgr2=0x7f69380c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:35:07.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.658+0000 7f6935d9b640 1 --2- 172.21.15.100:0/961422240 >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 0x7f69380c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:35:07.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:07.658+0000 7f6935d9b640 1 --2- 172.21.15.100:0/961422240 >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 0x7f69380c89b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:35:08.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:08.456+0000 7f6936d9d640 1 -- 172.21.15.100:0/961422240 >> v1:172.21.15.100:6789/0 conn(0x7f6938151830 legacy=0x7f6938161c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:35:08.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:08.460+0000 7f6935d9b640 1 --2- 172.21.15.100:0/961422240 >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 0x7f69380c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:08.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:08.460+0000 7f6935d9b640 1 -- 172.21.15.100:0/961422240 >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 msgr2=0x7f69380c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:35:08.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:08.460+0000 7f6935d9b640 1 -- 172.21.15.100:0/961422240 >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 msgr2=0x7f69380c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:35:08.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:08.460+0000 7f6935d9b640 1 --2- 172.21.15.100:0/961422240 >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 0x7f69380c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:35:08.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:08.460+0000 7f6935d9b640 1 --2- 172.21.15.100:0/961422240 >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 0x7f69380c89b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:35:09.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.647+0000 7f693559a640 1 -- 172.21.15.100:0/961422240 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3470973644 0 0) 0x7f693806d250 con 0x7f693806eac0 2024-09-11T22:35:09.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.647+0000 7f693559a640 1 -- 172.21.15.100:0/961422240 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6924003520 con 0x7f693806eac0 2024-09-11T22:35:09.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.648+0000 7f693559a640 1 -- 172.21.15.100:0/961422240 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3531677866 0 0) 0x7f6924003520 con 0x7f693806eac0 2024-09-11T22:35:09.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.648+0000 7f693559a640 1 -- 172.21.15.100:0/961422240 >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 msgr2=0x7f69380c89b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:35:09.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.648+0000 7f693559a640 1 --2- 172.21.15.100:0/961422240 >> v2:172.21.15.167:3300/0 conn(0x7f693806eea0 0x7f69380c89b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:09.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.648+0000 7f693559a640 1 -- 172.21.15.100:0/961422240 >> v1:172.21.15.100:6789/0 conn(0x7f6938151830 legacy=0x7f6938161c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:35:09.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.648+0000 7f693559a640 1 -- 172.21.15.100:0/961422240 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69380734f0 con 0x7f693806eac0 2024-09-11T22:35:09.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.648+0000 7f693559a640 1 -- 172.21.15.100:0/961422240 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f6930001650 con 0x7f693806eac0 2024-09-11T22:35:09.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.648+0000 7f693559a640 1 -- 172.21.15.100:0/961422240 >> v1:172.21.15.167:6789/0 conn(0x7f693806eac0 legacy=0x7f6938151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:09.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.648+0000 7f693559a640 1 --2- 172.21.15.100:0/961422240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69240039b0 0x7f6924003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:09.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.648+0000 7f693659c640 1 -- 172.21.15.100:0/961422240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69240039b0 msgr2=0x7f6924003dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:35:09.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.648+0000 7f693659c640 1 --2- 172.21.15.100:0/961422240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69240039b0 0x7f6924003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:35:09.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.648+0000 7f693559a640 1 --2- 172.21.15.100:0/961422240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6924004800 0x7f6924004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:09.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.648+0000 7f693559a640 1 --2- 172.21.15.100:0/961422240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69240051c0 0x7f692400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:09.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.648+0000 7f693559a640 1 -- 172.21.15.100:0/961422240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f692400bfe0 con 0x7f69240039b0 2024-09-11T22:35:09.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.649+0000 7f693559a640 1 -- 172.21.15.100:0/961422240 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f692400c190 con 0x7f6924004800 2024-09-11T22:35:09.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.649+0000 7f693559a640 1 -- 172.21.15.100:0/961422240 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f692400c390 con 0x7f69240051c0 2024-09-11T22:35:09.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.649+0000 7f6935d9b640 1 --2- 172.21.15.100:0/961422240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6924004800 0x7f6924004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:09.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.649+0000 7f6936d9d640 1 --2- 172.21.15.100:0/961422240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69240051c0 0x7f692400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:09.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.649+0000 7f6936d9d640 1 -- 172.21.15.100:0/961422240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6924004800 msgr2=0x7f6924004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:09.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.649+0000 7f6936d9d640 1 --2- 172.21.15.100:0/961422240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6924004800 0x7f6924004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:09.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.649+0000 7f6936d9d640 1 -- 172.21.15.100:0/961422240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69240039b0 msgr2=0x7f6924003dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:35:09.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.649+0000 7f6936d9d640 1 --2- 172.21.15.100:0/961422240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69240039b0 0x7f6924003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:09.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.649+0000 7f6936d9d640 1 -- 172.21.15.100:0/961422240 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6924003520 con 0x7f69240051c0 2024-09-11T22:35:09.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.649+0000 7f6935d9b640 1 --2- 172.21.15.100:0/961422240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6924004800 0x7f6924004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:35:09.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.650+0000 7f6936d9d640 1 -- 172.21.15.100:0/961422240 reap_dead start 2024-09-11T22:35:09.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.650+0000 7f6936d9d640 1 --2- 172.21.15.100:0/961422240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69240051c0 0x7f692400b9c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f69200099f0 tx=0x7f6924005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88d89b226601d763 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:09.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.652+0000 7f693559a640 1 -- 172.21.15.100:0/961422240 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69280097e0 con 0x7f69240051c0 2024-09-11T22:35:09.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.652+0000 7f693559a640 1 -- 172.21.15.100:0/961422240 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6920033070 con 0x7f69240051c0 2024-09-11T22:35:09.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.653+0000 7f693759e640 1 -- 172.21.15.100:0/961422240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69240051c0 msgr2=0x7f692400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:09.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.653+0000 7f693759e640 1 --2- 172.21.15.100:0/961422240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69240051c0 0x7f692400b9c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f69200099f0 tx=0x7f6924005830 comp rx=0 tx=0).stop 2024-09-11T22:35:09.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.653+0000 7f693759e640 1 -- 172.21.15.100:0/961422240 shutdown_connections 2024-09-11T22:35:09.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.653+0000 7f693759e640 1 --2- 172.21.15.100:0/961422240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69240051c0 0x7f692400b9c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:09.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.653+0000 7f693759e640 1 -- 172.21.15.100:0/961422240 >> 172.21.15.100:0/961422240 conn(0x7f69380c9a10 msgr2=0x7f69380c9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:09.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.653+0000 7f693759e640 1 -- 172.21.15.100:0/961422240 shutdown_connections 2024-09-11T22:35:09.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.653+0000 7f693759e640 1 -- 172.21.15.100:0/961422240 wait complete. 2024-09-11T22:35:09.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.655+0000 7f693759e640 1 Processor -- start 2024-09-11T22:35:09.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.655+0000 7f693759e640 1 -- start start 2024-09-11T22:35:09.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.656+0000 7f693759e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69381532b0 0x7f6938153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:09.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.656+0000 7f693759e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6938073730 0x7f6938073b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:09.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.656+0000 7f693759e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69381f3da0 0x7f69381f4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:09.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.656+0000 7f693759e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f69380c8520 con 0x7f69381f3da0 2024-09-11T22:35:09.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.656+0000 7f693759e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f69380c8240 con 0x7f6938073730 2024-09-11T22:35:09.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.656+0000 7f693759e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f693806f4f0 con 0x7f69381532b0 2024-09-11T22:35:09.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.657+0000 7f6936d9d640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69381f3da0 msgr2=0x7f69381f4220 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:35:09.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.657+0000 7f6936d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69381f3da0 0x7f69381f4220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:35:09.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.657+0000 7f693659c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69381532b0 0x7f6938153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:09.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.657+0000 7f693659c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69381532b0 0x7f6938153690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:57550/0 (socket says 172.21.15.100:57550) 2024-09-11T22:35:09.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.657+0000 7f693659c640 1 -- 172.21.15.100:0/1856751602 learned_addr learned my addr 172.21.15.100:0/1856751602 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:09.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.658+0000 7f6935d9b640 1 --2- 172.21.15.100:0/1856751602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6938073730 0x7f6938073b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:09.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.658+0000 7f693659c640 1 -- 172.21.15.100:0/1856751602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6938073730 msgr2=0x7f6938073b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:09.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.658+0000 7f693659c640 1 --2- 172.21.15.100:0/1856751602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6938073730 0x7f6938073b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:09.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.658+0000 7f693659c640 1 -- 172.21.15.100:0/1856751602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69381f3da0 msgr2=0x7f69381f4220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:35:09.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.658+0000 7f693659c640 1 --2- 172.21.15.100:0/1856751602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69381f3da0 0x7f69381f4220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:09.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.658+0000 7f693659c640 1 -- 172.21.15.100:0/1856751602 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6938156390 con 0x7f69381532b0 2024-09-11T22:35:09.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.662+0000 7f693659c640 1 --2- 172.21.15.100:0/1856751602 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69381532b0 0x7f6938153690 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f693000c7e0 tx=0x7f693000cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:09.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.664+0000 7f692effd640 1 -- 172.21.15.100:0/1856751602 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6930017070 con 0x7f69381532b0 2024-09-11T22:35:09.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.664+0000 7f693759e640 1 -- 172.21.15.100:0/1856751602 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69380c7340 con 0x7f69381532b0 2024-09-11T22:35:09.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.664+0000 7f693759e640 1 -- 172.21.15.100:0/1856751602 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f69381f7590 con 0x7f69381532b0 2024-09-11T22:35:09.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.664+0000 7f692effd640 1 -- 172.21.15.100:0/1856751602 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6930007270 con 0x7f69381532b0 2024-09-11T22:35:09.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.664+0000 7f692effd640 1 -- 172.21.15.100:0/1856751602 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6930007620 con 0x7f69381532b0 2024-09-11T22:35:09.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.668+0000 7f693759e640 1 -- 172.21.15.100:0/1856751602 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f691c005290 con 0x7f69381532b0 2024-09-11T22:35:09.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.671+0000 7f692effd640 1 -- 172.21.15.100:0/1856751602 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f693001a070 con 0x7f69381532b0 2024-09-11T22:35:09.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.671+0000 7f692effd640 1 --2- 172.21.15.100:0/1856751602 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f692406d7c0 0x7f692406fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:09.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.672+0000 7f692effd640 1 -- 172.21.15.100:0/1856751602 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f693008a660 con 0x7f69381532b0 2024-09-11T22:35:09.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.672+0000 7f6935d9b640 1 --2- 172.21.15.100:0/1856751602 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f692406d7c0 0x7f692406fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:09.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.674+0000 7f6935d9b640 1 --2- 172.21.15.100:0/1856751602 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f692406d7c0 0x7f692406fc80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f693815af70 tx=0x7f692800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:09.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:09.676+0000 7f692effd640 1 -- 172.21.15.100:0/1856751602 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6930058580 con 0x7f69381532b0 2024-09-11T22:35:10.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.159+0000 7f693759e640 1 -- 172.21.15.100:0/1856751602 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f691c005580 con 0x7f69381532b0 2024-09-11T22:35:10.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.165+0000 7f692effd640 1 -- 172.21.15.100:0/1856751602 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1563 (secure 0 0 0) 0x7f693005c880 con 0x7f69381532b0 2024-09-11T22:35:10.167 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":106,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:35:10.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.168+0000 7f693759e640 1 -- 172.21.15.100:0/1856751602 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f692406d7c0 msgr2=0x7f692406fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:10.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.168+0000 7f693759e640 1 --2- 172.21.15.100:0/1856751602 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f692406d7c0 0x7f692406fc80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f693815af70 tx=0x7f692800b040 comp rx=0 tx=0).stop 2024-09-11T22:35:10.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.168+0000 7f693759e640 1 -- 172.21.15.100:0/1856751602 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69381532b0 msgr2=0x7f6938153690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:10.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.168+0000 7f693759e640 1 --2- 172.21.15.100:0/1856751602 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69381532b0 0x7f6938153690 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f693000c7e0 tx=0x7f693000cbe0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.168+0000 7f693759e640 1 -- 172.21.15.100:0/1856751602 shutdown_connections 2024-09-11T22:35:10.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.168+0000 7f693759e640 1 --2- 172.21.15.100:0/1856751602 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f692406d7c0 0x7f692406fc80 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.168+0000 7f693759e640 1 --2- 172.21.15.100:0/1856751602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69381f3da0 0x7f69381f4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.168+0000 7f693759e640 1 --2- 172.21.15.100:0/1856751602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6938073730 0x7f6938073b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.168+0000 7f693759e640 1 --2- 172.21.15.100:0/1856751602 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f69381532b0 0x7f6938153690 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.168+0000 7f693759e640 1 -- 172.21.15.100:0/1856751602 >> 172.21.15.100:0/1856751602 conn(0x7f69380c9a10 msgr2=0x7f693814da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:10.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.169+0000 7f693759e640 1 -- 172.21.15.100:0/1856751602 shutdown_connections 2024-09-11T22:35:10.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.169+0000 7f693759e640 1 -- 172.21.15.100:0/1856751602 wait complete. 2024-09-11T22:35:10.184 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-11T22:35:10.185 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-11T22:35:10.185 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:35:10.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.392+0000 7f1a8f52f640 1 Processor -- start 2024-09-11T22:35:10.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.392+0000 7f1a8f52f640 1 -- start start 2024-09-11T22:35:10.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.393+0000 7f1a8f52f640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1a800d45f0 0x7f1a800da540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.393+0000 7f1a8f52f640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1a80005a00 0x7f1a80034250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.393+0000 7f1a8f52f640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a800d49d0 con 0x7f1a80034790 2024-09-11T22:35:10.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.393+0000 7f1a8f52f640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f1a80032c10 con 0x7f1a800d45f0 2024-09-11T22:35:10.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.393+0000 7f1a8f52f640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f1a80005fd0 con 0x7f1a80005a00 2024-09-11T22:35:10.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.393+0000 7f1a8e52d640 1 -- >> v2:172.21.15.100:3300/0 conn(0x7f1a800d45f0 msgr2=0x7f1a800da540 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:35:10.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.393+0000 7f1a8e52d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1a800d45f0 0x7f1a800da540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:35:10.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.393+0000 7f1a8ed2e640 1 -- >> v1:172.21.15.100:6789/0 conn(0x7f1a80034790 legacy=0x7f1a8004ae70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.100:6789/0 2024-09-11T22:35:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.396+0000 7f1a8dd2c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1a80005a00 0x7f1a80034250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.396+0000 7f1a8dd2c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1a80005a00 0x7f1a80034250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:42930/0 (socket says 172.21.15.100:42930) 2024-09-11T22:35:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.396+0000 7f1a8dd2c640 1 -- 172.21.15.100:0/674051388 learned_addr learned my addr 172.21.15.100:0/674051388 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:10.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.396+0000 7f1a8dd2c640 1 -- 172.21.15.100:0/674051388 >> v2:172.21.15.100:3300/0 conn(0x7f1a800d45f0 msgr2=0x7f1a800da540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:35:10.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.396+0000 7f1a8dd2c640 1 --2- 172.21.15.100:0/674051388 >> v2:172.21.15.100:3300/0 conn(0x7f1a800d45f0 0x7f1a800da540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.397+0000 7f1a8dd2c640 1 -- 172.21.15.100:0/674051388 >> v1:172.21.15.100:6789/0 conn(0x7f1a80034790 legacy=0x7f1a8004ae70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:35:10.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.397+0000 7f1a8dd2c640 1 -- 172.21.15.100:0/674051388 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a800062b0 con 0x7f1a80005a00 2024-09-11T22:35:10.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.399+0000 7f1a8dd2c640 1 --2- 172.21.15.100:0/674051388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a80005a00 0x7f1a80034250 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1a80009500 tx=0x7f1a7802a2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dbfb2dd71f2d5d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:10.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.399+0000 7f1a8d52b640 1 -- 172.21.15.100:0/674051388 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a78037070 con 0x7f1a80005a00 2024-09-11T22:35:10.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.399+0000 7f1a8d52b640 1 -- 172.21.15.100:0/674051388 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a78032440 con 0x7f1a80005a00 2024-09-11T22:35:10.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.399+0000 7f1a8d52b640 1 -- 172.21.15.100:0/674051388 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a78032810 con 0x7f1a80005a00 2024-09-11T22:35:10.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.400+0000 7f1a8f52f640 1 -- 172.21.15.100:0/674051388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a80005a00 msgr2=0x7f1a80034250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:10.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.400+0000 7f1a8f52f640 1 --2- 172.21.15.100:0/674051388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a80005a00 0x7f1a80034250 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1a80009500 tx=0x7f1a7802a2e0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.401+0000 7f1a8f52f640 1 -- 172.21.15.100:0/674051388 shutdown_connections 2024-09-11T22:35:10.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.401+0000 7f1a8f52f640 1 --2- 172.21.15.100:0/674051388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a80005a00 0x7f1a80034250 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1a80009500 tx=0x7f1a7802a2e0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.401+0000 7f1a8f52f640 1 --2- 172.21.15.100:0/674051388 >> v2:172.21.15.100:3300/0 conn(0x7f1a800d45f0 0x7f1a800da540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.401+0000 7f1a8f52f640 1 -- 172.21.15.100:0/674051388 >> 172.21.15.100:0/674051388 conn(0x7f1a8004fc50 msgr2=0x7f1a80050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:10.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.405+0000 7f1a8f52f640 1 -- 172.21.15.100:0/674051388 shutdown_connections 2024-09-11T22:35:10.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.407+0000 7f1a8f52f640 1 -- 172.21.15.100:0/674051388 wait complete. 2024-09-11T22:35:10.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.409+0000 7f1a8f52f640 1 Processor -- start 2024-09-11T22:35:10.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.412+0000 7f1a8f52f640 1 -- start start 2024-09-11T22:35:10.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.413+0000 7f1a8f52f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a80034790 0x7f1a800d9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.413+0000 7f1a8e52d640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a80034790 msgr2=0x7f1a800d9b80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:35:10.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.413+0000 7f1a8e52d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a80034790 0x7f1a800d9b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:35:10.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.413+0000 7f1a8f52f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a800d45f0 0x7f1a800cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.413+0000 7f1a8f52f640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a800cd5b0 0x7f1a800ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.413+0000 7f1a8f52f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1a80006b50 con 0x7f1a80034790 2024-09-11T22:35:10.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.413+0000 7f1a8f52f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1a80006870 con 0x7f1a800d45f0 2024-09-11T22:35:10.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.413+0000 7f1a8f52f640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f1a80006e30 con 0x7f1a800cd5b0 2024-09-11T22:35:10.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.413+0000 7f1a8ed2e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a800cd5b0 0x7f1a800ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.413+0000 7f1a8ed2e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a800cd5b0 0x7f1a800ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:57562/0 (socket says 172.21.15.100:57562) 2024-09-11T22:35:10.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.413+0000 7f1a8ed2e640 1 -- 172.21.15.100:0/1395211832 learned_addr learned my addr 172.21.15.100:0/1395211832 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:10.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.414+0000 7f1a8dd2c640 1 --2- 172.21.15.100:0/1395211832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a800d45f0 0x7f1a800cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.414+0000 7f1a8ed2e640 1 -- 172.21.15.100:0/1395211832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a800d45f0 msgr2=0x7f1a800cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:10.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.414+0000 7f1a8ed2e640 1 --2- 172.21.15.100:0/1395211832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a800d45f0 0x7f1a800cd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.414+0000 7f1a8ed2e640 1 -- 172.21.15.100:0/1395211832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a80034790 msgr2=0x7f1a800d9b80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:35:10.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.414+0000 7f1a8ed2e640 1 --2- 172.21.15.100:0/1395211832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a80034790 0x7f1a800d9b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.414+0000 7f1a8ed2e640 1 -- 172.21.15.100:0/1395211832 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a8004a230 con 0x7f1a800cd5b0 2024-09-11T22:35:10.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.415+0000 7f1a8ed2e640 1 --2- 172.21.15.100:0/1395211832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a800cd5b0 0x7f1a800ca490 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400b430 tx=0x7f1a8400b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:10.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.415+0000 7f1a7effd640 1 -- 172.21.15.100:0/1395211832 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a84016070 con 0x7f1a800cd5b0 2024-09-11T22:35:10.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.415+0000 7f1a8f52f640 1 -- 172.21.15.100:0/1395211832 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a80179960 con 0x7f1a800cd5b0 2024-09-11T22:35:10.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.415+0000 7f1a8f52f640 1 -- 172.21.15.100:0/1395211832 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a80049a30 con 0x7f1a800cd5b0 2024-09-11T22:35:10.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.416+0000 7f1a7effd640 1 -- 172.21.15.100:0/1395211832 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a84003d10 con 0x7f1a800cd5b0 2024-09-11T22:35:10.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.416+0000 7f1a7effd640 1 -- 172.21.15.100:0/1395211832 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a840052b0 con 0x7f1a800cd5b0 2024-09-11T22:35:10.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.417+0000 7f1a7effd640 1 -- 172.21.15.100:0/1395211832 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a84019070 con 0x7f1a800cd5b0 2024-09-11T22:35:10.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.420+0000 7f1a8f52f640 1 --2- 172.21.15.100:0/1395211832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a70002a70 0x7f1a70004f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.420+0000 7f1a8f52f640 1 -- 172.21.15.100:0/1395211832 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1a70007ec0 con 0x7f1a70002a70 2024-09-11T22:35:10.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.420+0000 7f1a7effd640 1 --2- 172.21.15.100:0/1395211832 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1a6c06bd90 0x7f1a6c06e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.420+0000 7f1a7effd640 1 -- 172.21.15.100:0/1395211832 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f1a8408a520 con 0x7f1a800cd5b0 2024-09-11T22:35:10.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.421+0000 7f1a8dd2c640 1 --2- 172.21.15.100:0/1395211832 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1a6c06bd90 0x7f1a6c06e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.422+0000 7f1a8dd2c640 1 --2- 172.21.15.100:0/1395211832 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1a6c06bd90 0x7f1a6c06e250 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1a78034000 tx=0x7f1a7802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:10.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.423+0000 7f1a8e52d640 1 --2- 172.21.15.100:0/1395211832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a70002a70 0x7f1a70004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.428+0000 7f1a8e52d640 1 -- 172.21.15.100:0/1395211832 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a700080c0 con 0x7f1a70002a70 2024-09-11T22:35:10.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.428+0000 7f1a8e52d640 1 --2- 172.21.15.100:0/1395211832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a70002a70 0x7f1a70004f30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1a88051790 tx=0x7f1a88069180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:10.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.429+0000 7f1a7effd640 1 -- 172.21.15.100:0/1395211832 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a88091070 con 0x7f1a70002a70 2024-09-11T22:35:10.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.429+0000 7f1a7effd640 1 -- 172.21.15.100:0/1395211832 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f1a88074260 con 0x7f1a70002a70 2024-09-11T22:35:10.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.429+0000 7f1a7effd640 1 -- 172.21.15.100:0/1395211832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a70002a70 msgr2=0x7f1a70004f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:10.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.429+0000 7f1a7effd640 1 --2- 172.21.15.100:0/1395211832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a70002a70 0x7f1a70004f30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1a88051790 tx=0x7f1a88069180 comp rx=0 tx=0).stop 2024-09-11T22:35:10.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.429+0000 7f1a7effd640 1 -- 172.21.15.100:0/1395211832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a70002a70 msgr2=0x7f1a70004f30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:35:10.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.429+0000 7f1a7effd640 1 --2- 172.21.15.100:0/1395211832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a70002a70 0x7f1a70004f30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.444+0000 7f1a8f52f640 1 --2- 172.21.15.100:0/1395211832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a70006f50 0x7f1a700073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.444+0000 7f1a8f52f640 1 -- 172.21.15.100:0/1395211832 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7000a4a0 con 0x7f1a70006f50 2024-09-11T22:35:10.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.444+0000 7f1a8e52d640 1 --2- 172.21.15.100:0/1395211832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a70006f50 0x7f1a700073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.445+0000 7f1a8e52d640 1 -- 172.21.15.100:0/1395211832 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1a70007900 con 0x7f1a70006f50 2024-09-11T22:35:10.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.445+0000 7f1a8e52d640 1 --2- 172.21.15.100:0/1395211832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a70006f50 0x7f1a700073c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1a880637b0 tx=0x7f1a88069df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:10.448 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:35:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:35:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:35:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:35:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 106, 2024-09-11T22:35:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 101978, 2024-09-11T22:35:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:35:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:35:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:35:10.448 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:35:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:35:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:35:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:35:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:35:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:35:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:35:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:35:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:35:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:35:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:35:10.449 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:35:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:35:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:35:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:35:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:35:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:35:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:35:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:35:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:35:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:35:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:35:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:35:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:35:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:35:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:35:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:35:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:35:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:35:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:35:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:35:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:35:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:35:10.451 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:35:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:35:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:35:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:35:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:35:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:35:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:35:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:35:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:35:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:35:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:35:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:35:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:35:10.452 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:35:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:35:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:35:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:35:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:35:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:35:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:35:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:35:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:35:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:35:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:35:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.453 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:35:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:35:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:35:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:35:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:35:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:35:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:35:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.454 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:35:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:35:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:35:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:35:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:35:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:35:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:35:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:35:10.455 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:35:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:35:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:35:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:35:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:35:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:35:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:35:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:10.456 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:35:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:35:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:35:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:35:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:35:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:35:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:35:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:35:10.457 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:35:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:35:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:35:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:35:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:35:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.458 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:35:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:35:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:35:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:35:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:35:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:35:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:35:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:35:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:35:10.459 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:35:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:35:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:35:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:35:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4 2024-09-11T22:35:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:35:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:35:10.460 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:35:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:35:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:35:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:35:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:35:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:35:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:35:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.461 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:35:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:35:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:35:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.462 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:35:10.462 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:35:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.446+0000 7f1a7effd640 1 -- 172.21.15.100:0/1395211832 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a88091040 con 0x7f1a70006f50 2024-09-11T22:35:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.446+0000 7f1a7effd640 1 -- 172.21.15.100:0/1395211832 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5046 (secure 0 0 0) 0x7f1a88096d00 con 0x7f1a70006f50 2024-09-11T22:35:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.446+0000 7f1a7effd640 1 -- 172.21.15.100:0/1395211832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a70006f50 msgr2=0x7f1a700073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.446+0000 7f1a7effd640 1 --2- 172.21.15.100:0/1395211832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a70006f50 0x7f1a700073c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1a880637b0 tx=0x7f1a88069df0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.446+0000 7f1a7effd640 1 -- 172.21.15.100:0/1395211832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a70006f50 msgr2=0x7f1a700073c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:35:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.446+0000 7f1a7effd640 1 --2- 172.21.15.100:0/1395211832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a70006f50 0x7f1a700073c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.447+0000 7f1a7cff9640 1 -- 172.21.15.100:0/1395211832 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1a6c06bd90 msgr2=0x7f1a6c06e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.447+0000 7f1a7cff9640 1 --2- 172.21.15.100:0/1395211832 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f1a6c06bd90 0x7f1a6c06e250 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1a78034000 tx=0x7f1a7802e000 comp rx=0 tx=0).stop 2024-09-11T22:35:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.447+0000 7f1a7cff9640 1 -- 172.21.15.100:0/1395211832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a800cd5b0 msgr2=0x7f1a800ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.447+0000 7f1a7cff9640 1 --2- 172.21.15.100:0/1395211832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a800cd5b0 0x7f1a800ca490 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1a8400b430 tx=0x7f1a8400b8f0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.447+0000 7f1a8ed2e640 1 -- 172.21.15.100:0/1395211832 reap_dead start 2024-09-11T22:35:10.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.447+0000 7f1a8ed2e640 1 -- 172.21.15.100:0/1395211832 reap_dead start 2024-09-11T22:35:10.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.450+0000 7f1a7cff9640 1 -- 172.21.15.100:0/1395211832 shutdown_connections 2024-09-11T22:35:10.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.450+0000 7f1a7cff9640 1 -- 172.21.15.100:0/1395211832 >> 172.21.15.100:0/1395211832 conn(0x7f1a8004fc50 msgr2=0x7f1a800d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:10.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.451+0000 7f1a7cff9640 1 -- 172.21.15.100:0/1395211832 shutdown_connections 2024-09-11T22:35:10.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.451+0000 7f1a7cff9640 1 -- 172.21.15.100:0/1395211832 wait complete. 2024-09-11T22:35:10.472 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:35:10.472 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-11T22:35:10.472 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:35:10.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.652+0000 7fcc47a5a640 1 Processor -- start 2024-09-11T22:35:10.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.653+0000 7fcc47a5a640 1 -- start start 2024-09-11T22:35:10.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.654+0000 7fcc47a5a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc380d4620 0x7fcc380da570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.654+0000 7fcc47a5a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcc38005a30 0x7fcc38034280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.654+0000 7fcc47a5a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcc380347c0 0x7fcc3804aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.654+0000 7fcc47a5a640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fcc38032c40 con 0x7fcc380347c0 2024-09-11T22:35:10.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.654+0000 7fcc47a5a640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fcc380d4a00 con 0x7fcc38005a30 2024-09-11T22:35:10.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.654+0000 7fcc47a5a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcc38006000 con 0x7fcc380d4620 2024-09-11T22:35:10.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.655+0000 7fcc44ff5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcc38005a30 0x7fcc38034280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.655+0000 7fcc44ff5640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcc38005a30 0x7fcc38034280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:42970/0 (socket says 172.21.15.100:42970) 2024-09-11T22:35:10.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.655+0000 7fcc44ff5640 1 -- 172.21.15.100:0/2301200038 learned_addr learned my addr 172.21.15.100:0/2301200038 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:10.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.655+0000 7fcc45ff7640 1 -- 172.21.15.100:0/2301200038 >> v2:172.21.15.100:3300/0 conn(0x7fcc380347c0 msgr2=0x7fcc3804aea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:35:10.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.655+0000 7fcc45ff7640 1 --2- 172.21.15.100:0/2301200038 >> v2:172.21.15.100:3300/0 conn(0x7fcc380347c0 0x7fcc3804aea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:35:10.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.655+0000 7fcc457f6640 1 --2- 172.21.15.100:0/2301200038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc380d4620 0x7fcc380da570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.655+0000 7fcc44ff5640 1 -- 172.21.15.100:0/2301200038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc380d4620 msgr2=0x7fcc380da570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:10.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.655+0000 7fcc44ff5640 1 --2- 172.21.15.100:0/2301200038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc380d4620 0x7fcc380da570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.655+0000 7fcc44ff5640 1 -- 172.21.15.100:0/2301200038 >> v2:172.21.15.100:3300/0 conn(0x7fcc380347c0 msgr2=0x7fcc3804aea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:35:10.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.655+0000 7fcc44ff5640 1 --2- 172.21.15.100:0/2301200038 >> v2:172.21.15.100:3300/0 conn(0x7fcc380347c0 0x7fcc3804aea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.655+0000 7fcc44ff5640 1 -- 172.21.15.100:0/2301200038 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc380062e0 con 0x7fcc38005a30 2024-09-11T22:35:10.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.657+0000 7fcc44ff5640 1 --2- 172.21.15.100:0/2301200038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc38005a30 0x7fcc38034280 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcc40074630 tx=0x7fcc400aaf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3efc3288c2c37a82 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:10.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.657+0000 7fcc37fff640 1 -- 172.21.15.100:0/2301200038 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc400b8070 con 0x7fcc38005a30 2024-09-11T22:35:10.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.657+0000 7fcc37fff640 1 -- 172.21.15.100:0/2301200038 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc400abd60 con 0x7fcc38005a30 2024-09-11T22:35:10.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.657+0000 7fcc37fff640 1 -- 172.21.15.100:0/2301200038 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc400b3660 con 0x7fcc38005a30 2024-09-11T22:35:10.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.658+0000 7fcc47a5a640 1 -- 172.21.15.100:0/2301200038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc38005a30 msgr2=0x7fcc38034280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:10.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.658+0000 7fcc47a5a640 1 --2- 172.21.15.100:0/2301200038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc38005a30 0x7fcc38034280 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcc40074630 tx=0x7fcc400aaf50 comp rx=0 tx=0).stop 2024-09-11T22:35:10.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.661+0000 7fcc47a5a640 1 -- 172.21.15.100:0/2301200038 shutdown_connections 2024-09-11T22:35:10.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.661+0000 7fcc47a5a640 1 --2- 172.21.15.100:0/2301200038 >> v2:172.21.15.100:3300/0 conn(0x7fcc380347c0 0x7fcc3804aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.661+0000 7fcc47a5a640 1 --2- 172.21.15.100:0/2301200038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc38005a30 0x7fcc38034280 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.661+0000 7fcc47a5a640 1 --2- 172.21.15.100:0/2301200038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc380d4620 0x7fcc380da570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.661+0000 7fcc47a5a640 1 -- 172.21.15.100:0/2301200038 >> 172.21.15.100:0/2301200038 conn(0x7fcc3804fc80 msgr2=0x7fcc38050090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:10.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.662+0000 7fcc47a5a640 1 -- 172.21.15.100:0/2301200038 shutdown_connections 2024-09-11T22:35:10.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.662+0000 7fcc47a5a640 1 -- 172.21.15.100:0/2301200038 wait complete. 2024-09-11T22:35:10.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.784+0000 7fcc47a5a640 1 Processor -- start 2024-09-11T22:35:10.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.784+0000 7fcc47a5a640 1 -- start start 2024-09-11T22:35:10.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.785+0000 7fcc47a5a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc38005a30 0x7fcc380d97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.785+0000 7fcc47a5a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc380347c0 0x7fcc380d6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.785+0000 7fcc47a5a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc380d4620 0x7fcc3817b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.785+0000 7fcc47a5a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcc38006b80 con 0x7fcc38005a30 2024-09-11T22:35:10.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.786+0000 7fcc47a5a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcc380068a0 con 0x7fcc380347c0 2024-09-11T22:35:10.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.786+0000 7fcc47a5a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcc38006e60 con 0x7fcc380d4620 2024-09-11T22:35:10.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.786+0000 7fcc457f6640 1 -- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc38005a30 msgr2=0x7fcc380d97d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:3300/0 2024-09-11T22:35:10.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.786+0000 7fcc457f6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc38005a30 0x7fcc380d97d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:35:10.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.786+0000 7fcc44ff5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc380347c0 0x7fcc380d6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.786+0000 7fcc44ff5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc380347c0 0x7fcc380d6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:42972/0 (socket says 172.21.15.100:42972) 2024-09-11T22:35:10.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.786+0000 7fcc44ff5640 1 -- 172.21.15.100:0/3515435164 learned_addr learned my addr 172.21.15.100:0/3515435164 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:10.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.786+0000 7fcc45ff7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc380d4620 0x7fcc3817b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.786+0000 7fcc44ff5640 1 -- 172.21.15.100:0/3515435164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc380d4620 msgr2=0x7fcc3817b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:10.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.786+0000 7fcc44ff5640 1 --2- 172.21.15.100:0/3515435164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc380d4620 0x7fcc3817b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.786+0000 7fcc44ff5640 1 -- 172.21.15.100:0/3515435164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc38005a30 msgr2=0x7fcc380d97d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:35:10.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.786+0000 7fcc44ff5640 1 --2- 172.21.15.100:0/3515435164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc38005a30 0x7fcc380d97d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.786+0000 7fcc44ff5640 1 -- 172.21.15.100:0/3515435164 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc381846f0 con 0x7fcc380347c0 2024-09-11T22:35:10.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.786+0000 7fcc44ff5640 1 --2- 172.21.15.100:0/3515435164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc380347c0 0x7fcc380d6130 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcc40065710 tx=0x7fcc40069df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:10.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.787+0000 7fcc35ffb640 1 -- 172.21.15.100:0/3515435164 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc400b8030 con 0x7fcc380347c0 2024-09-11T22:35:10.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.787+0000 7fcc35ffb640 1 -- 172.21.15.100:0/3515435164 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc400ba070 con 0x7fcc380347c0 2024-09-11T22:35:10.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.787+0000 7fcc47a5a640 1 -- 172.21.15.100:0/3515435164 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc381849b0 con 0x7fcc380347c0 2024-09-11T22:35:10.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.788+0000 7fcc35ffb640 1 -- 172.21.15.100:0/3515435164 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc400911d0 con 0x7fcc380347c0 2024-09-11T22:35:10.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.790+0000 7fcc35ffb640 1 -- 172.21.15.100:0/3515435164 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc400c5060 con 0x7fcc380347c0 2024-09-11T22:35:10.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.790+0000 7fcc35ffb640 1 --2- 172.21.15.100:0/3515435164 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcc2406bfd0 0x7fcc2406e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.790+0000 7fcc47a5a640 1 -- 172.21.15.100:0/3515435164 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc38181570 con 0x7fcc380347c0 2024-09-11T22:35:10.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.791+0000 7fcc457f6640 1 --2- 172.21.15.100:0/3515435164 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcc2406bfd0 0x7fcc2406e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.792+0000 7fcc457f6640 1 --2- 172.21.15.100:0/3515435164 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcc2406bfd0 0x7fcc2406e490 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c007d10 tx=0x7fcc3c0079a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:10.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.792+0000 7fcc35ffb640 1 -- 172.21.15.100:0/3515435164 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fcc40129420 con 0x7fcc380347c0 2024-09-11T22:35:10.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.792+0000 7fcc2b7fe640 1 --2- 172.21.15.100:0/3515435164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc38181770 0x7fcc3817b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.792+0000 7fcc2b7fe640 1 -- 172.21.15.100:0/3515435164 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcc3804a600 con 0x7fcc38181770 2024-09-11T22:35:10.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.792+0000 7fcc45ff7640 1 --2- 172.21.15.100:0/3515435164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc38181770 0x7fcc3817b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.793+0000 7fcc45ff7640 1 -- 172.21.15.100:0/3515435164 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc3804c4a0 con 0x7fcc38181770 2024-09-11T22:35:10.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.793+0000 7fcc45ff7640 1 --2- 172.21.15.100:0/3515435164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc38181770 0x7fcc3817b540 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcc30006fd0 tx=0x7fcc30009990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:10.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.793+0000 7fcc35ffb640 1 -- 172.21.15.100:0/3515435164 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc30016020 con 0x7fcc38181770 2024-09-11T22:35:10.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.794+0000 7fcc35ffb640 1 -- 172.21.15.100:0/3515435164 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fcc30012600 con 0x7fcc38181770 2024-09-11T22:35:10.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.794+0000 7fcc35ffb640 1 -- 172.21.15.100:0/3515435164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc38181770 msgr2=0x7fcc3817b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:10.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.794+0000 7fcc35ffb640 1 --2- 172.21.15.100:0/3515435164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc38181770 0x7fcc3817b540 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcc30006fd0 tx=0x7fcc30009990 comp rx=0 tx=0).stop 2024-09-11T22:35:10.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.794+0000 7fcc35ffb640 1 -- 172.21.15.100:0/3515435164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc38181770 msgr2=0x7fcc3817b540 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:35:10.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.794+0000 7fcc35ffb640 1 --2- 172.21.15.100:0/3515435164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc38181770 0x7fcc3817b540 secure :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcc30006fd0 tx=0x7fcc30009990 comp rx=0 tx=0).stop 2024-09-11T22:35:10.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.805+0000 7fcc2b7fe640 1 --2- 172.21.15.100:0/3515435164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc380d6670 0x7fcc3804eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:10.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.805+0000 7fcc2b7fe640 1 -- 172.21.15.100:0/3515435164 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcc3804ba00 con 0x7fcc380d6670 2024-09-11T22:35:10.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.807+0000 7fcc45ff7640 1 --2- 172.21.15.100:0/3515435164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc380d6670 0x7fcc3804eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:10.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.808+0000 7fcc45ff7640 1 -- 172.21.15.100:0/3515435164 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcc380d0810 con 0x7fcc380d6670 2024-09-11T22:35:10.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.809+0000 7fcc45ff7640 1 --2- 172.21.15.100:0/3515435164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc380d6670 0x7fcc3804eab0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcc30006a10 tx=0x7fcc30003860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:10.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.809+0000 7fcc35ffb640 1 -- 172.21.15.100:0/3515435164 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc30016030 con 0x7fcc380d6670 2024-09-11T22:35:10.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.809+0000 7fcc35ffb640 1 -- 172.21.15.100:0/3515435164 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5044 (secure 0 0 0) 0x7fcc3001b420 con 0x7fcc380d6670 2024-09-11T22:35:10.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.809+0000 7fcc35ffb640 1 -- 172.21.15.100:0/3515435164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc380d6670 msgr2=0x7fcc3804eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:10.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.809+0000 7fcc35ffb640 1 --2- 172.21.15.100:0/3515435164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc380d6670 0x7fcc3804eab0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcc30006a10 tx=0x7fcc30003860 comp rx=0 tx=0).stop 2024-09-11T22:35:10.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.809+0000 7fcc35ffb640 1 -- 172.21.15.100:0/3515435164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc380d6670 msgr2=0x7fcc3804eab0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:35:10.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.809+0000 7fcc35ffb640 1 --2- 172.21.15.100:0/3515435164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc380d6670 0x7fcc3804eab0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.811 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:35:10.811 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:35:10.811 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:35:10.811 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:35:10.811 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 106, 2024-09-11T22:35:10.811 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 801531, 2024-09-11T22:35:10.811 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:35:10.811 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:35:10.811 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:35:10.811 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:10.812 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:35:10.812 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:35:10.812 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:35:10.812 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:35:10.812 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:35:10.812 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:35:10.812 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:35:10.812 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:35:10.812 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:35:10.812 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:35:10.812 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:35:10.812 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:35:10.812 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:35:10.813 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:35:10.813 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:35:10.813 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:10.813 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:35:10.813 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:35:10.813 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:35:10.813 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:35:10.813 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:35:10.813 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:35:10.813 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:35:10.813 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:35:10.813 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:35:10.813 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:35:10.813 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:35:10.814 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:35:10.814 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:35:10.814 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:10.814 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.814 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:35:10.814 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:35:10.814 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:35:10.814 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:35:10.814 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:35:10.814 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:35:10.815 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:35:10.815 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:35:10.815 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:35:10.815 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:35:10.815 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:35:10.815 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:35:10.815 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:35:10.815 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:35:10.815 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:35:10.815 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:35:10.815 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:35:10.815 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:35:10.815 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:35:10.816 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:35:10.816 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:35:10.816 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:35:10.816 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:35:10.816 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:35:10.816 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:35:10.816 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:35:10.816 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:35:10.816 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:35:10.816 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:10.816 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:35:10.816 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.816 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:35:10.817 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.817 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:35:10.817 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:35:10.817 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:35:10.817 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:35:10.817 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.817 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:35:10.817 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:35:10.817 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:10.817 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.817 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.817 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:35:10.818 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:35:10.818 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:10.818 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:10.818 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:10.818 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.818 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:35:10.818 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:35:10.818 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:35:10.818 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:35:10.818 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:35:10.818 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.818 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.818 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:35:10.818 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:35:10.819 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:35:10.819 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:35:10.819 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.819 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:35:10.819 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:35:10.819 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:10.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.819 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.819 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:35:10.819 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:35:10.819 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:10.819 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:10.819 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:10.820 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.820 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:35:10.820 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:35:10.820 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:35:10.820 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:35:10.820 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:35:10.820 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.820 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.820 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:35:10.820 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:35:10.820 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:35:10.820 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:35:10.820 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.821 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:35:10.821 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:35:10.821 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:10.821 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.821 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.821 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:35:10.821 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:35:10.821 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:10.821 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:10.821 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:10.822 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.822 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:35:10.822 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:35:10.822 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:35:10.822 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:35:10.822 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:35:10.822 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:10.822 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:10.822 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.822 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:35:10.822 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:35:10.822 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.823 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:35:10.823 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:35:10.823 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:35:10.823 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:10.823 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:10.823 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:35:10.823 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.823 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:35:10.823 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:35:10.823 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:35:10.823 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:10.823 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:10.823 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:35:10.823 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.824 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:35:10.824 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:35:10.824 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:35:10.824 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:10.824 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:10.824 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:35:10.824 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.824 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:35:10.824 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:35:10.824 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4 2024-09-11T22:35:10.824 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:10.824 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:10.824 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:35:10.825 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:10.825 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:35:10.825 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:35:10.825 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:35:10.825 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:10.825 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:10.825 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:10.825 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:35:10.825 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:35:10.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.811+0000 7fcc47a5a640 1 -- 172.21.15.100:0/3515435164 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcc2406bfd0 msgr2=0x7fcc2406e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:10.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.812+0000 7fcc47a5a640 1 --2- 172.21.15.100:0/3515435164 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcc2406bfd0 0x7fcc2406e490 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c007d10 tx=0x7fcc3c0079a0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.812+0000 7fcc45ff7640 1 -- 172.21.15.100:0/3515435164 reap_dead start 2024-09-11T22:35:10.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.812+0000 7fcc47a5a640 1 -- 172.21.15.100:0/3515435164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc380347c0 msgr2=0x7fcc380d6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:10.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.812+0000 7fcc47a5a640 1 --2- 172.21.15.100:0/3515435164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc380347c0 0x7fcc380d6130 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcc40065710 tx=0x7fcc40069df0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.812+0000 7fcc47a5a640 1 -- 172.21.15.100:0/3515435164 shutdown_connections 2024-09-11T22:35:10.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.812+0000 7fcc47a5a640 1 --2- 172.21.15.100:0/3515435164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc380347c0 0x7fcc380d6130 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:10.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.812+0000 7fcc47a5a640 1 -- 172.21.15.100:0/3515435164 >> 172.21.15.100:0/3515435164 conn(0x7fcc3804fc80 msgr2=0x7fcc380d2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:10.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.813+0000 7fcc47a5a640 1 -- 172.21.15.100:0/3515435164 shutdown_connections 2024-09-11T22:35:10.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:10.813+0000 7fcc47a5a640 1 -- 172.21.15.100:0/3515435164 wait complete. 2024-09-11T22:35:10.839 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-11T22:35:10.839 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-11T22:35:21.914 INFO:tasks.workunit.client.0.smithi100.stdout:Syncing()...12 sec 2024-09-11T22:35:21.915 INFO:tasks.workunit.client.0.smithi100.stdout:FFSB benchmark finished at: Wed Sep 11 22:35:21 2024 2024-09-11T22:35:21.915 INFO:tasks.workunit.client.0.smithi100.stdout: 2024-09-11T22:35:21.915 INFO:tasks.workunit.client.0.smithi100.stdout:Results: 2024-09-11T22:35:21.915 INFO:tasks.workunit.client.0.smithi100.stdout:Benchmark took 323.54 sec 2024-09-11T22:35:21.915 INFO:tasks.workunit.client.0.smithi100.stdout: 2024-09-11T22:35:21.915 INFO:tasks.workunit.client.0.smithi100.stdout:Total Results 2024-09-11T22:35:21.915 INFO:tasks.workunit.client.0.smithi100.stdout:=============== 2024-09-11T22:35:21.915 INFO:tasks.workunit.client.0.smithi100.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-09-11T22:35:21.915 INFO:tasks.workunit.client.0.smithi100.stdout: ======= ============ ========= ======= =========== ========== 2024-09-11T22:35:21.915 INFO:tasks.workunit.client.0.smithi100.stdout: write : 879360 2717.89 100.000% 100.000% 10.6MB/sec 2024-09-11T22:35:21.916 INFO:tasks.workunit.client.0.smithi100.stdout:- 2024-09-11T22:35:21.916 INFO:tasks.workunit.client.0.smithi100.stdout:2717.89 Transactions per Second 2024-09-11T22:35:21.916 INFO:tasks.workunit.client.0.smithi100.stdout: 2024-09-11T22:35:21.916 INFO:tasks.workunit.client.0.smithi100.stdout:Throughput Results 2024-09-11T22:35:21.916 INFO:tasks.workunit.client.0.smithi100.stdout:=================== 2024-09-11T22:35:21.916 INFO:tasks.workunit.client.0.smithi100.stdout:Write Throughput: 10.6MB/sec 2024-09-11T22:35:21.917 INFO:tasks.workunit.client.0.smithi100.stdout: 2024-09-11T22:35:21.917 INFO:tasks.workunit.client.0.smithi100.stdout:System Call Latency statistics in millisecs 2024-09-11T22:35:21.920 INFO:tasks.workunit.client.0.smithi100.stdout:===== 2024-09-11T22:35:21.920 INFO:tasks.workunit.client.0.smithi100.stdout: Min Avg Max Total Calls 2024-09-11T22:35:21.920 INFO:tasks.workunit.client.0.smithi100.stdout: ======== ======== ======== ============ 2024-09-11T22:35:21.920 INFO:tasks.workunit.client.0.smithi100.stdout:[ open] 0.584000 289.818655 8551.097656 687 2024-09-11T22:35:21.920 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[0] 5000.000000 - 10000.000000 : 13 2024-09-11T22:35:21.920 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[1] 2000.000000 - 5000.000000 : 26 2024-09-11T22:35:21.920 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[2] 1000.000000 - 2000.000000 : 10 2024-09-11T22:35:21.920 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[3] 500.000000 - 1000.000000 : 5 2024-09-11T22:35:21.921 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[4] 200.000000 - 500.000000 : 5 2024-09-11T22:35:21.921 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[5] 100.000000 - 200.000000 : 2 2024-09-11T22:35:21.921 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[6] 50.000000 - 100.000000 : 18 2024-09-11T22:35:21.921 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[7] 20.000000 - 50.000000 : 168 2024-09-11T22:35:21.921 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[8] 10.000000 - 20.000000 : 205 2024-09-11T22:35:21.921 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[9] 5.000000 - 10.000000 : 138 2024-09-11T22:35:21.921 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[10] 2.000000 - 5.000000 : 80 2024-09-11T22:35:21.921 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[11] 1.000000 - 2.000000 : 12 2024-09-11T22:35:21.921 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[12] 0.500000 - 1.000000 : 5 2024-09-11T22:35:21.921 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[13] 0.200000 - 0.500000 : 0 2024-09-11T22:35:21.921 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[14] 0.100000 - 0.200000 : 0 2024-09-11T22:35:21.921 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[15] 0.050000 - 0.100000 : 0 2024-09-11T22:35:21.921 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-09-11T22:35:21.922 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-09-11T22:35:21.924 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-11T22:35:21.924 INFO:tasks.workunit.client.0.smithi100.stdout: 2024-09-11T22:35:21.924 INFO:tasks.workunit.client.0.smithi100.stdout:[ write] 0.087000 10.915534 468.886993 879360 2024-09-11T22:35:21.924 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-11T22:35:21.924 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-11T22:35:21.925 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-11T22:35:21.925 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-11T22:35:21.925 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[4] 200.000000 - 500.000000 : 254 2024-09-11T22:35:21.925 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[5] 100.000000 - 200.000000 : 3867 2024-09-11T22:35:21.925 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[6] 50.000000 - 100.000000 : 25958 2024-09-11T22:35:21.925 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[7] 20.000000 - 50.000000 : 116703 2024-09-11T22:35:21.925 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[8] 10.000000 - 20.000000 : 149641 2024-09-11T22:35:21.925 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[9] 5.000000 - 10.000000 : 139762 2024-09-11T22:35:21.925 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[10] 2.000000 - 5.000000 : 121233 2024-09-11T22:35:21.925 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[11] 1.000000 - 2.000000 : 70441 2024-09-11T22:35:21.925 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[12] 0.500000 - 1.000000 : 89684 2024-09-11T22:35:21.925 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[13] 0.200000 - 0.500000 : 132103 2024-09-11T22:35:21.925 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[14] 0.100000 - 0.200000 : 29642 2024-09-11T22:35:21.926 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[15] 0.050000 - 0.100000 : 72 2024-09-11T22:35:21.926 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[16] 0.020000 - 0.050000 : 0 2024-09-11T22:35:21.926 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-09-11T22:35:21.926 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-11T22:35:21.926 INFO:tasks.workunit.client.0.smithi100.stdout: 2024-09-11T22:35:21.926 INFO:tasks.workunit.client.0.smithi100.stdout:[ lseek] 0.000000 0.000943 7.654000 879360 2024-09-11T22:35:21.926 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-11T22:35:21.926 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-11T22:35:21.926 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-11T22:35:21.926 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-11T22:35:21.926 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-11T22:35:21.926 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-11T22:35:21.926 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-11T22:35:21.926 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-09-11T22:35:21.927 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-09-11T22:35:21.927 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[9] 5.000000 - 10.000000 : 1 2024-09-11T22:35:21.927 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[10] 2.000000 - 5.000000 : 2 2024-09-11T22:35:21.927 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[11] 1.000000 - 2.000000 : 2 2024-09-11T22:35:21.927 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[12] 0.500000 - 1.000000 : 5 2024-09-11T22:35:21.927 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[13] 0.200000 - 0.500000 : 19 2024-09-11T22:35:21.927 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[14] 0.100000 - 0.200000 : 17 2024-09-11T22:35:21.927 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[15] 0.050000 - 0.100000 : 9 2024-09-11T22:35:21.927 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[16] 0.020000 - 0.050000 : 117 2024-09-11T22:35:21.927 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[17] 0.010000 - 0.020000 : 617 2024-09-11T22:35:21.927 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[18] 0.000000 - 0.010000 : 878571 2024-09-11T22:35:21.927 INFO:tasks.workunit.client.0.smithi100.stdout: 2024-09-11T22:35:21.927 INFO:tasks.workunit.client.0.smithi100.stdout:[ close] 0.025000 4.367879 90.625999 687 2024-09-11T22:35:21.927 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-11T22:35:21.928 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-11T22:35:21.928 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-11T22:35:21.928 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-11T22:35:21.928 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-11T22:35:21.928 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-11T22:35:21.928 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[6] 50.000000 - 100.000000 : 14 2024-09-11T22:35:21.928 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[7] 20.000000 - 50.000000 : 30 2024-09-11T22:35:21.928 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[8] 10.000000 - 20.000000 : 26 2024-09-11T22:35:21.928 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[9] 5.000000 - 10.000000 : 42 2024-09-11T22:35:21.928 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[10] 2.000000 - 5.000000 : 62 2024-09-11T22:35:21.928 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[11] 1.000000 - 2.000000 : 62 2024-09-11T22:35:21.928 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[12] 0.500000 - 1.000000 : 75 2024-09-11T22:35:21.928 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[13] 0.200000 - 0.500000 : 144 2024-09-11T22:35:21.929 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[14] 0.100000 - 0.200000 : 124 2024-09-11T22:35:21.929 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[15] 0.050000 - 0.100000 : 56 2024-09-11T22:35:21.929 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[16] 0.020000 - 0.050000 : 52 2024-09-11T22:35:21.929 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[17] 0.010000 - 0.020000 : 0 2024-09-11T22:35:21.929 INFO:tasks.workunit.client.0.smithi100.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-11T22:35:21.929 INFO:tasks.workunit.client.0.smithi100.stdout: 2024-09-11T22:35:21.929 INFO:tasks.workunit.client.0.smithi100.stdout: 2024-09-11T22:35:21.929 INFO:tasks.workunit.client.0.smithi100.stdout: 2024-09-11T22:35:21.929 INFO:tasks.workunit.client.0.smithi100.stdout: 2024-09-11T22:35:21.929 INFO:tasks.workunit.client.0.smithi100.stdout:0.5% User Time 2024-09-11T22:35:21.929 INFO:tasks.workunit.client.0.smithi100.stdout:38.2% System Time 2024-09-11T22:35:21.929 INFO:tasks.workunit.client.0.smithi100.stdout:38.6% CPU Utilization 2024-09-11T22:35:21.941 INFO:tasks.workunit.client.0.smithi100.stderr:+ cd .. 2024-09-11T22:35:21.953 INFO:tasks.workunit.client.0.smithi100.stderr:+ rm -r tmp ffsb 2024-09-11T22:35:24.820 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-11T22:35:24.820 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-11T22:35:24.862 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-09-11T22:35:24.862 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-11T22:35:25.432 DEBUG:teuthology.parallel:result is None 2024-09-11T22:35:25.432 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T22:35:25.470 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T22:35:25.470 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2024-09-11T22:35:25.480 INFO:tasks.mon_thrash:joining mon_thrasher 2024-09-11T22:35:30.840 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-11T22:35:30.840 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-11T22:35:30.840 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T22:35:30.840 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T22:35:30.845 INFO:tasks.ceph.mon.a:Started 2024-09-11T22:35:30.845 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:35:30.845 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:35:31.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.032+0000 7f15c36d0640 1 Processor -- start 2024-09-11T22:35:31.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.032+0000 7f15c36d0640 1 -- start start 2024-09-11T22:35:31.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.033+0000 7f15c36d0640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f15bc150a90 0x7f15bc071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:31.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.033+0000 7f15c36d0640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15bc1577b0 con 0x7f15bc15a9c0 2024-09-11T22:35:31.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.033+0000 7f15c36d0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15bc0703e0 con 0x7f15bc073f20 2024-09-11T22:35:31.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.033+0000 7f15c36d0640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f15bc157280 con 0x7f15bc150a90 2024-09-11T22:35:31.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.034+0000 7f15c1c6d640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f15bc15a9c0 0x7f15bc06fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50642/0 (socket says 172.21.15.100:50642) 2024-09-11T22:35:31.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.034+0000 7f15c1c6d640 1 -- 172.21.15.100:0/2884762237 learned_addr learned my addr 172.21.15.100:0/2884762237 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:35:31.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.036+0000 7f15c146c640 1 --2- 172.21.15.100:0/2884762237 >> v2:172.21.15.167:3300/0 conn(0x7f15bc150a90 0x7f15bc071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:31.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.040+0000 7f15b3fff640 1 -- 172.21.15.100:0/2884762237 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 476145770 0 0) 0x7f15bc0703e0 con 0x7f15bc073f20 2024-09-11T22:35:31.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.041+0000 7f15b3fff640 1 -- 172.21.15.100:0/2884762237 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15a8003520 con 0x7f15bc073f20 2024-09-11T22:35:31.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.041+0000 7f15b3fff640 1 -- 172.21.15.100:0/2884762237 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 529716006 0 0) 0x7f15a8003520 con 0x7f15bc073f20 2024-09-11T22:35:31.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.041+0000 7f15b3fff640 1 -- 172.21.15.100:0/2884762237 >> v2:172.21.15.167:3300/0 conn(0x7f15bc150a90 msgr2=0x7f15bc071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:31.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.041+0000 7f15b3fff640 1 --2- 172.21.15.100:0/2884762237 >> v2:172.21.15.167:3300/0 conn(0x7f15bc150a90 0x7f15bc071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:31.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.041+0000 7f15b3fff640 1 -- 172.21.15.100:0/2884762237 >> v1:172.21.15.100:6789/0 conn(0x7f15bc15a9c0 legacy=0x7f15bc06fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:31.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.041+0000 7f15b3fff640 1 -- 172.21.15.100:0/2884762237 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15bc1574d0 con 0x7f15bc073f20 2024-09-11T22:35:31.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.041+0000 7f15b3fff640 1 -- 172.21.15.100:0/2884762237 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f15ac001650 con 0x7f15bc073f20 2024-09-11T22:35:31.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.041+0000 7f15b3fff640 1 -- 172.21.15.100:0/2884762237 >> v1:172.21.15.167:6789/0 conn(0x7f15bc073f20 legacy=0x7f15bc06f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:31.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.041+0000 7f15b3fff640 1 --2- 172.21.15.100:0/2884762237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a80039f0 0x7f15a8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:31.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.041+0000 7f15b3fff640 1 --2- 172.21.15.100:0/2884762237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15a8004800 0x7f15a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:31.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.041+0000 7f15b3fff640 1 --2- 172.21.15.100:0/2884762237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15a80051c0 0x7f15a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:31.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.041+0000 7f15b3fff640 1 -- 172.21.15.100:0/2884762237 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f15bc157280 con 0x7f15a80039f0 2024-09-11T22:35:31.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.041+0000 7f15b3fff640 1 -- 172.21.15.100:0/2884762237 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f15a8010500 con 0x7f15a80051c0 2024-09-11T22:35:31.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.041+0000 7f15b3fff640 1 -- 172.21.15.100:0/2884762237 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f15a8010700 con 0x7f15a8004800 2024-09-11T22:35:31.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.041+0000 7f15c146c640 1 --2- 172.21.15.100:0/2884762237 >> v2:172.21.15.167:3300/0 conn(0x7f15bc150a90 0x7f15bc071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:35:31.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.042+0000 7f15c0c6b640 1 --2- 172.21.15.100:0/2884762237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15a8004800 0x7f15a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:31.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.042+0000 7f15c1c6d640 1 --2- 172.21.15.100:0/2884762237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15a80051c0 0x7f15a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:31.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.042+0000 7f15c146c640 1 --2- 172.21.15.100:0/2884762237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a80039f0 0x7f15a8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:31.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.042+0000 7f15c1c6d640 1 -- 172.21.15.100:0/2884762237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15a8004800 msgr2=0x7f15a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:31.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.042+0000 7f15c1c6d640 1 --2- 172.21.15.100:0/2884762237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15a8004800 0x7f15a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:31.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.042+0000 7f15c1c6d640 1 -- 172.21.15.100:0/2884762237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a80039f0 msgr2=0x7f15a8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:31.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.042+0000 7f15c1c6d640 1 --2- 172.21.15.100:0/2884762237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a80039f0 0x7f15a8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:31.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.042+0000 7f15c1c6d640 1 -- 172.21.15.100:0/2884762237 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15bc1574d0 con 0x7f15a80051c0 2024-09-11T22:35:31.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.043+0000 7f15c1c6d640 1 -- 172.21.15.100:0/2884762237 reap_dead start 2024-09-11T22:35:31.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.043+0000 7f15c0c6b640 1 --2- 172.21.15.100:0/2884762237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15a8004800 0x7f15a8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:35:31.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.044+0000 7f15c1c6d640 1 --2- 172.21.15.100:0/2884762237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15a80051c0 0x7f15a800b9c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f15b8001810 tx=0x7f15a8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae9f08045b155f1c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:31.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.044+0000 7f15b3fff640 1 -- 172.21.15.100:0/2884762237 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b8001460 con 0x7f15a80051c0 2024-09-11T22:35:31.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.044+0000 7f15b3fff640 1 -- 172.21.15.100:0/2884762237 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15b802e070 con 0x7f15a80051c0 2024-09-11T22:35:31.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.045+0000 7f15c36d0640 1 -- 172.21.15.100:0/2884762237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15a80051c0 msgr2=0x7f15a800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:31.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.045+0000 7f15c36d0640 1 --2- 172.21.15.100:0/2884762237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15a80051c0 0x7f15a800b9c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f15b8001810 tx=0x7f15a8005830 comp rx=0 tx=0).stop 2024-09-11T22:35:31.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.047+0000 7f15c36d0640 1 -- 172.21.15.100:0/2884762237 shutdown_connections 2024-09-11T22:35:31.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.047+0000 7f15c36d0640 1 --2- 172.21.15.100:0/2884762237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15a80051c0 0x7f15a800b9c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:31.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.047+0000 7f15c36d0640 1 -- 172.21.15.100:0/2884762237 >> 172.21.15.100:0/2884762237 conn(0x7f15bc067f80 msgr2=0x7f15bc0cc410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:31.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.047+0000 7f15c36d0640 1 -- 172.21.15.100:0/2884762237 shutdown_connections 2024-09-11T22:35:31.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.054+0000 7f15c36d0640 1 -- 172.21.15.100:0/2884762237 wait complete. 2024-09-11T22:35:31.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.056+0000 7f15c36d0640 1 Processor -- start 2024-09-11T22:35:31.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.059+0000 7f15c36d0640 1 -- start start 2024-09-11T22:35:31.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.060+0000 7f15c36d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a80051c0 0x7f15bc157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:31.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.060+0000 7f15c36d0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15bc1e7450 0x7f15bc1f88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:31.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.060+0000 7f15c36d0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15bc1e7890 0x7f15bc14d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:31.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.060+0000 7f15c36d0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f15bc15a4a0 con 0x7f15a80051c0 2024-09-11T22:35:31.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.060+0000 7f15c36d0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f15bc15a1c0 con 0x7f15bc1e7450 2024-09-11T22:35:31.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.060+0000 7f15c36d0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f15bc150e70 con 0x7f15bc1e7890 2024-09-11T22:35:31.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.060+0000 7f15c146c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a80051c0 0x7f15bc157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:31.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.060+0000 7f15c146c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a80051c0 0x7f15bc157f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49960/0 (socket says 172.21.15.100:49960) 2024-09-11T22:35:31.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.060+0000 7f15c146c640 1 -- 172.21.15.100:0/451766079 learned_addr learned my addr 172.21.15.100:0/451766079 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:31.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.061+0000 7f15c146c640 1 -- 172.21.15.100:0/451766079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a80051c0 msgr2=0x7f15bc157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-11T22:35:31.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.061+0000 7f15c146c640 1 -- 172.21.15.100:0/451766079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a80051c0 msgr2=0x7f15bc157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-11T22:35:31.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.061+0000 7f15c146c640 1 --2- 172.21.15.100:0/451766079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a80051c0 0x7f15bc157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:35:31.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.061+0000 7f15c146c640 1 --2- 172.21.15.100:0/451766079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a80051c0 0x7f15bc157f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:35:31.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.062+0000 7f15c1c6d640 1 --2- 172.21.15.100:0/451766079 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15bc1e7890 0x7f15bc14d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:31.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.062+0000 7f15c0c6b640 1 --2- 172.21.15.100:0/451766079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15bc1e7450 0x7f15bc1f88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:31.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.065+0000 7f15c1c6d640 1 -- 172.21.15.100:0/451766079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15bc1e7450 msgr2=0x7f15bc1f88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:31.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.065+0000 7f15c1c6d640 1 --2- 172.21.15.100:0/451766079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15bc1e7450 0x7f15bc1f88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:31.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.065+0000 7f15c1c6d640 1 -- 172.21.15.100:0/451766079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a80051c0 msgr2=0x7f15bc157f20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:35:31.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.065+0000 7f15c1c6d640 1 --2- 172.21.15.100:0/451766079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a80051c0 0x7f15bc157f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:31.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.065+0000 7f15c1c6d640 1 -- 172.21.15.100:0/451766079 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15bc1e8fd0 con 0x7f15bc1e7890 2024-09-11T22:35:31.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.067+0000 7f15c1c6d640 1 --2- 172.21.15.100:0/451766079 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15bc1e7890 0x7f15bc14d0a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f15bc06d9b0 tx=0x7f15b8001120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:31.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.069+0000 7f15b1ffb640 1 -- 172.21.15.100:0/451766079 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b8001440 con 0x7f15bc1e7890 2024-09-11T22:35:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.069+0000 7f15c36d0640 1 -- 172.21.15.100:0/451766079 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15bc154500 con 0x7f15bc1e7890 2024-09-11T22:35:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.070+0000 7f15c36d0640 1 -- 172.21.15.100:0/451766079 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f15bc154ac0 con 0x7f15bc1e7890 2024-09-11T22:35:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.070+0000 7f15b1ffb640 1 -- 172.21.15.100:0/451766079 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15b8007280 con 0x7f15bc1e7890 2024-09-11T22:35:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.070+0000 7f15b1ffb640 1 -- 172.21.15.100:0/451766079 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b8007650 con 0x7f15bc1e7890 2024-09-11T22:35:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.072+0000 7f15b1ffb640 1 -- 172.21.15.100:0/451766079 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f15b803b030 con 0x7f15bc1e7890 2024-09-11T22:35:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.073+0000 7f15b1ffb640 1 --2- 172.21.15.100:0/451766079 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f15a006bf00 0x7f15a006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.073+0000 7f15c36d0640 1 -- 172.21.15.100:0/451766079 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f159c005290 con 0x7f15bc1e7890 2024-09-11T22:35:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.073+0000 7f15c146c640 1 --2- 172.21.15.100:0/451766079 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f15a006bf00 0x7f15a006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.074+0000 7f15c146c640 1 --2- 172.21.15.100:0/451766079 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f15a006bf00 0x7f15a006e3c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f15b4009be0 tx=0x7f15b400f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:31.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.074+0000 7f15b1ffb640 1 -- 172.21.15.100:0/451766079 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f15b80aa000 con 0x7f15bc1e7890 2024-09-11T22:35:31.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.080+0000 7f15b1ffb640 1 -- 172.21.15.100:0/451766079 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f15b8042030 con 0x7f15bc1e7890 2024-09-11T22:35:31.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.547+0000 7f15c36d0640 1 -- 172.21.15.100:0/451766079 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f159c005580 con 0x7f15bc1e7890 2024-09-11T22:35:31.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.554+0000 7f15b1ffb640 1 -- 172.21.15.100:0/451766079 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1564 (secure 0 0 0) 0x7f15b803b320 con 0x7f15bc1e7890 2024-09-11T22:35:31.560 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":106,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":21,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:35:31.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.561+0000 7f15c36d0640 1 -- 172.21.15.100:0/451766079 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f15a006bf00 msgr2=0x7f15a006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:31.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.561+0000 7f15c36d0640 1 --2- 172.21.15.100:0/451766079 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f15a006bf00 0x7f15a006e3c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f15b4009be0 tx=0x7f15b400f040 comp rx=0 tx=0).stop 2024-09-11T22:35:31.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.561+0000 7f15c36d0640 1 -- 172.21.15.100:0/451766079 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15bc1e7890 msgr2=0x7f15bc14d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:31.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.561+0000 7f15c36d0640 1 --2- 172.21.15.100:0/451766079 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15bc1e7890 0x7f15bc14d0a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f15bc06d9b0 tx=0x7f15b8001120 comp rx=0 tx=0).stop 2024-09-11T22:35:31.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.562+0000 7f15c36d0640 1 -- 172.21.15.100:0/451766079 shutdown_connections 2024-09-11T22:35:31.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.562+0000 7f15c36d0640 1 --2- 172.21.15.100:0/451766079 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f15a006bf00 0x7f15a006e3c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:31.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.562+0000 7f15c36d0640 1 --2- 172.21.15.100:0/451766079 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15bc1e7890 0x7f15bc14d0a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:31.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.562+0000 7f15c36d0640 1 --2- 172.21.15.100:0/451766079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15bc1e7450 0x7f15bc1f88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:31.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.562+0000 7f15c36d0640 1 --2- 172.21.15.100:0/451766079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15a80051c0 0x7f15bc157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:31.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.562+0000 7f15c36d0640 1 -- 172.21.15.100:0/451766079 >> 172.21.15.100:0/451766079 conn(0x7f15bc067f80 msgr2=0x7f15bc06f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:31.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.565+0000 7f15c36d0640 1 -- 172.21.15.100:0/451766079 shutdown_connections 2024-09-11T22:35:31.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:31.565+0000 7f15c36d0640 1 -- 172.21.15.100:0/451766079 wait complete. 2024-09-11T22:35:34.584 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:35:34.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.744+0000 7f9af77fd640 1 Processor -- start 2024-09-11T22:35:34.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.745+0000 7f9af77fd640 1 -- start start 2024-09-11T22:35:34.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.746+0000 7f9af77fd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 0x7f9af00c6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:34.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.746+0000 7f9af77fd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 0x7f9af00729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:34.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.746+0000 7f9af77fd640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9af00c6b40 con 0x7f9af00cac00 2024-09-11T22:35:34.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.746+0000 7f9af77fd640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f9af0162360 con 0x7f9af00cafe0 2024-09-11T22:35:34.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.746+0000 7f9af77fd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9af00c6e20 con 0x7f9af015f7c0 2024-09-11T22:35:34.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.747+0000 7f9af5599640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 0x7f9af00c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:34.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.747+0000 7f9af5d9a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 0x7f9af00729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:34.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.747+0000 7f9af5599640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 0x7f9af00c6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:33056/0 (socket says 172.21.15.100:33056) 2024-09-11T22:35:34.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.747+0000 7f9af5d9a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 0x7f9af00729d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46042/0 (socket says 172.21.15.100:46042) 2024-09-11T22:35:34.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.747+0000 7f9af5599640 1 -- 172.21.15.100:0/343121802 learned_addr learned my addr 172.21.15.100:0/343121802 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:34.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.747+0000 7f9af5d9a640 1 -- 172.21.15.100:0/343121802 >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 msgr2=0x7f9af00729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:35:34.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.747+0000 7f9af5d9a640 1 -- 172.21.15.100:0/343121802 >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 msgr2=0x7f9af00729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:35:34.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.747+0000 7f9af5d9a640 1 --2- 172.21.15.100:0/343121802 >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 0x7f9af00729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:35:34.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.747+0000 7f9af5d9a640 1 --2- 172.21.15.100:0/343121802 >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 0x7f9af00729d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:35:34.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.747+0000 7f9af5599640 1 -- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 msgr2=0x7f9af00c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-11T22:35:34.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.747+0000 7f9af5599640 1 -- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 msgr2=0x7f9af00c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:35:34.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.747+0000 7f9af5599640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 0x7f9af00c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:35:34.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.747+0000 7f9af5599640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 0x7f9af00c6520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T22:35:34.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.948+0000 7f9af5599640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 0x7f9af00c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:34.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.948+0000 7f9af5d9a640 1 --2- 172.21.15.100:0/343121802 >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 0x7f9af00729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:34.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.948+0000 7f9af5599640 1 -- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 msgr2=0x7f9af00c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:35:34.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.948+0000 7f9af5599640 1 -- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 msgr2=0x7f9af00c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:35:34.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.948+0000 7f9af5599640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 0x7f9af00c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:35:34.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.948+0000 7f9af5599640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 0x7f9af00c6520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:35:34.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.948+0000 7f9af5d9a640 1 -- 172.21.15.100:0/343121802 >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 msgr2=0x7f9af00729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:35:34.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.948+0000 7f9af5d9a640 1 -- 172.21.15.100:0/343121802 >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 msgr2=0x7f9af00729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:35:34.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.948+0000 7f9af5d9a640 1 --2- 172.21.15.100:0/343121802 >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 0x7f9af00729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:35:34.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:34.948+0000 7f9af5d9a640 1 --2- 172.21.15.100:0/343121802 >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 0x7f9af00729d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-11T22:35:35.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:35.349+0000 7f9af5599640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 0x7f9af00c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:35.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:35.349+0000 7f9af5d9a640 1 --2- 172.21.15.100:0/343121802 >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 0x7f9af00729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:35.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:35.349+0000 7f9af5599640 1 -- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 msgr2=0x7f9af00c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:35:35.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:35.349+0000 7f9af5599640 1 -- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 msgr2=0x7f9af00c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:35:35.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:35.349+0000 7f9af5599640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 0x7f9af00c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:35:35.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:35.349+0000 7f9af5599640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 0x7f9af00c6520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:35:35.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:35.349+0000 7f9af5d9a640 1 -- 172.21.15.100:0/343121802 >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 msgr2=0x7f9af00729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-11T22:35:35.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:35.349+0000 7f9af5d9a640 1 -- 172.21.15.100:0/343121802 >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 msgr2=0x7f9af00729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:35:35.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:35.349+0000 7f9af5d9a640 1 --2- 172.21.15.100:0/343121802 >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 0x7f9af00729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:35:35.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:35.350+0000 7f9af5d9a640 1 --2- 172.21.15.100:0/343121802 >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 0x7f9af00729d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-11T22:35:36.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:36.150+0000 7f9af5599640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 0x7f9af00c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:36.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:36.150+0000 7f9af5599640 1 -- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 msgr2=0x7f9af00c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:35:36.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:36.150+0000 7f9af5599640 1 -- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 msgr2=0x7f9af00c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:35:36.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:36.150+0000 7f9af5599640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 0x7f9af00c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:35:36.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:36.150+0000 7f9af5599640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 0x7f9af00c6520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:35:36.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:36.151+0000 7f9af5d9a640 1 --2- 172.21.15.100:0/343121802 >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 0x7f9af00729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:36.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:36.151+0000 7f9af5d9a640 1 -- 172.21.15.100:0/343121802 >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 msgr2=0x7f9af00729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T22:35:36.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:36.151+0000 7f9af5d9a640 1 -- 172.21.15.100:0/343121802 >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 msgr2=0x7f9af00729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T22:35:36.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:36.151+0000 7f9af5d9a640 1 --2- 172.21.15.100:0/343121802 >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 0x7f9af00729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T22:35:36.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:36.151+0000 7f9af5d9a640 1 --2- 172.21.15.100:0/343121802 >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 0x7f9af00729d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-11T22:35:37.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.252+0000 7f9ae7fff640 1 -- 172.21.15.100:0/343121802 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3667269498 0 0) 0x7f9af00c6b40 con 0x7f9af00cac00 2024-09-11T22:35:37.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.252+0000 7f9ae7fff640 1 -- 172.21.15.100:0/343121802 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9adc003520 con 0x7f9af00cac00 2024-09-11T22:35:37.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.260+0000 7f9ae7fff640 1 -- 172.21.15.100:0/343121802 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2830842028 0 0) 0x7f9adc003520 con 0x7f9af00cac00 2024-09-11T22:35:37.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.260+0000 7f9ae7fff640 1 -- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 msgr2=0x7f9af00c6520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:35:37.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.260+0000 7f9ae7fff640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 0x7f9af00c6520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:37.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.260+0000 7f9ae7fff640 1 -- 172.21.15.100:0/343121802 >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 msgr2=0x7f9af00729d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:35:37.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.260+0000 7f9ae7fff640 1 --2- 172.21.15.100:0/343121802 >> v2:172.21.15.100:3300/0 conn(0x7f9af00cafe0 0x7f9af00729d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:37.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.260+0000 7f9ae7fff640 1 -- 172.21.15.100:0/343121802 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af01625b0 con 0x7f9af00cac00 2024-09-11T22:35:37.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.260+0000 7f9ae7fff640 1 -- 172.21.15.100:0/343121802 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f9aec001650 con 0x7f9af00cac00 2024-09-11T22:35:37.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.260+0000 7f9ae7fff640 1 -- 172.21.15.100:0/343121802 >> v1:172.21.15.100:6789/0 conn(0x7f9af00cac00 legacy=0x7f9af00c5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:37.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.260+0000 7f9ae7fff640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9adc0039d0 0x7f9adc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:37.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.260+0000 7f9ae7fff640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 0x7f9adc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:37.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.260+0000 7f9ae7fff640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9adc004d40 0x7f9adc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:37.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.260+0000 7f9ae7fff640 1 -- 172.21.15.100:0/343121802 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9af0162360 con 0x7f9adc0039d0 2024-09-11T22:35:37.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.261+0000 7f9ae7fff640 1 -- 172.21.15.100:0/343121802 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9af00c6e20 con 0x7f9adc004d40 2024-09-11T22:35:37.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.261+0000 7f9ae7fff640 1 -- 172.21.15.100:0/343121802 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9adc00baf0 con 0x7f9af015f7c0 2024-09-11T22:35:37.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.261+0000 7f9af5d9a640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9adc004d40 0x7f9adc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:37.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.261+0000 7f9af5599640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9adc0039d0 0x7f9adc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:37.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.261+0000 7f9af4d98640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 0x7f9adc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:37.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.261+0000 7f9af5d9a640 1 -- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 msgr2=0x7f9adc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:37.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.261+0000 7f9af5d9a640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 0x7f9adc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:37.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.261+0000 7f9af5d9a640 1 -- 172.21.15.100:0/343121802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9adc0039d0 msgr2=0x7f9adc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:37.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.261+0000 7f9af5d9a640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9adc0039d0 0x7f9adc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:37.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.261+0000 7f9af5d9a640 1 -- 172.21.15.100:0/343121802 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af01625b0 con 0x7f9adc004d40 2024-09-11T22:35:37.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.262+0000 7f9af5599640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9adc0039d0 0x7f9adc003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:35:37.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.262+0000 7f9af5d9a640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9adc004d40 0x7f9adc0051c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9af00b54f0 tx=0x7f9adc005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=720bee0f92467c35 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:37.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.262+0000 7f9af4d98640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015f7c0 0x7f9adc004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:35:37.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.263+0000 7f9ae7fff640 1 -- 172.21.15.100:0/343121802 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8031070 con 0x7f9adc004d40 2024-09-11T22:35:37.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.263+0000 7f9ae7fff640 1 -- 172.21.15.100:0/343121802 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ae802bab0 con 0x7f9adc004d40 2024-09-11T22:35:37.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.263+0000 7f9ae7fff640 1 -- 172.21.15.100:0/343121802 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8031070 con 0x7f9adc004d40 2024-09-11T22:35:37.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.264+0000 7f9af77fd640 1 -- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9adc004d40 msgr2=0x7f9adc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:37.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.264+0000 7f9af77fd640 1 --2- 172.21.15.100:0/343121802 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9adc004d40 0x7f9adc0051c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9af00b54f0 tx=0x7f9adc005830 comp rx=0 tx=0).stop 2024-09-11T22:35:37.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.264+0000 7f9af5d9a640 1 -- 172.21.15.100:0/343121802 reap_dead start 2024-09-11T22:35:37.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.264+0000 7f9af77fd640 1 -- 172.21.15.100:0/343121802 shutdown_connections 2024-09-11T22:35:37.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.264+0000 7f9af77fd640 1 -- 172.21.15.100:0/343121802 >> 172.21.15.100:0/343121802 conn(0x7f9af0067d40 msgr2=0x7f9af006d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:37.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.264+0000 7f9af77fd640 1 -- 172.21.15.100:0/343121802 shutdown_connections 2024-09-11T22:35:37.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.264+0000 7f9af77fd640 1 -- 172.21.15.100:0/343121802 wait complete. 2024-09-11T22:35:37.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.266+0000 7f9af77fd640 1 Processor -- start 2024-09-11T22:35:37.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.266+0000 7f9af77fd640 1 -- start start 2024-09-11T22:35:37.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.267+0000 7f9af77fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9adc004d40 0x7f9af0159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:37.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.267+0000 7f9af77fd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015a880 0x7f9af015acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:37.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.267+0000 7f9af77fd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9af0071f80 0x7f9af00723e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:37.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.267+0000 7f9af77fd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9af0163090 con 0x7f9af0071f80 2024-09-11T22:35:37.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.267+0000 7f9af77fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9af0162b70 con 0x7f9adc004d40 2024-09-11T22:35:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.267+0000 7f9af77fd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9af0158030 con 0x7f9af015a880 2024-09-11T22:35:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.268+0000 7f9af5d9a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9af0071f80 0x7f9af00723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.268+0000 7f9af5d9a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9af0071f80 0x7f9af00723e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46078/0 (socket says 172.21.15.100:46078) 2024-09-11T22:35:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.268+0000 7f9af5d9a640 1 -- 172.21.15.100:0/4239828046 learned_addr learned my addr 172.21.15.100:0/4239828046 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.268+0000 7f9af5599640 1 --2- 172.21.15.100:0/4239828046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9adc004d40 0x7f9af0159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.268+0000 7f9af4d98640 1 --2- 172.21.15.100:0/4239828046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015a880 0x7f9af015acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.269+0000 7f9af5d9a640 1 -- 172.21.15.100:0/4239828046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015a880 msgr2=0x7f9af015acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.269+0000 7f9af5d9a640 1 --2- 172.21.15.100:0/4239828046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015a880 0x7f9af015acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.269+0000 7f9af5d9a640 1 -- 172.21.15.100:0/4239828046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9adc004d40 msgr2=0x7f9af0159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.269+0000 7f9af5d9a640 1 --2- 172.21.15.100:0/4239828046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9adc004d40 0x7f9af0159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.269+0000 7f9af5d9a640 1 -- 172.21.15.100:0/4239828046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af0163870 con 0x7f9af0071f80 2024-09-11T22:35:37.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.269+0000 7f9af5d9a640 1 --2- 172.21.15.100:0/4239828046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9af0071f80 0x7f9af00723e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8004450 tx=0x7f9ae8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.270+0000 7f9ae5ffb640 1 -- 172.21.15.100:0/4239828046 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8031070 con 0x7f9af0071f80 2024-09-11T22:35:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.270+0000 7f9af77fd640 1 -- 172.21.15.100:0/4239828046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af015ca90 con 0x7f9af0071f80 2024-09-11T22:35:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.270+0000 7f9af77fd640 1 -- 172.21.15.100:0/4239828046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af015d050 con 0x7f9af0071f80 2024-09-11T22:35:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.272+0000 7f9ae5ffb640 1 -- 172.21.15.100:0/4239828046 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ae8047070 con 0x7f9af0071f80 2024-09-11T22:35:37.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.272+0000 7f9ae5ffb640 1 -- 172.21.15.100:0/4239828046 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8004040 con 0x7f9af0071f80 2024-09-11T22:35:37.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.273+0000 7f9ae5ffb640 1 -- 172.21.15.100:0/4239828046 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ae8040640 con 0x7f9af0071f80 2024-09-11T22:35:37.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.273+0000 7f9ae5ffb640 1 --2- 172.21.15.100:0/4239828046 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9ad406bf30 0x7f9ad406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:37.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.273+0000 7f9ae5ffb640 1 -- 172.21.15.100:0/4239828046 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f9ae80ac550 con 0x7f9af0071f80 2024-09-11T22:35:37.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.275+0000 7f9af77fd640 1 -- 172.21.15.100:0/4239828046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ad0005290 con 0x7f9af0071f80 2024-09-11T22:35:37.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.280+0000 7f9af5599640 1 --2- 172.21.15.100:0/4239828046 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9ad406bf30 0x7f9ad406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:37.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.280+0000 7f9af5599640 1 --2- 172.21.15.100:0/4239828046 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9ad406bf30 0x7f9ad406e3f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0009100 tx=0x7f9ae0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:37.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.283+0000 7f9ae5ffb640 1 -- 172.21.15.100:0/4239828046 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ae807aac0 con 0x7f9af0071f80 2024-09-11T22:35:37.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.740+0000 7f9af77fd640 1 -- 172.21.15.100:0/4239828046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9ad0005580 con 0x7f9af0071f80 2024-09-11T22:35:37.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.741+0000 7f9ae5ffb640 1 -- 172.21.15.100:0/4239828046 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1569 (secure 0 0 0) 0x7f9ae807a3c0 con 0x7f9af0071f80 2024-09-11T22:35:37.744 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":110,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:35:37.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.749+0000 7f9adb7fe640 1 -- 172.21.15.100:0/4239828046 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9ad406bf30 msgr2=0x7f9ad406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:37.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.749+0000 7f9adb7fe640 1 --2- 172.21.15.100:0/4239828046 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9ad406bf30 0x7f9ad406e3f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0009100 tx=0x7f9ae0008040 comp rx=0 tx=0).stop 2024-09-11T22:35:37.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.749+0000 7f9adb7fe640 1 -- 172.21.15.100:0/4239828046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9af0071f80 msgr2=0x7f9af00723e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:37.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.749+0000 7f9adb7fe640 1 --2- 172.21.15.100:0/4239828046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9af0071f80 0x7f9af00723e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8004450 tx=0x7f9ae8004a40 comp rx=0 tx=0).stop 2024-09-11T22:35:37.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.749+0000 7f9adb7fe640 1 -- 172.21.15.100:0/4239828046 shutdown_connections 2024-09-11T22:35:37.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.749+0000 7f9adb7fe640 1 --2- 172.21.15.100:0/4239828046 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9ad406bf30 0x7f9ad406e3f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:37.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.749+0000 7f9adb7fe640 1 --2- 172.21.15.100:0/4239828046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9af0071f80 0x7f9af00723e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:37.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.749+0000 7f9adb7fe640 1 --2- 172.21.15.100:0/4239828046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9af015a880 0x7f9af015acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:37.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.749+0000 7f9adb7fe640 1 --2- 172.21.15.100:0/4239828046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9adc004d40 0x7f9af0159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:37.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.749+0000 7f9adb7fe640 1 -- 172.21.15.100:0/4239828046 >> 172.21.15.100:0/4239828046 conn(0x7f9af0067d40 msgr2=0x7f9af00c9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:37.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.750+0000 7f9adb7fe640 1 -- 172.21.15.100:0/4239828046 shutdown_connections 2024-09-11T22:35:37.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.754+0000 7f9adb7fe640 1 -- 172.21.15.100:0/4239828046 wait complete. 2024-09-11T22:35:37.772 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:35:37.772 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-11T22:35:37.772 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-11T22:35:37.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.950+0000 7f12e0805640 1 Processor -- start 2024-09-11T22:35:37.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.951+0000 7f12e0805640 1 -- start start 2024-09-11T22:35:37.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.952+0000 7f12e0805640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f12dc06f830 0x7f12dc15a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:37.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.952+0000 7f12e0805640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12dc15aec0 con 0x7f12dc1576d0 2024-09-11T22:35:37.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.952+0000 7f12e0805640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12dc073210 con 0x7f12dc06e2d0 2024-09-11T22:35:37.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.952+0000 7f12e0805640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f12dc0734f0 con 0x7f12dc06f830 2024-09-11T22:35:37.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.953+0000 7f12db59e640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f12dc1576d0 0x7f12dc06cfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:53132/0 (socket says 172.21.15.100:53132) 2024-09-11T22:35:37.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.953+0000 7f12db59e640 1 -- 172.21.15.100:0/3459139174 learned_addr learned my addr 172.21.15.100:0/3459139174 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:35:37.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.953+0000 7f12da59c640 1 --2- 172.21.15.100:0/3459139174 >> v2:172.21.15.100:3300/0 conn(0x7f12dc06f830 0x7f12dc15a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:37.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.956+0000 7f12da59c640 1 -- 172.21.15.100:0/3459139174 >> v1:172.21.15.167:6789/0 conn(0x7f12dc06e2d0 legacy=0x7f12dc0c0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:37.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.956+0000 7f12da59c640 1 -- 172.21.15.100:0/3459139174 >> v1:172.21.15.100:6789/0 conn(0x7f12dc1576d0 legacy=0x7f12dc06cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:37.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.956+0000 7f12da59c640 1 -- 172.21.15.100:0/3459139174 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12dc156bf0 con 0x7f12dc06f830 2024-09-11T22:35:37.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.957+0000 7f12da59c640 1 --2- 172.21.15.100:0/3459139174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc06f830 0x7f12dc15a980 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f12d4009d90 tx=0x7f12d402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ccbf32d506c317 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:37.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.962+0000 7f12d9d9b640 1 -- 172.21.15.100:0/3459139174 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d4007540 con 0x7f12dc06f830 2024-09-11T22:35:37.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.962+0000 7f12d9d9b640 1 -- 172.21.15.100:0/3459139174 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12d40076e0 con 0x7f12dc06f830 2024-09-11T22:35:37.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.962+0000 7f12d9d9b640 1 -- 172.21.15.100:0/3459139174 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d4007ab0 con 0x7f12dc06f830 2024-09-11T22:35:37.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.963+0000 7f12e0805640 1 -- 172.21.15.100:0/3459139174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc06f830 msgr2=0x7f12dc15a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:37.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.963+0000 7f12e0805640 1 --2- 172.21.15.100:0/3459139174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc06f830 0x7f12dc15a980 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f12d4009d90 tx=0x7f12d402a6a0 comp rx=0 tx=0).stop 2024-09-11T22:35:37.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.966+0000 7f12e0805640 1 -- 172.21.15.100:0/3459139174 shutdown_connections 2024-09-11T22:35:37.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.966+0000 7f12e0805640 1 --2- 172.21.15.100:0/3459139174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc06f830 0x7f12dc15a980 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:37.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.966+0000 7f12e0805640 1 -- 172.21.15.100:0/3459139174 >> 172.21.15.100:0/3459139174 conn(0x7f12dc06ed10 msgr2=0x7f12dc06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:37.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.975+0000 7f12e0805640 1 -- 172.21.15.100:0/3459139174 shutdown_connections 2024-09-11T22:35:37.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.975+0000 7f12e0805640 1 -- 172.21.15.100:0/3459139174 wait complete. 2024-09-11T22:35:37.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.978+0000 7f12e0805640 1 Processor -- start 2024-09-11T22:35:37.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.979+0000 7f12e0805640 1 -- start start 2024-09-11T22:35:37.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.980+0000 7f12e0805640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12dc06e2d0 0x7f12dc0c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:37.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.980+0000 7f12e0805640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12dc06f830 0x7f12dc152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:37.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.980+0000 7f12e0805640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc1576d0 0x7f12dc0c2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:37.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.980+0000 7f12db59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc1576d0 0x7f12dc0c2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:37.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.980+0000 7f12da59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12dc06f830 0x7f12dc152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:37.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.980+0000 7f12da59c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12dc06f830 0x7f12dc152da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44018/0 (socket says 172.21.15.100:44018) 2024-09-11T22:35:37.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.980+0000 7f12db59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc1576d0 0x7f12dc0c2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46106/0 (socket says 172.21.15.100:46106) 2024-09-11T22:35:37.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.980+0000 7f12da59c640 1 -- 172.21.15.100:0/1494118895 learned_addr learned my addr 172.21.15.100:0/1494118895 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:37.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.980+0000 7f12dad9d640 1 --2- 172.21.15.100:0/1494118895 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12dc06e2d0 0x7f12dc0c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:37.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.981+0000 7f12e0805640 1 -- 172.21.15.100:0/1494118895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc072b40 con 0x7f12dc1576d0 2024-09-11T22:35:37.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.981+0000 7f12e0805640 1 -- 172.21.15.100:0/1494118895 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc071490 con 0x7f12dc06f830 2024-09-11T22:35:37.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.981+0000 7f12e0805640 1 -- 172.21.15.100:0/1494118895 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f12dc072cc0 con 0x7f12dc06e2d0 2024-09-11T22:35:37.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.981+0000 7f12db59e640 1 -- 172.21.15.100:0/1494118895 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12dc06e2d0 msgr2=0x7f12dc0c34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:37.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.981+0000 7f12db59e640 1 --2- 172.21.15.100:0/1494118895 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12dc06e2d0 0x7f12dc0c34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:37.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.981+0000 7f12db59e640 1 -- 172.21.15.100:0/1494118895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12dc06f830 msgr2=0x7f12dc152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:37.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.981+0000 7f12db59e640 1 --2- 172.21.15.100:0/1494118895 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12dc06f830 0x7f12dc152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:37.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.981+0000 7f12db59e640 1 -- 172.21.15.100:0/1494118895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12dc1fde10 con 0x7f12dc1576d0 2024-09-11T22:35:37.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.981+0000 7f12db59e640 1 --2- 172.21.15.100:0/1494118895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc1576d0 0x7f12dc0c2060 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00c750 tx=0x7f12cc00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:37.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.982+0000 7f12dad9d640 1 --2- 172.21.15.100:0/1494118895 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12dc06e2d0 0x7f12dc0c34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:35:37.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.982+0000 7f12c37fe640 1 -- 172.21.15.100:0/1494118895 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12cc018070 con 0x7f12dc1576d0 2024-09-11T22:35:37.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.983+0000 7f12c37fe640 1 -- 172.21.15.100:0/1494118895 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12cc0072d0 con 0x7f12dc1576d0 2024-09-11T22:35:37.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.984+0000 7f12c37fe640 1 -- 172.21.15.100:0/1494118895 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12cc0047e0 con 0x7f12dc1576d0 2024-09-11T22:35:37.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.984+0000 7f12e0805640 1 -- 172.21.15.100:0/1494118895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12dc0c4070 con 0x7f12dc1576d0 2024-09-11T22:35:37.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.987+0000 7f12e0805640 1 -- 172.21.15.100:0/1494118895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12dc1fd050 con 0x7f12dc1576d0 2024-09-11T22:35:37.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.987+0000 7f12c37fe640 1 -- 172.21.15.100:0/1494118895 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f12cc01b070 con 0x7f12dc1576d0 2024-09-11T22:35:37.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.988+0000 7f12c37fe640 1 --2- 172.21.15.100:0/1494118895 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f12c806be80 0x7f12c806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:37.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.988+0000 7f12c37fe640 1 -- 172.21.15.100:0/1494118895 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f12cc08a470 con 0x7f12dc1576d0 2024-09-11T22:35:37.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.989+0000 7f12e0805640 1 --2- 172.21.15.100:0/1494118895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc0c25a0 0x7f12dc1fd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:37.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.989+0000 7f12e0805640 1 -- 172.21.15.100:0/1494118895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc15a980 con 0x7f12dc0c25a0 2024-09-11T22:35:37.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.989+0000 7f12dad9d640 1 --2- 172.21.15.100:0/1494118895 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f12c806be80 0x7f12c806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:37.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.990+0000 7f12da59c640 1 --2- 172.21.15.100:0/1494118895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc0c25a0 0x7f12dc1fd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:37.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.990+0000 7f12dad9d640 1 --2- 172.21.15.100:0/1494118895 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f12c806be80 0x7f12c806e340 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f12d0000f60 tx=0x7f12d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:37.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.991+0000 7f12da59c640 1 -- 172.21.15.100:0/1494118895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f12dc153ff0 con 0x7f12dc0c25a0 2024-09-11T22:35:37.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.992+0000 7f12da59c640 1 --2- 172.21.15.100:0/1494118895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc0c25a0 0x7f12dc1fd250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f12dc1684a0 tx=0x7f12d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:37.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.992+0000 7f12c37fe640 1 -- 172.21.15.100:0/1494118895 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d4004680 con 0x7f12dc0c25a0 2024-09-11T22:35:37.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.993+0000 7f12c37fe640 1 -- 172.21.15.100:0/1494118895 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f12d4041070 con 0x7f12dc0c25a0 2024-09-11T22:35:37.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.993+0000 7f12c37fe640 1 -- 172.21.15.100:0/1494118895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc0c25a0 msgr2=0x7f12dc1fd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:37.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.993+0000 7f12c37fe640 1 --2- 172.21.15.100:0/1494118895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc0c25a0 0x7f12dc1fd250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f12dc1684a0 tx=0x7f12d4004a40 comp rx=0 tx=0).stop 2024-09-11T22:35:37.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.993+0000 7f12c37fe640 1 -- 172.21.15.100:0/1494118895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc0c25a0 msgr2=0x7f12dc1fd250 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:35:37.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:37.993+0000 7f12c37fe640 1 --2- 172.21.15.100:0/1494118895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc0c25a0 0x7f12dc1fd250 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f12dc1684a0 tx=0x7f12d4004a40 comp rx=0 tx=0).stop 2024-09-11T22:35:38.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.003+0000 7f12e0805640 1 --2- 172.21.15.100:0/1494118895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc0aae50 0x7f12dc1fd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.003+0000 7f12e0805640 1 -- 172.21.15.100:0/1494118895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc153d10 con 0x7f12dc0aae50 2024-09-11T22:35:38.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.003+0000 7f12da59c640 1 --2- 172.21.15.100:0/1494118895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc0aae50 0x7f12dc1fd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:38.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.003+0000 7f12da59c640 1 -- 172.21.15.100:0/1494118895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f12dc152020 con 0x7f12dc0aae50 2024-09-11T22:35:38.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.004+0000 7f12da59c640 1 --2- 172.21.15.100:0/1494118895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc0aae50 0x7f12dc1fd790 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f12d4000f80 tx=0x7f12d4030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:38.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.004+0000 7f12c37fe640 1 -- 172.21.15.100:0/1494118895 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d404b770 con 0x7f12dc0aae50 2024-09-11T22:35:38.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.004+0000 7f12c37fe640 1 -- 172.21.15.100:0/1494118895 <== mon.0 v2:172.21.15.100:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+4554 (secure 0 0 0) 0x7f12d404b770 con 0x7f12dc0aae50 2024-09-11T22:35:38.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.004+0000 7f12c37fe640 1 -- 172.21.15.100:0/1494118895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc0aae50 msgr2=0x7f12dc1fd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:38.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.004+0000 7f12c37fe640 1 --2- 172.21.15.100:0/1494118895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc0aae50 0x7f12dc1fd790 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f12d4000f80 tx=0x7f12d4030000 comp rx=0 tx=0).stop 2024-09-11T22:35:38.006 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:35:38.006 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:35:38.006 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:35:38.006 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "leader", 2024-09-11T22:35:38.006 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 110, 2024-09-11T22:35:38.006 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 7014, 2024-09-11T22:35:38.006 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:35:38.007 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:35:38.007 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:35:38.007 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:35:38.007 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:38.007 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 0, 2024-09-11T22:35:38.007 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:35:38.007 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:35:38.007 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:35:38.007 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:35:38.007 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:35:38.007 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:35:38.007 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:35:38.007 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:35:38.008 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:35:38.008 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:35:38.008 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:35:38.008 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:35:38.008 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:35:38.008 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:35:38.008 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:38.008 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:35:38.008 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:35:38.008 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:35:38.008 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:35:38.008 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:35:38.008 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:35:38.008 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:35:38.009 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:35:38.009 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:35:38.009 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:35:38.009 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:35:38.009 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:35:38.009 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:35:38.009 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:38.009 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.009 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:35:38.009 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:35:38.009 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:35:38.009 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:35:38.009 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:35:38.010 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:35:38.010 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:35:38.010 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:35:38.010 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:35:38.010 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:35:38.010 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:35:38.010 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:35:38.010 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:35:38.010 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:35:38.010 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:35:38.010 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:35:38.010 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:35:38.010 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:35:38.010 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:35:38.011 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:35:38.011 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:35:38.011 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:35:38.011 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:35:38.011 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:35:38.011 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:35:38.011 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:35:38.011 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:35:38.011 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:35:38.011 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:38.011 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:35:38.011 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.011 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:35:38.012 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.012 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:35:38.012 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:35:38.012 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:35:38.012 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:35:38.012 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.012 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:35:38.012 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:35:38.012 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:38.012 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.012 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.012 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:35:38.012 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:35:38.013 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:38.013 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.013 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:38.013 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.013 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:35:38.013 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:35:38.013 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:35:38.013 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:35:38.013 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:35:38.013 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.013 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.013 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:35:38.013 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:35:38.014 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:35:38.014 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:35:38.014 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.014 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:35:38.014 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:35:38.014 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:38.014 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.014 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.014 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:35:38.014 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:35:38.014 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:38.014 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.014 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:38.015 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.015 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:35:38.015 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:35:38.015 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:35:38.015 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:35:38.015 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:35:38.015 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.015 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.015 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:35:38.015 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:35:38.015 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:35:38.015 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:35:38.015 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.015 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:35:38.016 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:35:38.016 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:38.016 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.016 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.016 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:35:38.016 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:35:38.016 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:38.016 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.016 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:38.016 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.016 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:35:38.016 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:35:38.016 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:35:38.016 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:35:38.017 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:35:38.017 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.017 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:38.017 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.017 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:35:38.017 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:35:38.017 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.017 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:35:38.017 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:35:38.017 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:35:38.017 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.017 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:38.018 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:35:38.018 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.018 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:35:38.018 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:35:38.018 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:35:38.018 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.018 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:38.018 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.018 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:35:38.018 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:35:38.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.004+0000 7f12c37fe640 1 -- 172.21.15.100:0/1494118895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc0aae50 msgr2=0x7f12dc1fd790 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:35:38.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.004+0000 7f12c37fe640 1 --2- 172.21.15.100:0/1494118895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc0aae50 0x7f12dc1fd790 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.005+0000 7f12e0805640 1 -- 172.21.15.100:0/1494118895 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f12c806be80 msgr2=0x7f12c806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:38.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.005+0000 7f12e0805640 1 --2- 172.21.15.100:0/1494118895 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f12c806be80 0x7f12c806e340 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f12d0000f60 tx=0x7f12d0009040 comp rx=0 tx=0).stop 2024-09-11T22:35:38.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.005+0000 7f12e0805640 1 -- 172.21.15.100:0/1494118895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc1576d0 msgr2=0x7f12dc0c2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:38.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.005+0000 7f12e0805640 1 --2- 172.21.15.100:0/1494118895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12dc1576d0 0x7f12dc0c2060 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00c750 tx=0x7f12cc00cc10 comp rx=0 tx=0).stop 2024-09-11T22:35:38.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.005+0000 7f12db59e640 1 -- 172.21.15.100:0/1494118895 reap_dead start 2024-09-11T22:35:38.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.005+0000 7f12db59e640 1 -- 172.21.15.100:0/1494118895 reap_dead start 2024-09-11T22:35:38.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.005+0000 7f12e0805640 1 -- 172.21.15.100:0/1494118895 shutdown_connections 2024-09-11T22:35:38.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.005+0000 7f12e0805640 1 -- 172.21.15.100:0/1494118895 >> 172.21.15.100:0/1494118895 conn(0x7f12dc06ed10 msgr2=0x7f12dc151570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:38.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.005+0000 7f12e0805640 1 -- 172.21.15.100:0/1494118895 shutdown_connections 2024-09-11T22:35:38.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.005+0000 7f12e0805640 1 -- 172.21.15.100:0/1494118895 wait complete. 2024-09-11T22:35:38.021 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:35:38.021 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-11T22:35:38.021 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-11T22:35:38.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.244+0000 7f71a3fff640 1 Processor -- start 2024-09-11T22:35:38.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.246+0000 7f71a3fff640 1 -- start start 2024-09-11T22:35:38.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.247+0000 7f71a3fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f719c005a00 0x7f719c0da540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.247+0000 7f71a3fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f719c04ae70 0x7f719c04b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.247+0000 7f71a3fff640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f719c0d49d0 con 0x7f719c0d45f0 2024-09-11T22:35:38.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.247+0000 7f71a3fff640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f719c032c10 con 0x7f719c04ae70 2024-09-11T22:35:38.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.247+0000 7f71a3fff640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f719c005fd0 con 0x7f719c005a00 2024-09-11T22:35:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.247+0000 7f71a37fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f719c04ae70 0x7f719c04b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.247+0000 7f71a37fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f719c04ae70 0x7f719c04b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46138/0 (socket says 172.21.15.100:46138) 2024-09-11T22:35:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.247+0000 7f71a37fe640 1 -- 172.21.15.100:0/1449683426 learned_addr learned my addr 172.21.15.100:0/1449683426 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.248+0000 7f71a37fe640 1 -- 172.21.15.100:0/1449683426 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f719c005a00 msgr2=0x7f719c0da540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T22:35:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.248+0000 7f71a37fe640 1 --2- 172.21.15.100:0/1449683426 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f719c005a00 0x7f719c0da540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.248+0000 7f71a37fe640 1 -- 172.21.15.100:0/1449683426 >> v1:172.21.15.100:6789/0 conn(0x7f719c0d45f0 legacy=0x7f719c034250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:38.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.248+0000 7f71a37fe640 1 -- 172.21.15.100:0/1449683426 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719c0062b0 con 0x7f719c04ae70 2024-09-11T22:35:38.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.250+0000 7f71a37fe640 1 --2- 172.21.15.100:0/1449683426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f719c04ae70 0x7f719c04b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7194009870 tx=0x7f719402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7d701e4ca524ea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:38.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.250+0000 7f71a1ffb640 1 -- 172.21.15.100:0/1449683426 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7194037070 con 0x7f719c04ae70 2024-09-11T22:35:38.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.250+0000 7f71a1ffb640 1 -- 172.21.15.100:0/1449683426 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7194032440 con 0x7f719c04ae70 2024-09-11T22:35:38.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.251+0000 7f71a3fff640 1 -- 172.21.15.100:0/1449683426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f719c04ae70 msgr2=0x7f719c04b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:38.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.251+0000 7f71a3fff640 1 --2- 172.21.15.100:0/1449683426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f719c04ae70 0x7f719c04b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7194009870 tx=0x7f719402a2c0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.252+0000 7f71a3fff640 1 -- 172.21.15.100:0/1449683426 shutdown_connections 2024-09-11T22:35:38.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.252+0000 7f71a3fff640 1 --2- 172.21.15.100:0/1449683426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f719c04ae70 0x7f719c04b2c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.252+0000 7f71a3fff640 1 --2- 172.21.15.100:0/1449683426 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f719c005a00 0x7f719c0da540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.252+0000 7f71a3fff640 1 -- 172.21.15.100:0/1449683426 >> 172.21.15.100:0/1449683426 conn(0x7f719c04fc50 msgr2=0x7f719c050060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:38.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.254+0000 7f71a3fff640 1 -- 172.21.15.100:0/1449683426 shutdown_connections 2024-09-11T22:35:38.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.254+0000 7f71a3fff640 1 -- 172.21.15.100:0/1449683426 wait complete. 2024-09-11T22:35:38.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.256+0000 7f71a3fff640 1 Processor -- start 2024-09-11T22:35:38.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.256+0000 7f71a3fff640 1 -- start start 2024-09-11T22:35:38.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.257+0000 7f71a3fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c005a00 0x7f719c04ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.257+0000 7f71a3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f719c04ae70 0x7f719c04de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.257+0000 7f71a3fff640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f719c0d45f0 0x7f719c04e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.257+0000 7f71a3fff640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f719c006b50 con 0x7f719c04ae70 2024-09-11T22:35:38.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.257+0000 7f71a3fff640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f719c006870 con 0x7f719c005a00 2024-09-11T22:35:38.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.257+0000 7f71a3fff640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f719c006e30 con 0x7f719c0d45f0 2024-09-11T22:35:38.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.258+0000 7f71a37fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f719c0d45f0 0x7f719c04e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:38.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.258+0000 7f71a37fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f719c0d45f0 0x7f719c04e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:33136/0 (socket says 172.21.15.100:33136) 2024-09-11T22:35:38.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.258+0000 7f71a37fe640 1 -- 172.21.15.100:0/1395644636 learned_addr learned my addr 172.21.15.100:0/1395644636 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:38.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.258+0000 7f71a2ffd640 1 --2- 172.21.15.100:0/1395644636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c005a00 0x7f719c04ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:38.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.258+0000 7f71a37fe640 1 -- 172.21.15.100:0/1395644636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c005a00 msgr2=0x7f719c04ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:38.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.258+0000 7f71a37fe640 1 --2- 172.21.15.100:0/1395644636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c005a00 0x7f719c04ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.258+0000 7f71a37fe640 1 -- 172.21.15.100:0/1395644636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f719c04ae70 msgr2=0x7f719c04de10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T22:35:38.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.258+0000 7f71a37fe640 1 --2- 172.21.15.100:0/1395644636 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f719c04ae70 0x7f719c04de10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.258+0000 7f71a37fe640 1 -- 172.21.15.100:0/1395644636 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719c1788f0 con 0x7f719c0d45f0 2024-09-11T22:35:38.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.259+0000 7f71a37fe640 1 --2- 172.21.15.100:0/1395644636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f719c0d45f0 0x7f719c04e350 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7194009990 tx=0x7f71940046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:38.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.264+0000 7f718bfff640 1 -- 172.21.15.100:0/1395644636 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7194037040 con 0x7f719c0d45f0 2024-09-11T22:35:38.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.264+0000 7f718bfff640 1 -- 172.21.15.100:0/1395644636 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7194042070 con 0x7f719c0d45f0 2024-09-11T22:35:38.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.264+0000 7f718bfff640 1 -- 172.21.15.100:0/1395644636 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7194030df0 con 0x7f719c0d45f0 2024-09-11T22:35:38.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.264+0000 7f71a3fff640 1 -- 172.21.15.100:0/1395644636 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f719c178bb0 con 0x7f719c0d45f0 2024-09-11T22:35:38.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.264+0000 7f71a3fff640 1 -- 172.21.15.100:0/1395644636 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f719c179170 con 0x7f719c0d45f0 2024-09-11T22:35:38.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.269+0000 7f71a3fff640 1 --2- 172.21.15.100:0/1395644636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c0caa00 0x7f719c179370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.269+0000 7f71a3fff640 1 -- 172.21.15.100:0/1395644636 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f719c0cc0f0 con 0x7f719c0caa00 2024-09-11T22:35:38.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.270+0000 7f718bfff640 1 -- 172.21.15.100:0/1395644636 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7194032440 con 0x7f719c0d45f0 2024-09-11T22:35:38.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.270+0000 7f718bfff640 1 --2- 172.21.15.100:0/1395644636 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f719006bf00 0x7f719006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.270+0000 7f718bfff640 1 -- 172.21.15.100:0/1395644636 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f71940abe00 con 0x7f719c0d45f0 2024-09-11T22:35:38.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.273+0000 7f71a2ffd640 1 --2- 172.21.15.100:0/1395644636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c0caa00 0x7f719c179370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:38.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.276+0000 7f71a27fc640 1 --2- 172.21.15.100:0/1395644636 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f719006bf00 0x7f719006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:38.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.277+0000 7f71a27fc640 1 --2- 172.21.15.100:0/1395644636 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f719006bf00 0x7f719006e3c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f719c000d90 tx=0x7f7198006bd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:38.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.280+0000 7f71a2ffd640 1 -- 172.21.15.100:0/1395644636 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f719c04a5d0 con 0x7f719c0caa00 2024-09-11T22:35:38.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.280+0000 7f71a2ffd640 1 --2- 172.21.15.100:0/1395644636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c0caa00 0x7f719c179370 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f71a4051790 tx=0x7f71a4069180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:38.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.280+0000 7f718bfff640 1 -- 172.21.15.100:0/1395644636 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a406a120 con 0x7f719c0caa00 2024-09-11T22:35:38.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.281+0000 7f718bfff640 1 -- 172.21.15.100:0/1395644636 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7f71a406a120 con 0x7f719c0caa00 2024-09-11T22:35:38.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.281+0000 7f718bfff640 1 -- 172.21.15.100:0/1395644636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c0caa00 msgr2=0x7f719c179370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:38.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.281+0000 7f718bfff640 1 --2- 172.21.15.100:0/1395644636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c0caa00 0x7f719c179370 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f71a4051790 tx=0x7f71a4069180 comp rx=0 tx=0).stop 2024-09-11T22:35:38.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.281+0000 7f718bfff640 1 -- 172.21.15.100:0/1395644636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c0caa00 msgr2=0x7f719c179370 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:35:38.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.281+0000 7f718bfff640 1 --2- 172.21.15.100:0/1395644636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c0caa00 0x7f719c179370 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f71a4051790 tx=0x7f71a4069180 comp rx=0 tx=0).stop 2024-09-11T22:35:38.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.305+0000 7f71a3fff640 1 --2- 172.21.15.100:0/1395644636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c04f2b0 0x7f719c04c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.305+0000 7f71a3fff640 1 -- 172.21.15.100:0/1395644636 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f719c034590 con 0x7f719c04f2b0 2024-09-11T22:35:38.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.305+0000 7f71a2ffd640 1 --2- 172.21.15.100:0/1395644636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c04f2b0 0x7f719c04c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:38.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.309+0000 7f71a2ffd640 1 -- 172.21.15.100:0/1395644636 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f719c04b9d0 con 0x7f719c04f2b0 2024-09-11T22:35:38.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.311+0000 7f71a2ffd640 1 --2- 172.21.15.100:0/1395644636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c04f2b0 0x7f719c04c470 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f71a406b1f0 tx=0x7f71a406bb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:38.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.313+0000 7f718bfff640 1 -- 172.21.15.100:0/1395644636 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a4073cc0 con 0x7f719c04f2b0 2024-09-11T22:35:38.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.313+0000 7f718bfff640 1 -- 172.21.15.100:0/1395644636 <== mon.1 v2:172.21.15.167:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7f71a4073e80 con 0x7f719c04f2b0 2024-09-11T22:35:38.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.313+0000 7f718bfff640 1 -- 172.21.15.100:0/1395644636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c04f2b0 msgr2=0x7f719c04c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:38.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.313+0000 7f718bfff640 1 --2- 172.21.15.100:0/1395644636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c04f2b0 0x7f719c04c470 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f71a406b1f0 tx=0x7f71a406bb40 comp rx=0 tx=0).stop 2024-09-11T22:35:38.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.313+0000 7f718bfff640 1 -- 172.21.15.100:0/1395644636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c04f2b0 msgr2=0x7f719c04c470 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:35:38.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.313+0000 7f718bfff640 1 --2- 172.21.15.100:0/1395644636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f719c04f2b0 0x7f719c04c470 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f71a406b1f0 tx=0x7f71a406bb40 comp rx=0 tx=0).stop 2024-09-11T22:35:38.315 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:35:38.315 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:35:38.315 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:35:38.315 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:35:38.315 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 110, 2024-09-11T22:35:38.315 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 129843, 2024-09-11T22:35:38.315 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:35:38.315 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:35:38.315 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:35:38.316 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:35:38.316 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:38.316 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:35:38.316 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:35:38.316 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:35:38.316 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:35:38.316 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:35:38.316 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:35:38.316 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:35:38.316 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:35:38.316 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:35:38.316 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:35:38.316 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:35:38.317 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:35:38.317 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:35:38.317 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:35:38.317 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:35:38.317 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:38.317 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:35:38.317 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:35:38.317 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:35:38.317 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:35:38.317 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:35:38.317 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:35:38.317 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:35:38.317 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:35:38.318 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:35:38.318 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:35:38.318 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:35:38.318 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:35:38.318 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:35:38.318 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:38.318 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.318 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:35:38.318 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:35:38.318 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:35:38.318 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:35:38.318 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:35:38.318 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:35:38.319 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:35:38.319 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:35:38.319 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:35:38.319 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:35:38.319 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:35:38.319 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:35:38.319 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:35:38.319 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:35:38.319 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:35:38.319 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:35:38.319 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:35:38.319 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:35:38.319 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:35:38.320 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:35:38.320 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:35:38.320 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:35:38.320 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:35:38.320 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:35:38.320 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:35:38.320 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:35:38.320 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:35:38.320 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:35:38.320 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:38.320 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:35:38.320 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.320 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:35:38.321 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.321 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:35:38.321 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:35:38.321 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:35:38.321 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:35:38.321 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.321 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:35:38.321 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:35:38.321 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:38.321 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.321 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.321 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:35:38.321 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:35:38.322 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:38.322 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.322 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:38.322 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.322 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:35:38.322 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:35:38.322 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:35:38.322 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:35:38.322 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:35:38.322 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.322 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.322 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:35:38.322 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:35:38.323 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:35:38.323 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:35:38.323 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.323 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:35:38.323 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:35:38.323 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:38.323 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.323 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.323 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:35:38.323 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:35:38.323 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:38.323 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.323 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:38.324 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.324 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:35:38.324 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:35:38.324 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:35:38.324 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:35:38.324 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:35:38.324 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.324 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.324 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:35:38.324 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:35:38.324 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:35:38.324 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:35:38.325 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.325 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:35:38.325 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:35:38.325 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:38.325 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.325 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.325 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:35:38.325 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:35:38.325 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:38.325 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.325 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:38.325 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.325 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:35:38.326 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:35:38.326 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:35:38.326 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:35:38.326 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:35:38.326 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.326 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:38.326 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.326 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:35:38.326 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:35:38.326 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.326 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:35:38.326 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:35:38.326 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:35:38.326 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.327 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:38.327 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:35:38.327 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.327 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:35:38.327 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:35:38.327 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4 2024-09-11T22:35:38.327 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.327 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:38.327 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:35:38.327 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.327 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:35:38.327 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:35:38.327 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:35:38.327 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.328 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:38.328 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:35:38.328 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.328 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:35:38.328 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:35:38.328 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 3 2024-09-11T22:35:38.328 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.328 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:38.328 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:35:38.328 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.328 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:35:38.328 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:35:38.328 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:35:38.328 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.329 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:38.329 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.329 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:35:38.329 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:35:38.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.314+0000 7f71a3fff640 1 -- 172.21.15.100:0/1395644636 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f719006bf00 msgr2=0x7f719006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:38.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.314+0000 7f71a3fff640 1 --2- 172.21.15.100:0/1395644636 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f719006bf00 0x7f719006e3c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f719c000d90 tx=0x7f7198006bd0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.314+0000 7f71a37fe640 1 -- 172.21.15.100:0/1395644636 reap_dead start 2024-09-11T22:35:38.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.314+0000 7f71a3fff640 1 -- 172.21.15.100:0/1395644636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f719c0d45f0 msgr2=0x7f719c04e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:38.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.314+0000 7f71a3fff640 1 --2- 172.21.15.100:0/1395644636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f719c0d45f0 0x7f719c04e350 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7194009990 tx=0x7f71940046c0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.314+0000 7f71a3fff640 1 -- 172.21.15.100:0/1395644636 shutdown_connections 2024-09-11T22:35:38.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.314+0000 7f71a3fff640 1 --2- 172.21.15.100:0/1395644636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f719c0d45f0 0x7f719c04e350 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.314+0000 7f71a3fff640 1 -- 172.21.15.100:0/1395644636 >> 172.21.15.100:0/1395644636 conn(0x7f719c04fc50 msgr2=0x7f719c0d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:38.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.315+0000 7f71a3fff640 1 -- 172.21.15.100:0/1395644636 shutdown_connections 2024-09-11T22:35:38.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.315+0000 7f71a3fff640 1 -- 172.21.15.100:0/1395644636 wait complete. 2024-09-11T22:35:38.336 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:35:38.336 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-11T22:35:38.336 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-11T22:35:38.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.531+0000 7fc9c6674640 1 Processor -- start 2024-09-11T22:35:38.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.531+0000 7fc9c6674640 1 -- start start 2024-09-11T22:35:38.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.532+0000 7fc9c6674640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc9c006ce70 0x7fc9c006c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.532+0000 7fc9c6674640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9c00c7a80 con 0x7fc9c0158f60 2024-09-11T22:35:38.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.532+0000 7fc9c6674640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9c0074150 con 0x7fc9c0067950 2024-09-11T22:35:38.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.532+0000 7fc9c6674640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fc9c0068530 con 0x7fc9c006ce70 2024-09-11T22:35:38.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.535+0000 7fc9c4c11640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fc9c0067950 0x7fc9c01695e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:47720/0 (socket says 172.21.15.100:47720) 2024-09-11T22:35:38.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.535+0000 7fc9c4c11640 1 -- 172.21.15.100:0/2770159109 learned_addr learned my addr 172.21.15.100:0/2770159109 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:35:38.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.535+0000 7fc9bf7fe640 1 --2- 172.21.15.100:0/2770159109 >> v2:172.21.15.167:3300/0 conn(0x7fc9c006ce70 0x7fc9c006c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:38.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.537+0000 7fc9beffd640 1 -- 172.21.15.100:0/2770159109 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1092105189 0 0) 0x7fc9c0074150 con 0x7fc9c0067950 2024-09-11T22:35:38.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.537+0000 7fc9beffd640 1 -- 172.21.15.100:0/2770159109 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9a8003520 con 0x7fc9c0067950 2024-09-11T22:35:38.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.537+0000 7fc9beffd640 1 -- 172.21.15.100:0/2770159109 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1382787023 0 0) 0x7fc9c00c7a80 con 0x7fc9c0158f60 2024-09-11T22:35:38.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.537+0000 7fc9beffd640 1 -- 172.21.15.100:0/2770159109 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9c0074150 con 0x7fc9c0158f60 2024-09-11T22:35:38.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.538+0000 7fc9beffd640 1 -- 172.21.15.100:0/2770159109 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 517383350 0 0) 0x7fc9c0074150 con 0x7fc9c0158f60 2024-09-11T22:35:38.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.538+0000 7fc9beffd640 1 -- 172.21.15.100:0/2770159109 >> v2:172.21.15.167:3300/0 conn(0x7fc9c006ce70 msgr2=0x7fc9c006c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:38.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.538+0000 7fc9beffd640 1 --2- 172.21.15.100:0/2770159109 >> v2:172.21.15.167:3300/0 conn(0x7fc9c006ce70 0x7fc9c006c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.538+0000 7fc9beffd640 1 -- 172.21.15.100:0/2770159109 >> v1:172.21.15.167:6789/0 conn(0x7fc9c0067950 legacy=0x7fc9c01695e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:38.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.538+0000 7fc9beffd640 1 -- 172.21.15.100:0/2770159109 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c00c3df0 con 0x7fc9c0158f60 2024-09-11T22:35:38.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.538+0000 7fc9beffd640 1 -- 172.21.15.100:0/2770159109 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fc9b0001670 con 0x7fc9c0158f60 2024-09-11T22:35:38.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.538+0000 7fc9beffd640 1 -- 172.21.15.100:0/2770159109 >> v1:172.21.15.100:6789/0 conn(0x7fc9c0158f60 legacy=0x7fc9c0073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:38.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.538+0000 7fc9beffd640 1 --2- 172.21.15.100:0/2770159109 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9a8003b40 0x7fc9a8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.538+0000 7fc9beffd640 1 --2- 172.21.15.100:0/2770159109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9a8004800 0x7fc9a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.538+0000 7fc9beffd640 1 --2- 172.21.15.100:0/2770159109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9a80051c0 0x7fc9a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.538+0000 7fc9beffd640 1 -- 172.21.15.100:0/2770159109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c0068530 con 0x7fc9a80051c0 2024-09-11T22:35:38.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.538+0000 7fc9beffd640 1 -- 172.21.15.100:0/2770159109 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a800bfb0 con 0x7fc9a8004800 2024-09-11T22:35:38.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.538+0000 7fc9beffd640 1 -- 172.21.15.100:0/2770159109 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a800c1b0 con 0x7fc9a8003b40 2024-09-11T22:35:38.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.538+0000 7fc9bffff640 1 --2- 172.21.15.100:0/2770159109 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9a8003b40 0x7fc9a8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:38.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.539+0000 7fc9c4c11640 1 --2- 172.21.15.100:0/2770159109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9a80051c0 0x7fc9a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:38.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.539+0000 7fc9bffff640 1 -- 172.21.15.100:0/2770159109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9a8004800 msgr2=0x7fc9a8004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:35:38.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.539+0000 7fc9bffff640 1 --2- 172.21.15.100:0/2770159109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9a8004800 0x7fc9a8004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.539+0000 7fc9bffff640 1 -- 172.21.15.100:0/2770159109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9a80051c0 msgr2=0x7fc9a800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:38.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.539+0000 7fc9bffff640 1 --2- 172.21.15.100:0/2770159109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9a80051c0 0x7fc9a800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.539+0000 7fc9bffff640 1 -- 172.21.15.100:0/2770159109 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c00c3df0 con 0x7fc9a8003b40 2024-09-11T22:35:38.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.540+0000 7fc9c4c11640 1 --2- 172.21.15.100:0/2770159109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9a80051c0 0x7fc9a800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:35:38.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.540+0000 7fc9c4c11640 1 -- 172.21.15.100:0/2770159109 reap_dead start 2024-09-11T22:35:38.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.540+0000 7fc9bffff640 1 --2- 172.21.15.100:0/2770159109 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9a8003b40 0x7fc9a8003f40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000c210 tx=0x7fc9a8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9fc10be1f71d311 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:38.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.542+0000 7fc9beffd640 1 -- 172.21.15.100:0/2770159109 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0007c40 con 0x7fc9a8003b40 2024-09-11T22:35:38.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.542+0000 7fc9beffd640 1 -- 172.21.15.100:0/2770159109 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b0031620 con 0x7fc9a8003b40 2024-09-11T22:35:38.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.542+0000 7fc9beffd640 1 -- 172.21.15.100:0/2770159109 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0031a10 con 0x7fc9a8003b40 2024-09-11T22:35:38.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.543+0000 7fc9c6674640 1 -- 172.21.15.100:0/2770159109 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9a8003b40 msgr2=0x7fc9a8003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:38.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.543+0000 7fc9c6674640 1 --2- 172.21.15.100:0/2770159109 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9a8003b40 0x7fc9a8003f40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000c210 tx=0x7fc9a8005830 comp rx=0 tx=0).stop 2024-09-11T22:35:38.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.545+0000 7fc9c6674640 1 -- 172.21.15.100:0/2770159109 shutdown_connections 2024-09-11T22:35:38.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.545+0000 7fc9c6674640 1 --2- 172.21.15.100:0/2770159109 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9a8003b40 0x7fc9a8003f40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.545+0000 7fc9c6674640 1 -- 172.21.15.100:0/2770159109 >> 172.21.15.100:0/2770159109 conn(0x7fc9c006ee80 msgr2=0x7fc9c0070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:38.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.548+0000 7fc9c6674640 1 -- 172.21.15.100:0/2770159109 shutdown_connections 2024-09-11T22:35:38.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.554+0000 7fc9c6674640 1 -- 172.21.15.100:0/2770159109 wait complete. 2024-09-11T22:35:38.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.555+0000 7fc9c6674640 1 Processor -- start 2024-09-11T22:35:38.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.556+0000 7fc9c6674640 1 -- start start 2024-09-11T22:35:38.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.557+0000 7fc9c6674640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9a8003b40 0x7fc9c0154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.557+0000 7fc9c6674640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9c00cb2d0 0x7fc9c01511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.557+0000 7fc9c6674640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9c01ead20 0x7fc9c0151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.557+0000 7fc9c6674640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c0073520 con 0x7fc9a8003b40 2024-09-11T22:35:38.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.557+0000 7fc9c6674640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c00c7fd0 con 0x7fc9c00cb2d0 2024-09-11T22:35:38.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.557+0000 7fc9c6674640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc9c0159340 con 0x7fc9c01ead20 2024-09-11T22:35:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.557+0000 7fc9bffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9a8003b40 0x7fc9c0154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.557+0000 7fc9bffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9a8003b40 0x7fc9c0154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46156/0 (socket says 172.21.15.100:46156) 2024-09-11T22:35:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.557+0000 7fc9bffff640 1 -- 172.21.15.100:0/139650609 learned_addr learned my addr 172.21.15.100:0/139650609 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.557+0000 7fc9bf7fe640 1 --2- 172.21.15.100:0/139650609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9c00cb2d0 0x7fc9c01511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.557+0000 7fc9c4c11640 1 --2- 172.21.15.100:0/139650609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9c01ead20 0x7fc9c0151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.558+0000 7fc9bffff640 1 -- 172.21.15.100:0/139650609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9c01ead20 msgr2=0x7fc9c0151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.558+0000 7fc9bffff640 1 --2- 172.21.15.100:0/139650609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9c01ead20 0x7fc9c0151730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.558+0000 7fc9bffff640 1 -- 172.21.15.100:0/139650609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9c00cb2d0 msgr2=0x7fc9c01511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.558+0000 7fc9bffff640 1 --2- 172.21.15.100:0/139650609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9c00cb2d0 0x7fc9c01511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.558+0000 7fc9bffff640 1 -- 172.21.15.100:0/139650609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c01e9e60 con 0x7fc9a8003b40 2024-09-11T22:35:38.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.558+0000 7fc9bffff640 1 --2- 172.21.15.100:0/139650609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9a8003b40 0x7fc9c0154940 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000c330 tx=0x7fc9b0001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:38.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.563+0000 7fc9bcff9640 1 -- 172.21.15.100:0/139650609 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b003f070 con 0x7fc9a8003b40 2024-09-11T22:35:38.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.563+0000 7fc9bcff9640 1 -- 172.21.15.100:0/139650609 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b0005270 con 0x7fc9a8003b40 2024-09-11T22:35:38.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.563+0000 7fc9bcff9640 1 -- 172.21.15.100:0/139650609 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0007c40 con 0x7fc9a8003b40 2024-09-11T22:35:38.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.563+0000 7fc9c6674640 1 -- 172.21.15.100:0/139650609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c01ea140 con 0x7fc9a8003b40 2024-09-11T22:35:38.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.563+0000 7fc9c6674640 1 -- 172.21.15.100:0/139650609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c01ea700 con 0x7fc9a8003b40 2024-09-11T22:35:38.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.565+0000 7fc9a67fc640 1 --2- 172.21.15.100:0/139650609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9c01fdbc0 0x7fc9c0200700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.565+0000 7fc9a67fc640 1 -- 172.21.15.100:0/139650609 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc9c00730f0 con 0x7fc9c01fdbc0 2024-09-11T22:35:38.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.565+0000 7fc9bf7fe640 1 --2- 172.21.15.100:0/139650609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9c01fdbc0 0x7fc9c0200700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:38.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.567+0000 7fc9bf7fe640 1 -- 172.21.15.100:0/139650609 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9c0073310 con 0x7fc9c01fdbc0 2024-09-11T22:35:38.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.568+0000 7fc9bf7fe640 1 --2- 172.21.15.100:0/139650609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9c01fdbc0 0x7fc9c0200700 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0155930 tx=0x7fc9b4011d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:38.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.575+0000 7fc9bcff9640 1 -- 172.21.15.100:0/139650609 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc9b0042070 con 0x7fc9a8003b40 2024-09-11T22:35:38.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.576+0000 7fc9bcff9640 1 --2- 172.21.15.100:0/139650609 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc9ac06be80 0x7fc9ac06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.576+0000 7fc9bcff9640 1 -- 172.21.15.100:0/139650609 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4019070 con 0x7fc9c01fdbc0 2024-09-11T22:35:38.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.576+0000 7fc9bcff9640 1 -- 172.21.15.100:0/139650609 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fc9b00ab860 con 0x7fc9a8003b40 2024-09-11T22:35:38.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.576+0000 7fc9bcff9640 1 -- 172.21.15.100:0/139650609 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (secure 0 0 0) 0x7fc9b4004300 con 0x7fc9c01fdbc0 2024-09-11T22:35:38.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.578+0000 7fc9c4c11640 1 --2- 172.21.15.100:0/139650609 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc9ac06be80 0x7fc9ac06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:38.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.579+0000 7fc9bcff9640 1 -- 172.21.15.100:0/139650609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9c01fdbc0 msgr2=0x7fc9c0200700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:38.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.579+0000 7fc9bcff9640 1 --2- 172.21.15.100:0/139650609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9c01fdbc0 0x7fc9c0200700 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0155930 tx=0x7fc9b4011d40 comp rx=0 tx=0).stop 2024-09-11T22:35:38.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.579+0000 7fc9bcff9640 1 -- 172.21.15.100:0/139650609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9c01fdbc0 msgr2=0x7fc9c0200700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:35:38.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.579+0000 7fc9bcff9640 1 --2- 172.21.15.100:0/139650609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9c01fdbc0 0x7fc9c0200700 secure :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0155930 tx=0x7fc9b4011d40 comp rx=0 tx=0).stop 2024-09-11T22:35:38.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.594+0000 7fc9c4c11640 1 --2- 172.21.15.100:0/139650609 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc9ac06be80 0x7fc9ac06e340 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc9c006d250 tx=0x7fc9b8001250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:38.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.596+0000 7fc9a67fc640 1 --2- 172.21.15.100:0/139650609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9c0200c40 0x7fc9c0201060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.596+0000 7fc9a67fc640 1 -- 172.21.15.100:0/139650609 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc9c00c40d0 con 0x7fc9c0200c40 2024-09-11T22:35:38.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.596+0000 7fc9bf7fe640 1 --2- 172.21.15.100:0/139650609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9c0200c40 0x7fc9c0201060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:38.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.597+0000 7fc9bf7fe640 1 -- 172.21.15.100:0/139650609 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc9c00c8340 con 0x7fc9c0200c40 2024-09-11T22:35:38.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.597+0000 7fc9bf7fe640 1 --2- 172.21.15.100:0/139650609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9c0200c40 0x7fc9c0201060 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0070360 tx=0x7fc9b40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:38.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.598+0000 7fc9bcff9640 1 -- 172.21.15.100:0/139650609 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4019040 con 0x7fc9c0200c40 2024-09-11T22:35:38.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.598+0000 7fc9bcff9640 1 -- 172.21.15.100:0/139650609 <== mon.2 v2:172.21.15.167:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+5055 (secure 0 0 0) 0x7fc9b4003bb0 con 0x7fc9c0200c40 2024-09-11T22:35:38.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.598+0000 7fc9bcff9640 1 -- 172.21.15.100:0/139650609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9c0200c40 msgr2=0x7fc9c0201060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:38.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.598+0000 7fc9bcff9640 1 --2- 172.21.15.100:0/139650609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9c0200c40 0x7fc9c0201060 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0070360 tx=0x7fc9b40046c0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.598+0000 7fc9bcff9640 1 -- 172.21.15.100:0/139650609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9c0200c40 msgr2=0x7fc9c0201060 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-11T22:35:38.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.598+0000 7fc9bcff9640 1 --2- 172.21.15.100:0/139650609 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9c0200c40 0x7fc9c0201060 secure :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0070360 tx=0x7fc9b40046c0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.600 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:35:38.600 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:35:38.600 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:35:38.600 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "peon", 2024-09-11T22:35:38.600 INFO:teuthology.orchestra.run.smithi100.stdout: "election_epoch": 110, 2024-09-11T22:35:38.600 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 829318, 2024-09-11T22:35:38.600 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum": [ 2024-09-11T22:35:38.600 INFO:teuthology.orchestra.run.smithi100.stdout: 0, 2024-09-11T22:35:38.600 INFO:teuthology.orchestra.run.smithi100.stdout: 1, 2024-09-11T22:35:38.600 INFO:teuthology.orchestra.run.smithi100.stdout: 2 2024-09-11T22:35:38.600 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:38.601 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_age": 1, 2024-09-11T22:35:38.601 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:35:38.601 INFO:teuthology.orchestra.run.smithi100.stdout: "required_con": "2450521708007866372", 2024-09-11T22:35:38.601 INFO:teuthology.orchestra.run.smithi100.stdout: "required_mon": [ 2024-09-11T22:35:38.601 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:35:38.601 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:35:38.601 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:35:38.601 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:35:38.601 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:35:38.601 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:35:38.601 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:35:38.601 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:35:38.601 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:35:38.601 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:35:38.602 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:35:38.602 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:38.602 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_con": "4540701547738038271", 2024-09-11T22:35:38.602 INFO:teuthology.orchestra.run.smithi100.stdout: "quorum_mon": [ 2024-09-11T22:35:38.602 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:35:38.602 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:35:38.602 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:35:38.602 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:35:38.602 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:35:38.602 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:35:38.602 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:35:38.602 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:35:38.602 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:35:38.602 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:35:38.603 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:35:38.603 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:38.603 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.603 INFO:teuthology.orchestra.run.smithi100.stdout: "outside_quorum": [], 2024-09-11T22:35:38.603 INFO:teuthology.orchestra.run.smithi100.stdout: "extra_probe_peers": [], 2024-09-11T22:35:38.603 INFO:teuthology.orchestra.run.smithi100.stdout: "sync_provider": [], 2024-09-11T22:35:38.603 INFO:teuthology.orchestra.run.smithi100.stdout: "monmap": { 2024-09-11T22:35:38.603 INFO:teuthology.orchestra.run.smithi100.stdout: "epoch": 1, 2024-09-11T22:35:38.603 INFO:teuthology.orchestra.run.smithi100.stdout: "fsid": "e9259096-4424-4dcb-839f-82ac34412ee2", 2024-09-11T22:35:38.603 INFO:teuthology.orchestra.run.smithi100.stdout: "modified": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:35:38.603 INFO:teuthology.orchestra.run.smithi100.stdout: "created": "2024-09-11T22:19:20.104546Z", 2024-09-11T22:35:38.603 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release": 19, 2024-09-11T22:35:38.603 INFO:teuthology.orchestra.run.smithi100.stdout: "min_mon_release_name": "squid", 2024-09-11T22:35:38.604 INFO:teuthology.orchestra.run.smithi100.stdout: "election_strategy": 1, 2024-09-11T22:35:38.604 INFO:teuthology.orchestra.run.smithi100.stdout: "disallowed_leaders: ": "", 2024-09-11T22:35:38.604 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false, 2024-09-11T22:35:38.604 INFO:teuthology.orchestra.run.smithi100.stdout: "tiebreaker_mon": "", 2024-09-11T22:35:38.604 INFO:teuthology.orchestra.run.smithi100.stdout: "removed_ranks: ": "", 2024-09-11T22:35:38.604 INFO:teuthology.orchestra.run.smithi100.stdout: "features": { 2024-09-11T22:35:38.604 INFO:teuthology.orchestra.run.smithi100.stdout: "persistent": [ 2024-09-11T22:35:38.604 INFO:teuthology.orchestra.run.smithi100.stdout: "kraken", 2024-09-11T22:35:38.604 INFO:teuthology.orchestra.run.smithi100.stdout: "luminous", 2024-09-11T22:35:38.604 INFO:teuthology.orchestra.run.smithi100.stdout: "mimic", 2024-09-11T22:35:38.604 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap-prune", 2024-09-11T22:35:38.604 INFO:teuthology.orchestra.run.smithi100.stdout: "nautilus", 2024-09-11T22:35:38.604 INFO:teuthology.orchestra.run.smithi100.stdout: "octopus", 2024-09-11T22:35:38.605 INFO:teuthology.orchestra.run.smithi100.stdout: "pacific", 2024-09-11T22:35:38.605 INFO:teuthology.orchestra.run.smithi100.stdout: "elector-pinging", 2024-09-11T22:35:38.605 INFO:teuthology.orchestra.run.smithi100.stdout: "quincy", 2024-09-11T22:35:38.605 INFO:teuthology.orchestra.run.smithi100.stdout: "reef", 2024-09-11T22:35:38.605 INFO:teuthology.orchestra.run.smithi100.stdout: "squid" 2024-09-11T22:35:38.605 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:38.605 INFO:teuthology.orchestra.run.smithi100.stdout: "optional": [] 2024-09-11T22:35:38.605 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.605 INFO:teuthology.orchestra.run.smithi100.stdout: "mons": [ 2024-09-11T22:35:38.605 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.605 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 0, 2024-09-11T22:35:38.605 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "a", 2024-09-11T22:35:38.605 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:35:38.606 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:35:38.606 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.606 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:35:38.606 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:3300", 2024-09-11T22:35:38.606 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:38.606 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.606 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.606 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:35:38.606 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789", 2024-09-11T22:35:38.606 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:38.606 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.606 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:38.606 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.607 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.100:6789/0", 2024-09-11T22:35:38.607 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.100:6789/0", 2024-09-11T22:35:38.607 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:35:38.607 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:35:38.607 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:35:38.607 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.607 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.607 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 1, 2024-09-11T22:35:38.607 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "b", 2024-09-11T22:35:38.607 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:35:38.607 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:35:38.607 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.607 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:35:38.607 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3300", 2024-09-11T22:35:38.608 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:38.608 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.608 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.608 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:35:38.608 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789", 2024-09-11T22:35:38.608 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:38.608 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.608 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:38.608 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.608 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6789/0", 2024-09-11T22:35:38.608 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6789/0", 2024-09-11T22:35:38.608 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:35:38.608 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:35:38.609 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:35:38.609 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.609 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.609 INFO:teuthology.orchestra.run.smithi100.stdout: "rank": 2, 2024-09-11T22:35:38.609 INFO:teuthology.orchestra.run.smithi100.stdout: "name": "c", 2024-09-11T22:35:38.609 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addrs": { 2024-09-11T22:35:38.609 INFO:teuthology.orchestra.run.smithi100.stdout: "addrvec": [ 2024-09-11T22:35:38.609 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.609 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v2", 2024-09-11T22:35:38.609 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:3301", 2024-09-11T22:35:38.609 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:38.609 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.609 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.609 INFO:teuthology.orchestra.run.smithi100.stdout: "type": "v1", 2024-09-11T22:35:38.610 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790", 2024-09-11T22:35:38.610 INFO:teuthology.orchestra.run.smithi100.stdout: "nonce": 0 2024-09-11T22:35:38.610 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.610 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:38.610 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.610 INFO:teuthology.orchestra.run.smithi100.stdout: "addr": "172.21.15.167:6790/0", 2024-09-11T22:35:38.610 INFO:teuthology.orchestra.run.smithi100.stdout: "public_addr": "172.21.15.167:6790/0", 2024-09-11T22:35:38.610 INFO:teuthology.orchestra.run.smithi100.stdout: "priority": 0, 2024-09-11T22:35:38.610 INFO:teuthology.orchestra.run.smithi100.stdout: "weight": 0, 2024-09-11T22:35:38.610 INFO:teuthology.orchestra.run.smithi100.stdout: "crush_location": "{}" 2024-09-11T22:35:38.610 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.610 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:38.610 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.611 INFO:teuthology.orchestra.run.smithi100.stdout: "feature_map": { 2024-09-11T22:35:38.611 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": [ 2024-09-11T22:35:38.611 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.611 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:35:38.611 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:35:38.611 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:35:38.611 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.611 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:38.611 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": [ 2024-09-11T22:35:38.611 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.611 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:35:38.611 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:35:38.611 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 2 2024-09-11T22:35:38.612 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.612 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:38.612 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": [ 2024-09-11T22:35:38.612 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.612 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:35:38.612 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:35:38.612 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 7 2024-09-11T22:35:38.612 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.612 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:38.612 INFO:teuthology.orchestra.run.smithi100.stdout: "client": [ 2024-09-11T22:35:38.612 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.612 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:35:38.612 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:35:38.613 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 4 2024-09-11T22:35:38.613 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.613 INFO:teuthology.orchestra.run.smithi100.stdout: ], 2024-09-11T22:35:38.613 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": [ 2024-09-11T22:35:38.613 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-09-11T22:35:38.613 INFO:teuthology.orchestra.run.smithi100.stdout: "features": "0x3f03cffffffdffff", 2024-09-11T22:35:38.613 INFO:teuthology.orchestra.run.smithi100.stdout: "release": "squid", 2024-09-11T22:35:38.613 INFO:teuthology.orchestra.run.smithi100.stdout: "num": 1 2024-09-11T22:35:38.613 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-11T22:35:38.613 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-11T22:35:38.613 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-11T22:35:38.613 INFO:teuthology.orchestra.run.smithi100.stdout: "stretch_mode": false 2024-09-11T22:35:38.613 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:35:38.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.602+0000 7fc9a67fc640 1 -- 172.21.15.100:0/139650609 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc9ac06be80 msgr2=0x7fc9ac06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:38.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.602+0000 7fc9a67fc640 1 --2- 172.21.15.100:0/139650609 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc9ac06be80 0x7fc9ac06e340 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc9c006d250 tx=0x7fc9b8001250 comp rx=0 tx=0).stop 2024-09-11T22:35:38.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.602+0000 7fc9c4c11640 1 -- 172.21.15.100:0/139650609 reap_dead start 2024-09-11T22:35:38.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.602+0000 7fc9a67fc640 1 -- 172.21.15.100:0/139650609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9a8003b40 msgr2=0x7fc9c0154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:38.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.602+0000 7fc9a67fc640 1 --2- 172.21.15.100:0/139650609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9a8003b40 0x7fc9c0154940 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000c330 tx=0x7fc9b0001970 comp rx=0 tx=0).stop 2024-09-11T22:35:38.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.603+0000 7fc9a67fc640 1 -- 172.21.15.100:0/139650609 shutdown_connections 2024-09-11T22:35:38.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.603+0000 7fc9a67fc640 1 --2- 172.21.15.100:0/139650609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9a8003b40 0x7fc9c0154940 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000c330 tx=0x7fc9b0001970 comp rx=0 tx=0).stop 2024-09-11T22:35:38.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.603+0000 7fc9a67fc640 1 -- 172.21.15.100:0/139650609 >> 172.21.15.100:0/139650609 conn(0x7fc9c006ee80 msgr2=0x7fc9c00cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:38.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.604+0000 7fc9a67fc640 1 -- 172.21.15.100:0/139650609 shutdown_connections 2024-09-11T22:35:38.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.604+0000 7fc9a67fc640 1 -- 172.21.15.100:0/139650609 wait complete. 2024-09-11T22:35:38.624 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-11T22:35:38.625 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-11T22:35:38.625 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-11T22:35:38.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.812+0000 7f9c37b2c640 1 Processor -- start 2024-09-11T22:35:38.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.815+0000 7f9c37b2c640 1 -- start start 2024-09-11T22:35:38.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.816+0000 7f9c37b2c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c30158e80 0x7f9c300c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.816+0000 7f9c37b2c640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9c300c7910 0x7f9c3006c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.816+0000 7f9c37b2c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9c300c93a0 0x7f9c3006c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.816+0000 7f9c37b2c640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f9c30159260 con 0x7f9c300c93a0 2024-09-11T22:35:38.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.816+0000 7f9c37b2c640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f9c3006cf80 con 0x7f9c300c7910 2024-09-11T22:35:38.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.816+0000 7f9c37b2c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9c3006d260 con 0x7f9c30158e80 2024-09-11T22:35:38.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.818+0000 7f9c350c7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9c300c7910 0x7f9c3006c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:38.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.818+0000 7f9c350c7640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9c300c7910 0x7f9c3006c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44078/0 (socket says 172.21.15.100:44078) 2024-09-11T22:35:38.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.818+0000 7f9c350c7640 1 -- 172.21.15.100:0/3423101460 learned_addr learned my addr 172.21.15.100:0/3423101460 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:38.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.818+0000 7f9c360c9640 1 --2- 172.21.15.100:0/3423101460 >> v2:172.21.15.100:3300/0 conn(0x7f9c300c93a0 0x7f9c3006c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:38.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.819+0000 7f9c360c9640 1 -- 172.21.15.100:0/3423101460 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c30158e80 msgr2=0x7f9c300c3d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T22:35:38.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.819+0000 7f9c360c9640 1 --2- 172.21.15.100:0/3423101460 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c30158e80 0x7f9c300c3d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.819+0000 7f9c360c9640 1 -- 172.21.15.100:0/3423101460 >> v2:172.21.15.167:3300/0 conn(0x7f9c300c7910 msgr2=0x7f9c3006c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:38.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.819+0000 7f9c360c9640 1 --2- 172.21.15.100:0/3423101460 >> v2:172.21.15.167:3300/0 conn(0x7f9c300c7910 0x7f9c3006c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.819+0000 7f9c360c9640 1 -- 172.21.15.100:0/3423101460 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c300679f0 con 0x7f9c300c93a0 2024-09-11T22:35:38.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.827+0000 7f9c360c9640 1 --2- 172.21.15.100:0/3423101460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c300c93a0 0x7f9c3006c5c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9c300ca830 tx=0x7f9c1802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4e2133d3959185 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:38.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.828+0000 7f9c348c6640 1 -- 172.21.15.100:0/3423101460 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18037070 con 0x7f9c300c93a0 2024-09-11T22:35:38.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.828+0000 7f9c348c6640 1 -- 172.21.15.100:0/3423101460 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c18032440 con 0x7f9c300c93a0 2024-09-11T22:35:38.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.828+0000 7f9c348c6640 1 -- 172.21.15.100:0/3423101460 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c18032850 con 0x7f9c300c93a0 2024-09-11T22:35:38.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.830+0000 7f9c37b2c640 1 -- 172.21.15.100:0/3423101460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c300c93a0 msgr2=0x7f9c3006c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:38.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.830+0000 7f9c37b2c640 1 --2- 172.21.15.100:0/3423101460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c300c93a0 0x7f9c3006c5c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9c300ca830 tx=0x7f9c1802a1e0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.834+0000 7f9c37b2c640 1 -- 172.21.15.100:0/3423101460 shutdown_connections 2024-09-11T22:35:38.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.834+0000 7f9c37b2c640 1 --2- 172.21.15.100:0/3423101460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c300c93a0 0x7f9c3006c5c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.834+0000 7f9c37b2c640 1 --2- 172.21.15.100:0/3423101460 >> v2:172.21.15.167:3300/0 conn(0x7f9c300c7910 0x7f9c3006c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.834+0000 7f9c37b2c640 1 --2- 172.21.15.100:0/3423101460 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c30158e80 0x7f9c300c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.834+0000 7f9c37b2c640 1 -- 172.21.15.100:0/3423101460 >> 172.21.15.100:0/3423101460 conn(0x7f9c300c9a10 msgr2=0x7f9c300c9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:38.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.842+0000 7f9c37b2c640 1 -- 172.21.15.100:0/3423101460 shutdown_connections 2024-09-11T22:35:38.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.844+0000 7f9c37b2c640 1 -- 172.21.15.100:0/3423101460 wait complete. 2024-09-11T22:35:38.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.846+0000 7f9c37b2c640 1 Processor -- start 2024-09-11T22:35:38.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.846+0000 7f9c37b2c640 1 -- start start 2024-09-11T22:35:38.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.847+0000 7f9c37b2c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c300c7910 0x7f9c300cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.847+0000 7f9c37b2c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c300c93a0 0x7f9c3013f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.847+0000 7f9c358c8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c300c7910 0x7f9c300cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:38.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.848+0000 7f9c358c8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c300c7910 0x7f9c300cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.100:44088/0 (socket says 172.21.15.100:44088) 2024-09-11T22:35:38.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.848+0000 7f9c358c8640 1 -- 172.21.15.100:0/644999702 learned_addr learned my addr 172.21.15.100:0/644999702 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:38.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.848+0000 7f9c350c7640 1 --2- 172.21.15.100:0/644999702 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c300c93a0 0x7f9c3013f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:38.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.848+0000 7f9c37b2c640 1 --2- 172.21.15.100:0/644999702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c30158e80 0x7f9c3013fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.848+0000 7f9c360c9640 1 --2- 172.21.15.100:0/644999702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c30158e80 0x7f9c3013fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:38.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.848+0000 7f9c37b2c640 1 -- 172.21.15.100:0/644999702 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9c30073670 con 0x7f9c30158e80 2024-09-11T22:35:38.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.848+0000 7f9c37b2c640 1 -- 172.21.15.100:0/644999702 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9c300734f0 con 0x7f9c300c7910 2024-09-11T22:35:38.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.848+0000 7f9c37b2c640 1 -- 172.21.15.100:0/644999702 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9c300737f0 con 0x7f9c300c93a0 2024-09-11T22:35:38.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.849+0000 7f9c358c8640 1 -- 172.21.15.100:0/644999702 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c300c93a0 msgr2=0x7f9c3013f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:38.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.849+0000 7f9c358c8640 1 --2- 172.21.15.100:0/644999702 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c300c93a0 0x7f9c3013f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.849+0000 7f9c358c8640 1 -- 172.21.15.100:0/644999702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c30158e80 msgr2=0x7f9c3013fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:38.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.850+0000 7f9c358c8640 1 --2- 172.21.15.100:0/644999702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c30158e80 0x7f9c3013fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:38.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.850+0000 7f9c358c8640 1 -- 172.21.15.100:0/644999702 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c30160db0 con 0x7f9c300c7910 2024-09-11T22:35:38.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.850+0000 7f9c360c9640 1 --2- 172.21.15.100:0/644999702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c30158e80 0x7f9c3013fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:35:38.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.852+0000 7f9c358c8640 1 --2- 172.21.15.100:0/644999702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c300c7910 0x7f9c300cc440 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800ba80 tx=0x7f9c2800bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:38.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.855+0000 7f9c2e7fc640 1 -- 172.21.15.100:0/644999702 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28019070 con 0x7f9c300c7910 2024-09-11T22:35:38.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.855+0000 7f9c2e7fc640 1 -- 172.21.15.100:0/644999702 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c2800cc90 con 0x7f9c300c7910 2024-09-11T22:35:38.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.855+0000 7f9c2e7fc640 1 -- 172.21.15.100:0/644999702 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28014680 con 0x7f9c300c7910 2024-09-11T22:35:38.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.857+0000 7f9c37b2c640 1 -- 172.21.15.100:0/644999702 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c301613c0 con 0x7f9c300c7910 2024-09-11T22:35:38.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.857+0000 7f9c37b2c640 1 -- 172.21.15.100:0/644999702 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c30161980 con 0x7f9c300c7910 2024-09-11T22:35:38.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.859+0000 7f9c27fff640 1 -- 172.21.15.100:0/644999702 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c08005290 con 0x7f9c300c7910 2024-09-11T22:35:38.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.863+0000 7f9c2e7fc640 1 -- 172.21.15.100:0/644999702 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c28007370 con 0x7f9c300c7910 2024-09-11T22:35:38.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.864+0000 7f9c2e7fc640 1 --2- 172.21.15.100:0/644999702 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9c1006bf30 0x7f9c1006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:38.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.864+0000 7f9c2e7fc640 1 -- 172.21.15.100:0/644999702 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f9c2808ae40 con 0x7f9c300c7910 2024-09-11T22:35:38.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.866+0000 7f9c350c7640 1 --2- 172.21.15.100:0/644999702 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9c1006bf30 0x7f9c1006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:38.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.866+0000 7f9c350c7640 1 --2- 172.21.15.100:0/644999702 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9c1006bf30 0x7f9c1006e3f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9c30160920 tx=0x7f9c20008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:38.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:38.867+0000 7f9c2e7fc640 1 -- 172.21.15.100:0/644999702 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9c28058df0 con 0x7f9c300c7910 2024-09-11T22:35:39.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:39.327+0000 7f9c27fff640 1 -- 172.21.15.100:0/644999702 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f9c08005d90 con 0x7f9c300c7910 2024-09-11T22:35:39.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:39.335+0000 7f9c2e7fc640 1 -- 172.21.15.100:0/644999702 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f9c2805d0f0 con 0x7f9c300c7910 2024-09-11T22:35:39.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:39.338+0000 7f9c37b2c640 1 -- 172.21.15.100:0/644999702 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9c1006bf30 msgr2=0x7f9c1006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:39.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:39.338+0000 7f9c37b2c640 1 --2- 172.21.15.100:0/644999702 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9c1006bf30 0x7f9c1006e3f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9c30160920 tx=0x7f9c20008040 comp rx=0 tx=0).stop 2024-09-11T22:35:39.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:39.338+0000 7f9c37b2c640 1 -- 172.21.15.100:0/644999702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c300c7910 msgr2=0x7f9c300cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:39.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:39.338+0000 7f9c37b2c640 1 --2- 172.21.15.100:0/644999702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c300c7910 0x7f9c300cc440 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800ba80 tx=0x7f9c2800bf40 comp rx=0 tx=0).stop 2024-09-11T22:35:39.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:39.338+0000 7f9c37b2c640 1 -- 172.21.15.100:0/644999702 shutdown_connections 2024-09-11T22:35:39.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:39.338+0000 7f9c37b2c640 1 --2- 172.21.15.100:0/644999702 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f9c1006bf30 0x7f9c1006e3f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:39.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:39.338+0000 7f9c37b2c640 1 --2- 172.21.15.100:0/644999702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c30158e80 0x7f9c3013fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:39.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:39.338+0000 7f9c37b2c640 1 --2- 172.21.15.100:0/644999702 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c300c93a0 0x7f9c3013f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:39.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:39.338+0000 7f9c37b2c640 1 --2- 172.21.15.100:0/644999702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c300c7910 0x7f9c300cc440 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:39.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:39.338+0000 7f9c37b2c640 1 -- 172.21.15.100:0/644999702 >> 172.21.15.100:0/644999702 conn(0x7f9c300c9a10 msgr2=0x7f9c300c3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:39.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:39.341+0000 7f9c37b2c640 1 -- 172.21.15.100:0/644999702 shutdown_connections 2024-09-11T22:35:39.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:39.341+0000 7f9c37b2c640 1 -- 172.21.15.100:0/644999702 wait complete. 2024-09-11T22:35:39.359 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-11T22:35:49.360 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:35:49.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.476+0000 7ff0f13bd640 1 Processor -- start 2024-09-11T22:35:49.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.476+0000 7ff0f13bd640 1 -- start start 2024-09-11T22:35:49.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.477+0000 7ff0f13bd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff0ec0c2380 0x7ff0ec0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:49.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.477+0000 7ff0f13bd640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0ec0c8380 con 0x7ff0ec06be80 2024-09-11T22:35:49.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.477+0000 7ff0f13bd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0ec072960 con 0x7ff0ec06c260 2024-09-11T22:35:49.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.477+0000 7ff0f13bd640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7ff0ec072c40 con 0x7ff0ec0c2380 2024-09-11T22:35:49.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.477+0000 7ff0eb7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff0ec0c2380 0x7ff0ec0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:49.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.477+0000 7ff0eb7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff0ec0c2380 0x7ff0ec0c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38922/0 (socket says 172.21.15.100:38922) 2024-09-11T22:35:49.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.477+0000 7ff0eb7fe640 1 -- 172.21.15.100:0/1139483442 learned_addr learned my addr 172.21.15.100:0/1139483442 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:49.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.477+0000 7ff0eaffd640 1 --1- 172.21.15.100:0/1139483442 >> v1:172.21.15.100:6789/0 conn(0x7ff0ec06be80 0x7ff0ec0c1c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51194/0 (socket says 172.21.15.100:51194) 2024-09-11T22:35:49.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.477+0000 7ff0ea7fc640 1 -- 172.21.15.100:0/1139483442 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3838228303 0 0) 0x7ff0ec072960 con 0x7ff0ec06c260 2024-09-11T22:35:49.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.498+0000 7ff0ea7fc640 1 -- 172.21.15.100:0/1139483442 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0d8003500 con 0x7ff0ec06c260 2024-09-11T22:35:49.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.498+0000 7ff0eb7fe640 1 -- 172.21.15.100:0/1139483442 >> v1:172.21.15.167:6789/0 conn(0x7ff0ec06c260 legacy=0x7ff0ec16b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:49.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.498+0000 7ff0eb7fe640 1 -- 172.21.15.100:0/1139483442 >> v1:172.21.15.100:6789/0 conn(0x7ff0ec06be80 legacy=0x7ff0ec0c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:49.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.498+0000 7ff0ea7fc640 1 -- 172.21.15.100:0/1139483442 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4124398407 0 0) 0x7ff0ec0c8380 con 0x7ff0ec06be80 2024-09-11T22:35:49.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.498+0000 7ff0eb7fe640 1 -- 172.21.15.100:0/1139483442 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0ec072f20 con 0x7ff0ec0c2380 2024-09-11T22:35:49.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.499+0000 7ff0eb7fe640 1 --2- 172.21.15.100:0/1139483442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0ec0c2380 0x7ff0ec0c7cf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4007730 tx=0x7ff0e402a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1438e65cf6548447 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:49.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.499+0000 7ff0ea7fc640 1 -- 172.21.15.100:0/1139483442 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e402e050 con 0x7ff0ec0c2380 2024-09-11T22:35:49.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.499+0000 7ff0ea7fc640 1 -- 172.21.15.100:0/1139483442 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e40094e0 con 0x7ff0ec0c2380 2024-09-11T22:35:49.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.499+0000 7ff0ea7fc640 1 -- 172.21.15.100:0/1139483442 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4003b90 con 0x7ff0ec0c2380 2024-09-11T22:35:49.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.499+0000 7ff0f13bd640 1 -- 172.21.15.100:0/1139483442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0ec0c2380 msgr2=0x7ff0ec0c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:49.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.499+0000 7ff0f13bd640 1 --2- 172.21.15.100:0/1139483442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0ec0c2380 0x7ff0ec0c7cf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4007730 tx=0x7ff0e402a840 comp rx=0 tx=0).stop 2024-09-11T22:35:49.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.499+0000 7ff0f13bd640 1 -- 172.21.15.100:0/1139483442 shutdown_connections 2024-09-11T22:35:49.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.499+0000 7ff0f13bd640 1 --2- 172.21.15.100:0/1139483442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0ec0c2380 0x7ff0ec0c7cf0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:49.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.499+0000 7ff0f13bd640 1 -- 172.21.15.100:0/1139483442 >> 172.21.15.100:0/1139483442 conn(0x7ff0ec0cbf70 msgr2=0x7ff0ec0cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:49.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.500+0000 7ff0f13bd640 1 -- 172.21.15.100:0/1139483442 shutdown_connections 2024-09-11T22:35:49.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.500+0000 7ff0f13bd640 1 -- 172.21.15.100:0/1139483442 wait complete. 2024-09-11T22:35:49.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.501+0000 7ff0f13bd640 1 Processor -- start 2024-09-11T22:35:49.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.501+0000 7ff0f13bd640 1 -- start start 2024-09-11T22:35:49.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.501+0000 7ff0f13bd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0ec06be80 0x7ff0ec0cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:49.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.501+0000 7ff0f13bd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0ec06c260 0x7ff0ec0c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:49.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.501+0000 7ff0f13bd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0ec0c2380 0x7ff0ec0c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:49.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.501+0000 7ff0f13bd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ec0c3000 con 0x7ff0ec0c2380 2024-09-11T22:35:49.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.501+0000 7ff0f13bd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ec06cc70 con 0x7ff0ec06be80 2024-09-11T22:35:49.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.501+0000 7ff0f13bd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff0ec158740 con 0x7ff0ec06c260 2024-09-11T22:35:49.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.502+0000 7ff0eb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0ec0c2380 0x7ff0ec0c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:49.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.502+0000 7ff0eb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0ec0c2380 0x7ff0ec0c5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38938/0 (socket says 172.21.15.100:38938) 2024-09-11T22:35:49.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.502+0000 7ff0eb7fe640 1 -- 172.21.15.100:0/3281070610 learned_addr learned my addr 172.21.15.100:0/3281070610 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:49.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.502+0000 7ff0eaffd640 1 --2- 172.21.15.100:0/3281070610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0ec06be80 0x7ff0ec0cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:49.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.502+0000 7ff0e3fff640 1 --2- 172.21.15.100:0/3281070610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0ec06c260 0x7ff0ec0c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:49.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.502+0000 7ff0eb7fe640 1 -- 172.21.15.100:0/3281070610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0ec06c260 msgr2=0x7ff0ec0c51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:49.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.502+0000 7ff0eb7fe640 1 --2- 172.21.15.100:0/3281070610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0ec06c260 0x7ff0ec0c51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:49.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.502+0000 7ff0eb7fe640 1 -- 172.21.15.100:0/3281070610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0ec06be80 msgr2=0x7ff0ec0cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:49.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.502+0000 7ff0eb7fe640 1 --2- 172.21.15.100:0/3281070610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0ec06be80 0x7ff0ec0cb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:49.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.502+0000 7ff0eb7fe640 1 -- 172.21.15.100:0/3281070610 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0ec165bf0 con 0x7ff0ec0c2380 2024-09-11T22:35:49.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.502+0000 7ff0eb7fe640 1 --2- 172.21.15.100:0/3281070610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0ec0c2380 0x7ff0ec0c5730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff0e402a880 tx=0x7ff0e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:49.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.502+0000 7ff0e37fe640 1 -- 172.21.15.100:0/3281070610 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4041070 con 0x7ff0ec0c2380 2024-09-11T22:35:49.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.502+0000 7ff0e37fe640 1 -- 172.21.15.100:0/3281070610 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e4009690 con 0x7ff0ec0c2380 2024-09-11T22:35:49.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.502+0000 7ff0f13bd640 1 -- 172.21.15.100:0/3281070610 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0ec15cda0 con 0x7ff0ec0c2380 2024-09-11T22:35:49.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.502+0000 7ff0e37fe640 1 -- 172.21.15.100:0/3281070610 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4004030 con 0x7ff0ec0c2380 2024-09-11T22:35:49.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.502+0000 7ff0f13bd640 1 -- 172.21.15.100:0/3281070610 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0ec15d040 con 0x7ff0ec0c2380 2024-09-11T22:35:49.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.503+0000 7ff0f13bd640 1 -- 172.21.15.100:0/3281070610 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0ec073f80 con 0x7ff0ec0c2380 2024-09-11T22:35:49.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.504+0000 7ff0e37fe640 1 -- 172.21.15.100:0/3281070610 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0e4044070 con 0x7ff0ec0c2380 2024-09-11T22:35:49.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.504+0000 7ff0e37fe640 1 --2- 172.21.15.100:0/3281070610 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff0cc06be30 0x7ff0cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:49.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.504+0000 7ff0e37fe640 1 -- 172.21.15.100:0/3281070610 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7ff0e4007e00 con 0x7ff0ec0c2380 2024-09-11T22:35:49.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.504+0000 7ff0eaffd640 1 --2- 172.21.15.100:0/3281070610 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff0cc06be30 0x7ff0cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:49.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.505+0000 7ff0eaffd640 1 --2- 172.21.15.100:0/3281070610 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff0cc06be30 0x7ff0cc06e2f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc004850 tx=0x7ff0dc00a1c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:49.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.509+0000 7ff0e37fe640 1 -- 172.21.15.100:0/3281070610 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff0e404b030 con 0x7ff0ec0c2380 2024-09-11T22:35:49.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.709+0000 7ff0f13bd640 1 -- 172.21.15.100:0/3281070610 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0ec0c7ad0 con 0x7ff0ec0c2380 2024-09-11T22:35:49.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.709+0000 7ff0e37fe640 1 -- 172.21.15.100:0/3281070610 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6926 (secure 0 0 0) 0x7ff0e4079f90 con 0x7ff0ec0c2380 2024-09-11T22:35:49.710 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:35:49.710 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":14,"btime":"2024-09-11T22:20:52:989866+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2075802330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":2075802330},{"type":"v1","addr":"172.21.15.100:6837","nonce":2075802330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/1727733473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1727733473},{"type":"v1","addr":"172.21.15.167:6836","nonce":1727733473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/880809662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":880809662},{"type":"v1","addr":"172.21.15.167:6837","nonce":880809662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:19.171222+0000","modified":"2024-09-11T22:20:52.989862+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4296,"mds_1":4281,"mds_2":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.100:6836/1912241808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1912241808},{"type":"v1","addr":"172.21.15.100:6836","nonce":1912241808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4281":{"gid":4281,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6839/3236256661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3236256661},{"type":"v1","addr":"172.21.15.100:6839","nonce":3236256661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4296":{"gid":4296,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6834/1651678197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1651678197},{"type":"v1","addr":"172.21.15.167:6834","nonce":1651678197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4275,4281,4296]},"id":1}]} 2024-09-11T22:35:49.711 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 14 2024-09-11T22:35:49.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.711+0000 7ff0f13bd640 1 -- 172.21.15.100:0/3281070610 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff0cc06be30 msgr2=0x7ff0cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:49.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.711+0000 7ff0f13bd640 1 --2- 172.21.15.100:0/3281070610 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff0cc06be30 0x7ff0cc06e2f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc004850 tx=0x7ff0dc00a1c0 comp rx=0 tx=0).stop 2024-09-11T22:35:49.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.711+0000 7ff0f13bd640 1 -- 172.21.15.100:0/3281070610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0ec0c2380 msgr2=0x7ff0ec0c5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:49.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.711+0000 7ff0f13bd640 1 --2- 172.21.15.100:0/3281070610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0ec0c2380 0x7ff0ec0c5730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff0e402a880 tx=0x7ff0e4004a40 comp rx=0 tx=0).stop 2024-09-11T22:35:49.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.711+0000 7ff0f13bd640 1 -- 172.21.15.100:0/3281070610 shutdown_connections 2024-09-11T22:35:49.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.711+0000 7ff0f13bd640 1 --2- 172.21.15.100:0/3281070610 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff0cc06be30 0x7ff0cc06e2f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:49.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.711+0000 7ff0f13bd640 1 --2- 172.21.15.100:0/3281070610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0ec0c2380 0x7ff0ec0c5730 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:49.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.711+0000 7ff0f13bd640 1 --2- 172.21.15.100:0/3281070610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0ec06c260 0x7ff0ec0c51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:49.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.711+0000 7ff0f13bd640 1 --2- 172.21.15.100:0/3281070610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0ec06be80 0x7ff0ec0cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:49.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.711+0000 7ff0f13bd640 1 -- 172.21.15.100:0/3281070610 >> 172.21.15.100:0/3281070610 conn(0x7ff0ec0cbf70 msgr2=0x7ff0ec0c8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:49.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.711+0000 7ff0f13bd640 1 -- 172.21.15.100:0/3281070610 shutdown_connections 2024-09-11T22:35:49.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.711+0000 7ff0f13bd640 1 -- 172.21.15.100:0/3281070610 wait complete. 2024-09-11T22:35:49.723 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-11T22:35:49.724 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-11T22:35:49.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.822+0000 7fec9c0f1640 1 Processor -- start 2024-09-11T22:35:49.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.822+0000 7fec9c0f1640 1 -- start start 2024-09-11T22:35:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.823+0000 7fec9c0f1640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fec940c6940 0x7fec940c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.823+0000 7fec9c0f1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec940c6d20 0x7fec941523e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.823+0000 7fec9c0f1640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fec940c3f30 0x7fec94152920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.823+0000 7fec9c0f1640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fec9406f1d0 con 0x7fec940c3f30 2024-09-11T22:35:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.823+0000 7fec9c0f1640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fec9406c060 con 0x7fec940c6940 2024-09-11T22:35:49.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.823+0000 7fec9c0f1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fec9406c340 con 0x7fec940c6d20 2024-09-11T22:35:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.823+0000 7fec9a68e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fec940c3f30 0x7fec94152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.823+0000 7fec9a68e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fec940c3f30 0x7fec94152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38950/0 (socket says 172.21.15.100:38950) 2024-09-11T22:35:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.823+0000 7fec9a68e640 1 -- 172.21.15.100:0/720276850 learned_addr learned my addr 172.21.15.100:0/720276850 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.823+0000 7fec9968c640 1 --2- 172.21.15.100:0/720276850 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec940c6d20 0x7fec941523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.823+0000 7fec99e8d640 1 --2- 172.21.15.100:0/720276850 >> v2:172.21.15.167:3300/0 conn(0x7fec940c6940 0x7fec940c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.823+0000 7fec9a68e640 1 -- 172.21.15.100:0/720276850 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec940c6d20 msgr2=0x7fec941523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.823+0000 7fec9a68e640 1 --2- 172.21.15.100:0/720276850 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec940c6d20 0x7fec941523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.823+0000 7fec9a68e640 1 -- 172.21.15.100:0/720276850 >> v2:172.21.15.167:3300/0 conn(0x7fec940c6940 msgr2=0x7fec940c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.823+0000 7fec9a68e640 1 --2- 172.21.15.100:0/720276850 >> v2:172.21.15.167:3300/0 conn(0x7fec940c6940 0x7fec940c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.823+0000 7fec9a68e640 1 -- 172.21.15.100:0/720276850 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec9406f420 con 0x7fec940c3f30 2024-09-11T22:35:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.824+0000 7fec9a68e640 1 --2- 172.21.15.100:0/720276850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec940c3f30 0x7fec94152920 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fec940689f0 tx=0x7fec8c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b494c3ed5345f193 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.824+0000 7fec98e8b640 1 -- 172.21.15.100:0/720276850 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c036070 con 0x7fec940c3f30 2024-09-11T22:35:49.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.824+0000 7fec98e8b640 1 -- 172.21.15.100:0/720276850 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec8c031600 con 0x7fec940c3f30 2024-09-11T22:35:49.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.824+0000 7fec98e8b640 1 -- 172.21.15.100:0/720276850 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c0319d0 con 0x7fec940c3f30 2024-09-11T22:35:49.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.825+0000 7fec9c0f1640 1 -- 172.21.15.100:0/720276850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec940c3f30 msgr2=0x7fec94152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:49.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.825+0000 7fec9c0f1640 1 --2- 172.21.15.100:0/720276850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec940c3f30 0x7fec94152920 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fec940689f0 tx=0x7fec8c02a610 comp rx=0 tx=0).stop 2024-09-11T22:35:49.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.825+0000 7fec9c0f1640 1 -- 172.21.15.100:0/720276850 shutdown_connections 2024-09-11T22:35:49.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.825+0000 7fec9c0f1640 1 --2- 172.21.15.100:0/720276850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec940c3f30 0x7fec94152920 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:49.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.825+0000 7fec9c0f1640 1 --2- 172.21.15.100:0/720276850 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec940c6d20 0x7fec941523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:49.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.825+0000 7fec9c0f1640 1 --2- 172.21.15.100:0/720276850 >> v2:172.21.15.167:3300/0 conn(0x7fec940c6940 0x7fec940c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:49.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.825+0000 7fec9c0f1640 1 -- 172.21.15.100:0/720276850 >> 172.21.15.100:0/720276850 conn(0x7fec94070b80 msgr2=0x7fec940ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:49.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.825+0000 7fec9c0f1640 1 -- 172.21.15.100:0/720276850 shutdown_connections 2024-09-11T22:35:49.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.825+0000 7fec9c0f1640 1 -- 172.21.15.100:0/720276850 wait complete. 2024-09-11T22:35:49.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.826+0000 7fec9c0f1640 1 Processor -- start 2024-09-11T22:35:49.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.826+0000 7fec9c0f1640 1 -- start start 2024-09-11T22:35:49.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.827+0000 7fec9c0f1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec940c3f30 0x7fec941500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:49.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.827+0000 7fec9c0f1640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec940c6940 0x7fec9415a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:49.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.827+0000 7fec9c0f1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec940c6d20 0x7fec941ee6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:49.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.827+0000 7fec9c0f1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fec940c9430 con 0x7fec940c3f30 2024-09-11T22:35:49.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.827+0000 7fec9c0f1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fec9406f9e0 con 0x7fec940c6d20 2024-09-11T22:35:49.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.827+0000 7fec9c0f1640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fec940c95b0 con 0x7fec940c6940 2024-09-11T22:35:49.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.827+0000 7fec99e8d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec940c3f30 0x7fec941500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:49.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.827+0000 7fec99e8d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec940c3f30 0x7fec941500e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38956/0 (socket says 172.21.15.100:38956) 2024-09-11T22:35:49.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.827+0000 7fec99e8d640 1 -- 172.21.15.100:0/3298206348 learned_addr learned my addr 172.21.15.100:0/3298206348 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:49.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.827+0000 7fec9a68e640 1 --2- 172.21.15.100:0/3298206348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec940c6d20 0x7fec941ee6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:49.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.827+0000 7fec9968c640 1 --2- 172.21.15.100:0/3298206348 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec940c6940 0x7fec9415a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:49.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.827+0000 7fec99e8d640 1 -- 172.21.15.100:0/3298206348 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec940c6940 msgr2=0x7fec9415a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:49.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.827+0000 7fec99e8d640 1 --2- 172.21.15.100:0/3298206348 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec940c6940 0x7fec9415a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:49.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.827+0000 7fec99e8d640 1 -- 172.21.15.100:0/3298206348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec940c6d20 msgr2=0x7fec941ee6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:49.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.827+0000 7fec99e8d640 1 --2- 172.21.15.100:0/3298206348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec940c6d20 0x7fec941ee6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:49.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.827+0000 7fec99e8d640 1 -- 172.21.15.100:0/3298206348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec941f1970 con 0x7fec940c3f30 2024-09-11T22:35:49.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.827+0000 7fec99e8d640 1 --2- 172.21.15.100:0/3298206348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec940c3f30 0x7fec941500e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fec9000d5f0 tx=0x7fec9000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:49.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.828+0000 7fec8a7fc640 1 -- 172.21.15.100:0/3298206348 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec900125f0 con 0x7fec940c3f30 2024-09-11T22:35:49.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.828+0000 7fec8a7fc640 1 -- 172.21.15.100:0/3298206348 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec90019070 con 0x7fec940c3f30 2024-09-11T22:35:49.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.828+0000 7fec9c0f1640 1 -- 172.21.15.100:0/3298206348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec941f1c90 con 0x7fec940c3f30 2024-09-11T22:35:49.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.828+0000 7fec8a7fc640 1 -- 172.21.15.100:0/3298206348 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec900129d0 con 0x7fec940c3f30 2024-09-11T22:35:49.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.828+0000 7fec9c0f1640 1 -- 172.21.15.100:0/3298206348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec941f24d0 con 0x7fec940c3f30 2024-09-11T22:35:49.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.829+0000 7fec9c0f1640 1 -- 172.21.15.100:0/3298206348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec940c76b0 con 0x7fec940c3f30 2024-09-11T22:35:49.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.829+0000 7fec8a7fc640 1 -- 172.21.15.100:0/3298206348 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec90012b70 con 0x7fec940c3f30 2024-09-11T22:35:49.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.829+0000 7fec8a7fc640 1 --2- 172.21.15.100:0/3298206348 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fec7806be30 0x7fec7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:49.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.830+0000 7fec8a7fc640 1 -- 172.21.15.100:0/3298206348 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fec9008b5b0 con 0x7fec940c3f30 2024-09-11T22:35:49.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.830+0000 7fec9968c640 1 --2- 172.21.15.100:0/3298206348 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fec7806be30 0x7fec7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:49.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.830+0000 7fec9968c640 1 --2- 172.21.15.100:0/3298206348 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fec7806be30 0x7fec7806e2f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fec941595f0 tx=0x7fec84008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:49.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:49.834+0000 7fec8a7fc640 1 -- 172.21.15.100:0/3298206348 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fec940c76b0 con 0x7fec940c3f30 2024-09-11T22:35:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.063+0000 7fec9c0f1640 1 -- 172.21.15.100:0/3298206348 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fec940c79c0 con 0x7fec940c3f30 2024-09-11T22:35:50.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.064+0000 7fec8a7fc640 1 -- 172.21.15.100:0/3298206348 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1570 (secure 0 0 0) 0x7fec941f1c90 con 0x7fec940c3f30 2024-09-11T22:35:50.065 INFO:teuthology.orchestra.run.smithi100.stdout:{"election_epoch":110,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","modified":"2024-09-11T22:19:20.104546Z","created":"2024-09-11T22:19:20.104546Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3301","nonce":0},{"type":"v1","addr":"172.21.15.167:6790","nonce":0}]},"addr":"172.21.15.167:6790/0","public_addr":"172.21.15.167:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-11T22:35:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.066+0000 7fec9c0f1640 1 -- 172.21.15.100:0/3298206348 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fec7806be30 msgr2=0x7fec7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.066+0000 7fec9c0f1640 1 --2- 172.21.15.100:0/3298206348 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fec7806be30 0x7fec7806e2f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fec941595f0 tx=0x7fec84008040 comp rx=0 tx=0).stop 2024-09-11T22:35:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.066+0000 7fec9c0f1640 1 -- 172.21.15.100:0/3298206348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec940c3f30 msgr2=0x7fec941500e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.066+0000 7fec9c0f1640 1 --2- 172.21.15.100:0/3298206348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec940c3f30 0x7fec941500e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fec9000d5f0 tx=0x7fec9000dab0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.066+0000 7fec9c0f1640 1 -- 172.21.15.100:0/3298206348 shutdown_connections 2024-09-11T22:35:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.066+0000 7fec9c0f1640 1 --2- 172.21.15.100:0/3298206348 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fec7806be30 0x7fec7806e2f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.066+0000 7fec9c0f1640 1 --2- 172.21.15.100:0/3298206348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec940c6d20 0x7fec941ee6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.066+0000 7fec9c0f1640 1 --2- 172.21.15.100:0/3298206348 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec940c6940 0x7fec9415a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.066+0000 7fec9c0f1640 1 --2- 172.21.15.100:0/3298206348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec940c3f30 0x7fec941500e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.066+0000 7fec9c0f1640 1 -- 172.21.15.100:0/3298206348 >> 172.21.15.100:0/3298206348 conn(0x7fec94070b80 msgr2=0x7fec9414e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:50.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.066+0000 7fec9c0f1640 1 -- 172.21.15.100:0/3298206348 shutdown_connections 2024-09-11T22:35:50.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.066+0000 7fec9c0f1640 1 -- 172.21.15.100:0/3298206348 wait complete. 2024-09-11T22:35:50.077 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-11T22:35:50.077 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-11T22:35:50.086 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-11T22:35:50.086 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:35:50.086 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:35:50.124 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:35:50.124 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:35:50.181 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T22:35:50.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.319+0000 7f7bbd918640 1 Processor -- start 2024-09-11T22:35:50.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.319+0000 7f7bbd918640 1 -- start start 2024-09-11T22:35:50.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.320+0000 7f7bbd918640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7bb80b20e0 0x7f7bb8072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:50.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.320+0000 7f7bbd918640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7bb806c3a0 0x7f7bb8073880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:50.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.320+0000 7f7bbd918640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bb806cee0 0x7f7bb8073dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:50.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.320+0000 7f7bbd918640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f7bb80c41a0 con 0x7f7bb80b20e0 2024-09-11T22:35:50.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.320+0000 7f7bbd918640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f7bb8072860 con 0x7f7bb806c3a0 2024-09-11T22:35:50.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.320+0000 7f7bbd918640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7bb80687e0 con 0x7f7bb806cee0 2024-09-11T22:35:50.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.320+0000 7f7bb6ffd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7bb80b20e0 0x7f7bb8072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:50.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.320+0000 7f7bb6ffd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7bb80b20e0 0x7f7bb8072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38962/0 (socket says 172.21.15.100:38962) 2024-09-11T22:35:50.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.320+0000 7f7bb6ffd640 1 -- 172.21.15.100:0/1201831664 learned_addr learned my addr 172.21.15.100:0/1201831664 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:50.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.321+0000 7f7bb77fe640 1 --2- 172.21.15.100:0/1201831664 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bb806cee0 0x7f7bb8073dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:50.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.321+0000 7f7bb67fc640 1 --2- 172.21.15.100:0/1201831664 >> v2:172.21.15.167:3300/0 conn(0x7f7bb806c3a0 0x7f7bb8073880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:50.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.321+0000 7f7bb6ffd640 1 -- 172.21.15.100:0/1201831664 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bb806cee0 msgr2=0x7f7bb8073dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:50.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.321+0000 7f7bb6ffd640 1 --2- 172.21.15.100:0/1201831664 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bb806cee0 0x7f7bb8073dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.321+0000 7f7bb6ffd640 1 -- 172.21.15.100:0/1201831664 >> v2:172.21.15.167:3300/0 conn(0x7f7bb806c3a0 msgr2=0x7f7bb8073880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:50.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.321+0000 7f7bb6ffd640 1 --2- 172.21.15.100:0/1201831664 >> v2:172.21.15.167:3300/0 conn(0x7f7bb806c3a0 0x7f7bb8073880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.321+0000 7f7bb6ffd640 1 -- 172.21.15.100:0/1201831664 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb806c890 con 0x7f7bb80b20e0 2024-09-11T22:35:50.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.321+0000 7f7bb6ffd640 1 --2- 172.21.15.100:0/1201831664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bb80b20e0 0x7f7bb8072cf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8073720 tx=0x7f7ba802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb4c0bbcae15009 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:50.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.322+0000 7f7bb5ffb640 1 -- 172.21.15.100:0/1201831664 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8037070 con 0x7f7bb80b20e0 2024-09-11T22:35:50.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.322+0000 7f7bb5ffb640 1 -- 172.21.15.100:0/1201831664 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ba8032440 con 0x7f7bb80b20e0 2024-09-11T22:35:50.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.322+0000 7f7bb5ffb640 1 -- 172.21.15.100:0/1201831664 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8032810 con 0x7f7bb80b20e0 2024-09-11T22:35:50.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.322+0000 7f7bbd918640 1 -- 172.21.15.100:0/1201831664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bb80b20e0 msgr2=0x7f7bb8072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:50.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.322+0000 7f7bbd918640 1 --2- 172.21.15.100:0/1201831664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bb80b20e0 0x7f7bb8072cf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8073720 tx=0x7f7ba802a270 comp rx=0 tx=0).stop 2024-09-11T22:35:50.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.322+0000 7f7bbd918640 1 -- 172.21.15.100:0/1201831664 shutdown_connections 2024-09-11T22:35:50.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.322+0000 7f7bbd918640 1 --2- 172.21.15.100:0/1201831664 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bb806cee0 0x7f7bb8073dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.322+0000 7f7bbd918640 1 --2- 172.21.15.100:0/1201831664 >> v2:172.21.15.167:3300/0 conn(0x7f7bb806c3a0 0x7f7bb8073880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.322+0000 7f7bbd918640 1 --2- 172.21.15.100:0/1201831664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bb80b20e0 0x7f7bb8072cf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.322+0000 7f7bbd918640 1 -- 172.21.15.100:0/1201831664 >> 172.21.15.100:0/1201831664 conn(0x7f7bb806ee80 msgr2=0x7f7bb8070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:50.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.322+0000 7f7bbd918640 1 -- 172.21.15.100:0/1201831664 shutdown_connections 2024-09-11T22:35:50.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.322+0000 7f7bbd918640 1 -- 172.21.15.100:0/1201831664 wait complete. 2024-09-11T22:35:50.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.323+0000 7f7bbd918640 1 Processor -- start 2024-09-11T22:35:50.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.324+0000 7f7bbd918640 1 -- start start 2024-09-11T22:35:50.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.324+0000 7f7bbd918640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bb806c3a0 0x7f7bb80af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:50.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.324+0000 7f7bbd918640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bb806cee0 0x7f7bb80b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:50.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.324+0000 7f7bbd918640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bb80b20e0 0x7f7bb81f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:50.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.324+0000 7f7bbd918640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb80b24c0 con 0x7f7bb806c3a0 2024-09-11T22:35:50.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.324+0000 7f7bbd918640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb80c7e60 con 0x7f7bb806cee0 2024-09-11T22:35:50.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.324+0000 7f7bbd918640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f7bb80c8140 con 0x7f7bb80b20e0 2024-09-11T22:35:50.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.324+0000 7f7bb6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bb806c3a0 0x7f7bb80af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:50.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.324+0000 7f7bb6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bb806c3a0 0x7f7bb80af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38974/0 (socket says 172.21.15.100:38974) 2024-09-11T22:35:50.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.324+0000 7f7bb6ffd640 1 -- 172.21.15.100:0/4081217555 learned_addr learned my addr 172.21.15.100:0/4081217555 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:50.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.324+0000 7f7bb67fc640 1 --2- 172.21.15.100:0/4081217555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bb806cee0 0x7f7bb80b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:50.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.325+0000 7f7bb77fe640 1 --2- 172.21.15.100:0/4081217555 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bb80b20e0 0x7f7bb81f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:50.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.325+0000 7f7bb6ffd640 1 -- 172.21.15.100:0/4081217555 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bb80b20e0 msgr2=0x7f7bb81f29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:50.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.325+0000 7f7bb6ffd640 1 --2- 172.21.15.100:0/4081217555 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bb80b20e0 0x7f7bb81f29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.325+0000 7f7bb6ffd640 1 -- 172.21.15.100:0/4081217555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bb806cee0 msgr2=0x7f7bb80b0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:50.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.325+0000 7f7bb6ffd640 1 --2- 172.21.15.100:0/4081217555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bb806cee0 0x7f7bb80b0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.325+0000 7f7bb6ffd640 1 -- 172.21.15.100:0/4081217555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb80afed0 con 0x7f7bb806c3a0 2024-09-11T22:35:50.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.325+0000 7f7bb77fe640 1 --2- 172.21.15.100:0/4081217555 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bb80b20e0 0x7f7bb81f29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:35:50.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.325+0000 7f7bb6ffd640 1 --2- 172.21.15.100:0/4081217555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bb806c3a0 0x7f7bb80af730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7ba80097c0 tx=0x7f7ba80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:50.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.325+0000 7f7b9ffff640 1 -- 172.21.15.100:0/4081217555 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8041020 con 0x7f7bb806c3a0 2024-09-11T22:35:50.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.325+0000 7f7b9ffff640 1 -- 172.21.15.100:0/4081217555 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ba80306c0 con 0x7f7bb806c3a0 2024-09-11T22:35:50.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.325+0000 7f7bbd918640 1 -- 172.21.15.100:0/4081217555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bb80b01b0 con 0x7f7bb806c3a0 2024-09-11T22:35:50.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.325+0000 7f7b9ffff640 1 -- 172.21.15.100:0/4081217555 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8037040 con 0x7f7bb806c3a0 2024-09-11T22:35:50.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.325+0000 7f7bbd918640 1 -- 172.21.15.100:0/4081217555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bb81f21d0 con 0x7f7bb806c3a0 2024-09-11T22:35:50.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.326+0000 7f7bbd918640 1 -- 172.21.15.100:0/4081217555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bb80c9710 con 0x7f7bb806c3a0 2024-09-11T22:35:50.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.326+0000 7f7b9ffff640 1 -- 172.21.15.100:0/4081217555 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ba8044020 con 0x7f7bb806c3a0 2024-09-11T22:35:50.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.327+0000 7f7b9ffff640 1 --2- 172.21.15.100:0/4081217555 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7ba406be30 0x7f7ba406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:50.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.327+0000 7f7b9ffff640 1 -- 172.21.15.100:0/4081217555 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f7ba80ab9e0 con 0x7f7bb806c3a0 2024-09-11T22:35:50.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.327+0000 7f7bb67fc640 1 --2- 172.21.15.100:0/4081217555 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7ba406be30 0x7f7ba406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:50.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.327+0000 7f7bb67fc640 1 --2- 172.21.15.100:0/4081217555 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7ba406be30 0x7f7ba406e2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7bb81541b0 tx=0x7f7bac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:50.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.331+0000 7f7b9ffff640 1 -- 172.21.15.100:0/4081217555 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7ba804b030 con 0x7f7bb806c3a0 2024-09-11T22:35:50.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.511+0000 7f7bbd918640 1 -- 172.21.15.100:0/4081217555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7bb8154970 con 0x7f7bb806c3a0 2024-09-11T22:35:50.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.511+0000 7f7b9ffff640 1 -- 172.21.15.100:0/4081217555 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f7ba8079f70 con 0x7f7bb806c3a0 2024-09-11T22:35:50.512 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-09-11T22:35:50.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.513+0000 7f7bbd918640 1 -- 172.21.15.100:0/4081217555 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7ba406be30 msgr2=0x7f7ba406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:50.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.513+0000 7f7bbd918640 1 --2- 172.21.15.100:0/4081217555 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7ba406be30 0x7f7ba406e2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7bb81541b0 tx=0x7f7bac008040 comp rx=0 tx=0).stop 2024-09-11T22:35:50.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.513+0000 7f7bbd918640 1 -- 172.21.15.100:0/4081217555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bb806c3a0 msgr2=0x7f7bb80af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:50.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.513+0000 7f7bbd918640 1 --2- 172.21.15.100:0/4081217555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bb806c3a0 0x7f7bb80af730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7ba80097c0 tx=0x7f7ba80046c0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.513+0000 7f7bbd918640 1 -- 172.21.15.100:0/4081217555 shutdown_connections 2024-09-11T22:35:50.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.513+0000 7f7bbd918640 1 --2- 172.21.15.100:0/4081217555 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f7ba406be30 0x7f7ba406e2f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.513+0000 7f7bbd918640 1 --2- 172.21.15.100:0/4081217555 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bb80b20e0 0x7f7bb81f29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.513+0000 7f7bbd918640 1 --2- 172.21.15.100:0/4081217555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bb806cee0 0x7f7bb80b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.513+0000 7f7bbd918640 1 --2- 172.21.15.100:0/4081217555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7bb806c3a0 0x7f7bb80af730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.513+0000 7f7bbd918640 1 -- 172.21.15.100:0/4081217555 >> 172.21.15.100:0/4081217555 conn(0x7f7bb806ee80 msgr2=0x7f7bb815e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:50.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.513+0000 7f7bbd918640 1 -- 172.21.15.100:0/4081217555 shutdown_connections 2024-09-11T22:35:50.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.513+0000 7f7bbd918640 1 -- 172.21.15.100:0/4081217555 wait complete. 2024-09-11T22:35:50.525 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-11T22:35:50.525 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T22:35:50.542 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-11T22:35:50.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.681+0000 7fb92b053640 1 Processor -- start 2024-09-11T22:35:50.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.681+0000 7fb92b053640 1 -- start start 2024-09-11T22:35:50.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.681+0000 7fb92b053640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb9240c8b10 0x7fb92406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:50.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.681+0000 7fb92b053640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb9240b0c00 0x7fb9240cb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:50.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.681+0000 7fb92b053640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9240c98f0 con 0x7fb924152a80 2024-09-11T22:35:50.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.681+0000 7fb92b053640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb924152e60 con 0x7fb9240c8b10 2024-09-11T22:35:50.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.681+0000 7fb92b053640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fb9240c9050 con 0x7fb9240b0c00 2024-09-11T22:35:50.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.682+0000 7fb923fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb9240c8b10 0x7fb92406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:50.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.682+0000 7fb923fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb9240c8b10 0x7fb92406ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38978/0 (socket says 172.21.15.100:38978) 2024-09-11T22:35:50.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.682+0000 7fb923fff640 1 -- 172.21.15.100:0/2567413198 learned_addr learned my addr 172.21.15.100:0/2567413198 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:50.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.682+0000 7fb9295f0640 1 --2- 172.21.15.100:0/2567413198 >> v2:172.21.15.167:3300/0 conn(0x7fb9240b0c00 0x7fb9240cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:50.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.682+0000 7fb923fff640 1 -- 172.21.15.100:0/2567413198 >> v2:172.21.15.167:3300/0 conn(0x7fb9240b0c00 msgr2=0x7fb9240cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:50.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.682+0000 7fb923fff640 1 --2- 172.21.15.100:0/2567413198 >> v2:172.21.15.167:3300/0 conn(0x7fb9240b0c00 0x7fb9240cb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.682+0000 7fb923fff640 1 -- 172.21.15.100:0/2567413198 >> v1:172.21.15.167:6789/0 conn(0x7fb924152a80 legacy=0x7fb924159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:50.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.682+0000 7fb923fff640 1 -- 172.21.15.100:0/2567413198 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9240c9330 con 0x7fb9240c8b10 2024-09-11T22:35:50.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.683+0000 7fb923fff640 1 --2- 172.21.15.100:0/2567413198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9240c8b10 0x7fb92406ff90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb924073710 tx=0x7fb91402a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be3779015f0f689 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:50.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.683+0000 7fb9237fe640 1 -- 172.21.15.100:0/2567413198 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914036070 con 0x7fb9240c8b10 2024-09-11T22:35:50.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.683+0000 7fb9237fe640 1 -- 172.21.15.100:0/2567413198 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb914031600 con 0x7fb9240c8b10 2024-09-11T22:35:50.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.683+0000 7fb9237fe640 1 -- 172.21.15.100:0/2567413198 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9140319f0 con 0x7fb9240c8b10 2024-09-11T22:35:50.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.683+0000 7fb92b053640 1 -- 172.21.15.100:0/2567413198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9240c8b10 msgr2=0x7fb92406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:50.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.683+0000 7fb92b053640 1 --2- 172.21.15.100:0/2567413198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9240c8b10 0x7fb92406ff90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb924073710 tx=0x7fb91402a7c0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.683+0000 7fb92b053640 1 -- 172.21.15.100:0/2567413198 shutdown_connections 2024-09-11T22:35:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.683+0000 7fb92b053640 1 --2- 172.21.15.100:0/2567413198 >> v2:172.21.15.167:3300/0 conn(0x7fb9240b0c00 0x7fb9240cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.683+0000 7fb92b053640 1 --2- 172.21.15.100:0/2567413198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9240c8b10 0x7fb92406ff90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.683+0000 7fb92b053640 1 -- 172.21.15.100:0/2567413198 >> 172.21.15.100:0/2567413198 conn(0x7fb92406e000 msgr2=0x7fb92406e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.683+0000 7fb92b053640 1 -- 172.21.15.100:0/2567413198 shutdown_connections 2024-09-11T22:35:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.683+0000 7fb92b053640 1 -- 172.21.15.100:0/2567413198 wait complete. 2024-09-11T22:35:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.684+0000 7fb92b053640 1 Processor -- start 2024-09-11T22:35:50.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.685+0000 7fb92b053640 1 -- start start 2024-09-11T22:35:50.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.685+0000 7fb92b053640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9240b0c00 0x7fb9241e5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:50.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.685+0000 7fb92b053640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9240c8b10 0x7fb9240c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:50.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.685+0000 7fb92b053640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb924152a80 0x7fb9240c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:50.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.685+0000 7fb92b053640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb924158b10 con 0x7fb9240c8b10 2024-09-11T22:35:50.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.685+0000 7fb92b053640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb924158830 con 0x7fb9240b0c00 2024-09-11T22:35:50.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.685+0000 7fb92b053640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb92415bc60 con 0x7fb924152a80 2024-09-11T22:35:50.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.685+0000 7fb923fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9240c8b10 0x7fb9240c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:50.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.686+0000 7fb923fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9240c8b10 0x7fb9240c7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38994/0 (socket says 172.21.15.100:38994) 2024-09-11T22:35:50.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.686+0000 7fb923fff640 1 -- 172.21.15.100:0/1723342885 learned_addr learned my addr 172.21.15.100:0/1723342885 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:50.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.686+0000 7fb928def640 1 --2- 172.21.15.100:0/1723342885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9240b0c00 0x7fb9241e5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:50.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.686+0000 7fb9295f0640 1 --2- 172.21.15.100:0/1723342885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb924152a80 0x7fb9240c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:50.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.686+0000 7fb923fff640 1 -- 172.21.15.100:0/1723342885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb924152a80 msgr2=0x7fb9240c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:50.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.686+0000 7fb923fff640 1 --2- 172.21.15.100:0/1723342885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb924152a80 0x7fb9240c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.686+0000 7fb923fff640 1 -- 172.21.15.100:0/1723342885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9240b0c00 msgr2=0x7fb9241e5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:50.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.686+0000 7fb923fff640 1 --2- 172.21.15.100:0/1723342885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9240b0c00 0x7fb9241e5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.686+0000 7fb923fff640 1 -- 172.21.15.100:0/1723342885 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb924153860 con 0x7fb9240c8b10 2024-09-11T22:35:50.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.686+0000 7fb923fff640 1 --2- 172.21.15.100:0/1723342885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9240c8b10 0x7fb9240c7ea0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb91402a800 tx=0x7fb914004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:50.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.686+0000 7fb9217fa640 1 -- 172.21.15.100:0/1723342885 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914036050 con 0x7fb9240c8b10 2024-09-11T22:35:50.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.686+0000 7fb9217fa640 1 -- 172.21.15.100:0/1723342885 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb914042070 con 0x7fb9240c8b10 2024-09-11T22:35:50.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.686+0000 7fb92b053640 1 -- 172.21.15.100:0/1723342885 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb924152fe0 con 0x7fb9240c8b10 2024-09-11T22:35:50.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.686+0000 7fb9217fa640 1 -- 172.21.15.100:0/1723342885 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914009510 con 0x7fb9240c8b10 2024-09-11T22:35:50.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.686+0000 7fb92b053640 1 -- 172.21.15.100:0/1723342885 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9240c5960 con 0x7fb9240c8b10 2024-09-11T22:35:50.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.687+0000 7fb92b053640 1 -- 172.21.15.100:0/1723342885 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb92415cb80 con 0x7fb9240c8b10 2024-09-11T22:35:50.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.688+0000 7fb9217fa640 1 -- 172.21.15.100:0/1723342885 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb914004470 con 0x7fb9240c8b10 2024-09-11T22:35:50.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.688+0000 7fb9217fa640 1 --2- 172.21.15.100:0/1723342885 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb90406be30 0x7fb90406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:50.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.688+0000 7fb9217fa640 1 -- 172.21.15.100:0/1723342885 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fb9140ac000 con 0x7fb9240c8b10 2024-09-11T22:35:50.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.688+0000 7fb928def640 1 --2- 172.21.15.100:0/1723342885 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb90406be30 0x7fb90406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:50.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.689+0000 7fb928def640 1 --2- 172.21.15.100:0/1723342885 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb90406be30 0x7fb90406e2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb90c001780 tx=0x7fb90c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:50.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.693+0000 7fb9217fa640 1 -- 172.21.15.100:0/1723342885 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb92415cb80 con 0x7fb9240c8b10 2024-09-11T22:35:50.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.871+0000 7fb92b053640 1 -- 172.21.15.100:0/1723342885 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb9240c8800 con 0x7fb9240c8b10 2024-09-11T22:35:50.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.872+0000 7fb9217fa640 1 -- 172.21.15.100:0/1723342885 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7fb9240c8800 con 0x7fb9240c8b10 2024-09-11T22:35:50.873 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-09-11T22:35:50.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.874+0000 7fb92b053640 1 -- 172.21.15.100:0/1723342885 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb90406be30 msgr2=0x7fb90406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:50.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.874+0000 7fb92b053640 1 --2- 172.21.15.100:0/1723342885 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb90406be30 0x7fb90406e2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb90c001780 tx=0x7fb90c009040 comp rx=0 tx=0).stop 2024-09-11T22:35:50.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.874+0000 7fb92b053640 1 -- 172.21.15.100:0/1723342885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9240c8b10 msgr2=0x7fb9240c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:50.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.874+0000 7fb92b053640 1 --2- 172.21.15.100:0/1723342885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9240c8b10 0x7fb9240c7ea0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb91402a800 tx=0x7fb914004a40 comp rx=0 tx=0).stop 2024-09-11T22:35:50.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.874+0000 7fb92b053640 1 -- 172.21.15.100:0/1723342885 shutdown_connections 2024-09-11T22:35:50.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.874+0000 7fb92b053640 1 --2- 172.21.15.100:0/1723342885 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb90406be30 0x7fb90406e2f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.874+0000 7fb92b053640 1 --2- 172.21.15.100:0/1723342885 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb924152a80 0x7fb9240c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.874+0000 7fb92b053640 1 --2- 172.21.15.100:0/1723342885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9240c8b10 0x7fb9240c7ea0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.874+0000 7fb92b053640 1 --2- 172.21.15.100:0/1723342885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9240b0c00 0x7fb9241e5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:50.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.874+0000 7fb92b053640 1 -- 172.21.15.100:0/1723342885 >> 172.21.15.100:0/1723342885 conn(0x7fb92406e000 msgr2=0x7fb9240b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:50.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.874+0000 7fb92b053640 1 -- 172.21.15.100:0/1723342885 shutdown_connections 2024-09-11T22:35:50.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:50.874+0000 7fb92b053640 1 -- 172.21.15.100:0/1723342885 wait complete. 2024-09-11T22:35:50.886 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi100.front.sepia.ceph.com... 2024-09-11T22:35:50.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:35:50.886 DEBUG:teuthology.orchestra.run.smithi100:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-11T22:35:50.995 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:35:51.006 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi100.stderr:ceph-fuse[44867]: fuse finished with error 0 and tester_r 0 2024-09-11T22:35:57.096 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-09-11T22:35:57.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:35:57.097 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T22:35:57.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:35:57.117 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-09-11T22:35:57.547 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T22:35:57.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:35:57.548 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T22:35:57.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T22:35:57.578 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-09-11T22:35:57.676 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-11T22:35:57.685 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T22:35:57.685 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:35:57.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.799+0000 7fe6edf1a640 1 Processor -- start 2024-09-11T22:35:57.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.799+0000 7fe6edf1a640 1 -- start start 2024-09-11T22:35:57.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.800+0000 7fe6edf1a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe6e81529f0 0x7fe6e81593b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:57.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.800+0000 7fe6edf1a640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6e8158910 con 0x7fe6e806ec60 2024-09-11T22:35:57.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.800+0000 7fe6edf1a640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6e80c7b10 con 0x7fe6e80c9710 2024-09-11T22:35:57.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.800+0000 7fe6edf1a640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fe6e815cd20 con 0x7fe6e81529f0 2024-09-11T22:35:57.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.800+0000 7fe6e77fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe6e81529f0 0x7fe6e81593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:57.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.800+0000 7fe6e77fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe6e81529f0 0x7fe6e81593b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46704/0 (socket says 172.21.15.100:46704) 2024-09-11T22:35:57.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.800+0000 7fe6e6ffd640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe6e806ec60 0x7fe6e80c6820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55490/0 (socket says 172.21.15.100:55490) 2024-09-11T22:35:57.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.800+0000 7fe6e77fe640 1 -- 172.21.15.100:0/1880123437 learned_addr learned my addr 172.21.15.100:0/1880123437 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:57.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.800+0000 7fe6e77fe640 1 -- 172.21.15.100:0/1880123437 >> v1:172.21.15.167:6789/0 conn(0x7fe6e80c9710 legacy=0x7fe6e8163120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:57.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.800+0000 7fe6e77fe640 1 -- 172.21.15.100:0/1880123437 >> v1:172.21.15.100:6789/0 conn(0x7fe6e806ec60 legacy=0x7fe6e80c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:57.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.800+0000 7fe6e77fe640 1 -- 172.21.15.100:0/1880123437 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e80c7df0 con 0x7fe6e81529f0 2024-09-11T22:35:57.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.801+0000 7fe6e77fe640 1 --2- 172.21.15.100:0/1880123437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e81529f0 0x7fe6e81593b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009870 tx=0x7fe6d802a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25e222bdab57aef server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:57.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.801+0000 7fe6e67fc640 1 -- 172.21.15.100:0/1880123437 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8037070 con 0x7fe6e81529f0 2024-09-11T22:35:57.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.801+0000 7fe6e67fc640 1 -- 172.21.15.100:0/1880123437 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d8032640 con 0x7fe6e81529f0 2024-09-11T22:35:57.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.801+0000 7fe6e67fc640 1 -- 172.21.15.100:0/1880123437 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8032a10 con 0x7fe6e81529f0 2024-09-11T22:35:57.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.802+0000 7fe6edf1a640 1 -- 172.21.15.100:0/1880123437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e81529f0 msgr2=0x7fe6e81593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:57.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.802+0000 7fe6edf1a640 1 --2- 172.21.15.100:0/1880123437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e81529f0 0x7fe6e81593b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009870 tx=0x7fe6d802a3c0 comp rx=0 tx=0).stop 2024-09-11T22:35:57.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.802+0000 7fe6edf1a640 1 -- 172.21.15.100:0/1880123437 shutdown_connections 2024-09-11T22:35:57.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.802+0000 7fe6edf1a640 1 --2- 172.21.15.100:0/1880123437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e81529f0 0x7fe6e81593b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:57.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.802+0000 7fe6edf1a640 1 -- 172.21.15.100:0/1880123437 >> 172.21.15.100:0/1880123437 conn(0x7fe6e80cd110 msgr2=0x7fe6e80cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:57.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.802+0000 7fe6edf1a640 1 -- 172.21.15.100:0/1880123437 shutdown_connections 2024-09-11T22:35:57.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.802+0000 7fe6edf1a640 1 -- 172.21.15.100:0/1880123437 wait complete. 2024-09-11T22:35:57.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.803+0000 7fe6edf1a640 1 Processor -- start 2024-09-11T22:35:57.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.803+0000 7fe6edf1a640 1 -- start start 2024-09-11T22:35:57.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.804+0000 7fe6edf1a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6e806ec60 0x7fe6e814af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:57.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.804+0000 7fe6edf1a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e80c9710 0x7fe6e81e2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:57.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.804+0000 7fe6edf1a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6e81529f0 0x7fe6e8159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:57.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.804+0000 7fe6edf1a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e80c80d0 con 0x7fe6e80c9710 2024-09-11T22:35:57.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.804+0000 7fe6edf1a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e8158e90 con 0x7fe6e81529f0 2024-09-11T22:35:57.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.804+0000 7fe6edf1a640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe6e80c8250 con 0x7fe6e806ec60 2024-09-11T22:35:57.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.804+0000 7fe6e6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e80c9710 0x7fe6e81e2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:57.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.804+0000 7fe6e6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e80c9710 0x7fe6e81e2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46706/0 (socket says 172.21.15.100:46706) 2024-09-11T22:35:57.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.804+0000 7fe6e6ffd640 1 -- 172.21.15.100:0/1867468138 learned_addr learned my addr 172.21.15.100:0/1867468138 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:57.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.804+0000 7fe6e77fe640 1 --2- 172.21.15.100:0/1867468138 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6e806ec60 0x7fe6e814af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:57.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.804+0000 7fe6e7fff640 1 --2- 172.21.15.100:0/1867468138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6e81529f0 0x7fe6e8159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:57.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.804+0000 7fe6e6ffd640 1 -- 172.21.15.100:0/1867468138 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6e806ec60 msgr2=0x7fe6e814af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:57.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.804+0000 7fe6e6ffd640 1 --2- 172.21.15.100:0/1867468138 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6e806ec60 0x7fe6e814af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:57.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.804+0000 7fe6e6ffd640 1 -- 172.21.15.100:0/1867468138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6e81529f0 msgr2=0x7fe6e8159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:57.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.804+0000 7fe6e6ffd640 1 --2- 172.21.15.100:0/1867468138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6e81529f0 0x7fe6e8159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:57.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.804+0000 7fe6e6ffd640 1 -- 172.21.15.100:0/1867468138 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e81e3480 con 0x7fe6e80c9710 2024-09-11T22:35:57.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.804+0000 7fe6e6ffd640 1 --2- 172.21.15.100:0/1867468138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e80c9710 0x7fe6e81e2bf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc00c450 tx=0x7fe6dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:57.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.805+0000 7fe6cffff640 1 -- 172.21.15.100:0/1867468138 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc018070 con 0x7fe6e80c9710 2024-09-11T22:35:57.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.805+0000 7fe6cffff640 1 -- 172.21.15.100:0/1867468138 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6dc0074a0 con 0x7fe6e80c9710 2024-09-11T22:35:57.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.805+0000 7fe6cffff640 1 -- 172.21.15.100:0/1867468138 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc004a20 con 0x7fe6e80c9710 2024-09-11T22:35:57.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.805+0000 7fe6edf1a640 1 -- 172.21.15.100:0/1867468138 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6e81e3760 con 0x7fe6e80c9710 2024-09-11T22:35:57.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.805+0000 7fe6edf1a640 1 -- 172.21.15.100:0/1867468138 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6e81e3d20 con 0x7fe6e80c9710 2024-09-11T22:35:57.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.806+0000 7fe6edf1a640 1 -- 172.21.15.100:0/1867468138 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6e806e770 con 0x7fe6e80c9710 2024-09-11T22:35:57.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.806+0000 7fe6cffff640 1 -- 172.21.15.100:0/1867468138 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe6dc01b070 con 0x7fe6e80c9710 2024-09-11T22:35:57.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.807+0000 7fe6cffff640 1 --2- 172.21.15.100:0/1867468138 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe6d406be30 0x7fe6d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:57.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.807+0000 7fe6cffff640 1 -- 172.21.15.100:0/1867468138 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fe6dc08a370 con 0x7fe6e80c9710 2024-09-11T22:35:57.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.807+0000 7fe6e77fe640 1 --2- 172.21.15.100:0/1867468138 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe6d406be30 0x7fe6d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:57.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.807+0000 7fe6e77fe640 1 --2- 172.21.15.100:0/1867468138 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe6d406be30 0x7fe6d406e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8034000 tx=0x7fe6d802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:57.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.811+0000 7fe6cffff640 1 -- 172.21.15.100:0/1867468138 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe6dc007650 con 0x7fe6e80c9710 2024-09-11T22:35:57.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.979+0000 7fe6edf1a640 1 -- 172.21.15.100:0/1867468138 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6e814e9d0 con 0x7fe6d406be30 2024-09-11T22:35:57.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.988+0000 7fe6cffff640 1 -- 172.21.15.100:0/1867468138 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334184 (secure 0 0 0) 0x7fe6e814e9d0 con 0x7fe6d406be30 2024-09-11T22:35:57.992 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:35:57.994 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-11T22:35:57.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.991+0000 7fe6edf1a640 1 -- 172.21.15.100:0/1867468138 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe6d406be30 msgr2=0x7fe6d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:57.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.991+0000 7fe6edf1a640 1 --2- 172.21.15.100:0/1867468138 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe6d406be30 0x7fe6d406e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8034000 tx=0x7fe6d802e000 comp rx=0 tx=0).stop 2024-09-11T22:35:57.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.991+0000 7fe6edf1a640 1 -- 172.21.15.100:0/1867468138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e80c9710 msgr2=0x7fe6e81e2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:57.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.991+0000 7fe6edf1a640 1 --2- 172.21.15.100:0/1867468138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e80c9710 0x7fe6e81e2bf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc00c450 tx=0x7fe6dc00c910 comp rx=0 tx=0).stop 2024-09-11T22:35:57.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.991+0000 7fe6edf1a640 1 -- 172.21.15.100:0/1867468138 shutdown_connections 2024-09-11T22:35:57.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.991+0000 7fe6edf1a640 1 --2- 172.21.15.100:0/1867468138 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe6d406be30 0x7fe6d406e2f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:57.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.991+0000 7fe6edf1a640 1 --2- 172.21.15.100:0/1867468138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe6e81529f0 0x7fe6e8159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:57.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.991+0000 7fe6edf1a640 1 --2- 172.21.15.100:0/1867468138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6e80c9710 0x7fe6e81e2bf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:57.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.991+0000 7fe6edf1a640 1 --2- 172.21.15.100:0/1867468138 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe6e806ec60 0x7fe6e814af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:57.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.991+0000 7fe6edf1a640 1 -- 172.21.15.100:0/1867468138 >> 172.21.15.100:0/1867468138 conn(0x7fe6e80cd110 msgr2=0x7fe6e8157920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:57.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.991+0000 7fe6edf1a640 1 -- 172.21.15.100:0/1867468138 shutdown_connections 2024-09-11T22:35:57.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:57.991+0000 7fe6edf1a640 1 -- 172.21.15.100:0/1867468138 wait complete. 2024-09-11T22:35:58.003 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":497,"stamp":"2024-09-11T22:35:56.569072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":15595723,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":161,"num_read_kb":222,"num_write":880820,"num_write_kb":16633497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195563,"ondisk_log_size":195563,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8681656,"kb_used_data":20280,"kb_used_omap":12,"kb_used_meta":8661235,"kb_avail":746293064,"statfs":{"total":773094113280,"available":764204097536,"internally_reserved":0,"allocated":20766720,"data_stored":32163590,"data_compressed":2726282,"data_compressed_allocated":3776512,"data_compressed_original":16719872,"omap_allocated":12752,"internal_metadata":8869105200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1409414290,"num_objects":-358,"num_object_clones":0,"num_object_copies":-1432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-358,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003804"},"pg_stats":[{"pgid":"2.1f","version":"28'176","reported_seq":209,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.008974+0000","last_change":"2024-09-11T22:20:18.853007+0000","last_active":"2024-09-11T22:35:51.008974+0000","last_peered":"2024-09-11T22:35:51.008974+0000","last_clean":"2024-09-11T22:35:51.008974+0000","last_became_active":"2024-09-11T22:20:18.852740+0000","last_became_peered":"2024-09-11T22:20:18.852740+0000","last_unstale":"2024-09-11T22:35:51.008974+0000","last_undegraded":"2024-09-11T22:35:51.008974+0000","last_fullsized":"2024-09-11T22:35:51.008974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:46.710328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2323991,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":2359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'9","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.039561+0000","last_change":"2024-09-11T22:20:19.849765+0000","last_active":"2024-09-11T22:35:51.039561+0000","last_peered":"2024-09-11T22:35:51.039561+0000","last_clean":"2024-09-11T22:35:51.039561+0000","last_became_active":"2024-09-11T22:20:19.848619+0000","last_became_peered":"2024-09-11T22:20:19.848619+0000","last_unstale":"2024-09-11T22:35:51.039561+0000","last_undegraded":"2024-09-11T22:35:51.039561+0000","last_fullsized":"2024-09-11T22:35:51.039561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:57.621624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'6890","reported_seq":6914,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.779066+0000","last_change":"2024-09-11T22:20:24.078618+0000","last_active":"2024-09-11T22:35:44.779066+0000","last_peered":"2024-09-11T22:35:44.779066+0000","last_clean":"2024-09-11T22:35:44.779066+0000","last_became_active":"2024-09-11T22:20:24.078283+0000","last_became_peered":"2024-09-11T22:20:24.078283+0000","last_unstale":"2024-09-11T22:35:44.779066+0000","last_undegraded":"2024-09-11T22:35:44.779066+0000","last_fullsized":"2024-09-11T22:35:44.779066+0000","mapping_epoch":24,"log_start":"28'603","ondisk_log_start":"28'603","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6287,"log_dups_size":0,"ondisk_log_size":6287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:01.901307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31450,"num_write_kb":560141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'9","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.935502+0000","last_change":"2024-09-11T22:20:18.855945+0000","last_active":"2024-09-11T22:35:41.935502+0000","last_peered":"2024-09-11T22:35:41.935502+0000","last_clean":"2024-09-11T22:35:41.935502+0000","last_became_active":"2024-09-11T22:20:18.854811+0000","last_became_peered":"2024-09-11T22:20:18.854811+0000","last_unstale":"2024-09-11T22:35:41.935502+0000","last_undegraded":"2024-09-11T22:35:41.935502+0000","last_fullsized":"2024-09-11T22:35:41.935502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:47.508920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'21","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.063302+0000","last_change":"2024-09-11T22:20:19.862436+0000","last_active":"2024-09-11T22:35:51.063302+0000","last_peered":"2024-09-11T22:35:51.063302+0000","last_clean":"2024-09-11T22:35:51.063302+0000","last_became_active":"2024-09-11T22:20:19.862061+0000","last_became_peered":"2024-09-11T22:20:19.862061+0000","last_unstale":"2024-09-11T22:35:51.063302+0000","last_undegraded":"2024-09-11T22:35:51.063302+0000","last_fullsized":"2024-09-11T22:35:51.063302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'6406","reported_seq":6430,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.675651+0000","last_change":"2024-09-11T22:20:23.879729+0000","last_active":"2024-09-11T22:35:44.675651+0000","last_peered":"2024-09-11T22:35:44.675651+0000","last_clean":"2024-09-11T22:35:44.675651+0000","last_became_active":"2024-09-11T22:20:23.879245+0000","last_became_peered":"2024-09-11T22:20:23.879245+0000","last_unstale":"2024-09-11T22:35:44.675651+0000","last_undegraded":"2024-09-11T22:35:44.675651+0000","last_fullsized":"2024-09-11T22:35:44.675651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6406,"log_dups_size":0,"ondisk_log_size":6406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:36.836842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28787,"num_write_kb":536913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'13","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.849483+0000","last_change":"2024-09-11T22:20:18.853076+0000","last_active":"2024-09-11T22:35:37.849483+0000","last_peered":"2024-09-11T22:35:37.849483+0000","last_clean":"2024-09-11T22:35:37.849483+0000","last_became_active":"2024-09-11T22:20:18.852728+0000","last_became_peered":"2024-09-11T22:20:18.852728+0000","last_unstale":"2024-09-11T22:35:37.849483+0000","last_undegraded":"2024-09-11T22:35:37.849483+0000","last_fullsized":"2024-09-11T22:35:37.849483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'17","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.061939+0000","last_change":"2024-09-11T22:20:19.864544+0000","last_active":"2024-09-11T22:35:51.061939+0000","last_peered":"2024-09-11T22:35:51.061939+0000","last_clean":"2024-09-11T22:35:51.061939+0000","last_became_active":"2024-09-11T22:20:19.864234+0000","last_became_peered":"2024-09-11T22:20:19.864234+0000","last_unstale":"2024-09-11T22:35:51.061939+0000","last_undegraded":"2024-09-11T22:35:51.061939+0000","last_fullsized":"2024-09-11T22:35:51.061939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'5642","reported_seq":5666,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.746934+0000","last_change":"2024-09-11T22:20:23.873783+0000","last_active":"2024-09-11T22:35:44.746934+0000","last_peered":"2024-09-11T22:35:44.746934+0000","last_clean":"2024-09-11T22:35:44.746934+0000","last_became_active":"2024-09-11T22:20:23.873385+0000","last_became_peered":"2024-09-11T22:20:23.873385+0000","last_unstale":"2024-09-11T22:35:44.746934+0000","last_undegraded":"2024-09-11T22:35:44.746934+0000","last_fullsized":"2024-09-11T22:35:44.746934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5642,"log_dups_size":0,"ondisk_log_size":5642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24462,"num_write_kb":498902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'3","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:18.543924+0000","last_change":"2024-09-11T22:20:18.861530+0000","last_active":"2024-09-11T22:35:18.543924+0000","last_peered":"2024-09-11T22:35:18.543924+0000","last_clean":"2024-09-11T22:35:18.543924+0000","last_became_active":"2024-09-11T22:20:18.861230+0000","last_became_peered":"2024-09-11T22:20:18.861230+0000","last_unstale":"2024-09-11T22:35:18.543924+0000","last_undegraded":"2024-09-11T22:35:18.543924+0000","last_fullsized":"2024-09-11T22:35:18.543924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'27","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.063087+0000","last_change":"2024-09-11T22:20:19.863401+0000","last_active":"2024-09-11T22:35:51.063087+0000","last_peered":"2024-09-11T22:35:51.063087+0000","last_clean":"2024-09-11T22:35:51.063087+0000","last_became_active":"2024-09-11T22:20:19.863127+0000","last_became_peered":"2024-09-11T22:20:19.863127+0000","last_unstale":"2024-09-11T22:35:51.063087+0000","last_undegraded":"2024-09-11T22:35:51.063087+0000","last_fullsized":"2024-09-11T22:35:51.063087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:36.888544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'4900","reported_seq":4924,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.832935+0000","last_change":"2024-09-11T22:20:23.874650+0000","last_active":"2024-09-11T22:35:44.832935+0000","last_peered":"2024-09-11T22:35:44.832935+0000","last_clean":"2024-09-11T22:35:44.832935+0000","last_became_active":"2024-09-11T22:20:23.874040+0000","last_became_peered":"2024-09-11T22:20:23.874040+0000","last_unstale":"2024-09-11T22:35:44.832935+0000","last_undegraded":"2024-09-11T22:35:44.832935+0000","last_fullsized":"2024-09-11T22:35:44.832935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":4900,"log_dups_size":0,"ondisk_log_size":4900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21721,"num_write_kb":438879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'14","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.041380+0000","last_change":"2024-09-11T22:20:19.859446+0000","last_active":"2024-09-11T22:35:51.041380+0000","last_peered":"2024-09-11T22:35:51.041380+0000","last_clean":"2024-09-11T22:35:51.041380+0000","last_became_active":"2024-09-11T22:20:19.859106+0000","last_became_peered":"2024-09-11T22:20:19.859106+0000","last_unstale":"2024-09-11T22:35:51.041380+0000","last_undegraded":"2024-09-11T22:35:51.041380+0000","last_fullsized":"2024-09-11T22:35:51.041380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'1002","reported_seq":1034,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.946261+0000","last_change":"2024-09-11T22:20:18.856475+0000","last_active":"2024-09-11T22:35:41.946261+0000","last_peered":"2024-09-11T22:35:41.946261+0000","last_clean":"2024-09-11T22:35:41.946261+0000","last_became_active":"2024-09-11T22:20:18.856165+0000","last_became_peered":"2024-09-11T22:20:18.856165+0000","last_unstale":"2024-09-11T22:35:41.946261+0000","last_undegraded":"2024-09-11T22:35:41.946261+0000","last_fullsized":"2024-09-11T22:35:41.946261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1002,"log_dups_size":0,"ondisk_log_size":1002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":994,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'6307","reported_seq":6331,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.864098+0000","last_change":"2024-09-11T22:20:23.878121+0000","last_active":"2024-09-11T22:35:44.864098+0000","last_peered":"2024-09-11T22:35:44.864098+0000","last_clean":"2024-09-11T22:35:44.864098+0000","last_became_active":"2024-09-11T22:20:23.877713+0000","last_became_peered":"2024-09-11T22:20:23.877713+0000","last_unstale":"2024-09-11T22:35:44.864098+0000","last_undegraded":"2024-09-11T22:35:44.864098+0000","last_fullsized":"2024-09-11T22:35:44.864098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6307,"log_dups_size":0,"ondisk_log_size":6307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28296,"num_write_kb":522771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'17","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.045109+0000","last_change":"2024-09-11T22:20:19.858358+0000","last_active":"2024-09-11T22:35:51.045109+0000","last_peered":"2024-09-11T22:35:51.045109+0000","last_clean":"2024-09-11T22:35:51.045109+0000","last_became_active":"2024-09-11T22:20:19.858057+0000","last_became_peered":"2024-09-11T22:20:19.858057+0000","last_unstale":"2024-09-11T22:35:51.045109+0000","last_undegraded":"2024-09-11T22:35:51.045109+0000","last_fullsized":"2024-09-11T22:35:51.045109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:07.839926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'7","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.931632+0000","last_change":"2024-09-11T22:20:18.853818+0000","last_active":"2024-09-11T22:35:41.931632+0000","last_peered":"2024-09-11T22:35:41.931632+0000","last_clean":"2024-09-11T22:35:41.931632+0000","last_became_active":"2024-09-11T22:20:18.853508+0000","last_became_peered":"2024-09-11T22:20:18.853508+0000","last_unstale":"2024-09-11T22:35:41.931632+0000","last_undegraded":"2024-09-11T22:35:41.931632+0000","last_fullsized":"2024-09-11T22:35:41.931632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:58.141587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'6073","reported_seq":6104,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.786267+0000","last_change":"2024-09-11T22:21:02.037670+0000","last_active":"2024-09-11T22:35:44.786267+0000","last_peered":"2024-09-11T22:35:44.786267+0000","last_clean":"2024-09-11T22:35:44.786267+0000","last_became_active":"2024-09-11T22:21:02.036941+0000","last_became_peered":"2024-09-11T22:21:02.036941+0000","last_unstale":"2024-09-11T22:35:44.786267+0000","last_undegraded":"2024-09-11T22:35:44.786267+0000","last_fullsized":"2024-09-11T22:35:44.786267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6073,"log_dups_size":0,"ondisk_log_size":6073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:20.859515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27207,"num_write_kb":522378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'18","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043412+0000","last_change":"2024-09-11T22:20:19.844748+0000","last_active":"2024-09-11T22:35:51.043412+0000","last_peered":"2024-09-11T22:35:51.043412+0000","last_clean":"2024-09-11T22:35:51.043412+0000","last_became_active":"2024-09-11T22:20:19.844446+0000","last_became_peered":"2024-09-11T22:20:19.844446+0000","last_unstale":"2024-09-11T22:35:51.043412+0000","last_undegraded":"2024-09-11T22:35:51.043412+0000","last_fullsized":"2024-09-11T22:35:51.043412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:13.319918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'6","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.366967+0000","last_change":"2024-09-11T22:20:18.847388+0000","last_active":"2024-09-11T22:35:37.366967+0000","last_peered":"2024-09-11T22:35:37.366967+0000","last_clean":"2024-09-11T22:35:37.366967+0000","last_became_active":"2024-09-11T22:20:18.847118+0000","last_became_peered":"2024-09-11T22:20:18.847118+0000","last_unstale":"2024-09-11T22:35:37.366967+0000","last_undegraded":"2024-09-11T22:35:37.366967+0000","last_fullsized":"2024-09-11T22:35:37.366967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:47.360920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'7846","reported_seq":7870,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.854263+0000","last_change":"2024-09-11T22:20:24.077604+0000","last_active":"2024-09-11T22:35:44.854263+0000","last_peered":"2024-09-11T22:35:44.854263+0000","last_clean":"2024-09-11T22:35:44.854263+0000","last_became_active":"2024-09-11T22:20:24.077231+0000","last_became_peered":"2024-09-11T22:20:24.077231+0000","last_unstale":"2024-09-11T22:35:44.854263+0000","last_undegraded":"2024-09-11T22:35:44.854263+0000","last_fullsized":"2024-09-11T22:35:44.854263+0000","mapping_epoch":24,"log_start":"28'701","ondisk_log_start":"28'701","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":7145,"log_dups_size":0,"ondisk_log_size":7145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:38.846688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35635,"num_write_kb":625996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"28'12","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.030058+0000","last_change":"2024-09-11T22:20:19.854453+0000","last_active":"2024-09-11T22:35:51.030058+0000","last_peered":"2024-09-11T22:35:51.030058+0000","last_clean":"2024-09-11T22:35:51.030058+0000","last_became_active":"2024-09-11T22:20:19.854100+0000","last_became_peered":"2024-09-11T22:20:19.854100+0000","last_unstale":"2024-09-11T22:35:51.030058+0000","last_undegraded":"2024-09-11T22:35:51.030058+0000","last_fullsized":"2024-09-11T22:35:51.030058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:06.166813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.334898+0000","last_change":"2024-09-11T22:20:18.854889+0000","last_active":"2024-09-11T22:35:37.334898+0000","last_peered":"2024-09-11T22:35:37.334898+0000","last_clean":"2024-09-11T22:35:37.334898+0000","last_became_active":"2024-09-11T22:20:18.854552+0000","last_became_peered":"2024-09-11T22:20:18.854552+0000","last_unstale":"2024-09-11T22:35:37.334898+0000","last_undegraded":"2024-09-11T22:35:37.334898+0000","last_fullsized":"2024-09-11T22:35:37.334898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:33.612126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'4949","reported_seq":4973,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.864497+0000","last_change":"2024-09-11T22:20:23.878932+0000","last_active":"2024-09-11T22:35:44.864497+0000","last_peered":"2024-09-11T22:35:44.864497+0000","last_clean":"2024-09-11T22:35:44.864497+0000","last_became_active":"2024-09-11T22:20:23.878305+0000","last_became_peered":"2024-09-11T22:20:23.878305+0000","last_unstale":"2024-09-11T22:35:44.864497+0000","last_undegraded":"2024-09-11T22:35:44.864497+0000","last_fullsized":"2024-09-11T22:35:44.864497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":4949,"log_dups_size":0,"ondisk_log_size":4949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21676,"num_write_kb":446977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'26","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043612+0000","last_change":"2024-09-11T22:20:19.856318+0000","last_active":"2024-09-11T22:35:51.043612+0000","last_peered":"2024-09-11T22:35:51.043612+0000","last_clean":"2024-09-11T22:35:51.043612+0000","last_became_active":"2024-09-11T22:20:19.855992+0000","last_became_peered":"2024-09-11T22:20:19.855992+0000","last_unstale":"2024-09-11T22:35:51.043612+0000","last_undegraded":"2024-09-11T22:35:51.043612+0000","last_fullsized":"2024-09-11T22:35:51.043612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:57.709140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'6","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:28.337628+0000","last_change":"2024-09-11T22:20:18.850750+0000","last_active":"2024-09-11T22:35:28.337628+0000","last_peered":"2024-09-11T22:35:28.337628+0000","last_clean":"2024-09-11T22:35:28.337628+0000","last_became_active":"2024-09-11T22:20:18.849621+0000","last_became_peered":"2024-09-11T22:20:18.849621+0000","last_unstale":"2024-09-11T22:35:28.337628+0000","last_undegraded":"2024-09-11T22:35:28.337628+0000","last_fullsized":"2024-09-11T22:35:28.337628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'5822","reported_seq":5847,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.807191+0000","last_change":"2024-09-11T22:20:24.077741+0000","last_active":"2024-09-11T22:35:44.807191+0000","last_peered":"2024-09-11T22:35:44.807191+0000","last_clean":"2024-09-11T22:35:44.807191+0000","last_became_active":"2024-09-11T22:20:24.077325+0000","last_became_peered":"2024-09-11T22:20:24.077325+0000","last_unstale":"2024-09-11T22:35:44.807191+0000","last_undegraded":"2024-09-11T22:35:44.807191+0000","last_fullsized":"2024-09-11T22:35:44.807191+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5822,"log_dups_size":0,"ondisk_log_size":5822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:18.656529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26961,"num_write_kb":521330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'18","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.057658+0000","last_change":"2024-09-11T22:20:19.850738+0000","last_active":"2024-09-11T22:35:51.057658+0000","last_peered":"2024-09-11T22:35:51.057658+0000","last_clean":"2024-09-11T22:35:51.057658+0000","last_became_active":"2024-09-11T22:20:19.850441+0000","last_became_peered":"2024-09-11T22:20:19.850441+0000","last_unstale":"2024-09-11T22:35:51.057658+0000","last_undegraded":"2024-09-11T22:35:51.057658+0000","last_fullsized":"2024-09-11T22:35:51.057658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:47.552343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'351","reported_seq":384,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.969721+0000","last_change":"2024-09-11T22:20:18.845173+0000","last_active":"2024-09-11T22:35:41.969721+0000","last_peered":"2024-09-11T22:35:41.969721+0000","last_clean":"2024-09-11T22:35:41.969721+0000","last_became_active":"2024-09-11T22:20:18.844731+0000","last_became_peered":"2024-09-11T22:20:18.844731+0000","last_unstale":"2024-09-11T22:35:41.969721+0000","last_undegraded":"2024-09-11T22:35:41.969721+0000","last_fullsized":"2024-09-11T22:35:41.969721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:32.963285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'6627","reported_seq":6659,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.761641+0000","last_change":"2024-09-11T22:21:02.037927+0000","last_active":"2024-09-11T22:35:44.761641+0000","last_peered":"2024-09-11T22:35:44.761641+0000","last_clean":"2024-09-11T22:35:44.761641+0000","last_became_active":"2024-09-11T22:21:02.037520+0000","last_became_peered":"2024-09-11T22:21:02.037520+0000","last_unstale":"2024-09-11T22:35:44.761641+0000","last_undegraded":"2024-09-11T22:35:44.761641+0000","last_fullsized":"2024-09-11T22:35:44.761641+0000","mapping_epoch":27,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6327,"log_dups_size":0,"ondisk_log_size":6327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:38.798530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30659,"num_write_kb":569042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'18","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.040494+0000","last_change":"2024-09-11T22:20:19.845497+0000","last_active":"2024-09-11T22:35:51.040494+0000","last_peered":"2024-09-11T22:35:51.040494+0000","last_clean":"2024-09-11T22:35:51.040494+0000","last_became_active":"2024-09-11T22:20:19.845203+0000","last_became_peered":"2024-09-11T22:20:19.845203+0000","last_unstale":"2024-09-11T22:35:51.040494+0000","last_undegraded":"2024-09-11T22:35:51.040494+0000","last_fullsized":"2024-09-11T22:35:51.040494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:12.086231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.363453+0000","last_change":"2024-09-11T22:20:18.856263+0000","last_active":"2024-09-11T22:35:37.363453+0000","last_peered":"2024-09-11T22:35:37.363453+0000","last_clean":"2024-09-11T22:35:37.363453+0000","last_became_active":"2024-09-11T22:20:18.855968+0000","last_became_peered":"2024-09-11T22:20:18.855968+0000","last_unstale":"2024-09-11T22:35:37.363453+0000","last_undegraded":"2024-09-11T22:35:37.363453+0000","last_fullsized":"2024-09-11T22:35:37.363453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'5454","reported_seq":5479,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.210141+0000","last_change":"2024-09-11T22:20:24.075030+0000","last_active":"2024-09-11T22:35:44.210141+0000","last_peered":"2024-09-11T22:35:44.210141+0000","last_clean":"2024-09-11T22:35:44.210141+0000","last_became_active":"2024-09-11T22:20:24.074588+0000","last_became_peered":"2024-09-11T22:20:24.074588+0000","last_unstale":"2024-09-11T22:35:44.210141+0000","last_undegraded":"2024-09-11T22:35:44.210141+0000","last_fullsized":"2024-09-11T22:35:44.210141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5454,"log_dups_size":0,"ondisk_log_size":5454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25186,"num_write_kb":469240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'18","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.062538+0000","last_change":"2024-09-11T22:20:19.859010+0000","last_active":"2024-09-11T22:35:51.062538+0000","last_peered":"2024-09-11T22:35:51.062538+0000","last_clean":"2024-09-11T22:35:51.062538+0000","last_became_active":"2024-09-11T22:20:19.858585+0000","last_became_peered":"2024-09-11T22:20:19.858585+0000","last_unstale":"2024-09-11T22:35:51.062538+0000","last_undegraded":"2024-09-11T22:35:51.062538+0000","last_fullsized":"2024-09-11T22:35:51.062538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.850550+0000","last_change":"2024-09-11T22:20:18.847904+0000","last_active":"2024-09-11T22:35:37.850550+0000","last_peered":"2024-09-11T22:35:37.850550+0000","last_clean":"2024-09-11T22:35:37.850550+0000","last_became_active":"2024-09-11T22:20:18.847669+0000","last_became_peered":"2024-09-11T22:20:18.847669+0000","last_unstale":"2024-09-11T22:35:37.850550+0000","last_undegraded":"2024-09-11T22:35:37.850550+0000","last_fullsized":"2024-09-11T22:35:37.850550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:08.717999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'6951","reported_seq":6976,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.741120+0000","last_change":"2024-09-11T22:20:23.881067+0000","last_active":"2024-09-11T22:35:44.741120+0000","last_peered":"2024-09-11T22:35:44.741120+0000","last_clean":"2024-09-11T22:35:44.741120+0000","last_became_active":"2024-09-11T22:20:23.880468+0000","last_became_peered":"2024-09-11T22:20:23.880468+0000","last_unstale":"2024-09-11T22:35:44.741120+0000","last_undegraded":"2024-09-11T22:35:44.741120+0000","last_fullsized":"2024-09-11T22:35:44.741120+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6951,"log_dups_size":0,"ondisk_log_size":6951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:23.480547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31360,"num_write_kb":584090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'17","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.049873+0000","last_change":"2024-09-11T22:20:19.860423+0000","last_active":"2024-09-11T22:35:51.049873+0000","last_peered":"2024-09-11T22:35:51.049873+0000","last_clean":"2024-09-11T22:35:51.049873+0000","last_became_active":"2024-09-11T22:20:19.858932+0000","last_became_peered":"2024-09-11T22:20:19.858932+0000","last_unstale":"2024-09-11T22:35:51.049873+0000","last_undegraded":"2024-09-11T22:35:51.049873+0000","last_fullsized":"2024-09-11T22:35:51.049873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:53.255932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'6","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.950652+0000","last_change":"2024-09-11T22:20:18.854973+0000","last_active":"2024-09-11T22:35:41.950652+0000","last_peered":"2024-09-11T22:35:41.950652+0000","last_clean":"2024-09-11T22:35:41.950652+0000","last_became_active":"2024-09-11T22:20:18.854725+0000","last_became_peered":"2024-09-11T22:20:18.854725+0000","last_unstale":"2024-09-11T22:35:41.950652+0000","last_undegraded":"2024-09-11T22:35:41.950652+0000","last_fullsized":"2024-09-11T22:35:41.950652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'6039","reported_seq":6064,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.873235+0000","last_change":"2024-09-11T22:20:23.880693+0000","last_active":"2024-09-11T22:35:44.873235+0000","last_peered":"2024-09-11T22:35:44.873235+0000","last_clean":"2024-09-11T22:35:44.873235+0000","last_became_active":"2024-09-11T22:20:23.880243+0000","last_became_peered":"2024-09-11T22:20:23.880243+0000","last_unstale":"2024-09-11T22:35:44.873235+0000","last_undegraded":"2024-09-11T22:35:44.873235+0000","last_fullsized":"2024-09-11T22:35:44.873235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6039,"log_dups_size":0,"ondisk_log_size":6039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.659287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27825,"num_write_kb":504386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'23","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.040905+0000","last_change":"2024-09-11T22:20:19.844808+0000","last_active":"2024-09-11T22:35:51.040905+0000","last_peered":"2024-09-11T22:35:51.040905+0000","last_clean":"2024-09-11T22:35:51.040905+0000","last_became_active":"2024-09-11T22:20:19.844536+0000","last_became_peered":"2024-09-11T22:20:19.844536+0000","last_unstale":"2024-09-11T22:35:51.040905+0000","last_undegraded":"2024-09-11T22:35:51.040905+0000","last_fullsized":"2024-09-11T22:35:51.040905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:57.142383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'51","reported_seq":129,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:31.518080+0000","last_change":"2024-09-11T22:20:18.855640+0000","last_active":"2024-09-11T22:35:31.518080+0000","last_peered":"2024-09-11T22:35:31.518080+0000","last_clean":"2024-09-11T22:35:31.518080+0000","last_became_active":"2024-09-11T22:20:18.855394+0000","last_became_peered":"2024-09-11T22:20:18.855394+0000","last_unstale":"2024-09-11T22:35:31.518080+0000","last_undegraded":"2024-09-11T22:35:31.518080+0000","last_fullsized":"2024-09-11T22:35:31.518080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94258,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":122,"num_write":49,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'6775","reported_seq":6800,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.543280+0000","last_change":"2024-09-11T22:20:23.882554+0000","last_active":"2024-09-11T22:35:44.543280+0000","last_peered":"2024-09-11T22:35:44.543280+0000","last_clean":"2024-09-11T22:35:44.543280+0000","last_became_active":"2024-09-11T22:20:23.881642+0000","last_became_peered":"2024-09-11T22:20:23.881642+0000","last_unstale":"2024-09-11T22:35:44.543280+0000","last_undegraded":"2024-09-11T22:35:44.543280+0000","last_fullsized":"2024-09-11T22:35:44.543280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6775,"log_dups_size":0,"ondisk_log_size":6775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:16.696043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30543,"num_write_kb":560301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'13","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.041208+0000","last_change":"2024-09-11T22:20:19.859429+0000","last_active":"2024-09-11T22:35:51.041208+0000","last_peered":"2024-09-11T22:35:51.041208+0000","last_clean":"2024-09-11T22:35:51.041208+0000","last_became_active":"2024-09-11T22:20:19.859159+0000","last_became_peered":"2024-09-11T22:20:19.859159+0000","last_unstale":"2024-09-11T22:35:51.041208+0000","last_undegraded":"2024-09-11T22:35:51.041208+0000","last_fullsized":"2024-09-11T22:35:51.041208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:02.696450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'8","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.980499+0000","last_change":"2024-09-11T22:20:18.856144+0000","last_active":"2024-09-11T22:35:41.980499+0000","last_peered":"2024-09-11T22:35:41.980499+0000","last_clean":"2024-09-11T22:35:41.980499+0000","last_became_active":"2024-09-11T22:20:18.855866+0000","last_became_peered":"2024-09-11T22:20:18.855866+0000","last_unstale":"2024-09-11T22:35:41.980499+0000","last_undegraded":"2024-09-11T22:35:41.980499+0000","last_fullsized":"2024-09-11T22:35:41.980499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:37.259393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'5391","reported_seq":5416,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.679630+0000","last_change":"2024-09-11T22:20:24.075154+0000","last_active":"2024-09-11T22:35:44.679630+0000","last_peered":"2024-09-11T22:35:44.679630+0000","last_clean":"2024-09-11T22:35:44.679630+0000","last_became_active":"2024-09-11T22:20:24.074568+0000","last_became_peered":"2024-09-11T22:20:24.074568+0000","last_unstale":"2024-09-11T22:35:44.679630+0000","last_undegraded":"2024-09-11T22:35:44.679630+0000","last_fullsized":"2024-09-11T22:35:44.679630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5391,"log_dups_size":0,"ondisk_log_size":5391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:09.804991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24494,"num_write_kb":454589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'16","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.061776+0000","last_change":"2024-09-11T22:20:19.861236+0000","last_active":"2024-09-11T22:35:51.061776+0000","last_peered":"2024-09-11T22:35:51.061776+0000","last_clean":"2024-09-11T22:35:51.061776+0000","last_became_active":"2024-09-11T22:20:19.860938+0000","last_became_peered":"2024-09-11T22:20:19.860938+0000","last_unstale":"2024-09-11T22:35:51.061776+0000","last_undegraded":"2024-09-11T22:35:51.061776+0000","last_fullsized":"2024-09-11T22:35:51.061776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:42.015334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'4","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:32:48.462376+0000","last_change":"2024-09-11T22:20:18.853467+0000","last_active":"2024-09-11T22:32:48.462376+0000","last_peered":"2024-09-11T22:32:48.462376+0000","last_clean":"2024-09-11T22:32:48.462376+0000","last_became_active":"2024-09-11T22:20:18.853182+0000","last_became_peered":"2024-09-11T22:20:18.853182+0000","last_unstale":"2024-09-11T22:32:48.462376+0000","last_undegraded":"2024-09-11T22:32:48.462376+0000","last_fullsized":"2024-09-11T22:32:48.462376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":189,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:32:13.435821+0000","last_change":"2024-09-11T22:20:09.425648+0000","last_active":"2024-09-11T22:32:13.435821+0000","last_peered":"2024-09-11T22:32:13.435821+0000","last_clean":"2024-09-11T22:32:13.435821+0000","last_became_active":"2024-09-11T22:20:09.424591+0000","last_became_peered":"2024-09-11T22:20:09.424591+0000","last_unstale":"2024-09-11T22:32:13.435821+0000","last_undegraded":"2024-09-11T22:32:13.435821+0000","last_fullsized":"2024-09-11T22:32:13.435821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_clean_scrub_stamp":"2024-09-11T22:20:08.334092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:53.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'5687","reported_seq":5712,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.790987+0000","last_change":"2024-09-11T22:20:24.077007+0000","last_active":"2024-09-11T22:35:44.790987+0000","last_peered":"2024-09-11T22:35:44.790987+0000","last_clean":"2024-09-11T22:35:44.790987+0000","last_became_active":"2024-09-11T22:20:24.076601+0000","last_became_peered":"2024-09-11T22:20:24.076601+0000","last_unstale":"2024-09-11T22:35:44.790987+0000","last_undegraded":"2024-09-11T22:35:44.790987+0000","last_fullsized":"2024-09-11T22:35:44.790987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5687,"log_dups_size":0,"ondisk_log_size":5687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25854,"num_write_kb":500757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'22","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.063439+0000","last_change":"2024-09-11T22:20:19.863279+0000","last_active":"2024-09-11T22:35:51.063439+0000","last_peered":"2024-09-11T22:35:51.063439+0000","last_clean":"2024-09-11T22:35:51.063439+0000","last_became_active":"2024-09-11T22:20:19.861322+0000","last_became_peered":"2024-09-11T22:20:19.861322+0000","last_unstale":"2024-09-11T22:35:51.063439+0000","last_undegraded":"2024-09-11T22:35:51.063439+0000","last_fullsized":"2024-09-11T22:35:51.063439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'5","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:33:51.687511+0000","last_change":"2024-09-11T22:20:18.853343+0000","last_active":"2024-09-11T22:33:51.687511+0000","last_peered":"2024-09-11T22:33:51.687511+0000","last_clean":"2024-09-11T22:33:51.687511+0000","last_became_active":"2024-09-11T22:20:18.853069+0000","last_became_peered":"2024-09-11T22:20:18.853069+0000","last_unstale":"2024-09-11T22:33:51.687511+0000","last_undegraded":"2024-09-11T22:33:51.687511+0000","last_fullsized":"2024-09-11T22:33:51.687511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'5968","reported_seq":5993,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.663026+0000","last_change":"2024-09-11T22:20:24.075350+0000","last_active":"2024-09-11T22:35:44.663026+0000","last_peered":"2024-09-11T22:35:44.663026+0000","last_clean":"2024-09-11T22:35:44.663026+0000","last_became_active":"2024-09-11T22:20:24.074789+0000","last_became_peered":"2024-09-11T22:20:24.074789+0000","last_unstale":"2024-09-11T22:35:44.663026+0000","last_undegraded":"2024-09-11T22:35:44.663026+0000","last_fullsized":"2024-09-11T22:35:44.663026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5968,"log_dups_size":0,"ondisk_log_size":5968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27295,"num_write_kb":514661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'20","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.061734+0000","last_change":"2024-09-11T22:20:19.866331+0000","last_active":"2024-09-11T22:35:51.061734+0000","last_peered":"2024-09-11T22:35:51.061734+0000","last_clean":"2024-09-11T22:35:51.061734+0000","last_became_active":"2024-09-11T22:20:19.865535+0000","last_became_peered":"2024-09-11T22:20:19.865535+0000","last_unstale":"2024-09-11T22:35:51.061734+0000","last_undegraded":"2024-09-11T22:35:51.061734+0000","last_fullsized":"2024-09-11T22:35:51.061734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'2","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:33:54.589490+0000","last_change":"2024-09-11T22:20:18.849434+0000","last_active":"2024-09-11T22:33:54.589490+0000","last_peered":"2024-09-11T22:33:54.589490+0000","last_clean":"2024-09-11T22:33:54.589490+0000","last_became_active":"2024-09-11T22:20:18.848787+0000","last_became_peered":"2024-09-11T22:20:18.848787+0000","last_unstale":"2024-09-11T22:33:54.589490+0000","last_undegraded":"2024-09-11T22:33:54.589490+0000","last_fullsized":"2024-09-11T22:33:54.589490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:25.689495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'5430","reported_seq":5454,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.747663+0000","last_change":"2024-09-11T22:20:23.879962+0000","last_active":"2024-09-11T22:35:44.747663+0000","last_peered":"2024-09-11T22:35:44.747663+0000","last_clean":"2024-09-11T22:35:44.747663+0000","last_became_active":"2024-09-11T22:20:23.879586+0000","last_became_peered":"2024-09-11T22:20:23.879586+0000","last_unstale":"2024-09-11T22:35:44.747663+0000","last_undegraded":"2024-09-11T22:35:44.747663+0000","last_fullsized":"2024-09-11T22:35:44.747663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5430,"log_dups_size":0,"ondisk_log_size":5430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:27.323116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24342,"num_write_kb":478105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'21","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.056702+0000","last_change":"2024-09-11T22:20:19.860411+0000","last_active":"2024-09-11T22:35:51.056702+0000","last_peered":"2024-09-11T22:35:51.056702+0000","last_clean":"2024-09-11T22:35:51.056702+0000","last_became_active":"2024-09-11T22:20:19.860076+0000","last_became_peered":"2024-09-11T22:20:19.860076+0000","last_unstale":"2024-09-11T22:35:51.056702+0000","last_undegraded":"2024-09-11T22:35:51.056702+0000","last_fullsized":"2024-09-11T22:35:51.056702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'6","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.945924+0000","last_change":"2024-09-11T22:20:18.856020+0000","last_active":"2024-09-11T22:35:41.945924+0000","last_peered":"2024-09-11T22:35:41.945924+0000","last_clean":"2024-09-11T22:35:41.945924+0000","last_became_active":"2024-09-11T22:20:18.855753+0000","last_became_peered":"2024-09-11T22:20:18.855753+0000","last_unstale":"2024-09-11T22:35:41.945924+0000","last_undegraded":"2024-09-11T22:35:41.945924+0000","last_fullsized":"2024-09-11T22:35:41.945924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'6069","reported_seq":6094,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.538017+0000","last_change":"2024-09-11T22:20:24.077975+0000","last_active":"2024-09-11T22:35:44.538017+0000","last_peered":"2024-09-11T22:35:44.538017+0000","last_clean":"2024-09-11T22:35:44.538017+0000","last_became_active":"2024-09-11T22:20:24.077502+0000","last_became_peered":"2024-09-11T22:20:24.077502+0000","last_unstale":"2024-09-11T22:35:44.538017+0000","last_undegraded":"2024-09-11T22:35:44.538017+0000","last_fullsized":"2024-09-11T22:35:44.538017+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6069,"log_dups_size":0,"ondisk_log_size":6069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:16.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27695,"num_write_kb":495810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'12","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.052943+0000","last_change":"2024-09-11T22:20:19.856986+0000","last_active":"2024-09-11T22:35:51.052943+0000","last_peered":"2024-09-11T22:35:51.052943+0000","last_clean":"2024-09-11T22:35:51.052943+0000","last_became_active":"2024-09-11T22:20:19.856739+0000","last_became_peered":"2024-09-11T22:20:19.856739+0000","last_unstale":"2024-09-11T22:35:51.052943+0000","last_undegraded":"2024-09-11T22:35:51.052943+0000","last_fullsized":"2024-09-11T22:35:51.052943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'6","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.987646+0000","last_change":"2024-09-11T22:20:18.855044+0000","last_active":"2024-09-11T22:35:41.987646+0000","last_peered":"2024-09-11T22:35:41.987646+0000","last_clean":"2024-09-11T22:35:41.987646+0000","last_became_active":"2024-09-11T22:20:18.854764+0000","last_became_peered":"2024-09-11T22:20:18.854764+0000","last_unstale":"2024-09-11T22:35:41.987646+0000","last_undegraded":"2024-09-11T22:35:41.987646+0000","last_fullsized":"2024-09-11T22:35:41.987646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:22.207278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'5738","reported_seq":5763,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.723908+0000","last_change":"2024-09-11T22:20:23.878383+0000","last_active":"2024-09-11T22:35:44.723908+0000","last_peered":"2024-09-11T22:35:44.723908+0000","last_clean":"2024-09-11T22:35:44.723908+0000","last_became_active":"2024-09-11T22:20:23.877890+0000","last_became_peered":"2024-09-11T22:20:23.877890+0000","last_unstale":"2024-09-11T22:35:44.723908+0000","last_undegraded":"2024-09-11T22:35:44.723908+0000","last_fullsized":"2024-09-11T22:35:44.723908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5738,"log_dups_size":0,"ondisk_log_size":5738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:18.876485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25762,"num_write_kb":496113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'20","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.057770+0000","last_change":"2024-09-11T22:20:19.861242+0000","last_active":"2024-09-11T22:35:51.057770+0000","last_peered":"2024-09-11T22:35:51.057770+0000","last_clean":"2024-09-11T22:35:51.057770+0000","last_became_active":"2024-09-11T22:20:19.860988+0000","last_became_peered":"2024-09-11T22:20:19.860988+0000","last_unstale":"2024-09-11T22:35:51.057770+0000","last_undegraded":"2024-09-11T22:35:51.057770+0000","last_fullsized":"2024-09-11T22:35:51.057770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'19","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.960798+0000","last_change":"2024-09-11T22:20:18.852459+0000","last_active":"2024-09-11T22:35:41.960798+0000","last_peered":"2024-09-11T22:35:41.960798+0000","last_clean":"2024-09-11T22:35:41.960798+0000","last_became_active":"2024-09-11T22:20:18.852153+0000","last_became_peered":"2024-09-11T22:20:18.852153+0000","last_unstale":"2024-09-11T22:35:41.960798+0000","last_undegraded":"2024-09-11T22:35:41.960798+0000","last_fullsized":"2024-09-11T22:35:41.960798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'6219","reported_seq":6243,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.807182+0000","last_change":"2024-09-11T22:20:23.874062+0000","last_active":"2024-09-11T22:35:44.807182+0000","last_peered":"2024-09-11T22:35:44.807182+0000","last_clean":"2024-09-11T22:35:44.807182+0000","last_became_active":"2024-09-11T22:20:23.873635+0000","last_became_peered":"2024-09-11T22:20:23.873635+0000","last_unstale":"2024-09-11T22:35:44.807182+0000","last_undegraded":"2024-09-11T22:35:44.807182+0000","last_fullsized":"2024-09-11T22:35:44.807182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6219,"log_dups_size":0,"ondisk_log_size":6219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:40.914142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28436,"num_write_kb":547819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'20","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.045171+0000","last_change":"2024-09-11T22:20:19.851577+0000","last_active":"2024-09-11T22:35:51.045171+0000","last_peered":"2024-09-11T22:35:51.045171+0000","last_clean":"2024-09-11T22:35:51.045171+0000","last_became_active":"2024-09-11T22:20:19.851286+0000","last_became_peered":"2024-09-11T22:20:19.851286+0000","last_unstale":"2024-09-11T22:35:51.045171+0000","last_undegraded":"2024-09-11T22:35:51.045171+0000","last_fullsized":"2024-09-11T22:35:51.045171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:32.025931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'9","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.934456+0000","last_change":"2024-09-11T22:20:18.853301+0000","last_active":"2024-09-11T22:35:41.934456+0000","last_peered":"2024-09-11T22:35:41.934456+0000","last_clean":"2024-09-11T22:35:41.934456+0000","last_became_active":"2024-09-11T22:20:18.852978+0000","last_became_peered":"2024-09-11T22:20:18.852978+0000","last_unstale":"2024-09-11T22:35:41.934456+0000","last_undegraded":"2024-09-11T22:35:41.934456+0000","last_fullsized":"2024-09-11T22:35:41.934456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'6495","reported_seq":6519,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.721208+0000","last_change":"2024-09-11T22:20:24.077636+0000","last_active":"2024-09-11T22:35:44.721208+0000","last_peered":"2024-09-11T22:35:44.721208+0000","last_clean":"2024-09-11T22:35:44.721208+0000","last_became_active":"2024-09-11T22:20:24.077313+0000","last_became_peered":"2024-09-11T22:20:24.077313+0000","last_unstale":"2024-09-11T22:35:44.721208+0000","last_undegraded":"2024-09-11T22:35:44.721208+0000","last_fullsized":"2024-09-11T22:35:44.721208+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6295,"log_dups_size":0,"ondisk_log_size":6295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:23.154027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29875,"num_write_kb":541234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'29","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.056839+0000","last_change":"2024-09-11T22:20:19.862562+0000","last_active":"2024-09-11T22:35:51.056839+0000","last_peered":"2024-09-11T22:35:51.056839+0000","last_clean":"2024-09-11T22:35:51.056839+0000","last_became_active":"2024-09-11T22:20:19.862267+0000","last_became_peered":"2024-09-11T22:20:19.862267+0000","last_unstale":"2024-09-11T22:35:51.056839+0000","last_undegraded":"2024-09-11T22:35:51.056839+0000","last_fullsized":"2024-09-11T22:35:51.056839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'8","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.772343+0000","last_change":"2024-09-11T22:20:18.858002+0000","last_active":"2024-09-11T22:35:41.772343+0000","last_peered":"2024-09-11T22:35:41.772343+0000","last_clean":"2024-09-11T22:35:41.772343+0000","last_became_active":"2024-09-11T22:20:18.857419+0000","last_became_peered":"2024-09-11T22:20:18.857419+0000","last_unstale":"2024-09-11T22:35:41.772343+0000","last_undegraded":"2024-09-11T22:35:41.772343+0000","last_fullsized":"2024-09-11T22:35:41.772343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'6284","reported_seq":6308,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.748617+0000","last_change":"2024-09-11T22:20:24.074971+0000","last_active":"2024-09-11T22:35:44.748617+0000","last_peered":"2024-09-11T22:35:44.748617+0000","last_clean":"2024-09-11T22:35:44.748617+0000","last_became_active":"2024-09-11T22:20:24.074609+0000","last_became_peered":"2024-09-11T22:20:24.074609+0000","last_unstale":"2024-09-11T22:35:44.748617+0000","last_undegraded":"2024-09-11T22:35:44.748617+0000","last_fullsized":"2024-09-11T22:35:44.748617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6284,"log_dups_size":0,"ondisk_log_size":6284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:55.318904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27888,"num_write_kb":554175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'24","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.058304+0000","last_change":"2024-09-11T22:20:19.857276+0000","last_active":"2024-09-11T22:35:51.058304+0000","last_peered":"2024-09-11T22:35:51.058304+0000","last_clean":"2024-09-11T22:35:51.058304+0000","last_became_active":"2024-09-11T22:20:19.857027+0000","last_became_peered":"2024-09-11T22:20:19.857027+0000","last_unstale":"2024-09-11T22:35:51.058304+0000","last_undegraded":"2024-09-11T22:35:51.058304+0000","last_fullsized":"2024-09-11T22:35:51.058304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'11","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.763997+0000","last_change":"2024-09-11T22:20:18.848671+0000","last_active":"2024-09-11T22:35:41.763997+0000","last_peered":"2024-09-11T22:35:41.763997+0000","last_clean":"2024-09-11T22:35:41.763997+0000","last_became_active":"2024-09-11T22:20:18.848405+0000","last_became_peered":"2024-09-11T22:20:18.848405+0000","last_unstale":"2024-09-11T22:35:41.763997+0000","last_undegraded":"2024-09-11T22:35:41.763997+0000","last_fullsized":"2024-09-11T22:35:41.763997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'5107","reported_seq":5131,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.845298+0000","last_change":"2024-09-11T22:20:24.076835+0000","last_active":"2024-09-11T22:35:44.845298+0000","last_peered":"2024-09-11T22:35:44.845298+0000","last_clean":"2024-09-11T22:35:44.845298+0000","last_became_active":"2024-09-11T22:20:24.076200+0000","last_became_peered":"2024-09-11T22:20:24.076200+0000","last_unstale":"2024-09-11T22:35:44.845298+0000","last_undegraded":"2024-09-11T22:35:44.845298+0000","last_fullsized":"2024-09-11T22:35:44.845298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5107,"log_dups_size":0,"ondisk_log_size":5107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:48.150778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22900,"num_write_kb":480501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'17","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.046531+0000","last_change":"2024-09-11T22:21:02.033502+0000","last_active":"2024-09-11T22:35:51.046531+0000","last_peered":"2024-09-11T22:35:51.046531+0000","last_clean":"2024-09-11T22:35:51.046531+0000","last_became_active":"2024-09-11T22:21:02.033269+0000","last_became_peered":"2024-09-11T22:21:02.033269+0000","last_unstale":"2024-09-11T22:35:51.046531+0000","last_undegraded":"2024-09-11T22:35:51.046531+0000","last_fullsized":"2024-09-11T22:35:51.046531+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:31.993239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'329","reported_seq":361,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.984847+0000","last_change":"2024-09-11T22:20:18.855665+0000","last_active":"2024-09-11T22:35:41.984847+0000","last_peered":"2024-09-11T22:35:41.984847+0000","last_clean":"2024-09-11T22:35:41.984847+0000","last_became_active":"2024-09-11T22:20:18.855386+0000","last_became_peered":"2024-09-11T22:20:18.855386+0000","last_unstale":"2024-09-11T22:35:41.984847+0000","last_undegraded":"2024-09-11T22:35:41.984847+0000","last_fullsized":"2024-09-11T22:35:41.984847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'5582","reported_seq":5606,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.597450+0000","last_change":"2024-09-11T22:20:23.880793+0000","last_active":"2024-09-11T22:35:44.597450+0000","last_peered":"2024-09-11T22:35:44.597450+0000","last_clean":"2024-09-11T22:35:44.597450+0000","last_became_active":"2024-09-11T22:20:23.879993+0000","last_became_peered":"2024-09-11T22:20:23.879993+0000","last_unstale":"2024-09-11T22:35:44.597450+0000","last_undegraded":"2024-09-11T22:35:44.597450+0000","last_fullsized":"2024-09-11T22:35:44.597450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5582,"log_dups_size":0,"ondisk_log_size":5582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:50.449090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25321,"num_write_kb":502610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'21","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.050799+0000","last_change":"2024-09-11T22:20:19.858588+0000","last_active":"2024-09-11T22:35:51.050799+0000","last_peered":"2024-09-11T22:35:51.050799+0000","last_clean":"2024-09-11T22:35:51.050799+0000","last_became_active":"2024-09-11T22:20:19.858322+0000","last_became_peered":"2024-09-11T22:20:19.858322+0000","last_unstale":"2024-09-11T22:35:51.050799+0000","last_undegraded":"2024-09-11T22:35:51.050799+0000","last_fullsized":"2024-09-11T22:35:51.050799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'27","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.992364+0000","last_change":"2024-09-11T22:20:18.855056+0000","last_active":"2024-09-11T22:35:41.992364+0000","last_peered":"2024-09-11T22:35:41.992364+0000","last_clean":"2024-09-11T22:35:41.992364+0000","last_became_active":"2024-09-11T22:20:18.854784+0000","last_became_peered":"2024-09-11T22:20:18.854784+0000","last_unstale":"2024-09-11T22:35:41.992364+0000","last_undegraded":"2024-09-11T22:35:41.992364+0000","last_fullsized":"2024-09-11T22:35:41.992364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:38.916121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'6236","reported_seq":6260,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.716467+0000","last_change":"2024-09-11T22:20:23.879768+0000","last_active":"2024-09-11T22:35:44.716467+0000","last_peered":"2024-09-11T22:35:44.716467+0000","last_clean":"2024-09-11T22:35:44.716467+0000","last_became_active":"2024-09-11T22:20:23.878794+0000","last_became_peered":"2024-09-11T22:20:23.878794+0000","last_unstale":"2024-09-11T22:35:44.716467+0000","last_undegraded":"2024-09-11T22:35:44.716467+0000","last_fullsized":"2024-09-11T22:35:44.716467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6236,"log_dups_size":0,"ondisk_log_size":6236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:07.301587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28034,"num_write_kb":525577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'25","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.044031+0000","last_change":"2024-09-11T22:21:02.034590+0000","last_active":"2024-09-11T22:35:51.044031+0000","last_peered":"2024-09-11T22:35:51.044031+0000","last_clean":"2024-09-11T22:35:51.044031+0000","last_became_active":"2024-09-11T22:21:02.034349+0000","last_became_peered":"2024-09-11T22:21:02.034349+0000","last_unstale":"2024-09-11T22:35:51.044031+0000","last_undegraded":"2024-09-11T22:35:51.044031+0000","last_fullsized":"2024-09-11T22:35:51.044031+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:24.655612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'4","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.765058+0000","last_change":"2024-09-11T22:20:18.853382+0000","last_active":"2024-09-11T22:35:41.765058+0000","last_peered":"2024-09-11T22:35:41.765058+0000","last_clean":"2024-09-11T22:35:41.765058+0000","last_became_active":"2024-09-11T22:20:18.853103+0000","last_became_peered":"2024-09-11T22:20:18.853103+0000","last_unstale":"2024-09-11T22:35:41.765058+0000","last_undegraded":"2024-09-11T22:35:41.765058+0000","last_fullsized":"2024-09-11T22:35:41.765058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'5748","reported_seq":5772,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.639554+0000","last_change":"2024-09-11T22:20:23.876997+0000","last_active":"2024-09-11T22:35:44.639554+0000","last_peered":"2024-09-11T22:35:44.639554+0000","last_clean":"2024-09-11T22:35:44.639554+0000","last_became_active":"2024-09-11T22:20:23.876587+0000","last_became_peered":"2024-09-11T22:20:23.876587+0000","last_unstale":"2024-09-11T22:35:44.639554+0000","last_undegraded":"2024-09-11T22:35:44.639554+0000","last_fullsized":"2024-09-11T22:35:44.639554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5748,"log_dups_size":0,"ondisk_log_size":5748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:19.670665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26080,"num_write_kb":501611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'25","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.055748+0000","last_change":"2024-09-11T22:20:19.866624+0000","last_active":"2024-09-11T22:35:51.055748+0000","last_peered":"2024-09-11T22:35:51.055748+0000","last_clean":"2024-09-11T22:35:51.055748+0000","last_became_active":"2024-09-11T22:20:19.866303+0000","last_became_peered":"2024-09-11T22:20:19.866303+0000","last_unstale":"2024-09-11T22:35:51.055748+0000","last_undegraded":"2024-09-11T22:35:51.055748+0000","last_fullsized":"2024-09-11T22:35:51.055748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'6","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.933977+0000","last_change":"2024-09-11T22:20:18.854361+0000","last_active":"2024-09-11T22:35:41.933977+0000","last_peered":"2024-09-11T22:35:41.933977+0000","last_clean":"2024-09-11T22:35:41.933977+0000","last_became_active":"2024-09-11T22:20:18.854019+0000","last_became_peered":"2024-09-11T22:20:18.854019+0000","last_unstale":"2024-09-11T22:35:41.933977+0000","last_undegraded":"2024-09-11T22:35:41.933977+0000","last_fullsized":"2024-09-11T22:35:41.933977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'5959","reported_seq":5983,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.721236+0000","last_change":"2024-09-11T22:20:24.077476+0000","last_active":"2024-09-11T22:35:44.721236+0000","last_peered":"2024-09-11T22:35:44.721236+0000","last_clean":"2024-09-11T22:35:44.721236+0000","last_became_active":"2024-09-11T22:20:24.077134+0000","last_became_peered":"2024-09-11T22:20:24.077134+0000","last_unstale":"2024-09-11T22:35:44.721236+0000","last_undegraded":"2024-09-11T22:35:44.721236+0000","last_fullsized":"2024-09-11T22:35:44.721236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5959,"log_dups_size":0,"ondisk_log_size":5959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:03.186460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26850,"num_write_kb":516954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'7134","reported_seq":7166,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.759457+0000","last_change":"2024-09-11T22:21:02.037816+0000","last_active":"2024-09-11T22:35:44.759457+0000","last_peered":"2024-09-11T22:35:44.759457+0000","last_clean":"2024-09-11T22:35:44.759457+0000","last_became_active":"2024-09-11T22:21:02.037407+0000","last_became_peered":"2024-09-11T22:21:02.037407+0000","last_unstale":"2024-09-11T22:35:44.759457+0000","last_undegraded":"2024-09-11T22:35:44.759457+0000","last_fullsized":"2024-09-11T22:35:44.759457+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":7134,"log_dups_size":0,"ondisk_log_size":7134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:36.018837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33450,"num_write_kb":608986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'20","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.042665+0000","last_change":"2024-09-11T22:20:19.845776+0000","last_active":"2024-09-11T22:35:51.042665+0000","last_peered":"2024-09-11T22:35:51.042665+0000","last_clean":"2024-09-11T22:35:51.042665+0000","last_became_active":"2024-09-11T22:20:19.845425+0000","last_became_peered":"2024-09-11T22:20:19.845425+0000","last_unstale":"2024-09-11T22:35:51.042665+0000","last_undegraded":"2024-09-11T22:35:51.042665+0000","last_fullsized":"2024-09-11T22:35:51.042665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:07.187533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'4","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.851019+0000","last_change":"2024-09-11T22:20:18.852446+0000","last_active":"2024-09-11T22:35:37.851019+0000","last_peered":"2024-09-11T22:35:37.851019+0000","last_clean":"2024-09-11T22:35:37.851019+0000","last_became_active":"2024-09-11T22:20:18.852155+0000","last_became_peered":"2024-09-11T22:20:18.852155+0000","last_unstale":"2024-09-11T22:35:37.851019+0000","last_undegraded":"2024-09-11T22:35:37.851019+0000","last_fullsized":"2024-09-11T22:35:37.851019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"28'6143","reported_seq":6168,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.664318+0000","last_change":"2024-09-11T22:20:23.876503+0000","last_active":"2024-09-11T22:35:44.664318+0000","last_peered":"2024-09-11T22:35:44.664318+0000","last_clean":"2024-09-11T22:35:44.664318+0000","last_became_active":"2024-09-11T22:20:23.876100+0000","last_became_peered":"2024-09-11T22:20:23.876100+0000","last_unstale":"2024-09-11T22:35:44.664318+0000","last_undegraded":"2024-09-11T22:35:44.664318+0000","last_fullsized":"2024-09-11T22:35:44.664318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6143,"log_dups_size":0,"ondisk_log_size":6143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28157,"num_write_kb":534365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'27","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.045313+0000","last_change":"2024-09-11T22:20:19.852606+0000","last_active":"2024-09-11T22:35:51.045313+0000","last_peered":"2024-09-11T22:35:51.045313+0000","last_clean":"2024-09-11T22:35:51.045313+0000","last_became_active":"2024-09-11T22:20:19.852333+0000","last_became_peered":"2024-09-11T22:20:19.852333+0000","last_unstale":"2024-09-11T22:35:51.045313+0000","last_undegraded":"2024-09-11T22:35:51.045313+0000","last_fullsized":"2024-09-11T22:35:51.045313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:56.940278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'5","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:34:55.328347+0000","last_change":"2024-09-11T22:20:18.853767+0000","last_active":"2024-09-11T22:34:55.328347+0000","last_peered":"2024-09-11T22:34:55.328347+0000","last_clean":"2024-09-11T22:34:55.328347+0000","last_became_active":"2024-09-11T22:20:18.853533+0000","last_became_peered":"2024-09-11T22:20:18.853533+0000","last_unstale":"2024-09-11T22:34:55.328347+0000","last_undegraded":"2024-09-11T22:34:55.328347+0000","last_fullsized":"2024-09-11T22:34:55.328347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:36.662271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'9","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.849731+0000","last_change":"2024-09-11T22:20:18.847133+0000","last_active":"2024-09-11T22:35:37.849731+0000","last_peered":"2024-09-11T22:35:37.849731+0000","last_clean":"2024-09-11T22:35:37.849731+0000","last_became_active":"2024-09-11T22:20:18.846321+0000","last_became_peered":"2024-09-11T22:20:18.846321+0000","last_unstale":"2024-09-11T22:35:37.849731+0000","last_undegraded":"2024-09-11T22:35:37.849731+0000","last_fullsized":"2024-09-11T22:35:37.849731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'19","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.044295+0000","last_change":"2024-09-11T22:20:19.861445+0000","last_active":"2024-09-11T22:35:51.044295+0000","last_peered":"2024-09-11T22:35:51.044295+0000","last_clean":"2024-09-11T22:35:51.044295+0000","last_became_active":"2024-09-11T22:20:19.861154+0000","last_became_peered":"2024-09-11T22:20:19.861154+0000","last_unstale":"2024-09-11T22:35:51.044295+0000","last_undegraded":"2024-09-11T22:35:51.044295+0000","last_fullsized":"2024-09-11T22:35:51.044295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'5094","reported_seq":5118,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.866023+0000","last_change":"2024-09-11T22:20:23.877973+0000","last_active":"2024-09-11T22:35:44.866023+0000","last_peered":"2024-09-11T22:35:44.866023+0000","last_clean":"2024-09-11T22:35:44.866023+0000","last_became_active":"2024-09-11T22:20:23.877578+0000","last_became_peered":"2024-09-11T22:20:23.877578+0000","last_unstale":"2024-09-11T22:35:44.866023+0000","last_undegraded":"2024-09-11T22:35:44.866023+0000","last_fullsized":"2024-09-11T22:35:44.866023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5094,"log_dups_size":0,"ondisk_log_size":5094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:27.826669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23560,"num_write_kb":426046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'584","reported_seq":616,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.378051+0000","last_change":"2024-09-11T22:20:18.854142+0000","last_active":"2024-09-11T22:35:37.378051+0000","last_peered":"2024-09-11T22:35:37.378051+0000","last_clean":"2024-09-11T22:35:37.378051+0000","last_became_active":"2024-09-11T22:20:18.853872+0000","last_became_peered":"2024-09-11T22:20:18.853872+0000","last_unstale":"2024-09-11T22:35:37.378051+0000","last_undegraded":"2024-09-11T22:35:37.378051+0000","last_fullsized":"2024-09-11T22:35:37.378051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:22.513242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195510,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":580,"num_write_kb":4218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'20","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.034644+0000","last_change":"2024-09-11T22:20:19.852580+0000","last_active":"2024-09-11T22:35:51.034644+0000","last_peered":"2024-09-11T22:35:51.034644+0000","last_clean":"2024-09-11T22:35:51.034644+0000","last_became_active":"2024-09-11T22:20:19.850175+0000","last_became_peered":"2024-09-11T22:20:19.850175+0000","last_unstale":"2024-09-11T22:35:51.034644+0000","last_undegraded":"2024-09-11T22:35:51.034644+0000","last_fullsized":"2024-09-11T22:35:51.034644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:11.937256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'6620","reported_seq":6644,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.412485+0000","last_change":"2024-09-11T22:20:23.878004+0000","last_active":"2024-09-11T22:35:44.412485+0000","last_peered":"2024-09-11T22:35:44.412485+0000","last_clean":"2024-09-11T22:35:44.412485+0000","last_became_active":"2024-09-11T22:20:23.876776+0000","last_became_peered":"2024-09-11T22:20:23.876776+0000","last_unstale":"2024-09-11T22:35:44.412485+0000","last_undegraded":"2024-09-11T22:35:44.412485+0000","last_fullsized":"2024-09-11T22:35:44.412485+0000","mapping_epoch":24,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6320,"log_dups_size":0,"ondisk_log_size":6320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:11.254248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29858,"num_write_kb":574080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'24","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.045814+0000","last_change":"2024-09-11T22:20:19.853439+0000","last_active":"2024-09-11T22:35:51.045814+0000","last_peered":"2024-09-11T22:35:51.045814+0000","last_clean":"2024-09-11T22:35:51.045814+0000","last_became_active":"2024-09-11T22:20:19.852937+0000","last_became_peered":"2024-09-11T22:20:19.852937+0000","last_unstale":"2024-09-11T22:35:51.045814+0000","last_undegraded":"2024-09-11T22:35:51.045814+0000","last_fullsized":"2024-09-11T22:35:51.045814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'25","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.061579+0000","last_change":"2024-09-11T22:20:19.861003+0000","last_active":"2024-09-11T22:35:51.061579+0000","last_peered":"2024-09-11T22:35:51.061579+0000","last_clean":"2024-09-11T22:35:51.061579+0000","last_became_active":"2024-09-11T22:20:19.860690+0000","last_became_peered":"2024-09-11T22:20:19.860690+0000","last_unstale":"2024-09-11T22:35:51.061579+0000","last_undegraded":"2024-09-11T22:35:51.061579+0000","last_fullsized":"2024-09-11T22:35:51.061579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'23","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.053250+0000","last_change":"2024-09-11T22:20:19.856756+0000","last_active":"2024-09-11T22:35:51.053250+0000","last_peered":"2024-09-11T22:35:51.053250+0000","last_clean":"2024-09-11T22:35:51.053250+0000","last_became_active":"2024-09-11T22:20:19.856460+0000","last_became_peered":"2024-09-11T22:20:19.856460+0000","last_unstale":"2024-09-11T22:35:51.053250+0000","last_undegraded":"2024-09-11T22:35:51.053250+0000","last_fullsized":"2024-09-11T22:35:51.053250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'18","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043855+0000","last_change":"2024-09-11T22:20:19.855629+0000","last_active":"2024-09-11T22:35:51.043855+0000","last_peered":"2024-09-11T22:35:51.043855+0000","last_clean":"2024-09-11T22:35:51.043855+0000","last_became_active":"2024-09-11T22:20:19.855363+0000","last_became_peered":"2024-09-11T22:20:19.855363+0000","last_unstale":"2024-09-11T22:35:51.043855+0000","last_undegraded":"2024-09-11T22:35:51.043855+0000","last_fullsized":"2024-09-11T22:35:51.043855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'14","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043787+0000","last_change":"2024-09-11T22:20:19.863122+0000","last_active":"2024-09-11T22:35:51.043787+0000","last_peered":"2024-09-11T22:35:51.043787+0000","last_clean":"2024-09-11T22:35:51.043787+0000","last_became_active":"2024-09-11T22:20:19.862828+0000","last_became_peered":"2024-09-11T22:20:19.862828+0000","last_unstale":"2024-09-11T22:35:51.043787+0000","last_undegraded":"2024-09-11T22:35:51.043787+0000","last_fullsized":"2024-09-11T22:35:51.043787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:10.868762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'15","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.026329+0000","last_change":"2024-09-11T22:20:19.846453+0000","last_active":"2024-09-11T22:35:51.026329+0000","last_peered":"2024-09-11T22:35:51.026329+0000","last_clean":"2024-09-11T22:35:51.026329+0000","last_became_active":"2024-09-11T22:20:19.846186+0000","last_became_peered":"2024-09-11T22:20:19.846186+0000","last_unstale":"2024-09-11T22:35:51.026329+0000","last_undegraded":"2024-09-11T22:35:51.026329+0000","last_fullsized":"2024-09-11T22:35:51.026329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:24.032365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'24","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.062384+0000","last_change":"2024-09-11T22:20:19.860632+0000","last_active":"2024-09-11T22:35:51.062384+0000","last_peered":"2024-09-11T22:35:51.062384+0000","last_clean":"2024-09-11T22:35:51.062384+0000","last_became_active":"2024-09-11T22:20:19.860005+0000","last_became_peered":"2024-09-11T22:20:19.860005+0000","last_unstale":"2024-09-11T22:35:51.062384+0000","last_undegraded":"2024-09-11T22:35:51.062384+0000","last_fullsized":"2024-09-11T22:35:51.062384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'17","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.048597+0000","last_change":"2024-09-11T22:20:19.859195+0000","last_active":"2024-09-11T22:35:51.048597+0000","last_peered":"2024-09-11T22:35:51.048597+0000","last_clean":"2024-09-11T22:35:51.048597+0000","last_became_active":"2024-09-11T22:20:19.858832+0000","last_became_peered":"2024-09-11T22:20:19.858832+0000","last_unstale":"2024-09-11T22:35:51.048597+0000","last_undegraded":"2024-09-11T22:35:51.048597+0000","last_fullsized":"2024-09-11T22:35:51.048597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:56.259074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'18","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.038124+0000","last_change":"2024-09-11T22:20:19.858969+0000","last_active":"2024-09-11T22:35:51.038124+0000","last_peered":"2024-09-11T22:35:51.038124+0000","last_clean":"2024-09-11T22:35:51.038124+0000","last_became_active":"2024-09-11T22:20:19.857847+0000","last_became_peered":"2024-09-11T22:20:19.857847+0000","last_unstale":"2024-09-11T22:35:51.038124+0000","last_undegraded":"2024-09-11T22:35:51.038124+0000","last_fullsized":"2024-09-11T22:35:51.038124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'23","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.048974+0000","last_change":"2024-09-11T22:20:19.863294+0000","last_active":"2024-09-11T22:35:51.048974+0000","last_peered":"2024-09-11T22:35:51.048974+0000","last_clean":"2024-09-11T22:35:51.048974+0000","last_became_active":"2024-09-11T22:20:19.863007+0000","last_became_peered":"2024-09-11T22:20:19.863007+0000","last_unstale":"2024-09-11T22:35:51.048974+0000","last_undegraded":"2024-09-11T22:35:51.048974+0000","last_fullsized":"2024-09-11T22:35:51.048974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:06.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'23","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.062556+0000","last_change":"2024-09-11T22:20:19.858414+0000","last_active":"2024-09-11T22:35:51.062556+0000","last_peered":"2024-09-11T22:35:51.062556+0000","last_clean":"2024-09-11T22:35:51.062556+0000","last_became_active":"2024-09-11T22:20:19.857790+0000","last_became_peered":"2024-09-11T22:20:19.857790+0000","last_unstale":"2024-09-11T22:35:51.062556+0000","last_undegraded":"2024-09-11T22:35:51.062556+0000","last_fullsized":"2024-09-11T22:35:51.062556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'28","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.057627+0000","last_change":"2024-09-11T22:21:02.034810+0000","last_active":"2024-09-11T22:35:51.057627+0000","last_peered":"2024-09-11T22:35:51.057627+0000","last_clean":"2024-09-11T22:35:51.057627+0000","last_became_active":"2024-09-11T22:21:02.034534+0000","last_became_peered":"2024-09-11T22:21:02.034534+0000","last_unstale":"2024-09-11T22:35:51.057627+0000","last_undegraded":"2024-09-11T22:35:51.057627+0000","last_fullsized":"2024-09-11T22:35:51.057627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"28'19","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043768+0000","last_change":"2024-09-11T22:20:19.864700+0000","last_active":"2024-09-11T22:35:51.043768+0000","last_peered":"2024-09-11T22:35:51.043768+0000","last_clean":"2024-09-11T22:35:51.043768+0000","last_became_active":"2024-09-11T22:20:19.862296+0000","last_became_peered":"2024-09-11T22:20:19.862296+0000","last_unstale":"2024-09-11T22:35:51.043768+0000","last_undegraded":"2024-09-11T22:35:51.043768+0000","last_fullsized":"2024-09-11T22:35:51.043768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'22","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.049922+0000","last_change":"2024-09-11T22:20:19.855253+0000","last_active":"2024-09-11T22:35:51.049922+0000","last_peered":"2024-09-11T22:35:51.049922+0000","last_clean":"2024-09-11T22:35:51.049922+0000","last_became_active":"2024-09-11T22:20:19.854970+0000","last_became_peered":"2024-09-11T22:20:19.854970+0000","last_unstale":"2024-09-11T22:35:51.049922+0000","last_undegraded":"2024-09-11T22:35:51.049922+0000","last_fullsized":"2024-09-11T22:35:51.049922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'29","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.048687+0000","last_change":"2024-09-11T22:20:19.850202+0000","last_active":"2024-09-11T22:35:51.048687+0000","last_peered":"2024-09-11T22:35:51.048687+0000","last_clean":"2024-09-11T22:35:51.048687+0000","last_became_active":"2024-09-11T22:20:19.849815+0000","last_became_peered":"2024-09-11T22:20:19.849815+0000","last_unstale":"2024-09-11T22:35:51.048687+0000","last_undegraded":"2024-09-11T22:35:51.048687+0000","last_fullsized":"2024-09-11T22:35:51.048687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:56.480679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'21","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.057298+0000","last_change":"2024-09-11T22:20:19.866864+0000","last_active":"2024-09-11T22:35:51.057298+0000","last_peered":"2024-09-11T22:35:51.057298+0000","last_clean":"2024-09-11T22:35:51.057298+0000","last_became_active":"2024-09-11T22:20:19.866484+0000","last_became_peered":"2024-09-11T22:20:19.866484+0000","last_unstale":"2024-09-11T22:35:51.057298+0000","last_undegraded":"2024-09-11T22:35:51.057298+0000","last_fullsized":"2024-09-11T22:35:51.057298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'21","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.044671+0000","last_change":"2024-09-11T22:21:02.035254+0000","last_active":"2024-09-11T22:35:51.044671+0000","last_peered":"2024-09-11T22:35:51.044671+0000","last_clean":"2024-09-11T22:35:51.044671+0000","last_became_active":"2024-09-11T22:21:02.034985+0000","last_became_peered":"2024-09-11T22:21:02.034985+0000","last_unstale":"2024-09-11T22:35:51.044671+0000","last_undegraded":"2024-09-11T22:35:51.044671+0000","last_fullsized":"2024-09-11T22:35:51.044671+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"28'21","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.036646+0000","last_change":"2024-09-11T22:20:19.860050+0000","last_active":"2024-09-11T22:35:51.036646+0000","last_peered":"2024-09-11T22:35:51.036646+0000","last_clean":"2024-09-11T22:35:51.036646+0000","last_became_active":"2024-09-11T22:20:19.859755+0000","last_became_peered":"2024-09-11T22:20:19.859755+0000","last_unstale":"2024-09-11T22:35:51.036646+0000","last_undegraded":"2024-09-11T22:35:51.036646+0000","last_fullsized":"2024-09-11T22:35:51.036646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:42.487669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'24","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043675+0000","last_change":"2024-09-11T22:20:19.853902+0000","last_active":"2024-09-11T22:35:51.043675+0000","last_peered":"2024-09-11T22:35:51.043675+0000","last_clean":"2024-09-11T22:35:51.043675+0000","last_became_active":"2024-09-11T22:20:19.853563+0000","last_became_peered":"2024-09-11T22:20:19.853563+0000","last_unstale":"2024-09-11T22:35:51.043675+0000","last_undegraded":"2024-09-11T22:35:51.043675+0000","last_fullsized":"2024-09-11T22:35:51.043675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'25","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043068+0000","last_change":"2024-09-11T22:20:19.849490+0000","last_active":"2024-09-11T22:35:51.043068+0000","last_peered":"2024-09-11T22:35:51.043068+0000","last_clean":"2024-09-11T22:35:51.043068+0000","last_became_active":"2024-09-11T22:20:19.848965+0000","last_became_peered":"2024-09-11T22:20:19.848965+0000","last_unstale":"2024-09-11T22:35:51.043068+0000","last_undegraded":"2024-09-11T22:35:51.043068+0000","last_fullsized":"2024-09-11T22:35:51.043068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:10.387663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'17","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.042418+0000","last_change":"2024-09-11T22:20:19.860457+0000","last_active":"2024-09-11T22:35:51.042418+0000","last_peered":"2024-09-11T22:35:51.042418+0000","last_clean":"2024-09-11T22:35:51.042418+0000","last_became_active":"2024-09-11T22:20:19.858887+0000","last_became_peered":"2024-09-11T22:20:19.858887+0000","last_unstale":"2024-09-11T22:35:51.042418+0000","last_undegraded":"2024-09-11T22:35:51.042418+0000","last_fullsized":"2024-09-11T22:35:51.042418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:34.620956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'18","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.062261+0000","last_change":"2024-09-11T22:20:19.862347+0000","last_active":"2024-09-11T22:35:51.062261+0000","last_peered":"2024-09-11T22:35:51.062261+0000","last_clean":"2024-09-11T22:35:51.062261+0000","last_became_active":"2024-09-11T22:20:19.861965+0000","last_became_peered":"2024-09-11T22:20:19.861965+0000","last_unstale":"2024-09-11T22:35:51.062261+0000","last_undegraded":"2024-09-11T22:35:51.062261+0000","last_fullsized":"2024-09-11T22:35:51.062261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'29","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.063182+0000","last_change":"2024-09-11T22:20:19.862065+0000","last_active":"2024-09-11T22:35:51.063182+0000","last_peered":"2024-09-11T22:35:51.063182+0000","last_clean":"2024-09-11T22:35:51.063182+0000","last_became_active":"2024-09-11T22:20:19.861765+0000","last_became_peered":"2024-09-11T22:20:19.861765+0000","last_unstale":"2024-09-11T22:35:51.063182+0000","last_undegraded":"2024-09-11T22:35:51.063182+0000","last_fullsized":"2024-09-11T22:35:51.063182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'27","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.062819+0000","last_change":"2024-09-11T22:20:19.865064+0000","last_active":"2024-09-11T22:35:51.062819+0000","last_peered":"2024-09-11T22:35:51.062819+0000","last_clean":"2024-09-11T22:35:51.062819+0000","last_became_active":"2024-09-11T22:20:19.864697+0000","last_became_peered":"2024-09-11T22:20:19.864697+0000","last_unstale":"2024-09-11T22:35:51.062819+0000","last_undegraded":"2024-09-11T22:35:51.062819+0000","last_fullsized":"2024-09-11T22:35:51.062819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'14","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.060918+0000","last_change":"2024-09-11T22:20:19.861293+0000","last_active":"2024-09-11T22:35:51.060918+0000","last_peered":"2024-09-11T22:35:51.060918+0000","last_clean":"2024-09-11T22:35:51.060918+0000","last_became_active":"2024-09-11T22:20:19.861013+0000","last_became_peered":"2024-09-11T22:20:19.861013+0000","last_unstale":"2024-09-11T22:35:51.060918+0000","last_undegraded":"2024-09-11T22:35:51.060918+0000","last_fullsized":"2024-09-11T22:35:51.060918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:13.178404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'14","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.060763+0000","last_change":"2024-09-11T22:20:19.858131+0000","last_active":"2024-09-11T22:35:51.060763+0000","last_peered":"2024-09-11T22:35:51.060763+0000","last_clean":"2024-09-11T22:35:51.060763+0000","last_became_active":"2024-09-11T22:20:19.857842+0000","last_became_peered":"2024-09-11T22:20:19.857842+0000","last_unstale":"2024-09-11T22:35:51.060763+0000","last_undegraded":"2024-09-11T22:35:51.060763+0000","last_fullsized":"2024-09-11T22:35:51.060763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'16","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.060898+0000","last_change":"2024-09-11T22:20:19.859667+0000","last_active":"2024-09-11T22:35:51.060898+0000","last_peered":"2024-09-11T22:35:51.060898+0000","last_clean":"2024-09-11T22:35:51.060898+0000","last_became_active":"2024-09-11T22:20:19.859306+0000","last_became_peered":"2024-09-11T22:20:19.859306+0000","last_unstale":"2024-09-11T22:35:51.060898+0000","last_undegraded":"2024-09-11T22:35:51.060898+0000","last_fullsized":"2024-09-11T22:35:51.060898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'19","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.048851+0000","last_change":"2024-09-11T22:20:19.848821+0000","last_active":"2024-09-11T22:35:51.048851+0000","last_peered":"2024-09-11T22:35:51.048851+0000","last_clean":"2024-09-11T22:35:51.048851+0000","last_became_active":"2024-09-11T22:20:19.848531+0000","last_became_peered":"2024-09-11T22:20:19.848531+0000","last_unstale":"2024-09-11T22:35:51.048851+0000","last_undegraded":"2024-09-11T22:35:51.048851+0000","last_fullsized":"2024-09-11T22:35:51.048851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'15","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.061871+0000","last_change":"2024-09-11T22:20:19.866300+0000","last_active":"2024-09-11T22:35:51.061871+0000","last_peered":"2024-09-11T22:35:51.061871+0000","last_clean":"2024-09-11T22:35:51.061871+0000","last_became_active":"2024-09-11T22:20:19.865939+0000","last_became_peered":"2024-09-11T22:20:19.865939+0000","last_unstale":"2024-09-11T22:35:51.061871+0000","last_undegraded":"2024-09-11T22:35:51.061871+0000","last_fullsized":"2024-09-11T22:35:51.061871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'19","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.042042+0000","last_change":"2024-09-11T22:20:19.858144+0000","last_active":"2024-09-11T22:35:51.042042+0000","last_peered":"2024-09-11T22:35:51.042042+0000","last_clean":"2024-09-11T22:35:51.042042+0000","last_became_active":"2024-09-11T22:20:19.857840+0000","last_became_peered":"2024-09-11T22:20:19.857840+0000","last_unstale":"2024-09-11T22:35:51.042042+0000","last_undegraded":"2024-09-11T22:35:51.042042+0000","last_fullsized":"2024-09-11T22:35:51.042042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:23.801072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'10","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.040742+0000","last_change":"2024-09-11T22:20:19.857378+0000","last_active":"2024-09-11T22:35:51.040742+0000","last_peered":"2024-09-11T22:35:51.040742+0000","last_clean":"2024-09-11T22:35:51.040742+0000","last_became_active":"2024-09-11T22:20:19.857089+0000","last_became_peered":"2024-09-11T22:20:19.857089+0000","last_unstale":"2024-09-11T22:35:51.040742+0000","last_undegraded":"2024-09-11T22:35:51.040742+0000","last_fullsized":"2024-09-11T22:35:51.040742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:29.835695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'16","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.042089+0000","last_change":"2024-09-11T22:21:02.036200+0000","last_active":"2024-09-11T22:35:51.042089+0000","last_peered":"2024-09-11T22:35:51.042089+0000","last_clean":"2024-09-11T22:35:51.042089+0000","last_became_active":"2024-09-11T22:21:02.035889+0000","last_became_peered":"2024-09-11T22:21:02.035889+0000","last_unstale":"2024-09-11T22:35:51.042089+0000","last_undegraded":"2024-09-11T22:35:51.042089+0000","last_fullsized":"2024-09-11T22:35:51.042089+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":877619,"num_write_kb":16615339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":191481,"ondisk_log_size":191481,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1274,"ondisk_log_size":1274,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":15005355,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":45,"num_read_kb":122,"num_write":3042,"num_write_kb":15742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18276352,"data_stored":30010710,"data_compressed":2661454,"data_compressed_allocated":3686400,"data_compressed_original":15572992,"omap_allocated":0,"internal_metadata":0},"log_size":2691,"ondisk_log_size":2691,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509631,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":969956,"kb_used_data":7316,"kb_used_omap":1,"kb_used_meta":962622,"kb_avail":93401884,"statfs":{"total":96636764160,"available":95643529216,"internally_reserved":0,"allocated":7491584,"data_stored":11425803,"data_compressed":849965,"data_compressed_allocated":1200128,"data_compressed_original":5332992,"omap_allocated":1590,"internal_metadata":985725386},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509632,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1137376,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":1135230,"kb_avail":93234464,"statfs":{"total":96636764160,"available":95472091136,"internally_reserved":0,"allocated":2179072,"data_stored":4317172,"data_compressed":509786,"data_compressed_allocated":684032,"data_compressed_original":3010560,"omap_allocated":1594,"internal_metadata":1162475974},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509633,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":763716,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":763390,"kb_avail":93608124,"statfs":{"total":96636764160,"available":95854718976,"internally_reserved":0,"allocated":315392,"data_stored":122896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":781711813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509632,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1079244,"kb_used_data":3772,"kb_used_omap":1,"kb_used_meta":1075454,"kb_avail":93292596,"statfs":{"total":96636764160,"available":95531618304,"internally_reserved":0,"allocated":3862528,"data_stored":4316536,"data_compressed":162063,"data_compressed_allocated":282624,"data_compressed_original":925696,"omap_allocated":1595,"internal_metadata":1101265349},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509630,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1425948,"kb_used_data":4620,"kb_used_omap":1,"kb_used_meta":1421310,"kb_avail":92945892,"statfs":{"total":96636764160,"available":95176593408,"internally_reserved":0,"allocated":4730880,"data_stored":8606262,"data_compressed":892093,"data_compressed_allocated":1200128,"data_compressed_original":5267456,"omap_allocated":1593,"internal_metadata":1455421895},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542335,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":868180,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":867774,"kb_avail":93503660,"statfs":{"total":96636764160,"available":95747747840,"internally_reserved":0,"allocated":397312,"data_stored":216504,"data_compressed":3390,"data_compressed_allocated":4096,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":888601029},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542336,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1062252,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":1060798,"kb_avail":93309588,"statfs":{"total":96636764160,"available":95549018112,"internally_reserved":0,"allocated":1470464,"data_stored":3035955,"data_compressed":308985,"data_compressed_allocated":405504,"data_compressed_original":2166784,"omap_allocated":1595,"internal_metadata":1086257605},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575040,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1374984,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":1374654,"kb_avail":92996856,"statfs":{"total":96636764160,"available":95228780544,"internally_reserved":0,"allocated":319488,"data_stored":122462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1407646149},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1110016,"data_stored":2324069,"data_compressed":276571,"data_compressed_allocated":360448,"data_compressed_original":1593344,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":94986,"data_compressed":3390,"data_compressed_allocated":4096,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4435968,"data_stored":8484744,"data_compressed":892093,"data_compressed_allocated":1200128,"data_compressed_original":5267456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3567616,"data_stored":4195018,"data_compressed":162063,"data_compressed_allocated":282624,"data_compressed_original":925696,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1884160,"data_stored":4195654,"data_compressed":509786,"data_compressed_allocated":684032,"data_compressed_original":3010560,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7131136,"data_stored":10713917,"data_compressed":817551,"data_compressed_allocated":1155072,"data_compressed_original":4759552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:35:58.009 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:35:58.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.145+0000 7fcdb5778640 1 Processor -- start 2024-09-11T22:35:58.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.145+0000 7fcdb5778640 1 -- start start 2024-09-11T22:35:58.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.146+0000 7fcdb5778640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcdb0151ae0 0x7fcdb0071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:58.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.146+0000 7fcdb5778640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcdb00c2de0 0x7fcdb006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:58.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.146+0000 7fcdb5778640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdb0071cc0 con 0x7fcdb00c8570 2024-09-11T22:35:58.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.146+0000 7fcdb5778640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fcdb00c1ec0 con 0x7fcdb00c2de0 2024-09-11T22:35:58.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.146+0000 7fcdb5778640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fcdb0071f50 con 0x7fcdb0151ae0 2024-09-11T22:35:58.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.146+0000 7fcdaf7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcdb00c2de0 0x7fcdb006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:58.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.146+0000 7fcdaf7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcdb00c2de0 0x7fcdb006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46708/0 (socket says 172.21.15.100:46708) 2024-09-11T22:35:58.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.146+0000 7fcdaf7fe640 1 -- 172.21.15.100:0/2621251177 learned_addr learned my addr 172.21.15.100:0/2621251177 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:58.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.146+0000 7fcdaeffd640 1 --2- 172.21.15.100:0/2621251177 >> v2:172.21.15.167:3300/0 conn(0x7fcdb0151ae0 0x7fcdb0071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:58.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.146+0000 7fcdaf7fe640 1 -- 172.21.15.100:0/2621251177 >> v2:172.21.15.167:3300/0 conn(0x7fcdb0151ae0 msgr2=0x7fcdb0071780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:58.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.146+0000 7fcdaf7fe640 1 --2- 172.21.15.100:0/2621251177 >> v2:172.21.15.167:3300/0 conn(0x7fcdb0151ae0 0x7fcdb0071780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:58.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.146+0000 7fcdaf7fe640 1 -- 172.21.15.100:0/2621251177 >> v1:172.21.15.100:6789/0 conn(0x7fcdb00c8570 legacy=0x7fcdb00c0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:58.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.146+0000 7fcdadffb640 1 -- 172.21.15.100:0/2621251177 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4043079221 0 0) 0x7fcdb0071cc0 con 0x7fcdb00c8570 2024-09-11T22:35:58.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.146+0000 7fcdaf7fe640 1 -- 172.21.15.100:0/2621251177 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb0072230 con 0x7fcdb00c2de0 2024-09-11T22:35:58.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.147+0000 7fcdaf7fe640 1 --2- 172.21.15.100:0/2621251177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdb00c2de0 0x7fcdb006bc10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcdb00cd000 tx=0x7fcda802c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49dd39828e61b996 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:58.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.147+0000 7fcdadffb640 1 -- 172.21.15.100:0/2621251177 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda800b2e0 con 0x7fcdb00c2de0 2024-09-11T22:35:58.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.147+0000 7fcdadffb640 1 -- 172.21.15.100:0/2621251177 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda8037070 con 0x7fcdb00c2de0 2024-09-11T22:35:58.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.147+0000 7fcdadffb640 1 -- 172.21.15.100:0/2621251177 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda800b480 con 0x7fcdb00c2de0 2024-09-11T22:35:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.148+0000 7fcdb5778640 1 -- 172.21.15.100:0/2621251177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdb00c2de0 msgr2=0x7fcdb006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.148+0000 7fcdb5778640 1 --2- 172.21.15.100:0/2621251177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdb00c2de0 0x7fcdb006bc10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcdb00cd000 tx=0x7fcda802c940 comp rx=0 tx=0).stop 2024-09-11T22:35:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.148+0000 7fcdb5778640 1 -- 172.21.15.100:0/2621251177 shutdown_connections 2024-09-11T22:35:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.148+0000 7fcdb5778640 1 --2- 172.21.15.100:0/2621251177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdb00c2de0 0x7fcdb006bc10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.148+0000 7fcdb5778640 1 --2- 172.21.15.100:0/2621251177 >> v2:172.21.15.167:3300/0 conn(0x7fcdb0151ae0 0x7fcdb0071780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.148+0000 7fcdb5778640 1 -- 172.21.15.100:0/2621251177 >> 172.21.15.100:0/2621251177 conn(0x7fcdb00cbf70 msgr2=0x7fcdb00cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.148+0000 7fcdb5778640 1 -- 172.21.15.100:0/2621251177 shutdown_connections 2024-09-11T22:35:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.148+0000 7fcdb5778640 1 -- 172.21.15.100:0/2621251177 wait complete. 2024-09-11T22:35:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.149+0000 7fcdb5778640 1 Processor -- start 2024-09-11T22:35:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.149+0000 7fcdb5778640 1 -- start start 2024-09-11T22:35:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.150+0000 7fcdb5778640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcdb00c2de0 0x7fcdb014b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.150+0000 7fcdb5778640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdb00c8570 0x7fcdb01f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:58.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.150+0000 7fcdb5778640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdb0151ae0 0x7fcdb00c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.150+0000 7fcdb5778640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb00c2720 con 0x7fcdb00c8570 2024-09-11T22:35:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.150+0000 7fcdb5778640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb00c2440 con 0x7fcdb0151ae0 2024-09-11T22:35:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.150+0000 7fcdb5778640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcdb00c16a0 con 0x7fcdb00c2de0 2024-09-11T22:35:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.150+0000 7fcdae7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdb00c8570 0x7fcdb01f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.150+0000 7fcdae7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdb00c8570 0x7fcdb01f36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46724/0 (socket says 172.21.15.100:46724) 2024-09-11T22:35:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.150+0000 7fcdae7fc640 1 -- 172.21.15.100:0/3377391693 learned_addr learned my addr 172.21.15.100:0/3377391693 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.150+0000 7fcdaf7fe640 1 --2- 172.21.15.100:0/3377391693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdb0151ae0 0x7fcdb00c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.150+0000 7fcdaeffd640 1 --2- 172.21.15.100:0/3377391693 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcdb00c2de0 0x7fcdb014b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.150+0000 7fcdae7fc640 1 -- 172.21.15.100:0/3377391693 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcdb00c2de0 msgr2=0x7fcdb014b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.150+0000 7fcdae7fc640 1 --2- 172.21.15.100:0/3377391693 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcdb00c2de0 0x7fcdb014b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.150+0000 7fcdae7fc640 1 -- 172.21.15.100:0/3377391693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdb0151ae0 msgr2=0x7fcdb00c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.150+0000 7fcdae7fc640 1 --2- 172.21.15.100:0/3377391693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdb0151ae0 0x7fcdb00c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:58.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.150+0000 7fcdae7fc640 1 -- 172.21.15.100:0/3377391693 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb014a070 con 0x7fcdb00c8570 2024-09-11T22:35:58.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.150+0000 7fcdaeffd640 1 --2- 172.21.15.100:0/3377391693 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcdb00c2de0 0x7fcdb014b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:35:58.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.150+0000 7fcdae7fc640 1 --2- 172.21.15.100:0/3377391693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdb00c8570 0x7fcdb01f36f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcda400c520 tx=0x7fcda400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:58.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.150+0000 7fcd977fe640 1 -- 172.21.15.100:0/3377391693 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda4017070 con 0x7fcdb00c8570 2024-09-11T22:35:58.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.150+0000 7fcd977fe640 1 -- 172.21.15.100:0/3377391693 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda40035f0 con 0x7fcdb00c8570 2024-09-11T22:35:58.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.150+0000 7fcd977fe640 1 -- 172.21.15.100:0/3377391693 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda40039e0 con 0x7fcdb00c8570 2024-09-11T22:35:58.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.150+0000 7fcdb5778640 1 -- 172.21.15.100:0/3377391693 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdb01f41b0 con 0x7fcdb00c8570 2024-09-11T22:35:58.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.151+0000 7fcdb5778640 1 -- 172.21.15.100:0/3377391693 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdb014a310 con 0x7fcdb00c8570 2024-09-11T22:35:58.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.151+0000 7fcdb5778640 1 -- 172.21.15.100:0/3377391693 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdb0071780 con 0x7fcdb00c8570 2024-09-11T22:35:58.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.152+0000 7fcd977fe640 1 -- 172.21.15.100:0/3377391693 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcda401a070 con 0x7fcdb00c8570 2024-09-11T22:35:58.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.152+0000 7fcd977fe640 1 --2- 172.21.15.100:0/3377391693 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcd9c06be30 0x7fcd9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:58.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.152+0000 7fcd977fe640 1 -- 172.21.15.100:0/3377391693 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fcda408a690 con 0x7fcdb00c8570 2024-09-11T22:35:58.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.152+0000 7fcdaeffd640 1 --2- 172.21.15.100:0/3377391693 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcd9c06be30 0x7fcd9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:58.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.153+0000 7fcdaeffd640 1 --2- 172.21.15.100:0/3377391693 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcd9c06be30 0x7fcd9c06e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcda0006fd0 tx=0x7fcda0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:58.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.160+0000 7fcd977fe640 1 -- 172.21.15.100:0/3377391693 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcda4058cb0 con 0x7fcdb00c8570 2024-09-11T22:35:58.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.331+0000 7fcdb5778640 1 -- 172.21.15.100:0/3377391693 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcdb00c4950 con 0x7fcd9c06be30 2024-09-11T22:35:58.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.339+0000 7fcd977fe640 1 -- 172.21.15.100:0/3377391693 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334184 (secure 0 0 0) 0x7fcdb00c4950 con 0x7fcd9c06be30 2024-09-11T22:35:58.343 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:35:58.344 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-11T22:35:58.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.342+0000 7fcdb5778640 1 -- 172.21.15.100:0/3377391693 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcd9c06be30 msgr2=0x7fcd9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:58.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.342+0000 7fcdb5778640 1 --2- 172.21.15.100:0/3377391693 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcd9c06be30 0x7fcd9c06e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcda0006fd0 tx=0x7fcda0008040 comp rx=0 tx=0).stop 2024-09-11T22:35:58.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.342+0000 7fcdb5778640 1 -- 172.21.15.100:0/3377391693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdb00c8570 msgr2=0x7fcdb01f36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:58.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.342+0000 7fcdb5778640 1 --2- 172.21.15.100:0/3377391693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdb00c8570 0x7fcdb01f36f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcda400c520 tx=0x7fcda400c9e0 comp rx=0 tx=0).stop 2024-09-11T22:35:58.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.342+0000 7fcdb5778640 1 -- 172.21.15.100:0/3377391693 shutdown_connections 2024-09-11T22:35:58.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.342+0000 7fcdb5778640 1 --2- 172.21.15.100:0/3377391693 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcd9c06be30 0x7fcd9c06e2f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.342+0000 7fcdb5778640 1 --2- 172.21.15.100:0/3377391693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdb0151ae0 0x7fcdb00c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.342+0000 7fcdb5778640 1 --2- 172.21.15.100:0/3377391693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdb00c8570 0x7fcdb01f36f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.342+0000 7fcdb5778640 1 --2- 172.21.15.100:0/3377391693 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcdb00c2de0 0x7fcdb014b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.342+0000 7fcdb5778640 1 -- 172.21.15.100:0/3377391693 >> 172.21.15.100:0/3377391693 conn(0x7fcdb00cbf70 msgr2=0x7fcdb0072e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.342+0000 7fcdb5778640 1 -- 172.21.15.100:0/3377391693 shutdown_connections 2024-09-11T22:35:58.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.342+0000 7fcdb5778640 1 -- 172.21.15.100:0/3377391693 wait complete. 2024-09-11T22:35:58.354 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":497,"stamp":"2024-09-11T22:35:56.569072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":15595723,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":161,"num_read_kb":222,"num_write":880820,"num_write_kb":16633497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195563,"ondisk_log_size":195563,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8681656,"kb_used_data":20280,"kb_used_omap":12,"kb_used_meta":8661235,"kb_avail":746293064,"statfs":{"total":773094113280,"available":764204097536,"internally_reserved":0,"allocated":20766720,"data_stored":32163590,"data_compressed":2726282,"data_compressed_allocated":3776512,"data_compressed_original":16719872,"omap_allocated":12752,"internal_metadata":8869105200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1409414290,"num_objects":-358,"num_object_clones":0,"num_object_copies":-1432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-358,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":365,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003804"},"pg_stats":[{"pgid":"2.1f","version":"28'176","reported_seq":209,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.008974+0000","last_change":"2024-09-11T22:20:18.853007+0000","last_active":"2024-09-11T22:35:51.008974+0000","last_peered":"2024-09-11T22:35:51.008974+0000","last_clean":"2024-09-11T22:35:51.008974+0000","last_became_active":"2024-09-11T22:20:18.852740+0000","last_became_peered":"2024-09-11T22:20:18.852740+0000","last_unstale":"2024-09-11T22:35:51.008974+0000","last_undegraded":"2024-09-11T22:35:51.008974+0000","last_fullsized":"2024-09-11T22:35:51.008974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:46.710328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2323991,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":2359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'9","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.039561+0000","last_change":"2024-09-11T22:20:19.849765+0000","last_active":"2024-09-11T22:35:51.039561+0000","last_peered":"2024-09-11T22:35:51.039561+0000","last_clean":"2024-09-11T22:35:51.039561+0000","last_became_active":"2024-09-11T22:20:19.848619+0000","last_became_peered":"2024-09-11T22:20:19.848619+0000","last_unstale":"2024-09-11T22:35:51.039561+0000","last_undegraded":"2024-09-11T22:35:51.039561+0000","last_fullsized":"2024-09-11T22:35:51.039561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:57.621624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'6890","reported_seq":6914,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.779066+0000","last_change":"2024-09-11T22:20:24.078618+0000","last_active":"2024-09-11T22:35:44.779066+0000","last_peered":"2024-09-11T22:35:44.779066+0000","last_clean":"2024-09-11T22:35:44.779066+0000","last_became_active":"2024-09-11T22:20:24.078283+0000","last_became_peered":"2024-09-11T22:20:24.078283+0000","last_unstale":"2024-09-11T22:35:44.779066+0000","last_undegraded":"2024-09-11T22:35:44.779066+0000","last_fullsized":"2024-09-11T22:35:44.779066+0000","mapping_epoch":24,"log_start":"28'603","ondisk_log_start":"28'603","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6287,"log_dups_size":0,"ondisk_log_size":6287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:01.901307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31450,"num_write_kb":560141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'9","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.935502+0000","last_change":"2024-09-11T22:20:18.855945+0000","last_active":"2024-09-11T22:35:41.935502+0000","last_peered":"2024-09-11T22:35:41.935502+0000","last_clean":"2024-09-11T22:35:41.935502+0000","last_became_active":"2024-09-11T22:20:18.854811+0000","last_became_peered":"2024-09-11T22:20:18.854811+0000","last_unstale":"2024-09-11T22:35:41.935502+0000","last_undegraded":"2024-09-11T22:35:41.935502+0000","last_fullsized":"2024-09-11T22:35:41.935502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:47.508920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'21","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.063302+0000","last_change":"2024-09-11T22:20:19.862436+0000","last_active":"2024-09-11T22:35:51.063302+0000","last_peered":"2024-09-11T22:35:51.063302+0000","last_clean":"2024-09-11T22:35:51.063302+0000","last_became_active":"2024-09-11T22:20:19.862061+0000","last_became_peered":"2024-09-11T22:20:19.862061+0000","last_unstale":"2024-09-11T22:35:51.063302+0000","last_undegraded":"2024-09-11T22:35:51.063302+0000","last_fullsized":"2024-09-11T22:35:51.063302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'6406","reported_seq":6430,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.675651+0000","last_change":"2024-09-11T22:20:23.879729+0000","last_active":"2024-09-11T22:35:44.675651+0000","last_peered":"2024-09-11T22:35:44.675651+0000","last_clean":"2024-09-11T22:35:44.675651+0000","last_became_active":"2024-09-11T22:20:23.879245+0000","last_became_peered":"2024-09-11T22:20:23.879245+0000","last_unstale":"2024-09-11T22:35:44.675651+0000","last_undegraded":"2024-09-11T22:35:44.675651+0000","last_fullsized":"2024-09-11T22:35:44.675651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6406,"log_dups_size":0,"ondisk_log_size":6406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:36.836842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28787,"num_write_kb":536913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'13","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.849483+0000","last_change":"2024-09-11T22:20:18.853076+0000","last_active":"2024-09-11T22:35:37.849483+0000","last_peered":"2024-09-11T22:35:37.849483+0000","last_clean":"2024-09-11T22:35:37.849483+0000","last_became_active":"2024-09-11T22:20:18.852728+0000","last_became_peered":"2024-09-11T22:20:18.852728+0000","last_unstale":"2024-09-11T22:35:37.849483+0000","last_undegraded":"2024-09-11T22:35:37.849483+0000","last_fullsized":"2024-09-11T22:35:37.849483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'17","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.061939+0000","last_change":"2024-09-11T22:20:19.864544+0000","last_active":"2024-09-11T22:35:51.061939+0000","last_peered":"2024-09-11T22:35:51.061939+0000","last_clean":"2024-09-11T22:35:51.061939+0000","last_became_active":"2024-09-11T22:20:19.864234+0000","last_became_peered":"2024-09-11T22:20:19.864234+0000","last_unstale":"2024-09-11T22:35:51.061939+0000","last_undegraded":"2024-09-11T22:35:51.061939+0000","last_fullsized":"2024-09-11T22:35:51.061939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'5642","reported_seq":5666,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.746934+0000","last_change":"2024-09-11T22:20:23.873783+0000","last_active":"2024-09-11T22:35:44.746934+0000","last_peered":"2024-09-11T22:35:44.746934+0000","last_clean":"2024-09-11T22:35:44.746934+0000","last_became_active":"2024-09-11T22:20:23.873385+0000","last_became_peered":"2024-09-11T22:20:23.873385+0000","last_unstale":"2024-09-11T22:35:44.746934+0000","last_undegraded":"2024-09-11T22:35:44.746934+0000","last_fullsized":"2024-09-11T22:35:44.746934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5642,"log_dups_size":0,"ondisk_log_size":5642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24462,"num_write_kb":498902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'3","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:18.543924+0000","last_change":"2024-09-11T22:20:18.861530+0000","last_active":"2024-09-11T22:35:18.543924+0000","last_peered":"2024-09-11T22:35:18.543924+0000","last_clean":"2024-09-11T22:35:18.543924+0000","last_became_active":"2024-09-11T22:20:18.861230+0000","last_became_peered":"2024-09-11T22:20:18.861230+0000","last_unstale":"2024-09-11T22:35:18.543924+0000","last_undegraded":"2024-09-11T22:35:18.543924+0000","last_fullsized":"2024-09-11T22:35:18.543924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'27","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.063087+0000","last_change":"2024-09-11T22:20:19.863401+0000","last_active":"2024-09-11T22:35:51.063087+0000","last_peered":"2024-09-11T22:35:51.063087+0000","last_clean":"2024-09-11T22:35:51.063087+0000","last_became_active":"2024-09-11T22:20:19.863127+0000","last_became_peered":"2024-09-11T22:20:19.863127+0000","last_unstale":"2024-09-11T22:35:51.063087+0000","last_undegraded":"2024-09-11T22:35:51.063087+0000","last_fullsized":"2024-09-11T22:35:51.063087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:36.888544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'4900","reported_seq":4924,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.832935+0000","last_change":"2024-09-11T22:20:23.874650+0000","last_active":"2024-09-11T22:35:44.832935+0000","last_peered":"2024-09-11T22:35:44.832935+0000","last_clean":"2024-09-11T22:35:44.832935+0000","last_became_active":"2024-09-11T22:20:23.874040+0000","last_became_peered":"2024-09-11T22:20:23.874040+0000","last_unstale":"2024-09-11T22:35:44.832935+0000","last_undegraded":"2024-09-11T22:35:44.832935+0000","last_fullsized":"2024-09-11T22:35:44.832935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":4900,"log_dups_size":0,"ondisk_log_size":4900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21721,"num_write_kb":438879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'14","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.041380+0000","last_change":"2024-09-11T22:20:19.859446+0000","last_active":"2024-09-11T22:35:51.041380+0000","last_peered":"2024-09-11T22:35:51.041380+0000","last_clean":"2024-09-11T22:35:51.041380+0000","last_became_active":"2024-09-11T22:20:19.859106+0000","last_became_peered":"2024-09-11T22:20:19.859106+0000","last_unstale":"2024-09-11T22:35:51.041380+0000","last_undegraded":"2024-09-11T22:35:51.041380+0000","last_fullsized":"2024-09-11T22:35:51.041380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'1002","reported_seq":1034,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.946261+0000","last_change":"2024-09-11T22:20:18.856475+0000","last_active":"2024-09-11T22:35:41.946261+0000","last_peered":"2024-09-11T22:35:41.946261+0000","last_clean":"2024-09-11T22:35:41.946261+0000","last_became_active":"2024-09-11T22:20:18.856165+0000","last_became_peered":"2024-09-11T22:20:18.856165+0000","last_unstale":"2024-09-11T22:35:41.946261+0000","last_undegraded":"2024-09-11T22:35:41.946261+0000","last_fullsized":"2024-09-11T22:35:41.946261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1002,"log_dups_size":0,"ondisk_log_size":1002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":994,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'6307","reported_seq":6331,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.864098+0000","last_change":"2024-09-11T22:20:23.878121+0000","last_active":"2024-09-11T22:35:44.864098+0000","last_peered":"2024-09-11T22:35:44.864098+0000","last_clean":"2024-09-11T22:35:44.864098+0000","last_became_active":"2024-09-11T22:20:23.877713+0000","last_became_peered":"2024-09-11T22:20:23.877713+0000","last_unstale":"2024-09-11T22:35:44.864098+0000","last_undegraded":"2024-09-11T22:35:44.864098+0000","last_fullsized":"2024-09-11T22:35:44.864098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6307,"log_dups_size":0,"ondisk_log_size":6307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28296,"num_write_kb":522771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'17","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.045109+0000","last_change":"2024-09-11T22:20:19.858358+0000","last_active":"2024-09-11T22:35:51.045109+0000","last_peered":"2024-09-11T22:35:51.045109+0000","last_clean":"2024-09-11T22:35:51.045109+0000","last_became_active":"2024-09-11T22:20:19.858057+0000","last_became_peered":"2024-09-11T22:20:19.858057+0000","last_unstale":"2024-09-11T22:35:51.045109+0000","last_undegraded":"2024-09-11T22:35:51.045109+0000","last_fullsized":"2024-09-11T22:35:51.045109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:07.839926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'7","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.931632+0000","last_change":"2024-09-11T22:20:18.853818+0000","last_active":"2024-09-11T22:35:41.931632+0000","last_peered":"2024-09-11T22:35:41.931632+0000","last_clean":"2024-09-11T22:35:41.931632+0000","last_became_active":"2024-09-11T22:20:18.853508+0000","last_became_peered":"2024-09-11T22:20:18.853508+0000","last_unstale":"2024-09-11T22:35:41.931632+0000","last_undegraded":"2024-09-11T22:35:41.931632+0000","last_fullsized":"2024-09-11T22:35:41.931632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:58.141587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'6073","reported_seq":6104,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.786267+0000","last_change":"2024-09-11T22:21:02.037670+0000","last_active":"2024-09-11T22:35:44.786267+0000","last_peered":"2024-09-11T22:35:44.786267+0000","last_clean":"2024-09-11T22:35:44.786267+0000","last_became_active":"2024-09-11T22:21:02.036941+0000","last_became_peered":"2024-09-11T22:21:02.036941+0000","last_unstale":"2024-09-11T22:35:44.786267+0000","last_undegraded":"2024-09-11T22:35:44.786267+0000","last_fullsized":"2024-09-11T22:35:44.786267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6073,"log_dups_size":0,"ondisk_log_size":6073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:20.859515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27207,"num_write_kb":522378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'18","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043412+0000","last_change":"2024-09-11T22:20:19.844748+0000","last_active":"2024-09-11T22:35:51.043412+0000","last_peered":"2024-09-11T22:35:51.043412+0000","last_clean":"2024-09-11T22:35:51.043412+0000","last_became_active":"2024-09-11T22:20:19.844446+0000","last_became_peered":"2024-09-11T22:20:19.844446+0000","last_unstale":"2024-09-11T22:35:51.043412+0000","last_undegraded":"2024-09-11T22:35:51.043412+0000","last_fullsized":"2024-09-11T22:35:51.043412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:13.319918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'6","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.366967+0000","last_change":"2024-09-11T22:20:18.847388+0000","last_active":"2024-09-11T22:35:37.366967+0000","last_peered":"2024-09-11T22:35:37.366967+0000","last_clean":"2024-09-11T22:35:37.366967+0000","last_became_active":"2024-09-11T22:20:18.847118+0000","last_became_peered":"2024-09-11T22:20:18.847118+0000","last_unstale":"2024-09-11T22:35:37.366967+0000","last_undegraded":"2024-09-11T22:35:37.366967+0000","last_fullsized":"2024-09-11T22:35:37.366967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:47.360920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'7846","reported_seq":7870,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.854263+0000","last_change":"2024-09-11T22:20:24.077604+0000","last_active":"2024-09-11T22:35:44.854263+0000","last_peered":"2024-09-11T22:35:44.854263+0000","last_clean":"2024-09-11T22:35:44.854263+0000","last_became_active":"2024-09-11T22:20:24.077231+0000","last_became_peered":"2024-09-11T22:20:24.077231+0000","last_unstale":"2024-09-11T22:35:44.854263+0000","last_undegraded":"2024-09-11T22:35:44.854263+0000","last_fullsized":"2024-09-11T22:35:44.854263+0000","mapping_epoch":24,"log_start":"28'701","ondisk_log_start":"28'701","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":7145,"log_dups_size":0,"ondisk_log_size":7145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:38.846688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35635,"num_write_kb":625996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"28'12","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.030058+0000","last_change":"2024-09-11T22:20:19.854453+0000","last_active":"2024-09-11T22:35:51.030058+0000","last_peered":"2024-09-11T22:35:51.030058+0000","last_clean":"2024-09-11T22:35:51.030058+0000","last_became_active":"2024-09-11T22:20:19.854100+0000","last_became_peered":"2024-09-11T22:20:19.854100+0000","last_unstale":"2024-09-11T22:35:51.030058+0000","last_undegraded":"2024-09-11T22:35:51.030058+0000","last_fullsized":"2024-09-11T22:35:51.030058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:06.166813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.334898+0000","last_change":"2024-09-11T22:20:18.854889+0000","last_active":"2024-09-11T22:35:37.334898+0000","last_peered":"2024-09-11T22:35:37.334898+0000","last_clean":"2024-09-11T22:35:37.334898+0000","last_became_active":"2024-09-11T22:20:18.854552+0000","last_became_peered":"2024-09-11T22:20:18.854552+0000","last_unstale":"2024-09-11T22:35:37.334898+0000","last_undegraded":"2024-09-11T22:35:37.334898+0000","last_fullsized":"2024-09-11T22:35:37.334898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:33.612126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'4949","reported_seq":4973,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.864497+0000","last_change":"2024-09-11T22:20:23.878932+0000","last_active":"2024-09-11T22:35:44.864497+0000","last_peered":"2024-09-11T22:35:44.864497+0000","last_clean":"2024-09-11T22:35:44.864497+0000","last_became_active":"2024-09-11T22:20:23.878305+0000","last_became_peered":"2024-09-11T22:20:23.878305+0000","last_unstale":"2024-09-11T22:35:44.864497+0000","last_undegraded":"2024-09-11T22:35:44.864497+0000","last_fullsized":"2024-09-11T22:35:44.864497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":4949,"log_dups_size":0,"ondisk_log_size":4949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21676,"num_write_kb":446977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'26","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043612+0000","last_change":"2024-09-11T22:20:19.856318+0000","last_active":"2024-09-11T22:35:51.043612+0000","last_peered":"2024-09-11T22:35:51.043612+0000","last_clean":"2024-09-11T22:35:51.043612+0000","last_became_active":"2024-09-11T22:20:19.855992+0000","last_became_peered":"2024-09-11T22:20:19.855992+0000","last_unstale":"2024-09-11T22:35:51.043612+0000","last_undegraded":"2024-09-11T22:35:51.043612+0000","last_fullsized":"2024-09-11T22:35:51.043612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:57.709140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'6","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:28.337628+0000","last_change":"2024-09-11T22:20:18.850750+0000","last_active":"2024-09-11T22:35:28.337628+0000","last_peered":"2024-09-11T22:35:28.337628+0000","last_clean":"2024-09-11T22:35:28.337628+0000","last_became_active":"2024-09-11T22:20:18.849621+0000","last_became_peered":"2024-09-11T22:20:18.849621+0000","last_unstale":"2024-09-11T22:35:28.337628+0000","last_undegraded":"2024-09-11T22:35:28.337628+0000","last_fullsized":"2024-09-11T22:35:28.337628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'5822","reported_seq":5847,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.807191+0000","last_change":"2024-09-11T22:20:24.077741+0000","last_active":"2024-09-11T22:35:44.807191+0000","last_peered":"2024-09-11T22:35:44.807191+0000","last_clean":"2024-09-11T22:35:44.807191+0000","last_became_active":"2024-09-11T22:20:24.077325+0000","last_became_peered":"2024-09-11T22:20:24.077325+0000","last_unstale":"2024-09-11T22:35:44.807191+0000","last_undegraded":"2024-09-11T22:35:44.807191+0000","last_fullsized":"2024-09-11T22:35:44.807191+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5822,"log_dups_size":0,"ondisk_log_size":5822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:18.656529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26961,"num_write_kb":521330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'18","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.057658+0000","last_change":"2024-09-11T22:20:19.850738+0000","last_active":"2024-09-11T22:35:51.057658+0000","last_peered":"2024-09-11T22:35:51.057658+0000","last_clean":"2024-09-11T22:35:51.057658+0000","last_became_active":"2024-09-11T22:20:19.850441+0000","last_became_peered":"2024-09-11T22:20:19.850441+0000","last_unstale":"2024-09-11T22:35:51.057658+0000","last_undegraded":"2024-09-11T22:35:51.057658+0000","last_fullsized":"2024-09-11T22:35:51.057658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:47.552343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'351","reported_seq":384,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.969721+0000","last_change":"2024-09-11T22:20:18.845173+0000","last_active":"2024-09-11T22:35:41.969721+0000","last_peered":"2024-09-11T22:35:41.969721+0000","last_clean":"2024-09-11T22:35:41.969721+0000","last_became_active":"2024-09-11T22:20:18.844731+0000","last_became_peered":"2024-09-11T22:20:18.844731+0000","last_unstale":"2024-09-11T22:35:41.969721+0000","last_undegraded":"2024-09-11T22:35:41.969721+0000","last_fullsized":"2024-09-11T22:35:41.969721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:32.963285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'6627","reported_seq":6659,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.761641+0000","last_change":"2024-09-11T22:21:02.037927+0000","last_active":"2024-09-11T22:35:44.761641+0000","last_peered":"2024-09-11T22:35:44.761641+0000","last_clean":"2024-09-11T22:35:44.761641+0000","last_became_active":"2024-09-11T22:21:02.037520+0000","last_became_peered":"2024-09-11T22:21:02.037520+0000","last_unstale":"2024-09-11T22:35:44.761641+0000","last_undegraded":"2024-09-11T22:35:44.761641+0000","last_fullsized":"2024-09-11T22:35:44.761641+0000","mapping_epoch":27,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6327,"log_dups_size":0,"ondisk_log_size":6327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:38.798530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30659,"num_write_kb":569042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'18","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.040494+0000","last_change":"2024-09-11T22:20:19.845497+0000","last_active":"2024-09-11T22:35:51.040494+0000","last_peered":"2024-09-11T22:35:51.040494+0000","last_clean":"2024-09-11T22:35:51.040494+0000","last_became_active":"2024-09-11T22:20:19.845203+0000","last_became_peered":"2024-09-11T22:20:19.845203+0000","last_unstale":"2024-09-11T22:35:51.040494+0000","last_undegraded":"2024-09-11T22:35:51.040494+0000","last_fullsized":"2024-09-11T22:35:51.040494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:12.086231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.363453+0000","last_change":"2024-09-11T22:20:18.856263+0000","last_active":"2024-09-11T22:35:37.363453+0000","last_peered":"2024-09-11T22:35:37.363453+0000","last_clean":"2024-09-11T22:35:37.363453+0000","last_became_active":"2024-09-11T22:20:18.855968+0000","last_became_peered":"2024-09-11T22:20:18.855968+0000","last_unstale":"2024-09-11T22:35:37.363453+0000","last_undegraded":"2024-09-11T22:35:37.363453+0000","last_fullsized":"2024-09-11T22:35:37.363453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'5454","reported_seq":5479,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.210141+0000","last_change":"2024-09-11T22:20:24.075030+0000","last_active":"2024-09-11T22:35:44.210141+0000","last_peered":"2024-09-11T22:35:44.210141+0000","last_clean":"2024-09-11T22:35:44.210141+0000","last_became_active":"2024-09-11T22:20:24.074588+0000","last_became_peered":"2024-09-11T22:20:24.074588+0000","last_unstale":"2024-09-11T22:35:44.210141+0000","last_undegraded":"2024-09-11T22:35:44.210141+0000","last_fullsized":"2024-09-11T22:35:44.210141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5454,"log_dups_size":0,"ondisk_log_size":5454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25186,"num_write_kb":469240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'18","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.062538+0000","last_change":"2024-09-11T22:20:19.859010+0000","last_active":"2024-09-11T22:35:51.062538+0000","last_peered":"2024-09-11T22:35:51.062538+0000","last_clean":"2024-09-11T22:35:51.062538+0000","last_became_active":"2024-09-11T22:20:19.858585+0000","last_became_peered":"2024-09-11T22:20:19.858585+0000","last_unstale":"2024-09-11T22:35:51.062538+0000","last_undegraded":"2024-09-11T22:35:51.062538+0000","last_fullsized":"2024-09-11T22:35:51.062538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.850550+0000","last_change":"2024-09-11T22:20:18.847904+0000","last_active":"2024-09-11T22:35:37.850550+0000","last_peered":"2024-09-11T22:35:37.850550+0000","last_clean":"2024-09-11T22:35:37.850550+0000","last_became_active":"2024-09-11T22:20:18.847669+0000","last_became_peered":"2024-09-11T22:20:18.847669+0000","last_unstale":"2024-09-11T22:35:37.850550+0000","last_undegraded":"2024-09-11T22:35:37.850550+0000","last_fullsized":"2024-09-11T22:35:37.850550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:08.717999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'6951","reported_seq":6976,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.741120+0000","last_change":"2024-09-11T22:20:23.881067+0000","last_active":"2024-09-11T22:35:44.741120+0000","last_peered":"2024-09-11T22:35:44.741120+0000","last_clean":"2024-09-11T22:35:44.741120+0000","last_became_active":"2024-09-11T22:20:23.880468+0000","last_became_peered":"2024-09-11T22:20:23.880468+0000","last_unstale":"2024-09-11T22:35:44.741120+0000","last_undegraded":"2024-09-11T22:35:44.741120+0000","last_fullsized":"2024-09-11T22:35:44.741120+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6951,"log_dups_size":0,"ondisk_log_size":6951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:23.480547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31360,"num_write_kb":584090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'17","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.049873+0000","last_change":"2024-09-11T22:20:19.860423+0000","last_active":"2024-09-11T22:35:51.049873+0000","last_peered":"2024-09-11T22:35:51.049873+0000","last_clean":"2024-09-11T22:35:51.049873+0000","last_became_active":"2024-09-11T22:20:19.858932+0000","last_became_peered":"2024-09-11T22:20:19.858932+0000","last_unstale":"2024-09-11T22:35:51.049873+0000","last_undegraded":"2024-09-11T22:35:51.049873+0000","last_fullsized":"2024-09-11T22:35:51.049873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:53.255932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'6","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.950652+0000","last_change":"2024-09-11T22:20:18.854973+0000","last_active":"2024-09-11T22:35:41.950652+0000","last_peered":"2024-09-11T22:35:41.950652+0000","last_clean":"2024-09-11T22:35:41.950652+0000","last_became_active":"2024-09-11T22:20:18.854725+0000","last_became_peered":"2024-09-11T22:20:18.854725+0000","last_unstale":"2024-09-11T22:35:41.950652+0000","last_undegraded":"2024-09-11T22:35:41.950652+0000","last_fullsized":"2024-09-11T22:35:41.950652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'6039","reported_seq":6064,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.873235+0000","last_change":"2024-09-11T22:20:23.880693+0000","last_active":"2024-09-11T22:35:44.873235+0000","last_peered":"2024-09-11T22:35:44.873235+0000","last_clean":"2024-09-11T22:35:44.873235+0000","last_became_active":"2024-09-11T22:20:23.880243+0000","last_became_peered":"2024-09-11T22:20:23.880243+0000","last_unstale":"2024-09-11T22:35:44.873235+0000","last_undegraded":"2024-09-11T22:35:44.873235+0000","last_fullsized":"2024-09-11T22:35:44.873235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6039,"log_dups_size":0,"ondisk_log_size":6039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.659287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27825,"num_write_kb":504386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'23","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.040905+0000","last_change":"2024-09-11T22:20:19.844808+0000","last_active":"2024-09-11T22:35:51.040905+0000","last_peered":"2024-09-11T22:35:51.040905+0000","last_clean":"2024-09-11T22:35:51.040905+0000","last_became_active":"2024-09-11T22:20:19.844536+0000","last_became_peered":"2024-09-11T22:20:19.844536+0000","last_unstale":"2024-09-11T22:35:51.040905+0000","last_undegraded":"2024-09-11T22:35:51.040905+0000","last_fullsized":"2024-09-11T22:35:51.040905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:57.142383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'51","reported_seq":129,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:31.518080+0000","last_change":"2024-09-11T22:20:18.855640+0000","last_active":"2024-09-11T22:35:31.518080+0000","last_peered":"2024-09-11T22:35:31.518080+0000","last_clean":"2024-09-11T22:35:31.518080+0000","last_became_active":"2024-09-11T22:20:18.855394+0000","last_became_peered":"2024-09-11T22:20:18.855394+0000","last_unstale":"2024-09-11T22:35:31.518080+0000","last_undegraded":"2024-09-11T22:35:31.518080+0000","last_fullsized":"2024-09-11T22:35:31.518080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94258,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":122,"num_write":49,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'6775","reported_seq":6800,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.543280+0000","last_change":"2024-09-11T22:20:23.882554+0000","last_active":"2024-09-11T22:35:44.543280+0000","last_peered":"2024-09-11T22:35:44.543280+0000","last_clean":"2024-09-11T22:35:44.543280+0000","last_became_active":"2024-09-11T22:20:23.881642+0000","last_became_peered":"2024-09-11T22:20:23.881642+0000","last_unstale":"2024-09-11T22:35:44.543280+0000","last_undegraded":"2024-09-11T22:35:44.543280+0000","last_fullsized":"2024-09-11T22:35:44.543280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6775,"log_dups_size":0,"ondisk_log_size":6775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:16.696043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30543,"num_write_kb":560301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'13","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.041208+0000","last_change":"2024-09-11T22:20:19.859429+0000","last_active":"2024-09-11T22:35:51.041208+0000","last_peered":"2024-09-11T22:35:51.041208+0000","last_clean":"2024-09-11T22:35:51.041208+0000","last_became_active":"2024-09-11T22:20:19.859159+0000","last_became_peered":"2024-09-11T22:20:19.859159+0000","last_unstale":"2024-09-11T22:35:51.041208+0000","last_undegraded":"2024-09-11T22:35:51.041208+0000","last_fullsized":"2024-09-11T22:35:51.041208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:02.696450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'8","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.980499+0000","last_change":"2024-09-11T22:20:18.856144+0000","last_active":"2024-09-11T22:35:41.980499+0000","last_peered":"2024-09-11T22:35:41.980499+0000","last_clean":"2024-09-11T22:35:41.980499+0000","last_became_active":"2024-09-11T22:20:18.855866+0000","last_became_peered":"2024-09-11T22:20:18.855866+0000","last_unstale":"2024-09-11T22:35:41.980499+0000","last_undegraded":"2024-09-11T22:35:41.980499+0000","last_fullsized":"2024-09-11T22:35:41.980499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:37.259393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'5391","reported_seq":5416,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.679630+0000","last_change":"2024-09-11T22:20:24.075154+0000","last_active":"2024-09-11T22:35:44.679630+0000","last_peered":"2024-09-11T22:35:44.679630+0000","last_clean":"2024-09-11T22:35:44.679630+0000","last_became_active":"2024-09-11T22:20:24.074568+0000","last_became_peered":"2024-09-11T22:20:24.074568+0000","last_unstale":"2024-09-11T22:35:44.679630+0000","last_undegraded":"2024-09-11T22:35:44.679630+0000","last_fullsized":"2024-09-11T22:35:44.679630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5391,"log_dups_size":0,"ondisk_log_size":5391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:09.804991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24494,"num_write_kb":454589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'16","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.061776+0000","last_change":"2024-09-11T22:20:19.861236+0000","last_active":"2024-09-11T22:35:51.061776+0000","last_peered":"2024-09-11T22:35:51.061776+0000","last_clean":"2024-09-11T22:35:51.061776+0000","last_became_active":"2024-09-11T22:20:19.860938+0000","last_became_peered":"2024-09-11T22:20:19.860938+0000","last_unstale":"2024-09-11T22:35:51.061776+0000","last_undegraded":"2024-09-11T22:35:51.061776+0000","last_fullsized":"2024-09-11T22:35:51.061776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:42.015334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'4","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:32:48.462376+0000","last_change":"2024-09-11T22:20:18.853467+0000","last_active":"2024-09-11T22:32:48.462376+0000","last_peered":"2024-09-11T22:32:48.462376+0000","last_clean":"2024-09-11T22:32:48.462376+0000","last_became_active":"2024-09-11T22:20:18.853182+0000","last_became_peered":"2024-09-11T22:20:18.853182+0000","last_unstale":"2024-09-11T22:32:48.462376+0000","last_undegraded":"2024-09-11T22:32:48.462376+0000","last_fullsized":"2024-09-11T22:32:48.462376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":189,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:32:13.435821+0000","last_change":"2024-09-11T22:20:09.425648+0000","last_active":"2024-09-11T22:32:13.435821+0000","last_peered":"2024-09-11T22:32:13.435821+0000","last_clean":"2024-09-11T22:32:13.435821+0000","last_became_active":"2024-09-11T22:20:09.424591+0000","last_became_peered":"2024-09-11T22:20:09.424591+0000","last_unstale":"2024-09-11T22:32:13.435821+0000","last_undegraded":"2024-09-11T22:32:13.435821+0000","last_fullsized":"2024-09-11T22:32:13.435821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_clean_scrub_stamp":"2024-09-11T22:20:08.334092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:53.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'5687","reported_seq":5712,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.790987+0000","last_change":"2024-09-11T22:20:24.077007+0000","last_active":"2024-09-11T22:35:44.790987+0000","last_peered":"2024-09-11T22:35:44.790987+0000","last_clean":"2024-09-11T22:35:44.790987+0000","last_became_active":"2024-09-11T22:20:24.076601+0000","last_became_peered":"2024-09-11T22:20:24.076601+0000","last_unstale":"2024-09-11T22:35:44.790987+0000","last_undegraded":"2024-09-11T22:35:44.790987+0000","last_fullsized":"2024-09-11T22:35:44.790987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5687,"log_dups_size":0,"ondisk_log_size":5687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25854,"num_write_kb":500757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'22","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.063439+0000","last_change":"2024-09-11T22:20:19.863279+0000","last_active":"2024-09-11T22:35:51.063439+0000","last_peered":"2024-09-11T22:35:51.063439+0000","last_clean":"2024-09-11T22:35:51.063439+0000","last_became_active":"2024-09-11T22:20:19.861322+0000","last_became_peered":"2024-09-11T22:20:19.861322+0000","last_unstale":"2024-09-11T22:35:51.063439+0000","last_undegraded":"2024-09-11T22:35:51.063439+0000","last_fullsized":"2024-09-11T22:35:51.063439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'5","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:33:51.687511+0000","last_change":"2024-09-11T22:20:18.853343+0000","last_active":"2024-09-11T22:33:51.687511+0000","last_peered":"2024-09-11T22:33:51.687511+0000","last_clean":"2024-09-11T22:33:51.687511+0000","last_became_active":"2024-09-11T22:20:18.853069+0000","last_became_peered":"2024-09-11T22:20:18.853069+0000","last_unstale":"2024-09-11T22:33:51.687511+0000","last_undegraded":"2024-09-11T22:33:51.687511+0000","last_fullsized":"2024-09-11T22:33:51.687511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'5968","reported_seq":5993,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.663026+0000","last_change":"2024-09-11T22:20:24.075350+0000","last_active":"2024-09-11T22:35:44.663026+0000","last_peered":"2024-09-11T22:35:44.663026+0000","last_clean":"2024-09-11T22:35:44.663026+0000","last_became_active":"2024-09-11T22:20:24.074789+0000","last_became_peered":"2024-09-11T22:20:24.074789+0000","last_unstale":"2024-09-11T22:35:44.663026+0000","last_undegraded":"2024-09-11T22:35:44.663026+0000","last_fullsized":"2024-09-11T22:35:44.663026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5968,"log_dups_size":0,"ondisk_log_size":5968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27295,"num_write_kb":514661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'20","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.061734+0000","last_change":"2024-09-11T22:20:19.866331+0000","last_active":"2024-09-11T22:35:51.061734+0000","last_peered":"2024-09-11T22:35:51.061734+0000","last_clean":"2024-09-11T22:35:51.061734+0000","last_became_active":"2024-09-11T22:20:19.865535+0000","last_became_peered":"2024-09-11T22:20:19.865535+0000","last_unstale":"2024-09-11T22:35:51.061734+0000","last_undegraded":"2024-09-11T22:35:51.061734+0000","last_fullsized":"2024-09-11T22:35:51.061734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'2","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:33:54.589490+0000","last_change":"2024-09-11T22:20:18.849434+0000","last_active":"2024-09-11T22:33:54.589490+0000","last_peered":"2024-09-11T22:33:54.589490+0000","last_clean":"2024-09-11T22:33:54.589490+0000","last_became_active":"2024-09-11T22:20:18.848787+0000","last_became_peered":"2024-09-11T22:20:18.848787+0000","last_unstale":"2024-09-11T22:33:54.589490+0000","last_undegraded":"2024-09-11T22:33:54.589490+0000","last_fullsized":"2024-09-11T22:33:54.589490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:25.689495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'5430","reported_seq":5454,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.747663+0000","last_change":"2024-09-11T22:20:23.879962+0000","last_active":"2024-09-11T22:35:44.747663+0000","last_peered":"2024-09-11T22:35:44.747663+0000","last_clean":"2024-09-11T22:35:44.747663+0000","last_became_active":"2024-09-11T22:20:23.879586+0000","last_became_peered":"2024-09-11T22:20:23.879586+0000","last_unstale":"2024-09-11T22:35:44.747663+0000","last_undegraded":"2024-09-11T22:35:44.747663+0000","last_fullsized":"2024-09-11T22:35:44.747663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5430,"log_dups_size":0,"ondisk_log_size":5430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:27.323116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24342,"num_write_kb":478105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'21","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.056702+0000","last_change":"2024-09-11T22:20:19.860411+0000","last_active":"2024-09-11T22:35:51.056702+0000","last_peered":"2024-09-11T22:35:51.056702+0000","last_clean":"2024-09-11T22:35:51.056702+0000","last_became_active":"2024-09-11T22:20:19.860076+0000","last_became_peered":"2024-09-11T22:20:19.860076+0000","last_unstale":"2024-09-11T22:35:51.056702+0000","last_undegraded":"2024-09-11T22:35:51.056702+0000","last_fullsized":"2024-09-11T22:35:51.056702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'6","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.945924+0000","last_change":"2024-09-11T22:20:18.856020+0000","last_active":"2024-09-11T22:35:41.945924+0000","last_peered":"2024-09-11T22:35:41.945924+0000","last_clean":"2024-09-11T22:35:41.945924+0000","last_became_active":"2024-09-11T22:20:18.855753+0000","last_became_peered":"2024-09-11T22:20:18.855753+0000","last_unstale":"2024-09-11T22:35:41.945924+0000","last_undegraded":"2024-09-11T22:35:41.945924+0000","last_fullsized":"2024-09-11T22:35:41.945924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'6069","reported_seq":6094,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.538017+0000","last_change":"2024-09-11T22:20:24.077975+0000","last_active":"2024-09-11T22:35:44.538017+0000","last_peered":"2024-09-11T22:35:44.538017+0000","last_clean":"2024-09-11T22:35:44.538017+0000","last_became_active":"2024-09-11T22:20:24.077502+0000","last_became_peered":"2024-09-11T22:20:24.077502+0000","last_unstale":"2024-09-11T22:35:44.538017+0000","last_undegraded":"2024-09-11T22:35:44.538017+0000","last_fullsized":"2024-09-11T22:35:44.538017+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6069,"log_dups_size":0,"ondisk_log_size":6069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:16.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27695,"num_write_kb":495810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'12","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.052943+0000","last_change":"2024-09-11T22:20:19.856986+0000","last_active":"2024-09-11T22:35:51.052943+0000","last_peered":"2024-09-11T22:35:51.052943+0000","last_clean":"2024-09-11T22:35:51.052943+0000","last_became_active":"2024-09-11T22:20:19.856739+0000","last_became_peered":"2024-09-11T22:20:19.856739+0000","last_unstale":"2024-09-11T22:35:51.052943+0000","last_undegraded":"2024-09-11T22:35:51.052943+0000","last_fullsized":"2024-09-11T22:35:51.052943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'6","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.987646+0000","last_change":"2024-09-11T22:20:18.855044+0000","last_active":"2024-09-11T22:35:41.987646+0000","last_peered":"2024-09-11T22:35:41.987646+0000","last_clean":"2024-09-11T22:35:41.987646+0000","last_became_active":"2024-09-11T22:20:18.854764+0000","last_became_peered":"2024-09-11T22:20:18.854764+0000","last_unstale":"2024-09-11T22:35:41.987646+0000","last_undegraded":"2024-09-11T22:35:41.987646+0000","last_fullsized":"2024-09-11T22:35:41.987646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:22.207278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'5738","reported_seq":5763,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.723908+0000","last_change":"2024-09-11T22:20:23.878383+0000","last_active":"2024-09-11T22:35:44.723908+0000","last_peered":"2024-09-11T22:35:44.723908+0000","last_clean":"2024-09-11T22:35:44.723908+0000","last_became_active":"2024-09-11T22:20:23.877890+0000","last_became_peered":"2024-09-11T22:20:23.877890+0000","last_unstale":"2024-09-11T22:35:44.723908+0000","last_undegraded":"2024-09-11T22:35:44.723908+0000","last_fullsized":"2024-09-11T22:35:44.723908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5738,"log_dups_size":0,"ondisk_log_size":5738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:18.876485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25762,"num_write_kb":496113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'20","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.057770+0000","last_change":"2024-09-11T22:20:19.861242+0000","last_active":"2024-09-11T22:35:51.057770+0000","last_peered":"2024-09-11T22:35:51.057770+0000","last_clean":"2024-09-11T22:35:51.057770+0000","last_became_active":"2024-09-11T22:20:19.860988+0000","last_became_peered":"2024-09-11T22:20:19.860988+0000","last_unstale":"2024-09-11T22:35:51.057770+0000","last_undegraded":"2024-09-11T22:35:51.057770+0000","last_fullsized":"2024-09-11T22:35:51.057770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'19","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.960798+0000","last_change":"2024-09-11T22:20:18.852459+0000","last_active":"2024-09-11T22:35:41.960798+0000","last_peered":"2024-09-11T22:35:41.960798+0000","last_clean":"2024-09-11T22:35:41.960798+0000","last_became_active":"2024-09-11T22:20:18.852153+0000","last_became_peered":"2024-09-11T22:20:18.852153+0000","last_unstale":"2024-09-11T22:35:41.960798+0000","last_undegraded":"2024-09-11T22:35:41.960798+0000","last_fullsized":"2024-09-11T22:35:41.960798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'6219","reported_seq":6243,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.807182+0000","last_change":"2024-09-11T22:20:23.874062+0000","last_active":"2024-09-11T22:35:44.807182+0000","last_peered":"2024-09-11T22:35:44.807182+0000","last_clean":"2024-09-11T22:35:44.807182+0000","last_became_active":"2024-09-11T22:20:23.873635+0000","last_became_peered":"2024-09-11T22:20:23.873635+0000","last_unstale":"2024-09-11T22:35:44.807182+0000","last_undegraded":"2024-09-11T22:35:44.807182+0000","last_fullsized":"2024-09-11T22:35:44.807182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6219,"log_dups_size":0,"ondisk_log_size":6219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:40.914142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28436,"num_write_kb":547819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'20","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.045171+0000","last_change":"2024-09-11T22:20:19.851577+0000","last_active":"2024-09-11T22:35:51.045171+0000","last_peered":"2024-09-11T22:35:51.045171+0000","last_clean":"2024-09-11T22:35:51.045171+0000","last_became_active":"2024-09-11T22:20:19.851286+0000","last_became_peered":"2024-09-11T22:20:19.851286+0000","last_unstale":"2024-09-11T22:35:51.045171+0000","last_undegraded":"2024-09-11T22:35:51.045171+0000","last_fullsized":"2024-09-11T22:35:51.045171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:32.025931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'9","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.934456+0000","last_change":"2024-09-11T22:20:18.853301+0000","last_active":"2024-09-11T22:35:41.934456+0000","last_peered":"2024-09-11T22:35:41.934456+0000","last_clean":"2024-09-11T22:35:41.934456+0000","last_became_active":"2024-09-11T22:20:18.852978+0000","last_became_peered":"2024-09-11T22:20:18.852978+0000","last_unstale":"2024-09-11T22:35:41.934456+0000","last_undegraded":"2024-09-11T22:35:41.934456+0000","last_fullsized":"2024-09-11T22:35:41.934456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'6495","reported_seq":6519,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.721208+0000","last_change":"2024-09-11T22:20:24.077636+0000","last_active":"2024-09-11T22:35:44.721208+0000","last_peered":"2024-09-11T22:35:44.721208+0000","last_clean":"2024-09-11T22:35:44.721208+0000","last_became_active":"2024-09-11T22:20:24.077313+0000","last_became_peered":"2024-09-11T22:20:24.077313+0000","last_unstale":"2024-09-11T22:35:44.721208+0000","last_undegraded":"2024-09-11T22:35:44.721208+0000","last_fullsized":"2024-09-11T22:35:44.721208+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6295,"log_dups_size":0,"ondisk_log_size":6295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:23.154027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29875,"num_write_kb":541234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'29","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.056839+0000","last_change":"2024-09-11T22:20:19.862562+0000","last_active":"2024-09-11T22:35:51.056839+0000","last_peered":"2024-09-11T22:35:51.056839+0000","last_clean":"2024-09-11T22:35:51.056839+0000","last_became_active":"2024-09-11T22:20:19.862267+0000","last_became_peered":"2024-09-11T22:20:19.862267+0000","last_unstale":"2024-09-11T22:35:51.056839+0000","last_undegraded":"2024-09-11T22:35:51.056839+0000","last_fullsized":"2024-09-11T22:35:51.056839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'8","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.772343+0000","last_change":"2024-09-11T22:20:18.858002+0000","last_active":"2024-09-11T22:35:41.772343+0000","last_peered":"2024-09-11T22:35:41.772343+0000","last_clean":"2024-09-11T22:35:41.772343+0000","last_became_active":"2024-09-11T22:20:18.857419+0000","last_became_peered":"2024-09-11T22:20:18.857419+0000","last_unstale":"2024-09-11T22:35:41.772343+0000","last_undegraded":"2024-09-11T22:35:41.772343+0000","last_fullsized":"2024-09-11T22:35:41.772343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'6284","reported_seq":6308,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.748617+0000","last_change":"2024-09-11T22:20:24.074971+0000","last_active":"2024-09-11T22:35:44.748617+0000","last_peered":"2024-09-11T22:35:44.748617+0000","last_clean":"2024-09-11T22:35:44.748617+0000","last_became_active":"2024-09-11T22:20:24.074609+0000","last_became_peered":"2024-09-11T22:20:24.074609+0000","last_unstale":"2024-09-11T22:35:44.748617+0000","last_undegraded":"2024-09-11T22:35:44.748617+0000","last_fullsized":"2024-09-11T22:35:44.748617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6284,"log_dups_size":0,"ondisk_log_size":6284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:55.318904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27888,"num_write_kb":554175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'24","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.058304+0000","last_change":"2024-09-11T22:20:19.857276+0000","last_active":"2024-09-11T22:35:51.058304+0000","last_peered":"2024-09-11T22:35:51.058304+0000","last_clean":"2024-09-11T22:35:51.058304+0000","last_became_active":"2024-09-11T22:20:19.857027+0000","last_became_peered":"2024-09-11T22:20:19.857027+0000","last_unstale":"2024-09-11T22:35:51.058304+0000","last_undegraded":"2024-09-11T22:35:51.058304+0000","last_fullsized":"2024-09-11T22:35:51.058304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'11","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.763997+0000","last_change":"2024-09-11T22:20:18.848671+0000","last_active":"2024-09-11T22:35:41.763997+0000","last_peered":"2024-09-11T22:35:41.763997+0000","last_clean":"2024-09-11T22:35:41.763997+0000","last_became_active":"2024-09-11T22:20:18.848405+0000","last_became_peered":"2024-09-11T22:20:18.848405+0000","last_unstale":"2024-09-11T22:35:41.763997+0000","last_undegraded":"2024-09-11T22:35:41.763997+0000","last_fullsized":"2024-09-11T22:35:41.763997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'5107","reported_seq":5131,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.845298+0000","last_change":"2024-09-11T22:20:24.076835+0000","last_active":"2024-09-11T22:35:44.845298+0000","last_peered":"2024-09-11T22:35:44.845298+0000","last_clean":"2024-09-11T22:35:44.845298+0000","last_became_active":"2024-09-11T22:20:24.076200+0000","last_became_peered":"2024-09-11T22:20:24.076200+0000","last_unstale":"2024-09-11T22:35:44.845298+0000","last_undegraded":"2024-09-11T22:35:44.845298+0000","last_fullsized":"2024-09-11T22:35:44.845298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5107,"log_dups_size":0,"ondisk_log_size":5107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:48.150778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22900,"num_write_kb":480501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'17","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.046531+0000","last_change":"2024-09-11T22:21:02.033502+0000","last_active":"2024-09-11T22:35:51.046531+0000","last_peered":"2024-09-11T22:35:51.046531+0000","last_clean":"2024-09-11T22:35:51.046531+0000","last_became_active":"2024-09-11T22:21:02.033269+0000","last_became_peered":"2024-09-11T22:21:02.033269+0000","last_unstale":"2024-09-11T22:35:51.046531+0000","last_undegraded":"2024-09-11T22:35:51.046531+0000","last_fullsized":"2024-09-11T22:35:51.046531+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:31.993239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'329","reported_seq":361,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.984847+0000","last_change":"2024-09-11T22:20:18.855665+0000","last_active":"2024-09-11T22:35:41.984847+0000","last_peered":"2024-09-11T22:35:41.984847+0000","last_clean":"2024-09-11T22:35:41.984847+0000","last_became_active":"2024-09-11T22:20:18.855386+0000","last_became_peered":"2024-09-11T22:20:18.855386+0000","last_unstale":"2024-09-11T22:35:41.984847+0000","last_undegraded":"2024-09-11T22:35:41.984847+0000","last_fullsized":"2024-09-11T22:35:41.984847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'5582","reported_seq":5606,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.597450+0000","last_change":"2024-09-11T22:20:23.880793+0000","last_active":"2024-09-11T22:35:44.597450+0000","last_peered":"2024-09-11T22:35:44.597450+0000","last_clean":"2024-09-11T22:35:44.597450+0000","last_became_active":"2024-09-11T22:20:23.879993+0000","last_became_peered":"2024-09-11T22:20:23.879993+0000","last_unstale":"2024-09-11T22:35:44.597450+0000","last_undegraded":"2024-09-11T22:35:44.597450+0000","last_fullsized":"2024-09-11T22:35:44.597450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5582,"log_dups_size":0,"ondisk_log_size":5582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:50.449090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25321,"num_write_kb":502610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'21","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.050799+0000","last_change":"2024-09-11T22:20:19.858588+0000","last_active":"2024-09-11T22:35:51.050799+0000","last_peered":"2024-09-11T22:35:51.050799+0000","last_clean":"2024-09-11T22:35:51.050799+0000","last_became_active":"2024-09-11T22:20:19.858322+0000","last_became_peered":"2024-09-11T22:20:19.858322+0000","last_unstale":"2024-09-11T22:35:51.050799+0000","last_undegraded":"2024-09-11T22:35:51.050799+0000","last_fullsized":"2024-09-11T22:35:51.050799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'27","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.992364+0000","last_change":"2024-09-11T22:20:18.855056+0000","last_active":"2024-09-11T22:35:41.992364+0000","last_peered":"2024-09-11T22:35:41.992364+0000","last_clean":"2024-09-11T22:35:41.992364+0000","last_became_active":"2024-09-11T22:20:18.854784+0000","last_became_peered":"2024-09-11T22:20:18.854784+0000","last_unstale":"2024-09-11T22:35:41.992364+0000","last_undegraded":"2024-09-11T22:35:41.992364+0000","last_fullsized":"2024-09-11T22:35:41.992364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:38.916121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'6236","reported_seq":6260,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.716467+0000","last_change":"2024-09-11T22:20:23.879768+0000","last_active":"2024-09-11T22:35:44.716467+0000","last_peered":"2024-09-11T22:35:44.716467+0000","last_clean":"2024-09-11T22:35:44.716467+0000","last_became_active":"2024-09-11T22:20:23.878794+0000","last_became_peered":"2024-09-11T22:20:23.878794+0000","last_unstale":"2024-09-11T22:35:44.716467+0000","last_undegraded":"2024-09-11T22:35:44.716467+0000","last_fullsized":"2024-09-11T22:35:44.716467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6236,"log_dups_size":0,"ondisk_log_size":6236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:07.301587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28034,"num_write_kb":525577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'25","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.044031+0000","last_change":"2024-09-11T22:21:02.034590+0000","last_active":"2024-09-11T22:35:51.044031+0000","last_peered":"2024-09-11T22:35:51.044031+0000","last_clean":"2024-09-11T22:35:51.044031+0000","last_became_active":"2024-09-11T22:21:02.034349+0000","last_became_peered":"2024-09-11T22:21:02.034349+0000","last_unstale":"2024-09-11T22:35:51.044031+0000","last_undegraded":"2024-09-11T22:35:51.044031+0000","last_fullsized":"2024-09-11T22:35:51.044031+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:24.655612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'4","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.765058+0000","last_change":"2024-09-11T22:20:18.853382+0000","last_active":"2024-09-11T22:35:41.765058+0000","last_peered":"2024-09-11T22:35:41.765058+0000","last_clean":"2024-09-11T22:35:41.765058+0000","last_became_active":"2024-09-11T22:20:18.853103+0000","last_became_peered":"2024-09-11T22:20:18.853103+0000","last_unstale":"2024-09-11T22:35:41.765058+0000","last_undegraded":"2024-09-11T22:35:41.765058+0000","last_fullsized":"2024-09-11T22:35:41.765058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'5748","reported_seq":5772,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.639554+0000","last_change":"2024-09-11T22:20:23.876997+0000","last_active":"2024-09-11T22:35:44.639554+0000","last_peered":"2024-09-11T22:35:44.639554+0000","last_clean":"2024-09-11T22:35:44.639554+0000","last_became_active":"2024-09-11T22:20:23.876587+0000","last_became_peered":"2024-09-11T22:20:23.876587+0000","last_unstale":"2024-09-11T22:35:44.639554+0000","last_undegraded":"2024-09-11T22:35:44.639554+0000","last_fullsized":"2024-09-11T22:35:44.639554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5748,"log_dups_size":0,"ondisk_log_size":5748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:19.670665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26080,"num_write_kb":501611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'25","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.055748+0000","last_change":"2024-09-11T22:20:19.866624+0000","last_active":"2024-09-11T22:35:51.055748+0000","last_peered":"2024-09-11T22:35:51.055748+0000","last_clean":"2024-09-11T22:35:51.055748+0000","last_became_active":"2024-09-11T22:20:19.866303+0000","last_became_peered":"2024-09-11T22:20:19.866303+0000","last_unstale":"2024-09-11T22:35:51.055748+0000","last_undegraded":"2024-09-11T22:35:51.055748+0000","last_fullsized":"2024-09-11T22:35:51.055748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'6","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.933977+0000","last_change":"2024-09-11T22:20:18.854361+0000","last_active":"2024-09-11T22:35:41.933977+0000","last_peered":"2024-09-11T22:35:41.933977+0000","last_clean":"2024-09-11T22:35:41.933977+0000","last_became_active":"2024-09-11T22:20:18.854019+0000","last_became_peered":"2024-09-11T22:20:18.854019+0000","last_unstale":"2024-09-11T22:35:41.933977+0000","last_undegraded":"2024-09-11T22:35:41.933977+0000","last_fullsized":"2024-09-11T22:35:41.933977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'5959","reported_seq":5983,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.721236+0000","last_change":"2024-09-11T22:20:24.077476+0000","last_active":"2024-09-11T22:35:44.721236+0000","last_peered":"2024-09-11T22:35:44.721236+0000","last_clean":"2024-09-11T22:35:44.721236+0000","last_became_active":"2024-09-11T22:20:24.077134+0000","last_became_peered":"2024-09-11T22:20:24.077134+0000","last_unstale":"2024-09-11T22:35:44.721236+0000","last_undegraded":"2024-09-11T22:35:44.721236+0000","last_fullsized":"2024-09-11T22:35:44.721236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5959,"log_dups_size":0,"ondisk_log_size":5959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:03.186460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26850,"num_write_kb":516954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'7134","reported_seq":7166,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.759457+0000","last_change":"2024-09-11T22:21:02.037816+0000","last_active":"2024-09-11T22:35:44.759457+0000","last_peered":"2024-09-11T22:35:44.759457+0000","last_clean":"2024-09-11T22:35:44.759457+0000","last_became_active":"2024-09-11T22:21:02.037407+0000","last_became_peered":"2024-09-11T22:21:02.037407+0000","last_unstale":"2024-09-11T22:35:44.759457+0000","last_undegraded":"2024-09-11T22:35:44.759457+0000","last_fullsized":"2024-09-11T22:35:44.759457+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":7134,"log_dups_size":0,"ondisk_log_size":7134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:36.018837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33450,"num_write_kb":608986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'20","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.042665+0000","last_change":"2024-09-11T22:20:19.845776+0000","last_active":"2024-09-11T22:35:51.042665+0000","last_peered":"2024-09-11T22:35:51.042665+0000","last_clean":"2024-09-11T22:35:51.042665+0000","last_became_active":"2024-09-11T22:20:19.845425+0000","last_became_peered":"2024-09-11T22:20:19.845425+0000","last_unstale":"2024-09-11T22:35:51.042665+0000","last_undegraded":"2024-09-11T22:35:51.042665+0000","last_fullsized":"2024-09-11T22:35:51.042665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:07.187533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'4","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.851019+0000","last_change":"2024-09-11T22:20:18.852446+0000","last_active":"2024-09-11T22:35:37.851019+0000","last_peered":"2024-09-11T22:35:37.851019+0000","last_clean":"2024-09-11T22:35:37.851019+0000","last_became_active":"2024-09-11T22:20:18.852155+0000","last_became_peered":"2024-09-11T22:20:18.852155+0000","last_unstale":"2024-09-11T22:35:37.851019+0000","last_undegraded":"2024-09-11T22:35:37.851019+0000","last_fullsized":"2024-09-11T22:35:37.851019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"28'6143","reported_seq":6168,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.664318+0000","last_change":"2024-09-11T22:20:23.876503+0000","last_active":"2024-09-11T22:35:44.664318+0000","last_peered":"2024-09-11T22:35:44.664318+0000","last_clean":"2024-09-11T22:35:44.664318+0000","last_became_active":"2024-09-11T22:20:23.876100+0000","last_became_peered":"2024-09-11T22:20:23.876100+0000","last_unstale":"2024-09-11T22:35:44.664318+0000","last_undegraded":"2024-09-11T22:35:44.664318+0000","last_fullsized":"2024-09-11T22:35:44.664318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6143,"log_dups_size":0,"ondisk_log_size":6143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28157,"num_write_kb":534365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'27","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.045313+0000","last_change":"2024-09-11T22:20:19.852606+0000","last_active":"2024-09-11T22:35:51.045313+0000","last_peered":"2024-09-11T22:35:51.045313+0000","last_clean":"2024-09-11T22:35:51.045313+0000","last_became_active":"2024-09-11T22:20:19.852333+0000","last_became_peered":"2024-09-11T22:20:19.852333+0000","last_unstale":"2024-09-11T22:35:51.045313+0000","last_undegraded":"2024-09-11T22:35:51.045313+0000","last_fullsized":"2024-09-11T22:35:51.045313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:56.940278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'5","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:34:55.328347+0000","last_change":"2024-09-11T22:20:18.853767+0000","last_active":"2024-09-11T22:34:55.328347+0000","last_peered":"2024-09-11T22:34:55.328347+0000","last_clean":"2024-09-11T22:34:55.328347+0000","last_became_active":"2024-09-11T22:20:18.853533+0000","last_became_peered":"2024-09-11T22:20:18.853533+0000","last_unstale":"2024-09-11T22:34:55.328347+0000","last_undegraded":"2024-09-11T22:34:55.328347+0000","last_fullsized":"2024-09-11T22:34:55.328347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:36.662271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'9","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.849731+0000","last_change":"2024-09-11T22:20:18.847133+0000","last_active":"2024-09-11T22:35:37.849731+0000","last_peered":"2024-09-11T22:35:37.849731+0000","last_clean":"2024-09-11T22:35:37.849731+0000","last_became_active":"2024-09-11T22:20:18.846321+0000","last_became_peered":"2024-09-11T22:20:18.846321+0000","last_unstale":"2024-09-11T22:35:37.849731+0000","last_undegraded":"2024-09-11T22:35:37.849731+0000","last_fullsized":"2024-09-11T22:35:37.849731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'19","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.044295+0000","last_change":"2024-09-11T22:20:19.861445+0000","last_active":"2024-09-11T22:35:51.044295+0000","last_peered":"2024-09-11T22:35:51.044295+0000","last_clean":"2024-09-11T22:35:51.044295+0000","last_became_active":"2024-09-11T22:20:19.861154+0000","last_became_peered":"2024-09-11T22:20:19.861154+0000","last_unstale":"2024-09-11T22:35:51.044295+0000","last_undegraded":"2024-09-11T22:35:51.044295+0000","last_fullsized":"2024-09-11T22:35:51.044295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'5094","reported_seq":5118,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.866023+0000","last_change":"2024-09-11T22:20:23.877973+0000","last_active":"2024-09-11T22:35:44.866023+0000","last_peered":"2024-09-11T22:35:44.866023+0000","last_clean":"2024-09-11T22:35:44.866023+0000","last_became_active":"2024-09-11T22:20:23.877578+0000","last_became_peered":"2024-09-11T22:20:23.877578+0000","last_unstale":"2024-09-11T22:35:44.866023+0000","last_undegraded":"2024-09-11T22:35:44.866023+0000","last_fullsized":"2024-09-11T22:35:44.866023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5094,"log_dups_size":0,"ondisk_log_size":5094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:27.826669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23560,"num_write_kb":426046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'584","reported_seq":616,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.378051+0000","last_change":"2024-09-11T22:20:18.854142+0000","last_active":"2024-09-11T22:35:37.378051+0000","last_peered":"2024-09-11T22:35:37.378051+0000","last_clean":"2024-09-11T22:35:37.378051+0000","last_became_active":"2024-09-11T22:20:18.853872+0000","last_became_peered":"2024-09-11T22:20:18.853872+0000","last_unstale":"2024-09-11T22:35:37.378051+0000","last_undegraded":"2024-09-11T22:35:37.378051+0000","last_fullsized":"2024-09-11T22:35:37.378051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:22.513242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195510,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":580,"num_write_kb":4218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'20","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.034644+0000","last_change":"2024-09-11T22:20:19.852580+0000","last_active":"2024-09-11T22:35:51.034644+0000","last_peered":"2024-09-11T22:35:51.034644+0000","last_clean":"2024-09-11T22:35:51.034644+0000","last_became_active":"2024-09-11T22:20:19.850175+0000","last_became_peered":"2024-09-11T22:20:19.850175+0000","last_unstale":"2024-09-11T22:35:51.034644+0000","last_undegraded":"2024-09-11T22:35:51.034644+0000","last_fullsized":"2024-09-11T22:35:51.034644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:11.937256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'6620","reported_seq":6644,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.412485+0000","last_change":"2024-09-11T22:20:23.878004+0000","last_active":"2024-09-11T22:35:44.412485+0000","last_peered":"2024-09-11T22:35:44.412485+0000","last_clean":"2024-09-11T22:35:44.412485+0000","last_became_active":"2024-09-11T22:20:23.876776+0000","last_became_peered":"2024-09-11T22:20:23.876776+0000","last_unstale":"2024-09-11T22:35:44.412485+0000","last_undegraded":"2024-09-11T22:35:44.412485+0000","last_fullsized":"2024-09-11T22:35:44.412485+0000","mapping_epoch":24,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6320,"log_dups_size":0,"ondisk_log_size":6320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:11.254248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29858,"num_write_kb":574080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'24","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.045814+0000","last_change":"2024-09-11T22:20:19.853439+0000","last_active":"2024-09-11T22:35:51.045814+0000","last_peered":"2024-09-11T22:35:51.045814+0000","last_clean":"2024-09-11T22:35:51.045814+0000","last_became_active":"2024-09-11T22:20:19.852937+0000","last_became_peered":"2024-09-11T22:20:19.852937+0000","last_unstale":"2024-09-11T22:35:51.045814+0000","last_undegraded":"2024-09-11T22:35:51.045814+0000","last_fullsized":"2024-09-11T22:35:51.045814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'25","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.061579+0000","last_change":"2024-09-11T22:20:19.861003+0000","last_active":"2024-09-11T22:35:51.061579+0000","last_peered":"2024-09-11T22:35:51.061579+0000","last_clean":"2024-09-11T22:35:51.061579+0000","last_became_active":"2024-09-11T22:20:19.860690+0000","last_became_peered":"2024-09-11T22:20:19.860690+0000","last_unstale":"2024-09-11T22:35:51.061579+0000","last_undegraded":"2024-09-11T22:35:51.061579+0000","last_fullsized":"2024-09-11T22:35:51.061579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'23","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.053250+0000","last_change":"2024-09-11T22:20:19.856756+0000","last_active":"2024-09-11T22:35:51.053250+0000","last_peered":"2024-09-11T22:35:51.053250+0000","last_clean":"2024-09-11T22:35:51.053250+0000","last_became_active":"2024-09-11T22:20:19.856460+0000","last_became_peered":"2024-09-11T22:20:19.856460+0000","last_unstale":"2024-09-11T22:35:51.053250+0000","last_undegraded":"2024-09-11T22:35:51.053250+0000","last_fullsized":"2024-09-11T22:35:51.053250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'18","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043855+0000","last_change":"2024-09-11T22:20:19.855629+0000","last_active":"2024-09-11T22:35:51.043855+0000","last_peered":"2024-09-11T22:35:51.043855+0000","last_clean":"2024-09-11T22:35:51.043855+0000","last_became_active":"2024-09-11T22:20:19.855363+0000","last_became_peered":"2024-09-11T22:20:19.855363+0000","last_unstale":"2024-09-11T22:35:51.043855+0000","last_undegraded":"2024-09-11T22:35:51.043855+0000","last_fullsized":"2024-09-11T22:35:51.043855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'14","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043787+0000","last_change":"2024-09-11T22:20:19.863122+0000","last_active":"2024-09-11T22:35:51.043787+0000","last_peered":"2024-09-11T22:35:51.043787+0000","last_clean":"2024-09-11T22:35:51.043787+0000","last_became_active":"2024-09-11T22:20:19.862828+0000","last_became_peered":"2024-09-11T22:20:19.862828+0000","last_unstale":"2024-09-11T22:35:51.043787+0000","last_undegraded":"2024-09-11T22:35:51.043787+0000","last_fullsized":"2024-09-11T22:35:51.043787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:10.868762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'15","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.026329+0000","last_change":"2024-09-11T22:20:19.846453+0000","last_active":"2024-09-11T22:35:51.026329+0000","last_peered":"2024-09-11T22:35:51.026329+0000","last_clean":"2024-09-11T22:35:51.026329+0000","last_became_active":"2024-09-11T22:20:19.846186+0000","last_became_peered":"2024-09-11T22:20:19.846186+0000","last_unstale":"2024-09-11T22:35:51.026329+0000","last_undegraded":"2024-09-11T22:35:51.026329+0000","last_fullsized":"2024-09-11T22:35:51.026329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:24.032365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'24","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.062384+0000","last_change":"2024-09-11T22:20:19.860632+0000","last_active":"2024-09-11T22:35:51.062384+0000","last_peered":"2024-09-11T22:35:51.062384+0000","last_clean":"2024-09-11T22:35:51.062384+0000","last_became_active":"2024-09-11T22:20:19.860005+0000","last_became_peered":"2024-09-11T22:20:19.860005+0000","last_unstale":"2024-09-11T22:35:51.062384+0000","last_undegraded":"2024-09-11T22:35:51.062384+0000","last_fullsized":"2024-09-11T22:35:51.062384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'17","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.048597+0000","last_change":"2024-09-11T22:20:19.859195+0000","last_active":"2024-09-11T22:35:51.048597+0000","last_peered":"2024-09-11T22:35:51.048597+0000","last_clean":"2024-09-11T22:35:51.048597+0000","last_became_active":"2024-09-11T22:20:19.858832+0000","last_became_peered":"2024-09-11T22:20:19.858832+0000","last_unstale":"2024-09-11T22:35:51.048597+0000","last_undegraded":"2024-09-11T22:35:51.048597+0000","last_fullsized":"2024-09-11T22:35:51.048597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:56.259074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'18","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.038124+0000","last_change":"2024-09-11T22:20:19.858969+0000","last_active":"2024-09-11T22:35:51.038124+0000","last_peered":"2024-09-11T22:35:51.038124+0000","last_clean":"2024-09-11T22:35:51.038124+0000","last_became_active":"2024-09-11T22:20:19.857847+0000","last_became_peered":"2024-09-11T22:20:19.857847+0000","last_unstale":"2024-09-11T22:35:51.038124+0000","last_undegraded":"2024-09-11T22:35:51.038124+0000","last_fullsized":"2024-09-11T22:35:51.038124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'23","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.048974+0000","last_change":"2024-09-11T22:20:19.863294+0000","last_active":"2024-09-11T22:35:51.048974+0000","last_peered":"2024-09-11T22:35:51.048974+0000","last_clean":"2024-09-11T22:35:51.048974+0000","last_became_active":"2024-09-11T22:20:19.863007+0000","last_became_peered":"2024-09-11T22:20:19.863007+0000","last_unstale":"2024-09-11T22:35:51.048974+0000","last_undegraded":"2024-09-11T22:35:51.048974+0000","last_fullsized":"2024-09-11T22:35:51.048974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:06.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'23","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.062556+0000","last_change":"2024-09-11T22:20:19.858414+0000","last_active":"2024-09-11T22:35:51.062556+0000","last_peered":"2024-09-11T22:35:51.062556+0000","last_clean":"2024-09-11T22:35:51.062556+0000","last_became_active":"2024-09-11T22:20:19.857790+0000","last_became_peered":"2024-09-11T22:20:19.857790+0000","last_unstale":"2024-09-11T22:35:51.062556+0000","last_undegraded":"2024-09-11T22:35:51.062556+0000","last_fullsized":"2024-09-11T22:35:51.062556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'28","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.057627+0000","last_change":"2024-09-11T22:21:02.034810+0000","last_active":"2024-09-11T22:35:51.057627+0000","last_peered":"2024-09-11T22:35:51.057627+0000","last_clean":"2024-09-11T22:35:51.057627+0000","last_became_active":"2024-09-11T22:21:02.034534+0000","last_became_peered":"2024-09-11T22:21:02.034534+0000","last_unstale":"2024-09-11T22:35:51.057627+0000","last_undegraded":"2024-09-11T22:35:51.057627+0000","last_fullsized":"2024-09-11T22:35:51.057627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"28'19","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043768+0000","last_change":"2024-09-11T22:20:19.864700+0000","last_active":"2024-09-11T22:35:51.043768+0000","last_peered":"2024-09-11T22:35:51.043768+0000","last_clean":"2024-09-11T22:35:51.043768+0000","last_became_active":"2024-09-11T22:20:19.862296+0000","last_became_peered":"2024-09-11T22:20:19.862296+0000","last_unstale":"2024-09-11T22:35:51.043768+0000","last_undegraded":"2024-09-11T22:35:51.043768+0000","last_fullsized":"2024-09-11T22:35:51.043768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'22","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.049922+0000","last_change":"2024-09-11T22:20:19.855253+0000","last_active":"2024-09-11T22:35:51.049922+0000","last_peered":"2024-09-11T22:35:51.049922+0000","last_clean":"2024-09-11T22:35:51.049922+0000","last_became_active":"2024-09-11T22:20:19.854970+0000","last_became_peered":"2024-09-11T22:20:19.854970+0000","last_unstale":"2024-09-11T22:35:51.049922+0000","last_undegraded":"2024-09-11T22:35:51.049922+0000","last_fullsized":"2024-09-11T22:35:51.049922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'29","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.048687+0000","last_change":"2024-09-11T22:20:19.850202+0000","last_active":"2024-09-11T22:35:51.048687+0000","last_peered":"2024-09-11T22:35:51.048687+0000","last_clean":"2024-09-11T22:35:51.048687+0000","last_became_active":"2024-09-11T22:20:19.849815+0000","last_became_peered":"2024-09-11T22:20:19.849815+0000","last_unstale":"2024-09-11T22:35:51.048687+0000","last_undegraded":"2024-09-11T22:35:51.048687+0000","last_fullsized":"2024-09-11T22:35:51.048687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:56.480679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'21","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.057298+0000","last_change":"2024-09-11T22:20:19.866864+0000","last_active":"2024-09-11T22:35:51.057298+0000","last_peered":"2024-09-11T22:35:51.057298+0000","last_clean":"2024-09-11T22:35:51.057298+0000","last_became_active":"2024-09-11T22:20:19.866484+0000","last_became_peered":"2024-09-11T22:20:19.866484+0000","last_unstale":"2024-09-11T22:35:51.057298+0000","last_undegraded":"2024-09-11T22:35:51.057298+0000","last_fullsized":"2024-09-11T22:35:51.057298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'21","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.044671+0000","last_change":"2024-09-11T22:21:02.035254+0000","last_active":"2024-09-11T22:35:51.044671+0000","last_peered":"2024-09-11T22:35:51.044671+0000","last_clean":"2024-09-11T22:35:51.044671+0000","last_became_active":"2024-09-11T22:21:02.034985+0000","last_became_peered":"2024-09-11T22:21:02.034985+0000","last_unstale":"2024-09-11T22:35:51.044671+0000","last_undegraded":"2024-09-11T22:35:51.044671+0000","last_fullsized":"2024-09-11T22:35:51.044671+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"28'21","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.036646+0000","last_change":"2024-09-11T22:20:19.860050+0000","last_active":"2024-09-11T22:35:51.036646+0000","last_peered":"2024-09-11T22:35:51.036646+0000","last_clean":"2024-09-11T22:35:51.036646+0000","last_became_active":"2024-09-11T22:20:19.859755+0000","last_became_peered":"2024-09-11T22:20:19.859755+0000","last_unstale":"2024-09-11T22:35:51.036646+0000","last_undegraded":"2024-09-11T22:35:51.036646+0000","last_fullsized":"2024-09-11T22:35:51.036646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:42.487669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'24","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043675+0000","last_change":"2024-09-11T22:20:19.853902+0000","last_active":"2024-09-11T22:35:51.043675+0000","last_peered":"2024-09-11T22:35:51.043675+0000","last_clean":"2024-09-11T22:35:51.043675+0000","last_became_active":"2024-09-11T22:20:19.853563+0000","last_became_peered":"2024-09-11T22:20:19.853563+0000","last_unstale":"2024-09-11T22:35:51.043675+0000","last_undegraded":"2024-09-11T22:35:51.043675+0000","last_fullsized":"2024-09-11T22:35:51.043675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'25","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043068+0000","last_change":"2024-09-11T22:20:19.849490+0000","last_active":"2024-09-11T22:35:51.043068+0000","last_peered":"2024-09-11T22:35:51.043068+0000","last_clean":"2024-09-11T22:35:51.043068+0000","last_became_active":"2024-09-11T22:20:19.848965+0000","last_became_peered":"2024-09-11T22:20:19.848965+0000","last_unstale":"2024-09-11T22:35:51.043068+0000","last_undegraded":"2024-09-11T22:35:51.043068+0000","last_fullsized":"2024-09-11T22:35:51.043068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:10.387663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'17","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.042418+0000","last_change":"2024-09-11T22:20:19.860457+0000","last_active":"2024-09-11T22:35:51.042418+0000","last_peered":"2024-09-11T22:35:51.042418+0000","last_clean":"2024-09-11T22:35:51.042418+0000","last_became_active":"2024-09-11T22:20:19.858887+0000","last_became_peered":"2024-09-11T22:20:19.858887+0000","last_unstale":"2024-09-11T22:35:51.042418+0000","last_undegraded":"2024-09-11T22:35:51.042418+0000","last_fullsized":"2024-09-11T22:35:51.042418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:34.620956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'18","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.062261+0000","last_change":"2024-09-11T22:20:19.862347+0000","last_active":"2024-09-11T22:35:51.062261+0000","last_peered":"2024-09-11T22:35:51.062261+0000","last_clean":"2024-09-11T22:35:51.062261+0000","last_became_active":"2024-09-11T22:20:19.861965+0000","last_became_peered":"2024-09-11T22:20:19.861965+0000","last_unstale":"2024-09-11T22:35:51.062261+0000","last_undegraded":"2024-09-11T22:35:51.062261+0000","last_fullsized":"2024-09-11T22:35:51.062261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'29","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.063182+0000","last_change":"2024-09-11T22:20:19.862065+0000","last_active":"2024-09-11T22:35:51.063182+0000","last_peered":"2024-09-11T22:35:51.063182+0000","last_clean":"2024-09-11T22:35:51.063182+0000","last_became_active":"2024-09-11T22:20:19.861765+0000","last_became_peered":"2024-09-11T22:20:19.861765+0000","last_unstale":"2024-09-11T22:35:51.063182+0000","last_undegraded":"2024-09-11T22:35:51.063182+0000","last_fullsized":"2024-09-11T22:35:51.063182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'27","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.062819+0000","last_change":"2024-09-11T22:20:19.865064+0000","last_active":"2024-09-11T22:35:51.062819+0000","last_peered":"2024-09-11T22:35:51.062819+0000","last_clean":"2024-09-11T22:35:51.062819+0000","last_became_active":"2024-09-11T22:20:19.864697+0000","last_became_peered":"2024-09-11T22:20:19.864697+0000","last_unstale":"2024-09-11T22:35:51.062819+0000","last_undegraded":"2024-09-11T22:35:51.062819+0000","last_fullsized":"2024-09-11T22:35:51.062819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'14","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.060918+0000","last_change":"2024-09-11T22:20:19.861293+0000","last_active":"2024-09-11T22:35:51.060918+0000","last_peered":"2024-09-11T22:35:51.060918+0000","last_clean":"2024-09-11T22:35:51.060918+0000","last_became_active":"2024-09-11T22:20:19.861013+0000","last_became_peered":"2024-09-11T22:20:19.861013+0000","last_unstale":"2024-09-11T22:35:51.060918+0000","last_undegraded":"2024-09-11T22:35:51.060918+0000","last_fullsized":"2024-09-11T22:35:51.060918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:13.178404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'14","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.060763+0000","last_change":"2024-09-11T22:20:19.858131+0000","last_active":"2024-09-11T22:35:51.060763+0000","last_peered":"2024-09-11T22:35:51.060763+0000","last_clean":"2024-09-11T22:35:51.060763+0000","last_became_active":"2024-09-11T22:20:19.857842+0000","last_became_peered":"2024-09-11T22:20:19.857842+0000","last_unstale":"2024-09-11T22:35:51.060763+0000","last_undegraded":"2024-09-11T22:35:51.060763+0000","last_fullsized":"2024-09-11T22:35:51.060763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'16","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.060898+0000","last_change":"2024-09-11T22:20:19.859667+0000","last_active":"2024-09-11T22:35:51.060898+0000","last_peered":"2024-09-11T22:35:51.060898+0000","last_clean":"2024-09-11T22:35:51.060898+0000","last_became_active":"2024-09-11T22:20:19.859306+0000","last_became_peered":"2024-09-11T22:20:19.859306+0000","last_unstale":"2024-09-11T22:35:51.060898+0000","last_undegraded":"2024-09-11T22:35:51.060898+0000","last_fullsized":"2024-09-11T22:35:51.060898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'19","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.048851+0000","last_change":"2024-09-11T22:20:19.848821+0000","last_active":"2024-09-11T22:35:51.048851+0000","last_peered":"2024-09-11T22:35:51.048851+0000","last_clean":"2024-09-11T22:35:51.048851+0000","last_became_active":"2024-09-11T22:20:19.848531+0000","last_became_peered":"2024-09-11T22:20:19.848531+0000","last_unstale":"2024-09-11T22:35:51.048851+0000","last_undegraded":"2024-09-11T22:35:51.048851+0000","last_fullsized":"2024-09-11T22:35:51.048851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'15","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.061871+0000","last_change":"2024-09-11T22:20:19.866300+0000","last_active":"2024-09-11T22:35:51.061871+0000","last_peered":"2024-09-11T22:35:51.061871+0000","last_clean":"2024-09-11T22:35:51.061871+0000","last_became_active":"2024-09-11T22:20:19.865939+0000","last_became_peered":"2024-09-11T22:20:19.865939+0000","last_unstale":"2024-09-11T22:35:51.061871+0000","last_undegraded":"2024-09-11T22:35:51.061871+0000","last_fullsized":"2024-09-11T22:35:51.061871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'19","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.042042+0000","last_change":"2024-09-11T22:20:19.858144+0000","last_active":"2024-09-11T22:35:51.042042+0000","last_peered":"2024-09-11T22:35:51.042042+0000","last_clean":"2024-09-11T22:35:51.042042+0000","last_became_active":"2024-09-11T22:20:19.857840+0000","last_became_peered":"2024-09-11T22:20:19.857840+0000","last_unstale":"2024-09-11T22:35:51.042042+0000","last_undegraded":"2024-09-11T22:35:51.042042+0000","last_fullsized":"2024-09-11T22:35:51.042042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:23.801072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'10","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.040742+0000","last_change":"2024-09-11T22:20:19.857378+0000","last_active":"2024-09-11T22:35:51.040742+0000","last_peered":"2024-09-11T22:35:51.040742+0000","last_clean":"2024-09-11T22:35:51.040742+0000","last_became_active":"2024-09-11T22:20:19.857089+0000","last_became_peered":"2024-09-11T22:20:19.857089+0000","last_unstale":"2024-09-11T22:35:51.040742+0000","last_undegraded":"2024-09-11T22:35:51.040742+0000","last_fullsized":"2024-09-11T22:35:51.040742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:29.835695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'16","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.042089+0000","last_change":"2024-09-11T22:21:02.036200+0000","last_active":"2024-09-11T22:35:51.042089+0000","last_peered":"2024-09-11T22:35:51.042089+0000","last_clean":"2024-09-11T22:35:51.042089+0000","last_became_active":"2024-09-11T22:21:02.035889+0000","last_became_peered":"2024-09-11T22:21:02.035889+0000","last_unstale":"2024-09-11T22:35:51.042089+0000","last_undegraded":"2024-09-11T22:35:51.042089+0000","last_fullsized":"2024-09-11T22:35:51.042089+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":877619,"num_write_kb":16615339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":191481,"ondisk_log_size":191481,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1274,"ondisk_log_size":1274,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":15005355,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":45,"num_read_kb":122,"num_write":3042,"num_write_kb":15742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18276352,"data_stored":30010710,"data_compressed":2661454,"data_compressed_allocated":3686400,"data_compressed_original":15572992,"omap_allocated":0,"internal_metadata":0},"log_size":2691,"ondisk_log_size":2691,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509631,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":969956,"kb_used_data":7316,"kb_used_omap":1,"kb_used_meta":962622,"kb_avail":93401884,"statfs":{"total":96636764160,"available":95643529216,"internally_reserved":0,"allocated":7491584,"data_stored":11425803,"data_compressed":849965,"data_compressed_allocated":1200128,"data_compressed_original":5332992,"omap_allocated":1590,"internal_metadata":985725386},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509632,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1137376,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":1135230,"kb_avail":93234464,"statfs":{"total":96636764160,"available":95472091136,"internally_reserved":0,"allocated":2179072,"data_stored":4317172,"data_compressed":509786,"data_compressed_allocated":684032,"data_compressed_original":3010560,"omap_allocated":1594,"internal_metadata":1162475974},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509633,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":763716,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":763390,"kb_avail":93608124,"statfs":{"total":96636764160,"available":95854718976,"internally_reserved":0,"allocated":315392,"data_stored":122896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":781711813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509632,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1079244,"kb_used_data":3772,"kb_used_omap":1,"kb_used_meta":1075454,"kb_avail":93292596,"statfs":{"total":96636764160,"available":95531618304,"internally_reserved":0,"allocated":3862528,"data_stored":4316536,"data_compressed":162063,"data_compressed_allocated":282624,"data_compressed_original":925696,"omap_allocated":1595,"internal_metadata":1101265349},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509630,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1425948,"kb_used_data":4620,"kb_used_omap":1,"kb_used_meta":1421310,"kb_avail":92945892,"statfs":{"total":96636764160,"available":95176593408,"internally_reserved":0,"allocated":4730880,"data_stored":8606262,"data_compressed":892093,"data_compressed_allocated":1200128,"data_compressed_original":5267456,"omap_allocated":1593,"internal_metadata":1455421895},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542335,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":868180,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":867774,"kb_avail":93503660,"statfs":{"total":96636764160,"available":95747747840,"internally_reserved":0,"allocated":397312,"data_stored":216504,"data_compressed":3390,"data_compressed_allocated":4096,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":888601029},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542336,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1062252,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":1060798,"kb_avail":93309588,"statfs":{"total":96636764160,"available":95549018112,"internally_reserved":0,"allocated":1470464,"data_stored":3035955,"data_compressed":308985,"data_compressed_allocated":405504,"data_compressed_original":2166784,"omap_allocated":1595,"internal_metadata":1086257605},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575040,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1374984,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":1374654,"kb_avail":92996856,"statfs":{"total":96636764160,"available":95228780544,"internally_reserved":0,"allocated":319488,"data_stored":122462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1407646149},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1110016,"data_stored":2324069,"data_compressed":276571,"data_compressed_allocated":360448,"data_compressed_original":1593344,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":94986,"data_compressed":3390,"data_compressed_allocated":4096,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4435968,"data_stored":8484744,"data_compressed":892093,"data_compressed_allocated":1200128,"data_compressed_original":5267456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3567616,"data_stored":4195018,"data_compressed":162063,"data_compressed_allocated":282624,"data_compressed_original":925696,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1884160,"data_stored":4195654,"data_compressed":509786,"data_compressed_allocated":684032,"data_compressed_original":3010560,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7131136,"data_stored":10713917,"data_compressed":817551,"data_compressed_allocated":1155072,"data_compressed_original":4759552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:35:58.359 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T22:35:58.359 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:35:58.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.494+0000 7fc85e4d0640 1 Processor -- start 2024-09-11T22:35:58.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.494+0000 7fc85e4d0640 1 -- start start 2024-09-11T22:35:58.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.494+0000 7fc85e4d0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8580ce2e0 0x7fc8580c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:58.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.494+0000 7fc85e4d0640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8580cb1f0 con 0x7fc8580ce6c0 2024-09-11T22:35:58.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.494+0000 7fc85e4d0640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8580cb4d0 con 0x7fc85815abb0 2024-09-11T22:35:58.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.494+0000 7fc85e4d0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc8580cb7b0 con 0x7fc8580ce2e0 2024-09-11T22:35:58.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.495+0000 7fc85ca6d640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc8580ce6c0 0x7fc858157a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55506/0 (socket says 172.21.15.100:55506) 2024-09-11T22:35:58.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.495+0000 7fc85ca6d640 1 -- 172.21.15.100:0/2741479490 learned_addr learned my addr 172.21.15.100:0/2741479490 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:35:58.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.495+0000 7fc857fff640 1 --2- 172.21.15.100:0/2741479490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8580ce2e0 0x7fc8580c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:58.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.495+0000 7fc856ffd640 1 -- 172.21.15.100:0/2741479490 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 802467685 0 0) 0x7fc8580cb1f0 con 0x7fc8580ce6c0 2024-09-11T22:35:58.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.495+0000 7fc856ffd640 1 -- 172.21.15.100:0/2741479490 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc840003520 con 0x7fc8580ce6c0 2024-09-11T22:35:58.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.495+0000 7fc856ffd640 1 -- 172.21.15.100:0/2741479490 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2955329494 0 0) 0x7fc8580cb4d0 con 0x7fc85815abb0 2024-09-11T22:35:58.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.495+0000 7fc856ffd640 1 -- 172.21.15.100:0/2741479490 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8580cb1f0 con 0x7fc85815abb0 2024-09-11T22:35:58.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.495+0000 7fc856ffd640 1 -- 172.21.15.100:0/2741479490 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3928563193 0 0) 0x7fc840003520 con 0x7fc8580ce6c0 2024-09-11T22:35:58.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.495+0000 7fc856ffd640 1 -- 172.21.15.100:0/2741479490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8580ce2e0 msgr2=0x7fc8580c3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:58.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.495+0000 7fc856ffd640 1 --2- 172.21.15.100:0/2741479490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8580ce2e0 0x7fc8580c3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:58.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.495+0000 7fc856ffd640 1 -- 172.21.15.100:0/2741479490 >> v1:172.21.15.167:6789/0 conn(0x7fc85815abb0 legacy=0x7fc8580ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:58.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.495+0000 7fc856ffd640 1 -- 172.21.15.100:0/2741479490 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8580c3790 con 0x7fc8580ce6c0 2024-09-11T22:35:58.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.495+0000 7fc856ffd640 1 -- 172.21.15.100:0/2741479490 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7fc8500019f0 con 0x7fc8580ce6c0 2024-09-11T22:35:58.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.495+0000 7fc857fff640 1 --2- 172.21.15.100:0/2741479490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8580ce2e0 0x7fc8580c3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:35:58.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.495+0000 7fc856ffd640 1 -- 172.21.15.100:0/2741479490 >> v1:172.21.15.100:6789/0 conn(0x7fc8580ce6c0 legacy=0x7fc858157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:58.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.495+0000 7fc856ffd640 1 --2- 172.21.15.100:0/2741479490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8580ce2e0 0x7fc840003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:58.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.495+0000 7fc856ffd640 1 --2- 172.21.15.100:0/2741479490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8400040b0 0x7fc840004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:58.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.495+0000 7fc856ffd640 1 --2- 172.21.15.100:0/2741479490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc840004d40 0x7fc8400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:58.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.495+0000 7fc856ffd640 1 -- 172.21.15.100:0/2741479490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc8580cb7b0 con 0x7fc840004d40 2024-09-11T22:35:58.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.495+0000 7fc856ffd640 1 -- 172.21.15.100:0/2741479490 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc84000ba70 con 0x7fc8400040b0 2024-09-11T22:35:58.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.495+0000 7fc856ffd640 1 -- 172.21.15.100:0/2741479490 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc84000bc70 con 0x7fc8580ce2e0 2024-09-11T22:35:58.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.495+0000 7fc85ca6d640 1 --2- 172.21.15.100:0/2741479490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc840004d40 0x7fc8400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:58.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.496+0000 7fc857fff640 1 --2- 172.21.15.100:0/2741479490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8580ce2e0 0x7fc840003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:58.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.496+0000 7fc8577fe640 1 --2- 172.21.15.100:0/2741479490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8400040b0 0x7fc840004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:58.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.496+0000 7fc85ca6d640 1 -- 172.21.15.100:0/2741479490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8580ce2e0 msgr2=0x7fc840003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:58.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.496+0000 7fc85ca6d640 1 --2- 172.21.15.100:0/2741479490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8580ce2e0 0x7fc840003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:58.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.496+0000 7fc85ca6d640 1 -- 172.21.15.100:0/2741479490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8400040b0 msgr2=0x7fc840004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:58.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.496+0000 7fc85ca6d640 1 --2- 172.21.15.100:0/2741479490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8400040b0 0x7fc840004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:58.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.496+0000 7fc85ca6d640 1 -- 172.21.15.100:0/2741479490 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc840003520 con 0x7fc840004d40 2024-09-11T22:35:58.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.496+0000 7fc85ca6d640 1 --2- 172.21.15.100:0/2741479490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc840004d40 0x7fc8400051c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc8580cead0 tx=0x7fc840005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f79872f894f6849 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:58.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.497+0000 7fc856ffd640 1 -- 172.21.15.100:0/2741479490 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85000a410 con 0x7fc840004d40 2024-09-11T22:35:58.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.497+0000 7fc856ffd640 1 -- 172.21.15.100:0/2741479490 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc85002f070 con 0x7fc840004d40 2024-09-11T22:35:58.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.497+0000 7fc856ffd640 1 -- 172.21.15.100:0/2741479490 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85002bbc0 con 0x7fc840004d40 2024-09-11T22:35:58.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.497+0000 7fc85e4d0640 1 -- 172.21.15.100:0/2741479490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc840004d40 msgr2=0x7fc8400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:58.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.497+0000 7fc85e4d0640 1 --2- 172.21.15.100:0/2741479490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc840004d40 0x7fc8400051c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc8580cead0 tx=0x7fc840005830 comp rx=0 tx=0).stop 2024-09-11T22:35:58.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.497+0000 7fc85ca6d640 1 -- 172.21.15.100:0/2741479490 reap_dead start 2024-09-11T22:35:58.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.497+0000 7fc85e4d0640 1 -- 172.21.15.100:0/2741479490 shutdown_connections 2024-09-11T22:35:58.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.497+0000 7fc85e4d0640 1 -- 172.21.15.100:0/2741479490 >> 172.21.15.100:0/2741479490 conn(0x7fc858073920 msgr2=0x7fc858073d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:58.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.497+0000 7fc85e4d0640 1 -- 172.21.15.100:0/2741479490 shutdown_connections 2024-09-11T22:35:58.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.497+0000 7fc85e4d0640 1 -- 172.21.15.100:0/2741479490 wait complete. 2024-09-11T22:35:58.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.498+0000 7fc85e4d0640 1 Processor -- start 2024-09-11T22:35:58.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.499+0000 7fc85e4d0640 1 -- start start 2024-09-11T22:35:58.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.499+0000 7fc85e4d0640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc840004d40 0x7fc8580cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:58.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.499+0000 7fc85e4d0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8580c7e60 0x7fc8581519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:58.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.499+0000 7fc85e4d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8581f3c00 0x7fc8581f4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:58.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.499+0000 7fc85e4d0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc8580cadf0 con 0x7fc8581f3c00 2024-09-11T22:35:58.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.499+0000 7fc85e4d0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc8580cac70 con 0x7fc8580c7e60 2024-09-11T22:35:58.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.499+0000 7fc85e4d0640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc8580caf70 con 0x7fc840004d40 2024-09-11T22:35:58.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.499+0000 7fc85ca6d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8581f3c00 0x7fc8581f4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:58.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.499+0000 7fc85ca6d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8581f3c00 0x7fc8581f4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46742/0 (socket says 172.21.15.100:46742) 2024-09-11T22:35:58.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.499+0000 7fc85ca6d640 1 -- 172.21.15.100:0/3911243602 learned_addr learned my addr 172.21.15.100:0/3911243602 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:58.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.500+0000 7fc8577fe640 1 --2- 172.21.15.100:0/3911243602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8580c7e60 0x7fc8581519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:58.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.500+0000 7fc857fff640 1 --2- 172.21.15.100:0/3911243602 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc840004d40 0x7fc8580cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:58.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.500+0000 7fc85ca6d640 1 -- 172.21.15.100:0/3911243602 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc840004d40 msgr2=0x7fc8580cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:58.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.500+0000 7fc85ca6d640 1 --2- 172.21.15.100:0/3911243602 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc840004d40 0x7fc8580cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:58.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.500+0000 7fc85ca6d640 1 -- 172.21.15.100:0/3911243602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8580c7e60 msgr2=0x7fc8581519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:58.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.500+0000 7fc85ca6d640 1 --2- 172.21.15.100:0/3911243602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8580c7e60 0x7fc8581519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:58.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.500+0000 7fc85ca6d640 1 -- 172.21.15.100:0/3911243602 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8581f45c0 con 0x7fc8581f3c00 2024-09-11T22:35:58.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.500+0000 7fc8577fe640 1 --2- 172.21.15.100:0/3911243602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8580c7e60 0x7fc8581519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:35:58.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.500+0000 7fc85ca6d640 1 --2- 172.21.15.100:0/3911243602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8581f3c00 0x7fc8581f4080 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc850000f80 tx=0x7fc8580c3960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:58.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.500+0000 7fc854ff9640 1 -- 172.21.15.100:0/3911243602 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc850044070 con 0x7fc8581f3c00 2024-09-11T22:35:58.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.500+0000 7fc854ff9640 1 -- 172.21.15.100:0/3911243602 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc85000a3f0 con 0x7fc8581f3c00 2024-09-11T22:35:58.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.500+0000 7fc85e4d0640 1 -- 172.21.15.100:0/3911243602 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8581f4840 con 0x7fc8581f3c00 2024-09-11T22:35:58.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.500+0000 7fc854ff9640 1 -- 172.21.15.100:0/3911243602 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc850001f70 con 0x7fc8581f3c00 2024-09-11T22:35:58.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.500+0000 7fc85e4d0640 1 -- 172.21.15.100:0/3911243602 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc858151240 con 0x7fc8581f3c00 2024-09-11T22:35:58.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.501+0000 7fc854ff9640 1 -- 172.21.15.100:0/3911243602 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc850047070 con 0x7fc8581f3c00 2024-09-11T22:35:58.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.501+0000 7fc85e4d0640 1 -- 172.21.15.100:0/3911243602 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8580ca560 con 0x7fc8581f3c00 2024-09-11T22:35:58.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.502+0000 7fc854ff9640 1 --2- 172.21.15.100:0/3911243602 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc84406be60 0x7fc84406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:58.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.502+0000 7fc854ff9640 1 -- 172.21.15.100:0/3911243602 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fc8500ab250 con 0x7fc8581f3c00 2024-09-11T22:35:58.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.502+0000 7fc857fff640 1 --2- 172.21.15.100:0/3911243602 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc84406be60 0x7fc84406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:58.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.502+0000 7fc857fff640 1 --2- 172.21.15.100:0/3911243602 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc84406be60 0x7fc84406e320 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc848009bb0 tx=0x7fc848009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:58.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.506+0000 7fc854ff9640 1 -- 172.21.15.100:0/3911243602 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc8581f45c0 con 0x7fc8581f3c00 2024-09-11T22:35:58.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.692+0000 7fc85e4d0640 1 -- 172.21.15.100:0/3911243602 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc8580c8240 con 0x7fc84406be60 2024-09-11T22:35:58.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.707+0000 7fc854ff9640 1 -- 172.21.15.100:0/3911243602 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334126 (secure 0 0 0) 0x7fc8580c8240 con 0x7fc84406be60 2024-09-11T22:35:58.711 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:35:58.713 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-11T22:35:58.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.711+0000 7fc85e4d0640 1 -- 172.21.15.100:0/3911243602 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc84406be60 msgr2=0x7fc84406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:58.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.711+0000 7fc85e4d0640 1 --2- 172.21.15.100:0/3911243602 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc84406be60 0x7fc84406e320 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc848009bb0 tx=0x7fc848009190 comp rx=0 tx=0).stop 2024-09-11T22:35:58.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.711+0000 7fc85e4d0640 1 -- 172.21.15.100:0/3911243602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8581f3c00 msgr2=0x7fc8581f4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:58.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.711+0000 7fc85e4d0640 1 --2- 172.21.15.100:0/3911243602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8581f3c00 0x7fc8581f4080 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc850000f80 tx=0x7fc8580c3960 comp rx=0 tx=0).stop 2024-09-11T22:35:58.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.711+0000 7fc85e4d0640 1 -- 172.21.15.100:0/3911243602 shutdown_connections 2024-09-11T22:35:58.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.711+0000 7fc85e4d0640 1 --2- 172.21.15.100:0/3911243602 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fc84406be60 0x7fc84406e320 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:58.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.711+0000 7fc85e4d0640 1 --2- 172.21.15.100:0/3911243602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8581f3c00 0x7fc8581f4080 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:58.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.711+0000 7fc85e4d0640 1 --2- 172.21.15.100:0/3911243602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8580c7e60 0x7fc8581519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:58.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.711+0000 7fc85e4d0640 1 --2- 172.21.15.100:0/3911243602 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc840004d40 0x7fc8580cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:58.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.711+0000 7fc85e4d0640 1 -- 172.21.15.100:0/3911243602 >> 172.21.15.100:0/3911243602 conn(0x7fc858073920 msgr2=0x7fc8581577f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:58.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.711+0000 7fc85e4d0640 1 -- 172.21.15.100:0/3911243602 shutdown_connections 2024-09-11T22:35:58.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.711+0000 7fc85e4d0640 1 -- 172.21.15.100:0/3911243602 wait complete. 2024-09-11T22:35:58.723 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":498,"stamp":"2024-09-11T22:35:58.569636+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":15595723,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":161,"num_read_kb":222,"num_write":880820,"num_write_kb":16633497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195563,"ondisk_log_size":195563,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8681656,"kb_used_data":20280,"kb_used_omap":12,"kb_used_meta":8661235,"kb_avail":746293064,"statfs":{"total":773094113280,"available":764204097536,"internally_reserved":0,"allocated":20766720,"data_stored":32163590,"data_compressed":2726282,"data_compressed_allocated":3776512,"data_compressed_original":16719872,"omap_allocated":12752,"internal_metadata":8869105200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-553649465,"num_objects":-133,"num_object_clones":0,"num_object_copies":-532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-133,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003769"},"pg_stats":[{"pgid":"2.1f","version":"28'176","reported_seq":209,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.008974+0000","last_change":"2024-09-11T22:20:18.853007+0000","last_active":"2024-09-11T22:35:51.008974+0000","last_peered":"2024-09-11T22:35:51.008974+0000","last_clean":"2024-09-11T22:35:51.008974+0000","last_became_active":"2024-09-11T22:20:18.852740+0000","last_became_peered":"2024-09-11T22:20:18.852740+0000","last_unstale":"2024-09-11T22:35:51.008974+0000","last_undegraded":"2024-09-11T22:35:51.008974+0000","last_fullsized":"2024-09-11T22:35:51.008974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:46.710328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2323991,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":2359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'9","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.039561+0000","last_change":"2024-09-11T22:20:19.849765+0000","last_active":"2024-09-11T22:35:51.039561+0000","last_peered":"2024-09-11T22:35:51.039561+0000","last_clean":"2024-09-11T22:35:51.039561+0000","last_became_active":"2024-09-11T22:20:19.848619+0000","last_became_peered":"2024-09-11T22:20:19.848619+0000","last_unstale":"2024-09-11T22:35:51.039561+0000","last_undegraded":"2024-09-11T22:35:51.039561+0000","last_fullsized":"2024-09-11T22:35:51.039561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:57.621624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'6890","reported_seq":6914,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.779066+0000","last_change":"2024-09-11T22:20:24.078618+0000","last_active":"2024-09-11T22:35:44.779066+0000","last_peered":"2024-09-11T22:35:44.779066+0000","last_clean":"2024-09-11T22:35:44.779066+0000","last_became_active":"2024-09-11T22:20:24.078283+0000","last_became_peered":"2024-09-11T22:20:24.078283+0000","last_unstale":"2024-09-11T22:35:44.779066+0000","last_undegraded":"2024-09-11T22:35:44.779066+0000","last_fullsized":"2024-09-11T22:35:44.779066+0000","mapping_epoch":24,"log_start":"28'603","ondisk_log_start":"28'603","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6287,"log_dups_size":0,"ondisk_log_size":6287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:01.901307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31450,"num_write_kb":560141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'9","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.935502+0000","last_change":"2024-09-11T22:20:18.855945+0000","last_active":"2024-09-11T22:35:41.935502+0000","last_peered":"2024-09-11T22:35:41.935502+0000","last_clean":"2024-09-11T22:35:41.935502+0000","last_became_active":"2024-09-11T22:20:18.854811+0000","last_became_peered":"2024-09-11T22:20:18.854811+0000","last_unstale":"2024-09-11T22:35:41.935502+0000","last_undegraded":"2024-09-11T22:35:41.935502+0000","last_fullsized":"2024-09-11T22:35:41.935502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:47.508920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'21","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.063302+0000","last_change":"2024-09-11T22:20:19.862436+0000","last_active":"2024-09-11T22:35:51.063302+0000","last_peered":"2024-09-11T22:35:51.063302+0000","last_clean":"2024-09-11T22:35:51.063302+0000","last_became_active":"2024-09-11T22:20:19.862061+0000","last_became_peered":"2024-09-11T22:20:19.862061+0000","last_unstale":"2024-09-11T22:35:51.063302+0000","last_undegraded":"2024-09-11T22:35:51.063302+0000","last_fullsized":"2024-09-11T22:35:51.063302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'6406","reported_seq":6430,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.675651+0000","last_change":"2024-09-11T22:20:23.879729+0000","last_active":"2024-09-11T22:35:44.675651+0000","last_peered":"2024-09-11T22:35:44.675651+0000","last_clean":"2024-09-11T22:35:44.675651+0000","last_became_active":"2024-09-11T22:20:23.879245+0000","last_became_peered":"2024-09-11T22:20:23.879245+0000","last_unstale":"2024-09-11T22:35:44.675651+0000","last_undegraded":"2024-09-11T22:35:44.675651+0000","last_fullsized":"2024-09-11T22:35:44.675651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6406,"log_dups_size":0,"ondisk_log_size":6406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:36.836842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28787,"num_write_kb":536913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'13","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.849483+0000","last_change":"2024-09-11T22:20:18.853076+0000","last_active":"2024-09-11T22:35:37.849483+0000","last_peered":"2024-09-11T22:35:37.849483+0000","last_clean":"2024-09-11T22:35:37.849483+0000","last_became_active":"2024-09-11T22:20:18.852728+0000","last_became_peered":"2024-09-11T22:20:18.852728+0000","last_unstale":"2024-09-11T22:35:37.849483+0000","last_undegraded":"2024-09-11T22:35:37.849483+0000","last_fullsized":"2024-09-11T22:35:37.849483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'17","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.061939+0000","last_change":"2024-09-11T22:20:19.864544+0000","last_active":"2024-09-11T22:35:51.061939+0000","last_peered":"2024-09-11T22:35:51.061939+0000","last_clean":"2024-09-11T22:35:51.061939+0000","last_became_active":"2024-09-11T22:20:19.864234+0000","last_became_peered":"2024-09-11T22:20:19.864234+0000","last_unstale":"2024-09-11T22:35:51.061939+0000","last_undegraded":"2024-09-11T22:35:51.061939+0000","last_fullsized":"2024-09-11T22:35:51.061939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'5642","reported_seq":5666,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.746934+0000","last_change":"2024-09-11T22:20:23.873783+0000","last_active":"2024-09-11T22:35:44.746934+0000","last_peered":"2024-09-11T22:35:44.746934+0000","last_clean":"2024-09-11T22:35:44.746934+0000","last_became_active":"2024-09-11T22:20:23.873385+0000","last_became_peered":"2024-09-11T22:20:23.873385+0000","last_unstale":"2024-09-11T22:35:44.746934+0000","last_undegraded":"2024-09-11T22:35:44.746934+0000","last_fullsized":"2024-09-11T22:35:44.746934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5642,"log_dups_size":0,"ondisk_log_size":5642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24462,"num_write_kb":498902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'3","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:18.543924+0000","last_change":"2024-09-11T22:20:18.861530+0000","last_active":"2024-09-11T22:35:18.543924+0000","last_peered":"2024-09-11T22:35:18.543924+0000","last_clean":"2024-09-11T22:35:18.543924+0000","last_became_active":"2024-09-11T22:20:18.861230+0000","last_became_peered":"2024-09-11T22:20:18.861230+0000","last_unstale":"2024-09-11T22:35:18.543924+0000","last_undegraded":"2024-09-11T22:35:18.543924+0000","last_fullsized":"2024-09-11T22:35:18.543924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'27","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.063087+0000","last_change":"2024-09-11T22:20:19.863401+0000","last_active":"2024-09-11T22:35:51.063087+0000","last_peered":"2024-09-11T22:35:51.063087+0000","last_clean":"2024-09-11T22:35:51.063087+0000","last_became_active":"2024-09-11T22:20:19.863127+0000","last_became_peered":"2024-09-11T22:20:19.863127+0000","last_unstale":"2024-09-11T22:35:51.063087+0000","last_undegraded":"2024-09-11T22:35:51.063087+0000","last_fullsized":"2024-09-11T22:35:51.063087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:36.888544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'4900","reported_seq":4924,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.832935+0000","last_change":"2024-09-11T22:20:23.874650+0000","last_active":"2024-09-11T22:35:44.832935+0000","last_peered":"2024-09-11T22:35:44.832935+0000","last_clean":"2024-09-11T22:35:44.832935+0000","last_became_active":"2024-09-11T22:20:23.874040+0000","last_became_peered":"2024-09-11T22:20:23.874040+0000","last_unstale":"2024-09-11T22:35:44.832935+0000","last_undegraded":"2024-09-11T22:35:44.832935+0000","last_fullsized":"2024-09-11T22:35:44.832935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":4900,"log_dups_size":0,"ondisk_log_size":4900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21721,"num_write_kb":438879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'14","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.041380+0000","last_change":"2024-09-11T22:20:19.859446+0000","last_active":"2024-09-11T22:35:51.041380+0000","last_peered":"2024-09-11T22:35:51.041380+0000","last_clean":"2024-09-11T22:35:51.041380+0000","last_became_active":"2024-09-11T22:20:19.859106+0000","last_became_peered":"2024-09-11T22:20:19.859106+0000","last_unstale":"2024-09-11T22:35:51.041380+0000","last_undegraded":"2024-09-11T22:35:51.041380+0000","last_fullsized":"2024-09-11T22:35:51.041380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'1002","reported_seq":1034,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.946261+0000","last_change":"2024-09-11T22:20:18.856475+0000","last_active":"2024-09-11T22:35:41.946261+0000","last_peered":"2024-09-11T22:35:41.946261+0000","last_clean":"2024-09-11T22:35:41.946261+0000","last_became_active":"2024-09-11T22:20:18.856165+0000","last_became_peered":"2024-09-11T22:20:18.856165+0000","last_unstale":"2024-09-11T22:35:41.946261+0000","last_undegraded":"2024-09-11T22:35:41.946261+0000","last_fullsized":"2024-09-11T22:35:41.946261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1002,"log_dups_size":0,"ondisk_log_size":1002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":994,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'6307","reported_seq":6331,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.864098+0000","last_change":"2024-09-11T22:20:23.878121+0000","last_active":"2024-09-11T22:35:44.864098+0000","last_peered":"2024-09-11T22:35:44.864098+0000","last_clean":"2024-09-11T22:35:44.864098+0000","last_became_active":"2024-09-11T22:20:23.877713+0000","last_became_peered":"2024-09-11T22:20:23.877713+0000","last_unstale":"2024-09-11T22:35:44.864098+0000","last_undegraded":"2024-09-11T22:35:44.864098+0000","last_fullsized":"2024-09-11T22:35:44.864098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6307,"log_dups_size":0,"ondisk_log_size":6307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28296,"num_write_kb":522771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'17","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.045109+0000","last_change":"2024-09-11T22:20:19.858358+0000","last_active":"2024-09-11T22:35:51.045109+0000","last_peered":"2024-09-11T22:35:51.045109+0000","last_clean":"2024-09-11T22:35:51.045109+0000","last_became_active":"2024-09-11T22:20:19.858057+0000","last_became_peered":"2024-09-11T22:20:19.858057+0000","last_unstale":"2024-09-11T22:35:51.045109+0000","last_undegraded":"2024-09-11T22:35:51.045109+0000","last_fullsized":"2024-09-11T22:35:51.045109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:07.839926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'7","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.931632+0000","last_change":"2024-09-11T22:20:18.853818+0000","last_active":"2024-09-11T22:35:41.931632+0000","last_peered":"2024-09-11T22:35:41.931632+0000","last_clean":"2024-09-11T22:35:41.931632+0000","last_became_active":"2024-09-11T22:20:18.853508+0000","last_became_peered":"2024-09-11T22:20:18.853508+0000","last_unstale":"2024-09-11T22:35:41.931632+0000","last_undegraded":"2024-09-11T22:35:41.931632+0000","last_fullsized":"2024-09-11T22:35:41.931632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:58.141587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'6073","reported_seq":6104,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.786267+0000","last_change":"2024-09-11T22:21:02.037670+0000","last_active":"2024-09-11T22:35:44.786267+0000","last_peered":"2024-09-11T22:35:44.786267+0000","last_clean":"2024-09-11T22:35:44.786267+0000","last_became_active":"2024-09-11T22:21:02.036941+0000","last_became_peered":"2024-09-11T22:21:02.036941+0000","last_unstale":"2024-09-11T22:35:44.786267+0000","last_undegraded":"2024-09-11T22:35:44.786267+0000","last_fullsized":"2024-09-11T22:35:44.786267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6073,"log_dups_size":0,"ondisk_log_size":6073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:20.859515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27207,"num_write_kb":522378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'18","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043412+0000","last_change":"2024-09-11T22:20:19.844748+0000","last_active":"2024-09-11T22:35:51.043412+0000","last_peered":"2024-09-11T22:35:51.043412+0000","last_clean":"2024-09-11T22:35:51.043412+0000","last_became_active":"2024-09-11T22:20:19.844446+0000","last_became_peered":"2024-09-11T22:20:19.844446+0000","last_unstale":"2024-09-11T22:35:51.043412+0000","last_undegraded":"2024-09-11T22:35:51.043412+0000","last_fullsized":"2024-09-11T22:35:51.043412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:13.319918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'6","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.366967+0000","last_change":"2024-09-11T22:20:18.847388+0000","last_active":"2024-09-11T22:35:37.366967+0000","last_peered":"2024-09-11T22:35:37.366967+0000","last_clean":"2024-09-11T22:35:37.366967+0000","last_became_active":"2024-09-11T22:20:18.847118+0000","last_became_peered":"2024-09-11T22:20:18.847118+0000","last_unstale":"2024-09-11T22:35:37.366967+0000","last_undegraded":"2024-09-11T22:35:37.366967+0000","last_fullsized":"2024-09-11T22:35:37.366967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:47.360920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'7846","reported_seq":7870,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.854263+0000","last_change":"2024-09-11T22:20:24.077604+0000","last_active":"2024-09-11T22:35:44.854263+0000","last_peered":"2024-09-11T22:35:44.854263+0000","last_clean":"2024-09-11T22:35:44.854263+0000","last_became_active":"2024-09-11T22:20:24.077231+0000","last_became_peered":"2024-09-11T22:20:24.077231+0000","last_unstale":"2024-09-11T22:35:44.854263+0000","last_undegraded":"2024-09-11T22:35:44.854263+0000","last_fullsized":"2024-09-11T22:35:44.854263+0000","mapping_epoch":24,"log_start":"28'701","ondisk_log_start":"28'701","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":7145,"log_dups_size":0,"ondisk_log_size":7145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:38.846688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35635,"num_write_kb":625996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"28'12","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.030058+0000","last_change":"2024-09-11T22:20:19.854453+0000","last_active":"2024-09-11T22:35:51.030058+0000","last_peered":"2024-09-11T22:35:51.030058+0000","last_clean":"2024-09-11T22:35:51.030058+0000","last_became_active":"2024-09-11T22:20:19.854100+0000","last_became_peered":"2024-09-11T22:20:19.854100+0000","last_unstale":"2024-09-11T22:35:51.030058+0000","last_undegraded":"2024-09-11T22:35:51.030058+0000","last_fullsized":"2024-09-11T22:35:51.030058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:06.166813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.334898+0000","last_change":"2024-09-11T22:20:18.854889+0000","last_active":"2024-09-11T22:35:37.334898+0000","last_peered":"2024-09-11T22:35:37.334898+0000","last_clean":"2024-09-11T22:35:37.334898+0000","last_became_active":"2024-09-11T22:20:18.854552+0000","last_became_peered":"2024-09-11T22:20:18.854552+0000","last_unstale":"2024-09-11T22:35:37.334898+0000","last_undegraded":"2024-09-11T22:35:37.334898+0000","last_fullsized":"2024-09-11T22:35:37.334898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:33.612126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'4949","reported_seq":4973,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.864497+0000","last_change":"2024-09-11T22:20:23.878932+0000","last_active":"2024-09-11T22:35:44.864497+0000","last_peered":"2024-09-11T22:35:44.864497+0000","last_clean":"2024-09-11T22:35:44.864497+0000","last_became_active":"2024-09-11T22:20:23.878305+0000","last_became_peered":"2024-09-11T22:20:23.878305+0000","last_unstale":"2024-09-11T22:35:44.864497+0000","last_undegraded":"2024-09-11T22:35:44.864497+0000","last_fullsized":"2024-09-11T22:35:44.864497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":4949,"log_dups_size":0,"ondisk_log_size":4949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21676,"num_write_kb":446977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'26","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043612+0000","last_change":"2024-09-11T22:20:19.856318+0000","last_active":"2024-09-11T22:35:51.043612+0000","last_peered":"2024-09-11T22:35:51.043612+0000","last_clean":"2024-09-11T22:35:51.043612+0000","last_became_active":"2024-09-11T22:20:19.855992+0000","last_became_peered":"2024-09-11T22:20:19.855992+0000","last_unstale":"2024-09-11T22:35:51.043612+0000","last_undegraded":"2024-09-11T22:35:51.043612+0000","last_fullsized":"2024-09-11T22:35:51.043612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:57.709140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'6","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:28.337628+0000","last_change":"2024-09-11T22:20:18.850750+0000","last_active":"2024-09-11T22:35:28.337628+0000","last_peered":"2024-09-11T22:35:28.337628+0000","last_clean":"2024-09-11T22:35:28.337628+0000","last_became_active":"2024-09-11T22:20:18.849621+0000","last_became_peered":"2024-09-11T22:20:18.849621+0000","last_unstale":"2024-09-11T22:35:28.337628+0000","last_undegraded":"2024-09-11T22:35:28.337628+0000","last_fullsized":"2024-09-11T22:35:28.337628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'5822","reported_seq":5847,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.807191+0000","last_change":"2024-09-11T22:20:24.077741+0000","last_active":"2024-09-11T22:35:44.807191+0000","last_peered":"2024-09-11T22:35:44.807191+0000","last_clean":"2024-09-11T22:35:44.807191+0000","last_became_active":"2024-09-11T22:20:24.077325+0000","last_became_peered":"2024-09-11T22:20:24.077325+0000","last_unstale":"2024-09-11T22:35:44.807191+0000","last_undegraded":"2024-09-11T22:35:44.807191+0000","last_fullsized":"2024-09-11T22:35:44.807191+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5822,"log_dups_size":0,"ondisk_log_size":5822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:18.656529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26961,"num_write_kb":521330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'18","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.057658+0000","last_change":"2024-09-11T22:20:19.850738+0000","last_active":"2024-09-11T22:35:51.057658+0000","last_peered":"2024-09-11T22:35:51.057658+0000","last_clean":"2024-09-11T22:35:51.057658+0000","last_became_active":"2024-09-11T22:20:19.850441+0000","last_became_peered":"2024-09-11T22:20:19.850441+0000","last_unstale":"2024-09-11T22:35:51.057658+0000","last_undegraded":"2024-09-11T22:35:51.057658+0000","last_fullsized":"2024-09-11T22:35:51.057658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:47.552343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'351","reported_seq":384,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.969721+0000","last_change":"2024-09-11T22:20:18.845173+0000","last_active":"2024-09-11T22:35:41.969721+0000","last_peered":"2024-09-11T22:35:41.969721+0000","last_clean":"2024-09-11T22:35:41.969721+0000","last_became_active":"2024-09-11T22:20:18.844731+0000","last_became_peered":"2024-09-11T22:20:18.844731+0000","last_unstale":"2024-09-11T22:35:41.969721+0000","last_undegraded":"2024-09-11T22:35:41.969721+0000","last_fullsized":"2024-09-11T22:35:41.969721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:32.963285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'6627","reported_seq":6659,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.761641+0000","last_change":"2024-09-11T22:21:02.037927+0000","last_active":"2024-09-11T22:35:44.761641+0000","last_peered":"2024-09-11T22:35:44.761641+0000","last_clean":"2024-09-11T22:35:44.761641+0000","last_became_active":"2024-09-11T22:21:02.037520+0000","last_became_peered":"2024-09-11T22:21:02.037520+0000","last_unstale":"2024-09-11T22:35:44.761641+0000","last_undegraded":"2024-09-11T22:35:44.761641+0000","last_fullsized":"2024-09-11T22:35:44.761641+0000","mapping_epoch":27,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6327,"log_dups_size":0,"ondisk_log_size":6327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:38.798530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30659,"num_write_kb":569042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'18","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.040494+0000","last_change":"2024-09-11T22:20:19.845497+0000","last_active":"2024-09-11T22:35:51.040494+0000","last_peered":"2024-09-11T22:35:51.040494+0000","last_clean":"2024-09-11T22:35:51.040494+0000","last_became_active":"2024-09-11T22:20:19.845203+0000","last_became_peered":"2024-09-11T22:20:19.845203+0000","last_unstale":"2024-09-11T22:35:51.040494+0000","last_undegraded":"2024-09-11T22:35:51.040494+0000","last_fullsized":"2024-09-11T22:35:51.040494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:12.086231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.363453+0000","last_change":"2024-09-11T22:20:18.856263+0000","last_active":"2024-09-11T22:35:37.363453+0000","last_peered":"2024-09-11T22:35:37.363453+0000","last_clean":"2024-09-11T22:35:37.363453+0000","last_became_active":"2024-09-11T22:20:18.855968+0000","last_became_peered":"2024-09-11T22:20:18.855968+0000","last_unstale":"2024-09-11T22:35:37.363453+0000","last_undegraded":"2024-09-11T22:35:37.363453+0000","last_fullsized":"2024-09-11T22:35:37.363453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'5454","reported_seq":5479,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.210141+0000","last_change":"2024-09-11T22:20:24.075030+0000","last_active":"2024-09-11T22:35:44.210141+0000","last_peered":"2024-09-11T22:35:44.210141+0000","last_clean":"2024-09-11T22:35:44.210141+0000","last_became_active":"2024-09-11T22:20:24.074588+0000","last_became_peered":"2024-09-11T22:20:24.074588+0000","last_unstale":"2024-09-11T22:35:44.210141+0000","last_undegraded":"2024-09-11T22:35:44.210141+0000","last_fullsized":"2024-09-11T22:35:44.210141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5454,"log_dups_size":0,"ondisk_log_size":5454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25186,"num_write_kb":469240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'18","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.062538+0000","last_change":"2024-09-11T22:20:19.859010+0000","last_active":"2024-09-11T22:35:51.062538+0000","last_peered":"2024-09-11T22:35:51.062538+0000","last_clean":"2024-09-11T22:35:51.062538+0000","last_became_active":"2024-09-11T22:20:19.858585+0000","last_became_peered":"2024-09-11T22:20:19.858585+0000","last_unstale":"2024-09-11T22:35:51.062538+0000","last_undegraded":"2024-09-11T22:35:51.062538+0000","last_fullsized":"2024-09-11T22:35:51.062538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.850550+0000","last_change":"2024-09-11T22:20:18.847904+0000","last_active":"2024-09-11T22:35:37.850550+0000","last_peered":"2024-09-11T22:35:37.850550+0000","last_clean":"2024-09-11T22:35:37.850550+0000","last_became_active":"2024-09-11T22:20:18.847669+0000","last_became_peered":"2024-09-11T22:20:18.847669+0000","last_unstale":"2024-09-11T22:35:37.850550+0000","last_undegraded":"2024-09-11T22:35:37.850550+0000","last_fullsized":"2024-09-11T22:35:37.850550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:08.717999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'6951","reported_seq":6976,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.741120+0000","last_change":"2024-09-11T22:20:23.881067+0000","last_active":"2024-09-11T22:35:44.741120+0000","last_peered":"2024-09-11T22:35:44.741120+0000","last_clean":"2024-09-11T22:35:44.741120+0000","last_became_active":"2024-09-11T22:20:23.880468+0000","last_became_peered":"2024-09-11T22:20:23.880468+0000","last_unstale":"2024-09-11T22:35:44.741120+0000","last_undegraded":"2024-09-11T22:35:44.741120+0000","last_fullsized":"2024-09-11T22:35:44.741120+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6951,"log_dups_size":0,"ondisk_log_size":6951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:23.480547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31360,"num_write_kb":584090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'17","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.049873+0000","last_change":"2024-09-11T22:20:19.860423+0000","last_active":"2024-09-11T22:35:51.049873+0000","last_peered":"2024-09-11T22:35:51.049873+0000","last_clean":"2024-09-11T22:35:51.049873+0000","last_became_active":"2024-09-11T22:20:19.858932+0000","last_became_peered":"2024-09-11T22:20:19.858932+0000","last_unstale":"2024-09-11T22:35:51.049873+0000","last_undegraded":"2024-09-11T22:35:51.049873+0000","last_fullsized":"2024-09-11T22:35:51.049873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:53.255932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'6","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.950652+0000","last_change":"2024-09-11T22:20:18.854973+0000","last_active":"2024-09-11T22:35:41.950652+0000","last_peered":"2024-09-11T22:35:41.950652+0000","last_clean":"2024-09-11T22:35:41.950652+0000","last_became_active":"2024-09-11T22:20:18.854725+0000","last_became_peered":"2024-09-11T22:20:18.854725+0000","last_unstale":"2024-09-11T22:35:41.950652+0000","last_undegraded":"2024-09-11T22:35:41.950652+0000","last_fullsized":"2024-09-11T22:35:41.950652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'6039","reported_seq":6064,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.873235+0000","last_change":"2024-09-11T22:20:23.880693+0000","last_active":"2024-09-11T22:35:44.873235+0000","last_peered":"2024-09-11T22:35:44.873235+0000","last_clean":"2024-09-11T22:35:44.873235+0000","last_became_active":"2024-09-11T22:20:23.880243+0000","last_became_peered":"2024-09-11T22:20:23.880243+0000","last_unstale":"2024-09-11T22:35:44.873235+0000","last_undegraded":"2024-09-11T22:35:44.873235+0000","last_fullsized":"2024-09-11T22:35:44.873235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6039,"log_dups_size":0,"ondisk_log_size":6039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.659287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27825,"num_write_kb":504386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'23","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.040905+0000","last_change":"2024-09-11T22:20:19.844808+0000","last_active":"2024-09-11T22:35:51.040905+0000","last_peered":"2024-09-11T22:35:51.040905+0000","last_clean":"2024-09-11T22:35:51.040905+0000","last_became_active":"2024-09-11T22:20:19.844536+0000","last_became_peered":"2024-09-11T22:20:19.844536+0000","last_unstale":"2024-09-11T22:35:51.040905+0000","last_undegraded":"2024-09-11T22:35:51.040905+0000","last_fullsized":"2024-09-11T22:35:51.040905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:57.142383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'51","reported_seq":129,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:31.518080+0000","last_change":"2024-09-11T22:20:18.855640+0000","last_active":"2024-09-11T22:35:31.518080+0000","last_peered":"2024-09-11T22:35:31.518080+0000","last_clean":"2024-09-11T22:35:31.518080+0000","last_became_active":"2024-09-11T22:20:18.855394+0000","last_became_peered":"2024-09-11T22:20:18.855394+0000","last_unstale":"2024-09-11T22:35:31.518080+0000","last_undegraded":"2024-09-11T22:35:31.518080+0000","last_fullsized":"2024-09-11T22:35:31.518080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94258,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":122,"num_write":49,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'6775","reported_seq":6800,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.543280+0000","last_change":"2024-09-11T22:20:23.882554+0000","last_active":"2024-09-11T22:35:44.543280+0000","last_peered":"2024-09-11T22:35:44.543280+0000","last_clean":"2024-09-11T22:35:44.543280+0000","last_became_active":"2024-09-11T22:20:23.881642+0000","last_became_peered":"2024-09-11T22:20:23.881642+0000","last_unstale":"2024-09-11T22:35:44.543280+0000","last_undegraded":"2024-09-11T22:35:44.543280+0000","last_fullsized":"2024-09-11T22:35:44.543280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6775,"log_dups_size":0,"ondisk_log_size":6775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:16.696043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30543,"num_write_kb":560301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'13","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.041208+0000","last_change":"2024-09-11T22:20:19.859429+0000","last_active":"2024-09-11T22:35:51.041208+0000","last_peered":"2024-09-11T22:35:51.041208+0000","last_clean":"2024-09-11T22:35:51.041208+0000","last_became_active":"2024-09-11T22:20:19.859159+0000","last_became_peered":"2024-09-11T22:20:19.859159+0000","last_unstale":"2024-09-11T22:35:51.041208+0000","last_undegraded":"2024-09-11T22:35:51.041208+0000","last_fullsized":"2024-09-11T22:35:51.041208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:02.696450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'8","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.980499+0000","last_change":"2024-09-11T22:20:18.856144+0000","last_active":"2024-09-11T22:35:41.980499+0000","last_peered":"2024-09-11T22:35:41.980499+0000","last_clean":"2024-09-11T22:35:41.980499+0000","last_became_active":"2024-09-11T22:20:18.855866+0000","last_became_peered":"2024-09-11T22:20:18.855866+0000","last_unstale":"2024-09-11T22:35:41.980499+0000","last_undegraded":"2024-09-11T22:35:41.980499+0000","last_fullsized":"2024-09-11T22:35:41.980499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:37.259393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'5391","reported_seq":5416,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.679630+0000","last_change":"2024-09-11T22:20:24.075154+0000","last_active":"2024-09-11T22:35:44.679630+0000","last_peered":"2024-09-11T22:35:44.679630+0000","last_clean":"2024-09-11T22:35:44.679630+0000","last_became_active":"2024-09-11T22:20:24.074568+0000","last_became_peered":"2024-09-11T22:20:24.074568+0000","last_unstale":"2024-09-11T22:35:44.679630+0000","last_undegraded":"2024-09-11T22:35:44.679630+0000","last_fullsized":"2024-09-11T22:35:44.679630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5391,"log_dups_size":0,"ondisk_log_size":5391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:09.804991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24494,"num_write_kb":454589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'16","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.061776+0000","last_change":"2024-09-11T22:20:19.861236+0000","last_active":"2024-09-11T22:35:51.061776+0000","last_peered":"2024-09-11T22:35:51.061776+0000","last_clean":"2024-09-11T22:35:51.061776+0000","last_became_active":"2024-09-11T22:20:19.860938+0000","last_became_peered":"2024-09-11T22:20:19.860938+0000","last_unstale":"2024-09-11T22:35:51.061776+0000","last_undegraded":"2024-09-11T22:35:51.061776+0000","last_fullsized":"2024-09-11T22:35:51.061776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:42.015334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'4","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:32:48.462376+0000","last_change":"2024-09-11T22:20:18.853467+0000","last_active":"2024-09-11T22:32:48.462376+0000","last_peered":"2024-09-11T22:32:48.462376+0000","last_clean":"2024-09-11T22:32:48.462376+0000","last_became_active":"2024-09-11T22:20:18.853182+0000","last_became_peered":"2024-09-11T22:20:18.853182+0000","last_unstale":"2024-09-11T22:32:48.462376+0000","last_undegraded":"2024-09-11T22:32:48.462376+0000","last_fullsized":"2024-09-11T22:32:48.462376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":189,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:32:13.435821+0000","last_change":"2024-09-11T22:20:09.425648+0000","last_active":"2024-09-11T22:32:13.435821+0000","last_peered":"2024-09-11T22:32:13.435821+0000","last_clean":"2024-09-11T22:32:13.435821+0000","last_became_active":"2024-09-11T22:20:09.424591+0000","last_became_peered":"2024-09-11T22:20:09.424591+0000","last_unstale":"2024-09-11T22:32:13.435821+0000","last_undegraded":"2024-09-11T22:32:13.435821+0000","last_fullsized":"2024-09-11T22:32:13.435821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_clean_scrub_stamp":"2024-09-11T22:20:08.334092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:53.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'5687","reported_seq":5712,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.790987+0000","last_change":"2024-09-11T22:20:24.077007+0000","last_active":"2024-09-11T22:35:44.790987+0000","last_peered":"2024-09-11T22:35:44.790987+0000","last_clean":"2024-09-11T22:35:44.790987+0000","last_became_active":"2024-09-11T22:20:24.076601+0000","last_became_peered":"2024-09-11T22:20:24.076601+0000","last_unstale":"2024-09-11T22:35:44.790987+0000","last_undegraded":"2024-09-11T22:35:44.790987+0000","last_fullsized":"2024-09-11T22:35:44.790987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5687,"log_dups_size":0,"ondisk_log_size":5687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25854,"num_write_kb":500757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'22","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.063439+0000","last_change":"2024-09-11T22:20:19.863279+0000","last_active":"2024-09-11T22:35:51.063439+0000","last_peered":"2024-09-11T22:35:51.063439+0000","last_clean":"2024-09-11T22:35:51.063439+0000","last_became_active":"2024-09-11T22:20:19.861322+0000","last_became_peered":"2024-09-11T22:20:19.861322+0000","last_unstale":"2024-09-11T22:35:51.063439+0000","last_undegraded":"2024-09-11T22:35:51.063439+0000","last_fullsized":"2024-09-11T22:35:51.063439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'5","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:33:51.687511+0000","last_change":"2024-09-11T22:20:18.853343+0000","last_active":"2024-09-11T22:33:51.687511+0000","last_peered":"2024-09-11T22:33:51.687511+0000","last_clean":"2024-09-11T22:33:51.687511+0000","last_became_active":"2024-09-11T22:20:18.853069+0000","last_became_peered":"2024-09-11T22:20:18.853069+0000","last_unstale":"2024-09-11T22:33:51.687511+0000","last_undegraded":"2024-09-11T22:33:51.687511+0000","last_fullsized":"2024-09-11T22:33:51.687511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'5968","reported_seq":5993,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.663026+0000","last_change":"2024-09-11T22:20:24.075350+0000","last_active":"2024-09-11T22:35:44.663026+0000","last_peered":"2024-09-11T22:35:44.663026+0000","last_clean":"2024-09-11T22:35:44.663026+0000","last_became_active":"2024-09-11T22:20:24.074789+0000","last_became_peered":"2024-09-11T22:20:24.074789+0000","last_unstale":"2024-09-11T22:35:44.663026+0000","last_undegraded":"2024-09-11T22:35:44.663026+0000","last_fullsized":"2024-09-11T22:35:44.663026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5968,"log_dups_size":0,"ondisk_log_size":5968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27295,"num_write_kb":514661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'20","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.061734+0000","last_change":"2024-09-11T22:20:19.866331+0000","last_active":"2024-09-11T22:35:51.061734+0000","last_peered":"2024-09-11T22:35:51.061734+0000","last_clean":"2024-09-11T22:35:51.061734+0000","last_became_active":"2024-09-11T22:20:19.865535+0000","last_became_peered":"2024-09-11T22:20:19.865535+0000","last_unstale":"2024-09-11T22:35:51.061734+0000","last_undegraded":"2024-09-11T22:35:51.061734+0000","last_fullsized":"2024-09-11T22:35:51.061734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'2","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:33:54.589490+0000","last_change":"2024-09-11T22:20:18.849434+0000","last_active":"2024-09-11T22:33:54.589490+0000","last_peered":"2024-09-11T22:33:54.589490+0000","last_clean":"2024-09-11T22:33:54.589490+0000","last_became_active":"2024-09-11T22:20:18.848787+0000","last_became_peered":"2024-09-11T22:20:18.848787+0000","last_unstale":"2024-09-11T22:33:54.589490+0000","last_undegraded":"2024-09-11T22:33:54.589490+0000","last_fullsized":"2024-09-11T22:33:54.589490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:25.689495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'5430","reported_seq":5454,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.747663+0000","last_change":"2024-09-11T22:20:23.879962+0000","last_active":"2024-09-11T22:35:44.747663+0000","last_peered":"2024-09-11T22:35:44.747663+0000","last_clean":"2024-09-11T22:35:44.747663+0000","last_became_active":"2024-09-11T22:20:23.879586+0000","last_became_peered":"2024-09-11T22:20:23.879586+0000","last_unstale":"2024-09-11T22:35:44.747663+0000","last_undegraded":"2024-09-11T22:35:44.747663+0000","last_fullsized":"2024-09-11T22:35:44.747663+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5430,"log_dups_size":0,"ondisk_log_size":5430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:27.323116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24342,"num_write_kb":478105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'21","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.056702+0000","last_change":"2024-09-11T22:20:19.860411+0000","last_active":"2024-09-11T22:35:51.056702+0000","last_peered":"2024-09-11T22:35:51.056702+0000","last_clean":"2024-09-11T22:35:51.056702+0000","last_became_active":"2024-09-11T22:20:19.860076+0000","last_became_peered":"2024-09-11T22:20:19.860076+0000","last_unstale":"2024-09-11T22:35:51.056702+0000","last_undegraded":"2024-09-11T22:35:51.056702+0000","last_fullsized":"2024-09-11T22:35:51.056702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'6","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.945924+0000","last_change":"2024-09-11T22:20:18.856020+0000","last_active":"2024-09-11T22:35:41.945924+0000","last_peered":"2024-09-11T22:35:41.945924+0000","last_clean":"2024-09-11T22:35:41.945924+0000","last_became_active":"2024-09-11T22:20:18.855753+0000","last_became_peered":"2024-09-11T22:20:18.855753+0000","last_unstale":"2024-09-11T22:35:41.945924+0000","last_undegraded":"2024-09-11T22:35:41.945924+0000","last_fullsized":"2024-09-11T22:35:41.945924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'6069","reported_seq":6094,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.538017+0000","last_change":"2024-09-11T22:20:24.077975+0000","last_active":"2024-09-11T22:35:44.538017+0000","last_peered":"2024-09-11T22:35:44.538017+0000","last_clean":"2024-09-11T22:35:44.538017+0000","last_became_active":"2024-09-11T22:20:24.077502+0000","last_became_peered":"2024-09-11T22:20:24.077502+0000","last_unstale":"2024-09-11T22:35:44.538017+0000","last_undegraded":"2024-09-11T22:35:44.538017+0000","last_fullsized":"2024-09-11T22:35:44.538017+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6069,"log_dups_size":0,"ondisk_log_size":6069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:16.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27695,"num_write_kb":495810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'12","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.052943+0000","last_change":"2024-09-11T22:20:19.856986+0000","last_active":"2024-09-11T22:35:51.052943+0000","last_peered":"2024-09-11T22:35:51.052943+0000","last_clean":"2024-09-11T22:35:51.052943+0000","last_became_active":"2024-09-11T22:20:19.856739+0000","last_became_peered":"2024-09-11T22:20:19.856739+0000","last_unstale":"2024-09-11T22:35:51.052943+0000","last_undegraded":"2024-09-11T22:35:51.052943+0000","last_fullsized":"2024-09-11T22:35:51.052943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'6","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.987646+0000","last_change":"2024-09-11T22:20:18.855044+0000","last_active":"2024-09-11T22:35:41.987646+0000","last_peered":"2024-09-11T22:35:41.987646+0000","last_clean":"2024-09-11T22:35:41.987646+0000","last_became_active":"2024-09-11T22:20:18.854764+0000","last_became_peered":"2024-09-11T22:20:18.854764+0000","last_unstale":"2024-09-11T22:35:41.987646+0000","last_undegraded":"2024-09-11T22:35:41.987646+0000","last_fullsized":"2024-09-11T22:35:41.987646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:22.207278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'5738","reported_seq":5763,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.723908+0000","last_change":"2024-09-11T22:20:23.878383+0000","last_active":"2024-09-11T22:35:44.723908+0000","last_peered":"2024-09-11T22:35:44.723908+0000","last_clean":"2024-09-11T22:35:44.723908+0000","last_became_active":"2024-09-11T22:20:23.877890+0000","last_became_peered":"2024-09-11T22:20:23.877890+0000","last_unstale":"2024-09-11T22:35:44.723908+0000","last_undegraded":"2024-09-11T22:35:44.723908+0000","last_fullsized":"2024-09-11T22:35:44.723908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5738,"log_dups_size":0,"ondisk_log_size":5738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:18.876485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25762,"num_write_kb":496113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'20","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.057770+0000","last_change":"2024-09-11T22:20:19.861242+0000","last_active":"2024-09-11T22:35:51.057770+0000","last_peered":"2024-09-11T22:35:51.057770+0000","last_clean":"2024-09-11T22:35:51.057770+0000","last_became_active":"2024-09-11T22:20:19.860988+0000","last_became_peered":"2024-09-11T22:20:19.860988+0000","last_unstale":"2024-09-11T22:35:51.057770+0000","last_undegraded":"2024-09-11T22:35:51.057770+0000","last_fullsized":"2024-09-11T22:35:51.057770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'19","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.960798+0000","last_change":"2024-09-11T22:20:18.852459+0000","last_active":"2024-09-11T22:35:41.960798+0000","last_peered":"2024-09-11T22:35:41.960798+0000","last_clean":"2024-09-11T22:35:41.960798+0000","last_became_active":"2024-09-11T22:20:18.852153+0000","last_became_peered":"2024-09-11T22:20:18.852153+0000","last_unstale":"2024-09-11T22:35:41.960798+0000","last_undegraded":"2024-09-11T22:35:41.960798+0000","last_fullsized":"2024-09-11T22:35:41.960798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'6219","reported_seq":6243,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.807182+0000","last_change":"2024-09-11T22:20:23.874062+0000","last_active":"2024-09-11T22:35:44.807182+0000","last_peered":"2024-09-11T22:35:44.807182+0000","last_clean":"2024-09-11T22:35:44.807182+0000","last_became_active":"2024-09-11T22:20:23.873635+0000","last_became_peered":"2024-09-11T22:20:23.873635+0000","last_unstale":"2024-09-11T22:35:44.807182+0000","last_undegraded":"2024-09-11T22:35:44.807182+0000","last_fullsized":"2024-09-11T22:35:44.807182+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6219,"log_dups_size":0,"ondisk_log_size":6219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:40.914142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28436,"num_write_kb":547819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'20","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.045171+0000","last_change":"2024-09-11T22:20:19.851577+0000","last_active":"2024-09-11T22:35:51.045171+0000","last_peered":"2024-09-11T22:35:51.045171+0000","last_clean":"2024-09-11T22:35:51.045171+0000","last_became_active":"2024-09-11T22:20:19.851286+0000","last_became_peered":"2024-09-11T22:20:19.851286+0000","last_unstale":"2024-09-11T22:35:51.045171+0000","last_undegraded":"2024-09-11T22:35:51.045171+0000","last_fullsized":"2024-09-11T22:35:51.045171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:32.025931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'9","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.934456+0000","last_change":"2024-09-11T22:20:18.853301+0000","last_active":"2024-09-11T22:35:41.934456+0000","last_peered":"2024-09-11T22:35:41.934456+0000","last_clean":"2024-09-11T22:35:41.934456+0000","last_became_active":"2024-09-11T22:20:18.852978+0000","last_became_peered":"2024-09-11T22:20:18.852978+0000","last_unstale":"2024-09-11T22:35:41.934456+0000","last_undegraded":"2024-09-11T22:35:41.934456+0000","last_fullsized":"2024-09-11T22:35:41.934456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'6495","reported_seq":6519,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.721208+0000","last_change":"2024-09-11T22:20:24.077636+0000","last_active":"2024-09-11T22:35:44.721208+0000","last_peered":"2024-09-11T22:35:44.721208+0000","last_clean":"2024-09-11T22:35:44.721208+0000","last_became_active":"2024-09-11T22:20:24.077313+0000","last_became_peered":"2024-09-11T22:20:24.077313+0000","last_unstale":"2024-09-11T22:35:44.721208+0000","last_undegraded":"2024-09-11T22:35:44.721208+0000","last_fullsized":"2024-09-11T22:35:44.721208+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6295,"log_dups_size":0,"ondisk_log_size":6295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:23.154027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29875,"num_write_kb":541234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'29","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.056839+0000","last_change":"2024-09-11T22:20:19.862562+0000","last_active":"2024-09-11T22:35:51.056839+0000","last_peered":"2024-09-11T22:35:51.056839+0000","last_clean":"2024-09-11T22:35:51.056839+0000","last_became_active":"2024-09-11T22:20:19.862267+0000","last_became_peered":"2024-09-11T22:20:19.862267+0000","last_unstale":"2024-09-11T22:35:51.056839+0000","last_undegraded":"2024-09-11T22:35:51.056839+0000","last_fullsized":"2024-09-11T22:35:51.056839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'8","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.772343+0000","last_change":"2024-09-11T22:20:18.858002+0000","last_active":"2024-09-11T22:35:41.772343+0000","last_peered":"2024-09-11T22:35:41.772343+0000","last_clean":"2024-09-11T22:35:41.772343+0000","last_became_active":"2024-09-11T22:20:18.857419+0000","last_became_peered":"2024-09-11T22:20:18.857419+0000","last_unstale":"2024-09-11T22:35:41.772343+0000","last_undegraded":"2024-09-11T22:35:41.772343+0000","last_fullsized":"2024-09-11T22:35:41.772343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'6284","reported_seq":6308,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.748617+0000","last_change":"2024-09-11T22:20:24.074971+0000","last_active":"2024-09-11T22:35:44.748617+0000","last_peered":"2024-09-11T22:35:44.748617+0000","last_clean":"2024-09-11T22:35:44.748617+0000","last_became_active":"2024-09-11T22:20:24.074609+0000","last_became_peered":"2024-09-11T22:20:24.074609+0000","last_unstale":"2024-09-11T22:35:44.748617+0000","last_undegraded":"2024-09-11T22:35:44.748617+0000","last_fullsized":"2024-09-11T22:35:44.748617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6284,"log_dups_size":0,"ondisk_log_size":6284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:55.318904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27888,"num_write_kb":554175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'24","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.058304+0000","last_change":"2024-09-11T22:20:19.857276+0000","last_active":"2024-09-11T22:35:51.058304+0000","last_peered":"2024-09-11T22:35:51.058304+0000","last_clean":"2024-09-11T22:35:51.058304+0000","last_became_active":"2024-09-11T22:20:19.857027+0000","last_became_peered":"2024-09-11T22:20:19.857027+0000","last_unstale":"2024-09-11T22:35:51.058304+0000","last_undegraded":"2024-09-11T22:35:51.058304+0000","last_fullsized":"2024-09-11T22:35:51.058304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'11","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.763997+0000","last_change":"2024-09-11T22:20:18.848671+0000","last_active":"2024-09-11T22:35:41.763997+0000","last_peered":"2024-09-11T22:35:41.763997+0000","last_clean":"2024-09-11T22:35:41.763997+0000","last_became_active":"2024-09-11T22:20:18.848405+0000","last_became_peered":"2024-09-11T22:20:18.848405+0000","last_unstale":"2024-09-11T22:35:41.763997+0000","last_undegraded":"2024-09-11T22:35:41.763997+0000","last_fullsized":"2024-09-11T22:35:41.763997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'5107","reported_seq":5131,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.845298+0000","last_change":"2024-09-11T22:20:24.076835+0000","last_active":"2024-09-11T22:35:44.845298+0000","last_peered":"2024-09-11T22:35:44.845298+0000","last_clean":"2024-09-11T22:35:44.845298+0000","last_became_active":"2024-09-11T22:20:24.076200+0000","last_became_peered":"2024-09-11T22:20:24.076200+0000","last_unstale":"2024-09-11T22:35:44.845298+0000","last_undegraded":"2024-09-11T22:35:44.845298+0000","last_fullsized":"2024-09-11T22:35:44.845298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5107,"log_dups_size":0,"ondisk_log_size":5107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:48.150778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22900,"num_write_kb":480501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'17","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.046531+0000","last_change":"2024-09-11T22:21:02.033502+0000","last_active":"2024-09-11T22:35:51.046531+0000","last_peered":"2024-09-11T22:35:51.046531+0000","last_clean":"2024-09-11T22:35:51.046531+0000","last_became_active":"2024-09-11T22:21:02.033269+0000","last_became_peered":"2024-09-11T22:21:02.033269+0000","last_unstale":"2024-09-11T22:35:51.046531+0000","last_undegraded":"2024-09-11T22:35:51.046531+0000","last_fullsized":"2024-09-11T22:35:51.046531+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:31.993239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'329","reported_seq":361,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.984847+0000","last_change":"2024-09-11T22:20:18.855665+0000","last_active":"2024-09-11T22:35:41.984847+0000","last_peered":"2024-09-11T22:35:41.984847+0000","last_clean":"2024-09-11T22:35:41.984847+0000","last_became_active":"2024-09-11T22:20:18.855386+0000","last_became_peered":"2024-09-11T22:20:18.855386+0000","last_unstale":"2024-09-11T22:35:41.984847+0000","last_undegraded":"2024-09-11T22:35:41.984847+0000","last_fullsized":"2024-09-11T22:35:41.984847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'5582","reported_seq":5606,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.597450+0000","last_change":"2024-09-11T22:20:23.880793+0000","last_active":"2024-09-11T22:35:44.597450+0000","last_peered":"2024-09-11T22:35:44.597450+0000","last_clean":"2024-09-11T22:35:44.597450+0000","last_became_active":"2024-09-11T22:20:23.879993+0000","last_became_peered":"2024-09-11T22:20:23.879993+0000","last_unstale":"2024-09-11T22:35:44.597450+0000","last_undegraded":"2024-09-11T22:35:44.597450+0000","last_fullsized":"2024-09-11T22:35:44.597450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5582,"log_dups_size":0,"ondisk_log_size":5582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:50.449090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25321,"num_write_kb":502610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'21","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.050799+0000","last_change":"2024-09-11T22:20:19.858588+0000","last_active":"2024-09-11T22:35:51.050799+0000","last_peered":"2024-09-11T22:35:51.050799+0000","last_clean":"2024-09-11T22:35:51.050799+0000","last_became_active":"2024-09-11T22:20:19.858322+0000","last_became_peered":"2024-09-11T22:20:19.858322+0000","last_unstale":"2024-09-11T22:35:51.050799+0000","last_undegraded":"2024-09-11T22:35:51.050799+0000","last_fullsized":"2024-09-11T22:35:51.050799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'27","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.992364+0000","last_change":"2024-09-11T22:20:18.855056+0000","last_active":"2024-09-11T22:35:41.992364+0000","last_peered":"2024-09-11T22:35:41.992364+0000","last_clean":"2024-09-11T22:35:41.992364+0000","last_became_active":"2024-09-11T22:20:18.854784+0000","last_became_peered":"2024-09-11T22:20:18.854784+0000","last_unstale":"2024-09-11T22:35:41.992364+0000","last_undegraded":"2024-09-11T22:35:41.992364+0000","last_fullsized":"2024-09-11T22:35:41.992364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:38.916121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'6236","reported_seq":6260,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.716467+0000","last_change":"2024-09-11T22:20:23.879768+0000","last_active":"2024-09-11T22:35:44.716467+0000","last_peered":"2024-09-11T22:35:44.716467+0000","last_clean":"2024-09-11T22:35:44.716467+0000","last_became_active":"2024-09-11T22:20:23.878794+0000","last_became_peered":"2024-09-11T22:20:23.878794+0000","last_unstale":"2024-09-11T22:35:44.716467+0000","last_undegraded":"2024-09-11T22:35:44.716467+0000","last_fullsized":"2024-09-11T22:35:44.716467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6236,"log_dups_size":0,"ondisk_log_size":6236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:07.301587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28034,"num_write_kb":525577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'25","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.044031+0000","last_change":"2024-09-11T22:21:02.034590+0000","last_active":"2024-09-11T22:35:51.044031+0000","last_peered":"2024-09-11T22:35:51.044031+0000","last_clean":"2024-09-11T22:35:51.044031+0000","last_became_active":"2024-09-11T22:21:02.034349+0000","last_became_peered":"2024-09-11T22:21:02.034349+0000","last_unstale":"2024-09-11T22:35:51.044031+0000","last_undegraded":"2024-09-11T22:35:51.044031+0000","last_fullsized":"2024-09-11T22:35:51.044031+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:24.655612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'4","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.765058+0000","last_change":"2024-09-11T22:20:18.853382+0000","last_active":"2024-09-11T22:35:41.765058+0000","last_peered":"2024-09-11T22:35:41.765058+0000","last_clean":"2024-09-11T22:35:41.765058+0000","last_became_active":"2024-09-11T22:20:18.853103+0000","last_became_peered":"2024-09-11T22:20:18.853103+0000","last_unstale":"2024-09-11T22:35:41.765058+0000","last_undegraded":"2024-09-11T22:35:41.765058+0000","last_fullsized":"2024-09-11T22:35:41.765058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'5748","reported_seq":5772,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.639554+0000","last_change":"2024-09-11T22:20:23.876997+0000","last_active":"2024-09-11T22:35:44.639554+0000","last_peered":"2024-09-11T22:35:44.639554+0000","last_clean":"2024-09-11T22:35:44.639554+0000","last_became_active":"2024-09-11T22:20:23.876587+0000","last_became_peered":"2024-09-11T22:20:23.876587+0000","last_unstale":"2024-09-11T22:35:44.639554+0000","last_undegraded":"2024-09-11T22:35:44.639554+0000","last_fullsized":"2024-09-11T22:35:44.639554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5748,"log_dups_size":0,"ondisk_log_size":5748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:19.670665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26080,"num_write_kb":501611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'25","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.055748+0000","last_change":"2024-09-11T22:20:19.866624+0000","last_active":"2024-09-11T22:35:51.055748+0000","last_peered":"2024-09-11T22:35:51.055748+0000","last_clean":"2024-09-11T22:35:51.055748+0000","last_became_active":"2024-09-11T22:20:19.866303+0000","last_became_peered":"2024-09-11T22:20:19.866303+0000","last_unstale":"2024-09-11T22:35:51.055748+0000","last_undegraded":"2024-09-11T22:35:51.055748+0000","last_fullsized":"2024-09-11T22:35:51.055748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'6","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.933977+0000","last_change":"2024-09-11T22:20:18.854361+0000","last_active":"2024-09-11T22:35:41.933977+0000","last_peered":"2024-09-11T22:35:41.933977+0000","last_clean":"2024-09-11T22:35:41.933977+0000","last_became_active":"2024-09-11T22:20:18.854019+0000","last_became_peered":"2024-09-11T22:20:18.854019+0000","last_unstale":"2024-09-11T22:35:41.933977+0000","last_undegraded":"2024-09-11T22:35:41.933977+0000","last_fullsized":"2024-09-11T22:35:41.933977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'5959","reported_seq":5983,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.721236+0000","last_change":"2024-09-11T22:20:24.077476+0000","last_active":"2024-09-11T22:35:44.721236+0000","last_peered":"2024-09-11T22:35:44.721236+0000","last_clean":"2024-09-11T22:35:44.721236+0000","last_became_active":"2024-09-11T22:20:24.077134+0000","last_became_peered":"2024-09-11T22:20:24.077134+0000","last_unstale":"2024-09-11T22:35:44.721236+0000","last_undegraded":"2024-09-11T22:35:44.721236+0000","last_fullsized":"2024-09-11T22:35:44.721236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5959,"log_dups_size":0,"ondisk_log_size":5959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:03.186460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26850,"num_write_kb":516954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'7134","reported_seq":7166,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.759457+0000","last_change":"2024-09-11T22:21:02.037816+0000","last_active":"2024-09-11T22:35:44.759457+0000","last_peered":"2024-09-11T22:35:44.759457+0000","last_clean":"2024-09-11T22:35:44.759457+0000","last_became_active":"2024-09-11T22:21:02.037407+0000","last_became_peered":"2024-09-11T22:21:02.037407+0000","last_unstale":"2024-09-11T22:35:44.759457+0000","last_undegraded":"2024-09-11T22:35:44.759457+0000","last_fullsized":"2024-09-11T22:35:44.759457+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":7134,"log_dups_size":0,"ondisk_log_size":7134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:36.018837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33450,"num_write_kb":608986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'20","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.042665+0000","last_change":"2024-09-11T22:20:19.845776+0000","last_active":"2024-09-11T22:35:51.042665+0000","last_peered":"2024-09-11T22:35:51.042665+0000","last_clean":"2024-09-11T22:35:51.042665+0000","last_became_active":"2024-09-11T22:20:19.845425+0000","last_became_peered":"2024-09-11T22:20:19.845425+0000","last_unstale":"2024-09-11T22:35:51.042665+0000","last_undegraded":"2024-09-11T22:35:51.042665+0000","last_fullsized":"2024-09-11T22:35:51.042665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:07.187533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'4","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.851019+0000","last_change":"2024-09-11T22:20:18.852446+0000","last_active":"2024-09-11T22:35:37.851019+0000","last_peered":"2024-09-11T22:35:37.851019+0000","last_clean":"2024-09-11T22:35:37.851019+0000","last_became_active":"2024-09-11T22:20:18.852155+0000","last_became_peered":"2024-09-11T22:20:18.852155+0000","last_unstale":"2024-09-11T22:35:37.851019+0000","last_undegraded":"2024-09-11T22:35:37.851019+0000","last_fullsized":"2024-09-11T22:35:37.851019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"28'6143","reported_seq":6168,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.664318+0000","last_change":"2024-09-11T22:20:23.876503+0000","last_active":"2024-09-11T22:35:44.664318+0000","last_peered":"2024-09-11T22:35:44.664318+0000","last_clean":"2024-09-11T22:35:44.664318+0000","last_became_active":"2024-09-11T22:20:23.876100+0000","last_became_peered":"2024-09-11T22:20:23.876100+0000","last_unstale":"2024-09-11T22:35:44.664318+0000","last_undegraded":"2024-09-11T22:35:44.664318+0000","last_fullsized":"2024-09-11T22:35:44.664318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6143,"log_dups_size":0,"ondisk_log_size":6143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28157,"num_write_kb":534365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'27","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.045313+0000","last_change":"2024-09-11T22:20:19.852606+0000","last_active":"2024-09-11T22:35:51.045313+0000","last_peered":"2024-09-11T22:35:51.045313+0000","last_clean":"2024-09-11T22:35:51.045313+0000","last_became_active":"2024-09-11T22:20:19.852333+0000","last_became_peered":"2024-09-11T22:20:19.852333+0000","last_unstale":"2024-09-11T22:35:51.045313+0000","last_undegraded":"2024-09-11T22:35:51.045313+0000","last_fullsized":"2024-09-11T22:35:51.045313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:56.940278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'5","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:34:55.328347+0000","last_change":"2024-09-11T22:20:18.853767+0000","last_active":"2024-09-11T22:34:55.328347+0000","last_peered":"2024-09-11T22:34:55.328347+0000","last_clean":"2024-09-11T22:34:55.328347+0000","last_became_active":"2024-09-11T22:20:18.853533+0000","last_became_peered":"2024-09-11T22:20:18.853533+0000","last_unstale":"2024-09-11T22:34:55.328347+0000","last_undegraded":"2024-09-11T22:34:55.328347+0000","last_fullsized":"2024-09-11T22:34:55.328347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:36.662271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'9","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.849731+0000","last_change":"2024-09-11T22:20:18.847133+0000","last_active":"2024-09-11T22:35:37.849731+0000","last_peered":"2024-09-11T22:35:37.849731+0000","last_clean":"2024-09-11T22:35:37.849731+0000","last_became_active":"2024-09-11T22:20:18.846321+0000","last_became_peered":"2024-09-11T22:20:18.846321+0000","last_unstale":"2024-09-11T22:35:37.849731+0000","last_undegraded":"2024-09-11T22:35:37.849731+0000","last_fullsized":"2024-09-11T22:35:37.849731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'19","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.044295+0000","last_change":"2024-09-11T22:20:19.861445+0000","last_active":"2024-09-11T22:35:51.044295+0000","last_peered":"2024-09-11T22:35:51.044295+0000","last_clean":"2024-09-11T22:35:51.044295+0000","last_became_active":"2024-09-11T22:20:19.861154+0000","last_became_peered":"2024-09-11T22:20:19.861154+0000","last_unstale":"2024-09-11T22:35:51.044295+0000","last_undegraded":"2024-09-11T22:35:51.044295+0000","last_fullsized":"2024-09-11T22:35:51.044295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'5094","reported_seq":5118,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.866023+0000","last_change":"2024-09-11T22:20:23.877973+0000","last_active":"2024-09-11T22:35:44.866023+0000","last_peered":"2024-09-11T22:35:44.866023+0000","last_clean":"2024-09-11T22:35:44.866023+0000","last_became_active":"2024-09-11T22:20:23.877578+0000","last_became_peered":"2024-09-11T22:20:23.877578+0000","last_unstale":"2024-09-11T22:35:44.866023+0000","last_undegraded":"2024-09-11T22:35:44.866023+0000","last_fullsized":"2024-09-11T22:35:44.866023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5094,"log_dups_size":0,"ondisk_log_size":5094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:27.826669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23560,"num_write_kb":426046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'584","reported_seq":616,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.378051+0000","last_change":"2024-09-11T22:20:18.854142+0000","last_active":"2024-09-11T22:35:37.378051+0000","last_peered":"2024-09-11T22:35:37.378051+0000","last_clean":"2024-09-11T22:35:37.378051+0000","last_became_active":"2024-09-11T22:20:18.853872+0000","last_became_peered":"2024-09-11T22:20:18.853872+0000","last_unstale":"2024-09-11T22:35:37.378051+0000","last_undegraded":"2024-09-11T22:35:37.378051+0000","last_fullsized":"2024-09-11T22:35:37.378051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:22.513242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195510,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":580,"num_write_kb":4218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'20","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.034644+0000","last_change":"2024-09-11T22:20:19.852580+0000","last_active":"2024-09-11T22:35:51.034644+0000","last_peered":"2024-09-11T22:35:51.034644+0000","last_clean":"2024-09-11T22:35:51.034644+0000","last_became_active":"2024-09-11T22:20:19.850175+0000","last_became_peered":"2024-09-11T22:20:19.850175+0000","last_unstale":"2024-09-11T22:35:51.034644+0000","last_undegraded":"2024-09-11T22:35:51.034644+0000","last_fullsized":"2024-09-11T22:35:51.034644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:11.937256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'6620","reported_seq":6644,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.412485+0000","last_change":"2024-09-11T22:20:23.878004+0000","last_active":"2024-09-11T22:35:44.412485+0000","last_peered":"2024-09-11T22:35:44.412485+0000","last_clean":"2024-09-11T22:35:44.412485+0000","last_became_active":"2024-09-11T22:20:23.876776+0000","last_became_peered":"2024-09-11T22:20:23.876776+0000","last_unstale":"2024-09-11T22:35:44.412485+0000","last_undegraded":"2024-09-11T22:35:44.412485+0000","last_fullsized":"2024-09-11T22:35:44.412485+0000","mapping_epoch":24,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6320,"log_dups_size":0,"ondisk_log_size":6320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:11.254248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29858,"num_write_kb":574080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'24","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.045814+0000","last_change":"2024-09-11T22:20:19.853439+0000","last_active":"2024-09-11T22:35:51.045814+0000","last_peered":"2024-09-11T22:35:51.045814+0000","last_clean":"2024-09-11T22:35:51.045814+0000","last_became_active":"2024-09-11T22:20:19.852937+0000","last_became_peered":"2024-09-11T22:20:19.852937+0000","last_unstale":"2024-09-11T22:35:51.045814+0000","last_undegraded":"2024-09-11T22:35:51.045814+0000","last_fullsized":"2024-09-11T22:35:51.045814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'25","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.061579+0000","last_change":"2024-09-11T22:20:19.861003+0000","last_active":"2024-09-11T22:35:51.061579+0000","last_peered":"2024-09-11T22:35:51.061579+0000","last_clean":"2024-09-11T22:35:51.061579+0000","last_became_active":"2024-09-11T22:20:19.860690+0000","last_became_peered":"2024-09-11T22:20:19.860690+0000","last_unstale":"2024-09-11T22:35:51.061579+0000","last_undegraded":"2024-09-11T22:35:51.061579+0000","last_fullsized":"2024-09-11T22:35:51.061579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'23","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.053250+0000","last_change":"2024-09-11T22:20:19.856756+0000","last_active":"2024-09-11T22:35:51.053250+0000","last_peered":"2024-09-11T22:35:51.053250+0000","last_clean":"2024-09-11T22:35:51.053250+0000","last_became_active":"2024-09-11T22:20:19.856460+0000","last_became_peered":"2024-09-11T22:20:19.856460+0000","last_unstale":"2024-09-11T22:35:51.053250+0000","last_undegraded":"2024-09-11T22:35:51.053250+0000","last_fullsized":"2024-09-11T22:35:51.053250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'18","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043855+0000","last_change":"2024-09-11T22:20:19.855629+0000","last_active":"2024-09-11T22:35:51.043855+0000","last_peered":"2024-09-11T22:35:51.043855+0000","last_clean":"2024-09-11T22:35:51.043855+0000","last_became_active":"2024-09-11T22:20:19.855363+0000","last_became_peered":"2024-09-11T22:20:19.855363+0000","last_unstale":"2024-09-11T22:35:51.043855+0000","last_undegraded":"2024-09-11T22:35:51.043855+0000","last_fullsized":"2024-09-11T22:35:51.043855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'14","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043787+0000","last_change":"2024-09-11T22:20:19.863122+0000","last_active":"2024-09-11T22:35:51.043787+0000","last_peered":"2024-09-11T22:35:51.043787+0000","last_clean":"2024-09-11T22:35:51.043787+0000","last_became_active":"2024-09-11T22:20:19.862828+0000","last_became_peered":"2024-09-11T22:20:19.862828+0000","last_unstale":"2024-09-11T22:35:51.043787+0000","last_undegraded":"2024-09-11T22:35:51.043787+0000","last_fullsized":"2024-09-11T22:35:51.043787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:10.868762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'15","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.026329+0000","last_change":"2024-09-11T22:20:19.846453+0000","last_active":"2024-09-11T22:35:51.026329+0000","last_peered":"2024-09-11T22:35:51.026329+0000","last_clean":"2024-09-11T22:35:51.026329+0000","last_became_active":"2024-09-11T22:20:19.846186+0000","last_became_peered":"2024-09-11T22:20:19.846186+0000","last_unstale":"2024-09-11T22:35:51.026329+0000","last_undegraded":"2024-09-11T22:35:51.026329+0000","last_fullsized":"2024-09-11T22:35:51.026329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:24.032365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'24","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.062384+0000","last_change":"2024-09-11T22:20:19.860632+0000","last_active":"2024-09-11T22:35:51.062384+0000","last_peered":"2024-09-11T22:35:51.062384+0000","last_clean":"2024-09-11T22:35:51.062384+0000","last_became_active":"2024-09-11T22:20:19.860005+0000","last_became_peered":"2024-09-11T22:20:19.860005+0000","last_unstale":"2024-09-11T22:35:51.062384+0000","last_undegraded":"2024-09-11T22:35:51.062384+0000","last_fullsized":"2024-09-11T22:35:51.062384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'17","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.048597+0000","last_change":"2024-09-11T22:20:19.859195+0000","last_active":"2024-09-11T22:35:51.048597+0000","last_peered":"2024-09-11T22:35:51.048597+0000","last_clean":"2024-09-11T22:35:51.048597+0000","last_became_active":"2024-09-11T22:20:19.858832+0000","last_became_peered":"2024-09-11T22:20:19.858832+0000","last_unstale":"2024-09-11T22:35:51.048597+0000","last_undegraded":"2024-09-11T22:35:51.048597+0000","last_fullsized":"2024-09-11T22:35:51.048597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:56.259074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'18","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.038124+0000","last_change":"2024-09-11T22:20:19.858969+0000","last_active":"2024-09-11T22:35:51.038124+0000","last_peered":"2024-09-11T22:35:51.038124+0000","last_clean":"2024-09-11T22:35:51.038124+0000","last_became_active":"2024-09-11T22:20:19.857847+0000","last_became_peered":"2024-09-11T22:20:19.857847+0000","last_unstale":"2024-09-11T22:35:51.038124+0000","last_undegraded":"2024-09-11T22:35:51.038124+0000","last_fullsized":"2024-09-11T22:35:51.038124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'23","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.048974+0000","last_change":"2024-09-11T22:20:19.863294+0000","last_active":"2024-09-11T22:35:51.048974+0000","last_peered":"2024-09-11T22:35:51.048974+0000","last_clean":"2024-09-11T22:35:51.048974+0000","last_became_active":"2024-09-11T22:20:19.863007+0000","last_became_peered":"2024-09-11T22:20:19.863007+0000","last_unstale":"2024-09-11T22:35:51.048974+0000","last_undegraded":"2024-09-11T22:35:51.048974+0000","last_fullsized":"2024-09-11T22:35:51.048974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:06.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'23","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.062556+0000","last_change":"2024-09-11T22:20:19.858414+0000","last_active":"2024-09-11T22:35:51.062556+0000","last_peered":"2024-09-11T22:35:51.062556+0000","last_clean":"2024-09-11T22:35:51.062556+0000","last_became_active":"2024-09-11T22:20:19.857790+0000","last_became_peered":"2024-09-11T22:20:19.857790+0000","last_unstale":"2024-09-11T22:35:51.062556+0000","last_undegraded":"2024-09-11T22:35:51.062556+0000","last_fullsized":"2024-09-11T22:35:51.062556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'28","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.057627+0000","last_change":"2024-09-11T22:21:02.034810+0000","last_active":"2024-09-11T22:35:51.057627+0000","last_peered":"2024-09-11T22:35:51.057627+0000","last_clean":"2024-09-11T22:35:51.057627+0000","last_became_active":"2024-09-11T22:21:02.034534+0000","last_became_peered":"2024-09-11T22:21:02.034534+0000","last_unstale":"2024-09-11T22:35:51.057627+0000","last_undegraded":"2024-09-11T22:35:51.057627+0000","last_fullsized":"2024-09-11T22:35:51.057627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"28'19","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043768+0000","last_change":"2024-09-11T22:20:19.864700+0000","last_active":"2024-09-11T22:35:51.043768+0000","last_peered":"2024-09-11T22:35:51.043768+0000","last_clean":"2024-09-11T22:35:51.043768+0000","last_became_active":"2024-09-11T22:20:19.862296+0000","last_became_peered":"2024-09-11T22:20:19.862296+0000","last_unstale":"2024-09-11T22:35:51.043768+0000","last_undegraded":"2024-09-11T22:35:51.043768+0000","last_fullsized":"2024-09-11T22:35:51.043768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'22","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.049922+0000","last_change":"2024-09-11T22:20:19.855253+0000","last_active":"2024-09-11T22:35:51.049922+0000","last_peered":"2024-09-11T22:35:51.049922+0000","last_clean":"2024-09-11T22:35:51.049922+0000","last_became_active":"2024-09-11T22:20:19.854970+0000","last_became_peered":"2024-09-11T22:20:19.854970+0000","last_unstale":"2024-09-11T22:35:51.049922+0000","last_undegraded":"2024-09-11T22:35:51.049922+0000","last_fullsized":"2024-09-11T22:35:51.049922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'29","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.048687+0000","last_change":"2024-09-11T22:20:19.850202+0000","last_active":"2024-09-11T22:35:51.048687+0000","last_peered":"2024-09-11T22:35:51.048687+0000","last_clean":"2024-09-11T22:35:51.048687+0000","last_became_active":"2024-09-11T22:20:19.849815+0000","last_became_peered":"2024-09-11T22:20:19.849815+0000","last_unstale":"2024-09-11T22:35:51.048687+0000","last_undegraded":"2024-09-11T22:35:51.048687+0000","last_fullsized":"2024-09-11T22:35:51.048687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:56.480679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'21","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.057298+0000","last_change":"2024-09-11T22:20:19.866864+0000","last_active":"2024-09-11T22:35:51.057298+0000","last_peered":"2024-09-11T22:35:51.057298+0000","last_clean":"2024-09-11T22:35:51.057298+0000","last_became_active":"2024-09-11T22:20:19.866484+0000","last_became_peered":"2024-09-11T22:20:19.866484+0000","last_unstale":"2024-09-11T22:35:51.057298+0000","last_undegraded":"2024-09-11T22:35:51.057298+0000","last_fullsized":"2024-09-11T22:35:51.057298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'21","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.044671+0000","last_change":"2024-09-11T22:21:02.035254+0000","last_active":"2024-09-11T22:35:51.044671+0000","last_peered":"2024-09-11T22:35:51.044671+0000","last_clean":"2024-09-11T22:35:51.044671+0000","last_became_active":"2024-09-11T22:21:02.034985+0000","last_became_peered":"2024-09-11T22:21:02.034985+0000","last_unstale":"2024-09-11T22:35:51.044671+0000","last_undegraded":"2024-09-11T22:35:51.044671+0000","last_fullsized":"2024-09-11T22:35:51.044671+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"28'21","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.036646+0000","last_change":"2024-09-11T22:20:19.860050+0000","last_active":"2024-09-11T22:35:51.036646+0000","last_peered":"2024-09-11T22:35:51.036646+0000","last_clean":"2024-09-11T22:35:51.036646+0000","last_became_active":"2024-09-11T22:20:19.859755+0000","last_became_peered":"2024-09-11T22:20:19.859755+0000","last_unstale":"2024-09-11T22:35:51.036646+0000","last_undegraded":"2024-09-11T22:35:51.036646+0000","last_fullsized":"2024-09-11T22:35:51.036646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:42.487669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'24","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043675+0000","last_change":"2024-09-11T22:20:19.853902+0000","last_active":"2024-09-11T22:35:51.043675+0000","last_peered":"2024-09-11T22:35:51.043675+0000","last_clean":"2024-09-11T22:35:51.043675+0000","last_became_active":"2024-09-11T22:20:19.853563+0000","last_became_peered":"2024-09-11T22:20:19.853563+0000","last_unstale":"2024-09-11T22:35:51.043675+0000","last_undegraded":"2024-09-11T22:35:51.043675+0000","last_fullsized":"2024-09-11T22:35:51.043675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'25","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043068+0000","last_change":"2024-09-11T22:20:19.849490+0000","last_active":"2024-09-11T22:35:51.043068+0000","last_peered":"2024-09-11T22:35:51.043068+0000","last_clean":"2024-09-11T22:35:51.043068+0000","last_became_active":"2024-09-11T22:20:19.848965+0000","last_became_peered":"2024-09-11T22:20:19.848965+0000","last_unstale":"2024-09-11T22:35:51.043068+0000","last_undegraded":"2024-09-11T22:35:51.043068+0000","last_fullsized":"2024-09-11T22:35:51.043068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:10.387663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'17","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.042418+0000","last_change":"2024-09-11T22:20:19.860457+0000","last_active":"2024-09-11T22:35:51.042418+0000","last_peered":"2024-09-11T22:35:51.042418+0000","last_clean":"2024-09-11T22:35:51.042418+0000","last_became_active":"2024-09-11T22:20:19.858887+0000","last_became_peered":"2024-09-11T22:20:19.858887+0000","last_unstale":"2024-09-11T22:35:51.042418+0000","last_undegraded":"2024-09-11T22:35:51.042418+0000","last_fullsized":"2024-09-11T22:35:51.042418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:34.620956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'18","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.062261+0000","last_change":"2024-09-11T22:20:19.862347+0000","last_active":"2024-09-11T22:35:51.062261+0000","last_peered":"2024-09-11T22:35:51.062261+0000","last_clean":"2024-09-11T22:35:51.062261+0000","last_became_active":"2024-09-11T22:20:19.861965+0000","last_became_peered":"2024-09-11T22:20:19.861965+0000","last_unstale":"2024-09-11T22:35:51.062261+0000","last_undegraded":"2024-09-11T22:35:51.062261+0000","last_fullsized":"2024-09-11T22:35:51.062261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'29","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.063182+0000","last_change":"2024-09-11T22:20:19.862065+0000","last_active":"2024-09-11T22:35:51.063182+0000","last_peered":"2024-09-11T22:35:51.063182+0000","last_clean":"2024-09-11T22:35:51.063182+0000","last_became_active":"2024-09-11T22:20:19.861765+0000","last_became_peered":"2024-09-11T22:20:19.861765+0000","last_unstale":"2024-09-11T22:35:51.063182+0000","last_undegraded":"2024-09-11T22:35:51.063182+0000","last_fullsized":"2024-09-11T22:35:51.063182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'27","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.062819+0000","last_change":"2024-09-11T22:20:19.865064+0000","last_active":"2024-09-11T22:35:51.062819+0000","last_peered":"2024-09-11T22:35:51.062819+0000","last_clean":"2024-09-11T22:35:51.062819+0000","last_became_active":"2024-09-11T22:20:19.864697+0000","last_became_peered":"2024-09-11T22:20:19.864697+0000","last_unstale":"2024-09-11T22:35:51.062819+0000","last_undegraded":"2024-09-11T22:35:51.062819+0000","last_fullsized":"2024-09-11T22:35:51.062819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'14","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.060918+0000","last_change":"2024-09-11T22:20:19.861293+0000","last_active":"2024-09-11T22:35:51.060918+0000","last_peered":"2024-09-11T22:35:51.060918+0000","last_clean":"2024-09-11T22:35:51.060918+0000","last_became_active":"2024-09-11T22:20:19.861013+0000","last_became_peered":"2024-09-11T22:20:19.861013+0000","last_unstale":"2024-09-11T22:35:51.060918+0000","last_undegraded":"2024-09-11T22:35:51.060918+0000","last_fullsized":"2024-09-11T22:35:51.060918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:13.178404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'14","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.060763+0000","last_change":"2024-09-11T22:20:19.858131+0000","last_active":"2024-09-11T22:35:51.060763+0000","last_peered":"2024-09-11T22:35:51.060763+0000","last_clean":"2024-09-11T22:35:51.060763+0000","last_became_active":"2024-09-11T22:20:19.857842+0000","last_became_peered":"2024-09-11T22:20:19.857842+0000","last_unstale":"2024-09-11T22:35:51.060763+0000","last_undegraded":"2024-09-11T22:35:51.060763+0000","last_fullsized":"2024-09-11T22:35:51.060763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'16","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.060898+0000","last_change":"2024-09-11T22:20:19.859667+0000","last_active":"2024-09-11T22:35:51.060898+0000","last_peered":"2024-09-11T22:35:51.060898+0000","last_clean":"2024-09-11T22:35:51.060898+0000","last_became_active":"2024-09-11T22:20:19.859306+0000","last_became_peered":"2024-09-11T22:20:19.859306+0000","last_unstale":"2024-09-11T22:35:51.060898+0000","last_undegraded":"2024-09-11T22:35:51.060898+0000","last_fullsized":"2024-09-11T22:35:51.060898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'19","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.048851+0000","last_change":"2024-09-11T22:20:19.848821+0000","last_active":"2024-09-11T22:35:51.048851+0000","last_peered":"2024-09-11T22:35:51.048851+0000","last_clean":"2024-09-11T22:35:51.048851+0000","last_became_active":"2024-09-11T22:20:19.848531+0000","last_became_peered":"2024-09-11T22:20:19.848531+0000","last_unstale":"2024-09-11T22:35:51.048851+0000","last_undegraded":"2024-09-11T22:35:51.048851+0000","last_fullsized":"2024-09-11T22:35:51.048851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'15","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.061871+0000","last_change":"2024-09-11T22:20:19.866300+0000","last_active":"2024-09-11T22:35:51.061871+0000","last_peered":"2024-09-11T22:35:51.061871+0000","last_clean":"2024-09-11T22:35:51.061871+0000","last_became_active":"2024-09-11T22:20:19.865939+0000","last_became_peered":"2024-09-11T22:20:19.865939+0000","last_unstale":"2024-09-11T22:35:51.061871+0000","last_undegraded":"2024-09-11T22:35:51.061871+0000","last_fullsized":"2024-09-11T22:35:51.061871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'19","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.042042+0000","last_change":"2024-09-11T22:20:19.858144+0000","last_active":"2024-09-11T22:35:51.042042+0000","last_peered":"2024-09-11T22:35:51.042042+0000","last_clean":"2024-09-11T22:35:51.042042+0000","last_became_active":"2024-09-11T22:20:19.857840+0000","last_became_peered":"2024-09-11T22:20:19.857840+0000","last_unstale":"2024-09-11T22:35:51.042042+0000","last_undegraded":"2024-09-11T22:35:51.042042+0000","last_fullsized":"2024-09-11T22:35:51.042042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:23.801072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'10","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.040742+0000","last_change":"2024-09-11T22:20:19.857378+0000","last_active":"2024-09-11T22:35:51.040742+0000","last_peered":"2024-09-11T22:35:51.040742+0000","last_clean":"2024-09-11T22:35:51.040742+0000","last_became_active":"2024-09-11T22:20:19.857089+0000","last_became_peered":"2024-09-11T22:20:19.857089+0000","last_unstale":"2024-09-11T22:35:51.040742+0000","last_undegraded":"2024-09-11T22:35:51.040742+0000","last_fullsized":"2024-09-11T22:35:51.040742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:29.835695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'16","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.042089+0000","last_change":"2024-09-11T22:21:02.036200+0000","last_active":"2024-09-11T22:35:51.042089+0000","last_peered":"2024-09-11T22:35:51.042089+0000","last_clean":"2024-09-11T22:35:51.042089+0000","last_became_active":"2024-09-11T22:21:02.035889+0000","last_became_peered":"2024-09-11T22:21:02.035889+0000","last_unstale":"2024-09-11T22:35:51.042089+0000","last_undegraded":"2024-09-11T22:35:51.042089+0000","last_fullsized":"2024-09-11T22:35:51.042089+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":877619,"num_write_kb":16615339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":191481,"ondisk_log_size":191481,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1274,"ondisk_log_size":1274,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":15005355,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":45,"num_read_kb":122,"num_write":3042,"num_write_kb":15742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18276352,"data_stored":30010710,"data_compressed":2661454,"data_compressed_allocated":3686400,"data_compressed_original":15572992,"omap_allocated":0,"internal_metadata":0},"log_size":2691,"ondisk_log_size":2691,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509632,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":969956,"kb_used_data":7316,"kb_used_omap":1,"kb_used_meta":962622,"kb_avail":93401884,"statfs":{"total":96636764160,"available":95643529216,"internally_reserved":0,"allocated":7491584,"data_stored":11425803,"data_compressed":849965,"data_compressed_allocated":1200128,"data_compressed_original":5332992,"omap_allocated":1590,"internal_metadata":985725386},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509633,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1137376,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":1135230,"kb_avail":93234464,"statfs":{"total":96636764160,"available":95472091136,"internally_reserved":0,"allocated":2179072,"data_stored":4317172,"data_compressed":509786,"data_compressed_allocated":684032,"data_compressed_original":3010560,"omap_allocated":1594,"internal_metadata":1162475974},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509634,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":763716,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":763390,"kb_avail":93608124,"statfs":{"total":96636764160,"available":95854718976,"internally_reserved":0,"allocated":315392,"data_stored":122896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":781711813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509632,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1079244,"kb_used_data":3772,"kb_used_omap":1,"kb_used_meta":1075454,"kb_avail":93292596,"statfs":{"total":96636764160,"available":95531618304,"internally_reserved":0,"allocated":3862528,"data_stored":4316536,"data_compressed":162063,"data_compressed_allocated":282624,"data_compressed_original":925696,"omap_allocated":1595,"internal_metadata":1101265349},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509630,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1425948,"kb_used_data":4620,"kb_used_omap":1,"kb_used_meta":1421310,"kb_avail":92945892,"statfs":{"total":96636764160,"available":95176593408,"internally_reserved":0,"allocated":4730880,"data_stored":8606262,"data_compressed":892093,"data_compressed_allocated":1200128,"data_compressed_original":5267456,"omap_allocated":1593,"internal_metadata":1455421895},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542336,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":868180,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":867774,"kb_avail":93503660,"statfs":{"total":96636764160,"available":95747747840,"internally_reserved":0,"allocated":397312,"data_stored":216504,"data_compressed":3390,"data_compressed_allocated":4096,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":888601029},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542336,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1062252,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":1060798,"kb_avail":93309588,"statfs":{"total":96636764160,"available":95549018112,"internally_reserved":0,"allocated":1470464,"data_stored":3035955,"data_compressed":308985,"data_compressed_allocated":405504,"data_compressed_original":2166784,"omap_allocated":1595,"internal_metadata":1086257605},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575040,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1374984,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":1374654,"kb_avail":92996856,"statfs":{"total":96636764160,"available":95228780544,"internally_reserved":0,"allocated":319488,"data_stored":122462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1407646149},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1110016,"data_stored":2324069,"data_compressed":276571,"data_compressed_allocated":360448,"data_compressed_original":1593344,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":94986,"data_compressed":3390,"data_compressed_allocated":4096,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4435968,"data_stored":8484744,"data_compressed":892093,"data_compressed_allocated":1200128,"data_compressed_original":5267456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3567616,"data_stored":4195018,"data_compressed":162063,"data_compressed_allocated":282624,"data_compressed_original":925696,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1884160,"data_stored":4195654,"data_compressed":509786,"data_compressed_allocated":684032,"data_compressed_original":3010560,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7131136,"data_stored":10713917,"data_compressed":817551,"data_compressed_allocated":1155072,"data_compressed_original":4759552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:35:58.728 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:35:58.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.863+0000 7f2368d6d640 1 Processor -- start 2024-09-11T22:35:58.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.863+0000 7f2368d6d640 1 -- start start 2024-09-11T22:35:58.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.864+0000 7f2368d6d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f236406d150 0x7f2364072840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:58.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.864+0000 7f2368d6d640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23640c9190 con 0x7f2364154b00 2024-09-11T22:35:58.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.864+0000 7f2368d6d640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23640c9470 con 0x7f23640c89a0 2024-09-11T22:35:58.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.864+0000 7f2368d6d640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f23640739d0 con 0x7f236406d150 2024-09-11T22:35:58.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.864+0000 7f2361d9b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f236406d150 0x7f2364072840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:58.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.864+0000 7f236259c640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2364154b00 0x7f236415e840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55512/0 (socket says 172.21.15.100:55512) 2024-09-11T22:35:58.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.864+0000 7f2361d9b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f236406d150 0x7f2364072840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46744/0 (socket says 172.21.15.100:46744) 2024-09-11T22:35:58.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.864+0000 7f236259c640 1 -- 172.21.15.100:0/1521294970 learned_addr learned my addr 172.21.15.100:0/1521294970 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:35:58.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.864+0000 7f2361d9b640 1 -- 172.21.15.100:0/1521294970 >> v1:172.21.15.167:6789/0 conn(0x7f23640c89a0 legacy=0x7f2364067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:35:58.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.864+0000 7f2361d9b640 1 -- 172.21.15.100:0/1521294970 >> v1:172.21.15.100:6789/0 conn(0x7f2364154b00 legacy=0x7f236415e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:58.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.864+0000 7f236159a640 1 -- 172.21.15.100:0/1521294970 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1227493194 0 0) 0x7f23640c9190 con 0x7f2364154b00 2024-09-11T22:35:58.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.864+0000 7f2361d9b640 1 -- 172.21.15.100:0/1521294970 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236406c670 con 0x7f236406d150 2024-09-11T22:35:58.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.865+0000 7f2361d9b640 1 --2- 172.21.15.100:0/1521294970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f236406d150 0x7f2364072840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f23580097a0 tx=0x7f235802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c26b8fe53de105f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:58.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.865+0000 7f236159a640 1 -- 172.21.15.100:0/1521294970 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2358037070 con 0x7f236406d150 2024-09-11T22:35:58.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.865+0000 7f236159a640 1 -- 172.21.15.100:0/1521294970 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2358032440 con 0x7f236406d150 2024-09-11T22:35:58.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.865+0000 7f236159a640 1 -- 172.21.15.100:0/1521294970 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2358032810 con 0x7f236406d150 2024-09-11T22:35:58.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.866+0000 7f2368d6d640 1 -- 172.21.15.100:0/1521294970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f236406d150 msgr2=0x7f2364072840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:58.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.866+0000 7f2368d6d640 1 --2- 172.21.15.100:0/1521294970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f236406d150 0x7f2364072840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f23580097a0 tx=0x7f235802a270 comp rx=0 tx=0).stop 2024-09-11T22:35:58.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.866+0000 7f2368d6d640 1 -- 172.21.15.100:0/1521294970 shutdown_connections 2024-09-11T22:35:58.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.866+0000 7f2368d6d640 1 --2- 172.21.15.100:0/1521294970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f236406d150 0x7f2364072840 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:58.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.866+0000 7f2368d6d640 1 -- 172.21.15.100:0/1521294970 >> 172.21.15.100:0/1521294970 conn(0x7f23640cd200 msgr2=0x7f23640cd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:58.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.866+0000 7f2368d6d640 1 -- 172.21.15.100:0/1521294970 shutdown_connections 2024-09-11T22:35:58.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.866+0000 7f2368d6d640 1 -- 172.21.15.100:0/1521294970 wait complete. 2024-09-11T22:35:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.867+0000 7f2368d6d640 1 Processor -- start 2024-09-11T22:35:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.867+0000 7f2368d6d640 1 -- start start 2024-09-11T22:35:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.868+0000 7f2368d6d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f236406d150 0x7f23641f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.868+0000 7f2368d6d640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23640c89a0 0x7f23641f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.868+0000 7f2368d6d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2364154b00 0x7f2364152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.868+0000 7f2368d6d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f23640c8510 con 0x7f2364154b00 2024-09-11T22:35:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.868+0000 7f2368d6d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f236406cc30 con 0x7f236406d150 2024-09-11T22:35:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.868+0000 7f2368d6d640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f23640c8e30 con 0x7f23640c89a0 2024-09-11T22:35:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.868+0000 7f2362d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2364154b00 0x7f2364152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:58.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.868+0000 7f2362d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2364154b00 0x7f2364152a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46752/0 (socket says 172.21.15.100:46752) 2024-09-11T22:35:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.868+0000 7f2362d9d640 1 -- 172.21.15.100:0/3707755485 learned_addr learned my addr 172.21.15.100:0/3707755485 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:35:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.868+0000 7f2361d9b640 1 --2- 172.21.15.100:0/3707755485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23640c89a0 0x7f23641f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.868+0000 7f236259c640 1 --2- 172.21.15.100:0/3707755485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f236406d150 0x7f23641f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.868+0000 7f2362d9d640 1 -- 172.21.15.100:0/3707755485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23640c89a0 msgr2=0x7f23641f2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.868+0000 7f2362d9d640 1 --2- 172.21.15.100:0/3707755485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23640c89a0 0x7f23641f2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.868+0000 7f2362d9d640 1 -- 172.21.15.100:0/3707755485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f236406d150 msgr2=0x7f23641f2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.868+0000 7f2362d9d640 1 --2- 172.21.15.100:0/3707755485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f236406d150 0x7f23641f2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.868+0000 7f2362d9d640 1 -- 172.21.15.100:0/3707755485 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23640c2960 con 0x7f2364154b00 2024-09-11T22:35:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.868+0000 7f2361d9b640 1 --2- 172.21.15.100:0/3707755485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23640c89a0 0x7f23641f2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:35:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.868+0000 7f2362d9d640 1 --2- 172.21.15.100:0/3707755485 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2364154b00 0x7f2364152a90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f235c00c780 tx=0x7f235c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.869+0000 7f2352ffd640 1 -- 172.21.15.100:0/3707755485 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c004b60 con 0x7f2364154b00 2024-09-11T22:35:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.869+0000 7f2352ffd640 1 -- 172.21.15.100:0/3707755485 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f235c004d00 con 0x7f2364154b00 2024-09-11T22:35:58.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.869+0000 7f2368d6d640 1 -- 172.21.15.100:0/3707755485 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23640b21e0 con 0x7f2364154b00 2024-09-11T22:35:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.869+0000 7f2352ffd640 1 -- 172.21.15.100:0/3707755485 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c00aa90 con 0x7f2364154b00 2024-09-11T22:35:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.869+0000 7f2368d6d640 1 -- 172.21.15.100:0/3707755485 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23640b24a0 con 0x7f2364154b00 2024-09-11T22:35:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.870+0000 7f2368d6d640 1 -- 172.21.15.100:0/3707755485 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23640c9190 con 0x7f2364154b00 2024-09-11T22:35:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.870+0000 7f2352ffd640 1 -- 172.21.15.100:0/3707755485 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f235c00ac30 con 0x7f2364154b00 2024-09-11T22:35:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.871+0000 7f2352ffd640 1 --2- 172.21.15.100:0/3707755485 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f234406be30 0x7f234406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:35:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.871+0000 7f2352ffd640 1 -- 172.21.15.100:0/3707755485 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f235c08b710 con 0x7f2364154b00 2024-09-11T22:35:58.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.871+0000 7f236259c640 1 --2- 172.21.15.100:0/3707755485 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f234406be30 0x7f234406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:35:58.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.871+0000 7f236259c640 1 --2- 172.21.15.100:0/3707755485 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f234406be30 0x7f234406e2f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2354007fd0 tx=0x7f2354007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:35:58.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:58.879+0000 7f2352ffd640 1 -- 172.21.15.100:0/3707755485 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f23640c9190 con 0x7f2364154b00 2024-09-11T22:35:59.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:59.051+0000 7f2368d6d640 1 -- 172.21.15.100:0/3707755485 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2364154ee0 con 0x7f2364154b00 2024-09-11T22:35:59.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:59.053+0000 7f2352ffd640 1 -- 172.21.15.100:0/3707755485 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+19082 (secure 0 0 0) 0x7f235c059ca0 con 0x7f2364154b00 2024-09-11T22:35:59.054 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:35:59.054 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","created":"2024-09-11T22:19:56.198855+0000","modified":"2024-09-11T22:21:02.021308+0000","last_up_change":"2024-09-11T22:20:07.328863+0000","last_in_change":"2024-09-11T22:19:58.294227+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:20:08.333538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:20:16.995279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:20:18.147950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:20:21.873694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5de0ba54-34c5-4343-b19a-1f675efc49c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6809","nonce":2008454847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6811","nonce":2008454847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6815","nonce":2008454847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6813","nonce":2008454847}]},"public_addr":"172.21.15.100:6809/2008454847","cluster_addr":"172.21.15.100:6811/2008454847","heartbeat_back_addr":"172.21.15.100:6815/2008454847","heartbeat_front_addr":"172.21.15.100:6813/2008454847","state":["exists","up"]},{"osd":1,"uuid":"5a1f6456-6604-4b41-b9b9-52ae8d6616ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6801","nonce":1802107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6803","nonce":1802107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6807","nonce":1802107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6805","nonce":1802107101}]},"public_addr":"172.21.15.100:6801/1802107101","cluster_addr":"172.21.15.100:6803/1802107101","heartbeat_back_addr":"172.21.15.100:6807/1802107101","heartbeat_front_addr":"172.21.15.100:6805/1802107101","state":["exists","up"]},{"osd":2,"uuid":"a604cb26-7b0f-402d-b6ac-3652884b4b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6817","nonce":644491349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6819","nonce":644491349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6823","nonce":644491349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6821","nonce":644491349}]},"public_addr":"172.21.15.100:6817/644491349","cluster_addr":"172.21.15.100:6819/644491349","heartbeat_back_addr":"172.21.15.100:6823/644491349","heartbeat_front_addr":"172.21.15.100:6821/644491349","state":["exists","up"]},{"osd":3,"uuid":"73dc2cbb-70ff-4d12-ba2f-8778a49892f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6825","nonce":2519160882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6827","nonce":2519160882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6831","nonce":2519160882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6829","nonce":2519160882}]},"public_addr":"172.21.15.100:6825/2519160882","cluster_addr":"172.21.15.100:6827/2519160882","heartbeat_back_addr":"172.21.15.100:6831/2519160882","heartbeat_front_addr":"172.21.15.100:6829/2519160882","state":["exists","up"]},{"osd":4,"uuid":"07960648-04df-4aec-a72c-c29e28b74bcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6817","nonce":736010951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6819","nonce":736010951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6823","nonce":736010951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6821","nonce":736010951}]},"public_addr":"172.21.15.167:6817/736010951","cluster_addr":"172.21.15.167:6819/736010951","heartbeat_back_addr":"172.21.15.167:6823/736010951","heartbeat_front_addr":"172.21.15.167:6821/736010951","state":["exists","up"]},{"osd":5,"uuid":"2b4767e6-cab7-4b45-9150-55432f5576aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6825","nonce":2479173909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6827","nonce":2479173909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6831","nonce":2479173909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6829","nonce":2479173909}]},"public_addr":"172.21.15.167:6825/2479173909","cluster_addr":"172.21.15.167:6827/2479173909","heartbeat_back_addr":"172.21.15.167:6831/2479173909","heartbeat_front_addr":"172.21.15.167:6829/2479173909","state":["exists","up"]},{"osd":6,"uuid":"4ef2c4b5-52f4-4f69-8fca-2334077ed8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6809","nonce":2825112504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6811","nonce":2825112504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6815","nonce":2825112504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6813","nonce":2825112504}]},"public_addr":"172.21.15.167:6809/2825112504","cluster_addr":"172.21.15.167:6811/2825112504","heartbeat_back_addr":"172.21.15.167:6815/2825112504","heartbeat_front_addr":"172.21.15.167:6813/2825112504","state":["exists","up"]},{"osd":7,"uuid":"761673d8-d6fc-4ded-a9f3-d49ab8f7c969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337015843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337015843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337015843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337015843}]},"public_addr":"172.21.15.167:6801/1337015843","cluster_addr":"172.21.15.167:6803/1337015843","heartbeat_back_addr":"172.21.15.167:6807/1337015843","heartbeat_front_addr":"172.21.15.167:6805/1337015843","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.833280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.080311+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.100648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.544261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.670353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.880921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.365441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.366659+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:35:59.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:59.055+0000 7f2368d6d640 1 -- 172.21.15.100:0/3707755485 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f234406be30 msgr2=0x7f234406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:59.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:59.055+0000 7f2368d6d640 1 --2- 172.21.15.100:0/3707755485 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f234406be30 0x7f234406e2f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2354007fd0 tx=0x7f2354007de0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:59.055+0000 7f2368d6d640 1 -- 172.21.15.100:0/3707755485 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2364154b00 msgr2=0x7f2364152a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:35:59.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:59.055+0000 7f2368d6d640 1 --2- 172.21.15.100:0/3707755485 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2364154b00 0x7f2364152a90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f235c00c780 tx=0x7f235c00cc40 comp rx=0 tx=0).stop 2024-09-11T22:35:59.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:59.055+0000 7f2368d6d640 1 -- 172.21.15.100:0/3707755485 shutdown_connections 2024-09-11T22:35:59.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:59.055+0000 7f2368d6d640 1 --2- 172.21.15.100:0/3707755485 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f234406be30 0x7f234406e2f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:59.055+0000 7f2368d6d640 1 --2- 172.21.15.100:0/3707755485 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2364154b00 0x7f2364152a90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:59.055+0000 7f2368d6d640 1 --2- 172.21.15.100:0/3707755485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f23640c89a0 0x7f23641f2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:59.055+0000 7f2368d6d640 1 --2- 172.21.15.100:0/3707755485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f236406d150 0x7f23641f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:35:59.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:59.055+0000 7f2368d6d640 1 -- 172.21.15.100:0/3707755485 >> 172.21.15.100:0/3707755485 conn(0x7f23640cd200 msgr2=0x7f23640cd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:35:59.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:59.055+0000 7f2368d6d640 1 -- 172.21.15.100:0/3707755485 shutdown_connections 2024-09-11T22:35:59.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:35:59.055+0000 7f2368d6d640 1 -- 172.21.15.100:0/3707755485 wait complete. 2024-09-11T22:36:00.068 INFO:tasks.ceph:Scrubbing osd.0 2024-09-11T22:36:00.068 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-11T22:36:00.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.172+0000 7f996aee6640 1 Processor -- start 2024-09-11T22:36:00.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.172+0000 7f996aee6640 1 -- start start 2024-09-11T22:36:00.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.173+0000 7f996aee6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f99640cc770 0x7f99640cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.173+0000 7f996aee6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f99640cb920 0x7f996415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.173+0000 7f996aee6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99640c5d80 con 0x7f9964154d20 2024-09-11T22:36:00.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.173+0000 7f996aee6640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f996415ebe0 con 0x7f99640cb920 2024-09-11T22:36:00.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.173+0000 7f996aee6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f9964155100 con 0x7f99640cc770 2024-09-11T22:36:00.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.173+0000 7f9969483640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f99640cb920 0x7f996415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.173+0000 7f9969483640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f99640cb920 0x7f996415aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46768/0 (socket says 172.21.15.100:46768) 2024-09-11T22:36:00.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.173+0000 7f9969483640 1 -- 172.21.15.100:0/333859304 learned_addr learned my addr 172.21.15.100:0/333859304 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:00.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.174+0000 7f9963fff640 1 --2- 172.21.15.100:0/333859304 >> v2:172.21.15.167:3300/0 conn(0x7f99640cc770 0x7f99640cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.174+0000 7f9969483640 1 -- 172.21.15.100:0/333859304 >> v2:172.21.15.167:3300/0 conn(0x7f99640cc770 msgr2=0x7f99640cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:00.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.174+0000 7f9969483640 1 --2- 172.21.15.100:0/333859304 >> v2:172.21.15.167:3300/0 conn(0x7f99640cc770 0x7f99640cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.174+0000 7f9969483640 1 -- 172.21.15.100:0/333859304 >> v1:172.21.15.167:6789/0 conn(0x7f9964154d20 legacy=0x7f9964072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:00.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.174+0000 7f9969483640 1 -- 172.21.15.100:0/333859304 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996415dfd0 con 0x7f99640cb920 2024-09-11T22:36:00.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.175+0000 7f9969483640 1 --2- 172.21.15.100:0/333859304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99640cb920 0x7f996415aaa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f99640ca980 tx=0x7f994c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d078c4e10fab725e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:00.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.175+0000 7f99637fe640 1 -- 172.21.15.100:0/333859304 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c037070 con 0x7f99640cb920 2024-09-11T22:36:00.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.175+0000 7f99637fe640 1 -- 172.21.15.100:0/333859304 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994c032440 con 0x7f99640cb920 2024-09-11T22:36:00.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.175+0000 7f99637fe640 1 -- 172.21.15.100:0/333859304 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c032810 con 0x7f99640cb920 2024-09-11T22:36:00.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.176+0000 7f996aee6640 1 -- 172.21.15.100:0/333859304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99640cb920 msgr2=0x7f996415aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.176+0000 7f996aee6640 1 --2- 172.21.15.100:0/333859304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99640cb920 0x7f996415aaa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f99640ca980 tx=0x7f994c02a1a0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.176+0000 7f996aee6640 1 -- 172.21.15.100:0/333859304 shutdown_connections 2024-09-11T22:36:00.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.176+0000 7f996aee6640 1 --2- 172.21.15.100:0/333859304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99640cb920 0x7f996415aaa0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.176+0000 7f996aee6640 1 --2- 172.21.15.100:0/333859304 >> v2:172.21.15.167:3300/0 conn(0x7f99640cc770 0x7f99640cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.176+0000 7f996aee6640 1 -- 172.21.15.100:0/333859304 >> 172.21.15.100:0/333859304 conn(0x7f99640d0380 msgr2=0x7f99640d0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.176+0000 7f996aee6640 1 -- 172.21.15.100:0/333859304 shutdown_connections 2024-09-11T22:36:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.176+0000 7f996aee6640 1 -- 172.21.15.100:0/333859304 wait complete. 2024-09-11T22:36:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.177+0000 7f996aee6640 1 Processor -- start 2024-09-11T22:36:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.177+0000 7f996aee6640 1 -- start start 2024-09-11T22:36:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.178+0000 7f996aee6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99640cb920 0x7f99640ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.178+0000 7f996aee6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99640cc770 0x7f99641576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.178+0000 7f996aee6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9964154d20 0x7f99641f0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.178+0000 7f996aee6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f996415e870 con 0x7f99640cb920 2024-09-11T22:36:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.178+0000 7f996aee6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f996415e590 con 0x7f9964154d20 2024-09-11T22:36:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.178+0000 7f996aee6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f9964072940 con 0x7f99640cc770 2024-09-11T22:36:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.178+0000 7f9968c82640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99640cb920 0x7f99640ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.178+0000 7f9968c82640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99640cb920 0x7f99640ca210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46782/0 (socket says 172.21.15.100:46782) 2024-09-11T22:36:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.178+0000 7f9968c82640 1 -- 172.21.15.100:0/2752052782 learned_addr learned my addr 172.21.15.100:0/2752052782 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.178+0000 7f9969483640 1 --2- 172.21.15.100:0/2752052782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9964154d20 0x7f99641f0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.178+0000 7f9963fff640 1 --2- 172.21.15.100:0/2752052782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99640cc770 0x7f99641576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.178+0000 7f9968c82640 1 -- 172.21.15.100:0/2752052782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99640cc770 msgr2=0x7f99641576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.178+0000 7f9968c82640 1 --2- 172.21.15.100:0/2752052782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99640cc770 0x7f99641576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.178+0000 7f9968c82640 1 -- 172.21.15.100:0/2752052782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9964154d20 msgr2=0x7f99641f0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.178+0000 7f9968c82640 1 --2- 172.21.15.100:0/2752052782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9964154d20 0x7f99641f0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.178+0000 7f9968c82640 1 -- 172.21.15.100:0/2752052782 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99640c76c0 con 0x7f99640cb920 2024-09-11T22:36:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.178+0000 7f9969483640 1 --2- 172.21.15.100:0/2752052782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9964154d20 0x7f99641f0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.178+0000 7f9968c82640 1 --2- 172.21.15.100:0/2752052782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99640cb920 0x7f99640ca210 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f995c00c430 tx=0x7f995c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.178+0000 7f99617fa640 1 -- 172.21.15.100:0/2752052782 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c011790 con 0x7f99640cb920 2024-09-11T22:36:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.178+0000 7f99617fa640 1 -- 172.21.15.100:0/2752052782 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995c017070 con 0x7f99640cb920 2024-09-11T22:36:00.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.178+0000 7f99617fa640 1 -- 172.21.15.100:0/2752052782 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c011bb0 con 0x7f99640cb920 2024-09-11T22:36:00.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.178+0000 7f996aee6640 1 -- 172.21.15.100:0/2752052782 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9964158650 con 0x7f99640cb920 2024-09-11T22:36:00.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.179+0000 7f996aee6640 1 -- 172.21.15.100:0/2752052782 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99641588f0 con 0x7f99640cb920 2024-09-11T22:36:00.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.180+0000 7f996aee6640 1 -- 172.21.15.100:0/2752052782 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f99640cb300 con 0x7f99640cb920 2024-09-11T22:36:00.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.180+0000 7f99617fa640 1 -- 172.21.15.100:0/2752052782 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f995c01c460 con 0x7f99640cb920 2024-09-11T22:36:00.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.180+0000 7f99617fa640 1 --2- 172.21.15.100:0/2752052782 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f994406be30 0x7f994406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.180+0000 7f99617fa640 1 -- 172.21.15.100:0/2752052782 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f995c08b160 con 0x7f99640cb920 2024-09-11T22:36:00.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.180+0000 7f9963fff640 1 --2- 172.21.15.100:0/2752052782 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f994406be30 0x7f994406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.181+0000 7f99617fa640 1 --2- 172.21.15.100:0/2752052782 >> [v2:172.21.15.100:6808/2008454847,v1:172.21.15.100:6809/2008454847] conn(0x7f99440758d0 0x7f9944077d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.181+0000 7f99617fa640 1 -- 172.21.15.100:0/2752052782 --> [v2:172.21.15.100:6808/2008454847,v1:172.21.15.100:6809/2008454847] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f995c00ae50 con 0x7f99440758d0 2024-09-11T22:36:00.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.181+0000 7f99617fa640 1 -- 172.21.15.100:0/2752052782 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f995c092050 con 0x7f99640cb920 2024-09-11T22:36:00.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.181+0000 7f9969483640 1 --2- 172.21.15.100:0/2752052782 >> [v2:172.21.15.100:6808/2008454847,v1:172.21.15.100:6809/2008454847] conn(0x7f99440758d0 0x7f9944077d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.181+0000 7f9963fff640 1 --2- 172.21.15.100:0/2752052782 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f994406be30 0x7f994406e2f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f99640b45c0 tx=0x7f99540098d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:00.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.181+0000 7f9969483640 1 --2- 172.21.15.100:0/2752052782 >> [v2:172.21.15.100:6808/2008454847,v1:172.21.15.100:6809/2008454847] conn(0x7f99440758d0 0x7f9944077d70 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:00.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.182+0000 7f99617fa640 1 -- 172.21.15.100:0/2752052782 <== osd.0 v2:172.21.15.100:6808/2008454847 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f995c00ae50 con 0x7f99440758d0 2024-09-11T22:36:00.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.195+0000 7f996aee6640 1 -- 172.21.15.100:0/2752052782 --> [v2:172.21.15.100:6808/2008454847,v1:172.21.15.100:6809/2008454847] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f99640cbed0 con 0x7f99440758d0 2024-09-11T22:36:00.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.195+0000 7f99617fa640 1 -- 172.21.15.100:0/2752052782 <== osd.0 v2:172.21.15.100:6808/2008454847 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f99640cbed0 con 0x7f99440758d0 2024-09-11T22:36:00.196 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:36:00.196 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T22:36:00.196 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:36:00.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.195+0000 7f996aee6640 1 -- 172.21.15.100:0/2752052782 >> [v2:172.21.15.100:6808/2008454847,v1:172.21.15.100:6809/2008454847] conn(0x7f99440758d0 msgr2=0x7f9944077d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.195+0000 7f996aee6640 1 --2- 172.21.15.100:0/2752052782 >> [v2:172.21.15.100:6808/2008454847,v1:172.21.15.100:6809/2008454847] conn(0x7f99440758d0 0x7f9944077d70 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.195+0000 7f996aee6640 1 -- 172.21.15.100:0/2752052782 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f994406be30 msgr2=0x7f994406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.195+0000 7f996aee6640 1 --2- 172.21.15.100:0/2752052782 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f994406be30 0x7f994406e2f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f99640b45c0 tx=0x7f99540098d0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.195+0000 7f996aee6640 1 -- 172.21.15.100:0/2752052782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99640cb920 msgr2=0x7f99640ca210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.195+0000 7f996aee6640 1 --2- 172.21.15.100:0/2752052782 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99640cb920 0x7f99640ca210 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f995c00c430 tx=0x7f995c00c8f0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.195+0000 7f9969483640 1 -- 172.21.15.100:0/2752052782 reap_dead start 2024-09-11T22:36:00.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.195+0000 7f996aee6640 1 -- 172.21.15.100:0/2752052782 shutdown_connections 2024-09-11T22:36:00.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.195+0000 7f996aee6640 1 -- 172.21.15.100:0/2752052782 >> 172.21.15.100:0/2752052782 conn(0x7f99640d0380 msgr2=0x7f99640ce790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:00.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.195+0000 7f996aee6640 1 -- 172.21.15.100:0/2752052782 shutdown_connections 2024-09-11T22:36:00.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.195+0000 7f996aee6640 1 -- 172.21.15.100:0/2752052782 wait complete. 2024-09-11T22:36:00.207 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-11T22:36:00.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.307+0000 7f8ac8d49640 1 Processor -- start 2024-09-11T22:36:00.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.307+0000 7f8ac8d49640 1 -- start start 2024-09-11T22:36:00.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.308+0000 7f8ac8d49640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ac4154d50 0x7f8ac40caf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.308+0000 7f8ac8d49640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8ac406d890 0x7f8ac40cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.308+0000 7f8ac8d49640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ac415e930 con 0x7f8ac40ca750 2024-09-11T22:36:00.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.308+0000 7f8ac8d49640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f8ac406ffc0 con 0x7f8ac406d890 2024-09-11T22:36:00.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.308+0000 7f8ac8d49640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac40ca380 con 0x7f8ac4154d50 2024-09-11T22:36:00.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.309+0000 7f8ac2d9d640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f8ac40ca750 0x7f8ac415ad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55514/0 (socket says 172.21.15.100:55514) 2024-09-11T22:36:00.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.309+0000 7f8ac2d9d640 1 -- 172.21.15.100:0/2237106741 learned_addr learned my addr 172.21.15.100:0/2237106741 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:36:00.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.309+0000 7f8ac259c640 1 --2- 172.21.15.100:0/2237106741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ac4154d50 0x7f8ac40caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.309+0000 7f8ac1d9b640 1 --2- 172.21.15.100:0/2237106741 >> v2:172.21.15.167:3300/0 conn(0x7f8ac406d890 0x7f8ac40cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.309+0000 7f8ac159a640 1 -- 172.21.15.100:0/2237106741 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2577966161 0 0) 0x7f8ac415e930 con 0x7f8ac40ca750 2024-09-11T22:36:00.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.309+0000 7f8ac159a640 1 -- 172.21.15.100:0/2237106741 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ab0003520 con 0x7f8ac40ca750 2024-09-11T22:36:00.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.309+0000 7f8ac159a640 1 -- 172.21.15.100:0/2237106741 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 63428842 0 0) 0x7f8ab0003520 con 0x7f8ac40ca750 2024-09-11T22:36:00.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.309+0000 7f8ac159a640 1 -- 172.21.15.100:0/2237106741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ac4154d50 msgr2=0x7f8ac40caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:00.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.309+0000 7f8ac159a640 1 --2- 172.21.15.100:0/2237106741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ac4154d50 0x7f8ac40caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.309+0000 7f8ac159a640 1 -- 172.21.15.100:0/2237106741 >> v2:172.21.15.167:3300/0 conn(0x7f8ac406d890 msgr2=0x7f8ac40cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:00.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.309+0000 7f8ac159a640 1 --2- 172.21.15.100:0/2237106741 >> v2:172.21.15.167:3300/0 conn(0x7f8ac406d890 0x7f8ac40cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.309+0000 7f8ac159a640 1 -- 172.21.15.100:0/2237106741 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac4070210 con 0x7f8ac40ca750 2024-09-11T22:36:00.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.309+0000 7f8ac159a640 1 -- 172.21.15.100:0/2237106741 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 631370095 0 0) 0x7f8abc0019f0 con 0x7f8ac40ca750 2024-09-11T22:36:00.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.309+0000 7f8ac159a640 1 -- 172.21.15.100:0/2237106741 >> v1:172.21.15.100:6789/0 conn(0x7f8ac40ca750 legacy=0x7f8ac415ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.309+0000 7f8ac159a640 1 --2- 172.21.15.100:0/2237106741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ac4154d50 0x7f8ab00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.309+0000 7f8ac159a640 1 --2- 172.21.15.100:0/2237106741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ab0003f80 0x7f8ab0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.309+0000 7f8ac159a640 1 --2- 172.21.15.100:0/2237106741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ab0004d40 0x7f8ab00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.309+0000 7f8ac159a640 1 -- 172.21.15.100:0/2237106741 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac406ffc0 con 0x7f8ab0003f80 2024-09-11T22:36:00.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.309+0000 7f8ac159a640 1 -- 172.21.15.100:0/2237106741 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac40ca380 con 0x7f8ab0004d40 2024-09-11T22:36:00.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.309+0000 7f8ac159a640 1 -- 172.21.15.100:0/2237106741 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab000ba70 con 0x7f8ac4154d50 2024-09-11T22:36:00.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.309+0000 7f8ac1d9b640 1 --2- 172.21.15.100:0/2237106741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ab0003f80 0x7f8ab0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.309+0000 7f8ac259c640 1 --2- 172.21.15.100:0/2237106741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ac4154d50 0x7f8ab00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.310+0000 7f8ac2d9d640 1 --2- 172.21.15.100:0/2237106741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ab0004d40 0x7f8ab00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.310+0000 7f8ac1d9b640 1 -- 172.21.15.100:0/2237106741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ac4154d50 msgr2=0x7f8ab00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:00.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.310+0000 7f8ac1d9b640 1 --2- 172.21.15.100:0/2237106741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ac4154d50 0x7f8ab00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.310+0000 7f8ac1d9b640 1 -- 172.21.15.100:0/2237106741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ab0004d40 msgr2=0x7f8ab00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:00.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.310+0000 7f8ac1d9b640 1 --2- 172.21.15.100:0/2237106741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ab0004d40 0x7f8ab00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.310+0000 7f8ac1d9b640 1 -- 172.21.15.100:0/2237106741 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab0003520 con 0x7f8ab0003f80 2024-09-11T22:36:00.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.310+0000 7f8ac1d9b640 1 --2- 172.21.15.100:0/2237106741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ab0003f80 0x7f8ab0004800 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4071050 tx=0x7f8ab0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a68ed1593a747ed server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:00.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.311+0000 7f8ac159a640 1 -- 172.21.15.100:0/2237106741 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4036070 con 0x7f8ab0003f80 2024-09-11T22:36:00.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.311+0000 7f8ac159a640 1 -- 172.21.15.100:0/2237106741 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ab4031400 con 0x7f8ab0003f80 2024-09-11T22:36:00.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.311+0000 7f8ac159a640 1 -- 172.21.15.100:0/2237106741 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4009690 con 0x7f8ab0003f80 2024-09-11T22:36:00.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.311+0000 7f8ac8d49640 1 -- 172.21.15.100:0/2237106741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ab0003f80 msgr2=0x7f8ab0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.311+0000 7f8ac8d49640 1 --2- 172.21.15.100:0/2237106741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ab0003f80 0x7f8ab0004800 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4071050 tx=0x7f8ab0005830 comp rx=0 tx=0).stop 2024-09-11T22:36:00.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.311+0000 7f8ac2d9d640 1 -- 172.21.15.100:0/2237106741 reap_dead start 2024-09-11T22:36:00.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.311+0000 7f8ac8d49640 1 -- 172.21.15.100:0/2237106741 shutdown_connections 2024-09-11T22:36:00.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.311+0000 7f8ac8d49640 1 -- 172.21.15.100:0/2237106741 >> 172.21.15.100:0/2237106741 conn(0x7f8ac406e000 msgr2=0x7f8ac406e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:00.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.311+0000 7f8ac8d49640 1 -- 172.21.15.100:0/2237106741 shutdown_connections 2024-09-11T22:36:00.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.311+0000 7f8ac8d49640 1 -- 172.21.15.100:0/2237106741 wait complete. 2024-09-11T22:36:00.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.313+0000 7f8ac8d49640 1 Processor -- start 2024-09-11T22:36:00.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.313+0000 7f8ac8d49640 1 -- start start 2024-09-11T22:36:00.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.313+0000 7f8ac8d49640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ab0003f80 0x7f8ac41f1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.313+0000 7f8ac8d49640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ac40b06e0 0x7f8ac415a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.313+0000 7f8ac8d49640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ac415a690 0x7f8ac4150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.313+0000 7f8ac8d49640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac415b4a0 con 0x7f8ac415a690 2024-09-11T22:36:00.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.313+0000 7f8ac8d49640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8ac40c8b10 con 0x7f8ac40b06e0 2024-09-11T22:36:00.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.313+0000 7f8ac8d49640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f8ac415b620 con 0x7f8ab0003f80 2024-09-11T22:36:00.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.313+0000 7f8ac2d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ac415a690 0x7f8ac4150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.313+0000 7f8ac2d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ac415a690 0x7f8ac4150980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46804/0 (socket says 172.21.15.100:46804) 2024-09-11T22:36:00.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.313+0000 7f8ac2d9d640 1 -- 172.21.15.100:0/3331111753 learned_addr learned my addr 172.21.15.100:0/3331111753 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:00.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.313+0000 7f8ac259c640 1 --2- 172.21.15.100:0/3331111753 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ab0003f80 0x7f8ac41f1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.313+0000 7f8ac1d9b640 1 --2- 172.21.15.100:0/3331111753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ac40b06e0 0x7f8ac415a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.314+0000 7f8ac2d9d640 1 -- 172.21.15.100:0/3331111753 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ab0003f80 msgr2=0x7f8ac41f1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.314+0000 7f8ac2d9d640 1 --2- 172.21.15.100:0/3331111753 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ab0003f80 0x7f8ac41f1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.314+0000 7f8ac2d9d640 1 -- 172.21.15.100:0/3331111753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ac40b06e0 msgr2=0x7f8ac415a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.314+0000 7f8ac2d9d640 1 --2- 172.21.15.100:0/3331111753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ac40b06e0 0x7f8ac415a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.314+0000 7f8ac2d9d640 1 -- 172.21.15.100:0/3331111753 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ac415ab10 con 0x7f8ac415a690 2024-09-11T22:36:00.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.314+0000 7f8ac2d9d640 1 --2- 172.21.15.100:0/3331111753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ac415a690 0x7f8ac4150980 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40cabe0 tx=0x7f8abc00a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:00.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.314+0000 7f8abaffd640 1 -- 172.21.15.100:0/3331111753 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc00acd0 con 0x7f8ac415a690 2024-09-11T22:36:00.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.314+0000 7f8abaffd640 1 -- 172.21.15.100:0/3331111753 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8abc018070 con 0x7f8ac415a690 2024-09-11T22:36:00.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.314+0000 7f8abaffd640 1 -- 172.21.15.100:0/3331111753 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8abc0135f0 con 0x7f8ac415a690 2024-09-11T22:36:00.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.314+0000 7f8ac8d49640 1 -- 172.21.15.100:0/3331111753 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ac40cd230 con 0x7f8ac415a690 2024-09-11T22:36:00.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.314+0000 7f8ac8d49640 1 -- 172.21.15.100:0/3331111753 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ac40ccf50 con 0x7f8ac415a690 2024-09-11T22:36:00.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.315+0000 7f8ac8d49640 1 -- 172.21.15.100:0/3331111753 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ac40c3320 con 0x7f8ac415a690 2024-09-11T22:36:00.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.316+0000 7f8abaffd640 1 -- 172.21.15.100:0/3331111753 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8abc013790 con 0x7f8ac415a690 2024-09-11T22:36:00.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.316+0000 7f8abaffd640 1 --2- 172.21.15.100:0/3331111753 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8aa406be30 0x7f8aa406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.316+0000 7f8ac259c640 1 --2- 172.21.15.100:0/3331111753 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8aa406be30 0x7f8aa406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.316+0000 7f8abaffd640 1 -- 172.21.15.100:0/3331111753 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f8abc08b6a0 con 0x7f8ac415a690 2024-09-11T22:36:00.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.317+0000 7f8ac259c640 1 --2- 172.21.15.100:0/3331111753 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8aa406be30 0x7f8aa406e2f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009ae0 tx=0x7f8aac009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:00.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.320+0000 7f8abaffd640 1 -- 172.21.15.100:0/3331111753 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ac40c3320 con 0x7f8ac415a690 2024-09-11T22:36:00.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.498+0000 7f8ac8d49640 1 -- 172.21.15.100:0/3331111753 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f8ac40c9680 con 0x7f8aa406be30 2024-09-11T22:36:00.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.498+0000 7f8abaffd640 1 -- 172.21.15.100:0/3331111753 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8ac40c9680 con 0x7f8aa406be30 2024-09-11T22:36:00.499 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 0 to deep-scrub 2024-09-11T22:36:00.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.500+0000 7f8ac8d49640 1 -- 172.21.15.100:0/3331111753 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8aa406be30 msgr2=0x7f8aa406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.500+0000 7f8ac8d49640 1 --2- 172.21.15.100:0/3331111753 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8aa406be30 0x7f8aa406e2f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009ae0 tx=0x7f8aac009190 comp rx=0 tx=0).stop 2024-09-11T22:36:00.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.500+0000 7f8ac8d49640 1 -- 172.21.15.100:0/3331111753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ac415a690 msgr2=0x7f8ac4150980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.500+0000 7f8ac8d49640 1 --2- 172.21.15.100:0/3331111753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ac415a690 0x7f8ac4150980 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40cabe0 tx=0x7f8abc00a6a0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.500+0000 7f8ac8d49640 1 -- 172.21.15.100:0/3331111753 shutdown_connections 2024-09-11T22:36:00.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.500+0000 7f8ac8d49640 1 --2- 172.21.15.100:0/3331111753 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f8aa406be30 0x7f8aa406e2f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.500+0000 7f8ac8d49640 1 --2- 172.21.15.100:0/3331111753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ac415a690 0x7f8ac4150980 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.500+0000 7f8ac8d49640 1 --2- 172.21.15.100:0/3331111753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ac40b06e0 0x7f8ac415a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.500+0000 7f8ac8d49640 1 --2- 172.21.15.100:0/3331111753 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ab0003f80 0x7f8ac41f1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.500+0000 7f8ac8d49640 1 -- 172.21.15.100:0/3331111753 >> 172.21.15.100:0/3331111753 conn(0x7f8ac406e000 msgr2=0x7f8ac40cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:00.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.501+0000 7f8ac8d49640 1 -- 172.21.15.100:0/3331111753 shutdown_connections 2024-09-11T22:36:00.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.501+0000 7f8ac8d49640 1 -- 172.21.15.100:0/3331111753 wait complete. 2024-09-11T22:36:00.513 INFO:tasks.ceph:Scrubbing osd.1 2024-09-11T22:36:00.513 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-11T22:36:00.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.617+0000 7f52e9959640 1 Processor -- start 2024-09-11T22:36:00.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.617+0000 7f52e9959640 1 -- start start 2024-09-11T22:36:00.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.618+0000 7f52e9959640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f52e40cd410 0x7f52e40680a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.618+0000 7f52e9959640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52e406bc10 0x7f52e4154650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.618+0000 7f52e9959640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e40c9150 con 0x7f52e40cd7f0 2024-09-11T22:36:00.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.618+0000 7f52e9959640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f52e40c7dd0 con 0x7f52e40cd410 2024-09-11T22:36:00.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.618+0000 7f52e9959640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f52e40c85d0 con 0x7f52e406bc10 2024-09-11T22:36:00.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.619+0000 7f52e37fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52e406bc10 0x7f52e4154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.619+0000 7f52e2ffd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f52e40cd410 0x7f52e40680a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.619+0000 7f52e37fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52e406bc10 0x7f52e4154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:59090/0 (socket says 172.21.15.100:59090) 2024-09-11T22:36:00.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.619+0000 7f52e37fe640 1 -- 172.21.15.100:0/1790108264 learned_addr learned my addr 172.21.15.100:0/1790108264 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:00.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.619+0000 7f52e37fe640 1 -- 172.21.15.100:0/1790108264 >> v2:172.21.15.167:3300/0 conn(0x7f52e40cd410 msgr2=0x7f52e40680a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:00.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.619+0000 7f52e37fe640 1 --2- 172.21.15.100:0/1790108264 >> v2:172.21.15.167:3300/0 conn(0x7f52e40cd410 0x7f52e40680a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.619+0000 7f52e37fe640 1 -- 172.21.15.100:0/1790108264 >> v1:172.21.15.167:6789/0 conn(0x7f52e40cd7f0 legacy=0x7f52e415afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.619+0000 7f52e37fe640 1 -- 172.21.15.100:0/1790108264 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e40c88b0 con 0x7f52e406bc10 2024-09-11T22:36:00.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.619+0000 7f52e2ffd640 1 --2- 172.21.15.100:0/1790108264 >> v2:172.21.15.167:3300/0 conn(0x7f52e40cd410 0x7f52e40680a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:36:00.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.620+0000 7f52e37fe640 1 --2- 172.21.15.100:0/1790108264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52e406bc10 0x7f52e4154650 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f52dc009e50 tx=0x7f52dc02a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfa70d45a2181e23 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:00.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.620+0000 7f52e27fc640 1 -- 172.21.15.100:0/1790108264 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc036070 con 0x7f52e406bc10 2024-09-11T22:36:00.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.620+0000 7f52e27fc640 1 -- 172.21.15.100:0/1790108264 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52dc031600 con 0x7f52e406bc10 2024-09-11T22:36:00.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.620+0000 7f52e27fc640 1 -- 172.21.15.100:0/1790108264 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc0319d0 con 0x7f52e406bc10 2024-09-11T22:36:00.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.621+0000 7f52e9959640 1 -- 172.21.15.100:0/1790108264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52e406bc10 msgr2=0x7f52e4154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.621+0000 7f52e9959640 1 --2- 172.21.15.100:0/1790108264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52e406bc10 0x7f52e4154650 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f52dc009e50 tx=0x7f52dc02a7a0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.621+0000 7f52e9959640 1 -- 172.21.15.100:0/1790108264 shutdown_connections 2024-09-11T22:36:00.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.621+0000 7f52e9959640 1 --2- 172.21.15.100:0/1790108264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52e406bc10 0x7f52e4154650 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.621+0000 7f52e9959640 1 --2- 172.21.15.100:0/1790108264 >> v2:172.21.15.167:3300/0 conn(0x7f52e40cd410 0x7f52e40680a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.621+0000 7f52e9959640 1 -- 172.21.15.100:0/1790108264 >> 172.21.15.100:0/1790108264 conn(0x7f52e406e670 msgr2=0x7f52e406ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:00.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.621+0000 7f52e9959640 1 -- 172.21.15.100:0/1790108264 shutdown_connections 2024-09-11T22:36:00.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.621+0000 7f52e9959640 1 -- 172.21.15.100:0/1790108264 wait complete. 2024-09-11T22:36:00.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.622+0000 7f52e9959640 1 Processor -- start 2024-09-11T22:36:00.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.622+0000 7f52e9959640 1 -- start start 2024-09-11T22:36:00.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.622+0000 7f52e9959640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52e406bc10 0x7f52e41f0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.622+0000 7f52e9959640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e40cd410 0x7f52e415d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.622+0000 7f52e9959640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52e40cd7f0 0x7f52e4158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.622+0000 7f52e9959640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f52e415b6b0 con 0x7f52e40cd410 2024-09-11T22:36:00.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.622+0000 7f52e9959640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f52e40c8e70 con 0x7f52e406bc10 2024-09-11T22:36:00.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.622+0000 7f52e9959640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f52e415b830 con 0x7f52e40cd7f0 2024-09-11T22:36:00.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.623+0000 7f52dbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e40cd410 0x7f52e415d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.623+0000 7f52dbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e40cd410 0x7f52e415d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46814/0 (socket says 172.21.15.100:46814) 2024-09-11T22:36:00.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.623+0000 7f52e2ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52e406bc10 0x7f52e41f0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.623+0000 7f52dbfff640 1 -- 172.21.15.100:0/59395923 learned_addr learned my addr 172.21.15.100:0/59395923 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:00.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.623+0000 7f52e37fe640 1 --2- 172.21.15.100:0/59395923 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52e40cd7f0 0x7f52e4158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.623+0000 7f52dbfff640 1 -- 172.21.15.100:0/59395923 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52e40cd7f0 msgr2=0x7f52e4158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.623+0000 7f52dbfff640 1 --2- 172.21.15.100:0/59395923 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52e40cd7f0 0x7f52e4158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.623+0000 7f52dbfff640 1 -- 172.21.15.100:0/59395923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52e406bc10 msgr2=0x7f52e41f0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.623+0000 7f52dbfff640 1 --2- 172.21.15.100:0/59395923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52e406bc10 0x7f52e41f0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.623+0000 7f52dbfff640 1 -- 172.21.15.100:0/59395923 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e415a600 con 0x7f52e40cd410 2024-09-11T22:36:00.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.623+0000 7f52e2ffd640 1 --2- 172.21.15.100:0/59395923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52e406bc10 0x7f52e41f0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:36:00.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.623+0000 7f52dbfff640 1 --2- 172.21.15.100:0/59395923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e40cd410 0x7f52e415d290 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00c3c0 tx=0x7f52cc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:00.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.623+0000 7f52e0ff9640 1 -- 172.21.15.100:0/59395923 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc0052d0 con 0x7f52e40cd410 2024-09-11T22:36:00.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.623+0000 7f52e0ff9640 1 -- 172.21.15.100:0/59395923 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52cc005490 con 0x7f52e40cd410 2024-09-11T22:36:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.623+0000 7f52e9959640 1 -- 172.21.15.100:0/59395923 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e4155200 con 0x7f52e40cd410 2024-09-11T22:36:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.623+0000 7f52e0ff9640 1 -- 172.21.15.100:0/59395923 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc007260 con 0x7f52e40cd410 2024-09-11T22:36:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.623+0000 7f52e9959640 1 -- 172.21.15.100:0/59395923 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e41585b0 con 0x7f52e40cd410 2024-09-11T22:36:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.624+0000 7f52e9959640 1 -- 172.21.15.100:0/59395923 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f52e4158990 con 0x7f52e40cd410 2024-09-11T22:36:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.625+0000 7f52e0ff9640 1 -- 172.21.15.100:0/59395923 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f52cc007400 con 0x7f52e40cd410 2024-09-11T22:36:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.625+0000 7f52e0ff9640 1 --2- 172.21.15.100:0/59395923 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f52c406be30 0x7f52c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.626+0000 7f52e0ff9640 1 -- 172.21.15.100:0/59395923 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f52cc08b000 con 0x7f52e40cd410 2024-09-11T22:36:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.626+0000 7f52e2ffd640 1 --2- 172.21.15.100:0/59395923 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f52c406be30 0x7f52c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.626+0000 7f52e0ff9640 1 --2- 172.21.15.100:0/59395923 >> [v2:172.21.15.100:6800/1802107101,v1:172.21.15.100:6801/1802107101] conn(0x7f52c4075840 0x7f52c4077ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.626+0000 7f52e0ff9640 1 -- 172.21.15.100:0/59395923 --> [v2:172.21.15.100:6800/1802107101,v1:172.21.15.100:6801/1802107101] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f52c40783b0 con 0x7f52c4075840 2024-09-11T22:36:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.626+0000 7f52e0ff9640 1 -- 172.21.15.100:0/59395923 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f52cc08b490 con 0x7f52e40cd410 2024-09-11T22:36:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.626+0000 7f52e37fe640 1 --2- 172.21.15.100:0/59395923 >> [v2:172.21.15.100:6800/1802107101,v1:172.21.15.100:6801/1802107101] conn(0x7f52c4075840 0x7f52c4077ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.626+0000 7f52e2ffd640 1 --2- 172.21.15.100:0/59395923 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f52c406be30 0x7f52c406e2f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f52d4009560 tx=0x7f52d4009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.626+0000 7f52e37fe640 1 --2- 172.21.15.100:0/59395923 >> [v2:172.21.15.100:6800/1802107101,v1:172.21.15.100:6801/1802107101] conn(0x7f52c4075840 0x7f52c4077ce0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:00.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.627+0000 7f52e0ff9640 1 -- 172.21.15.100:0/59395923 <== osd.1 v2:172.21.15.100:6800/1802107101 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f52c40783b0 con 0x7f52c4075840 2024-09-11T22:36:00.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.639+0000 7f52e9959640 1 -- 172.21.15.100:0/59395923 --> [v2:172.21.15.100:6800/1802107101,v1:172.21.15.100:6801/1802107101] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f52e415afa0 con 0x7f52c4075840 2024-09-11T22:36:00.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.640+0000 7f52e0ff9640 1 -- 172.21.15.100:0/59395923 <== osd.1 v2:172.21.15.100:6800/1802107101 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f52e415afa0 con 0x7f52c4075840 2024-09-11T22:36:00.641 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:36:00.641 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T22:36:00.641 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:36:00.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.640+0000 7f52e9959640 1 -- 172.21.15.100:0/59395923 >> [v2:172.21.15.100:6800/1802107101,v1:172.21.15.100:6801/1802107101] conn(0x7f52c4075840 msgr2=0x7f52c4077ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.640+0000 7f52e9959640 1 --2- 172.21.15.100:0/59395923 >> [v2:172.21.15.100:6800/1802107101,v1:172.21.15.100:6801/1802107101] conn(0x7f52c4075840 0x7f52c4077ce0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.640+0000 7f52e9959640 1 -- 172.21.15.100:0/59395923 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f52c406be30 msgr2=0x7f52c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.640+0000 7f52e9959640 1 --2- 172.21.15.100:0/59395923 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f52c406be30 0x7f52c406e2f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f52d4009560 tx=0x7f52d4009190 comp rx=0 tx=0).stop 2024-09-11T22:36:00.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.640+0000 7f52e9959640 1 -- 172.21.15.100:0/59395923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e40cd410 msgr2=0x7f52e415d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.640+0000 7f52e9959640 1 --2- 172.21.15.100:0/59395923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52e40cd410 0x7f52e415d290 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00c3c0 tx=0x7f52cc00c880 comp rx=0 tx=0).stop 2024-09-11T22:36:00.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.640+0000 7f52e37fe640 1 -- 172.21.15.100:0/59395923 reap_dead start 2024-09-11T22:36:00.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.640+0000 7f52e9959640 1 -- 172.21.15.100:0/59395923 shutdown_connections 2024-09-11T22:36:00.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.640+0000 7f52e9959640 1 -- 172.21.15.100:0/59395923 >> 172.21.15.100:0/59395923 conn(0x7f52e406e670 msgr2=0x7f52e40c5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:00.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.640+0000 7f52e9959640 1 -- 172.21.15.100:0/59395923 shutdown_connections 2024-09-11T22:36:00.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.640+0000 7f52e9959640 1 -- 172.21.15.100:0/59395923 wait complete. 2024-09-11T22:36:00.652 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-11T22:36:00.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.754+0000 7f59ccc1e640 1 Processor -- start 2024-09-11T22:36:00.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.754+0000 7f59ccc1e640 1 -- start start 2024-09-11T22:36:00.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.755+0000 7f59ccc1e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59c806d240 0x7f59c81546b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.755+0000 7f59ccc1e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f59c815b2e0 0x7f59c8154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.755+0000 7f59ccc1e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59c80c6510 con 0x7f59c806ce60 2024-09-11T22:36:00.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.755+0000 7f59ccc1e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f59c815b820 con 0x7f59c815b2e0 2024-09-11T22:36:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.755+0000 7f59ccc1e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f59c80c5470 con 0x7f59c806d240 2024-09-11T22:36:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.755+0000 7f59c6d9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f59c815b2e0 0x7f59c8154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.755+0000 7f59c659c640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f59c806ce60 0x7f59c815bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55522/0 (socket says 172.21.15.100:55522) 2024-09-11T22:36:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.755+0000 7f59c659c640 1 -- 172.21.15.100:0/2977874257 learned_addr learned my addr 172.21.15.100:0/2977874257 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:36:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.755+0000 7f59c6d9d640 1 -- 172.21.15.100:0/2977874257 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59c806d240 msgr2=0x7f59c81546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.755+0000 7f59c5d9b640 1 --2- 172.21.15.100:0/2977874257 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59c806d240 0x7f59c81546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.755+0000 7f59c6d9d640 1 --2- 172.21.15.100:0/2977874257 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59c806d240 0x7f59c81546b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.755+0000 7f59c6d9d640 1 -- 172.21.15.100:0/2977874257 >> v1:172.21.15.100:6789/0 conn(0x7f59c806ce60 legacy=0x7f59c815bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.755+0000 7f59c6d9d640 1 -- 172.21.15.100:0/2977874257 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c80c5750 con 0x7f59c815b2e0 2024-09-11T22:36:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.755+0000 7f59c559a640 1 -- 172.21.15.100:0/2977874257 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1861423287 0 0) 0x7f59c80c6510 con 0x7f59c806ce60 2024-09-11T22:36:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.756+0000 7f59c6d9d640 1 --2- 172.21.15.100:0/2977874257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59c815b2e0 0x7f59c8154bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009d90 tx=0x7f59c002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e226cb3b3cd07d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:00.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.756+0000 7f59c559a640 1 -- 172.21.15.100:0/2977874257 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0007740 con 0x7f59c815b2e0 2024-09-11T22:36:00.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.756+0000 7f59c559a640 1 -- 172.21.15.100:0/2977874257 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59c00078e0 con 0x7f59c815b2e0 2024-09-11T22:36:00.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.756+0000 7f59c559a640 1 -- 172.21.15.100:0/2977874257 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0007cb0 con 0x7f59c815b2e0 2024-09-11T22:36:00.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.757+0000 7f59ccc1e640 1 -- 172.21.15.100:0/2977874257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59c815b2e0 msgr2=0x7f59c8154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.757+0000 7f59ccc1e640 1 --2- 172.21.15.100:0/2977874257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59c815b2e0 0x7f59c8154bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009d90 tx=0x7f59c002a660 comp rx=0 tx=0).stop 2024-09-11T22:36:00.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.757+0000 7f59ccc1e640 1 -- 172.21.15.100:0/2977874257 shutdown_connections 2024-09-11T22:36:00.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.757+0000 7f59ccc1e640 1 --2- 172.21.15.100:0/2977874257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59c815b2e0 0x7f59c8154bf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.757+0000 7f59ccc1e640 1 --2- 172.21.15.100:0/2977874257 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59c806d240 0x7f59c81546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.757+0000 7f59ccc1e640 1 -- 172.21.15.100:0/2977874257 >> 172.21.15.100:0/2977874257 conn(0x7f59c806bc10 msgr2=0x7f59c806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:00.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.757+0000 7f59ccc1e640 1 -- 172.21.15.100:0/2977874257 shutdown_connections 2024-09-11T22:36:00.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.757+0000 7f59ccc1e640 1 -- 172.21.15.100:0/2977874257 wait complete. 2024-09-11T22:36:00.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.758+0000 7f59ccc1e640 1 Processor -- start 2024-09-11T22:36:00.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.758+0000 7f59ccc1e640 1 -- start start 2024-09-11T22:36:00.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.759+0000 7f59ccc1e640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59c806ce60 0x7f59c8149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.759+0000 7f59ccc1e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59c806d240 0x7f59c80c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.759+0000 7f59ccc1e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59c815b2e0 0x7f59c80c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.759+0000 7f59ccc1e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f59c815c460 con 0x7f59c815b2e0 2024-09-11T22:36:00.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.759+0000 7f59ccc1e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f59c80c5d10 con 0x7f59c806d240 2024-09-11T22:36:00.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.759+0000 7f59ccc1e640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f59c80cb1b0 con 0x7f59c806ce60 2024-09-11T22:36:00.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.759+0000 7f59c6d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59c815b2e0 0x7f59c80c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.759+0000 7f59c6d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59c815b2e0 0x7f59c80c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46834/0 (socket says 172.21.15.100:46834) 2024-09-11T22:36:00.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.759+0000 7f59c6d9d640 1 -- 172.21.15.100:0/2570906319 learned_addr learned my addr 172.21.15.100:0/2570906319 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:00.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.759+0000 7f59c659c640 1 --2- 172.21.15.100:0/2570906319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59c806ce60 0x7f59c8149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.759+0000 7f59c5d9b640 1 --2- 172.21.15.100:0/2570906319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59c806d240 0x7f59c80c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.759+0000 7f59c6d9d640 1 -- 172.21.15.100:0/2570906319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59c806ce60 msgr2=0x7f59c8149560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.759+0000 7f59c6d9d640 1 --2- 172.21.15.100:0/2570906319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59c806ce60 0x7f59c8149560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.759+0000 7f59c6d9d640 1 -- 172.21.15.100:0/2570906319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59c806d240 msgr2=0x7f59c80c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.759+0000 7f59c6d9d640 1 --2- 172.21.15.100:0/2570906319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59c806d240 0x7f59c80c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.759+0000 7f59c6d9d640 1 -- 172.21.15.100:0/2570906319 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c81f0b50 con 0x7f59c815b2e0 2024-09-11T22:36:00.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.759+0000 7f59c659c640 1 --2- 172.21.15.100:0/2570906319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59c806ce60 0x7f59c8149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:36:00.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.759+0000 7f59c5d9b640 1 --2- 172.21.15.100:0/2570906319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59c806d240 0x7f59c80c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:36:00.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.760+0000 7f59c6d9d640 1 --2- 172.21.15.100:0/2570906319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59c815b2e0 0x7f59c80c8ba0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f59c002ac50 tx=0x7f59c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:00.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.760+0000 7f59beffd640 1 -- 172.21.15.100:0/2570906319 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0040070 con 0x7f59c815b2e0 2024-09-11T22:36:00.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.760+0000 7f59beffd640 1 -- 172.21.15.100:0/2570906319 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59c0031c90 con 0x7f59c815b2e0 2024-09-11T22:36:00.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.760+0000 7f59ccc1e640 1 -- 172.21.15.100:0/2570906319 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c80cda20 con 0x7f59c815b2e0 2024-09-11T22:36:00.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.760+0000 7f59beffd640 1 -- 172.21.15.100:0/2570906319 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0045680 con 0x7f59c815b2e0 2024-09-11T22:36:00.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.760+0000 7f59ccc1e640 1 -- 172.21.15.100:0/2570906319 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c80b5720 con 0x7f59c815b2e0 2024-09-11T22:36:00.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.761+0000 7f59ccc1e640 1 -- 172.21.15.100:0/2570906319 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59c81f1050 con 0x7f59c815b2e0 2024-09-11T22:36:00.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.761+0000 7f59beffd640 1 -- 172.21.15.100:0/2570906319 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f59c0039040 con 0x7f59c815b2e0 2024-09-11T22:36:00.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.762+0000 7f59beffd640 1 --2- 172.21.15.100:0/2570906319 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f59a806be30 0x7f59a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:00.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.762+0000 7f59beffd640 1 -- 172.21.15.100:0/2570906319 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f59c00acc10 con 0x7f59c815b2e0 2024-09-11T22:36:00.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.762+0000 7f59c659c640 1 --2- 172.21.15.100:0/2570906319 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f59a806be30 0x7f59a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:00.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.762+0000 7f59c659c640 1 --2- 172.21.15.100:0/2570906319 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f59a806be30 0x7f59a806e2f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f59b8000f60 tx=0x7f59b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:00.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.766+0000 7f59beffd640 1 -- 172.21.15.100:0/2570906319 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f59c81f1050 con 0x7f59c815b2e0 2024-09-11T22:36:00.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.939+0000 7f59ccc1e640 1 -- 172.21.15.100:0/2570906319 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f59c80cad20 con 0x7f59a806be30 2024-09-11T22:36:00.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.939+0000 7f59beffd640 1 -- 172.21.15.100:0/2570906319 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f59c80cad20 con 0x7f59a806be30 2024-09-11T22:36:00.940 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 1 to deep-scrub 2024-09-11T22:36:00.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.941+0000 7f59ccc1e640 1 -- 172.21.15.100:0/2570906319 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f59a806be30 msgr2=0x7f59a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.941+0000 7f59ccc1e640 1 --2- 172.21.15.100:0/2570906319 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f59a806be30 0x7f59a806e2f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f59b8000f60 tx=0x7f59b8009040 comp rx=0 tx=0).stop 2024-09-11T22:36:00.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.941+0000 7f59ccc1e640 1 -- 172.21.15.100:0/2570906319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59c815b2e0 msgr2=0x7f59c80c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:00.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.941+0000 7f59ccc1e640 1 --2- 172.21.15.100:0/2570906319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59c815b2e0 0x7f59c80c8ba0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f59c002ac50 tx=0x7f59c0004a40 comp rx=0 tx=0).stop 2024-09-11T22:36:00.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.942+0000 7f59ccc1e640 1 -- 172.21.15.100:0/2570906319 shutdown_connections 2024-09-11T22:36:00.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.942+0000 7f59ccc1e640 1 --2- 172.21.15.100:0/2570906319 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f59a806be30 0x7f59a806e2f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.942+0000 7f59ccc1e640 1 --2- 172.21.15.100:0/2570906319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59c815b2e0 0x7f59c80c8ba0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.942+0000 7f59ccc1e640 1 --2- 172.21.15.100:0/2570906319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59c806d240 0x7f59c80c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.942+0000 7f59ccc1e640 1 --2- 172.21.15.100:0/2570906319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59c806ce60 0x7f59c8149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:00.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.942+0000 7f59ccc1e640 1 -- 172.21.15.100:0/2570906319 >> 172.21.15.100:0/2570906319 conn(0x7f59c806bc10 msgr2=0x7f59c815d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:00.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.942+0000 7f59ccc1e640 1 -- 172.21.15.100:0/2570906319 shutdown_connections 2024-09-11T22:36:00.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:00.942+0000 7f59ccc1e640 1 -- 172.21.15.100:0/2570906319 wait complete. 2024-09-11T22:36:00.954 INFO:tasks.ceph:Scrubbing osd.2 2024-09-11T22:36:00.954 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-11T22:36:01.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.057+0000 7f21096e4640 1 Processor -- start 2024-09-11T22:36:01.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.057+0000 7f21096e4640 1 -- start start 2024-09-11T22:36:01.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.058+0000 7f21096e4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f210406e140 0x7f2104067950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.058+0000 7f21096e4640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2104067e90 0x7f210415ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.058+0000 7f21096e4640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f210406d100 con 0x7f2104154710 2024-09-11T22:36:01.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.058+0000 7f21096e4640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f210406ced0 con 0x7f2104067e90 2024-09-11T22:36:01.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.058+0000 7f21096e4640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f210406d3c0 con 0x7f210406e140 2024-09-11T22:36:01.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.058+0000 7f21037fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2104067e90 0x7f210415ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.058+0000 7f21037fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2104067e90 0x7f210415ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46844/0 (socket says 172.21.15.100:46844) 2024-09-11T22:36:01.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.058+0000 7f21037fe640 1 -- 172.21.15.100:0/1693582162 learned_addr learned my addr 172.21.15.100:0/1693582162 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:01.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.058+0000 7f21027fc640 1 --2- 172.21.15.100:0/1693582162 >> v2:172.21.15.167:3300/0 conn(0x7f210406e140 0x7f2104067950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.058+0000 7f21037fe640 1 -- 172.21.15.100:0/1693582162 >> v2:172.21.15.167:3300/0 conn(0x7f210406e140 msgr2=0x7f2104067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:01.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.058+0000 7f21037fe640 1 --2- 172.21.15.100:0/1693582162 >> v2:172.21.15.167:3300/0 conn(0x7f210406e140 0x7f2104067950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.058+0000 7f21037fe640 1 -- 172.21.15.100:0/1693582162 >> v1:172.21.15.167:6789/0 conn(0x7f2104154710 legacy=0x7f21040c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.058+0000 7f21037fe640 1 -- 172.21.15.100:0/1693582162 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f210415ab50 con 0x7f2104067e90 2024-09-11T22:36:01.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.059+0000 7f21037fe640 1 --2- 172.21.15.100:0/1693582162 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2104067e90 0x7f210415ddf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f210406ce60 tx=0x7f20fc02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7392f8639dd601b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:01.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.059+0000 7f2101ffb640 1 -- 172.21.15.100:0/1693582162 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20fc036070 con 0x7f2104067e90 2024-09-11T22:36:01.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.059+0000 7f2101ffb640 1 -- 172.21.15.100:0/1693582162 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20fc031600 con 0x7f2104067e90 2024-09-11T22:36:01.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.059+0000 7f2101ffb640 1 -- 172.21.15.100:0/1693582162 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20fc0319f0 con 0x7f2104067e90 2024-09-11T22:36:01.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.060+0000 7f21096e4640 1 -- 172.21.15.100:0/1693582162 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2104067e90 msgr2=0x7f210415ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.060+0000 7f21096e4640 1 --2- 172.21.15.100:0/1693582162 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2104067e90 0x7f210415ddf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f210406ce60 tx=0x7f20fc02a7c0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.060+0000 7f21096e4640 1 -- 172.21.15.100:0/1693582162 shutdown_connections 2024-09-11T22:36:01.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.060+0000 7f21096e4640 1 --2- 172.21.15.100:0/1693582162 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2104067e90 0x7f210415ddf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.060+0000 7f21096e4640 1 --2- 172.21.15.100:0/1693582162 >> v2:172.21.15.167:3300/0 conn(0x7f210406e140 0x7f2104067950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.060+0000 7f21096e4640 1 -- 172.21.15.100:0/1693582162 >> 172.21.15.100:0/1693582162 conn(0x7f2104070b80 msgr2=0x7f21040ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:01.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.060+0000 7f21096e4640 1 -- 172.21.15.100:0/1693582162 shutdown_connections 2024-09-11T22:36:01.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.060+0000 7f21096e4640 1 -- 172.21.15.100:0/1693582162 wait complete. 2024-09-11T22:36:01.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.061+0000 7f21096e4640 1 Processor -- start 2024-09-11T22:36:01.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.061+0000 7f21096e4640 1 -- start start 2024-09-11T22:36:01.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.062+0000 7f21096e4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2104067e90 0x7f21041555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.062+0000 7f21096e4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f210406e140 0x7f21040cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.062+0000 7f21096e4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2104154710 0x7f2104156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.062+0000 7f21096e4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f210415b3f0 con 0x7f2104154710 2024-09-11T22:36:01.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.062+0000 7f21096e4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f210415b110 con 0x7f210406e140 2024-09-11T22:36:01.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.062+0000 7f21096e4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f210415a800 con 0x7f2104067e90 2024-09-11T22:36:01.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.062+0000 7f21037fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2104154710 0x7f2104156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.062+0000 7f21037fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2104154710 0x7f2104156c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46856/0 (socket says 172.21.15.100:46856) 2024-09-11T22:36:01.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.062+0000 7f21037fe640 1 -- 172.21.15.100:0/3539351612 learned_addr learned my addr 172.21.15.100:0/3539351612 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:01.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.062+0000 7f21027fc640 1 --2- 172.21.15.100:0/3539351612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f210406e140 0x7f21040cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.062+0000 7f2102ffd640 1 --2- 172.21.15.100:0/3539351612 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2104067e90 0x7f21041555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.062+0000 7f21037fe640 1 -- 172.21.15.100:0/3539351612 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2104067e90 msgr2=0x7f21041555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.062+0000 7f21037fe640 1 --2- 172.21.15.100:0/3539351612 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2104067e90 0x7f21041555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.062+0000 7f21037fe640 1 -- 172.21.15.100:0/3539351612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f210406e140 msgr2=0x7f21040cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.062+0000 7f21037fe640 1 --2- 172.21.15.100:0/3539351612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f210406e140 0x7f21040cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.062+0000 7f21037fe640 1 -- 172.21.15.100:0/3539351612 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f210415c090 con 0x7f2104154710 2024-09-11T22:36:01.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.062+0000 7f21037fe640 1 --2- 172.21.15.100:0/3539351612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2104154710 0x7f2104156c00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f20fc009f40 tx=0x7f20fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:01.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.062+0000 7f20fb7fe640 1 -- 172.21.15.100:0/3539351612 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20fc036050 con 0x7f2104154710 2024-09-11T22:36:01.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.063+0000 7f20fb7fe640 1 -- 172.21.15.100:0/3539351612 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20fc037040 con 0x7f2104154710 2024-09-11T22:36:01.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.063+0000 7f21096e4640 1 -- 172.21.15.100:0/3539351612 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2104156440 con 0x7f2104154710 2024-09-11T22:36:01.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.063+0000 7f20fb7fe640 1 -- 172.21.15.100:0/3539351612 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20fc009510 con 0x7f2104154710 2024-09-11T22:36:01.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.063+0000 7f21096e4640 1 -- 172.21.15.100:0/3539351612 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f210415bdb0 con 0x7f2104154710 2024-09-11T22:36:01.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.063+0000 7f21096e4640 1 -- 172.21.15.100:0/3539351612 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f21041509c0 con 0x7f2104154710 2024-09-11T22:36:01.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.064+0000 7f20fb7fe640 1 -- 172.21.15.100:0/3539351612 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f20fc044020 con 0x7f2104154710 2024-09-11T22:36:01.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.064+0000 7f20fb7fe640 1 --2- 172.21.15.100:0/3539351612 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f20e406be30 0x7f20e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.065+0000 7f20fb7fe640 1 -- 172.21.15.100:0/3539351612 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f20fc0ab590 con 0x7f2104154710 2024-09-11T22:36:01.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.065+0000 7f2102ffd640 1 --2- 172.21.15.100:0/3539351612 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f20e406be30 0x7f20e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.065+0000 7f20fb7fe640 1 --2- 172.21.15.100:0/3539351612 >> [v2:172.21.15.100:6816/644491349,v1:172.21.15.100:6817/644491349] conn(0x7f20e40758c0 0x7f20e4077d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.065+0000 7f20fb7fe640 1 -- 172.21.15.100:0/3539351612 --> [v2:172.21.15.100:6816/644491349,v1:172.21.15.100:6817/644491349] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20e4078430 con 0x7f20e40758c0 2024-09-11T22:36:01.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.065+0000 7f20fb7fe640 1 -- 172.21.15.100:0/3539351612 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f20fc0b2050 con 0x7f2104154710 2024-09-11T22:36:01.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.065+0000 7f21027fc640 1 --2- 172.21.15.100:0/3539351612 >> [v2:172.21.15.100:6816/644491349,v1:172.21.15.100:6817/644491349] conn(0x7f20e40758c0 0x7f20e4077d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.065+0000 7f2102ffd640 1 --2- 172.21.15.100:0/3539351612 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f20e406be30 0x7f20e406e2f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f20f4001640 tx=0x7f20f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:01.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.065+0000 7f21027fc640 1 --2- 172.21.15.100:0/3539351612 >> [v2:172.21.15.100:6816/644491349,v1:172.21.15.100:6817/644491349] conn(0x7f20e40758c0 0x7f20e4077d60 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:01.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.066+0000 7f20fb7fe640 1 -- 172.21.15.100:0/3539351612 <== osd.2 v2:172.21.15.100:6816/644491349 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f20e4078430 con 0x7f20e40758c0 2024-09-11T22:36:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.078+0000 7f21096e4640 1 -- 172.21.15.100:0/3539351612 --> [v2:172.21.15.100:6816/644491349,v1:172.21.15.100:6817/644491349] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2104154af0 con 0x7f20e40758c0 2024-09-11T22:36:01.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.079+0000 7f20fb7fe640 1 -- 172.21.15.100:0/3539351612 <== osd.2 v2:172.21.15.100:6816/644491349 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2104154af0 con 0x7f20e40758c0 2024-09-11T22:36:01.080 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:36:01.080 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T22:36:01.080 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:36:01.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.079+0000 7f21096e4640 1 -- 172.21.15.100:0/3539351612 >> [v2:172.21.15.100:6816/644491349,v1:172.21.15.100:6817/644491349] conn(0x7f20e40758c0 msgr2=0x7f20e4077d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.079+0000 7f21096e4640 1 --2- 172.21.15.100:0/3539351612 >> [v2:172.21.15.100:6816/644491349,v1:172.21.15.100:6817/644491349] conn(0x7f20e40758c0 0x7f20e4077d60 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.079+0000 7f21096e4640 1 -- 172.21.15.100:0/3539351612 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f20e406be30 msgr2=0x7f20e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.079+0000 7f21096e4640 1 --2- 172.21.15.100:0/3539351612 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f20e406be30 0x7f20e406e2f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f20f4001640 tx=0x7f20f4009040 comp rx=0 tx=0).stop 2024-09-11T22:36:01.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.079+0000 7f21096e4640 1 -- 172.21.15.100:0/3539351612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2104154710 msgr2=0x7f2104156c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.079+0000 7f21096e4640 1 --2- 172.21.15.100:0/3539351612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2104154710 0x7f2104156c00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f20fc009f40 tx=0x7f20fc004a40 comp rx=0 tx=0).stop 2024-09-11T22:36:01.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.079+0000 7f21037fe640 1 -- 172.21.15.100:0/3539351612 reap_dead start 2024-09-11T22:36:01.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.079+0000 7f21096e4640 1 -- 172.21.15.100:0/3539351612 shutdown_connections 2024-09-11T22:36:01.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.079+0000 7f21096e4640 1 -- 172.21.15.100:0/3539351612 >> 172.21.15.100:0/3539351612 conn(0x7f2104070b80 msgr2=0x7f210406f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:01.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.079+0000 7f21096e4640 1 -- 172.21.15.100:0/3539351612 shutdown_connections 2024-09-11T22:36:01.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.079+0000 7f21096e4640 1 -- 172.21.15.100:0/3539351612 wait complete. 2024-09-11T22:36:01.091 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-11T22:36:01.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.190+0000 7f0da6c4c640 1 Processor -- start 2024-09-11T22:36:01.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.190+0000 7f0da6c4c640 1 -- start start 2024-09-11T22:36:01.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.191+0000 7f0da6c4c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0da0158210 0x7f0da00707a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.191+0000 7f0da6c4c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0da015e100 0x7f0da00ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.191+0000 7f0da6c4c640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da01585f0 con 0x7f0da00b0ca0 2024-09-11T22:36:01.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.191+0000 7f0da6c4c640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f0da0070310 con 0x7f0da0158210 2024-09-11T22:36:01.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.191+0000 7f0da6c4c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0da00c9430 con 0x7f0da015e100 2024-09-11T22:36:01.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.192+0000 7f0da49e8640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0da0158210 0x7f0da00707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.192+0000 7f0da49e8640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0da0158210 0x7f0da00707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46860/0 (socket says 172.21.15.100:46860) 2024-09-11T22:36:01.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.192+0000 7f0da49e8640 1 -- 172.21.15.100:0/1583305392 learned_addr learned my addr 172.21.15.100:0/1583305392 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:01.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.192+0000 7f0da51e9640 1 --2- 172.21.15.100:0/1583305392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0da015e100 0x7f0da00ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.192+0000 7f0da49e8640 1 -- 172.21.15.100:0/1583305392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0da015e100 msgr2=0x7f0da00ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:01.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.192+0000 7f0da49e8640 1 --2- 172.21.15.100:0/1583305392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0da015e100 0x7f0da00ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.192+0000 7f0da49e8640 1 -- 172.21.15.100:0/1583305392 >> v1:172.21.15.167:6789/0 conn(0x7f0da00b0ca0 legacy=0x7f0da006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.192+0000 7f0da49e8640 1 -- 172.21.15.100:0/1583305392 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da00c96d0 con 0x7f0da0158210 2024-09-11T22:36:01.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.192+0000 7f0da49e8640 1 --2- 172.21.15.100:0/1583305392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0da0158210 0x7f0da00707a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0d94009870 tx=0x7f0d9402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1174ee77e1d4aa3f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:01.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.193+0000 7f0d9f7fe640 1 -- 172.21.15.100:0/1583305392 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94037070 con 0x7f0da0158210 2024-09-11T22:36:01.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.193+0000 7f0d9f7fe640 1 -- 172.21.15.100:0/1583305392 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d9402ae50 con 0x7f0da0158210 2024-09-11T22:36:01.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.193+0000 7f0d9f7fe640 1 -- 172.21.15.100:0/1583305392 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94032860 con 0x7f0da0158210 2024-09-11T22:36:01.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.193+0000 7f0da6c4c640 1 -- 172.21.15.100:0/1583305392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0da0158210 msgr2=0x7f0da00707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.193+0000 7f0da6c4c640 1 --2- 172.21.15.100:0/1583305392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0da0158210 0x7f0da00707a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0d94009870 tx=0x7f0d9402a300 comp rx=0 tx=0).stop 2024-09-11T22:36:01.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.193+0000 7f0da6c4c640 1 -- 172.21.15.100:0/1583305392 shutdown_connections 2024-09-11T22:36:01.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.193+0000 7f0da6c4c640 1 --2- 172.21.15.100:0/1583305392 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0da015e100 0x7f0da00ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.193+0000 7f0da6c4c640 1 --2- 172.21.15.100:0/1583305392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0da0158210 0x7f0da00707a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.193+0000 7f0da6c4c640 1 -- 172.21.15.100:0/1583305392 >> 172.21.15.100:0/1583305392 conn(0x7f0da006de20 msgr2=0x7f0da006e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:01.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.193+0000 7f0da6c4c640 1 -- 172.21.15.100:0/1583305392 shutdown_connections 2024-09-11T22:36:01.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.193+0000 7f0da6c4c640 1 -- 172.21.15.100:0/1583305392 wait complete. 2024-09-11T22:36:01.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.194+0000 7f0da6c4c640 1 Processor -- start 2024-09-11T22:36:01.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.195+0000 7f0da6c4c640 1 -- start start 2024-09-11T22:36:01.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.195+0000 7f0da6c4c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0da00b0ca0 0x7f0da00cd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.195+0000 7f0da6c4c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0da0158210 0x7f0da00ce040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.195+0000 7f0da6c4c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0da015e100 0x7f0da00cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.195+0000 7f0da6c4c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0da006ffa0 con 0x7f0da00b0ca0 2024-09-11T22:36:01.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.195+0000 7f0da6c4c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0da00c9c90 con 0x7f0da015e100 2024-09-11T22:36:01.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.195+0000 7f0da6c4c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0da006db40 con 0x7f0da0158210 2024-09-11T22:36:01.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.195+0000 7f0da49e8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0da00b0ca0 0x7f0da00cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.195+0000 7f0da49e8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0da00b0ca0 0x7f0da00cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46870/0 (socket says 172.21.15.100:46870) 2024-09-11T22:36:01.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.195+0000 7f0da49e8640 1 -- 172.21.15.100:0/594464018 learned_addr learned my addr 172.21.15.100:0/594464018 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:01.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.196+0000 7f0da51e9640 1 --2- 172.21.15.100:0/594464018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0da015e100 0x7f0da00cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.196+0000 7f0d9ffff640 1 --2- 172.21.15.100:0/594464018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0da0158210 0x7f0da00ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.196+0000 7f0da49e8640 1 -- 172.21.15.100:0/594464018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0da0158210 msgr2=0x7f0da00ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.196+0000 7f0da49e8640 1 --2- 172.21.15.100:0/594464018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0da0158210 0x7f0da00ce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.196+0000 7f0da49e8640 1 -- 172.21.15.100:0/594464018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0da015e100 msgr2=0x7f0da00cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.196+0000 7f0da49e8640 1 --2- 172.21.15.100:0/594464018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0da015e100 0x7f0da00cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.196+0000 7f0da49e8640 1 -- 172.21.15.100:0/594464018 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da00ce580 con 0x7f0da00b0ca0 2024-09-11T22:36:01.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.196+0000 7f0da49e8640 1 --2- 172.21.15.100:0/594464018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0da00b0ca0 0x7f0da00cd780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0d9402a340 tx=0x7f0d940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:01.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.196+0000 7f0d9d7fa640 1 -- 172.21.15.100:0/594464018 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94041020 con 0x7f0da00b0ca0 2024-09-11T22:36:01.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.196+0000 7f0d9d7fa640 1 -- 172.21.15.100:0/594464018 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d9403c670 con 0x7f0da00b0ca0 2024-09-11T22:36:01.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.196+0000 7f0da6c4c640 1 -- 172.21.15.100:0/594464018 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0da0156b10 con 0x7f0da00b0ca0 2024-09-11T22:36:01.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.196+0000 7f0d9d7fa640 1 -- 172.21.15.100:0/594464018 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94037040 con 0x7f0da00b0ca0 2024-09-11T22:36:01.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.196+0000 7f0da6c4c640 1 -- 172.21.15.100:0/594464018 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0da00b21c0 con 0x7f0da00b0ca0 2024-09-11T22:36:01.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.197+0000 7f0da6c4c640 1 -- 172.21.15.100:0/594464018 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0da00707a0 con 0x7f0da00b0ca0 2024-09-11T22:36:01.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.198+0000 7f0d9d7fa640 1 -- 172.21.15.100:0/594464018 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0d94044020 con 0x7f0da00b0ca0 2024-09-11T22:36:01.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.198+0000 7f0d9d7fa640 1 --2- 172.21.15.100:0/594464018 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0d8406be30 0x7f0d8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.198+0000 7f0d9d7fa640 1 -- 172.21.15.100:0/594464018 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f0d940ab600 con 0x7f0da00b0ca0 2024-09-11T22:36:01.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.198+0000 7f0d9ffff640 1 --2- 172.21.15.100:0/594464018 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0d8406be30 0x7f0d8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.199+0000 7f0d9ffff640 1 --2- 172.21.15.100:0/594464018 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0d8406be30 0x7f0d8406e2f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0da015f0f0 tx=0x7f0d8c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:01.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.202+0000 7f0d9d7fa640 1 -- 172.21.15.100:0/594464018 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0d9404b030 con 0x7f0da00b0ca0 2024-09-11T22:36:01.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.377+0000 7f0da6c4c640 1 -- 172.21.15.100:0/594464018 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f0da0070da0 con 0x7f0d8406be30 2024-09-11T22:36:01.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.377+0000 7f0d9d7fa640 1 -- 172.21.15.100:0/594464018 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0da0070da0 con 0x7f0d8406be30 2024-09-11T22:36:01.379 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 2 to deep-scrub 2024-09-11T22:36:01.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.380+0000 7f0da6c4c640 1 -- 172.21.15.100:0/594464018 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0d8406be30 msgr2=0x7f0d8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.380+0000 7f0da6c4c640 1 --2- 172.21.15.100:0/594464018 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0d8406be30 0x7f0d8406e2f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0da015f0f0 tx=0x7f0d8c009040 comp rx=0 tx=0).stop 2024-09-11T22:36:01.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.380+0000 7f0da6c4c640 1 -- 172.21.15.100:0/594464018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0da00b0ca0 msgr2=0x7f0da00cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.380+0000 7f0da6c4c640 1 --2- 172.21.15.100:0/594464018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0da00b0ca0 0x7f0da00cd780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0d9402a340 tx=0x7f0d940046c0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.380+0000 7f0da6c4c640 1 -- 172.21.15.100:0/594464018 shutdown_connections 2024-09-11T22:36:01.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.380+0000 7f0da6c4c640 1 --2- 172.21.15.100:0/594464018 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0d8406be30 0x7f0d8406e2f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.380+0000 7f0da6c4c640 1 --2- 172.21.15.100:0/594464018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0da015e100 0x7f0da00cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.380+0000 7f0da6c4c640 1 --2- 172.21.15.100:0/594464018 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0da0158210 0x7f0da00ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.380+0000 7f0da6c4c640 1 --2- 172.21.15.100:0/594464018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0da00b0ca0 0x7f0da00cd780 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.380+0000 7f0da6c4c640 1 -- 172.21.15.100:0/594464018 >> 172.21.15.100:0/594464018 conn(0x7f0da006de20 msgr2=0x7f0da006bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:01.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.381+0000 7f0da6c4c640 1 -- 172.21.15.100:0/594464018 shutdown_connections 2024-09-11T22:36:01.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.381+0000 7f0da6c4c640 1 -- 172.21.15.100:0/594464018 wait complete. 2024-09-11T22:36:01.396 INFO:tasks.ceph:Scrubbing osd.3 2024-09-11T22:36:01.396 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-11T22:36:01.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.500+0000 7ff7a16e4640 1 Processor -- start 2024-09-11T22:36:01.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.500+0000 7ff7a16e4640 1 -- start start 2024-09-11T22:36:01.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.501+0000 7ff7a16e4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff79c072820 0x7ff79c0c2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.501+0000 7ff7a16e4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff79c0c8fb0 0x7ff79c073960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.501+0000 7ff7a16e4640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff79c0c9440 con 0x7ff79c155050 2024-09-11T22:36:01.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.501+0000 7ff7a16e4640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7ff79c06fe60 con 0x7ff79c072820 2024-09-11T22:36:01.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.501+0000 7ff7a16e4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff79c0c8b20 con 0x7ff79c0c8fb0 2024-09-11T22:36:01.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.501+0000 7ff79b7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff79c0c8fb0 0x7ff79c073960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.501+0000 7ff79a7fc640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff79c072820 0x7ff79c0c2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.501+0000 7ff79affd640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ff79c155050 0x7ff79c073250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:51432/0 (socket says 172.21.15.100:51432) 2024-09-11T22:36:01.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.501+0000 7ff79b7fe640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff79c0c8fb0 0x7ff79c073960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:59140/0 (socket says 172.21.15.100:59140) 2024-09-11T22:36:01.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.501+0000 7ff79affd640 1 -- 172.21.15.100:0/2387902547 learned_addr learned my addr 172.21.15.100:0/2387902547 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:36:01.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.501+0000 7ff79b7fe640 1 -- 172.21.15.100:0/2387902547 >> v2:172.21.15.167:3300/0 conn(0x7ff79c072820 msgr2=0x7ff79c0c2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:01.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.501+0000 7ff79b7fe640 1 --2- 172.21.15.100:0/2387902547 >> v2:172.21.15.167:3300/0 conn(0x7ff79c072820 0x7ff79c0c2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.501+0000 7ff79b7fe640 1 -- 172.21.15.100:0/2387902547 >> v1:172.21.15.167:6789/0 conn(0x7ff79c155050 legacy=0x7ff79c073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.501+0000 7ff79b7fe640 1 -- 172.21.15.100:0/2387902547 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff79c155430 con 0x7ff79c0c8fb0 2024-09-11T22:36:01.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.502+0000 7ff79b7fe640 1 --2- 172.21.15.100:0/2387902547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff79c0c8fb0 0x7ff79c073960 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff794009d90 tx=0x7ff79402a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3b8eba6140cd586 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:01.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.502+0000 7ff799ffb640 1 -- 172.21.15.100:0/2387902547 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff794007740 con 0x7ff79c0c8fb0 2024-09-11T22:36:01.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.502+0000 7ff799ffb640 1 -- 172.21.15.100:0/2387902547 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7940078e0 con 0x7ff79c0c8fb0 2024-09-11T22:36:01.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.502+0000 7ff799ffb640 1 -- 172.21.15.100:0/2387902547 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff794007cb0 con 0x7ff79c0c8fb0 2024-09-11T22:36:01.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.503+0000 7ff7a16e4640 1 -- 172.21.15.100:0/2387902547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff79c0c8fb0 msgr2=0x7ff79c073960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.503+0000 7ff7a16e4640 1 --2- 172.21.15.100:0/2387902547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff79c0c8fb0 0x7ff79c073960 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff794009d90 tx=0x7ff79402a6f0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.503+0000 7ff7a16e4640 1 -- 172.21.15.100:0/2387902547 shutdown_connections 2024-09-11T22:36:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.503+0000 7ff7a16e4640 1 --2- 172.21.15.100:0/2387902547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff79c0c8fb0 0x7ff79c073960 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.503+0000 7ff7a16e4640 1 --2- 172.21.15.100:0/2387902547 >> v2:172.21.15.167:3300/0 conn(0x7ff79c072820 0x7ff79c0c2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.503+0000 7ff7a16e4640 1 -- 172.21.15.100:0/2387902547 >> 172.21.15.100:0/2387902547 conn(0x7ff79c0c9d00 msgr2=0x7ff79c0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.503+0000 7ff7a16e4640 1 -- 172.21.15.100:0/2387902547 shutdown_connections 2024-09-11T22:36:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.503+0000 7ff7a16e4640 1 -- 172.21.15.100:0/2387902547 wait complete. 2024-09-11T22:36:01.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.504+0000 7ff7a16e4640 1 Processor -- start 2024-09-11T22:36:01.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.504+0000 7ff7a16e4640 1 -- start start 2024-09-11T22:36:01.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.505+0000 7ff7a16e4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff79c072820 0x7ff79c06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.505+0000 7ff7a16e4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff79c0c8fb0 0x7ff79c1f4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.505+0000 7ff7a16e4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff79c155050 0x7ff79c155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.505+0000 7ff7a16e4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff79c0c81f0 con 0x7ff79c0c8fb0 2024-09-11T22:36:01.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.505+0000 7ff7a16e4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff79c158670 con 0x7ff79c072820 2024-09-11T22:36:01.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.505+0000 7ff7a16e4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7ff79c0c84d0 con 0x7ff79c155050 2024-09-11T22:36:01.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.505+0000 7ff79a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff79c0c8fb0 0x7ff79c1f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.505+0000 7ff79a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff79c0c8fb0 0x7ff79c1f4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46880/0 (socket says 172.21.15.100:46880) 2024-09-11T22:36:01.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.505+0000 7ff79a7fc640 1 -- 172.21.15.100:0/1852512907 learned_addr learned my addr 172.21.15.100:0/1852512907 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.505+0000 7ff79affd640 1 --2- 172.21.15.100:0/1852512907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff79c072820 0x7ff79c06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.505+0000 7ff79b7fe640 1 --2- 172.21.15.100:0/1852512907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff79c155050 0x7ff79c155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.505+0000 7ff79a7fc640 1 -- 172.21.15.100:0/1852512907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff79c155050 msgr2=0x7ff79c155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.505+0000 7ff79a7fc640 1 --2- 172.21.15.100:0/1852512907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff79c155050 0x7ff79c155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.505+0000 7ff79a7fc640 1 -- 172.21.15.100:0/1852512907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff79c072820 msgr2=0x7ff79c06ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.505+0000 7ff79a7fc640 1 --2- 172.21.15.100:0/1852512907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff79c072820 0x7ff79c06ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.505+0000 7ff79a7fc640 1 -- 172.21.15.100:0/1852512907 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff79c0c5cc0 con 0x7ff79c0c8fb0 2024-09-11T22:36:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.506+0000 7ff79a7fc640 1 --2- 172.21.15.100:0/1852512907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff79c0c8fb0 0x7ff79c1f4570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff79000e870 tx=0x7ff79000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.506+0000 7ff7837fe640 1 -- 172.21.15.100:0/1852512907 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff790017070 con 0x7ff79c0c8fb0 2024-09-11T22:36:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.506+0000 7ff7837fe640 1 -- 172.21.15.100:0/1852512907 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff79000c940 con 0x7ff79c0c8fb0 2024-09-11T22:36:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.506+0000 7ff7a16e4640 1 -- 172.21.15.100:0/1852512907 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff79c0c5f80 con 0x7ff79c0c8fb0 2024-09-11T22:36:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.506+0000 7ff7837fe640 1 -- 172.21.15.100:0/1852512907 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79000cd10 con 0x7ff79c0c8fb0 2024-09-11T22:36:01.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.506+0000 7ff7a16e4640 1 -- 172.21.15.100:0/1852512907 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff79c0c6540 con 0x7ff79c0c8fb0 2024-09-11T22:36:01.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.507+0000 7ff7a16e4640 1 -- 172.21.15.100:0/1852512907 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff79c0aeba0 con 0x7ff79c0c8fb0 2024-09-11T22:36:01.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.507+0000 7ff7837fe640 1 -- 172.21.15.100:0/1852512907 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff79001a070 con 0x7ff79c0c8fb0 2024-09-11T22:36:01.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.508+0000 7ff7837fe640 1 --2- 172.21.15.100:0/1852512907 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff78806be60 0x7ff78806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.508+0000 7ff7837fe640 1 -- 172.21.15.100:0/1852512907 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7ff79008b460 con 0x7ff79c0c8fb0 2024-09-11T22:36:01.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.508+0000 7ff79affd640 1 --2- 172.21.15.100:0/1852512907 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff78806be60 0x7ff78806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.508+0000 7ff7837fe640 1 --2- 172.21.15.100:0/1852512907 >> [v2:172.21.15.100:6824/2519160882,v1:172.21.15.100:6825/2519160882] conn(0x7ff7880758f0 0x7ff788077d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.508+0000 7ff7837fe640 1 -- 172.21.15.100:0/1852512907 --> [v2:172.21.15.100:6824/2519160882,v1:172.21.15.100:6825/2519160882] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff788078460 con 0x7ff7880758f0 2024-09-11T22:36:01.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.508+0000 7ff7837fe640 1 -- 172.21.15.100:0/1852512907 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff790092050 con 0x7ff79c0c8fb0 2024-09-11T22:36:01.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.508+0000 7ff79b7fe640 1 --2- 172.21.15.100:0/1852512907 >> [v2:172.21.15.100:6824/2519160882,v1:172.21.15.100:6825/2519160882] conn(0x7ff7880758f0 0x7ff788077d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.508+0000 7ff79affd640 1 --2- 172.21.15.100:0/1852512907 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff78806be60 0x7ff78806e320 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff78c007fd0 tx=0x7ff78c007e80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:01.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.508+0000 7ff79b7fe640 1 --2- 172.21.15.100:0/1852512907 >> [v2:172.21.15.100:6824/2519160882,v1:172.21.15.100:6825/2519160882] conn(0x7ff7880758f0 0x7ff788077d90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:01.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.509+0000 7ff7837fe640 1 -- 172.21.15.100:0/1852512907 <== osd.3 v2:172.21.15.100:6824/2519160882 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff788078460 con 0x7ff7880758f0 2024-09-11T22:36:01.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.521+0000 7ff7a16e4640 1 -- 172.21.15.100:0/1852512907 --> [v2:172.21.15.100:6824/2519160882,v1:172.21.15.100:6825/2519160882] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff79c0c87b0 con 0x7ff7880758f0 2024-09-11T22:36:01.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.522+0000 7ff7837fe640 1 -- 172.21.15.100:0/1852512907 <== osd.3 v2:172.21.15.100:6824/2519160882 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff79c0c87b0 con 0x7ff7880758f0 2024-09-11T22:36:01.523 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:36:01.523 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T22:36:01.523 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:36:01.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.522+0000 7ff7a16e4640 1 -- 172.21.15.100:0/1852512907 >> [v2:172.21.15.100:6824/2519160882,v1:172.21.15.100:6825/2519160882] conn(0x7ff7880758f0 msgr2=0x7ff788077d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.522+0000 7ff7a16e4640 1 --2- 172.21.15.100:0/1852512907 >> [v2:172.21.15.100:6824/2519160882,v1:172.21.15.100:6825/2519160882] conn(0x7ff7880758f0 0x7ff788077d90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.522+0000 7ff7a16e4640 1 -- 172.21.15.100:0/1852512907 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff78806be60 msgr2=0x7ff78806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.522+0000 7ff7a16e4640 1 --2- 172.21.15.100:0/1852512907 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7ff78806be60 0x7ff78806e320 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff78c007fd0 tx=0x7ff78c007e80 comp rx=0 tx=0).stop 2024-09-11T22:36:01.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.522+0000 7ff7a16e4640 1 -- 172.21.15.100:0/1852512907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff79c0c8fb0 msgr2=0x7ff79c1f4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.522+0000 7ff7a16e4640 1 --2- 172.21.15.100:0/1852512907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff79c0c8fb0 0x7ff79c1f4570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff79000e870 tx=0x7ff79000ed30 comp rx=0 tx=0).stop 2024-09-11T22:36:01.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.522+0000 7ff79b7fe640 1 -- 172.21.15.100:0/1852512907 reap_dead start 2024-09-11T22:36:01.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.522+0000 7ff7a16e4640 1 -- 172.21.15.100:0/1852512907 shutdown_connections 2024-09-11T22:36:01.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.522+0000 7ff7a16e4640 1 -- 172.21.15.100:0/1852512907 >> 172.21.15.100:0/1852512907 conn(0x7ff79c0c9d00 msgr2=0x7ff79c0cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:01.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.522+0000 7ff7a16e4640 1 -- 172.21.15.100:0/1852512907 shutdown_connections 2024-09-11T22:36:01.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.522+0000 7ff7a16e4640 1 -- 172.21.15.100:0/1852512907 wait complete. 2024-09-11T22:36:01.534 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-11T22:36:01.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.635+0000 7efcb6db7640 1 Processor -- start 2024-09-11T22:36:01.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.635+0000 7efcb6db7640 1 -- start start 2024-09-11T22:36:01.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.636+0000 7efcb6db7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcb0152a80 0x7efcb006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.636+0000 7efcb6db7640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efcb00c8b10 0x7efcb0159030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.636+0000 7efcb6db7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcb00c98f0 con 0x7efcb00b0c00 2024-09-11T22:36:01.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.636+0000 7efcb6db7640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7efcb0152e60 con 0x7efcb00c8b10 2024-09-11T22:36:01.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.636+0000 7efcb6db7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7efcb00c9050 con 0x7efcb0152a80 2024-09-11T22:36:01.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.636+0000 7efcaffff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efcb00c8b10 0x7efcb0159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.636+0000 7efcaffff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efcb00c8b10 0x7efcb0159030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46888/0 (socket says 172.21.15.100:46888) 2024-09-11T22:36:01.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.636+0000 7efcaffff640 1 -- 172.21.15.100:0/700925547 learned_addr learned my addr 172.21.15.100:0/700925547 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:01.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.636+0000 7efcb4b53640 1 --2- 172.21.15.100:0/700925547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcb0152a80 0x7efcb006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.636+0000 7efcaffff640 1 -- 172.21.15.100:0/700925547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcb0152a80 msgr2=0x7efcb006ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:01.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.636+0000 7efcaffff640 1 --2- 172.21.15.100:0/700925547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcb0152a80 0x7efcb006ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.636+0000 7efcaffff640 1 -- 172.21.15.100:0/700925547 >> v1:172.21.15.167:6789/0 conn(0x7efcb00b0c00 legacy=0x7efcb00cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.636+0000 7efcaffff640 1 -- 172.21.15.100:0/700925547 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb00c9330 con 0x7efcb00c8b10 2024-09-11T22:36:01.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.637+0000 7efcaffff640 1 --2- 172.21.15.100:0/700925547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcb00c8b10 0x7efcb0159030 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009870 tx=0x7efc9c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e90cd356f0b76c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:01.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.637+0000 7efcaf7fe640 1 -- 172.21.15.100:0/700925547 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c037070 con 0x7efcb00c8b10 2024-09-11T22:36:01.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.637+0000 7efcaf7fe640 1 -- 172.21.15.100:0/700925547 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc9c02ae50 con 0x7efcb00c8b10 2024-09-11T22:36:01.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.637+0000 7efcaf7fe640 1 -- 172.21.15.100:0/700925547 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c032860 con 0x7efcb00c8b10 2024-09-11T22:36:01.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.638+0000 7efcb6db7640 1 -- 172.21.15.100:0/700925547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcb00c8b10 msgr2=0x7efcb0159030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.638+0000 7efcb6db7640 1 --2- 172.21.15.100:0/700925547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcb00c8b10 0x7efcb0159030 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009870 tx=0x7efc9c02a300 comp rx=0 tx=0).stop 2024-09-11T22:36:01.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.638+0000 7efcb6db7640 1 -- 172.21.15.100:0/700925547 shutdown_connections 2024-09-11T22:36:01.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.638+0000 7efcb6db7640 1 --2- 172.21.15.100:0/700925547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcb00c8b10 0x7efcb0159030 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.638+0000 7efcb6db7640 1 --2- 172.21.15.100:0/700925547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcb0152a80 0x7efcb006ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.638+0000 7efcb6db7640 1 -- 172.21.15.100:0/700925547 >> 172.21.15.100:0/700925547 conn(0x7efcb006e000 msgr2=0x7efcb006e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:01.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.638+0000 7efcb6db7640 1 -- 172.21.15.100:0/700925547 shutdown_connections 2024-09-11T22:36:01.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.638+0000 7efcb6db7640 1 -- 172.21.15.100:0/700925547 wait complete. 2024-09-11T22:36:01.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.639+0000 7efcb6db7640 1 Processor -- start 2024-09-11T22:36:01.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.639+0000 7efcb6db7640 1 -- start start 2024-09-11T22:36:01.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.640+0000 7efcb6db7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcb00b0c00 0x7efcb00c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.640+0000 7efcb6db7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcb00c8b10 0x7efcb01e1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.640+0000 7efcb6db7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcb0152a80 0x7efcb006d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.640+0000 7efcb6db7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efcb0158b10 con 0x7efcb00b0c00 2024-09-11T22:36:01.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.640+0000 7efcb6db7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efcb0158830 con 0x7efcb0152a80 2024-09-11T22:36:01.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.640+0000 7efcb6db7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7efcb0159570 con 0x7efcb00c8b10 2024-09-11T22:36:01.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.640+0000 7efcb4b53640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcb00b0c00 0x7efcb00c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.640+0000 7efcb4b53640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcb00b0c00 0x7efcb00c7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46904/0 (socket says 172.21.15.100:46904) 2024-09-11T22:36:01.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.640+0000 7efcb4b53640 1 -- 172.21.15.100:0/2715394862 learned_addr learned my addr 172.21.15.100:0/2715394862 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:01.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.640+0000 7efcaffff640 1 --2- 172.21.15.100:0/2715394862 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcb00c8b10 0x7efcb01e1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.640+0000 7efcb5354640 1 --2- 172.21.15.100:0/2715394862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcb0152a80 0x7efcb006d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.640+0000 7efcb4b53640 1 -- 172.21.15.100:0/2715394862 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcb00c8b10 msgr2=0x7efcb01e1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.640+0000 7efcb4b53640 1 --2- 172.21.15.100:0/2715394862 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcb00c8b10 0x7efcb01e1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.640+0000 7efcb4b53640 1 -- 172.21.15.100:0/2715394862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcb0152a80 msgr2=0x7efcb006d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.640+0000 7efcb4b53640 1 --2- 172.21.15.100:0/2715394862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcb0152a80 0x7efcb006d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.640+0000 7efcb4b53640 1 -- 172.21.15.100:0/2715394862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb01e2f90 con 0x7efcb00b0c00 2024-09-11T22:36:01.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.641+0000 7efcb4b53640 1 --2- 172.21.15.100:0/2715394862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcb00b0c00 0x7efcb00c7ce0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efca400d830 tx=0x7efca400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:01.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.641+0000 7efcad7fa640 1 -- 172.21.15.100:0/2715394862 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca400b6c0 con 0x7efcb00b0c00 2024-09-11T22:36:01.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.641+0000 7efcad7fa640 1 -- 172.21.15.100:0/2715394862 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca4019070 con 0x7efcb00b0c00 2024-09-11T22:36:01.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.641+0000 7efcb6db7640 1 -- 172.21.15.100:0/2715394862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb01e3af0 con 0x7efcb00b0c00 2024-09-11T22:36:01.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.641+0000 7efcad7fa640 1 -- 172.21.15.100:0/2715394862 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca400ba80 con 0x7efcb00b0c00 2024-09-11T22:36:01.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.641+0000 7efcb6db7640 1 -- 172.21.15.100:0/2715394862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb00b0650 con 0x7efcb00b0c00 2024-09-11T22:36:01.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.642+0000 7efcb6db7640 1 -- 172.21.15.100:0/2715394862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb006f800 con 0x7efcb00b0c00 2024-09-11T22:36:01.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.643+0000 7efcad7fa640 1 -- 172.21.15.100:0/2715394862 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efca401e460 con 0x7efcb00b0c00 2024-09-11T22:36:01.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.643+0000 7efcad7fa640 1 --2- 172.21.15.100:0/2715394862 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efc9406be60 0x7efc9406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.643+0000 7efcaffff640 1 --2- 172.21.15.100:0/2715394862 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efc9406be60 0x7efc9406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.643+0000 7efcad7fa640 1 -- 172.21.15.100:0/2715394862 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7efca408b790 con 0x7efcb00b0c00 2024-09-11T22:36:01.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.644+0000 7efcaffff640 1 --2- 172.21.15.100:0/2715394862 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efc9406be60 0x7efc9406e320 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7efc9c034000 tx=0x7efc9c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:01.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.648+0000 7efcad7fa640 1 -- 172.21.15.100:0/2715394862 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efcb006f800 con 0x7efcb00b0c00 2024-09-11T22:36:01.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.827+0000 7efcb6db7640 1 -- 172.21.15.100:0/2715394862 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7efcb00c34d0 con 0x7efc9406be60 2024-09-11T22:36:01.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.827+0000 7efcad7fa640 1 -- 172.21.15.100:0/2715394862 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7efcb00c34d0 con 0x7efc9406be60 2024-09-11T22:36:01.829 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 3 to deep-scrub 2024-09-11T22:36:01.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.830+0000 7efcb6db7640 1 -- 172.21.15.100:0/2715394862 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efc9406be60 msgr2=0x7efc9406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.830+0000 7efcb6db7640 1 --2- 172.21.15.100:0/2715394862 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efc9406be60 0x7efc9406e320 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7efc9c034000 tx=0x7efc9c02e000 comp rx=0 tx=0).stop 2024-09-11T22:36:01.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.830+0000 7efcb6db7640 1 -- 172.21.15.100:0/2715394862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcb00b0c00 msgr2=0x7efcb00c7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.830+0000 7efcb6db7640 1 --2- 172.21.15.100:0/2715394862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcb00b0c00 0x7efcb00c7ce0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efca400d830 tx=0x7efca400dcf0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.830+0000 7efcb6db7640 1 -- 172.21.15.100:0/2715394862 shutdown_connections 2024-09-11T22:36:01.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.830+0000 7efcb6db7640 1 --2- 172.21.15.100:0/2715394862 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7efc9406be60 0x7efc9406e320 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.830+0000 7efcb6db7640 1 --2- 172.21.15.100:0/2715394862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcb0152a80 0x7efcb006d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.830+0000 7efcb6db7640 1 --2- 172.21.15.100:0/2715394862 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcb00c8b10 0x7efcb01e1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.830+0000 7efcb6db7640 1 --2- 172.21.15.100:0/2715394862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efcb00b0c00 0x7efcb00c7ce0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.830+0000 7efcb6db7640 1 -- 172.21.15.100:0/2715394862 >> 172.21.15.100:0/2715394862 conn(0x7efcb006e000 msgr2=0x7efcb00c3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:01.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.830+0000 7efcb6db7640 1 -- 172.21.15.100:0/2715394862 shutdown_connections 2024-09-11T22:36:01.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.830+0000 7efcb6db7640 1 -- 172.21.15.100:0/2715394862 wait complete. 2024-09-11T22:36:01.842 INFO:tasks.ceph:Scrubbing osd.4 2024-09-11T22:36:01.842 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-11T22:36:01.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.945+0000 7f79685c4640 1 Processor -- start 2024-09-11T22:36:01.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.945+0000 7f79685c4640 1 -- start start 2024-09-11T22:36:01.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.946+0000 7f79685c4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79600c8d60 0x7f79600cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.946+0000 7f79685c4640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79600ca9c0 con 0x7f7960071fc0 2024-09-11T22:36:01.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.946+0000 7f79685c4640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79601588a0 con 0x7f79600cabc0 2024-09-11T22:36:01.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.946+0000 7f79685c4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f796015cc50 con 0x7f79600c8d60 2024-09-11T22:36:01.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.946+0000 7f7965b5f640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7960071fc0 0x7f7960161000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55526/0 (socket says 172.21.15.100:55526) 2024-09-11T22:36:01.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.946+0000 7f7965b5f640 1 -- 172.21.15.100:0/816000237 learned_addr learned my addr 172.21.15.100:0/816000237 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:36:01.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.946+0000 7f7966b61640 1 --2- 172.21.15.100:0/816000237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79600c8d60 0x7f79600cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.947+0000 7f796535e640 1 -- 172.21.15.100:0/816000237 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4024406892 0 0) 0x7f795c001110 con 0x7f7960071fc0 2024-09-11T22:36:01.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.947+0000 7f796535e640 1 -- 172.21.15.100:0/816000237 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f794c003520 con 0x7f7960071fc0 2024-09-11T22:36:01.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.947+0000 7f796535e640 1 -- 172.21.15.100:0/816000237 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 287196578 0 0) 0x7f79601588a0 con 0x7f79600cabc0 2024-09-11T22:36:01.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.947+0000 7f796535e640 1 -- 172.21.15.100:0/816000237 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f795c001110 con 0x7f79600cabc0 2024-09-11T22:36:01.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.947+0000 7f7966b61640 1 -- 172.21.15.100:0/816000237 >> v1:172.21.15.167:6789/0 conn(0x7f79600cabc0 legacy=0x7f7960159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.947+0000 7f7966b61640 1 -- 172.21.15.100:0/816000237 >> v1:172.21.15.100:6789/0 conn(0x7f7960071fc0 legacy=0x7f7960161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.947+0000 7f796535e640 1 -- 172.21.15.100:0/816000237 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2763377161 0 0) 0x7f794c003520 con 0x7f7960071fc0 2024-09-11T22:36:01.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.947+0000 7f7966b61640 1 -- 172.21.15.100:0/816000237 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79600c9980 con 0x7f79600c8d60 2024-09-11T22:36:01.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.948+0000 7f7966b61640 1 --2- 172.21.15.100:0/816000237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79600c8d60 0x7f79600cafa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7958009dc0 tx=0x7f795802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4226332cab3c9fd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:01.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.948+0000 7f796535e640 1 -- 172.21.15.100:0/816000237 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c001840 con 0x7f79600c8d60 2024-09-11T22:36:01.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.948+0000 7f796535e640 1 -- 172.21.15.100:0/816000237 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7958007540 con 0x7f79600c8d60 2024-09-11T22:36:01.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.948+0000 7f796535e640 1 -- 172.21.15.100:0/816000237 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7958007910 con 0x7f79600c8d60 2024-09-11T22:36:01.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.949+0000 7f79685c4640 1 -- 172.21.15.100:0/816000237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79600c8d60 msgr2=0x7f79600cafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.949+0000 7f79685c4640 1 --2- 172.21.15.100:0/816000237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79600c8d60 0x7f79600cafa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7958009dc0 tx=0x7f795802a5d0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.949+0000 7f79685c4640 1 -- 172.21.15.100:0/816000237 shutdown_connections 2024-09-11T22:36:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.949+0000 7f79685c4640 1 --2- 172.21.15.100:0/816000237 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79600c8d60 0x7f79600cafa0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.949+0000 7f79685c4640 1 -- 172.21.15.100:0/816000237 >> 172.21.15.100:0/816000237 conn(0x7f796006fb70 msgr2=0x7f7960071590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.949+0000 7f79685c4640 1 -- 172.21.15.100:0/816000237 shutdown_connections 2024-09-11T22:36:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.949+0000 7f79685c4640 1 -- 172.21.15.100:0/816000237 wait complete. 2024-09-11T22:36:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.950+0000 7f79685c4640 1 Processor -- start 2024-09-11T22:36:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.950+0000 7f79685c4640 1 -- start start 2024-09-11T22:36:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.951+0000 7f79685c4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7960071fc0 0x7f79600c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.951+0000 7f79685c4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79600c8d60 0x7f79601e3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.951+0000 7f79685c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79600cabc0 0x7f7960151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.951+0000 7f79685c4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7960158bd0 con 0x7f79600cabc0 2024-09-11T22:36:01.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.951+0000 7f79685c4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f79600b1160 con 0x7f7960071fc0 2024-09-11T22:36:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.951+0000 7f79685c4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f796015c970 con 0x7f79600c8d60 2024-09-11T22:36:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.951+0000 7f7966b61640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79600cabc0 0x7f7960151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.951+0000 7f7966b61640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79600cabc0 0x7f7960151f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46920/0 (socket says 172.21.15.100:46920) 2024-09-11T22:36:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.951+0000 7f7966b61640 1 -- 172.21.15.100:0/454368603 learned_addr learned my addr 172.21.15.100:0/454368603 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.951+0000 7f7966360640 1 --2- 172.21.15.100:0/454368603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7960071fc0 0x7f79600c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.951+0000 7f7965b5f640 1 --2- 172.21.15.100:0/454368603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79600c8d60 0x7f79601e3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.951+0000 7f7966b61640 1 -- 172.21.15.100:0/454368603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79600c8d60 msgr2=0x7f79601e3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.951+0000 7f7966b61640 1 --2- 172.21.15.100:0/454368603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79600c8d60 0x7f79601e3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.951+0000 7f7966b61640 1 -- 172.21.15.100:0/454368603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7960071fc0 msgr2=0x7f79600c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.951+0000 7f7966b61640 1 --2- 172.21.15.100:0/454368603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7960071fc0 0x7f79600c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.951+0000 7f7966b61640 1 -- 172.21.15.100:0/454368603 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79601ef840 con 0x7f79600cabc0 2024-09-11T22:36:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.951+0000 7f7966b61640 1 --2- 172.21.15.100:0/454368603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79600cabc0 0x7f7960151f00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f795802abc0 tx=0x7f7958004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:01.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.951+0000 7f7956ffd640 1 -- 172.21.15.100:0/454368603 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7958040070 con 0x7f79600cabc0 2024-09-11T22:36:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.951+0000 7f7956ffd640 1 -- 172.21.15.100:0/454368603 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7958031c40 con 0x7f79600cabc0 2024-09-11T22:36:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.951+0000 7f7956ffd640 1 -- 172.21.15.100:0/454368603 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7958009450 con 0x7f79600cabc0 2024-09-11T22:36:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.951+0000 7f79685c4640 1 -- 172.21.15.100:0/454368603 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79600c7e00 con 0x7f79600cabc0 2024-09-11T22:36:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.952+0000 7f79685c4640 1 -- 172.21.15.100:0/454368603 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79600c6450 con 0x7f79600cabc0 2024-09-11T22:36:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.952+0000 7f79685c4640 1 -- 172.21.15.100:0/454368603 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f79600c3380 con 0x7f79600cabc0 2024-09-11T22:36:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.953+0000 7f7956ffd640 1 -- 172.21.15.100:0/454368603 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7958039040 con 0x7f79600cabc0 2024-09-11T22:36:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.953+0000 7f7956ffd640 1 --2- 172.21.15.100:0/454368603 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f794406be30 0x7f794406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.953+0000 7f7956ffd640 1 -- 172.21.15.100:0/454368603 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f79580ac420 con 0x7f79600cabc0 2024-09-11T22:36:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.953+0000 7f7966360640 1 --2- 172.21.15.100:0/454368603 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f794406be30 0x7f794406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.953+0000 7f7956ffd640 1 --2- 172.21.15.100:0/454368603 >> [v2:172.21.15.167:6816/736010951,v1:172.21.15.167:6817/736010951] conn(0x7f79440758d0 0x7f7944077d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.953+0000 7f7956ffd640 1 -- 172.21.15.100:0/454368603 --> [v2:172.21.15.167:6816/736010951,v1:172.21.15.167:6817/736010951] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f79580020b0 con 0x7f79440758d0 2024-09-11T22:36:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.953+0000 7f7956ffd640 1 -- 172.21.15.100:0/454368603 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f79580b3050 con 0x7f79600cabc0 2024-09-11T22:36:01.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.954+0000 7f7965b5f640 1 --2- 172.21.15.100:0/454368603 >> [v2:172.21.15.167:6816/736010951,v1:172.21.15.167:6817/736010951] conn(0x7f79440758d0 0x7f7944077d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.954+0000 7f7966360640 1 --2- 172.21.15.100:0/454368603 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f794406be30 0x7f794406e2f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f79500011e0 tx=0x7f7950009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.954+0000 7f7965b5f640 1 --2- 172.21.15.100:0/454368603 >> [v2:172.21.15.167:6816/736010951,v1:172.21.15.167:6817/736010951] conn(0x7f79440758d0 0x7f7944077d70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:01.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.955+0000 7f7956ffd640 1 -- 172.21.15.100:0/454368603 <== osd.4 v2:172.21.15.167:6816/736010951 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f79580020b0 con 0x7f79440758d0 2024-09-11T22:36:01.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.967+0000 7f79685c4640 1 -- 172.21.15.100:0/454368603 --> [v2:172.21.15.167:6816/736010951,v1:172.21.15.167:6817/736010951] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f79600cd530 con 0x7f79440758d0 2024-09-11T22:36:01.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.968+0000 7f7956ffd640 1 -- 172.21.15.100:0/454368603 <== osd.4 v2:172.21.15.167:6816/736010951 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f79600cd530 con 0x7f79440758d0 2024-09-11T22:36:01.969 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:36:01.969 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T22:36:01.969 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:36:01.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.968+0000 7f79685c4640 1 -- 172.21.15.100:0/454368603 >> [v2:172.21.15.167:6816/736010951,v1:172.21.15.167:6817/736010951] conn(0x7f79440758d0 msgr2=0x7f7944077d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.968+0000 7f79685c4640 1 --2- 172.21.15.100:0/454368603 >> [v2:172.21.15.167:6816/736010951,v1:172.21.15.167:6817/736010951] conn(0x7f79440758d0 0x7f7944077d70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:01.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.968+0000 7f79685c4640 1 -- 172.21.15.100:0/454368603 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f794406be30 msgr2=0x7f794406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.968+0000 7f79685c4640 1 --2- 172.21.15.100:0/454368603 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f794406be30 0x7f794406e2f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f79500011e0 tx=0x7f7950009040 comp rx=0 tx=0).stop 2024-09-11T22:36:01.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.968+0000 7f79685c4640 1 -- 172.21.15.100:0/454368603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79600cabc0 msgr2=0x7f7960151f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:01.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.968+0000 7f79685c4640 1 --2- 172.21.15.100:0/454368603 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79600cabc0 0x7f7960151f00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f795802abc0 tx=0x7f7958004a40 comp rx=0 tx=0).stop 2024-09-11T22:36:01.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.968+0000 7f7966b61640 1 -- 172.21.15.100:0/454368603 reap_dead start 2024-09-11T22:36:01.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.968+0000 7f79685c4640 1 -- 172.21.15.100:0/454368603 shutdown_connections 2024-09-11T22:36:01.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.968+0000 7f79685c4640 1 -- 172.21.15.100:0/454368603 >> 172.21.15.100:0/454368603 conn(0x7f796006fb70 msgr2=0x7f79600cc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:01.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.968+0000 7f79685c4640 1 -- 172.21.15.100:0/454368603 shutdown_connections 2024-09-11T22:36:01.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:01.968+0000 7f79685c4640 1 -- 172.21.15.100:0/454368603 wait complete. 2024-09-11T22:36:01.980 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-11T22:36:02.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.081+0000 7f68c45fd640 1 Processor -- start 2024-09-11T22:36:02.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.081+0000 7f68c45fd640 1 -- start start 2024-09-11T22:36:02.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.082+0000 7f68c45fd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68bc158210 0x7f68bc0707a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.082+0000 7f68c45fd640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f68bc15e100 0x7f68bc0ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.082+0000 7f68c45fd640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68bc1585f0 con 0x7f68bc0b0ca0 2024-09-11T22:36:02.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.082+0000 7f68c45fd640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f68bc070310 con 0x7f68bc15e100 2024-09-11T22:36:02.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.082+0000 7f68c45fd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f68bc0c9430 con 0x7f68bc158210 2024-09-11T22:36:02.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.082+0000 7f68c2b9a640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f68bc15e100 0x7f68bc0ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.082+0000 7f68c1b98640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f68bc0b0ca0 0x7f68bc06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:51464/0 (socket says 172.21.15.100:51464) 2024-09-11T22:36:02.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.082+0000 7f68c1b98640 1 -- 172.21.15.100:0/1886977265 learned_addr learned my addr 172.21.15.100:0/1886977265 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:36:02.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.082+0000 7f68c2399640 1 --2- 172.21.15.100:0/1886977265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68bc158210 0x7f68bc0707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.082+0000 7f68c1397640 1 -- 172.21.15.100:0/1886977265 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4052512383 0 0) 0x7f68bc1585f0 con 0x7f68bc0b0ca0 2024-09-11T22:36:02.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.082+0000 7f68c1397640 1 -- 172.21.15.100:0/1886977265 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68a8003520 con 0x7f68bc0b0ca0 2024-09-11T22:36:02.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.082+0000 7f68c2b9a640 1 -- 172.21.15.100:0/1886977265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68bc158210 msgr2=0x7f68bc0707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:02.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.082+0000 7f68c2b9a640 1 --2- 172.21.15.100:0/1886977265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68bc158210 0x7f68bc0707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.082+0000 7f68c2b9a640 1 -- 172.21.15.100:0/1886977265 >> v1:172.21.15.167:6789/0 conn(0x7f68bc0b0ca0 legacy=0x7f68bc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.082+0000 7f68c2b9a640 1 -- 172.21.15.100:0/1886977265 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68bc0c96d0 con 0x7f68bc15e100 2024-09-11T22:36:02.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.082+0000 7f68c2399640 1 --2- 172.21.15.100:0/1886977265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68bc158210 0x7f68bc0707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:36:02.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.083+0000 7f68c2b9a640 1 --2- 172.21.15.100:0/1886977265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68bc15e100 0x7f68bc0ce160 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009d90 tx=0x7f68b402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8ede85db2b0100e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:02.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.083+0000 7f68c1397640 1 -- 172.21.15.100:0/1886977265 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4007740 con 0x7f68bc15e100 2024-09-11T22:36:02.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.083+0000 7f68c1397640 1 -- 172.21.15.100:0/1886977265 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68b40078e0 con 0x7f68bc15e100 2024-09-11T22:36:02.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.083+0000 7f68c1397640 1 -- 172.21.15.100:0/1886977265 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4007cb0 con 0x7f68bc15e100 2024-09-11T22:36:02.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.084+0000 7f68c45fd640 1 -- 172.21.15.100:0/1886977265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68bc15e100 msgr2=0x7f68bc0ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.084+0000 7f68c45fd640 1 --2- 172.21.15.100:0/1886977265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68bc15e100 0x7f68bc0ce160 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009d90 tx=0x7f68b402a6f0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.084+0000 7f68c45fd640 1 -- 172.21.15.100:0/1886977265 shutdown_connections 2024-09-11T22:36:02.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.084+0000 7f68c45fd640 1 --2- 172.21.15.100:0/1886977265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68bc15e100 0x7f68bc0ce160 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.084+0000 7f68c45fd640 1 --2- 172.21.15.100:0/1886977265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68bc158210 0x7f68bc0707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.084+0000 7f68c45fd640 1 -- 172.21.15.100:0/1886977265 >> 172.21.15.100:0/1886977265 conn(0x7f68bc06de20 msgr2=0x7f68bc06e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:02.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.084+0000 7f68c45fd640 1 -- 172.21.15.100:0/1886977265 shutdown_connections 2024-09-11T22:36:02.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.084+0000 7f68c45fd640 1 -- 172.21.15.100:0/1886977265 wait complete. 2024-09-11T22:36:02.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.085+0000 7f68c45fd640 1 Processor -- start 2024-09-11T22:36:02.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.085+0000 7f68c45fd640 1 -- start start 2024-09-11T22:36:02.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.086+0000 7f68c45fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68bc0b0ca0 0x7f68bc15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.086+0000 7f68c45fd640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68bc158210 0x7f68bc1f1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.086+0000 7f68c45fd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68bc15e100 0x7f68bc153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.086+0000 7f68c45fd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f68bc06ffa0 con 0x7f68bc15e100 2024-09-11T22:36:02.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.086+0000 7f68c45fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f68bc0c9c90 con 0x7f68bc0b0ca0 2024-09-11T22:36:02.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.086+0000 7f68c45fd640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f68bc06db40 con 0x7f68bc158210 2024-09-11T22:36:02.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.086+0000 7f68c2b9a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68bc15e100 0x7f68bc153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.086+0000 7f68c2b9a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68bc15e100 0x7f68bc153d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46936/0 (socket says 172.21.15.100:46936) 2024-09-11T22:36:02.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.086+0000 7f68c2b9a640 1 -- 172.21.15.100:0/1538786043 learned_addr learned my addr 172.21.15.100:0/1538786043 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:02.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.086+0000 7f68c1b98640 1 --2- 172.21.15.100:0/1538786043 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68bc158210 0x7f68bc1f1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.086+0000 7f68c2399640 1 --2- 172.21.15.100:0/1538786043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68bc0b0ca0 0x7f68bc15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.087+0000 7f68c2b9a640 1 -- 172.21.15.100:0/1538786043 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68bc158210 msgr2=0x7f68bc1f1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.087+0000 7f68c2b9a640 1 --2- 172.21.15.100:0/1538786043 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68bc158210 0x7f68bc1f1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.087+0000 7f68c2b9a640 1 -- 172.21.15.100:0/1538786043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68bc0b0ca0 msgr2=0x7f68bc15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.087+0000 7f68c2b9a640 1 --2- 172.21.15.100:0/1538786043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68bc0b0ca0 0x7f68bc15bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.087+0000 7f68c2b9a640 1 -- 172.21.15.100:0/1538786043 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68bc1f46f0 con 0x7f68bc15e100 2024-09-11T22:36:02.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.087+0000 7f68c2b9a640 1 --2- 172.21.15.100:0/1538786043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68bc15e100 0x7f68bc153d50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009eb0 tx=0x7f68b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:02.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.087+0000 7f68b2ffd640 1 -- 172.21.15.100:0/1538786043 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b403f070 con 0x7f68bc15e100 2024-09-11T22:36:02.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.087+0000 7f68b2ffd640 1 -- 172.21.15.100:0/1538786043 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68b4031bc0 con 0x7f68bc15e100 2024-09-11T22:36:02.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.087+0000 7f68c45fd640 1 -- 172.21.15.100:0/1538786043 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68bc1f06d0 con 0x7f68bc15e100 2024-09-11T22:36:02.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.087+0000 7f68b2ffd640 1 -- 172.21.15.100:0/1538786043 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4009450 con 0x7f68bc15e100 2024-09-11T22:36:02.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.087+0000 7f68c45fd640 1 -- 172.21.15.100:0/1538786043 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68bc1f0990 con 0x7f68bc15e100 2024-09-11T22:36:02.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.088+0000 7f68c45fd640 1 -- 172.21.15.100:0/1538786043 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68bc0707a0 con 0x7f68bc15e100 2024-09-11T22:36:02.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.088+0000 7f68b2ffd640 1 -- 172.21.15.100:0/1538786043 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f68b403b410 con 0x7f68bc15e100 2024-09-11T22:36:02.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.089+0000 7f68b2ffd640 1 --2- 172.21.15.100:0/1538786043 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f68a006be30 0x7f68a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.089+0000 7f68b2ffd640 1 -- 172.21.15.100:0/1538786043 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f68b40ac780 con 0x7f68bc15e100 2024-09-11T22:36:02.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.089+0000 7f68c2399640 1 --2- 172.21.15.100:0/1538786043 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f68a006be30 0x7f68a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.089+0000 7f68c2399640 1 --2- 172.21.15.100:0/1538786043 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f68a006be30 0x7f68a006e2f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f68b8009560 tx=0x7f68b8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:02.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.093+0000 7f68b2ffd640 1 -- 172.21.15.100:0/1538786043 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f68b407a750 con 0x7f68bc15e100 2024-09-11T22:36:02.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.266+0000 7f68c45fd640 1 -- 172.21.15.100:0/1538786043 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f68bc1e5d20 con 0x7f68a006be30 2024-09-11T22:36:02.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.267+0000 7f68b2ffd640 1 -- 172.21.15.100:0/1538786043 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f68b8011a60 con 0x7f68a006be30 2024-09-11T22:36:02.268 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 4 to deep-scrub 2024-09-11T22:36:02.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.269+0000 7f68c45fd640 1 -- 172.21.15.100:0/1538786043 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f68a006be30 msgr2=0x7f68a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.269+0000 7f68c45fd640 1 --2- 172.21.15.100:0/1538786043 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f68a006be30 0x7f68a006e2f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f68b8009560 tx=0x7f68b8009190 comp rx=0 tx=0).stop 2024-09-11T22:36:02.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.269+0000 7f68c45fd640 1 -- 172.21.15.100:0/1538786043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68bc15e100 msgr2=0x7f68bc153d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.269+0000 7f68c45fd640 1 --2- 172.21.15.100:0/1538786043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68bc15e100 0x7f68bc153d50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009eb0 tx=0x7f68b4004a40 comp rx=0 tx=0).stop 2024-09-11T22:36:02.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.269+0000 7f68c45fd640 1 -- 172.21.15.100:0/1538786043 shutdown_connections 2024-09-11T22:36:02.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.269+0000 7f68c45fd640 1 --2- 172.21.15.100:0/1538786043 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f68a006be30 0x7f68a006e2f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.269+0000 7f68c45fd640 1 --2- 172.21.15.100:0/1538786043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68bc15e100 0x7f68bc153d50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.269+0000 7f68c45fd640 1 --2- 172.21.15.100:0/1538786043 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f68bc158210 0x7f68bc1f1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.269+0000 7f68c45fd640 1 --2- 172.21.15.100:0/1538786043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68bc0b0ca0 0x7f68bc15bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.269+0000 7f68c45fd640 1 -- 172.21.15.100:0/1538786043 >> 172.21.15.100:0/1538786043 conn(0x7f68bc06de20 msgr2=0x7f68bc0c4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:02.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.269+0000 7f68c45fd640 1 -- 172.21.15.100:0/1538786043 shutdown_connections 2024-09-11T22:36:02.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.269+0000 7f68c45fd640 1 -- 172.21.15.100:0/1538786043 wait complete. 2024-09-11T22:36:02.281 INFO:tasks.ceph:Scrubbing osd.5 2024-09-11T22:36:02.282 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-11T22:36:02.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.386+0000 7fc00a0e4640 1 Processor -- start 2024-09-11T22:36:02.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.386+0000 7fc00a0e4640 1 -- start start 2024-09-11T22:36:02.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.386+0000 7fc00a0e4640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc004154d20 0x7fc0040cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.386+0000 7fc00a0e4640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc0040cc770 0x7fc0040cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.386+0000 7fc00a0e4640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0040c5d80 con 0x7fc004072230 2024-09-11T22:36:02.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.386+0000 7fc00a0e4640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fc00415ebe0 con 0x7fc004154d20 2024-09-11T22:36:02.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.386+0000 7fc00a0e4640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fc004155100 con 0x7fc0040cc770 2024-09-11T22:36:02.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.387+0000 7fc0037fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc004154d20 0x7fc0040cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.387+0000 7fc003fff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc004072230 0x7fc00415aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:35300/0 (socket says 172.21.15.100:35300) 2024-09-11T22:36:02.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.387+0000 7fc003fff640 1 -- 172.21.15.100:0/4007558150 learned_addr learned my addr 172.21.15.100:0/4007558150 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:36:02.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.387+0000 7fc0037fe640 1 -- 172.21.15.100:0/4007558150 >> v2:172.21.15.167:3300/0 conn(0x7fc0040cc770 msgr2=0x7fc0040cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:02.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.387+0000 7fc002ffd640 1 --2- 172.21.15.100:0/4007558150 >> v2:172.21.15.167:3300/0 conn(0x7fc0040cc770 0x7fc0040cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.387+0000 7fc0027fc640 1 -- 172.21.15.100:0/4007558150 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2344165327 0 0) 0x7fc0040c5d80 con 0x7fc004072230 2024-09-11T22:36:02.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.387+0000 7fc0037fe640 1 --2- 172.21.15.100:0/4007558150 >> v2:172.21.15.167:3300/0 conn(0x7fc0040cc770 0x7fc0040cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.387+0000 7fc0037fe640 1 -- 172.21.15.100:0/4007558150 >> v1:172.21.15.100:6789/0 conn(0x7fc004072230 legacy=0x7fc00415aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.387+0000 7fc0037fe640 1 -- 172.21.15.100:0/4007558150 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00415dfd0 con 0x7fc004154d20 2024-09-11T22:36:02.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.388+0000 7fc0037fe640 1 --2- 172.21.15.100:0/4007558150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc004154d20 0x7fc0040cb300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc0040ca980 tx=0x7fbff402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302174c5886d8642 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:02.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.388+0000 7fc0027fc640 1 -- 172.21.15.100:0/4007558150 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff4037070 con 0x7fc004154d20 2024-09-11T22:36:02.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.388+0000 7fc0027fc640 1 -- 172.21.15.100:0/4007558150 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff4032440 con 0x7fc004154d20 2024-09-11T22:36:02.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.388+0000 7fc0027fc640 1 -- 172.21.15.100:0/4007558150 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff402ae60 con 0x7fc004154d20 2024-09-11T22:36:02.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.388+0000 7fc00a0e4640 1 -- 172.21.15.100:0/4007558150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc004154d20 msgr2=0x7fc0040cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.388+0000 7fc00a0e4640 1 --2- 172.21.15.100:0/4007558150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc004154d20 0x7fc0040cb300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc0040ca980 tx=0x7fbff402a110 comp rx=0 tx=0).stop 2024-09-11T22:36:02.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.388+0000 7fc00a0e4640 1 -- 172.21.15.100:0/4007558150 shutdown_connections 2024-09-11T22:36:02.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.388+0000 7fc00a0e4640 1 --2- 172.21.15.100:0/4007558150 >> v2:172.21.15.167:3300/0 conn(0x7fc0040cc770 0x7fc0040cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.388+0000 7fc00a0e4640 1 --2- 172.21.15.100:0/4007558150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc004154d20 0x7fc0040cb300 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.388+0000 7fc00a0e4640 1 -- 172.21.15.100:0/4007558150 >> 172.21.15.100:0/4007558150 conn(0x7fc0040d0380 msgr2=0x7fc0040d0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:02.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.388+0000 7fc00a0e4640 1 -- 172.21.15.100:0/4007558150 shutdown_connections 2024-09-11T22:36:02.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.388+0000 7fc00a0e4640 1 -- 172.21.15.100:0/4007558150 wait complete. 2024-09-11T22:36:02.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.390+0000 7fc00a0e4640 1 Processor -- start 2024-09-11T22:36:02.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.390+0000 7fc00a0e4640 1 -- start start 2024-09-11T22:36:02.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.390+0000 7fc00a0e4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc004072230 0x7fc00415a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.390+0000 7fc00a0e4640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0040cc770 0x7fc0041597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.390+0000 7fc00a0e4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc004154d20 0x7fc00415c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.390+0000 7fc00a0e4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc00415e870 con 0x7fc004154d20 2024-09-11T22:36:02.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.390+0000 7fc00a0e4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc00415e590 con 0x7fc004072230 2024-09-11T22:36:02.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.390+0000 7fc00a0e4640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fc00415b1b0 con 0x7fc0040cc770 2024-09-11T22:36:02.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.391+0000 7fc003fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc004154d20 0x7fc00415c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.391+0000 7fc003fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc004154d20 0x7fc00415c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45572/0 (socket says 172.21.15.100:45572) 2024-09-11T22:36:02.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.391+0000 7fc003fff640 1 -- 172.21.15.100:0/3186187254 learned_addr learned my addr 172.21.15.100:0/3186187254 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:02.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.391+0000 7fc0037fe640 1 --2- 172.21.15.100:0/3186187254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc004072230 0x7fc00415a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.391+0000 7fc002ffd640 1 --2- 172.21.15.100:0/3186187254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0040cc770 0x7fc0041597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.391+0000 7fc003fff640 1 -- 172.21.15.100:0/3186187254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0040cc770 msgr2=0x7fc0041597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.391+0000 7fc003fff640 1 --2- 172.21.15.100:0/3186187254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0040cc770 0x7fc0041597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.391+0000 7fc003fff640 1 -- 172.21.15.100:0/3186187254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc004072230 msgr2=0x7fc00415a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.391+0000 7fc003fff640 1 --2- 172.21.15.100:0/3186187254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc004072230 0x7fc00415a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.391+0000 7fc003fff640 1 -- 172.21.15.100:0/3186187254 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0041f0550 con 0x7fc004154d20 2024-09-11T22:36:02.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.391+0000 7fc002ffd640 1 --2- 172.21.15.100:0/3186187254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc0040cc770 0x7fc0041597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:02.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.391+0000 7fc003fff640 1 --2- 172.21.15.100:0/3186187254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc004154d20 0x7fc00415c950 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00c7d0 tx=0x7fbffc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:02.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.391+0000 7fbfebfff640 1 -- 172.21.15.100:0/3186187254 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc018070 con 0x7fc004154d20 2024-09-11T22:36:02.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.391+0000 7fbfebfff640 1 -- 172.21.15.100:0/3186187254 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbffc00a640 con 0x7fc004154d20 2024-09-11T22:36:02.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.391+0000 7fbfebfff640 1 -- 172.21.15.100:0/3186187254 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc00aa70 con 0x7fc004154d20 2024-09-11T22:36:02.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.391+0000 7fc00a0e4640 1 -- 172.21.15.100:0/3186187254 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0041f0830 con 0x7fc004154d20 2024-09-11T22:36:02.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.391+0000 7fc00a0e4640 1 -- 172.21.15.100:0/3186187254 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0041f0df0 con 0x7fc004154d20 2024-09-11T22:36:02.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.392+0000 7fc00a0e4640 1 -- 172.21.15.100:0/3186187254 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc0040c70c0 con 0x7fc004154d20 2024-09-11T22:36:02.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.393+0000 7fbfebfff640 1 -- 172.21.15.100:0/3186187254 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbffc01b070 con 0x7fc004154d20 2024-09-11T22:36:02.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.393+0000 7fbfebfff640 1 --2- 172.21.15.100:0/3186187254 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbff006be30 0x7fbff006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.393+0000 7fbfebfff640 1 -- 172.21.15.100:0/3186187254 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fbffc08ade0 con 0x7fc004154d20 2024-09-11T22:36:02.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.393+0000 7fc0037fe640 1 --2- 172.21.15.100:0/3186187254 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbff006be30 0x7fbff006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.393+0000 7fbfebfff640 1 --2- 172.21.15.100:0/3186187254 >> [v2:172.21.15.167:6824/2479173909,v1:172.21.15.167:6825/2479173909] conn(0x7fbff00758d0 0x7fbff0077d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.393+0000 7fbfebfff640 1 -- 172.21.15.100:0/3186187254 --> [v2:172.21.15.167:6824/2479173909,v1:172.21.15.167:6825/2479173909] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbffc01fe50 con 0x7fbff00758d0 2024-09-11T22:36:02.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.393+0000 7fbfebfff640 1 -- 172.21.15.100:0/3186187254 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbffc08b270 con 0x7fc004154d20 2024-09-11T22:36:02.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.394+0000 7fc002ffd640 1 --2- 172.21.15.100:0/3186187254 >> [v2:172.21.15.167:6824/2479173909,v1:172.21.15.167:6825/2479173909] conn(0x7fbff00758d0 0x7fbff0077d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.394+0000 7fc0037fe640 1 --2- 172.21.15.100:0/3186187254 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbff006be30 0x7fbff006e2f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fbff4034000 tx=0x7fbff402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:02.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.394+0000 7fc002ffd640 1 --2- 172.21.15.100:0/3186187254 >> [v2:172.21.15.167:6824/2479173909,v1:172.21.15.167:6825/2479173909] conn(0x7fbff00758d0 0x7fbff0077d70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:02.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.395+0000 7fbfebfff640 1 -- 172.21.15.100:0/3186187254 <== osd.5 v2:172.21.15.167:6824/2479173909 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbffc01fe50 con 0x7fbff00758d0 2024-09-11T22:36:02.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.407+0000 7fc00a0e4640 1 -- 172.21.15.100:0/3186187254 --> [v2:172.21.15.167:6824/2479173909,v1:172.21.15.167:6825/2479173909] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc0041520d0 con 0x7fbff00758d0 2024-09-11T22:36:02.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.408+0000 7fbfebfff640 1 -- 172.21.15.100:0/3186187254 <== osd.5 v2:172.21.15.167:6824/2479173909 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc0041520d0 con 0x7fbff00758d0 2024-09-11T22:36:02.409 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:36:02.409 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T22:36:02.409 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:36:02.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.408+0000 7fc00a0e4640 1 -- 172.21.15.100:0/3186187254 >> [v2:172.21.15.167:6824/2479173909,v1:172.21.15.167:6825/2479173909] conn(0x7fbff00758d0 msgr2=0x7fbff0077d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.408+0000 7fc00a0e4640 1 --2- 172.21.15.100:0/3186187254 >> [v2:172.21.15.167:6824/2479173909,v1:172.21.15.167:6825/2479173909] conn(0x7fbff00758d0 0x7fbff0077d70 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.408+0000 7fc00a0e4640 1 -- 172.21.15.100:0/3186187254 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbff006be30 msgr2=0x7fbff006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.408+0000 7fc00a0e4640 1 --2- 172.21.15.100:0/3186187254 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbff006be30 0x7fbff006e2f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fbff4034000 tx=0x7fbff402e000 comp rx=0 tx=0).stop 2024-09-11T22:36:02.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.408+0000 7fc00a0e4640 1 -- 172.21.15.100:0/3186187254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc004154d20 msgr2=0x7fc00415c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.408+0000 7fc00a0e4640 1 --2- 172.21.15.100:0/3186187254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc004154d20 0x7fc00415c950 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00c7d0 tx=0x7fbffc00cc90 comp rx=0 tx=0).stop 2024-09-11T22:36:02.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.408+0000 7fc003fff640 1 -- 172.21.15.100:0/3186187254 reap_dead start 2024-09-11T22:36:02.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.408+0000 7fc00a0e4640 1 -- 172.21.15.100:0/3186187254 shutdown_connections 2024-09-11T22:36:02.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.408+0000 7fc00a0e4640 1 -- 172.21.15.100:0/3186187254 >> 172.21.15.100:0/3186187254 conn(0x7fc0040d0380 msgr2=0x7fc00414a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:02.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.409+0000 7fc00a0e4640 1 -- 172.21.15.100:0/3186187254 shutdown_connections 2024-09-11T22:36:02.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.409+0000 7fc00a0e4640 1 -- 172.21.15.100:0/3186187254 wait complete. 2024-09-11T22:36:02.420 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-11T22:36:02.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.520+0000 7fd08a650640 1 Processor -- start 2024-09-11T22:36:02.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.520+0000 7fd08a650640 1 -- start start 2024-09-11T22:36:02.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.521+0000 7fd08a650640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd084154cd0 0x7fd08415bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.521+0000 7fd08a650640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd08415e7c0 0x7fd0840cc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.521+0000 7fd08a650640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd0840c71e0 0x7fd0840ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.521+0000 7fd08a650640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fd08415ecb0 con 0x7fd0840c71e0 2024-09-11T22:36:02.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.521+0000 7fd08a650640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fd0840738d0 con 0x7fd084154cd0 2024-09-11T22:36:02.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.521+0000 7fd08a650640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd084072830 con 0x7fd08415e7c0 2024-09-11T22:36:02.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.521+0000 7fd088bed640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd0840c71e0 0x7fd0840ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.521+0000 7fd088bed640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd0840c71e0 0x7fd0840ccc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45582/0 (socket says 172.21.15.100:45582) 2024-09-11T22:36:02.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.521+0000 7fd088bed640 1 -- 172.21.15.100:0/1306585708 learned_addr learned my addr 172.21.15.100:0/1306585708 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:02.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.521+0000 7fd0837fe640 1 --2- 172.21.15.100:0/1306585708 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd08415e7c0 0x7fd0840cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.521+0000 7fd083fff640 1 --2- 172.21.15.100:0/1306585708 >> v2:172.21.15.167:3300/0 conn(0x7fd084154cd0 0x7fd08415bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.522+0000 7fd088bed640 1 -- 172.21.15.100:0/1306585708 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd08415e7c0 msgr2=0x7fd0840cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:02.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.522+0000 7fd088bed640 1 --2- 172.21.15.100:0/1306585708 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd08415e7c0 0x7fd0840cc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.522+0000 7fd088bed640 1 -- 172.21.15.100:0/1306585708 >> v2:172.21.15.167:3300/0 conn(0x7fd084154cd0 msgr2=0x7fd08415bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:02.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.522+0000 7fd088bed640 1 --2- 172.21.15.100:0/1306585708 >> v2:172.21.15.167:3300/0 conn(0x7fd084154cd0 0x7fd08415bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.522+0000 7fd088bed640 1 -- 172.21.15.100:0/1306585708 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd084072b10 con 0x7fd0840c71e0 2024-09-11T22:36:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.523+0000 7fd088bed640 1 --2- 172.21.15.100:0/1306585708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0840c71e0 0x7fd0840ccc80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd084071820 tx=0x7fd07c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541a3610393f6f23 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.523+0000 7fd082ffd640 1 -- 172.21.15.100:0/1306585708 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c036070 con 0x7fd0840c71e0 2024-09-11T22:36:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.523+0000 7fd082ffd640 1 -- 172.21.15.100:0/1306585708 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd07c031600 con 0x7fd0840c71e0 2024-09-11T22:36:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.523+0000 7fd082ffd640 1 -- 172.21.15.100:0/1306585708 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07c0319d0 con 0x7fd0840c71e0 2024-09-11T22:36:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.523+0000 7fd08a650640 1 -- 172.21.15.100:0/1306585708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0840c71e0 msgr2=0x7fd0840ccc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.523+0000 7fd08a650640 1 --2- 172.21.15.100:0/1306585708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0840c71e0 0x7fd0840ccc80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd084071820 tx=0x7fd07c02a6c0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.523+0000 7fd08a650640 1 -- 172.21.15.100:0/1306585708 shutdown_connections 2024-09-11T22:36:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.523+0000 7fd08a650640 1 --2- 172.21.15.100:0/1306585708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0840c71e0 0x7fd0840ccc80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.523+0000 7fd08a650640 1 --2- 172.21.15.100:0/1306585708 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd08415e7c0 0x7fd0840cc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.523+0000 7fd08a650640 1 --2- 172.21.15.100:0/1306585708 >> v2:172.21.15.167:3300/0 conn(0x7fd084154cd0 0x7fd08415bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.523+0000 7fd08a650640 1 -- 172.21.15.100:0/1306585708 >> 172.21.15.100:0/1306585708 conn(0x7fd08406fa70 msgr2=0x7fd08406fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:02.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.523+0000 7fd08a650640 1 -- 172.21.15.100:0/1306585708 shutdown_connections 2024-09-11T22:36:02.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.523+0000 7fd08a650640 1 -- 172.21.15.100:0/1306585708 wait complete. 2024-09-11T22:36:02.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.525+0000 7fd08a650640 1 Processor -- start 2024-09-11T22:36:02.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.525+0000 7fd08a650640 1 -- start start 2024-09-11T22:36:02.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.525+0000 7fd08a650640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0840c71e0 0x7fd08415d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.525+0000 7fd08a650640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd084154cd0 0x7fd084155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.525+0000 7fd08a650640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd08415e7c0 0x7fd0841f08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.525+0000 7fd08a650640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd084075770 con 0x7fd0840c71e0 2024-09-11T22:36:02.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.525+0000 7fd08a650640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd0840730d0 con 0x7fd08415e7c0 2024-09-11T22:36:02.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.525+0000 7fd08a650640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd0840c7800 con 0x7fd084154cd0 2024-09-11T22:36:02.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.526+0000 7fd083fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0840c71e0 0x7fd08415d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.526+0000 7fd083fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0840c71e0 0x7fd08415d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45586/0 (socket says 172.21.15.100:45586) 2024-09-11T22:36:02.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.526+0000 7fd083fff640 1 -- 172.21.15.100:0/3440160659 learned_addr learned my addr 172.21.15.100:0/3440160659 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:02.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.526+0000 7fd0837fe640 1 --2- 172.21.15.100:0/3440160659 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd084154cd0 0x7fd084155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.526+0000 7fd088bed640 1 --2- 172.21.15.100:0/3440160659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd08415e7c0 0x7fd0841f08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.526+0000 7fd083fff640 1 -- 172.21.15.100:0/3440160659 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd084154cd0 msgr2=0x7fd084155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.526+0000 7fd083fff640 1 --2- 172.21.15.100:0/3440160659 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd084154cd0 0x7fd084155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.526+0000 7fd083fff640 1 -- 172.21.15.100:0/3440160659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd08415e7c0 msgr2=0x7fd0841f08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.526+0000 7fd083fff640 1 --2- 172.21.15.100:0/3440160659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd08415e7c0 0x7fd0841f08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.526+0000 7fd083fff640 1 -- 172.21.15.100:0/3440160659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd08414f2a0 con 0x7fd0840c71e0 2024-09-11T22:36:02.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.526+0000 7fd088bed640 1 --2- 172.21.15.100:0/3440160659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd08415e7c0 0x7fd0841f08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:36:02.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.526+0000 7fd083fff640 1 --2- 172.21.15.100:0/3440160659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0840c71e0 0x7fd08415d210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd07400e8c0 tx=0x7fd07400ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:02.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.526+0000 7fd080ff9640 1 -- 172.21.15.100:0/3440160659 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd074017070 con 0x7fd0840c71e0 2024-09-11T22:36:02.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.526+0000 7fd080ff9640 1 -- 172.21.15.100:0/3440160659 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd07400c940 con 0x7fd0840c71e0 2024-09-11T22:36:02.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.526+0000 7fd08a650640 1 -- 172.21.15.100:0/3440160659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd08414f5e0 con 0x7fd0840c71e0 2024-09-11T22:36:02.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.526+0000 7fd080ff9640 1 -- 172.21.15.100:0/3440160659 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07400cd10 con 0x7fd0840c71e0 2024-09-11T22:36:02.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.526+0000 7fd08a650640 1 -- 172.21.15.100:0/3440160659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd08414fba0 con 0x7fd0840c71e0 2024-09-11T22:36:02.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.527+0000 7fd08a650640 1 -- 172.21.15.100:0/3440160659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd08415bcb0 con 0x7fd0840c71e0 2024-09-11T22:36:02.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.528+0000 7fd080ff9640 1 -- 172.21.15.100:0/3440160659 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd07401a070 con 0x7fd0840c71e0 2024-09-11T22:36:02.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.528+0000 7fd080ff9640 1 --2- 172.21.15.100:0/3440160659 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd06406be60 0x7fd06406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.528+0000 7fd080ff9640 1 -- 172.21.15.100:0/3440160659 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fd07408b670 con 0x7fd0840c71e0 2024-09-11T22:36:02.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.528+0000 7fd0837fe640 1 --2- 172.21.15.100:0/3440160659 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd06406be60 0x7fd06406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.529+0000 7fd0837fe640 1 --2- 172.21.15.100:0/3440160659 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd06406be60 0x7fd06406e320 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd084152a30 tx=0x7fd06c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:02.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.536+0000 7fd080ff9640 1 -- 172.21.15.100:0/3440160659 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd074059b70 con 0x7fd0840c71e0 2024-09-11T22:36:02.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.710+0000 7fd08a650640 1 -- 172.21.15.100:0/3440160659 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fd0840722d0 con 0x7fd06406be60 2024-09-11T22:36:02.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.710+0000 7fd080ff9640 1 -- 172.21.15.100:0/3440160659 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd0840722d0 con 0x7fd06406be60 2024-09-11T22:36:02.711 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 5 to deep-scrub 2024-09-11T22:36:02.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.712+0000 7fd08a650640 1 -- 172.21.15.100:0/3440160659 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd06406be60 msgr2=0x7fd06406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.712+0000 7fd08a650640 1 --2- 172.21.15.100:0/3440160659 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd06406be60 0x7fd06406e320 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd084152a30 tx=0x7fd06c008040 comp rx=0 tx=0).stop 2024-09-11T22:36:02.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.713+0000 7fd08a650640 1 -- 172.21.15.100:0/3440160659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0840c71e0 msgr2=0x7fd08415d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.713+0000 7fd08a650640 1 --2- 172.21.15.100:0/3440160659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0840c71e0 0x7fd08415d210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd07400e8c0 tx=0x7fd07400ed80 comp rx=0 tx=0).stop 2024-09-11T22:36:02.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.713+0000 7fd08a650640 1 -- 172.21.15.100:0/3440160659 shutdown_connections 2024-09-11T22:36:02.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.713+0000 7fd08a650640 1 --2- 172.21.15.100:0/3440160659 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd06406be60 0x7fd06406e320 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.713+0000 7fd08a650640 1 --2- 172.21.15.100:0/3440160659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd08415e7c0 0x7fd0841f08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.713+0000 7fd08a650640 1 --2- 172.21.15.100:0/3440160659 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd084154cd0 0x7fd084155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.713+0000 7fd08a650640 1 --2- 172.21.15.100:0/3440160659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0840c71e0 0x7fd08415d210 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.713+0000 7fd08a650640 1 -- 172.21.15.100:0/3440160659 >> 172.21.15.100:0/3440160659 conn(0x7fd08406fa70 msgr2=0x7fd0840c6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:02.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.713+0000 7fd08a650640 1 -- 172.21.15.100:0/3440160659 shutdown_connections 2024-09-11T22:36:02.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.713+0000 7fd08a650640 1 -- 172.21.15.100:0/3440160659 wait complete. 2024-09-11T22:36:02.725 INFO:tasks.ceph:Scrubbing osd.6 2024-09-11T22:36:02.725 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-11T22:36:02.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.828+0000 7f85970ae640 1 Processor -- start 2024-09-11T22:36:02.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.828+0000 7f85970ae640 1 -- start start 2024-09-11T22:36:02.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.829+0000 7f85970ae640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8590157f50 0x7f8590158330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.829+0000 7f85970ae640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f859015bcc0 0x7f85900c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.829+0000 7f85970ae640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8590070050 con 0x7f85900c5130 2024-09-11T22:36:02.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.829+0000 7f85970ae640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f859015c190 con 0x7f859015bcc0 2024-09-11T22:36:02.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.829+0000 7f85970ae640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f859015c470 con 0x7f8590157f50 2024-09-11T22:36:02.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.829+0000 7f858ffff640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f859015bcc0 0x7f85900c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.829+0000 7f8594e4a640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8590157f50 0x7f8590158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.829+0000 7f859564b640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f85900c5130 0x7f8590158f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:48710/0 (socket says 172.21.15.100:48710) 2024-09-11T22:36:02.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.829+0000 7f859564b640 1 -- 172.21.15.100:0/4090149094 learned_addr learned my addr 172.21.15.100:0/4090149094 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:36:02.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.830+0000 7f858ffff640 1 -- 172.21.15.100:0/4090149094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8590157f50 msgr2=0x7f8590158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:02.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.830+0000 7f858ffff640 1 --2- 172.21.15.100:0/4090149094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8590157f50 0x7f8590158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.830+0000 7f858ffff640 1 -- 172.21.15.100:0/4090149094 >> v1:172.21.15.167:6789/0 conn(0x7f85900c5130 legacy=0x7f8590158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.830+0000 7f858f7fe640 1 -- 172.21.15.100:0/4090149094 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3337579891 0 0) 0x7f8590070050 con 0x7f85900c5130 2024-09-11T22:36:02.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.830+0000 7f858ffff640 1 -- 172.21.15.100:0/4090149094 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859015c750 con 0x7f859015bcc0 2024-09-11T22:36:02.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.830+0000 7f8594e4a640 1 --2- 172.21.15.100:0/4090149094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8590157f50 0x7f8590158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:36:02.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.830+0000 7f858ffff640 1 --2- 172.21.15.100:0/4090149094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f859015bcc0 0x7f85900c8c50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f857c0097a0 tx=0x7f857c02a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bae0ee491ef74aa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:02.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.831+0000 7f858f7fe640 1 -- 172.21.15.100:0/4090149094 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c037070 con 0x7f859015bcc0 2024-09-11T22:36:02.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.831+0000 7f858f7fe640 1 -- 172.21.15.100:0/4090149094 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f857c032440 con 0x7f859015bcc0 2024-09-11T22:36:02.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.831+0000 7f858f7fe640 1 -- 172.21.15.100:0/4090149094 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c032810 con 0x7f859015bcc0 2024-09-11T22:36:02.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.831+0000 7f85970ae640 1 -- 172.21.15.100:0/4090149094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f859015bcc0 msgr2=0x7f85900c8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.831+0000 7f85970ae640 1 --2- 172.21.15.100:0/4090149094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f859015bcc0 0x7f85900c8c50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f857c0097a0 tx=0x7f857c02a210 comp rx=0 tx=0).stop 2024-09-11T22:36:02.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.831+0000 7f85970ae640 1 -- 172.21.15.100:0/4090149094 shutdown_connections 2024-09-11T22:36:02.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.831+0000 7f85970ae640 1 --2- 172.21.15.100:0/4090149094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f859015bcc0 0x7f85900c8c50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.831+0000 7f85970ae640 1 --2- 172.21.15.100:0/4090149094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8590157f50 0x7f8590158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.831+0000 7f85970ae640 1 -- 172.21.15.100:0/4090149094 >> 172.21.15.100:0/4090149094 conn(0x7f8590068090 msgr2=0x7f8590071580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:02.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.831+0000 7f85970ae640 1 -- 172.21.15.100:0/4090149094 shutdown_connections 2024-09-11T22:36:02.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.831+0000 7f85970ae640 1 -- 172.21.15.100:0/4090149094 wait complete. 2024-09-11T22:36:02.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.832+0000 7f85970ae640 1 Processor -- start 2024-09-11T22:36:02.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.832+0000 7f85970ae640 1 -- start start 2024-09-11T22:36:02.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.833+0000 7f85970ae640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85900c5130 0x7f85901f1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.833+0000 7f85970ae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8590157f50 0x7f85901556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.833+0000 7f85970ae640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f859015bcc0 0x7f8590156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.833+0000 7f85970ae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8590159640 con 0x7f8590157f50 2024-09-11T22:36:02.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.833+0000 7f85970ae640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8590158a10 con 0x7f85900c5130 2024-09-11T22:36:02.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.833+0000 7f85970ae640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f85900cace0 con 0x7f859015bcc0 2024-09-11T22:36:02.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.833+0000 7f858ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8590157f50 0x7f85901556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.833+0000 7f858ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8590157f50 0x7f85901556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45592/0 (socket says 172.21.15.100:45592) 2024-09-11T22:36:02.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.833+0000 7f858ffff640 1 -- 172.21.15.100:0/45225997 learned_addr learned my addr 172.21.15.100:0/45225997 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:02.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.833+0000 7f859564b640 1 --2- 172.21.15.100:0/45225997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f859015bcc0 0x7f8590156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.833+0000 7f8594e4a640 1 --2- 172.21.15.100:0/45225997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85900c5130 0x7f85901f1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.834+0000 7f858ffff640 1 -- 172.21.15.100:0/45225997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f859015bcc0 msgr2=0x7f8590156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.834+0000 7f858ffff640 1 --2- 172.21.15.100:0/45225997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f859015bcc0 0x7f8590156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.834+0000 7f858ffff640 1 -- 172.21.15.100:0/45225997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85900c5130 msgr2=0x7f85901f1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.834+0000 7f858ffff640 1 --2- 172.21.15.100:0/45225997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85900c5130 0x7f85901f1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.834+0000 7f858ffff640 1 -- 172.21.15.100:0/45225997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859014ac60 con 0x7f8590157f50 2024-09-11T22:36:02.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.834+0000 7f859564b640 1 --2- 172.21.15.100:0/45225997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f859015bcc0 0x7f8590156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:02.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.834+0000 7f8594e4a640 1 --2- 172.21.15.100:0/45225997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85900c5130 0x7f85901f1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:02.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.834+0000 7f858ffff640 1 --2- 172.21.15.100:0/45225997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8590157f50 0x7f85901556b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f857c035040 tx=0x7f857c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:02.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.834+0000 7f858d7fa640 1 -- 172.21.15.100:0/45225997 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c037050 con 0x7f8590157f50 2024-09-11T22:36:02.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.834+0000 7f85970ae640 1 -- 172.21.15.100:0/45225997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f859006d880 con 0x7f8590157f50 2024-09-11T22:36:02.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.834+0000 7f858d7fa640 1 -- 172.21.15.100:0/45225997 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f857c038040 con 0x7f8590157f50 2024-09-11T22:36:02.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.834+0000 7f858d7fa640 1 -- 172.21.15.100:0/45225997 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c004490 con 0x7f8590157f50 2024-09-11T22:36:02.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.834+0000 7f85970ae640 1 -- 172.21.15.100:0/45225997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85901f0a00 con 0x7f8590157f50 2024-09-11T22:36:02.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.835+0000 7f85970ae640 1 -- 172.21.15.100:0/45225997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f859006d630 con 0x7f8590157f50 2024-09-11T22:36:02.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.836+0000 7f858d7fa640 1 -- 172.21.15.100:0/45225997 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f857c03c6d0 con 0x7f8590157f50 2024-09-11T22:36:02.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.836+0000 7f858d7fa640 1 --2- 172.21.15.100:0/45225997 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f857406be30 0x7f857406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.836+0000 7f858d7fa640 1 -- 172.21.15.100:0/45225997 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f857c0ac870 con 0x7f8590157f50 2024-09-11T22:36:02.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.836+0000 7f8594e4a640 1 --2- 172.21.15.100:0/45225997 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f857406be30 0x7f857406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.836+0000 7f858d7fa640 1 --2- 172.21.15.100:0/45225997 >> [v2:172.21.15.167:6808/2825112504,v1:172.21.15.167:6809/2825112504] conn(0x7f8574075850 0x7f8574077cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.836+0000 7f858d7fa640 1 -- 172.21.15.100:0/45225997 --> [v2:172.21.15.167:6808/2825112504,v1:172.21.15.167:6809/2825112504] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f857c008eb0 con 0x7f8574075850 2024-09-11T22:36:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.836+0000 7f858d7fa640 1 -- 172.21.15.100:0/45225997 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f857c0acd00 con 0x7f8590157f50 2024-09-11T22:36:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.836+0000 7f8594e4a640 1 --2- 172.21.15.100:0/45225997 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f857406be30 0x7f857406e2f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8584009ba0 tx=0x7f8584008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.837+0000 7f859564b640 1 --2- 172.21.15.100:0/45225997 >> [v2:172.21.15.167:6808/2825112504,v1:172.21.15.167:6809/2825112504] conn(0x7f8574075850 0x7f8574077cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.837+0000 7f859564b640 1 --2- 172.21.15.100:0/45225997 >> [v2:172.21.15.167:6808/2825112504,v1:172.21.15.167:6809/2825112504] conn(0x7f8574075850 0x7f8574077cf0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.838+0000 7f858d7fa640 1 -- 172.21.15.100:0/45225997 <== osd.6 v2:172.21.15.167:6808/2825112504 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f857c008eb0 con 0x7f8574075850 2024-09-11T22:36:02.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.850+0000 7f85970ae640 1 -- 172.21.15.100:0/45225997 --> [v2:172.21.15.167:6808/2825112504,v1:172.21.15.167:6809/2825112504] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8590158330 con 0x7f8574075850 2024-09-11T22:36:02.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.851+0000 7f858d7fa640 1 -- 172.21.15.100:0/45225997 <== osd.6 v2:172.21.15.167:6808/2825112504 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8590158330 con 0x7f8574075850 2024-09-11T22:36:02.852 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:36:02.852 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T22:36:02.852 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:36:02.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.851+0000 7f85970ae640 1 -- 172.21.15.100:0/45225997 >> [v2:172.21.15.167:6808/2825112504,v1:172.21.15.167:6809/2825112504] conn(0x7f8574075850 msgr2=0x7f8574077cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.851+0000 7f85970ae640 1 --2- 172.21.15.100:0/45225997 >> [v2:172.21.15.167:6808/2825112504,v1:172.21.15.167:6809/2825112504] conn(0x7f8574075850 0x7f8574077cf0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.851+0000 7f85970ae640 1 -- 172.21.15.100:0/45225997 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f857406be30 msgr2=0x7f857406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.851+0000 7f85970ae640 1 --2- 172.21.15.100:0/45225997 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f857406be30 0x7f857406e2f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8584009ba0 tx=0x7f8584008040 comp rx=0 tx=0).stop 2024-09-11T22:36:02.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.851+0000 7f85970ae640 1 -- 172.21.15.100:0/45225997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8590157f50 msgr2=0x7f85901556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.851+0000 7f85970ae640 1 --2- 172.21.15.100:0/45225997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8590157f50 0x7f85901556b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f857c035040 tx=0x7f857c0046c0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.851+0000 7f859564b640 1 -- 172.21.15.100:0/45225997 reap_dead start 2024-09-11T22:36:02.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.851+0000 7f85970ae640 1 -- 172.21.15.100:0/45225997 shutdown_connections 2024-09-11T22:36:02.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.851+0000 7f85970ae640 1 -- 172.21.15.100:0/45225997 >> 172.21.15.100:0/45225997 conn(0x7f8590068090 msgr2=0x7f85900cb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:02.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.851+0000 7f85970ae640 1 -- 172.21.15.100:0/45225997 shutdown_connections 2024-09-11T22:36:02.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.851+0000 7f85970ae640 1 -- 172.21.15.100:0/45225997 wait complete. 2024-09-11T22:36:02.863 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-11T22:36:02.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.963+0000 7fcaccd03640 1 Processor -- start 2024-09-11T22:36:02.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.963+0000 7fcaccd03640 1 -- start start 2024-09-11T22:36:02.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.964+0000 7fcaccd03640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcac8154cd0 0x7fcac815bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.964+0000 7fcaccd03640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcac815e7c0 0x7fcac80cc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.964+0000 7fcaccd03640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcac80738d0 con 0x7fcac80c71e0 2024-09-11T22:36:02.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.964+0000 7fcaccd03640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fcac815ecb0 con 0x7fcac8154cd0 2024-09-11T22:36:02.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.964+0000 7fcaccd03640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcac8072830 con 0x7fcac815e7c0 2024-09-11T22:36:02.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.964+0000 7fcac6d9d640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fcac80c71e0 0x7fcac815a7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:35312/0 (socket says 172.21.15.100:35312) 2024-09-11T22:36:02.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.964+0000 7fcac6d9d640 1 -- 172.21.15.100:0/143786911 learned_addr learned my addr 172.21.15.100:0/143786911 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:36:02.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.964+0000 7fcac659c640 1 --2- 172.21.15.100:0/143786911 >> v2:172.21.15.100:3300/0 conn(0x7fcac8154cd0 0x7fcac815bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.964+0000 7fcac5d9b640 1 --2- 172.21.15.100:0/143786911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcac815e7c0 0x7fcac80cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.964+0000 7fcac659c640 1 -- 172.21.15.100:0/143786911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcac815e7c0 msgr2=0x7fcac80cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:02.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.964+0000 7fcac659c640 1 --2- 172.21.15.100:0/143786911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcac815e7c0 0x7fcac80cc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.964+0000 7fcac659c640 1 -- 172.21.15.100:0/143786911 >> v1:172.21.15.100:6789/0 conn(0x7fcac80c71e0 legacy=0x7fcac815a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.964+0000 7fcac659c640 1 -- 172.21.15.100:0/143786911 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac8072b10 con 0x7fcac8154cd0 2024-09-11T22:36:02.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.964+0000 7fcac5d9b640 1 --2- 172.21.15.100:0/143786911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcac815e7c0 0x7fcac80cc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:02.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.965+0000 7fcac659c640 1 --2- 172.21.15.100:0/143786911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcac8154cd0 0x7fcac815bcb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcab00097a0 tx=0x7fcab002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ee712110d4c67 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:02.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.965+0000 7fcac559a640 1 -- 172.21.15.100:0/143786911 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab0037070 con 0x7fcac8154cd0 2024-09-11T22:36:02.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.965+0000 7fcac559a640 1 -- 172.21.15.100:0/143786911 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcab0032440 con 0x7fcac8154cd0 2024-09-11T22:36:02.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.965+0000 7fcac559a640 1 -- 172.21.15.100:0/143786911 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab0032810 con 0x7fcac8154cd0 2024-09-11T22:36:02.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.966+0000 7fcaccd03640 1 -- 172.21.15.100:0/143786911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcac8154cd0 msgr2=0x7fcac815bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.966+0000 7fcaccd03640 1 --2- 172.21.15.100:0/143786911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcac8154cd0 0x7fcac815bcb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcab00097a0 tx=0x7fcab002a180 comp rx=0 tx=0).stop 2024-09-11T22:36:02.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.966+0000 7fcaccd03640 1 -- 172.21.15.100:0/143786911 shutdown_connections 2024-09-11T22:36:02.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.966+0000 7fcaccd03640 1 --2- 172.21.15.100:0/143786911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcac815e7c0 0x7fcac80cc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.966+0000 7fcaccd03640 1 --2- 172.21.15.100:0/143786911 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcac8154cd0 0x7fcac815bcb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.966+0000 7fcaccd03640 1 -- 172.21.15.100:0/143786911 >> 172.21.15.100:0/143786911 conn(0x7fcac806fa70 msgr2=0x7fcac806fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:02.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.966+0000 7fcaccd03640 1 -- 172.21.15.100:0/143786911 shutdown_connections 2024-09-11T22:36:02.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.966+0000 7fcaccd03640 1 -- 172.21.15.100:0/143786911 wait complete. 2024-09-11T22:36:02.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.967+0000 7fcaccd03640 1 Processor -- start 2024-09-11T22:36:02.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.967+0000 7fcaccd03640 1 -- start start 2024-09-11T22:36:02.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.968+0000 7fcaccd03640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcac80c71e0 0x7fcac8156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.968+0000 7fcaccd03640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcac8154cd0 0x7fcac81f11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.968+0000 7fcaccd03640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcac815e7c0 0x7fcac80c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.968+0000 7fcaccd03640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcac8075770 con 0x7fcac80c71e0 2024-09-11T22:36:02.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.968+0000 7fcaccd03640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcac80730d0 con 0x7fcac8154cd0 2024-09-11T22:36:02.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.968+0000 7fcaccd03640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fcac80c7800 con 0x7fcac815e7c0 2024-09-11T22:36:02.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.968+0000 7fcac659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcac80c71e0 0x7fcac8156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.968+0000 7fcac659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcac80c71e0 0x7fcac8156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45618/0 (socket says 172.21.15.100:45618) 2024-09-11T22:36:02.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.968+0000 7fcac659c640 1 -- 172.21.15.100:0/2986536397 learned_addr learned my addr 172.21.15.100:0/2986536397 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:02.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.968+0000 7fcac6d9d640 1 --2- 172.21.15.100:0/2986536397 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcac815e7c0 0x7fcac80c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.968+0000 7fcac5d9b640 1 --2- 172.21.15.100:0/2986536397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcac8154cd0 0x7fcac81f11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.968+0000 7fcac659c640 1 -- 172.21.15.100:0/2986536397 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcac815e7c0 msgr2=0x7fcac80c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.968+0000 7fcac659c640 1 --2- 172.21.15.100:0/2986536397 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcac815e7c0 0x7fcac80c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.968+0000 7fcac659c640 1 -- 172.21.15.100:0/2986536397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcac8154cd0 msgr2=0x7fcac81f11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:02.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.968+0000 7fcac659c640 1 --2- 172.21.15.100:0/2986536397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcac8154cd0 0x7fcac81f11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:02.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.968+0000 7fcac659c640 1 -- 172.21.15.100:0/2986536397 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac81f1730 con 0x7fcac80c71e0 2024-09-11T22:36:02.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.969+0000 7fcac6d9d640 1 --2- 172.21.15.100:0/2986536397 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcac815e7c0 0x7fcac80c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:02.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.969+0000 7fcac5d9b640 1 --2- 172.21.15.100:0/2986536397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcac8154cd0 0x7fcac81f11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:02.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.969+0000 7fcac659c640 1 --2- 172.21.15.100:0/2986536397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcac80c71e0 0x7fcac8156170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcab00097a0 tx=0x7fcab00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:02.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.969+0000 7fcabeffd640 1 -- 172.21.15.100:0/2986536397 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab0041070 con 0x7fcac80c71e0 2024-09-11T22:36:02.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.969+0000 7fcabeffd640 1 -- 172.21.15.100:0/2986536397 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcab003c930 con 0x7fcac80c71e0 2024-09-11T22:36:02.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.969+0000 7fcabeffd640 1 -- 172.21.15.100:0/2986536397 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab0037040 con 0x7fcac80c71e0 2024-09-11T22:36:02.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.969+0000 7fcaccd03640 1 -- 172.21.15.100:0/2986536397 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcac8155bb0 con 0x7fcac80c71e0 2024-09-11T22:36:02.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.969+0000 7fcaccd03640 1 -- 172.21.15.100:0/2986536397 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcac815b1f0 con 0x7fcac80c71e0 2024-09-11T22:36:02.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.970+0000 7fcaccd03640 1 -- 172.21.15.100:0/2986536397 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcac8151210 con 0x7fcac80c71e0 2024-09-11T22:36:02.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.970+0000 7fcabeffd640 1 -- 172.21.15.100:0/2986536397 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcab0044070 con 0x7fcac80c71e0 2024-09-11T22:36:02.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.971+0000 7fcabeffd640 1 --2- 172.21.15.100:0/2986536397 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcaa806be30 0x7fcaa806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:02.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.971+0000 7fcabeffd640 1 -- 172.21.15.100:0/2986536397 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fcab00abf50 con 0x7fcac80c71e0 2024-09-11T22:36:02.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.971+0000 7fcac5d9b640 1 --2- 172.21.15.100:0/2986536397 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcaa806be30 0x7fcaa806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:02.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.971+0000 7fcac5d9b640 1 --2- 172.21.15.100:0/2986536397 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcaa806be30 0x7fcaa806e2f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fcac8158300 tx=0x7fcab8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:02.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:02.979+0000 7fcabeffd640 1 -- 172.21.15.100:0/2986536397 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcab007a570 con 0x7fcac80c71e0 2024-09-11T22:36:03.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.153+0000 7fcaccd03640 1 -- 172.21.15.100:0/2986536397 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fcac8155960 con 0x7fcaa806be30 2024-09-11T22:36:03.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.153+0000 7fcabeffd640 1 -- 172.21.15.100:0/2986536397 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcac8155960 con 0x7fcaa806be30 2024-09-11T22:36:03.154 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 6 to deep-scrub 2024-09-11T22:36:03.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.155+0000 7fcaccd03640 1 -- 172.21.15.100:0/2986536397 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcaa806be30 msgr2=0x7fcaa806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:03.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.155+0000 7fcaccd03640 1 --2- 172.21.15.100:0/2986536397 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcaa806be30 0x7fcaa806e2f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fcac8158300 tx=0x7fcab8008040 comp rx=0 tx=0).stop 2024-09-11T22:36:03.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.155+0000 7fcaccd03640 1 -- 172.21.15.100:0/2986536397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcac80c71e0 msgr2=0x7fcac8156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:03.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.155+0000 7fcaccd03640 1 --2- 172.21.15.100:0/2986536397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcac80c71e0 0x7fcac8156170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcab00097a0 tx=0x7fcab00046c0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.155+0000 7fcaccd03640 1 -- 172.21.15.100:0/2986536397 shutdown_connections 2024-09-11T22:36:03.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.155+0000 7fcaccd03640 1 --2- 172.21.15.100:0/2986536397 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fcaa806be30 0x7fcaa806e2f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.155+0000 7fcaccd03640 1 --2- 172.21.15.100:0/2986536397 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcac815e7c0 0x7fcac80c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.155+0000 7fcaccd03640 1 --2- 172.21.15.100:0/2986536397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcac8154cd0 0x7fcac81f11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.155+0000 7fcaccd03640 1 --2- 172.21.15.100:0/2986536397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcac80c71e0 0x7fcac8156170 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.155+0000 7fcaccd03640 1 -- 172.21.15.100:0/2986536397 >> 172.21.15.100:0/2986536397 conn(0x7fcac806fa70 msgr2=0x7fcac80c63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:03.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.155+0000 7fcaccd03640 1 -- 172.21.15.100:0/2986536397 shutdown_connections 2024-09-11T22:36:03.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.155+0000 7fcaccd03640 1 -- 172.21.15.100:0/2986536397 wait complete. 2024-09-11T22:36:03.167 INFO:tasks.ceph:Scrubbing osd.7 2024-09-11T22:36:03.167 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-11T22:36:03.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.270+0000 7fef48c65640 1 Processor -- start 2024-09-11T22:36:03.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.270+0000 7fef48c65640 1 -- start start 2024-09-11T22:36:03.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.271+0000 7fef48c65640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fef440ca8e0 0x7fef440c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:03.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.271+0000 7fef48c65640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef44071fc0 0x7fef4415c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:03.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.271+0000 7fef48c65640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef44159350 con 0x7fef44152a00 2024-09-11T22:36:03.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.271+0000 7fef48c65640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fef4415bd90 con 0x7fef440ca8e0 2024-09-11T22:36:03.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.271+0000 7fef48c65640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fef44159610 con 0x7fef44071fc0 2024-09-11T22:36:03.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.271+0000 7fef41d9b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fef440ca8e0 0x7fef440c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:03.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.271+0000 7fef41d9b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fef440ca8e0 0x7fef440c8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45632/0 (socket says 172.21.15.100:45632) 2024-09-11T22:36:03.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.271+0000 7fef41d9b640 1 -- 172.21.15.100:0/521914595 learned_addr learned my addr 172.21.15.100:0/521914595 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:03.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.271+0000 7fef42d9d640 1 --2- 172.21.15.100:0/521914595 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef44071fc0 0x7fef4415c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:03.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.272+0000 7fef41d9b640 1 -- 172.21.15.100:0/521914595 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef44071fc0 msgr2=0x7fef4415c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:03.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.272+0000 7fef41d9b640 1 --2- 172.21.15.100:0/521914595 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef44071fc0 0x7fef4415c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.272+0000 7fef41d9b640 1 -- 172.21.15.100:0/521914595 >> v1:172.21.15.167:6789/0 conn(0x7fef44152a00 legacy=0x7fef440cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:03.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.272+0000 7fef41d9b640 1 -- 172.21.15.100:0/521914595 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef440c94f0 con 0x7fef440ca8e0 2024-09-11T22:36:03.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.272+0000 7fef42d9d640 1 --2- 172.21.15.100:0/521914595 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef44071fc0 0x7fef4415c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:03.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.272+0000 7fef41d9b640 1 --2- 172.21.15.100:0/521914595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef440ca8e0 0x7fef440c8d60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fef2c009870 tx=0x7fef2c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89db3fd70b48085 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:03.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.272+0000 7fef4159a640 1 -- 172.21.15.100:0/521914595 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c037070 con 0x7fef440ca8e0 2024-09-11T22:36:03.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.273+0000 7fef4159a640 1 -- 172.21.15.100:0/521914595 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2c02ae50 con 0x7fef440ca8e0 2024-09-11T22:36:03.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.273+0000 7fef4159a640 1 -- 172.21.15.100:0/521914595 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c032860 con 0x7fef440ca8e0 2024-09-11T22:36:03.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.273+0000 7fef48c65640 1 -- 172.21.15.100:0/521914595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef440ca8e0 msgr2=0x7fef440c8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:03.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.273+0000 7fef48c65640 1 --2- 172.21.15.100:0/521914595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef440ca8e0 0x7fef440c8d60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fef2c009870 tx=0x7fef2c02a300 comp rx=0 tx=0).stop 2024-09-11T22:36:03.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.273+0000 7fef48c65640 1 -- 172.21.15.100:0/521914595 shutdown_connections 2024-09-11T22:36:03.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.273+0000 7fef48c65640 1 --2- 172.21.15.100:0/521914595 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef44071fc0 0x7fef4415c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.273+0000 7fef48c65640 1 --2- 172.21.15.100:0/521914595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef440ca8e0 0x7fef440c8d60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.273+0000 7fef48c65640 1 -- 172.21.15.100:0/521914595 >> 172.21.15.100:0/521914595 conn(0x7fef4406fb70 msgr2=0x7fef44071590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:03.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.273+0000 7fef48c65640 1 -- 172.21.15.100:0/521914595 shutdown_connections 2024-09-11T22:36:03.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.273+0000 7fef48c65640 1 -- 172.21.15.100:0/521914595 wait complete. 2024-09-11T22:36:03.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.275+0000 7fef48c65640 1 Processor -- start 2024-09-11T22:36:03.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.275+0000 7fef48c65640 1 -- start start 2024-09-11T22:36:03.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.275+0000 7fef48c65640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef44071fc0 0x7fef4406cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:03.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.275+0000 7fef48c65640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef440ca8e0 0x7fef44158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:03.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.275+0000 7fef48c65640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef44152a00 0x7fef4414b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:03.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.275+0000 7fef48c65640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fef44152de0 con 0x7fef44152a00 2024-09-11T22:36:03.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.275+0000 7fef48c65640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fef440c9ab0 con 0x7fef440ca8e0 2024-09-11T22:36:03.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.275+0000 7fef48c65640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fef44152f60 con 0x7fef44071fc0 2024-09-11T22:36:03.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.275+0000 7fef42d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef44152a00 0x7fef4414b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:03.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.275+0000 7fef42d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef44152a00 0x7fef4414b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45646/0 (socket says 172.21.15.100:45646) 2024-09-11T22:36:03.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.275+0000 7fef42d9d640 1 -- 172.21.15.100:0/337610333 learned_addr learned my addr 172.21.15.100:0/337610333 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:03.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.276+0000 7fef4259c640 1 --2- 172.21.15.100:0/337610333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef44071fc0 0x7fef4406cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:03.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.276+0000 7fef41d9b640 1 --2- 172.21.15.100:0/337610333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef440ca8e0 0x7fef44158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:03.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.276+0000 7fef42d9d640 1 -- 172.21.15.100:0/337610333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef44071fc0 msgr2=0x7fef4406cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:03.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.276+0000 7fef42d9d640 1 --2- 172.21.15.100:0/337610333 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef44071fc0 0x7fef4406cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.276+0000 7fef42d9d640 1 -- 172.21.15.100:0/337610333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef440ca8e0 msgr2=0x7fef44158230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:03.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.276+0000 7fef42d9d640 1 --2- 172.21.15.100:0/337610333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef440ca8e0 0x7fef44158230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.276+0000 7fef42d9d640 1 -- 172.21.15.100:0/337610333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef44148b60 con 0x7fef44152a00 2024-09-11T22:36:03.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.276+0000 7fef42d9d640 1 --2- 172.21.15.100:0/337610333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef44152a00 0x7fef4414b9b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fef3c007f20 tx=0x7fef3c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:03.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.276+0000 7fef3affd640 1 -- 172.21.15.100:0/337610333 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3c01a070 con 0x7fef44152a00 2024-09-11T22:36:03.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.276+0000 7fef3affd640 1 -- 172.21.15.100:0/337610333 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef3c003b90 con 0x7fef44152a00 2024-09-11T22:36:03.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.276+0000 7fef48c65640 1 -- 172.21.15.100:0/337610333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef44148e40 con 0x7fef44152a00 2024-09-11T22:36:03.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.276+0000 7fef3affd640 1 -- 172.21.15.100:0/337610333 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3c004030 con 0x7fef44152a00 2024-09-11T22:36:03.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.276+0000 7fef48c65640 1 -- 172.21.15.100:0/337610333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef4406c090 con 0x7fef44152a00 2024-09-11T22:36:03.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.277+0000 7fef48c65640 1 -- 172.21.15.100:0/337610333 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fef440c8d60 con 0x7fef44152a00 2024-09-11T22:36:03.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.278+0000 7fef3affd640 1 -- 172.21.15.100:0/337610333 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef3c01d070 con 0x7fef44152a00 2024-09-11T22:36:03.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.278+0000 7fef3affd640 1 --2- 172.21.15.100:0/337610333 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fef2406be30 0x7fef2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:03.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.278+0000 7fef3affd640 1 -- 172.21.15.100:0/337610333 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fef3c08b470 con 0x7fef44152a00 2024-09-11T22:36:03.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.278+0000 7fef4259c640 1 --2- 172.21.15.100:0/337610333 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fef2406be30 0x7fef2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:03.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.278+0000 7fef3affd640 1 --2- 172.21.15.100:0/337610333 >> [v2:172.21.15.167:6800/1337015843,v1:172.21.15.167:6801/1337015843] conn(0x7fef240758c0 0x7fef24077d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:03.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.278+0000 7fef3affd640 1 -- 172.21.15.100:0/337610333 --> [v2:172.21.15.167:6800/1337015843,v1:172.21.15.167:6801/1337015843] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fef24078430 con 0x7fef240758c0 2024-09-11T22:36:03.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.278+0000 7fef3affd640 1 -- 172.21.15.100:0/337610333 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fef3c092050 con 0x7fef44152a00 2024-09-11T22:36:03.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.278+0000 7fef4259c640 1 --2- 172.21.15.100:0/337610333 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fef2406be30 0x7fef2406e2f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fef340016e0 tx=0x7fef34009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:03.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.279+0000 7fef41d9b640 1 --2- 172.21.15.100:0/337610333 >> [v2:172.21.15.167:6800/1337015843,v1:172.21.15.167:6801/1337015843] conn(0x7fef240758c0 0x7fef24077d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:03.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.279+0000 7fef41d9b640 1 --2- 172.21.15.100:0/337610333 >> [v2:172.21.15.167:6800/1337015843,v1:172.21.15.167:6801/1337015843] conn(0x7fef240758c0 0x7fef24077d60 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:03.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.280+0000 7fef3affd640 1 -- 172.21.15.100:0/337610333 <== osd.7 v2:172.21.15.167:6800/1337015843 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fef24078430 con 0x7fef240758c0 2024-09-11T22:36:03.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.292+0000 7fef48c65640 1 -- 172.21.15.100:0/337610333 --> [v2:172.21.15.167:6800/1337015843,v1:172.21.15.167:6801/1337015843] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fef440cbce0 con 0x7fef240758c0 2024-09-11T22:36:03.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.293+0000 7fef3affd640 1 -- 172.21.15.100:0/337610333 <== osd.7 v2:172.21.15.167:6800/1337015843 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fef440cbce0 con 0x7fef240758c0 2024-09-11T22:36:03.294 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-11T22:36:03.294 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T22:36:03.294 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-11T22:36:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.293+0000 7fef48c65640 1 -- 172.21.15.100:0/337610333 >> [v2:172.21.15.167:6800/1337015843,v1:172.21.15.167:6801/1337015843] conn(0x7fef240758c0 msgr2=0x7fef24077d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.293+0000 7fef48c65640 1 --2- 172.21.15.100:0/337610333 >> [v2:172.21.15.167:6800/1337015843,v1:172.21.15.167:6801/1337015843] conn(0x7fef240758c0 0x7fef24077d60 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.293+0000 7fef48c65640 1 -- 172.21.15.100:0/337610333 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fef2406be30 msgr2=0x7fef2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.293+0000 7fef48c65640 1 --2- 172.21.15.100:0/337610333 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fef2406be30 0x7fef2406e2f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fef340016e0 tx=0x7fef34009040 comp rx=0 tx=0).stop 2024-09-11T22:36:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.293+0000 7fef48c65640 1 -- 172.21.15.100:0/337610333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef44152a00 msgr2=0x7fef4414b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.293+0000 7fef48c65640 1 --2- 172.21.15.100:0/337610333 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef44152a00 0x7fef4414b9b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fef3c007f20 tx=0x7fef3c00d560 comp rx=0 tx=0).stop 2024-09-11T22:36:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.293+0000 7fef42d9d640 1 -- 172.21.15.100:0/337610333 reap_dead start 2024-09-11T22:36:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.293+0000 7fef48c65640 1 -- 172.21.15.100:0/337610333 shutdown_connections 2024-09-11T22:36:03.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.293+0000 7fef48c65640 1 -- 172.21.15.100:0/337610333 >> 172.21.15.100:0/337610333 conn(0x7fef4406fb70 msgr2=0x7fef440cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:03.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.293+0000 7fef48c65640 1 -- 172.21.15.100:0/337610333 shutdown_connections 2024-09-11T22:36:03.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.293+0000 7fef48c65640 1 -- 172.21.15.100:0/337610333 wait complete. 2024-09-11T22:36:03.305 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-11T22:36:03.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.405+0000 7f3d4ad66640 1 Processor -- start 2024-09-11T22:36:03.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.406+0000 7f3d4ad66640 1 -- start start 2024-09-11T22:36:03.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.406+0000 7f3d4ad66640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3d44152a80 0x7f3d4406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:03.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.406+0000 7f3d4ad66640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3d440b0c00 0x7f3d440cb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:03.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.406+0000 7f3d4ad66640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d440c98f0 con 0x7f3d440c8b10 2024-09-11T22:36:03.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.406+0000 7f3d4ad66640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f3d44152e60 con 0x7f3d44152a80 2024-09-11T22:36:03.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.406+0000 7f3d4ad66640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f3d440c9050 con 0x7f3d440b0c00 2024-09-11T22:36:03.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.406+0000 7f3d48b02640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3d44152a80 0x7f3d4406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:03.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.406+0000 7f3d43fff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3d440c8b10 0x7f3d44159030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:35318/0 (socket says 172.21.15.100:35318) 2024-09-11T22:36:03.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.406+0000 7f3d43fff640 1 -- 172.21.15.100:0/3144364418 learned_addr learned my addr 172.21.15.100:0/3144364418 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:36:03.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.407+0000 7f3d49303640 1 --2- 172.21.15.100:0/3144364418 >> v2:172.21.15.167:3300/0 conn(0x7f3d440b0c00 0x7f3d440cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:03.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.407+0000 7f3d48b02640 1 -- 172.21.15.100:0/3144364418 >> v2:172.21.15.167:3300/0 conn(0x7f3d440b0c00 msgr2=0x7f3d440cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:03.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.407+0000 7f3d48b02640 1 --2- 172.21.15.100:0/3144364418 >> v2:172.21.15.167:3300/0 conn(0x7f3d440b0c00 0x7f3d440cb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.407+0000 7f3d48b02640 1 -- 172.21.15.100:0/3144364418 >> v1:172.21.15.100:6789/0 conn(0x7f3d440c8b10 legacy=0x7f3d44159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:03.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.407+0000 7f3d48b02640 1 -- 172.21.15.100:0/3144364418 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d440c9330 con 0x7f3d44152a80 2024-09-11T22:36:03.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.407+0000 7f3d437fe640 1 -- 172.21.15.100:0/3144364418 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4139205028 0 0) 0x7f3d440c98f0 con 0x7f3d440c8b10 2024-09-11T22:36:03.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.407+0000 7f3d48b02640 1 --2- 172.21.15.100:0/3144364418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d44152a80 0x7f3d4406ff90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3d44073710 tx=0x7f3d3802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb386b489d39c5b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:03.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.408+0000 7f3d437fe640 1 -- 172.21.15.100:0/3144364418 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d38037070 con 0x7f3d44152a80 2024-09-11T22:36:03.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.408+0000 7f3d437fe640 1 -- 172.21.15.100:0/3144364418 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d38032440 con 0x7f3d44152a80 2024-09-11T22:36:03.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.408+0000 7f3d437fe640 1 -- 172.21.15.100:0/3144364418 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d38032810 con 0x7f3d44152a80 2024-09-11T22:36:03.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.408+0000 7f3d4ad66640 1 -- 172.21.15.100:0/3144364418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d44152a80 msgr2=0x7f3d4406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:03.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.408+0000 7f3d4ad66640 1 --2- 172.21.15.100:0/3144364418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d44152a80 0x7f3d4406ff90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3d44073710 tx=0x7f3d3802a230 comp rx=0 tx=0).stop 2024-09-11T22:36:03.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.408+0000 7f3d4ad66640 1 -- 172.21.15.100:0/3144364418 shutdown_connections 2024-09-11T22:36:03.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.408+0000 7f3d4ad66640 1 --2- 172.21.15.100:0/3144364418 >> v2:172.21.15.167:3300/0 conn(0x7f3d440b0c00 0x7f3d440cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.408+0000 7f3d4ad66640 1 --2- 172.21.15.100:0/3144364418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d44152a80 0x7f3d4406ff90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.408+0000 7f3d4ad66640 1 -- 172.21.15.100:0/3144364418 >> 172.21.15.100:0/3144364418 conn(0x7f3d4406e000 msgr2=0x7f3d4406e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:03.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.408+0000 7f3d4ad66640 1 -- 172.21.15.100:0/3144364418 shutdown_connections 2024-09-11T22:36:03.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.408+0000 7f3d4ad66640 1 -- 172.21.15.100:0/3144364418 wait complete. 2024-09-11T22:36:03.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.409+0000 7f3d4ad66640 1 Processor -- start 2024-09-11T22:36:03.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.409+0000 7f3d4ad66640 1 -- start start 2024-09-11T22:36:03.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.410+0000 7f3d4ad66640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d440b0c00 0x7f3d4406d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:03.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.410+0000 7f3d4ad66640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d440c8b10 0x7f3d4406c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:03.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.410+0000 7f3d4ad66640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d44152a80 0x7f3d4415a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:03.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.410+0000 7f3d4ad66640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3d44158b10 con 0x7f3d44152a80 2024-09-11T22:36:03.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.410+0000 7f3d4ad66640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3d44158830 con 0x7f3d440c8b10 2024-09-11T22:36:03.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.410+0000 7f3d4ad66640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3d4415bc60 con 0x7f3d440b0c00 2024-09-11T22:36:03.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.411+0000 7f3d49303640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d44152a80 0x7f3d4415a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:03.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.411+0000 7f3d49303640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d44152a80 0x7f3d4415a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45668/0 (socket says 172.21.15.100:45668) 2024-09-11T22:36:03.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.411+0000 7f3d49303640 1 -- 172.21.15.100:0/1824995166 learned_addr learned my addr 172.21.15.100:0/1824995166 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:03.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.411+0000 7f3d48b02640 1 --2- 172.21.15.100:0/1824995166 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d440b0c00 0x7f3d4406d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:03.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.411+0000 7f3d43fff640 1 --2- 172.21.15.100:0/1824995166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d440c8b10 0x7f3d4406c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:03.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.411+0000 7f3d49303640 1 -- 172.21.15.100:0/1824995166 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d440b0c00 msgr2=0x7f3d4406d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:03.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.411+0000 7f3d49303640 1 --2- 172.21.15.100:0/1824995166 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d440b0c00 0x7f3d4406d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.411+0000 7f3d49303640 1 -- 172.21.15.100:0/1824995166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d440c8b10 msgr2=0x7f3d4406c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:03.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.411+0000 7f3d49303640 1 --2- 172.21.15.100:0/1824995166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d440c8b10 0x7f3d4406c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.411+0000 7f3d49303640 1 -- 172.21.15.100:0/1824995166 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d44158220 con 0x7f3d44152a80 2024-09-11T22:36:03.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.411+0000 7f3d49303640 1 --2- 172.21.15.100:0/1824995166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d44152a80 0x7f3d4415a860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c007e60 tx=0x7f3d3c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:03.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.411+0000 7f3d417fa640 1 -- 172.21.15.100:0/1824995166 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c014420 con 0x7f3d44152a80 2024-09-11T22:36:03.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.411+0000 7f3d417fa640 1 -- 172.21.15.100:0/1824995166 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d3c019070 con 0x7f3d44152a80 2024-09-11T22:36:03.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.411+0000 7f3d417fa640 1 -- 172.21.15.100:0/1824995166 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c014820 con 0x7f3d44152a80 2024-09-11T22:36:03.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.411+0000 7f3d4ad66640 1 -- 172.21.15.100:0/1824995166 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d441f3840 con 0x7f3d44152a80 2024-09-11T22:36:03.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.411+0000 7f3d4ad66640 1 -- 172.21.15.100:0/1824995166 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d440cdcc0 con 0x7f3d44152a80 2024-09-11T22:36:03.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.412+0000 7f3d4ad66640 1 -- 172.21.15.100:0/1824995166 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d440c4c40 con 0x7f3d44152a80 2024-09-11T22:36:03.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.413+0000 7f3d417fa640 1 -- 172.21.15.100:0/1824995166 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d3c0149c0 con 0x7f3d44152a80 2024-09-11T22:36:03.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.413+0000 7f3d417fa640 1 --2- 172.21.15.100:0/1824995166 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d2806be30 0x7f3d2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:03.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.414+0000 7f3d417fa640 1 -- 172.21.15.100:0/1824995166 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f3d3c08ba20 con 0x7f3d44152a80 2024-09-11T22:36:03.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.414+0000 7f3d48b02640 1 --2- 172.21.15.100:0/1824995166 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d2806be30 0x7f3d2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:03.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.414+0000 7f3d48b02640 1 --2- 172.21.15.100:0/1824995166 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d2806be30 0x7f3d2806e2f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3d38034000 tx=0x7f3d3802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:03.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.418+0000 7f3d417fa640 1 -- 172.21.15.100:0/1824995166 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3d3c0598d0 con 0x7f3d44152a80 2024-09-11T22:36:03.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.589+0000 7f3d4ad66640 1 -- 172.21.15.100:0/1824995166 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f3d440c9db0 con 0x7f3d2806be30 2024-09-11T22:36:03.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.589+0000 7f3d417fa640 1 -- 172.21.15.100:0/1824995166 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3d440c9db0 con 0x7f3d2806be30 2024-09-11T22:36:03.591 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 7 to deep-scrub 2024-09-11T22:36:03.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.591+0000 7f3d4ad66640 1 -- 172.21.15.100:0/1824995166 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d2806be30 msgr2=0x7f3d2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:03.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.591+0000 7f3d4ad66640 1 --2- 172.21.15.100:0/1824995166 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d2806be30 0x7f3d2806e2f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3d38034000 tx=0x7f3d3802e000 comp rx=0 tx=0).stop 2024-09-11T22:36:03.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.591+0000 7f3d4ad66640 1 -- 172.21.15.100:0/1824995166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d44152a80 msgr2=0x7f3d4415a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:03.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.591+0000 7f3d4ad66640 1 --2- 172.21.15.100:0/1824995166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d44152a80 0x7f3d4415a860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c007e60 tx=0x7f3d3c00e4b0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.592+0000 7f3d4ad66640 1 -- 172.21.15.100:0/1824995166 shutdown_connections 2024-09-11T22:36:03.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.592+0000 7f3d4ad66640 1 --2- 172.21.15.100:0/1824995166 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d2806be30 0x7f3d2806e2f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.592+0000 7f3d4ad66640 1 --2- 172.21.15.100:0/1824995166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d44152a80 0x7f3d4415a860 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.592+0000 7f3d4ad66640 1 --2- 172.21.15.100:0/1824995166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d440c8b10 0x7f3d4406c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.592+0000 7f3d4ad66640 1 --2- 172.21.15.100:0/1824995166 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d440b0c00 0x7f3d4406d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.592+0000 7f3d4ad66640 1 -- 172.21.15.100:0/1824995166 >> 172.21.15.100:0/1824995166 conn(0x7f3d4406e000 msgr2=0x7f3d4415bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:03.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.592+0000 7f3d4ad66640 1 -- 172.21.15.100:0/1824995166 shutdown_connections 2024-09-11T22:36:03.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.592+0000 7f3d4ad66640 1 -- 172.21.15.100:0/1824995166 wait complete. 2024-09-11T22:36:03.604 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:36:03.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.704+0000 7fe8d5a37640 1 Processor -- start 2024-09-11T22:36:03.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.704+0000 7fe8d5a37640 1 -- start start 2024-09-11T22:36:03.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.705+0000 7fe8d5a37640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe8d0157fd0 0x7fe8d00c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:03.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.705+0000 7fe8d5a37640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe8d006bc10 0x7fe8d00ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:03.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.705+0000 7fe8d5a37640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8d015a950 con 0x7fe8d00cd480 2024-09-11T22:36:03.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.705+0000 7fe8d5a37640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fe8d01583b0 con 0x7fe8d0157fd0 2024-09-11T22:36:03.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.705+0000 7fe8d5a37640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7fe8d015abd0 con 0x7fe8d006bc10 2024-09-11T22:36:03.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.705+0000 7fe8ceffd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe8d0157fd0 0x7fe8d00c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:03.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.705+0000 7fe8ceffd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe8d0157fd0 0x7fe8d00c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45678/0 (socket says 172.21.15.100:45678) 2024-09-11T22:36:03.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.705+0000 7fe8ceffd640 1 -- 172.21.15.100:0/1850878285 learned_addr learned my addr 172.21.15.100:0/1850878285 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:03.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.706+0000 7fe8ceffd640 1 -- 172.21.15.100:0/1850878285 >> v2:172.21.15.167:3300/0 conn(0x7fe8d006bc10 msgr2=0x7fe8d00ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:03.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.706+0000 7fe8ce7fc640 1 --2- 172.21.15.100:0/1850878285 >> v2:172.21.15.167:3300/0 conn(0x7fe8d006bc10 0x7fe8d00ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:03.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.706+0000 7fe8ceffd640 1 --2- 172.21.15.100:0/1850878285 >> v2:172.21.15.167:3300/0 conn(0x7fe8d006bc10 0x7fe8d00ccf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.706+0000 7fe8ceffd640 1 -- 172.21.15.100:0/1850878285 >> v1:172.21.15.167:6789/0 conn(0x7fe8d00cd480 legacy=0x7fe8d015e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:03.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.706+0000 7fe8ceffd640 1 -- 172.21.15.100:0/1850878285 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d015aeb0 con 0x7fe8d0157fd0 2024-09-11T22:36:03.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.706+0000 7fe8ceffd640 1 --2- 172.21.15.100:0/1850878285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d0157fd0 0x7fe8d00c8ca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00caee0 tx=0x7fe8c002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c46ca68a60c0513 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:03.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.707+0000 7fe8cdffb640 1 -- 172.21.15.100:0/1850878285 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0037070 con 0x7fe8d0157fd0 2024-09-11T22:36:03.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.707+0000 7fe8cdffb640 1 -- 172.21.15.100:0/1850878285 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c0032440 con 0x7fe8d0157fd0 2024-09-11T22:36:03.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.707+0000 7fe8cdffb640 1 -- 172.21.15.100:0/1850878285 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0032810 con 0x7fe8d0157fd0 2024-09-11T22:36:03.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.707+0000 7fe8d5a37640 1 -- 172.21.15.100:0/1850878285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d0157fd0 msgr2=0x7fe8d00c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:03.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.707+0000 7fe8d5a37640 1 --2- 172.21.15.100:0/1850878285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d0157fd0 0x7fe8d00c8ca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00caee0 tx=0x7fe8c002a2c0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.707+0000 7fe8d5a37640 1 -- 172.21.15.100:0/1850878285 shutdown_connections 2024-09-11T22:36:03.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.707+0000 7fe8d5a37640 1 --2- 172.21.15.100:0/1850878285 >> v2:172.21.15.167:3300/0 conn(0x7fe8d006bc10 0x7fe8d00ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.707+0000 7fe8d5a37640 1 --2- 172.21.15.100:0/1850878285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d0157fd0 0x7fe8d00c8ca0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.707+0000 7fe8d5a37640 1 -- 172.21.15.100:0/1850878285 >> 172.21.15.100:0/1850878285 conn(0x7fe8d0072960 msgr2=0x7fe8d0072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:03.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.707+0000 7fe8d5a37640 1 -- 172.21.15.100:0/1850878285 shutdown_connections 2024-09-11T22:36:03.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.707+0000 7fe8d5a37640 1 -- 172.21.15.100:0/1850878285 wait complete. 2024-09-11T22:36:03.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.708+0000 7fe8d5a37640 1 Processor -- start 2024-09-11T22:36:03.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.708+0000 7fe8d5a37640 1 -- start start 2024-09-11T22:36:03.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.709+0000 7fe8d5a37640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8d006bc10 0x7fe8d00c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:03.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.709+0000 7fe8d5a37640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d00cd480 0x7fe8d01f0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:03.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.709+0000 7fe8d5a37640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8d0157fd0 0x7fe8d00cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:03.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.709+0000 7fe8d5a37640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d0067ae0 con 0x7fe8d00cd480 2024-09-11T22:36:03.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.709+0000 7fe8d5a37640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d015b470 con 0x7fe8d0157fd0 2024-09-11T22:36:03.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.709+0000 7fe8d5a37640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fe8d00cc020 con 0x7fe8d006bc10 2024-09-11T22:36:03.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.709+0000 7fe8ce7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d00cd480 0x7fe8d01f0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:03.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.709+0000 7fe8ce7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d00cd480 0x7fe8d01f0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45680/0 (socket says 172.21.15.100:45680) 2024-09-11T22:36:03.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.709+0000 7fe8ce7fc640 1 -- 172.21.15.100:0/4019836050 learned_addr learned my addr 172.21.15.100:0/4019836050 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:03.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.709+0000 7fe8ceffd640 1 --2- 172.21.15.100:0/4019836050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8d006bc10 0x7fe8d00c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:03.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.709+0000 7fe8cf7fe640 1 --2- 172.21.15.100:0/4019836050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8d0157fd0 0x7fe8d00cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:03.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.710+0000 7fe8ce7fc640 1 -- 172.21.15.100:0/4019836050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8d006bc10 msgr2=0x7fe8d00c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:03.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.710+0000 7fe8ce7fc640 1 --2- 172.21.15.100:0/4019836050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8d006bc10 0x7fe8d00c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.710+0000 7fe8ce7fc640 1 -- 172.21.15.100:0/4019836050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8d0157fd0 msgr2=0x7fe8d00cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:03.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.710+0000 7fe8ce7fc640 1 --2- 172.21.15.100:0/4019836050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8d0157fd0 0x7fe8d00cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.710+0000 7fe8ce7fc640 1 -- 172.21.15.100:0/4019836050 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d00cc300 con 0x7fe8d00cd480 2024-09-11T22:36:03.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.710+0000 7fe8ce7fc640 1 --2- 172.21.15.100:0/4019836050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d00cd480 0x7fe8d01f0c90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe8b800c7f0 tx=0x7fe8b800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:03.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.710+0000 7fe8c7fff640 1 -- 172.21.15.100:0/4019836050 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8015070 con 0x7fe8d00cd480 2024-09-11T22:36:03.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.710+0000 7fe8c7fff640 1 -- 172.21.15.100:0/4019836050 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8b8004240 con 0x7fe8d00cd480 2024-09-11T22:36:03.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.710+0000 7fe8d5a37640 1 -- 172.21.15.100:0/4019836050 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8d00cc5e0 con 0x7fe8d00cd480 2024-09-11T22:36:03.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.710+0000 7fe8c7fff640 1 -- 172.21.15.100:0/4019836050 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8003610 con 0x7fe8d00cd480 2024-09-11T22:36:03.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.710+0000 7fe8d5a37640 1 -- 172.21.15.100:0/4019836050 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8d00ccba0 con 0x7fe8d00cd480 2024-09-11T22:36:03.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.711+0000 7fe8d5a37640 1 -- 172.21.15.100:0/4019836050 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8d0068060 con 0x7fe8d00cd480 2024-09-11T22:36:03.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.711+0000 7fe8c7fff640 1 -- 172.21.15.100:0/4019836050 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe8b80037b0 con 0x7fe8d00cd480 2024-09-11T22:36:03.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.712+0000 7fe8c7fff640 1 --2- 172.21.15.100:0/4019836050 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe8b006be60 0x7fe8b006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:03.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.712+0000 7fe8ceffd640 1 --2- 172.21.15.100:0/4019836050 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe8b006be60 0x7fe8b006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:03.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.712+0000 7fe8c7fff640 1 -- 172.21.15.100:0/4019836050 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fe8b808af20 con 0x7fe8d00cd480 2024-09-11T22:36:03.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.713+0000 7fe8ceffd640 1 --2- 172.21.15.100:0/4019836050 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe8b006be60 0x7fe8b006e320 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0034000 tx=0x7fe8c002e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:03.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.716+0000 7fe8c7fff640 1 -- 172.21.15.100:0/4019836050 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe8b8058ef0 con 0x7fe8d00cd480 2024-09-11T22:36:03.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.885+0000 7fe8d5a37640 1 -- 172.21.15.100:0/4019836050 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe8d00c4210 con 0x7fe8b006be60 2024-09-11T22:36:03.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.893+0000 7fe8c7fff640 1 -- 172.21.15.100:0/4019836050 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333196 (secure 0 0 0) 0x7fe8d00c4210 con 0x7fe8b006be60 2024-09-11T22:36:03.898 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:36:03.900 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-11T22:36:03.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.896+0000 7fe8d5a37640 1 -- 172.21.15.100:0/4019836050 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe8b006be60 msgr2=0x7fe8b006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:03.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.896+0000 7fe8d5a37640 1 --2- 172.21.15.100:0/4019836050 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe8b006be60 0x7fe8b006e320 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0034000 tx=0x7fe8c002e000 comp rx=0 tx=0).stop 2024-09-11T22:36:03.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.896+0000 7fe8d5a37640 1 -- 172.21.15.100:0/4019836050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d00cd480 msgr2=0x7fe8d01f0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:03.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.896+0000 7fe8d5a37640 1 --2- 172.21.15.100:0/4019836050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d00cd480 0x7fe8d01f0c90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe8b800c7f0 tx=0x7fe8b800ccb0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.896+0000 7fe8d5a37640 1 -- 172.21.15.100:0/4019836050 shutdown_connections 2024-09-11T22:36:03.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.896+0000 7fe8d5a37640 1 --2- 172.21.15.100:0/4019836050 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fe8b006be60 0x7fe8b006e320 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.896+0000 7fe8d5a37640 1 --2- 172.21.15.100:0/4019836050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8d0157fd0 0x7fe8d00cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.896+0000 7fe8d5a37640 1 --2- 172.21.15.100:0/4019836050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8d00cd480 0x7fe8d01f0c90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.896+0000 7fe8d5a37640 1 --2- 172.21.15.100:0/4019836050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8d006bc10 0x7fe8d00c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:03.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.896+0000 7fe8d5a37640 1 -- 172.21.15.100:0/4019836050 >> 172.21.15.100:0/4019836050 conn(0x7fe8d0072960 msgr2=0x7fe8d00c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:03.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.897+0000 7fe8d5a37640 1 -- 172.21.15.100:0/4019836050 shutdown_connections 2024-09-11T22:36:03.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:03.897+0000 7fe8d5a37640 1 -- 172.21.15.100:0/4019836050 wait complete. 2024-09-11T22:36:03.908 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":500,"stamp":"2024-09-11T22:36:02.570530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":15595723,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":161,"num_read_kb":222,"num_write":880820,"num_write_kb":16633497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195575,"ondisk_log_size":195575,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8681656,"kb_used_data":20280,"kb_used_omap":12,"kb_used_meta":8661235,"kb_avail":746293064,"statfs":{"total":773094113280,"available":764204097536,"internally_reserved":0,"allocated":20766720,"data_stored":32163590,"data_compressed":2726282,"data_compressed_allocated":3776512,"data_compressed_original":16719872,"omap_allocated":12752,"internal_metadata":8869105200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":390,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003521"},"pg_stats":[{"pgid":"2.1f","version":"28'176","reported_seq":210,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.064903+0000","last_change":"2024-09-11T22:20:18.853007+0000","last_active":"2024-09-11T22:35:51.064903+0000","last_peered":"2024-09-11T22:35:51.064903+0000","last_clean":"2024-09-11T22:35:51.064903+0000","last_became_active":"2024-09-11T22:20:18.852740+0000","last_became_peered":"2024-09-11T22:20:18.852740+0000","last_unstale":"2024-09-11T22:35:51.064903+0000","last_undegraded":"2024-09-11T22:35:51.064903+0000","last_fullsized":"2024-09-11T22:35:51.064903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2323991,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":2359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'9","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.039561+0000","last_change":"2024-09-11T22:20:19.849765+0000","last_active":"2024-09-11T22:35:51.039561+0000","last_peered":"2024-09-11T22:35:51.039561+0000","last_clean":"2024-09-11T22:35:51.039561+0000","last_became_active":"2024-09-11T22:20:19.848619+0000","last_became_peered":"2024-09-11T22:20:19.848619+0000","last_unstale":"2024-09-11T22:35:51.039561+0000","last_undegraded":"2024-09-11T22:35:51.039561+0000","last_fullsized":"2024-09-11T22:35:51.039561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:57.621624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'6890","reported_seq":6914,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.779066+0000","last_change":"2024-09-11T22:20:24.078618+0000","last_active":"2024-09-11T22:35:44.779066+0000","last_peered":"2024-09-11T22:35:44.779066+0000","last_clean":"2024-09-11T22:35:44.779066+0000","last_became_active":"2024-09-11T22:20:24.078283+0000","last_became_peered":"2024-09-11T22:20:24.078283+0000","last_unstale":"2024-09-11T22:35:44.779066+0000","last_undegraded":"2024-09-11T22:35:44.779066+0000","last_fullsized":"2024-09-11T22:35:44.779066+0000","mapping_epoch":24,"log_start":"28'603","ondisk_log_start":"28'603","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6287,"log_dups_size":0,"ondisk_log_size":6287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:01.901307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31450,"num_write_kb":560141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'9","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.935502+0000","last_change":"2024-09-11T22:20:18.855945+0000","last_active":"2024-09-11T22:35:41.935502+0000","last_peered":"2024-09-11T22:35:41.935502+0000","last_clean":"2024-09-11T22:35:41.935502+0000","last_became_active":"2024-09-11T22:20:18.854811+0000","last_became_peered":"2024-09-11T22:20:18.854811+0000","last_unstale":"2024-09-11T22:35:41.935502+0000","last_undegraded":"2024-09-11T22:35:41.935502+0000","last_fullsized":"2024-09-11T22:35:41.935502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:47.508920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'21","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.063396+0000","last_change":"2024-09-11T22:20:19.862436+0000","last_active":"2024-09-11T22:35:51.063396+0000","last_peered":"2024-09-11T22:35:51.063396+0000","last_clean":"2024-09-11T22:35:51.063396+0000","last_became_active":"2024-09-11T22:20:19.862061+0000","last_became_peered":"2024-09-11T22:20:19.862061+0000","last_unstale":"2024-09-11T22:35:51.063396+0000","last_undegraded":"2024-09-11T22:35:51.063396+0000","last_fullsized":"2024-09-11T22:35:51.063396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'6406","reported_seq":6430,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.675651+0000","last_change":"2024-09-11T22:20:23.879729+0000","last_active":"2024-09-11T22:35:44.675651+0000","last_peered":"2024-09-11T22:35:44.675651+0000","last_clean":"2024-09-11T22:35:44.675651+0000","last_became_active":"2024-09-11T22:20:23.879245+0000","last_became_peered":"2024-09-11T22:20:23.879245+0000","last_unstale":"2024-09-11T22:35:44.675651+0000","last_undegraded":"2024-09-11T22:35:44.675651+0000","last_fullsized":"2024-09-11T22:35:44.675651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6406,"log_dups_size":0,"ondisk_log_size":6406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:36.836842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28787,"num_write_kb":536913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'13","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.849483+0000","last_change":"2024-09-11T22:20:18.853076+0000","last_active":"2024-09-11T22:35:37.849483+0000","last_peered":"2024-09-11T22:35:37.849483+0000","last_clean":"2024-09-11T22:35:37.849483+0000","last_became_active":"2024-09-11T22:20:18.852728+0000","last_became_peered":"2024-09-11T22:20:18.852728+0000","last_unstale":"2024-09-11T22:35:37.849483+0000","last_undegraded":"2024-09-11T22:35:37.849483+0000","last_fullsized":"2024-09-11T22:35:37.849483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'17","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.061939+0000","last_change":"2024-09-11T22:20:19.864544+0000","last_active":"2024-09-11T22:35:51.061939+0000","last_peered":"2024-09-11T22:35:51.061939+0000","last_clean":"2024-09-11T22:35:51.061939+0000","last_became_active":"2024-09-11T22:20:19.864234+0000","last_became_peered":"2024-09-11T22:20:19.864234+0000","last_unstale":"2024-09-11T22:35:51.061939+0000","last_undegraded":"2024-09-11T22:35:51.061939+0000","last_fullsized":"2024-09-11T22:35:51.061939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'5642","reported_seq":5666,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.746934+0000","last_change":"2024-09-11T22:20:23.873783+0000","last_active":"2024-09-11T22:35:44.746934+0000","last_peered":"2024-09-11T22:35:44.746934+0000","last_clean":"2024-09-11T22:35:44.746934+0000","last_became_active":"2024-09-11T22:20:23.873385+0000","last_became_peered":"2024-09-11T22:20:23.873385+0000","last_unstale":"2024-09-11T22:35:44.746934+0000","last_undegraded":"2024-09-11T22:35:44.746934+0000","last_fullsized":"2024-09-11T22:35:44.746934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5642,"log_dups_size":0,"ondisk_log_size":5642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24462,"num_write_kb":498902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'3","reported_seq":35,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:18.543924+0000","last_change":"2024-09-11T22:20:18.861530+0000","last_active":"2024-09-11T22:35:18.543924+0000","last_peered":"2024-09-11T22:35:18.543924+0000","last_clean":"2024-09-11T22:35:18.543924+0000","last_became_active":"2024-09-11T22:20:18.861230+0000","last_became_peered":"2024-09-11T22:20:18.861230+0000","last_unstale":"2024-09-11T22:35:18.543924+0000","last_undegraded":"2024-09-11T22:35:18.543924+0000","last_fullsized":"2024-09-11T22:35:18.543924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'27","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.063087+0000","last_change":"2024-09-11T22:20:19.863401+0000","last_active":"2024-09-11T22:35:51.063087+0000","last_peered":"2024-09-11T22:35:51.063087+0000","last_clean":"2024-09-11T22:35:51.063087+0000","last_became_active":"2024-09-11T22:20:19.863127+0000","last_became_peered":"2024-09-11T22:20:19.863127+0000","last_unstale":"2024-09-11T22:35:51.063087+0000","last_undegraded":"2024-09-11T22:35:51.063087+0000","last_fullsized":"2024-09-11T22:35:51.063087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:36.888544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'4900","reported_seq":4924,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.832935+0000","last_change":"2024-09-11T22:20:23.874650+0000","last_active":"2024-09-11T22:35:44.832935+0000","last_peered":"2024-09-11T22:35:44.832935+0000","last_clean":"2024-09-11T22:35:44.832935+0000","last_became_active":"2024-09-11T22:20:23.874040+0000","last_became_peered":"2024-09-11T22:20:23.874040+0000","last_unstale":"2024-09-11T22:35:44.832935+0000","last_undegraded":"2024-09-11T22:35:44.832935+0000","last_fullsized":"2024-09-11T22:35:44.832935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":4900,"log_dups_size":0,"ondisk_log_size":4900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.942564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21721,"num_write_kb":438879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'14","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.041380+0000","last_change":"2024-09-11T22:20:19.859446+0000","last_active":"2024-09-11T22:35:51.041380+0000","last_peered":"2024-09-11T22:35:51.041380+0000","last_clean":"2024-09-11T22:35:51.041380+0000","last_became_active":"2024-09-11T22:20:19.859106+0000","last_became_peered":"2024-09-11T22:20:19.859106+0000","last_unstale":"2024-09-11T22:35:51.041380+0000","last_undegraded":"2024-09-11T22:35:51.041380+0000","last_fullsized":"2024-09-11T22:35:51.041380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:01.388633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'1002","reported_seq":1034,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.946261+0000","last_change":"2024-09-11T22:20:18.856475+0000","last_active":"2024-09-11T22:35:41.946261+0000","last_peered":"2024-09-11T22:35:41.946261+0000","last_clean":"2024-09-11T22:35:41.946261+0000","last_became_active":"2024-09-11T22:20:18.856165+0000","last_became_peered":"2024-09-11T22:20:18.856165+0000","last_unstale":"2024-09-11T22:35:41.946261+0000","last_undegraded":"2024-09-11T22:35:41.946261+0000","last_fullsized":"2024-09-11T22:35:41.946261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":1002,"log_dups_size":0,"ondisk_log_size":1002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":994,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'6307","reported_seq":6331,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.864098+0000","last_change":"2024-09-11T22:20:23.878121+0000","last_active":"2024-09-11T22:35:44.864098+0000","last_peered":"2024-09-11T22:35:44.864098+0000","last_clean":"2024-09-11T22:35:44.864098+0000","last_became_active":"2024-09-11T22:20:23.877713+0000","last_became_peered":"2024-09-11T22:20:23.877713+0000","last_unstale":"2024-09-11T22:35:44.864098+0000","last_undegraded":"2024-09-11T22:35:44.864098+0000","last_fullsized":"2024-09-11T22:35:44.864098+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6307,"log_dups_size":0,"ondisk_log_size":6307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28296,"num_write_kb":522771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'17","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.045109+0000","last_change":"2024-09-11T22:20:19.858358+0000","last_active":"2024-09-11T22:35:51.045109+0000","last_peered":"2024-09-11T22:35:51.045109+0000","last_clean":"2024-09-11T22:35:51.045109+0000","last_became_active":"2024-09-11T22:20:19.858057+0000","last_became_peered":"2024-09-11T22:20:19.858057+0000","last_unstale":"2024-09-11T22:35:51.045109+0000","last_undegraded":"2024-09-11T22:35:51.045109+0000","last_fullsized":"2024-09-11T22:35:51.045109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:07.839926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'7","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.931632+0000","last_change":"2024-09-11T22:20:18.853818+0000","last_active":"2024-09-11T22:35:41.931632+0000","last_peered":"2024-09-11T22:35:41.931632+0000","last_clean":"2024-09-11T22:35:41.931632+0000","last_became_active":"2024-09-11T22:20:18.853508+0000","last_became_peered":"2024-09-11T22:20:18.853508+0000","last_unstale":"2024-09-11T22:35:41.931632+0000","last_undegraded":"2024-09-11T22:35:41.931632+0000","last_fullsized":"2024-09-11T22:35:41.931632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:58.141587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'6073","reported_seq":6104,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.786267+0000","last_change":"2024-09-11T22:21:02.037670+0000","last_active":"2024-09-11T22:35:44.786267+0000","last_peered":"2024-09-11T22:35:44.786267+0000","last_clean":"2024-09-11T22:35:44.786267+0000","last_became_active":"2024-09-11T22:21:02.036941+0000","last_became_peered":"2024-09-11T22:21:02.036941+0000","last_unstale":"2024-09-11T22:35:44.786267+0000","last_undegraded":"2024-09-11T22:35:44.786267+0000","last_fullsized":"2024-09-11T22:35:44.786267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6073,"log_dups_size":0,"ondisk_log_size":6073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:20.859515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27207,"num_write_kb":522378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'18","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043412+0000","last_change":"2024-09-11T22:20:19.844748+0000","last_active":"2024-09-11T22:35:51.043412+0000","last_peered":"2024-09-11T22:35:51.043412+0000","last_clean":"2024-09-11T22:35:51.043412+0000","last_became_active":"2024-09-11T22:20:19.844446+0000","last_became_peered":"2024-09-11T22:20:19.844446+0000","last_unstale":"2024-09-11T22:35:51.043412+0000","last_undegraded":"2024-09-11T22:35:51.043412+0000","last_fullsized":"2024-09-11T22:35:51.043412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:13.319918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'6","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.366967+0000","last_change":"2024-09-11T22:20:18.847388+0000","last_active":"2024-09-11T22:35:37.366967+0000","last_peered":"2024-09-11T22:35:37.366967+0000","last_clean":"2024-09-11T22:35:37.366967+0000","last_became_active":"2024-09-11T22:20:18.847118+0000","last_became_peered":"2024-09-11T22:20:18.847118+0000","last_unstale":"2024-09-11T22:35:37.366967+0000","last_undegraded":"2024-09-11T22:35:37.366967+0000","last_fullsized":"2024-09-11T22:35:37.366967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:47.360920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'7846","reported_seq":7870,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.854263+0000","last_change":"2024-09-11T22:20:24.077604+0000","last_active":"2024-09-11T22:35:44.854263+0000","last_peered":"2024-09-11T22:35:44.854263+0000","last_clean":"2024-09-11T22:35:44.854263+0000","last_became_active":"2024-09-11T22:20:24.077231+0000","last_became_peered":"2024-09-11T22:20:24.077231+0000","last_unstale":"2024-09-11T22:35:44.854263+0000","last_undegraded":"2024-09-11T22:35:44.854263+0000","last_fullsized":"2024-09-11T22:35:44.854263+0000","mapping_epoch":24,"log_start":"28'701","ondisk_log_start":"28'701","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":7145,"log_dups_size":0,"ondisk_log_size":7145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:38.846688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35635,"num_write_kb":625996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"28'12","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.030058+0000","last_change":"2024-09-11T22:20:19.854453+0000","last_active":"2024-09-11T22:35:51.030058+0000","last_peered":"2024-09-11T22:35:51.030058+0000","last_clean":"2024-09-11T22:35:51.030058+0000","last_became_active":"2024-09-11T22:20:19.854100+0000","last_became_peered":"2024-09-11T22:20:19.854100+0000","last_unstale":"2024-09-11T22:35:51.030058+0000","last_undegraded":"2024-09-11T22:35:51.030058+0000","last_fullsized":"2024-09-11T22:35:51.030058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:06.166813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.334898+0000","last_change":"2024-09-11T22:20:18.854889+0000","last_active":"2024-09-11T22:35:37.334898+0000","last_peered":"2024-09-11T22:35:37.334898+0000","last_clean":"2024-09-11T22:35:37.334898+0000","last_became_active":"2024-09-11T22:20:18.854552+0000","last_became_peered":"2024-09-11T22:20:18.854552+0000","last_unstale":"2024-09-11T22:35:37.334898+0000","last_undegraded":"2024-09-11T22:35:37.334898+0000","last_fullsized":"2024-09-11T22:35:37.334898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:33.612126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'4949","reported_seq":4973,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.864497+0000","last_change":"2024-09-11T22:20:23.878932+0000","last_active":"2024-09-11T22:35:44.864497+0000","last_peered":"2024-09-11T22:35:44.864497+0000","last_clean":"2024-09-11T22:35:44.864497+0000","last_became_active":"2024-09-11T22:20:23.878305+0000","last_became_peered":"2024-09-11T22:20:23.878305+0000","last_unstale":"2024-09-11T22:35:44.864497+0000","last_undegraded":"2024-09-11T22:35:44.864497+0000","last_fullsized":"2024-09-11T22:35:44.864497+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":4949,"log_dups_size":0,"ondisk_log_size":4949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21676,"num_write_kb":446977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'26","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043966+0000","last_change":"2024-09-11T22:20:19.856318+0000","last_active":"2024-09-11T22:35:51.043966+0000","last_peered":"2024-09-11T22:35:51.043966+0000","last_clean":"2024-09-11T22:35:51.043966+0000","last_became_active":"2024-09-11T22:20:19.855992+0000","last_became_peered":"2024-09-11T22:20:19.855992+0000","last_unstale":"2024-09-11T22:35:51.043966+0000","last_undegraded":"2024-09-11T22:35:51.043966+0000","last_fullsized":"2024-09-11T22:35:51.043966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'6","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:28.337628+0000","last_change":"2024-09-11T22:20:18.850750+0000","last_active":"2024-09-11T22:35:28.337628+0000","last_peered":"2024-09-11T22:35:28.337628+0000","last_clean":"2024-09-11T22:35:28.337628+0000","last_became_active":"2024-09-11T22:20:18.849621+0000","last_became_peered":"2024-09-11T22:20:18.849621+0000","last_unstale":"2024-09-11T22:35:28.337628+0000","last_undegraded":"2024-09-11T22:35:28.337628+0000","last_fullsized":"2024-09-11T22:35:28.337628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'5822","reported_seq":5847,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.807191+0000","last_change":"2024-09-11T22:20:24.077741+0000","last_active":"2024-09-11T22:35:44.807191+0000","last_peered":"2024-09-11T22:35:44.807191+0000","last_clean":"2024-09-11T22:35:44.807191+0000","last_became_active":"2024-09-11T22:20:24.077325+0000","last_became_peered":"2024-09-11T22:20:24.077325+0000","last_unstale":"2024-09-11T22:35:44.807191+0000","last_undegraded":"2024-09-11T22:35:44.807191+0000","last_fullsized":"2024-09-11T22:35:44.807191+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5822,"log_dups_size":0,"ondisk_log_size":5822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:18.656529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26961,"num_write_kb":521330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'18","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.057658+0000","last_change":"2024-09-11T22:20:19.850738+0000","last_active":"2024-09-11T22:35:51.057658+0000","last_peered":"2024-09-11T22:35:51.057658+0000","last_clean":"2024-09-11T22:35:51.057658+0000","last_became_active":"2024-09-11T22:20:19.850441+0000","last_became_peered":"2024-09-11T22:20:19.850441+0000","last_unstale":"2024-09-11T22:35:51.057658+0000","last_undegraded":"2024-09-11T22:35:51.057658+0000","last_fullsized":"2024-09-11T22:35:51.057658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:47.552343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'351","reported_seq":384,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.969721+0000","last_change":"2024-09-11T22:20:18.845173+0000","last_active":"2024-09-11T22:35:41.969721+0000","last_peered":"2024-09-11T22:35:41.969721+0000","last_clean":"2024-09-11T22:35:41.969721+0000","last_became_active":"2024-09-11T22:20:18.844731+0000","last_became_peered":"2024-09-11T22:20:18.844731+0000","last_unstale":"2024-09-11T22:35:41.969721+0000","last_undegraded":"2024-09-11T22:35:41.969721+0000","last_fullsized":"2024-09-11T22:35:41.969721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:32.963285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'6627","reported_seq":6659,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.761641+0000","last_change":"2024-09-11T22:21:02.037927+0000","last_active":"2024-09-11T22:35:44.761641+0000","last_peered":"2024-09-11T22:35:44.761641+0000","last_clean":"2024-09-11T22:35:44.761641+0000","last_became_active":"2024-09-11T22:21:02.037520+0000","last_became_peered":"2024-09-11T22:21:02.037520+0000","last_unstale":"2024-09-11T22:35:44.761641+0000","last_undegraded":"2024-09-11T22:35:44.761641+0000","last_fullsized":"2024-09-11T22:35:44.761641+0000","mapping_epoch":27,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6327,"log_dups_size":0,"ondisk_log_size":6327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:38.798530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30659,"num_write_kb":569042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'18","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.040494+0000","last_change":"2024-09-11T22:20:19.845497+0000","last_active":"2024-09-11T22:35:51.040494+0000","last_peered":"2024-09-11T22:35:51.040494+0000","last_clean":"2024-09-11T22:35:51.040494+0000","last_became_active":"2024-09-11T22:20:19.845203+0000","last_became_peered":"2024-09-11T22:20:19.845203+0000","last_unstale":"2024-09-11T22:35:51.040494+0000","last_undegraded":"2024-09-11T22:35:51.040494+0000","last_fullsized":"2024-09-11T22:35:51.040494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:12.086231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.363453+0000","last_change":"2024-09-11T22:20:18.856263+0000","last_active":"2024-09-11T22:35:37.363453+0000","last_peered":"2024-09-11T22:35:37.363453+0000","last_clean":"2024-09-11T22:35:37.363453+0000","last_became_active":"2024-09-11T22:20:18.855968+0000","last_became_peered":"2024-09-11T22:20:18.855968+0000","last_unstale":"2024-09-11T22:35:37.363453+0000","last_undegraded":"2024-09-11T22:35:37.363453+0000","last_fullsized":"2024-09-11T22:35:37.363453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'5454","reported_seq":5480,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.493084+0000","last_change":"2024-09-11T22:20:24.075030+0000","last_active":"2024-09-11T22:35:44.493084+0000","last_peered":"2024-09-11T22:35:44.493084+0000","last_clean":"2024-09-11T22:35:44.493084+0000","last_became_active":"2024-09-11T22:20:24.074588+0000","last_became_peered":"2024-09-11T22:20:24.074588+0000","last_unstale":"2024-09-11T22:35:44.493084+0000","last_undegraded":"2024-09-11T22:35:44.493084+0000","last_fullsized":"2024-09-11T22:35:44.493084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5454,"log_dups_size":0,"ondisk_log_size":5454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25186,"num_write_kb":469240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'18","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.062538+0000","last_change":"2024-09-11T22:20:19.859010+0000","last_active":"2024-09-11T22:35:51.062538+0000","last_peered":"2024-09-11T22:35:51.062538+0000","last_clean":"2024-09-11T22:35:51.062538+0000","last_became_active":"2024-09-11T22:20:19.858585+0000","last_became_peered":"2024-09-11T22:20:19.858585+0000","last_unstale":"2024-09-11T22:35:51.062538+0000","last_undegraded":"2024-09-11T22:35:51.062538+0000","last_fullsized":"2024-09-11T22:35:51.062538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.850550+0000","last_change":"2024-09-11T22:20:18.847904+0000","last_active":"2024-09-11T22:35:37.850550+0000","last_peered":"2024-09-11T22:35:37.850550+0000","last_clean":"2024-09-11T22:35:37.850550+0000","last_became_active":"2024-09-11T22:20:18.847669+0000","last_became_peered":"2024-09-11T22:20:18.847669+0000","last_unstale":"2024-09-11T22:35:37.850550+0000","last_undegraded":"2024-09-11T22:35:37.850550+0000","last_fullsized":"2024-09-11T22:35:37.850550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:08.717999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'6951","reported_seq":6976,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.741120+0000","last_change":"2024-09-11T22:20:23.881067+0000","last_active":"2024-09-11T22:35:44.741120+0000","last_peered":"2024-09-11T22:35:44.741120+0000","last_clean":"2024-09-11T22:35:44.741120+0000","last_became_active":"2024-09-11T22:20:23.880468+0000","last_became_peered":"2024-09-11T22:20:23.880468+0000","last_unstale":"2024-09-11T22:35:44.741120+0000","last_undegraded":"2024-09-11T22:35:44.741120+0000","last_fullsized":"2024-09-11T22:35:44.741120+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6951,"log_dups_size":0,"ondisk_log_size":6951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:23.480547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31360,"num_write_kb":584090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'17","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.049873+0000","last_change":"2024-09-11T22:20:19.860423+0000","last_active":"2024-09-11T22:35:51.049873+0000","last_peered":"2024-09-11T22:35:51.049873+0000","last_clean":"2024-09-11T22:35:51.049873+0000","last_became_active":"2024-09-11T22:20:19.858932+0000","last_became_peered":"2024-09-11T22:20:19.858932+0000","last_unstale":"2024-09-11T22:35:51.049873+0000","last_undegraded":"2024-09-11T22:35:51.049873+0000","last_fullsized":"2024-09-11T22:35:51.049873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:53.255932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'6","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.950652+0000","last_change":"2024-09-11T22:20:18.854973+0000","last_active":"2024-09-11T22:35:41.950652+0000","last_peered":"2024-09-11T22:35:41.950652+0000","last_clean":"2024-09-11T22:35:41.950652+0000","last_became_active":"2024-09-11T22:20:18.854725+0000","last_became_peered":"2024-09-11T22:20:18.854725+0000","last_unstale":"2024-09-11T22:35:41.950652+0000","last_undegraded":"2024-09-11T22:35:41.950652+0000","last_fullsized":"2024-09-11T22:35:41.950652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:52.247103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'6039","reported_seq":6064,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.873235+0000","last_change":"2024-09-11T22:20:23.880693+0000","last_active":"2024-09-11T22:35:44.873235+0000","last_peered":"2024-09-11T22:35:44.873235+0000","last_clean":"2024-09-11T22:35:44.873235+0000","last_became_active":"2024-09-11T22:20:23.880243+0000","last_became_peered":"2024-09-11T22:20:23.880243+0000","last_unstale":"2024-09-11T22:35:44.873235+0000","last_undegraded":"2024-09-11T22:35:44.873235+0000","last_fullsized":"2024-09-11T22:35:44.873235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6039,"log_dups_size":0,"ondisk_log_size":6039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:09.659287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27825,"num_write_kb":504386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'23","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.040905+0000","last_change":"2024-09-11T22:20:19.844808+0000","last_active":"2024-09-11T22:35:51.040905+0000","last_peered":"2024-09-11T22:35:51.040905+0000","last_clean":"2024-09-11T22:35:51.040905+0000","last_became_active":"2024-09-11T22:20:19.844536+0000","last_became_peered":"2024-09-11T22:20:19.844536+0000","last_unstale":"2024-09-11T22:35:51.040905+0000","last_undegraded":"2024-09-11T22:35:51.040905+0000","last_fullsized":"2024-09-11T22:35:51.040905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:57.142383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'51","reported_seq":130,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.940434+0000","last_change":"2024-09-11T22:20:18.855640+0000","last_active":"2024-09-11T22:35:41.940434+0000","last_peered":"2024-09-11T22:35:41.940434+0000","last_clean":"2024-09-11T22:35:41.940434+0000","last_became_active":"2024-09-11T22:20:18.855394+0000","last_became_peered":"2024-09-11T22:20:18.855394+0000","last_unstale":"2024-09-11T22:35:41.940434+0000","last_undegraded":"2024-09-11T22:35:41.940434+0000","last_fullsized":"2024-09-11T22:35:41.940434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94258,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":122,"num_write":49,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'6775","reported_seq":6800,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.543280+0000","last_change":"2024-09-11T22:20:23.882554+0000","last_active":"2024-09-11T22:35:44.543280+0000","last_peered":"2024-09-11T22:35:44.543280+0000","last_clean":"2024-09-11T22:35:44.543280+0000","last_became_active":"2024-09-11T22:20:23.881642+0000","last_became_peered":"2024-09-11T22:20:23.881642+0000","last_unstale":"2024-09-11T22:35:44.543280+0000","last_undegraded":"2024-09-11T22:35:44.543280+0000","last_fullsized":"2024-09-11T22:35:44.543280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6775,"log_dups_size":0,"ondisk_log_size":6775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:16.696043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30543,"num_write_kb":560301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'13","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.041324+0000","last_change":"2024-09-11T22:20:19.859429+0000","last_active":"2024-09-11T22:35:51.041324+0000","last_peered":"2024-09-11T22:35:51.041324+0000","last_clean":"2024-09-11T22:35:51.041324+0000","last_became_active":"2024-09-11T22:20:19.859159+0000","last_became_peered":"2024-09-11T22:20:19.859159+0000","last_unstale":"2024-09-11T22:35:51.041324+0000","last_undegraded":"2024-09-11T22:35:51.041324+0000","last_fullsized":"2024-09-11T22:35:51.041324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'8","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.980499+0000","last_change":"2024-09-11T22:20:18.856144+0000","last_active":"2024-09-11T22:35:41.980499+0000","last_peered":"2024-09-11T22:35:41.980499+0000","last_clean":"2024-09-11T22:35:41.980499+0000","last_became_active":"2024-09-11T22:20:18.855866+0000","last_became_peered":"2024-09-11T22:20:18.855866+0000","last_unstale":"2024-09-11T22:35:41.980499+0000","last_undegraded":"2024-09-11T22:35:41.980499+0000","last_fullsized":"2024-09-11T22:35:41.980499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:37.259393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'5391","reported_seq":5417,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.691196+0000","last_change":"2024-09-11T22:20:24.075154+0000","last_active":"2024-09-11T22:35:44.691196+0000","last_peered":"2024-09-11T22:35:44.691196+0000","last_clean":"2024-09-11T22:35:44.691196+0000","last_became_active":"2024-09-11T22:20:24.074568+0000","last_became_peered":"2024-09-11T22:20:24.074568+0000","last_unstale":"2024-09-11T22:35:44.691196+0000","last_undegraded":"2024-09-11T22:35:44.691196+0000","last_fullsized":"2024-09-11T22:35:44.691196+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5391,"log_dups_size":0,"ondisk_log_size":5391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24494,"num_write_kb":454589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'16","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.061776+0000","last_change":"2024-09-11T22:20:19.861236+0000","last_active":"2024-09-11T22:35:51.061776+0000","last_peered":"2024-09-11T22:35:51.061776+0000","last_clean":"2024-09-11T22:35:51.061776+0000","last_became_active":"2024-09-11T22:20:19.860938+0000","last_became_peered":"2024-09-11T22:20:19.860938+0000","last_unstale":"2024-09-11T22:35:51.061776+0000","last_undegraded":"2024-09-11T22:35:51.061776+0000","last_fullsized":"2024-09-11T22:35:51.061776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:42.015334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'4","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:32:48.462376+0000","last_change":"2024-09-11T22:20:18.853467+0000","last_active":"2024-09-11T22:32:48.462376+0000","last_peered":"2024-09-11T22:32:48.462376+0000","last_clean":"2024-09-11T22:32:48.462376+0000","last_became_active":"2024-09-11T22:20:18.853182+0000","last_became_peered":"2024-09-11T22:20:18.853182+0000","last_unstale":"2024-09-11T22:32:48.462376+0000","last_undegraded":"2024-09-11T22:32:48.462376+0000","last_fullsized":"2024-09-11T22:32:48.462376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":189,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:32:13.435821+0000","last_change":"2024-09-11T22:20:09.425648+0000","last_active":"2024-09-11T22:32:13.435821+0000","last_peered":"2024-09-11T22:32:13.435821+0000","last_clean":"2024-09-11T22:32:13.435821+0000","last_became_active":"2024-09-11T22:20:09.424591+0000","last_became_peered":"2024-09-11T22:20:09.424591+0000","last_unstale":"2024-09-11T22:32:13.435821+0000","last_undegraded":"2024-09-11T22:32:13.435821+0000","last_fullsized":"2024-09-11T22:32:13.435821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:08.334092+0000","last_clean_scrub_stamp":"2024-09-11T22:20:08.334092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:53.974197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'5687","reported_seq":5712,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.790987+0000","last_change":"2024-09-11T22:20:24.077007+0000","last_active":"2024-09-11T22:35:44.790987+0000","last_peered":"2024-09-11T22:35:44.790987+0000","last_clean":"2024-09-11T22:35:44.790987+0000","last_became_active":"2024-09-11T22:20:24.076601+0000","last_became_peered":"2024-09-11T22:20:24.076601+0000","last_unstale":"2024-09-11T22:35:44.790987+0000","last_undegraded":"2024-09-11T22:35:44.790987+0000","last_fullsized":"2024-09-11T22:35:44.790987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5687,"log_dups_size":0,"ondisk_log_size":5687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:36.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25854,"num_write_kb":500757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'22","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.063439+0000","last_change":"2024-09-11T22:20:19.863279+0000","last_active":"2024-09-11T22:35:51.063439+0000","last_peered":"2024-09-11T22:35:51.063439+0000","last_clean":"2024-09-11T22:35:51.063439+0000","last_became_active":"2024-09-11T22:20:19.861322+0000","last_became_peered":"2024-09-11T22:20:19.861322+0000","last_unstale":"2024-09-11T22:35:51.063439+0000","last_undegraded":"2024-09-11T22:35:51.063439+0000","last_fullsized":"2024-09-11T22:35:51.063439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'5","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.325592+0000","last_change":"2024-09-11T22:20:18.853343+0000","last_active":"2024-09-11T22:35:37.325592+0000","last_peered":"2024-09-11T22:35:37.325592+0000","last_clean":"2024-09-11T22:35:37.325592+0000","last_became_active":"2024-09-11T22:20:18.853069+0000","last_became_peered":"2024-09-11T22:20:18.853069+0000","last_unstale":"2024-09-11T22:35:37.325592+0000","last_undegraded":"2024-09-11T22:35:37.325592+0000","last_fullsized":"2024-09-11T22:35:37.325592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'5968","reported_seq":5993,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.663026+0000","last_change":"2024-09-11T22:20:24.075350+0000","last_active":"2024-09-11T22:35:44.663026+0000","last_peered":"2024-09-11T22:35:44.663026+0000","last_clean":"2024-09-11T22:35:44.663026+0000","last_became_active":"2024-09-11T22:20:24.074789+0000","last_became_peered":"2024-09-11T22:20:24.074789+0000","last_unstale":"2024-09-11T22:35:44.663026+0000","last_undegraded":"2024-09-11T22:35:44.663026+0000","last_fullsized":"2024-09-11T22:35:44.663026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5968,"log_dups_size":0,"ondisk_log_size":5968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.582648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27295,"num_write_kb":514661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'20","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.061734+0000","last_change":"2024-09-11T22:20:19.866331+0000","last_active":"2024-09-11T22:35:51.061734+0000","last_peered":"2024-09-11T22:35:51.061734+0000","last_clean":"2024-09-11T22:35:51.061734+0000","last_became_active":"2024-09-11T22:20:19.865535+0000","last_became_peered":"2024-09-11T22:20:19.865535+0000","last_unstale":"2024-09-11T22:35:51.061734+0000","last_undegraded":"2024-09-11T22:35:51.061734+0000","last_fullsized":"2024-09-11T22:35:51.061734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'2","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:33:54.589490+0000","last_change":"2024-09-11T22:20:18.849434+0000","last_active":"2024-09-11T22:33:54.589490+0000","last_peered":"2024-09-11T22:33:54.589490+0000","last_clean":"2024-09-11T22:33:54.589490+0000","last_became_active":"2024-09-11T22:20:18.848787+0000","last_became_peered":"2024-09-11T22:20:18.848787+0000","last_unstale":"2024-09-11T22:33:54.589490+0000","last_undegraded":"2024-09-11T22:33:54.589490+0000","last_fullsized":"2024-09-11T22:33:54.589490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:13:25.689495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'5430","reported_seq":5455,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.845579+0000","last_change":"2024-09-11T22:20:23.879962+0000","last_active":"2024-09-11T22:35:44.845579+0000","last_peered":"2024-09-11T22:35:44.845579+0000","last_clean":"2024-09-11T22:35:44.845579+0000","last_became_active":"2024-09-11T22:20:23.879586+0000","last_became_peered":"2024-09-11T22:20:23.879586+0000","last_unstale":"2024-09-11T22:35:44.845579+0000","last_undegraded":"2024-09-11T22:35:44.845579+0000","last_fullsized":"2024-09-11T22:35:44.845579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5430,"log_dups_size":0,"ondisk_log_size":5430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24342,"num_write_kb":478105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'21","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.056702+0000","last_change":"2024-09-11T22:20:19.860411+0000","last_active":"2024-09-11T22:35:51.056702+0000","last_peered":"2024-09-11T22:35:51.056702+0000","last_clean":"2024-09-11T22:35:51.056702+0000","last_became_active":"2024-09-11T22:20:19.860076+0000","last_became_peered":"2024-09-11T22:20:19.860076+0000","last_unstale":"2024-09-11T22:35:51.056702+0000","last_undegraded":"2024-09-11T22:35:51.056702+0000","last_fullsized":"2024-09-11T22:35:51.056702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:56:23.297519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'6","reported_seq":39,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.970052+0000","last_change":"2024-09-11T22:20:18.856020+0000","last_active":"2024-09-11T22:35:41.970052+0000","last_peered":"2024-09-11T22:35:41.970052+0000","last_clean":"2024-09-11T22:35:41.970052+0000","last_became_active":"2024-09-11T22:20:18.855753+0000","last_became_peered":"2024-09-11T22:20:18.855753+0000","last_unstale":"2024-09-11T22:35:41.970052+0000","last_undegraded":"2024-09-11T22:35:41.970052+0000","last_fullsized":"2024-09-11T22:35:41.970052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'6069","reported_seq":6094,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.538017+0000","last_change":"2024-09-11T22:20:24.077975+0000","last_active":"2024-09-11T22:35:44.538017+0000","last_peered":"2024-09-11T22:35:44.538017+0000","last_clean":"2024-09-11T22:35:44.538017+0000","last_became_active":"2024-09-11T22:20:24.077502+0000","last_became_peered":"2024-09-11T22:20:24.077502+0000","last_unstale":"2024-09-11T22:35:44.538017+0000","last_undegraded":"2024-09-11T22:35:44.538017+0000","last_fullsized":"2024-09-11T22:35:44.538017+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6069,"log_dups_size":0,"ondisk_log_size":6069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:16.601216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27695,"num_write_kb":495810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'12","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.052943+0000","last_change":"2024-09-11T22:20:19.856986+0000","last_active":"2024-09-11T22:35:51.052943+0000","last_peered":"2024-09-11T22:35:51.052943+0000","last_clean":"2024-09-11T22:35:51.052943+0000","last_became_active":"2024-09-11T22:20:19.856739+0000","last_became_peered":"2024-09-11T22:20:19.856739+0000","last_unstale":"2024-09-11T22:35:51.052943+0000","last_undegraded":"2024-09-11T22:35:51.052943+0000","last_fullsized":"2024-09-11T22:35:51.052943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'6","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.987646+0000","last_change":"2024-09-11T22:20:18.855044+0000","last_active":"2024-09-11T22:35:41.987646+0000","last_peered":"2024-09-11T22:35:41.987646+0000","last_clean":"2024-09-11T22:35:41.987646+0000","last_became_active":"2024-09-11T22:20:18.854764+0000","last_became_peered":"2024-09-11T22:20:18.854764+0000","last_unstale":"2024-09-11T22:35:41.987646+0000","last_undegraded":"2024-09-11T22:35:41.987646+0000","last_fullsized":"2024-09-11T22:35:41.987646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:22.207278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'5738","reported_seq":5763,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.723908+0000","last_change":"2024-09-11T22:20:23.878383+0000","last_active":"2024-09-11T22:35:44.723908+0000","last_peered":"2024-09-11T22:35:44.723908+0000","last_clean":"2024-09-11T22:35:44.723908+0000","last_became_active":"2024-09-11T22:20:23.877890+0000","last_became_peered":"2024-09-11T22:20:23.877890+0000","last_unstale":"2024-09-11T22:35:44.723908+0000","last_undegraded":"2024-09-11T22:35:44.723908+0000","last_fullsized":"2024-09-11T22:35:44.723908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5738,"log_dups_size":0,"ondisk_log_size":5738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:18.876485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25762,"num_write_kb":496113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'20","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.057770+0000","last_change":"2024-09-11T22:20:19.861242+0000","last_active":"2024-09-11T22:35:51.057770+0000","last_peered":"2024-09-11T22:35:51.057770+0000","last_clean":"2024-09-11T22:35:51.057770+0000","last_became_active":"2024-09-11T22:20:19.860988+0000","last_became_peered":"2024-09-11T22:20:19.860988+0000","last_unstale":"2024-09-11T22:35:51.057770+0000","last_undegraded":"2024-09-11T22:35:51.057770+0000","last_fullsized":"2024-09-11T22:35:51.057770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'27","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:01.772298+0000","last_change":"2024-09-11T22:36:01.772348+0000","last_active":"2024-09-11T22:36:01.772298+0000","last_peered":"2024-09-11T22:36:01.772298+0000","last_clean":"2024-09-11T22:36:01.772298+0000","last_became_active":"2024-09-11T22:20:18.852153+0000","last_became_peered":"2024-09-11T22:20:18.852153+0000","last_unstale":"2024-09-11T22:36:01.772298+0000","last_undegraded":"2024-09-11T22:36:01.772298+0000","last_fullsized":"2024-09-11T22:36:01.772298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'27","last_scrub_stamp":"2024-09-11T22:36:01.772209+0000","last_deep_scrub":"28'27","last_deep_scrub_stamp":"2024-09-11T22:36:01.772209+0000","last_clean_scrub_stamp":"2024-09-11T22:36:01.772209+0000","objects_scrubbed":8,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:54.186626+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'6219","reported_seq":6244,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.874212+0000","last_change":"2024-09-11T22:20:23.874062+0000","last_active":"2024-09-11T22:35:44.874212+0000","last_peered":"2024-09-11T22:35:44.874212+0000","last_clean":"2024-09-11T22:35:44.874212+0000","last_became_active":"2024-09-11T22:20:23.873635+0000","last_became_peered":"2024-09-11T22:20:23.873635+0000","last_unstale":"2024-09-11T22:35:44.874212+0000","last_undegraded":"2024-09-11T22:35:44.874212+0000","last_fullsized":"2024-09-11T22:35:44.874212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6219,"log_dups_size":0,"ondisk_log_size":6219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28436,"num_write_kb":547819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'20","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.045171+0000","last_change":"2024-09-11T22:20:19.851577+0000","last_active":"2024-09-11T22:35:51.045171+0000","last_peered":"2024-09-11T22:35:51.045171+0000","last_clean":"2024-09-11T22:35:51.045171+0000","last_became_active":"2024-09-11T22:20:19.851286+0000","last_became_peered":"2024-09-11T22:20:19.851286+0000","last_unstale":"2024-09-11T22:35:51.045171+0000","last_undegraded":"2024-09-11T22:35:51.045171+0000","last_fullsized":"2024-09-11T22:35:51.045171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:32.025931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'9","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.934456+0000","last_change":"2024-09-11T22:20:18.853301+0000","last_active":"2024-09-11T22:35:41.934456+0000","last_peered":"2024-09-11T22:35:41.934456+0000","last_clean":"2024-09-11T22:35:41.934456+0000","last_became_active":"2024-09-11T22:20:18.852978+0000","last_became_peered":"2024-09-11T22:20:18.852978+0000","last_unstale":"2024-09-11T22:35:41.934456+0000","last_undegraded":"2024-09-11T22:35:41.934456+0000","last_fullsized":"2024-09-11T22:35:41.934456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:10.200253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'6495","reported_seq":6519,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.721208+0000","last_change":"2024-09-11T22:20:24.077636+0000","last_active":"2024-09-11T22:35:44.721208+0000","last_peered":"2024-09-11T22:35:44.721208+0000","last_clean":"2024-09-11T22:35:44.721208+0000","last_became_active":"2024-09-11T22:20:24.077313+0000","last_became_peered":"2024-09-11T22:20:24.077313+0000","last_unstale":"2024-09-11T22:35:44.721208+0000","last_undegraded":"2024-09-11T22:35:44.721208+0000","last_fullsized":"2024-09-11T22:35:44.721208+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6295,"log_dups_size":0,"ondisk_log_size":6295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:23.154027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29875,"num_write_kb":541234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'29","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.056839+0000","last_change":"2024-09-11T22:20:19.862562+0000","last_active":"2024-09-11T22:35:51.056839+0000","last_peered":"2024-09-11T22:35:51.056839+0000","last_clean":"2024-09-11T22:35:51.056839+0000","last_became_active":"2024-09-11T22:20:19.862267+0000","last_became_peered":"2024-09-11T22:20:19.862267+0000","last_unstale":"2024-09-11T22:35:51.056839+0000","last_undegraded":"2024-09-11T22:35:51.056839+0000","last_fullsized":"2024-09-11T22:35:51.056839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'8","reported_seq":40,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.772343+0000","last_change":"2024-09-11T22:20:18.858002+0000","last_active":"2024-09-11T22:35:41.772343+0000","last_peered":"2024-09-11T22:35:41.772343+0000","last_clean":"2024-09-11T22:35:41.772343+0000","last_became_active":"2024-09-11T22:20:18.857419+0000","last_became_peered":"2024-09-11T22:20:18.857419+0000","last_unstale":"2024-09-11T22:35:41.772343+0000","last_undegraded":"2024-09-11T22:35:41.772343+0000","last_fullsized":"2024-09-11T22:35:41.772343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.157983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'6284","reported_seq":6308,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.748617+0000","last_change":"2024-09-11T22:20:24.074971+0000","last_active":"2024-09-11T22:35:44.748617+0000","last_peered":"2024-09-11T22:35:44.748617+0000","last_clean":"2024-09-11T22:35:44.748617+0000","last_became_active":"2024-09-11T22:20:24.074609+0000","last_became_peered":"2024-09-11T22:20:24.074609+0000","last_unstale":"2024-09-11T22:35:44.748617+0000","last_undegraded":"2024-09-11T22:35:44.748617+0000","last_fullsized":"2024-09-11T22:35:44.748617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6284,"log_dups_size":0,"ondisk_log_size":6284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:55.318904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27888,"num_write_kb":554175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'24","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.058411+0000","last_change":"2024-09-11T22:20:19.857276+0000","last_active":"2024-09-11T22:35:51.058411+0000","last_peered":"2024-09-11T22:35:51.058411+0000","last_clean":"2024-09-11T22:35:51.058411+0000","last_became_active":"2024-09-11T22:20:19.857027+0000","last_became_peered":"2024-09-11T22:20:19.857027+0000","last_unstale":"2024-09-11T22:35:51.058411+0000","last_undegraded":"2024-09-11T22:35:51.058411+0000","last_fullsized":"2024-09-11T22:35:51.058411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'15","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:00.703974+0000","last_change":"2024-09-11T22:36:00.704034+0000","last_active":"2024-09-11T22:36:00.703974+0000","last_peered":"2024-09-11T22:36:00.703974+0000","last_clean":"2024-09-11T22:36:00.703974+0000","last_became_active":"2024-09-11T22:20:18.848405+0000","last_became_peered":"2024-09-11T22:20:18.848405+0000","last_unstale":"2024-09-11T22:36:00.703974+0000","last_undegraded":"2024-09-11T22:36:00.703974+0000","last_fullsized":"2024-09-11T22:36:00.703974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-09-11T22:36:00.703688+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-09-11T22:36:00.703688+0000","last_clean_scrub_stamp":"2024-09-11T22:36:00.703688+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:50:43.022157+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'5107","reported_seq":5131,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.845298+0000","last_change":"2024-09-11T22:20:24.076835+0000","last_active":"2024-09-11T22:35:44.845298+0000","last_peered":"2024-09-11T22:35:44.845298+0000","last_clean":"2024-09-11T22:35:44.845298+0000","last_became_active":"2024-09-11T22:20:24.076200+0000","last_became_peered":"2024-09-11T22:20:24.076200+0000","last_unstale":"2024-09-11T22:35:44.845298+0000","last_undegraded":"2024-09-11T22:35:44.845298+0000","last_fullsized":"2024-09-11T22:35:44.845298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5107,"log_dups_size":0,"ondisk_log_size":5107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:48.150778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22900,"num_write_kb":480501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'17","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.046531+0000","last_change":"2024-09-11T22:21:02.033502+0000","last_active":"2024-09-11T22:35:51.046531+0000","last_peered":"2024-09-11T22:35:51.046531+0000","last_clean":"2024-09-11T22:35:51.046531+0000","last_became_active":"2024-09-11T22:21:02.033269+0000","last_became_peered":"2024-09-11T22:21:02.033269+0000","last_unstale":"2024-09-11T22:35:51.046531+0000","last_undegraded":"2024-09-11T22:35:51.046531+0000","last_fullsized":"2024-09-11T22:35:51.046531+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:31.993239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'329","reported_seq":361,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.984847+0000","last_change":"2024-09-11T22:20:18.855665+0000","last_active":"2024-09-11T22:35:41.984847+0000","last_peered":"2024-09-11T22:35:41.984847+0000","last_clean":"2024-09-11T22:35:41.984847+0000","last_became_active":"2024-09-11T22:20:18.855386+0000","last_became_peered":"2024-09-11T22:20:18.855386+0000","last_unstale":"2024-09-11T22:35:41.984847+0000","last_undegraded":"2024-09-11T22:35:41.984847+0000","last_fullsized":"2024-09-11T22:35:41.984847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:24.017393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'5582","reported_seq":5606,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.597450+0000","last_change":"2024-09-11T22:20:23.880793+0000","last_active":"2024-09-11T22:35:44.597450+0000","last_peered":"2024-09-11T22:35:44.597450+0000","last_clean":"2024-09-11T22:35:44.597450+0000","last_became_active":"2024-09-11T22:20:23.879993+0000","last_became_peered":"2024-09-11T22:20:23.879993+0000","last_unstale":"2024-09-11T22:35:44.597450+0000","last_undegraded":"2024-09-11T22:35:44.597450+0000","last_fullsized":"2024-09-11T22:35:44.597450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5582,"log_dups_size":0,"ondisk_log_size":5582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:50.449090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25321,"num_write_kb":502610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'21","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.050799+0000","last_change":"2024-09-11T22:20:19.858588+0000","last_active":"2024-09-11T22:35:51.050799+0000","last_peered":"2024-09-11T22:35:51.050799+0000","last_clean":"2024-09-11T22:35:51.050799+0000","last_became_active":"2024-09-11T22:20:19.858322+0000","last_became_peered":"2024-09-11T22:20:19.858322+0000","last_unstale":"2024-09-11T22:35:51.050799+0000","last_undegraded":"2024-09-11T22:35:51.050799+0000","last_fullsized":"2024-09-11T22:35:51.050799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:38.268223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'27","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.992364+0000","last_change":"2024-09-11T22:20:18.855056+0000","last_active":"2024-09-11T22:35:41.992364+0000","last_peered":"2024-09-11T22:35:41.992364+0000","last_clean":"2024-09-11T22:35:41.992364+0000","last_became_active":"2024-09-11T22:20:18.854784+0000","last_became_peered":"2024-09-11T22:20:18.854784+0000","last_unstale":"2024-09-11T22:35:41.992364+0000","last_undegraded":"2024-09-11T22:35:41.992364+0000","last_fullsized":"2024-09-11T22:35:41.992364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:38.916121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'6236","reported_seq":6260,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.716467+0000","last_change":"2024-09-11T22:20:23.879768+0000","last_active":"2024-09-11T22:35:44.716467+0000","last_peered":"2024-09-11T22:35:44.716467+0000","last_clean":"2024-09-11T22:35:44.716467+0000","last_became_active":"2024-09-11T22:20:23.878794+0000","last_became_peered":"2024-09-11T22:20:23.878794+0000","last_unstale":"2024-09-11T22:35:44.716467+0000","last_undegraded":"2024-09-11T22:35:44.716467+0000","last_fullsized":"2024-09-11T22:35:44.716467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6236,"log_dups_size":0,"ondisk_log_size":6236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:07.301587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28034,"num_write_kb":525577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'25","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.044289+0000","last_change":"2024-09-11T22:21:02.034590+0000","last_active":"2024-09-11T22:35:51.044289+0000","last_peered":"2024-09-11T22:35:51.044289+0000","last_clean":"2024-09-11T22:35:51.044289+0000","last_became_active":"2024-09-11T22:21:02.034349+0000","last_became_peered":"2024-09-11T22:21:02.034349+0000","last_unstale":"2024-09-11T22:35:51.044289+0000","last_undegraded":"2024-09-11T22:35:51.044289+0000","last_fullsized":"2024-09-11T22:35:51.044289+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'4","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.765058+0000","last_change":"2024-09-11T22:20:18.853382+0000","last_active":"2024-09-11T22:35:41.765058+0000","last_peered":"2024-09-11T22:35:41.765058+0000","last_clean":"2024-09-11T22:35:41.765058+0000","last_became_active":"2024-09-11T22:20:18.853103+0000","last_became_peered":"2024-09-11T22:20:18.853103+0000","last_unstale":"2024-09-11T22:35:41.765058+0000","last_undegraded":"2024-09-11T22:35:41.765058+0000","last_fullsized":"2024-09-11T22:35:41.765058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'5748","reported_seq":5772,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.639554+0000","last_change":"2024-09-11T22:20:23.876997+0000","last_active":"2024-09-11T22:35:44.639554+0000","last_peered":"2024-09-11T22:35:44.639554+0000","last_clean":"2024-09-11T22:35:44.639554+0000","last_became_active":"2024-09-11T22:20:23.876587+0000","last_became_peered":"2024-09-11T22:20:23.876587+0000","last_unstale":"2024-09-11T22:35:44.639554+0000","last_undegraded":"2024-09-11T22:35:44.639554+0000","last_fullsized":"2024-09-11T22:35:44.639554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5748,"log_dups_size":0,"ondisk_log_size":5748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:19.670665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26080,"num_write_kb":501611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'25","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.055748+0000","last_change":"2024-09-11T22:20:19.866624+0000","last_active":"2024-09-11T22:35:51.055748+0000","last_peered":"2024-09-11T22:35:51.055748+0000","last_clean":"2024-09-11T22:35:51.055748+0000","last_became_active":"2024-09-11T22:20:19.866303+0000","last_became_peered":"2024-09-11T22:20:19.866303+0000","last_unstale":"2024-09-11T22:35:51.055748+0000","last_undegraded":"2024-09-11T22:35:51.055748+0000","last_fullsized":"2024-09-11T22:35:51.055748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'6","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:41.933977+0000","last_change":"2024-09-11T22:20:18.854361+0000","last_active":"2024-09-11T22:35:41.933977+0000","last_peered":"2024-09-11T22:35:41.933977+0000","last_clean":"2024-09-11T22:35:41.933977+0000","last_became_active":"2024-09-11T22:20:18.854019+0000","last_became_peered":"2024-09-11T22:20:18.854019+0000","last_unstale":"2024-09-11T22:35:41.933977+0000","last_undegraded":"2024-09-11T22:35:41.933977+0000","last_fullsized":"2024-09-11T22:35:41.933977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'5959","reported_seq":5983,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.721236+0000","last_change":"2024-09-11T22:20:24.077476+0000","last_active":"2024-09-11T22:35:44.721236+0000","last_peered":"2024-09-11T22:35:44.721236+0000","last_clean":"2024-09-11T22:35:44.721236+0000","last_became_active":"2024-09-11T22:20:24.077134+0000","last_became_peered":"2024-09-11T22:20:24.077134+0000","last_unstale":"2024-09-11T22:35:44.721236+0000","last_undegraded":"2024-09-11T22:35:44.721236+0000","last_fullsized":"2024-09-11T22:35:44.721236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5959,"log_dups_size":0,"ondisk_log_size":5959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:03.186460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26850,"num_write_kb":516954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'7134","reported_seq":7167,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.865687+0000","last_change":"2024-09-11T22:21:02.037816+0000","last_active":"2024-09-11T22:35:44.865687+0000","last_peered":"2024-09-11T22:35:44.865687+0000","last_clean":"2024-09-11T22:35:44.865687+0000","last_became_active":"2024-09-11T22:21:02.037407+0000","last_became_peered":"2024-09-11T22:21:02.037407+0000","last_unstale":"2024-09-11T22:35:44.865687+0000","last_undegraded":"2024-09-11T22:35:44.865687+0000","last_fullsized":"2024-09-11T22:35:44.865687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":7134,"log_dups_size":0,"ondisk_log_size":7134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33450,"num_write_kb":608986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'20","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.042665+0000","last_change":"2024-09-11T22:20:19.845776+0000","last_active":"2024-09-11T22:35:51.042665+0000","last_peered":"2024-09-11T22:35:51.042665+0000","last_clean":"2024-09-11T22:35:51.042665+0000","last_became_active":"2024-09-11T22:20:19.845425+0000","last_became_peered":"2024-09-11T22:20:19.845425+0000","last_unstale":"2024-09-11T22:35:51.042665+0000","last_undegraded":"2024-09-11T22:35:51.042665+0000","last_fullsized":"2024-09-11T22:35:51.042665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:07.187533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'4","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.851019+0000","last_change":"2024-09-11T22:20:18.852446+0000","last_active":"2024-09-11T22:35:37.851019+0000","last_peered":"2024-09-11T22:35:37.851019+0000","last_clean":"2024-09-11T22:35:37.851019+0000","last_became_active":"2024-09-11T22:20:18.852155+0000","last_became_peered":"2024-09-11T22:20:18.852155+0000","last_unstale":"2024-09-11T22:35:37.851019+0000","last_undegraded":"2024-09-11T22:35:37.851019+0000","last_fullsized":"2024-09-11T22:35:37.851019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:24.615703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"28'6143","reported_seq":6168,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.664318+0000","last_change":"2024-09-11T22:20:23.876503+0000","last_active":"2024-09-11T22:35:44.664318+0000","last_peered":"2024-09-11T22:35:44.664318+0000","last_clean":"2024-09-11T22:35:44.664318+0000","last_became_active":"2024-09-11T22:20:23.876100+0000","last_became_peered":"2024-09-11T22:20:23.876100+0000","last_unstale":"2024-09-11T22:35:44.664318+0000","last_undegraded":"2024-09-11T22:35:44.664318+0000","last_fullsized":"2024-09-11T22:35:44.664318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6143,"log_dups_size":0,"ondisk_log_size":6143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:40.982226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28157,"num_write_kb":534365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'27","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.045313+0000","last_change":"2024-09-11T22:20:19.852606+0000","last_active":"2024-09-11T22:35:51.045313+0000","last_peered":"2024-09-11T22:35:51.045313+0000","last_clean":"2024-09-11T22:35:51.045313+0000","last_became_active":"2024-09-11T22:20:19.852333+0000","last_became_peered":"2024-09-11T22:20:19.852333+0000","last_unstale":"2024-09-11T22:35:51.045313+0000","last_undegraded":"2024-09-11T22:35:51.045313+0000","last_fullsized":"2024-09-11T22:35:51.045313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:56.940278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'5","reported_seq":37,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:34:55.328347+0000","last_change":"2024-09-11T22:20:18.853767+0000","last_active":"2024-09-11T22:34:55.328347+0000","last_peered":"2024-09-11T22:34:55.328347+0000","last_clean":"2024-09-11T22:34:55.328347+0000","last_became_active":"2024-09-11T22:20:18.853533+0000","last_became_peered":"2024-09-11T22:20:18.853533+0000","last_unstale":"2024-09-11T22:34:55.328347+0000","last_undegraded":"2024-09-11T22:34:55.328347+0000","last_fullsized":"2024-09-11T22:34:55.328347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:36.662271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'9","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.849731+0000","last_change":"2024-09-11T22:20:18.847133+0000","last_active":"2024-09-11T22:35:37.849731+0000","last_peered":"2024-09-11T22:35:37.849731+0000","last_clean":"2024-09-11T22:35:37.849731+0000","last_became_active":"2024-09-11T22:20:18.846321+0000","last_became_peered":"2024-09-11T22:20:18.846321+0000","last_unstale":"2024-09-11T22:35:37.849731+0000","last_undegraded":"2024-09-11T22:35:37.849731+0000","last_fullsized":"2024-09-11T22:35:37.849731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:10.928426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'19","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.044367+0000","last_change":"2024-09-11T22:20:19.861445+0000","last_active":"2024-09-11T22:35:51.044367+0000","last_peered":"2024-09-11T22:35:51.044367+0000","last_clean":"2024-09-11T22:35:51.044367+0000","last_became_active":"2024-09-11T22:20:19.861154+0000","last_became_peered":"2024-09-11T22:20:19.861154+0000","last_unstale":"2024-09-11T22:35:51.044367+0000","last_undegraded":"2024-09-11T22:35:51.044367+0000","last_fullsized":"2024-09-11T22:35:51.044367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'5094","reported_seq":5119,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.867051+0000","last_change":"2024-09-11T22:20:23.877973+0000","last_active":"2024-09-11T22:35:44.867051+0000","last_peered":"2024-09-11T22:35:44.867051+0000","last_clean":"2024-09-11T22:35:44.867051+0000","last_became_active":"2024-09-11T22:20:23.877578+0000","last_became_peered":"2024-09-11T22:20:23.877578+0000","last_unstale":"2024-09-11T22:35:44.867051+0000","last_undegraded":"2024-09-11T22:35:44.867051+0000","last_fullsized":"2024-09-11T22:35:44.867051+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5094,"log_dups_size":0,"ondisk_log_size":5094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23560,"num_write_kb":426046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'584","reported_seq":616,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:37.378051+0000","last_change":"2024-09-11T22:20:18.854142+0000","last_active":"2024-09-11T22:35:37.378051+0000","last_peered":"2024-09-11T22:35:37.378051+0000","last_clean":"2024-09-11T22:35:37.378051+0000","last_became_active":"2024-09-11T22:20:18.853872+0000","last_became_peered":"2024-09-11T22:20:18.853872+0000","last_unstale":"2024-09-11T22:35:37.378051+0000","last_undegraded":"2024-09-11T22:35:37.378051+0000","last_fullsized":"2024-09-11T22:35:37.378051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:17.819479+0000","last_clean_scrub_stamp":"2024-09-11T22:20:17.819479+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:22.513242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195510,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":580,"num_write_kb":4218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'20","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.034644+0000","last_change":"2024-09-11T22:20:19.852580+0000","last_active":"2024-09-11T22:35:51.034644+0000","last_peered":"2024-09-11T22:35:51.034644+0000","last_clean":"2024-09-11T22:35:51.034644+0000","last_became_active":"2024-09-11T22:20:19.850175+0000","last_became_peered":"2024-09-11T22:20:19.850175+0000","last_unstale":"2024-09-11T22:35:51.034644+0000","last_undegraded":"2024-09-11T22:35:51.034644+0000","last_fullsized":"2024-09-11T22:35:51.034644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:11.937256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'6620","reported_seq":6644,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.412485+0000","last_change":"2024-09-11T22:20:23.878004+0000","last_active":"2024-09-11T22:35:44.412485+0000","last_peered":"2024-09-11T22:35:44.412485+0000","last_clean":"2024-09-11T22:35:44.412485+0000","last_became_active":"2024-09-11T22:20:23.876776+0000","last_became_peered":"2024-09-11T22:20:23.876776+0000","last_unstale":"2024-09-11T22:35:44.412485+0000","last_undegraded":"2024-09-11T22:35:44.412485+0000","last_fullsized":"2024-09-11T22:35:44.412485+0000","mapping_epoch":24,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6320,"log_dups_size":0,"ondisk_log_size":6320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:11.254248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29858,"num_write_kb":574080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'24","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.045814+0000","last_change":"2024-09-11T22:20:19.853439+0000","last_active":"2024-09-11T22:35:51.045814+0000","last_peered":"2024-09-11T22:35:51.045814+0000","last_clean":"2024-09-11T22:35:51.045814+0000","last_became_active":"2024-09-11T22:20:19.852937+0000","last_became_peered":"2024-09-11T22:20:19.852937+0000","last_unstale":"2024-09-11T22:35:51.045814+0000","last_undegraded":"2024-09-11T22:35:51.045814+0000","last_fullsized":"2024-09-11T22:35:51.045814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:47.008530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'25","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.061702+0000","last_change":"2024-09-11T22:20:19.861003+0000","last_active":"2024-09-11T22:35:51.061702+0000","last_peered":"2024-09-11T22:35:51.061702+0000","last_clean":"2024-09-11T22:35:51.061702+0000","last_became_active":"2024-09-11T22:20:19.860690+0000","last_became_peered":"2024-09-11T22:20:19.860690+0000","last_unstale":"2024-09-11T22:35:51.061702+0000","last_undegraded":"2024-09-11T22:35:51.061702+0000","last_fullsized":"2024-09-11T22:35:51.061702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'23","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.053250+0000","last_change":"2024-09-11T22:20:19.856756+0000","last_active":"2024-09-11T22:35:51.053250+0000","last_peered":"2024-09-11T22:35:51.053250+0000","last_clean":"2024-09-11T22:35:51.053250+0000","last_became_active":"2024-09-11T22:20:19.856460+0000","last_became_peered":"2024-09-11T22:20:19.856460+0000","last_unstale":"2024-09-11T22:35:51.053250+0000","last_undegraded":"2024-09-11T22:35:51.053250+0000","last_fullsized":"2024-09-11T22:35:51.053250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.916966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'18","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043961+0000","last_change":"2024-09-11T22:20:19.855629+0000","last_active":"2024-09-11T22:35:51.043961+0000","last_peered":"2024-09-11T22:35:51.043961+0000","last_clean":"2024-09-11T22:35:51.043961+0000","last_became_active":"2024-09-11T22:20:19.855363+0000","last_became_peered":"2024-09-11T22:20:19.855363+0000","last_unstale":"2024-09-11T22:35:51.043961+0000","last_undegraded":"2024-09-11T22:35:51.043961+0000","last_fullsized":"2024-09-11T22:35:51.043961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'14","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043787+0000","last_change":"2024-09-11T22:20:19.863122+0000","last_active":"2024-09-11T22:35:51.043787+0000","last_peered":"2024-09-11T22:35:51.043787+0000","last_clean":"2024-09-11T22:35:51.043787+0000","last_became_active":"2024-09-11T22:20:19.862828+0000","last_became_peered":"2024-09-11T22:20:19.862828+0000","last_unstale":"2024-09-11T22:35:51.043787+0000","last_undegraded":"2024-09-11T22:35:51.043787+0000","last_fullsized":"2024-09-11T22:35:51.043787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:10.868762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'15","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.026329+0000","last_change":"2024-09-11T22:20:19.846453+0000","last_active":"2024-09-11T22:35:51.026329+0000","last_peered":"2024-09-11T22:35:51.026329+0000","last_clean":"2024-09-11T22:35:51.026329+0000","last_became_active":"2024-09-11T22:20:19.846186+0000","last_became_peered":"2024-09-11T22:20:19.846186+0000","last_unstale":"2024-09-11T22:35:51.026329+0000","last_undegraded":"2024-09-11T22:35:51.026329+0000","last_fullsized":"2024-09-11T22:35:51.026329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:24.032365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'24","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.062384+0000","last_change":"2024-09-11T22:20:19.860632+0000","last_active":"2024-09-11T22:35:51.062384+0000","last_peered":"2024-09-11T22:35:51.062384+0000","last_clean":"2024-09-11T22:35:51.062384+0000","last_became_active":"2024-09-11T22:20:19.860005+0000","last_became_peered":"2024-09-11T22:20:19.860005+0000","last_unstale":"2024-09-11T22:35:51.062384+0000","last_undegraded":"2024-09-11T22:35:51.062384+0000","last_fullsized":"2024-09-11T22:35:51.062384+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:14.850888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'17","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.048597+0000","last_change":"2024-09-11T22:20:19.859195+0000","last_active":"2024-09-11T22:35:51.048597+0000","last_peered":"2024-09-11T22:35:51.048597+0000","last_clean":"2024-09-11T22:35:51.048597+0000","last_became_active":"2024-09-11T22:20:19.858832+0000","last_became_peered":"2024-09-11T22:20:19.858832+0000","last_unstale":"2024-09-11T22:35:51.048597+0000","last_undegraded":"2024-09-11T22:35:51.048597+0000","last_fullsized":"2024-09-11T22:35:51.048597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:56.259074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'18","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.038124+0000","last_change":"2024-09-11T22:20:19.858969+0000","last_active":"2024-09-11T22:35:51.038124+0000","last_peered":"2024-09-11T22:35:51.038124+0000","last_clean":"2024-09-11T22:35:51.038124+0000","last_became_active":"2024-09-11T22:20:19.857847+0000","last_became_peered":"2024-09-11T22:20:19.857847+0000","last_unstale":"2024-09-11T22:35:51.038124+0000","last_undegraded":"2024-09-11T22:35:51.038124+0000","last_fullsized":"2024-09-11T22:35:51.038124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'23","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.048974+0000","last_change":"2024-09-11T22:20:19.863294+0000","last_active":"2024-09-11T22:35:51.048974+0000","last_peered":"2024-09-11T22:35:51.048974+0000","last_clean":"2024-09-11T22:35:51.048974+0000","last_became_active":"2024-09-11T22:20:19.863007+0000","last_became_peered":"2024-09-11T22:20:19.863007+0000","last_unstale":"2024-09-11T22:35:51.048974+0000","last_undegraded":"2024-09-11T22:35:51.048974+0000","last_fullsized":"2024-09-11T22:35:51.048974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:06.673369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'23","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.062556+0000","last_change":"2024-09-11T22:20:19.858414+0000","last_active":"2024-09-11T22:35:51.062556+0000","last_peered":"2024-09-11T22:35:51.062556+0000","last_clean":"2024-09-11T22:35:51.062556+0000","last_became_active":"2024-09-11T22:20:19.857790+0000","last_became_peered":"2024-09-11T22:20:19.857790+0000","last_unstale":"2024-09-11T22:35:51.062556+0000","last_undegraded":"2024-09-11T22:35:51.062556+0000","last_fullsized":"2024-09-11T22:35:51.062556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:09.220329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'28","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.057725+0000","last_change":"2024-09-11T22:21:02.034810+0000","last_active":"2024-09-11T22:35:51.057725+0000","last_peered":"2024-09-11T22:35:51.057725+0000","last_clean":"2024-09-11T22:35:51.057725+0000","last_became_active":"2024-09-11T22:21:02.034534+0000","last_became_peered":"2024-09-11T22:21:02.034534+0000","last_unstale":"2024-09-11T22:35:51.057725+0000","last_undegraded":"2024-09-11T22:35:51.057725+0000","last_fullsized":"2024-09-11T22:35:51.057725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"28'19","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043768+0000","last_change":"2024-09-11T22:20:19.864700+0000","last_active":"2024-09-11T22:35:51.043768+0000","last_peered":"2024-09-11T22:35:51.043768+0000","last_clean":"2024-09-11T22:35:51.043768+0000","last_became_active":"2024-09-11T22:20:19.862296+0000","last_became_peered":"2024-09-11T22:20:19.862296+0000","last_unstale":"2024-09-11T22:35:51.043768+0000","last_undegraded":"2024-09-11T22:35:51.043768+0000","last_fullsized":"2024-09-11T22:35:51.043768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:33.034978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'22","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.049922+0000","last_change":"2024-09-11T22:20:19.855253+0000","last_active":"2024-09-11T22:35:51.049922+0000","last_peered":"2024-09-11T22:35:51.049922+0000","last_clean":"2024-09-11T22:35:51.049922+0000","last_became_active":"2024-09-11T22:20:19.854970+0000","last_became_peered":"2024-09-11T22:20:19.854970+0000","last_unstale":"2024-09-11T22:35:51.049922+0000","last_undegraded":"2024-09-11T22:35:51.049922+0000","last_fullsized":"2024-09-11T22:35:51.049922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:36.956628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'29","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.049993+0000","last_change":"2024-09-11T22:20:19.850202+0000","last_active":"2024-09-11T22:35:51.049993+0000","last_peered":"2024-09-11T22:35:51.049993+0000","last_clean":"2024-09-11T22:35:51.049993+0000","last_became_active":"2024-09-11T22:20:19.849815+0000","last_became_peered":"2024-09-11T22:20:19.849815+0000","last_unstale":"2024-09-11T22:35:51.049993+0000","last_undegraded":"2024-09-11T22:35:51.049993+0000","last_fullsized":"2024-09-11T22:35:51.049993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'21","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.057298+0000","last_change":"2024-09-11T22:20:19.866864+0000","last_active":"2024-09-11T22:35:51.057298+0000","last_peered":"2024-09-11T22:35:51.057298+0000","last_clean":"2024-09-11T22:35:51.057298+0000","last_became_active":"2024-09-11T22:20:19.866484+0000","last_became_peered":"2024-09-11T22:20:19.866484+0000","last_unstale":"2024-09-11T22:35:51.057298+0000","last_undegraded":"2024-09-11T22:35:51.057298+0000","last_fullsized":"2024-09-11T22:35:51.057298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:58.635479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'21","reported_seq":38,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.044996+0000","last_change":"2024-09-11T22:21:02.035254+0000","last_active":"2024-09-11T22:35:51.044996+0000","last_peered":"2024-09-11T22:35:51.044996+0000","last_clean":"2024-09-11T22:35:51.044996+0000","last_became_active":"2024-09-11T22:21:02.034985+0000","last_became_peered":"2024-09-11T22:21:02.034985+0000","last_unstale":"2024-09-11T22:35:51.044996+0000","last_undegraded":"2024-09-11T22:35:51.044996+0000","last_fullsized":"2024-09-11T22:35:51.044996+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"28'21","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.036646+0000","last_change":"2024-09-11T22:20:19.860050+0000","last_active":"2024-09-11T22:35:51.036646+0000","last_peered":"2024-09-11T22:35:51.036646+0000","last_clean":"2024-09-11T22:35:51.036646+0000","last_became_active":"2024-09-11T22:20:19.859755+0000","last_became_peered":"2024-09-11T22:20:19.859755+0000","last_unstale":"2024-09-11T22:35:51.036646+0000","last_undegraded":"2024-09-11T22:35:51.036646+0000","last_fullsized":"2024-09-11T22:35:51.036646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:42.487669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'24","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.044242+0000","last_change":"2024-09-11T22:20:19.853902+0000","last_active":"2024-09-11T22:35:51.044242+0000","last_peered":"2024-09-11T22:35:51.044242+0000","last_clean":"2024-09-11T22:35:51.044242+0000","last_became_active":"2024-09-11T22:20:19.853563+0000","last_became_peered":"2024-09-11T22:20:19.853563+0000","last_unstale":"2024-09-11T22:35:51.044242+0000","last_undegraded":"2024-09-11T22:35:51.044242+0000","last_fullsized":"2024-09-11T22:35:51.044242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'25","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.043068+0000","last_change":"2024-09-11T22:20:19.849490+0000","last_active":"2024-09-11T22:35:51.043068+0000","last_peered":"2024-09-11T22:35:51.043068+0000","last_clean":"2024-09-11T22:35:51.043068+0000","last_became_active":"2024-09-11T22:20:19.848965+0000","last_became_peered":"2024-09-11T22:20:19.848965+0000","last_unstale":"2024-09-11T22:35:51.043068+0000","last_undegraded":"2024-09-11T22:35:51.043068+0000","last_fullsized":"2024-09-11T22:35:51.043068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:10.387663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'17","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.042418+0000","last_change":"2024-09-11T22:20:19.860457+0000","last_active":"2024-09-11T22:35:51.042418+0000","last_peered":"2024-09-11T22:35:51.042418+0000","last_clean":"2024-09-11T22:35:51.042418+0000","last_became_active":"2024-09-11T22:20:19.858887+0000","last_became_peered":"2024-09-11T22:20:19.858887+0000","last_unstale":"2024-09-11T22:35:51.042418+0000","last_undegraded":"2024-09-11T22:35:51.042418+0000","last_fullsized":"2024-09-11T22:35:51.042418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:34.620956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'18","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.062261+0000","last_change":"2024-09-11T22:20:19.862347+0000","last_active":"2024-09-11T22:35:51.062261+0000","last_peered":"2024-09-11T22:35:51.062261+0000","last_clean":"2024-09-11T22:35:51.062261+0000","last_became_active":"2024-09-11T22:20:19.861965+0000","last_became_peered":"2024-09-11T22:20:19.861965+0000","last_unstale":"2024-09-11T22:35:51.062261+0000","last_undegraded":"2024-09-11T22:35:51.062261+0000","last_fullsized":"2024-09-11T22:35:51.062261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:30:08.096748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'29","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.063182+0000","last_change":"2024-09-11T22:20:19.862065+0000","last_active":"2024-09-11T22:35:51.063182+0000","last_peered":"2024-09-11T22:35:51.063182+0000","last_clean":"2024-09-11T22:35:51.063182+0000","last_became_active":"2024-09-11T22:20:19.861765+0000","last_became_peered":"2024-09-11T22:20:19.861765+0000","last_unstale":"2024-09-11T22:35:51.063182+0000","last_undegraded":"2024-09-11T22:35:51.063182+0000","last_fullsized":"2024-09-11T22:35:51.063182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.811244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'27","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.062819+0000","last_change":"2024-09-11T22:20:19.865064+0000","last_active":"2024-09-11T22:35:51.062819+0000","last_peered":"2024-09-11T22:35:51.062819+0000","last_clean":"2024-09-11T22:35:51.062819+0000","last_became_active":"2024-09-11T22:20:19.864697+0000","last_became_peered":"2024-09-11T22:20:19.864697+0000","last_unstale":"2024-09-11T22:35:51.062819+0000","last_undegraded":"2024-09-11T22:35:51.062819+0000","last_fullsized":"2024-09-11T22:35:51.062819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:32.500765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'14","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.060918+0000","last_change":"2024-09-11T22:20:19.861293+0000","last_active":"2024-09-11T22:35:51.060918+0000","last_peered":"2024-09-11T22:35:51.060918+0000","last_clean":"2024-09-11T22:35:51.060918+0000","last_became_active":"2024-09-11T22:20:19.861013+0000","last_became_peered":"2024-09-11T22:20:19.861013+0000","last_unstale":"2024-09-11T22:35:51.060918+0000","last_undegraded":"2024-09-11T22:35:51.060918+0000","last_fullsized":"2024-09-11T22:35:51.060918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:13.178404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'14","reported_seq":44,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.060763+0000","last_change":"2024-09-11T22:20:19.858131+0000","last_active":"2024-09-11T22:35:51.060763+0000","last_peered":"2024-09-11T22:35:51.060763+0000","last_clean":"2024-09-11T22:35:51.060763+0000","last_became_active":"2024-09-11T22:20:19.857842+0000","last_became_peered":"2024-09-11T22:20:19.857842+0000","last_unstale":"2024-09-11T22:35:51.060763+0000","last_undegraded":"2024-09-11T22:35:51.060763+0000","last_fullsized":"2024-09-11T22:35:51.060763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'16","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.060898+0000","last_change":"2024-09-11T22:20:19.859667+0000","last_active":"2024-09-11T22:35:51.060898+0000","last_peered":"2024-09-11T22:35:51.060898+0000","last_clean":"2024-09-11T22:35:51.060898+0000","last_became_active":"2024-09-11T22:20:19.859306+0000","last_became_peered":"2024-09-11T22:20:19.859306+0000","last_unstale":"2024-09-11T22:35:51.060898+0000","last_undegraded":"2024-09-11T22:35:51.060898+0000","last_fullsized":"2024-09-11T22:35:51.060898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:14.630932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'19","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.048851+0000","last_change":"2024-09-11T22:20:19.848821+0000","last_active":"2024-09-11T22:35:51.048851+0000","last_peered":"2024-09-11T22:35:51.048851+0000","last_clean":"2024-09-11T22:35:51.048851+0000","last_became_active":"2024-09-11T22:20:19.848531+0000","last_became_peered":"2024-09-11T22:20:19.848531+0000","last_unstale":"2024-09-11T22:35:51.048851+0000","last_undegraded":"2024-09-11T22:35:51.048851+0000","last_fullsized":"2024-09-11T22:35:51.048851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:28.557050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'15","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.061871+0000","last_change":"2024-09-11T22:20:19.866300+0000","last_active":"2024-09-11T22:35:51.061871+0000","last_peered":"2024-09-11T22:35:51.061871+0000","last_clean":"2024-09-11T22:35:51.061871+0000","last_became_active":"2024-09-11T22:20:19.865939+0000","last_became_peered":"2024-09-11T22:20:19.865939+0000","last_unstale":"2024-09-11T22:35:51.061871+0000","last_undegraded":"2024-09-11T22:35:51.061871+0000","last_fullsized":"2024-09-11T22:35:51.061871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:03.275990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'19","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.042169+0000","last_change":"2024-09-11T22:20:19.858144+0000","last_active":"2024-09-11T22:35:51.042169+0000","last_peered":"2024-09-11T22:35:51.042169+0000","last_clean":"2024-09-11T22:35:51.042169+0000","last_became_active":"2024-09-11T22:20:19.857840+0000","last_became_peered":"2024-09-11T22:20:19.857840+0000","last_unstale":"2024-09-11T22:35:51.042169+0000","last_undegraded":"2024-09-11T22:35:51.042169+0000","last_fullsized":"2024-09-11T22:35:51.042169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'10","reported_seq":41,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.040742+0000","last_change":"2024-09-11T22:20:19.857378+0000","last_active":"2024-09-11T22:35:51.040742+0000","last_peered":"2024-09-11T22:35:51.040742+0000","last_clean":"2024-09-11T22:35:51.040742+0000","last_became_active":"2024-09-11T22:20:19.857089+0000","last_became_peered":"2024-09-11T22:20:19.857089+0000","last_unstale":"2024-09-11T22:35:51.040742+0000","last_undegraded":"2024-09-11T22:35:51.040742+0000","last_fullsized":"2024-09-11T22:35:51.040742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:29.835695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'16","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.042658+0000","last_change":"2024-09-11T22:21:02.036200+0000","last_active":"2024-09-11T22:35:51.042658+0000","last_peered":"2024-09-11T22:35:51.042658+0000","last_clean":"2024-09-11T22:35:51.042658+0000","last_became_active":"2024-09-11T22:21:02.035889+0000","last_became_peered":"2024-09-11T22:21:02.035889+0000","last_unstale":"2024-09-11T22:35:51.042658+0000","last_undegraded":"2024-09-11T22:35:51.042658+0000","last_fullsized":"2024-09-11T22:35:51.042658+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":877619,"num_write_kb":16615339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":191481,"ondisk_log_size":191481,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1274,"ondisk_log_size":1274,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":15005355,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":45,"num_read_kb":122,"num_write":3042,"num_write_kb":15742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18276352,"data_stored":30010710,"data_compressed":2661454,"data_compressed_allocated":3686400,"data_compressed_original":15572992,"omap_allocated":0,"internal_metadata":0},"log_size":2703,"ondisk_log_size":2703,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509632,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":969956,"kb_used_data":7316,"kb_used_omap":1,"kb_used_meta":962622,"kb_avail":93401884,"statfs":{"total":96636764160,"available":95643529216,"internally_reserved":0,"allocated":7491584,"data_stored":11425803,"data_compressed":849965,"data_compressed_allocated":1200128,"data_compressed_original":5332992,"omap_allocated":1590,"internal_metadata":985725386},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509633,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1137376,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":1135230,"kb_avail":93234464,"statfs":{"total":96636764160,"available":95472091136,"internally_reserved":0,"allocated":2179072,"data_stored":4317172,"data_compressed":509786,"data_compressed_allocated":684032,"data_compressed_original":3010560,"omap_allocated":1594,"internal_metadata":1162475974},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509634,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":763716,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":763390,"kb_avail":93608124,"statfs":{"total":96636764160,"available":95854718976,"internally_reserved":0,"allocated":315392,"data_stored":122896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":781711813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509633,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1079244,"kb_used_data":3772,"kb_used_omap":1,"kb_used_meta":1075454,"kb_avail":93292596,"statfs":{"total":96636764160,"available":95531618304,"internally_reserved":0,"allocated":3862528,"data_stored":4316536,"data_compressed":162063,"data_compressed_allocated":282624,"data_compressed_original":925696,"omap_allocated":1595,"internal_metadata":1101265349},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509631,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1425948,"kb_used_data":4620,"kb_used_omap":1,"kb_used_meta":1421310,"kb_avail":92945892,"statfs":{"total":96636764160,"available":95176593408,"internally_reserved":0,"allocated":4730880,"data_stored":8606262,"data_compressed":892093,"data_compressed_allocated":1200128,"data_compressed_original":5267456,"omap_allocated":1593,"internal_metadata":1455421895},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542337,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":868180,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":867774,"kb_avail":93503660,"statfs":{"total":96636764160,"available":95747747840,"internally_reserved":0,"allocated":397312,"data_stored":216504,"data_compressed":3390,"data_compressed_allocated":4096,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":888601029},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542337,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1062252,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":1060798,"kb_avail":93309588,"statfs":{"total":96636764160,"available":95549018112,"internally_reserved":0,"allocated":1470464,"data_stored":3035955,"data_compressed":308985,"data_compressed_allocated":405504,"data_compressed_original":2166784,"omap_allocated":1595,"internal_metadata":1086257605},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575041,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1374984,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":1374654,"kb_avail":92996856,"statfs":{"total":96636764160,"available":95228780544,"internally_reserved":0,"allocated":319488,"data_stored":122462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1407646149},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1110016,"data_stored":2324069,"data_compressed":276571,"data_compressed_allocated":360448,"data_compressed_original":1593344,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":94986,"data_compressed":3390,"data_compressed_allocated":4096,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4435968,"data_stored":8484744,"data_compressed":892093,"data_compressed_allocated":1200128,"data_compressed_original":5267456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3567616,"data_stored":4195018,"data_compressed":162063,"data_compressed_allocated":282624,"data_compressed_original":925696,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1884160,"data_stored":4195654,"data_compressed":509786,"data_compressed_allocated":684032,"data_compressed_original":3010560,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7131136,"data_stored":10713917,"data_compressed":817551,"data_compressed_allocated":1155072,"data_compressed_original":4759552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:36:03.917 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.917 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.917 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.918 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.918 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.918 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.918 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.918 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.918 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.918 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.918 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.918 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.919 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.919 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.919 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.919 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.919 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.919 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.919 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.919 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.919 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.919 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.920 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.920 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.920 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.920 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.920 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.920 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.920 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.920 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.921 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.921 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.921 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.921 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.921 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.921 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.922 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.922 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.922 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.922 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.922 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.922 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.923 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.923 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.923 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.923 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.923 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.923 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-11T22:20:08.334092+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.923 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.923 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.923 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.924 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.924 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.924 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.924 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.924 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.924 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.924 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.924 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.925 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.925 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.925 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.925 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.925 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.925 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.925 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.925 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.926 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.926 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.926 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.926 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.926 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.926 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.926 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.926 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.927 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.927 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.927 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.927 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.927 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.927 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.927 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.927 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.927 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.928 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.928 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.928 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.928 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.928 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.928 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.928 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.928 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.928 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-11T22:20:17.819479+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=17, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.929 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.929 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.929 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.929 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.929 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.929 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.929 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.929 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.929 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.930 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.930 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.930 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.930 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.930 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.930 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.930 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.930 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.930 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.931 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.931 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.931 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.931 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.931 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.931 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.931 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.931 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.932 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.932 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.932 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.932 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.932 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.932 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.932 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.932 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:03.932 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T22:36:23.934 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:36:24.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.034+0000 7f2cab3d8640 1 Processor -- start 2024-09-11T22:36:24.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.034+0000 7f2cab3d8640 1 -- start start 2024-09-11T22:36:24.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.035+0000 7f2cab3d8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ca4154d20 0x7f2ca40cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:24.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.035+0000 7f2cab3d8640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2ca40cb920 0x7f2ca415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:24.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.035+0000 7f2cab3d8640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ca40c5d80 con 0x7f2ca40cc770 2024-09-11T22:36:24.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.035+0000 7f2cab3d8640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f2ca415ebe0 con 0x7f2ca40cb920 2024-09-11T22:36:24.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.035+0000 7f2cab3d8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2ca4155100 con 0x7f2ca4154d20 2024-09-11T22:36:24.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.035+0000 7f2ca9174640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ca4154d20 0x7f2ca40cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:24.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.035+0000 7f2ca9975640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2ca40cb920 0x7f2ca415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:24.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.035+0000 7f2ca9174640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ca4154d20 0x7f2ca40cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:52612/0 (socket says 172.21.15.100:52612) 2024-09-11T22:36:24.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.035+0000 7f2ca9174640 1 -- 172.21.15.100:0/3871240572 learned_addr learned my addr 172.21.15.100:0/3871240572 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:24.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.035+0000 7f2ca8973640 1 --1- 172.21.15.100:0/3871240572 >> v1:172.21.15.167:6789/0 conn(0x7f2ca40cc770 0x7f2ca4072230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:43136/0 (socket says 172.21.15.100:43136) 2024-09-11T22:36:24.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.035+0000 7f2c9bfff640 1 -- 172.21.15.100:0/3871240572 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 269957565 0 0) 0x7f2ca40c5d80 con 0x7f2ca40cc770 2024-09-11T22:36:24.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.036+0000 7f2c9bfff640 1 -- 172.21.15.100:0/3871240572 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c90003520 con 0x7f2ca40cc770 2024-09-11T22:36:24.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.036+0000 7f2ca9975640 1 -- 172.21.15.100:0/3871240572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ca4154d20 msgr2=0x7f2ca40cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:24.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.036+0000 7f2ca9975640 1 --2- 172.21.15.100:0/3871240572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ca4154d20 0x7f2ca40cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:24.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.036+0000 7f2ca9975640 1 -- 172.21.15.100:0/3871240572 >> v1:172.21.15.167:6789/0 conn(0x7f2ca40cc770 legacy=0x7f2ca4072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:24.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.036+0000 7f2ca9975640 1 -- 172.21.15.100:0/3871240572 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca415dfd0 con 0x7f2ca40cb920 2024-09-11T22:36:24.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.036+0000 7f2ca9174640 1 --2- 172.21.15.100:0/3871240572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ca4154d20 0x7f2ca40cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T22:36:24.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.037+0000 7f2ca9975640 1 --2- 172.21.15.100:0/3871240572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ca40cb920 0x7f2ca415aaa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009d90 tx=0x7f2c9c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7530dacae016e022 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:24.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.037+0000 7f2c9bfff640 1 -- 172.21.15.100:0/3871240572 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c007740 con 0x7f2ca40cb920 2024-09-11T22:36:24.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.037+0000 7f2c9bfff640 1 -- 172.21.15.100:0/3871240572 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c9c0078e0 con 0x7f2ca40cb920 2024-09-11T22:36:24.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.037+0000 7f2c9bfff640 1 -- 172.21.15.100:0/3871240572 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c007c90 con 0x7f2ca40cb920 2024-09-11T22:36:24.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.038+0000 7f2cab3d8640 1 -- 172.21.15.100:0/3871240572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ca40cb920 msgr2=0x7f2ca415aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:24.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.038+0000 7f2cab3d8640 1 --2- 172.21.15.100:0/3871240572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ca40cb920 0x7f2ca415aaa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009d90 tx=0x7f2c9c02a660 comp rx=0 tx=0).stop 2024-09-11T22:36:24.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.038+0000 7f2cab3d8640 1 -- 172.21.15.100:0/3871240572 shutdown_connections 2024-09-11T22:36:24.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.038+0000 7f2cab3d8640 1 --2- 172.21.15.100:0/3871240572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ca40cb920 0x7f2ca415aaa0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:24.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.038+0000 7f2cab3d8640 1 --2- 172.21.15.100:0/3871240572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ca4154d20 0x7f2ca40cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:24.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.038+0000 7f2cab3d8640 1 -- 172.21.15.100:0/3871240572 >> 172.21.15.100:0/3871240572 conn(0x7f2ca40d0380 msgr2=0x7f2ca40d0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:24.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.038+0000 7f2cab3d8640 1 -- 172.21.15.100:0/3871240572 shutdown_connections 2024-09-11T22:36:24.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.038+0000 7f2cab3d8640 1 -- 172.21.15.100:0/3871240572 wait complete. 2024-09-11T22:36:24.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.040+0000 7f2cab3d8640 1 Processor -- start 2024-09-11T22:36:24.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.040+0000 7f2cab3d8640 1 -- start start 2024-09-11T22:36:24.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.041+0000 7f2cab3d8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ca40cb920 0x7f2ca414aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:24.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.041+0000 7f2cab3d8640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ca40cc770 0x7f2ca40c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:24.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.041+0000 7f2cab3d8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ca4154d20 0x7f2ca4149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:24.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.041+0000 7f2cab3d8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca415e870 con 0x7f2ca40cb920 2024-09-11T22:36:24.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.041+0000 7f2cab3d8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca415e590 con 0x7f2ca4154d20 2024-09-11T22:36:24.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.041+0000 7f2cab3d8640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f2ca4072940 con 0x7f2ca40cc770 2024-09-11T22:36:24.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.041+0000 7f2ca9174640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ca40cb920 0x7f2ca414aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:24.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.041+0000 7f2ca9174640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ca40cb920 0x7f2ca414aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48684/0 (socket says 172.21.15.100:48684) 2024-09-11T22:36:24.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.041+0000 7f2ca9174640 1 -- 172.21.15.100:0/3240851177 learned_addr learned my addr 172.21.15.100:0/3240851177 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:24.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.041+0000 7f2ca8973640 1 --2- 172.21.15.100:0/3240851177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ca40cc770 0x7f2ca40c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:24.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.041+0000 7f2ca9975640 1 --2- 172.21.15.100:0/3240851177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ca4154d20 0x7f2ca4149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:24.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.041+0000 7f2ca9174640 1 -- 172.21.15.100:0/3240851177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ca40cc770 msgr2=0x7f2ca40c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:24.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.041+0000 7f2ca9174640 1 --2- 172.21.15.100:0/3240851177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ca40cc770 0x7f2ca40c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:24.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.041+0000 7f2ca9174640 1 -- 172.21.15.100:0/3240851177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ca4154d20 msgr2=0x7f2ca4149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:24.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.041+0000 7f2ca9174640 1 --2- 172.21.15.100:0/3240851177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ca4154d20 0x7f2ca4149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:24.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.041+0000 7f2ca9174640 1 -- 172.21.15.100:0/3240851177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca4148770 con 0x7f2ca40cb920 2024-09-11T22:36:24.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.041+0000 7f2ca9174640 1 --2- 172.21.15.100:0/3240851177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ca40cb920 0x7f2ca414aa90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000e9e0 tx=0x7f2ca000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:24.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.042+0000 7f2c99ffb640 1 -- 172.21.15.100:0/3240851177 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0017070 con 0x7f2ca40cb920 2024-09-11T22:36:24.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.042+0000 7f2c99ffb640 1 -- 172.21.15.100:0/3240851177 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca000c970 con 0x7f2ca40cb920 2024-09-11T22:36:24.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.042+0000 7f2cab3d8640 1 -- 172.21.15.100:0/3240851177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ca4148490 con 0x7f2ca40cb920 2024-09-11T22:36:24.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.042+0000 7f2c99ffb640 1 -- 172.21.15.100:0/3240851177 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000cd20 con 0x7f2ca40cb920 2024-09-11T22:36:24.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.042+0000 7f2cab3d8640 1 -- 172.21.15.100:0/3240851177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ca4144f50 con 0x7f2ca40cb920 2024-09-11T22:36:24.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.043+0000 7f2cab3d8640 1 -- 172.21.15.100:0/3240851177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ca40cb300 con 0x7f2ca40cb920 2024-09-11T22:36:24.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.043+0000 7f2c99ffb640 1 -- 172.21.15.100:0/3240851177 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2ca001a070 con 0x7f2ca40cb920 2024-09-11T22:36:24.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.044+0000 7f2c99ffb640 1 --2- 172.21.15.100:0/3240851177 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2c8806be30 0x7f2c8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:24.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.044+0000 7f2ca8973640 1 --2- 172.21.15.100:0/3240851177 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2c8806be30 0x7f2c8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:24.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.044+0000 7f2c99ffb640 1 -- 172.21.15.100:0/3240851177 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f2ca008b320 con 0x7f2ca40cb920 2024-09-11T22:36:24.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.045+0000 7f2ca8973640 1 --2- 172.21.15.100:0/3240851177 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2c8806be30 0x7f2c8806e2f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40cf510 tx=0x7f2c94007cf0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:24.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.049+0000 7f2c99ffb640 1 -- 172.21.15.100:0/3240851177 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2ca00592f0 con 0x7f2ca40cb920 2024-09-11T22:36:24.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.248+0000 7f2cab3d8640 1 -- 172.21.15.100:0/3240851177 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2ca40cbed0 con 0x7f2c8806be30 2024-09-11T22:36:24.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.256+0000 7f2c99ffb640 1 -- 172.21.15.100:0/3240851177 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334339 (secure 0 0 0) 0x7f2ca40cbed0 con 0x7f2c8806be30 2024-09-11T22:36:24.261 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:36:24.263 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-11T22:36:24.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.260+0000 7f2cab3d8640 1 -- 172.21.15.100:0/3240851177 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2c8806be30 msgr2=0x7f2c8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:24.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.260+0000 7f2cab3d8640 1 --2- 172.21.15.100:0/3240851177 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2c8806be30 0x7f2c8806e2f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40cf510 tx=0x7f2c94007cf0 comp rx=0 tx=0).stop 2024-09-11T22:36:24.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.260+0000 7f2cab3d8640 1 -- 172.21.15.100:0/3240851177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ca40cb920 msgr2=0x7f2ca414aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:24.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.260+0000 7f2cab3d8640 1 --2- 172.21.15.100:0/3240851177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ca40cb920 0x7f2ca414aa90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000e9e0 tx=0x7f2ca000eea0 comp rx=0 tx=0).stop 2024-09-11T22:36:24.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.261+0000 7f2cab3d8640 1 -- 172.21.15.100:0/3240851177 shutdown_connections 2024-09-11T22:36:24.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.261+0000 7f2cab3d8640 1 --2- 172.21.15.100:0/3240851177 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f2c8806be30 0x7f2c8806e2f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:24.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.261+0000 7f2cab3d8640 1 --2- 172.21.15.100:0/3240851177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ca4154d20 0x7f2ca4149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:24.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.261+0000 7f2cab3d8640 1 --2- 172.21.15.100:0/3240851177 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ca40cc770 0x7f2ca40c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:24.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.261+0000 7f2cab3d8640 1 --2- 172.21.15.100:0/3240851177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ca40cb920 0x7f2ca414aa90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:24.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.261+0000 7f2cab3d8640 1 -- 172.21.15.100:0/3240851177 >> 172.21.15.100:0/3240851177 conn(0x7f2ca40d0380 msgr2=0x7f2ca40cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:24.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.261+0000 7f2cab3d8640 1 -- 172.21.15.100:0/3240851177 shutdown_connections 2024-09-11T22:36:24.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:24.261+0000 7f2cab3d8640 1 -- 172.21.15.100:0/3240851177 wait complete. 2024-09-11T22:36:24.273 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":510,"stamp":"2024-09-11T22:36:22.575280+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":15595723,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":161,"num_read_kb":222,"num_write":880820,"num_write_kb":16633497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195624,"ondisk_log_size":195624,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8665016,"kb_used_data":20280,"kb_used_omap":12,"kb_used_meta":8644595,"kb_avail":746309704,"statfs":{"total":773094113280,"available":764221136896,"internally_reserved":0,"allocated":20766720,"data_stored":32163590,"data_compressed":2726282,"data_compressed_allocated":3776512,"data_compressed_original":16719872,"omap_allocated":12752,"internal_metadata":8852065840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002944"},"pg_stats":[{"pgid":"2.1f","version":"28'180","reported_seq":222,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:01.759409+0000","last_change":"2024-09-11T22:36:01.759440+0000","last_active":"2024-09-11T22:36:01.759409+0000","last_peered":"2024-09-11T22:36:01.759409+0000","last_clean":"2024-09-11T22:36:01.759409+0000","last_became_active":"2024-09-11T22:20:18.852740+0000","last_became_peered":"2024-09-11T22:20:18.852740+0000","last_unstale":"2024-09-11T22:36:01.759409+0000","last_undegraded":"2024-09-11T22:36:01.759409+0000","last_fullsized":"2024-09-11T22:36:01.759409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'180","last_scrub_stamp":"2024-09-11T22:36:01.759349+0000","last_deep_scrub":"28'180","last_deep_scrub_stamp":"2024-09-11T22:36:01.759349+0000","last_clean_scrub_stamp":"2024-09-11T22:36:01.759349+0000","objects_scrubbed":5,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:29.687454+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2323991,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":2359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'9","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:12.227533+0000","last_change":"2024-09-11T22:36:12.227571+0000","last_active":"2024-09-11T22:36:12.227533+0000","last_peered":"2024-09-11T22:36:12.227533+0000","last_clean":"2024-09-11T22:36:12.227533+0000","last_became_active":"2024-09-11T22:20:19.848619+0000","last_became_peered":"2024-09-11T22:20:19.848619+0000","last_unstale":"2024-09-11T22:36:12.227533+0000","last_undegraded":"2024-09-11T22:36:12.227533+0000","last_fullsized":"2024-09-11T22:36:12.227533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-11T22:36:12.227438+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-11T22:36:12.227438+0000","last_clean_scrub_stamp":"2024-09-11T22:36:12.227438+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:28.649486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'6890","reported_seq":6915,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.838210+0000","last_change":"2024-09-11T22:20:24.078618+0000","last_active":"2024-09-11T22:35:44.838210+0000","last_peered":"2024-09-11T22:35:44.838210+0000","last_clean":"2024-09-11T22:35:44.838210+0000","last_became_active":"2024-09-11T22:20:24.078283+0000","last_became_peered":"2024-09-11T22:20:24.078283+0000","last_unstale":"2024-09-11T22:35:44.838210+0000","last_undegraded":"2024-09-11T22:35:44.838210+0000","last_fullsized":"2024-09-11T22:35:44.838210+0000","mapping_epoch":24,"log_start":"28'603","ondisk_log_start":"28'603","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6287,"log_dups_size":0,"ondisk_log_size":6287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31450,"num_write_kb":560141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'9","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:09.182963+0000","last_change":"2024-09-11T22:36:09.183009+0000","last_active":"2024-09-11T22:36:09.182963+0000","last_peered":"2024-09-11T22:36:09.182963+0000","last_clean":"2024-09-11T22:36:09.182963+0000","last_became_active":"2024-09-11T22:20:18.854811+0000","last_became_peered":"2024-09-11T22:20:18.854811+0000","last_unstale":"2024-09-11T22:36:09.182963+0000","last_undegraded":"2024-09-11T22:36:09.182963+0000","last_fullsized":"2024-09-11T22:36:09.182963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-11T22:36:09.182868+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-11T22:36:09.182868+0000","last_clean_scrub_stamp":"2024-09-11T22:36:09.182868+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:41:38.454367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'21","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:09.689421+0000","last_change":"2024-09-11T22:36:09.689443+0000","last_active":"2024-09-11T22:36:09.689421+0000","last_peered":"2024-09-11T22:36:09.689421+0000","last_clean":"2024-09-11T22:36:09.689421+0000","last_became_active":"2024-09-11T22:20:19.862061+0000","last_became_peered":"2024-09-11T22:20:19.862061+0000","last_unstale":"2024-09-11T22:36:09.689421+0000","last_undegraded":"2024-09-11T22:36:09.689421+0000","last_fullsized":"2024-09-11T22:36:09.689421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'21","last_scrub_stamp":"2024-09-11T22:36:09.689357+0000","last_deep_scrub":"28'21","last_deep_scrub_stamp":"2024-09-11T22:36:09.689357+0000","last_clean_scrub_stamp":"2024-09-11T22:36:09.689357+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:05.969343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'6406","reported_seq":6439,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:14.170649+0000","last_change":"2024-09-11T22:36:14.170676+0000","last_active":"2024-09-11T22:36:14.170649+0000","last_peered":"2024-09-11T22:36:14.170649+0000","last_clean":"2024-09-11T22:36:14.170649+0000","last_became_active":"2024-09-11T22:20:23.879245+0000","last_became_peered":"2024-09-11T22:20:23.879245+0000","last_unstale":"2024-09-11T22:36:14.170649+0000","last_undegraded":"2024-09-11T22:36:14.170649+0000","last_fullsized":"2024-09-11T22:36:14.170649+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6406","last_scrub_stamp":"2024-09-11T22:36:14.170541+0000","last_deep_scrub":"28'6406","last_deep_scrub_stamp":"2024-09-11T22:36:14.170541+0000","last_clean_scrub_stamp":"2024-09-11T22:36:14.170541+0000","objects_scrubbed":0,"log_size":6406,"log_dups_size":0,"ondisk_log_size":6406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:02:45.412404+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28787,"num_write_kb":536913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'15","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:05.582600+0000","last_change":"2024-09-11T22:36:05.582632+0000","last_active":"2024-09-11T22:36:05.582600+0000","last_peered":"2024-09-11T22:36:05.582600+0000","last_clean":"2024-09-11T22:36:05.582600+0000","last_became_active":"2024-09-11T22:20:18.852728+0000","last_became_peered":"2024-09-11T22:20:18.852728+0000","last_unstale":"2024-09-11T22:36:05.582600+0000","last_undegraded":"2024-09-11T22:36:05.582600+0000","last_fullsized":"2024-09-11T22:36:05.582600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-09-11T22:36:05.582514+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-09-11T22:36:05.582514+0000","last_clean_scrub_stamp":"2024-09-11T22:36:05.582514+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:41.703465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'17","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:14.469943+0000","last_change":"2024-09-11T22:36:14.469995+0000","last_active":"2024-09-11T22:36:14.469943+0000","last_peered":"2024-09-11T22:36:14.469943+0000","last_clean":"2024-09-11T22:36:14.469943+0000","last_became_active":"2024-09-11T22:20:19.864234+0000","last_became_peered":"2024-09-11T22:20:19.864234+0000","last_unstale":"2024-09-11T22:36:14.469943+0000","last_undegraded":"2024-09-11T22:36:14.469943+0000","last_fullsized":"2024-09-11T22:36:14.469943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'17","last_scrub_stamp":"2024-09-11T22:36:14.469836+0000","last_deep_scrub":"28'17","last_deep_scrub_stamp":"2024-09-11T22:36:14.469836+0000","last_clean_scrub_stamp":"2024-09-11T22:36:14.469836+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:46.249026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'5642","reported_seq":5675,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:09.130374+0000","last_change":"2024-09-11T22:36:09.130419+0000","last_active":"2024-09-11T22:36:09.130374+0000","last_peered":"2024-09-11T22:36:09.130374+0000","last_clean":"2024-09-11T22:36:09.130374+0000","last_became_active":"2024-09-11T22:20:23.873385+0000","last_became_peered":"2024-09-11T22:20:23.873385+0000","last_unstale":"2024-09-11T22:36:09.130374+0000","last_undegraded":"2024-09-11T22:36:09.130374+0000","last_fullsized":"2024-09-11T22:36:09.130374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5642","last_scrub_stamp":"2024-09-11T22:36:09.130232+0000","last_deep_scrub":"28'5642","last_deep_scrub_stamp":"2024-09-11T22:36:09.130232+0000","last_clean_scrub_stamp":"2024-09-11T22:36:09.130232+0000","objects_scrubbed":0,"log_size":5642,"log_dups_size":0,"ondisk_log_size":5642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:58.467457+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24462,"num_write_kb":498902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'4","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:10.515581+0000","last_change":"2024-09-11T22:36:10.515611+0000","last_active":"2024-09-11T22:36:10.515581+0000","last_peered":"2024-09-11T22:36:10.515581+0000","last_clean":"2024-09-11T22:36:10.515581+0000","last_became_active":"2024-09-11T22:20:18.861230+0000","last_became_peered":"2024-09-11T22:20:18.861230+0000","last_unstale":"2024-09-11T22:36:10.515581+0000","last_undegraded":"2024-09-11T22:36:10.515581+0000","last_fullsized":"2024-09-11T22:36:10.515581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-11T22:36:10.515497+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-11T22:36:10.515497+0000","last_clean_scrub_stamp":"2024-09-11T22:36:10.515497+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:09.013618+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'27","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:13.489341+0000","last_change":"2024-09-11T22:36:13.489381+0000","last_active":"2024-09-11T22:36:13.489341+0000","last_peered":"2024-09-11T22:36:13.489341+0000","last_clean":"2024-09-11T22:36:13.489341+0000","last_became_active":"2024-09-11T22:20:19.863127+0000","last_became_peered":"2024-09-11T22:20:19.863127+0000","last_unstale":"2024-09-11T22:36:13.489341+0000","last_undegraded":"2024-09-11T22:36:13.489341+0000","last_fullsized":"2024-09-11T22:36:13.489341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'27","last_scrub_stamp":"2024-09-11T22:36:13.489221+0000","last_deep_scrub":"28'27","last_deep_scrub_stamp":"2024-09-11T22:36:13.489221+0000","last_clean_scrub_stamp":"2024-09-11T22:36:13.489221+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:09.769207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'4900","reported_seq":4933,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:10.106038+0000","last_change":"2024-09-11T22:36:10.106085+0000","last_active":"2024-09-11T22:36:10.106038+0000","last_peered":"2024-09-11T22:36:10.106038+0000","last_clean":"2024-09-11T22:36:10.106038+0000","last_became_active":"2024-09-11T22:20:23.874040+0000","last_became_peered":"2024-09-11T22:20:23.874040+0000","last_unstale":"2024-09-11T22:36:10.106038+0000","last_undegraded":"2024-09-11T22:36:10.106038+0000","last_fullsized":"2024-09-11T22:36:10.106038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4900","last_scrub_stamp":"2024-09-11T22:36:10.105913+0000","last_deep_scrub":"28'4900","last_deep_scrub_stamp":"2024-09-11T22:36:10.105913+0000","last_clean_scrub_stamp":"2024-09-11T22:36:10.105913+0000","objects_scrubbed":0,"log_size":4900,"log_dups_size":0,"ondisk_log_size":4900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:37.081623+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21721,"num_write_kb":438879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'14","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:10.602900+0000","last_change":"2024-09-11T22:36:10.602939+0000","last_active":"2024-09-11T22:36:10.602900+0000","last_peered":"2024-09-11T22:36:10.602900+0000","last_clean":"2024-09-11T22:36:10.602900+0000","last_became_active":"2024-09-11T22:20:19.859106+0000","last_became_peered":"2024-09-11T22:20:19.859106+0000","last_unstale":"2024-09-11T22:36:10.602900+0000","last_undegraded":"2024-09-11T22:36:10.602900+0000","last_fullsized":"2024-09-11T22:36:10.602900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'14","last_scrub_stamp":"2024-09-11T22:36:10.602798+0000","last_deep_scrub":"28'14","last_deep_scrub_stamp":"2024-09-11T22:36:10.602798+0000","last_clean_scrub_stamp":"2024-09-11T22:36:10.602798+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:37.578508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'1005","reported_seq":1047,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:09.570940+0000","last_change":"2024-09-11T22:36:09.571007+0000","last_active":"2024-09-11T22:36:09.570940+0000","last_peered":"2024-09-11T22:36:09.570940+0000","last_clean":"2024-09-11T22:36:09.570940+0000","last_became_active":"2024-09-11T22:20:18.856165+0000","last_became_peered":"2024-09-11T22:20:18.856165+0000","last_unstale":"2024-09-11T22:36:09.570940+0000","last_undegraded":"2024-09-11T22:36:09.570940+0000","last_fullsized":"2024-09-11T22:36:09.570940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1005","last_scrub_stamp":"2024-09-11T22:36:09.570801+0000","last_deep_scrub":"28'1005","last_deep_scrub_stamp":"2024-09-11T22:36:09.570801+0000","last_clean_scrub_stamp":"2024-09-11T22:36:09.570801+0000","objects_scrubbed":3,"log_size":1005,"log_dups_size":0,"ondisk_log_size":1005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:40.765380+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":994,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'6307","reported_seq":6341,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:11.128009+0000","last_change":"2024-09-11T22:36:11.128042+0000","last_active":"2024-09-11T22:36:11.128009+0000","last_peered":"2024-09-11T22:36:11.128009+0000","last_clean":"2024-09-11T22:36:11.128009+0000","last_became_active":"2024-09-11T22:20:23.877713+0000","last_became_peered":"2024-09-11T22:20:23.877713+0000","last_unstale":"2024-09-11T22:36:11.128009+0000","last_undegraded":"2024-09-11T22:36:11.128009+0000","last_fullsized":"2024-09-11T22:36:11.128009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6307","last_scrub_stamp":"2024-09-11T22:36:11.127451+0000","last_deep_scrub":"28'6307","last_deep_scrub_stamp":"2024-09-11T22:36:11.127451+0000","last_clean_scrub_stamp":"2024-09-11T22:36:11.127451+0000","objects_scrubbed":0,"log_size":6307,"log_dups_size":0,"ondisk_log_size":6307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:05.877411+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28296,"num_write_kb":522771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'17","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:06.109611+0000","last_change":"2024-09-11T22:36:06.109651+0000","last_active":"2024-09-11T22:36:06.109611+0000","last_peered":"2024-09-11T22:36:06.109611+0000","last_clean":"2024-09-11T22:36:06.109611+0000","last_became_active":"2024-09-11T22:20:19.858057+0000","last_became_peered":"2024-09-11T22:20:19.858057+0000","last_unstale":"2024-09-11T22:36:06.109611+0000","last_undegraded":"2024-09-11T22:36:06.109611+0000","last_fullsized":"2024-09-11T22:36:06.109611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'17","last_scrub_stamp":"2024-09-11T22:36:06.109521+0000","last_deep_scrub":"28'17","last_deep_scrub_stamp":"2024-09-11T22:36:06.109521+0000","last_clean_scrub_stamp":"2024-09-11T22:36:06.109521+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:25.313248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'8","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:06.319396+0000","last_change":"2024-09-11T22:36:06.319419+0000","last_active":"2024-09-11T22:36:06.319396+0000","last_peered":"2024-09-11T22:36:06.319396+0000","last_clean":"2024-09-11T22:36:06.319396+0000","last_became_active":"2024-09-11T22:20:18.853508+0000","last_became_peered":"2024-09-11T22:20:18.853508+0000","last_unstale":"2024-09-11T22:36:06.319396+0000","last_undegraded":"2024-09-11T22:36:06.319396+0000","last_fullsized":"2024-09-11T22:36:06.319396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-11T22:36:06.319331+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-11T22:36:06.319331+0000","last_clean_scrub_stamp":"2024-09-11T22:36:06.319331+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:39.382881+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'6073","reported_seq":6114,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:17.217703+0000","last_change":"2024-09-11T22:36:17.217748+0000","last_active":"2024-09-11T22:36:17.217703+0000","last_peered":"2024-09-11T22:36:17.217703+0000","last_clean":"2024-09-11T22:36:17.217703+0000","last_became_active":"2024-09-11T22:21:02.036941+0000","last_became_peered":"2024-09-11T22:21:02.036941+0000","last_unstale":"2024-09-11T22:36:17.217703+0000","last_undegraded":"2024-09-11T22:36:17.217703+0000","last_fullsized":"2024-09-11T22:36:17.217703+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6073","last_scrub_stamp":"2024-09-11T22:36:17.217581+0000","last_deep_scrub":"28'6073","last_deep_scrub_stamp":"2024-09-11T22:36:17.217581+0000","last_clean_scrub_stamp":"2024-09-11T22:36:17.217581+0000","objects_scrubbed":0,"log_size":6073,"log_dups_size":0,"ondisk_log_size":6073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:58.180969+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27207,"num_write_kb":522378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'18","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:10.172287+0000","last_change":"2024-09-11T22:36:10.172326+0000","last_active":"2024-09-11T22:36:10.172287+0000","last_peered":"2024-09-11T22:36:10.172287+0000","last_clean":"2024-09-11T22:36:10.172287+0000","last_became_active":"2024-09-11T22:20:19.844446+0000","last_became_peered":"2024-09-11T22:20:19.844446+0000","last_unstale":"2024-09-11T22:36:10.172287+0000","last_undegraded":"2024-09-11T22:36:10.172287+0000","last_fullsized":"2024-09-11T22:36:10.172287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'18","last_scrub_stamp":"2024-09-11T22:36:10.172185+0000","last_deep_scrub":"28'18","last_deep_scrub_stamp":"2024-09-11T22:36:10.172185+0000","last_clean_scrub_stamp":"2024-09-11T22:36:10.172185+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:58.030647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'8","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:03.305204+0000","last_change":"2024-09-11T22:36:03.305247+0000","last_active":"2024-09-11T22:36:03.305204+0000","last_peered":"2024-09-11T22:36:03.305204+0000","last_clean":"2024-09-11T22:36:03.305204+0000","last_became_active":"2024-09-11T22:20:18.847118+0000","last_became_peered":"2024-09-11T22:20:18.847118+0000","last_unstale":"2024-09-11T22:36:03.305204+0000","last_undegraded":"2024-09-11T22:36:03.305204+0000","last_fullsized":"2024-09-11T22:36:03.305204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-11T22:36:03.305127+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-11T22:36:03.305127+0000","last_clean_scrub_stamp":"2024-09-11T22:36:03.305127+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:10:38.504714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'7846","reported_seq":7880,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:17.351237+0000","last_change":"2024-09-11T22:36:17.351263+0000","last_active":"2024-09-11T22:36:17.351237+0000","last_peered":"2024-09-11T22:36:17.351237+0000","last_clean":"2024-09-11T22:36:17.351237+0000","last_became_active":"2024-09-11T22:20:24.077231+0000","last_became_peered":"2024-09-11T22:20:24.077231+0000","last_unstale":"2024-09-11T22:36:17.351237+0000","last_undegraded":"2024-09-11T22:36:17.351237+0000","last_fullsized":"2024-09-11T22:36:17.351237+0000","mapping_epoch":24,"log_start":"28'701","ondisk_log_start":"28'701","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7846","last_scrub_stamp":"2024-09-11T22:36:17.351145+0000","last_deep_scrub":"28'7846","last_deep_scrub_stamp":"2024-09-11T22:36:17.351145+0000","last_clean_scrub_stamp":"2024-09-11T22:36:17.351145+0000","objects_scrubbed":0,"log_size":7145,"log_dups_size":0,"ondisk_log_size":7145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:35:07.616851+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35635,"num_write_kb":625996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"28'12","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:05.054185+0000","last_change":"2024-09-11T22:36:05.054215+0000","last_active":"2024-09-11T22:36:05.054185+0000","last_peered":"2024-09-11T22:36:05.054185+0000","last_clean":"2024-09-11T22:36:05.054185+0000","last_became_active":"2024-09-11T22:20:19.854100+0000","last_became_peered":"2024-09-11T22:20:19.854100+0000","last_unstale":"2024-09-11T22:36:05.054185+0000","last_undegraded":"2024-09-11T22:36:05.054185+0000","last_fullsized":"2024-09-11T22:36:05.054185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-09-11T22:36:05.054093+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-09-11T22:36:05.054093+0000","last_clean_scrub_stamp":"2024-09-11T22:36:05.054093+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:10.864495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'6","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:06.580044+0000","last_change":"2024-09-11T22:36:06.580074+0000","last_active":"2024-09-11T22:36:06.580044+0000","last_peered":"2024-09-11T22:36:06.580044+0000","last_clean":"2024-09-11T22:36:06.580044+0000","last_became_active":"2024-09-11T22:20:18.854552+0000","last_became_peered":"2024-09-11T22:20:18.854552+0000","last_unstale":"2024-09-11T22:36:06.580044+0000","last_undegraded":"2024-09-11T22:36:06.580044+0000","last_fullsized":"2024-09-11T22:36:06.580044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-11T22:36:06.579965+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-11T22:36:06.579965+0000","last_clean_scrub_stamp":"2024-09-11T22:36:06.579965+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:41.396326+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'4949","reported_seq":4983,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:13.110963+0000","last_change":"2024-09-11T22:36:13.110991+0000","last_active":"2024-09-11T22:36:13.110963+0000","last_peered":"2024-09-11T22:36:13.110963+0000","last_clean":"2024-09-11T22:36:13.110963+0000","last_became_active":"2024-09-11T22:20:23.878305+0000","last_became_peered":"2024-09-11T22:20:23.878305+0000","last_unstale":"2024-09-11T22:36:13.110963+0000","last_undegraded":"2024-09-11T22:36:13.110963+0000","last_fullsized":"2024-09-11T22:36:13.110963+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4949","last_scrub_stamp":"2024-09-11T22:36:13.110856+0000","last_deep_scrub":"28'4949","last_deep_scrub_stamp":"2024-09-11T22:36:13.110856+0000","last_clean_scrub_stamp":"2024-09-11T22:36:13.110856+0000","objects_scrubbed":0,"log_size":4949,"log_dups_size":0,"ondisk_log_size":4949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:11.608977+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21676,"num_write_kb":446977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'26","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:04.717137+0000","last_change":"2024-09-11T22:36:04.717159+0000","last_active":"2024-09-11T22:36:04.717137+0000","last_peered":"2024-09-11T22:36:04.717137+0000","last_clean":"2024-09-11T22:36:04.717137+0000","last_became_active":"2024-09-11T22:20:19.855992+0000","last_became_peered":"2024-09-11T22:20:19.855992+0000","last_unstale":"2024-09-11T22:36:04.717137+0000","last_undegraded":"2024-09-11T22:36:04.717137+0000","last_fullsized":"2024-09-11T22:36:04.717137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'26","last_scrub_stamp":"2024-09-11T22:36:04.717069+0000","last_deep_scrub":"28'26","last_deep_scrub_stamp":"2024-09-11T22:36:04.717069+0000","last_clean_scrub_stamp":"2024-09-11T22:36:04.717069+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:40.283221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'8","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:04.578916+0000","last_change":"2024-09-11T22:36:04.578951+0000","last_active":"2024-09-11T22:36:04.578916+0000","last_peered":"2024-09-11T22:36:04.578916+0000","last_clean":"2024-09-11T22:36:04.578916+0000","last_became_active":"2024-09-11T22:20:18.849621+0000","last_became_peered":"2024-09-11T22:20:18.849621+0000","last_unstale":"2024-09-11T22:36:04.578916+0000","last_undegraded":"2024-09-11T22:36:04.578916+0000","last_fullsized":"2024-09-11T22:36:04.578916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-11T22:36:04.578807+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-11T22:36:04.578807+0000","last_clean_scrub_stamp":"2024-09-11T22:36:04.578807+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:32.529199+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'5822","reported_seq":5856,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:16.247704+0000","last_change":"2024-09-11T22:36:16.247735+0000","last_active":"2024-09-11T22:36:16.247704+0000","last_peered":"2024-09-11T22:36:16.247704+0000","last_clean":"2024-09-11T22:36:16.247704+0000","last_became_active":"2024-09-11T22:20:24.077325+0000","last_became_peered":"2024-09-11T22:20:24.077325+0000","last_unstale":"2024-09-11T22:36:16.247704+0000","last_undegraded":"2024-09-11T22:36:16.247704+0000","last_fullsized":"2024-09-11T22:36:16.247704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5822","last_scrub_stamp":"2024-09-11T22:36:16.247591+0000","last_deep_scrub":"28'5822","last_deep_scrub_stamp":"2024-09-11T22:36:16.247591+0000","last_clean_scrub_stamp":"2024-09-11T22:36:16.247591+0000","objects_scrubbed":0,"log_size":5822,"log_dups_size":0,"ondisk_log_size":5822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:29.618501+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26961,"num_write_kb":521330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'18","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:13.218832+0000","last_change":"2024-09-11T22:36:13.218877+0000","last_active":"2024-09-11T22:36:13.218832+0000","last_peered":"2024-09-11T22:36:13.218832+0000","last_clean":"2024-09-11T22:36:13.218832+0000","last_became_active":"2024-09-11T22:20:19.850441+0000","last_became_peered":"2024-09-11T22:20:19.850441+0000","last_unstale":"2024-09-11T22:36:13.218832+0000","last_undegraded":"2024-09-11T22:36:13.218832+0000","last_fullsized":"2024-09-11T22:36:13.218832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'18","last_scrub_stamp":"2024-09-11T22:36:13.218726+0000","last_deep_scrub":"28'18","last_deep_scrub_stamp":"2024-09-11T22:36:13.218726+0000","last_clean_scrub_stamp":"2024-09-11T22:36:13.218726+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:55.621331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'353","reported_seq":395,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:02.345792+0000","last_change":"2024-09-11T22:36:02.345818+0000","last_active":"2024-09-11T22:36:02.345792+0000","last_peered":"2024-09-11T22:36:02.345792+0000","last_clean":"2024-09-11T22:36:02.345792+0000","last_became_active":"2024-09-11T22:20:18.844731+0000","last_became_peered":"2024-09-11T22:20:18.844731+0000","last_unstale":"2024-09-11T22:36:02.345792+0000","last_undegraded":"2024-09-11T22:36:02.345792+0000","last_fullsized":"2024-09-11T22:36:02.345792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'353","last_scrub_stamp":"2024-09-11T22:36:02.345734+0000","last_deep_scrub":"28'353","last_deep_scrub_stamp":"2024-09-11T22:36:02.345734+0000","last_clean_scrub_stamp":"2024-09-11T22:36:02.345734+0000","objects_scrubbed":2,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.504894+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'6627","reported_seq":6660,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.842180+0000","last_change":"2024-09-11T22:21:02.037927+0000","last_active":"2024-09-11T22:35:44.842180+0000","last_peered":"2024-09-11T22:35:44.842180+0000","last_clean":"2024-09-11T22:35:44.842180+0000","last_became_active":"2024-09-11T22:21:02.037520+0000","last_became_peered":"2024-09-11T22:21:02.037520+0000","last_unstale":"2024-09-11T22:35:44.842180+0000","last_undegraded":"2024-09-11T22:35:44.842180+0000","last_fullsized":"2024-09-11T22:35:44.842180+0000","mapping_epoch":27,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6327,"log_dups_size":0,"ondisk_log_size":6327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30659,"num_write_kb":569042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'18","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:09.338706+0000","last_change":"2024-09-11T22:36:09.338727+0000","last_active":"2024-09-11T22:36:09.338706+0000","last_peered":"2024-09-11T22:36:09.338706+0000","last_clean":"2024-09-11T22:36:09.338706+0000","last_became_active":"2024-09-11T22:20:19.845203+0000","last_became_peered":"2024-09-11T22:20:19.845203+0000","last_unstale":"2024-09-11T22:36:09.338706+0000","last_undegraded":"2024-09-11T22:36:09.338706+0000","last_fullsized":"2024-09-11T22:36:09.338706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'18","last_scrub_stamp":"2024-09-11T22:36:09.338639+0000","last_deep_scrub":"28'18","last_deep_scrub_stamp":"2024-09-11T22:36:09.338639+0000","last_clean_scrub_stamp":"2024-09-11T22:36:09.338639+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:39.639448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'6","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:08.566362+0000","last_change":"2024-09-11T22:36:08.566391+0000","last_active":"2024-09-11T22:36:08.566362+0000","last_peered":"2024-09-11T22:36:08.566362+0000","last_clean":"2024-09-11T22:36:08.566362+0000","last_became_active":"2024-09-11T22:20:18.855968+0000","last_became_peered":"2024-09-11T22:20:18.855968+0000","last_unstale":"2024-09-11T22:36:08.566362+0000","last_undegraded":"2024-09-11T22:36:08.566362+0000","last_fullsized":"2024-09-11T22:36:08.566362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-11T22:36:08.566277+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-11T22:36:08.566277+0000","last_clean_scrub_stamp":"2024-09-11T22:36:08.566277+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:03.316236+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'5454","reported_seq":5488,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:12.641022+0000","last_change":"2024-09-11T22:36:12.641046+0000","last_active":"2024-09-11T22:36:12.641022+0000","last_peered":"2024-09-11T22:36:12.641022+0000","last_clean":"2024-09-11T22:36:12.641022+0000","last_became_active":"2024-09-11T22:20:24.074588+0000","last_became_peered":"2024-09-11T22:20:24.074588+0000","last_unstale":"2024-09-11T22:36:12.641022+0000","last_undegraded":"2024-09-11T22:36:12.641022+0000","last_fullsized":"2024-09-11T22:36:12.641022+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5454","last_scrub_stamp":"2024-09-11T22:36:12.640933+0000","last_deep_scrub":"28'5454","last_deep_scrub_stamp":"2024-09-11T22:36:12.640933+0000","last_clean_scrub_stamp":"2024-09-11T22:36:12.640933+0000","objects_scrubbed":0,"log_size":5454,"log_dups_size":0,"ondisk_log_size":5454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:33.359788+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25186,"num_write_kb":469240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'18","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:04.579015+0000","last_change":"2024-09-11T22:36:04.579056+0000","last_active":"2024-09-11T22:36:04.579015+0000","last_peered":"2024-09-11T22:36:04.579015+0000","last_clean":"2024-09-11T22:36:04.579015+0000","last_became_active":"2024-09-11T22:20:19.858585+0000","last_became_peered":"2024-09-11T22:20:19.858585+0000","last_unstale":"2024-09-11T22:36:04.579015+0000","last_undegraded":"2024-09-11T22:36:04.579015+0000","last_fullsized":"2024-09-11T22:36:04.579015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'18","last_scrub_stamp":"2024-09-11T22:36:04.578906+0000","last_deep_scrub":"28'18","last_deep_scrub_stamp":"2024-09-11T22:36:04.578906+0000","last_clean_scrub_stamp":"2024-09-11T22:36:04.578906+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:40.699857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'5","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:04.321551+0000","last_change":"2024-09-11T22:36:04.321588+0000","last_active":"2024-09-11T22:36:04.321551+0000","last_peered":"2024-09-11T22:36:04.321551+0000","last_clean":"2024-09-11T22:36:04.321551+0000","last_became_active":"2024-09-11T22:20:18.847669+0000","last_became_peered":"2024-09-11T22:20:18.847669+0000","last_unstale":"2024-09-11T22:36:04.321551+0000","last_undegraded":"2024-09-11T22:36:04.321551+0000","last_fullsized":"2024-09-11T22:36:04.321551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-11T22:36:04.321445+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-11T22:36:04.321445+0000","last_clean_scrub_stamp":"2024-09-11T22:36:04.321445+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:57.609542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'6951","reported_seq":6985,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:15.373858+0000","last_change":"2024-09-11T22:36:15.373900+0000","last_active":"2024-09-11T22:36:15.373858+0000","last_peered":"2024-09-11T22:36:15.373858+0000","last_clean":"2024-09-11T22:36:15.373858+0000","last_became_active":"2024-09-11T22:20:23.880468+0000","last_became_peered":"2024-09-11T22:20:23.880468+0000","last_unstale":"2024-09-11T22:36:15.373858+0000","last_undegraded":"2024-09-11T22:36:15.373858+0000","last_fullsized":"2024-09-11T22:36:15.373858+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6951","last_scrub_stamp":"2024-09-11T22:36:15.373757+0000","last_deep_scrub":"28'6951","last_deep_scrub_stamp":"2024-09-11T22:36:15.373757+0000","last_clean_scrub_stamp":"2024-09-11T22:36:15.373757+0000","objects_scrubbed":0,"log_size":6951,"log_dups_size":0,"ondisk_log_size":6951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:42.007063+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31360,"num_write_kb":584090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'17","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:07.019363+0000","last_change":"2024-09-11T22:36:07.019408+0000","last_active":"2024-09-11T22:36:07.019363+0000","last_peered":"2024-09-11T22:36:07.019363+0000","last_clean":"2024-09-11T22:36:07.019363+0000","last_became_active":"2024-09-11T22:20:19.858932+0000","last_became_peered":"2024-09-11T22:20:19.858932+0000","last_unstale":"2024-09-11T22:36:07.019363+0000","last_undegraded":"2024-09-11T22:36:07.019363+0000","last_fullsized":"2024-09-11T22:36:07.019363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'17","last_scrub_stamp":"2024-09-11T22:36:07.019212+0000","last_deep_scrub":"28'17","last_deep_scrub_stamp":"2024-09-11T22:36:07.019212+0000","last_clean_scrub_stamp":"2024-09-11T22:36:07.019212+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:34.947317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'6","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:08.472846+0000","last_change":"2024-09-11T22:36:08.472892+0000","last_active":"2024-09-11T22:36:08.472846+0000","last_peered":"2024-09-11T22:36:08.472846+0000","last_clean":"2024-09-11T22:36:08.472846+0000","last_became_active":"2024-09-11T22:20:18.854725+0000","last_became_peered":"2024-09-11T22:20:18.854725+0000","last_unstale":"2024-09-11T22:36:08.472846+0000","last_undegraded":"2024-09-11T22:36:08.472846+0000","last_fullsized":"2024-09-11T22:36:08.472846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-11T22:36:08.472740+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-11T22:36:08.472740+0000","last_clean_scrub_stamp":"2024-09-11T22:36:08.472740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:47.943037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'6039","reported_seq":6073,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:13.320084+0000","last_change":"2024-09-11T22:36:13.320109+0000","last_active":"2024-09-11T22:36:13.320084+0000","last_peered":"2024-09-11T22:36:13.320084+0000","last_clean":"2024-09-11T22:36:13.320084+0000","last_became_active":"2024-09-11T22:20:23.880243+0000","last_became_peered":"2024-09-11T22:20:23.880243+0000","last_unstale":"2024-09-11T22:36:13.320084+0000","last_undegraded":"2024-09-11T22:36:13.320084+0000","last_fullsized":"2024-09-11T22:36:13.320084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6039","last_scrub_stamp":"2024-09-11T22:36:13.319992+0000","last_deep_scrub":"28'6039","last_deep_scrub_stamp":"2024-09-11T22:36:13.319992+0000","last_clean_scrub_stamp":"2024-09-11T22:36:13.319992+0000","objects_scrubbed":0,"log_size":6039,"log_dups_size":0,"ondisk_log_size":6039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:18.218022+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27825,"num_write_kb":504386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'23","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:08.326605+0000","last_change":"2024-09-11T22:36:08.326644+0000","last_active":"2024-09-11T22:36:08.326605+0000","last_peered":"2024-09-11T22:36:08.326605+0000","last_clean":"2024-09-11T22:36:08.326605+0000","last_became_active":"2024-09-11T22:20:19.844536+0000","last_became_peered":"2024-09-11T22:20:19.844536+0000","last_unstale":"2024-09-11T22:36:08.326605+0000","last_undegraded":"2024-09-11T22:36:08.326605+0000","last_fullsized":"2024-09-11T22:36:08.326605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'23","last_scrub_stamp":"2024-09-11T22:36:08.326489+0000","last_deep_scrub":"28'23","last_deep_scrub_stamp":"2024-09-11T22:36:08.326489+0000","last_clean_scrub_stamp":"2024-09-11T22:36:08.326489+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:16.320573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'54","reported_seq":141,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:03.701074+0000","last_change":"2024-09-11T22:36:03.701102+0000","last_active":"2024-09-11T22:36:03.701074+0000","last_peered":"2024-09-11T22:36:03.701074+0000","last_clean":"2024-09-11T22:36:03.701074+0000","last_became_active":"2024-09-11T22:20:18.855394+0000","last_became_peered":"2024-09-11T22:20:18.855394+0000","last_unstale":"2024-09-11T22:36:03.701074+0000","last_undegraded":"2024-09-11T22:36:03.701074+0000","last_fullsized":"2024-09-11T22:36:03.701074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'54","last_scrub_stamp":"2024-09-11T22:36:03.701011+0000","last_deep_scrub":"28'54","last_deep_scrub_stamp":"2024-09-11T22:36:03.701011+0000","last_clean_scrub_stamp":"2024-09-11T22:36:03.701011+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:16.359382+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94258,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":122,"num_write":49,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'6775","reported_seq":6809,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:16.343639+0000","last_change":"2024-09-11T22:36:16.343684+0000","last_active":"2024-09-11T22:36:16.343639+0000","last_peered":"2024-09-11T22:36:16.343639+0000","last_clean":"2024-09-11T22:36:16.343639+0000","last_became_active":"2024-09-11T22:20:23.881642+0000","last_became_peered":"2024-09-11T22:20:23.881642+0000","last_unstale":"2024-09-11T22:36:16.343639+0000","last_undegraded":"2024-09-11T22:36:16.343639+0000","last_fullsized":"2024-09-11T22:36:16.343639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6775","last_scrub_stamp":"2024-09-11T22:36:16.343513+0000","last_deep_scrub":"28'6775","last_deep_scrub_stamp":"2024-09-11T22:36:16.343513+0000","last_clean_scrub_stamp":"2024-09-11T22:36:16.343513+0000","objects_scrubbed":0,"log_size":6775,"log_dups_size":0,"ondisk_log_size":6775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:14:36.299557+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30543,"num_write_kb":560301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'13","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:07.685907+0000","last_change":"2024-09-11T22:36:07.685945+0000","last_active":"2024-09-11T22:36:07.685907+0000","last_peered":"2024-09-11T22:36:07.685907+0000","last_clean":"2024-09-11T22:36:07.685907+0000","last_became_active":"2024-09-11T22:20:19.859159+0000","last_became_peered":"2024-09-11T22:20:19.859159+0000","last_unstale":"2024-09-11T22:36:07.685907+0000","last_undegraded":"2024-09-11T22:36:07.685907+0000","last_fullsized":"2024-09-11T22:36:07.685907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2024-09-11T22:36:07.685805+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2024-09-11T22:36:07.685805+0000","last_clean_scrub_stamp":"2024-09-11T22:36:07.685805+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:52.831972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'9","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:07.573700+0000","last_change":"2024-09-11T22:36:07.573700+0000","last_active":"2024-09-11T22:36:07.573700+0000","last_peered":"2024-09-11T22:36:07.573700+0000","last_clean":"2024-09-11T22:36:07.573700+0000","last_became_active":"2024-09-11T22:20:18.855866+0000","last_became_peered":"2024-09-11T22:20:18.855866+0000","last_unstale":"2024-09-11T22:36:07.573700+0000","last_undegraded":"2024-09-11T22:36:07.573700+0000","last_fullsized":"2024-09-11T22:36:07.573700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-11T22:36:07.573594+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-11T22:36:07.573594+0000","last_clean_scrub_stamp":"2024-09-11T22:36:07.573594+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:34.549304+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'5391","reported_seq":5425,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:13.640962+0000","last_change":"2024-09-11T22:36:13.640992+0000","last_active":"2024-09-11T22:36:13.640962+0000","last_peered":"2024-09-11T22:36:13.640962+0000","last_clean":"2024-09-11T22:36:13.640962+0000","last_became_active":"2024-09-11T22:20:24.074568+0000","last_became_peered":"2024-09-11T22:20:24.074568+0000","last_unstale":"2024-09-11T22:36:13.640962+0000","last_undegraded":"2024-09-11T22:36:13.640962+0000","last_fullsized":"2024-09-11T22:36:13.640962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5391","last_scrub_stamp":"2024-09-11T22:36:13.640872+0000","last_deep_scrub":"28'5391","last_deep_scrub_stamp":"2024-09-11T22:36:13.640872+0000","last_clean_scrub_stamp":"2024-09-11T22:36:13.640872+0000","objects_scrubbed":0,"log_size":5391,"log_dups_size":0,"ondisk_log_size":5391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:54.943009+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24494,"num_write_kb":454589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'16","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:02.085301+0000","last_change":"2024-09-11T22:36:02.085342+0000","last_active":"2024-09-11T22:36:02.085301+0000","last_peered":"2024-09-11T22:36:02.085301+0000","last_clean":"2024-09-11T22:36:02.085301+0000","last_became_active":"2024-09-11T22:20:19.860938+0000","last_became_peered":"2024-09-11T22:20:19.860938+0000","last_unstale":"2024-09-11T22:36:02.085301+0000","last_undegraded":"2024-09-11T22:36:02.085301+0000","last_fullsized":"2024-09-11T22:36:02.085301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'16","last_scrub_stamp":"2024-09-11T22:36:02.085196+0000","last_deep_scrub":"28'16","last_deep_scrub_stamp":"2024-09-11T22:36:02.085196+0000","last_clean_scrub_stamp":"2024-09-11T22:36:02.085196+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:14.832536+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'7","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:07.515569+0000","last_change":"2024-09-11T22:36:07.515602+0000","last_active":"2024-09-11T22:36:07.515569+0000","last_peered":"2024-09-11T22:36:07.515569+0000","last_clean":"2024-09-11T22:36:07.515569+0000","last_became_active":"2024-09-11T22:20:18.853182+0000","last_became_peered":"2024-09-11T22:20:18.853182+0000","last_unstale":"2024-09-11T22:36:07.515569+0000","last_undegraded":"2024-09-11T22:36:07.515569+0000","last_fullsized":"2024-09-11T22:36:07.515569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-11T22:36:07.515471+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-11T22:36:07.515471+0000","last_clean_scrub_stamp":"2024-09-11T22:36:07.515471+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:02.265430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":201,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:04.631252+0000","last_change":"2024-09-11T22:36:04.631252+0000","last_active":"2024-09-11T22:36:04.631252+0000","last_peered":"2024-09-11T22:36:04.631252+0000","last_clean":"2024-09-11T22:36:04.631252+0000","last_became_active":"2024-09-11T22:20:09.424591+0000","last_became_peered":"2024-09-11T22:20:09.424591+0000","last_unstale":"2024-09-11T22:36:04.631252+0000","last_undegraded":"2024-09-11T22:36:04.631252+0000","last_fullsized":"2024-09-11T22:36:04.631252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2024-09-11T22:36:04.631139+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2024-09-11T22:36:04.631139+0000","last_clean_scrub_stamp":"2024-09-11T22:36:04.631139+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:32.559244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'5687","reported_seq":5721,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:17.599567+0000","last_change":"2024-09-11T22:36:17.599597+0000","last_active":"2024-09-11T22:36:17.599567+0000","last_peered":"2024-09-11T22:36:17.599567+0000","last_clean":"2024-09-11T22:36:17.599567+0000","last_became_active":"2024-09-11T22:20:24.076601+0000","last_became_peered":"2024-09-11T22:20:24.076601+0000","last_unstale":"2024-09-11T22:36:17.599567+0000","last_undegraded":"2024-09-11T22:36:17.599567+0000","last_fullsized":"2024-09-11T22:36:17.599567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5687","last_scrub_stamp":"2024-09-11T22:36:17.599459+0000","last_deep_scrub":"28'5687","last_deep_scrub_stamp":"2024-09-11T22:36:17.599459+0000","last_clean_scrub_stamp":"2024-09-11T22:36:17.599459+0000","objects_scrubbed":0,"log_size":5687,"log_dups_size":0,"ondisk_log_size":5687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:13.879445+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25854,"num_write_kb":500757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'22","reported_seq":62,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:17.580508+0000","last_change":"2024-09-11T22:36:17.580554+0000","last_active":"2024-09-11T22:36:17.580508+0000","last_peered":"2024-09-11T22:36:17.580508+0000","last_clean":"2024-09-11T22:36:17.580508+0000","last_became_active":"2024-09-11T22:20:19.861322+0000","last_became_peered":"2024-09-11T22:20:19.861322+0000","last_unstale":"2024-09-11T22:36:17.580508+0000","last_undegraded":"2024-09-11T22:36:17.580508+0000","last_fullsized":"2024-09-11T22:36:17.580508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'22","last_scrub_stamp":"2024-09-11T22:36:17.580395+0000","last_deep_scrub":"28'22","last_deep_scrub_stamp":"2024-09-11T22:36:17.580395+0000","last_clean_scrub_stamp":"2024-09-11T22:36:17.580395+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:31:06.227335+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'7","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:02.720926+0000","last_change":"2024-09-11T22:36:02.720926+0000","last_active":"2024-09-11T22:36:02.720926+0000","last_peered":"2024-09-11T22:36:02.720926+0000","last_clean":"2024-09-11T22:36:02.720926+0000","last_became_active":"2024-09-11T22:20:18.853069+0000","last_became_peered":"2024-09-11T22:20:18.853069+0000","last_unstale":"2024-09-11T22:36:02.720926+0000","last_undegraded":"2024-09-11T22:36:02.720926+0000","last_fullsized":"2024-09-11T22:36:02.720926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-11T22:36:02.720783+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-11T22:36:02.720783+0000","last_clean_scrub_stamp":"2024-09-11T22:36:02.720783+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:47.441121+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'5968","reported_seq":6002,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:16.623844+0000","last_change":"2024-09-11T22:36:16.623873+0000","last_active":"2024-09-11T22:36:16.623844+0000","last_peered":"2024-09-11T22:36:16.623844+0000","last_clean":"2024-09-11T22:36:16.623844+0000","last_became_active":"2024-09-11T22:20:24.074789+0000","last_became_peered":"2024-09-11T22:20:24.074789+0000","last_unstale":"2024-09-11T22:36:16.623844+0000","last_undegraded":"2024-09-11T22:36:16.623844+0000","last_fullsized":"2024-09-11T22:36:16.623844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5968","last_scrub_stamp":"2024-09-11T22:36:16.623730+0000","last_deep_scrub":"28'5968","last_deep_scrub_stamp":"2024-09-11T22:36:16.623730+0000","last_clean_scrub_stamp":"2024-09-11T22:36:16.623730+0000","objects_scrubbed":0,"log_size":5968,"log_dups_size":0,"ondisk_log_size":5968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:59.824771+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27295,"num_write_kb":514661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'20","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:16.539723+0000","last_change":"2024-09-11T22:36:16.539749+0000","last_active":"2024-09-11T22:36:16.539723+0000","last_peered":"2024-09-11T22:36:16.539723+0000","last_clean":"2024-09-11T22:36:16.539723+0000","last_became_active":"2024-09-11T22:20:19.865535+0000","last_became_peered":"2024-09-11T22:20:19.865535+0000","last_unstale":"2024-09-11T22:36:16.539723+0000","last_undegraded":"2024-09-11T22:36:16.539723+0000","last_fullsized":"2024-09-11T22:36:16.539723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'20","last_scrub_stamp":"2024-09-11T22:36:16.539642+0000","last_deep_scrub":"28'20","last_deep_scrub_stamp":"2024-09-11T22:36:16.539642+0000","last_clean_scrub_stamp":"2024-09-11T22:36:16.539642+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:30:06.778993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'3","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:05.308938+0000","last_change":"2024-09-11T22:36:05.308938+0000","last_active":"2024-09-11T22:36:05.308938+0000","last_peered":"2024-09-11T22:36:05.308938+0000","last_clean":"2024-09-11T22:36:05.308938+0000","last_became_active":"2024-09-11T22:20:18.848787+0000","last_became_peered":"2024-09-11T22:20:18.848787+0000","last_unstale":"2024-09-11T22:36:05.308938+0000","last_undegraded":"2024-09-11T22:36:05.308938+0000","last_fullsized":"2024-09-11T22:36:05.308938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-11T22:36:05.308823+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-11T22:36:05.308823+0000","last_clean_scrub_stamp":"2024-09-11T22:36:05.308823+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:37.727488+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'5430","reported_seq":5464,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:11.612332+0000","last_change":"2024-09-11T22:36:11.612357+0000","last_active":"2024-09-11T22:36:11.612332+0000","last_peered":"2024-09-11T22:36:11.612332+0000","last_clean":"2024-09-11T22:36:11.612332+0000","last_became_active":"2024-09-11T22:20:23.879586+0000","last_became_peered":"2024-09-11T22:20:23.879586+0000","last_unstale":"2024-09-11T22:36:11.612332+0000","last_undegraded":"2024-09-11T22:36:11.612332+0000","last_fullsized":"2024-09-11T22:36:11.612332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5430","last_scrub_stamp":"2024-09-11T22:36:11.612246+0000","last_deep_scrub":"28'5430","last_deep_scrub_stamp":"2024-09-11T22:36:11.612246+0000","last_clean_scrub_stamp":"2024-09-11T22:36:11.612246+0000","objects_scrubbed":0,"log_size":5430,"log_dups_size":0,"ondisk_log_size":5430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:15:19.533127+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24342,"num_write_kb":478105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'21","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:14.563461+0000","last_change":"2024-09-11T22:36:14.563503+0000","last_active":"2024-09-11T22:36:14.563461+0000","last_peered":"2024-09-11T22:36:14.563461+0000","last_clean":"2024-09-11T22:36:14.563461+0000","last_became_active":"2024-09-11T22:20:19.860076+0000","last_became_peered":"2024-09-11T22:20:19.860076+0000","last_unstale":"2024-09-11T22:36:14.563461+0000","last_undegraded":"2024-09-11T22:36:14.563461+0000","last_fullsized":"2024-09-11T22:36:14.563461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'21","last_scrub_stamp":"2024-09-11T22:36:14.563352+0000","last_deep_scrub":"28'21","last_deep_scrub_stamp":"2024-09-11T22:36:14.563352+0000","last_clean_scrub_stamp":"2024-09-11T22:36:14.563352+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:55.526740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'7","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:04.655239+0000","last_change":"2024-09-11T22:36:04.655239+0000","last_active":"2024-09-11T22:36:04.655239+0000","last_peered":"2024-09-11T22:36:04.655239+0000","last_clean":"2024-09-11T22:36:04.655239+0000","last_became_active":"2024-09-11T22:20:18.855753+0000","last_became_peered":"2024-09-11T22:20:18.855753+0000","last_unstale":"2024-09-11T22:36:04.655239+0000","last_undegraded":"2024-09-11T22:36:04.655239+0000","last_fullsized":"2024-09-11T22:36:04.655239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-11T22:36:04.655113+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-11T22:36:04.655113+0000","last_clean_scrub_stamp":"2024-09-11T22:36:04.655113+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:55.600341+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'6069","reported_seq":6095,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.631553+0000","last_change":"2024-09-11T22:20:24.077975+0000","last_active":"2024-09-11T22:35:44.631553+0000","last_peered":"2024-09-11T22:35:44.631553+0000","last_clean":"2024-09-11T22:35:44.631553+0000","last_became_active":"2024-09-11T22:20:24.077502+0000","last_became_peered":"2024-09-11T22:20:24.077502+0000","last_unstale":"2024-09-11T22:35:44.631553+0000","last_undegraded":"2024-09-11T22:35:44.631553+0000","last_fullsized":"2024-09-11T22:35:44.631553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6069,"log_dups_size":0,"ondisk_log_size":6069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27695,"num_write_kb":495810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'12","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:12.533716+0000","last_change":"2024-09-11T22:36:12.533745+0000","last_active":"2024-09-11T22:36:12.533716+0000","last_peered":"2024-09-11T22:36:12.533716+0000","last_clean":"2024-09-11T22:36:12.533716+0000","last_became_active":"2024-09-11T22:20:19.856739+0000","last_became_peered":"2024-09-11T22:20:19.856739+0000","last_unstale":"2024-09-11T22:36:12.533716+0000","last_undegraded":"2024-09-11T22:36:12.533716+0000","last_fullsized":"2024-09-11T22:36:12.533716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-09-11T22:36:12.533609+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-09-11T22:36:12.533609+0000","last_clean_scrub_stamp":"2024-09-11T22:36:12.533609+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:03.936229+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'8","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:03.097372+0000","last_change":"2024-09-11T22:36:03.097372+0000","last_active":"2024-09-11T22:36:03.097372+0000","last_peered":"2024-09-11T22:36:03.097372+0000","last_clean":"2024-09-11T22:36:03.097372+0000","last_became_active":"2024-09-11T22:20:18.854764+0000","last_became_peered":"2024-09-11T22:20:18.854764+0000","last_unstale":"2024-09-11T22:36:03.097372+0000","last_undegraded":"2024-09-11T22:36:03.097372+0000","last_fullsized":"2024-09-11T22:36:03.097372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-11T22:36:03.096954+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-11T22:36:03.096954+0000","last_clean_scrub_stamp":"2024-09-11T22:36:03.096954+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:24.275387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'5738","reported_seq":5772,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:12.117012+0000","last_change":"2024-09-11T22:36:12.117041+0000","last_active":"2024-09-11T22:36:12.117012+0000","last_peered":"2024-09-11T22:36:12.117012+0000","last_clean":"2024-09-11T22:36:12.117012+0000","last_became_active":"2024-09-11T22:20:23.877890+0000","last_became_peered":"2024-09-11T22:20:23.877890+0000","last_unstale":"2024-09-11T22:36:12.117012+0000","last_undegraded":"2024-09-11T22:36:12.117012+0000","last_fullsized":"2024-09-11T22:36:12.117012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5738","last_scrub_stamp":"2024-09-11T22:36:12.116881+0000","last_deep_scrub":"28'5738","last_deep_scrub_stamp":"2024-09-11T22:36:12.116881+0000","last_clean_scrub_stamp":"2024-09-11T22:36:12.116881+0000","objects_scrubbed":0,"log_size":5738,"log_dups_size":0,"ondisk_log_size":5738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:43.311459+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25762,"num_write_kb":496113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'20","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:15.523171+0000","last_change":"2024-09-11T22:36:15.523198+0000","last_active":"2024-09-11T22:36:15.523171+0000","last_peered":"2024-09-11T22:36:15.523171+0000","last_clean":"2024-09-11T22:36:15.523171+0000","last_became_active":"2024-09-11T22:20:19.860988+0000","last_became_peered":"2024-09-11T22:20:19.860988+0000","last_unstale":"2024-09-11T22:36:15.523171+0000","last_undegraded":"2024-09-11T22:36:15.523171+0000","last_fullsized":"2024-09-11T22:36:15.523171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'20","last_scrub_stamp":"2024-09-11T22:36:15.523071+0000","last_deep_scrub":"28'20","last_deep_scrub_stamp":"2024-09-11T22:36:15.523071+0000","last_clean_scrub_stamp":"2024-09-11T22:36:15.523071+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:47.302261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'27","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:01.772298+0000","last_change":"2024-09-11T22:36:01.772348+0000","last_active":"2024-09-11T22:36:01.772298+0000","last_peered":"2024-09-11T22:36:01.772298+0000","last_clean":"2024-09-11T22:36:01.772298+0000","last_became_active":"2024-09-11T22:20:18.852153+0000","last_became_peered":"2024-09-11T22:20:18.852153+0000","last_unstale":"2024-09-11T22:36:01.772298+0000","last_undegraded":"2024-09-11T22:36:01.772298+0000","last_fullsized":"2024-09-11T22:36:01.772298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'27","last_scrub_stamp":"2024-09-11T22:36:01.772209+0000","last_deep_scrub":"28'27","last_deep_scrub_stamp":"2024-09-11T22:36:01.772209+0000","last_clean_scrub_stamp":"2024-09-11T22:36:01.772209+0000","objects_scrubbed":8,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:54.186626+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'6219","reported_seq":6252,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:10.663311+0000","last_change":"2024-09-11T22:36:10.663337+0000","last_active":"2024-09-11T22:36:10.663311+0000","last_peered":"2024-09-11T22:36:10.663311+0000","last_clean":"2024-09-11T22:36:10.663311+0000","last_became_active":"2024-09-11T22:20:23.873635+0000","last_became_peered":"2024-09-11T22:20:23.873635+0000","last_unstale":"2024-09-11T22:36:10.663311+0000","last_undegraded":"2024-09-11T22:36:10.663311+0000","last_fullsized":"2024-09-11T22:36:10.663311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6219","last_scrub_stamp":"2024-09-11T22:36:10.663227+0000","last_deep_scrub":"28'6219","last_deep_scrub_stamp":"2024-09-11T22:36:10.663227+0000","last_clean_scrub_stamp":"2024-09-11T22:36:10.663227+0000","objects_scrubbed":0,"log_size":6219,"log_dups_size":0,"ondisk_log_size":6219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:51.984529+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28436,"num_write_kb":547819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'20","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:08.589142+0000","last_change":"2024-09-11T22:36:08.589170+0000","last_active":"2024-09-11T22:36:08.589142+0000","last_peered":"2024-09-11T22:36:08.589142+0000","last_clean":"2024-09-11T22:36:08.589142+0000","last_became_active":"2024-09-11T22:20:19.851286+0000","last_became_peered":"2024-09-11T22:20:19.851286+0000","last_unstale":"2024-09-11T22:36:08.589142+0000","last_undegraded":"2024-09-11T22:36:08.589142+0000","last_fullsized":"2024-09-11T22:36:08.589142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'20","last_scrub_stamp":"2024-09-11T22:36:08.589051+0000","last_deep_scrub":"28'20","last_deep_scrub_stamp":"2024-09-11T22:36:08.589051+0000","last_clean_scrub_stamp":"2024-09-11T22:36:08.589051+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:44.710002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'11","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:05.608683+0000","last_change":"2024-09-11T22:36:05.608722+0000","last_active":"2024-09-11T22:36:05.608683+0000","last_peered":"2024-09-11T22:36:05.608683+0000","last_clean":"2024-09-11T22:36:05.608683+0000","last_became_active":"2024-09-11T22:20:18.852978+0000","last_became_peered":"2024-09-11T22:20:18.852978+0000","last_unstale":"2024-09-11T22:36:05.608683+0000","last_undegraded":"2024-09-11T22:36:05.608683+0000","last_fullsized":"2024-09-11T22:36:05.608683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-09-11T22:36:05.608594+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-09-11T22:36:05.608594+0000","last_clean_scrub_stamp":"2024-09-11T22:36:05.608594+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:32.566087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'6495","reported_seq":6520,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.812517+0000","last_change":"2024-09-11T22:20:24.077636+0000","last_active":"2024-09-11T22:35:44.812517+0000","last_peered":"2024-09-11T22:35:44.812517+0000","last_clean":"2024-09-11T22:35:44.812517+0000","last_became_active":"2024-09-11T22:20:24.077313+0000","last_became_peered":"2024-09-11T22:20:24.077313+0000","last_unstale":"2024-09-11T22:35:44.812517+0000","last_undegraded":"2024-09-11T22:35:44.812517+0000","last_fullsized":"2024-09-11T22:35:44.812517+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":6295,"log_dups_size":0,"ondisk_log_size":6295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29875,"num_write_kb":541234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'29","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:16.530765+0000","last_change":"2024-09-11T22:36:16.530791+0000","last_active":"2024-09-11T22:36:16.530765+0000","last_peered":"2024-09-11T22:36:16.530765+0000","last_clean":"2024-09-11T22:36:16.530765+0000","last_became_active":"2024-09-11T22:20:19.862267+0000","last_became_peered":"2024-09-11T22:20:19.862267+0000","last_unstale":"2024-09-11T22:36:16.530765+0000","last_undegraded":"2024-09-11T22:36:16.530765+0000","last_fullsized":"2024-09-11T22:36:16.530765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'29","last_scrub_stamp":"2024-09-11T22:36:16.530674+0000","last_deep_scrub":"28'29","last_deep_scrub_stamp":"2024-09-11T22:36:16.530674+0000","last_clean_scrub_stamp":"2024-09-11T22:36:16.530674+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:37.249529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'9","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:09.459365+0000","last_change":"2024-09-11T22:36:09.459424+0000","last_active":"2024-09-11T22:36:09.459365+0000","last_peered":"2024-09-11T22:36:09.459365+0000","last_clean":"2024-09-11T22:36:09.459365+0000","last_became_active":"2024-09-11T22:20:18.857419+0000","last_became_peered":"2024-09-11T22:20:18.857419+0000","last_unstale":"2024-09-11T22:36:09.459365+0000","last_undegraded":"2024-09-11T22:36:09.459365+0000","last_fullsized":"2024-09-11T22:36:09.459365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-11T22:36:09.459262+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-11T22:36:09.459262+0000","last_clean_scrub_stamp":"2024-09-11T22:36:09.459262+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:53.312211+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'6284","reported_seq":6317,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:18.220385+0000","last_change":"2024-09-11T22:36:18.220410+0000","last_active":"2024-09-11T22:36:18.220385+0000","last_peered":"2024-09-11T22:36:18.220385+0000","last_clean":"2024-09-11T22:36:18.220385+0000","last_became_active":"2024-09-11T22:20:24.074609+0000","last_became_peered":"2024-09-11T22:20:24.074609+0000","last_unstale":"2024-09-11T22:36:18.220385+0000","last_undegraded":"2024-09-11T22:36:18.220385+0000","last_fullsized":"2024-09-11T22:36:18.220385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6284","last_scrub_stamp":"2024-09-11T22:36:18.220294+0000","last_deep_scrub":"28'6284","last_deep_scrub_stamp":"2024-09-11T22:36:18.220294+0000","last_clean_scrub_stamp":"2024-09-11T22:36:18.220294+0000","objects_scrubbed":0,"log_size":6284,"log_dups_size":0,"ondisk_log_size":6284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:13.137403+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27888,"num_write_kb":554175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'24","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:05.701661+0000","last_change":"2024-09-11T22:36:05.701681+0000","last_active":"2024-09-11T22:36:05.701661+0000","last_peered":"2024-09-11T22:36:05.701661+0000","last_clean":"2024-09-11T22:36:05.701661+0000","last_became_active":"2024-09-11T22:20:19.857027+0000","last_became_peered":"2024-09-11T22:20:19.857027+0000","last_unstale":"2024-09-11T22:36:05.701661+0000","last_undegraded":"2024-09-11T22:36:05.701661+0000","last_fullsized":"2024-09-11T22:36:05.701661+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'24","last_scrub_stamp":"2024-09-11T22:36:05.701596+0000","last_deep_scrub":"28'24","last_deep_scrub_stamp":"2024-09-11T22:36:05.701596+0000","last_clean_scrub_stamp":"2024-09-11T22:36:05.701596+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:36.896174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'15","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:00.703974+0000","last_change":"2024-09-11T22:36:00.704034+0000","last_active":"2024-09-11T22:36:00.703974+0000","last_peered":"2024-09-11T22:36:00.703974+0000","last_clean":"2024-09-11T22:36:00.703974+0000","last_became_active":"2024-09-11T22:20:18.848405+0000","last_became_peered":"2024-09-11T22:20:18.848405+0000","last_unstale":"2024-09-11T22:36:00.703974+0000","last_undegraded":"2024-09-11T22:36:00.703974+0000","last_fullsized":"2024-09-11T22:36:00.703974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-09-11T22:36:00.703688+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-09-11T22:36:00.703688+0000","last_clean_scrub_stamp":"2024-09-11T22:36:00.703688+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:50:43.022157+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'5107","reported_seq":5132,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.846292+0000","last_change":"2024-09-11T22:20:24.076835+0000","last_active":"2024-09-11T22:35:44.846292+0000","last_peered":"2024-09-11T22:35:44.846292+0000","last_clean":"2024-09-11T22:35:44.846292+0000","last_became_active":"2024-09-11T22:20:24.076200+0000","last_became_peered":"2024-09-11T22:20:24.076200+0000","last_unstale":"2024-09-11T22:35:44.846292+0000","last_undegraded":"2024-09-11T22:35:44.846292+0000","last_fullsized":"2024-09-11T22:35:44.846292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5107,"log_dups_size":0,"ondisk_log_size":5107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22900,"num_write_kb":480501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'17","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.048031+0000","last_change":"2024-09-11T22:21:02.033502+0000","last_active":"2024-09-11T22:35:51.048031+0000","last_peered":"2024-09-11T22:35:51.048031+0000","last_clean":"2024-09-11T22:35:51.048031+0000","last_became_active":"2024-09-11T22:21:02.033269+0000","last_became_peered":"2024-09-11T22:21:02.033269+0000","last_unstale":"2024-09-11T22:35:51.048031+0000","last_undegraded":"2024-09-11T22:35:51.048031+0000","last_fullsized":"2024-09-11T22:35:51.048031+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'333","reported_seq":374,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:07.644731+0000","last_change":"2024-09-11T22:36:07.644771+0000","last_active":"2024-09-11T22:36:07.644731+0000","last_peered":"2024-09-11T22:36:07.644731+0000","last_clean":"2024-09-11T22:36:07.644731+0000","last_became_active":"2024-09-11T22:20:18.855386+0000","last_became_peered":"2024-09-11T22:20:18.855386+0000","last_unstale":"2024-09-11T22:36:07.644731+0000","last_undegraded":"2024-09-11T22:36:07.644731+0000","last_fullsized":"2024-09-11T22:36:07.644731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'333","last_scrub_stamp":"2024-09-11T22:36:07.644644+0000","last_deep_scrub":"28'333","last_deep_scrub_stamp":"2024-09-11T22:36:07.644644+0000","last_clean_scrub_stamp":"2024-09-11T22:36:07.644644+0000","objects_scrubbed":5,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:35.572748+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'5582","reported_seq":5615,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:14.331913+0000","last_change":"2024-09-11T22:36:14.331938+0000","last_active":"2024-09-11T22:36:14.331913+0000","last_peered":"2024-09-11T22:36:14.331913+0000","last_clean":"2024-09-11T22:36:14.331913+0000","last_became_active":"2024-09-11T22:20:23.879993+0000","last_became_peered":"2024-09-11T22:20:23.879993+0000","last_unstale":"2024-09-11T22:36:14.331913+0000","last_undegraded":"2024-09-11T22:36:14.331913+0000","last_fullsized":"2024-09-11T22:36:14.331913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5582","last_scrub_stamp":"2024-09-11T22:36:14.331821+0000","last_deep_scrub":"28'5582","last_deep_scrub_stamp":"2024-09-11T22:36:14.331821+0000","last_clean_scrub_stamp":"2024-09-11T22:36:14.331821+0000","objects_scrubbed":0,"log_size":5582,"log_dups_size":0,"ondisk_log_size":5582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:14.962618+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25321,"num_write_kb":502610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'21","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:06.065749+0000","last_change":"2024-09-11T22:36:06.065783+0000","last_active":"2024-09-11T22:36:06.065749+0000","last_peered":"2024-09-11T22:36:06.065749+0000","last_clean":"2024-09-11T22:36:06.065749+0000","last_became_active":"2024-09-11T22:20:19.858322+0000","last_became_peered":"2024-09-11T22:20:19.858322+0000","last_unstale":"2024-09-11T22:36:06.065749+0000","last_undegraded":"2024-09-11T22:36:06.065749+0000","last_fullsized":"2024-09-11T22:36:06.065749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'21","last_scrub_stamp":"2024-09-11T22:36:06.065658+0000","last_deep_scrub":"28'21","last_deep_scrub_stamp":"2024-09-11T22:36:06.065658+0000","last_clean_scrub_stamp":"2024-09-11T22:36:06.065658+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:50:48.384128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'29","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:07.337574+0000","last_change":"2024-09-11T22:36:07.337617+0000","last_active":"2024-09-11T22:36:07.337574+0000","last_peered":"2024-09-11T22:36:07.337574+0000","last_clean":"2024-09-11T22:36:07.337574+0000","last_became_active":"2024-09-11T22:20:18.854784+0000","last_became_peered":"2024-09-11T22:20:18.854784+0000","last_unstale":"2024-09-11T22:36:07.337574+0000","last_undegraded":"2024-09-11T22:36:07.337574+0000","last_fullsized":"2024-09-11T22:36:07.337574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'29","last_scrub_stamp":"2024-09-11T22:36:07.337504+0000","last_deep_scrub":"28'29","last_deep_scrub_stamp":"2024-09-11T22:36:07.337504+0000","last_clean_scrub_stamp":"2024-09-11T22:36:07.337504+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:51.681304+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'6236","reported_seq":6269,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:15.193948+0000","last_change":"2024-09-11T22:36:15.193975+0000","last_active":"2024-09-11T22:36:15.193948+0000","last_peered":"2024-09-11T22:36:15.193948+0000","last_clean":"2024-09-11T22:36:15.193948+0000","last_became_active":"2024-09-11T22:20:23.878794+0000","last_became_peered":"2024-09-11T22:20:23.878794+0000","last_unstale":"2024-09-11T22:36:15.193948+0000","last_undegraded":"2024-09-11T22:36:15.193948+0000","last_fullsized":"2024-09-11T22:36:15.193948+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6236","last_scrub_stamp":"2024-09-11T22:36:15.193841+0000","last_deep_scrub":"28'6236","last_deep_scrub_stamp":"2024-09-11T22:36:15.193841+0000","last_clean_scrub_stamp":"2024-09-11T22:36:15.193841+0000","objects_scrubbed":0,"log_size":6236,"log_dups_size":0,"ondisk_log_size":6236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:06.596461+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28034,"num_write_kb":525577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'25","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:14.635165+0000","last_change":"2024-09-11T22:36:14.635217+0000","last_active":"2024-09-11T22:36:14.635165+0000","last_peered":"2024-09-11T22:36:14.635165+0000","last_clean":"2024-09-11T22:36:14.635165+0000","last_became_active":"2024-09-11T22:21:02.034349+0000","last_became_peered":"2024-09-11T22:21:02.034349+0000","last_unstale":"2024-09-11T22:36:14.635165+0000","last_undegraded":"2024-09-11T22:36:14.635165+0000","last_fullsized":"2024-09-11T22:36:14.635165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'25","last_scrub_stamp":"2024-09-11T22:36:14.635057+0000","last_deep_scrub":"28'25","last_deep_scrub_stamp":"2024-09-11T22:36:14.635057+0000","last_clean_scrub_stamp":"2024-09-11T22:36:14.635057+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:32.058146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'5","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:06.531254+0000","last_change":"2024-09-11T22:36:06.531285+0000","last_active":"2024-09-11T22:36:06.531254+0000","last_peered":"2024-09-11T22:36:06.531254+0000","last_clean":"2024-09-11T22:36:06.531254+0000","last_became_active":"2024-09-11T22:20:18.853103+0000","last_became_peered":"2024-09-11T22:20:18.853103+0000","last_unstale":"2024-09-11T22:36:06.531254+0000","last_undegraded":"2024-09-11T22:36:06.531254+0000","last_fullsized":"2024-09-11T22:36:06.531254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-11T22:36:06.531169+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-11T22:36:06.531169+0000","last_clean_scrub_stamp":"2024-09-11T22:36:06.531169+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:08.866712+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'5748","reported_seq":5781,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:16.228962+0000","last_change":"2024-09-11T22:36:16.228992+0000","last_active":"2024-09-11T22:36:16.228962+0000","last_peered":"2024-09-11T22:36:16.228962+0000","last_clean":"2024-09-11T22:36:16.228962+0000","last_became_active":"2024-09-11T22:20:23.876587+0000","last_became_peered":"2024-09-11T22:20:23.876587+0000","last_unstale":"2024-09-11T22:36:16.228962+0000","last_undegraded":"2024-09-11T22:36:16.228962+0000","last_fullsized":"2024-09-11T22:36:16.228962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5748","last_scrub_stamp":"2024-09-11T22:36:16.228846+0000","last_deep_scrub":"28'5748","last_deep_scrub_stamp":"2024-09-11T22:36:16.228846+0000","last_clean_scrub_stamp":"2024-09-11T22:36:16.228846+0000","objects_scrubbed":0,"log_size":5748,"log_dups_size":0,"ondisk_log_size":5748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:24.022659+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26080,"num_write_kb":501611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'25","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:17.549914+0000","last_change":"2024-09-11T22:36:17.549941+0000","last_active":"2024-09-11T22:36:17.549914+0000","last_peered":"2024-09-11T22:36:17.549914+0000","last_clean":"2024-09-11T22:36:17.549914+0000","last_became_active":"2024-09-11T22:20:19.866303+0000","last_became_peered":"2024-09-11T22:20:19.866303+0000","last_unstale":"2024-09-11T22:36:17.549914+0000","last_undegraded":"2024-09-11T22:36:17.549914+0000","last_fullsized":"2024-09-11T22:36:17.549914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'25","last_scrub_stamp":"2024-09-11T22:36:17.549821+0000","last_deep_scrub":"28'25","last_deep_scrub_stamp":"2024-09-11T22:36:17.549821+0000","last_clean_scrub_stamp":"2024-09-11T22:36:17.549821+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:31:06.196760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'7","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:06.637430+0000","last_change":"2024-09-11T22:36:06.637479+0000","last_active":"2024-09-11T22:36:06.637430+0000","last_peered":"2024-09-11T22:36:06.637430+0000","last_clean":"2024-09-11T22:36:06.637430+0000","last_became_active":"2024-09-11T22:20:18.854019+0000","last_became_peered":"2024-09-11T22:20:18.854019+0000","last_unstale":"2024-09-11T22:36:06.637430+0000","last_undegraded":"2024-09-11T22:36:06.637430+0000","last_fullsized":"2024-09-11T22:36:06.637430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-11T22:36:06.637335+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-11T22:36:06.637335+0000","last_clean_scrub_stamp":"2024-09-11T22:36:06.637335+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:50:48.955804+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'5959","reported_seq":5984,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:44.825453+0000","last_change":"2024-09-11T22:20:24.077476+0000","last_active":"2024-09-11T22:35:44.825453+0000","last_peered":"2024-09-11T22:35:44.825453+0000","last_clean":"2024-09-11T22:35:44.825453+0000","last_became_active":"2024-09-11T22:20:24.077134+0000","last_became_peered":"2024-09-11T22:20:24.077134+0000","last_unstale":"2024-09-11T22:35:44.825453+0000","last_undegraded":"2024-09-11T22:35:44.825453+0000","last_fullsized":"2024-09-11T22:35:44.825453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:22.853906+0000","last_clean_scrub_stamp":"2024-09-11T22:20:22.853906+0000","objects_scrubbed":0,"log_size":5959,"log_dups_size":0,"ondisk_log_size":5959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26850,"num_write_kb":516954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'7134","reported_seq":7175,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:15.616253+0000","last_change":"2024-09-11T22:36:15.616295+0000","last_active":"2024-09-11T22:36:15.616253+0000","last_peered":"2024-09-11T22:36:15.616253+0000","last_clean":"2024-09-11T22:36:15.616253+0000","last_became_active":"2024-09-11T22:21:02.037407+0000","last_became_peered":"2024-09-11T22:21:02.037407+0000","last_unstale":"2024-09-11T22:36:15.616253+0000","last_undegraded":"2024-09-11T22:36:15.616253+0000","last_fullsized":"2024-09-11T22:36:15.616253+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7134","last_scrub_stamp":"2024-09-11T22:36:15.616131+0000","last_deep_scrub":"28'7134","last_deep_scrub_stamp":"2024-09-11T22:36:15.616131+0000","last_clean_scrub_stamp":"2024-09-11T22:36:15.616131+0000","objects_scrubbed":0,"log_size":7134,"log_dups_size":0,"ondisk_log_size":7134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:55.356023+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33450,"num_write_kb":608986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'20","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:01.353495+0000","last_change":"2024-09-11T22:36:01.353532+0000","last_active":"2024-09-11T22:36:01.353495+0000","last_peered":"2024-09-11T22:36:01.353495+0000","last_clean":"2024-09-11T22:36:01.353495+0000","last_became_active":"2024-09-11T22:20:19.845425+0000","last_became_peered":"2024-09-11T22:20:19.845425+0000","last_unstale":"2024-09-11T22:36:01.353495+0000","last_undegraded":"2024-09-11T22:36:01.353495+0000","last_fullsized":"2024-09-11T22:36:01.353495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'20","last_scrub_stamp":"2024-09-11T22:36:01.353393+0000","last_deep_scrub":"28'20","last_deep_scrub_stamp":"2024-09-11T22:36:01.353393+0000","last_clean_scrub_stamp":"2024-09-11T22:36:01.353393+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:42.279729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'4","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:05.578614+0000","last_change":"2024-09-11T22:36:05.578650+0000","last_active":"2024-09-11T22:36:05.578614+0000","last_peered":"2024-09-11T22:36:05.578614+0000","last_clean":"2024-09-11T22:36:05.578614+0000","last_became_active":"2024-09-11T22:20:18.852155+0000","last_became_peered":"2024-09-11T22:20:18.852155+0000","last_unstale":"2024-09-11T22:36:05.578614+0000","last_undegraded":"2024-09-11T22:36:05.578614+0000","last_fullsized":"2024-09-11T22:36:05.578614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-11T22:36:05.578489+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-11T22:36:05.578489+0000","last_clean_scrub_stamp":"2024-09-11T22:36:05.578489+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:54.915715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"28'6143","reported_seq":6177,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:15.629640+0000","last_change":"2024-09-11T22:36:15.629667+0000","last_active":"2024-09-11T22:36:15.629640+0000","last_peered":"2024-09-11T22:36:15.629640+0000","last_clean":"2024-09-11T22:36:15.629640+0000","last_became_active":"2024-09-11T22:20:23.876100+0000","last_became_peered":"2024-09-11T22:20:23.876100+0000","last_unstale":"2024-09-11T22:36:15.629640+0000","last_undegraded":"2024-09-11T22:36:15.629640+0000","last_fullsized":"2024-09-11T22:36:15.629640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6143","last_scrub_stamp":"2024-09-11T22:36:15.629537+0000","last_deep_scrub":"28'6143","last_deep_scrub_stamp":"2024-09-11T22:36:15.629537+0000","last_clean_scrub_stamp":"2024-09-11T22:36:15.629537+0000","objects_scrubbed":0,"log_size":6143,"log_dups_size":0,"ondisk_log_size":6143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:00.775705+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28157,"num_write_kb":534365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'27","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:14.216663+0000","last_change":"2024-09-11T22:36:14.216683+0000","last_active":"2024-09-11T22:36:14.216663+0000","last_peered":"2024-09-11T22:36:14.216663+0000","last_clean":"2024-09-11T22:36:14.216663+0000","last_became_active":"2024-09-11T22:20:19.852333+0000","last_became_peered":"2024-09-11T22:20:19.852333+0000","last_unstale":"2024-09-11T22:36:14.216663+0000","last_undegraded":"2024-09-11T22:36:14.216663+0000","last_fullsized":"2024-09-11T22:36:14.216663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'27","last_scrub_stamp":"2024-09-11T22:36:14.216594+0000","last_deep_scrub":"28'27","last_deep_scrub_stamp":"2024-09-11T22:36:14.216594+0000","last_clean_scrub_stamp":"2024-09-11T22:36:14.216594+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:06.171850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'6","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:07.150994+0000","last_change":"2024-09-11T22:36:07.151035+0000","last_active":"2024-09-11T22:36:07.150994+0000","last_peered":"2024-09-11T22:36:07.150994+0000","last_clean":"2024-09-11T22:36:07.150994+0000","last_became_active":"2024-09-11T22:20:18.853533+0000","last_became_peered":"2024-09-11T22:20:18.853533+0000","last_unstale":"2024-09-11T22:36:07.150994+0000","last_undegraded":"2024-09-11T22:36:07.150994+0000","last_fullsized":"2024-09-11T22:36:07.150994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-11T22:36:07.150892+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-11T22:36:07.150892+0000","last_clean_scrub_stamp":"2024-09-11T22:36:07.150892+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:31.963855+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'10","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:03.543188+0000","last_change":"2024-09-11T22:36:03.543235+0000","last_active":"2024-09-11T22:36:03.543188+0000","last_peered":"2024-09-11T22:36:03.543188+0000","last_clean":"2024-09-11T22:36:03.543188+0000","last_became_active":"2024-09-11T22:20:18.846321+0000","last_became_peered":"2024-09-11T22:20:18.846321+0000","last_unstale":"2024-09-11T22:36:03.543188+0000","last_undegraded":"2024-09-11T22:36:03.543188+0000","last_fullsized":"2024-09-11T22:36:03.543188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-09-11T22:36:03.543082+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-09-11T22:36:03.543082+0000","last_clean_scrub_stamp":"2024-09-11T22:36:03.543082+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:24.721515+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'19","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:08.711576+0000","last_change":"2024-09-11T22:36:08.711597+0000","last_active":"2024-09-11T22:36:08.711576+0000","last_peered":"2024-09-11T22:36:08.711576+0000","last_clean":"2024-09-11T22:36:08.711576+0000","last_became_active":"2024-09-11T22:20:19.861154+0000","last_became_peered":"2024-09-11T22:20:19.861154+0000","last_unstale":"2024-09-11T22:36:08.711576+0000","last_undegraded":"2024-09-11T22:36:08.711576+0000","last_fullsized":"2024-09-11T22:36:08.711576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'19","last_scrub_stamp":"2024-09-11T22:36:08.711516+0000","last_deep_scrub":"28'19","last_deep_scrub_stamp":"2024-09-11T22:36:08.711516+0000","last_clean_scrub_stamp":"2024-09-11T22:36:08.711516+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:43.813069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'5094","reported_seq":5127,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:07.682008+0000","last_change":"2024-09-11T22:36:07.682039+0000","last_active":"2024-09-11T22:36:07.682008+0000","last_peered":"2024-09-11T22:36:07.682008+0000","last_clean":"2024-09-11T22:36:07.682008+0000","last_became_active":"2024-09-11T22:20:23.877578+0000","last_became_peered":"2024-09-11T22:20:23.877578+0000","last_unstale":"2024-09-11T22:36:07.682008+0000","last_undegraded":"2024-09-11T22:36:07.682008+0000","last_fullsized":"2024-09-11T22:36:07.682008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5094","last_scrub_stamp":"2024-09-11T22:36:07.681912+0000","last_deep_scrub":"28'5094","last_deep_scrub_stamp":"2024-09-11T22:36:07.681912+0000","last_clean_scrub_stamp":"2024-09-11T22:36:07.681912+0000","objects_scrubbed":0,"log_size":5094,"log_dups_size":0,"ondisk_log_size":5094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:05.444259+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23560,"num_write_kb":426046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'586","reported_seq":627,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:08.183650+0000","last_change":"2024-09-11T22:36:08.183675+0000","last_active":"2024-09-11T22:36:08.183650+0000","last_peered":"2024-09-11T22:36:08.183650+0000","last_clean":"2024-09-11T22:36:08.183650+0000","last_became_active":"2024-09-11T22:20:18.853872+0000","last_became_peered":"2024-09-11T22:20:18.853872+0000","last_unstale":"2024-09-11T22:36:08.183650+0000","last_undegraded":"2024-09-11T22:36:08.183650+0000","last_fullsized":"2024-09-11T22:36:08.183650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'586","last_scrub_stamp":"2024-09-11T22:36:08.183580+0000","last_deep_scrub":"28'586","last_deep_scrub_stamp":"2024-09-11T22:36:08.183580+0000","last_clean_scrub_stamp":"2024-09-11T22:36:08.183580+0000","objects_scrubbed":3,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:27:50.647683+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195510,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":580,"num_write_kb":4218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'20","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:04.047038+0000","last_change":"2024-09-11T22:36:04.047098+0000","last_active":"2024-09-11T22:36:04.047038+0000","last_peered":"2024-09-11T22:36:04.047038+0000","last_clean":"2024-09-11T22:36:04.047038+0000","last_became_active":"2024-09-11T22:20:19.850175+0000","last_became_peered":"2024-09-11T22:20:19.850175+0000","last_unstale":"2024-09-11T22:36:04.047038+0000","last_undegraded":"2024-09-11T22:36:04.047038+0000","last_fullsized":"2024-09-11T22:36:04.047038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'20","last_scrub_stamp":"2024-09-11T22:36:04.046903+0000","last_deep_scrub":"28'20","last_deep_scrub_stamp":"2024-09-11T22:36:04.046903+0000","last_clean_scrub_stamp":"2024-09-11T22:36:04.046903+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:39.546107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'6620","reported_seq":6653,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:17.215067+0000","last_change":"2024-09-11T22:36:17.215090+0000","last_active":"2024-09-11T22:36:17.215067+0000","last_peered":"2024-09-11T22:36:17.215067+0000","last_clean":"2024-09-11T22:36:17.215067+0000","last_became_active":"2024-09-11T22:20:23.876776+0000","last_became_peered":"2024-09-11T22:20:23.876776+0000","last_unstale":"2024-09-11T22:36:17.215067+0000","last_undegraded":"2024-09-11T22:36:17.215067+0000","last_fullsized":"2024-09-11T22:36:17.215067+0000","mapping_epoch":24,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6620","last_scrub_stamp":"2024-09-11T22:36:17.214982+0000","last_deep_scrub":"28'6620","last_deep_scrub_stamp":"2024-09-11T22:36:17.214982+0000","last_clean_scrub_stamp":"2024-09-11T22:36:17.214982+0000","objects_scrubbed":0,"log_size":6320,"log_dups_size":0,"ondisk_log_size":6320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:19.333814+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29858,"num_write_kb":574080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'24","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:09.590752+0000","last_change":"2024-09-11T22:36:09.590775+0000","last_active":"2024-09-11T22:36:09.590752+0000","last_peered":"2024-09-11T22:36:09.590752+0000","last_clean":"2024-09-11T22:36:09.590752+0000","last_became_active":"2024-09-11T22:20:19.852937+0000","last_became_peered":"2024-09-11T22:20:19.852937+0000","last_unstale":"2024-09-11T22:36:09.590752+0000","last_undegraded":"2024-09-11T22:36:09.590752+0000","last_fullsized":"2024-09-11T22:36:09.590752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'24","last_scrub_stamp":"2024-09-11T22:36:09.590671+0000","last_deep_scrub":"28'24","last_deep_scrub_stamp":"2024-09-11T22:36:09.590671+0000","last_clean_scrub_stamp":"2024-09-11T22:36:09.590671+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:58.927896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'25","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:06.665150+0000","last_change":"2024-09-11T22:36:06.665172+0000","last_active":"2024-09-11T22:36:06.665150+0000","last_peered":"2024-09-11T22:36:06.665150+0000","last_clean":"2024-09-11T22:36:06.665150+0000","last_became_active":"2024-09-11T22:20:19.860690+0000","last_became_peered":"2024-09-11T22:20:19.860690+0000","last_unstale":"2024-09-11T22:36:06.665150+0000","last_undegraded":"2024-09-11T22:36:06.665150+0000","last_fullsized":"2024-09-11T22:36:06.665150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'25","last_scrub_stamp":"2024-09-11T22:36:06.665084+0000","last_deep_scrub":"28'25","last_deep_scrub_stamp":"2024-09-11T22:36:06.665084+0000","last_clean_scrub_stamp":"2024-09-11T22:36:06.665084+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:04.719957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'23","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:10.492330+0000","last_change":"2024-09-11T22:36:10.492376+0000","last_active":"2024-09-11T22:36:10.492330+0000","last_peered":"2024-09-11T22:36:10.492330+0000","last_clean":"2024-09-11T22:36:10.492330+0000","last_became_active":"2024-09-11T22:20:19.856460+0000","last_became_peered":"2024-09-11T22:20:19.856460+0000","last_unstale":"2024-09-11T22:36:10.492330+0000","last_undegraded":"2024-09-11T22:36:10.492330+0000","last_fullsized":"2024-09-11T22:36:10.492330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'23","last_scrub_stamp":"2024-09-11T22:36:10.492214+0000","last_deep_scrub":"28'23","last_deep_scrub_stamp":"2024-09-11T22:36:10.492214+0000","last_clean_scrub_stamp":"2024-09-11T22:36:10.492214+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:59.935563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'18","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:03.724026+0000","last_change":"2024-09-11T22:36:03.724047+0000","last_active":"2024-09-11T22:36:03.724026+0000","last_peered":"2024-09-11T22:36:03.724026+0000","last_clean":"2024-09-11T22:36:03.724026+0000","last_became_active":"2024-09-11T22:20:19.855363+0000","last_became_peered":"2024-09-11T22:20:19.855363+0000","last_unstale":"2024-09-11T22:36:03.724026+0000","last_undegraded":"2024-09-11T22:36:03.724026+0000","last_fullsized":"2024-09-11T22:36:03.724026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'18","last_scrub_stamp":"2024-09-11T22:36:03.723942+0000","last_deep_scrub":"28'18","last_deep_scrub_stamp":"2024-09-11T22:36:03.723942+0000","last_clean_scrub_stamp":"2024-09-11T22:36:03.723942+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:38.540303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'14","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:05.123302+0000","last_change":"2024-09-11T22:36:05.123333+0000","last_active":"2024-09-11T22:36:05.123302+0000","last_peered":"2024-09-11T22:36:05.123302+0000","last_clean":"2024-09-11T22:36:05.123302+0000","last_became_active":"2024-09-11T22:20:19.862828+0000","last_became_peered":"2024-09-11T22:20:19.862828+0000","last_unstale":"2024-09-11T22:36:05.123302+0000","last_undegraded":"2024-09-11T22:36:05.123302+0000","last_fullsized":"2024-09-11T22:36:05.123302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'14","last_scrub_stamp":"2024-09-11T22:36:05.123230+0000","last_deep_scrub":"28'14","last_deep_scrub_stamp":"2024-09-11T22:36:05.123230+0000","last_clean_scrub_stamp":"2024-09-11T22:36:05.123230+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:30.371413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'15","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:10.335529+0000","last_change":"2024-09-11T22:36:10.335549+0000","last_active":"2024-09-11T22:36:10.335529+0000","last_peered":"2024-09-11T22:36:10.335529+0000","last_clean":"2024-09-11T22:36:10.335529+0000","last_became_active":"2024-09-11T22:20:19.846186+0000","last_became_peered":"2024-09-11T22:20:19.846186+0000","last_unstale":"2024-09-11T22:36:10.335529+0000","last_undegraded":"2024-09-11T22:36:10.335529+0000","last_fullsized":"2024-09-11T22:36:10.335529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-09-11T22:36:10.335457+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-09-11T22:36:10.335457+0000","last_clean_scrub_stamp":"2024-09-11T22:36:10.335457+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:19.720830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'24","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:11.597241+0000","last_change":"2024-09-11T22:36:11.597271+0000","last_active":"2024-09-11T22:36:11.597241+0000","last_peered":"2024-09-11T22:36:11.597241+0000","last_clean":"2024-09-11T22:36:11.597241+0000","last_became_active":"2024-09-11T22:20:19.860005+0000","last_became_peered":"2024-09-11T22:20:19.860005+0000","last_unstale":"2024-09-11T22:36:11.597241+0000","last_undegraded":"2024-09-11T22:36:11.597241+0000","last_fullsized":"2024-09-11T22:36:11.597241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'24","last_scrub_stamp":"2024-09-11T22:36:11.597154+0000","last_deep_scrub":"28'24","last_deep_scrub_stamp":"2024-09-11T22:36:11.597154+0000","last_clean_scrub_stamp":"2024-09-11T22:36:11.597154+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:06.347114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'17","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:04.086315+0000","last_change":"2024-09-11T22:36:04.086336+0000","last_active":"2024-09-11T22:36:04.086315+0000","last_peered":"2024-09-11T22:36:04.086315+0000","last_clean":"2024-09-11T22:36:04.086315+0000","last_became_active":"2024-09-11T22:20:19.858832+0000","last_became_peered":"2024-09-11T22:20:19.858832+0000","last_unstale":"2024-09-11T22:36:04.086315+0000","last_undegraded":"2024-09-11T22:36:04.086315+0000","last_fullsized":"2024-09-11T22:36:04.086315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'17","last_scrub_stamp":"2024-09-11T22:36:04.086252+0000","last_deep_scrub":"28'17","last_deep_scrub_stamp":"2024-09-11T22:36:04.086252+0000","last_clean_scrub_stamp":"2024-09-11T22:36:04.086252+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:03.145629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'18","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:12.499697+0000","last_change":"2024-09-11T22:36:12.499724+0000","last_active":"2024-09-11T22:36:12.499697+0000","last_peered":"2024-09-11T22:36:12.499697+0000","last_clean":"2024-09-11T22:36:12.499697+0000","last_became_active":"2024-09-11T22:20:19.857847+0000","last_became_peered":"2024-09-11T22:20:19.857847+0000","last_unstale":"2024-09-11T22:36:12.499697+0000","last_undegraded":"2024-09-11T22:36:12.499697+0000","last_fullsized":"2024-09-11T22:36:12.499697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'18","last_scrub_stamp":"2024-09-11T22:36:12.499570+0000","last_deep_scrub":"28'18","last_deep_scrub_stamp":"2024-09-11T22:36:12.499570+0000","last_clean_scrub_stamp":"2024-09-11T22:36:12.499570+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:55.700611+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'23","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:15.206235+0000","last_change":"2024-09-11T22:36:15.206257+0000","last_active":"2024-09-11T22:36:15.206235+0000","last_peered":"2024-09-11T22:36:15.206235+0000","last_clean":"2024-09-11T22:36:15.206235+0000","last_became_active":"2024-09-11T22:20:19.863007+0000","last_became_peered":"2024-09-11T22:20:19.863007+0000","last_unstale":"2024-09-11T22:36:15.206235+0000","last_undegraded":"2024-09-11T22:36:15.206235+0000","last_fullsized":"2024-09-11T22:36:15.206235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'23","last_scrub_stamp":"2024-09-11T22:36:15.206169+0000","last_deep_scrub":"28'23","last_deep_scrub_stamp":"2024-09-11T22:36:15.206169+0000","last_clean_scrub_stamp":"2024-09-11T22:36:15.206169+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:54.861077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'23","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:11.486114+0000","last_change":"2024-09-11T22:36:11.486180+0000","last_active":"2024-09-11T22:36:11.486114+0000","last_peered":"2024-09-11T22:36:11.486114+0000","last_clean":"2024-09-11T22:36:11.486114+0000","last_became_active":"2024-09-11T22:20:19.857790+0000","last_became_peered":"2024-09-11T22:20:19.857790+0000","last_unstale":"2024-09-11T22:36:11.486114+0000","last_undegraded":"2024-09-11T22:36:11.486114+0000","last_fullsized":"2024-09-11T22:36:11.486114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'23","last_scrub_stamp":"2024-09-11T22:36:11.485986+0000","last_deep_scrub":"28'23","last_deep_scrub_stamp":"2024-09-11T22:36:11.485986+0000","last_clean_scrub_stamp":"2024-09-11T22:36:11.485986+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:02.888607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'28","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:08.631830+0000","last_change":"2024-09-11T22:36:08.631850+0000","last_active":"2024-09-11T22:36:08.631830+0000","last_peered":"2024-09-11T22:36:08.631830+0000","last_clean":"2024-09-11T22:36:08.631830+0000","last_became_active":"2024-09-11T22:21:02.034534+0000","last_became_peered":"2024-09-11T22:21:02.034534+0000","last_unstale":"2024-09-11T22:36:08.631830+0000","last_undegraded":"2024-09-11T22:36:08.631830+0000","last_fullsized":"2024-09-11T22:36:08.631830+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'28","last_scrub_stamp":"2024-09-11T22:36:08.631765+0000","last_deep_scrub":"28'28","last_deep_scrub_stamp":"2024-09-11T22:36:08.631765+0000","last_clean_scrub_stamp":"2024-09-11T22:36:08.631765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:44.130969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"28'19","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:14.577611+0000","last_change":"2024-09-11T22:36:14.577652+0000","last_active":"2024-09-11T22:36:14.577611+0000","last_peered":"2024-09-11T22:36:14.577611+0000","last_clean":"2024-09-11T22:36:14.577611+0000","last_became_active":"2024-09-11T22:20:19.862296+0000","last_became_peered":"2024-09-11T22:20:19.862296+0000","last_unstale":"2024-09-11T22:36:14.577611+0000","last_undegraded":"2024-09-11T22:36:14.577611+0000","last_fullsized":"2024-09-11T22:36:14.577611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'19","last_scrub_stamp":"2024-09-11T22:36:14.577498+0000","last_deep_scrub":"28'19","last_deep_scrub_stamp":"2024-09-11T22:36:14.577498+0000","last_clean_scrub_stamp":"2024-09-11T22:36:14.577498+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:02:45.819361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'22","reported_seq":62,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:03.658363+0000","last_change":"2024-09-11T22:36:03.658363+0000","last_active":"2024-09-11T22:36:03.658363+0000","last_peered":"2024-09-11T22:36:03.658363+0000","last_clean":"2024-09-11T22:36:03.658363+0000","last_became_active":"2024-09-11T22:20:19.854970+0000","last_became_peered":"2024-09-11T22:20:19.854970+0000","last_unstale":"2024-09-11T22:36:03.658363+0000","last_undegraded":"2024-09-11T22:36:03.658363+0000","last_fullsized":"2024-09-11T22:36:03.658363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'22","last_scrub_stamp":"2024-09-11T22:36:03.658243+0000","last_deep_scrub":"28'22","last_deep_scrub_stamp":"2024-09-11T22:36:03.658243+0000","last_clean_scrub_stamp":"2024-09-11T22:36:03.658243+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:50:45.976712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'29","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:05.684626+0000","last_change":"2024-09-11T22:36:05.684664+0000","last_active":"2024-09-11T22:36:05.684626+0000","last_peered":"2024-09-11T22:36:05.684626+0000","last_clean":"2024-09-11T22:36:05.684626+0000","last_became_active":"2024-09-11T22:20:19.849815+0000","last_became_peered":"2024-09-11T22:20:19.849815+0000","last_unstale":"2024-09-11T22:36:05.684626+0000","last_undegraded":"2024-09-11T22:36:05.684626+0000","last_fullsized":"2024-09-11T22:36:05.684626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'29","last_scrub_stamp":"2024-09-11T22:36:05.684528+0000","last_deep_scrub":"28'29","last_deep_scrub_stamp":"2024-09-11T22:36:05.684528+0000","last_clean_scrub_stamp":"2024-09-11T22:36:05.684528+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:25.845286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'21","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.057520+0000","last_change":"2024-09-11T22:20:19.866864+0000","last_active":"2024-09-11T22:35:51.057520+0000","last_peered":"2024-09-11T22:35:51.057520+0000","last_clean":"2024-09-11T22:35:51.057520+0000","last_became_active":"2024-09-11T22:20:19.866484+0000","last_became_peered":"2024-09-11T22:20:19.866484+0000","last_unstale":"2024-09-11T22:35:51.057520+0000","last_undegraded":"2024-09-11T22:35:51.057520+0000","last_fullsized":"2024-09-11T22:35:51.057520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'21","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:09.630816+0000","last_change":"2024-09-11T22:36:09.630837+0000","last_active":"2024-09-11T22:36:09.630816+0000","last_peered":"2024-09-11T22:36:09.630816+0000","last_clean":"2024-09-11T22:36:09.630816+0000","last_became_active":"2024-09-11T22:21:02.034985+0000","last_became_peered":"2024-09-11T22:21:02.034985+0000","last_unstale":"2024-09-11T22:36:09.630816+0000","last_undegraded":"2024-09-11T22:36:09.630816+0000","last_fullsized":"2024-09-11T22:36:09.630816+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'21","last_scrub_stamp":"2024-09-11T22:36:09.630747+0000","last_deep_scrub":"28'21","last_deep_scrub_stamp":"2024-09-11T22:36:09.630747+0000","last_clean_scrub_stamp":"2024-09-11T22:36:09.630747+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:58.570412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"28'21","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:12.276233+0000","last_change":"2024-09-11T22:36:12.276254+0000","last_active":"2024-09-11T22:36:12.276233+0000","last_peered":"2024-09-11T22:36:12.276233+0000","last_clean":"2024-09-11T22:36:12.276233+0000","last_became_active":"2024-09-11T22:20:19.859755+0000","last_became_peered":"2024-09-11T22:20:19.859755+0000","last_unstale":"2024-09-11T22:36:12.276233+0000","last_undegraded":"2024-09-11T22:36:12.276233+0000","last_fullsized":"2024-09-11T22:36:12.276233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'21","last_scrub_stamp":"2024-09-11T22:36:12.276168+0000","last_deep_scrub":"28'21","last_deep_scrub_stamp":"2024-09-11T22:36:12.276168+0000","last_clean_scrub_stamp":"2024-09-11T22:36:12.276168+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:02.517435+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'24","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:02.738803+0000","last_change":"2024-09-11T22:36:02.738842+0000","last_active":"2024-09-11T22:36:02.738803+0000","last_peered":"2024-09-11T22:36:02.738803+0000","last_clean":"2024-09-11T22:36:02.738803+0000","last_became_active":"2024-09-11T22:20:19.853563+0000","last_became_peered":"2024-09-11T22:20:19.853563+0000","last_unstale":"2024-09-11T22:36:02.738803+0000","last_undegraded":"2024-09-11T22:36:02.738803+0000","last_fullsized":"2024-09-11T22:36:02.738803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'24","last_scrub_stamp":"2024-09-11T22:36:02.738691+0000","last_deep_scrub":"28'24","last_deep_scrub_stamp":"2024-09-11T22:36:02.738691+0000","last_clean_scrub_stamp":"2024-09-11T22:36:02.738691+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:48.445069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'25","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:11.182870+0000","last_change":"2024-09-11T22:36:11.182911+0000","last_active":"2024-09-11T22:36:11.182870+0000","last_peered":"2024-09-11T22:36:11.182870+0000","last_clean":"2024-09-11T22:36:11.182870+0000","last_became_active":"2024-09-11T22:20:19.848965+0000","last_became_peered":"2024-09-11T22:20:19.848965+0000","last_unstale":"2024-09-11T22:36:11.182870+0000","last_undegraded":"2024-09-11T22:36:11.182870+0000","last_fullsized":"2024-09-11T22:36:11.182870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'25","last_scrub_stamp":"2024-09-11T22:36:11.182786+0000","last_deep_scrub":"28'25","last_deep_scrub_stamp":"2024-09-11T22:36:11.182786+0000","last_clean_scrub_stamp":"2024-09-11T22:36:11.182786+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:03.323701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'17","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:08.068145+0000","last_change":"2024-09-11T22:36:08.068169+0000","last_active":"2024-09-11T22:36:08.068145+0000","last_peered":"2024-09-11T22:36:08.068145+0000","last_clean":"2024-09-11T22:36:08.068145+0000","last_became_active":"2024-09-11T22:20:19.858887+0000","last_became_peered":"2024-09-11T22:20:19.858887+0000","last_unstale":"2024-09-11T22:36:08.068145+0000","last_undegraded":"2024-09-11T22:36:08.068145+0000","last_fullsized":"2024-09-11T22:36:08.068145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'17","last_scrub_stamp":"2024-09-11T22:36:08.068061+0000","last_deep_scrub":"28'17","last_deep_scrub_stamp":"2024-09-11T22:36:08.068061+0000","last_clean_scrub_stamp":"2024-09-11T22:36:08.068061+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:44.189012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'18","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:13.569008+0000","last_change":"2024-09-11T22:36:13.569033+0000","last_active":"2024-09-11T22:36:13.569008+0000","last_peered":"2024-09-11T22:36:13.569008+0000","last_clean":"2024-09-11T22:36:13.569008+0000","last_became_active":"2024-09-11T22:20:19.861965+0000","last_became_peered":"2024-09-11T22:20:19.861965+0000","last_unstale":"2024-09-11T22:36:13.569008+0000","last_undegraded":"2024-09-11T22:36:13.569008+0000","last_fullsized":"2024-09-11T22:36:13.569008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'18","last_scrub_stamp":"2024-09-11T22:36:13.568922+0000","last_deep_scrub":"28'18","last_deep_scrub_stamp":"2024-09-11T22:36:13.568922+0000","last_clean_scrub_stamp":"2024-09-11T22:36:13.568922+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:12.067043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'29","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:12.611370+0000","last_change":"2024-09-11T22:36:12.611395+0000","last_active":"2024-09-11T22:36:12.611370+0000","last_peered":"2024-09-11T22:36:12.611370+0000","last_clean":"2024-09-11T22:36:12.611370+0000","last_became_active":"2024-09-11T22:20:19.861765+0000","last_became_peered":"2024-09-11T22:20:19.861765+0000","last_unstale":"2024-09-11T22:36:12.611370+0000","last_undegraded":"2024-09-11T22:36:12.611370+0000","last_fullsized":"2024-09-11T22:36:12.611370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'29","last_scrub_stamp":"2024-09-11T22:36:12.611266+0000","last_deep_scrub":"28'29","last_deep_scrub_stamp":"2024-09-11T22:36:12.611266+0000","last_clean_scrub_stamp":"2024-09-11T22:36:12.611266+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:43.805844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'27","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:35:51.062958+0000","last_change":"2024-09-11T22:20:19.865064+0000","last_active":"2024-09-11T22:35:51.062958+0000","last_peered":"2024-09-11T22:35:51.062958+0000","last_clean":"2024-09-11T22:35:51.062958+0000","last_became_active":"2024-09-11T22:20:19.864697+0000","last_became_peered":"2024-09-11T22:20:19.864697+0000","last_unstale":"2024-09-11T22:35:51.062958+0000","last_undegraded":"2024-09-11T22:35:51.062958+0000","last_fullsized":"2024-09-11T22:35:51.062958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T22:20:18.828308+0000","last_clean_scrub_stamp":"2024-09-11T22:20:18.828308+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'14","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:03.058447+0000","last_change":"2024-09-11T22:36:03.058485+0000","last_active":"2024-09-11T22:36:03.058447+0000","last_peered":"2024-09-11T22:36:03.058447+0000","last_clean":"2024-09-11T22:36:03.058447+0000","last_became_active":"2024-09-11T22:20:19.861013+0000","last_became_peered":"2024-09-11T22:20:19.861013+0000","last_unstale":"2024-09-11T22:36:03.058447+0000","last_undegraded":"2024-09-11T22:36:03.058447+0000","last_fullsized":"2024-09-11T22:36:03.058447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'14","last_scrub_stamp":"2024-09-11T22:36:03.058371+0000","last_deep_scrub":"28'14","last_deep_scrub_stamp":"2024-09-11T22:36:03.058371+0000","last_clean_scrub_stamp":"2024-09-11T22:36:03.058371+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:26.218935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'14","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:13.539219+0000","last_change":"2024-09-11T22:36:13.539252+0000","last_active":"2024-09-11T22:36:13.539219+0000","last_peered":"2024-09-11T22:36:13.539219+0000","last_clean":"2024-09-11T22:36:13.539219+0000","last_became_active":"2024-09-11T22:20:19.857842+0000","last_became_peered":"2024-09-11T22:20:19.857842+0000","last_unstale":"2024-09-11T22:36:13.539219+0000","last_undegraded":"2024-09-11T22:36:13.539219+0000","last_fullsized":"2024-09-11T22:36:13.539219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'14","last_scrub_stamp":"2024-09-11T22:36:13.539138+0000","last_deep_scrub":"28'14","last_deep_scrub_stamp":"2024-09-11T22:36:13.539138+0000","last_clean_scrub_stamp":"2024-09-11T22:36:13.539138+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:26.910048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'16","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:03.600370+0000","last_change":"2024-09-11T22:36:03.600412+0000","last_active":"2024-09-11T22:36:03.600370+0000","last_peered":"2024-09-11T22:36:03.600370+0000","last_clean":"2024-09-11T22:36:03.600370+0000","last_became_active":"2024-09-11T22:20:19.859306+0000","last_became_peered":"2024-09-11T22:20:19.859306+0000","last_unstale":"2024-09-11T22:36:03.600370+0000","last_undegraded":"2024-09-11T22:36:03.600370+0000","last_fullsized":"2024-09-11T22:36:03.600370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'16","last_scrub_stamp":"2024-09-11T22:36:03.600236+0000","last_deep_scrub":"28'16","last_deep_scrub_stamp":"2024-09-11T22:36:03.600236+0000","last_clean_scrub_stamp":"2024-09-11T22:36:03.600236+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:31.528340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'19","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:11.564060+0000","last_change":"2024-09-11T22:36:11.564112+0000","last_active":"2024-09-11T22:36:11.564060+0000","last_peered":"2024-09-11T22:36:11.564060+0000","last_clean":"2024-09-11T22:36:11.564060+0000","last_became_active":"2024-09-11T22:20:19.848531+0000","last_became_peered":"2024-09-11T22:20:19.848531+0000","last_unstale":"2024-09-11T22:36:11.564060+0000","last_undegraded":"2024-09-11T22:36:11.564060+0000","last_fullsized":"2024-09-11T22:36:11.564060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'19","last_scrub_stamp":"2024-09-11T22:36:11.563965+0000","last_deep_scrub":"28'19","last_deep_scrub_stamp":"2024-09-11T22:36:11.563965+0000","last_clean_scrub_stamp":"2024-09-11T22:36:11.563965+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:02:42.805827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'15","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:15.508096+0000","last_change":"2024-09-11T22:36:15.508131+0000","last_active":"2024-09-11T22:36:15.508096+0000","last_peered":"2024-09-11T22:36:15.508096+0000","last_clean":"2024-09-11T22:36:15.508096+0000","last_became_active":"2024-09-11T22:20:19.865939+0000","last_became_peered":"2024-09-11T22:20:19.865939+0000","last_unstale":"2024-09-11T22:36:15.508096+0000","last_undegraded":"2024-09-11T22:36:15.508096+0000","last_fullsized":"2024-09-11T22:36:15.508096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-09-11T22:36:15.507992+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-09-11T22:36:15.507992+0000","last_clean_scrub_stamp":"2024-09-11T22:36:15.507992+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:02.639696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'19","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:06.672282+0000","last_change":"2024-09-11T22:36:06.672303+0000","last_active":"2024-09-11T22:36:06.672282+0000","last_peered":"2024-09-11T22:36:06.672282+0000","last_clean":"2024-09-11T22:36:06.672282+0000","last_became_active":"2024-09-11T22:20:19.857840+0000","last_became_peered":"2024-09-11T22:20:19.857840+0000","last_unstale":"2024-09-11T22:36:06.672282+0000","last_undegraded":"2024-09-11T22:36:06.672282+0000","last_fullsized":"2024-09-11T22:36:06.672282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'19","last_scrub_stamp":"2024-09-11T22:36:06.672216+0000","last_deep_scrub":"28'19","last_deep_scrub_stamp":"2024-09-11T22:36:06.672216+0000","last_clean_scrub_stamp":"2024-09-11T22:36:06.672216+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:50.525165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'10","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:11.320268+0000","last_change":"2024-09-11T22:36:11.320290+0000","last_active":"2024-09-11T22:36:11.320268+0000","last_peered":"2024-09-11T22:36:11.320268+0000","last_clean":"2024-09-11T22:36:11.320268+0000","last_became_active":"2024-09-11T22:20:19.857089+0000","last_became_peered":"2024-09-11T22:20:19.857089+0000","last_unstale":"2024-09-11T22:36:11.320268+0000","last_undegraded":"2024-09-11T22:36:11.320268+0000","last_fullsized":"2024-09-11T22:36:11.320268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-09-11T22:36:11.320197+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-09-11T22:36:11.320197+0000","last_clean_scrub_stamp":"2024-09-11T22:36:11.320197+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:33.646313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'16","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:10.646381+0000","last_change":"2024-09-11T22:36:10.646402+0000","last_active":"2024-09-11T22:36:10.646381+0000","last_peered":"2024-09-11T22:36:10.646381+0000","last_clean":"2024-09-11T22:36:10.646381+0000","last_became_active":"2024-09-11T22:21:02.035889+0000","last_became_peered":"2024-09-11T22:21:02.035889+0000","last_unstale":"2024-09-11T22:36:10.646381+0000","last_undegraded":"2024-09-11T22:36:10.646381+0000","last_fullsized":"2024-09-11T22:36:10.646381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'16","last_scrub_stamp":"2024-09-11T22:36:10.646315+0000","last_deep_scrub":"28'16","last_deep_scrub_stamp":"2024-09-11T22:36:10.646315+0000","last_clean_scrub_stamp":"2024-09-11T22:36:10.646315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:38.574419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":877619,"num_write_kb":16615339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":191481,"ondisk_log_size":191481,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1274,"ondisk_log_size":1274,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":15005355,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":45,"num_read_kb":122,"num_write":3042,"num_write_kb":15742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18276352,"data_stored":30010710,"data_compressed":2661454,"data_compressed_allocated":3686400,"data_compressed_original":15572992,"omap_allocated":0,"internal_metadata":0},"log_size":2750,"ondisk_log_size":2750,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509636,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":969956,"kb_used_data":7316,"kb_used_omap":1,"kb_used_meta":962622,"kb_avail":93401884,"statfs":{"total":96636764160,"available":95643529216,"internally_reserved":0,"allocated":7491584,"data_stored":11425803,"data_compressed":849965,"data_compressed_allocated":1200128,"data_compressed_original":5332992,"omap_allocated":1590,"internal_metadata":985725386},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509637,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1137376,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":1135230,"kb_avail":93234464,"statfs":{"total":96636764160,"available":95472091136,"internally_reserved":0,"allocated":2179072,"data_stored":4317172,"data_compressed":509786,"data_compressed_allocated":684032,"data_compressed_original":3010560,"omap_allocated":1594,"internal_metadata":1162475974},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509638,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":763716,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":763390,"kb_avail":93608124,"statfs":{"total":96636764160,"available":95854718976,"internally_reserved":0,"allocated":315392,"data_stored":122896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":781711813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509637,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1079244,"kb_used_data":3772,"kb_used_omap":1,"kb_used_meta":1075454,"kb_avail":93292596,"statfs":{"total":96636764160,"available":95531618304,"internally_reserved":0,"allocated":3862528,"data_stored":4316536,"data_compressed":162063,"data_compressed_allocated":282624,"data_compressed_original":925696,"omap_allocated":1595,"internal_metadata":1101265349},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509635,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1425948,"kb_used_data":4620,"kb_used_omap":1,"kb_used_meta":1421310,"kb_avail":92945892,"statfs":{"total":96636764160,"available":95176593408,"internally_reserved":0,"allocated":4730880,"data_stored":8606262,"data_compressed":892093,"data_compressed_allocated":1200128,"data_compressed_original":5267456,"omap_allocated":1593,"internal_metadata":1455421895},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542341,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":868180,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":867774,"kb_avail":93503660,"statfs":{"total":96636764160,"available":95747747840,"internally_reserved":0,"allocated":397312,"data_stored":216504,"data_compressed":3390,"data_compressed_allocated":4096,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":888601029},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542341,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1045612,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":1044158,"kb_avail":93326228,"statfs":{"total":96636764160,"available":95566057472,"internally_reserved":0,"allocated":1470464,"data_stored":3035955,"data_compressed":308985,"data_compressed_allocated":405504,"data_compressed_original":2166784,"omap_allocated":1595,"internal_metadata":1069218245},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575045,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1374984,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":1374654,"kb_avail":92996856,"statfs":{"total":96636764160,"available":95228780544,"internally_reserved":0,"allocated":319488,"data_stored":122462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1407646149},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1110016,"data_stored":2324069,"data_compressed":276571,"data_compressed_allocated":360448,"data_compressed_original":1593344,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":94986,"data_compressed":3390,"data_compressed_allocated":4096,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4435968,"data_stored":8484744,"data_compressed":892093,"data_compressed_allocated":1200128,"data_compressed_original":5267456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3567616,"data_stored":4195018,"data_compressed":162063,"data_compressed_allocated":282624,"data_compressed_original":925696,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1884160,"data_stored":4195654,"data_compressed":509786,"data_compressed_allocated":684032,"data_compressed_original":3010560,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7131136,"data_stored":10713917,"data_compressed":817551,"data_compressed_allocated":1155072,"data_compressed_original":4759552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:36:24.279 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:24.280 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:24.280 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:24.280 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:24.281 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:24.281 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:24.281 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-11T22:20:22.853906+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=22, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:24.281 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:24.282 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-11T22:20:18.828308+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=20, tm_sec=18, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=22, tm_min=35, tm_sec=59, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T22:36:24.282 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T22:36:44.283 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T22:36:44.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.383+0000 7fbbc3c96640 1 Processor -- start 2024-09-11T22:36:44.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.383+0000 7fbbc3c96640 1 -- start start 2024-09-11T22:36:44.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.384+0000 7fbbc3c96640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbbc0c8a70 0x7fbbbc06e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:44.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.384+0000 7fbbc3c96640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbbbc0c8250 0x7fbbbc0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:44.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.384+0000 7fbbc3c96640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbbc0c9a10 con 0x7fbbbc1527d0 2024-09-11T22:36:44.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.384+0000 7fbbc3c96640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fbbbc0c5080 con 0x7fbbbc0c8250 2024-09-11T22:36:44.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.384+0000 7fbbc3c96640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbbbc0ca3b0 con 0x7fbbbc0c8a70 2024-09-11T22:36:44.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.384+0000 7fbbc1a32640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fbbbc1527d0 0x7fbbbc0c9300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58958/0 (socket says 172.21.15.100:58958) 2024-09-11T22:36:44.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.384+0000 7fbbc1a32640 1 -- 172.21.15.100:0/3155438722 learned_addr learned my addr 172.21.15.100:0/3155438722 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:36:44.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.384+0000 7fbbc2233640 1 --2- 172.21.15.100:0/3155438722 >> v2:172.21.15.100:3300/0 conn(0x7fbbbc0c8250 0x7fbbbc0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:44.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.384+0000 7fbbc1231640 1 --2- 172.21.15.100:0/3155438722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbbc0c8a70 0x7fbbbc06e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:44.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.384+0000 7fbbc2233640 1 -- 172.21.15.100:0/3155438722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbbc0c8a70 msgr2=0x7fbbbc06e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:44.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.384+0000 7fbbc2233640 1 --2- 172.21.15.100:0/3155438722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbbc0c8a70 0x7fbbbc06e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:44.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.384+0000 7fbbc2233640 1 -- 172.21.15.100:0/3155438722 >> v1:172.21.15.100:6789/0 conn(0x7fbbbc1527d0 legacy=0x7fbbbc0c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:44.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.384+0000 7fbbc2233640 1 -- 172.21.15.100:0/3155438722 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbbc0ca690 con 0x7fbbbc0c8250 2024-09-11T22:36:44.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.384+0000 7fbbc0a30640 1 -- 172.21.15.100:0/3155438722 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1360741397 0 0) 0x7fbbbc0c9a10 con 0x7fbbbc1527d0 2024-09-11T22:36:44.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.385+0000 7fbbc2233640 1 --2- 172.21.15.100:0/3155438722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbbc0c8250 0x7fbbbc0cab00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009d90 tx=0x7fbbb402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18705d789050090d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:44.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.385+0000 7fbbc0a30640 1 -- 172.21.15.100:0/3155438722 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4007740 con 0x7fbbbc0c8250 2024-09-11T22:36:44.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.386+0000 7fbbc0a30640 1 -- 172.21.15.100:0/3155438722 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb40078e0 con 0x7fbbbc0c8250 2024-09-11T22:36:44.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.386+0000 7fbbc0a30640 1 -- 172.21.15.100:0/3155438722 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4007cb0 con 0x7fbbbc0c8250 2024-09-11T22:36:44.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.386+0000 7fbbc3c96640 1 -- 172.21.15.100:0/3155438722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbbc0c8250 msgr2=0x7fbbbc0cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:44.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.386+0000 7fbbc3c96640 1 --2- 172.21.15.100:0/3155438722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbbc0c8250 0x7fbbbc0cab00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009d90 tx=0x7fbbb402a660 comp rx=0 tx=0).stop 2024-09-11T22:36:44.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.386+0000 7fbbc3c96640 1 -- 172.21.15.100:0/3155438722 shutdown_connections 2024-09-11T22:36:44.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.386+0000 7fbbc3c96640 1 --2- 172.21.15.100:0/3155438722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbbc0c8250 0x7fbbbc0cab00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:44.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.386+0000 7fbbc3c96640 1 --2- 172.21.15.100:0/3155438722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbbc0c8a70 0x7fbbbc06e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:44.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.386+0000 7fbbc3c96640 1 -- 172.21.15.100:0/3155438722 >> 172.21.15.100:0/3155438722 conn(0x7fbbbc073900 msgr2=0x7fbbbc073ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:44.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.386+0000 7fbbc3c96640 1 -- 172.21.15.100:0/3155438722 shutdown_connections 2024-09-11T22:36:44.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.386+0000 7fbbc3c96640 1 -- 172.21.15.100:0/3155438722 wait complete. 2024-09-11T22:36:44.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.387+0000 7fbbc3c96640 1 Processor -- start 2024-09-11T22:36:44.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.387+0000 7fbbc3c96640 1 -- start start 2024-09-11T22:36:44.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.388+0000 7fbbc3c96640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbbc0c8250 0x7fbbbc15c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:44.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.388+0000 7fbbc3c96640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbbbc0c8a70 0x7fbbbc0cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:44.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.388+0000 7fbbc3c96640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbbc1527d0 0x7fbbbc1545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:44.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.388+0000 7fbbc3c96640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc152d30 con 0x7fbbbc0c8250 2024-09-11T22:36:44.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.388+0000 7fbbc3c96640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbbbc152bb0 con 0x7fbbbc0c8a70 2024-09-11T22:36:44.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.388+0000 7fbbc3c96640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fbbbc0cb040 con 0x7fbbbc1527d0 2024-09-11T22:36:44.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.388+0000 7fbbc1a32640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbbc0c8250 0x7fbbbc15c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:44.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.388+0000 7fbbc1a32640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbbc0c8250 0x7fbbbc15c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45084/0 (socket says 172.21.15.100:45084) 2024-09-11T22:36:44.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.388+0000 7fbbc1a32640 1 -- 172.21.15.100:0/3586001229 learned_addr learned my addr 172.21.15.100:0/3586001229 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:44.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.388+0000 7fbbc1231640 1 --2- 172.21.15.100:0/3586001229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbbbc0c8a70 0x7fbbbc0cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:44.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.388+0000 7fbbc2233640 1 --2- 172.21.15.100:0/3586001229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbbc1527d0 0x7fbbbc1545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:44.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.388+0000 7fbbc1a32640 1 -- 172.21.15.100:0/3586001229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbbc1527d0 msgr2=0x7fbbbc1545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:44.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.388+0000 7fbbc1a32640 1 --2- 172.21.15.100:0/3586001229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbbc1527d0 0x7fbbbc1545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:44.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.388+0000 7fbbc1a32640 1 -- 172.21.15.100:0/3586001229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbbbc0c8a70 msgr2=0x7fbbbc0cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:44.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.388+0000 7fbbc1a32640 1 --2- 172.21.15.100:0/3586001229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbbbc0c8a70 0x7fbbbc0cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:44.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.388+0000 7fbbc1a32640 1 -- 172.21.15.100:0/3586001229 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbbc1f0eb0 con 0x7fbbbc0c8250 2024-09-11T22:36:44.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.388+0000 7fbbc1231640 1 --2- 172.21.15.100:0/3586001229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbbbc0c8a70 0x7fbbbc0cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:44.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.389+0000 7fbbc1a32640 1 --2- 172.21.15.100:0/3586001229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbbc0c8250 0x7fbbbc15c6f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000c460 tx=0x7fbbb000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:44.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.389+0000 7fbbae7fc640 1 -- 172.21.15.100:0/3586001229 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0018070 con 0x7fbbbc0c8250 2024-09-11T22:36:44.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.389+0000 7fbbae7fc640 1 -- 172.21.15.100:0/3586001229 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb0007500 con 0x7fbbbc0c8250 2024-09-11T22:36:44.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.389+0000 7fbbae7fc640 1 -- 172.21.15.100:0/3586001229 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0004a20 con 0x7fbbbc0c8250 2024-09-11T22:36:44.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.389+0000 7fbbc3c96640 1 -- 172.21.15.100:0/3586001229 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbbc0cdd00 con 0x7fbbbc0c8250 2024-09-11T22:36:44.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.389+0000 7fbbc3c96640 1 -- 172.21.15.100:0/3586001229 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbbc1f0610 con 0x7fbbbc0c8250 2024-09-11T22:36:44.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.390+0000 7fbbc3c96640 1 -- 172.21.15.100:0/3586001229 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbbc14fff0 con 0x7fbbbc0c8250 2024-09-11T22:36:44.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.390+0000 7fbbae7fc640 1 -- 172.21.15.100:0/3586001229 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbbb001b070 con 0x7fbbbc0c8250 2024-09-11T22:36:44.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.391+0000 7fbbae7fc640 1 --2- 172.21.15.100:0/3586001229 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbba006be30 0x7fbba006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:44.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.391+0000 7fbbae7fc640 1 -- 172.21.15.100:0/3586001229 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fbbb008a530 con 0x7fbbbc0c8250 2024-09-11T22:36:44.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.391+0000 7fbbc1231640 1 --2- 172.21.15.100:0/3586001229 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbba006be30 0x7fbba006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:44.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.391+0000 7fbbc1231640 1 --2- 172.21.15.100:0/3586001229 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbba006be30 0x7fbba006e2f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc150800 tx=0x7fbbb8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:44.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.399+0000 7fbbae7fc640 1 -- 172.21.15.100:0/3586001229 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbbbc14fff0 con 0x7fbbbc0c8250 2024-09-11T22:36:44.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.584+0000 7fbbc3c96640 1 -- 172.21.15.100:0/3586001229 --> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbbbc0cab00 con 0x7fbba006be30 2024-09-11T22:36:44.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.591+0000 7fbbae7fc640 1 -- 172.21.15.100:0/3586001229 <== mgr.4101 v2:172.21.15.100:6832/1748304473 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334738 (secure 0 0 0) 0x7fbbbc0cab00 con 0x7fbba006be30 2024-09-11T22:36:44.596 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:36:44.598 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-09-11T22:36:44.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.595+0000 7fbbc3c96640 1 -- 172.21.15.100:0/3586001229 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbba006be30 msgr2=0x7fbba006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:44.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.595+0000 7fbbc3c96640 1 --2- 172.21.15.100:0/3586001229 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbba006be30 0x7fbba006e2f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc150800 tx=0x7fbbb8008040 comp rx=0 tx=0).stop 2024-09-11T22:36:44.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.595+0000 7fbbc3c96640 1 -- 172.21.15.100:0/3586001229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbbc0c8250 msgr2=0x7fbbbc15c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:44.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.595+0000 7fbbc3c96640 1 --2- 172.21.15.100:0/3586001229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbbc0c8250 0x7fbbbc15c6f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000c460 tx=0x7fbbb000c920 comp rx=0 tx=0).stop 2024-09-11T22:36:44.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.595+0000 7fbbc3c96640 1 -- 172.21.15.100:0/3586001229 shutdown_connections 2024-09-11T22:36:44.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.595+0000 7fbbc3c96640 1 --2- 172.21.15.100:0/3586001229 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fbba006be30 0x7fbba006e2f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:44.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.595+0000 7fbbc3c96640 1 --2- 172.21.15.100:0/3586001229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbbc1527d0 0x7fbbbc1545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:44.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.595+0000 7fbbc3c96640 1 --2- 172.21.15.100:0/3586001229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbbbc0c8a70 0x7fbbbc0cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:44.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.595+0000 7fbbc3c96640 1 --2- 172.21.15.100:0/3586001229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbbc0c8250 0x7fbbbc15c6f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:44.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.595+0000 7fbbc3c96640 1 -- 172.21.15.100:0/3586001229 >> 172.21.15.100:0/3586001229 conn(0x7fbbbc073900 msgr2=0x7fbbbc0c7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:44.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.595+0000 7fbbc3c96640 1 -- 172.21.15.100:0/3586001229 shutdown_connections 2024-09-11T22:36:44.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.595+0000 7fbbc3c96640 1 -- 172.21.15.100:0/3586001229 wait complete. 2024-09-11T22:36:44.607 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":521,"stamp":"2024-09-11T22:36:44.579892+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":15595723,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":161,"num_read_kb":222,"num_write":880820,"num_write_kb":16633497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195624,"ondisk_log_size":195624,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8665016,"kb_used_data":20280,"kb_used_omap":12,"kb_used_meta":8644595,"kb_avail":746309704,"statfs":{"total":773094113280,"available":764221136896,"internally_reserved":0,"allocated":20766720,"data_stored":32163590,"data_compressed":2726282,"data_compressed_allocated":3776512,"data_compressed_original":16719872,"omap_allocated":12752,"internal_metadata":8852065840},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002366"},"pg_stats":[{"pgid":"2.1f","version":"28'180","reported_seq":222,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:01.759409+0000","last_change":"2024-09-11T22:36:01.759440+0000","last_active":"2024-09-11T22:36:01.759409+0000","last_peered":"2024-09-11T22:36:01.759409+0000","last_clean":"2024-09-11T22:36:01.759409+0000","last_became_active":"2024-09-11T22:20:18.852740+0000","last_became_peered":"2024-09-11T22:20:18.852740+0000","last_unstale":"2024-09-11T22:36:01.759409+0000","last_undegraded":"2024-09-11T22:36:01.759409+0000","last_fullsized":"2024-09-11T22:36:01.759409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'180","last_scrub_stamp":"2024-09-11T22:36:01.759349+0000","last_deep_scrub":"28'180","last_deep_scrub_stamp":"2024-09-11T22:36:01.759349+0000","last_clean_scrub_stamp":"2024-09-11T22:36:01.759349+0000","objects_scrubbed":5,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:29.687454+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2323991,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":175,"num_write_kb":2359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'9","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:12.227571+0000","last_change":"2024-09-11T22:36:12.227571+0000","last_active":"2024-09-11T22:36:12.227571+0000","last_peered":"2024-09-11T22:36:12.227571+0000","last_clean":"2024-09-11T22:36:12.227571+0000","last_became_active":"2024-09-11T22:20:19.848619+0000","last_became_peered":"2024-09-11T22:20:19.848619+0000","last_unstale":"2024-09-11T22:36:12.227571+0000","last_undegraded":"2024-09-11T22:36:12.227571+0000","last_fullsized":"2024-09-11T22:36:12.227571+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-11T22:36:12.227438+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-11T22:36:12.227438+0000","last_clean_scrub_stamp":"2024-09-11T22:36:12.227438+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:28.649486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"28'6890","reported_seq":6923,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:21.253353+0000","last_change":"2024-09-11T22:36:21.253398+0000","last_active":"2024-09-11T22:36:21.253353+0000","last_peered":"2024-09-11T22:36:21.253353+0000","last_clean":"2024-09-11T22:36:21.253353+0000","last_became_active":"2024-09-11T22:20:24.078283+0000","last_became_peered":"2024-09-11T22:20:24.078283+0000","last_unstale":"2024-09-11T22:36:21.253353+0000","last_undegraded":"2024-09-11T22:36:21.253353+0000","last_fullsized":"2024-09-11T22:36:21.253353+0000","mapping_epoch":24,"log_start":"28'603","ondisk_log_start":"28'603","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6890","last_scrub_stamp":"2024-09-11T22:36:21.253219+0000","last_deep_scrub":"28'6890","last_deep_scrub_stamp":"2024-09-11T22:36:21.253219+0000","last_clean_scrub_stamp":"2024-09-11T22:36:21.253219+0000","objects_scrubbed":0,"log_size":6287,"log_dups_size":0,"ondisk_log_size":6287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:31.137010+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31450,"num_write_kb":560141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"28'9","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:09.183009+0000","last_change":"2024-09-11T22:36:09.183009+0000","last_active":"2024-09-11T22:36:09.183009+0000","last_peered":"2024-09-11T22:36:09.183009+0000","last_clean":"2024-09-11T22:36:09.183009+0000","last_became_active":"2024-09-11T22:20:18.854811+0000","last_became_peered":"2024-09-11T22:20:18.854811+0000","last_unstale":"2024-09-11T22:36:09.183009+0000","last_undegraded":"2024-09-11T22:36:09.183009+0000","last_fullsized":"2024-09-11T22:36:09.183009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-11T22:36:09.182868+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-11T22:36:09.182868+0000","last_clean_scrub_stamp":"2024-09-11T22:36:09.182868+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:41:38.454367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'21","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:09.689421+0000","last_change":"2024-09-11T22:36:09.689443+0000","last_active":"2024-09-11T22:36:09.689421+0000","last_peered":"2024-09-11T22:36:09.689421+0000","last_clean":"2024-09-11T22:36:09.689421+0000","last_became_active":"2024-09-11T22:20:19.862061+0000","last_became_peered":"2024-09-11T22:20:19.862061+0000","last_unstale":"2024-09-11T22:36:09.689421+0000","last_undegraded":"2024-09-11T22:36:09.689421+0000","last_fullsized":"2024-09-11T22:36:09.689421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'21","last_scrub_stamp":"2024-09-11T22:36:09.689357+0000","last_deep_scrub":"28'21","last_deep_scrub_stamp":"2024-09-11T22:36:09.689357+0000","last_clean_scrub_stamp":"2024-09-11T22:36:09.689357+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:05.969343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"28'6406","reported_seq":6439,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:14.170649+0000","last_change":"2024-09-11T22:36:14.170676+0000","last_active":"2024-09-11T22:36:14.170649+0000","last_peered":"2024-09-11T22:36:14.170649+0000","last_clean":"2024-09-11T22:36:14.170649+0000","last_became_active":"2024-09-11T22:20:23.879245+0000","last_became_peered":"2024-09-11T22:20:23.879245+0000","last_unstale":"2024-09-11T22:36:14.170649+0000","last_undegraded":"2024-09-11T22:36:14.170649+0000","last_fullsized":"2024-09-11T22:36:14.170649+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6406","last_scrub_stamp":"2024-09-11T22:36:14.170541+0000","last_deep_scrub":"28'6406","last_deep_scrub_stamp":"2024-09-11T22:36:14.170541+0000","last_clean_scrub_stamp":"2024-09-11T22:36:14.170541+0000","objects_scrubbed":0,"log_size":6406,"log_dups_size":0,"ondisk_log_size":6406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:02:45.412404+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28787,"num_write_kb":536913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'15","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:05.582600+0000","last_change":"2024-09-11T22:36:05.582632+0000","last_active":"2024-09-11T22:36:05.582600+0000","last_peered":"2024-09-11T22:36:05.582600+0000","last_clean":"2024-09-11T22:36:05.582600+0000","last_became_active":"2024-09-11T22:20:18.852728+0000","last_became_peered":"2024-09-11T22:20:18.852728+0000","last_unstale":"2024-09-11T22:36:05.582600+0000","last_undegraded":"2024-09-11T22:36:05.582600+0000","last_fullsized":"2024-09-11T22:36:05.582600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-09-11T22:36:05.582514+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-09-11T22:36:05.582514+0000","last_clean_scrub_stamp":"2024-09-11T22:36:05.582514+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:41.703465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'17","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:14.469943+0000","last_change":"2024-09-11T22:36:14.469995+0000","last_active":"2024-09-11T22:36:14.469943+0000","last_peered":"2024-09-11T22:36:14.469943+0000","last_clean":"2024-09-11T22:36:14.469943+0000","last_became_active":"2024-09-11T22:20:19.864234+0000","last_became_peered":"2024-09-11T22:20:19.864234+0000","last_unstale":"2024-09-11T22:36:14.469943+0000","last_undegraded":"2024-09-11T22:36:14.469943+0000","last_fullsized":"2024-09-11T22:36:14.469943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'17","last_scrub_stamp":"2024-09-11T22:36:14.469836+0000","last_deep_scrub":"28'17","last_deep_scrub_stamp":"2024-09-11T22:36:14.469836+0000","last_clean_scrub_stamp":"2024-09-11T22:36:14.469836+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:46.249026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"28'5642","reported_seq":5675,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:09.130374+0000","last_change":"2024-09-11T22:36:09.130419+0000","last_active":"2024-09-11T22:36:09.130374+0000","last_peered":"2024-09-11T22:36:09.130374+0000","last_clean":"2024-09-11T22:36:09.130374+0000","last_became_active":"2024-09-11T22:20:23.873385+0000","last_became_peered":"2024-09-11T22:20:23.873385+0000","last_unstale":"2024-09-11T22:36:09.130374+0000","last_undegraded":"2024-09-11T22:36:09.130374+0000","last_fullsized":"2024-09-11T22:36:09.130374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5642","last_scrub_stamp":"2024-09-11T22:36:09.130232+0000","last_deep_scrub":"28'5642","last_deep_scrub_stamp":"2024-09-11T22:36:09.130232+0000","last_clean_scrub_stamp":"2024-09-11T22:36:09.130232+0000","objects_scrubbed":0,"log_size":5642,"log_dups_size":0,"ondisk_log_size":5642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:58.467457+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24462,"num_write_kb":498902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'4","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:10.515581+0000","last_change":"2024-09-11T22:36:10.515611+0000","last_active":"2024-09-11T22:36:10.515581+0000","last_peered":"2024-09-11T22:36:10.515581+0000","last_clean":"2024-09-11T22:36:10.515581+0000","last_became_active":"2024-09-11T22:20:18.861230+0000","last_became_peered":"2024-09-11T22:20:18.861230+0000","last_unstale":"2024-09-11T22:36:10.515581+0000","last_undegraded":"2024-09-11T22:36:10.515581+0000","last_fullsized":"2024-09-11T22:36:10.515581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-11T22:36:10.515497+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-11T22:36:10.515497+0000","last_clean_scrub_stamp":"2024-09-11T22:36:10.515497+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:09.013618+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'27","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:13.489341+0000","last_change":"2024-09-11T22:36:13.489381+0000","last_active":"2024-09-11T22:36:13.489341+0000","last_peered":"2024-09-11T22:36:13.489341+0000","last_clean":"2024-09-11T22:36:13.489341+0000","last_became_active":"2024-09-11T22:20:19.863127+0000","last_became_peered":"2024-09-11T22:20:19.863127+0000","last_unstale":"2024-09-11T22:36:13.489341+0000","last_undegraded":"2024-09-11T22:36:13.489341+0000","last_fullsized":"2024-09-11T22:36:13.489341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'27","last_scrub_stamp":"2024-09-11T22:36:13.489221+0000","last_deep_scrub":"28'27","last_deep_scrub_stamp":"2024-09-11T22:36:13.489221+0000","last_clean_scrub_stamp":"2024-09-11T22:36:13.489221+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:09.769207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"28'4900","reported_seq":4933,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:10.106038+0000","last_change":"2024-09-11T22:36:10.106085+0000","last_active":"2024-09-11T22:36:10.106038+0000","last_peered":"2024-09-11T22:36:10.106038+0000","last_clean":"2024-09-11T22:36:10.106038+0000","last_became_active":"2024-09-11T22:20:23.874040+0000","last_became_peered":"2024-09-11T22:20:23.874040+0000","last_unstale":"2024-09-11T22:36:10.106038+0000","last_undegraded":"2024-09-11T22:36:10.106038+0000","last_fullsized":"2024-09-11T22:36:10.106038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4900","last_scrub_stamp":"2024-09-11T22:36:10.105913+0000","last_deep_scrub":"28'4900","last_deep_scrub_stamp":"2024-09-11T22:36:10.105913+0000","last_clean_scrub_stamp":"2024-09-11T22:36:10.105913+0000","objects_scrubbed":0,"log_size":4900,"log_dups_size":0,"ondisk_log_size":4900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:37.081623+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21721,"num_write_kb":438879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"28'14","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:10.602900+0000","last_change":"2024-09-11T22:36:10.602939+0000","last_active":"2024-09-11T22:36:10.602900+0000","last_peered":"2024-09-11T22:36:10.602900+0000","last_clean":"2024-09-11T22:36:10.602900+0000","last_became_active":"2024-09-11T22:20:19.859106+0000","last_became_peered":"2024-09-11T22:20:19.859106+0000","last_unstale":"2024-09-11T22:36:10.602900+0000","last_undegraded":"2024-09-11T22:36:10.602900+0000","last_fullsized":"2024-09-11T22:36:10.602900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'14","last_scrub_stamp":"2024-09-11T22:36:10.602798+0000","last_deep_scrub":"28'14","last_deep_scrub_stamp":"2024-09-11T22:36:10.602798+0000","last_clean_scrub_stamp":"2024-09-11T22:36:10.602798+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:37.578508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'1005","reported_seq":1047,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:09.570940+0000","last_change":"2024-09-11T22:36:09.571007+0000","last_active":"2024-09-11T22:36:09.570940+0000","last_peered":"2024-09-11T22:36:09.570940+0000","last_clean":"2024-09-11T22:36:09.570940+0000","last_became_active":"2024-09-11T22:20:18.856165+0000","last_became_peered":"2024-09-11T22:20:18.856165+0000","last_unstale":"2024-09-11T22:36:09.570940+0000","last_undegraded":"2024-09-11T22:36:09.570940+0000","last_fullsized":"2024-09-11T22:36:09.570940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1005","last_scrub_stamp":"2024-09-11T22:36:09.570801+0000","last_deep_scrub":"28'1005","last_deep_scrub_stamp":"2024-09-11T22:36:09.570801+0000","last_clean_scrub_stamp":"2024-09-11T22:36:09.570801+0000","objects_scrubbed":3,"log_size":1005,"log_dups_size":0,"ondisk_log_size":1005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:40.765380+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":994,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"28'6307","reported_seq":6341,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:11.128009+0000","last_change":"2024-09-11T22:36:11.128042+0000","last_active":"2024-09-11T22:36:11.128009+0000","last_peered":"2024-09-11T22:36:11.128009+0000","last_clean":"2024-09-11T22:36:11.128009+0000","last_became_active":"2024-09-11T22:20:23.877713+0000","last_became_peered":"2024-09-11T22:20:23.877713+0000","last_unstale":"2024-09-11T22:36:11.128009+0000","last_undegraded":"2024-09-11T22:36:11.128009+0000","last_fullsized":"2024-09-11T22:36:11.128009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6307","last_scrub_stamp":"2024-09-11T22:36:11.127451+0000","last_deep_scrub":"28'6307","last_deep_scrub_stamp":"2024-09-11T22:36:11.127451+0000","last_clean_scrub_stamp":"2024-09-11T22:36:11.127451+0000","objects_scrubbed":0,"log_size":6307,"log_dups_size":0,"ondisk_log_size":6307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:05.877411+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28296,"num_write_kb":522771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"28'17","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:06.109611+0000","last_change":"2024-09-11T22:36:06.109651+0000","last_active":"2024-09-11T22:36:06.109611+0000","last_peered":"2024-09-11T22:36:06.109611+0000","last_clean":"2024-09-11T22:36:06.109611+0000","last_became_active":"2024-09-11T22:20:19.858057+0000","last_became_peered":"2024-09-11T22:20:19.858057+0000","last_unstale":"2024-09-11T22:36:06.109611+0000","last_undegraded":"2024-09-11T22:36:06.109611+0000","last_fullsized":"2024-09-11T22:36:06.109611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'17","last_scrub_stamp":"2024-09-11T22:36:06.109521+0000","last_deep_scrub":"28'17","last_deep_scrub_stamp":"2024-09-11T22:36:06.109521+0000","last_clean_scrub_stamp":"2024-09-11T22:36:06.109521+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:25.313248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'8","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:06.319396+0000","last_change":"2024-09-11T22:36:06.319419+0000","last_active":"2024-09-11T22:36:06.319396+0000","last_peered":"2024-09-11T22:36:06.319396+0000","last_clean":"2024-09-11T22:36:06.319396+0000","last_became_active":"2024-09-11T22:20:18.853508+0000","last_became_peered":"2024-09-11T22:20:18.853508+0000","last_unstale":"2024-09-11T22:36:06.319396+0000","last_undegraded":"2024-09-11T22:36:06.319396+0000","last_fullsized":"2024-09-11T22:36:06.319396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-11T22:36:06.319331+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-11T22:36:06.319331+0000","last_clean_scrub_stamp":"2024-09-11T22:36:06.319331+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:39.382881+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"28'6073","reported_seq":6114,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:17.217703+0000","last_change":"2024-09-11T22:36:17.217748+0000","last_active":"2024-09-11T22:36:17.217703+0000","last_peered":"2024-09-11T22:36:17.217703+0000","last_clean":"2024-09-11T22:36:17.217703+0000","last_became_active":"2024-09-11T22:21:02.036941+0000","last_became_peered":"2024-09-11T22:21:02.036941+0000","last_unstale":"2024-09-11T22:36:17.217703+0000","last_undegraded":"2024-09-11T22:36:17.217703+0000","last_fullsized":"2024-09-11T22:36:17.217703+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6073","last_scrub_stamp":"2024-09-11T22:36:17.217581+0000","last_deep_scrub":"28'6073","last_deep_scrub_stamp":"2024-09-11T22:36:17.217581+0000","last_clean_scrub_stamp":"2024-09-11T22:36:17.217581+0000","objects_scrubbed":0,"log_size":6073,"log_dups_size":0,"ondisk_log_size":6073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:58.180969+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27207,"num_write_kb":522378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"28'18","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:10.172287+0000","last_change":"2024-09-11T22:36:10.172326+0000","last_active":"2024-09-11T22:36:10.172287+0000","last_peered":"2024-09-11T22:36:10.172287+0000","last_clean":"2024-09-11T22:36:10.172287+0000","last_became_active":"2024-09-11T22:20:19.844446+0000","last_became_peered":"2024-09-11T22:20:19.844446+0000","last_unstale":"2024-09-11T22:36:10.172287+0000","last_undegraded":"2024-09-11T22:36:10.172287+0000","last_fullsized":"2024-09-11T22:36:10.172287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'18","last_scrub_stamp":"2024-09-11T22:36:10.172185+0000","last_deep_scrub":"28'18","last_deep_scrub_stamp":"2024-09-11T22:36:10.172185+0000","last_clean_scrub_stamp":"2024-09-11T22:36:10.172185+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:58.030647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"28'8","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:03.305204+0000","last_change":"2024-09-11T22:36:03.305247+0000","last_active":"2024-09-11T22:36:03.305204+0000","last_peered":"2024-09-11T22:36:03.305204+0000","last_clean":"2024-09-11T22:36:03.305204+0000","last_became_active":"2024-09-11T22:20:18.847118+0000","last_became_peered":"2024-09-11T22:20:18.847118+0000","last_unstale":"2024-09-11T22:36:03.305204+0000","last_undegraded":"2024-09-11T22:36:03.305204+0000","last_fullsized":"2024-09-11T22:36:03.305204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-11T22:36:03.305127+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-11T22:36:03.305127+0000","last_clean_scrub_stamp":"2024-09-11T22:36:03.305127+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:10:38.504714+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"28'7846","reported_seq":7880,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:17.351237+0000","last_change":"2024-09-11T22:36:17.351263+0000","last_active":"2024-09-11T22:36:17.351237+0000","last_peered":"2024-09-11T22:36:17.351237+0000","last_clean":"2024-09-11T22:36:17.351237+0000","last_became_active":"2024-09-11T22:20:24.077231+0000","last_became_peered":"2024-09-11T22:20:24.077231+0000","last_unstale":"2024-09-11T22:36:17.351237+0000","last_undegraded":"2024-09-11T22:36:17.351237+0000","last_fullsized":"2024-09-11T22:36:17.351237+0000","mapping_epoch":24,"log_start":"28'701","ondisk_log_start":"28'701","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7846","last_scrub_stamp":"2024-09-11T22:36:17.351145+0000","last_deep_scrub":"28'7846","last_deep_scrub_stamp":"2024-09-11T22:36:17.351145+0000","last_clean_scrub_stamp":"2024-09-11T22:36:17.351145+0000","objects_scrubbed":0,"log_size":7145,"log_dups_size":0,"ondisk_log_size":7145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:35:07.616851+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35635,"num_write_kb":625996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"28'12","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:05.054185+0000","last_change":"2024-09-11T22:36:05.054215+0000","last_active":"2024-09-11T22:36:05.054185+0000","last_peered":"2024-09-11T22:36:05.054185+0000","last_clean":"2024-09-11T22:36:05.054185+0000","last_became_active":"2024-09-11T22:20:19.854100+0000","last_became_peered":"2024-09-11T22:20:19.854100+0000","last_unstale":"2024-09-11T22:36:05.054185+0000","last_undegraded":"2024-09-11T22:36:05.054185+0000","last_fullsized":"2024-09-11T22:36:05.054185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-09-11T22:36:05.054093+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-09-11T22:36:05.054093+0000","last_clean_scrub_stamp":"2024-09-11T22:36:05.054093+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:10.864495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'6","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:06.580044+0000","last_change":"2024-09-11T22:36:06.580074+0000","last_active":"2024-09-11T22:36:06.580044+0000","last_peered":"2024-09-11T22:36:06.580044+0000","last_clean":"2024-09-11T22:36:06.580044+0000","last_became_active":"2024-09-11T22:20:18.854552+0000","last_became_peered":"2024-09-11T22:20:18.854552+0000","last_unstale":"2024-09-11T22:36:06.580044+0000","last_undegraded":"2024-09-11T22:36:06.580044+0000","last_fullsized":"2024-09-11T22:36:06.580044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-11T22:36:06.579965+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-11T22:36:06.579965+0000","last_clean_scrub_stamp":"2024-09-11T22:36:06.579965+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:41.396326+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"28'4949","reported_seq":4983,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:13.110963+0000","last_change":"2024-09-11T22:36:13.110991+0000","last_active":"2024-09-11T22:36:13.110963+0000","last_peered":"2024-09-11T22:36:13.110963+0000","last_clean":"2024-09-11T22:36:13.110963+0000","last_became_active":"2024-09-11T22:20:23.878305+0000","last_became_peered":"2024-09-11T22:20:23.878305+0000","last_unstale":"2024-09-11T22:36:13.110963+0000","last_undegraded":"2024-09-11T22:36:13.110963+0000","last_fullsized":"2024-09-11T22:36:13.110963+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4949","last_scrub_stamp":"2024-09-11T22:36:13.110856+0000","last_deep_scrub":"28'4949","last_deep_scrub_stamp":"2024-09-11T22:36:13.110856+0000","last_clean_scrub_stamp":"2024-09-11T22:36:13.110856+0000","objects_scrubbed":0,"log_size":4949,"log_dups_size":0,"ondisk_log_size":4949,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:11.608977+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21676,"num_write_kb":446977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'26","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:04.717137+0000","last_change":"2024-09-11T22:36:04.717159+0000","last_active":"2024-09-11T22:36:04.717137+0000","last_peered":"2024-09-11T22:36:04.717137+0000","last_clean":"2024-09-11T22:36:04.717137+0000","last_became_active":"2024-09-11T22:20:19.855992+0000","last_became_peered":"2024-09-11T22:20:19.855992+0000","last_unstale":"2024-09-11T22:36:04.717137+0000","last_undegraded":"2024-09-11T22:36:04.717137+0000","last_fullsized":"2024-09-11T22:36:04.717137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'26","last_scrub_stamp":"2024-09-11T22:36:04.717069+0000","last_deep_scrub":"28'26","last_deep_scrub_stamp":"2024-09-11T22:36:04.717069+0000","last_clean_scrub_stamp":"2024-09-11T22:36:04.717069+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:40.283221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'8","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:04.578916+0000","last_change":"2024-09-11T22:36:04.578951+0000","last_active":"2024-09-11T22:36:04.578916+0000","last_peered":"2024-09-11T22:36:04.578916+0000","last_clean":"2024-09-11T22:36:04.578916+0000","last_became_active":"2024-09-11T22:20:18.849621+0000","last_became_peered":"2024-09-11T22:20:18.849621+0000","last_unstale":"2024-09-11T22:36:04.578916+0000","last_undegraded":"2024-09-11T22:36:04.578916+0000","last_fullsized":"2024-09-11T22:36:04.578916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-11T22:36:04.578807+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-11T22:36:04.578807+0000","last_clean_scrub_stamp":"2024-09-11T22:36:04.578807+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:58:32.529199+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"28'5822","reported_seq":5856,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:16.247704+0000","last_change":"2024-09-11T22:36:16.247735+0000","last_active":"2024-09-11T22:36:16.247704+0000","last_peered":"2024-09-11T22:36:16.247704+0000","last_clean":"2024-09-11T22:36:16.247704+0000","last_became_active":"2024-09-11T22:20:24.077325+0000","last_became_peered":"2024-09-11T22:20:24.077325+0000","last_unstale":"2024-09-11T22:36:16.247704+0000","last_undegraded":"2024-09-11T22:36:16.247704+0000","last_fullsized":"2024-09-11T22:36:16.247704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5822","last_scrub_stamp":"2024-09-11T22:36:16.247591+0000","last_deep_scrub":"28'5822","last_deep_scrub_stamp":"2024-09-11T22:36:16.247591+0000","last_clean_scrub_stamp":"2024-09-11T22:36:16.247591+0000","objects_scrubbed":0,"log_size":5822,"log_dups_size":0,"ondisk_log_size":5822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:29.618501+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26961,"num_write_kb":521330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"28'18","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:13.218832+0000","last_change":"2024-09-11T22:36:13.218877+0000","last_active":"2024-09-11T22:36:13.218832+0000","last_peered":"2024-09-11T22:36:13.218832+0000","last_clean":"2024-09-11T22:36:13.218832+0000","last_became_active":"2024-09-11T22:20:19.850441+0000","last_became_peered":"2024-09-11T22:20:19.850441+0000","last_unstale":"2024-09-11T22:36:13.218832+0000","last_undegraded":"2024-09-11T22:36:13.218832+0000","last_fullsized":"2024-09-11T22:36:13.218832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'18","last_scrub_stamp":"2024-09-11T22:36:13.218726+0000","last_deep_scrub":"28'18","last_deep_scrub_stamp":"2024-09-11T22:36:13.218726+0000","last_clean_scrub_stamp":"2024-09-11T22:36:13.218726+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:55.621331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'353","reported_seq":395,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:02.345792+0000","last_change":"2024-09-11T22:36:02.345818+0000","last_active":"2024-09-11T22:36:02.345792+0000","last_peered":"2024-09-11T22:36:02.345792+0000","last_clean":"2024-09-11T22:36:02.345792+0000","last_became_active":"2024-09-11T22:20:18.844731+0000","last_became_peered":"2024-09-11T22:20:18.844731+0000","last_unstale":"2024-09-11T22:36:02.345792+0000","last_undegraded":"2024-09-11T22:36:02.345792+0000","last_fullsized":"2024-09-11T22:36:02.345792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'353","last_scrub_stamp":"2024-09-11T22:36:02.345734+0000","last_deep_scrub":"28'353","last_deep_scrub_stamp":"2024-09-11T22:36:02.345734+0000","last_clean_scrub_stamp":"2024-09-11T22:36:02.345734+0000","objects_scrubbed":2,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.504894+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'6627","reported_seq":6669,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:22.275713+0000","last_change":"2024-09-11T22:36:22.275713+0000","last_active":"2024-09-11T22:36:22.275713+0000","last_peered":"2024-09-11T22:36:22.275713+0000","last_clean":"2024-09-11T22:36:22.275713+0000","last_became_active":"2024-09-11T22:21:02.037520+0000","last_became_peered":"2024-09-11T22:21:02.037520+0000","last_unstale":"2024-09-11T22:36:22.275713+0000","last_undegraded":"2024-09-11T22:36:22.275713+0000","last_fullsized":"2024-09-11T22:36:22.275713+0000","mapping_epoch":27,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6627","last_scrub_stamp":"2024-09-11T22:36:22.275559+0000","last_deep_scrub":"28'6627","last_deep_scrub_stamp":"2024-09-11T22:36:22.275559+0000","last_clean_scrub_stamp":"2024-09-11T22:36:22.275559+0000","objects_scrubbed":0,"log_size":6327,"log_dups_size":0,"ondisk_log_size":6327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:13.403069+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30659,"num_write_kb":569042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"28'18","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:09.338706+0000","last_change":"2024-09-11T22:36:09.338727+0000","last_active":"2024-09-11T22:36:09.338706+0000","last_peered":"2024-09-11T22:36:09.338706+0000","last_clean":"2024-09-11T22:36:09.338706+0000","last_became_active":"2024-09-11T22:20:19.845203+0000","last_became_peered":"2024-09-11T22:20:19.845203+0000","last_unstale":"2024-09-11T22:36:09.338706+0000","last_undegraded":"2024-09-11T22:36:09.338706+0000","last_fullsized":"2024-09-11T22:36:09.338706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'18","last_scrub_stamp":"2024-09-11T22:36:09.338639+0000","last_deep_scrub":"28'18","last_deep_scrub_stamp":"2024-09-11T22:36:09.338639+0000","last_clean_scrub_stamp":"2024-09-11T22:36:09.338639+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:39.639448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"28'6","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:08.566362+0000","last_change":"2024-09-11T22:36:08.566391+0000","last_active":"2024-09-11T22:36:08.566362+0000","last_peered":"2024-09-11T22:36:08.566362+0000","last_clean":"2024-09-11T22:36:08.566362+0000","last_became_active":"2024-09-11T22:20:18.855968+0000","last_became_peered":"2024-09-11T22:20:18.855968+0000","last_unstale":"2024-09-11T22:36:08.566362+0000","last_undegraded":"2024-09-11T22:36:08.566362+0000","last_fullsized":"2024-09-11T22:36:08.566362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-11T22:36:08.566277+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-11T22:36:08.566277+0000","last_clean_scrub_stamp":"2024-09-11T22:36:08.566277+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:03.316236+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'5454","reported_seq":5488,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:12.641022+0000","last_change":"2024-09-11T22:36:12.641046+0000","last_active":"2024-09-11T22:36:12.641022+0000","last_peered":"2024-09-11T22:36:12.641022+0000","last_clean":"2024-09-11T22:36:12.641022+0000","last_became_active":"2024-09-11T22:20:24.074588+0000","last_became_peered":"2024-09-11T22:20:24.074588+0000","last_unstale":"2024-09-11T22:36:12.641022+0000","last_undegraded":"2024-09-11T22:36:12.641022+0000","last_fullsized":"2024-09-11T22:36:12.641022+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5454","last_scrub_stamp":"2024-09-11T22:36:12.640933+0000","last_deep_scrub":"28'5454","last_deep_scrub_stamp":"2024-09-11T22:36:12.640933+0000","last_clean_scrub_stamp":"2024-09-11T22:36:12.640933+0000","objects_scrubbed":0,"log_size":5454,"log_dups_size":0,"ondisk_log_size":5454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:33.359788+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25186,"num_write_kb":469240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'18","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:04.579015+0000","last_change":"2024-09-11T22:36:04.579056+0000","last_active":"2024-09-11T22:36:04.579015+0000","last_peered":"2024-09-11T22:36:04.579015+0000","last_clean":"2024-09-11T22:36:04.579015+0000","last_became_active":"2024-09-11T22:20:19.858585+0000","last_became_peered":"2024-09-11T22:20:19.858585+0000","last_unstale":"2024-09-11T22:36:04.579015+0000","last_undegraded":"2024-09-11T22:36:04.579015+0000","last_fullsized":"2024-09-11T22:36:04.579015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'18","last_scrub_stamp":"2024-09-11T22:36:04.578906+0000","last_deep_scrub":"28'18","last_deep_scrub_stamp":"2024-09-11T22:36:04.578906+0000","last_clean_scrub_stamp":"2024-09-11T22:36:04.578906+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:40.699857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"28'5","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:04.321551+0000","last_change":"2024-09-11T22:36:04.321588+0000","last_active":"2024-09-11T22:36:04.321551+0000","last_peered":"2024-09-11T22:36:04.321551+0000","last_clean":"2024-09-11T22:36:04.321551+0000","last_became_active":"2024-09-11T22:20:18.847669+0000","last_became_peered":"2024-09-11T22:20:18.847669+0000","last_unstale":"2024-09-11T22:36:04.321551+0000","last_undegraded":"2024-09-11T22:36:04.321551+0000","last_fullsized":"2024-09-11T22:36:04.321551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-11T22:36:04.321445+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-11T22:36:04.321445+0000","last_clean_scrub_stamp":"2024-09-11T22:36:04.321445+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:57.609542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"28'6951","reported_seq":6985,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:15.373858+0000","last_change":"2024-09-11T22:36:15.373900+0000","last_active":"2024-09-11T22:36:15.373858+0000","last_peered":"2024-09-11T22:36:15.373858+0000","last_clean":"2024-09-11T22:36:15.373858+0000","last_became_active":"2024-09-11T22:20:23.880468+0000","last_became_peered":"2024-09-11T22:20:23.880468+0000","last_unstale":"2024-09-11T22:36:15.373858+0000","last_undegraded":"2024-09-11T22:36:15.373858+0000","last_fullsized":"2024-09-11T22:36:15.373858+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6951","last_scrub_stamp":"2024-09-11T22:36:15.373757+0000","last_deep_scrub":"28'6951","last_deep_scrub_stamp":"2024-09-11T22:36:15.373757+0000","last_clean_scrub_stamp":"2024-09-11T22:36:15.373757+0000","objects_scrubbed":0,"log_size":6951,"log_dups_size":0,"ondisk_log_size":6951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:42.007063+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31360,"num_write_kb":584090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'17","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:07.019363+0000","last_change":"2024-09-11T22:36:07.019408+0000","last_active":"2024-09-11T22:36:07.019363+0000","last_peered":"2024-09-11T22:36:07.019363+0000","last_clean":"2024-09-11T22:36:07.019363+0000","last_became_active":"2024-09-11T22:20:19.858932+0000","last_became_peered":"2024-09-11T22:20:19.858932+0000","last_unstale":"2024-09-11T22:36:07.019363+0000","last_undegraded":"2024-09-11T22:36:07.019363+0000","last_fullsized":"2024-09-11T22:36:07.019363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'17","last_scrub_stamp":"2024-09-11T22:36:07.019212+0000","last_deep_scrub":"28'17","last_deep_scrub_stamp":"2024-09-11T22:36:07.019212+0000","last_clean_scrub_stamp":"2024-09-11T22:36:07.019212+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:34.947317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"28'6","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:08.472846+0000","last_change":"2024-09-11T22:36:08.472892+0000","last_active":"2024-09-11T22:36:08.472846+0000","last_peered":"2024-09-11T22:36:08.472846+0000","last_clean":"2024-09-11T22:36:08.472846+0000","last_became_active":"2024-09-11T22:20:18.854725+0000","last_became_peered":"2024-09-11T22:20:18.854725+0000","last_unstale":"2024-09-11T22:36:08.472846+0000","last_undegraded":"2024-09-11T22:36:08.472846+0000","last_fullsized":"2024-09-11T22:36:08.472846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-11T22:36:08.472740+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-11T22:36:08.472740+0000","last_clean_scrub_stamp":"2024-09-11T22:36:08.472740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:47.943037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'6039","reported_seq":6073,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:13.320084+0000","last_change":"2024-09-11T22:36:13.320109+0000","last_active":"2024-09-11T22:36:13.320084+0000","last_peered":"2024-09-11T22:36:13.320084+0000","last_clean":"2024-09-11T22:36:13.320084+0000","last_became_active":"2024-09-11T22:20:23.880243+0000","last_became_peered":"2024-09-11T22:20:23.880243+0000","last_unstale":"2024-09-11T22:36:13.320084+0000","last_undegraded":"2024-09-11T22:36:13.320084+0000","last_fullsized":"2024-09-11T22:36:13.320084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6039","last_scrub_stamp":"2024-09-11T22:36:13.319992+0000","last_deep_scrub":"28'6039","last_deep_scrub_stamp":"2024-09-11T22:36:13.319992+0000","last_clean_scrub_stamp":"2024-09-11T22:36:13.319992+0000","objects_scrubbed":0,"log_size":6039,"log_dups_size":0,"ondisk_log_size":6039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:18.218022+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27825,"num_write_kb":504386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'23","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:08.326644+0000","last_change":"2024-09-11T22:36:08.326644+0000","last_active":"2024-09-11T22:36:08.326644+0000","last_peered":"2024-09-11T22:36:08.326644+0000","last_clean":"2024-09-11T22:36:08.326644+0000","last_became_active":"2024-09-11T22:20:19.844536+0000","last_became_peered":"2024-09-11T22:20:19.844536+0000","last_unstale":"2024-09-11T22:36:08.326644+0000","last_undegraded":"2024-09-11T22:36:08.326644+0000","last_fullsized":"2024-09-11T22:36:08.326644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'23","last_scrub_stamp":"2024-09-11T22:36:08.326489+0000","last_deep_scrub":"28'23","last_deep_scrub_stamp":"2024-09-11T22:36:08.326489+0000","last_clean_scrub_stamp":"2024-09-11T22:36:08.326489+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:16.320573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'54","reported_seq":141,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:03.701074+0000","last_change":"2024-09-11T22:36:03.701102+0000","last_active":"2024-09-11T22:36:03.701074+0000","last_peered":"2024-09-11T22:36:03.701074+0000","last_clean":"2024-09-11T22:36:03.701074+0000","last_became_active":"2024-09-11T22:20:18.855394+0000","last_became_peered":"2024-09-11T22:20:18.855394+0000","last_unstale":"2024-09-11T22:36:03.701074+0000","last_undegraded":"2024-09-11T22:36:03.701074+0000","last_fullsized":"2024-09-11T22:36:03.701074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'54","last_scrub_stamp":"2024-09-11T22:36:03.701011+0000","last_deep_scrub":"28'54","last_deep_scrub_stamp":"2024-09-11T22:36:03.701011+0000","last_clean_scrub_stamp":"2024-09-11T22:36:03.701011+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:16.359382+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94258,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":122,"num_write":49,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"28'6775","reported_seq":6809,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:16.343639+0000","last_change":"2024-09-11T22:36:16.343684+0000","last_active":"2024-09-11T22:36:16.343639+0000","last_peered":"2024-09-11T22:36:16.343639+0000","last_clean":"2024-09-11T22:36:16.343639+0000","last_became_active":"2024-09-11T22:20:23.881642+0000","last_became_peered":"2024-09-11T22:20:23.881642+0000","last_unstale":"2024-09-11T22:36:16.343639+0000","last_undegraded":"2024-09-11T22:36:16.343639+0000","last_fullsized":"2024-09-11T22:36:16.343639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6775","last_scrub_stamp":"2024-09-11T22:36:16.343513+0000","last_deep_scrub":"28'6775","last_deep_scrub_stamp":"2024-09-11T22:36:16.343513+0000","last_clean_scrub_stamp":"2024-09-11T22:36:16.343513+0000","objects_scrubbed":0,"log_size":6775,"log_dups_size":0,"ondisk_log_size":6775,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:14:36.299557+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30543,"num_write_kb":560301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'13","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:07.685907+0000","last_change":"2024-09-11T22:36:07.685945+0000","last_active":"2024-09-11T22:36:07.685907+0000","last_peered":"2024-09-11T22:36:07.685907+0000","last_clean":"2024-09-11T22:36:07.685907+0000","last_became_active":"2024-09-11T22:20:19.859159+0000","last_became_peered":"2024-09-11T22:20:19.859159+0000","last_unstale":"2024-09-11T22:36:07.685907+0000","last_undegraded":"2024-09-11T22:36:07.685907+0000","last_fullsized":"2024-09-11T22:36:07.685907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'13","last_scrub_stamp":"2024-09-11T22:36:07.685805+0000","last_deep_scrub":"28'13","last_deep_scrub_stamp":"2024-09-11T22:36:07.685805+0000","last_clean_scrub_stamp":"2024-09-11T22:36:07.685805+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:52.831972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'9","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:07.573700+0000","last_change":"2024-09-11T22:36:07.573700+0000","last_active":"2024-09-11T22:36:07.573700+0000","last_peered":"2024-09-11T22:36:07.573700+0000","last_clean":"2024-09-11T22:36:07.573700+0000","last_became_active":"2024-09-11T22:20:18.855866+0000","last_became_peered":"2024-09-11T22:20:18.855866+0000","last_unstale":"2024-09-11T22:36:07.573700+0000","last_undegraded":"2024-09-11T22:36:07.573700+0000","last_fullsized":"2024-09-11T22:36:07.573700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-11T22:36:07.573594+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-11T22:36:07.573594+0000","last_clean_scrub_stamp":"2024-09-11T22:36:07.573594+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:34.549304+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'5391","reported_seq":5425,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:13.640962+0000","last_change":"2024-09-11T22:36:13.640992+0000","last_active":"2024-09-11T22:36:13.640962+0000","last_peered":"2024-09-11T22:36:13.640962+0000","last_clean":"2024-09-11T22:36:13.640962+0000","last_became_active":"2024-09-11T22:20:24.074568+0000","last_became_peered":"2024-09-11T22:20:24.074568+0000","last_unstale":"2024-09-11T22:36:13.640962+0000","last_undegraded":"2024-09-11T22:36:13.640962+0000","last_fullsized":"2024-09-11T22:36:13.640962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5391","last_scrub_stamp":"2024-09-11T22:36:13.640872+0000","last_deep_scrub":"28'5391","last_deep_scrub_stamp":"2024-09-11T22:36:13.640872+0000","last_clean_scrub_stamp":"2024-09-11T22:36:13.640872+0000","objects_scrubbed":0,"log_size":5391,"log_dups_size":0,"ondisk_log_size":5391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:54.943009+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24494,"num_write_kb":454589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'16","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:02.085301+0000","last_change":"2024-09-11T22:36:02.085342+0000","last_active":"2024-09-11T22:36:02.085301+0000","last_peered":"2024-09-11T22:36:02.085301+0000","last_clean":"2024-09-11T22:36:02.085301+0000","last_became_active":"2024-09-11T22:20:19.860938+0000","last_became_peered":"2024-09-11T22:20:19.860938+0000","last_unstale":"2024-09-11T22:36:02.085301+0000","last_undegraded":"2024-09-11T22:36:02.085301+0000","last_fullsized":"2024-09-11T22:36:02.085301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'16","last_scrub_stamp":"2024-09-11T22:36:02.085196+0000","last_deep_scrub":"28'16","last_deep_scrub_stamp":"2024-09-11T22:36:02.085196+0000","last_clean_scrub_stamp":"2024-09-11T22:36:02.085196+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:14.832536+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'7","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:07.515569+0000","last_change":"2024-09-11T22:36:07.515602+0000","last_active":"2024-09-11T22:36:07.515569+0000","last_peered":"2024-09-11T22:36:07.515569+0000","last_clean":"2024-09-11T22:36:07.515569+0000","last_became_active":"2024-09-11T22:20:18.853182+0000","last_became_peered":"2024-09-11T22:20:18.853182+0000","last_unstale":"2024-09-11T22:36:07.515569+0000","last_undegraded":"2024-09-11T22:36:07.515569+0000","last_fullsized":"2024-09-11T22:36:07.515569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-11T22:36:07.515471+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-11T22:36:07.515471+0000","last_clean_scrub_stamp":"2024-09-11T22:36:07.515471+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:02.265430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":201,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:04.631252+0000","last_change":"2024-09-11T22:36:04.631252+0000","last_active":"2024-09-11T22:36:04.631252+0000","last_peered":"2024-09-11T22:36:04.631252+0000","last_clean":"2024-09-11T22:36:04.631252+0000","last_became_active":"2024-09-11T22:20:09.424591+0000","last_became_peered":"2024-09-11T22:20:09.424591+0000","last_unstale":"2024-09-11T22:36:04.631252+0000","last_undegraded":"2024-09-11T22:36:04.631252+0000","last_fullsized":"2024-09-11T22:36:04.631252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2024-09-11T22:36:04.631139+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2024-09-11T22:36:04.631139+0000","last_clean_scrub_stamp":"2024-09-11T22:36:04.631139+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:32.559244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"28'5687","reported_seq":5721,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:17.599567+0000","last_change":"2024-09-11T22:36:17.599597+0000","last_active":"2024-09-11T22:36:17.599567+0000","last_peered":"2024-09-11T22:36:17.599567+0000","last_clean":"2024-09-11T22:36:17.599567+0000","last_became_active":"2024-09-11T22:20:24.076601+0000","last_became_peered":"2024-09-11T22:20:24.076601+0000","last_unstale":"2024-09-11T22:36:17.599567+0000","last_undegraded":"2024-09-11T22:36:17.599567+0000","last_fullsized":"2024-09-11T22:36:17.599567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5687","last_scrub_stamp":"2024-09-11T22:36:17.599459+0000","last_deep_scrub":"28'5687","last_deep_scrub_stamp":"2024-09-11T22:36:17.599459+0000","last_clean_scrub_stamp":"2024-09-11T22:36:17.599459+0000","objects_scrubbed":0,"log_size":5687,"log_dups_size":0,"ondisk_log_size":5687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:13.879445+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25854,"num_write_kb":500757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"28'22","reported_seq":62,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:17.580508+0000","last_change":"2024-09-11T22:36:17.580554+0000","last_active":"2024-09-11T22:36:17.580508+0000","last_peered":"2024-09-11T22:36:17.580508+0000","last_clean":"2024-09-11T22:36:17.580508+0000","last_became_active":"2024-09-11T22:20:19.861322+0000","last_became_peered":"2024-09-11T22:20:19.861322+0000","last_unstale":"2024-09-11T22:36:17.580508+0000","last_undegraded":"2024-09-11T22:36:17.580508+0000","last_fullsized":"2024-09-11T22:36:17.580508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'22","last_scrub_stamp":"2024-09-11T22:36:17.580395+0000","last_deep_scrub":"28'22","last_deep_scrub_stamp":"2024-09-11T22:36:17.580395+0000","last_clean_scrub_stamp":"2024-09-11T22:36:17.580395+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:31:06.227335+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"28'7","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:02.720926+0000","last_change":"2024-09-11T22:36:02.720926+0000","last_active":"2024-09-11T22:36:02.720926+0000","last_peered":"2024-09-11T22:36:02.720926+0000","last_clean":"2024-09-11T22:36:02.720926+0000","last_became_active":"2024-09-11T22:20:18.853069+0000","last_became_peered":"2024-09-11T22:20:18.853069+0000","last_unstale":"2024-09-11T22:36:02.720926+0000","last_undegraded":"2024-09-11T22:36:02.720926+0000","last_fullsized":"2024-09-11T22:36:02.720926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-11T22:36:02.720783+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-11T22:36:02.720783+0000","last_clean_scrub_stamp":"2024-09-11T22:36:02.720783+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:47.441121+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"28'5968","reported_seq":6002,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:16.623844+0000","last_change":"2024-09-11T22:36:16.623873+0000","last_active":"2024-09-11T22:36:16.623844+0000","last_peered":"2024-09-11T22:36:16.623844+0000","last_clean":"2024-09-11T22:36:16.623844+0000","last_became_active":"2024-09-11T22:20:24.074789+0000","last_became_peered":"2024-09-11T22:20:24.074789+0000","last_unstale":"2024-09-11T22:36:16.623844+0000","last_undegraded":"2024-09-11T22:36:16.623844+0000","last_fullsized":"2024-09-11T22:36:16.623844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5968","last_scrub_stamp":"2024-09-11T22:36:16.623730+0000","last_deep_scrub":"28'5968","last_deep_scrub_stamp":"2024-09-11T22:36:16.623730+0000","last_clean_scrub_stamp":"2024-09-11T22:36:16.623730+0000","objects_scrubbed":0,"log_size":5968,"log_dups_size":0,"ondisk_log_size":5968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:59.824771+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27295,"num_write_kb":514661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"28'20","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:16.539723+0000","last_change":"2024-09-11T22:36:16.539749+0000","last_active":"2024-09-11T22:36:16.539723+0000","last_peered":"2024-09-11T22:36:16.539723+0000","last_clean":"2024-09-11T22:36:16.539723+0000","last_became_active":"2024-09-11T22:20:19.865535+0000","last_became_peered":"2024-09-11T22:20:19.865535+0000","last_unstale":"2024-09-11T22:36:16.539723+0000","last_undegraded":"2024-09-11T22:36:16.539723+0000","last_fullsized":"2024-09-11T22:36:16.539723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'20","last_scrub_stamp":"2024-09-11T22:36:16.539642+0000","last_deep_scrub":"28'20","last_deep_scrub_stamp":"2024-09-11T22:36:16.539642+0000","last_clean_scrub_stamp":"2024-09-11T22:36:16.539642+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:30:06.778993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"28'3","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:05.308938+0000","last_change":"2024-09-11T22:36:05.308938+0000","last_active":"2024-09-11T22:36:05.308938+0000","last_peered":"2024-09-11T22:36:05.308938+0000","last_clean":"2024-09-11T22:36:05.308938+0000","last_became_active":"2024-09-11T22:20:18.848787+0000","last_became_peered":"2024-09-11T22:20:18.848787+0000","last_unstale":"2024-09-11T22:36:05.308938+0000","last_undegraded":"2024-09-11T22:36:05.308938+0000","last_fullsized":"2024-09-11T22:36:05.308938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3","last_scrub_stamp":"2024-09-11T22:36:05.308823+0000","last_deep_scrub":"28'3","last_deep_scrub_stamp":"2024-09-11T22:36:05.308823+0000","last_clean_scrub_stamp":"2024-09-11T22:36:05.308823+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:37.727488+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"28'5430","reported_seq":5464,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:11.612332+0000","last_change":"2024-09-11T22:36:11.612357+0000","last_active":"2024-09-11T22:36:11.612332+0000","last_peered":"2024-09-11T22:36:11.612332+0000","last_clean":"2024-09-11T22:36:11.612332+0000","last_became_active":"2024-09-11T22:20:23.879586+0000","last_became_peered":"2024-09-11T22:20:23.879586+0000","last_unstale":"2024-09-11T22:36:11.612332+0000","last_undegraded":"2024-09-11T22:36:11.612332+0000","last_fullsized":"2024-09-11T22:36:11.612332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5430","last_scrub_stamp":"2024-09-11T22:36:11.612246+0000","last_deep_scrub":"28'5430","last_deep_scrub_stamp":"2024-09-11T22:36:11.612246+0000","last_clean_scrub_stamp":"2024-09-11T22:36:11.612246+0000","objects_scrubbed":0,"log_size":5430,"log_dups_size":0,"ondisk_log_size":5430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:15:19.533127+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24342,"num_write_kb":478105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"28'21","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:14.563461+0000","last_change":"2024-09-11T22:36:14.563503+0000","last_active":"2024-09-11T22:36:14.563461+0000","last_peered":"2024-09-11T22:36:14.563461+0000","last_clean":"2024-09-11T22:36:14.563461+0000","last_became_active":"2024-09-11T22:20:19.860076+0000","last_became_peered":"2024-09-11T22:20:19.860076+0000","last_unstale":"2024-09-11T22:36:14.563461+0000","last_undegraded":"2024-09-11T22:36:14.563461+0000","last_fullsized":"2024-09-11T22:36:14.563461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'21","last_scrub_stamp":"2024-09-11T22:36:14.563352+0000","last_deep_scrub":"28'21","last_deep_scrub_stamp":"2024-09-11T22:36:14.563352+0000","last_clean_scrub_stamp":"2024-09-11T22:36:14.563352+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:55.526740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'7","reported_seq":49,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:04.655239+0000","last_change":"2024-09-11T22:36:04.655239+0000","last_active":"2024-09-11T22:36:04.655239+0000","last_peered":"2024-09-11T22:36:04.655239+0000","last_clean":"2024-09-11T22:36:04.655239+0000","last_became_active":"2024-09-11T22:20:18.855753+0000","last_became_peered":"2024-09-11T22:20:18.855753+0000","last_unstale":"2024-09-11T22:36:04.655239+0000","last_undegraded":"2024-09-11T22:36:04.655239+0000","last_fullsized":"2024-09-11T22:36:04.655239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-11T22:36:04.655113+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-11T22:36:04.655113+0000","last_clean_scrub_stamp":"2024-09-11T22:36:04.655113+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:55.600341+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"28'6069","reported_seq":6103,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:20.550979+0000","last_change":"2024-09-11T22:36:20.551009+0000","last_active":"2024-09-11T22:36:20.550979+0000","last_peered":"2024-09-11T22:36:20.550979+0000","last_clean":"2024-09-11T22:36:20.550979+0000","last_became_active":"2024-09-11T22:20:24.077502+0000","last_became_peered":"2024-09-11T22:20:24.077502+0000","last_unstale":"2024-09-11T22:36:20.550979+0000","last_undegraded":"2024-09-11T22:36:20.550979+0000","last_fullsized":"2024-09-11T22:36:20.550979+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6069","last_scrub_stamp":"2024-09-11T22:36:20.550863+0000","last_deep_scrub":"28'6069","last_deep_scrub_stamp":"2024-09-11T22:36:20.550863+0000","last_clean_scrub_stamp":"2024-09-11T22:36:20.550863+0000","objects_scrubbed":0,"log_size":6069,"log_dups_size":0,"ondisk_log_size":6069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:48.356444+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27695,"num_write_kb":495810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"28'12","reported_seq":52,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:12.533716+0000","last_change":"2024-09-11T22:36:12.533745+0000","last_active":"2024-09-11T22:36:12.533716+0000","last_peered":"2024-09-11T22:36:12.533716+0000","last_clean":"2024-09-11T22:36:12.533716+0000","last_became_active":"2024-09-11T22:20:19.856739+0000","last_became_peered":"2024-09-11T22:20:19.856739+0000","last_unstale":"2024-09-11T22:36:12.533716+0000","last_undegraded":"2024-09-11T22:36:12.533716+0000","last_fullsized":"2024-09-11T22:36:12.533716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'12","last_scrub_stamp":"2024-09-11T22:36:12.533609+0000","last_deep_scrub":"28'12","last_deep_scrub_stamp":"2024-09-11T22:36:12.533609+0000","last_clean_scrub_stamp":"2024-09-11T22:36:12.533609+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:03.936229+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'8","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:03.097372+0000","last_change":"2024-09-11T22:36:03.097372+0000","last_active":"2024-09-11T22:36:03.097372+0000","last_peered":"2024-09-11T22:36:03.097372+0000","last_clean":"2024-09-11T22:36:03.097372+0000","last_became_active":"2024-09-11T22:20:18.854764+0000","last_became_peered":"2024-09-11T22:20:18.854764+0000","last_unstale":"2024-09-11T22:36:03.097372+0000","last_undegraded":"2024-09-11T22:36:03.097372+0000","last_fullsized":"2024-09-11T22:36:03.097372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8","last_scrub_stamp":"2024-09-11T22:36:03.096954+0000","last_deep_scrub":"28'8","last_deep_scrub_stamp":"2024-09-11T22:36:03.096954+0000","last_clean_scrub_stamp":"2024-09-11T22:36:03.096954+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:24.275387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"28'5738","reported_seq":5772,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:12.117012+0000","last_change":"2024-09-11T22:36:12.117041+0000","last_active":"2024-09-11T22:36:12.117012+0000","last_peered":"2024-09-11T22:36:12.117012+0000","last_clean":"2024-09-11T22:36:12.117012+0000","last_became_active":"2024-09-11T22:20:23.877890+0000","last_became_peered":"2024-09-11T22:20:23.877890+0000","last_unstale":"2024-09-11T22:36:12.117012+0000","last_undegraded":"2024-09-11T22:36:12.117012+0000","last_fullsized":"2024-09-11T22:36:12.117012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5738","last_scrub_stamp":"2024-09-11T22:36:12.116881+0000","last_deep_scrub":"28'5738","last_deep_scrub_stamp":"2024-09-11T22:36:12.116881+0000","last_clean_scrub_stamp":"2024-09-11T22:36:12.116881+0000","objects_scrubbed":0,"log_size":5738,"log_dups_size":0,"ondisk_log_size":5738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:43.311459+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25762,"num_write_kb":496113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'20","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:15.523198+0000","last_change":"2024-09-11T22:36:15.523198+0000","last_active":"2024-09-11T22:36:15.523198+0000","last_peered":"2024-09-11T22:36:15.523198+0000","last_clean":"2024-09-11T22:36:15.523198+0000","last_became_active":"2024-09-11T22:20:19.860988+0000","last_became_peered":"2024-09-11T22:20:19.860988+0000","last_unstale":"2024-09-11T22:36:15.523198+0000","last_undegraded":"2024-09-11T22:36:15.523198+0000","last_fullsized":"2024-09-11T22:36:15.523198+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'20","last_scrub_stamp":"2024-09-11T22:36:15.523071+0000","last_deep_scrub":"28'20","last_deep_scrub_stamp":"2024-09-11T22:36:15.523071+0000","last_clean_scrub_stamp":"2024-09-11T22:36:15.523071+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:47.302261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'27","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:01.772348+0000","last_change":"2024-09-11T22:36:01.772348+0000","last_active":"2024-09-11T22:36:01.772348+0000","last_peered":"2024-09-11T22:36:01.772348+0000","last_clean":"2024-09-11T22:36:01.772348+0000","last_became_active":"2024-09-11T22:20:18.852153+0000","last_became_peered":"2024-09-11T22:20:18.852153+0000","last_unstale":"2024-09-11T22:36:01.772348+0000","last_undegraded":"2024-09-11T22:36:01.772348+0000","last_fullsized":"2024-09-11T22:36:01.772348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'27","last_scrub_stamp":"2024-09-11T22:36:01.772209+0000","last_deep_scrub":"28'27","last_deep_scrub_stamp":"2024-09-11T22:36:01.772209+0000","last_clean_scrub_stamp":"2024-09-11T22:36:01.772209+0000","objects_scrubbed":8,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:54.186626+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"28'6219","reported_seq":6252,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:10.663311+0000","last_change":"2024-09-11T22:36:10.663337+0000","last_active":"2024-09-11T22:36:10.663311+0000","last_peered":"2024-09-11T22:36:10.663311+0000","last_clean":"2024-09-11T22:36:10.663311+0000","last_became_active":"2024-09-11T22:20:23.873635+0000","last_became_peered":"2024-09-11T22:20:23.873635+0000","last_unstale":"2024-09-11T22:36:10.663311+0000","last_undegraded":"2024-09-11T22:36:10.663311+0000","last_fullsized":"2024-09-11T22:36:10.663311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6219","last_scrub_stamp":"2024-09-11T22:36:10.663227+0000","last_deep_scrub":"28'6219","last_deep_scrub_stamp":"2024-09-11T22:36:10.663227+0000","last_clean_scrub_stamp":"2024-09-11T22:36:10.663227+0000","objects_scrubbed":0,"log_size":6219,"log_dups_size":0,"ondisk_log_size":6219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:51.984529+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28436,"num_write_kb":547819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'20","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:08.589170+0000","last_change":"2024-09-11T22:36:08.589170+0000","last_active":"2024-09-11T22:36:08.589170+0000","last_peered":"2024-09-11T22:36:08.589170+0000","last_clean":"2024-09-11T22:36:08.589170+0000","last_became_active":"2024-09-11T22:20:19.851286+0000","last_became_peered":"2024-09-11T22:20:19.851286+0000","last_unstale":"2024-09-11T22:36:08.589170+0000","last_undegraded":"2024-09-11T22:36:08.589170+0000","last_fullsized":"2024-09-11T22:36:08.589170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'20","last_scrub_stamp":"2024-09-11T22:36:08.589051+0000","last_deep_scrub":"28'20","last_deep_scrub_stamp":"2024-09-11T22:36:08.589051+0000","last_clean_scrub_stamp":"2024-09-11T22:36:08.589051+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:44.710002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"28'11","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:05.608722+0000","last_change":"2024-09-11T22:36:05.608722+0000","last_active":"2024-09-11T22:36:05.608722+0000","last_peered":"2024-09-11T22:36:05.608722+0000","last_clean":"2024-09-11T22:36:05.608722+0000","last_became_active":"2024-09-11T22:20:18.852978+0000","last_became_peered":"2024-09-11T22:20:18.852978+0000","last_unstale":"2024-09-11T22:36:05.608722+0000","last_undegraded":"2024-09-11T22:36:05.608722+0000","last_fullsized":"2024-09-11T22:36:05.608722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'11","last_scrub_stamp":"2024-09-11T22:36:05.608594+0000","last_deep_scrub":"28'11","last_deep_scrub_stamp":"2024-09-11T22:36:05.608594+0000","last_clean_scrub_stamp":"2024-09-11T22:36:05.608594+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:32.566087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"28'6495","reported_seq":6528,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:20.216585+0000","last_change":"2024-09-11T22:36:20.216628+0000","last_active":"2024-09-11T22:36:20.216585+0000","last_peered":"2024-09-11T22:36:20.216585+0000","last_clean":"2024-09-11T22:36:20.216585+0000","last_became_active":"2024-09-11T22:20:24.077313+0000","last_became_peered":"2024-09-11T22:20:24.077313+0000","last_unstale":"2024-09-11T22:36:20.216585+0000","last_undegraded":"2024-09-11T22:36:20.216585+0000","last_fullsized":"2024-09-11T22:36:20.216585+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6495","last_scrub_stamp":"2024-09-11T22:36:20.216460+0000","last_deep_scrub":"28'6495","last_deep_scrub_stamp":"2024-09-11T22:36:20.216460+0000","last_clean_scrub_stamp":"2024-09-11T22:36:20.216460+0000","objects_scrubbed":0,"log_size":6295,"log_dups_size":0,"ondisk_log_size":6295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:35.326182+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29875,"num_write_kb":541234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"28'29","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:16.530791+0000","last_change":"2024-09-11T22:36:16.530791+0000","last_active":"2024-09-11T22:36:16.530791+0000","last_peered":"2024-09-11T22:36:16.530791+0000","last_clean":"2024-09-11T22:36:16.530791+0000","last_became_active":"2024-09-11T22:20:19.862267+0000","last_became_peered":"2024-09-11T22:20:19.862267+0000","last_unstale":"2024-09-11T22:36:16.530791+0000","last_undegraded":"2024-09-11T22:36:16.530791+0000","last_fullsized":"2024-09-11T22:36:16.530791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'29","last_scrub_stamp":"2024-09-11T22:36:16.530674+0000","last_deep_scrub":"28'29","last_deep_scrub_stamp":"2024-09-11T22:36:16.530674+0000","last_clean_scrub_stamp":"2024-09-11T22:36:16.530674+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:37.249529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'9","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:09.459424+0000","last_change":"2024-09-11T22:36:09.459424+0000","last_active":"2024-09-11T22:36:09.459424+0000","last_peered":"2024-09-11T22:36:09.459424+0000","last_clean":"2024-09-11T22:36:09.459424+0000","last_became_active":"2024-09-11T22:20:18.857419+0000","last_became_peered":"2024-09-11T22:20:18.857419+0000","last_unstale":"2024-09-11T22:36:09.459424+0000","last_undegraded":"2024-09-11T22:36:09.459424+0000","last_fullsized":"2024-09-11T22:36:09.459424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9","last_scrub_stamp":"2024-09-11T22:36:09.459262+0000","last_deep_scrub":"28'9","last_deep_scrub_stamp":"2024-09-11T22:36:09.459262+0000","last_clean_scrub_stamp":"2024-09-11T22:36:09.459262+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:53.312211+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"28'6284","reported_seq":6317,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:18.220385+0000","last_change":"2024-09-11T22:36:18.220410+0000","last_active":"2024-09-11T22:36:18.220385+0000","last_peered":"2024-09-11T22:36:18.220385+0000","last_clean":"2024-09-11T22:36:18.220385+0000","last_became_active":"2024-09-11T22:20:24.074609+0000","last_became_peered":"2024-09-11T22:20:24.074609+0000","last_unstale":"2024-09-11T22:36:18.220385+0000","last_undegraded":"2024-09-11T22:36:18.220385+0000","last_fullsized":"2024-09-11T22:36:18.220385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6284","last_scrub_stamp":"2024-09-11T22:36:18.220294+0000","last_deep_scrub":"28'6284","last_deep_scrub_stamp":"2024-09-11T22:36:18.220294+0000","last_clean_scrub_stamp":"2024-09-11T22:36:18.220294+0000","objects_scrubbed":0,"log_size":6284,"log_dups_size":0,"ondisk_log_size":6284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:13.137403+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27888,"num_write_kb":554175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"28'24","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:05.701681+0000","last_change":"2024-09-11T22:36:05.701681+0000","last_active":"2024-09-11T22:36:05.701681+0000","last_peered":"2024-09-11T22:36:05.701681+0000","last_clean":"2024-09-11T22:36:05.701681+0000","last_became_active":"2024-09-11T22:20:19.857027+0000","last_became_peered":"2024-09-11T22:20:19.857027+0000","last_unstale":"2024-09-11T22:36:05.701681+0000","last_undegraded":"2024-09-11T22:36:05.701681+0000","last_fullsized":"2024-09-11T22:36:05.701681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'24","last_scrub_stamp":"2024-09-11T22:36:05.701596+0000","last_deep_scrub":"28'24","last_deep_scrub_stamp":"2024-09-11T22:36:05.701596+0000","last_clean_scrub_stamp":"2024-09-11T22:36:05.701596+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:36.896174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"28'15","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:00.703974+0000","last_change":"2024-09-11T22:36:00.704034+0000","last_active":"2024-09-11T22:36:00.703974+0000","last_peered":"2024-09-11T22:36:00.703974+0000","last_clean":"2024-09-11T22:36:00.703974+0000","last_became_active":"2024-09-11T22:20:18.848405+0000","last_became_peered":"2024-09-11T22:20:18.848405+0000","last_unstale":"2024-09-11T22:36:00.703974+0000","last_undegraded":"2024-09-11T22:36:00.703974+0000","last_fullsized":"2024-09-11T22:36:00.703974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-09-11T22:36:00.703688+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-09-11T22:36:00.703688+0000","last_clean_scrub_stamp":"2024-09-11T22:36:00.703688+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:50:43.022157+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"28'5107","reported_seq":5140,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:19.556630+0000","last_change":"2024-09-11T22:36:19.556679+0000","last_active":"2024-09-11T22:36:19.556630+0000","last_peered":"2024-09-11T22:36:19.556630+0000","last_clean":"2024-09-11T22:36:19.556630+0000","last_became_active":"2024-09-11T22:20:24.076200+0000","last_became_peered":"2024-09-11T22:20:24.076200+0000","last_unstale":"2024-09-11T22:36:19.556630+0000","last_undegraded":"2024-09-11T22:36:19.556630+0000","last_fullsized":"2024-09-11T22:36:19.556630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5107","last_scrub_stamp":"2024-09-11T22:36:19.556525+0000","last_deep_scrub":"28'5107","last_deep_scrub_stamp":"2024-09-11T22:36:19.556525+0000","last_clean_scrub_stamp":"2024-09-11T22:36:19.556525+0000","objects_scrubbed":0,"log_size":5107,"log_dups_size":0,"ondisk_log_size":5107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:56.245384+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22900,"num_write_kb":480501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"28'17","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:19.549379+0000","last_change":"2024-09-11T22:36:19.549421+0000","last_active":"2024-09-11T22:36:19.549379+0000","last_peered":"2024-09-11T22:36:19.549379+0000","last_clean":"2024-09-11T22:36:19.549379+0000","last_became_active":"2024-09-11T22:21:02.033269+0000","last_became_peered":"2024-09-11T22:21:02.033269+0000","last_unstale":"2024-09-11T22:36:19.549379+0000","last_undegraded":"2024-09-11T22:36:19.549379+0000","last_fullsized":"2024-09-11T22:36:19.549379+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'17","last_scrub_stamp":"2024-09-11T22:36:19.549243+0000","last_deep_scrub":"28'17","last_deep_scrub_stamp":"2024-09-11T22:36:19.549243+0000","last_clean_scrub_stamp":"2024-09-11T22:36:19.549243+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:59.289136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"28'333","reported_seq":375,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:07.644771+0000","last_change":"2024-09-11T22:36:07.644771+0000","last_active":"2024-09-11T22:36:07.644771+0000","last_peered":"2024-09-11T22:36:07.644771+0000","last_clean":"2024-09-11T22:36:07.644771+0000","last_became_active":"2024-09-11T22:20:18.855386+0000","last_became_peered":"2024-09-11T22:20:18.855386+0000","last_unstale":"2024-09-11T22:36:07.644771+0000","last_undegraded":"2024-09-11T22:36:07.644771+0000","last_fullsized":"2024-09-11T22:36:07.644771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'333","last_scrub_stamp":"2024-09-11T22:36:07.644644+0000","last_deep_scrub":"28'333","last_deep_scrub_stamp":"2024-09-11T22:36:07.644644+0000","last_clean_scrub_stamp":"2024-09-11T22:36:07.644644+0000","objects_scrubbed":5,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:35.572748+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":326,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"28'5582","reported_seq":5615,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:14.331913+0000","last_change":"2024-09-11T22:36:14.331938+0000","last_active":"2024-09-11T22:36:14.331913+0000","last_peered":"2024-09-11T22:36:14.331913+0000","last_clean":"2024-09-11T22:36:14.331913+0000","last_became_active":"2024-09-11T22:20:23.879993+0000","last_became_peered":"2024-09-11T22:20:23.879993+0000","last_unstale":"2024-09-11T22:36:14.331913+0000","last_undegraded":"2024-09-11T22:36:14.331913+0000","last_fullsized":"2024-09-11T22:36:14.331913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5582","last_scrub_stamp":"2024-09-11T22:36:14.331821+0000","last_deep_scrub":"28'5582","last_deep_scrub_stamp":"2024-09-11T22:36:14.331821+0000","last_clean_scrub_stamp":"2024-09-11T22:36:14.331821+0000","objects_scrubbed":0,"log_size":5582,"log_dups_size":0,"ondisk_log_size":5582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:14.962618+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25321,"num_write_kb":502610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'21","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:06.065783+0000","last_change":"2024-09-11T22:36:06.065783+0000","last_active":"2024-09-11T22:36:06.065783+0000","last_peered":"2024-09-11T22:36:06.065783+0000","last_clean":"2024-09-11T22:36:06.065783+0000","last_became_active":"2024-09-11T22:20:19.858322+0000","last_became_peered":"2024-09-11T22:20:19.858322+0000","last_unstale":"2024-09-11T22:36:06.065783+0000","last_undegraded":"2024-09-11T22:36:06.065783+0000","last_fullsized":"2024-09-11T22:36:06.065783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'21","last_scrub_stamp":"2024-09-11T22:36:06.065658+0000","last_deep_scrub":"28'21","last_deep_scrub_stamp":"2024-09-11T22:36:06.065658+0000","last_clean_scrub_stamp":"2024-09-11T22:36:06.065658+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:50:48.384128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'29","reported_seq":70,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:07.337574+0000","last_change":"2024-09-11T22:36:07.337617+0000","last_active":"2024-09-11T22:36:07.337574+0000","last_peered":"2024-09-11T22:36:07.337574+0000","last_clean":"2024-09-11T22:36:07.337574+0000","last_became_active":"2024-09-11T22:20:18.854784+0000","last_became_peered":"2024-09-11T22:20:18.854784+0000","last_unstale":"2024-09-11T22:36:07.337574+0000","last_undegraded":"2024-09-11T22:36:07.337574+0000","last_fullsized":"2024-09-11T22:36:07.337574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'29","last_scrub_stamp":"2024-09-11T22:36:07.337504+0000","last_deep_scrub":"28'29","last_deep_scrub_stamp":"2024-09-11T22:36:07.337504+0000","last_clean_scrub_stamp":"2024-09-11T22:36:07.337504+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:51.681304+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"28'6236","reported_seq":6270,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:15.193975+0000","last_change":"2024-09-11T22:36:15.193975+0000","last_active":"2024-09-11T22:36:15.193975+0000","last_peered":"2024-09-11T22:36:15.193975+0000","last_clean":"2024-09-11T22:36:15.193975+0000","last_became_active":"2024-09-11T22:20:23.878794+0000","last_became_peered":"2024-09-11T22:20:23.878794+0000","last_unstale":"2024-09-11T22:36:15.193975+0000","last_undegraded":"2024-09-11T22:36:15.193975+0000","last_fullsized":"2024-09-11T22:36:15.193975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6236","last_scrub_stamp":"2024-09-11T22:36:15.193841+0000","last_deep_scrub":"28'6236","last_deep_scrub_stamp":"2024-09-11T22:36:15.193841+0000","last_clean_scrub_stamp":"2024-09-11T22:36:15.193841+0000","objects_scrubbed":0,"log_size":6236,"log_dups_size":0,"ondisk_log_size":6236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:06.596461+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28034,"num_write_kb":525577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"28'25","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:14.635165+0000","last_change":"2024-09-11T22:36:14.635217+0000","last_active":"2024-09-11T22:36:14.635165+0000","last_peered":"2024-09-11T22:36:14.635165+0000","last_clean":"2024-09-11T22:36:14.635165+0000","last_became_active":"2024-09-11T22:21:02.034349+0000","last_became_peered":"2024-09-11T22:21:02.034349+0000","last_unstale":"2024-09-11T22:36:14.635165+0000","last_undegraded":"2024-09-11T22:36:14.635165+0000","last_fullsized":"2024-09-11T22:36:14.635165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'25","last_scrub_stamp":"2024-09-11T22:36:14.635057+0000","last_deep_scrub":"28'25","last_deep_scrub_stamp":"2024-09-11T22:36:14.635057+0000","last_clean_scrub_stamp":"2024-09-11T22:36:14.635057+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:32.058146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"28'5","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:06.531254+0000","last_change":"2024-09-11T22:36:06.531285+0000","last_active":"2024-09-11T22:36:06.531254+0000","last_peered":"2024-09-11T22:36:06.531254+0000","last_clean":"2024-09-11T22:36:06.531254+0000","last_became_active":"2024-09-11T22:20:18.853103+0000","last_became_peered":"2024-09-11T22:20:18.853103+0000","last_unstale":"2024-09-11T22:36:06.531254+0000","last_undegraded":"2024-09-11T22:36:06.531254+0000","last_fullsized":"2024-09-11T22:36:06.531254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5","last_scrub_stamp":"2024-09-11T22:36:06.531169+0000","last_deep_scrub":"28'5","last_deep_scrub_stamp":"2024-09-11T22:36:06.531169+0000","last_clean_scrub_stamp":"2024-09-11T22:36:06.531169+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:08.866712+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'5748","reported_seq":5782,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:16.228992+0000","last_change":"2024-09-11T22:36:16.228992+0000","last_active":"2024-09-11T22:36:16.228992+0000","last_peered":"2024-09-11T22:36:16.228992+0000","last_clean":"2024-09-11T22:36:16.228992+0000","last_became_active":"2024-09-11T22:20:23.876587+0000","last_became_peered":"2024-09-11T22:20:23.876587+0000","last_unstale":"2024-09-11T22:36:16.228992+0000","last_undegraded":"2024-09-11T22:36:16.228992+0000","last_fullsized":"2024-09-11T22:36:16.228992+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5748","last_scrub_stamp":"2024-09-11T22:36:16.228846+0000","last_deep_scrub":"28'5748","last_deep_scrub_stamp":"2024-09-11T22:36:16.228846+0000","last_clean_scrub_stamp":"2024-09-11T22:36:16.228846+0000","objects_scrubbed":0,"log_size":5748,"log_dups_size":0,"ondisk_log_size":5748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:24.022659+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26080,"num_write_kb":501611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'25","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:17.549914+0000","last_change":"2024-09-11T22:36:17.549941+0000","last_active":"2024-09-11T22:36:17.549914+0000","last_peered":"2024-09-11T22:36:17.549914+0000","last_clean":"2024-09-11T22:36:17.549914+0000","last_became_active":"2024-09-11T22:20:19.866303+0000","last_became_peered":"2024-09-11T22:20:19.866303+0000","last_unstale":"2024-09-11T22:36:17.549914+0000","last_undegraded":"2024-09-11T22:36:17.549914+0000","last_fullsized":"2024-09-11T22:36:17.549914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'25","last_scrub_stamp":"2024-09-11T22:36:17.549821+0000","last_deep_scrub":"28'25","last_deep_scrub_stamp":"2024-09-11T22:36:17.549821+0000","last_clean_scrub_stamp":"2024-09-11T22:36:17.549821+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:31:06.196760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"28'7","reported_seq":48,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:06.637430+0000","last_change":"2024-09-11T22:36:06.637479+0000","last_active":"2024-09-11T22:36:06.637430+0000","last_peered":"2024-09-11T22:36:06.637430+0000","last_clean":"2024-09-11T22:36:06.637430+0000","last_became_active":"2024-09-11T22:20:18.854019+0000","last_became_peered":"2024-09-11T22:20:18.854019+0000","last_unstale":"2024-09-11T22:36:06.637430+0000","last_undegraded":"2024-09-11T22:36:06.637430+0000","last_fullsized":"2024-09-11T22:36:06.637430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7","last_scrub_stamp":"2024-09-11T22:36:06.637335+0000","last_deep_scrub":"28'7","last_deep_scrub_stamp":"2024-09-11T22:36:06.637335+0000","last_clean_scrub_stamp":"2024-09-11T22:36:06.637335+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:50:48.955804+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"28'5959","reported_seq":5993,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:19.197401+0000","last_change":"2024-09-11T22:36:19.197401+0000","last_active":"2024-09-11T22:36:19.197401+0000","last_peered":"2024-09-11T22:36:19.197401+0000","last_clean":"2024-09-11T22:36:19.197401+0000","last_became_active":"2024-09-11T22:20:24.077134+0000","last_became_peered":"2024-09-11T22:20:24.077134+0000","last_unstale":"2024-09-11T22:36:19.197401+0000","last_undegraded":"2024-09-11T22:36:19.197401+0000","last_fullsized":"2024-09-11T22:36:19.197401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5959","last_scrub_stamp":"2024-09-11T22:36:19.197240+0000","last_deep_scrub":"28'5959","last_deep_scrub_stamp":"2024-09-11T22:36:19.197240+0000","last_clean_scrub_stamp":"2024-09-11T22:36:19.197240+0000","objects_scrubbed":0,"log_size":5959,"log_dups_size":0,"ondisk_log_size":5959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:26.428397+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26850,"num_write_kb":516954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'7134","reported_seq":7176,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:15.616295+0000","last_change":"2024-09-11T22:36:15.616295+0000","last_active":"2024-09-11T22:36:15.616295+0000","last_peered":"2024-09-11T22:36:15.616295+0000","last_clean":"2024-09-11T22:36:15.616295+0000","last_became_active":"2024-09-11T22:21:02.037407+0000","last_became_peered":"2024-09-11T22:21:02.037407+0000","last_unstale":"2024-09-11T22:36:15.616295+0000","last_undegraded":"2024-09-11T22:36:15.616295+0000","last_fullsized":"2024-09-11T22:36:15.616295+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7134","last_scrub_stamp":"2024-09-11T22:36:15.616131+0000","last_deep_scrub":"28'7134","last_deep_scrub_stamp":"2024-09-11T22:36:15.616131+0000","last_clean_scrub_stamp":"2024-09-11T22:36:15.616131+0000","objects_scrubbed":0,"log_size":7134,"log_dups_size":0,"ondisk_log_size":7134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:55.356023+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33450,"num_write_kb":608986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"28'20","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:01.353495+0000","last_change":"2024-09-11T22:36:01.353532+0000","last_active":"2024-09-11T22:36:01.353495+0000","last_peered":"2024-09-11T22:36:01.353495+0000","last_clean":"2024-09-11T22:36:01.353495+0000","last_became_active":"2024-09-11T22:20:19.845425+0000","last_became_peered":"2024-09-11T22:20:19.845425+0000","last_unstale":"2024-09-11T22:36:01.353495+0000","last_undegraded":"2024-09-11T22:36:01.353495+0000","last_fullsized":"2024-09-11T22:36:01.353495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'20","last_scrub_stamp":"2024-09-11T22:36:01.353393+0000","last_deep_scrub":"28'20","last_deep_scrub_stamp":"2024-09-11T22:36:01.353393+0000","last_clean_scrub_stamp":"2024-09-11T22:36:01.353393+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:42.279729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'4","reported_seq":45,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:05.578614+0000","last_change":"2024-09-11T22:36:05.578650+0000","last_active":"2024-09-11T22:36:05.578614+0000","last_peered":"2024-09-11T22:36:05.578614+0000","last_clean":"2024-09-11T22:36:05.578614+0000","last_became_active":"2024-09-11T22:20:18.852155+0000","last_became_peered":"2024-09-11T22:20:18.852155+0000","last_unstale":"2024-09-11T22:36:05.578614+0000","last_undegraded":"2024-09-11T22:36:05.578614+0000","last_fullsized":"2024-09-11T22:36:05.578614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-11T22:36:05.578489+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-11T22:36:05.578489+0000","last_clean_scrub_stamp":"2024-09-11T22:36:05.578489+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:54.915715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"28'6143","reported_seq":6177,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:15.629640+0000","last_change":"2024-09-11T22:36:15.629667+0000","last_active":"2024-09-11T22:36:15.629640+0000","last_peered":"2024-09-11T22:36:15.629640+0000","last_clean":"2024-09-11T22:36:15.629640+0000","last_became_active":"2024-09-11T22:20:23.876100+0000","last_became_peered":"2024-09-11T22:20:23.876100+0000","last_unstale":"2024-09-11T22:36:15.629640+0000","last_undegraded":"2024-09-11T22:36:15.629640+0000","last_fullsized":"2024-09-11T22:36:15.629640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6143","last_scrub_stamp":"2024-09-11T22:36:15.629537+0000","last_deep_scrub":"28'6143","last_deep_scrub_stamp":"2024-09-11T22:36:15.629537+0000","last_clean_scrub_stamp":"2024-09-11T22:36:15.629537+0000","objects_scrubbed":0,"log_size":6143,"log_dups_size":0,"ondisk_log_size":6143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:00.775705+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28157,"num_write_kb":534365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"28'27","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:14.216663+0000","last_change":"2024-09-11T22:36:14.216683+0000","last_active":"2024-09-11T22:36:14.216663+0000","last_peered":"2024-09-11T22:36:14.216663+0000","last_clean":"2024-09-11T22:36:14.216663+0000","last_became_active":"2024-09-11T22:20:19.852333+0000","last_became_peered":"2024-09-11T22:20:19.852333+0000","last_unstale":"2024-09-11T22:36:14.216663+0000","last_undegraded":"2024-09-11T22:36:14.216663+0000","last_fullsized":"2024-09-11T22:36:14.216663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'27","last_scrub_stamp":"2024-09-11T22:36:14.216594+0000","last_deep_scrub":"28'27","last_deep_scrub_stamp":"2024-09-11T22:36:14.216594+0000","last_clean_scrub_stamp":"2024-09-11T22:36:14.216594+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:06.171850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"28'6","reported_seq":47,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:07.150994+0000","last_change":"2024-09-11T22:36:07.151035+0000","last_active":"2024-09-11T22:36:07.150994+0000","last_peered":"2024-09-11T22:36:07.150994+0000","last_clean":"2024-09-11T22:36:07.150994+0000","last_became_active":"2024-09-11T22:20:18.853533+0000","last_became_peered":"2024-09-11T22:20:18.853533+0000","last_unstale":"2024-09-11T22:36:07.150994+0000","last_undegraded":"2024-09-11T22:36:07.150994+0000","last_fullsized":"2024-09-11T22:36:07.150994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6","last_scrub_stamp":"2024-09-11T22:36:07.150892+0000","last_deep_scrub":"28'6","last_deep_scrub_stamp":"2024-09-11T22:36:07.150892+0000","last_clean_scrub_stamp":"2024-09-11T22:36:07.150892+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:31.963855+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"28'10","reported_seq":51,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:03.543188+0000","last_change":"2024-09-11T22:36:03.543235+0000","last_active":"2024-09-11T22:36:03.543188+0000","last_peered":"2024-09-11T22:36:03.543188+0000","last_clean":"2024-09-11T22:36:03.543188+0000","last_became_active":"2024-09-11T22:20:18.846321+0000","last_became_peered":"2024-09-11T22:20:18.846321+0000","last_unstale":"2024-09-11T22:36:03.543188+0000","last_undegraded":"2024-09-11T22:36:03.543188+0000","last_fullsized":"2024-09-11T22:36:03.543188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-09-11T22:36:03.543082+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-09-11T22:36:03.543082+0000","last_clean_scrub_stamp":"2024-09-11T22:36:03.543082+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:24.721515+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'19","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:08.711576+0000","last_change":"2024-09-11T22:36:08.711597+0000","last_active":"2024-09-11T22:36:08.711576+0000","last_peered":"2024-09-11T22:36:08.711576+0000","last_clean":"2024-09-11T22:36:08.711576+0000","last_became_active":"2024-09-11T22:20:19.861154+0000","last_became_peered":"2024-09-11T22:20:19.861154+0000","last_unstale":"2024-09-11T22:36:08.711576+0000","last_undegraded":"2024-09-11T22:36:08.711576+0000","last_fullsized":"2024-09-11T22:36:08.711576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'19","last_scrub_stamp":"2024-09-11T22:36:08.711516+0000","last_deep_scrub":"28'19","last_deep_scrub_stamp":"2024-09-11T22:36:08.711516+0000","last_clean_scrub_stamp":"2024-09-11T22:36:08.711516+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:43.813069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"28'5094","reported_seq":5127,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:07.682008+0000","last_change":"2024-09-11T22:36:07.682039+0000","last_active":"2024-09-11T22:36:07.682008+0000","last_peered":"2024-09-11T22:36:07.682008+0000","last_clean":"2024-09-11T22:36:07.682008+0000","last_became_active":"2024-09-11T22:20:23.877578+0000","last_became_peered":"2024-09-11T22:20:23.877578+0000","last_unstale":"2024-09-11T22:36:07.682008+0000","last_undegraded":"2024-09-11T22:36:07.682008+0000","last_fullsized":"2024-09-11T22:36:07.682008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5094","last_scrub_stamp":"2024-09-11T22:36:07.681912+0000","last_deep_scrub":"28'5094","last_deep_scrub_stamp":"2024-09-11T22:36:07.681912+0000","last_clean_scrub_stamp":"2024-09-11T22:36:07.681912+0000","objects_scrubbed":0,"log_size":5094,"log_dups_size":0,"ondisk_log_size":5094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:05.444259+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23560,"num_write_kb":426046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"28'586","reported_seq":627,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:08.183650+0000","last_change":"2024-09-11T22:36:08.183675+0000","last_active":"2024-09-11T22:36:08.183650+0000","last_peered":"2024-09-11T22:36:08.183650+0000","last_clean":"2024-09-11T22:36:08.183650+0000","last_became_active":"2024-09-11T22:20:18.853872+0000","last_became_peered":"2024-09-11T22:20:18.853872+0000","last_unstale":"2024-09-11T22:36:08.183650+0000","last_undegraded":"2024-09-11T22:36:08.183650+0000","last_fullsized":"2024-09-11T22:36:08.183650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'586","last_scrub_stamp":"2024-09-11T22:36:08.183580+0000","last_deep_scrub":"28'586","last_deep_scrub_stamp":"2024-09-11T22:36:08.183580+0000","last_clean_scrub_stamp":"2024-09-11T22:36:08.183580+0000","objects_scrubbed":3,"log_size":586,"log_dups_size":0,"ondisk_log_size":586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:27:50.647683+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195510,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":580,"num_write_kb":4218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'20","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:04.047038+0000","last_change":"2024-09-11T22:36:04.047098+0000","last_active":"2024-09-11T22:36:04.047038+0000","last_peered":"2024-09-11T22:36:04.047038+0000","last_clean":"2024-09-11T22:36:04.047038+0000","last_became_active":"2024-09-11T22:20:19.850175+0000","last_became_peered":"2024-09-11T22:20:19.850175+0000","last_unstale":"2024-09-11T22:36:04.047038+0000","last_undegraded":"2024-09-11T22:36:04.047038+0000","last_fullsized":"2024-09-11T22:36:04.047038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'20","last_scrub_stamp":"2024-09-11T22:36:04.046903+0000","last_deep_scrub":"28'20","last_deep_scrub_stamp":"2024-09-11T22:36:04.046903+0000","last_clean_scrub_stamp":"2024-09-11T22:36:04.046903+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:39.546107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"28'6620","reported_seq":6653,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:17.215067+0000","last_change":"2024-09-11T22:36:17.215090+0000","last_active":"2024-09-11T22:36:17.215067+0000","last_peered":"2024-09-11T22:36:17.215067+0000","last_clean":"2024-09-11T22:36:17.215067+0000","last_became_active":"2024-09-11T22:20:23.876776+0000","last_became_peered":"2024-09-11T22:20:23.876776+0000","last_unstale":"2024-09-11T22:36:17.215067+0000","last_undegraded":"2024-09-11T22:36:17.215067+0000","last_fullsized":"2024-09-11T22:36:17.215067+0000","mapping_epoch":24,"log_start":"28'300","ondisk_log_start":"28'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6620","last_scrub_stamp":"2024-09-11T22:36:17.214982+0000","last_deep_scrub":"28'6620","last_deep_scrub_stamp":"2024-09-11T22:36:17.214982+0000","last_clean_scrub_stamp":"2024-09-11T22:36:17.214982+0000","objects_scrubbed":0,"log_size":6320,"log_dups_size":0,"ondisk_log_size":6320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:19.333814+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29858,"num_write_kb":574080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"28'24","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:09.590752+0000","last_change":"2024-09-11T22:36:09.590775+0000","last_active":"2024-09-11T22:36:09.590752+0000","last_peered":"2024-09-11T22:36:09.590752+0000","last_clean":"2024-09-11T22:36:09.590752+0000","last_became_active":"2024-09-11T22:20:19.852937+0000","last_became_peered":"2024-09-11T22:20:19.852937+0000","last_unstale":"2024-09-11T22:36:09.590752+0000","last_undegraded":"2024-09-11T22:36:09.590752+0000","last_fullsized":"2024-09-11T22:36:09.590752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'24","last_scrub_stamp":"2024-09-11T22:36:09.590671+0000","last_deep_scrub":"28'24","last_deep_scrub_stamp":"2024-09-11T22:36:09.590671+0000","last_clean_scrub_stamp":"2024-09-11T22:36:09.590671+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:58.927896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'25","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:06.665150+0000","last_change":"2024-09-11T22:36:06.665172+0000","last_active":"2024-09-11T22:36:06.665150+0000","last_peered":"2024-09-11T22:36:06.665150+0000","last_clean":"2024-09-11T22:36:06.665150+0000","last_became_active":"2024-09-11T22:20:19.860690+0000","last_became_peered":"2024-09-11T22:20:19.860690+0000","last_unstale":"2024-09-11T22:36:06.665150+0000","last_undegraded":"2024-09-11T22:36:06.665150+0000","last_fullsized":"2024-09-11T22:36:06.665150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'25","last_scrub_stamp":"2024-09-11T22:36:06.665084+0000","last_deep_scrub":"28'25","last_deep_scrub_stamp":"2024-09-11T22:36:06.665084+0000","last_clean_scrub_stamp":"2024-09-11T22:36:06.665084+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:11:04.719957+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'23","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:10.492330+0000","last_change":"2024-09-11T22:36:10.492376+0000","last_active":"2024-09-11T22:36:10.492330+0000","last_peered":"2024-09-11T22:36:10.492330+0000","last_clean":"2024-09-11T22:36:10.492330+0000","last_became_active":"2024-09-11T22:20:19.856460+0000","last_became_peered":"2024-09-11T22:20:19.856460+0000","last_unstale":"2024-09-11T22:36:10.492330+0000","last_undegraded":"2024-09-11T22:36:10.492330+0000","last_fullsized":"2024-09-11T22:36:10.492330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'23","last_scrub_stamp":"2024-09-11T22:36:10.492214+0000","last_deep_scrub":"28'23","last_deep_scrub_stamp":"2024-09-11T22:36:10.492214+0000","last_clean_scrub_stamp":"2024-09-11T22:36:10.492214+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:59.935563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'18","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:03.724026+0000","last_change":"2024-09-11T22:36:03.724047+0000","last_active":"2024-09-11T22:36:03.724026+0000","last_peered":"2024-09-11T22:36:03.724026+0000","last_clean":"2024-09-11T22:36:03.724026+0000","last_became_active":"2024-09-11T22:20:19.855363+0000","last_became_peered":"2024-09-11T22:20:19.855363+0000","last_unstale":"2024-09-11T22:36:03.724026+0000","last_undegraded":"2024-09-11T22:36:03.724026+0000","last_fullsized":"2024-09-11T22:36:03.724026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'18","last_scrub_stamp":"2024-09-11T22:36:03.723942+0000","last_deep_scrub":"28'18","last_deep_scrub_stamp":"2024-09-11T22:36:03.723942+0000","last_clean_scrub_stamp":"2024-09-11T22:36:03.723942+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:38.540303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'14","reported_seq":54,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:05.123302+0000","last_change":"2024-09-11T22:36:05.123333+0000","last_active":"2024-09-11T22:36:05.123302+0000","last_peered":"2024-09-11T22:36:05.123302+0000","last_clean":"2024-09-11T22:36:05.123302+0000","last_became_active":"2024-09-11T22:20:19.862828+0000","last_became_peered":"2024-09-11T22:20:19.862828+0000","last_unstale":"2024-09-11T22:36:05.123302+0000","last_undegraded":"2024-09-11T22:36:05.123302+0000","last_fullsized":"2024-09-11T22:36:05.123302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'14","last_scrub_stamp":"2024-09-11T22:36:05.123230+0000","last_deep_scrub":"28'14","last_deep_scrub_stamp":"2024-09-11T22:36:05.123230+0000","last_clean_scrub_stamp":"2024-09-11T22:36:05.123230+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:30.371413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'15","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:10.335529+0000","last_change":"2024-09-11T22:36:10.335549+0000","last_active":"2024-09-11T22:36:10.335529+0000","last_peered":"2024-09-11T22:36:10.335529+0000","last_clean":"2024-09-11T22:36:10.335529+0000","last_became_active":"2024-09-11T22:20:19.846186+0000","last_became_peered":"2024-09-11T22:20:19.846186+0000","last_unstale":"2024-09-11T22:36:10.335529+0000","last_undegraded":"2024-09-11T22:36:10.335529+0000","last_fullsized":"2024-09-11T22:36:10.335529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-09-11T22:36:10.335457+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-09-11T22:36:10.335457+0000","last_clean_scrub_stamp":"2024-09-11T22:36:10.335457+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:19.720830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'24","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:11.597241+0000","last_change":"2024-09-11T22:36:11.597271+0000","last_active":"2024-09-11T22:36:11.597241+0000","last_peered":"2024-09-11T22:36:11.597241+0000","last_clean":"2024-09-11T22:36:11.597241+0000","last_became_active":"2024-09-11T22:20:19.860005+0000","last_became_peered":"2024-09-11T22:20:19.860005+0000","last_unstale":"2024-09-11T22:36:11.597241+0000","last_undegraded":"2024-09-11T22:36:11.597241+0000","last_fullsized":"2024-09-11T22:36:11.597241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'24","last_scrub_stamp":"2024-09-11T22:36:11.597154+0000","last_deep_scrub":"28'24","last_deep_scrub_stamp":"2024-09-11T22:36:11.597154+0000","last_clean_scrub_stamp":"2024-09-11T22:36:11.597154+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:38:06.347114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'17","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:04.086315+0000","last_change":"2024-09-11T22:36:04.086336+0000","last_active":"2024-09-11T22:36:04.086315+0000","last_peered":"2024-09-11T22:36:04.086315+0000","last_clean":"2024-09-11T22:36:04.086315+0000","last_became_active":"2024-09-11T22:20:19.858832+0000","last_became_peered":"2024-09-11T22:20:19.858832+0000","last_unstale":"2024-09-11T22:36:04.086315+0000","last_undegraded":"2024-09-11T22:36:04.086315+0000","last_fullsized":"2024-09-11T22:36:04.086315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'17","last_scrub_stamp":"2024-09-11T22:36:04.086252+0000","last_deep_scrub":"28'17","last_deep_scrub_stamp":"2024-09-11T22:36:04.086252+0000","last_clean_scrub_stamp":"2024-09-11T22:36:04.086252+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:03.145629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'18","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:12.499697+0000","last_change":"2024-09-11T22:36:12.499724+0000","last_active":"2024-09-11T22:36:12.499697+0000","last_peered":"2024-09-11T22:36:12.499697+0000","last_clean":"2024-09-11T22:36:12.499697+0000","last_became_active":"2024-09-11T22:20:19.857847+0000","last_became_peered":"2024-09-11T22:20:19.857847+0000","last_unstale":"2024-09-11T22:36:12.499697+0000","last_undegraded":"2024-09-11T22:36:12.499697+0000","last_fullsized":"2024-09-11T22:36:12.499697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'18","last_scrub_stamp":"2024-09-11T22:36:12.499570+0000","last_deep_scrub":"28'18","last_deep_scrub_stamp":"2024-09-11T22:36:12.499570+0000","last_clean_scrub_stamp":"2024-09-11T22:36:12.499570+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:55.700611+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'23","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:15.206235+0000","last_change":"2024-09-11T22:36:15.206257+0000","last_active":"2024-09-11T22:36:15.206235+0000","last_peered":"2024-09-11T22:36:15.206235+0000","last_clean":"2024-09-11T22:36:15.206235+0000","last_became_active":"2024-09-11T22:20:19.863007+0000","last_became_peered":"2024-09-11T22:20:19.863007+0000","last_unstale":"2024-09-11T22:36:15.206235+0000","last_undegraded":"2024-09-11T22:36:15.206235+0000","last_fullsized":"2024-09-11T22:36:15.206235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'23","last_scrub_stamp":"2024-09-11T22:36:15.206169+0000","last_deep_scrub":"28'23","last_deep_scrub_stamp":"2024-09-11T22:36:15.206169+0000","last_clean_scrub_stamp":"2024-09-11T22:36:15.206169+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:09:54.861077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'23","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:11.486114+0000","last_change":"2024-09-11T22:36:11.486180+0000","last_active":"2024-09-11T22:36:11.486114+0000","last_peered":"2024-09-11T22:36:11.486114+0000","last_clean":"2024-09-11T22:36:11.486114+0000","last_became_active":"2024-09-11T22:20:19.857790+0000","last_became_peered":"2024-09-11T22:20:19.857790+0000","last_unstale":"2024-09-11T22:36:11.486114+0000","last_undegraded":"2024-09-11T22:36:11.486114+0000","last_fullsized":"2024-09-11T22:36:11.486114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'23","last_scrub_stamp":"2024-09-11T22:36:11.485986+0000","last_deep_scrub":"28'23","last_deep_scrub_stamp":"2024-09-11T22:36:11.485986+0000","last_clean_scrub_stamp":"2024-09-11T22:36:11.485986+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:50:02.888607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'28","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:08.631830+0000","last_change":"2024-09-11T22:36:08.631850+0000","last_active":"2024-09-11T22:36:08.631830+0000","last_peered":"2024-09-11T22:36:08.631830+0000","last_clean":"2024-09-11T22:36:08.631830+0000","last_became_active":"2024-09-11T22:21:02.034534+0000","last_became_peered":"2024-09-11T22:21:02.034534+0000","last_unstale":"2024-09-11T22:36:08.631830+0000","last_undegraded":"2024-09-11T22:36:08.631830+0000","last_fullsized":"2024-09-11T22:36:08.631830+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'28","last_scrub_stamp":"2024-09-11T22:36:08.631765+0000","last_deep_scrub":"28'28","last_deep_scrub_stamp":"2024-09-11T22:36:08.631765+0000","last_clean_scrub_stamp":"2024-09-11T22:36:08.631765+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:44.130969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"28'19","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:14.577611+0000","last_change":"2024-09-11T22:36:14.577652+0000","last_active":"2024-09-11T22:36:14.577611+0000","last_peered":"2024-09-11T22:36:14.577611+0000","last_clean":"2024-09-11T22:36:14.577611+0000","last_became_active":"2024-09-11T22:20:19.862296+0000","last_became_peered":"2024-09-11T22:20:19.862296+0000","last_unstale":"2024-09-11T22:36:14.577611+0000","last_undegraded":"2024-09-11T22:36:14.577611+0000","last_fullsized":"2024-09-11T22:36:14.577611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'19","last_scrub_stamp":"2024-09-11T22:36:14.577498+0000","last_deep_scrub":"28'19","last_deep_scrub_stamp":"2024-09-11T22:36:14.577498+0000","last_clean_scrub_stamp":"2024-09-11T22:36:14.577498+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:02:45.819361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'22","reported_seq":62,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:03.658363+0000","last_change":"2024-09-11T22:36:03.658363+0000","last_active":"2024-09-11T22:36:03.658363+0000","last_peered":"2024-09-11T22:36:03.658363+0000","last_clean":"2024-09-11T22:36:03.658363+0000","last_became_active":"2024-09-11T22:20:19.854970+0000","last_became_peered":"2024-09-11T22:20:19.854970+0000","last_unstale":"2024-09-11T22:36:03.658363+0000","last_undegraded":"2024-09-11T22:36:03.658363+0000","last_fullsized":"2024-09-11T22:36:03.658363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'22","last_scrub_stamp":"2024-09-11T22:36:03.658243+0000","last_deep_scrub":"28'22","last_deep_scrub_stamp":"2024-09-11T22:36:03.658243+0000","last_clean_scrub_stamp":"2024-09-11T22:36:03.658243+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:50:45.976712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"28'29","reported_seq":69,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:05.684664+0000","last_change":"2024-09-11T22:36:05.684664+0000","last_active":"2024-09-11T22:36:05.684664+0000","last_peered":"2024-09-11T22:36:05.684664+0000","last_clean":"2024-09-11T22:36:05.684664+0000","last_became_active":"2024-09-11T22:20:19.849815+0000","last_became_peered":"2024-09-11T22:20:19.849815+0000","last_unstale":"2024-09-11T22:36:05.684664+0000","last_undegraded":"2024-09-11T22:36:05.684664+0000","last_fullsized":"2024-09-11T22:36:05.684664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'29","last_scrub_stamp":"2024-09-11T22:36:05.684528+0000","last_deep_scrub":"28'29","last_deep_scrub_stamp":"2024-09-11T22:36:05.684528+0000","last_clean_scrub_stamp":"2024-09-11T22:36:05.684528+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:23:25.845286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"28'21","reported_seq":61,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:18.509059+0000","last_change":"2024-09-11T22:36:18.509059+0000","last_active":"2024-09-11T22:36:18.509059+0000","last_peered":"2024-09-11T22:36:18.509059+0000","last_clean":"2024-09-11T22:36:18.509059+0000","last_became_active":"2024-09-11T22:20:19.866484+0000","last_became_peered":"2024-09-11T22:20:19.866484+0000","last_unstale":"2024-09-11T22:36:18.509059+0000","last_undegraded":"2024-09-11T22:36:18.509059+0000","last_fullsized":"2024-09-11T22:36:18.509059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'21","last_scrub_stamp":"2024-09-11T22:36:18.508939+0000","last_deep_scrub":"28'21","last_deep_scrub_stamp":"2024-09-11T22:36:18.508939+0000","last_clean_scrub_stamp":"2024-09-11T22:36:18.508939+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:52.862256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"28'21","reported_seq":46,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:09.630816+0000","last_change":"2024-09-11T22:36:09.630837+0000","last_active":"2024-09-11T22:36:09.630816+0000","last_peered":"2024-09-11T22:36:09.630816+0000","last_clean":"2024-09-11T22:36:09.630816+0000","last_became_active":"2024-09-11T22:21:02.034985+0000","last_became_peered":"2024-09-11T22:21:02.034985+0000","last_unstale":"2024-09-11T22:36:09.630816+0000","last_undegraded":"2024-09-11T22:36:09.630816+0000","last_fullsized":"2024-09-11T22:36:09.630816+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'21","last_scrub_stamp":"2024-09-11T22:36:09.630747+0000","last_deep_scrub":"28'21","last_deep_scrub_stamp":"2024-09-11T22:36:09.630747+0000","last_clean_scrub_stamp":"2024-09-11T22:36:09.630747+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:58.570412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"28'21","reported_seq":60,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:12.276233+0000","last_change":"2024-09-11T22:36:12.276254+0000","last_active":"2024-09-11T22:36:12.276233+0000","last_peered":"2024-09-11T22:36:12.276233+0000","last_clean":"2024-09-11T22:36:12.276233+0000","last_became_active":"2024-09-11T22:20:19.859755+0000","last_became_peered":"2024-09-11T22:20:19.859755+0000","last_unstale":"2024-09-11T22:36:12.276233+0000","last_undegraded":"2024-09-11T22:36:12.276233+0000","last_fullsized":"2024-09-11T22:36:12.276233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'21","last_scrub_stamp":"2024-09-11T22:36:12.276168+0000","last_deep_scrub":"28'21","last_deep_scrub_stamp":"2024-09-11T22:36:12.276168+0000","last_clean_scrub_stamp":"2024-09-11T22:36:12.276168+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:02.517435+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"28'24","reported_seq":63,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:02.738803+0000","last_change":"2024-09-11T22:36:02.738842+0000","last_active":"2024-09-11T22:36:02.738803+0000","last_peered":"2024-09-11T22:36:02.738803+0000","last_clean":"2024-09-11T22:36:02.738803+0000","last_became_active":"2024-09-11T22:20:19.853563+0000","last_became_peered":"2024-09-11T22:20:19.853563+0000","last_unstale":"2024-09-11T22:36:02.738803+0000","last_undegraded":"2024-09-11T22:36:02.738803+0000","last_fullsized":"2024-09-11T22:36:02.738803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'24","last_scrub_stamp":"2024-09-11T22:36:02.738691+0000","last_deep_scrub":"28'24","last_deep_scrub_stamp":"2024-09-11T22:36:02.738691+0000","last_clean_scrub_stamp":"2024-09-11T22:36:02.738691+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:48.445069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"28'25","reported_seq":64,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:11.182870+0000","last_change":"2024-09-11T22:36:11.182911+0000","last_active":"2024-09-11T22:36:11.182870+0000","last_peered":"2024-09-11T22:36:11.182870+0000","last_clean":"2024-09-11T22:36:11.182870+0000","last_became_active":"2024-09-11T22:20:19.848965+0000","last_became_peered":"2024-09-11T22:20:19.848965+0000","last_unstale":"2024-09-11T22:36:11.182870+0000","last_undegraded":"2024-09-11T22:36:11.182870+0000","last_fullsized":"2024-09-11T22:36:11.182870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'25","last_scrub_stamp":"2024-09-11T22:36:11.182786+0000","last_deep_scrub":"28'25","last_deep_scrub_stamp":"2024-09-11T22:36:11.182786+0000","last_clean_scrub_stamp":"2024-09-11T22:36:11.182786+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:03.323701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"28'17","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:08.068145+0000","last_change":"2024-09-11T22:36:08.068169+0000","last_active":"2024-09-11T22:36:08.068145+0000","last_peered":"2024-09-11T22:36:08.068145+0000","last_clean":"2024-09-11T22:36:08.068145+0000","last_became_active":"2024-09-11T22:20:19.858887+0000","last_became_peered":"2024-09-11T22:20:19.858887+0000","last_unstale":"2024-09-11T22:36:08.068145+0000","last_undegraded":"2024-09-11T22:36:08.068145+0000","last_fullsized":"2024-09-11T22:36:08.068145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'17","last_scrub_stamp":"2024-09-11T22:36:08.068061+0000","last_deep_scrub":"28'17","last_deep_scrub_stamp":"2024-09-11T22:36:08.068061+0000","last_clean_scrub_stamp":"2024-09-11T22:36:08.068061+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:44.189012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"28'18","reported_seq":57,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:13.569008+0000","last_change":"2024-09-11T22:36:13.569033+0000","last_active":"2024-09-11T22:36:13.569008+0000","last_peered":"2024-09-11T22:36:13.569008+0000","last_clean":"2024-09-11T22:36:13.569008+0000","last_became_active":"2024-09-11T22:20:19.861965+0000","last_became_peered":"2024-09-11T22:20:19.861965+0000","last_unstale":"2024-09-11T22:36:13.569008+0000","last_undegraded":"2024-09-11T22:36:13.569008+0000","last_fullsized":"2024-09-11T22:36:13.569008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'18","last_scrub_stamp":"2024-09-11T22:36:13.568922+0000","last_deep_scrub":"28'18","last_deep_scrub_stamp":"2024-09-11T22:36:13.568922+0000","last_clean_scrub_stamp":"2024-09-11T22:36:13.568922+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:12.067043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'29","reported_seq":68,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:12.611370+0000","last_change":"2024-09-11T22:36:12.611395+0000","last_active":"2024-09-11T22:36:12.611370+0000","last_peered":"2024-09-11T22:36:12.611370+0000","last_clean":"2024-09-11T22:36:12.611370+0000","last_became_active":"2024-09-11T22:20:19.861765+0000","last_became_peered":"2024-09-11T22:20:19.861765+0000","last_unstale":"2024-09-11T22:36:12.611370+0000","last_undegraded":"2024-09-11T22:36:12.611370+0000","last_fullsized":"2024-09-11T22:36:12.611370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'29","last_scrub_stamp":"2024-09-11T22:36:12.611266+0000","last_deep_scrub":"28'29","last_deep_scrub_stamp":"2024-09-11T22:36:12.611266+0000","last_clean_scrub_stamp":"2024-09-11T22:36:12.611266+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:43.805844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"28'27","reported_seq":66,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:18.591854+0000","last_change":"2024-09-11T22:36:18.591880+0000","last_active":"2024-09-11T22:36:18.591854+0000","last_peered":"2024-09-11T22:36:18.591854+0000","last_clean":"2024-09-11T22:36:18.591854+0000","last_became_active":"2024-09-11T22:20:19.864697+0000","last_became_peered":"2024-09-11T22:20:19.864697+0000","last_unstale":"2024-09-11T22:36:18.591854+0000","last_undegraded":"2024-09-11T22:36:18.591854+0000","last_fullsized":"2024-09-11T22:36:18.591854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'27","last_scrub_stamp":"2024-09-11T22:36:18.591769+0000","last_deep_scrub":"28'27","last_deep_scrub_stamp":"2024-09-11T22:36:18.591769+0000","last_clean_scrub_stamp":"2024-09-11T22:36:18.591769+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:36.014858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'14","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:03.058447+0000","last_change":"2024-09-11T22:36:03.058485+0000","last_active":"2024-09-11T22:36:03.058447+0000","last_peered":"2024-09-11T22:36:03.058447+0000","last_clean":"2024-09-11T22:36:03.058447+0000","last_became_active":"2024-09-11T22:20:19.861013+0000","last_became_peered":"2024-09-11T22:20:19.861013+0000","last_unstale":"2024-09-11T22:36:03.058447+0000","last_undegraded":"2024-09-11T22:36:03.058447+0000","last_fullsized":"2024-09-11T22:36:03.058447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'14","last_scrub_stamp":"2024-09-11T22:36:03.058371+0000","last_deep_scrub":"28'14","last_deep_scrub_stamp":"2024-09-11T22:36:03.058371+0000","last_clean_scrub_stamp":"2024-09-11T22:36:03.058371+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:26.218935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'14","reported_seq":53,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:13.539219+0000","last_change":"2024-09-11T22:36:13.539252+0000","last_active":"2024-09-11T22:36:13.539219+0000","last_peered":"2024-09-11T22:36:13.539219+0000","last_clean":"2024-09-11T22:36:13.539219+0000","last_became_active":"2024-09-11T22:20:19.857842+0000","last_became_peered":"2024-09-11T22:20:19.857842+0000","last_unstale":"2024-09-11T22:36:13.539219+0000","last_undegraded":"2024-09-11T22:36:13.539219+0000","last_fullsized":"2024-09-11T22:36:13.539219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'14","last_scrub_stamp":"2024-09-11T22:36:13.539138+0000","last_deep_scrub":"28'14","last_deep_scrub_stamp":"2024-09-11T22:36:13.539138+0000","last_clean_scrub_stamp":"2024-09-11T22:36:13.539138+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:41:26.910048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'16","reported_seq":55,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:03.600370+0000","last_change":"2024-09-11T22:36:03.600412+0000","last_active":"2024-09-11T22:36:03.600370+0000","last_peered":"2024-09-11T22:36:03.600370+0000","last_clean":"2024-09-11T22:36:03.600370+0000","last_became_active":"2024-09-11T22:20:19.859306+0000","last_became_peered":"2024-09-11T22:20:19.859306+0000","last_unstale":"2024-09-11T22:36:03.600370+0000","last_undegraded":"2024-09-11T22:36:03.600370+0000","last_fullsized":"2024-09-11T22:36:03.600370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'16","last_scrub_stamp":"2024-09-11T22:36:03.600236+0000","last_deep_scrub":"28'16","last_deep_scrub_stamp":"2024-09-11T22:36:03.600236+0000","last_clean_scrub_stamp":"2024-09-11T22:36:03.600236+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:31.528340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'19","reported_seq":58,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:11.564060+0000","last_change":"2024-09-11T22:36:11.564112+0000","last_active":"2024-09-11T22:36:11.564060+0000","last_peered":"2024-09-11T22:36:11.564060+0000","last_clean":"2024-09-11T22:36:11.564060+0000","last_became_active":"2024-09-11T22:20:19.848531+0000","last_became_peered":"2024-09-11T22:20:19.848531+0000","last_unstale":"2024-09-11T22:36:11.564060+0000","last_undegraded":"2024-09-11T22:36:11.564060+0000","last_fullsized":"2024-09-11T22:36:11.564060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'19","last_scrub_stamp":"2024-09-11T22:36:11.563965+0000","last_deep_scrub":"28'19","last_deep_scrub_stamp":"2024-09-11T22:36:11.563965+0000","last_clean_scrub_stamp":"2024-09-11T22:36:11.563965+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:02:42.805827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'15","reported_seq":56,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:15.508131+0000","last_change":"2024-09-11T22:36:15.508131+0000","last_active":"2024-09-11T22:36:15.508131+0000","last_peered":"2024-09-11T22:36:15.508131+0000","last_clean":"2024-09-11T22:36:15.508131+0000","last_became_active":"2024-09-11T22:20:19.865939+0000","last_became_peered":"2024-09-11T22:20:19.865939+0000","last_unstale":"2024-09-11T22:36:15.508131+0000","last_undegraded":"2024-09-11T22:36:15.508131+0000","last_fullsized":"2024-09-11T22:36:15.508131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'15","last_scrub_stamp":"2024-09-11T22:36:15.507992+0000","last_deep_scrub":"28'15","last_deep_scrub_stamp":"2024-09-11T22:36:15.507992+0000","last_clean_scrub_stamp":"2024-09-11T22:36:15.507992+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:02.639696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"28'19","reported_seq":59,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:06.672282+0000","last_change":"2024-09-11T22:36:06.672303+0000","last_active":"2024-09-11T22:36:06.672282+0000","last_peered":"2024-09-11T22:36:06.672282+0000","last_clean":"2024-09-11T22:36:06.672282+0000","last_became_active":"2024-09-11T22:20:19.857840+0000","last_became_peered":"2024-09-11T22:20:19.857840+0000","last_unstale":"2024-09-11T22:36:06.672282+0000","last_undegraded":"2024-09-11T22:36:06.672282+0000","last_fullsized":"2024-09-11T22:36:06.672282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'19","last_scrub_stamp":"2024-09-11T22:36:06.672216+0000","last_deep_scrub":"28'19","last_deep_scrub_stamp":"2024-09-11T22:36:06.672216+0000","last_clean_scrub_stamp":"2024-09-11T22:36:06.672216+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:50.525165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'10","reported_seq":50,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:11.320268+0000","last_change":"2024-09-11T22:36:11.320290+0000","last_active":"2024-09-11T22:36:11.320268+0000","last_peered":"2024-09-11T22:36:11.320268+0000","last_clean":"2024-09-11T22:36:11.320268+0000","last_became_active":"2024-09-11T22:20:19.857089+0000","last_became_peered":"2024-09-11T22:20:19.857089+0000","last_unstale":"2024-09-11T22:36:11.320268+0000","last_undegraded":"2024-09-11T22:36:11.320268+0000","last_fullsized":"2024-09-11T22:36:11.320268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'10","last_scrub_stamp":"2024-09-11T22:36:11.320197+0000","last_deep_scrub":"28'10","last_deep_scrub_stamp":"2024-09-11T22:36:11.320197+0000","last_clean_scrub_stamp":"2024-09-11T22:36:11.320197+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:33.646313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"28'16","reported_seq":42,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-09-11T22:36:10.646381+0000","last_change":"2024-09-11T22:36:10.646402+0000","last_active":"2024-09-11T22:36:10.646381+0000","last_peered":"2024-09-11T22:36:10.646381+0000","last_clean":"2024-09-11T22:36:10.646381+0000","last_became_active":"2024-09-11T22:21:02.035889+0000","last_became_peered":"2024-09-11T22:21:02.035889+0000","last_unstale":"2024-09-11T22:36:10.646381+0000","last_undegraded":"2024-09-11T22:36:10.646381+0000","last_fullsized":"2024-09-11T22:36:10.646381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'16","last_scrub_stamp":"2024-09-11T22:36:10.646315+0000","last_deep_scrub":"28'16","last_deep_scrub_stamp":"2024-09-11T22:36:10.646315+0000","last_clean_scrub_stamp":"2024-09-11T22:36:10.646315+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:38.574419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":877619,"num_write_kb":16615339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":191481,"ondisk_log_size":191481,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1274,"ondisk_log_size":1274,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":15005355,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":45,"num_read_kb":122,"num_write":3042,"num_write_kb":15742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18276352,"data_stored":30010710,"data_compressed":2661454,"data_compressed_allocated":3686400,"data_compressed_original":15572992,"omap_allocated":0,"internal_metadata":0},"log_size":2750,"ondisk_log_size":2750,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64828,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509641,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":969956,"kb_used_data":7316,"kb_used_omap":1,"kb_used_meta":962622,"kb_avail":93401884,"statfs":{"total":96636764160,"available":95643529216,"internally_reserved":0,"allocated":7491584,"data_stored":11425803,"data_compressed":849965,"data_compressed_allocated":1200128,"data_compressed_original":5332992,"omap_allocated":1590,"internal_metadata":985725386},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509642,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1137376,"kb_used_data":2128,"kb_used_omap":1,"kb_used_meta":1135230,"kb_avail":93234464,"statfs":{"total":96636764160,"available":95472091136,"internally_reserved":0,"allocated":2179072,"data_stored":4317172,"data_compressed":509786,"data_compressed_allocated":684032,"data_compressed_original":3010560,"omap_allocated":1594,"internal_metadata":1162475974},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509643,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":763716,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":763390,"kb_avail":93608124,"statfs":{"total":96636764160,"available":95854718976,"internally_reserved":0,"allocated":315392,"data_stored":122896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":781711813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509642,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1079244,"kb_used_data":3772,"kb_used_omap":1,"kb_used_meta":1075454,"kb_avail":93292596,"statfs":{"total":96636764160,"available":95531618304,"internally_reserved":0,"allocated":3862528,"data_stored":4316536,"data_compressed":162063,"data_compressed_allocated":282624,"data_compressed_original":925696,"omap_allocated":1595,"internal_metadata":1101265349},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509640,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1425948,"kb_used_data":4620,"kb_used_omap":1,"kb_used_meta":1421310,"kb_avail":92945892,"statfs":{"total":96636764160,"available":95176593408,"internally_reserved":0,"allocated":4730880,"data_stored":8606262,"data_compressed":892093,"data_compressed_allocated":1200128,"data_compressed_original":5267456,"omap_allocated":1593,"internal_metadata":1455421895},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542345,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":868180,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":867774,"kb_avail":93503660,"statfs":{"total":96636764160,"available":95747747840,"internally_reserved":0,"allocated":397312,"data_stored":216504,"data_compressed":3390,"data_compressed_allocated":4096,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":888601029},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542345,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1045612,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":1044158,"kb_avail":93326228,"statfs":{"total":96636764160,"available":95566057472,"internally_reserved":0,"allocated":1470464,"data_stored":3035955,"data_compressed":308985,"data_compressed_allocated":405504,"data_compressed_original":2166784,"omap_allocated":1595,"internal_metadata":1069218245},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575049,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1374984,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":1374654,"kb_avail":92996856,"statfs":{"total":96636764160,"available":95228780544,"internally_reserved":0,"allocated":319488,"data_stored":122462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":1407646149},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32414,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1110016,"data_stored":2324069,"data_compressed":276571,"data_compressed_allocated":360448,"data_compressed_original":1593344,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":94986,"data_compressed":3390,"data_compressed_allocated":4096,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4435968,"data_stored":8484744,"data_compressed":892093,"data_compressed_allocated":1200128,"data_compressed_original":5267456,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3567616,"data_stored":4195018,"data_compressed":162063,"data_compressed_allocated":282624,"data_compressed_original":925696,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1884160,"data_stored":4195654,"data_compressed":509786,"data_compressed_allocated":684032,"data_compressed_original":3010560,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7131136,"data_stored":10713917,"data_compressed":817551,"data_compressed_allocated":1155072,"data_compressed_original":4759552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T22:36:44.669 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-11T22:36:44.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.768+0000 7f96cf8d7640 1 Processor -- start 2024-09-11T22:36:44.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.768+0000 7f96cf8d7640 1 -- start start 2024-09-11T22:36:44.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.769+0000 7f96cf8d7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96c8157fc0 0x7f96c8073a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:44.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.769+0000 7f96cf8d7640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f96c80c9560 0x7f96c8067950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:44.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.769+0000 7f96cf8d7640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96c8072fd0 con 0x7f96c8067e90 2024-09-11T22:36:44.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.769+0000 7f96cf8d7640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f96c81583a0 con 0x7f96c80c9560 2024-09-11T22:36:44.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.769+0000 7f96cf8d7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f96c80c7980 con 0x7f96c8157fc0 2024-09-11T22:36:44.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.769+0000 7f96cce72640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f96c80c9560 0x7f96c8067950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:44.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.769+0000 7f96cce72640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f96c80c9560 0x7f96c8067950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45094/0 (socket says 172.21.15.100:45094) 2024-09-11T22:36:44.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.769+0000 7f96cce72640 1 -- 172.21.15.100:0/1159575562 learned_addr learned my addr 172.21.15.100:0/1159575562 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:44.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.769+0000 7f96cce72640 1 -- 172.21.15.100:0/1159575562 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96c8157fc0 msgr2=0x7f96c8073a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:44.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.769+0000 7f96cce72640 1 --2- 172.21.15.100:0/1159575562 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96c8157fc0 0x7f96c8073a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:44.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.769+0000 7f96cce72640 1 -- 172.21.15.100:0/1159575562 >> v1:172.21.15.167:6789/0 conn(0x7f96c8067e90 legacy=0x7f96c806eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:44.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.769+0000 7f96cce72640 1 -- 172.21.15.100:0/1159575562 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c80c7bd0 con 0x7f96c80c9560 2024-09-11T22:36:44.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.770+0000 7f96cce72640 1 --2- 172.21.15.100:0/1159575562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96c80c9560 0x7f96c8067950 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f96c80c7b00 tx=0x7f96b802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dccb92987edfdc8d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:44.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.770+0000 7f96bffff640 1 -- 172.21.15.100:0/1159575562 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b8037070 con 0x7f96c80c9560 2024-09-11T22:36:44.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.770+0000 7f96bffff640 1 -- 172.21.15.100:0/1159575562 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96b8032440 con 0x7f96c80c9560 2024-09-11T22:36:44.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.770+0000 7f96bffff640 1 -- 172.21.15.100:0/1159575562 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b8032810 con 0x7f96c80c9560 2024-09-11T22:36:44.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.771+0000 7f96cf8d7640 1 -- 172.21.15.100:0/1159575562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96c80c9560 msgr2=0x7f96c8067950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:44.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.771+0000 7f96cf8d7640 1 --2- 172.21.15.100:0/1159575562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96c80c9560 0x7f96c8067950 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f96c80c7b00 tx=0x7f96b802a290 comp rx=0 tx=0).stop 2024-09-11T22:36:44.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.771+0000 7f96cf8d7640 1 -- 172.21.15.100:0/1159575562 shutdown_connections 2024-09-11T22:36:44.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.771+0000 7f96cf8d7640 1 --2- 172.21.15.100:0/1159575562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96c80c9560 0x7f96c8067950 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:44.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.771+0000 7f96cf8d7640 1 --2- 172.21.15.100:0/1159575562 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96c8157fc0 0x7f96c8073a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:44.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.771+0000 7f96cf8d7640 1 -- 172.21.15.100:0/1159575562 >> 172.21.15.100:0/1159575562 conn(0x7f96c8070190 msgr2=0x7f96c80705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:44.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.771+0000 7f96cf8d7640 1 -- 172.21.15.100:0/1159575562 shutdown_connections 2024-09-11T22:36:44.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.771+0000 7f96cf8d7640 1 -- 172.21.15.100:0/1159575562 wait complete. 2024-09-11T22:36:44.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.772+0000 7f96cf8d7640 1 Processor -- start 2024-09-11T22:36:44.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.772+0000 7f96cf8d7640 1 -- start start 2024-09-11T22:36:44.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.773+0000 7f96cf8d7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96c8067e90 0x7f96c81f1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:44.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.773+0000 7f96cf8d7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96c80c9560 0x7f96c81f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:44.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.773+0000 7f96cf8d7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96c8157fc0 0x7f96c81f4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:44.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.773+0000 7f96cf8d7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f96c80c7eb0 con 0x7f96c8067e90 2024-09-11T22:36:44.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.773+0000 7f96cf8d7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f96c8073520 con 0x7f96c80c9560 2024-09-11T22:36:44.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.773+0000 7f96cf8d7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f96c80c8030 con 0x7f96c8157fc0 2024-09-11T22:36:44.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.773+0000 7f96cd673640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96c8067e90 0x7f96c81f1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:44.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.773+0000 7f96cd673640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96c8067e90 0x7f96c81f1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45100/0 (socket says 172.21.15.100:45100) 2024-09-11T22:36:44.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.773+0000 7f96cd673640 1 -- 172.21.15.100:0/1242197984 learned_addr learned my addr 172.21.15.100:0/1242197984 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:44.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.773+0000 7f96cce72640 1 --2- 172.21.15.100:0/1242197984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96c80c9560 0x7f96c81f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:44.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.773+0000 7f96cde74640 1 --2- 172.21.15.100:0/1242197984 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96c8157fc0 0x7f96c81f4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:44.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.773+0000 7f96cd673640 1 -- 172.21.15.100:0/1242197984 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96c8157fc0 msgr2=0x7f96c81f4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:44.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.773+0000 7f96cd673640 1 --2- 172.21.15.100:0/1242197984 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96c8157fc0 0x7f96c81f4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:44.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.773+0000 7f96cd673640 1 -- 172.21.15.100:0/1242197984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96c80c9560 msgr2=0x7f96c81f3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:44.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.773+0000 7f96cd673640 1 --2- 172.21.15.100:0/1242197984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96c80c9560 0x7f96c81f3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:44.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.773+0000 7f96cd673640 1 -- 172.21.15.100:0/1242197984 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c81f4c70 con 0x7f96c8067e90 2024-09-11T22:36:44.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.773+0000 7f96cce72640 1 --2- 172.21.15.100:0/1242197984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96c80c9560 0x7f96c81f3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:36:44.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.773+0000 7f96cd673640 1 --2- 172.21.15.100:0/1242197984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96c8067e90 0x7f96c81f1c80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f96c400b410 tx=0x7f96c400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:44.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.773+0000 7f96bdffb640 1 -- 172.21.15.100:0/1242197984 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4015020 con 0x7f96c8067e90 2024-09-11T22:36:44.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.773+0000 7f96bdffb640 1 -- 172.21.15.100:0/1242197984 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c4011850 con 0x7f96c8067e90 2024-09-11T22:36:44.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.773+0000 7f96bdffb640 1 -- 172.21.15.100:0/1242197984 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4011c40 con 0x7f96c8067e90 2024-09-11T22:36:44.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.773+0000 7f96cf8d7640 1 -- 172.21.15.100:0/1242197984 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c8150fd0 con 0x7f96c8067e90 2024-09-11T22:36:44.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.774+0000 7f96cf8d7640 1 -- 172.21.15.100:0/1242197984 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c8151590 con 0x7f96c8067e90 2024-09-11T22:36:44.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.775+0000 7f96cf8d7640 1 -- 172.21.15.100:0/1242197984 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96c80c3fb0 con 0x7f96c8067e90 2024-09-11T22:36:44.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.775+0000 7f96bdffb640 1 -- 172.21.15.100:0/1242197984 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f96c4018020 con 0x7f96c8067e90 2024-09-11T22:36:44.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.776+0000 7f96bdffb640 1 --2- 172.21.15.100:0/1242197984 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f96ac06be60 0x7f96ac06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:44.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.776+0000 7f96cce72640 1 --2- 172.21.15.100:0/1242197984 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f96ac06be60 0x7f96ac06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:44.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.776+0000 7f96bdffb640 1 -- 172.21.15.100:0/1242197984 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f96c408b170 con 0x7f96c8067e90 2024-09-11T22:36:44.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.776+0000 7f96cce72640 1 --2- 172.21.15.100:0/1242197984 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f96ac06be60 0x7f96ac06e320 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f96b8034000 tx=0x7f96b802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:44.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.780+0000 7f96bdffb640 1 -- 172.21.15.100:0/1242197984 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f96c401f020 con 0x7f96c8067e90 2024-09-11T22:36:44.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.952+0000 7f96cf8d7640 1 -- 172.21.15.100:0/1242197984 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f96c80c3b80 con 0x7f96c8067e90 2024-09-11T22:36:44.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.955+0000 7f96bdffb640 1 -- 172.21.15.100:0/1242197984 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f96c40172c0 con 0x7f96c8067e90 2024-09-11T22:36:44.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.956+0000 7f96bdffb640 1 -- 172.21.15.100:0/1242197984 <== mon.0 v2:172.21.15.100:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f96c4059000 con 0x7f96c8067e90 2024-09-11T22:36:44.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.958+0000 7f96cf8d7640 1 -- 172.21.15.100:0/1242197984 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f96ac06be60 msgr2=0x7f96ac06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:44.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.958+0000 7f96cf8d7640 1 --2- 172.21.15.100:0/1242197984 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f96ac06be60 0x7f96ac06e320 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f96b8034000 tx=0x7f96b802e000 comp rx=0 tx=0).stop 2024-09-11T22:36:44.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.958+0000 7f96cf8d7640 1 -- 172.21.15.100:0/1242197984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96c8067e90 msgr2=0x7f96c81f1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.958+0000 7f96cf8d7640 1 --2- 172.21.15.100:0/1242197984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96c8067e90 0x7f96c81f1c80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f96c400b410 tx=0x7f96c400b8d0 comp rx=0 tx=0).stop 2024-09-11T22:36:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.958+0000 7f96cf8d7640 1 -- 172.21.15.100:0/1242197984 shutdown_connections 2024-09-11T22:36:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.958+0000 7f96cf8d7640 1 --2- 172.21.15.100:0/1242197984 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f96ac06be60 0x7f96ac06e320 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.958+0000 7f96cf8d7640 1 --2- 172.21.15.100:0/1242197984 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96c8157fc0 0x7f96c81f4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.958+0000 7f96cf8d7640 1 --2- 172.21.15.100:0/1242197984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96c80c9560 0x7f96c81f3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.958+0000 7f96cf8d7640 1 --2- 172.21.15.100:0/1242197984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96c8067e90 0x7f96c81f1c80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.958+0000 7f96cf8d7640 1 -- 172.21.15.100:0/1242197984 >> 172.21.15.100:0/1242197984 conn(0x7f96c8070190 msgr2=0x7f96c8158530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.959+0000 7f96cf8d7640 1 -- 172.21.15.100:0/1242197984 shutdown_connections 2024-09-11T22:36:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:44.959+0000 7f96cf8d7640 1 -- 172.21.15.100:0/1242197984 wait complete. 2024-09-11T22:36:44.970 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T22:36:44.971 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:36:45.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.070+0000 7fb63e2b7640 1 Processor -- start 2024-09-11T22:36:45.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.070+0000 7fb63e2b7640 1 -- start start 2024-09-11T22:36:45.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.070+0000 7fb63e2b7640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb6380c8020 0x7fb63815de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.070+0000 7fb63e2b7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6380c98d0 0x7fb6380c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.070+0000 7fb63e2b7640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6380c5a20 con 0x7fb6380caf70 2024-09-11T22:36:45.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.070+0000 7fb63e2b7640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb63815ed80 con 0x7fb6380c8020 2024-09-11T22:36:45.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.070+0000 7fb63e2b7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb63815e4e0 con 0x7fb6380c98d0 2024-09-11T22:36:45.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.071+0000 7fb62ffff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb6380c8020 0x7fb63815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.071+0000 7fb637fff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb6380caf70 0x7fb63815b280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58974/0 (socket says 172.21.15.100:58974) 2024-09-11T22:36:45.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.071+0000 7fb637fff640 1 -- 172.21.15.100:0/3201369826 learned_addr learned my addr 172.21.15.100:0/3201369826 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:36:45.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.071+0000 7fb63c854640 1 --2- 172.21.15.100:0/3201369826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6380c98d0 0x7fb6380c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.071+0000 7fb62ffff640 1 -- 172.21.15.100:0/3201369826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6380c98d0 msgr2=0x7fb6380c9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:45.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.071+0000 7fb62ffff640 1 --2- 172.21.15.100:0/3201369826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6380c98d0 0x7fb6380c9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.071+0000 7fb62ffff640 1 -- 172.21.15.100:0/3201369826 >> v1:172.21.15.100:6789/0 conn(0x7fb6380caf70 legacy=0x7fb63815b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.071+0000 7fb6377fe640 1 -- 172.21.15.100:0/3201369826 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2404352556 0 0) 0x7fb6380c5a20 con 0x7fb6380caf70 2024-09-11T22:36:45.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.071+0000 7fb62ffff640 1 -- 172.21.15.100:0/3201369826 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63815e7c0 con 0x7fb6380c8020 2024-09-11T22:36:45.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.072+0000 7fb62ffff640 1 --2- 172.21.15.100:0/3201369826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6380c8020 0x7fb63815de50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb6200097a0 tx=0x7fb62002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca23e2574b3551fb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:45.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.072+0000 7fb6377fe640 1 -- 172.21.15.100:0/3201369826 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb620037070 con 0x7fb6380c8020 2024-09-11T22:36:45.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.072+0000 7fb6377fe640 1 -- 172.21.15.100:0/3201369826 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb620032440 con 0x7fb6380c8020 2024-09-11T22:36:45.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.072+0000 7fb6377fe640 1 -- 172.21.15.100:0/3201369826 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb620032830 con 0x7fb6380c8020 2024-09-11T22:36:45.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.072+0000 7fb63e2b7640 1 -- 172.21.15.100:0/3201369826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6380c8020 msgr2=0x7fb63815de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.072+0000 7fb63e2b7640 1 --2- 172.21.15.100:0/3201369826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6380c8020 0x7fb63815de50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb6200097a0 tx=0x7fb62002a210 comp rx=0 tx=0).stop 2024-09-11T22:36:45.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.072+0000 7fb63e2b7640 1 -- 172.21.15.100:0/3201369826 shutdown_connections 2024-09-11T22:36:45.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.072+0000 7fb63e2b7640 1 --2- 172.21.15.100:0/3201369826 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6380c98d0 0x7fb6380c9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.072+0000 7fb63e2b7640 1 --2- 172.21.15.100:0/3201369826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6380c8020 0x7fb63815de50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.073+0000 7fb63e2b7640 1 -- 172.21.15.100:0/3201369826 >> 172.21.15.100:0/3201369826 conn(0x7fb638073900 msgr2=0x7fb638073ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:45.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.073+0000 7fb63e2b7640 1 -- 172.21.15.100:0/3201369826 shutdown_connections 2024-09-11T22:36:45.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.073+0000 7fb63e2b7640 1 -- 172.21.15.100:0/3201369826 wait complete. 2024-09-11T22:36:45.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.074+0000 7fb63e2b7640 1 Processor -- start 2024-09-11T22:36:45.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.074+0000 7fb63e2b7640 1 -- start start 2024-09-11T22:36:45.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.074+0000 7fb63e2b7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6380c8020 0x7fb638154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.074+0000 7fb63e2b7640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6380c98d0 0x7fb638159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.074+0000 7fb63e2b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6380caf70 0x7fb6380cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.074+0000 7fb63e2b7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb63815ad60 con 0x7fb6380caf70 2024-09-11T22:36:45.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.074+0000 7fb63e2b7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb63815aa80 con 0x7fb6380c8020 2024-09-11T22:36:45.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.074+0000 7fb63e2b7640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fb6380cb350 con 0x7fb6380c98d0 2024-09-11T22:36:45.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.075+0000 7fb63c854640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6380caf70 0x7fb6380cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.075+0000 7fb63c854640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6380caf70 0x7fb6380cbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45122/0 (socket says 172.21.15.100:45122) 2024-09-11T22:36:45.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.075+0000 7fb63c854640 1 -- 172.21.15.100:0/2853955996 learned_addr learned my addr 172.21.15.100:0/2853955996 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:45.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.075+0000 7fb62ffff640 1 --2- 172.21.15.100:0/2853955996 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6380c98d0 0x7fb638159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.075+0000 7fb637fff640 1 --2- 172.21.15.100:0/2853955996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6380c8020 0x7fb638154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.075+0000 7fb63c854640 1 -- 172.21.15.100:0/2853955996 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6380c98d0 msgr2=0x7fb638159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.075+0000 7fb63c854640 1 --2- 172.21.15.100:0/2853955996 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6380c98d0 0x7fb638159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.075+0000 7fb63c854640 1 -- 172.21.15.100:0/2853955996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6380c8020 msgr2=0x7fb638154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.075+0000 7fb63c854640 1 --2- 172.21.15.100:0/2853955996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6380c8020 0x7fb638154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.075+0000 7fb63c854640 1 -- 172.21.15.100:0/2853955996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb638150ae0 con 0x7fb6380caf70 2024-09-11T22:36:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.075+0000 7fb63c854640 1 --2- 172.21.15.100:0/2853955996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6380caf70 0x7fb6380cbf50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb630009dd0 tx=0x7fb63000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.075+0000 7fb6357fa640 1 -- 172.21.15.100:0/2853955996 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb630018020 con 0x7fb6380caf70 2024-09-11T22:36:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.075+0000 7fb6357fa640 1 -- 172.21.15.100:0/2853955996 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb630014480 con 0x7fb6380caf70 2024-09-11T22:36:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.075+0000 7fb63e2b7640 1 -- 172.21.15.100:0/2853955996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6381f1020 con 0x7fb6380caf70 2024-09-11T22:36:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.075+0000 7fb6357fa640 1 -- 172.21.15.100:0/2853955996 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb630014890 con 0x7fb6380caf70 2024-09-11T22:36:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.075+0000 7fb63e2b7640 1 -- 172.21.15.100:0/2853955996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6381f0540 con 0x7fb6380caf70 2024-09-11T22:36:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.076+0000 7fb63e2b7640 1 -- 172.21.15.100:0/2853955996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6380c3090 con 0x7fb6380caf70 2024-09-11T22:36:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.077+0000 7fb6357fa640 1 -- 172.21.15.100:0/2853955996 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb630005d10 con 0x7fb6380caf70 2024-09-11T22:36:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.077+0000 7fb6357fa640 1 --2- 172.21.15.100:0/2853955996 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb61806be30 0x7fb61806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.077+0000 7fb6357fa640 1 -- 172.21.15.100:0/2853955996 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7fb63008bdf0 con 0x7fb6380caf70 2024-09-11T22:36:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.077+0000 7fb637fff640 1 --2- 172.21.15.100:0/2853955996 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb61806be30 0x7fb61806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.078+0000 7fb637fff640 1 --2- 172.21.15.100:0/2853955996 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb61806be30 0x7fb61806e2f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb628000f60 tx=0x7fb628009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:45.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.082+0000 7fb6357fa640 1 -- 172.21.15.100:0/2853955996 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb630022070 con 0x7fb6380caf70 2024-09-11T22:36:45.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.290+0000 7fb63e2b7640 1 -- 172.21.15.100:0/2853955996 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb63815bec0 con 0x7fb6380caf70 2024-09-11T22:36:45.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.291+0000 7fb6357fa640 1 -- 172.21.15.100:0/2853955996 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6926 (secure 0 0 0) 0x7fb630010040 con 0x7fb6380caf70 2024-09-11T22:36:45.292 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:36:45.292 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":14,"btime":"2024-09-11T22:20:52:989866+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2075802330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":2075802330},{"type":"v1","addr":"172.21.15.100:6837","nonce":2075802330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/1727733473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1727733473},{"type":"v1","addr":"172.21.15.167:6836","nonce":1727733473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/880809662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":880809662},{"type":"v1","addr":"172.21.15.167:6837","nonce":880809662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:19.171222+0000","modified":"2024-09-11T22:20:52.989862+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4296,"mds_1":4281,"mds_2":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.100:6836/1912241808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1912241808},{"type":"v1","addr":"172.21.15.100:6836","nonce":1912241808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4281":{"gid":4281,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6839/3236256661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3236256661},{"type":"v1","addr":"172.21.15.100:6839","nonce":3236256661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4296":{"gid":4296,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6834/1651678197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1651678197},{"type":"v1","addr":"172.21.15.167:6834","nonce":1651678197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4275,4281,4296]},"id":1}]} 2024-09-11T22:36:45.292 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 14 2024-09-11T22:36:45.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.293+0000 7fb63e2b7640 1 -- 172.21.15.100:0/2853955996 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb61806be30 msgr2=0x7fb61806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.293+0000 7fb63e2b7640 1 --2- 172.21.15.100:0/2853955996 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb61806be30 0x7fb61806e2f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb628000f60 tx=0x7fb628009040 comp rx=0 tx=0).stop 2024-09-11T22:36:45.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.293+0000 7fb63e2b7640 1 -- 172.21.15.100:0/2853955996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6380caf70 msgr2=0x7fb6380cbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.293+0000 7fb63e2b7640 1 --2- 172.21.15.100:0/2853955996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6380caf70 0x7fb6380cbf50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb630009dd0 tx=0x7fb63000c490 comp rx=0 tx=0).stop 2024-09-11T22:36:45.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.293+0000 7fb63e2b7640 1 -- 172.21.15.100:0/2853955996 shutdown_connections 2024-09-11T22:36:45.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.293+0000 7fb63e2b7640 1 --2- 172.21.15.100:0/2853955996 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fb61806be30 0x7fb61806e2f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.293+0000 7fb63e2b7640 1 --2- 172.21.15.100:0/2853955996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6380caf70 0x7fb6380cbf50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.293+0000 7fb63e2b7640 1 --2- 172.21.15.100:0/2853955996 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb6380c98d0 0x7fb638159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.293+0000 7fb63e2b7640 1 --2- 172.21.15.100:0/2853955996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb6380c8020 0x7fb638154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.293+0000 7fb63e2b7640 1 -- 172.21.15.100:0/2853955996 >> 172.21.15.100:0/2853955996 conn(0x7fb638073900 msgr2=0x7fb638071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:45.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.293+0000 7fb63e2b7640 1 -- 172.21.15.100:0/2853955996 shutdown_connections 2024-09-11T22:36:45.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.293+0000 7fb63e2b7640 1 -- 172.21.15.100:0/2853955996 wait complete. 2024-09-11T22:36:45.305 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-11T22:36:45.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.403+0000 7f0fd3386640 1 Processor -- start 2024-09-11T22:36:45.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.403+0000 7f0fd3386640 1 -- start start 2024-09-11T22:36:45.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.404+0000 7f0fd3386640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0fcc0cd1b0 0x7f0fcc1512d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.404+0000 7f0fd3386640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0fcc06bc10 0x7f0fcc151810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.404+0000 7f0fd3386640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fcc0c7320 0x7f0fcc157d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.404+0000 7f0fd3386640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f0fcc06d490 con 0x7f0fcc06bc10 2024-09-11T22:36:45.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.404+0000 7f0fd3386640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f0fcc06c530 con 0x7f0fcc0cd1b0 2024-09-11T22:36:45.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.404+0000 7f0fd3386640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0fcc06c810 con 0x7f0fcc0c7320 2024-09-11T22:36:45.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.404+0000 7f0fd0921640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0fcc06bc10 0x7f0fcc151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.404+0000 7f0fd0921640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0fcc06bc10 0x7f0fcc151810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45132/0 (socket says 172.21.15.100:45132) 2024-09-11T22:36:45.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.404+0000 7f0fd0921640 1 -- 172.21.15.100:0/2813057503 learned_addr learned my addr 172.21.15.100:0/2813057503 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:45.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.404+0000 7f0fd0921640 1 -- 172.21.15.100:0/2813057503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fcc0c7320 msgr2=0x7f0fcc157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:45.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.404+0000 7f0fd0921640 1 --2- 172.21.15.100:0/2813057503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fcc0c7320 0x7f0fcc157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.404+0000 7f0fd0921640 1 -- 172.21.15.100:0/2813057503 >> v2:172.21.15.167:3300/0 conn(0x7f0fcc0cd1b0 msgr2=0x7f0fcc1512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:45.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.404+0000 7f0fd0921640 1 --2- 172.21.15.100:0/2813057503 >> v2:172.21.15.167:3300/0 conn(0x7f0fcc0cd1b0 0x7f0fcc1512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.404+0000 7f0fd0921640 1 -- 172.21.15.100:0/2813057503 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fcc06ced0 con 0x7f0fcc06bc10 2024-09-11T22:36:45.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.405+0000 7f0fd0921640 1 --2- 172.21.15.100:0/2813057503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fcc06bc10 0x7f0fcc151810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc06cea0 tx=0x7f0fc802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a875a0aae346784 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:45.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.405+0000 7f0fc3fff640 1 -- 172.21.15.100:0/2813057503 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc8037070 con 0x7f0fcc06bc10 2024-09-11T22:36:45.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.405+0000 7f0fc3fff640 1 -- 172.21.15.100:0/2813057503 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0fc8032440 con 0x7f0fcc06bc10 2024-09-11T22:36:45.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.405+0000 7f0fc3fff640 1 -- 172.21.15.100:0/2813057503 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc8032830 con 0x7f0fcc06bc10 2024-09-11T22:36:45.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.406+0000 7f0fd3386640 1 -- 172.21.15.100:0/2813057503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fcc06bc10 msgr2=0x7f0fcc151810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.406+0000 7f0fd3386640 1 --2- 172.21.15.100:0/2813057503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fcc06bc10 0x7f0fcc151810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc06cea0 tx=0x7f0fc802a1e0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.406+0000 7f0fd3386640 1 -- 172.21.15.100:0/2813057503 shutdown_connections 2024-09-11T22:36:45.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.406+0000 7f0fd3386640 1 --2- 172.21.15.100:0/2813057503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fcc0c7320 0x7f0fcc157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.406+0000 7f0fd3386640 1 --2- 172.21.15.100:0/2813057503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fcc06bc10 0x7f0fcc151810 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.406+0000 7f0fd3386640 1 --2- 172.21.15.100:0/2813057503 >> v2:172.21.15.167:3300/0 conn(0x7f0fcc0cd1b0 0x7f0fcc1512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.406+0000 7f0fd3386640 1 -- 172.21.15.100:0/2813057503 >> 172.21.15.100:0/2813057503 conn(0x7f0fcc072960 msgr2=0x7f0fcc072d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:45.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.406+0000 7f0fd3386640 1 -- 172.21.15.100:0/2813057503 shutdown_connections 2024-09-11T22:36:45.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.406+0000 7f0fd3386640 1 -- 172.21.15.100:0/2813057503 wait complete. 2024-09-11T22:36:45.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.407+0000 7f0fd3386640 1 Processor -- start 2024-09-11T22:36:45.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.407+0000 7f0fd3386640 1 -- start start 2024-09-11T22:36:45.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.408+0000 7f0fd3386640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fcc06bc10 0x7f0fcc13ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.408+0000 7f0fd3386640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fcc0c7320 0x7f0fcc0cc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.408+0000 7f0fd3386640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fcc0cd1b0 0x7f0fcc155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.408+0000 7f0fd3386640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0fcc06cc50 con 0x7f0fcc06bc10 2024-09-11T22:36:45.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.408+0000 7f0fd3386640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0fcc157800 con 0x7f0fcc0cd1b0 2024-09-11T22:36:45.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.408+0000 7f0fd3386640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f0fcc0cd590 con 0x7f0fcc0c7320 2024-09-11T22:36:45.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.408+0000 7f0fd1122640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fcc06bc10 0x7f0fcc13ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.408+0000 7f0fd1122640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fcc06bc10 0x7f0fcc13ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45144/0 (socket says 172.21.15.100:45144) 2024-09-11T22:36:45.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.408+0000 7f0fd1122640 1 -- 172.21.15.100:0/3920262049 learned_addr learned my addr 172.21.15.100:0/3920262049 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:45.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.408+0000 7f0fd0921640 1 --2- 172.21.15.100:0/3920262049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fcc0c7320 0x7f0fcc0cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.408+0000 7f0fd1923640 1 --2- 172.21.15.100:0/3920262049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fcc0cd1b0 0x7f0fcc155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.408+0000 7f0fd1122640 1 -- 172.21.15.100:0/3920262049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fcc0c7320 msgr2=0x7f0fcc0cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.408+0000 7f0fd1122640 1 --2- 172.21.15.100:0/3920262049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fcc0c7320 0x7f0fcc0cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.408+0000 7f0fd1122640 1 -- 172.21.15.100:0/3920262049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fcc0cd1b0 msgr2=0x7f0fcc155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.408+0000 7f0fd1122640 1 --2- 172.21.15.100:0/3920262049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fcc0cd1b0 0x7f0fcc155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.408+0000 7f0fd1122640 1 -- 172.21.15.100:0/3920262049 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fcc140520 con 0x7f0fcc06bc10 2024-09-11T22:36:45.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.408+0000 7f0fd1923640 1 --2- 172.21.15.100:0/3920262049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fcc0cd1b0 0x7f0fcc155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T22:36:45.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.408+0000 7f0fd0921640 1 --2- 172.21.15.100:0/3920262049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fcc0c7320 0x7f0fcc0cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T22:36:45.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.408+0000 7f0fd1122640 1 --2- 172.21.15.100:0/3920262049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fcc06bc10 0x7f0fcc13ffe0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00b4d0 tx=0x7f0fbc00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:45.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.409+0000 7f0fc1ffb640 1 -- 172.21.15.100:0/3920262049 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc014070 con 0x7f0fcc06bc10 2024-09-11T22:36:45.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.409+0000 7f0fc1ffb640 1 -- 172.21.15.100:0/3920262049 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0fbc010870 con 0x7f0fcc06bc10 2024-09-11T22:36:45.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.409+0000 7f0fd3386640 1 -- 172.21.15.100:0/3920262049 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fcc067d50 con 0x7f0fcc06bc10 2024-09-11T22:36:45.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.409+0000 7f0fc1ffb640 1 -- 172.21.15.100:0/3920262049 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc010c80 con 0x7f0fcc06bc10 2024-09-11T22:36:45.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.409+0000 7f0fd3386640 1 -- 172.21.15.100:0/3920262049 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fcc13f220 con 0x7f0fcc06bc10 2024-09-11T22:36:45.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.410+0000 7f0fd3386640 1 -- 172.21.15.100:0/3920262049 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fcc0c4530 con 0x7f0fcc06bc10 2024-09-11T22:36:45.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.411+0000 7f0fc1ffb640 1 -- 172.21.15.100:0/3920262049 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0fbc017070 con 0x7f0fcc06bc10 2024-09-11T22:36:45.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.411+0000 7f0fc1ffb640 1 --2- 172.21.15.100:0/3920262049 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0fb006be30 0x7f0fb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.411+0000 7f0fd0921640 1 --2- 172.21.15.100:0/3920262049 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0fb006be30 0x7f0fb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.411+0000 7f0fc1ffb640 1 -- 172.21.15.100:0/3920262049 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f0fbc08b100 con 0x7f0fcc06bc10 2024-09-11T22:36:45.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.412+0000 7f0fd0921640 1 --2- 172.21.15.100:0/3920262049 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0fb006be30 0x7f0fb006e2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8034000 tx=0x7f0fc802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:45.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.416+0000 7f0fc1ffb640 1 -- 172.21.15.100:0/3920262049 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0fbc059600 con 0x7f0fcc06bc10 2024-09-11T22:36:45.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.623+0000 7f0fd3386640 1 -- 172.21.15.100:0/3920262049 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0fcc0c79b0 con 0x7f0fcc06bc10 2024-09-11T22:36:45.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.623+0000 7f0fc1ffb640 1 -- 172.21.15.100:0/3920262049 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6926 (secure 0 0 0) 0x7f0fbc010e20 con 0x7f0fcc06bc10 2024-09-11T22:36:45.625 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:36:45.625 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":14,"btime":"2024-09-11T22:20:52:989866+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/2075802330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":2075802330},{"type":"v1","addr":"172.21.15.100:6837","nonce":2075802330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/1727733473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1727733473},{"type":"v1","addr":"172.21.15.167:6836","nonce":1727733473}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4265,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/880809662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6833","nonce":880809662},{"type":"v1","addr":"172.21.15.167:6837","nonce":880809662}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T22:20:19.171222+0000","modified":"2024-09-11T22:20:52.989862+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4296,"mds_1":4281,"mds_2":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"a","rank":2,"incarnation":13,"state":"up:active","state_seq":11,"addr":"172.21.15.100:6836/1912241808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1912241808},{"type":"v1","addr":"172.21.15.100:6836","nonce":1912241808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4281":{"gid":4281,"name":"e","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6839/3236256661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3236256661},{"type":"v1","addr":"172.21.15.100:6839","nonce":3236256661}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4296":{"gid":4296,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6834/1651678197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":1651678197},{"type":"v1","addr":"172.21.15.167:6834","nonce":1651678197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4275,4281,4296]},"id":1}]} 2024-09-11T22:36:45.625 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 14 2024-09-11T22:36:45.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.625+0000 7f0fd3386640 1 -- 172.21.15.100:0/3920262049 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0fb006be30 msgr2=0x7f0fb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.625+0000 7f0fd3386640 1 --2- 172.21.15.100:0/3920262049 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0fb006be30 0x7f0fb006e2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8034000 tx=0x7f0fc802e000 comp rx=0 tx=0).stop 2024-09-11T22:36:45.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.625+0000 7f0fd3386640 1 -- 172.21.15.100:0/3920262049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fcc06bc10 msgr2=0x7f0fcc13ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.625+0000 7f0fd3386640 1 --2- 172.21.15.100:0/3920262049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fcc06bc10 0x7f0fcc13ffe0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00b4d0 tx=0x7f0fbc00b990 comp rx=0 tx=0).stop 2024-09-11T22:36:45.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.626+0000 7f0fd3386640 1 -- 172.21.15.100:0/3920262049 shutdown_connections 2024-09-11T22:36:45.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.626+0000 7f0fd3386640 1 --2- 172.21.15.100:0/3920262049 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f0fb006be30 0x7f0fb006e2f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.626+0000 7f0fd3386640 1 --2- 172.21.15.100:0/3920262049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0fcc0cd1b0 0x7f0fcc155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.626+0000 7f0fd3386640 1 --2- 172.21.15.100:0/3920262049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fcc0c7320 0x7f0fcc0cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.626+0000 7f0fd3386640 1 --2- 172.21.15.100:0/3920262049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fcc06bc10 0x7f0fcc13ffe0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.626+0000 7f0fd3386640 1 -- 172.21.15.100:0/3920262049 >> 172.21.15.100:0/3920262049 conn(0x7f0fcc072960 msgr2=0x7f0fcc14aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:45.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.626+0000 7f0fd3386640 1 -- 172.21.15.100:0/3920262049 shutdown_connections 2024-09-11T22:36:45.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.626+0000 7f0fd3386640 1 -- 172.21.15.100:0/3920262049 wait complete. 2024-09-11T22:36:45.638 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T22:36:45.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.737+0000 7f3d53080640 1 Processor -- start 2024-09-11T22:36:45.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.737+0000 7f3d53080640 1 -- start start 2024-09-11T22:36:45.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.737+0000 7f3d53080640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3d4c06fbb0 0x7f3d4c15b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.737+0000 7f3d53080640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d4c0679f0 con 0x7f3d4c06d1e0 2024-09-11T22:36:45.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.738+0000 7f3d53080640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d4c067c90 con 0x7f3d4c154a70 2024-09-11T22:36:45.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.738+0000 7f3d53080640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f3d4c15b8d0 con 0x7f3d4c06fbb0 2024-09-11T22:36:45.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.738+0000 7f3d5161d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3d4c06fbb0 0x7f3d4c15b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.738+0000 7f3d4bfff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3d4c06d1e0 0x7f3d4c0aee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58990/0 (socket says 172.21.15.100:58990) 2024-09-11T22:36:45.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.738+0000 7f3d4bfff640 1 -- 172.21.15.100:0/4233236380 learned_addr learned my addr 172.21.15.100:0/4233236380 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:36:45.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.738+0000 7f3d5161d640 1 -- 172.21.15.100:0/4233236380 >> v1:172.21.15.167:6789/0 conn(0x7f3d4c154a70 legacy=0x7f3d4c06c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.738+0000 7f3d5161d640 1 -- 172.21.15.100:0/4233236380 >> v1:172.21.15.100:6789/0 conn(0x7f3d4c06d1e0 legacy=0x7f3d4c0aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.738+0000 7f3d5161d640 1 -- 172.21.15.100:0/4233236380 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d4c067f70 con 0x7f3d4c06fbb0 2024-09-11T22:36:45.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.738+0000 7f3d4b7fe640 1 -- 172.21.15.100:0/4233236380 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 487302990 0 0) 0x7f3d4c0679f0 con 0x7f3d4c06d1e0 2024-09-11T22:36:45.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.739+0000 7f3d5161d640 1 --2- 172.21.15.100:0/4233236380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d4c06fbb0 0x7f3d4c15b390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3d44009d90 tx=0x7f3d4402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcfae329c2c79b4d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:45.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.739+0000 7f3d4b7fe640 1 -- 172.21.15.100:0/4233236380 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d44007740 con 0x7f3d4c06fbb0 2024-09-11T22:36:45.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.739+0000 7f3d4b7fe640 1 -- 172.21.15.100:0/4233236380 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3d440078e0 con 0x7f3d4c06fbb0 2024-09-11T22:36:45.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.739+0000 7f3d4b7fe640 1 -- 172.21.15.100:0/4233236380 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d44007cd0 con 0x7f3d4c06fbb0 2024-09-11T22:36:45.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.739+0000 7f3d53080640 1 -- 172.21.15.100:0/4233236380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d4c06fbb0 msgr2=0x7f3d4c15b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.739+0000 7f3d53080640 1 --2- 172.21.15.100:0/4233236380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d4c06fbb0 0x7f3d4c15b390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3d44009d90 tx=0x7f3d4402a6f0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.739+0000 7f3d53080640 1 -- 172.21.15.100:0/4233236380 shutdown_connections 2024-09-11T22:36:45.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.739+0000 7f3d53080640 1 --2- 172.21.15.100:0/4233236380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d4c06fbb0 0x7f3d4c15b390 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.739+0000 7f3d53080640 1 -- 172.21.15.100:0/4233236380 >> 172.21.15.100:0/4233236380 conn(0x7f3d4c0c9d00 msgr2=0x7f3d4c0ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:45.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.739+0000 7f3d53080640 1 -- 172.21.15.100:0/4233236380 shutdown_connections 2024-09-11T22:36:45.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.739+0000 7f3d53080640 1 -- 172.21.15.100:0/4233236380 wait complete. 2024-09-11T22:36:45.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.741+0000 7f3d53080640 1 Processor -- start 2024-09-11T22:36:45.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.741+0000 7f3d53080640 1 -- start start 2024-09-11T22:36:45.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.741+0000 7f3d53080640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d4c06d1e0 0x7f3d4c1e33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.741+0000 7f3d53080640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d4c06fbb0 0x7f3d4c1e20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.741+0000 7f3d53080640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d4c154a70 0x7f3d4c1f0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.741+0000 7f3d53080640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4c0ae8f0 con 0x7f3d4c06d1e0 2024-09-11T22:36:45.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.741+0000 7f3d53080640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4c068530 con 0x7f3d4c154a70 2024-09-11T22:36:45.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.741+0000 7f3d53080640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3d4c06cdc0 con 0x7f3d4c06fbb0 2024-09-11T22:36:45.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.741+0000 7f3d50e1c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d4c06d1e0 0x7f3d4c1e33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.742+0000 7f3d50e1c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d4c06d1e0 0x7f3d4c1e33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45164/0 (socket says 172.21.15.100:45164) 2024-09-11T22:36:45.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.742+0000 7f3d50e1c640 1 -- 172.21.15.100:0/3753696109 learned_addr learned my addr 172.21.15.100:0/3753696109 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:45.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.742+0000 7f3d5161d640 1 --2- 172.21.15.100:0/3753696109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d4c154a70 0x7f3d4c1f0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.742+0000 7f3d4bfff640 1 --2- 172.21.15.100:0/3753696109 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d4c06fbb0 0x7f3d4c1e20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.742+0000 7f3d50e1c640 1 -- 172.21.15.100:0/3753696109 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d4c06fbb0 msgr2=0x7f3d4c1e20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.742+0000 7f3d50e1c640 1 --2- 172.21.15.100:0/3753696109 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d4c06fbb0 0x7f3d4c1e20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.742+0000 7f3d50e1c640 1 -- 172.21.15.100:0/3753696109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d4c154a70 msgr2=0x7f3d4c1f0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.742+0000 7f3d50e1c640 1 --2- 172.21.15.100:0/3753696109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d4c154a70 0x7f3d4c1f0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.742+0000 7f3d50e1c640 1 -- 172.21.15.100:0/3753696109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d4c14fe00 con 0x7f3d4c06d1e0 2024-09-11T22:36:45.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.742+0000 7f3d50e1c640 1 --2- 172.21.15.100:0/3753696109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d4c06d1e0 0x7f3d4c1e33d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000c400 tx=0x7f3d4000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:45.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.742+0000 7f3d497fa640 1 -- 172.21.15.100:0/3753696109 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d40017070 con 0x7f3d4c06d1e0 2024-09-11T22:36:45.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.742+0000 7f3d497fa640 1 -- 172.21.15.100:0/3753696109 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3d400052d0 con 0x7f3d4c06d1e0 2024-09-11T22:36:45.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.742+0000 7f3d497fa640 1 -- 172.21.15.100:0/3753696109 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d40003850 con 0x7f3d4c06d1e0 2024-09-11T22:36:45.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.742+0000 7f3d53080640 1 -- 172.21.15.100:0/3753696109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d4c1500c0 con 0x7f3d4c06d1e0 2024-09-11T22:36:45.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.742+0000 7f3d53080640 1 -- 172.21.15.100:0/3753696109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d4c150680 con 0x7f3d4c06d1e0 2024-09-11T22:36:45.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.743+0000 7f3d53080640 1 -- 172.21.15.100:0/3753696109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d4c152af0 con 0x7f3d4c06d1e0 2024-09-11T22:36:45.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.744+0000 7f3d497fa640 1 -- 172.21.15.100:0/3753696109 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d4001a070 con 0x7f3d4c06d1e0 2024-09-11T22:36:45.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.744+0000 7f3d497fa640 1 --2- 172.21.15.100:0/3753696109 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d3006be30 0x7f3d3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:45.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.744+0000 7f3d497fa640 1 -- 172.21.15.100:0/3753696109 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f3d4008a610 con 0x7f3d4c06d1e0 2024-09-11T22:36:45.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.744+0000 7f3d4bfff640 1 --2- 172.21.15.100:0/3753696109 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d3006be30 0x7f3d3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:45.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.745+0000 7f3d4bfff640 1 --2- 172.21.15.100:0/3753696109 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d3006be30 0x7f3d3006e2f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c150e30 tx=0x7f3d38007b90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:45.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.748+0000 7f3d497fa640 1 -- 172.21.15.100:0/3753696109 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3d4c152af0 con 0x7f3d4c06d1e0 2024-09-11T22:36:45.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.921+0000 7f3d53080640 1 -- 172.21.15.100:0/3753696109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d4c06c0d0 con 0x7f3d4c06d1e0 2024-09-11T22:36:45.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.922+0000 7f3d497fa640 1 -- 172.21.15.100:0/3753696109 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+19082 (secure 0 0 0) 0x7f3d40058ba0 con 0x7f3d4c06d1e0 2024-09-11T22:36:45.923 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-11T22:36:45.924 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":28,"fsid":"e9259096-4424-4dcb-839f-82ac34412ee2","created":"2024-09-11T22:19:56.198855+0000","modified":"2024-09-11T22:21:02.021308+0000","last_up_change":"2024-09-11T22:20:07.328863+0000","last_in_change":"2024-09-11T22:19:58.294227+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T22:20:08.333538+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T22:20:16.995279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T22:20:18.147950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T22:20:21.873694+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5de0ba54-34c5-4343-b19a-1f675efc49c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6809","nonce":2008454847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6811","nonce":2008454847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6815","nonce":2008454847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":2008454847},{"type":"v1","addr":"172.21.15.100:6813","nonce":2008454847}]},"public_addr":"172.21.15.100:6809/2008454847","cluster_addr":"172.21.15.100:6811/2008454847","heartbeat_back_addr":"172.21.15.100:6815/2008454847","heartbeat_front_addr":"172.21.15.100:6813/2008454847","state":["exists","up"]},{"osd":1,"uuid":"5a1f6456-6604-4b41-b9b9-52ae8d6616ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6801","nonce":1802107101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6803","nonce":1802107101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6807","nonce":1802107101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1802107101},{"type":"v1","addr":"172.21.15.100:6805","nonce":1802107101}]},"public_addr":"172.21.15.100:6801/1802107101","cluster_addr":"172.21.15.100:6803/1802107101","heartbeat_back_addr":"172.21.15.100:6807/1802107101","heartbeat_front_addr":"172.21.15.100:6805/1802107101","state":["exists","up"]},{"osd":2,"uuid":"a604cb26-7b0f-402d-b6ac-3652884b4b45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6817","nonce":644491349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6819","nonce":644491349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6823","nonce":644491349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":644491349},{"type":"v1","addr":"172.21.15.100:6821","nonce":644491349}]},"public_addr":"172.21.15.100:6817/644491349","cluster_addr":"172.21.15.100:6819/644491349","heartbeat_back_addr":"172.21.15.100:6823/644491349","heartbeat_front_addr":"172.21.15.100:6821/644491349","state":["exists","up"]},{"osd":3,"uuid":"73dc2cbb-70ff-4d12-ba2f-8778a49892f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6825","nonce":2519160882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6827","nonce":2519160882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6831","nonce":2519160882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2519160882},{"type":"v1","addr":"172.21.15.100:6829","nonce":2519160882}]},"public_addr":"172.21.15.100:6825/2519160882","cluster_addr":"172.21.15.100:6827/2519160882","heartbeat_back_addr":"172.21.15.100:6831/2519160882","heartbeat_front_addr":"172.21.15.100:6829/2519160882","state":["exists","up"]},{"osd":4,"uuid":"07960648-04df-4aec-a72c-c29e28b74bcb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6817","nonce":736010951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6819","nonce":736010951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6823","nonce":736010951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":736010951},{"type":"v1","addr":"172.21.15.167:6821","nonce":736010951}]},"public_addr":"172.21.15.167:6817/736010951","cluster_addr":"172.21.15.167:6819/736010951","heartbeat_back_addr":"172.21.15.167:6823/736010951","heartbeat_front_addr":"172.21.15.167:6821/736010951","state":["exists","up"]},{"osd":5,"uuid":"2b4767e6-cab7-4b45-9150-55432f5576aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6825","nonce":2479173909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6827","nonce":2479173909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6831","nonce":2479173909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2479173909},{"type":"v1","addr":"172.21.15.167:6829","nonce":2479173909}]},"public_addr":"172.21.15.167:6825/2479173909","cluster_addr":"172.21.15.167:6827/2479173909","heartbeat_back_addr":"172.21.15.167:6831/2479173909","heartbeat_front_addr":"172.21.15.167:6829/2479173909","state":["exists","up"]},{"osd":6,"uuid":"4ef2c4b5-52f4-4f69-8fca-2334077ed8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6809","nonce":2825112504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6811","nonce":2825112504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6815","nonce":2825112504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":2825112504},{"type":"v1","addr":"172.21.15.167:6813","nonce":2825112504}]},"public_addr":"172.21.15.167:6809/2825112504","cluster_addr":"172.21.15.167:6811/2825112504","heartbeat_back_addr":"172.21.15.167:6815/2825112504","heartbeat_front_addr":"172.21.15.167:6813/2825112504","state":["exists","up"]},{"osd":7,"uuid":"761673d8-d6fc-4ded-a9f3-d49ab8f7c969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6801","nonce":1337015843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6803","nonce":1337015843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6807","nonce":1337015843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":1337015843},{"type":"v1","addr":"172.21.15.167:6805","nonce":1337015843}]},"public_addr":"172.21.15.167:6801/1337015843","cluster_addr":"172.21.15.167:6803/1337015843","heartbeat_back_addr":"172.21.15.167:6807/1337015843","heartbeat_front_addr":"172.21.15.167:6805/1337015843","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.833280+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.080311+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.100648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:05.544261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.670353+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.880921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.365441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T22:20:04.366659+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T22:36:45.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.924+0000 7f3d53080640 1 -- 172.21.15.100:0/3753696109 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d3006be30 msgr2=0x7f3d3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.925+0000 7f3d53080640 1 --2- 172.21.15.100:0/3753696109 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d3006be30 0x7f3d3006e2f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c150e30 tx=0x7f3d38007b90 comp rx=0 tx=0).stop 2024-09-11T22:36:45.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.925+0000 7f3d53080640 1 -- 172.21.15.100:0/3753696109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d4c06d1e0 msgr2=0x7f3d4c1e33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:45.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.925+0000 7f3d53080640 1 --2- 172.21.15.100:0/3753696109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d4c06d1e0 0x7f3d4c1e33d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000c400 tx=0x7f3d4000c8c0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.925+0000 7f3d53080640 1 -- 172.21.15.100:0/3753696109 shutdown_connections 2024-09-11T22:36:45.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.925+0000 7f3d53080640 1 --2- 172.21.15.100:0/3753696109 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3d3006be30 0x7f3d3006e2f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.925+0000 7f3d53080640 1 --2- 172.21.15.100:0/3753696109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d4c154a70 0x7f3d4c1f0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.925+0000 7f3d53080640 1 --2- 172.21.15.100:0/3753696109 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3d4c06fbb0 0x7f3d4c1e20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.925+0000 7f3d53080640 1 --2- 172.21.15.100:0/3753696109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d4c06d1e0 0x7f3d4c1e33d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:45.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.925+0000 7f3d53080640 1 -- 172.21.15.100:0/3753696109 >> 172.21.15.100:0/3753696109 conn(0x7f3d4c0c9d00 msgr2=0x7f3d4c1537b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:45.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.925+0000 7f3d53080640 1 -- 172.21.15.100:0/3753696109 shutdown_connections 2024-09-11T22:36:45.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:45.925+0000 7f3d53080640 1 -- 172.21.15.100:0/3753696109 wait complete. 2024-09-11T22:36:45.937 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-11T22:36:46.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.039+0000 7f75bce4c640 1 Processor -- start 2024-09-11T22:36:46.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.039+0000 7f75bce4c640 1 -- start start 2024-09-11T22:36:46.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.039+0000 7f75bce4c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75b8158210 0x7f75b80707a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:46.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.040+0000 7f75bce4c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f75b80b0ca0 0x7f75b815e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:46.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.040+0000 7f75bce4c640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75b81585f0 con 0x7f75b806bc10 2024-09-11T22:36:46.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.040+0000 7f75bce4c640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f75b8070310 con 0x7f75b80b0ca0 2024-09-11T22:36:46.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.040+0000 7f75bce4c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f75b80c9430 con 0x7f75b8158210 2024-09-11T22:36:46.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.040+0000 7f75add9b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f75b80b0ca0 0x7f75b815e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:46.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.040+0000 7f75add9b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f75b80b0ca0 0x7f75b815e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45166/0 (socket says 172.21.15.100:45166) 2024-09-11T22:36:46.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.040+0000 7f75add9b640 1 -- 172.21.15.100:0/2577780098 learned_addr learned my addr 172.21.15.100:0/2577780098 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:46.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.040+0000 7f75add9b640 1 -- 172.21.15.100:0/2577780098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75b8158210 msgr2=0x7f75b80707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:46.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.040+0000 7f75add9b640 1 --2- 172.21.15.100:0/2577780098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75b8158210 0x7f75b80707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:46.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.040+0000 7f75add9b640 1 -- 172.21.15.100:0/2577780098 >> v1:172.21.15.100:6789/0 conn(0x7f75b806bc10 legacy=0x7f75b80ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:46.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.040+0000 7f75b5d9b640 1 -- 172.21.15.100:0/2577780098 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 39567253 0 0) 0x7f75b81585f0 con 0x7f75b806bc10 2024-09-11T22:36:46.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.040+0000 7f75add9b640 1 -- 172.21.15.100:0/2577780098 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b80c96d0 con 0x7f75b80b0ca0 2024-09-11T22:36:46.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.041+0000 7f75add9b640 1 --2- 172.21.15.100:0/2577780098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75b80b0ca0 0x7f75b815e100 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009870 tx=0x7f75a002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300cc5736cbbe279 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:46.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.041+0000 7f75b5d9b640 1 -- 172.21.15.100:0/2577780098 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a0037070 con 0x7f75b80b0ca0 2024-09-11T22:36:46.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.041+0000 7f75b5d9b640 1 -- 172.21.15.100:0/2577780098 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f75a002ae50 con 0x7f75b80b0ca0 2024-09-11T22:36:46.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.041+0000 7f75b5d9b640 1 -- 172.21.15.100:0/2577780098 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a0032880 con 0x7f75b80b0ca0 2024-09-11T22:36:46.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.041+0000 7f75bce4c640 1 -- 172.21.15.100:0/2577780098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75b80b0ca0 msgr2=0x7f75b815e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:46.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.041+0000 7f75bce4c640 1 --2- 172.21.15.100:0/2577780098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75b80b0ca0 0x7f75b815e100 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009870 tx=0x7f75a002a300 comp rx=0 tx=0).stop 2024-09-11T22:36:46.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.041+0000 7f75bce4c640 1 -- 172.21.15.100:0/2577780098 shutdown_connections 2024-09-11T22:36:46.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.041+0000 7f75bce4c640 1 --2- 172.21.15.100:0/2577780098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75b80b0ca0 0x7f75b815e100 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:46.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.041+0000 7f75bce4c640 1 --2- 172.21.15.100:0/2577780098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75b8158210 0x7f75b80707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:46.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.041+0000 7f75bce4c640 1 -- 172.21.15.100:0/2577780098 >> 172.21.15.100:0/2577780098 conn(0x7f75b806de20 msgr2=0x7f75b806e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:46.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.041+0000 7f75bce4c640 1 -- 172.21.15.100:0/2577780098 shutdown_connections 2024-09-11T22:36:46.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.041+0000 7f75bce4c640 1 -- 172.21.15.100:0/2577780098 wait complete. 2024-09-11T22:36:46.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.043+0000 7f75bce4c640 1 Processor -- start 2024-09-11T22:36:46.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.043+0000 7f75bce4c640 1 -- start start 2024-09-11T22:36:46.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.043+0000 7f75bce4c640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75b806bc10 0x7f75b80b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:46.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.043+0000 7f75bce4c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75b80b0ca0 0x7f75b81f3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:46.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.043+0000 7f75bce4c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75b8158210 0x7f75b81f4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:46.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.044+0000 7f75bce4c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f75b806ffa0 con 0x7f75b8158210 2024-09-11T22:36:46.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.044+0000 7f75bce4c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f75b80c9c90 con 0x7f75b80b0ca0 2024-09-11T22:36:46.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.044+0000 7f75bce4c640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f75b806db40 con 0x7f75b806bc10 2024-09-11T22:36:46.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.044+0000 7f75b6d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75b8158210 0x7f75b81f4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:46.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.044+0000 7f75b6d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75b8158210 0x7f75b81f4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45172/0 (socket says 172.21.15.100:45172) 2024-09-11T22:36:46.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.044+0000 7f75b6d9d640 1 -- 172.21.15.100:0/398520973 learned_addr learned my addr 172.21.15.100:0/398520973 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:46.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.044+0000 7f75add9b640 1 --2- 172.21.15.100:0/398520973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75b80b0ca0 0x7f75b81f3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:46.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.044+0000 7f75b659c640 1 --2- 172.21.15.100:0/398520973 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75b806bc10 0x7f75b80b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:46.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.044+0000 7f75b6d9d640 1 -- 172.21.15.100:0/398520973 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75b806bc10 msgr2=0x7f75b80b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:46.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.044+0000 7f75b6d9d640 1 --2- 172.21.15.100:0/398520973 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75b806bc10 0x7f75b80b1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:46.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.044+0000 7f75b6d9d640 1 -- 172.21.15.100:0/398520973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75b80b0ca0 msgr2=0x7f75b81f3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:46.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.044+0000 7f75b6d9d640 1 --2- 172.21.15.100:0/398520973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75b80b0ca0 0x7f75b81f3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:46.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.044+0000 7f75b6d9d640 1 -- 172.21.15.100:0/398520973 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b815a5e0 con 0x7f75b8158210 2024-09-11T22:36:46.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.044+0000 7f75b6d9d640 1 --2- 172.21.15.100:0/398520973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75b8158210 0x7f75b81f4000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f75b000c790 tx=0x7f75b000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:46.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.044+0000 7f75af7fe640 1 -- 172.21.15.100:0/398520973 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b0003da0 con 0x7f75b8158210 2024-09-11T22:36:46.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.044+0000 7f75af7fe640 1 -- 172.21.15.100:0/398520973 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f75b0005070 con 0x7f75b8158210 2024-09-11T22:36:46.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.044+0000 7f75bce4c640 1 -- 172.21.15.100:0/398520973 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75b81f0eb0 con 0x7f75b8158210 2024-09-11T22:36:46.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.044+0000 7f75af7fe640 1 -- 172.21.15.100:0/398520973 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b0005480 con 0x7f75b8158210 2024-09-11T22:36:46.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.044+0000 7f75bce4c640 1 -- 172.21.15.100:0/398520973 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75b815a020 con 0x7f75b8158210 2024-09-11T22:36:46.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.045+0000 7f75bce4c640 1 -- 172.21.15.100:0/398520973 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75b80707a0 con 0x7f75b8158210 2024-09-11T22:36:46.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.046+0000 7f75af7fe640 1 -- 172.21.15.100:0/398520973 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f75b0005620 con 0x7f75b8158210 2024-09-11T22:36:46.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.046+0000 7f75af7fe640 1 --2- 172.21.15.100:0/398520973 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f759806be30 0x7f759806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:46.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.047+0000 7f75b659c640 1 --2- 172.21.15.100:0/398520973 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f759806be30 0x7f759806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:46.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.047+0000 7f75af7fe640 1 -- 172.21.15.100:0/398520973 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6764+0+0 (secure 0 0 0) 0x7f75b008b0a0 con 0x7f75b8158210 2024-09-11T22:36:46.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.047+0000 7f75b659c640 1 --2- 172.21.15.100:0/398520973 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f759806be30 0x7f759806e2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f75a800b810 tx=0x7f75a8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:46.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.051+0000 7f75af7fe640 1 -- 172.21.15.100:0/398520973 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f75b815a5e0 con 0x7f75b8158210 2024-09-11T22:36:46.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.262+0000 7f75bce4c640 1 -- 172.21.15.100:0/398520973 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f75b8070da0 con 0x7f75b8158210 2024-09-11T22:36:46.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.270+0000 7f75af7fe640 1 -- 172.21.15.100:0/398520973 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) ==== 161+0+0 (secure 0 0 0) 0x7f75b00596c0 con 0x7f75b8158210 2024-09-11T22:36:46.271 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T22:36:46.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.273+0000 7f75bce4c640 1 -- 172.21.15.100:0/398520973 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f759806be30 msgr2=0x7f759806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:46.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.273+0000 7f75bce4c640 1 --2- 172.21.15.100:0/398520973 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f759806be30 0x7f759806e2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f75a800b810 tx=0x7f75a8008040 comp rx=0 tx=0).stop 2024-09-11T22:36:46.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.273+0000 7f75bce4c640 1 -- 172.21.15.100:0/398520973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75b8158210 msgr2=0x7f75b81f4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:46.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.273+0000 7f75bce4c640 1 --2- 172.21.15.100:0/398520973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75b8158210 0x7f75b81f4000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f75b000c790 tx=0x7f75b000cc50 comp rx=0 tx=0).stop 2024-09-11T22:36:46.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.273+0000 7f75bce4c640 1 -- 172.21.15.100:0/398520973 shutdown_connections 2024-09-11T22:36:46.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.273+0000 7f75bce4c640 1 --2- 172.21.15.100:0/398520973 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f759806be30 0x7f759806e2f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:46.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.273+0000 7f75bce4c640 1 --2- 172.21.15.100:0/398520973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75b8158210 0x7f75b81f4000 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:46.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.273+0000 7f75bce4c640 1 --2- 172.21.15.100:0/398520973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75b80b0ca0 0x7f75b81f3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:46.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.273+0000 7f75bce4c640 1 --2- 172.21.15.100:0/398520973 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75b806bc10 0x7f75b80b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:46.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.273+0000 7f75bce4c640 1 -- 172.21.15.100:0/398520973 >> 172.21.15.100:0/398520973 conn(0x7f75b806de20 msgr2=0x7f75b80c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:46.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.273+0000 7f75bce4c640 1 -- 172.21.15.100:0/398520973 shutdown_connections 2024-09-11T22:36:46.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.273+0000 7f75bce4c640 1 -- 172.21.15.100:0/398520973 wait complete. 2024-09-11T22:36:46.289 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T22:36:46.363 INFO:tasks.ceph.mds.f.smithi167.stdout:starting mds.f at 2024-09-11T22:36:46.370 INFO:tasks.ceph.mds.e.smithi100.stdout:starting mds.e at 2024-09-11T22:36:46.373 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2024-09-11T22:36:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.393+0000 7f277f8ba640 1 Processor -- start 2024-09-11T22:36:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.393+0000 7f277f8ba640 1 -- start start 2024-09-11T22:36:46.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.394+0000 7f277f8ba640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2778151970 0x7f27780726c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.394+0000 7f277f8ba640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f27780c3c60 0x7f27781576c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.394+0000 7f277f8ba640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2778073bf0 con 0x7f2778157c00 2024-09-11T22:36:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.394+0000 7f277f8ba640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f27780ca3f0 con 0x7f27780c3c60 2024-09-11T22:36:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.394+0000 7f277f8ba640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f27780c9f60 con 0x7f2778151970 2024-09-11T22:36:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.394+0000 7f277d656640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2778151970 0x7f27780726c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.394+0000 7f277ce55640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f27780c3c60 0x7f27781576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.394+0000 7f277de57640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f2778157c00 0x7f2778072f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.100:52168/0 (socket says 172.21.15.100:52168) 2024-09-11T22:36:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.394+0000 7f277d656640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2778151970 0x7f27780726c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.100:43916/0 (socket says 172.21.15.100:43916) 2024-09-11T22:36:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.394+0000 7f277de57640 1 -- 172.21.15.100:0/107671067 learned_addr learned my addr 172.21.15.100:0/107671067 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:36:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.395+0000 7f277d656640 1 -- 172.21.15.100:0/107671067 >> v2:172.21.15.100:3300/0 conn(0x7f27780c3c60 msgr2=0x7f27781576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.395+0000 7f277d656640 1 --2- 172.21.15.100:0/107671067 >> v2:172.21.15.100:3300/0 conn(0x7f27780c3c60 0x7f27781576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.395+0000 7f277d656640 1 -- 172.21.15.100:0/107671067 >> v1:172.21.15.167:6789/0 conn(0x7f2778157c00 legacy=0x7f2778072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:46.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.395+0000 7f277d656640 1 -- 172.21.15.100:0/107671067 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2778073ed0 con 0x7f2778151970 2024-09-11T22:36:46.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.395+0000 7f277d656640 1 --2- 172.21.15.100:0/107671067 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2778151970 0x7f27780726c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f276800dbc0 tx=0x7f276802e510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84a80156d141fa1e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:46.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.395+0000 7f276ffff640 1 -- 172.21.15.100:0/107671067 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276803a070 con 0x7f2778151970 2024-09-11T22:36:46.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.396+0000 7f276ffff640 1 -- 172.21.15.100:0/107671067 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f276800b650 con 0x7f2778151970 2024-09-11T22:36:46.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.396+0000 7f276ffff640 1 -- 172.21.15.100:0/107671067 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276800ba40 con 0x7f2778151970 2024-09-11T22:36:46.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.396+0000 7f277f8ba640 1 -- 172.21.15.100:0/107671067 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2778151970 msgr2=0x7f27780726c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:46.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.396+0000 7f277f8ba640 1 --2- 172.21.15.100:0/107671067 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2778151970 0x7f27780726c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f276800dbc0 tx=0x7f276802e510 comp rx=0 tx=0).stop 2024-09-11T22:36:46.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.396+0000 7f277f8ba640 1 -- 172.21.15.100:0/107671067 shutdown_connections 2024-09-11T22:36:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.396+0000 7f277f8ba640 1 --2- 172.21.15.100:0/107671067 >> v2:172.21.15.100:3300/0 conn(0x7f27780c3c60 0x7f27781576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.396+0000 7f277f8ba640 1 --2- 172.21.15.100:0/107671067 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2778151970 0x7f27780726c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.396+0000 7f277f8ba640 1 -- 172.21.15.100:0/107671067 >> 172.21.15.100:0/107671067 conn(0x7f277806ee80 msgr2=0x7f2778070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.396+0000 7f277f8ba640 1 -- 172.21.15.100:0/107671067 shutdown_connections 2024-09-11T22:36:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.396+0000 7f277f8ba640 1 -- 172.21.15.100:0/107671067 wait complete. 2024-09-11T22:36:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.397+0000 7f277f8ba640 1 Processor -- start 2024-09-11T22:36:46.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.397+0000 7f277f8ba640 1 -- start start 2024-09-11T22:36:46.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.398+0000 7f277f8ba640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27780c3c60 0x7f277814e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:46.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.398+0000 7f277f8ba640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2778151970 0x7f27781efce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:46.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.398+0000 7f277f8ba640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2778157c00 0x7f277814a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:46.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.398+0000 7f277f8ba640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f27780c9bf0 con 0x7f2778157c00 2024-09-11T22:36:46.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.398+0000 7f277f8ba640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f27780741b0 con 0x7f2778151970 2024-09-11T22:36:46.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.398+0000 7f277f8ba640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f277806d530 con 0x7f27780c3c60 2024-09-11T22:36:46.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.398+0000 7f277de57640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2778157c00 0x7f277814a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.398+0000 7f277de57640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2778157c00 0x7f277814a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45206/0 (socket says 172.21.15.100:45206) 2024-09-11T22:36:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.398+0000 7f277de57640 1 -- 172.21.15.100:0/3684147339 learned_addr learned my addr 172.21.15.100:0/3684147339 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.398+0000 7f277d656640 1 --2- 172.21.15.100:0/3684147339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27780c3c60 0x7f277814e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.398+0000 7f277ce55640 1 --2- 172.21.15.100:0/3684147339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2778151970 0x7f27781efce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.398+0000 7f277de57640 1 -- 172.21.15.100:0/3684147339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27780c3c60 msgr2=0x7f277814e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.398+0000 7f277de57640 1 --2- 172.21.15.100:0/3684147339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27780c3c60 0x7f277814e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.398+0000 7f277de57640 1 -- 172.21.15.100:0/3684147339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2778151970 msgr2=0x7f27781efce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.398+0000 7f277de57640 1 --2- 172.21.15.100:0/3684147339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2778151970 0x7f27781efce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.398+0000 7f277de57640 1 -- 172.21.15.100:0/3684147339 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27781f0600 con 0x7f2778157c00 2024-09-11T22:36:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.399+0000 7f277de57640 1 --2- 172.21.15.100:0/3684147339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2778157c00 0x7f277814a290 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f277000c890 tx=0x7f277000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.399+0000 7f276dffb640 1 -- 172.21.15.100:0/3684147339 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2770018070 con 0x7f2778157c00 2024-09-11T22:36:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.399+0000 7f276dffb640 1 -- 172.21.15.100:0/3684147339 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f277000a640 con 0x7f2778157c00 2024-09-11T22:36:46.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.399+0000 7f277f8ba640 1 -- 172.21.15.100:0/3684147339 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27781f08e0 con 0x7f2778157c00 2024-09-11T22:36:46.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.399+0000 7f276dffb640 1 -- 172.21.15.100:0/3684147339 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2770007e60 con 0x7f2778157c00 2024-09-11T22:36:46.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.399+0000 7f277f8ba640 1 -- 172.21.15.100:0/3684147339 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2778149a90 con 0x7f2778157c00 2024-09-11T22:36:46.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.400+0000 7f277f8ba640 1 -- 172.21.15.100:0/3684147339 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2778151d50 con 0x7f2778157c00 2024-09-11T22:36:46.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.400+0000 7f276dffb640 1 -- 172.21.15.100:0/3684147339 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f277001b070 con 0x7f2778157c00 2024-09-11T22:36:46.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.401+0000 7f276dffb640 1 --2- 172.21.15.100:0/3684147339 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f275c06be60 0x7f275c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:46.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.401+0000 7f276dffb640 1 -- 172.21.15.100:0/3684147339 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 7022+0+0 (secure 0 0 0) 0x7f277008a950 con 0x7f2778157c00 2024-09-11T22:36:46.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.401+0000 7f277d656640 1 --2- 172.21.15.100:0/3684147339 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f275c06be60 0x7f275c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:46.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.401+0000 7f277d656640 1 --2- 172.21.15.100:0/3684147339 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f275c06be60 0x7f275c06e320 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2768037000 tx=0x7f276800d000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:46.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.405+0000 7f276dffb640 1 -- 172.21.15.100:0/3684147339 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2770058700 con 0x7f2778157c00 2024-09-11T22:36:46.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:46.615+0000 7f277f8ba640 1 -- 172.21.15.100:0/3684147339 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2778072d10 con 0x7f2778157c00 2024-09-11T22:36:47.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.275+0000 7f276dffb640 1 -- 172.21.15.100:0/3684147339 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) ==== 104+0+0 (secure 0 0 0) 0x7f277005ca00 con 0x7f2778157c00 2024-09-11T22:36:47.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.277+0000 7f277f8ba640 1 -- 172.21.15.100:0/3684147339 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f275c06be60 msgr2=0x7f275c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:47.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.277+0000 7f277f8ba640 1 --2- 172.21.15.100:0/3684147339 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f275c06be60 0x7f275c06e320 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2768037000 tx=0x7f276800d000 comp rx=0 tx=0).stop 2024-09-11T22:36:47.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.277+0000 7f277f8ba640 1 -- 172.21.15.100:0/3684147339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2778157c00 msgr2=0x7f277814a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:47.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.277+0000 7f277f8ba640 1 --2- 172.21.15.100:0/3684147339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2778157c00 0x7f277814a290 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f277000c890 tx=0x7f277000cd50 comp rx=0 tx=0).stop 2024-09-11T22:36:47.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.278+0000 7f277f8ba640 1 -- 172.21.15.100:0/3684147339 shutdown_connections 2024-09-11T22:36:47.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.278+0000 7f277f8ba640 1 --2- 172.21.15.100:0/3684147339 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f275c06be60 0x7f275c06e320 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.278+0000 7f277f8ba640 1 --2- 172.21.15.100:0/3684147339 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2778157c00 0x7f277814a290 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.278+0000 7f277f8ba640 1 --2- 172.21.15.100:0/3684147339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2778151970 0x7f27781efce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.278+0000 7f277f8ba640 1 --2- 172.21.15.100:0/3684147339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27780c3c60 0x7f277814e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.278+0000 7f277f8ba640 1 -- 172.21.15.100:0/3684147339 >> 172.21.15.100:0/3684147339 conn(0x7f277806ee80 msgr2=0x7f2778072f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:47.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.278+0000 7f277f8ba640 1 -- 172.21.15.100:0/3684147339 shutdown_connections 2024-09-11T22:36:47.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.278+0000 7f277f8ba640 1 -- 172.21.15.100:0/3684147339 wait complete. 2024-09-11T22:36:47.290 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T22:36:47.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.390+0000 7fd818752640 1 Processor -- start 2024-09-11T22:36:47.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.390+0000 7fd818752640 1 -- start start 2024-09-11T22:36:47.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.391+0000 7fd818752640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd810158c50 0x7fd8100c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:47.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.391+0000 7fd818752640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd81006c060 con 0x7fd8100c6940 2024-09-11T22:36:47.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.391+0000 7fd818752640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd81006c340 con 0x7fd8100c6d20 2024-09-11T22:36:47.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.391+0000 7fd818752640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd81006f1d0 con 0x7fd810158c50 2024-09-11T22:36:47.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.391+0000 7fd8164ee640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd8100c6940 0x7fd8101523e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59016/0 (socket says 172.21.15.100:59016) 2024-09-11T22:36:47.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.391+0000 7fd8164ee640 1 -- 172.21.15.100:0/2484412979 learned_addr learned my addr 172.21.15.100:0/2484412979 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-09-11T22:36:47.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.391+0000 7fd816cef640 1 --2- 172.21.15.100:0/2484412979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd810158c50 0x7fd8100c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:47.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.391+0000 7fd8154ec640 1 -- 172.21.15.100:0/2484412979 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3641702431 0 0) 0x7fd81006c060 con 0x7fd8100c6940 2024-09-11T22:36:47.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.391+0000 7fd8154ec640 1 -- 172.21.15.100:0/2484412979 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7fc003520 con 0x7fd8100c6940 2024-09-11T22:36:47.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.392+0000 7fd8154ec640 1 -- 172.21.15.100:0/2484412979 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3616562302 0 0) 0x7fd81006c340 con 0x7fd8100c6d20 2024-09-11T22:36:47.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.392+0000 7fd8154ec640 1 -- 172.21.15.100:0/2484412979 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd81006c060 con 0x7fd8100c6d20 2024-09-11T22:36:47.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.392+0000 7fd8154ec640 1 -- 172.21.15.100:0/2484412979 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1642677134 0 0) 0x7fd7fc003520 con 0x7fd8100c6940 2024-09-11T22:36:47.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.392+0000 7fd816cef640 1 -- 172.21.15.100:0/2484412979 >> v1:172.21.15.167:6789/0 conn(0x7fd8100c6d20 legacy=0x7fd810158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:47.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.392+0000 7fd816cef640 1 -- 172.21.15.100:0/2484412979 >> v1:172.21.15.100:6789/0 conn(0x7fd8100c6940 legacy=0x7fd8101523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:47.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.392+0000 7fd816cef640 1 -- 172.21.15.100:0/2484412979 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd81006f420 con 0x7fd810158c50 2024-09-11T22:36:47.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.392+0000 7fd816cef640 1 --2- 172.21.15.100:0/2484412979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd810158c50 0x7fd8100c79c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd808009dc0 tx=0x7fd80802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2810f0033fb79643 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:47.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.393+0000 7fd8154ec640 1 -- 172.21.15.100:0/2484412979 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c001670 con 0x7fd810158c50 2024-09-11T22:36:47.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.393+0000 7fd8154ec640 1 -- 172.21.15.100:0/2484412979 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd808007540 con 0x7fd810158c50 2024-09-11T22:36:47.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.393+0000 7fd8154ec640 1 -- 172.21.15.100:0/2484412979 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8080078f0 con 0x7fd810158c50 2024-09-11T22:36:47.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.393+0000 7fd818752640 1 -- 172.21.15.100:0/2484412979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd810158c50 msgr2=0x7fd8100c79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:47.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.393+0000 7fd818752640 1 --2- 172.21.15.100:0/2484412979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd810158c50 0x7fd8100c79c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd808009dc0 tx=0x7fd80802a5d0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.393+0000 7fd818752640 1 -- 172.21.15.100:0/2484412979 shutdown_connections 2024-09-11T22:36:47.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.393+0000 7fd818752640 1 --2- 172.21.15.100:0/2484412979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd810158c50 0x7fd8100c79c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.393+0000 7fd818752640 1 -- 172.21.15.100:0/2484412979 >> 172.21.15.100:0/2484412979 conn(0x7fd810070b80 msgr2=0x7fd8100ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:47.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.393+0000 7fd818752640 1 -- 172.21.15.100:0/2484412979 shutdown_connections 2024-09-11T22:36:47.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.393+0000 7fd818752640 1 -- 172.21.15.100:0/2484412979 wait complete. 2024-09-11T22:36:47.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.394+0000 7fd818752640 1 Processor -- start 2024-09-11T22:36:47.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.394+0000 7fd818752640 1 -- start start 2024-09-11T22:36:47.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.395+0000 7fd818752640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8100c6940 0x7fd8101e2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:47.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.395+0000 7fd818752640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8100c6d20 0x7fd8101e34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:47.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.395+0000 7fd818752640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8101e4bf0 0x7fd8101e50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:47.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.395+0000 7fd818752640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd810152af0 con 0x7fd8100c6d20 2024-09-11T22:36:47.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.395+0000 7fd818752640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd81006f9e0 con 0x7fd8101e4bf0 2024-09-11T22:36:47.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.395+0000 7fd818752640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7fd810152c70 con 0x7fd8100c6940 2024-09-11T22:36:47.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.395+0000 7fd815ced640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8100c6d20 0x7fd8101e34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:47.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.395+0000 7fd815ced640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8100c6d20 0x7fd8101e34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45220/0 (socket says 172.21.15.100:45220) 2024-09-11T22:36:47.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.395+0000 7fd815ced640 1 -- 172.21.15.100:0/2568393349 learned_addr learned my addr 172.21.15.100:0/2568393349 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:47.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.395+0000 7fd816cef640 1 --2- 172.21.15.100:0/2568393349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8101e4bf0 0x7fd8101e50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:47.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.395+0000 7fd8164ee640 1 --2- 172.21.15.100:0/2568393349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8100c6940 0x7fd8101e2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:47.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.395+0000 7fd815ced640 1 -- 172.21.15.100:0/2568393349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8100c6940 msgr2=0x7fd8101e2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:47.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.395+0000 7fd815ced640 1 --2- 172.21.15.100:0/2568393349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8100c6940 0x7fd8101e2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.395+0000 7fd815ced640 1 -- 172.21.15.100:0/2568393349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8101e4bf0 msgr2=0x7fd8101e50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:47.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.395+0000 7fd815ced640 1 --2- 172.21.15.100:0/2568393349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8101e4bf0 0x7fd8101e50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:47.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.395+0000 7fd815ced640 1 -- 172.21.15.100:0/2568393349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8101f19f0 con 0x7fd8100c6d20 2024-09-11T22:36:47.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.396+0000 7fd815ced640 1 --2- 172.21.15.100:0/2568393349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8100c6d20 0x7fd8101e34a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd80000c480 tx=0x7fd80000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:47.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.396+0000 7fd806ffd640 1 -- 172.21.15.100:0/2568393349 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8000052d0 con 0x7fd8100c6d20 2024-09-11T22:36:47.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.396+0000 7fd806ffd640 1 -- 172.21.15.100:0/2568393349 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd800005470 con 0x7fd8100c6d20 2024-09-11T22:36:47.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.396+0000 7fd806ffd640 1 -- 172.21.15.100:0/2568393349 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd800012890 con 0x7fd8100c6d20 2024-09-11T22:36:47.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.396+0000 7fd818752640 1 -- 172.21.15.100:0/2568393349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8101ee580 con 0x7fd8100c6d20 2024-09-11T22:36:47.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.396+0000 7fd818752640 1 -- 172.21.15.100:0/2568393349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8101eeb40 con 0x7fd8100c6d20 2024-09-11T22:36:47.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.397+0000 7fd818752640 1 -- 172.21.15.100:0/2568393349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8100c8c50 con 0x7fd8100c6d20 2024-09-11T22:36:47.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.397+0000 7fd806ffd640 1 -- 172.21.15.100:0/2568393349 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd800012a30 con 0x7fd8100c6d20 2024-09-11T22:36:47.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.398+0000 7fd806ffd640 1 --2- 172.21.15.100:0/2568393349 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd7f406be30 0x7fd7f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:47.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.398+0000 7fd8164ee640 1 --2- 172.21.15.100:0/2568393349 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd7f406be30 0x7fd7f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:47.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.398+0000 7fd806ffd640 1 -- 172.21.15.100:0/2568393349 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 7022+0+0 (secure 0 0 0) 0x7fd80008b080 con 0x7fd8100c6d20 2024-09-11T22:36:47.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.398+0000 7fd8164ee640 1 --2- 172.21.15.100:0/2568393349 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd7f406be30 0x7fd7f406e2f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0011e0 tx=0x7fd80c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:47.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.402+0000 7fd806ffd640 1 -- 172.21.15.100:0/2568393349 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd8100c8c50 con 0x7fd8100c6d20 2024-09-11T22:36:47.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:47.571+0000 7fd818752640 1 -- 172.21.15.100:0/2568393349 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd8100c3f30 con 0x7fd8100c6d20 2024-09-11T22:36:48.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.283+0000 7fd806ffd640 1 -- 172.21.15.100:0/2568393349 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) ==== 181+0+0 (secure 0 0 0) 0x7fd8000595d0 con 0x7fd8100c6d20 2024-09-11T22:36:48.284 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' removed 2024-09-11T22:36:48.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.286+0000 7fd818752640 1 -- 172.21.15.100:0/2568393349 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd7f406be30 msgr2=0x7fd7f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:48.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.286+0000 7fd818752640 1 --2- 172.21.15.100:0/2568393349 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd7f406be30 0x7fd7f406e2f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0011e0 tx=0x7fd80c009040 comp rx=0 tx=0).stop 2024-09-11T22:36:48.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.286+0000 7fd818752640 1 -- 172.21.15.100:0/2568393349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8100c6d20 msgr2=0x7fd8101e34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:48.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.286+0000 7fd818752640 1 --2- 172.21.15.100:0/2568393349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8100c6d20 0x7fd8101e34a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd80000c480 tx=0x7fd80000c940 comp rx=0 tx=0).stop 2024-09-11T22:36:48.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.286+0000 7fd818752640 1 -- 172.21.15.100:0/2568393349 shutdown_connections 2024-09-11T22:36:48.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.286+0000 7fd818752640 1 --2- 172.21.15.100:0/2568393349 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7fd7f406be30 0x7fd7f406e2f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:48.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.286+0000 7fd818752640 1 --2- 172.21.15.100:0/2568393349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8101e4bf0 0x7fd8101e50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:48.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.286+0000 7fd818752640 1 --2- 172.21.15.100:0/2568393349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8100c6d20 0x7fd8101e34a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:48.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.286+0000 7fd818752640 1 --2- 172.21.15.100:0/2568393349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd8100c6940 0x7fd8101e2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:48.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.286+0000 7fd818752640 1 -- 172.21.15.100:0/2568393349 >> 172.21.15.100:0/2568393349 conn(0x7fd810070b80 msgr2=0x7fd8101521b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:48.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.286+0000 7fd818752640 1 -- 172.21.15.100:0/2568393349 shutdown_connections 2024-09-11T22:36:48.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.286+0000 7fd818752640 1 -- 172.21.15.100:0/2568393349 wait complete. 2024-09-11T22:36:48.301 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T22:36:48.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.410+0000 7f3c3f7f6640 1 Processor -- start 2024-09-11T22:36:48.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.410+0000 7f3c3f7f6640 1 -- start start 2024-09-11T22:36:48.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.411+0000 7f3c3f7f6640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3c38072820 0x7f3c380c2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:48.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.411+0000 7f3c3f7f6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3c380c8fb0 0x7f3c38073960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:48.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.411+0000 7f3c3f7f6640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c380c9400 con 0x7f3c38155050 2024-09-11T22:36:48.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.411+0000 7f3c3f7f6640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f3c3806fe60 con 0x7f3c380c8fb0 2024-09-11T22:36:48.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.411+0000 7f3c3f7f6640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f3c380c8b20 con 0x7f3c38072820 2024-09-11T22:36:48.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.411+0000 7f3c3dd93640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3c380c8fb0 0x7f3c38073960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:48.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.411+0000 7f3c3dd93640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3c380c8fb0 0x7f3c38073960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45234/0 (socket says 172.21.15.100:45234) 2024-09-11T22:36:48.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.411+0000 7f3c3dd93640 1 -- 172.21.15.100:0/4013589457 learned_addr learned my addr 172.21.15.100:0/4013589457 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:48.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.411+0000 7f3c3cd91640 1 --2- 172.21.15.100:0/4013589457 >> v2:172.21.15.167:3300/0 conn(0x7f3c38072820 0x7f3c380c2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:48.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.412+0000 7f3c3dd93640 1 -- 172.21.15.100:0/4013589457 >> v2:172.21.15.167:3300/0 conn(0x7f3c38072820 msgr2=0x7f3c380c2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:48.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.412+0000 7f3c3dd93640 1 --2- 172.21.15.100:0/4013589457 >> v2:172.21.15.167:3300/0 conn(0x7f3c38072820 0x7f3c380c2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:48.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.412+0000 7f3c3dd93640 1 -- 172.21.15.100:0/4013589457 >> v1:172.21.15.167:6789/0 conn(0x7f3c38155050 legacy=0x7f3c38073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:48.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.412+0000 7f3c3dd93640 1 -- 172.21.15.100:0/4013589457 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c38155430 con 0x7f3c380c8fb0 2024-09-11T22:36:48.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.412+0000 7f3c3dd93640 1 --2- 172.21.15.100:0/4013589457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c380c8fb0 0x7f3c38073960 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3c380cad20 tx=0x7f3c3002c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f21610a145d2a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:48.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.412+0000 7f3c2ffff640 1 -- 172.21.15.100:0/4013589457 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c30035020 con 0x7f3c380c8fb0 2024-09-11T22:36:48.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.413+0000 7f3c2ffff640 1 -- 172.21.15.100:0/4013589457 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3c30009600 con 0x7f3c380c8fb0 2024-09-11T22:36:48.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.413+0000 7f3c2ffff640 1 -- 172.21.15.100:0/4013589457 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c300099f0 con 0x7f3c380c8fb0 2024-09-11T22:36:48.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.413+0000 7f3c3f7f6640 1 -- 172.21.15.100:0/4013589457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c380c8fb0 msgr2=0x7f3c38073960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:48.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.413+0000 7f3c3f7f6640 1 --2- 172.21.15.100:0/4013589457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c380c8fb0 0x7f3c38073960 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3c380cad20 tx=0x7f3c3002c9e0 comp rx=0 tx=0).stop 2024-09-11T22:36:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.413+0000 7f3c3f7f6640 1 -- 172.21.15.100:0/4013589457 shutdown_connections 2024-09-11T22:36:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.413+0000 7f3c3f7f6640 1 --2- 172.21.15.100:0/4013589457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c380c8fb0 0x7f3c38073960 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.413+0000 7f3c3f7f6640 1 --2- 172.21.15.100:0/4013589457 >> v2:172.21.15.167:3300/0 conn(0x7f3c38072820 0x7f3c380c2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.413+0000 7f3c3f7f6640 1 -- 172.21.15.100:0/4013589457 >> 172.21.15.100:0/4013589457 conn(0x7f3c380c9d00 msgr2=0x7f3c380ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.413+0000 7f3c3f7f6640 1 -- 172.21.15.100:0/4013589457 shutdown_connections 2024-09-11T22:36:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.413+0000 7f3c3f7f6640 1 -- 172.21.15.100:0/4013589457 wait complete. 2024-09-11T22:36:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.415+0000 7f3c3f7f6640 1 Processor -- start 2024-09-11T22:36:48.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.415+0000 7f3c3f7f6640 1 -- start start 2024-09-11T22:36:48.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.415+0000 7f3c3f7f6640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c38072820 0x7f3c381de0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:48.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.415+0000 7f3c3f7f6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c380c8fb0 0x7f3c381e3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:48.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.415+0000 7f3c3f7f6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c38155050 0x7f3c38151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:48.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.415+0000 7f3c3f7f6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3c380c81f0 con 0x7f3c380c8fb0 2024-09-11T22:36:48.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.415+0000 7f3c3f7f6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3c38158670 con 0x7f3c38155050 2024-09-11T22:36:48.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.415+0000 7f3c3f7f6640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f3c380c84d0 con 0x7f3c38072820 2024-09-11T22:36:48.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.415+0000 7f3c3cd91640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c380c8fb0 0x7f3c381e3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:48.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.415+0000 7f3c3cd91640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c380c8fb0 0x7f3c381e3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45246/0 (socket says 172.21.15.100:45246) 2024-09-11T22:36:48.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.415+0000 7f3c3cd91640 1 -- 172.21.15.100:0/1081075305 learned_addr learned my addr 172.21.15.100:0/1081075305 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:48.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.415+0000 7f3c3d592640 1 --2- 172.21.15.100:0/1081075305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c38072820 0x7f3c381de0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:48.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.415+0000 7f3c3dd93640 1 --2- 172.21.15.100:0/1081075305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c38155050 0x7f3c38151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:48.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.416+0000 7f3c3cd91640 1 -- 172.21.15.100:0/1081075305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c38072820 msgr2=0x7f3c381de0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:48.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.416+0000 7f3c3cd91640 1 --2- 172.21.15.100:0/1081075305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c38072820 0x7f3c381de0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:48.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.416+0000 7f3c3cd91640 1 -- 172.21.15.100:0/1081075305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c38155050 msgr2=0x7f3c38151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:48.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.416+0000 7f3c3cd91640 1 --2- 172.21.15.100:0/1081075305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c38155050 0x7f3c38151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:48.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.416+0000 7f3c3cd91640 1 -- 172.21.15.100:0/1081075305 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c381dd920 con 0x7f3c380c8fb0 2024-09-11T22:36:48.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.416+0000 7f3c3cd91640 1 --2- 172.21.15.100:0/1081075305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c380c8fb0 0x7f3c381e3520 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400e870 tx=0x7f3c3400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:48.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.416+0000 7f3c2dffb640 1 -- 172.21.15.100:0/1081075305 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c34017070 con 0x7f3c380c8fb0 2024-09-11T22:36:48.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.416+0000 7f3c2dffb640 1 -- 172.21.15.100:0/1081075305 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3c3400c940 con 0x7f3c380c8fb0 2024-09-11T22:36:48.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.416+0000 7f3c2dffb640 1 -- 172.21.15.100:0/1081075305 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3400cd30 con 0x7f3c380c8fb0 2024-09-11T22:36:48.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.416+0000 7f3c3f7f6640 1 -- 172.21.15.100:0/1081075305 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c380b0240 con 0x7f3c380c8fb0 2024-09-11T22:36:48.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.416+0000 7f3c3f7f6640 1 -- 172.21.15.100:0/1081075305 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c381ddb90 con 0x7f3c380c8fb0 2024-09-11T22:36:48.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.417+0000 7f3c3f7f6640 1 -- 172.21.15.100:0/1081075305 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c380c87b0 con 0x7f3c380c8fb0 2024-09-11T22:36:48.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.418+0000 7f3c2dffb640 1 -- 172.21.15.100:0/1081075305 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3c3401a070 con 0x7f3c380c8fb0 2024-09-11T22:36:48.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.418+0000 7f3c2dffb640 1 --2- 172.21.15.100:0/1081075305 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3c1c06be30 0x7f3c1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:48.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.418+0000 7f3c2dffb640 1 -- 172.21.15.100:0/1081075305 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6584+0+0 (secure 0 0 0) 0x7f3c3408b290 con 0x7f3c380c8fb0 2024-09-11T22:36:48.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.418+0000 7f3c3d592640 1 --2- 172.21.15.100:0/1081075305 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3c1c06be30 0x7f3c1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:48.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.419+0000 7f3c3d592640 1 --2- 172.21.15.100:0/1081075305 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3c1c06be30 0x7f3c1c06e2f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3c28000f60 tx=0x7f3c28009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:48.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.423+0000 7f3c2dffb640 1 -- 172.21.15.100:0/1081075305 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3c34059310 con 0x7f3c380c8fb0 2024-09-11T22:36:48.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:48.590+0000 7f3c3f7f6640 1 -- 172.21.15.100:0/1081075305 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3c3806c460 con 0x7f3c380c8fb0 2024-09-11T22:36:49.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.290+0000 7f3c2dffb640 1 -- 172.21.15.100:0/1081075305 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) ==== 169+0+0 (secure 0 0 0) 0x7f3c3405d610 con 0x7f3c380c8fb0 2024-09-11T22:36:49.291 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' removed 2024-09-11T22:36:49.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.292+0000 7f3c3f7f6640 1 -- 172.21.15.100:0/1081075305 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3c1c06be30 msgr2=0x7f3c1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:49.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.292+0000 7f3c3f7f6640 1 --2- 172.21.15.100:0/1081075305 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3c1c06be30 0x7f3c1c06e2f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3c28000f60 tx=0x7f3c28009040 comp rx=0 tx=0).stop 2024-09-11T22:36:49.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.292+0000 7f3c3f7f6640 1 -- 172.21.15.100:0/1081075305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c380c8fb0 msgr2=0x7f3c381e3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:49.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.292+0000 7f3c3f7f6640 1 --2- 172.21.15.100:0/1081075305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c380c8fb0 0x7f3c381e3520 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400e870 tx=0x7f3c3400ed30 comp rx=0 tx=0).stop 2024-09-11T22:36:49.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.292+0000 7f3c3f7f6640 1 -- 172.21.15.100:0/1081075305 shutdown_connections 2024-09-11T22:36:49.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.292+0000 7f3c3f7f6640 1 --2- 172.21.15.100:0/1081075305 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f3c1c06be30 0x7f3c1c06e2f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:49.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.292+0000 7f3c3f7f6640 1 --2- 172.21.15.100:0/1081075305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3c38155050 0x7f3c38151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:49.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.292+0000 7f3c3f7f6640 1 --2- 172.21.15.100:0/1081075305 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c380c8fb0 0x7f3c381e3520 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:49.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.292+0000 7f3c3f7f6640 1 --2- 172.21.15.100:0/1081075305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3c38072820 0x7f3c381de0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:49.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.292+0000 7f3c3f7f6640 1 -- 172.21.15.100:0/1081075305 >> 172.21.15.100:0/1081075305 conn(0x7f3c380c9d00 msgr2=0x7f3c38154130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:49.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.292+0000 7f3c3f7f6640 1 -- 172.21.15.100:0/1081075305 shutdown_connections 2024-09-11T22:36:49.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.292+0000 7f3c3f7f6640 1 -- 172.21.15.100:0/1081075305 wait complete. 2024-09-11T22:36:49.306 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-11T22:36:49.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.410+0000 7f86bc627640 1 Processor -- start 2024-09-11T22:36:49.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.410+0000 7f86bc627640 1 -- start start 2024-09-11T22:36:49.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.411+0000 7f86bc627640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f86b4154d20 0x7f86b40cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:49.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.411+0000 7f86bc627640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86b40cc770 0x7f86b40cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:49.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.411+0000 7f86bc627640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f86b4072230 0x7f86b40726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:49.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.411+0000 7f86bc627640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f86b415ebe0 con 0x7f86b4154d20 2024-09-11T22:36:49.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.411+0000 7f86bc627640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 -- 0x7f86b4155100 con 0x7f86b4072230 2024-09-11T22:36:49.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.411+0000 7f86bc627640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f86b40c5d80 con 0x7f86b40cc770 2024-09-11T22:36:49.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.411+0000 7f86ba3c3640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f86b4154d20 0x7f86b40cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:49.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.411+0000 7f86ba3c3640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f86b4154d20 0x7f86b40cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45248/0 (socket says 172.21.15.100:45248) 2024-09-11T22:36:49.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.411+0000 7f86ba3c3640 1 -- 172.21.15.100:0/3062660583 learned_addr learned my addr 172.21.15.100:0/3062660583 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:49.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.411+0000 7f86b9bc2640 1 --2- 172.21.15.100:0/3062660583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86b40cc770 0x7f86b40cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:49.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.411+0000 7f86babc4640 1 --2- 172.21.15.100:0/3062660583 >> v2:172.21.15.167:3300/0 conn(0x7f86b4072230 0x7f86b40726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:49.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.411+0000 7f86ba3c3640 1 -- 172.21.15.100:0/3062660583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86b40cc770 msgr2=0x7f86b40cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:49.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.411+0000 7f86ba3c3640 1 --2- 172.21.15.100:0/3062660583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86b40cc770 0x7f86b40cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:49.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.411+0000 7f86ba3c3640 1 -- 172.21.15.100:0/3062660583 >> v2:172.21.15.167:3300/0 conn(0x7f86b4072230 msgr2=0x7f86b40726e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T22:36:49.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.411+0000 7f86ba3c3640 1 --2- 172.21.15.100:0/3062660583 >> v2:172.21.15.167:3300/0 conn(0x7f86b4072230 0x7f86b40726e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:49.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.411+0000 7f86ba3c3640 1 -- 172.21.15.100:0/3062660583 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b415dfd0 con 0x7f86b4154d20 2024-09-11T22:36:49.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.412+0000 7f86ba3c3640 1 --2- 172.21.15.100:0/3062660583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b4154d20 0x7f86b40cb300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86b40b4520 tx=0x7f86a402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc22688a3d7489d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:49.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.412+0000 7f86b93c1640 1 -- 172.21.15.100:0/3062660583 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a4037070 con 0x7f86b4154d20 2024-09-11T22:36:49.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.412+0000 7f86b93c1640 1 -- 172.21.15.100:0/3062660583 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f86a4032440 con 0x7f86b4154d20 2024-09-11T22:36:49.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.412+0000 7f86b93c1640 1 -- 172.21.15.100:0/3062660583 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a4032830 con 0x7f86b4154d20 2024-09-11T22:36:49.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.413+0000 7f86bc627640 1 -- 172.21.15.100:0/3062660583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b4154d20 msgr2=0x7f86b40cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:49.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.413+0000 7f86bc627640 1 --2- 172.21.15.100:0/3062660583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b4154d20 0x7f86b40cb300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86b40b4520 tx=0x7f86a402a1e0 comp rx=0 tx=0).stop 2024-09-11T22:36:49.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.413+0000 7f86bc627640 1 -- 172.21.15.100:0/3062660583 shutdown_connections 2024-09-11T22:36:49.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.413+0000 7f86bc627640 1 --2- 172.21.15.100:0/3062660583 >> v2:172.21.15.167:3300/0 conn(0x7f86b4072230 0x7f86b40726e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:49.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.413+0000 7f86bc627640 1 --2- 172.21.15.100:0/3062660583 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86b40cc770 0x7f86b40cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:49.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.413+0000 7f86bc627640 1 --2- 172.21.15.100:0/3062660583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b4154d20 0x7f86b40cb300 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:49.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.413+0000 7f86bc627640 1 -- 172.21.15.100:0/3062660583 >> 172.21.15.100:0/3062660583 conn(0x7f86b40d0380 msgr2=0x7f86b40d0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:49.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.413+0000 7f86bc627640 1 -- 172.21.15.100:0/3062660583 shutdown_connections 2024-09-11T22:36:49.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.413+0000 7f86bc627640 1 -- 172.21.15.100:0/3062660583 wait complete. 2024-09-11T22:36:49.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.414+0000 7f86bc627640 1 Processor -- start 2024-09-11T22:36:49.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.414+0000 7f86bc627640 1 -- start start 2024-09-11T22:36:49.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.415+0000 7f86bc627640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86b4072230 0x7f86b40b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:49.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.415+0000 7f86bc627640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b40cc770 0x7f86b40b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:49.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.415+0000 7f86bc627640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86b4154d20 0x7f86b4159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:49.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.415+0000 7f86bc627640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f86b415e870 con 0x7f86b40cc770 2024-09-11T22:36:49.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.415+0000 7f86bc627640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f86b415e590 con 0x7f86b4154d20 2024-09-11T22:36:49.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.415+0000 7f86bc627640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 -- 0x7f86b415aaa0 con 0x7f86b4072230 2024-09-11T22:36:49.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.415+0000 7f86b9bc2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b40cc770 0x7f86b40b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:49.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.415+0000 7f86b9bc2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b40cc770 0x7f86b40b57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45264/0 (socket says 172.21.15.100:45264) 2024-09-11T22:36:49.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.415+0000 7f86b9bc2640 1 -- 172.21.15.100:0/649626797 learned_addr learned my addr 172.21.15.100:0/649626797 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-11T22:36:49.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.415+0000 7f86ba3c3640 1 --2- 172.21.15.100:0/649626797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86b4072230 0x7f86b40b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:49.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.415+0000 7f86babc4640 1 --2- 172.21.15.100:0/649626797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86b4154d20 0x7f86b4159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:49.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.415+0000 7f86b9bc2640 1 -- 172.21.15.100:0/649626797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86b4072230 msgr2=0x7f86b40b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:49.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.415+0000 7f86b9bc2640 1 --2- 172.21.15.100:0/649626797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86b4072230 0x7f86b40b5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:49.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.415+0000 7f86b9bc2640 1 -- 172.21.15.100:0/649626797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86b4154d20 msgr2=0x7f86b4159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:49.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.415+0000 7f86b9bc2640 1 --2- 172.21.15.100:0/649626797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86b4154d20 0x7f86b4159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:49.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.415+0000 7f86b9bc2640 1 -- 172.21.15.100:0/649626797 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b415db30 con 0x7f86b40cc770 2024-09-11T22:36:49.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.415+0000 7f86b9bc2640 1 --2- 172.21.15.100:0/649626797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b40cc770 0x7f86b40b57a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f86b000d800 tx=0x7f86b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:49.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.415+0000 7f86aaffd640 1 -- 172.21.15.100:0/649626797 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b0004020 con 0x7f86b40cc770 2024-09-11T22:36:49.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.415+0000 7f86aaffd640 1 -- 172.21.15.100:0/649626797 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f86b00041c0 con 0x7f86b40cc770 2024-09-11T22:36:49.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.415+0000 7f86bc627640 1 -- 172.21.15.100:0/649626797 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86b41f1250 con 0x7f86b40cc770 2024-09-11T22:36:49.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.415+0000 7f86aaffd640 1 -- 172.21.15.100:0/649626797 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b00043b0 con 0x7f86b40cc770 2024-09-11T22:36:49.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.416+0000 7f86bc627640 1 -- 172.21.15.100:0/649626797 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86b415a150 con 0x7f86b40cc770 2024-09-11T22:36:49.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.417+0000 7f86bc627640 1 -- 172.21.15.100:0/649626797 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86b4068de0 con 0x7f86b40cc770 2024-09-11T22:36:49.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.417+0000 7f86aaffd640 1 -- 172.21.15.100:0/649626797 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f86b001b020 con 0x7f86b40cc770 2024-09-11T22:36:49.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.417+0000 7f86aaffd640 1 --2- 172.21.15.100:0/649626797 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f869806be30 0x7f869806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T22:36:49.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.417+0000 7f86aaffd640 1 -- 172.21.15.100:0/649626797 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6025+0+0 (secure 0 0 0) 0x7f86b008abc0 con 0x7f86b40cc770 2024-09-11T22:36:49.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.417+0000 7f86ba3c3640 1 --2- 172.21.15.100:0/649626797 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f869806be30 0x7f869806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T22:36:49.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.418+0000 7f86ba3c3640 1 --2- 172.21.15.100:0/649626797 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f869806be30 0x7f869806e2f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f86a4034000 tx=0x7f86a402e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T22:36:49.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.422+0000 7f86aaffd640 1 -- 172.21.15.100:0/649626797 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f86b4068de0 con 0x7f86b40cc770 2024-09-11T22:36:49.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:49.609+0000 7f86bc627640 1 -- 172.21.15.100:0/649626797 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f86b40cb920 con 0x7f86b40cc770 2024-09-11T22:36:50.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:50.291+0000 7f86aaffd640 1 -- 172.21.15.100:0/649626797 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) ==== 178+0+0 (secure 0 0 0) 0x7f86b0058e70 con 0x7f86b40cc770 2024-09-11T22:36:50.292 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data_ec' removed 2024-09-11T22:36:50.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:50.293+0000 7f86bc627640 1 -- 172.21.15.100:0/649626797 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f869806be30 msgr2=0x7f869806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:50.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:50.293+0000 7f86bc627640 1 --2- 172.21.15.100:0/649626797 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f869806be30 0x7f869806e2f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f86a4034000 tx=0x7f86a402e000 comp rx=0 tx=0).stop 2024-09-11T22:36:50.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:50.293+0000 7f86bc627640 1 -- 172.21.15.100:0/649626797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b40cc770 msgr2=0x7f86b40b57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T22:36:50.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:50.293+0000 7f86bc627640 1 --2- 172.21.15.100:0/649626797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b40cc770 0x7f86b40b57a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f86b000d800 tx=0x7f86b000dcc0 comp rx=0 tx=0).stop 2024-09-11T22:36:50.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:50.293+0000 7f86bc627640 1 -- 172.21.15.100:0/649626797 shutdown_connections 2024-09-11T22:36:50.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:50.293+0000 7f86bc627640 1 --2- 172.21.15.100:0/649626797 >> [v2:172.21.15.100:6832/1748304473,v1:172.21.15.100:6833/1748304473] conn(0x7f869806be30 0x7f869806e2f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:50.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:50.293+0000 7f86bc627640 1 --2- 172.21.15.100:0/649626797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86b4154d20 0x7f86b4159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:50.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:50.293+0000 7f86bc627640 1 --2- 172.21.15.100:0/649626797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b40cc770 0x7f86b40b57a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:50.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:50.293+0000 7f86bc627640 1 --2- 172.21.15.100:0/649626797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86b4072230 0x7f86b40b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T22:36:50.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:50.293+0000 7f86bc627640 1 -- 172.21.15.100:0/649626797 >> 172.21.15.100:0/649626797 conn(0x7f86b40d0380 msgr2=0x7f86b4152f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T22:36:50.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:50.294+0000 7f86bc627640 1 -- 172.21.15.100:0/649626797 shutdown_connections 2024-09-11T22:36:50.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-11T22:36:50.294+0000 7f86bc627640 1 -- 172.21.15.100:0/649626797 wait complete. 2024-09-11T22:36:50.313 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-11T22:36:50.314 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-11T22:36:50.314 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:36:50.325 INFO:tasks.ceph.mds.a:Stopped 2024-09-11T22:36:50.325 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-11T22:36:50.325 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:36:50.380 INFO:tasks.ceph.mds.c:Stopped 2024-09-11T22:36:50.380 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-09-11T22:36:50.380 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:36:50.429 INFO:tasks.ceph.mds.e:Stopped 2024-09-11T22:36:50.429 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-11T22:36:50.429 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:36:50.439 INFO:tasks.ceph.mds.b:Stopped 2024-09-11T22:36:50.439 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-11T22:36:50.439 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:36:50.492 INFO:tasks.ceph.mds.d:Stopped 2024-09-11T22:36:50.492 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-09-11T22:36:50.492 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:36:50.541 INFO:tasks.ceph.mds.f:Stopped 2024-09-11T22:36:50.541 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-11T22:36:50.541 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-11T22:36:50.541 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:36:50.623 INFO:tasks.ceph.osd.0:Stopped 2024-09-11T22:36:50.623 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-11T22:36:50.623 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:36:50.721 INFO:tasks.ceph.osd.1:Stopped 2024-09-11T22:36:50.721 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-11T22:36:50.722 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:36:50.806 INFO:tasks.ceph.osd.2:Stopped 2024-09-11T22:36:50.806 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-11T22:36:50.806 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:36:50.882 INFO:tasks.ceph.osd.3:Stopped 2024-09-11T22:36:50.883 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-11T22:36:50.883 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:36:50.962 INFO:tasks.ceph.osd.4:Stopped 2024-09-11T22:36:50.962 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-11T22:36:50.963 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:36:51.040 INFO:tasks.ceph.osd.5:Stopped 2024-09-11T22:36:51.040 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-11T22:36:51.040 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:36:51.133 INFO:tasks.ceph.osd.6:Stopped 2024-09-11T22:36:51.133 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-11T22:36:51.133 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:36:51.214 INFO:tasks.ceph.osd.7:Stopped 2024-09-11T22:36:51.214 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-11T22:36:51.215 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-11T22:36:51.215 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:36:51.252 INFO:tasks.ceph.mgr.y:Stopped 2024-09-11T22:36:51.253 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-11T22:36:51.253 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:36:51.281 INFO:tasks.ceph.mgr.x:Stopped 2024-09-11T22:36:51.281 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-11T22:36:51.281 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T22:36:51.282 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:36:51.304 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T22:36:51.304 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-11T22:36:51.304 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:36:51.335 INFO:tasks.ceph.mon.b:Stopped 2024-09-11T22:36:51.336 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-11T22:36:51.336 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T22:36:51.391 INFO:tasks.ceph.mon.c:Stopped 2024-09-11T22:36:51.391 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-11T22:36:51.392 DEBUG:teuthology.orchestra.run.smithi100:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-11T22:36:51.514 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-11T22:36:51.514 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-11T22:36:52.075 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-11T22:36:52.075 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-11T22:36:52.256 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-11T22:36:52.256 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-11T22:36:52.375 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi100.front.sepia.ceph.com 2024-09-11T22:36:52.375 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-11T22:36:52.516 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-11T22:36:52.517 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-11T22:36:52.951 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-11T22:36:52.952 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-11T22:36:53.097 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-11T22:36:53.097 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-11T22:36:53.197 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi167.front.sepia.ceph.com 2024-09-11T22:36:53.198 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-11T22:36:53.320 INFO:tasks.ceph:Archiving mon data... 2024-09-11T22:36:53.322 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901420/data/mon.a.tgz 2024-09-11T22:36:53.322 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-09-11T22:36:53.341 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.Mf27FC8LSx 2024-09-11T22:36:53.342 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Mf27FC8LSx 2024-09-11T22:36:53.638 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.Mf27FC8LSx 2024-09-11T22:36:53.756 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.Mf27FC8LSx is 453KB 2024-09-11T22:36:53.826 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.Mf27FC8LSx 2024-09-11T22:36:53.841 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901420/data/mon.b.tgz 2024-09-11T22:36:53.842 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2024-09-11T22:36:53.867 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.UatA0beWyd 2024-09-11T22:36:53.867 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.UatA0beWyd 2024-09-11T22:36:54.024 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.UatA0beWyd 2024-09-11T22:36:54.132 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.UatA0beWyd is 452KB 2024-09-11T22:36:54.230 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.UatA0beWyd 2024-09-11T22:36:54.245 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901420/data/mon.c.tgz 2024-09-11T22:36:54.245 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2024-09-11T22:36:54.299 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.njCjZirMgN 2024-09-11T22:36:54.299 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.njCjZirMgN 2024-09-11T22:36:54.443 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.njCjZirMgN 2024-09-11T22:36:54.527 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.njCjZirMgN is 455KB 2024-09-11T22:36:54.624 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.njCjZirMgN 2024-09-11T22:36:54.639 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-11T22:36:54.639 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T22:36:54.642 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T22:36:54.736 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T22:36:54.781 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T22:36:54.781 INFO:tasks.ceph:Archiving crash dumps... 2024-09-11T22:36:54.783 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901420/remote/smithi100/crash 2024-09-11T22:36:54.783 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T22:36:54.808 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901420/remote/smithi167/crash 2024-09-11T22:36:54.809 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T22:36:54.845 INFO:tasks.ceph:Shutting down logrotate 2024-09-11T22:38:11.563 INFO:teuthology.orchestra.run.smithi100.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.3.log.1: 2024-09-11T22:38:11.564 INFO:teuthology.orchestra.run.smithi100.stderr:gzip: stdin: file size changed while zipping 2024-09-11T22:38:13.104 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-11T22:38:13.131 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-11T22:38:13.162 INFO:tasks.ceph:Compressing logs... 2024-09-11T22:38:13.162 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T22:38:13.174 DEBUG:teuthology.orchestra.run.smithi167:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T22:38:13.208 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-11T22:38:13.208 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51889.log 2024-09-11T22:38:13.214 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80720.log 2024-09-11T22:38:13.214 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90350.log 2024-09-11T22:38:13.214 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.80720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98093.log 2024-09-11T22:38:13.214 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.90350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43555.log 2024-09-11T22:38:13.214 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.98093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60083.log 2024-09-11T22:38:13.214 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.90350.log.gz 2024-09-11T22:38:13.215 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43555.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98093.log.gz 2024-09-11T22:38:13.215 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51015.log 2024-09-11T22:38:13.215 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55454.log 2024-09-11T22:38:13.215 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99290.log 2024-09-11T22:38:13.215 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55370.log 2024-09-11T22:38:13.215 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.99290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97455.log 2024-09-11T22:38:13.215 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97844.log 2024-09-11T22:38:13.215 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99290.log.gz 2024-09-11T22:38:13.215 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.97455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50265.log 2024-09-11T22:38:13.215 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.97844.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97455.log.gz 2024-09-11T22:38:13.215 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96564.log 2024-09-11T22:38:13.215 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50265.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97844.log.gz 2024-09-11T22:38:13.215 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41988.log 2024-09-11T22:38:13.215 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.96564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53948.log 2024-09-11T22:38:13.216 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41988.log: gzip 90.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.96564.log.gz --verbose 2024-09-11T22:38:13.216 INFO:teuthology.orchestra.run.smithi100.stderr: -- /var/log/ceph/ceph-client.admin.50349.log 2024-09-11T22:38:13.216 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55059.log 2024-09-11T22:38:13.216 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53197.log 2024-09-11T22:38:13.216 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45889.log 2024-09-11T22:38:13.216 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55538.log 2024-09-11T22:38:13.216 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42164.log 2024-09-11T22:38:13.216 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45118.log 2024-09-11T22:38:13.216 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55538.log: /var/log/ceph/ceph-client.admin.42164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50745.log 2024-09-11T22:38:13.261 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36310.log 2024-09-11T22:38:13.262 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-11T22:38:13.262 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.36310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36390.log 2024-09-11T22:38:13.262 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-11T22:38:13.262 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.36390.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-11T22:38:13.262 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36521.log 2024-09-11T22:38:13.262 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T22:38:13.262 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.36521.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-11T22:38:13.262 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36350.log 2024-09-11T22:38:13.262 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36481.log 2024-09-11T22:38:13.262 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.36350.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-11T22:38:13.262 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.36481.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-11T22:38:13.262 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T22:38:13.263 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36230.log 2024-09-11T22:38:13.263 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-11T22:38:13.263 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.36230.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-11T22:38:13.263 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-11T22:38:13.263 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36434.log 2024-09-11T22:38:13.263 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36270.log 2024-09-11T22:38:13.263 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.36434.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-09-11T22:38:13.263 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.36270.log: /var/log/ceph/ceph-mds.f.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36310.log.gz 2024-09-11T22:38:13.263 INFO:teuthology.orchestra.run.smithi167.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36350.log.gz 2024-09-11T22:38:13.263 INFO:teuthology.orchestra.run.smithi167.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36390.log.gz 2024-09-11T22:38:13.263 INFO:teuthology.orchestra.run.smithi167.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36270.log.gz 2024-09-11T22:38:13.263 INFO:teuthology.orchestra.run.smithi167.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36434.log.gz 2024-09-11T22:38:13.263 INFO:teuthology.orchestra.run.smithi167.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36481.log.gz 2024-09-11T22:38:13.264 INFO:teuthology.orchestra.run.smithi167.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36521.log.gz 2024-09-11T22:38:13.369 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75287.log 2024-09-11T22:38:13.369 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89448.log 2024-09-11T22:38:13.369 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.75287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51403.log 2024-09-11T22:38:13.369 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.89448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52074.log 2024-09-11T22:38:13.370 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75194.log 2024-09-11T22:38:13.370 INFO:teuthology.orchestra.run.smithi100.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.89448.log.gz 2024-09-11T22:38:13.370 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44039.log 2024-09-11T22:38:13.370 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.75194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45681.log 2024-09-11T22:38:13.370 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43320.log 2024-09-11T22:38:13.370 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50931.log 2024-09-11T22:38:13.370 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43535.log 2024-09-11T22:38:13.370 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53864.log 2024-09-11T22:38:13.370 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43535.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-11T22:38:13.370 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46573.log 2024-09-11T22:38:13.370 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54949.log 2024-09-11T22:38:13.370 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46573.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30141.log 2024-09-11T22:38:13.370 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60305.log 2024-09-11T22:38:13.371 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76721.log 2024-09-11T22:38:13.371 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.tmp-client.admin.30141.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30141.log.gz 2024-09-11T22:38:13.371 INFO:teuthology.orchestra.run.smithi100.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.54949.log.gz 2024-09-11T22:38:13.371 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54508.log 2024-09-11T22:38:13.371 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.76721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44867.log 2024-09-11T22:38:13.371 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98870.log 2024-09-11T22:38:13.371 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.44867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51787.log 2024-09-11T22:38:13.371 INFO:teuthology.orchestra.run.smithi100.stderr:gzip/var/log/ceph/ceph-client.admin.98870.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.41811.log 2024-09-11T22:38:13.371 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98251.log 2024-09-11T22:38:13.371 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98870.log.gz 2024-09-11T22:38:13.371 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72990.log 2024-09-11T22:38:13.371 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.98251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99248.log 2024-09-11T22:38:13.371 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.72990.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.98251.log.gz 2024-09-11T22:38:13.371 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54845.log 2024-09-11T22:38:13.372 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.99248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45245.log 2024-09-11T22:38:13.372 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54845.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99248.log.gz 2024-09-11T22:38:13.372 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53612.log 2024-09-11T22:38:13.372 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45413.log 2024-09-11T22:38:13.372 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62555.log 2024-09-11T22:38:13.372 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42374.log 2024-09-11T22:38:13.372 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43871.log 2024-09-11T22:38:13.372 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81931.log 2024-09-11T22:38:13.372 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42374.log: /var/log/ceph/ceph-client.admin.43871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46226.log 2024-09-11T22:38:13.372 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.81931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53113.log 2024-09-11T22:38:13.372 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96342.log 2024-09-11T22:38:13.372 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50391.log 2024-09-11T22:38:13.372 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.96342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44280.log 2024-09-11T22:38:13.373 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96342.log.gz 2024-09-11T22:38:13.373 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50619.log 2024-09-11T22:38:13.373 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50391.log: /var/log/ceph/ceph-client.admin.44280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98492.log 2024-09-11T22:38:13.373 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42030.log 2024-09-11T22:38:13.373 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.98492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52431.log 2024-09-11T22:38:13.373 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42030.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98492.log.gz 2024-09-11T22:38:13.373 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99374.log 2024-09-11T22:38:13.373 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98051.log 2024-09-11T22:38:13.373 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52431.log: /var/log/ceph/ceph-client.admin.99374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50307.log 2024-09-11T22:38:13.373 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.98051.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99374.log.gz 2024-09-11T22:38:13.373 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99540.log 2024-09-11T22:38:13.373 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.98051.log.gz 2024-09-11T22:38:13.373 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42122.log 2024-09-11T22:38:13.373 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50307.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44039.log.gz 2024-09-11T22:38:13.374 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.99540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45024.log 2024-09-11T22:38:13.374 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99540.log.gz 2024-09-11T22:38:13.374 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43313.log 2024-09-11T22:38:13.374 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75403.log 2024-09-11T22:38:13.374 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42638.log 2024-09-11T22:38:13.374 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.75403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51141.log 2024-09-11T22:38:13.374 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99624.log 2024-09-11T22:38:13.374 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42638.log: /var/log/ceph/ceph-client.admin.51141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45539.log 2024-09-11T22:38:13.374 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42164.log.gz 2024-09-11T22:38:13.374 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.99624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55580.log 2024-09-11T22:38:13.374 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99624.log.gz 2024-09-11T22:38:13.374 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83264.log 2024-09-11T22:38:13.374 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45539.log: /var/log/ceph/ceph-client.admin.55580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42639.log 2024-09-11T22:38:13.374 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.83264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55244.log 2024-09-11T22:38:13.375 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83363.log 2024-09-11T22:38:13.375 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91833.log 2024-09-11T22:38:13.375 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55244.log: /var/log/ceph/ceph-client.admin.83363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97073.log 2024-09-11T22:38:13.375 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.91833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41869.log 2024-09-11T22:38:13.375 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.97073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99704.log 2024-09-11T22:38:13.375 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.91833.log.gz 2024-09-11T22:38:13.375 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97073.log.gz 2024-09-11T22:38:13.375 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49995.log 2024-09-11T22:38:13.375 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43320.log.gz 2024-09-11T22:38:13.375 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45581.log 2024-09-11T22:38:13.375 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.99704.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43535.log.gz 2024-09-11T22:38:13.375 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49995.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99704.log.gz 2024-09-11T22:38:13.375 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95359.log 2024-09-11T22:38:13.376 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85944.log 2024-09-11T22:38:13.376 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43555.log.gz 2024-09-11T22:38:13.376 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.95359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77861.log 2024-09-11T22:38:13.376 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.95359.log.gz 2024-09-11T22:38:13.376 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.85944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41131.log 2024-09-11T22:38:13.376 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.85944.log.gz 2024-09-11T22:38:13.376 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.77861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54593.log 2024-09-11T22:38:13.376 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41131.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60083.log.gz 2024-09-11T22:38:13.376 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52885.log 2024-09-11T22:38:13.376 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60305.log.gz 2024-09-11T22:38:13.376 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54635.log 2024-09-11T22:38:13.376 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52885.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.62555.log.gz 2024-09-11T22:38:13.376 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43683.log 2024-09-11T22:38:13.376 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52557.log 2024-09-11T22:38:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43683.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.75194.log.gz 2024-09-11T22:38:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90131.log 2024-09-11T22:38:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99332.log 2024-09-11T22:38:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.90131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41047.log 2024-09-11T22:38:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.99332.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.90131.log.gz 2024-09-11T22:38:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55766.log 2024-09-11T22:38:13.377 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99332.log.gz 2024-09-11T22:38:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47210.log 2024-09-11T22:38:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42290.log 2024-09-11T22:38:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75097.log 2024-09-11T22:38:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42290.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45118.log.gz 2024-09-11T22:38:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.75097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51487.log 2024-09-11T22:38:13.377 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42458.log 2024-09-11T22:38:13.378 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52641.log 2024-09-11T22:38:13.378 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74915.log 2024-09-11T22:38:13.378 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42973.log 2024-09-11T22:38:13.378 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.74915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98660.log 2024-09-11T22:38:13.378 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55328.log 2024-09-11T22:38:13.378 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.98660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99582.log 2024-09-11T22:38:13.378 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98177.log 2024-09-11T22:38:13.378 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98660.log.gz 2024-09-11T22:38:13.378 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.99582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47168.log 2024-09-11T22:38:13.378 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.98177.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99582.log.gz 2024-09-11T22:38:13.378 INFO:teuthology.orchestra.run.smithi100.stderr:gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50391.log.gz 2024-09-11T22:38:13.378 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54761.log 2024-09-11T22:38:13.378 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47168.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.98177.log.gz 2024-09-11T22:38:13.378 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50619.log.gz 2024-09-11T22:38:13.379 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46489.log 2024-09-11T22:38:13.379 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54761.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51889.log.gz 2024-09-11T22:38:13.379 INFO:teuthology.orchestra.run.smithi100.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.53113.log.gz 2024-09-11T22:38:13.379 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T22:38:13.379 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94808.log 2024-09-11T22:38:13.379 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46405.log 2024-09-11T22:38:13.379 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.audit.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.55244.log.gz 2024-09-11T22:38:13.379 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.94808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53029.log 2024-09-11T22:38:13.379 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94808.log.gz 2024-09-11T22:38:13.379 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52843.log 2024-09-11T22:38:13.379 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55370.log.gz 2024-09-11T22:38:13.379 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55160.log 2024-09-11T22:38:13.379 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52843.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55454.log.gz 2024-09-11T22:38:13.379 INFO:teuthology.orchestra.run.smithi100.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.55538.log.gz 2024-09-11T22:38:13.379 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40561.log 2024-09-11T22:38:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43997.log 2024-09-11T22:38:13.380 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55580.log.gz 2024-09-11T22:38:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42630.log 2024-09-11T22:38:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40561.log: /var/log/ceph/ceph-client.admin.43997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52262.log 2024-09-11T22:38:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92912.log 2024-09-11T22:38:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58383.log 2024-09-11T22:38:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.92912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42976.log 2024-09-11T22:38:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99080.log 2024-09-11T22:38:13.380 INFO:teuthology.orchestra.run.smithi100.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.92912.log.gz 2024-09-11T22:38:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42975.log 2024-09-11T22:38:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.99080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95252.log 2024-09-11T22:38:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42975.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.99080.log.gz 2024-09-11T22:38:13.380 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98618.log 2024-09-11T22:38:13.381 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.95252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97662.log 2024-09-11T22:38:13.381 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.98618.log: 89.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49953.log 2024-09-11T22:38:13.381 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95252.log.gz 2024-09-11T22:38:13.381 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98618.log.gz 2024-09-11T22:38:13.381 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.97662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45762.log 2024-09-11T22:38:13.381 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54340.log 2024-09-11T22:38:13.381 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.97662.log.gz 2024-09-11T22:38:13.381 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36448.log 2024-09-11T22:38:13.381 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42072.log 2024-09-11T22:38:13.381 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90203.log 2024-09-11T22:38:13.381 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44346.log 2024-09-11T22:38:13.381 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.90203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43316.log 2024-09-11T22:38:13.381 INFO:teuthology.orchestra.run.smithi100.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.90203.log.gz 2024-09-11T22:38:13.381 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45203.log 2024-09-11T22:38:13.382 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43316.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.75097.log.gz 2024-09-11T22:38:13.382 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99498.log 2024-09-11T22:38:13.382 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99456.log 2024-09-11T22:38:13.382 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.99498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45805.log 2024-09-11T22:38:13.382 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.99456.log: gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.99498.log.gz 2024-09-11T22:38:13.382 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45287.log 2024-09-11T22:38:13.382 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99456.log.gz 2024-09-11T22:38:13.382 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54053.log 2024-09-11T22:38:13.382 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99164.log 2024-09-11T22:38:13.382 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45847.log 2024-09-11T22:38:13.382 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.99164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40793.log 2024-09-11T22:38:13.382 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45847.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99164.log.gz 2024-09-11T22:38:13.382 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47270.log 2024-09-11T22:38:13.382 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42962.log 2024-09-11T22:38:13.383 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41988.log.gz 2024-09-11T22:38:13.383 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42030.log.gz 2024-09-11T22:38:13.383 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52200.log 2024-09-11T22:38:13.383 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47270.log: /var/log/ceph/ceph-client.admin.42962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53822.log 2024-09-11T22:38:13.383 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76068.log 2024-09-11T22:38:13.383 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52389.log 2024-09-11T22:38:13.383 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.76068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98996.log 2024-09-11T22:38:13.383 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47168.log.gz 2024-09-11T22:38:13.383 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52389.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.50265.log.gz 2024-09-11T22:38:13.383 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53071.log 2024-09-11T22:38:13.383 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.98996.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50307.log.gz 2024-09-11T22:38:13.383 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98996.log.gz 2024-09-11T22:38:13.383 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50349.log.gz 2024-09-11T22:38:13.383 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97925.log 2024-09-11T22:38:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52347.log 2024-09-11T22:38:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.97925.log: /var/log/ceph/ceph-client.admin.52347.log: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.97925.log.gz 2024-09-11T22:38:13.384 INFO:teuthology.orchestra.run.smithi100.stderr: 91.9% 92.8% -- replaced with /var/log/ceph/ceph-client.admin.52557.log.gz -- replaced with /var/log/ceph/ceph-client.admin.51787.log.gz 2024-09-11T22:38:13.384 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-11T22:38:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50577.log 2024-09-11T22:38:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:gzip 89.7% 90.3% -- replaced with /var/log/ceph/ceph-client.admin.52885.log.gz -- replaced with /var/log/ceph/ceph-client.admin.52843.log.gz 2024-09-11T22:38:13.384 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-11T22:38:13.384 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.62225.log 2024-09-11T22:38:13.384 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53612.log.gz 2024-09-11T22:38:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45329.log 2024-09-11T22:38:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42637.log 2024-09-11T22:38:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45329.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54845.log.gz 2024-09-11T22:38:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55202.log 2024-09-11T22:38:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:gzip/var/log/ceph/ceph-client.admin.42637.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53281.log 2024-09-11T22:38:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42972.log 2024-09-11T22:38:13.385 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55160.log.gz 2024-09-11T22:38:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53654.log 2024-09-11T22:38:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42972.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41811.log.gz 2024-09-11T22:38:13.385 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41869.log.gz 2024-09-11T22:38:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92621.log 2024-09-11T22:38:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40751.log 2024-09-11T22:38:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.92621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91616.log 2024-09-11T22:38:13.385 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4%/var/log/ceph/ceph-client.admin.40751.log: -- replaced with /var/log/ceph/ceph-client.admin.92621.log.gz 2024-09-11T22:38:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40879.log 2024-09-11T22:38:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.91616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96653.log 2024-09-11T22:38:13.385 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.91616.log.gz 2024-09-11T22:38:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40302.log 2024-09-11T22:38:13.386 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40879.log: /var/log/ceph/ceph-client.admin.96653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41627.log 2024-09-11T22:38:13.386 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40302.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96653.log.gz 2024-09-11T22:38:13.386 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51951.log 2024-09-11T22:38:13.386 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81988.log 2024-09-11T22:38:13.386 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51951.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-11T22:38:13.386 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.81988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51847.log 2024-09-11T22:38:13.386 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98786.log 2024-09-11T22:38:13.386 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53991.log 2024-09-11T22:38:13.386 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.98786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53570.log 2024-09-11T22:38:13.386 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98786.log.gz 2024-09-11T22:38:13.386 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40200.log 2024-09-11T22:38:13.386 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52304.log 2024-09-11T22:38:13.386 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54803.log 2024-09-11T22:38:13.386 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40417.log 2024-09-11T22:38:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66145.log 2024-09-11T22:38:13.387 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54803.log.gz 2024-09-11T22:38:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53409.log 2024-09-11T22:38:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.66145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96440.log 2024-09-11T22:38:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54466.log 2024-09-11T22:38:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.96440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54382.log 2024-09-11T22:38:13.387 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.96440.log.gz 2024-09-11T22:38:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42974.log 2024-09-11T22:38:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43913.log 2024-09-11T22:38:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54137.log 2024-09-11T22:38:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72835.log 2024-09-11T22:38:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98912.log 2024-09-11T22:38:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.72835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45932.log 2024-09-11T22:38:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.98912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36184.log 2024-09-11T22:38:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45932.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98912.log.gz 2024-09-11T22:38:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81364.log 2024-09-11T22:38:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36184.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42122.log.gz 2024-09-11T22:38:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83481.log 2024-09-11T22:38:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.81364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95062.log 2024-09-11T22:38:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.83481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54095.log 2024-09-11T22:38:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.95062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45074.log 2024-09-11T22:38:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54095.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.80720.log.gz 2024-09-11T22:38:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46531.log 2024-09-11T22:38:13.388 INFO:teuthology.orchestra.run.smithi100.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.95062.log.gz 2024-09-11T22:38:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45371.log 2024-09-11T22:38:13.388 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.81931.log.gz 2024-09-11T22:38:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46615.log 2024-09-11T22:38:13.388 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.77861.log.gz 2024-09-11T22:38:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46531.log: /var/log/ceph/ceph-client.admin.45371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51739.log 2024-09-11T22:38:13.389 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.83264.log.gz 89.3% 2024-09-11T22:38:13.389 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.83363.log.gz 2024-09-11T22:38:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54991.log 2024-09-11T22:38:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51445.log 2024-09-11T22:38:13.389 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42290.log.gz 2024-09-11T22:38:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99746.log 2024-09-11T22:38:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51445.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54991.log.gz 2024-09-11T22:38:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-11T22:38:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77776.log 2024-09-11T22:38:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.99746.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46360.log 2024-09-11T22:38:13.389 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99746.log.gz 2024-09-11T22:38:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.77776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99122.log 2024-09-11T22:38:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66045.log 2024-09-11T22:38:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.99122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46318.log 2024-09-11T22:38:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.66045.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99122.log.gz 2024-09-11T22:38:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50889.log 2024-09-11T22:38:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81852.log 2024-09-11T22:38:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54719.log 2024-09-11T22:38:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.81852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97967.log 2024-09-11T22:38:13.390 INFO:teuthology.orchestra.run.smithi100.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.46573.log.gz 2024-09-11T22:38:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98828.log 2024-09-11T22:38:13.390 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43997.log.gz 2024-09-11T22:38:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.97967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53696.log 2024-09-11T22:38:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.98828.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97967.log.gz 2024-09-11T22:38:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45161.log 2024-09-11T22:38:13.390 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98828.log.gz 2024-09-11T22:38:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40647.log 2024-09-11T22:38:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50433.log 2024-09-11T22:38:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44081.log 2024-09-11T22:38:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44123.log 2024-09-11T22:38:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91712.log 2024-09-11T22:38:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44123.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-11T22:38:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.91712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52969.log 2024-09-11T22:38:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.2.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.91712.log.gz 2024-09-11T22:38:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45497.log 2024-09-11T22:38:13.391 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45681.log.gz 2024-09-11T22:38:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45455.log 2024-09-11T22:38:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43318.log 2024-09-11T22:38:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98135.log 2024-09-11T22:38:13.391 INFO:teuthology.orchestra.run.smithi100.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.45889.log.gz 2024-09-11T22:38:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46276.log 2024-09-11T22:38:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.98135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42248.log 2024-09-11T22:38:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46276.log: gzip -5 88.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.98135.log.gz 2024-09-11T22:38:13.392 INFO:teuthology.orchestra.run.smithi100.stderr: /var/log/ceph/ceph-client.admin.50181.log 2024-09-11T22:38:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:gzip/var/log/ceph/ceph-client.admin.42248.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.96496.log 2024-09-11T22:38:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43681.log 2024-09-11T22:38:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.96496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55622.log 2024-09-11T22:38:13.392 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.96496.log.gz 2024-09-11T22:38:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43680.log 2024-09-11T22:38:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50973.log 2024-09-11T22:38:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53489.log 2024-09-11T22:38:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42206.log 2024-09-11T22:38:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82058.log 2024-09-11T22:38:13.392 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51529.log 2024-09-11T22:38:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.82058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93320.log 2024-09-11T22:38:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95309.log 2024-09-11T22:38:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.93320.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53197.log.gz 2024-09-11T22:38:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53780.log 2024-09-11T22:38:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.95309.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93320.log.gz 2024-09-11T22:38:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:gzip 89.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.59996.log 2024-09-11T22:38:13.393 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45024.log.gz 2024-09-11T22:38:13.393 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45074.log.gz 2024-09-11T22:38:13.393 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9%/var/log/ceph/ceph-client.admin.53780.log: -- replaced with /var/log/ceph/ceph-client.admin.95309.log.gz 2024-09-11T22:38:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-11T22:38:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51277.log 2024-09-11T22:38:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40963.log 2024-09-11T22:38:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52599.log 2024-09-11T22:38:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36538.log 2024-09-11T22:38:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46161.log 2024-09-11T22:38:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77318.log 2024-09-11T22:38:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44169.log 2024-09-11T22:38:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.77318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45974.log 2024-09-11T22:38:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44169.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T22:38:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53367.log 2024-09-11T22:38:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53239.log 2024-09-11T22:38:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46447.log 2024-09-11T22:38:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53906.log 2024-09-11T22:38:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55286.log 2024-09-11T22:38:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59088.log 2024-09-11T22:38:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46034.log 2024-09-11T22:38:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43181.log 2024-09-11T22:38:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59088.log: /var/log/ceph/ceph-client.admin.46034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45623.log 2024-09-11T22:38:13.395 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.41131.log.gz 2024-09-11T22:38:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95409.log 2024-09-11T22:38:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41197.log 2024-09-11T22:38:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.95409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41089.log 2024-09-11T22:38:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41197.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54424.log 2024-09-11T22:38:13.395 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95409.log.gz 2024-09-11T22:38:13.395 INFO:teuthology.orchestra.run.smithi100.stderr: 87.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T22:38:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51655.log 2024-09-11T22:38:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52801.log 2024-09-11T22:38:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54258.log 2024-09-11T22:38:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52720.log 2024-09-11T22:38:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52801.log: /var/log/ceph/ceph-client.admin.54258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59817.log 2024-09-11T22:38:13.395 INFO:teuthology.orchestra.run.smithi100.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.53864.log.gz 2024-09-11T22:38:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46076.log 2024-09-11T22:38:13.396 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53948.log.gz 2024-09-11T22:38:13.396 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51319.log 2024-09-11T22:38:13.396 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54340.log.gz 2024-09-11T22:38:13.396 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73062.log 2024-09-11T22:38:13.396 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46076.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.54508.log.gz 2024-09-11T22:38:13.396 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90280.log 2024-09-11T22:38:13.396 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51319.log: /var/log/ceph/ceph-client.admin.73062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60209.log 2024-09-11T22:38:13.396 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.90280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50037.log 2024-09-11T22:38:13.396 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.90280.log.gz 2024-09-11T22:38:13.396 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85116.log 2024-09-11T22:38:13.396 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.81852.log.gz 2024-09-11T22:38:13.396 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60209.log: /var/log/ceph/ceph-client.admin.50037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47312.log 2024-09-11T22:38:13.396 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.85116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98702.log 2024-09-11T22:38:13.397 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92298.log 2024-09-11T22:38:13.397 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.98702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50661.log 2024-09-11T22:38:13.397 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.92298.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43679.log 2024-09-11T22:38:13.397 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.98702.log.gz 2024-09-11T22:38:13.397 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.92298.log.gz 2024-09-11T22:38:13.397 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86015.log 2024-09-11T22:38:13.397 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52032.log 2024-09-11T22:38:13.397 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43679.log: /var/log/ceph/ceph-client.admin.86015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50829.log 2024-09-11T22:38:13.397 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9%/var/log/ceph/ceph-client.admin.52032.log: -- replaced with /var/log/ceph/ceph-client.admin.86015.log.gz 2024-09-11T22:38:13.397 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51099.log 2024-09-11T22:38:13.397 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55412.log 2024-09-11T22:38:13.397 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42633.log 2024-09-11T22:38:13.397 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98534.log 2024-09-11T22:38:13.398 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52473.log 2024-09-11T22:38:13.398 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.98534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43319.log 2024-09-11T22:38:13.398 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98534.log.gz 2024-09-11T22:38:13.398 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55808.log 2024-09-11T22:38:13.398 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53738.log 2024-09-11T22:38:13.398 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44211.log 2024-09-11T22:38:13.398 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98744.log 2024-09-11T22:38:13.398 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42628.log 2024-09-11T22:38:13.398 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.98744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46119.log 2024-09-11T22:38:13.398 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42628.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98744.log.gz 2024-09-11T22:38:13.398 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54907.log 2024-09-11T22:38:13.398 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50703.log 2024-09-11T22:38:13.398 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97704.log 2024-09-11T22:38:13.398 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49872.log 2024-09-11T22:38:13.399 INFO:teuthology.orchestra.run.smithi100.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.54907.log.gz 2024-09-11T22:38:13.399 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.97704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51613.log 2024-09-11T22:38:13.399 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49872.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.97704.log.gz 2024-09-11T22:38:13.399 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99038.log 2024-09-11T22:38:13.399 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53155.log 2024-09-11T22:38:13.399 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.99038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54179.log 2024-09-11T22:38:13.399 INFO:teuthology.orchestra.run.smithi100.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.50745.log.gz 2024-09-11T22:38:13.399 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53155.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99038.log.gz 2024-09-11T22:38:13.399 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50475.log 2024-09-11T22:38:13.399 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62382.log 2024-09-11T22:38:13.399 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54179.log: /var/log/ceph/ceph-client.admin.50475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99206.log 2024-09-11T22:38:13.399 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40921.log 2024-09-11T22:38:13.399 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.99206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50139.log 2024-09-11T22:38:13.399 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99206.log.gz 2024-09-11T22:38:13.399 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42332.log 2024-09-11T22:38:13.400 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40921.log: /var/log/ceph/ceph-client.admin.50139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43689.log 2024-09-11T22:38:13.400 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40519.log 2024-09-11T22:38:13.400 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51571.log 2024-09-11T22:38:13.400 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43321.log 2024-09-11T22:38:13.400 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50787.log 2024-09-11T22:38:13.400 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51571.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42374.log.gz 2024-09-11T22:38:13.400 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41946.log 2024-09-11T22:38:13.400 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42458.log.gz 2024-09-11T22:38:13.400 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83413.log 2024-09-11T22:38:13.400 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50223.log 2024-09-11T22:38:13.400 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42630.log.gz 2024-09-11T22:38:13.400 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42639.log.gz 2024-09-11T22:38:13.400 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42637.log.gz 2024-09-11T22:38:13.401 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42638.log.gz 2024-09-11T22:38:13.401 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.83413.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42972.log.gz 2024-09-11T22:38:13.401 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42962.log.gz 2024-09-11T22:38:13.401 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42973.log.gz 2024-09-11T22:38:13.401 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42970.log 2024-09-11T22:38:13.401 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50223.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42974.log.gz 2024-09-11T22:38:13.401 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42975.log.gz 2024-09-11T22:38:13.401 INFO:teuthology.orchestra.run.smithi100.stderr:gzip 88.5% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.42976.log.gz -- 2024-09-11T22:38:13.401 INFO:teuthology.orchestra.run.smithi100.stderr: /var/log/ceph/ceph-client.admin.52116.log 2024-09-11T22:38:13.401 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43316.log.gz 2024-09-11T22:38:13.401 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54677.log 2024-09-11T22:38:13.401 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43313.log.gz 2024-09-11T22:38:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42970.log: /var/log/ceph/ceph-client.admin.52116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72926.log 2024-09-11T22:38:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99788.log 2024-09-11T22:38:13.402 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43683.log.gz 2024-09-11T22:38:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.72926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46787.log 2024-09-11T22:38:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.99788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52158.log 2024-09-11T22:38:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46787.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.99788.log.gz 2024-09-11T22:38:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-09-11T22:38:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52158.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43913.log.gz 2024-09-11T22:38:13.402 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43871.log.gz 2024-09-11T22:38:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98954.log 2024-09-11T22:38:13.402 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.e.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.44346.log.gz 2024-09-11T22:38:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52515.log 2024-09-11T22:38:13.403 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44280.log.gz 2024-09-11T22:38:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.98954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98576.log 2024-09-11T22:38:13.403 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98954.log.gz 2024-09-11T22:38:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40837.log 2024-09-11T22:38:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.98576.log: gzip -5 --verbose 87.9% -- /var/log/ceph/ceph-client.admin.51361.log 2024-09-11T22:38:13.403 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.74915.log.gz 2024-09-11T22:38:13.403 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.98576.log.gz 2024-09-11T22:38:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50517.log 2024-09-11T22:38:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55664.log 2024-09-11T22:38:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55706.log 2024-09-11T22:38:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98309.log 2024-09-11T22:38:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99414.log 2024-09-11T22:38:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.98309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97600.log 2024-09-11T22:38:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98309.log.gz 2024-09-11T22:38:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.99414.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54550.log 2024-09-11T22:38:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.97600.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99414.log.gz 2024-09-11T22:38:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40603.log 2024-09-11T22:38:13.404 INFO:teuthology.orchestra.run.smithi100.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.97600.log.gz 2024-09-11T22:38:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42966.log 2024-09-11T22:38:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42636.log 2024-09-11T22:38:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51057.log 2024-09-11T22:38:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93368.log 2024-09-11T22:38:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98009.log 2024-09-11T22:38:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.93368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65297.log 2024-09-11T22:38:13.404 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.93368.log.gz 2024-09-11T22:38:13.404 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.98009.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-11T22:38:13.405 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.98009.log.gz 2024-09-11T22:38:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.65297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62454.log 2024-09-11T22:38:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72629.log 2024-09-11T22:38:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44475.log 2024-09-11T22:38:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.72629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43317.log 2024-09-11T22:38:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44475.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-11T22:38:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40709.log 2024-09-11T22:38:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52927.log 2024-09-11T22:38:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50079.log 2024-09-11T22:38:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98442.log 2024-09-11T22:38:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55496.log 2024-09-11T22:38:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.98442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53324.log 2024-09-11T22:38:13.405 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98442.log.gz 2024-09-11T22:38:13.406 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42416.log 2024-09-11T22:38:13.406 INFO:teuthology.orchestra.run.smithi100.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.75287.log.gz 2024-09-11T22:38:13.406 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53324.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.76068.log.gz 2024-09-11T22:38:13.406 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51697.log 2024-09-11T22:38:13.406 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42416.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76721.log.gz 2024-09-11T22:38:13.406 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43955.log 2024-09-11T22:38:13.406 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.75403.log.gz 2024-09-11T22:38:13.406 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91779.log 2024-09-11T22:38:13.406 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42640.log 2024-09-11T22:38:13.406 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.91779.log: /var/log/ceph/ceph-client.admin.43955.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.53654.log.gz 2024-09-11T22:38:13.406 INFO:teuthology.orchestra.run.smithi100.stderr: 91.9% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.91779.log.gz 2024-09-11T22:38:13.406 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54095.log.gz 2024-09-11T22:38:13.406 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54053.log.gz -- replaced with /var/log/ceph/ceph-client.admin.53738.log.gz 2024-09-11T22:38:13.406 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-11T22:38:13.406 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41005.log 2024-09-11T22:38:13.407 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42640.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50577.log.gz 2024-09-11T22:38:13.407 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43692.log 2024-09-11T22:38:13.407 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91897.log 2024-09-11T22:38:13.407 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51739.log.gz 2024-09-11T22:38:13.407 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43692.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53780.log.gz 2024-09-11T22:38:13.407 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.91897.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54424.log.gz 2024-09-11T22:38:13.407 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54382.log.gz 2024-09-11T22:38:13.407 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.91897.log.gz 2024-09-11T22:38:13.407 INFO:teuthology.orchestra.run.smithi100.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.53071.log.gz 2024-09-11T22:38:13.407 INFO:teuthology.orchestra.run.smithi100.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.36184.log.gz 2024-09-11T22:38:13.407 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55202.log.gz 2024-09-11T22:38:13.407 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53281.log.gz 2024-09-11T22:38:13.407 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46226.log.gz 2024-09-11T22:38:13.407 INFO:teuthology.orchestra.run.smithi100.stderr: 89.8% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52262.log.gz 2024-09-11T22:38:13.408 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52431.log.gz 2024-09-11T22:38:13.408 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52347.log.gz 2024-09-11T22:38:13.408 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52389.log.gz 2024-09-11T22:38:13.408 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52304.log.gz 2024-09-11T22:38:13.408 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52641.log.gz 2024-09-11T22:38:13.408 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45762.log.gz 2024-09-11T22:38:13.408 INFO:teuthology.orchestra.run.smithi100.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.49953.log.gz 2024-09-11T22:38:13.408 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49995.log.gz 2024-09-11T22:38:13.408 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51319.log.gz 2024-09-11T22:38:13.408 INFO:teuthology.orchestra.run.smithi100.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.51403.log.gz 2024-09-11T22:38:13.408 INFO:teuthology.orchestra.run.smithi100.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.52720.log.gz 2024-09-11T22:38:13.408 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59088.log.gz 2024-09-11T22:38:13.408 INFO:teuthology.orchestra.run.smithi100.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.59996.log.gz 2024-09-11T22:38:13.409 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59817.log.gz 2024-09-11T22:38:13.409 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.60209.log.gz 2024-09-11T22:38:13.409 INFO:teuthology.orchestra.run.smithi100.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.45805.log.gz 2024-09-11T22:38:13.409 INFO:teuthology.orchestra.run.smithi100.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.45847.log.gz 2024-09-11T22:38:13.409 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41946.log.gz 2024-09-11T22:38:13.409 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45974.log.gz 2024-09-11T22:38:13.409 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45932.log.gz 2024-09-11T22:38:13.409 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42416.log.gz 2024-09-11T22:38:13.409 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42640.log.gz 2024-09-11T22:38:13.409 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42970.log.gz 2024-09-11T22:38:13.409 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43181.log.gz 2024-09-11T22:38:13.409 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43318.log.gz 2024-09-11T22:38:13.409 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43321.log.gz 2024-09-11T22:38:13.409 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43317.log.gz 2024-09-11T22:38:13.410 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43955.log.gz 2024-09-11T22:38:13.410 INFO:teuthology.orchestra.run.smithi100.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.46276.log.gz 2024-09-11T22:38:13.410 INFO:teuthology.orchestra.run.smithi100.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.46360.log.gz 2024-09-11T22:38:13.410 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.77776.log.gz 2024-09-11T22:38:13.410 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.82058.log.gz 2024-09-11T22:38:13.410 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.83413.log.gz 2024-09-11T22:38:13.410 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51361.log.gz 2024-09-11T22:38:13.410 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51445.log.gz 2024-09-11T22:38:13.410 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52969.log.gz 2024-09-11T22:38:13.410 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53489.log.gz 2024-09-11T22:38:13.411 INFO:teuthology.orchestra.run.smithi167.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-11T22:38:13.411 INFO:teuthology.orchestra.run.smithi167.stderr: 94.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T22:38:13.421 INFO:teuthology.orchestra.run.smithi100.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.53570.log.gz 2024-09-11T22:38:13.421 INFO:teuthology.orchestra.run.smithi100.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.53367.log.gz 2024-09-11T22:38:13.421 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53409.log.gz 2024-09-11T22:38:13.421 INFO:teuthology.orchestra.run.smithi100.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.53822.log.gz 2024-09-11T22:38:13.421 INFO:teuthology.orchestra.run.smithi100.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.54466.log.gz 2024-09-11T22:38:13.421 INFO:teuthology.orchestra.run.smithi100.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.77318.log.gz 2024-09-11T22:38:13.421 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51951.log.gz 2024-09-11T22:38:13.421 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55328.log.gz 2024-09-11T22:38:13.421 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55622.log.gz 2024-09-11T22:38:13.421 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.55766.log.gz 2024-09-11T22:38:13.421 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50181.log.gz 2024-09-11T22:38:13.421 INFO:teuthology.orchestra.run.smithi100.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.47270.log.gz 2024-09-11T22:38:13.422 INFO:teuthology.orchestra.run.smithi100.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.50931.log.gz 2024-09-11T22:38:13.422 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50973.log.gz 2024-09-11T22:38:13.422 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51015.log.gz 2024-09-11T22:38:13.422 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51487.log.gz 2024-09-11T22:38:13.422 INFO:teuthology.orchestra.run.smithi100.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.51613.log.gz 2024-09-11T22:38:13.422 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51571.log.gz 2024-09-11T22:38:13.422 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51655.log.gz 2024-09-11T22:38:13.422 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.52074.log.gz 2024-09-11T22:38:13.422 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52158.log.gz 2024-09-11T22:38:13.422 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52200.log.gz 2024-09-11T22:38:13.422 INFO:teuthology.orchestra.run.smithi100.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.53696.log.gz 2024-09-11T22:38:13.422 INFO:teuthology.orchestra.run.smithi100.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.54635.log.gz 2024-09-11T22:38:13.422 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54677.log.gz 2024-09-11T22:38:13.422 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54719.log.gz 2024-09-11T22:38:13.423 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54761.log.gz 2024-09-11T22:38:13.423 INFO:teuthology.orchestra.run.smithi100.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.55059.log.gz 2024-09-11T22:38:13.423 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46615.log.gz 2024-09-11T22:38:13.423 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46034.log.gz 2024-09-11T22:38:13.423 INFO:teuthology.orchestra.run.smithi100.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.50787.log.gz 2024-09-11T22:38:13.423 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51141.log.gz 2024-09-11T22:38:13.423 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54137.log.gz 2024-09-11T22:38:13.423 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54593.log.gz 2024-09-11T22:38:13.423 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.72990.log.gz 2024-09-11T22:38:13.423 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42072.log.gz 2024-09-11T22:38:13.423 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42206.log.gz 2024-09-11T22:38:13.423 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42248.log.gz 2024-09-11T22:38:13.423 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43319.log.gz 2024-09-11T22:38:13.423 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43680.log.gz 2024-09-11T22:38:13.424 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43679.log.gz 2024-09-11T22:38:13.424 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43681.log.gz 2024-09-11T22:38:13.424 INFO:teuthology.orchestra.run.smithi100.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46318.log.gz 2024-09-11T22:38:13.424 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52599.log.gz 2024-09-11T22:38:13.424 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54179.log.gz 2024-09-11T22:38:13.424 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54258.log.gz 2024-09-11T22:38:13.424 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.73062.log.gz 2024-09-11T22:38:13.424 INFO:teuthology.orchestra.run.smithi100.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.81364.log.gz 2024-09-11T22:38:13.424 INFO:teuthology.orchestra.run.smithi100.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.81988.log.gz 2024-09-11T22:38:13.424 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46405.log.gz 2024-09-11T22:38:13.424 INFO:teuthology.orchestra.run.smithi100.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.46489.log.gz 2024-09-11T22:38:13.424 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46447.log.gz 2024-09-11T22:38:13.424 INFO:teuthology.orchestra.run.smithi100.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46531.log.gz 2024-09-11T22:38:13.425 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50037.log.gz 2024-09-11T22:38:13.425 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58383.log.gz 2024-09-11T22:38:13.425 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.72835.log.gz 2024-09-11T22:38:13.425 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51277.log.gz 2024-09-11T22:38:13.425 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62454.log.gz 2024-09-11T22:38:13.425 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50139.log.gz 2024-09-11T22:38:13.425 INFO:teuthology.orchestra.run.smithi100.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.62382.log.gz 2024-09-11T22:38:13.425 INFO:teuthology.orchestra.run.smithi100.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.52801.log.gz 2024-09-11T22:38:13.425 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53239.log.gz 2024-09-11T22:38:13.425 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50223.log.gz 2024-09-11T22:38:13.425 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% 88.9% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40793.log.gz -- replaced with /var/log/ceph/ceph-client.admin.40879.log.gz -- replaced with /var/log/ceph/ceph-client.admin.40837.log.gz 2024-09-11T22:38:13.425 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-11T22:38:13.425 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-11T22:38:13.426 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40963.log.gz 2024-09-11T22:38:13.426 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45329.log.gz 2024-09-11T22:38:13.426 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45371.log.gz 2024-09-11T22:38:13.426 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45203.log.gz 2024-09-11T22:38:13.426 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45539.log.gz 2024-09-11T22:38:13.426 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45287.log.gz 2024-09-11T22:38:13.426 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45581.log.gz 2024-09-11T22:38:13.426 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45161.log.gz -- replaced with /var/log/ceph/ceph-client.admin.45245.log.gz 2024-09-11T22:38:13.426 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-11T22:38:13.426 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45413.log.gz 2024-09-11T22:38:13.426 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45455.log.gz 2024-09-11T22:38:13.426 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45497.log.gz 2024-09-11T22:38:13.426 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45623.log.gz 2024-09-11T22:38:13.426 INFO:teuthology.orchestra.run.smithi100.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.46076.log.gz 2024-09-11T22:38:13.427 INFO:teuthology.orchestra.run.smithi100.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.53906.log.gz 2024-09-11T22:38:13.427 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54550.log.gz 2024-09-11T22:38:13.427 INFO:teuthology.orchestra.run.smithi100.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50433.log.gz 2024-09-11T22:38:13.427 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53029.log.gz 2024-09-11T22:38:13.427 INFO:teuthology.orchestra.run.smithi100.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.55286.log.gz 2024-09-11T22:38:13.427 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55412.log.gz 2024-09-11T22:38:13.427 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55664.log.gz 2024-09-11T22:38:13.427 INFO:teuthology.orchestra.run.smithi100.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.55706.log.gz 2024-09-11T22:38:13.427 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55808.log.gz 2024-09-11T22:38:13.427 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47312.log.gz -- replaced with /var/log/ceph/ceph-client.admin.50889.log.gz 2024-09-11T22:38:13.427 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-11T22:38:13.427 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52032.log.gz 2024-09-11T22:38:13.427 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36448.log.gz 2024-09-11T22:38:13.427 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52116.log.gz 2024-09-11T22:38:13.428 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40921.log.gz 2024-09-11T22:38:13.428 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36538.log.gz 2024-09-11T22:38:13.428 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42332.log.gz 2024-09-11T22:38:13.428 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42633.log.gz 2024-09-11T22:38:13.428 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42628.log.gz 2024-09-11T22:38:13.428 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42636.log.gz 2024-09-11T22:38:13.428 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42966.log.gz 2024-09-11T22:38:13.428 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52473.log.gz 2024-09-11T22:38:13.428 INFO:teuthology.orchestra.run.smithi100.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.53155.log.gz 2024-09-11T22:38:13.428 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43692.log.gz 2024-09-11T22:38:13.428 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43689.log.gz 2024-09-11T22:38:13.428 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40200.log.gz 2024-09-11T22:38:13.428 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41005.log.gz 2024-09-11T22:38:13.428 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44475.log.gz 2024-09-11T22:38:13.430 INFO:teuthology.orchestra.run.smithi100.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.47210.log.gz 2024-09-11T22:38:13.430 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50829.log.gz 2024-09-11T22:38:13.430 INFO:teuthology.orchestra.run.smithi100.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.51057.log.gz 2024-09-11T22:38:13.430 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.83481.log.gz 2024-09-11T22:38:13.430 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51099.log.gz 2024-09-11T22:38:13.430 INFO:teuthology.orchestra.run.smithi100.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.85116.log.gz 2024-09-11T22:38:13.430 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40302.log.gz 2024-09-11T22:38:13.430 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49872.log.gz 2024-09-11T22:38:13.430 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50079.log.gz 2024-09-11T22:38:13.430 INFO:teuthology.orchestra.run.smithi100.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.65297.log.gz 2024-09-11T22:38:13.431 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.66145.log.gz 2024-09-11T22:38:13.431 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40519.log.gz 2024-09-11T22:38:13.431 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72629.log.gz 2024-09-11T22:38:13.433 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40417.log.gz 2024-09-11T22:38:13.434 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46787.log.gz 2024-09-11T22:38:13.435 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.52927.log.gz 2024-09-11T22:38:13.443 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44123.log.gz 2024-09-11T22:38:13.444 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44081.log.gz 2024-09-11T22:38:13.444 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44169.log.gz 2024-09-11T22:38:13.444 INFO:teuthology.orchestra.run.smithi100.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.44211.log.gz 2024-09-11T22:38:13.445 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41047.log.gz 2024-09-11T22:38:13.447 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50475.log.gz 2024-09-11T22:38:13.447 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41089.log.gz 2024-09-11T22:38:13.447 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50517.log.gz 2024-09-11T22:38:13.447 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51697.log.gz 2024-09-11T22:38:13.448 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53324.log.gz 2024-09-11T22:38:13.448 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53991.log.gz 2024-09-11T22:38:13.448 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51847.log.gz 2024-09-11T22:38:13.448 INFO:teuthology.orchestra.run.smithi100.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.55496.log.gz 2024-09-11T22:38:13.449 INFO:teuthology.orchestra.run.smithi100.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.51529.log.gz 2024-09-11T22:38:13.449 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52515.log.gz 2024-09-11T22:38:13.466 INFO:teuthology.orchestra.run.smithi100.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.41627.log.gz 2024-09-11T22:38:13.467 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62225.log.gz 2024-09-11T22:38:13.468 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.66045.log.gz 2024-09-11T22:38:13.468 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.72926.log.gz 2024-09-11T22:38:13.472 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40603.log.gz -- replaced with /var/log/ceph/ceph-client.admin.40561.log.gz 2024-09-11T22:38:13.473 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-11T22:38:13.473 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40647.log.gz 2024-09-11T22:38:13.473 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40751.log.gz 2024-09-11T22:38:13.473 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40709.log.gz 2024-09-11T22:38:13.476 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% 89.8% -- replaced with /var/log/ceph/ceph-client.admin.50661.log.gz -- replaced with /var/log/ceph/ceph-client.admin.50703.log.gz 2024-09-11T22:38:13.476 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-11T22:38:13.479 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41197.log.gz 2024-09-11T22:38:13.513 INFO:teuthology.orchestra.run.smithi100.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-11T22:38:13.737 INFO:teuthology.orchestra.run.smithi100.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-11T22:38:13.803 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46119.log.gz -- replaced with /var/log/ceph/ceph-client.admin.46161.log.gz 2024-09-11T22:38:13.803 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-11T22:38:13.869 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T22:38:14.157 INFO:teuthology.orchestra.run.smithi100.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-09-11T22:38:14.624 INFO:teuthology.orchestra.run.smithi167.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-11T22:38:14.744 INFO:teuthology.orchestra.run.smithi167.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-11T22:38:14.761 INFO:teuthology.orchestra.run.smithi167.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36230.log.gz 2024-09-11T22:38:14.768 INFO:teuthology.orchestra.run.smithi167.stderr: 92.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T22:38:16.277 INFO:teuthology.orchestra.run.smithi167.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-11T22:38:17.400 INFO:teuthology.orchestra.run.smithi100.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-11T22:38:19.414 INFO:teuthology.orchestra.run.smithi167.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-11T22:38:20.648 INFO:teuthology.orchestra.run.smithi100.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-11T22:38:38.671 INFO:teuthology.orchestra.run.smithi100.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-11T22:39:00.991 INFO:teuthology.orchestra.run.smithi167.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-09-11T22:46:22.139 INFO:teuthology.orchestra.run.smithi167.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-11T22:46:47.060 INFO:teuthology.orchestra.run.smithi167.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-11T22:48:17.192 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-11T22:49:23.951 INFO:teuthology.orchestra.run.smithi167.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-11T22:49:59.651 INFO:teuthology.orchestra.run.smithi167.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-11T22:49:59.653 INFO:teuthology.orchestra.run.smithi167.stderr: 2024-09-11T22:49:59.653 INFO:teuthology.orchestra.run.smithi167.stderr:real 11m46.434s 2024-09-11T22:49:59.653 INFO:teuthology.orchestra.run.smithi167.stderr:user 6m6.617s 2024-09-11T22:49:59.653 INFO:teuthology.orchestra.run.smithi167.stderr:sys 0m15.275s 2024-09-11T22:51:14.450 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-11T22:55:44.541 INFO:teuthology.orchestra.run.smithi100.stderr: 90.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-11T22:56:28.450 INFO:teuthology.orchestra.run.smithi100.stderr: 96.4% -- replaced with /var/log/ceph/ceph-client.0.44867.log.gz 2024-09-11T22:56:28.451 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-11T22:56:28.452 INFO:teuthology.orchestra.run.smithi100.stderr:real 18m15.265s 2024-09-11T22:56:28.452 INFO:teuthology.orchestra.run.smithi100.stderr:user 7m18.970s 2024-09-11T22:56:28.452 INFO:teuthology.orchestra.run.smithi100.stderr:sys 0m21.972s 2024-09-11T22:56:28.452 INFO:tasks.ceph:Archiving logs... 2024-09-11T22:56:28.453 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901420/remote/smithi100/log 2024-09-11T22:56:28.454 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T22:57:57.840 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901420/remote/smithi167/log 2024-09-11T22:57:58.093 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T22:59:01.597 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T22:59:01.608 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T22:59:01.609 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T22:59:01.612 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T22:59:01.743 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T22:59:01.753 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T22:59:01.753 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T22:59:01.756 DEBUG:teuthology.orchestra.run.smithi167:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T22:59:01.770 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2024-09-11T22:59:01.771 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-09-11T22:59:01.788 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T22:59:01.788 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2024-09-11T22:59:01.788 INFO:teuthology.orchestra.run.smithi167.stdout:^* hv01.front.sepia.ceph.com 3 6 377 15 +1147us[+1189us] +/- 40ms 2024-09-11T22:59:01.788 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 15 -1151us[-1151us] +/- 79ms 2024-09-11T22:59:01.788 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 79 -1143us[-1105us] +/- 83ms 2024-09-11T22:59:01.789 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:59:01.827 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T22:59:01.827 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-09-11T22:59:01.828 INFO:teuthology.orchestra.run.smithi100.stdout:^* hv01.front.sepia.ceph.com 3 6 377 16 +1107us[+1116us] +/- 40ms 2024-09-11T22:59:01.828 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 16 -1168us[-1160us] +/- 79ms 2024-09-11T22:59:01.828 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 -1146us[-1137us] +/- 84ms 2024-09-11T22:59:01.828 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T22:59:01.829 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T22:59:01.838 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T22:59:01.838 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T22:59:01.846 DEBUG:teuthology.orchestra.run.smithi100:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T22:59:01.997 DEBUG:teuthology.orchestra.run.smithi167:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T22:59:02.081 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T22:59:02.112 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:59:02.113 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-11T22:59:02.141 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:59:02.141 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T22:59:02.150 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T22:59:02.159 INFO:teuthology.task.internal:Duration was 2705.648641 seconds 2024-09-11T22:59:02.160 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T22:59:02.168 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T22:59:02.168 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T22:59:02.170 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T22:59:02.238 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T22:59:02.244 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T22:59:02.675 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T22:59:02.675 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2024-09-11T22:59:02.675 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T22:59:02.698 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi167.front.sepia.ceph.com 2024-09-11T22:59:02.698 DEBUG:teuthology.orchestra.run.smithi167:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T22:59:02.723 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T22:59:02.724 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T22:59:02.741 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T22:59:02.790 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T22:59:02.790 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T22:59:02.809 DEBUG:teuthology.orchestra.run.smithi167:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T22:59:02.946 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T22:59:02.956 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T22:59:02.957 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T22:59:02.996 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T22:59:03.035 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T22:59:03.045 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T22:59:03.048 DEBUG:teuthology.orchestra.run.smithi167:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T22:59:03.085 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2024-09-11T22:59:03.110 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = core 2024-09-11T22:59:03.134 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T22:59:03.154 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:59:03.154 DEBUG:teuthology.orchestra.run.smithi167:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T22:59:03.189 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T22:59:03.189 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T22:59:03.199 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T22:59:03.201 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901420/remote/smithi100 2024-09-11T22:59:03.201 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T22:59:03.237 DEBUG:teuthology.misc:Transferring archived files from smithi167:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901420/remote/smithi167 2024-09-11T22:59:03.237 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T22:59:03.270 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T22:59:03.270 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T22:59:03.273 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T22:59:03.321 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T22:59:03.333 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T22:59:03.333 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T22:59:03.342 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T22:59:03.343 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T22:59:03.345 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T22:59:03.357 INFO:teuthology.orchestra.run.smithi100.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 22:59 /home/ubuntu/cephtest 2024-09-11T22:59:03.376 INFO:teuthology.orchestra.run.smithi167.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 22:59 /home/ubuntu/cephtest 2024-09-11T22:59:03.377 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T22:59:03.387 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T22:59:03.411 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} duration: 2705.6486411094666 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-11T22:59:03.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T22:59:03.498 INFO:teuthology.run:pass